Workshop description

Social Skills Training is often used in the multimodal Interaction research community as an umbrella term for systems that aim at training social skills: managing appropriately verbal and nonverbal behaviors when interacting with one or more persons, in relation with various communicative functions such as turn taking and emotions.

People with social affective deficits have difficulties controlling their own social behavior and also suffer from interpreting others' social behavior. Behavioral therapy (e.g. with a clinician) and Social Skills Training (SST) are used in medical settings. Patients are trained with a coach to experience social interaction and to reduce social stress. SST includes a role-play of a simulation of actual situations [1,2,3]. In addition to behavioral training, cognitive behavioral therapy [4] and motivational interviewing are also useful to better understand and train social-affective interaction. All these methods are effective but expensive and difficult to access.

This workshop is looking for works describing how interactive, multimodal technology such as virtual agents can be used in social skills training for measuring and training social-affective interactions [5]. Sensing technology now enables analyzing user's behaviors and physiological signals (heart-rate, EEG, etc.). Various signal processing and machine learning methods can be used for such prediction tasks. Beyond sensing, it is also important to analyze human behaviors and model and implement training methods (e.g. by virtual agents, social robots, relevant scenarios, design appropriate and personalized feedback about social skills performance). Such social signal processing and tools can be applied to measure and reduce social stress in everyday situations, including public speaking at schools and workplaces. Target populations include depression, Social Anxiety Disorder (SAD), Schizophrenia, Autism Spectrum Disorder (ASD), but also a much larger group of different social pathological phenomena.

In this workshop, we invite participants from academia, industry or clinical settings to present and discuss social-affective design of multimodal training for health.

Important dates

  • Workshop papers due: 26 July, 2022.
  • Notification of acceptance: 10 August, 2022. 12 August, 2022.
  • Camera-ready paper: 19 August, 2022. 23 August, 2022.
  • Workshop date: 7 November, 2022

Program

Presentation guideline:

  • 40 min. presentation + 5 min. Q&A for a keynote
  • 15 min. presentation + 5 min. Q&A for a paper presentation
  • All presentations are oral. For a hybrid format, all presenters, even if onsite participation, should share a screen via Zoom during a presentation.
  • The Zoom link for presenters and audience will be provided by ICMI.
  • Schedule:

     9:00am-12:30pm (IST), November 7

      (5:30am-9:00am Paris; 12:30pm-16:00pm Tokyo)

    9:00-9:10 Opening remark and presentation of the TAPAS project by workshop organizers
        Hiroki Tanaka

    9:10-9:55 Keynote: Eye Gaze Controlled Human Robot Interfaces for Users with Severe Speech and Motor Impairment
        Pradipta Biswas
        Chair: Jean-Claude Martin

    9:55-10:10 Coffee break

    10:10-10:30 Paper 1: An Architecture Supporting Configurable Autonomous Multimodal Joint-Attention-Therapy for Various Robotic Systems
        André Groß, Christian Schütze, Britta Wrede and Birte Richter
        Chair: Hiroki Tanaka

    10:30-10:50 Paper 2: Exploring Facial Metric Normalization For Within- and Between-Subject Comparisons in a Multimodal Health Monitoring Agent
        Oliver Roesler, Hardik Kothare, William Burke, Michael Neumann, Jackson Liscombe, Andrew Cornish, Doug Habberstad,
         David Pautler, David Suendermann-Oeft and Vikram Ramanarayanan
        Chair: Hiroki Tanaka

    10:50-11:10 Paper 3: Enabling Non-Technical Domain Experts to Create Robot-Assisted Therapeutic Scenarios via Visual Programming
        Christian Schütze, André Groß, Britta Wrede and Birte Richter
        Chair: Hiroki Tanaka

    11:10-11:30 Coffee break

    11:30-11:50 Paper 4: Towards Multimodal Dialog-Based Speech & Facial Biomarkers of Schizophrenia
        Vanessa Richter, Michael Neumann, Hardik Kothare, Oliver Roesler, Jackson Liscombe, David Suendermann-Oeft, Sebastian Prokop,
         Anzalee Khan, Christian Yavorsky, Jean-Pierre Lindenmayer and Vikram Ramanarayanan
        Chair: Hiroki Tanaka

    11:50-12:10 Paper 5: A Wavelet-based Approach for Multimodal Prediction of Alexithymia from Physiological Signals
        Valeria Filippou, Nikolas Theodosiou, Mihalis Nicolaou, Elena Constantinou, Georgia Panayiotou and Marios Theodorou
        Chair: Hiroki Tanaka

    12:10-12:30 Discussion and closing
        Chair: Jean-Claude Martin and Hiroki Tanaka

    Call for papers

    The following keywords describe the topics of this workshop (but are not limited to these) .

      Theoretical backgrounds:

    • Cognitive behavioral therapy
    • Motivational interview
    • Social skills training

      Approaches:

    • Social signal processing
    • Affective computing
    • Physiological signal processing
    • Virtual agents
    • Social robotics

    We will invite external reviewers in addition to the internal reviewers. The review process is a single-blind review (submitted articles do not need to be anonymous).

    Paper format:

    • Short Papers = 7 pages + extra pages for references
    • Please use the default "sigconf" style.

    Template:

      Please refer to the instructions on the link.

    • (Word template) Write your paper using the Submission Template. Follow the embedded instructions to apply the paragraph styles to your various text elements. The text is in the single-column format at this stage and no additional formatting is required at this point.
    • (Latex template) Please use the latest version of the Primary Article Template - LaTeX (1.83; published February 22, 2022) to create your paper submission. Use the “manuscript” call to create the single-column format.

    Submission:

      Easychair to handle the papers here.

    Publication:

      Proceedings will be published as adjunct proceedings to the ACM International Conference on Multimodal Interaction 2022.

    Hybrid Workshop:

      The workshop will have both physical and virtual attendance possibilities.

    Participation:

      Please register on the ICMI website.

    Keynote speaker

    Pradipta Biswas

    Associate Professor of Indian Institute of Sciences, India

    Title: Eye Gaze Controlled Human Robot Interfaces for Users with Severe Speech and Motor Impairment

    Abstract: Persons with severe speech and motor impairment (SSMI) belong to an isolated part of the disability spectrum. The complexity of their physical conditions renders them unable to have natural interactions with their environments even for activities of daily living (ADL). Advances in robotics and technology have provided opportunities to design systems to enable and support persons with disabilities in everyday activities, communication, education, and fun. This research work proposes an inclusive and safe eye-gaze-controlled human-robot interaction (HRI) system for persons with SSMI. Our work reports an improvement in eye gaze-controlled interaction through use of playful cyber physical systems. The talk will also present details of an upcoming hackathon sponsored by India-EU ICT Collaboration, that aims to help in education and rehabilitation process of users with SSMI through teaching them use of cyber physical systems and associated eye gaze controlled human robot interfaces.

    Details of speaker's research: Hackathon for SSMI (cambum.net)
    Details on Hackathon: AssistiveUI I3D Lab (cambum.net)
    Speaker's Bio: Pradipta Biswas (cambum.net)

    Organizers

    Contact: hiroki-tan[at]is.naist.jp

    Hiroki Tanaka

    Nara Institute of Science and Technology, Japan

    Satoshi Nakamura

    Nara Institute of Science and Technology, Japan

    Kazuhiro Shidara

    Nara Institute of Science and Technology, Japan

    Jean-Claude Martin

    CNRS-LISN, Université Paris Saclay, France

    Catherine Pelachaud

    CNRS-ISIR, Sorbonne University, France

    Program commitee

    • Hiroki Tanaka (Nara Institute of Science and Technology)
    • Satoshi Nakamura (Nara Institute of Science and Technology)
    • Kazuhiro Shidara (Nara Institute of Science and Technology)
    • Jean-Claude Martin (CNRS-LISN, Université Paris-Saclay)
    • Catherine Pelachaud, (CNRS-ISIR, Sorbonne University)
    • Shiro Kumano (NTT)
    • Yuichiro Fujimoto (Nara Institute of Science and Technology)
    • Kana Miyamoto (Nara Institure of Science and Technology)
    • Jennifer Hamet Bagnou (CNRS-LISN, Université Paris Saclay)
    • Liu Yang (CNRS-ISIR, Sorbonne University)

    Projects

    • ANR-CREST-TAPAS Japan - France project