Workshop description
Social Skills Training is often used in the multimodal Interaction research community as an umbrella term for systems that aim at training social skills: managing appropriately verbal and nonverbal behaviors when interacting with one or more persons, in relation with various communicative functions such as turn taking and emotions.
People with social affective deficits have difficulties controlling their own social behavior and also suffer from interpreting others' social behavior. Behavioral therapy (e.g. with a clinician) and Social Skills Training (SST) are used in medical settings. Patients are trained with a coach to experience social interaction and to reduce social stress. SST includes a role-play of a simulation of actual situations [1,2,3]. In addition to behavioral training, cognitive behavioral therapy [4] and motivational interviewing are also useful to better understand and train social-affective interaction. All these methods are effective but expensive and difficult to access.
This workshop is looking for works describing how interactive, multimodal technology such as virtual agents can be used in social skills training for measuring and training social-affective interactions [5]. Sensing technology now enables analyzing user's behaviors and physiological signals (heart-rate, EEG, etc.). Various signal processing and machine learning methods can be used for such prediction tasks. Beyond sensing, it is also important to analyze human behaviors and model and implement training methods (e.g. by virtual agents, social robots, relevant scenarios, design appropriate and personalized feedback about social skills performance). Such social signal processing and tools can be applied to measure and reduce social stress in everyday situations, including public speaking at schools and workplaces. Target populations include depression, Social Anxiety Disorder (SAD), Schizophrenia, Autism Spectrum Disorder (ASD), but also a much larger group of different social pathological phenomena.
In this workshop, we invite participants from academia, industry or clinical settings to present and discuss social-affective design of multimodal training for health.
References
- [1] Hiroki Tanaka et al., Embodied conversational agents for multimodal automated social skills training in people with autism spectrum disorders. Plos one, 12(8) (2017).
- [2] Hoque Mohammed et al., MACH: My automated conversation coach. UbiComp 2013, Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing (2013).
- [3] Bruijnes, M et al., Special issue editorial: Virtual Agents for Social Skills Training. Journal on Multimodal User Interfaces 13: 1 (2019).
- [4] Fitzpatrick K et al., Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial, JMIR Mental Health (2017).
- [5] Daniels, J. et al., Exploratory study examining the at-home feasibility of a wearable tool for social-affective learning in children with autism. Nature Digital Med 1, 32 (2018).
- [6] Hiroki Tanaka et al., Social Affective Multimodal Interaction for Health. In Proceedings of the 2020 International Conference on Multimodal Interaction, pp.893-894 (2020).
- [7] Hiroki Tanaka et al., 2nd Workshop on Social Affective Multimodal Interaction for Health (SAMIH). In Proceedings of the 2021 International Conference on Multimodal Interaction, pp.853-854 (2021).
Important dates
- Workshop papers due: 26 July, 2022.
- Notification of acceptance:
10 August, 2022.12 August, 2022. - Camera-ready paper:
19 August, 2022.23 August, 2022. - Workshop date: 7 November, 2022
Program
Presentation guideline:
Schedule:
9:00am-12:30pm (IST), November 7
(5:30am-9:00am Paris; 12:30pm-16:00pm Tokyo)
9:00-9:10 Opening remark and presentation of the TAPAS project by workshop organizers
Hiroki Tanaka
9:10-9:55 Keynote: Eye Gaze Controlled Human Robot Interfaces for Users with Severe Speech and Motor Impairment
Pradipta Biswas
Chair: Jean-Claude Martin
9:55-10:10 Coffee break
10:10-10:30 Paper 1: An Architecture Supporting Configurable Autonomous Multimodal Joint-Attention-Therapy for Various Robotic Systems
André Groß, Christian Schütze, Britta Wrede and Birte Richter
Chair: Hiroki Tanaka
10:30-10:50 Paper 2: Exploring Facial Metric Normalization For Within- and Between-Subject Comparisons in a Multimodal Health Monitoring Agent
Oliver Roesler, Hardik Kothare, William Burke, Michael Neumann, Jackson Liscombe, Andrew Cornish, Doug Habberstad,
David Pautler, David Suendermann-Oeft and Vikram Ramanarayanan
Chair: Hiroki Tanaka
10:50-11:10 Paper 3: Enabling Non-Technical Domain Experts to Create Robot-Assisted Therapeutic Scenarios via Visual Programming
Christian Schütze, André Groß, Britta Wrede and Birte Richter
Chair: Hiroki Tanaka
11:10-11:30 Coffee break
11:30-11:50 Paper 4: Towards Multimodal Dialog-Based Speech & Facial Biomarkers of Schizophrenia
Vanessa Richter, Michael Neumann, Hardik Kothare, Oliver Roesler, Jackson Liscombe, David Suendermann-Oeft, Sebastian Prokop,
Anzalee Khan, Christian Yavorsky, Jean-Pierre Lindenmayer and Vikram Ramanarayanan
Chair: Hiroki Tanaka
11:50-12:10 Paper 5: A Wavelet-based Approach for Multimodal Prediction of Alexithymia from Physiological Signals
Valeria Filippou, Nikolas Theodosiou, Mihalis Nicolaou, Elena Constantinou, Georgia Panayiotou and Marios Theodorou
Chair: Hiroki Tanaka
12:10-12:30 Discussion and closing
Chair: Jean-Claude Martin and Hiroki Tanaka
Call for papers
The following keywords describe the topics of this workshop (but are not limited to these) .
Theoretical backgrounds:
- Cognitive behavioral therapy
- Motivational interview
- Social skills training
Approaches:
- Social signal processing
- Affective computing
- Physiological signal processing
- Virtual agents
- Social robotics
We will invite external reviewers in addition to the internal reviewers. The review process is a single-blind review (submitted articles do not need to be anonymous).
Paper format:
- Short Papers = 7 pages + extra pages for references Please use the default "sigconf" style.
Template:
Please refer to the instructions on the link.
- (Word template) Write your paper using the Submission Template. Follow the embedded instructions to apply the paragraph styles to your various text elements. The text is in the single-column format at this stage and no additional formatting is required at this point.
- (Latex template) Please use the latest version of the Primary Article Template - LaTeX (1.83; published February 22, 2022) to create your paper submission. Use the “manuscript” call to create the single-column format.
Submission:
Easychair to handle the papers here.
Publication:
Proceedings will be published as adjunct proceedings to the ACM International Conference on Multimodal Interaction 2022.
Hybrid Workshop:
The workshop will have both physical and virtual attendance possibilities.
Participation:
Please register on the ICMI website.
Keynote speaker
Pradipta Biswas
Associate Professor of Indian Institute of Sciences, India
Title: Eye Gaze Controlled Human Robot Interfaces for Users with Severe Speech and Motor Impairment
Abstract: Persons with severe speech and motor impairment (SSMI) belong to an isolated part of the disability spectrum. The complexity of their physical conditions renders them unable to have natural interactions with their environments even for activities of daily living (ADL). Advances in robotics and technology have provided opportunities to design systems to enable and support persons with disabilities in everyday activities, communication, education, and fun. This research work proposes an inclusive and safe eye-gaze-controlled human-robot interaction (HRI) system for persons with SSMI. Our work reports an improvement in eye gaze-controlled interaction through use of playful cyber physical systems. The talk will also present details of an upcoming hackathon sponsored by India-EU ICT Collaboration, that aims to help in education and rehabilitation process of users with SSMI through teaching them use of cyber physical systems and associated eye gaze controlled human robot interfaces.
Details of speaker's research: Hackathon for SSMI (cambum.net)
Details on Hackathon: AssistiveUI I3D Lab (cambum.net)
Speaker's Bio: Pradipta Biswas (cambum.net)
Organizers
Contact: hiroki-tan[at]is.naist.jp
Satoshi Nakamura
Nara Institute of Science and Technology, Japan
Catherine Pelachaud
CNRS-ISIR, Sorbonne University, FranceProgram commitee
- Hiroki Tanaka (Nara Institute of Science and Technology)
- Satoshi Nakamura (Nara Institute of Science and Technology)
- Kazuhiro Shidara (Nara Institute of Science and Technology)
- Jean-Claude Martin (CNRS-LISN, Université Paris-Saclay)
- Catherine Pelachaud, (CNRS-ISIR, Sorbonne University)
- Shiro Kumano (NTT)
- Yuichiro Fujimoto (Nara Institute of Science and Technology)
- Kana Miyamoto (Nara Institure of Science and Technology)
- Jennifer Hamet Bagnou (CNRS-LISN, Université Paris Saclay)
- Liu Yang (CNRS-ISIR, Sorbonne University)
Projects
- ANR-CREST-TAPAS Japan - France project




