VibEmoji: Exploring User-authoring Multi-modal Emoticons in Social Communication

An，Pengcheng1,2; Zhou，Ziqi2; Liu，Qing2; Yin，Yifei3; Du，Linghao4,5; Huang，Da Yuan4,5; Zhao，Jian2

10.1145/3491102.3501940

2022-04-29

CHI Conference on Human Factors in Computing Systems (CHI)

Conference on Human Factors in Computing Systems - Proceedings

APR 30-MAY 05, 2022

null,New Orleans,LA

1601 Broadway, 10th Floor, NEW YORK, NY, UNITED STATES

ASSOC COMPUTING MACHINERY

Emoticons are indispensable in online communications. With users' growing needs for more customized and expressive emoticons, recent messaging applications begin to support (limited) multi-modal emoticons:, enhancing emoticons with animations or vibrotactile feedback. However, little empirical knowledge has been accumulated concerning how people create, share and experience multi-modal emoticons in everyday communication, and how to better support them through design. To tackle this, we developed VibEmoji, a user-authoring multi-modal emoticon interface for mobile messaging. Extending existing designs, VibEmoji grants users greater flexibility to combine various emoticons, vibrations, and animations on-the-fly, and offers non-aggressive recommendations based on these components' emotional relevance. Using VibEmoji as a probe, we conducted a four-week field study with 20 participants, to gain new understandings from in-the-wild usage and experience, and extract implications for design. We thereby contribute to both a novel system and various insights for supporting users' creation and communication of multi-modal emoticons.

animation emoticons emotional expression haptic feedback mobile interfaces multi-modal interaction Social communication

First

English

EI ; CPCI-S

Computer Science ; Robotics

Computer Science, Information Systems ; Computer Science, Theory & Methods ; Robotics

WOS:000890212502009

20222112159216

Computer Peripheral Equipment:722.2

2-s2.0-85130546594

Scopus

1.School of Design,SUSTech,Shenzhen,China
2.University of Waterloo,Waterloo,Canada
3.University of Toronto Scarborough,Scarborough,Canada
4.Human-Machine Interaction Lab,Huawei,Canada
5.Markham,Ontario,Canada

An，Pengcheng,Zhou，Ziqi,Liu，Qing,et al. VibEmoji: Exploring User-authoring Multi-modal Emoticons in Social Communication[C]. 1601 Broadway, 10th Floor, NEW YORK, NY, UNITED STATES:ASSOC COMPUTING MACHINERY,2022.