Voice User Interface (VUI): A Review of Present and Potential Voice Assistant (VA) applications

Main Article Content

Krittiya Tangmanee
Sakol Teeravarunyou
Nattanit Buaban

Abstract

Voice user interface (VUI) could come to replace the graphic user interface (i.e., mobile phone screen and computer). The reason is that users interact with VUI naturally more than touch screen interface. Nevertheless, the VUI with voice assistants still has problems in both acceptance and usability. The factors like privacy issue, voice assistants’ personality, the differentiation of age, language impacts the usability. For this review, 30 papers from the database of conference and research are investigated. Many researchers recommended the multimodality of VUI both input and output make an interface ease of use. For user experience, the speech technique and reformulating query and modeling users is the technique that makes machines understand the context of use better.

Article Details

Section
Review Articles

References

IBM Shoebox (2020). IBM Archives, Access on Oct 14, 2020. https://www.ibm.com/ibm/history/exhibits/specialprod1/specialprod1_7.html

Bell System Technical Journal (1940), p. 509.

Choi S, Kim Y, Han E, Son J, Cho J. (2018) Designing conversational voice user interface for

improving intimacy of shared invehicle. In: Proceedings of the 2018 ACM International Joint

Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and

Wearable Computers [Internet]. New York, NY, USA: Association for Computing Machinery;

p. 33–37. (UbiComp ’18). Available from: https://doi.org/10.1145/3267305.3267638

Dasgupta R. (2018) Voice User Interface Design: Moving from GUI to Mixed Modal Interaction. 2018.

Berdasco, A,,López, G Diaz, I Quesada, L Guerrero, L.A. User Experience Comparison

ofIntelligent Personal Assistants: Alexa, Google Assistant, Siri and Cortana. Proceedings 2019, 31, 51.

Yuan Y, Thompson S, Watson K, Chase A, Senthilkumar A, Bernheim Brush A J. (2019) Speech interface reformulations and voice assistant personification preferences of children and parents. Int J Child-Computer Interact [Internet]. 2019; 21:77–88. Available from:

http://www.sciencedirect.com/science/article/pii/S2212868918300898

Zhao J, Patrick Rau P L. (2020) Merging and synchronizing corporate and personal voice

agents: Comparison of voice agents acting as a secretary and a housekeeper. Comput Human Behav [Internet]. 2020; 108:106334. Available from:

http://www.sciencedirect.com/science/article/pii/S0747563220300881

Kowalski J, Jaskulska A, Skorupska K, Abramczuk K, Biele C, Kopeć W. (2019) Older Adults and Voice Interaction: A Pilot Study with Google Home. In: Extended Abstracts of the 2019 CHI

Conference on Human Factors in Computing Systems [Internet]. New York, NY, USA:

Association for Computing Machinery; 2019. p. 1–6. (CHI EA ’19). Available from:

https://doi.org/10.1145/3290607.3312973

Trajkova M, Martin-Hammond A. (2020) “Alexa is a Toy”: Exploring Older Adults’ Reasons for Using, Limiting, and Abandoning Echo. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems [Internet]. New York, NY, USA: Association for Computing Machinery; 2020. p. 1–13. (CHI ’20). Available from: https://doi.org/10.1145/3313831.3376760

Lauretti C, Cordella F, di Luzio FS, Saccucci S, Davalli A, Sacchetti R. (2017) Comparative

performance analysis of M-IMU/EMG and voice user interfaces for assistive robots. In: 2017

International Conference on Rehabilitation Robotics (ICORR). 2017. p. 1001–6.

Corbett E, Weber A. (2016) What Can I Say? Addressing User Experience Challenges of a

Mobile Voice User Interface for Accessibility. In: Proceedings of the 18th International

Conference on Human-Computer Interaction with Mobile Devices and Services [Internet].

New York, NY, USA: Association for Computing Machinery; 2016. p. 72–82. (MobileHCI ’16).

Available from: https://doi.org/10.1145/2935334.2935386

Rong X, Fourney A, Brewer R N, Morris MR, Bennett P N. (2017) Managing Uncertainty in Time Expressions for Virtual Assistants. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems [Internet]. New York, NY, USA: Association for Computing Machinery; 2017. p. 568–579. (CHI ’17). Available from:

https://doi.org/10.1145/3025453.3025674

Jung. J., Lee. S., Hong. J., Youn. E., Lee. G. (2020) Voice+ Tactile: Augmenting In-vehicle Voice User Interface with Tactile Touchpad Interaction. CHI 2020 Paper. Available from:

http://dx.doi.org/10.1145/3313831.3376863

Jung H, So S, Oh C,Kim H, Kim J. (2019) TurtleTalk: An Educational Programming Game for

Children with User Interface. CHI 2019 Extended Abstracts.

Park. S., Lim. K. Y. (2020) Investigating User Expectations on the Roles of Family -shared AI speakers. CHI 2020 PAPER. Available from: http://dx.doi.org/10.1145/3313831.3376450

Pyae. A., Sciflleet. P. (2018) Investigating Difference between Native English and Non-native English Speaker in Interacting with a Voice User Interface: A case of Google Home. Available from: https://doi.org/10.1145/3292147.3292236

Murad C. Tools to Support Voice User Interface Design. In: Proceedings of the 21st

International Conference on Human-Computer Interaction with Mobile Devices and Services

[Internet]. New York, NY, USA: Association for Computing Machinery; 2019. (MobileHCI ’19).

Available from: https://doi.org/10.1145/3338286.3344424

Shneiderman, B. (2000) The Limits of Speech Recognition. Commun. ACM 43, 9 (Sept. 2000), 63–65. Available from: http://dx.doi.org/10.1145/348941.348990

Myers CM, Grethlein D, Furqan A, Ontañón S, Zhu J. (2019) Modeling Behavior Patterns with an Unfamiliar Voice User Interface. In: Proceedings of the 27th ACM Conference on User

Modeling, Adaptation and Personalization [Internet]. New York, NY, USA: Association for

Computing Machinery; 2019. p. 196–200. (UMAP ’19). Available from:

https://doi.org/10.1145/3320435.3320475

Kim D, Lee H. Effects of user experience on user resistance to change to the voice user

interface of an in‑vehicle infotainment system: Implications for platform and standards

competition. Int J Inf Manage [Internet]. 2016;36(4):653–67. Available from:

http://www.sciencedirect.com/science/article/pii/S0268401216302298

McLean G, Osei-Frimpong K. Hey Alexa … examine the variables influencing the use of

artificial intelligent in-home voice assistants. Comput Human Behav [Internet]. 2019. 99(28–

. Available from: http://www.sciencedirect.com/science/article/pii/S0747563219301840

Braun M, Mainz A, Chadowitz R, Pfleging B, Alt F. (2019) At Your Service: Designing Voice

Assistant Personalities to Improve Automotive User Interfaces. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems [Internet]. New York, NY, USA:

Association for Computing Machinery; 2019. p. 1–11. (CHI ’19). Available from:

https://doi.org/10.1145/3290605.3300270

Ziman R, Walsh G. (2018) Factors Affecting Seniors’ Perceptions of Voice-Enabled User

Interfaces. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in

Computing Systems [Internet]. New York, NY, USA: Association for Computing Machinery;

p. 1–6. (CHI EA ’18). Available from: https://doi.org/10.1145/3170427.3188575

Kiseleva J, Williams K, Jiang J, Hassan Awadallah A, Crook AC, Zitouni I. (2016) Understanding User Satisfaction with Intelligent Assistants. In: Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval [Internet]. New York, NY, USA: Association for Computing Machinery; 2016. p. 121–130. (CHIIR ’16). Available from:

https://doi.org/10.1145/2854946.2854961

Thakur N, Han CY. (2018) An Approach to Analyze the Social Acceptance of Virtual Assistants by Elderly People. In: Proceedings of the 8th International Conference on the Internet of Things [Internet]. New York, NY, USA: Association for Computing Machinery; 2018. (IOT ’18). Available from: https://doi.org/10.1145/3277593.3277616

Ammari T, Kaye J, Tsai JY, Bentley F. (2019) Music, Search, and IoT: How People (Really) Use Voice Assistants. ACM Trans Comput Interact [Internet]. 2019 Apr;26(3). Available from:

https://doi.org/10.1145/3311956

Myers C, Furqan A, Nebolsky J, Caro K, Zhu J. (2018) Patterns for How Users Overcome

Obstacles in Voice User Interfaces. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems [Internet]. New York, NY, USA: Association for Computing

Machinery; 2018. p. 1–7. (CHI ’18). Available from: https://doi.org/10.1145/3173574.3173580

Nguyen QN, Ta A, Prybutok V. (2018) An Integrated Model of Voice-User Interface

Continuance Intention: The Gender Effect. Int J Human–Computer Interact [Internet]. 2019

Sep 14;35(15):1362–77. Available from: https://doi.org/10.1080/10447318.2018.1525023

Xu C, Li Z, Zhang H, Rathore AS, Li H, Song C. (2019) WaveEar: Exploring a MmWave-Based

Noise-Resistant Speech Sensing for Voice-User Interface. In: Proceedings of the 17th Annual

International Conference on Mobile Systems, Applications, and Services [Internet]. New York,

NY, USA: Association for Computing Machinery; 2019. p. 14–26. (MobiSys ’19). Available from:

https://doi.org/10.1145/3307334.3326073