Voice User Interface (VUI): A Review of Present and Potential Voice Assistant (VA) applications
Main Article Content
Abstract
Voice user interface (VUI) could come to replace the graphic user interface (i.e., mobile phone screen and computer). The reason is that users interact with VUI naturally more than touch screen interface. Nevertheless, the VUI with voice assistants still has problems in both acceptance and usability. The factors like privacy issue, voice assistants’ personality, the differentiation of age, language impacts the usability. For this review, 30 papers from the database of conference and research are investigated. Many researchers recommended the multimodality of VUI both input and output make an interface ease of use. For user experience, the speech technique and reformulating query and modeling users is the technique that makes machines understand the context of use better.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
IBM Shoebox (2020). IBM Archives, Access on Oct 14, 2020. https://www.ibm.com/ibm/history/exhibits/specialprod1/specialprod1_7.html
Bell System Technical Journal (1940), p. 509.
Choi S, Kim Y, Han E, Son J, Cho J. (2018) Designing conversational voice user interface for
improving intimacy of shared invehicle. In: Proceedings of the 2018 ACM International Joint
Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and
Wearable Computers [Internet]. New York, NY, USA: Association for Computing Machinery;
p. 33–37. (UbiComp ’18). Available from: https://doi.org/10.1145/3267305.3267638
Dasgupta R. (2018) Voice User Interface Design: Moving from GUI to Mixed Modal Interaction. 2018.
Berdasco, A,,López, G Diaz, I Quesada, L Guerrero, L.A. User Experience Comparison
ofIntelligent Personal Assistants: Alexa, Google Assistant, Siri and Cortana. Proceedings 2019, 31, 51.
Yuan Y, Thompson S, Watson K, Chase A, Senthilkumar A, Bernheim Brush A J. (2019) Speech interface reformulations and voice assistant personification preferences of children and parents. Int J Child-Computer Interact [Internet]. 2019; 21:77–88. Available from:
http://www.sciencedirect.com/science/article/pii/S2212868918300898
Zhao J, Patrick Rau P L. (2020) Merging and synchronizing corporate and personal voice
agents: Comparison of voice agents acting as a secretary and a housekeeper. Comput Human Behav [Internet]. 2020; 108:106334. Available from:
http://www.sciencedirect.com/science/article/pii/S0747563220300881
Kowalski J, Jaskulska A, Skorupska K, Abramczuk K, Biele C, Kopeć W. (2019) Older Adults and Voice Interaction: A Pilot Study with Google Home. In: Extended Abstracts of the 2019 CHI
Conference on Human Factors in Computing Systems [Internet]. New York, NY, USA:
Association for Computing Machinery; 2019. p. 1–6. (CHI EA ’19). Available from:
https://doi.org/10.1145/3290607.3312973
Trajkova M, Martin-Hammond A. (2020) “Alexa is a Toy”: Exploring Older Adults’ Reasons for Using, Limiting, and Abandoning Echo. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems [Internet]. New York, NY, USA: Association for Computing Machinery; 2020. p. 1–13. (CHI ’20). Available from: https://doi.org/10.1145/3313831.3376760
Lauretti C, Cordella F, di Luzio FS, Saccucci S, Davalli A, Sacchetti R. (2017) Comparative
performance analysis of M-IMU/EMG and voice user interfaces for assistive robots. In: 2017
International Conference on Rehabilitation Robotics (ICORR). 2017. p. 1001–6.
Corbett E, Weber A. (2016) What Can I Say? Addressing User Experience Challenges of a
Mobile Voice User Interface for Accessibility. In: Proceedings of the 18th International
Conference on Human-Computer Interaction with Mobile Devices and Services [Internet].
New York, NY, USA: Association for Computing Machinery; 2016. p. 72–82. (MobileHCI ’16).
Available from: https://doi.org/10.1145/2935334.2935386
Rong X, Fourney A, Brewer R N, Morris MR, Bennett P N. (2017) Managing Uncertainty in Time Expressions for Virtual Assistants. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems [Internet]. New York, NY, USA: Association for Computing Machinery; 2017. p. 568–579. (CHI ’17). Available from:
https://doi.org/10.1145/3025453.3025674
Jung. J., Lee. S., Hong. J., Youn. E., Lee. G. (2020) Voice+ Tactile: Augmenting In-vehicle Voice User Interface with Tactile Touchpad Interaction. CHI 2020 Paper. Available from:
http://dx.doi.org/10.1145/3313831.3376863
Jung H, So S, Oh C,Kim H, Kim J. (2019) TurtleTalk: An Educational Programming Game for
Children with User Interface. CHI 2019 Extended Abstracts.
Park. S., Lim. K. Y. (2020) Investigating User Expectations on the Roles of Family -shared AI speakers. CHI 2020 PAPER. Available from: http://dx.doi.org/10.1145/3313831.3376450
Pyae. A., Sciflleet. P. (2018) Investigating Difference between Native English and Non-native English Speaker in Interacting with a Voice User Interface: A case of Google Home. Available from: https://doi.org/10.1145/3292147.3292236
Murad C. Tools to Support Voice User Interface Design. In: Proceedings of the 21st
International Conference on Human-Computer Interaction with Mobile Devices and Services
[Internet]. New York, NY, USA: Association for Computing Machinery; 2019. (MobileHCI ’19).
Available from: https://doi.org/10.1145/3338286.3344424
Shneiderman, B. (2000) The Limits of Speech Recognition. Commun. ACM 43, 9 (Sept. 2000), 63–65. Available from: http://dx.doi.org/10.1145/348941.348990
Myers CM, Grethlein D, Furqan A, Ontañón S, Zhu J. (2019) Modeling Behavior Patterns with an Unfamiliar Voice User Interface. In: Proceedings of the 27th ACM Conference on User
Modeling, Adaptation and Personalization [Internet]. New York, NY, USA: Association for
Computing Machinery; 2019. p. 196–200. (UMAP ’19). Available from:
https://doi.org/10.1145/3320435.3320475
Kim D, Lee H. Effects of user experience on user resistance to change to the voice user
interface of an in‑vehicle infotainment system: Implications for platform and standards
competition. Int J Inf Manage [Internet]. 2016;36(4):653–67. Available from:
http://www.sciencedirect.com/science/article/pii/S0268401216302298
McLean G, Osei-Frimpong K. Hey Alexa … examine the variables influencing the use of
artificial intelligent in-home voice assistants. Comput Human Behav [Internet]. 2019. 99(28–
. Available from: http://www.sciencedirect.com/science/article/pii/S0747563219301840
Braun M, Mainz A, Chadowitz R, Pfleging B, Alt F. (2019) At Your Service: Designing Voice
Assistant Personalities to Improve Automotive User Interfaces. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems [Internet]. New York, NY, USA:
Association for Computing Machinery; 2019. p. 1–11. (CHI ’19). Available from:
https://doi.org/10.1145/3290605.3300270
Ziman R, Walsh G. (2018) Factors Affecting Seniors’ Perceptions of Voice-Enabled User
Interfaces. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in
Computing Systems [Internet]. New York, NY, USA: Association for Computing Machinery;
p. 1–6. (CHI EA ’18). Available from: https://doi.org/10.1145/3170427.3188575
Kiseleva J, Williams K, Jiang J, Hassan Awadallah A, Crook AC, Zitouni I. (2016) Understanding User Satisfaction with Intelligent Assistants. In: Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval [Internet]. New York, NY, USA: Association for Computing Machinery; 2016. p. 121–130. (CHIIR ’16). Available from:
https://doi.org/10.1145/2854946.2854961
Thakur N, Han CY. (2018) An Approach to Analyze the Social Acceptance of Virtual Assistants by Elderly People. In: Proceedings of the 8th International Conference on the Internet of Things [Internet]. New York, NY, USA: Association for Computing Machinery; 2018. (IOT ’18). Available from: https://doi.org/10.1145/3277593.3277616
Ammari T, Kaye J, Tsai JY, Bentley F. (2019) Music, Search, and IoT: How People (Really) Use Voice Assistants. ACM Trans Comput Interact [Internet]. 2019 Apr;26(3). Available from:
https://doi.org/10.1145/3311956
Myers C, Furqan A, Nebolsky J, Caro K, Zhu J. (2018) Patterns for How Users Overcome
Obstacles in Voice User Interfaces. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems [Internet]. New York, NY, USA: Association for Computing
Machinery; 2018. p. 1–7. (CHI ’18). Available from: https://doi.org/10.1145/3173574.3173580
Nguyen QN, Ta A, Prybutok V. (2018) An Integrated Model of Voice-User Interface
Continuance Intention: The Gender Effect. Int J Human–Computer Interact [Internet]. 2019
Sep 14;35(15):1362–77. Available from: https://doi.org/10.1080/10447318.2018.1525023
Xu C, Li Z, Zhang H, Rathore AS, Li H, Song C. (2019) WaveEar: Exploring a MmWave-Based
Noise-Resistant Speech Sensing for Voice-User Interface. In: Proceedings of the 17th Annual
International Conference on Mobile Systems, Applications, and Services [Internet]. New York,
NY, USA: Association for Computing Machinery; 2019. p. 14–26. (MobiSys ’19). Available from: