File(s) under permanent embargo
Edge4Emotion: An Edge Computing based Multi-source Emotion Recognition Platform for Human-Centric Software Engineering
conference contribution
posted on 2021-01-01, 00:00 authored by Ben Cheng, Owen Wang, Di ShaoDi Shao, Chetan Arora, Thuong HoangThuong Hoang, Xiao LiuXiao LiuHuman emotion recognition has been widely used and intensively studied in many areas such as e-Commerce, online education, healthcare, human-computer interaction and recently human-centric software engineering (HCSE). HCSE investigates human factors in the entire software development lifecycle, and human emotion can be used in many scenarios such as requirement gathering and usability testing. However, even though existing studies have already shown the advantages of emotion recognition with multi-source data such as text, audio and video, the current research and practice in HCSE are primarily based on single-source data. In addition, emotion recognition in HCSE faces several challenges such as multiple participants, changing environments and real-time requirement. To tackle these challenges, this paper proposes Edge4Emotion, a novel edge computing-based multisource human emotion recognition platform for HCSE. Edge4Emotion takes the advantage of the edge computing paradigm to efficiently support the collection of multi-source data such as audio, video and physiological data from various IoT devices, and emotion recognition with both single- and multisource models. As an on-going project, this paper focuses on the platform design and the preliminary evaluation of the platform with representative emotion recognition applications. The platform will be further extended to include more multi-source learning models and serve as an open-source platform for the development and evaluation of multi-source emotion recognition models for HCSE.
History
Event
Cluster, Cloud and Internet Computing. Symposium (2021 : 21st : Melbourne, Victoria)Pagination
610 - 613Publisher
IEEELocation
Melbourne, VictoriaPlace of publication
Piscataway, N.J.Publisher DOI
Start date
2021-05-10End date
2021-05-13ISBN-13
9781728195865Language
engPublication classification
E1 Full written paper - refereedTitle of proceedings
CCGrid 2021 : Proceedings of the 21st IEEE/ACM International Symposium on Cluster, Cloud and Internet ComputingUsage metrics
Categories
No categories selectedKeywords
Licence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC