论文标题

社交数据的情绪检测:API比较研究

Emotion detection of social data: APIs comparative study

论文作者

Abu-Salih, Bilal, Alhabashneh, Mohammad, Zhu, Dengya, Awajan, Albara, Alshamaileh, Yazan, Al-Shboul, Bashar, Alshraideh, Mohammad

论文摘要

由于这种新学科几乎无限,尤其是在社会数据的不断传播的过程中,情感检测技术的发展已成为公司部门的一种非常有价值的可能性。近年来,电子市场见证了建立了许多初创企业,几乎唯一着重于构建新的商业和开源工具以及API,以进行情感检测和认可。但是,必须对这些工具和API进行连续评估和评估,并且应报告和讨论它们的性能。缺乏研究从经验上比较当前的情绪检测技术,该技术使用相同的文本数据集从每个模型中获得的结果进行比较。此外,缺乏对社会数据进行基准比较的比较研究。这项研究比较了八种技术。 IBM Watson Nlu,Paralleldots,Symanto-Ekman,Crystalfeel,Text to Emotion,Senpy,Textprobe和NLP Cloud。使用两个不同的数据集进行了比较。然后使用Incorpated API得出所选数据集中的情绪。这些API的性能是使用他们交付的汇总分数以及理论上证明的评估指标(例如准确性,分类误差,精度,召回和F1得分)进行评估的。最后,报告并讨论了包括评估措施的这些API的评估。

The development of emotion detection technology has emerged as a highly valuable possibility in the corporate sector due to the nearly limitless uses of this new discipline, particularly with the unceasing propagation of social data. In recent years, the electronic marketplace has witnessed the establishment of a large number of start-up businesses with an almost sole focus on building new commercial and open-source tools and APIs for emotion detection and recognition. Yet, these tools and APIs must be continuously reviewed and evaluated, and their performances should be reported and discussed. There is a lack of research to empirically compare current emotion detection technologies in terms of the results obtained from each model using the same textual dataset. Also, there is a lack of comparative studies that apply benchmark comparison to social data. This study compares eight technologies; IBM Watson NLU, ParallelDots, Symanto-Ekman, Crystalfeel, Text to Emotion, Senpy, Textprobe, and NLP Cloud. The comparison was undertaken using two different datasets. The emotions from the chosen datasets were then derived using the incorporated APIs. The performance of these APIs was assessed using the aggregated scores that they delivered as well as the theoretically proven evaluation metrics such as the micro-average of accuracy, classification error, precision, recall, and f1-score. Lastly, the assessment of these APIs incorporating the evaluation measures is reported and discussed.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源