论文标题

当大脑计算机界面符合元视频时:景观,示威者,趋势,挑战和关注点

When Brain-Computer Interfaces Meet the Metaverse: Landscape, Demonstrator, Trends, Challenges, and Concerns

论文作者

Bernal, Sergio López, Pérez, Mario Quiles, Beltrán, Enrique Tomás Martínez, Pérez, Gregorio Martínez, Celdrán, Alberto Huertas

论文摘要

近年来,该元评估已获得了极大的知名度,从而允许全球用户的互连。但是,当前的荟萃情况下的系统(例如虚拟现实眼镜)提供了部分沉浸式体验。在这种情况下,尽管需要研究BCI在这些虚拟场景中的适用性和含义的研究,但脑部计算机界面(BCIS)可以引入元革命。基于缺乏文献,这项工作首次回顾了BCI在元评估中的适用性,分析了基于与虚拟世界有关的不同类别的当前状态以及在媒体和长期中这些场景中BCIS的演变。这项工作还提出了一个通用框架的设计和实施,该框架将BCIS与基于模块化设计的传感器和执行器(例如VR眼镜)的不同数据源集成在一起,以易于扩展。该手稿还验证了示威者中的框架,该示威者包括在元视频中驾驶汽车,使用BCI进行神经数据采集,VR耳机提供现实主义,以及方向盘和踏板。选择了四个用例(UC),重点是对驾驶员的认知和情感评估,嗜睡的检测以及驾驶员身份验证。此外,该手稿对Metaverse的BCI趋势进行了分析,还确定了这些技术相交将面临的未来挑战。最后,它审查了在虚拟世界应用程序中使用BCIS可以根据不同类别产生的担忧:可访问性,用户包容性,隐私,网络安全性,物理安全性和道德规范。

The metaverse has gained tremendous popularity in recent years, allowing the interconnection of users worldwide. However, current systems in metaverse scenarios, such as virtual reality glasses, offer a partial immersive experience. In this context, Brain-Computer Interfaces (BCIs) can introduce a revolution in the metaverse, although a study of the applicability and implications of BCIs in these virtual scenarios is required. Based on the absence of literature, this work reviews, for the first time, the applicability of BCIs in the metaverse, analyzing the current status of this integration based on different categories related to virtual worlds and the evolution of BCIs in these scenarios in the medium and long term. This work also proposes the design and implementation of a general framework that integrates BCIs with different data sources from sensors and actuators (e.g., VR glasses) based on a modular design to be easily extended. This manuscript also validates the framework in a demonstrator consisting of driving a car within a metaverse, using a BCI for neural data acquisition, a VR headset to provide realism, and a steering wheel and pedals. Four use cases (UCs) are selected, focusing on cognitive and emotional assessment of the driver, detection of drowsiness, and driver authentication while using the vehicle. Moreover, this manuscript offers an analysis of BCI trends in the metaverse, also identifying future challenges that the intersection of these technologies will face. Finally, it reviews the concerns that using BCIs in virtual world applications could generate according to different categories: accessibility, user inclusion, privacy, cybersecurity, physical safety, and ethics.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源