论文标题
BOTSIM：用于商业面向任务的对话框系统的端到端机器人模拟工具包
BotSIM: An End-to-End Bot Simulation Toolkit for Commercial Task-Oriented Dialog Systems
论文作者
论文摘要
我们介绍了BOTSIM，这是一种模块化的开源机器人模拟环境，具有对话框生成，用户仿真和对话分析功能。 BOTSIM旨在作为一站式解决方案，用于大规模数据有效的端到端评估，诊断和修复商业面向任务的对话框（TOD）系统，以显着加速商业机器人的开发和评估，降低成本和成本和市场的时间。 BOTSIM采用了一个分层设计，其中包括基础架构层，适配器层和应用层。基础架构层构成了关键模型和组件，以通过简化的“生成模拟解析”管道来支持BOTSIM的主要功能。适配器层用于扩展BOTSIM以容纳新的机器人平台。该应用程序层提供了一套命令行工具和Web应用程序套件，可显着降低BOTSIM用户（例如Bot Admins或从业者）的进入障碍。在本报告中，我们专注于各种系统组件的技术设计。还提出了使用爱因斯坦植物建筑商的详细案例研究，以展示如何将BOTSIM管道用于机器人评估和修复。详细的系统描述可以在我们的系统演示纸中找到。该工具包可在以下网址获得：https：//github.com/salesforce/botsim。
We introduce BotSIM, a modular, open-source Bot SIMulation environment with dialog generation, user simulation and conversation analytics capabilities. BotSIM aims to serve as a one-stop solution for large-scale data-efficient end-to-end evaluation, diagnosis and remediation of commercial task-oriented dialog (TOD) systems to significantly accelerate commercial bot development and evaluation, reduce cost and time-to-market. BotSIM adopts a layered design comprising the infrastructure layer, the adaptor layer and the application layer. The infrastructure layer hosts key models and components to support BotSIM's major functionalities via a streamlined "generation-simulation-remediation" pipeline. The adaptor layer is used to extend BotSIM to accommodate new bot platforms. The application layer provides a suite of command line tools and a Web App to significantly lower the entry barrier for BotSIM users such as bot admins or practitioners. In this report, we focus on the technical designs of various system components. A detailed case study using Einstein BotBuilder is also presented to show how to apply BotSIM pipeline for bot evaluation and remediation. The detailed system descriptions can be found in our system demo paper. The toolkit is available at: https://github.com/salesforce/BotSIM .
