论文标题
Skyplane:使用Cloud-Aware叠加层优化转移成本和吞吐量
Skyplane: Optimizing Transfer Cost and Throughput Using Cloud-Aware Overlays
论文作者
论文摘要
云应用程序越来越多地在多个区域和云提供商之间分发数据。不幸的是,广阔的批量数据传输通常很慢,瓶颈应用程序。我们证明,可以通过将网络叠加层调整为云设置来显着改善区域间云的传输吞吐量,也就是说,通过通过应用程序层的间接路径路由数据。但是,在此环境中直接应用网络叠加可能会导致云出口价格的不可接受。我们提出了Skyplane,这是一种用于使用云吸引网络叠加层的云对象存储之间的批量数据传输系统,以最佳地导航价格和性能之间的权衡。 Skyplane的规划师使用混合工作者线性编程来确定数据传输的最佳覆盖路径和资源分配,但要受到用户提供的价格或性能的约束。 Skyplane的表现优于公共云转移服务,最高为$ 4.6 \ times $ $ $ $ $ 5.0 \ $ 5.0 \ times $跨云。
Cloud applications are increasingly distributing data across multiple regions and cloud providers. Unfortunately, wide-area bulk data transfers are often slow, bottlenecking applications. We demonstrate that it is possible to significantly improve inter-region cloud bulk transfer throughput by adapting network overlays to the cloud setting -- that is, by routing data through indirect paths at the application layer. However, directly applying network overlays in this setting can result in unacceptable increases in cloud egress prices. We present Skyplane, a system for bulk data transfer between cloud object stores that uses cloud-aware network overlays to optimally navigate the trade-off between price and performance. Skyplane's planner uses mixed-integer linear programming to determine the optimal overlay path and resource allocation for data transfer, subject to user-provided constraints on price or performance. Skyplane outperforms public cloud transfer services by up to $4.6\times$ for transfers within one cloud and by up to $5.0\times$ across clouds.