论文标题
通过迭代非线性优化和动画进行语义运动校正
Semantic Motion Correction Via Iterative Nonlinear Optimization and Animation
论文作者
论文摘要
在这里，我们提出了一种端到端方法，为试图阻止罚球的守门员创建2D动画，然后使用迭代非线性优化方案更正该运动。输入是一个原始视频，该视频被馈入姿势和对象检测网络，以找到守门员和球的骨架。输出是与校正运动相关的骨架的一组关键帧，因此，如果守门员错过了球，动画将显示，然后成功偏转。我们的方法足够强大，守门员可以犯的不同类型的错误，例如没有足够的刺耳或跳到不正确的一侧。我们的方法还应在语义上与守门员的原始动作相似，这有助于使我们的动画基于实际人类行为的基础。
Here, we present an end-to-end method to create 2D animation for a goalkeeper attempting to block a penalty kick, and then correct that motion using an iterative nonlinear optimization scheme. The input is a raw video that is fed into pose and object detection networks to find the skeleton of the goalkeeper and the ball. The output is a set of key frames of the skeleton associated with the corrected motion so that if the goalkeeper missed the ball, the animation will show then successfully deflecting it. Our method is robust enough correct different kinds of mistakes the goalkeeper can make, such as not lunging far enough or jumping to the incorrect side. Our method is also meant to be semantically similar to the goalkeeper's original motion, which helps keep our animation grounded with respect to actual human behavior.
