Motion Overview of Human Actions

Jackie Assa     Daniel Cohen-Or     I-Cheng Yeh     Tong-Yee Lee

ACM Transactions on Graphics (SIGGRAPH Asia 2008 issue)

Teaser: Our algorithm analyzes human motion data to generate an overview video clip. On the right, a bird s eye view on the character reference location (shown in red) and our generated multi-shot camera control path (shown in blue-green)

During the last decade, motion capture data has emerged and gained a leading role in animations, games and 3D environments. Many of these applications require the creation of expressive overview video clips capturing the human motion, however sufficient attention has not been given to this problem. In this paper, we present a technique that generates an overview video based on the analysis of motion capture data. Our method is targeted for applications of 3D character based animations, automating, for example, the action summary and gameplay overview in simulations and computer games. We base our method on quantum annealing optimization with an objective function that respects the analysis of the character motion and the camera movement constraints. It automatically generates a smooth camera control path, splitting it to several shots if required. To evaluate our method, we introduce a novel camera placement metric which is evaluated against previous work and conduct a user study comparing our results with the various systems.

(Adobe PDF, Paper:10.9MB)

(Quick Time Format, Demo:75.4MB and User Study:29.7MB)

@inproceedings{Assa08,
   author    = {Jackie Assaand and Daniel Cohen-Orand and
                I-Cheng Yeh and Tong-Yee Lee},
   title     = {Motion Overview of Human Action},
   booktitle = {SIGGRAPH Asia 2008 Conference Proceedings},
   month     = {Dec},
   year      = {2008},
   pages     = {???--???},
   location  = {Suntec City, Singapore},
   publisher = {ACM}
}

@article{Assa08,
   author    = {Assa, Jackie and Cohen-Or, Daniel and Yeh, I-Cheng and Lee, Tong-Yee},
   title     = {Motion overview of human actions},
   journal   = {ACM Trans. Graph.},
   volume    = {27},
   number    = {5},
   year      = {2008},
   issn      = {0730-0301},
   pages     = {1--10},
   doi       = {http://doi.acm.org/10.1145/1409060.1409068},
   publisher = {ACM},
   address   = {New York, NY, USA},
}