This Article Abstract Free Full Text (Free PDF) Free Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Lee, S.-Y. Articles by Lim, M. Search for Related Content Social Bookmarking                   What's this?

Real-time 3D video avatar in mixed reality: An implementation for immersive telecommunication

Korea Institute of Science and Technology

Sang C. Ahn

Korea Institute of Science and Technology

Hyoung-Gon Kim

Korea Institute of Science and Technology

MyoTaeg Lim

Korea University

This article presents an implementation of a real-time dynamic 3D avatar from multiview cameras for immersive telecommunication. Immersive telecommunication is a new challenging field that enables a user to share a virtual space with remote participants, providing users with a sense of telepresence and interaction. The main objective is to offer rich communication modalities, as similar as those used in face-to-face meetings, like gestures, gaze awareness, realistic images, and correct sound direction. As a result, the user can be immersed and has natural interaction with remote participants. This would overcome the limitations of conventional video-based telecommunication as well as the VR-based collaborative virtual environment approaches.

Key Words: 3D video avatar • image-based rendering • immersive display environment • immersive telecommunication • mixed reality • natural interaction • real time • telepresence • virtual reality

References

• Cruz-Neira, C., Sandin, D. J., DeFanti, T. A., Kenyon, R. V., & Hart, J. C. (1992). The CAVE: Audio visual experience automatic virtual environment. Communications of the ACM, 35(6), 64-72.
• Li, M., Magnor, M., & Seidel, H. (2003). Online accelerated rendering of visual hulls in real scenes. Journal of WSCG 2003, 11(2), 290-297.
• Lok, B. (2001). Online model reconstruction for interactive virtual environments. Proceedings of the 2001 Symposium on Interactive 3D graphics, pp. 69-72.
• Markus, G., Stephan, W., Martin, N., Edouard, L., Christian, S., Andreas, K., Esther, K., Tomas, S., Luc, V. G., Silke, L., Kai, S., Andrew, V. M., & Oliver, S. (2003). blue-c: A spatially immersive display and 3D video portal for telepresence. Proceedings of ACM SIGGRAPH 2003.
• Matusik, W., Buehler, C., Raskar, R., Gortler, S., & McMillan, L. (2000). Image-based visual hulls. Proceedings of ACM SIGGRAPH 2000, pp. 369-374.
• Sato, M. (2002). Development of string-based force display: SPIDAR. 8th International Conference on Virtual Systems and Multimedia.

CiteULike

Connotea

Del.icio.us

Digg

Reddit

Technorati

This Article Abstract Free Full Text (Free PDF) Free Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Lee, S.-Y. Articles by Lim, M. Search for Related Content Social Bookmarking                   What's this?