3D live: real time captured content for mixed reality

作者: Adrian David Cheok , Farzam Farbiz , Simon Prince , Mark Billinghurst , Todd Williamson

DOI: 10.5555/850976.854974

关键词:

摘要: We present a complete system for live capture of 3D content and simultaneous presentation in augmented reality. The user sees the real world from his viewpoint, but modified so that image remote collaborator is rendered into scene. Fifteen cameras surround collaborator, resulting video streams are used to construct three-dimensional model subject using shape-from-silhouette algorithm. Users view two-dimensional fiducial marker video-see-through reality interface. geometric relationship between head-mounted camera calculated, equivalent computed drawn Our can generate 384 /spl times/ 288 pixel images models at 25 fps, with latency < 100 ms. result gives strong impression part demonstrate applications this videoconferencing entertainment.

参考文章(20)
J. Mulligan, K. Daniilidis, Real time trinocular stereo for tele-immersion international conference on image processing. ,vol. 3, pp. 959- 962 ,(2001) , 10.1109/ICIP.2001.958284
Justine Cassell, Kristinn R. Thorisson, The power of a nod and a glance: Envelope vs. emotional feedback in animated conversational agents Applied Artificial Intelligence. ,vol. 13, pp. 519- 538 ,(1999) , 10.1080/088395199117360
Benjamin Lok, Online model reconstruction for interactive virtual environments Proceedings of the 2001 symposium on Interactive 3D graphics - SI3D '01. pp. 69- 72 ,(2001) , 10.1145/364338.364364
M. Billinghurst, A. Cheok, S. Prince, H. Kato, Real world teleconferencing IEEE Computer Graphics and Applications. ,vol. 22, pp. 11- 13 ,(2002) , 10.1109/MCG.2002.1046623
Martin A. Fischler, Robert C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography Communications of The ACM. ,vol. 24, pp. 381- 395 ,(1981) , 10.1145/358669.358692
Mark Billinghurst, Hirokazu Kato, Real world teleconferencing CHI '99 extended abstracts on Human factors in computing systems - CHI '99. pp. 194- 195 ,(1999) , 10.1145/632716.632838
H. Kato, M. Billinghurst, I. Poupyrev, K. Imamoto, K. Tachibana, Virtual object manipulation on a table-top AR environment Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000). pp. 111- 119 ,(2000) , 10.1109/ISAR.2000.880934
A. Laurentini, The visual hull concept for silhouette-based image understanding IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 16, pp. 150- 162 ,(1994) , 10.1109/34.273735
Ronald T. Azuma, A survey of augmented reality Presence: Teleoperators & Virtual Environments. ,vol. 6, pp. 355- 385 ,(1997) , 10.1162/PRES.1997.6.4.355
H. Kato, M. Billinghurst, Marker tracking and HMD calibration for a video-based augmented reality conferencing system Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99). pp. 85- 94 ,(1999) , 10.1109/IWAR.1999.803809