Mobile face capture for virtual face videos

Chandan K. Reddy; George C. Stockman; Jannick P. Rolland; Frank A. Biocca

doi:10.1109/CVPR.2004.396

Mobile face capture for virtual face videos

Chandan K. Reddy, George C. Stockman, Jannick P. Rolland, Frank A. Biocca

Research output: Contribution to journal › Conference article › peer-review

5 Scopus citations

Abstract

Minimally obtrusive face capture is essential for applications in tele-conferencing, collaborative work, and mobile applications. Acquiring and coding video for such applications is a challenging problem, particularly for a mobile user. A pilot head-mounted display system (HMD) is shown that captures two side views of the face and generates in real-time a quality frontal video of the wearer. The face is captured with little obstruction of the users field of view. The frontal views are generated by warping and blending the side views after a calibration step. In tests of a bench prototype, the generated virtual videos compared well with real video based on both objective and qualitative criteria. With success of the pilot work, we are continuing development of the mobile HMD system.

Original language	English (US)
Article number	1384870
Journal	IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
Volume	2004-January
Issue number	January
DOIs	https://doi.org/10.1109/CVPR.2004.396
State	Published - 2004
Externally published	Yes
Event	2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2004 - Washington, United States Duration: Jun 27 2004 → Jul 2 2004

All Science Journal Classification (ASJC) codes

Computer Vision and Pattern Recognition
Electrical and Electronic Engineering

Access to Document

10.1109/CVPR.2004.396

Cite this

@article{728e0b8ea13f4578a490ab4dc8a1e728,

title = "Mobile face capture for virtual face videos",

abstract = "Minimally obtrusive face capture is essential for applications in tele-conferencing, collaborative work, and mobile applications. Acquiring and coding video for such applications is a challenging problem, particularly for a mobile user. A pilot head-mounted display system (HMD) is shown that captures two side views of the face and generates in real-time a quality frontal video of the wearer. The face is captured with little obstruction of the users field of view. The frontal views are generated by warping and blending the side views after a calibration step. In tests of a bench prototype, the generated virtual videos compared well with real video based on both objective and qualitative criteria. With success of the pilot work, we are continuing development of the mobile HMD system.",

author = "Reddy, {Chandan K.} and Stockman, {George C.} and Rolland, {Jannick P.} and Biocca, {Frank A.}",

note = "Publisher Copyright: {\textcopyright} 2004 IEEE.; 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2004 ; Conference date: 27-06-2004 Through 02-07-2004",

year = "2004",

doi = "10.1109/CVPR.2004.396",

language = "English (US)",

volume = "2004-January",

journal = "IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops",

issn = "2160-7508",

number = "January",

}

TY - JOUR

T1 - Mobile face capture for virtual face videos

AU - Reddy, Chandan K.

AU - Stockman, George C.

AU - Rolland, Jannick P.

AU - Biocca, Frank A.

PY - 2004

Y1 - 2004

N2 - Minimally obtrusive face capture is essential for applications in tele-conferencing, collaborative work, and mobile applications. Acquiring and coding video for such applications is a challenging problem, particularly for a mobile user. A pilot head-mounted display system (HMD) is shown that captures two side views of the face and generates in real-time a quality frontal video of the wearer. The face is captured with little obstruction of the users field of view. The frontal views are generated by warping and blending the side views after a calibration step. In tests of a bench prototype, the generated virtual videos compared well with real video based on both objective and qualitative criteria. With success of the pilot work, we are continuing development of the mobile HMD system.

AB - Minimally obtrusive face capture is essential for applications in tele-conferencing, collaborative work, and mobile applications. Acquiring and coding video for such applications is a challenging problem, particularly for a mobile user. A pilot head-mounted display system (HMD) is shown that captures two side views of the face and generates in real-time a quality frontal video of the wearer. The face is captured with little obstruction of the users field of view. The frontal views are generated by warping and blending the side views after a calibration step. In tests of a bench prototype, the generated virtual videos compared well with real video based on both objective and qualitative criteria. With success of the pilot work, we are continuing development of the mobile HMD system.

UR - http://www.scopus.com/inward/record.url?scp=84932634186&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84932634186&partnerID=8YFLogxK

U2 - 10.1109/CVPR.2004.396

DO - 10.1109/CVPR.2004.396

M3 - Conference article

AN - SCOPUS:84932634186

SN - 2160-7508

VL - 2004-January

JO - IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

JF - IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

IS - January

M1 - 1384870

T2 - 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2004

Y2 - 27 June 2004 through 2 July 2004

ER -

Mobile face capture for virtual face videos

Abstract

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this