Loading...
Please wait, while we are loading the content...
Similar Documents
Face synthesis and recognition from a single image under arbitrary unknown lighting using a spherical harmonic basis morphable model (2005)
| Content Provider | CiteSeerX |
|---|---|
| Author | Zhang, Lei Wang, Sen Samaras, Dimitris |
| Description | Understanding and modifying the effects of arbitrary illumination on human faces in a realistic manner is a challenging problem both for face synthesis and recognition. Recent research demonstrates that the set of images of a convex Lambertian object obtained under a wide variety of lighting conditions can be approximated accurately by a low-dimensional linear subspace using spherical harmonics representation. Morphable models are statistical ensembles of facial properties such as shape and texture. In this paper, we integrate spherical harmonics into the morphable model framework, by proposing a 3D Spherical Harmonic Basis Morphable Model(SHBMM) and demonstrate that any face under arbitrary unknown lighting can be simply represented by three low-dimensional vectors: shape parameters, spherical harmonic basis parameters and illumination coefficients. We show that, with our SHBMM, given one single image under arbitrary unknown lighting, we can remove the illumination effects from the image (face “delighting”) and synthesize new images under different illumination conditions (face “re-lighting”). Furthermore, we demonstrate that cast shadows can be detected and subsequently removed by using the image error between the input image and the corresponding rendered image. We also propose two illumination invariant face recognition methods based on the recovered SHBMM parameters and the de-lit images respectively. Experimental results show that using only a single image of a face under unknown lighting, we can achieve high recognition rates and generate photorealistic images of the face under a wide range of illumination conditions, including multiple sources of illumination. 1. In CVPR’05 |
| File Format | |
| Language | English |
| Publisher Date | 2005-01-01 |
| Access Restriction | Open |
| Subject Keyword | Input Image Unknown Lighting Spherical Harmonic Basis Morphable Model Facial Property Convex Lambertian Object Realistic Manner Low-dimensional Linear Subspace New Image Recent Research Illumination Invariant Face Recognition Method Photorealistic Image Face Synthesis Shape Parameter Statistical Ensemble Morphable Model Cast Shadow Illumination Coefficient Single Image Multiple Source Arbitrary Unknown Lighting Wide Variety Spherical Harmonic Representation Different Illumination Condition Wide Range Arbitrary Illumination Illumination Condition Low-dimensional Vector Face Delighting Spherical Harmonic Illumination Effect De-lit Image Challenging Problem Image Error Morphable Model Framework High Recognition Rate Experimental Result Spherical Harmonic Basis Parameter Recovered Shbmm Parameter |
| Content Type | Text |
| Resource Type | Article |
