Face Recognition With Contiguous Occlusion Using Markov Random Fields

Zihan Zhou, Andrew Wagner, Hossein Mobahi, John Wright, Yi Ma

2010/11/18

zw

Outline
Introduction Local spatial continuity Error correction Choosing parameters Experiments

2010/11/18

Introduction
From ICCV09 poster Extended work from:

face recognition via sparse representation

Aimed at solving continuous error Apply continuity constraint to sparse representation

2010/11/18

Introduction

J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma. Robust face recognition via sparse representation. PAMI, y Ax 2009.

Sparse representation:

y Ax

=[
2010/11/18

]x
4

Introduction

y Ax e

Solve this problem by:

2010/11/18

Introduction
However, they only achieve their best performance on occlusions that are not spatially correlated.

2010/11/18

Introduction

2010/11/18

Introduction

2010/11/18

Local Spatial Continuity

support vector

2010/11/18

10

Local Spatial Continuity

2010/11/18

11

Local Spatial Continuity

Approximation to the log-likelihood function

2010/11/18

12

Error correction

2010/11/18

13

Error correction
1Estimating Linear Regressor x with Sparsity.

2Estimating Error Support s with MRF.

2010/11/18

14

Error correction
3Identify the test image assign it to the class that minimizes the

l1error.

2010/11/18

15

2010/11/18

16

Choosing parameters

Choosing :
the level of error we would accept before considering an entry of the image as occluded

2010/11/18

17

Choosing parameters

Choosing :

2010/11/18

18

Choosing parameters

Choosing :

2010/11/18

19

Choosing parameters

Choosing :
controls the strength of mutual interaction between adjacent pixels

2010/11/18

20

Experiments

Recognition with synthetic occlusion

2010/11/18

21

Recognition with synthetic occlusion

2010/11/18

22

Experiments

Recognition with disguises

2010/11/18

23

Recognition with disguises

2010/11/18

24

Experiments

Validation on Extend Yale B dataset

If

exceeds a thresholdit is declared as invalid

2010/11/18

25

Validation on Extend Yale B dataset

First 19 subjects as training, the other 19

subjects as invalid test images to be rejected. IReceiver operating characteristic (ROC) curves for 60% and 80% occlusion

2010/11/18

26

Experiments

Experiments with realistic test images

Training: 116 subjects with 38 illuminations. ITesting: 855 images under realistic illuminations (indoors, outdoors), which have been divided into ve categories: Normal: 354 images Occlusion by eyeglasses: 118 images Occlusion by sunglasses: 126 images Occlusion by hats: 40 images Occlusion by various disguises: 217 images

2010/11/18

27

Validation on Extend Yale B dataset

2010/11/18

28

Validation on Extend Yale B dataset

2010/11/18

29