Académique Documents
Professionnel Documents
Culture Documents
Pattern Recognition
journal homepage: www.elsevier.com/locate/pr
A R T I C L E I N F O A BS T RAC T
Keywords: Extracting reliable finger-vein features directly from original finger-vein images is not an easy task since the
Biometrics captured finger-vein images are always poor in quality. This paper proposes an effective method of finger-vein
Finger-vein recognition feature representation based on adaptive vector field estimation. Considering that the vein networks consist of
Spatial curve filter vein curve segments, a set of spatial curve filters (SCFs) with variations in curvature and orientation are first
Vector field
designed. To fit vein curves locally and closely, SCFs is then weighted using a variable Gaussian model. Due to
the fact that finger veins vary in diameters naturally, an effective curve length field (CLF) estimation method is
proposed to make weighted SCFs adaptive to vein-width variations. Finally, with CLF constrain, vein vector
fields(VVF) are built for finger-vein network feature description. Experimental results show that the proposed
method is highly powerful in improving finger-vein matching accuracy.
⁎
Corresponding author.
E-mail address: jfyang@cauc.edu.cn (J. Yang).
http://dx.doi.org/10.1016/j.patcog.2017.01.008
Received 2 August 2016; Received in revised form 4 January 2017; Accepted 6 January 2017
Available online 07 January 2017
0031-3203/ © 2017 Elsevier Ltd. All rights reserved.
J. Yang et al. Pattern Recognition 66 (2017) 34–43
because the ridge structures are totally different between fingerprints Curve
and finger veins. In order to implement ridge-specific enhancement, a model
curve filter transform (CFT) was proposed for orientation field estima-
tion in electron micrograph images [23]. Unfortunately, this method is
Spatial
still incapable by itself of handling low-contrast ridge enhancement curve filter
problem. Moreover, incidentally generating false ridges is also an 2D Gausian
model
inherent drawback of CFT. Therefore, developing a vein-ridge-specific
orientation estimation strategy is promising for reliably exploiting Weighted spatial
finger-vein network features in finger-vein images. curve filter
Curve length
In this paper, we focus on two fundamental problems: spatial curve field
filter design and accurate vector field estimation. They are directly Finger-vein
related to the effective network feature representation of finger-vein image
trait in personal identification. The main contributions of this paper are
the followings: Finger-vein
vector field
1. A set of spatial curve filters(SCFs) are designed using a variable
curve model in curvature and orientation.
2. A Gaussian weighted curve model is proposed to reduce filtering Matching
errors in fitting vein diameters.
3. An efficient method is proposed for reliably estimating curve length Fig. 2. Block diagram of the proposed method.
fields (CLF). This can make SCFs adaptive to vein-width variations.
imaging plane is set for finger-vein imaging. The luminaire is a NIR
The remainder of this paper is organized as follows. In Section 2, we light-emitting diode (LED) array at a wavelength of 760 nm, and in
briefly introduce a homemade finger-vein imaging system. Section 3 NIR transillumination, a CCD sensor is place at the bottom of the
details the proposed method in finger-vein feature representation. homemade box device.
Experimental results are reported in Section 5. Finally, Section 6 To localize the ROIs from finger-vein images, an simple but
summarizes this paper. effective method proposed in our previous work [13,27] is used here,
as shown in Fig. 1(b). From Fig. 1(b), we can see that veins cast dark
2. Finger-vein image acquisition “shadows” on imaging plane while the surrounding tissue (e.g., fat)
presents a bright background. We can note from Fig. 1(b) that the
To obtain finger-vein images, we have designed a homemade finger- sample ROIs have small intra-class variation, which is clearly beneficial
vein imaging system, which can automatically capture a finger-vein for accurate finger-vein recognition.
imagery when a finger is available in a collection groove, as shown in
Fig. 1(a). An open window (7 0 × 25 mm 2) centered in the width of
Fig. 1. Image acquisition. (a) A homemade finger-vein imaging system. (b) ROI segmentation results of different finger-vein images using the method proposed in [13,27].
35
J. Yang et al. Pattern Recognition 66 (2017) 34–43
In this section, the proposed algorithm for adaptive vector field In this section, we report a method of weighting SCFs. To some
estimation is presented in detail. The complete framework is illustrated extend, the distortions illustrated in Fig. 6(b) and (c) arise from valuing
in Fig. 2, consisting of SCF design, CLF estimation, Gaussian weighted the curve length LP unreasonably. Therefore, to make SCFs more
SCF and vector field estimation. effective in vein-curve feature exploitation, we should further weight
In the first step shown in Fig. 2, we propose an inferior arc-curve them adaptively considering the spatial errors between vein curves and
model whose curve length, curvature and orientation are all variable. curve models. Based on the findings in embryology [29,30], the
Based this curve model, SCFs are then generated. Since the veins vary curvatures and shapes of veins are of randomness. The spatial
in width, the SCFs with fixed curve length are surely not optimal in differences between the real vein curves and the proposed curve
vein-ridge information exploration. In order to assign a suitable curve models can not be therefore reduced since the proposed curve models
length to each pixel-point, the CLF of a finger-vein image is estimated are expressed using inferior arc-curves with finite curvature variation
adaptively. In fact, the contributions of pixels in a curve are different (see Eq. (1)). To understand this intuitively, we plot two diagrammatic
when implementing filter operation, we therefore use a Gaussian model curves in Fig. 7. Assume that CA and VB respectively represent a curve
to weight the obtained SCFs. Under CLF constrain, based on the model and a local vein curve, as shown in Fig. 7(a), we can clearly
weighted SCFs, we finally can generate an adaptive vector field that can observe that the separation between CA and VB gradually increase
give a reliable vector representation of the finger-vein network. Finger- towards their two ends. Although we can assign a suitable curve length
vein image matching is implemented by Phase-Only-Correlation be- LP to locally fitting the shape of a candidate curve, there are still some
tween two finger-vein vector fields. points away from the curve center to be necessarily devaluated in
venous region exploration.
Thus, it is obviously unreasonable that using the pixels correspond-
ing to ( A1, …, Ai ) and ( Am , …, An ) to respectively represent (B1, …, Bi ) and
3.1. Spatial curve filter design (Bm, …, Bn ). Hence, a sub-curve of CA, indicated by window H in
Fig. 7(b), is actually more robust than the whole CA in representing
In this section, we first introduce a curve model, and then construct the shape of vein segment VB centered at P (x, y). However, it is still a
a set of spatial curve filters. Considering vein variation in shape, we nontrivial task how to select a suitable sub-curve from CA, since the
define a variable inferior arc-curve model as curve lengths should vary with the vein diameters. This motivates us to
adopt a common way to make a curve CA more flexible.
⎛ sin α ⎞
2 ⎛ cos α ⎞
2
Imaginably, replacing CA by a Gaussian-like curve CA, as shown in
C ( x , y , κ , α ) = ⎜x − ⎟ + ⎜y + ⎟ − κ −2,
⎝ κ ⎠ ⎝ κ ⎠ (1) Fig. 7(b), is undoubtedly desirable for effectively weakening the
dissimilarities between a local vein curve and a curve model. Hence,
where κ and α respectively denote the curvature and the direction of a a SCF with a Gaussian-like curve can be obtained conveniently by
tangent line at the center point. The scope of C (x, y, κ , α ) is here
f mn (x, y) |LP × LP = f mn (x, y)|LP × LP ·Gmn (x, y)|LP × LP , (3)
constrained by the inferior arc-curve length LP, as shown in Fig. 3.
Thus, under LP constraint, given a curvature κm and an orientation αn, where Gmn (x, y)|LP × LP is a 2D Gaussian-like model defined as
we can obtain different arc-curves, as shown in Fig. 4.
s2 ⎛ s 2 (x 2 + y 2 ) ⎞
Using C (x, y, κ , α ) as constrain, a spatial curve filter with LP × LP Gmn (x, y)|LP × LP = exp ⎜ − ⎟,
size is defined as 2πLP2
⎝ 2LP2 ⎠ (4)
⎧1, C (x, y, κm, αn ) = 0 where s is a scale factor determining the 2D Gaussian shape. Here, for
f mn (x, y)|LP × LP = ⎨ . convenience, f mn (x, y) |LP × LP defined by Eq. (3) is called a Gaussian
⎩ 0, otherwise (2)
weighted SCF (GWSCF). Some GWSCFs are listed in Fig. 8. Comparing
Fig. 8 with Fig. 5, we can clearly see that f mn (x, y) |LP × LP is more
Hence, let M and N be the numbers of curvatures and orientations
reasonable than f mn (x, y)|LP × LP in vein information exploration.
respectively, for a given curve length LP, a set of SCFs with M × N can
From the above discussion, it should be noted that the properties of
be generated accordingly by varying κm and αn. For illustration, we list
f mn (x, y) |LP × LP are jointly determined by four parameters, κm, αn, s and
some SCFs with a LP × LP window size in Fig. 5.
LP. Given a LP, we are able to make a GWSCF fitting a local curve best
It should be noted that a filter f mn (x, y) with a fixed LP × LP window
by adjusting κm, αn and s. However, using GWSCFs with a fixed curve
size usually can not perform well in curve-like ridge detection, as
length is undoubtedly unsuitable for venous region exploration, since
shown in Fig. 6. Using two CLFs (α1 = 0 o , α2 = 90 o ) with κ = 0.2 and
the diameters of vein vessels are changeable in biological tissues.
LP=15 respectively filter an image shown in Fig. 6(a) in horizontal and
vertical directions, we can clearly see from Fig. 6(b) and (c) that the two
filtered ellipses are both distorted severely. Hence, in order to make the 3.3. Curve length field estimation
curve length LP locally and adaptively match the real finger-vein ridges,
LP should be estimated pixelwise over a finger-vein image. In this section, a new scheme is reported to assign a suitable curve
length pixelwisely to each point in a finger-vein image. For estimating
I LP reasonably, we should begin with vein-width computation. In [11],
y a curvature-based method had been proposed to compute the widths of
C(x , y, κ ,α) finger veins. This method works well for estimating the widths of clear
veins, but it often fails for many low contrast veins. Here, a new
P α method is proposed for implementing finger-vein width estimation.
x By applying an adaptive local threshold method proposed in [14], a
κ coarse finger-vein network is first extracted, as shown in Fig. 9(b).
Then, the curvatures of cross-sectional profiles are computed over the
LP segmented image. For a given cross-sectional profile, some pairs of
Fig. 3. The proposed curve model. The shape of this model is determined by three local maximum curvatures (LMCs) with two up and down zero cross-
variables: curvature κ, orientation α and curve length L. ings, as shown in Fig. 9(c), are detected sequentially, and the distance
36
J. Yang et al. Pattern Recognition 66 (2017) 34–43
Fig. 4. A set of fixed-length curves with different curvatures and orientations. (a) 0°, (b) 45°, (c) 90°, (d) 135°, (e) 180°, (f) 225°, (g) 270°, (h) 315°.
Fig. 5. A set of spatial curve filters. Top: SCFs with same curvature and orientation but
different curve lengths. Middle: SCFs with same curve length and orientation but
different curvatures. Bottom: SCFs with same curvature and curve length but different
Fig. 7. A diagrammatic sketch for illustrating the spatial differences.
orientations.
Fig. 6. Spatial curve filter transformation. (a) A synthetic image. (b) The filtered result
using a SCF at 0°. (c) The filtered result using a SCF at 90°.
37
J. Yang et al. Pattern Recognition 66 (2017) 34–43
Fig. 9. Vein-width estimation. (a) An original image. (b) Adaptive finger-vein segmentation. (c) The curvature of a cross-sectional profile corresponding to a dark line in (b).
Fig. 10. Vein width estimation result. (a) An original finger-vein image. (b)The used finger-vein segmentation result. (c) Wh (x, y). (d) Wv (x, y). (e) W (x, y) . (f) Vein width estimation
result using the method proposed in [11].
38
J. Yang et al. Pattern Recognition 66 (2017) 34–43
Fig. 12. Orientation field estimation. (a) An original image. (b) The negative of (a). (c) ω (x, y) .(d) β (x, y). (e) Orientation field estimated by [24].
where Umn (x, y) represent the adaptive transform result, I (x, y) denotes problem based on VVF, since POC measure is sensitive to two vector
the negative version of I (x, y) and the symbol “·” denotes the product fields from different individuals. Assume that ⎯→ ⎯ν (x, y) and ⎯→
1
⎯ν (x, y) are
2
operator. Using I (x, y) to substitute I (x, y) arises from that the veins two VVFs, and F1 (u , v ) and F2 (u , v ) represent their 2D DFT, according
appear dark curves in the original imageries. to the property of Fourier transform, that is,
Assume that P (x, y) is a point in I (x, y), Umn (x, y) must be maximum ⎯→
⎯ν (x, y)○⎯→
⎯ν (x, y)⟺F (u , v ) F (u , v ),
(11)
in a local LP × LP block when αn and κm simultaneously and locally 1 2 1 2
match the orientation and the curvature of a finger-vein ridge at point where “○” denotes a 2D correlation operator, we can compute the cross
P (x, y). Therefore, we define phase spectrum as
⎧ ω (x, y) = max Umn (x, y)|LP × LP F1 (u , v ) F2 (u , v )
⎪ αm, κn R (u , v ) =
= e j θ (u , v ) .
⎨ n , ∥ F1 (u , v ) F2 (u , v )∥ (12)
⎪ β (x, y) = arg max Um (x, y)|LP × LP
⎩ αm ∈[0,2π ) (9)
Let r (x, y) = IDFT(R (u , v )), thus, r (x, y) is a POC function or measure.
where ω (x, y) represents the maximum value of all filtered results of The POC measure has a sharp peak when two VVFs are similar,
P (x, y), and β (x, y) denotes an orientation field corresponding to whereas it will be near zero for those from different classes, as shown in
ω (x, y). Some results are shown in Fig. 12. Fig. 14. Moreover, POC measure is insensitive to image shift and
Imaginably, for a given finger-vein ridge, β (x, y) is more reliable noises. Detailed description about POC can be found in [25,26].
than ω (x, y) in vein course description, and ω (x, y) is more discrimi-
native than β (x, y) in vein network variation. This is because pixels 5. Experiments
with different vein-width values may be similar in β (x, y) but different
in ω (x, y), as shown in Fig. 11(b), (c) and (d). Here, an image database containing 2040 finger-vein images from
Hence, ω (x, y) together with β (x, y) is desirable for finger-vein 68 individuals is used for performance testing. In this database, each
primitive information representation. Based on this consideration, we individual contributes 30 forefinger-vein images of the right hand. All
define images are 8-bit gray images with a resolution of 320×240, and
→ captured using a homemade image acquisition system at different
ν (x, y) = ω (x, y) e−j β (x, y), (10)
sessions, as shown in Fig. 1.
where j = −1 , and → ν (x, y) is called a vein vector field (VVF)
estimated from a finger-vein image. Some VVFs are shown in Fig. 13. 5.1. SCF transform testing
Fig. 13. Vein vector field estimation. Left: The proposed method. Right: Estimation result by [24]. The two close-up images respectively corresponding to the left and the right.
39
J. Yang et al. Pattern Recognition 66 (2017) 34–43
Fig. 14. POC measure. Left: r (x, y) of two same finger-vein images. Right: r (x, y) of two finger-vein images from different classes.
40
J. Yang et al. Pattern Recognition 66 (2017) 34–43
Fig. 18. Curve length variation. Top: LP=5. Middle: LP=9. Bottom: LP=13. Here, s=3, κ = 0.2 , α = kπ /4, k = 0, 1, …, 7.
Fig. 19. Gaussian scale variation. Top: s=2. Middle: s=3. Bottom: s=4. Here, LP=9, κ = 0.2 , α = kπ /4, k = 0, 1, …, 7.
41
J. Yang et al. Pattern Recognition 66 (2017) 34–43
Fig. 21. Transform results of some finger-vein images. Here, α = kπ /4, k = 0, 1, …, 7, and s=3.
42
J. Yang et al. Pattern Recognition 66 (2017) 34–43
curvature and orientation. To make SCFs adaptive to the variations of [13] J. Yang, X. Li, Efficient finger vein localization and recognition, Int’l Conf. on
Pattern Recogn., 2010, 1148-1151.
veins in diameter, we then proposed a new method to estimate a curve [14] J. Yang, J. Yang, Y. Shi, Finger-vein segmentation based on multi-channel even-
length field (CLF). Since the proposed curve model is still inflexible in symmetric gabor filters, Int’l Conf. on Intelligent Computing & Intelligent Systems,
shape though its curvature is changeable, a Gaussian weighting scheme 2009, 500-503.
[15] E. Lee, K. Park, Restoration method of skin scattering blurred vein image for finger
was proposed. With the CLF constrain, we proposed an adaptive spatial vein recognition, Electron. Lett. 45 (21) (2009) 1074–1076.
curve transform for finger-vein ridge information extraction. Based the [16] E.C. Lee, K.R. Park, Image restoration of skin scattering and optical blurring for
proposed transform, we used vein vector fields (VVFs) for finger-vein finger vein recognition, Opt. Lasers Eng. 49 (2011) 816–828.
[17] J.F. Yang, B. Zhang, Scattering removal for finger-Vein image enhancement, IEEE
feature presentation. Experimental results demonstrated that the Int'l Conf. Hand-Based Biom. (2011) 193–197.
proposed method was highly powerful in improving finger-vein match- [18] J.F. Yang, B. Zhang, Y.H. Shi, Scattering removal for finger-vein image restoration,
ing accuracy. Sensors 12 (3) (2012) 3627–3640.
[19] J.F. Yang, Y.H. Shi, Towards finger-vein image restoration and enhancement for
finger-vein recognition, Inf. Sci. 268 (2014) 33–52.
Acknowledgement [20] J. Gu, J. Zhou, A novel model for orientation field of finger-prints, CVPR 26 (2003)
493–498.
This research work is jointly supported by National Natural Science [21] B. Sherlock, D. Monro, A model for interpreting fingerprint topology, Pattern
Recognit. 26 (1993) 1047–1055.
Foundation of China (No. 61379102, No. U1343120, No. 61502498). [22] J. Zhou, J. Gu, Modeling orientation field of fingerprints with rational complex
functions, Pattern Recognit. 37 (2004) 389–391.
References [23] K. Sandberg, The curve filter transform-a robust method for curve enhancement,
Advances in Visual Computinginternational Symposium, 2010, 107-116.
[24] W. Kang, D.F.H. Li, Direct gray-scale extraction of topographic features for vein
[1] J.F. Uhl, C. Gillot, Embryology and three-dimensional anatomy of the superficial recognition, Sci. China Ser. F 41 (2011) 324–337.
venous system of the lower limbs, Phlebology 22 (5) (2007) 194–206. [25] K. Ito, H. Nakajima, K. Kobayashi, T. Aoki, T. Higuchi, A fingerprint matching
[2] V. Zharov, S. Ferguson, J. Eidt, P. Howard, L. Fink, M. Waner, Infrared imaging of algorithm using phase-only correlation, IEICE Trans. Fundam. 87 (2004) 682–691.
subcutaneous veins, Lasers Surg. Med. 34 (1) (2014) 56–61. [26] K. Ito, T. Aoki, H. Nakajima, K. Kobayashi, T. Higuchi, A palmprint recognition
[3] R. Cheng, B. Huang, Y. Wang, H. Zeng, S. Xie, The optical model of human skin, algorithm using phase-only correlation, IEICE Trans. Fundam. E91-A (4) (2008)
Acta Laser Biol. Sin. 14 (2005) 401–404. 1023–1030.
[4] J. Xu, H. Wei, X. Li, G. Wu, D. Li, Optical characteristics of human veins tissue in [27] J.F. Yang, Y.H. Shi, R.O.I. Finger-vein, localization and vein ridge enhancement,
kubelka-munk model at he-ne laser in vitro, J. Optoelectron. Laser 13 (3) (2002) Pattern Recognit. Lett. 33 (12) (2012) 1569–1579.
401–404. [28] J. Yang, M.Wu,W. Y.Wang, Y. Shi, Finger-vein matching based on adaptive vector
[5] D.T. Delpy, M. Cope, Quantification in tissue near-infrared spectroscopy, Philos. field estimation, Int’l Conf. on Image Processing, 2012,145-148.
Trans. R. Soc. Lond. B. 352 (1997) 649–659. [29] D. Guidolin, B. Nico, G. Mazzocchi, A. Vacca, G.G. Nussdorfer, D. Ribatti, Order
[6] A.P. Dhawan, B.D. Alessandro, X. Fu, Optical imaging modalities for biomedical and disorder in the vascular network, Leukemia 18 (2004) 1745–1750.
applications, IEEE Rev. Biomed. Eng. 3 (2010) 69–92. [30] T. Nguyen, M. Unbekandt, U. Fleury, The textural aspects of vessel formation
[7] A.N. Bashkatov, E.A. Genina, V.I. Kochubey, V.V. Tuchin, Optical properties of during embryo development and their relation to gastrulation movements,
human skin, subcutaneous and mucous tissues in the wavelength rang from 400 to Organogenesis 3 (1) (2007) 49–56.
2000 nm, J. Phys. D: Appl. Phys. 38 (2005) 2543–2555.
[8] P. Lv, S. Hai, Image enhancement and feature matching of palmdorsa vein, Jinfeng Yang is currently a Professor at Civil Aviation University of China. He received
Comput. Eng. Des. 28 (2007) 3623–3625. the PhD degree in Pattern Recognition and Intelligent System from the National
[9] C. Mei, X. Xiao, G. Liu, Y. Chen, Feature extraction of finger-vein image based on Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese Academy
morphologic algorithm, Int'l Conf. Fuzzy Syst. Knowl. Discov. (2009) 407–411. of Sciences (CAS), China, in 2005. Msc (2001) and Bsc(1994) respectively from
[10] N. Miura, A. Nagasaka, T. Miyatake, Feature extraction of finger vein patterns Zhengzhou University and Zhengzhou University of light industry, China. His major
based on repeated line tracking and its tracking and its application to personal research interests include machine learning, pattern recognition, computer vision,
identification, March. Visi. Appl. 15 (2004) 194–203. multimedia processing, and data mining. He regularly served as PC members/referees
[11] N. Miura, A. Nagasaka, T. Miyatake, Extraction of finger vein patterns using for international journals and top conferences, including, IEEE TIP, IVC, PR, PRL, ICCV,
maximum curvature points in image profiles, IEICE-Trans. Inf. Syst. (2007) CVPR, ECCV, etc. He is a member of IEEE. He currently serves as syndic of the Chinese
185–194. Society of Image and Graphics, syndic of the Chinese Association for Artificial
[12] Z. Zhang, D. Wu, S. Ma, J. Ma, Muliscale feature extraction of finger-vein patterns Intelligence.
based on wavelet and logical interconnection structure neural network, Int'l Conf.
Neural Netw. Brain 2 (2005) 1081–1084.
43