Digital Photo Processing

LinZHANG,SSE,2013
Lecture2
DigitalImageFundamentals
LinZHANG,PhD
SchoolofSoftwareEngineering
Tongji University
Spring2013
LinZHANG,SSE,2013
Contents
Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels
LinZHANG,SSE,2013
ElementsofVisualPerception
Structureofthehumaneye
sclera
choroid
blindspot
visualaxis
LinZHANG,SSE,2013
Threemembranesenclosetheeye:thecorneaandsclera,
choroid,andretina
Atitsanteriorextreme,thechoroidisdividedintotheciliary body
andtheiris;thelatercontractsorexpandstocontroltheamountof
lightthatenterstheeye
LinZHANG,SSE,2013
Whentheeyeisproperlyfocused,lightfromanobject
outsidetheeyeisimagedontheretina
Twokindsoflightreceptorsdistributeontheretina,cones androds
Conesareprimarilylocatedinthecentralportionoftheretina,
calledfovea andaresensitivetocolor;theyfunctionbestin
relativelybrightlight;so,conevisioniscalledbrightlightvision
Rodsaredistributedovertheretinalsurface;rodsservetogivea
generaloverallpictureofthefieldofview;theyarenotinvolvedin
colorvisionandaresensitivetolowlevelsofillumination;rodvision
iscalleddimlightvision
Aroundtheregionoftheemergenceoftheopticnerve,thereisno
receptorsandresultsinthesocalledblindspot
LinZHANG,SSE,2013
Structureofthehumaneye(moreonconecell)
Humansusuallyhavethreekindsofconeswithdifferent
photopsins,whichhavedifferentspectralresponsecurves;
thus,wehavetrichromatic vision.
Interestingly,somepeoplehavefourormoretypesof
cones,givingthemtetrachromatic vision
LinZHANG,SSE,2013
Threetypesofcolorsensitiveconesintheretinaofthehumaneye,
correspondingroughlytored,green,andbluesensitivedetectors.
LinZHANG,SSE,2013
LinZHANG,SSE,2013
Structureofthehumaneye(moreonrodcell)
Rodcell
LinZHANG,SSE,2013
Structureofthehumaneye(moreonrodcell)
Wavelengthresponsivenessofrodscomparedtothatofthree
typesofcones.Thedashedgraycurveisforrods.
LinZHANG,SSE,2013
Distributionofrodsandconesintheretina
LinZHANG,SSE,2013
Drawanimagesimilartothatbelowonapieceofpaper(the
dotandcrossareabout6inchesapart)
Closeyourrighteyeandfocusonthecrosswithyourlefteye
Holdtheimageabout20inchesawayfromyourfaceand
moveitslowlytowardsyou
Thedotshoulddisappear!
Blindspotexperiment
LinZHANG,SSE,2013
Imageformationintheeye
Muscleswithintheeyecanbeusedtochangetheshapeof
thelensallowingusfocusonobjectsthatarenearorfar
away
Animageisfocusedontotheretinacausingrodsandcones
tobecomeexcitedwhichultimatelysendsignalstothebrain
C istheopticalcenterofthelens
LinZHANG,SSE,2013
HumaneyeVScamera
VS
Lens
Iris
Retina
Related
components?
LinZHANG,SSE,2013
Perceivedbrightnessisnotasimplefunctionof
intensity
Visualsystemtendstoundershootorovershootaroundthe
boundaryofregionsofdifferentintensities,calledas
Mach bands
Aregionsperceivedbrightnessdoesnotonlydependsimply
onitsintensity,butonitssurroundingregions;sucha
phenomenoniscalledsimultaneouscontrast
LinZHANG,SSE,2013
intensity
AnexampleofMachbands
LinZHANG,SSE,2013
intensity
LinZHANG,SSE,2013
intensity
Anexampleofsimultaneouscontrast
LinZHANG,SSE,2013
intensity
LinZHANG,SSE,2013
intensity
LinZHANG,SSE,2013
Opticalillusions:ourvisualsystemsplaylotsof
interestingtricksonus
Itisstillynotfullyunderstoodyet
LinZHANG,SSE,2013
LinZHANG,SSE,2013
Contents
LinZHANG,SSE,2013
LightandtheElectromagneticSpectrum
Lightisjustaparticularpartoftheelectromagnetic
spectrumthatcanbesensedbythehumaneye
Theelectromagneticspectrumissplitupaccordingto
thewavelengthsofdifferentformsofenergy
LinZHANG,SSE,2013
Thecolours thatweperceivearedeterminedbythe
natureofthelightreflectedfromanobject
Inadditiontofrequency,threebasicquantitiesare
usedtodescribethequalityofachromaticlightsource
Radiance.Itisthetotalamountofenergythatflowsfromthe
lightsource,measuredinWatts
Luminance.Givesameasureoftheamountofenergyan
observerperceives,measuredinlumens
Brightness.Itisasubjectivedescriptoroflightperception
thatispracticallyimpossibletomeasure
LinZHANG,SSE,2013
electromagneticwave
spectralpower
distribution
spectralpower
distribution
reflectance
spectrum
Red
LinZHANG,SSE,2013
Contents
LinZHANG,SSE,2013
ImageSensingandAcquisition
Imagecreationbasedontwofactors
Illuminationsource
Reflection orabsorption ofenergyfromthatsourcebythe
elementsofthescene beingimaged
Any examples for
these two kinds?
LinZHANG,SSE,2013
Imagingsensors
Singleimagingsensor
Linesensor
Arraysensor
Singleimagingsensor
LinZHANG,SSE,2013
Imagingsensors
Singleimagingsensor
Linesensor
Arraysensor
Linesensor
Application
scenario?
LinZHANG,SSE,2013
Imagingsensors
Singleimagingsensor
Linesensor
Arraysensor
Arraysensor,usedinordinarydigitalcamera
LinZHANG,SSE,2013
Image acquisiton using a linear sensor strip and a circular sensor strip
Imagingsensingusingsensorstrips
LinZHANG,SSE,2013
Anexampleofthedigitalimageacquisitionprocess
Imagingsensingusingsensorarrays
LinZHANG,SSE,2013
Contents
LinZHANG,SSE,2013
ImageSamplingandQuantization
Samplingandquantizationwillconvertacontinuous
imagesignalf toadiscretedigitalform
Digitizingthecoordinatevaluesiscalledsampling
Digitizingtheamplitudeiscalledquantization
LinZHANG,SSE,2013
LinZHANG,SSE,2013
Resultofimagesamplingandquantization
LinZHANG,SSE,2013
Representingimages
LinZHANG,SSE,2013
Spatialresolution
Thespatialresolutionofanimageisdeterminedbyhow
samplingwascarriedout
DPI(dotsperinch)isusedtomeasurethespatialresolution
Note:tosaythatanimagehasaresolution1024*1024
isnotameaningfulstatementwithoutstatingthe
spatialdimensionsencompassedbytheimage
LinZHANG,SSE,2013
Spatialresolutionanexample
LinZHANG,SSE,2013
LinZHANG,SSE,2013
LinZHANG,SSE,2013
LinZHANG,SSE,2013
LinZHANG,SSE,2013
LinZHANG,SSE,2013
Intensityresolution
Intensityresolutionreferstothesmallestdiscerniblechange
inintensitylevel
Themoreintensitylevelsused,thefinerthelevelofdetail
discernableinanimage
Thenumberofbitsusedtoquantizeintensityisoftenreferred
astheintensityresolution
Number of Bits
Number of Intensity
Levels
Examples
1 2 0, 1
2 4 00, 01, 10, 11
4 16 0000, 0101, 1111
8 256 00110011, 01010101
16 65,536 1010101010101010
LinZHANG,SSE,2013
Intensityresolution
7bpp
6bpp 5bpp
4bpp 3bpp
2bpp 1bpp
8bitsperpixel
LinZHANG,SSE,2013
Imageinterpolation
Itisabasictoolusedintaskssuchaszooming,shrinking,
rotating,andgeometriccorrections
Traditionalmethodsincludenearestneighbor,bilinear,and
bicubic
n
e
a
r
e
s
t
n
e
i
g
h
b
o
u
r
b
i
l
i
n
e
a
r
LinZHANG,SSE,2013
Contents
LinZHANG,SSE,2013
SomeBasicRelationshipsbetweenPixels
Neighborsofapixel
p(x, y) isapixel
p
N
4
(p): 4neighbours
ofp
p
N
D
(p): diagonal
neighboursofp
p
N
8
(p): 8neighbours
ofp
LinZHANG,SSE,2013
Adjacency
LetV:Setofgraylevelvaluesusedtodefineconnectivity;
e.g.,V={1}.
4adjacency:twopixelsp andq withvaluesinV are4
adjacentifq isinthesetN
4
(p)
8adjacency:twopixelsp andq withvaluesinV are8
adjacentifq isinthesetN
8
(p)
madjacency(mixedadjacency):(modificationof8ato
eliminatemultipleconnections)twopixelsp andq with
valuesinV aremadjacentif
(i)q isinN
4
(p) or
(ii)q inN
D
(p) andN
4
(p) N
4
(q) hasnopixelswhosevalues
arefromV
LinZHANG,SSE,2013
Adjacencyexamples
011
010
001
Anarrangementofpixels8adjacencymadjacency
011
010
001
011
010
001
LinZHANG,SSE,2013
Connectivityandregions
LetS representasubsetofpixelsinanimage
For,thesetofpixelsthatareconnecttoitinS iscalled
aconnectedcomponent ofS;ifS hasonlyoneconnected
component,S iscalledaconnectedset anditisalsoaregion
TworegionsR
i
andR
j
aresaidtobeadjacent iftheirunion
formsaconnectedset;otherwise,theyaredisjoint
p S
110111
101011
110011
R
i
R
j
Note:whentalkingabout
regionsadjacency,the
adjacencytypeshouldbe
mentioned
LinZHANG,SSE,2013
Boundary
BoundaryofaregionR isthesetofpointsthatareadjacentto
pointsinthecomplementofR (innerborder)
Outerborder istheborderofinthebackground(toguarantee
theborderfollowingalgorithmswillformaclosedpath)
Usually,adjacencybetweenpointsinaregionandits
backgroundisdefinedintermsof8connectivity
000
010
010
010
010
000
Theinnerborderofthe1valuedregion
doesnotformaclosedpath,butitsouter
boundarydoes
LinZHANG,SSE,2013
Distancemeasures
Forpixelsp,q,andz,withcoordinates(x, y),(s, t),and(v, w),D
isadistance function ormetric if
(a)
(b) ,and
(c)

( , ) 0 ( , ) 0, D p q D p q iff p q
( , ) ( , ) D p q D q p
( , ) ( , ) ( , ) D p z D p q D q z
Euclideandistance

1/2
2 2
( , ) ( ) ( )
e
D p q x s y t
LinZHANG,SSE,2013
Distancemeasures
(a)
(b) ,and
(c)

( , ) 0 ( , ) 0, D p q D p q iff p q
( , ) ( , ) D p q D q p
( , ) ( , ) ( , ) D p z D p q D q z
D
4
distance(cityblockdistance,orManhattandistance)
4
( , ) D p q x s y t
p
1
1
1
1
2
2
2
2
2
2
2
2
LinZHANG,SSE,2013
Distancemeasures
(a)
(b) ,and
(c)

( , ) 0 ( , ) 0, D p q D p q iff p q
( , ) ( , ) D p q D q p
( , ) ( , ) ( , ) D p z D p q D q z
D
8
distance(Chessboarddistance)

8
( , ) max , D p q x s y t
p
1
1
1
1
2
2
1
1
2
1
2
1
2
2 2 2
2
2
2 2 2
2
2
2
LinZHANG,SSE,2013
Summary
Wehavelookedat:
Nexttimewestarttolookattechniquesforimage
enhancement
LinZHANG,SSE,2013
Thanksforyourattention

Digital Photo Processing

Transféré par

Informations du document

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

Digital Photo Processing

Transféré par

Droits d'auteur :

Formats disponibles

LinZHANG,SSE,2013

Vous aimerez peut-être aussi