Académique Documents
Professionnel Documents
Culture Documents
2013
doi:10.14355/jitae.2013.0204.04
LectureRecordingsinHigherMathematics
Education
UseandImpactonAcademicPerformance
MarcZimmermann*1,AnnikaJokiaho2,BirgitMay3
Instituteofmathematicsandcomputerscience;2,3DepartmentofELearning
UniversityofEducationLudwigsburg,Reuteallee46,71634Ludwigsburg,Germany
1
*1
zimmermann01@phludwigsburg.de;2jokiaho@phludwigsburg.de;3may@phludwigsburg.de
Abstract
This article presented a first explorative study of the
relationshipbetweenthestudentsuseoflecturerecordings
andtheiracademicperformance.Forthispurpose,statistics
ofaccesstotherecordingsoftwolectureswereanalyzedand
thencomparedwiththeresultsofthecorrespondingexamat
the University of Education. Also, students answered a
questionnaireinthewaytheyusedthelecturerecordingsin
theirlearningprocess.Afirstlookatthedataconveyedthe
impressionthatfrequentuseofthelecturerecordingleadsto
worseresultsintheexam.However,atthesametime,there
has been a decrease in the failure rates for courses where
lecturesarerecorded.
Keywords
ICT;Lecturerecordings;HigherMathematicsEducation;Academic
Performance
Introduction
Lecture recordings have already become a regular
feature at many universities around the world
(Blumschein & Vgele, 2005; Verliefde, Vermeyen &
Van Den Bossche, 2010). These are generally made
availableinadditiontoattendingthelectureinperson.
Varioustermsareusedintheliterature:lecturecapture
(Veerami & Bradley, 2008), lecture webcasting
(Traphagan,Kucsera&Kishi,2009),onlinevideolecture
recordings(Wieling&Hofman,2010),webcasting(Deal,
2007 and weblecture (Day, 2008). The term lecture
recordingsisusedinthispaperwhichmeansthevideo
recording of a lecture given by the lecturer, of the
boardandpresentationsslides.
There are now many studies and analyses of lecture
recordings, but these generally only target the way
they are used (e.g. Veeramani & Bradley, 2008), the
influenceoftherecordingsonthelearningmotivation
or on attendance at the lecture (e.g. Traphagan,
Kucsera&Kishi,2009).However,therearehardlyany
studies that examine the effects of lecture recordings
ontheacademicperformance.AtGermanuniversities
150
JournalofInformationTechnologyandApplicationinEducationVol.2Iss.4,Dec.2013www.jitae.org
Anormalvideocameraandaradiomicrophonewere
usedforthefirstlecturerecordings.Thevideocamera
was located at the rear of the lecture hall and the
lecturer,thewritingontheboardandthePowerPoint
presentations were captured on video. Depending on
what was done, the recording focused on what was
mostimportant.Afterthelecture,therecordingswere
processedbyamemberoftheprojectteamandmade
availableonlineontheuniversitywideLMS.Thusthe
students were able to view lecture recordings on the
LMSatanytimeandanynumberoftimes.Inspiteof
compression, the approx. 90minute videos were
approx.150200MBinsize.Thiswasthereasonwhy
the students also wanted the videos to be made
available to download, so that the replay quality did
not depend on the bandwidth of the Internet
connection.
Forfurtherinformationvisithttp://www.lecturnity.co.uk
151
www.jitae.orgJournalofInformationTechnologyandApplicationinEducationVol.2Iss.4,Dec.2013
Table1);thisisalsoshownbytheresultsofHveret
al.(2010)andDeal(2007).
TABLE1ROLEOFLECTURERECORDINGSDURINGTHEPROCESSOF
LEARNINGOFTHESTUDENTS
Roleduringthelearning
process
Noroleatall
Inexchangetothelecture
Forrevieworrepetition
Referencework
Exampreperation
Winterterm
2010/11
n
p%*
52
17%
52
38%
52
42%
52
19%
52
8%
*)percentageswereroundedofftointegers.
UseoftheLectureRecordings
For this purpose, a questionnaire 2 was designed to
investigate the use of lecture recordings in the
students learning process in mathematics. Besides
personaldata,thestudentswerealsotomakearough
estimate of the frequency of use of the recordings.
Alsotheywereaskedtogivedetailsoftheimportance
and role of the lecture recordings in their individual
learning process. The questionnaire consisted of one
page with multiple choice questions. In the summer
semester 2010 a total of 67 students (48 female/ 19
male), in the winter semester 2010/11 52 (33/19)
participatedinthesurveywithanaverageageof22.5
and24.0yearsrespectively.Thesurveywastakenafter
the last lecture of the semester online in the LMS.
Response rates cannot be quoted, because there are
studentsregisteredintheLMSwhichquitattendingto
thelectureafterthefirstweeks.
Inanswertothequestionabouttheroleofthelecture
recordings,thestudentscouldchoosefromfiveitems
describing how they use the recordings in their
learning process, multiple answers were possible.
Admittedly, it is worrying here that a relatively high
number of students (30% and 38%; cf. Table 1) stated
that they use the recordings as a substitute for
attending a lecture. However, the number of
participants attending the lecture personally did not
decrease to this extent during the semester. First and
foremost, the lecture recordings serve to review and
reviseworkaswellaspartlytoprepareforexams(cf.
FIG.1NUMBEROFVIEWSANDDOWNLOADSOFTHE
LECTURERECORDINGSPERWEEKOFTHESUMMER
SEMESTER2010
152
Summerterm
2010
n
p%*
67
34%
67
30%
67
45%
67
18%
67
34%
JournalofInformationTechnologyandApplicationinEducationVol.2Iss.4,Dec.2013www.jitae.org
ensuresthattheauthorscannotdrawanyconclusions
aboutthepersonsconcerned.Thispseudonymizedlist
is then made available to the authors for the
evaluation.
anonymised Logfiles
(TN1, TN2)
KeyKeeper
Inthelastquestion,thestudentswereaskedtoassess
how useful in general the provision of lecture
recordings was in their studies. Here only 3% of the
studentsconsidertheoffertobesuperfluous.Whereas
24%ofthestudentsseetheofferasaniceextra,73%
statedthattheserviceshouldalsobeextendedtoother
courses,especiallyinmathematics.
Department E-Learning
FIG.2PROCESSOFPSEUDONYMISATION
Basedonthecorrelationoftheaccessstatisticsforthe
recordings and the exam grades, the pseudonymized
datacannowbeusedtoexaminequantitativelywhat
effect lecture recordings have on the students
performance. Here the mean values of the data are
compared using a single factor variance analysis
accordingtoSpearmann.
EffectsofLectureRecordingsonAcademicPerformance
Todate,thereareonlyisolatedstudiesoftheeffectsof
offering lecture recordings. The reason for this is
primarily that research in this area frequently comes
up against the constraints of data protection, since
personaldatahavetobeused.WiththeLMSMoodle
used at the University of Education Ludwigsburg, as
with other learning management systems, all user
activitiesforeachcoursearestoredforadministrative
purposes. This data can be viewed exclusively by the
administrators of the learning platform; however, the
datashowsforeachandeverystudenthowoftenthey
viewedordownloadedafileoravideo.Thisdatacan
beanalyzedingreaterdetail,e.g.thenumberoftimes
therecordingsareaccessedcanbecomparedwiththe
correspondingexamresultsattheendofthesemester.
In order to use this data without breaching privacy
lawsandsothatnodeductionscanbemadeaboutany
particular person, a procedure was developed for
pseudonymizing the data (Fig. 2). A neutral person,
the keykeeper, is provided with a list of all the
grades and matriculation numbers. In addition, the
staffofthedepartmentofElearningattheUniversity
of Education Ludwigsburg makes detailed log files
showing access from the LMS along with the
matriculation numbers available to the keykeeper.
Usingthis,alistisgeneratedwithpseudonyms(TN01,
TN02, etc.), the access statistics and the grade. Only
the keykeeper has the key consisting of the
pseudonym and the matriculation number. This
Logfiles with
matriculation number
Exam marks
FIG.3CORRELATIONBETWEENTHENUMBEROFACCESSTO
LECTURERECORDINGSANDEXAMMARKS(COURSE:
INTRODUCTIONINELEMENTARYGEOMETRY)
153
www.jitae.orgJournalofInformationTechnologyandApplicationinEducationVol.2Iss.4,Dec.2013
researchregardingthequestionoftheeffectoflecture
recordings on academic performance. The evaluation
attheUniversityofEducationLudwigsburgpresented
initialresultsformathematicsintheGermanspeaking
regions; however, these results will be investigated
furtherandinamoredifferentiatedwayinthecoming
semesters.
Forthemostpart,theresultsofourstudycorrespond
withthefindingsinsection1.Ontheonehand,lecture
recordings play a role in the lerning processes of the
students, especially for exam preparations and for
review or epetition. Regardning the effects on
academic performance of the lecture recordings, the
mostcorrelationswereneithersignificantnorpositive.
However, our correlations were all weak positive:
good students hardly make any use of the lecture
recordings,weakstudentsusethemmoreoften(cf.Fig.
3 and Fig. 4). Despite of the data, it can not be
concludedthatlecturerecordingshavenegativeeffects
ontheacademicperformance.Leetal.(2004)showed
thattheuseoftherecordingsisassociatedtolearning
strategies of the students. In contrast to weaker
students, good students adopted a deep learning
strategyanddidnotneedthiskindofsupportorhelp
in addition to the lecture. However, weaker students
withamoresurfacestrategyneedthiskindofsupport
fortheirlearningprocesses(Leetal.,2004).Inaddition,
weakerstudentsaremoreattractedtonewtechnology
and use it more often (Allert, 2004). For the time, the
reasons for our positive effects of lecture recordings
remained suppositions, but they were supported by
thelowfailureratesinthecorrespondingexams.
Exam marks
FIG.4CORRELATIONBETWEENTHENUMBEROFACCESSTO
LECTURERECORDINGSANDEXAMMARKS(COURSE:
APPLICATIONORIENTATEDMATHEMATICS)
Atfirstsight,analyzingthecorrelationtendencies,one
can say that the more often a lecture recordings is
watchedbyastudent,theworsehisorherexamgrade
willbe3.However,inouropinion,thiscausalityofthe
datacannotbeinferred.Normally,themoreoftenyou
repeat and recap, or in our case review a content, it
shouldhaveapositiveimpactonthelearningprocess.
With a differentiated view of the data, including the
failure rate in the exams, the causality has to be
disregarded. The failure rate in the exams of both
investigated courses is about 23%, which is relatively
low for mathematics courses at German universities.
InGermanyfailureratesfrom40%upto60%arequite
normal (cf. Heublein et al, 2010). Obviously, lecture
recordingsseemtohelpandsupportweakerstudents
in particular. The exam can be passed successfully,
even if the mark is not good. Without lecture
recording,theexammighthavebeenfailed.Forthese
reasons, a positive effect can be ascribed to lecture
recordings.
Aftertheinitialexperiencesandfurtherdevelopments
regardingthetechnologyandqualityoftherecordings,
this service is now also made available to other
lecturers. This complies with the wishof the majority
ofthestudentsthattheserviceshouldbeextendedto
other lectures, both in mathematics and other subject
areas. In addition, the effect of the academic
performance on exam results should be further
investigated by evaluating other series of lectures.
Further investigations will have to be carried out in
thisdirection,andpossiblyothersubjectareas,should
the indicatedweakcorrelation be confirmed or
become more pronounced in the current and the
coming semesters. Thus the idea is, possibly, to
conduct interviews with students who can provide
further insights into the learning role of lecture
recordings.
Afurtherpossibilityforimprovingtheserviceoffered
to students is the idea that recordings and/or in
InGermanythebestmarkis1.0,theworstis6.0.Normally
yousuccessfullypasstheexambyreaching4.0.
3
154
JournalofInformationTechnologyandApplicationinEducationVol.2Iss.4,Dec.2013www.jitae.org
generalmaterialsthatareofferedasapodcastshould
not serve to entertain the students, but should be
additionally combined with other learning activities
(cf. Edirisingha & Salmon, 2007; Spannagel &
Spannagel, in press). Initial developments go in the
direction of combining the lecture recordings with
wikis, annotation tools and other social applications
(cf.Ketterl,Emden,Mertens&Vornberger,2010).
Web
und
Vorlesungsaufzeichnungen.
In
REFERENCES
ResearchandPracticeinInformationTechnology,Vol26,
(MTEL),Taichung,Taiwan,2010.
2004.
Accessed
August
20,
2013.
http://crpit.com/abstracts/CRPITV26Allert.html
Bescherer,C.andZimmermann,M..LearningMathematics
Education55,2010,313319.
Ross,T.K.andBell,P.D..Nosignificantdifferenceonlyon
Press.
TechnologyandDistanceLearning,4(7),2007,313.
Einsatzszenarien.InWorkshopProceedingsDeLFI2005
Tavangarian,788.Berlin:Logos,2005.
Wiemeyer,.Mnchen:Oldenbourg.(inpress).
Chiu,C.F.,Lee,G.C.andYang,J.H..Acomparativestudy
IASTED
EducationTechResearchDev58(2010):1937.
international
conference
on
Webbased
2006
preferenceforlecturecapture,2008.AccessedMarch8,
2011.
August
learning.pdf.
7,
2013.
http://smartech.gatech.edu/handle/1853/22627.
http://www.uwebi.org/news/uwonline
DidacticScenariosforaneffectiveuseofWeblectures:A
2013.
http://www.cmu.edu/teaching/technology/whitepapers/
LectureWebcasting_Jan07.pdf.
Accessed
https://lirias.kuleuven.be/bitstream/123456789/342412/1/
Accessed
paper_Didactic+scenarios+for+web+lectures.pdf.
August
7,
2013.
https://lra.le.ac.uk/handle/2381/405
July
7,
2013.
Besuch,G..UrsachendesStudienabbruchsinBachelor
155
www.jitae.orgJournalofInformationTechnologyandApplicationinEducationVol.2Iss.4,Dec.2013
JournalofEducationalTechnology,28/2(2012),199213.
156