May Ng – PME 802

Data Collection Methods and Analysis of Learning Buddies Network

Key Evaluation Data Collection Methods Type of Data Collections Data Analysis (reviewing data to
Questions (Collecting a wide range of (Quantitative or Qualitative) answer research questions)
information about the evaluand)

1) How has the program *Direct Source (purposive sampling of focus Quantitative Data Look at the results of controlled group with
group) no LBN support verses the focus group
contributed to -observations Count # of participants and tally up results of who has gotten support (2x a week for 4
improving academic - interviews controlled group vs LBN focus group. weeks)
progress for the -questionnaires Track sheets from data base Interpret quantitative data to see
buddies? -assessments on math & reading assessment results.
comprehension questions Qualitative Data
Look for trends, themes & patterns of
*Archival data Ask teachers, mentors, LBN staff, parents and improvement in the focus group
collection from LBN buddies regarding observations on progress for
-past records &other artifacts focus group Interpret qualitative data by identifying
-look for past assessments Participant evaluation survey common themes, trends & pattern

Record findings from both data collections

2)How has the program *Direct Source Quantitative Data Identify commonalities in the data
-observations, interviews & information
helped with improving
questionnaires/surveys (demographics, Count # of questionnaires/surveys on from
mentors' and learning participation, satisfaction of programs) mentors & participants & family/friends Look for descriptive feedback on self-
buddies' self-esteem, esteem, self-efficacy, responsibility &
self-efficacy, Qualitative Data motivation
*Archival data Make sense of the observations, interviews and
responsibility and collection from LBN staff Participant evaluation survey Interpret data to see patterns, trends &
motivation? themes to see changes in behavior and
*Indirect Source Record findings from both data collections attitudes
-ask families and friends

*Direct Source Quantitative Data Interpret data on program performance

3) To what extent were -observations, interviews &
questionnaires/surveys of LBN staff, Count # of questionnaires/surveys on from LBN Examine records present and past
the program goals and stakeholders like Board of Directors and staff, stakeholders, Board of Directors and
objectives met? Funding Agencies agencies Interpret external statistics and surveys
from government agencies
May Ng – PME 802
*Archival data Collect longitudinal data
collection from LBN staff, Board of Qualitative Data Discuss findings with clients, participants,
Directors, and stakeholders
Make sense of the descriptive data; tally up #
*Indirect Source questionnaires/ surveys
-other organizations with similar LBN
program profile Record results from both data collections

*Direct Source
4)How to sustain the -observations, interviews &
questionnaires/surveys (demographics,
level of participatory participation, satisfaction of programs)
activities and success Interpret mentors and buddies’ surveys and
rate in this program? *Archival data
past reports from LBN staff
*Indirect Source
-ask families and friends; other organizations
with similar profile
Quantitative Data
Count # of past participants since 2008 to
present time
Count # satisfaction surveys/questionnaires
Qualitative Data
Read upon the past LBN reports and findings
compare success rates of other organizations
Interpret data and analyze trends, themes,
patterns from the beginning of the program
till now.
questionnaires
Review on all information collected from
attendance records to satisfaction surveys

Sources:

Data Collection Methods video: https://www.youtube.com/watch?v=NJ-gW6adQTc

Qualitative and Quantitative Data video: https://www.youtube.com/watch?v=dwFsRZv4oHA

Data Collection and Analysis for Impact Evaluation Video: https://www.youtube.com/watch?v=HFGVJJMDo4I
E-text: Huey-Tsyh, C. (2005). Practical program evaluation: Assessing and improving planning, implementation, and effectiveness. Thousand Oaks, CA:
Sage Publications.
o Approaches to Qual Data Analysis.pdf

o Qualitative Data Analysis StAR_Toolkit.pdf