MPU1024

Research Methods in Education I

Dr. Zairul Nor Deana Md Desa
Email: zairul@utm.my
Section: 3
Mondays, 4:30 7:00
C13 - 112
6/7/2014 1
Class Outline
Variable

Conceptual & theoretical framework

Internal and external validity

Ethics
6/7/2014 2
Different kinds of variables
6/7/2014 3
Variables
An attribute of a person/object being studied with different
levels or values
E.g. Gender, SES, educational level, math/sc achievement,
positive affect and etc.
Independent Variable (IV)
Differing conditions on the subjects (e.g. treatments vs
placebo/control, novice vs expertise)
Characteristics of the subjects in the research (e.g.
demographic characters)
Also known as predictor variables because they predict
DV.
Dependent Variable (DV)
The response or outcome variable.
Different kinds of variables
6/7/2014 4
Other terms for IV and DV
Predictor-criterion, Stimulus-response, Task-performance,
Input-output.
Control variable
A variable that is related to the DV (the influence that need to
be removed/controlled)
Extraneous
A variable that is related to the DV or IV that is not part of
experiment (threatening variable)
Mediator and Moderator
Mediator: A variable that is related to the DV or IV, and explains
the relationship between variables.
Moderator: A variable that is related to the DV or IV and has an
impact on the DV (interacting variable, e.g. gender, race, level
of income) and will change the strength of an effect between
variables.
Different kinds of variables
6/7/2014 5
Continuous, discrete and dichotomous data
Continuous interval, scale or quantitative
E.g. Time, temperature, age, distance, GPA
Dichotomous or discrete nominal, categorical,
qualitative
E.g. Race, type of school, gender

Scale of Measurement for Variable
Labeling system devised by S. S. Stevens to classify
measurement. Different scales of measurement allow
different statistical data analysis.
Nominal, Ordinal, Interval, Ratio
Different kinds of variables
6/7/2014 6
Nominal: Value denotes group membership, but no
information about quantity.
Gender (1 = male, 2 = female), race, religion, experimental
condition, etc.
Ordinal: Value denotes rank order. Distance between values
is not necessarily equal.
Order of finish in a race, questionnaire scale (1 = very happy, 2 =
satisfied, 3 = unhappy), etc.
Interval: Numbers denote magnitude of differences among
observations.
Difference between 30 and 50 degrees is exactly the same as
between 100 and 120 degrees.
No logical zero; zero no more meaningful than any other value.
Ratio: The same as interval, but with a logical zero point. Zero
means absence of.
Height, weight, speed, etc.
Theoretical & Conceptual Framework
6/7/2014 7
What is framework?
A fundamental, basis or abstract structure of meaning
from a written work or literature.
It can be derived from theories and concepts.
What is theory
A set of rules, procedures, principles and assumptions
used to produce a result.
An ideal or hypothetical situation.
What is concept
The highest level of abstraction that convey general
meanings.
Theories and concepts help to stimulate research
and to extent knowledge.
Theoretical & Conceptual Framework
6/7/2014 8

Theory Concept
Theoretical Framework
6/7/2014 9
Consists of rules, procedures, principles and
assumptions.

They are explained within a logical and sequential
format.

To provide a map for interpreting the findings of the
study.

From a loosely-structured framework to something
meaningful and scientifically sound.

It consists of theories and concepts that seem to be
interrelated and systematically viewed.

Conceptual Framework
6/7/2014 10
Consists of constructs or terms for an issue or
phenomenon.

Is a structure of concepts and/or theories which are
pulled together as a map for a study.

To establish connection between facts and
observations.

Example
6/7/2014 11
Self-
esteem
Graduat
e
Program
Student
Profile
Framework:
Graduate Student Career Readiness Program
Theoretical or Conceptual?
Theories on Self-
esteem
(Author, Year)
(Author, Year)
:
Theories on
Graduate Program
and Career
Readiness
(Author, Year)
(Author, Year)
:
Studies on Student
Demographics:
Age, gender, program
mode, type of study,
citizenship, etc.
Validity
6/7/2014 12
Validity is the degree to which a study accurately
reflects or assesses the specific concept that the
researcher is attempting to measure.

A test may be valid for one purpose and not for other
purposes.

Internal validity and external validity.
Face validity
Criterion
Content
Construct
Internal and External validity
6/7/2014 13
Internal Validity
Refers to causal relationship between variables in the
study.

Refers to quality of the experiment which results are used
to manipulated independent variables.

The strength of relationship between IV and DV.

External Validity
External validity refers to the extent to which the results of
a study are generalizable.
How well the results can be generalized in different
setting, times and persons?


Threats to Internal validity
6/7/2014 14
History
A study on a period of time cannot control for events, which occur
during the time, that might influence the DV.
Maturation
Changes caused by biological or psychological forces.
Selection
When the selection is not random but systematic that can induce
bias.
Testing
Pre-tests can affect the performance on measures of the DV.
Instrumentation
Lack of reliably measures, administration technique, scaling or
scoring problem.
Mortality
For a follow-up study when participants are difficult to find (i.e.
drop-out or refuse to participate) that change the nature of the
group.

Threats to External validity
6/7/2014 15
Multiple Treatment Interference
When the unintentional treatment interacts with the
intended treatment.
Reactive Arrangements
Subjects behave differently due to the action they receive
from researcher.
Hawthorne Effect: Special attention is given from the
researchers.
John Henry Effect: Control group tries harder.
Experimenter Effects
Experimenter may sometimes unintentionally influence
the performance of participants in a study.
Rosenthal or Pygmalion Effect: subjects perform in
accordance with researchers expectations.


Basic Principles of Ethical Research
6/7/2014 16
Protection from Harm
Subjects must be prevented from physical and psychological
harm

Maintenance of Privacy
Being anonymous within a research context.
Only the principle investigator can match participant confidential
data to the research findings.
Subjects IDs (i.e. name, IC #, ect) must be kept in a secure
place out of the public eye.

Coercion
Subject should not be forced for whatever reason to participate
in a study.

Basic Principles of Ethical Research
6/7/2014 17
Informed Consent
The goal is to inform the participant.
Informed consent form/letter must be read and signed by each
participant or the person granting participation (e.g. parent,
principal, etc.)
To ensure the participant will not be placed in any danger or
harm.
To explain potential benefits to the project as well as to society.
To assure that the results will be kept in strictest confidence.
A brief explanation on how the subject can get a copy of the
results and how can they ask questions.
Confidentiality
Records cannot be linked with participants identity.
Data is kept in a controlled situation.
Minimize the number of people who see or handle the data.

Next Class
Methodology: population and sampling

Quiz 1 (Week 1 Week 3 Lectures):
MCQ Format
10 15 questions in 15-20 minutes.
In-class, paper-and-pencil test.
6/7/2014 18