Research approaches in education

Week 2, 25-31 Feb 2013

Pre-activity questions

• What would be the differences between quantitative and qualitative approaches?

• What are the types of quantitative approach?• How you distinguish experimental research from non-

experimental research in quantitative approach?• What are similarities & differences between experimental

and ex post facto research?• How you differ independent and dependent variables in

experimental research?• What would be the different between basic and applied

research?

Objectives

• At the end of class, students are expected to:– Define the difference between methods &

methodology– Distinguish quantitative from qualitative

research– Identify types of quantitative research– Identify the differences between types of

quantitative research– Describe common stages in reserach

Method vs. Methodology

• Research methods may be understood as all those methods/techniques that are used for conduction of research. They refer to the methods the researchers use in performing research operations. In other words, all those methods which are used by the researcher during the course of studying his research problem are termed as research methods.

• Research methodology is a way to systematically solve the research problem. It may be understood as a science of studying how research is done scientifically. In it we study the various steps that are generally adopted by a researcher in studying his research problem along with the logic behind them. It is necessary for the researcher to know not only the research methods/techniques but also the methodology. Researchers not only need to know how to develop certain indices or tests, how to calculate the mean, the mode, the median or the standard deviation or chi-square, how to apply particular research techniques, but they also need to know which of these methods or techniques, are relevant and which are not, and what would they mean and indicate and why. Researchers also need to understand the assumptions underlying various techniques and they need to know the criteria by which they can decide that certain techniques and procedures will be applicable to certain problems and others will not.

• From what has been stated above, we can say that research methodology has many dimensions and research methods do constitute a part of the research methodology. The scope of research methodology is wider than that of research methods. Thus, when we talk of research methodology we not only talk of the research methods but also consider the logic behind the methods we use in the context of our research study and explain why we are using a particular method or technique and why we are not using others so that research results are capable of being evaluated either by the researcher himself or by others

(Khotari, 7-8)

Research approaches used in Education

1. Quantitative research

2. Qualitative research

3. Mix-methods research

Quantitative, Qualitative & Mix-Method Approaches

– Quantitative approach involves the generation of data in quantitative form which can be subjected to rigorous quantitative analysis in a formal and rigid fashion.

– Qualitative approach to research is concerned with subjective assessment of attitudes, opinions and behaviour

– Mix-Method Approaches refer to research that combine quantitative and qualitative approaches

Comparison of Quantitative and Qualitative Research

Quantitative Qualitative

Purpose To study relationships, cause and effect

To examine a phenomenon as it is, in rich detail

Design Developed prior to study Flexible, evolves during study

Approach Deductive; tests theory Inductive; may generate theory

Tools Uses preselected instruments

The researcher is primary data collection tool

Sample Uses large samples Uses small samples

Analysis Statistical analysis of numeric data

Narrative description and interpretation

Quantitative Research

• Can be classified into two types– Experimental

• True experiment• Quasi experiment

– Non-Experimental• Ex post facto• Correlation• Survey/Descriptive

Experimental Research

• Experimental research involves a study of the effect of the systematic manipulation of one variable on another variable.

• The manipulated variable is called the experimental treatment or the independent variable.

• The observed and measured variable is called the dependent variable

• Independent variable Dependent variable changes

True vs. Quasi Experiment

• To have a “true” experiment, researchers must use a random process such as a coin toss to assign available subjects to the experimental treatments. With random assignment, each subject has an equal and independent chance of being assigned to any group; thus, the assignment is independent of the researcher’s personal judgment or the characteristics of the subjects themselves

• Sometimes, however, researchers cannot randomly assign subjects to experimental treatments for a study. Instead, as in the preceding example, the experimenter must use already assembled groups such as classes. In this case, the research is called quasi-experimental

Non-experimental Research

• In non-experimental quantitative research, the researcher identifies variables and may look for relationships among them but does not manipulate the variables

Ex post facto research• Ex post facto research is similar to an experiment, except the

researcher does not manipulate the independent variable, which has already occurred in the natural course of events.

• The researcher simply compares groups differing on the preexisting independent variable to determine any relationship to the dependent variable.

• Because there is no manipulation or control of the independent variable, one must be very careful regarding the conclusions that are drawn about any observed relationship

e.g. What is the effect of part-time work on school achievement of high school students?

Correlational research

• Correlational research gathers data from individuals on two or more variables and then seeks to determine if the variables are related (correlated).

• Correlation means the extent to which the two variables vary directly (positive correlation) or inversely (negative correlation). The degree of relationship is expressed as a numeric index called the coefficient of correlation

Ex post facto vs. Correlational research

Similarity:• Both ex post facto and correlational research investigate

relationships between variables.

Difference(s):• The major distinction between the two is that in ex post

facto research one categorizes the participants into at least two groups on one variable and then compares them on the other variable.

• In correlational research, a researcher deals with one group of individuals measured on at least two continuous variables

Survey research

• Survey research (also called descriptive research) uses instruments such as questionnaires and interviews to gather information from groups of individuals.

• Surveys permit the researcher to summarize the characteristics of different groups or to measure their attitudes and opinions toward some issue

Qualitative Research (For Research on ELT 2)

• Basic Interpretative studies• Case studies• Document or content analysis• Ethnography• Grounded theory• Historical research• Narrative inquiry• Phenomenological studies• (Action Research)

Basic Interpretative studies

• A basic interpretative study provides descriptive accounts targeted to understanding a phenomenon using data that might be collected in a variety of ways, such as interviews, observations, and document review. The purpose is to understand the world or experience of another.

• These are the most simple and most common qualitative studies. Describing how teachers perceive their role in selecting curriculum is an example.

Case studies

• A case study is a type of ethnographic research study that focuses on a single unit, such as one individual, one group, one organization, or one program. The goal is to arrive at a detailed description and understanding of the entity (the “case”). In addition, a case study can result in data from which generalizations to theory are possible.

Document or content analysis

• Content analysis focuses on analyzing and interpreting recorded material to learn about human behavior. The material may be public records, textbooks, letters, films, tapes, diaries, themes, reports, or other documents.

Ethnography

• Ethnography is an in-depth study of naturally occurring behavior within a culture or social group. Social scientists sometimes call ethnography field research because it is conducted in a natural setting or “field.” The researcher observes group behavior as it occurs naturally in the setting, without any simulation or imposed structure. Ethnography requires a variety of data-gathering procedures, such as prolonged observation of the setting, interviewing members of the culture, and studying documents and artifacts. Researchers interpret the data in the context of the situation in which they gathered the data.

Grounded theory

• Grounded theory research is designed to develop a theory of social phenomena based on the field data collected in a study. Experience with the data generates insights, hypotheses, and questions, which researchers pursue with further data collection.

• From an inductive analysis of the data, the researcher constructs concepts. He or she then forms a theory by proposing plausible relationships among the concepts. The theory is thus said to be grounded in the data

Historical research

• Historical research analyzes documents, and artifacts and/or uses interviews with eyewitnesses to gain insight into past events. The success of historical research depends on the accuracy and completeness of the source material. The researcher must establish the authenticity of the documents used, as well as the validity of their contents.

Narrative inquiry

• In narrative inquiry, researchers examine the stories people tell about their lives and co-construct a narrative analysis of those stories. The researcher and those telling their stories have an equal voice in determining the meanings attributed to the experiences. Narrative analysis has also been referred to using terms such as life stories. A researcher investigating teacher reflection or teacher pathways into teaching might use narrative inquiry approaches.

Phenomenological studies

• Phenomenological studies begin with the assumption that multiple realities are rooted in subjects’ perspectives. Thus, an experience has different meanings for each person. Through unstructured interviews, the investigator explores the subject’s thoughts and feelings to elicit the essence of an individual’s experience.

• A phenomenological study might be conducted to answer the questions, “What is the relationship like between a beginning teacher and his or her mentor?” and “What does the experience mean to the beginning teacher?”

Summary 1

• Qualitative vs. Quantitative

Typical stages in research

1. Selecting a problem. 2. Reviewing the literature on the problem3. Designing the research4. Collecting the data5. Analyzing the data6. Interpreting the findings and stating

conclusions7. Reporting results

(Don’t be confused with)Research proposal

• Title

• Introduction

• Literature review

• Research problem/questions/objectives

• Research Significance

• Research methods

• References

1. Selecting a problem.

• The first step is to select the problem to investigate. Also, the answer to the problem is not already available, but the means for finding answers are available.

• Quantitative researchers typically state the problem in the form of a specific question about the relationship between variables.

2. Reviewing the literature on the problem.

• Researchers should thoroughly review the relevant literature to gain more understanding and insight into the problem and to determine what research may already have been done.

• The beginning researcher will likely turn to the literature for help in locating and formulating a researchable problem

3. Designing the research

• The investigator next plans how to conduct research to answer the question.

• The design is the researcher’s plan for the study, which includes the method to be used, what data will be gathered, where, how, and from whom.

• Quantitative researchers maintain that once this research plan is set forth, it must be followed.

4. Collecting the data.

• The next step involves executing the research plan. Quantitative researchers use a wide variety of instruments to gather data, including tests, questionnaires, ratings, and attitude scales.

• Qualitative researchers also have a toolbox of data-gathering techniques, including in-depth interviewing, participant observation, and document analysis.

5. Analyzing the data.

• The data collected in research must be analyzed. Quantitative data are usually in the form of numbers that researchers analyze using various statistical procedures. Even verbal data, such as compositions written by high school students, would be converted through the scoring process to a numerical form.

• The analysis of the numerical data in quantitative research provides evidence that supports or fails to support the hypothesis of the study.

• Qualitative data generally take the form of words (descriptions, observations, impressions, recordings, and the like).

6. Interpreting the findings and stating conclusions

• The researcher next tries to interpret the findings in terms of the research problem.

• The quantitative researcher typically makes statements about the probability that such a finding is due to chance and reaches a conclusion about the hypothesis.

• Qualitative researchers present their interpretations and explanations in narrative form. They do not talk about probability but try to emphasize the trustworthiness and credibility of the findings

7. Reporting results

• Researchers must make their procedures, findings, and conclusions available in a form intelligible to others who may be interested.

• This involves clearly and concisely presenting the steps in the study in sufficient detail so that another person can replicate it.

Types of Questions in E.RThe specific question chosen for research, of course, depends on the area that interests the researchers, their background, and the particular problem they confront. However, we may classify questions in educational research as:

1. Theoretical (having to do with fundamental principles). Research with a theoretical orientation may focus on either developing new theories or testing existing theories.

2. Practical (designed to solve immediate problems of the everyday situation). Many questions in educational research are direct and practical, aimed at solving specific problems that educators may encounter in everyday activities. These questions are relevant for educational research because they deal with actual problems at the level of practice and lead to an improvement in the teaching–learning process.

Basic & Applied research 1. Basic research is research aimed at obtaining empirical data used

to formulate and expand theory.

Basic research is not oriented in design or purpose toward the solution of practical problems. Its essential aim is to expand the frontiers of knowledge without regard to practical application

2. Applied research aims to solve an immediate practical problem. It is research performed in relation to actual problems and under the conditions in which they appear in practice.

Through applied research, educators can often solve their problems at the appropriate level of complexity—that is, in the classroom teaching–learning situation. Although applied research may solve some specific question, it may not provide the general knowledge to solve other problems.

Types of questions & basic/applied research

Do you find any relationships between theoretical/practical questions and basic/applied research?

Other issues…

• Construct – Constitutive definition– Operational definition

• Variables– Independent– Dependent

• Constant

These topics would be discussed later!

Summary 2

• Stages of research

Resources

• Ari, D., Jacobs, L. C., Sorensen, C. & Razavieh, A. (2010). Introduction to Research in Education. Belmont: Wadsworth

• Khotari, C. R. (2004). Research Methodology: Methods and Techniques. New Delhi: New Age International Publishers

Next Topic!

• Topic:– Research problem.

• Recommended reading(s):– Chapter 3, from Ari, D., et.al. (2010). Introduction to

Research in Education.

– Resources can be downloaded from www.englishprog-untirta.wikispaces.com/est