12-2010-writing & evaluating mm

7/28/2019 12-2010-Writing & Evaluating MM

1/5

1

Today's Plan

! Planning the next few weeks

!

Talk about writing and evaluating mixed methodsresearch (including the structure of your classproject papers)

! Examine the structure of a few mixed methodsstudies

! Share your project research questions and analysisplans

2

Upcoming Schedule

! April 13: Reflections on mixed methods! Read: MMReader: Ch. 13 & 14

! Student presentations:a. Aaron d. Jolene g. Michele

b. Stu e. Gerard h. Zantel

c. Chandra f. Kathie

! April 20:! All project papers due!

! Student presentations:a. Suzi d. Megan g. Mary

b. Francisco e. Theresa h. Carmen

c. Amy f. Virginia

! April 27:! Student presentations:

a. Sara d. Olha g. Sherry

b. Ted e. Debbie h. Meryem

c. Rosemary f. Sai

Mixed Methods

ResearchEDPS 936

Chapter 8 -- Writing and

Evaluating Mixed Methods

Research

44

Writing and evaluating

! General writing guidelines for mixed methods

research! How to organize the structure of a mixed

methods research report

! Ways to evaluate the quality of a mixed

methods study


2/5

55

General writing guidelines

! Write with proper grammar, syntax, and scholarly style

! Consider your audience

! Educate the reader about mixed methods by includingdefinitions, methodological references, and signposts such as

a purpose statement and a mixed methods research question

! Provide a logical story: give a reason for needing both data

types and link the two datasets

! Consider what point of view you want to use (personal or

impersonal)

! Adapt the writing structure to match the type of manuscript

and the type of design

6

Resources for assistance with

general writing

! UNL's Writing Center! FREE assistance for UNL students!

!

http://www.unl.edu/writing/about/index.shtml

! Locate good proposals, completed dissertations, orpublished journal articles for models

! Learn from feedback you receive; keep your own"writing guide" of issues you need to watch for whenyou write scholarly papers

77

Writing a proposal for a

dissertation or thesis

! Need to convince your advisor and committee that

!

Topic is worth studying! It will be studied in a rigorous fashion

! That you have a complete, well-thought plan that is also

feasible

! You may have to educate them about mixed

methods

! Bring an article from your field of study that used the same

design to your committee meeting

8Creswell & Plano Clark (2007) 8

Outline of the structure of a proposal

for a dissertation, thesis, or study

Title (Foreshadows mixed methods study and type of design)

Introduction The research problem Past research on the problem Deficiencies in past research and one deficiency related to a need to collect both

quantitative and qualitative data The audiences that will benefit from the study

Purpose The purpose of the project and reasons for design type The research questions or hypotheses (order according to timing or priority)

Quantitative research questions/hypotheses Qualitative research questions Mixed methods research question

Philosophical Foundations (worldview and assumptions for using mixedmethods and type of design)

Literature Review (include quantitative, qualitative, and mixed methods

studies, if they are available)


3/5

9Creswell & Plano Clark (2007) 9

Outline of the structure of a proposal for a

dissertation, thesis, or study (cont.)

Methods Definition of mixed methods research The type of design used and its definition Challenges in using this design and how they will be addressed

Examples of using the type of design (in your field, if possible) Reference to and inclusion of a procedural diagram in appendix Quantitative data collection and analysis Qualitative data collection and analysis Mixed methods data analysis procedures Validity approaches (quantitative, qualitative, and mixed methods research)

Potential Ethical Issues

Researchers Resources and Skills

Timeline for Completing the Study

References

Appendices with instruments/protocols/procedural diagram

10

Outline of the structure for a mixed

methods journal article

Title (foreshadows the mixed methods research and design)

Introduction Statement of a problem or issue

Literature on the research problem or issue (focused on establishing the need forstudying the research problem or issue)

Deficiencies in previous studies (incorporate need for collecting both quantitativeand qualitative data)

Audiences for the study Purpose statement (written using script that applies to type of design) Research questions (order according to timing and priority)

1. Quantitative questions or hypotheses2. Qualitative questions3. Mixed methods questions

Related Literature Review (optional, depending on priority; a broad literature reviewabout the topic of the study that narrows the focus to the specific issue or problemof the proposed study)

Outline of the structure for a mixed methods journal article (cont.)

Methods

Type of research design used and definition of mixed methods

Type of mixed methods design used (define, give reasons for using design, cite

studies using design in field)

Diagram of procedures included as a figure or appendix

Data collection (order quantitative and qualitative collection methods based on timing

and priority)

Data analysis (order quantitative and qualitative analyses based on timing and

priority)

Validity

Results

Two models

1. Merge results in Triangulation or Embedded concurrent design (sometimes we

see separate reports of quantitative and qualitative results, with merging in

the discussion section)

2. Report results in sequence (qualitative followed by quantitative in Exploratory;

quantitative followed by qualitative in Explanatory)

Discussion

Summarize results (merged, embedded, connected)

Explain results

Limitations Future research

12

Outline of the structure for a NIH

proposal narrative (new format!)

A. Specific Aims (Limit to one page) Goals of the proposed research (include a mixed methods purpose statement with quantitative questions or

hypotheses, qualitative questions, and mixed methods questions). Mention the impact the proposedresearch will have on the content field as well as the mixed methods literature. Discuss reasons for usingmixed methods research and how the study will advance understanding of mixed methods research.

Specify objectives of the proposed research (include objectives that will be accomplished through the mixedmethods design).

B. Research Strategy (6 or 12 pages, depending on proposal type)(a) Significance (mention how mixed methods will enhance the study of the problem)

Explain the importance of the problem or critical barrier to progress in the field that the proposed projectaddresses.

Explain how the proposed project will improve scientific knowledge, technical capability, and/or clinicalpractice in one or more broad fields.

Describe how the concepts, methods, technologies, treatments, services, or preventative interventionsthat drive this field will be changed if the proposed aims are achieved.

(b) Innovation (mention the innovative use of mixed methods as an approach) Explain how the application challenges and seeks to shift current research or clinical practice paradigms. Describe any novel theoretical concepts, approaches or methodologies, instrumentation or

intervention(s) to be developed or used, and any advantage over existing methodologies,instrumentation or intervention(s).

Explain any refinements, improvements, or new applications of theoretical concepts, approaches ormethodologies, instrumentation or interventions.


4/5

13

Outline of the structure for a NIH

proposal narrative (cont.)

(c) Approach Describe the overall strategy, methodology, and analyses to be used to accomplish the

specific aims of the project. Include how the data will be collected, analyzed, andinterpreted as well as any resource sharing plans as appropriate. Include:

- Overall approach (mixed methods) and definition of mixed methods research

- Type of mixed methods design used (define, give reasons for using design, cite studiesusing design in field)

-Diagram of procedures (may include as appendix)-Data collection (order quantitative and qualitative collection methods according to design)-Data analysis (order quantitative and qualitative analyses according to design)-Validity (quantitative, qualitative, and mixed methods)-Discuss potential difficulties and limitations of the proposed procedures (include the

challenges to the design and how they will be addressed)-Provide a tentative sequence or timetable for the project (include this timetable in the

mixed methods diagram)

Discuss potential problems, alternative strategies, and benchmarks for successanticipated to achieve the aims.

If the project is in the early stages of development, describe any strategy to establishfeasibility, and address the management of any high risk aspects of the proposed work.

Point out any procedures, situations, or materials that may be hazardous to personneland precautions to be exercised.

Add preliminary studies for new applications (these studies can include research thatuses quantitative, qualitative, and mixed methods approaches). Add in experiences andcompetence of the researchers (include individual and team skills in quantitative,qualitative, and mixed methods research).

1414

Structure of Mixed Methods

Study by Design

! Explanatory sequential design

! Data collection quan, then qual

! Results - quan, then qual

! Conclusions quan, then qual, then integration

! Exploratory sequential design

! Data collection qual, then quan

! Results qual, then quan

! Conclusions qual, then quan, then integration

! Concurrent designs

! Data collection quan, then qual or qual, then quan

! Results integration of qual and quan

! Conclusions integration of qual and quan

1515

Evaluating a mixed methods

study

! Does the study meet the definition of mixed

methods?! Does the study demonstrate rigorous mixed

methods research?

! Does the report include advanced mixedmethods features consistent with a design?

! Were the procedures sensitive to thechallenges of using the design?

16

Activity

! Let's apply these ideas to examine the writing structure of andevaluate a few mixed methods studies

! If you are using a concurrent approach:

! Examine: MM Reader chapter 15 or 18

! If you are using a sequential QUAN! QUAL approach:! Examine: MM Reader chapter 20

! If you are using a sequential QUAL! QUAN approach:! Examine: D&CMMR Appendix D or MM Reader chapter 22

! If you are using a methodological approach:

! Examine: MM Reader chapter 10 or 5


5/5

Sharing your data analysis plans

12-2010-writing & evaluating mm

Documents