make better decisions usually business decisions build theory understand the world better

32
The Scientific Method

Upload: kelsie-biswell

Post on 14-Dec-2015

214 views

Category:

Documents


1 download

TRANSCRIPT

  • Slide 1

Slide 2 Make better decisions Usually business decisions Build theory Understand the world better Slide 3 Determine what the question is Find out what has been learned in the past Identify areas of insufficient knowledge Choose a method to fill in the gaps Carefully construct a means to gather data on the question Carry out the data collection method and organize the data Evaluate the data that have been collected Make a provisional statement about the original question Evaluate the process and the new knowledge to determine whether additional research is necessary Slide 4 Determine what the question is Slide 5 This seems pretty straightforward at first. You might need to make a business decision You might need to choose one or another medical treatment You might want to decide which movie to go see However, many times we are fairly uncertain about the nature of the problem at hand. You are not understanding your math homework whats the problem? Slide 6 We may have only a vague notion what it is we want to study. Why do people choose one TV show over another? Why do some teens take to the Internet while others dont? What are the effects of exposure to hip-hop? Slide 7 Some questions have many different dimensions. What is the impact of gender on video game use? Choice of games Gameplay Likelihood of buying Console preference Gratifications received Slide 8 Just about any question can be approached many different ways Cognitive Attitudinal Social Economic Political Aesthetic Slide 9 The most common and most significant mistake in social science is to skimp on the development of the question. Once a researcher gets to the point where she is choosing measures and methods, there is no saving a poorly-developed question. Slide 10 Determine what the question is Find out what has been learned in the past Slide 11 Efficiency Dont reinvent the wheel. Gain insights from those who have studied the topic in the past Appropriate theory Research method effectiveness Slide 12 How? Complete a literature review What literature should I review? It depends partly upon the question However, some literature is better than other literature Refereed journals Edited books Government publications Slide 13 There may be data already available that can answer your question but has not yet been used for that purposeSave time and money Omnibus surveys The main problem is that these studies rarely have exactly the data you want Theres a tradeoff between money savings and quality of the data for your purpose Slide 14 Determine what the question is Find out what has been learned in the past Identify areas of insufficient knowledge Slide 15 If the information available in the literature is not adequate to meet your needs, you will need to generate new information that can be brought to bear on your question May need to localize the information Local ratings May need to apply knowledge about one medium to another May need to choose between competing theories Nature v. nurture Slide 16 Determine what the question is Find out what has been learned in the past Identify areas of insufficient knowledge Choose a method to fill in the gaps in our knowledge Slide 17 Methods are more or less appropriate depending on the question asked and the conditions the research is carried out under Studying childrens learning from Sesame Street Finding out what kinds of content will be most effective in getting people to vote for Rand Paul Figuring out what types of online video content generates the most sales Slide 18 Experiment Laboratory or natural Survey Distribution methods Observation Text analysis Content analysis or qualitative textual analysis Slide 19 Determine what the question is Find out what has been learned in the past Identify areas of insufficient knowledge Choose a method to fill in the gaps Carefully construct a means to gather data on the question Slide 20 The development of an actual, real-world study takes careful planning and attention to detail Many decisions have to be made, some of which seem rather trivial but can have an important impact on the final outcome. Should I use a four-point or five-point scale? Should I show the film in the subjects homes or in a lab? How large a sample should I take? Does it need to be random? Slide 21 Determine what the question is Find out what has been learned in the past Identify areas of insufficient knowledge Choose a method to fill in the gaps Carefully construct a means to gather data on the question Carry out the data collection method and organize the data Slide 22 A lot of things can go wrong with even a well- planned study when it enters the field. Your clips may have a screwed-up soundtrack. There may be someone in the house who is disruptive during a survey interview. Some spectacular event in the news may heavily color questions on a related topic. Weather could cause delay or cancellation of focus groups. You may plan poorly and introduce error into your own study You could fail to treat all subjects equally Slide 23 You have to be careful in handling the data not to either lose or fail to record important information Its easier to do than you think Especially in field studies Always, always, always back your data and codebook up Slide 24 Determine what the question is Find out what has been learned in the past Identify areas of insufficient knowledge Choose a method to fill in the gaps Carefully construct a means to gather data on the question Carry out the data collection method and organize the data Evaluate the data that have been collected Slide 25 This is the analysis portion of your study Hypothesis testing Statistical analysis In some cases you will engage in more inductive and/or subjective analyses Slide 26 While many researchers spend a great amount of time applying advanced and complicated statistical analyses to their data, fairly simple and straightforward analysis procedures can be just as effective Slide 27 Determine what the question is Find out what has been learned in the past Identify areas of insufficient knowledge Choose a method to fill in the gaps Carefully construct a means to gather data on the question Carry out the data collection method and organize the data Evaluate the data that have been collected Make a provisional statement about the original question Slide 28 Did the data support your hypotheses? Its not always entirely clear. If the hypotheses are stated statistically, you can usually say yes or no (though people try to cheat). If they are not, then theres quite a bit of interpretation to do in evaluating the fit of the data to a particular theory or set of concerns. If youre partly right and partly wrong, what do you do? Slide 29 Determine what the question is Find out what has been learned in the past Identify areas of insufficient knowledge Choose a method to fill in the gaps Carefully construct a means to gather data on the question Carry out the data collection method and organize the data Evaluate the data that have been collected Make a provisional statement about the original question Evaluate the process and the new knowledge to determine whether additional research is necessary Slide 30 Heres where you go back and with the benefit of hindsight determine for yourself whether the study you did ended up providing you with new that is sufficient or whether you need to engage in further study (keeping in mind the additional cost of additional research) Slide 31 You also speculate as to how what you have learned fits into the larger picture What does it all mean, anyway? Your write-up should include your conclusions and recommendations for further research Slide 32 Having identified the further needs for research in the area of study you have set up a base for the next round of explication The process continues