using online instruments to study “hard to involve” populations in social research fabiola...

15
VIRTUAL PRESENTATION USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata- Argentina [email protected] Aleix Gregori Universitat Rovira i Virgili Tarragona- Spain [email protected]

Upload: moses-white

Post on 25-Dec-2015

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

VIRTUAL PRESENTATION

USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH

Fabiola BaltarUniversidad Nacional de Mar del Plata

Mar del Plata- [email protected]

Aleix GregoriUniversitat Rovira i Virgili

Tarragona- [email protected]

Page 2: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

INTRODUCTION

In business research field, researchers are frequently confronted by the need to collect substantial quantities of empirical data, often from a reluctant population.

Although many authors have discussed about the importance of methodological issues concerning with data collection process to study SMEs, there is not a substantial advance in the application of new technologies, specifically Web 2.0 frame, to reach and research entrepreneurs and small firms.

Thus, we formulate the following exploratory questions:

Page 3: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

INTRODUCTION

QUESTIONS

Is it possible to integrate Web 2.0 technology as a research tool to improve the data collection process in small business research field?

Which are the main attributes of those technologies that favour the involvement of the entrepreneurs in business surveys?

OBJECTIVE

The aim of the study is to explore the advantages and disadvantages of using new technologies for data collection to study SMEs.

Page 4: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

LITERATURE REVIEW

METHODOLOGICAL CONCERNS IN BUSINESS SURVEYS

The literature concentrates on the followings topics:

The attention seeking strategy applied to increase the response rate, such as telephone pre-notifications and personalised strategies.

Strategies applied for questionnaire completion such as the use of university sponsorship, anonymity guarantees, the survey´s format.

Strategies to improve questionnaire returns with follow up techniques.

The relation between incentives and response rate (e.g. monetary, non-monetary and the offer of results).

Page 5: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

LITERATURE REVIEW

RECRUITMENT USING WEB 2.0 FRAME

Ball (2010) found, using a survey sent by Facebook, Twiter and email, that SME´s owners indicate Facebook as the first networking site to develop their businesses.

Social Networking Sites (SNSs) can be an accurate space to improve the results in business surveys. Entrepreneurs who are familiarized with the technology can minimize time costs and increase trust because of the accessibility of the researcher profile and its network.

Virtual snowball sampling not only facilitates the access to “hard to involve” population but also can expand sample size and the scope of the study.

Page 6: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

LITERATURE REVIEW

ADVANTAGES OF ONLINE SURVEYS

Flexibility (e.g. language) and time-efficiency (collect/process data). Questionnaires are more attractive and easier to use. Respondents can answer at a convenient time for themselves. Researcher instantaneously has all the data stored in a data base. Surveys can include all kinds of questions (dichotomous, scales). Lower costs. It is easier to follow-up non respondents. Respondents answer in the order intended by the study designer. Respondents answer only questions that are specifically design to

them.

Page 7: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

LITERATURE REVIEW

DISADVANTAGES OF ONLINE SURVEYS

The perception that the mail is a “spam”, which increases the non response rate.Selection bias concerning internet population (gender, age, education level, socioeconomic level, etc).The sample selection methods are “volunteer” samples. Respondent lack of online experience.Unclear answering instructions because online questionnaires are self-administered. Impersonal. There is usually no human contact in online surveys. Privacy related with how data will be used. Some studies reflect that there is a low response rate of many online surveys.

Page 8: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

METHODOLOGY

We explored 52 virtual groups.

We contacted their members sending them private messages.

We extended the sample size, asking each member if they knew anyone else (online or offline contact).

We obtained 1103 responses (53.2%), of which 343 were entrepreneurs (31%).

An online questionnaire was sent to these entrepreneurs, of whom 218 answered (63.5%).

Sample Response Non response TOTALFacebook snowball sampling 1023 (53,6%) 887 (46,4%) 1910 (100%)

Traditional snowball sampling 80 (49,1%) 83 (50,9% 163 (100%)TOTAL 1103 970 2073

Type of question Frequency %Dichotomies 21 41.2One option 14 27.5Multiple options 7 13.7Likert 4 7.8Open questions 5 9.8Total 51 100

Page 9: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

RESULTS

a) PROFILES OF SMEs OWNERS

Group Frequency %

I: Highly educated male entrepreneurs with more than 42 years old 76 34.8

II: Low educated entrepreneurs (either sex and age) 64 29.3

III: Highly educated male entrepreneurs with less than 42 years old 36 16.5

IV: Female entrepreneurs (either age and education) 42 19.2

Total 218 100

Profiles of entrepreneurs according to age, education and sex variables

Source: Self-elaboration

In the sample obtained with Facebook we could identify four heterogeneous groups basically defined by sex and education level.

Page 10: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

RESULTS

B) THE ENVIRONMENT OF SURVEY ADMINISTRATION

Time Frequency %Working hours 96 43.8Spare time hours 123 56.2Total 219 100

Comparison of surveys completed in working hours vs. spare time hours

Source: Self-elaboration

56.2% of entrepreneurs have completed the survey in their spare time. Furthermore, 83.5% have completed them the first time they entered to the survey. In this regard, we consider that this is a good contribution of Facebook as a contact space because people mainly use it in their free time.

For example, lunch time, early morning and late night are the most common moments used to complete them. It is interesting to remark that women have a greater propensity to answer the survey in their working hours than male entrepreneurs.

Page 11: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

RESULTS

C) PROFILES OF THE ENTREPRENEURS AND DATA QUALITY

Group 0 to 15% 15.1% to 50% More than 50% Total

I: Highly educated male entrepreneurs with more than 42 years old

80,3% 11,8% 7,9% 100,0%

II: Low educated entrepreneurs (either sex and age) 82,8% 10,9% 6,3% 100,0%

III: Highly educated male entrepreneurs with less than 42 years old

91,7% 5,6% 2,8% 100,0%

IV: Highly educated women entrepreneurs (either age) 71,4% 23,8% 4,8% 100,0%

Total 177 28 13 218

81,2% 12,8% 6,0% 100,0%

The entrepreneurs profile and the quality of response

Source: Self-elaboration

Differences in the level of response are not statistically significant among groups. However, the quality of information is higher in questionnaires sent by highly educated young entrepreneurs than in other groups. Even though results confirm that there is a propensity to make a better use of these technologies in a targeted population, they do not constitute a technological barrier for the rest (81.2% of the questionnaires have been completed successfully in at least 85% of the questions).

Page 12: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

RESULTS

D) THE TYPE OF FIRMS AND DATA QUALITY

Time * Technology based firms Non-technology based firms Total

1 to 10 minutes 12.9% 8.2% 21.1%

11 to 15 minutes 32.3% 25.2% 57.5%

16 a 25 minutes 27.4% 36.7% 64.1%

More than 25 minutes 12.9% 15% 27.9%

Did not complete 11.3% 10.9% 22.2%

Non response 3.2% 4.1% 7.3%

Total 64 154 218

Comparison of time spent to complete the survey according to the type of business

Source: Self-elaboration. * X2: 18.640; df:10; Asymp sig: 0.045. Al 95%

This result shows that there are statistical differences between the minutes spent answering by technology-based firms and that spent by traditional ones . However this variable does not affect the quality of data because the level of non response rate and not finished questionnaires are similar in both groups.

Page 13: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

CONCLUSIONS The level of non response rate is lower than the average rate presented in business studies.

Although we found that young entrepreneurs with high education level and operating in technology based-sectors are more familiarised with the use of online technologies, there are not statistical differences with the rest in terms of quality of the information and the level of non response rate among groups.

The main attribute that favours involvement of this reluctant population is the close relation reached using Facebook as the environment of contact, especially avoiding intermediation and allowing entrepreneurs to access in their free time.

Facebook can increase the level of confidence because entrepreneurs can access to private information of the researcher and his network (age, university and workplace).

However, we consider that many issues associated with external validity of results must be considered and further explored.

Page 14: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

BIBLIOGRAPHYBall, L. (2010), “How small business owners use Facebook”, [online]:http://www.roundpeg. biz/wp-content/uploads/2010/11/FrontPage4.pdf.Baruch,Y. and Holtom, B. (2008), “Survey response rate levels and trends in organizational research”, Human Relations, 61(8): 1139-1160.Bavdaz, M.; Drnovsek, M. and Lotric Dolinar, A. (2009), “Achieving a response from fast-growing companies: The case of Slovenian gazelles”, Economic and Business Review, 11 (3): 187-203.Cycyota, C.S. and Harrison, D.A. (2006), “What (not) to expect when surveying executives”, Organizational Research Methods, 9: 133-160.Dennis, W. J. (2003), “Raising Response Rates in Mail Surveys of Small Business Owners: Results of an Experiment”, Journal of Small Business Management, 41: 278-295.Greer, T. V.; Chuchinprakam, N. and Seshadri, S. (2000),“Likelihood of Participating in Mail Survey Research: Business Respondents’ Perspective”, Industrial Marketing Management, 29(2): 97-109.Newby, R., Watson, J. and Woodliff, D. (2003), “SME Survey Methodology: Response Rates, Data Quality, and Cost Effectiveness”, Entrepreneurship Theory and Practice, 28: 163–172. Porter, S.R. (2004), “Raising response rates: What works?”, New Directions for Institutional Research, 121: 5–21.Simsek, Z. and Veiga, J.F. (2001), “A primer on internet organizational surveys”, Organizational Research Methods, 4: 218-35.

Page 15: USING ONLINE INSTRUMENTS TO STUDY “HARD TO INVOLVE” POPULATIONS IN SOCIAL RESEARCH Fabiola Baltar Universidad Nacional de Mar del Plata Mar del Plata-

THANK YOU FOR THE ATTENTION