research method chp 1 to 9

31
CHp 1 Ch- 1 : Introduction to Research 1.1. The Excitement of research and Why Managers Should Know about Research: With good understanding of the research good computer skills, a manager can face decision situations involving many sophisticated variables. 1.What is Research? Research is the systematic and scientific process of inquiry into a problem with the purpose of finding a solution for it. 4 3. Types of Business Research: 3.1 Applied Research: It is undertaken to resolve a problem currently faced by an organization. It is specifically focused on a current issue. 3.2 Basic Research or Fundamental Research: The primary purpose of basic research is to generate more knowledge and understanding of the phenomenon of interest and to create theories from research results. Results and theories of basic research can then be applied to other situations. 4. Managers and Research Through research managers can understand , predict and control events and behaviors in their environment. 2 2. Business Research Managers encounter problems that need solutions. Business research is a systematic and organized effort to investigate such problems. 2.1 Definition of Research Business Research is defined as an organized, systematic, data-based, critical, objective, scientific inquiry or investigation into a specific problem, undertaken with the purpose of finding answers or solutions to it. The research is based on (i) Primary data: Gathered first hand for the given problem (ii) Secondary data : Already available (company records, industry reports, publications, or on the net). 3 Introduction to Research Data Types: (i) Quantitative Data (structured questionnaire), (ii) Qualitative Data (observation, interviews, open-ended questionnaire). 2.2 Research and Manager Research investigation covers, accounting , finance , management , and marketing , or an interrelated issue. Problems must be analyzed in the context of external environment (economic, political, demographic, technological, competitive). 5 4.1 Benefits of Research and Research Methods for Managers: Because of research and research methods, managers can: 1. Identify and effectively solve minor problems. 2. Differentiate between good and bad research. 3. Understand the multiple influences and multiple effects of complex factors in the environment. 4. Take calculated risk in decision making, based on known probabilities of various outcomes. 5. Prevent influence of people with vested or personal interests. 6. Relate to hired consultants and researchers more effectively. 7. Combine experience with scientific knowledge when making decisions. 6 5. The manager and the Consultant- Researcher Managers are often required to engage consultants or researchers to investigate more complex and time- consuming problems. 5.1 How to Locate and Select a Researcher Sources of consultants and researchers; a. Consulting and Research companies (from business directories or the Internet) b. Individual Consultants or Researchers (by reference) c. Universities (research faculties and departments) d. Full-Service Advertising companies (for marketing research)

Upload: preston-union

Post on 01-Nov-2014

9.245 views

Category:

Business


0 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Research method chp 1 to 9

CHp 1

Ch- 1 : Introduction to Research

1.1. The Excitement of research and Why Managers Should Know about Research:

With good understanding of the research good computer skills, a manager can face decision situations involving many sophisticated variables.

1.What is Research?

Research is the systematic and scientific process of

inquiry into a problem with the purpose of finding a solution for it.

4

3. Types of Business Research:

3.1 Applied Research:It is undertaken to resolve a problem currently faced by an

organization. It is specifically focused on a current issue.

3.2 Basic Research or Fundamental Research: The primary purpose of basic research is to generate more

knowledge and understanding of the phenomenon of interest and to create theories from research results. Results and theories of basic research can then be applied to other situations.

4. Managers and ResearchThrough research managers can understand, predict

and control events and behaviors in their environment.

2

2. Business Research

Managers encounter problems that need solutions.

Business research is a systematic and organized effort to investigate such problems.

2.1 Definition of Research Business Research is defined as an organized,

systematic, data-based, critical, objective, scientific inquiry or investigation into a specific problem, undertaken with the purpose of finding answers or solutions to it.

The research is based on (i) Primary data: Gathered first hand for the given problem (ii) Secondary data: Already available (company records, industry reports, publications, or on the net).

3 Introduction to Research

Data Types:(i) Quantitative Data (structured questionnaire),

(ii) Qualitative Data (observation, interviews, open-ended questionnaire).

2.2 Research and ManagerResearch investigation covers, accounting, finance,

management, and marketing, or an interrelated issue. Problems must be analyzed in the context of external environment (economic, political, demographic, technological, competitive).

5

4.1 Benefits of Research and Research Methods for Managers:

Because of research and research methods, managers can:1. Identify and effectively solve minor problems.2. Differentiate between good and bad research.3. Understand the multiple influences and multiple effects of

complex factors in the environment.4. Take calculated risk in decision making, based on known

probabilities of various outcomes.5. Prevent influence of people with vested or personal interests.6. Relate to hired consultants and researchers more effectively.7. Combine experience with scientific knowledge when making

decisions.

6

5. The manager and the Consultant-Researcher

Managers are often required to engage consultants or researchers to investigate more complex and time-consuming problems.

5.1 How to Locate and Select a ResearcherSources of consultants and researchers;

a. Consulting and Research companies (from business directories or the Internet)

b. Individual Consultants or Researchers (by reference)c. Universities (research faculties and departments)d. Full-Service Advertising companies (for marketing

research)

Page 2: Research method chp 1 to 9

7

5.2 The Manager-Researcher Relationship

The manager must take care of the following aspects when dealing with researchers:

a. The manager must inform the researcher of the relevant variables involved in the problem or issue at hand.

b. The manager should provide insights into the problem.c. The manager must clearly identify and explain the roles of

the manager and the researcher in the assignment being undertaken.

d. The manager must clearly identify what kind of information will be made available to the researcher.

e. The manager must identify what type of information and records are confidential or classified and will not be provided to the researcher.

8

5.3 ValuesWhen engaging a researcher or consultant, the

manager should ensure that there is a congruence or match between the value systems of the organization and the consultant company. Specifically, the manager must ensure that:a. The roles and expectations of both parties are made

explicit and understood.b. Relevant philosophies and value systems (organizational

culture) are clearly stated and any constraints or limitations are clearly communicated.

c. A good rapport is established between (i) the manager and the researcher, and (ii) researcher and the employees.

96.1 Internal Consultants/Researchers

Large organizations have their own research departments with in-house capacity to undertake management research.

A. Advantages of Internal Consultants/Researchersa. The Internal Researchers are readily accepted by the employees.b. The Internal Research Team already understands the

organizational structure and culture, reducing the orientation time.c. Internal Researchers are available during implementation of the

recommendations.d. The Internal Research Team costs much less.

B. Disadvantages of Internal Consultants/Researchers a. Internal Researchers may be inhibited in taking an independent

external perspective, and may miss fresh ideas.b. There may be internal coalitions to influence the Internal

Researchers to conceal, distort, or misrepresent facts.c. Internal Researchers may be regarded in low esteem and their

conclusions may not get full value.d. The Internal Researchers may have their own biases because of

being employees of the same organization.

10

6.2 External Consultants/ResearchersExternal consultants/researchers are members of the team hired from outside.

A. Advantages of External Consultants/Researchersa. The External Research Team is more enriched in experience, brings

an outside, independent perspective, and is open to a wider variety of alternatives.

b. The External Research Team, will have knowledge of more sophisticated problem-solving techniques and trained in innovative theories and technologies.

B. Disadvantages of External Consultants/Researchersa. The External Research Teams are very expensive.b. The External Research Team will take a considerable time in

understanding the structure and the culture of the organization. c. External Researchers will charge additional fees for any help in the

implementation process.

11

a. Manager becomes more observant and sensitive to internal and external factors.

b. Manager is more effective in dealing with consultants and researchers.

c. A Manager who fully understands the research process will be able to appreciate the use of modern research technology and research models, such as simulation.

d. Manager better understands the conclusions and recommendations of the researchers.

e. Manager is able to grasp the full scope and depth of the managerial decision making process.

7. Knowledge About Research and Managerial Effectiveness

Ch- 1 : Introduction to Research

8. Ethics and Business ResearchEthics in business research refers to a code of conduct or

expected social norms of behavior. Ethical conduct applies to: (i) the organization sponsoring the research, (ii) employees of the sponsor organization, (iii) researchers and their staff, and, (iv) the respondents who are required to provide data.

In general, ethics in business research require everyone involved to show behavior in good faith, provide required level of attention, subdue ego, and place organizational goals above the personal goals.

Page 3: Research method chp 1 to 9

CHP 2 :-Scientific Investigation

1. Scientific Research

Definition: Scientific Research focuses on solving problems by

following a logical, organized, and rigorous method to identify the problems, gather data, analyze that data, and draw valid conclusions from it.

Decisions based on scientific research are purposive, rigorous and effective.

Scientific Research applies to both basic and applied research.

CH-2: Scientific Investigation

2. The Hallmarks or Main Characteristics of Scientific Research

1. Purposiveness: Scientific Research has a specific goal and

well-defined purpose.

2. Rigor: It means the research involves a good theoretical

base, a good methodology, and carefulness, scrupulousness, and exactitude.

3. Testability: Scientific Research can be used to test logically

developed hypotheses.

4. Replicability: Means results or conclusions drawn are such

that they will withhold in other similar situations over and over again.

3

5. Precision and Confidence: Precision refers to the

closeness of the findings to the “reality” based on the sample. It reflects the degree of accuracy of results of research.

Confidence refers to the probability that our results are

correct. The range in which the research results fall is known as the Confidence Interval. The probability that a certain result will definitely be true at all times is known as the Confidence Level.

6. Objectivity: This implies that the conclusions drawn from

the collected data must be based only on the facts and should not involve subjective or emotional values.

4

7. Generalizability: This means that the results of scientific

investigation will also be applicable with same results to other similar situation in other organizations.

8. Parsimony: This implies that research design should be

meaningful and simple. A more complex, elaborate and cumbersome research model is more difficult to handle in scientific terms.

5

3. Obstacles in Conducting Management Research

It is not possible to conduct 100% scientific research studies. It is due to human behavior being studied. Data collection in the subjective areas of feelings, moods, attitudes and perceptions may not be 100% accurate. Sometimes, the obstacle is due to lack of a representative sample.

1.Observation

3. Theoretical Framework

4.Hypotheses

5. Constructs Concepts andOperational Definitions

6. Research Design

7. Data Collection

8. Analysis of Data

9. Interpretation

of Data

10. Refinement of theory

(Pure Research)Or

Implementation(Applied Research)

The Building Blocks of Scientific Research or The Scientific Model

Page 4: Research method chp 1 to 9

8

4.1 Deduction and InductionDeduction and Induction are the two methods of drawing

conclusions.

a. Deduction: Deduction is a process of arriving at a

conclusion by applying known facts or principles to a specific situation.

b. Induction: Induction is a process in which certain

observations are used to logically establish a general

proposition from which we draw a conclusion.

1. Observation

2. Preliminary Information

Gathering

3. Theory Formulation

4. Hypothesizing

5. Further Scientific Data collection

6. Data Analysis

7. Deduction

5. The Hypothetic-Deductive Method

9

5.1 ObservationManager observes that changes are occurring in the work

environment showing variation in behaviors, attitudes, feelings, communication pattern and styles, work performance and many other variables.

5.2 Preliminary Information GatheringThis involves collecting of information in depth regarding the

observed critical change.

5.3 Theory FormulationIt integrates all the information in a logical manner, so that

the factors responsible for the problem can be conceptualized and tested. The Theoretical Framework is designed to assess the influence of the critical variables on the problem.

CH-2: Scientific Investigation

5.4 HypothesizingA hypothesis is a statement that proposes a possible

relationship or conclusion that can be tested. The research process is undertaken to test this hypothesis.

Inductive Research is used for hypotheses generation.

Deductive Research is used for hypotheses testing.

5.5 Further Scientific Data CollectionFor each variable in the hypothesis, data needs to be

collected scientifically, so that it is valid and reliable. Data on every variable in the Theoretical Framework also needs to be collected.

CH-2: Scientific Investigation

5.6 Data AnalysisThe collected data are statistically analyzed to see if the data

support the hypotheses. Qualitative data (narrative information through interviews, group discussions, observation etc.) and quantitative data (numerical information through structured interviews, questionnaires, human and technology-based observations, etc.).

5.7 DeductionDeduction is the process of arriving at conclusions by

interpreting the meaning of the results of the data analysis, leading recommendations to solve the problem.

12

6. Other Types of Research6.1 Case Studies

Case studies involve in-depth, contextual analyses of similar

situations in other organizations, where the nature and definition of the problem happen to be the same as experienced in the current situation.

6.2 Action ResearchAction Research is used by trained and experienced consultants to bring about a planned change. In Action Research, the researcher begins with a problem that is already identified, and gathers relevant data to provide a tentative problem solution. This solution is then implemented, with the knowledge that there may be unintended consequences as a result of this implementation. The effects are then evaluated, defined, and diagnosed.

Page 5: Research method chp 1 to 9

CHP 3

Ch- 3: TECHNOLOGY AND BUSINESS RESEARCH

1. Information Needs of Business

To run a business, useful, timely, accurate, reliable, and

valid data are needed. When data in their raw from are evaluated, analyzed, and synthesized, useful information is generated for managers.

The methods used to gather, analyze, and synthesize information are becoming more sophisticated due to the immense scope of technology.

Ch- 3 : TECHNOLOGY AND BUSINESS RESEARCH

2. Commonly Used Technologies in Business Research2.1 The Internet

The Internet, is a vast global network of computers.• We can easily download and print secondary data.• We can also conduct computer-interactive surveys very

efficiently with large global audiences.• Specialized companies like Survey Online offer specialized

services to conduct Internet surveys for firms that needinformation of a confidential nature.

• The LAN enables employees with computers in close proximityto share information resources and files, and helps schedule,monitor, and process data from remote locations.

• Search engines are software programs designed to help thesearch on the World Wide Web.

Ch- 3 :TECHNOLOGY AND BUSINESS RESEARCH

2.2 Electronic MailThe Internet allows the exchange of electronic mail

(e-mail), which is the primary mode of business communication. The easy global access to the Internet has enabled all organizations to have access to e-mail. E-mail is inexpensive, almost instantaneous, and has the added advantage of guaranteed delivery.

2.3 The Intranet

The Intranet links internal data networks of the company, but prevents access to others outside the company. It also facilitates data gathering from within the company.

Ch- 3 :TECHNOLOGY AND BUSINESS RESEARCH

2.4 BrowsersThe wide use of the internet is possible due to the enabling features of the browser, which front-ends the web sites and web applications. Browser software (like Microsoft’s Explorer and Netscape) allows even the nontechnical user easy access to and navigation through the web. In a sense, browsers ignited the “Internet revolution.”

2.5 Web SitesOrganizations create web sites to promote their image, communicate with customers, build relationships, share information, offer attractive inducements to prospective customers, provide online purchases by customers. The built-in audit capability and push technology (using cookies) also provides feedback.

Ch- 3 :TECHNOLOGY AND BUSINESS RESEARCH

3. Some Software Used in Business Research3.1 Group Ware

Groupware is software that runs on a network so that teams can work on joint projects. This software is of immense use for efficient and effective completion of specific team projects.

3.2 Neural NetworksNeural Networks are designed to trace patterns in a set of data and generalize from them. This software enables sales forecasts, stock market predictions, employee behavior assessments, etc.

Ch- 3 :TECHNOLOGY AND BUSINESS RESEARCH

3.3 CAM / CADComputer-aided manufacturing (CAM) software helps engineers to design and manufacture components and products. Computer-aided design (CAD) software creates and displays complex drawings with precision enabling experimentation with different designs.

3.4 Enterprise Resource PlanningEnterprise-Resource Planning (ERP) packages offer all-in-one integrated business applications, slowly replacing traditional manufacturing, finance, and order entry applications. ERP packages provide comprehensive solutions.

Page 6: Research method chp 1 to 9

Ch- 3 :TECHNOLOGY AND BUSINESS RESEARCH

3.5 Data Analytic Software ProgramsSoftware programs are available to obtain, store, and analyze raw data collected through surveys, using SPSS, SAS, Excel and the like.Gathering data is facilitated through audit capabilities in software that track and provide information on the extent of usage of any function or feature. Designing questionnaires, collecting data, data analysis, and web and e-mail surveys are facilitated by software programs, including SumQuest or SQ, Survey Software, Professional Quest and Perseus.

Ch- 3 :TECHNOLOGY AND BUSINESS RESEARCH

4. Emerging Applications in Technology4.1 Handheld Devices

The new computer technology using small, cost-effective, handheld devices like the Palm, eases data gathering and immediate analysis. Critical data the wireless devices further increase efficiency.

4.2 Interactive Voice Technology, CD-ROM, and Relational DatabasesThese technological advances help businesses to conduct research. Relational databases can be linked in any desired manner.

Ch- 3 :TECHNOLOGY AND BUSINESS RESEARCH

4.3 Digital WhiteboardsDigital whiteboards allow contents on a board to be copied on to the PC and transmitted electronically to others.

4.4 Group VideoconferencingGroup videoconferencing reproduces the face-to-face meeting effect by using large TV monitors or multimedia projectors.

4.5 Virtual RealityVirtual reality creates 3-D environments in which to create a product in a computer and show it to interested groups with details regarding price, materials, and other relevant information.

4.6 Linkage of PCs to Electronic DevicesLatest technologies available from Microsoft and Sony link PCs and consumer electronic devices. Business transactions, communication, and research can be accelerated many fold.

Ch- 3 :TECHNOLOGY AND BUSINESS RESEARCH

5. Information Systems and Managerial Decision Making

Organizations with expanded functions and growing in size, require good information system. Computerized information systems enable the efficient operation of different subsystems in finance, transportation, marketing, or human resources.

5.1 Data Warehousing, Data Mining andOperations Research

a. Data Warehousing

A data warehouse that serves as the central repository of all data collected from different sources, The data warehouse can be accessed through various on-line analytical processing (OLAP) tools to support decision making. Data warehousing can be described as the process of extracting, transferring, and integrating data from multiple external databases and operating systems.

Page 7: Research method chp 1 to 9

Ch- 3 :TECHNOLOGY AND BUSINESS RESEARCH

b. Data MiningData mining is a strategic tool for reaching new levels of business intelligence. Using algorithms to analyze data in a meaningful way, data mining more effectively leverages the data warehouse by identifying hidden relations and pattern.

c. Operations ResearchOperations Research (OR) or management sciences (MS) is another sophisticated tool used to simplify and clarify complex problems by quantification. OR uses higher mathematics and statistics to solve intricate problems of great complexity relating to inventory, queuing, sequencing, routing, etc.

Ch- 3 :TECHNOLOGY AND BUSINESS RESEARCH

d. Management Information Systems Management Information Systems (MIS), Decision Support System, the Executive Information System, and the Expert System, are good decision making aids.

6. International Dimensions of CyberspaceCyberspace is not free of geographical boundaries or cultural issues. Foreign governments can use the firewall and filtering technology to deter computer hackers. Unregulated cyberspace is a mythical notion. Local laws do indeed govern what can and cannot appear in cyberspace.Copyright laws can also be deemed to be broken.

Ch- 3 :TECHNOLOGY AND BUSINESS RESEARCH

7. Data Storage and Surveillance7.1 Storage of DatabasesData is the lifeblood of companies and should be mirrored live in at least two other locations, or at least backed up on tape and stored in other remote locations.

7.2 Data SecurityIncreasingly, organizations and their information systems are faced with security threats that include computer hacking, computer viruses, Internet fraud, and sabotage. To protect information digital IDs and firewalls are used. Authentication, authorization, and encryption are some basic security methodologies used for this purpose.

Ch- 3 :TECHNOLOGY AND BUSINESS RESEARCH

8. Managerial Advantage of TechnologicalAdvancements

It is important for managers to take full advantage of information technology and software developments. Software technology can be used in the research process for problem identification, theory building, data collection, data analysis, and presentation of results..

Ch- 3 :15

9. Ethics in Handling Information TechnologyUse of technology also imposes certain obligations on the part of its users:

1. It is important that the privacy of all individuals is protected.2. Companies also need to ensure that confidential information

relating to individuals is protected. 3. Care should be taken to ensure that incorrect information is

not distributed in the company. 4. Researchers collecting data should be honest, trustworthy,

and careful in obtaining and recording the data in a timelyfashion.

Page 8: Research method chp 1 to 9

CHP 4

Ch- 4 THE RESEARCH PROCESS

1. The Research Process for Applied and Basic Research

The hypothetico-deductive method has two distinct

aspects: (i) the process of developing the conceptual framework and the hypotheses; and, (ii) the design, including the planning of the actual study, location of the study, the selection of the sample, and collection and analysis of the data.

OBSERVATIONBroad area of research

interest identified

PRELIMINARYDATA GATHERING

InterviewingLiterature survey

NO

PROBLEMDEFINITION

ResearchProblem

delineated

THEORETICAL FRAMEWORK

Variables clearlyIdentified and

labeled

GENERATION OF

HYPOTHESES

SCIENTIFICRESEARCH

DESIGN

DATA COLLECTION,

ANALYSIS, ANDINTERPRETATION

DEDUCTIONHypotheses

Substantiated?Research question

answered?

Yes

ManagerialDecisionMaking

ReportPresentation

ReportWritingDiagram 4.1: The research process

for basic and applied research.

1

119

8

10

765

43

2

5

1.1 Broad Problem AreaThe broad problem area refers to the entire situation

where there is a possible need for research and problem solving. The specific issue might pertain to (1) problems currently existing in an organizational setting that need to be solved, (2) areas that a manager believes need to be improved, (3) conceptual or theoretical issue that needs to be researched to understand certain phenomena, and (4) some research questions that a basic researcher wants to answer empirically.

3

Example 3: Conceptual Issue that Needs to be Researched:

A researcher may undertake basic research to study the phenomenon of punctuality so as to define that concept in

precise terms.Example 4: Empirical Answers: A researcher may want to find answers empirically to the

issue of perceived punctuality versus the actual punctuality and its impact on the consequences for the individuals (psychological stress) and for organizations (poor performance). Such research is done by gathering data and testing the relationships between variables.

4

Example 1: Problem Currently Existing:

A General Manager receives complaints from Supervisory Managers that their subordinate staff is not punctual in attending office. From such statements the General Manager becomes aware that a punctuality-related problem exists. Poor punctuality is a symptom, whereas the true underlying problem may not be known. Research investigation is required to identify the problem and then fix it.

Example 2: Situation Requiring Improvement: If the company has already implemented measures to

ensure punctuality, and some complaints of poor punctuality continue to come in, then it is obvious that the policies are not bringing the full results. Through research, such policies and procedures need to be redefined.

Ch- 4 THE RESEARCH PROCESS

Further Examples of broad problems areas:1. Training programs are perhaps not as effective as anticipated.2. The sales volume of a product is not picking up.3. Minority group members in organizations are not advancing in

their careers.4. The daily balancing of accounting ledgers is becoming a continuing

concern.5. The newly installed information system is not being used by the

managers.6. The introduction of flexible work hours has created more

problems.7. The anticipated results of a recent merger have not been

forthcoming.8. Inventory control is not effective.9. The installation of an MIS keeps getting stalled.10. The management of a complex, multidepartmental team project is

getting out of hand in the R & D department of a firm.

Page 9: Research method chp 1 to 9

Ch- 4 THE RESEARCH PROCESS

1.2 Preliminary Data Collection

1.2.1 Nature of Data to be Gathered

The nature of information needed by the researchers

may be broadly classified as:1. Background information of the organization—that is, the

contextual factors.2. Managerial philosophy, company policies, and other

structural aspects.3. Perceptions, attitudes, and behavioral responses of

organization’s employees or customers.

Ch- 4 THE RESEARCH PROCESS

Secondary data are data that already exist and include

statistical bulletins, government publications, information published or unpublished and available from either within or outside the organization, data available from previous research, case studies and library records, online data, web sites, and the internet.

Primary Data are the data collected first-hand by the

researcher. It includes gathering such information as the perceptions and attitudes of employees by talking to them; by observing events, people, and objects; or by administering questionnaires to individuals.

Ch- 4 THE RESEARCH PROCESS

a. Background Information on the OrganizationIt includes the contextual factors:

1. The origin and history of the company.2. Size in terms of employees, assets, etc.3. Charter—purpose and ideology.4. Location—regional, national, or other.5. Resources—human and other.6. Interdependent relationships with other institutions and the

external environment.7. Financial position during the previous 5 to 10 years, and

relevant financial data.

Ch- 4 THE RESEARCH PROCESS

b. Information on Structural Factors and Management Philosophy

Information on company policies, structure, workflow, management philosophy, and the like can be obtained from the management.

Some of the structural factors are:1. Roles and positions in the organization and number of

employees at each job level.2. Extent of specialization.3. Communication channels.4. Control systems.5. Coordination and span of control.6. Reward systems.7. Workflow systems.

Ch- 4 THE RESEARCH PROCESS

c. Perceptions, Attitudes, and Behavioral ResponsesEmployees’ perceptions of the work and the work environment and their attitudinal and behavioral responses can be recorded in the research process.

(i) Attitudinal factors comprise people’s beliefs about and reactions to the following:1. Nature of the work.2. Workflow interdependencies.3. Superiors in the organization.4. Participation in decision making.5. Client systems.6. Co-workers.7. Rewards provided by the organization, such as pay raises and fringe

benefits.8. Opportunities for advancement in the organization.9. Organization’s attitudes toward employees’ family responsibilities.10. Company’s involvement with community, civic, and other social groups.11. Company’s tolerance of employees’ taking time off from the job.

Ch- 4 THE RESEARCH PROCESS

(ii) Behavioral factors include actual work habits such as

industriousness, extent of absenteeism, performance on the job, etc.

The main idea in gathering information on values, structures, and processes is that these might often reveal the root of the real problem. Once the interviews have been conducted, the various types of information that have been gathered during the interviews are tabulated to determine if there is a discernible pattern in the responses.

Page 10: Research method chp 1 to 9

Ch- 4 THE RESEARCH PROCESS

1.2.2 Literature SurveyLiterature survey is the documentation of relevant

published and unpublished work from secondary sources.

a. Reasons for the literature SurveyAn effective literature survey leads to comprehensive

theoretical framework .

Ch- 4 THE RESEARCH PROCESS

A good literature survey thus ensures that:1. Important variables that are likely to influence the problem

situation are not left out. 2. A clearer idea emerges as to what variables would be most

important to consider (parsimony), why they would be considered important, and how they should be investigated to solve the problem. It helps the development of the theoretical framework and hypothesis for testing.

3. The Problem Statement can be made with precision and clarity.

4. Testability and replicability of the findings of the current research are enhanced.

5. Efforts are not wasted in rediscovering something that is already known.

6. The problem investigated is perceived by the scientific community as relevant and significant.

Ch- 4 THE RESEARCH PROCESS

Conducting the Literature SurveyThe first step in this process involves identifying the various published and unpublished materials. The second step is gathering the relevant information from a library or online sources. The third step is writing up the literature review.

i. Identifying the Relevant SourcesGlobal business information, published articles in

newspaper and periodicals, and conference proceedings, are available on data bases. Computerized databases include bibliographies, abstracts, and full texts of articles on various business topics. Statistical and financial databases are also easily accessible.

Ch- 4 THE RESEARCH PROCESS

Basically, three forms of databases are used when reviewing the literature:

Bibliographic Databases display only the bibliographic

citations, that is, the name of the author, the title of the article (or book), source of publication, year, volume, and page numbers.

Abstract Databases provide an abstract or summary of the

articles.

Full-text Databases provide the full text of the articles.

Ch- 4 THE RESEARCH PROCESS

Online searches provide a number of advantages. Besides saving enormous amounts of time, they are comprehensive in their listing and review of references, and the researcher can focus on materials most central to the research effort.

ii. Extracting the Relevant InformationBibliography: Accessing the online system and getting a printout of all the published works in the area of interest from a bibliographical index will provide a comprehensive bibliography.

Abstracts: The abstract of such articles that seem to be

relevant can then be obtained through the online system.

Full-Text: The full text of articles can then be printed out.

While reading these articles, details can be systematically noted.

Ch- 4 THE RESEARCH PROCESS

iii. Writing Up the Literature ReviewThe documentation of the relevant studies citing the

author and the year of the study is called literature review or literature survey. The literature survey is a clear and logical presentation of the relevant research work done thus far in the area of investigation.

A point to note is that the literature survey should bring together all relevant information in a clear and logical manner instead of presenting all the studies in chronological order. A good literature survey also leads to a good problem statement.

There are several accepted methods of citing references in the literature survey.

Page 11: Research method chp 1 to 9

Ch- 4 THE RESEARCH PROCESS

Problem Definition or Problem Statement is a clear, precise, and succinct statement of the question or issue that is to be investigated with the goal of finding an answer or solution. As mentioned earlier, problem definitions could pertain to (1) existing business problems where a manager is looking for a solution, (2) situations that may not pose any current problem but which the manager feels have scope for improvement, (3) areas where some conceptual clarity is needed for better theory building, or (4) situations in which a researcher is trying to answer a research question empirically because of interest in the topic.

Ch- 4 THE RESEARCH PROCESS

1.3 Problem DefinitionA “problem” could simply indicate an interest in an issue where finding the right answers might help to improve an existing situation.

Definition: A problem is defined as any situation where a gap exists between the actual and the desired ideal states.It is very important that symptoms of problems are not

defined as the real problem.

Antecedent conditions or symptoms lead to a problem;

whereas Consequences are the results of the problem.

Page 12: Research method chp 1 to 9

CHP 5

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

2. VariablesA variable is anything that can take on differing or varying values.

2.1 Types of VariablesFour main types of variables are discussed in this chapter:

a. The dependent variable (also known as the criterion variable).b. The independent variable (also known as the predictor variable).c. The moderating variable.d. The intervening variable.

Variables can be discrete (e.g., male/female) or continuous (e.g., the age of an individual).

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

Independent Variable

Dependent Variable

Diagram 5.1: Variables

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

Managerial values Power distance

Diagram 5.2: Variables

Independent variable Dependent variable

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

Independent Variable (IV)

Dependent Variable (DV)

Diagram 5.3: Moderating Variable

Moderating Variable

(MV)

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

Availability of Reference Manuals

# of Rejects

Diagram 5.3B: Moderating Variable

Interest&

Inclination

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

Page 13: Research method chp 1 to 9

Workforce diversity

Organizationaleffectiveness

Diagram 5.4:Moderating Variable

Managerialexpertise

Independent Variable Dependent variable

Moderating Variable

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

Wil

lin

gn

ess t

o l

ea

rn

Training programsGrowth needs

Diagram 5.5 A: Influence of Independent Variable on Dependent Variable

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

Wil

lin

gn

ess t

o l

ea

rn

Training programs

Diagram 5.5 B: Influence of Interviewing Variable

Effects for those highin growth needs

Effects for those

lowin growth needs

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

Workforcediversity

Organizational

effectiveness

Diagram 5.6: Relationship Between IV, DV & MV

Creativesynergy

Time t₂t₁ t₃

Independent Variable Dependent VariableIntervening Variable

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

Workforcediversity

Organizational

effectiveness

Diagram 5.7: Relationship Between IV, DV, MV

& Interviewing Variable

Creativesynergy

Time t₂t₁ t₃

Independent Variable Dependent VariableIntervening Variable

Managerialexpertise

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

Page 14: Research method chp 1 to 9

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

3. Theoretical FrameworkThe theoretical framework is the foundation on which the entire research project

is based. It is a logically developed, described, and elaborated network of associations among the variables deemed relevant to the problem situation and identified through such processes as interviews, observations, and literature survey. Experience and intuition also guide in developing the theoretical framework.

The relationship between the literature survey and the theoretical framework

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

3.1The Components of the Theoretical Framework

There are five basic features that should be incorporated in the theoretical framework.1. The variables considered relevant to the study should be clearly identified and

labeled in the discussions.2. The discussions should state how two or more variables are related to one another.

This should be done for the important relationships that are theorized to exist among the variables.

3. If the nature and direction of the relationships can be theorized on the basis of the findings of previous research, then there should be an indication in the discussions as to whether the relationships would be positive or negative.

4. There should be a clear explanation of why we would expect these relationships to exist. The arguments could be drawn from the previous research findings.

5. A schematic diagram of the theoretical framework should be given so that the reader can see and easily comprehend the theoretical relationships.

Communication among Cockpit members

Communication betweenGround control and cockpit

Decentralization

Training of cockpit crew

Air-safetyviolations

Independent Variables Dependent Variable

Diagram 5.8: Schematic diagram for the theoreticalframework in Example 5.13.

Communication among Cockpit members

Communication betweenGround control and cockpit

Decentralization

Training of cockpit crew

Air-safetyviolations

Independent variables Dependent variable

Diagram 5.9: Schematic diagram for the theoretical framework including the intervening variable.

NervousnessAnd

diffidence

Intervening variable

Communication among Cockpit members

Communication betweenGround control and cockpit

Decentralization

Air-safetyviolations

Independent variables Dependent variable

Diagram 5.10: Schematic diagram for the theoretical framework including a moderating variable.

Moderating variable

Training

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

4. Hypotheses Development

4.1 Definition of Hypothesis

A hypothesis can be defined as a logically conjectured relationship between two or more variables expressed in the form of a testable statement. Relationships are conjectured on the basis of the network of associations established in the theoretical framework formulated for the research study. By testing the hypotheses and confirming the conjectured relationships, it is expected that solutions can be found to correct the problem encountered.

Page 15: Research method chp 1 to 9

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

4.2 Statement of Hypotheses: Formats

a. If—Then StatementsTo examine whether or not the conjectured relationships or differences exist, these hypotheses can be set either as propositions or in the form of if—then statements. The two formats can be seen in the following two examples.

Example 5.15 Employees who are more healthy will take sick leave

less frequently.

Example 5.16 If employees are more healthy, then they will take

sick leave less frequently.

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

4.3 Directional and Nondirectional HypothesesIf, in stating the relationship between two variables or comparing two

groups, terms such as positive, negative, more than, less than, and the like are used, then these hypotheses are directional because the direction of the relationship between the variables (positive/negative) is indicated, as in Example 5.17 below, or the nature of the difference between two groups on a variable (more than/less than) is postulated, as in example 5.18.

Example 5.17The greater the stress experienced in the job, the lower the job satisfaction of employees.

Example 5.18Women are more motivated than men.

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

On the other hand, nondirectional hypotheses are those that do postulate a relationship or difference, but offer no indication of the direction of these relationships or differences. In other words, though it may be conjectured that there would be a significant relationship between two variables, we may not be able to say whether the relationship would be positive or negative.

Example 5.19There is a relationship between age and job satisfaction.

Example 5.20There is a difference between the work ethic values of American and Asian employees.

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

4.4 Null and Alternate Hypotheses

The null hypotheses is a proposition that states a definitive, exact relationship between two variables. That is, it states that the population correlation between two variables is equal to zero or that the difference in the means of two groups in the population is equal to zero (or some definitenumber). In general, the null statement is expressed as no (significant) relationship between two variables or no (significant) difference between two groups, as we will see in the various examples in this chapter. The alternate hypothesis, which is the opposite of the null, is a statement expressing a relationship between two variables or indicating differences between groups.

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

The null hypothesis in respect of group differences stated in our Example 5.18 would be:

H0: µm = µw H0: Meanm = Meanw

orH0: µm - µw = 0 H0: Meanm - Meanw = 0

The alternate for the above example would statistically be set as follows:

HA: µM < µW H0: Meanm is less than Meanw

which is the same as HA: µW >µM H0: Meanw is greater than Meanm

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

For the nondirectional hypothesis of the mean group differences in work ethic values in Example 5.20, the null hypothesis would be:

H0: AM = AS

orH0: AM - AS = 0

where H0 represents the null hypothesis, AM is the mean work ethic value of Americans and AS is the mean work ethic value of Asians.

The alternate hypothesis for the above example would statistically be set as:

HA: AM AS

where HA represents the alternate hypothesis and AM and AS are the mean work ethic values of Americans and Asians, respectively.

Page 16: Research method chp 1 to 9

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

The null hypothesis for the relationship between the two variables in Example 5.17 would be

HO: There is no relationship between stress experienced on the job and the job satisfaction of employees.

This would be statistically expressed byH0: = 0

where represents the correlation between stress and job satisfaction, which in this case is equal to 0 (i.e., no correlation).

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

The alternate hypotheses for the above null, which has been expressed directionally in Example 5.17, can be statistically expressed as

HA: < 0 (The correlation is negative.)

For Example 5.19, which has been stated nondirectionally, while the null hypothesis would be statistically expresses as:

H0: = 0

The alternate hypothesis would be expressed as:H0: 0

Ch- 5 THE RESEARCH PROCESS: Steps 4 & 5

4.5 Steps in Hypothesis Testing

1. State the null and the alternate hypotheses.2. Choose the appropriate statistical test depending on whether the data

collected are parametric or nonparametric (discussed in a later chapter).3. Determine the level of significance desired (p= 05, or more, or less).4. See if the output results from computer analysis indicate that the

significance level is met. If, as in the case of Pearson correlation analysis in Excel software, the significance level is not indicated in the printout, look up the critical values that define the regions of acceptance on the appropriate table [(t, F, χ2)—see tables at the end of the book]. This critical value demarcates the region of rejection from that of acceptance of the null hypothesis.

5. When the resultant value is larger than the critical value, the null hypothesis is rejected, and the alternate accepted. If the calculated value is less than the critical value, the null is accepted and the alternate rejected.

Page 17: Research method chp 1 to 9

CHP 6

OBSERVATIONBroad area of research

interest identified

PRELIMINARYDATA GATHERING

InterviewingLiterature survey

NO

PROBLEMDEFINITION

ResearchProblem

delineated

THEORETICAL FRAMEWORK

Variables clearlyIdentified and

labeled

GENERATION OF

HYPOTHESES

SCIENTIFICRESEARCH

DESIGN

DATA COLLECTION,

ANALYSIS, ANDINTERPRETATION

DEDUCTIONHypotheses

Substantiated?Research question

answered?

Yes

ManagerialDecisionMaking

ReportPresentation

ReportWritingDiagram 6.1: The research process

1

119

8

10

765

43

2

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

1. The Research Design

Having identified the variables in a problem situation and

development the theoretical framework, the next step is to design the

research in a way that the requisite data can be gathered and analyze to

arrive at a solution.

Purpose of thestudy

ExplorationDescription

Hypothesis testing

Measurement and measures

Operational definitionItems (measure)Scaling CategorizingCoding

Study setting

ContrivedNoncontrived

Extent of researcherinterference

Minimal: Studying eventsas they normally occurManipulation and/or control and/or simulation

Types of investigation

Establishing:Causal relationshipsCorrelationsGroup differences,ranks, etc.

MEASUREMENTDETAILS OF STUDY

Data collection method

ObservationInterviewQuestionnairePhysicalmeasurement

Unobtrusive

Timehorizon

One-shot(cross-sectional)Longitudinal

Samplingdesign

Probability/nonprobabilitySample

size (n)

Unit of analysis(population to be studied)

IndividualsDyadsGroupsOrganizations Machinesetc.

1. Feel fordata

2. Goodnessof data

3. Hypotheses

testing

DATAANALYSIS

PR

OB

LE

M S

TA

TE

ME

NT

Diagram 6.2: The research design.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

2. Purpose of the Study: Exploratory, Descriptive,Hypothesis Testing

(Analytical and Predictive), Case Study Analysis

2.1 Exploratory StudyAn exploratory study is undertaken when not much is known about the

situation at hand, or no information is available on how similar problems or

research issues have been solved in the past. In such cases, extensive preliminary

work needs to be done to gain familiarity with the phenomena in the situation, and

understand what is occurring, before we develop a model and set up a rigorous

design for comprehensive investigation.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

2.2 Descriptive StudyA descriptive study is undertaken in order to ascertain and be able to

describe the characteristics of the variables of interest in a situation.

Descriptive studies are undertaken in organizations to learn about and

describe the characteristics of a group of employees, as for example, the

age, educational level, job status, and length of service of Hispanics or

Asians, working in the system. Descriptive studies are also undertaken to

understand the characteristics of organizations that follow certain common

practices.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.2 A bank manager wants to have a profile of the individuals who have load

payments outstanding for 6 months and more. It would include details of

their average age, earnings, nature of occupation, full-time/part-time

employment status, and the like.

Example 6.3A CEO may be interested in having a description of organizations in her

industry that follow the LIFO system. In this case, the report might include

the age of the organizations, their locations, their production levels, assets,

sales, inventory levels, suppliers, and profits.

Descriptive studies thus become essential in many situations. Whereas

qualitative data obtained by interviewing individuals may help the

understanding of phenomena at the exploratory stages of a study,

qualitative data in terms of frequencies, or mean and standard deviations,

become necessary for descriptive studies.

Page 18: Research method chp 1 to 9

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

2.3. Hypotheses TestingStudies that engage in hypotheses testing usually explain the nature of

certain relationships, or establish the differences among groups or the

independence of two or more factors in a situation. Hypothesis testing is

undertaken to explain the variance in the dependent variable or to predict

organizational outcomes.

Example 6.5A marketing manager wants to know if the sales of the company will

increase if he doubles the advertising dollars. Here, the manager would like

to know the nature of the relationship that can be established between

advertising and sales by testing the hypothesis: If advertising is increased,

then sales will also go up.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.7The testing of a hypothesis such as: More men than women are inotivated,

establishes the difference between two groups—men and women—in

regard to their inotivated behavior.

Example 6.8The independence between two variables that are qualitative in nature can

also be established through hypothesis testing. Consider the hypothesis:

Working the night shift (as opposed to the day shift) is related to whether or

not one is married. A chi-square test of independence will easily provide the

answer to this question.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

2.4. Case Study Analysis

2.5. Review of The purpose of the StudyIt is not difficult to see that in exploratory studies, the researcher is basically interested in exploring the situational factors so as to get a grip on the characteristics of the phenomena of interest. Also, pilot studies on a small scale, by interviewing individuals or gathering information from a limited number of occurrences, are not uncommon in exploratory research.Descriptive studies are undertaken when the characteristics or the phenomena to be tapped in a situation are known to exist, and one wants to be able to describe them better by offering a profile of the factors. Hypothesis testing offers an enhanced understanding of the relationship that exists among variables.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

It could also establish cause-and-effect relationships.

Methodological rigor increases as we move progressively from an

exploratory study to a hypothesis-testing study, and with this, the costs of

research also increase. Increases in sample size, multiple methods of data

collection, development of sophisticated measuring instruments, and the

like, add to research costs, though they contribute more to testability,

accuracy, precision, and generalizability.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

3. Type of Investigation: Casual VersusCorrelational

A correlational study is done when it is necessary to establish a definitive

cause-and-effect relationship. However, if all that the manager wants is a

mere identification of the important factors “associated with” the problem,

then a correlational study is called for.

Example 6.9A casual study question:

Does smoking cause cancer?

A correlational study question:

Are smoking and cancer related?

OR

Are smoking, drinking, and chewing tobacco associated with cancer? If so,

which of these contributes most to the variance in the dependent variable?

Page 19: Research method chp 1 to 9

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.10Fears of an earthquake predicted recently in the New Madrid fault zone were

instrumental (i.e., casual) in an unprecedented number of house owners in the

Midwest region taking out an earthquake insurance policy.

4. Extent of Researcher Interference with the StudyThe extent of interference by the researcher with the normal flow of work at the workplace has a direct bearing on whether the study undertaken is casual or correlational. A correlational study is conducted in the natural environment of the organization with minimum interference by the researcher with the normal flow of work. For example, if a researcher wants to study the factors influencing training effectiveness (a correlational study), all that the individual has to do is develop a theoretical framework, collect the relevant data, and analyze them to come up with the findings.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.12 Minimal InterferenceA hospital administrator wants to examine the relationship between the

perceived emotional support in the system and the stresses experienced by

the nursing staff. (correlational study).

Here, the administrator/researcher will collect data from the nurses

(perhaps through a questionnaire) to indicate hoe much emotional support

they get in the hospital and to what extent the experience stress. By

correlating the two variables, the answer that is being sought can be found.

In this case, beyond administering a questionnaire to the nurses, the

researcher has not interfered with the normal activities in the hospital. In

other words, researcher interference has been minimal.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.13 Moderate Interference

The researcher wants to demonstrate that if the nurses had emotional

support, this indeed would cause them to experience less stress.

To test the cause-and-effect relationship, the researcher will measure the

stress and deliberately manipulate the extent of emotional support given to

the three groups of nurses in the three wards for perhaps a weeks, and

measure the amount of stress. For one group, the researcher will ensure

extensive emotional support.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.14 Excessive InterferenceThe researcher feels that the results may or may not be valid since other external

factors might have influenced the stress levels experienced by the nurses. For

example, during the particular experimental week, the nurses in one or more

wards may not have experienced high levels of stress because there were no

serious illnesses or deaths in the ward. Hence, the emotional support received

might not be related to the level of stresses experienced.

The researcher will want to make sure that such extraneous factors as might

affect the cause-and-effect relationship are controlled. So she might take three

groups of medical students, put them in different rooms, and confront all of them

with the same stressful task to describe in the minutest detail, the surgical

procedures in performing surgery on a patient and keep asking more and more

question. One group might get help from a doctor who offers clarifications and

help when students stumble. In the second group, a doctor might offer

clarifications and help only if the group seeks it. In the third group, there is no

doctor present and no help is available.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

5. Study Setting: Contrived and NoncontrivedOrganizational research can be done in the natural environment where proceeds

normally (noncontrived Settings) or in artificial, contrived settings. Correlational

studies are invariably conducted in noncontrived settings, whereas most rigorous

causal studies are done in contrived lab settings.

Correlational studies done in organizations are called field studies. Studies

conducted to establish cause-and-effect relationship using the same natural

environment in which employees normally function are called field experiments.

Experiments done to establish cause and effect relationship beyond the possibility

of the least doubt require the creation of an artificial, contrived environment in

which all the extraneous factors are strictly controlled. Similar subjects are

chosen carefully to respond to certain manipulated stimuli. These studies are

referred to as lab experiments.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.15 Field StudyA bank manager wants to analyze the relationship between interest rates

and bank deposit patterns of clients. She tries to correlate the two by

looking at deposits into different kinds of accounts (such as savings,

certificates to deposit, golden passbooks, and interest-bearing checking

accounts) as interest rates changed.

Page 20: Research method chp 1 to 9

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.16 Field ExperimentThe bank manager now wants to determine the cause-and-effect

relationship between interest rate and the inducement it offers to clients to

save and deposit money in the bank. She selects four branches within a 60-

mile radius for the experiment. For 1 week only, she advertises the annual

rate for new certificates of deposit received during that week in the

following manner: the interest rate would be 9% in one branch, 8% in

another branch, and 10% in the third. In the fourth branch, the interest

rate remains unchanged at 5%. Within the week, She would be able to

determine the effects, if any, of interest rates on deposit mobilization.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Analysis of husband-wife interactions in families and supervisor-

subordinate relationship at the workplace are good examples of dyads as

the unit of analysis. However, if the problem statement is related to group

effectiveness, then the unit of analysis would be at the group level. Om

other words, even though we may gather relevant data from all individuals

comprising, say, six groups, we would aggregate the individual data into

group data so as to see the differences among the six groups. If we compare

different department in the organization, then the data analysis will be

done at the department level—that is, the individuals in the department

will be treated as one unit—and comparisons made treating the department

as the unit of analysis. Our research question determines the unit of

analysis.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.17 Lab ExperimentThe banker in Example 6.16 may now want to establish the causal

connection between interest rates and savings, beyond a doubt. Because of

this she wants to create an artificial environment and trace the true cause-

and effect relationship. She recruits 40 students who are all business majors

in their final years of study and are more or less of the same age. She splits

them into four groups and gives each one of them chips that count for

$1.000, which they are told they might utilize to buy their needs or save for

the future, or both. She offers them by way of incentive, interest on what

they save but manipulates the interest rates by offering a 6% interest rate

on savings for group 1, 8% for group 2, 9% for group 3, and keeps the

interest at the low rate of 1% for group 4.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

6. Unit of analysis: Individuals, Dyads, Groups,

Organizations, Cultures The unit of analysis refers to the level of aggregation of the data collected

during the subsequent data analysis stage. If, for instance, the problem

statement focuses on how to raise the motivational levels of employees in

general, then we are interested in individual employees in the organization

and would have to find out what we can do to raise their motivation. Here

the unit of analysis is the individual. We will be looking at the data gathered

from each individual and treating each employee’s response as an

individual data source. If the researcher is interested in studying two-

person interactions, then several two-person groups, also known as dyads,

will become the unit of analysis. Analysis of husband-wife interactions in

families and supervisor-subordinate relationship at the workplace are good

examples of dyads as the unit of analysis.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

However, if the problem statement is related to group effectiveness, then the

unit of analysis would be at the group level. Om other words, even though

we may gather relevant data from all individuals comprising, say, six

groups, we would aggregate the individual data into group data so as to see

the differences among the six groups. If we compare different department

in the organization, then the data analysis will be done at the department

level—that is, the individuals in the department will be treated as one

unit—and comparisons made treating the department as the unit of

analysis. Our research question determines the unit of analysis.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.18 Individuals as the Unit AnalysisHe Chief Financial Officer of a manufacturing company wants to know

how many of the staff would be interested in attending 3-day seminar on

making appropriate investment decisions. For this purpose, data will have

to be collected from each individual staff member and the unit of analysis is

the individual.

Example 6.19 Dyads as the Unit of AnalysisHaving ready about the benefits of mentoring, a human resources manager

wants to first identify the number of employees in three departments of the

organization who are in mentoring relationships, and then find out what

the jointly perceived benefits (i.e., by both the mentor and the one

mentored) of such a relationship are.

Page 21: Research method chp 1 to 9

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.20 Groups as the unit of AnalysisA manager wants to see the patterns of usage of the newly installed

information system (IS) by the production, sales, and operations personnel.

Here three groups of personnel are involved ad information on the number

of times the (IS) is used by each member in each of the three groups as well

as other relevant issues will be collected and analyzed. The final results will

indicate the mean usage of the system per day or month for each group.

Here the unit of analysis is the group.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.22 Industry as the Unit of AnalysisAm employment survey specialist wants to see the proportion of the

workforce employed by the health care, utilities, transportation, and

manufacturing industries. In the case, the researcher has to aggregate the

data relating to each of the subunits comprised in each of the industries and

report the proportions of the workforce employed at the industry level. The

health care industry, for instance, includes hospitals, nursing homes,

mobiles units, small and large clinics, and other health care providing

facilities.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.23 Countries as the Unit of AnalysisThe Chief Financial Officer (CFO) of a multinational corporation

wants to know the profits made during the past 5 years by each of the

subsidiaries in England, Germany, France, and Spain. It is possible that

there are many regional offices of these subsidiaries in each of these

countries. The profits of the various regional centers for each country have

to be aggregated and the profits for each country for the past 5 years

provided to the CFO. In other words, the data will now have to be

aggregated at the country level.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

6. Time Horizon: Cross-Sectional Versus

Longitudinal Studies

7.1 Cross-Sectional StudiesA study can be done in which data are gathered just once, perhaps over a

period pf days or weeks or months, in order to answer a research question.

Such studies are called one-shot or crosssectional studies.

Example 6.24 Data were collected from stock brokers between April and June of last year

to study their concerns in a turbulent stock market. Data with respect to

this particular research had not been collected before, nor will they be

collected again from them for this research.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.25A drug company desirous of investing in research for a new obesity

(reduction) pill conducted a survey among obese people to see how many of

them would be interested in trying the new pill. This is a one-shot or cross-

sectional study to assess the likely demand for the new product.

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

7.2 Longitudinal StudiesIn some cases, however, the researcher might want to study people or

phenomena at more than one point in time in order to answer the research

question. For instance, the researcher might want to study employees’

behavior before and after the change in the top management, so as to know

what effects the change accomplished. Here, because data are gathered at

two different points in time, the study is not cross-sectional or of the one-

shot kind, but is carried longitudinally across a period of time. Such

studies, as when data on the dependent variable are gathered at two or

more points in time to answer the research question, are called longitudinal

studies.

Page 22: Research method chp 1 to 9

Ch- 6 THE RESEARCH PROCESSStep 6: Elements of Research Design

Example 6.27A marketing manager is interested in tracing the pattern of sales of a

particular product in four different regions of the country on a quarterly

basis for the next 2 years. Since data are collected several times to answer

the same issue (tracing pattern of sales), the study falls under the

longitudinal category.

Longitudinal Studies take more time and efforts and cost more than cross-

sectional studies. However, well-planned longitudinal studies could, among

other things, help to identify cause-and-effect relationships.

Page 23: Research method chp 1 to 9

CHP 8

Ch-8: Measurement Of Variables: Operational Definition and Scales

1. How Variables Are MeasuredData representing several demographic characteristics of the office

personnel are easily obtained by asking employees simple, straightforward

questions, as for example:

How long have you been working in this organization?

How long have you been working on this particular assignment?

What is your Job title?

What is your marital status?

One can use company records to obtain data on the absenteeism

performance.etc. However, even such objective data might, in some cases,

call for careful interpretation while making managerial decisions.

Certain variables are easily measured by using appropriate

measuring instruments, as for example, blood pressure, pulse rates, body

temperature, height and weight. But when we get into the realm of

people’s subjective feelings, attitudes, and perceptions, the measurement

of these factors or variables becomes difficult.

There are at least two types of variables: One lends itself to objective

and precise measurement; the other is more nebulous and does not lend

itself to accurate measurement because of its subjective nature. One

technique is to reduce the abstract notions, or concepts such as

motivation, involvement, satisfaction, buyer behavior, stock market

exuberance, and the like, to observable behavior and characteristics.

Reduction of abstract concepts to render them measureable in a tangible

way is called operationalizing the concepts.

Ch-8: Measurement Of Variables: Operational Definition and Scales

2. Operational Definition: Dimensions and Elements

Operationalizing, or operationally defining a concept to render it

measureable, is done by looking at the behavioral dimensions, facets, or

properties denoted by the concept. These are then translated into

observable and measureable elements so as to develop an index of

measurement of the concept.

Example 8.1 Operationalizing the Concept of Achievement Motivation

Let us try to operationally define achievement motivation. What

behavioral dimensions or facets or characteristics would we expect to find

in people with high achievement motivation? They would probably have the

following five typical broad characteristics, which we will call dimensions.

Ch-8: Measurement Of Variables: Operational Definition and Scales

They would be driven by work.

Many of them would generally be in no mood to relax.

Because they want always to be achieving, they prefer to work on their own.

They would rather engage in challenging jobs rather than easy, hum-drum

ones.

They would like to get frequent feedback in direct and subtle ways from their

superiors, colleagues, and even sub-ordinates, to know how they are

progressing.

Although breaking the concept into these five dimensions has somewhat

reduced its level of abstraction, we have still not operationalized the

concept into measureable elements of behavior. This could be done by

examining each of the five dimensions and breaking each further into its

elements. These should be quantitatively measureable so that we can

distinguish those who have high motivation from those with less.

Ch-8: Measurement Of Variables: Operational Definition and Scales

i. Elements of Dimension 1

A person who is driven by work will (1) be at work all the time, (2) be reluctant

to take time off from work, and (3) persevere even in the face of some

setbacks. These types of behavior can be measured.

For instance, we can count the number of hours employees engage themselves

in work-related activities. It would be an index of the extent to work

“drive” them.

Achievement-motivated individuals would not usually want to give up on their

tasks even when confronted by initial failures.

Finally, in order to measure the reluctance to take time off, we need only know

how frequently people take time off from their jobs, and for what reasons.

Ch-8: Measurement Of Variables: Operational Definition and Scales

Thus, if we can measure how many hours per week individuals spend

on work-related activities, how persevering they are in completing their

daily tasks, and how frequently and for what reasons they take time off

from their jobs, we would have a measure of the extent to which employees

are driven by work.

Diagram 8.1schematically diagrams the dimensions (the main

characteristics) and the elements (representative behaviors) for the concept

of achievement motivation.

Ch-8: Measurement Of Variables: Operational Definition and Scales

Page 24: Research method chp 1 to 9

Achievementmotivation

C

D₁ D₂ D₃

D₄

D₅

E

Very reluctantto take time

off for anything

Thinks ofwork even

at home

E

Constantlyworking

E

Does not like to

work with slow or

inefficient people

E

Driven by work Impatience withineffectiveness

Seeks moderatechallenge

Seeks feedbackUnable to relax

E EE E E

Constantlyworking Persevering

despitesetbacks

Swears under one’sBreath when even

Small mistakesoccur

Opts to do a challenging rather than a routine job

Opts to take moderate, rather

than overwhelming

challenges

Asks for feedback on how the job

has been done

Is impatient for immediate feedback

E E

Diagram 8.1

Dimensions (D) and elements (E) of the concept (C) learning.

ii. Elements of Dimension 2The degree of unwillingness to relax can be measured by asking

persons such questions as (1) how often do you think about work while you

are away from the workplace? (2) what are your hobbies? And (3) how do

you spend your time when you are away from the workplace?

Thus we can place employees on a continuum ranging from those who relax

vary well to those who relax very little.

iii. Elements of Dimension 3Individuals with high achievement motivation have no patience with

ineffective people and are reluctant to work with others. Thus impatience

with ineffectiveness an also be measured by observing behavior.

Ch-8: Measurement Of Variables: Operational Definition and Scales

Ch-8: Measurement Of Variables: Operational Definition and Scales

iv. Elements of Dimension 4A measure of how excited people are at seeking challenging jobs can be had

by asking employees what kinds of jobs they prefer. Employee preferences

for different types of jobs could then be placed on a continuum ranging

from those who prefer fairly routine jobs to those who prefer jobs with a

progressive increase in challenge.

v. Elements of Dimension 5 Those who desire feedback would seek it from their superiors, co-workers,

and sometimes even from their subordinates. Feedback, both positive and

negative, would indicate to them how much they are achieving and

accomplishing. Employees can be placed on a continuum ranging from

those who seek extensive feedback from all sources to those who never seek

any feedback from anyone at any time.

Ch-8: Measurement Of Variables: Operational Definition and Scales

Operationally defining the concept, nevertheless, is the best way to

measure it and instead of actually observing the behaviors of individuals,

we could ask them to report their own behavior patterns by asking them

appropriate questions, which they can respond to on some scale that we

provide.

2.1 What an Operational Definition Is Not An operational definition does not describe the correlates of the

concept. Operationally defining a concept does not consist of delineating the

reasons, antecedents, consequences, or correlates of the concept. I f we

either operationalize the concepts incorrectly or confuse them with other

concepts, then we will not have valid measures. This means that we will not

have “good” data, and our research will not be scientific.

Ch-8: Measurement Of Variables: Operational Definition and Scales

Example 8.3 Operationalizing the Concept of LearningLearning is an important concept in the educational setting. E need to

define the concept operationally and break it down to observable and

measureable behaviors. In other words, we should delineate the dimensions

and elements of the concept of learning. The dimensions of learning may

well be as follows:

Understanding

Retention

Application

In other words, we can be reasonably certain that a student in the class is

“learning” when the individual (1) understands what is taught (2) retains

and remembers what is understood, and (3) applies whatever has been

understood.

It is necessary to break these three dimensions into elements so that we can

measure the concept of learning.

Page 25: Research method chp 1 to 9

Ch-8: Measurement Of Variables: Operational Definition and Scales

Answer questions correctly

Recall material after some lapse

of time

Solve problems applying concepts

understood and recalled

Integrate with other

relevant material

Give appropriate examples

Understanding ApplicationRetention

Learning

C

D DD

E EE E E

Diagram 8.2

Dimensions (D) and elements (E)

of the concept © learning.

Ch-8: Measurement Of Variables: Operational Definition and Scales

2.2. Review of Operational DefinitionOperational definitions are necessary to measure abstract concepts such as those

that usually fall into the subjective areas of feelings and attitudes. More

objective variables such as age or educational level are easily measured through

simple straightforward questions and do not have to be operationally defined.

Measures for many concepts that are relevant in the organizational context have

already been developed by researchers.

3. ScalesAfter operationalizing concepts, we need to measure them. We will examine the

types of scales that can be applied to measure different variables.

A scale is a toll or mechanism, by which individuals are distinguished as to how

they differ from one another on the variables of interest.

There are four basic types of scales are fine-tuned increases progressively as we

move from the nominal to the ratio scale. As the calibration or fine-tuning of the

scale increases in sophistication, so does the power of the scale. With more

powerful scales, increasingly sophisticated data analyses can be performed.

Ch-8: Measurement Of Variables: Operational Definition and Scales

3.1 Nominal ScaleA nominal scale is one that allows the researcher to assign subjects to certain

categories or groups. For example, wit respect to the variable of gender,

respondent can be grouped into two categories—male and female. Thus,

nominal scales categorize individuals or objects into mutually exclusive groups.

Ch-8: Measurement Of Variables: Operational Definition and Scales

Example 8.4A variable that lends itself to nominal scaling is the nationality of individuals.

We could nominally scale this variable in the following mutually exclusive and

collectively exhaustive categories.

Indian Pakistan

3.2 Ordinal ScaleAn ordinal scale not only categorizes the variables in such a way as to denote

differences among the various categories, it also rank-orders the categories in

some meaningful way. The preference would be ranked (e.g., from best to worst;

first to last) and numbered 1, 2, and so on. For example, respondents might be

asked to indicate their preferences by ranking the importance they attach to five

distinct characteristics in a job.

Ch-8: Measurement Of Variables: Operational Definition and Scales

Example 8.4A variable that lends itself to nominal scaling is the nationality of individuals.

We could nominally scale this variable in the following mutually exclusive and

collectively exhaustive categories.

Indian Pakistan

3.2 Ordinal ScaleAn ordinal scale not only categorizes the variables in such a way as to denote

differences among the various categories, it also rank-orders the categories in

some meaningful way. The preference would be ranked (e.g., from best to worst;

first to last) and numbered 1, 2, and so on. For example, respondents might be

asked to indicate their preferences by ranking the importance they attach to five

distinct characteristics in a job.

Ch-8: Measurement Of Variables: Operational Definition and Scales

Example 8.5Rank the following five characteristics in a job in terms of how important they

are for you. You should rank the most important item as 1, the next in

importance as 2, and so on, until you have ranked each of them 1, 2, 3, 4, or 5.

Job Characteristic Ranking of Importance

The opportunity provided by the job to:

1. Interact with others ____

2. Use a number of different skills ____

3. Complete a whole task from beginning to end ____

4. Serve others. ____

5. Work independently ____

Page 26: Research method chp 1 to 9

Ch-8: Measurement Of Variables: Operational Definition and Scales

Example 8.5Rank the following five characteristics in a job in terms of how important they

are for you. You should rank the most important item as 1, the next in

importance as 2, and so on, until you have ranked each of them 1, 2, 3, 4, or 5.

Job Characteristic Ranking of Importance

The opportunity provided by the job to:

1. Interact with others ____

2. Use a number of different skills ____

3. Complete a whole task from beginning to end ____

4. Serve others. ____

5. Work independently ____

Ch-8: Measurement Of Variables: Operational Definition and Scales

The ordinal scale helps the researcher to determine the percentage of

respondents who consider interaction with others as most important, those who

consider using a number of different skills as most important, and so on.

3.3 Interval ScaleAn interval scale allows us to perform certain arithmetical operations on the

data collected from the respondents. The interval scale lets us measure the

distance between any two points on the scale. This helps us to compute the

means and the standard deviations of the responses on the variables. In other

words, the interval scale not only groups individuals according to certain

categories and taps the order of these groups, it also measures the magnitude of

the differences in the preferences among the individuals.

Ch-8: Measurement Of Variables: Operational Definition and Scales

Example 8.6 Indicate the extent to which you agree with the following statements as they relate to your job, by

circling the appropriate number against each, using the scale given below.

_________________________________________________________________________________

Strongly Neither Agree Strongly

Disagree Disagree Nor Disagree Agree Agree

1 2 3 4 5

_________________________________________________________________________________

The following opportunities by the job are very important to me:

Interacting with others 1 2 3 4 5

Using a number of different skills 1 2 3 4 5

Completing a task from beginning to end 1 2 3 4 5

Serving others 1 2 3 4 5

Working Independently 1 2 3 4 5

_________________________________________________________________________________

Ch-8: Measurement Of Variables: Operational Definition and Scales

The interval scale, then, taps the differences, the order, and the equality of the magnitude of the

differences in the variable. As such, it is a more powerful scale than the differences in the variable.

As such, it is a more powerful scale than the nominal and ordinal scales, and has for its measure of

central tendency the arithmetic mean,. Its measures of dispersion are the range, the standard

deviation, and the variance.

3.4 Ratio ScaleThe ratio scale overcomes the disadvantage of the arbitrary origin point of the interval scale, in that

it has an absolute (in contrast to an arbitrary) zero point, which is a meaningful measurement point.

Thus the ration scale not only measures the magnitude of the differences between points on the scale

but also taps the proportions in the differences. It is the most powerful of the four scales because it

has a unique zero origin (not an arbitrary origin) and subsumes all the properties of the other three

scales.

Page 27: Research method chp 1 to 9

CHP 9

Chapter 9: Measurement: Scaling, Reliability, Validity

1. Rating Scales

Dichotomous scale

Category scale

Likert scale

Numerical scales

Semantic differential scale

Itemized rating scale

Fixed or constant sum rating scale

Stapel scale

Graphic rating scale

Consensus scale

Chapter 9: Measurement: Scaling, Reliability, Validity

1.1 Dichotomous ScaleThe dichotomous scale is used to elicit a Yes or No answer, as in example

below. Note that a nominal scale is used to elicit the response.

Example 9.1Do you own a car? Yes No

1.2 Category ScaleThe category scale uses multiple items to elicit a single response as per the

following example. This also uses nominal scale.

Example 9.2Where in northern California do you reside? ____North Bay

____ South Bay

____East Bay

____Peninsula

____Other

Chapter 9: Measurement: Scaling, Reliability, Validity

1.3. Likert ScaleThe Likert scale is designed to examine how strongly subjects agree

or disagree with statements on a 5-point scale with the following anchors:

The responses over a number of items tapping a particular concept or

variable (as per the following example) are then summated for every

respondent. This is an interval scale and the differences in the responses

between any two points on the scale remain the same.

Chapter 9: Measurement: Scaling, Reliability, Validity

1.4 Semantic Differential ScaleSeveral bipolar attributes at the identified at the extremes of the scale, and

respondents are asked to indicate their attitudes, on what may be called a

semantic space, toward a particular individual, object, or event on each of the

attributes. The bipolar adjectives used, for instance, would employ such terms

as Good­­-Bad; Strong—weak; Hot—Cold. The responses can be plotted to

obtain a good idea of their perceptions. This is treated as an interval scale.

Example 9.4

Chapter 9: Measurement: Scaling, Reliability, Validity

1.5. Numerical ScaleThe numerical scale is similar to the semantic differential scale, with the

difference that numbers on a 5-point or 7-point scale are provided, with bipolar

adjectives at both ends, as illustrated below. This is also an interval scale.

Example 9.5How pleased are you with your new real estate agent?

7 6 5 4 3 2 1Extremely

Pleased

Extremely

Displeased

Chapter 9: Measurement: Scaling, Reliability, Validity

1.6 Itemized Rating ScaleA 5-point or 7-point scale with anchors, as needed, is provided for each item and

the respondent states the appropriate number on the side of each item, or circles

the relevant number against each item. The responses to the items are then

summated. This uses an interval scale.

Example 9.6 (i)Respond to each item using the scale below, and indicate your response number

on the line by each item.

1. I will be changing my job within the next 12 months. -------

2. I will take on new assignments in the near future. --------

3. It is possible that I will be out of this organization within

the next 12 months. --------

Note that the above is a balanced rating scale with a neutral point.

Page 28: Research method chp 1 to 9

Chapter 9: Measurement: Scaling, Reliability, Validity

Example 9.6 (ii)Circle the number that is closest to how you feel for item below.

How would you rate your interest in 1 2 3 4

Changing current organizational policies?

This is an unbalanced rating scale which does not have a neutral point.

Chapter 9: Measurement: Scaling, Reliability, Validity

1.7 Fixed or Constant Sum ScaleThe respondents are here asked to distribute a given number of points

across various items as per the example below. This is more in the nature of

an ordinal scale.

Example 9.7In choosing a toilet soap, indicate the importance you attach to each of the

following five aspects by allotting points for each to total 100 in all.

Fragrance ____

Color ____

Shape ____

Size ____

Texture of lather ____

______________________

Total Points 100

Chapter 9: Measurement: Scaling, Reliability, Validity

1.8 Stapel ScaleThis scale simultaneously measures both the direction and intensity

of the attitude toward the items under study. The characteristic of interest

to the study is placed at the corner and a numerical scale ranging, say, from

+3 to -3, on either side of the item as illustrated below. This gives an idea of

how close or distant the individual response to the stimulus is, as shown in

the example below. Since this does not have an absolute zero point, this is

an interval scale.

Chapter 9: Measurement: Scaling, Reliability, Validity

1.9 Graphic Rating ScaleA graphical representation helps the respondents to indicate on this scale their answers to a particular question by placing a mark at the appropriate point on the line, as in the following example. This is an ordinal scale, though it might appear to make it look like an interval scale.

Example 9.910 Excellent

On a scale of 1 to 10,how would you rate 5 All rightyour supervisor?

1 Very bad

Chapter 9: Measurement: Scaling, Reliability, Validity

Example 9.8

State how you would rate your supervisor’s abilities with respect to

each of the characteristics mentioned below, by circling the appropriate

number.

+3 +3 +3+2 +2 +2+1 +1 +1

Adopting Modern Product InterpersonalTechnology Innovation Skills

-1 -1 -1-2 -2 -2-3 -3 -3

Chapter 9: Measurement: Scaling, Reliability, Validity

1.10. Consensus ScaleScales are also developed by consensus, where a panel of judges selects

certain items, which in its view measure the relevant concept. The items are

chosen particularly based on their pertinence or relevance to the concept. One

such consensus scale is the Thurstone Equal Appearing Interval Scale, where a concept is measured by a complex process followed by a panel of

judges. Using a pile of cards containing several descriptions of the concept, a

panel of judges offers inputs to indicate how close or not the statements are to

the concept under study. The scale is then developed based on the consensus

reached.

Page 29: Research method chp 1 to 9

Chapter 9: Measurement: Scaling, Reliability, Validity

1.11. Other ScalesThere are also some advanced scaling methods such as multidimensional

scaling, where objects, people, or both, are visually scaled, and a conjoint

analysis is performed. This provides a visual image of the relationships in

space among the dimensions of a construct.

2. Ranking ScalesRanking scales are used to tap preferences between two or among more

objects or items (ordinal in nature).

Chapter 9: Measurement: Scaling, Reliability, Validity

2.1 Paired ComparisonThe paired comparison scale is used when, among a small number of

objects, respondents are asked to choose between two objects at a time. This

helps to assess preferences. If, for instance, in the previous example, during

the paired comparisons, respondents consistently show a preference for

product one over products two, three, and four, the manager reliably

understands which product line demands his utmost attention. However, as

the number of objects to be compared increases, so does the number of

paired comparisons. Hence paired comparison is a good method if the

number of stimuli presented is small.

Chapter 9: Measurement: Scaling, Reliability, Validity

2.2 Forced ChoiceThe forced choice enables respondents to rank objects relative to one

another, among the alternatives provided. This is easier for the respondents,

particularly if the number of choices to be ranked is limited in number.

Example 9.10Rank the following magazines that you would like to subscribe to in the

order of preference,

assignment 1 for the most preferred choice and 5 for the least preferred.

Fortune ____

Playboy ____

Time ____

People ____

Prevention ____

Chapter 9: Measurement: Scaling, Reliability, Validity

2.3 Comparative Scale

The comparative scale provides a benchmark or a point of reference to

assess attitudes towards the current object, event, or situation under study.

An example of the use of comparative scale follows.

Example 9.11In a volatile financial environment, compared to stocks, how wise or useful is

it to invest in Treasury bonds? Please circle the appropriate response.

________________________________________________________________

More Useful About the Same Less Useful

1 2 3 4 5

________________________________________________________________

Rating scales are used to measure most behavioral concepts. Ranking scales

are used to make comparisons or rank the variables that have been tapped on

a nominal scale.

Chapter 9: Measurement: Scaling, Reliability, Validity

3. Goodness of MeasuresIt is important to make sure that the instrument that the instrument that we

develop to measure a particular concept is instrument that we develop to

measures a particular concept is indeed accurately measuring the variable,

and that in fact, we are actually measuring the concept that we set out to

measure. This ensures that in operationally defining perceptual and

attitudinal variables, we have not overlooked some important dimensions and

elements or included some irrelevant ones.

3.1. Item AnalysisItem analysis is done to see if the items in the instrument belong there or not.

Each item is examined for its ability to discriminate between those subjects

whose total scores are high, and those will low scores. In item analysis, the

means between the high-score group and the low-score group are tested to

detect significant differences through the t-values. The items with a high t-

value (test which is able to identify the highly discriminating items in the

instrument) are then included in the instrument.

Chapter 9: Measurement: Scaling, Reliability, Validity

4. ReliabilityThe reliability of a measure indicates the extent to which it is without bias

(error free) and hence ensures consistent measurement across time and across

the various items in the instrument. In other words, the reliability of a

measure is an indication of the stability and consistency with which the

instrument measures the concept and helps to assess the “goodness” of a

measure.

4.1 Stability of MeasuresThe ability of a measure to remain the same over time—despite uncontrollable

testing conditions or the state of the respondents themselves—is indicative of

its stability and low vulnerability to changes in the situation. This attests to its

“goodness” because the concept is stably measured, no matter when it is done.

Two tests of stability are test-retest reliability and parallel-form reliability.

Page 30: Research method chp 1 to 9

Reliability (accuracy in

measurement)

Validity (are we

measuring the right thing?)

Goodness of data

Test-retest reliability

Parallel-form reliability

Interitem consistency reliability

Split-half reliability

Stability

Consistency

Face validity

Logical validity (content)

Congruent validity

(construct)

Convergent Discriminant

Criterion-related validity

Predictive Concurrent

Diagram 9.1 Testing Goodness of Measures: Forms of Reliability and Validity.

Chapter 9: Measurement: Scaling, Reliability, Validity

4.2 Test-Retest ReliabilityThe reliability coefficient obtained with a repetition of the same measure on

a second occasion is called test-retest reliability. That is, when a

questionnaire is administered to a set of respondents now, and again to the

same respondents, says several weeks to 6 months later, then the correlation

between the scores obtained at the two different times from one and the

same set of respondents is called the test-retest coefficient. The higher it is,

the better the test-retest reliability, and consequently, the stability of the

measure across time.

Chapter 9: Measurement: Scaling, Reliability, Validity

4.3 Parallel-Form ReliabilityWhen responses on two comparable sets of measures tapping the same

construct are highly correlated, we have parallel-form reliability. Both forms

have similar items and the same response format, the only changes being the

wordings and the order or sequence of the questions. What we try to

establish here is the error variability resulting from wording and ordering of

the questions. If two such comparable forms are highly correlated the

measures are reasonably reliable.

4.4 Internal Consistency of MeasuresThe internal consistency of measures is indicative of the homogeneity of the

items in the measure that tap the construct. In other words, the items should

“hang together as a set,” and be capable of independently measuring the

same concept so that the respondents attach the same overall meaning to

each of the items. This can be seen by examining if the items and the subsets

of items in the measuring instruments are correlated highly. Consistency can

be examined through the inter-item consistency reliability and split-half

reliability tests.

Chapter 9: Measurement: Scaling, Reliability, Validity

a. Interitem Consistency ReliabilityThis is a test of the consistency of respondents’ answers to all the items in a

measure. To the degree that items are independent measures of the same

concept, they will be correlated with one another. The most popular test of

interitem consistency reliability is the Cronbach’s coefficient alpha

(Cronbach’s alpha; Cronbach, 1946), which is used for multipoint-scaled

items, and the Kuder-Richardson formulas (Kuder & Richardson, 1937),

used for dichotomous items. The higher the coefficients, the better the

measuring instrument.

b. Split-Half ReliabilitySplit-half reliability reflects the correlations between two halves of an

instrument. The estimates would vary depending on how the items in the

measure are split into two halves. Split-half reliabilities could be higher than

Cronbach’s alpha only in the circumstance of there being more than one

underlying response dimension tapped by the measure and when certain

other conditions are met as well. Hence, in almost all cases, Cronbach’s alpha

can be considered a perfectly adequate index of the interitem consistency

reliability.

Chapter 9: Measurement: Scaling, Reliability, Validity

5. ValiditySeveral types of validity tests are used to test the goodness of measures and

writers use different terms to denote them. For the sake of clarity, we may

group validity tests under three broad headings: content validity,

criterion-related validity, and construct validity.

5.1 Content ValidityContent validity ensures that the measure includes an adequate and

representative set of items that tap the concept. The more the scale items

represent the domain or universe of the concept being measured, the greater

the content validity. To put it differently, content validity is a function of how

well the dimensions and elements of a concept have been delineated.

Face validity is considered by some as a basic and a very minimum index of

content validity. Face validity indicates that the items that are intended to

measure a concept, do on the face of it look like they measure the concept.

Chapter 9: Measurement: Scaling, Reliability, Validity

5.2 Criterion-Related ValidityCriterion-related validity is established when the measure differentiates

individuals on a criterion it is expected to predict. This can be done by

establishing con-current validity or predictive validity, as explained below.

Concurrent validity is established when the scale discriminates individuals who

are known to be different; that is, they should score differently on the

instrument as in the example that follows.

5.3 Construct ValidityConstruct validity testifies to how well the results obtained from the use of the

measure fit the theories around which the test is designed. This is assessed

through convergent and discriminant validity, which are explained below.

Convergent validity is established when the scores obtained with two different

instruments measuring the same concept are highly correlated.

Discriminant Validity is established when, based on theory, two variables are

predicted to be uncorrelated, and the scores obtained by measuring them are

indeed empirically found to be so.

Page 31: Research method chp 1 to 9

Chapter 9: Measurement: Scaling, Reliability, Validity

Table 9.1 Types of Validity

Validity Description

Content validity Does the measure adequately measure the concept?

Face validity Do “experts” validate that the instrument measures what its

name suggests it measure?

Criterion-related validity Does the measure differentiate in a manner that helps to

predict a criterion variable?

Concurrent validity Does the measure differentiate in a manner that helps to

predict a criterion variable currently?

Predictive validity Does the measure differentiate individuals in a manner as to

help predict a future criterion?

Construct validity Does the instrument tap the concept as theorized?

Convergent validity Does the measure have low correlation with a variable

That is supposed to be unrelated to this variable?