Research Design
Key Attributes of a Research Design
Improving Internal and External Validity
Popular Research Designs
Selecting Research Designs
Research design is a comprehensive plan for data collection in an empirical research project. It is a "blueprint" for empirical research aimed at answering specific research questions or testing specific hypotheses.
3 processes: the data collection, instrument development, and the sampling process
Data collection methods can be grouped into two categories: positivist and interpretive.
Positivist methods, such as laboratory experiments and survey research, are aimed at theory (or hypotheses) testing. Employs an deductive approach to research. Examples: laboratory experiments. field surveys, field experiments, case studies
Interpretive methods, such as action research and ethnography, are aimed at theory building. Employs an inductive approach. Examples: case research, phenomenology
Internal validity also called causality examines whether the observed change in a dependent variable is caused by a corresponding change in hypothesized independent variable
External validity refers to whether the observed associations can be generalized from the sample to the population, or to other people, organizations, contexts, or time
Construct validity examines how well a given measurement scale is measuring the theoretical construct that it is expected to measure
Statistical conclusion validity examines the extent to which conclusion derived using a statistical procedure is valid. Example, whether the right statistical method was used for hypotheses testing, variables used meet the assumptions of that statistical test
Causality require 3 conditions: covariation of cause and effect; temporal precedence, no plausible alternative explanation. ex. laboratory experiments
Accomplished is 4 ways: manipulation, elimination, inclusion, and randomization
Manipulation technique: the researcher manipulates the independent variable in one or more levels and compares the effects of the treatments against control group where subjects do not receive the treatments.
Elimination technique: relies on eliminating extraneous variables by holding them constant across treatments, such as by restricting the study to a single gender or a single socioeconomic status.
Inclusion technique: the role of extraneous variables is considered by including them in the research design and separately estimating their effects on the dependent variable
Randomization technique: aimed at canceling out the effects of extraneous variables through a process of random sampling, if it can be assured that these effects are of a random nature
Experimental studies; intended to test cause-effect relationships (hypotheses) in a tightly controlled setting. For instance, an experiment to test the efficacy of a new drug in treating a certain ailment, random sample of people afflicted with the ailment, randomly assign them to one of two groups, administer the drug to subjects in the treatment group, but only a placebo.
Secondary data analysis; an analysis of data that has previously been collected and tabulated by other sources. Such data may include data from government agencies such as employment statistics from the US Bureau of Labor, publicly available third-party data i.e. data from stock markets
Field surveys; non-experimental designs that do not control for or manipulate independent variables or treatments, but measure these variables and test their effects using statistical methods. Capture snapshots of practices, beliefs, or situations from a random sample of subjects through a survey questionnaire or a structured interview.
Case research; an in-depth investigation of a problem in one or more real-life settings (case sites) over an extended period of time. Data may be collected using a combination of interviews, personal observations, and internal or external documents.
Focus group research; is a type of research that involves bringing in a small group of subjects (typically 6 to 10 people) at one location, and having them discuss a phenomenon of interest for a period of 1.5 to 2 hours. Led by a trained facilitator; more suited for exploratory research, not used for explanatory or descriptive research
Action research; assumes that complex social phenomena are best understood by introducing interventions or "actions" into those phenomena and observing the effects of those actions. The researcher is usually a consultant or an organizational member embedded within a social context such as organization, who initiates an action
Ethnography; an interpretive design that emphasizes that research phenomenon must be studied within the context of its culture. (8 months to 2 years), and during that period engages, observes, and records, the daily life of he studied culture, and theorizes about the evolution and behaviors in that culture.
Researchers tend to select those research designs that they are most comfortable with, but ideally the choice should depend on the nature of the research phenomenon being studied.
The researcher should strive to collect quantitative and qualitative data using a combination of techniques such as questionnaires, interviews, observations, documents, or secondary data
Irrespective of the specific research design employed, the goal of the researcher should be to collect as much and as diverse data as possible that can help generate the best possible insights about the phenomenon of interests