sociology of experiment

A Sociology Experiment

What if a group of the most creative, passionate writers and teachers of sociology got together to write the chapters of a new kind of textbook what if they offered those chapters directly to students for $1.

Instructors

Register as Student

I have read the Terms of Service *

Click here to read the Privacy Policy

Register as Instructor

A-Z Publications

Annual Review of Sociology

Volume 43, 2017, review article, field experiments across the social sciences.

Delia Baldassarri 1 , and Maria Abascal 2
View Affiliations Hide Affiliations Affiliations: 1 Department of Sociology, New York University, New York, New York 10012; email: [email protected] 2 Department of Sociology, Columbia University, New York, New York 10027; email: [email protected]
Vol. 43:41-73 (Volume publication date July 2017) https://doi.org/10.1146/annurev-soc-073014-112445
First published as a Review in Advance on May 22, 2017
© Annual Reviews

Using field experiments, scholars can identify causal effects via randomization while studying people and groups in their naturally occurring contexts. In light of renewed interest in field experimental methods, this review covers a wide range of field experiments from across the social sciences, with an eye to those that adopt virtuous practices, including unobtrusive measurement, naturalistic interventions, attention to realistic outcomes and consequential behaviors, and application to diverse samples and settings. The review covers four broad research areas of substantive and policy interest: first, randomized controlled trials, with a focus on policy interventions in economic development, poverty reduction, and education; second, experiments on the role that norms, motivations, and incentives play in shaping behavior; third, experiments on political mobilization, social influence, and institutional effects; and fourth, experiments on prejudice and discrimination. We discuss methodological issues concerning generalizability and scalability as well as ethical issues related to field experimental methods. We conclude by arguing that field experiments are well equipped to advance the kind of middle-range theorizing that sociologists value.

Article metrics loading...

Full text loading...

Literature Cited

Abascal M . 2015 . Us and them: black–white relations in the wake of Hispanic population growth. Am. Sociol. Rev. 80 : 789– 813 [Google Scholar]
Adida CL , Laitin DD , Valfort MA . 2016 . Why Muslim Integration Fails in Christian-Heritage Societies Cambridge, MA: Harvard Univ. Press [Google Scholar]
Ahmed AM , Hammarstedt M . 2008 . Discrimination in the rental housing market: a field experiment on the Internet. J. Urban Econ. 64 : 362– 72 [Google Scholar]
Ahmed AM , Hammarstedt M . 2009 . Detecting discrimination against homosexuals: evidence from a field experiment on the Internet. Economica 76 : 599– 97 [Google Scholar]
Arceneaux K , Nickerson DW . 2009 . Who is mobilized to vote? A re-analysis of 11 field experiments. Am. J. Political Sci. 53 : 1– 16 [Google Scholar]
Attanasio O , Augsburg B , De Haas R , Fitzsimons E , Harmgart H . 2012 . Group lending or individual lending? Evidence from a randomised field experiment in Mongolia. Work. Pap. No. 136, Eur. Bank Reconstr. Dev. [Google Scholar]
Attanasio O , Pellerano L , Reyes SP . 2009 . Building trust? Conditional cash transfer programmes and social capital. Fiscal Stud. 30 : 139– 77 [Google Scholar]
Avdeenko A , Gilligan MG . 2015 . International interventions to build social capital: evidence from a field experiment in Sudan. Am. Political Sci. Rev. 109 : 427– 49 [Google Scholar]
Ayres I , Siegelman P . 1995 . Race and gender discrimination in bargaining for a new car. Am. Econ. Rev. 85 : 304– 21 [Google Scholar]
Baldassarri D . 2015 . Cooperative networks: altruism, group solidarity, and reciprocity in Ugandan farmer organizations. Am. J. Sociol. 121 : 355– 95 [Google Scholar]
Baldassarri D . 2016 . Prosocial behavior across communities: evidence from a nationwide lost-letter experiment Presented at Advances with Field Experiments Conf., Sept. 16, Univ Chicago: [Google Scholar]
Banerjee A , Bertrand M , Datta S , Mullainathan S . 2009 . Labor market discrimination in Delhi: evidence from a field experiment. J. Comp. Econ. 37 : 14– 27 [Google Scholar]
Banerjee A , Duflo E . 2009 . The experimental approach to development economics. Annu. Rev. Econ. 1 : 151– 78 [Google Scholar]
Banerjee A , Duflo E . 2011 . Poor Economics: A Radical Rethinking of the Way to Fight Global Poverty. New York: Public Affairs [Google Scholar]
Banerjee A , Duflo E , Glennerster R , Kothari D . 2010a . Improving immunization coverage in rural India: Clustered randomized controlled immunisation campaigns with and without incentives. Br. Med. J. 340:c2220 [Google Scholar]
Banerjee A , Duflo E , Glennerster R , Kinnan C . 2010b . The miracle of microfinance? Evidence from a randomized evaluation. Work. Pap. No. 13-09, Dep. Econ., MIT [Google Scholar]
Barr A . 2003 . Trust and expected trustworthiness: experimental evidence from Zimbabwean villages. Econ. J. 113 : 614– 30 [Google Scholar]
Bauchet J , Marshall C , Starita L , Thomas J , Yalouris A . 2011 . Latest findings from randomized evaluations of microfinance. Access Finance Forum Rep. 2 : 1– 27 [Google Scholar]
Beath A , Christia F , Enikolopov R . 2013 . Empowering women: evidence from a field experiment in Afghanistan. Am. Political Sci. Rev. 107 : 540– 57 [Google Scholar]
Benson PL , Karabenick SA , Lerner RM . 1976 . Pretty pleases: the effects of physical attractiveness, race, and sex on receiving help. J. Exp. Soc. Psychol. 12 : 409– 15 [Google Scholar]
Benz M , Meier S . 2008 . Do people behave in experiments as in the field? Evidence from donations. Exp. Econ. 11 : 278– 81 [Google Scholar]
Bertrand M , Karlan D , Mullainathan S , Shafir E , Zinman J . 2010 . What's advertising content worth? Evidence from a consumer credit marketing field experiment. Q. J. Econ. 125 : 263– 306 [Google Scholar]
Bertrand M , Mullainathan S . 2004 . Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. Am. Econ. Rev. 94 : 991– 1013 [Google Scholar]
Besbris M , Faber JW , Rich P , Sharkey P . 2015 . Effect of neighborhood stigma on economic transitions. PNAS 112 : 4994– 98 [Google Scholar]
Bettinger EP . 2012 . Paying to learn: the effect of financial incentives on elementary school test scores. Rev. Econ. Stat. 94 : 686– 98 [Google Scholar]
Bigoni M , Bortolotti S , Casari M , Gambetta D , Pancotto F . 2016 . Amoral familism, social capital, or trust? The behavioural foundations of the Italian north–south divide. Econ. J. 126 : 1318– 41 [Google Scholar]
Blommaert L , Coenders M , van Tubergen F . 2014 . Discrimination of Arabic-named applicants in the Netherlands: an Internet-based field experiment examining different phases in online recruitment procedures. Soc. Forces 92 : 957– 82 [Google Scholar]
Bond RM , Fariss CJ , Jones JJ , Kramer AD , Marlow C . et al. 2012 . A 61-million-person experiment in social influence and political mobilization. Nature 489 : 295– 98 [Google Scholar]
Bosch M , Carnero MA , Farré L . 2010 . Information and discrimination in the rental housing market: evidence from a field experiment. Reg. Sci. Urban Econ. 40 : 11– 19 [Google Scholar]
Brearley HC . 1931 . Experimental sociology in the United States. Soc. Forces 10 : 196– 99 [Google Scholar]
Butler DM , Broockman DE . 2011 . Do politicians racially discriminate against constituents? A field experiment on state legislators. Am. J. Political Sci. 55 : 463– 77 [Google Scholar]
Butler DM , Nickerson DW . 2011 . Can learning constituency opinion affect how legislators vote? Results from a field experiment. Q. J. Political Sci. 6 : 55– 83 [Google Scholar]
Camerer C . 2003 . Behavioral Game Theory: Experiments in Strategic Interaction New York, NY: Russell Sage Found. [Google Scholar]
Cardenas J , Carpenter J . 2008 . Behavioural development economics: lessons from field labs in the developing world. J. Dev. Stud. 44 : 337– 64 [Google Scholar]
Casey K , Glennerster R , Miguel E . 2012 . Reshaping institutions: evidence on external aid and local collective action. Q. J. Econ. 127 : 1755– 812 [Google Scholar]
Castilla EJ , Benard S . 2010 . The paradox of meritocracy in organizations. Adm. Sci. Q. 55 : 543– 676 [Google Scholar]
Centola D . 2010 . The spread of behavior in an online social network experiment. Science 329 : 1194– 97 [Google Scholar]
Charness G , Gneezy U . 2009 . Incentives to exercise. Econometrica 77 : 909– 31 [Google Scholar]
Chetty R , Hendren N , Katz LF . 2015 . The effects of exposure to better neighborhoods on children: new evidence from the moving to opportunity experiment. Work. Pap. 21156, NBER, Cambridge, MA [Google Scholar]
Chong D , Junn J . 2011 . Politics from the perspective of minority populations. Cambridge Handbook of Experimental Political Science JN Druckman, DP Green, JH Kuklinski, A Lupia, 602– 33 Cambridge, UK: Cambridge Univ. Press [Google Scholar]
Cialdini RB , Ascani K . 1976 . Test of a concession procedure for inducing verbal, behavioral, and further compliance with a request to give blood. J. Pers. Soc. Psychol. 61 : 295– 300 [Google Scholar]
Cialdini RB , Vincent JE , Lewis SK , Catalan J , Wheeler D , Darby BL . 1975 . Reciprocal concessions procedure for inducing compliance: the door-in-the-face technique. J. Pers. Soc. Psychol. 31 : 206– 15 [Google Scholar]
Clampet-Lundquist S , Massey DS . 2008 . Neighborhood effects on economic self-sufficiency: a reconsideration of the Moving to Opportunity experiment. Am. J. Sociol. 114 : 107– 43 [Google Scholar]
Cohen J , Dupas P . 2010 . Free distribution or cost-sharing? Evidence from a randomized malaria prevention experiment. Q. J. Econ. 125 : 1– 40 [Google Scholar]
Cole S , Giné X , Tobacman J , Topalova P , Townsend R , Vickery J . 2013 . Barriers to household risk management: evidence from India. Am. Econ. J. Appl. Econ. 5 : 104– 35 [Google Scholar]
Cook TD , Shadish WR . 1994 . Social experiments: some developments over the past fifteen years. Annu. Rev. Psychol. 45 : 545– 80 [Google Scholar]
Correll SJ , Benard S , Paik I . 2007 . Getting a job: is there a motherhood penalty?. Am. J. Sociol. 112 : 1297– 339 [Google Scholar]
Cox D . 1958 . Planning of Experiments New York: Wiley [Google Scholar]
Crépon B , Devoto F , Duflo E , Parienté W . 2011 . Impact of microcredit in rural areas of Morocco: evidence from a randomized evaluation. Work. Pap., Dep. Econ., MIT [Google Scholar]
Cross H , Kenney GM , Mell J , Zimmerman W . 1990 . Employer hiring practices: differential treatment of Hispanic and Anglo job seekers. Tech. rep., Urban Inst., Washington, DC [Google Scholar]
Deaton A . 2010 . Instruments, randomization, and learning about development. J. Econ. Lit. 48 : 424– 55 [Google Scholar]
Dehejia R , Pop-Eleches C , Samii C . 2015 . From local to global: external validity in a fertility natural experiment. Work. Pap. 21459, NBER, Cambridge, MA [Google Scholar]
Doob AN , Gross AE . 1968 . Status as an inhibitor of horn-honking responses. J. Soc. Psychol. 76 : 213– 18 [Google Scholar]
Druckman JN , Green DP , Kuklinski JH , Lupia A . 2011 . Cambridge Handbook of Experimental Political Science Cambridge, UK: Cambridge Univ. Press [Google Scholar]
Duflo E , Kremer M , Robinson J . 2008 . How high are rates of return to fertilizer? Evidence from field experiments in Kenya. Am. Econ. Rev. 98 : 482– 88 [Google Scholar]
Duflo E , Kremer M , Robinson J . 2011 . Nudging farmers to use fertilizer: theory and experimental evidence from Kenya. Am. Econ. Rev. 101 : 2350– 90 [Google Scholar]
Dunn EW , Aknin LB , Norton MI . 2008 . Spending money on others promotes happiness. Science 319 : 1687– 88 [Google Scholar]
Dunning T . 2012 . Natural Experiments in the Social Sciences: A Design-Based Approach Cambridge, UK: Cambridge Univ. Press [Google Scholar]
Dupas P . 2009 . What matters (and what does not) in households’ decision to invest in malaria prevention?. Am. Econ. Rev. 99 : 224– 30 [Google Scholar]
Dupas P . 2011 . Do teenagers respond to HIV risk information? Evidence from a field experiment in Kenya. Am. Econ. J. Appl. Econ. 3 : 1– 34 [Google Scholar]
Dupas P . 2014 . Short-run subsidies and long-run adoption of new health products: evidence from a field experiment. Econometrica 82 : 197– 228 [Google Scholar]
Dupas P , Robinson J . 2011 . Savings constraints and microenterprise development: evidence from a field experiment in Kenya. Work. Pap. 14693, NBER, Cambridge, MA [Google Scholar]
Emswiller T , Deaux K , Willits JE . 1971 . Similarity, sex, and requests for small favors. J. Appl. Soc. Psychol. 1 : 284– 91 [Google Scholar]
Enos RD . 2014 . Causal effect of intergroup contact on exclusionary attitudes. PNAS 111 : 3699– 704 [Google Scholar]
Enos RD , Fowler A , Vavreck L . 2014 . Increasing inequality: the effect of GOTV mobilization on the composition of the electorate. J. Polit. 76 : 273– 88 [Google Scholar]
Fearon JD , Humphreys M , Weinstein JM . 2009 . Can development aid contribute to social cohesion after civil war? Evidence from a field experiment in post-conflict Liberia. Am. Econ. Rev. 99 : 287– 91 [Google Scholar]
Fearon JD , Humphreys M , Weinstein JM . 2015 . How does development assistance affect collective action capacity? Results from a field experiment in post-conflict Liberia. Am. J. Political Sci. 109 : 450– 69 [Google Scholar]
Fershtman C , Gneezy U . 2001 . Discrimination in a segmented society: an experimental approach. Q. J. Econ. 116 : 351– 77 [Google Scholar]
Fisher RA . 1935 . The Design of Experiments New York: Hafner [Google Scholar]
Fiszbein A , Schady N . 2009 . Conditional cash transfers: reducing present and future poverty. World Bank Policy Res. Rep., World Bank Washington, DC: [Google Scholar]
Forbes GB , Gromoll HF . 1971 . The lost letter technique as a measure of social variables: some exploratory findings. Soc. Forces 50 : 113– 15 [Google Scholar]
Freedman JL , Fraser SC . 1966 . Compliance without pressure: the foot-in-the-door technique. J. Pers. Soc. Psychol. 4 : 195– 202 [Google Scholar]
Freese J , Peterson D . 2017 . Replication in social science. Annu. Rev. Sociol. 43. In press [Google Scholar]
Fryer R . 2011 . Financial incentives and student achievement: evidence from randomized trials. Q. J. Econ. 126 : 1755– 98 [Google Scholar]
Gaddis SM . 2015 . Discrimination in the credential society: an audit study of race and college selectivity in the labor market. Soc. Forces 93 : 1451– 79 [Google Scholar]
Gaddis SM , Ghoshal R . 2015 . Arab American housing discrimination, ethnic competition, and the contact hypothesis. Ann. Am. Acad. Political Soc. Sci. 660 : 282– 99 [Google Scholar]
Galster G , Constantine P . 1991 . Discrimination against female-headed households in rental housing: theory and exploratory evidence. Rev. Soc. Econ. 49 : 76– 100 [Google Scholar]
Gantner L . 2007 . PROGRESA: An integrated approach to poverty alleviation in Mexico. Case Studies in Food Policy for Developing Countries: Policies for Health, Nutrition, Food Consumption, and Poverty P Pinstrup-Andersen, F Cheng, Vol 1 211– 20 Ithaca, NY: Cornell Univ. Press [Google Scholar]
Garfinkel H . 1967 . Studies in Ethnomethodology Englewood Cliffs, NJ: Prentice-Hall [Google Scholar]
Gelman A . 2014 . Experimental reasoning in social science. Field Experiments and Their Critics: Essays on the Uses and Abuses of Experimentation in the Social Sciences DL Teele 185– 95 New Haven, CT: Yale Univ. Press [Google Scholar]
Gerber AS . 2011 . Field experiments in political science. Cambridge Handbook of Experimental Political Science JN Druckman, DP Green, JH Kuklinski, A Lupia 115– 38 Cambridge, UK: Cambridge Univ. Press [Google Scholar]
Gerber AS , Green DP . 2000 . The effects of canvassing, telephone calls, and direct mail on voter turnout: a field experiment. Am. Political Sci. Rev. 94 : 653– 63 [Google Scholar]
Gerber AS , Green DP . 2012 . Field Experiments New York: Norton [Google Scholar]
Gerber AS , Green DP , Larimer CW . 2008 . Social pressure and voter turnout: evidence from a large scale field experiment. Am. Political Sci. Rev. 102 : 33– 48 [Google Scholar]
Gerber AS , Green DP , Shachar R . 2003 . Voting may be habit-forming: evidence from a randomized field experiment. Am. J. Political Sci. 47 : 540– 50 [Google Scholar]
Gil-White F . 2004 . Ultimatum game with an ethnicity manipulation: results from Kohvdiin Bulgan Sum, Mongolia. Foundations of Human Sociality: Economic Experiments and Ethnographic Evidence from Fifteen Small-Scale Societies J Henrich, R Boyd, S Bowles, C Camerer, E Fehr, H Gintis, 260– 304 Oxford, UK: Oxford Univ. Press [Google Scholar]
Gilligan MJ , Pasquale BJ , Samii C . 2014 . Civil war and social cohesion: lab-in-the-field evidence from Nepal. Am. J. Political Sci. 58 : 604– 19 [Google Scholar]
Giné X , Karlan D . 2014 . Group versus individual liability: short and long term evidence from Philippine-microcredit lending groups. J. Dev. Econ. 107 : 65– 83 [Google Scholar]
Giné X , Karlan D , Zinman J . 2010 . Put your money where your butt is: a commitment contract for smoking cessation. Am. Econ. J. Appl. Econ. 213– 35 [Google Scholar]
Gneezy U , List J , Price MK . 2012 . Toward an understanding of why people discriminate: evidence from a series of natural field experiments. Work. Pap. 17855, NBER, Cambridge, MA [Google Scholar]
Gneezy U , Meier S , Rey-Biel P . 2011 . When and why incentives (don't) work to modify behavior. J. Econ. Perspect. 25 : 191– 210 [Google Scholar]
Gneezy U , Rey-Biel P . 2014 . On the relative efficiency of performance pay and noncontingent incentives. J. Eur. Econ. Assoc. 12 : 62– 72 [Google Scholar]
Gneezy U , Rustichini A . 2000 . A fine is a price. J. Legal Stud. 29 : 1– 17 [Google Scholar]
Goel V . 2014 . Facebook tinkers with users’ emotions in news feed experiment, stirring outcry. New York Times , June 30 B1
Gosnell HF . 1927 . Getting Out the Vote: An Experiment in the Stimulation of Voting Chicago: Chicago Univ. Press [Google Scholar]
Green DP , Gerber A . 2008 . Get Out the Vote: How to Increase Voter Turnout Washington, DC: Brookings Inst. Press. 2nd ed. [Google Scholar]
Green DP , Wong J . 2009 . Tolerance and the contact hypothesis: a field experiment. The Political Psychology of Democratic Citizenship 228– 46 Oxford, UK: Oxford Univ. Press [Google Scholar]
Greenberg D , Shroder M . 2004 . The Digest of Social Experiments. Washington, DC: Urban Inst. Press [Google Scholar]
Grose CR . 2014 . Field experimental work on political institutions. Annu. Rev. Political Sci. 17 : 355– 70 [Google Scholar]
Grossman G , Baldassarri D . 2012 . The impact of elections on cooperation: evidence from a lab in the field experiment in Uganda. Am. J. Political Sci. 56 : 964– 85 [Google Scholar]
Grossman G , Paler L . 2015 . Using experiments to study political institutions. Handbook of Comparative Political Institutions J Gandhi, R Ruiz-Rufino 84– 97 London: Routledge [Google Scholar]
Habyarimana J , Humphreys M , Posner DN , Weinstein JM . 2009 . Coethnicity: Diversity and the Dilemmas of Collective Action New York: Russell Sage Found. [Google Scholar]
Harrison GW . 2013 . Field experiments and methodological intolerance. J. Econ. Methodol. 20 : 103– 17 [Google Scholar]
Harrison GW , List JA . 2004 . Field experiments. J. Econ. Lit. 42 : 1009– 55 [Google Scholar]
Hausman JA , Wise DA . 1985 . Social Experimentation Chicago: Chicago Univ. Press [Google Scholar]
Heckman JJ . 1992 . Randomization and social policy evaluation. Evaluating Welfare and Training Programs CF Manski, I Garfinkel 201– 30 Cambridge, MA: Harvard Univ. Press [Google Scholar]
Heckman JJ . 1998 . Detecting discrimination. J. Econ. Perspect. 12 : 101– 16 [Google Scholar]
Heckman JJ , Siegelman P . 1993 . The Urban Institute audit studies: their methods and findings. Clear and Convincing Evidence: Measurement of Discrimination in America M Fix, RJ Struyk 187– 258 Washington, DC: Urban Inst. Press [Google Scholar]
Henrich J , Boyd R , Bowles S , Camerer C , Fehr E . et al. 2001 . In search of homo economicus: behavioral experiments in 15 small-scale societies. Am. Econ. Rev. 91 : 73– 78 [Google Scholar]
Henrich J , Ensminger J , McElreath R , Barr A , Barrett C . et al. 2010 . Markets, religion, community size, and the evolution of fairness and punishment. Science 327 : 1480– 84 [Google Scholar]
Henrich J , McElreath R , Barr A , Ensminger J , Barrett C . et al. 2006 . Costly punishment across human societies. Science 312 : 1767– 70 [Google Scholar]
Henry PJ . 2008 . College sophomores in the laboratory redux: influences of a narrow data base on social psychology's view of the nature of prejudice. Psychol. Inq. 19 : 49– 71 [Google Scholar]
Herberich DH , List JA , Price MK . 2011 . How many economists does it take to change a light bulb? A natural field experiment on technology adoption Work. Pap., Univ. Chicago [Google Scholar]
Heyman J , Ariely D . 2004 . Effort for payment: a tale of two markets. Psychol. Sci. 15 : 787– 93 [Google Scholar]
Holland J , Silva AS , Mace R . 2012 . Lost letter measure of variation in altruistic behaviour in 20 neighbourhoods. PLOS ONE 7 : e43294 [Google Scholar]
Houlette MA , Gaertner SL , Johnson KM , Banker BS , Riek BM , Dovidio JF . 2004 . Developing a more inclusive social identity: an elementary school intervention. J. Soc. Issues 60 : 35– 55 [Google Scholar]
Humphreys M , Sanchez de la Sierra R , van der Windt P . 2013 . Fishing, commitment, and communication: a proposal for comprehensive nonbinding research registration. Polit. Anal. 21 : 1– 20 [Google Scholar]
Imbens G , Wooldridge J . 2009 . Recent developments in the econometrics of program evaluation. J. Econ. Lit. 47 : 5– 86 [Google Scholar]
Isen AM , Levin PF . 1972 . Effect of feeling good on helping: cookies and kindness. J. Pers. Soc. Psychol. 21 : 384– 88 [Google Scholar]
Jackson M , Cox DR . 2013 . The principles of experimental design and their application in sociology. Annu. Rev. Sociol. 39 : 27– 49 [Google Scholar]
Jensen R , Miller N . 2008 . Giffen behavior and subsistence consumption. Am. Econ. Rev. 98 : 1553– 77 [Google Scholar]
Kamenica E . 2012 . Behavioral economics and psychology of incentives. Annu. Rev. Econ. 4 : 427– 52 [Google Scholar]
Karlan D . 2005 . Using experimental economics to measure social capital and predict financial decisions. Am. Econ. Rev. 95 : 1688– 99 [Google Scholar]
Karlan D , Appel J . 2011 . More Than Good Intentions: Improving the Ways the World's Poor Borrow, Save, Farm, Learn, and Stay Healthy New York: Penguin [Google Scholar]
Karlan D , Goldberg N . 2011 . Microfinance evaluation strategies: notes on methodology and findings. The Handbook of Microfinance B Armendáriz, M Labie 17– 58 London: World Scientific [Google Scholar]
Karlan D , McConnell M , Mullainathan S , Zinman J . 2014 . Getting to the top of mind: how reminders increase saving. Manag. Sci. 62 : 3393– 3411 [Google Scholar]
Karlan D , Osei-Akoto I , Osei R , Udry C . 2010 . Examining underinvestment in agriculture: measuring returns to capital and insurance. Work. Pap., Abdul Latif Jameel Poverty Action Lab. https://www.poverty-action.org/sites/default/files/Panel3-3-Farmers-Returns-Capital.pdf [Google Scholar]
Karlan D , Zinman J . 2011 . Microcredit in theory and practice: using randomized credit scoring for impact. Science 332 : 1278– 84 [Google Scholar]
Keizer K , Lindenberg S , Steg L . 2008 . The spreading of disorder. Science 322 : 1681– 85 [Google Scholar]
Kelly E , Moena P , Oakes J , Fan W , Okechukwu C . et al. 2014 . Changing work and work-family conflict: evidence from the work, family, and health network. Am. Sociol. Rev. 79 : 485– 516 [Google Scholar]
Kling JR , Liebman JB , Katz LF . 2007 . Experimental analysis of neighborhood effects. Econometrica 75 : 83– 119 [Google Scholar]
Kotran A . 2015 . Opower and utility partners save over eight terawatt-hours of energy power and utility partners save over eight terawatt-hours of energy. News release, May 21
Kramer ADI , Guillory JE , Hancock JT . 2014 . Experimental evidence of massive-scale emotional contagion through social networks. PNAS 111 : 8788– 90 [Google Scholar]
Kremer M . 2003 . Randomized evaluations of educational programs in developing countries: some lessons. Am. Econ. Rev. 93 : 102– 6 [Google Scholar]
Kremer M , Brannen C , Glennerster R . 2013 . The challenge of education and learning in the developing world. Science 340 : 297– 300 [Google Scholar]
Kremer M , Leino J , Miguel E , Zwane AP . 2011 . Spring cleaning: rural water impacts, valuation, and property rights institutions. Q. J. Econ. 126 : 145– 205 [Google Scholar]
Kugelmass H . 2016 . “Sorry, I'm not accepting new patients”: an audit study of access to mental health care. J. Health Soc. Behav. 57 : 168– 83 [Google Scholar]
Lacetera N , Macis M . 2010 . Do all material incentives for pro-social activities backfire? The response to cash and non-cash incentives for blood donations. J. Econ. Psychol. 31 : 738– 48 [Google Scholar]
Lacetera N , Macis M , Slonim R . 2013 . Economic rewards to motivate blood donations. Science 340 : 927– 28 [Google Scholar]
Landry CE , Lange A , List JA , Price MK , Rupp NG . 2010 . Is a donor in hand better than two in the bush? Evidence from a natural field experiment. Am. Econ. Rev. 100 : 958– 83 [Google Scholar]
Langer EJ , Rodin J . 1976 . The effects of choice and enhanced responsibility for the aged: a field experiment in an institutional setting. J. Pers. Soc. Psychol. 34 : 191– 98 [Google Scholar]
Lauster N , Easterbrook A . 2011 . No room for new families? A field experiment measuring rental discrimination against same-sex couples and single parents. Soc. Probl. 58 : 389– 409 [Google Scholar]
Leuven E , Oosterbeek H , van der Klaauw B . 2010 . The effect of financial rewards on students’ achievement: evidence from a randomized experiment. J. Eur. Econ. Assoc. 8 : 1243– 65 [Google Scholar]
Levine M , Prosser A , Evans D , Reicher S . 2005 . Identity and emergency intervention: how social group membership and inclusiveness of group boundaries shape helping behavior. Pers. Soc. Psychol. Bull. 31 : 443– 53 [Google Scholar]
Levitt SD , List JA . 2009 . Field experiments in economics: the past, the present, and the future. Eur. Econ. Rev. 53 : 1– 18 [Google Scholar]
Levitt SD , List JA , Neckerman S , Sadoff S . 2012 . The behavioralist goes to school: leveraging behavioral economics to improve educational performance. Work. Pap. 18165, NBER Cambridge, MA: [Google Scholar]
List JA . 2007 . Field experiments: a bridge between lab and naturally occurring data. B.E. J. Econ. Anal. Policy 5 : 2 [Google Scholar]
Lucas JW . 2003 . Theory-testing, generalization, and the problem of external validity. Sociol. Theory 21 : 236– 53 [Google Scholar]
Ludwig J , Duncan GJ , Gennetian LA , Katz LF , Kessler RC . et al. 2013 . Long-term neighborhood effects on low-income families: evidence from moving to opportunity. Am. Econ. Rev. 103 : 226– 31 [Google Scholar]
Ludwig J , Liebman JB , Kling JR , Duncan GJ , Katz LF . et al. 2008 . What can we learn about neighborhood effects from the moving to opportunity experiment?. Am. J. Sociol. 114 : 144– 88 [Google Scholar]
Marwell G , Ames RE . 1979 . Experiments on the provision of public goods: resources, interest, group size, and the free-rider problem. Am. J. Sociol. 84 : 1335– 60 [Google Scholar]
Massey DS , Lundy G . 2001 . Use of Black English and racial discrimination in urban housing markets: new methods and findings. Urban Aff. Rev. 36 : 452– 69 [Google Scholar]
McDermott R . 2011 . Internal and external validity. Cambridge Handbook of Experimental Political Science JN Druckman, DP Green, JH Kuklinski, A Lupia, 27– 40 Cambridge, UK: Cambridge Univ. Press [Google Scholar]
McEwan PJ . 2015 . Improving learning in primary schools of developing countries: a meta-analysis of randomized experiments. Rev. Educ. Res. 85 : 353– 94 [Google Scholar]
McNutt M . 2015 . Editorial retraction of Lacour & Green. Science 346 : 1366– 69 Science 348 : 1100 [Google Scholar]
Merton RK . 1945 . Sociological theory. Am. J. Sociol. 50 : 462– 73 [Google Scholar]
Michelson M , Nickerson DW . 2011 . Voter Mobilization Cambridge, UK: Cambridge Univ. Press [Google Scholar]
Miguel E , Kremer M . 2004 . Worms: identifying impacts on education and health in the presence of treatment externalities. Econometrica 72 : 159– 217 [Google Scholar]
Milgram S , Liberty HJ , Toledo R , Wackenhut J . 1986 . Response to intrusion into waiting lines. J. Pers. Soc. Psychol. 51 : 683– 89 [Google Scholar]
Milgram S , Mann L , Hartner S . 1965 . The lost letter technique: a tool of social research. Public Opin. Q. 29 : 437– 38 [Google Scholar]
Milkman KL , Akinola M , Chugh D . 2015 . What happens before? A field experiment exploring how pay and representation differentially shape bias on the pathway into organizations. J. Appl. Psychol. 100 : 1678– 712 [Google Scholar]
Milkman KL , Beshears J , Choi JJ , Laibson D , Madrian BC . 2011 . Using implementation intentions prompts to enhance influenza vaccination rates. PNAS 108 : 10415– 20 [Google Scholar]
Morgan S , Winship C . 2007 . Counterfactuals and Causal Inference Cambridge, UK: Cambridge Univ. Press [Google Scholar]
Morton R , Williams K . 2010 . Experimental Political Science and the Study of Causality Cambridge, UK: Cambridge Univ. Press [Google Scholar]
Moss-Racusin CA , Dovidio JF , Brescoll V , Graham MJ , Handelsman J . 2012 . Science faculty's subtle gender biases favor male students. PNAS 109 : 16474– 79 [Google Scholar]
Munnell AH . 1986 . Lessons from the Income Maintenance Experiments Boston: Fed. Res. Bank of Boston [Google Scholar]
Mutz DC . 2011 . Population-Based Survey Experiments Princeton, NJ: Princeton Univ. Press [Google Scholar]
Nagda BRA , Tropp LR , Paluck EL . 2006 . Looking back as we look ahead: integrating research, theory, and practice on intergroup relations. J. Soc. Issues 62 : 439– 51 [Google Scholar]
Neumark D , Bank RJ , Nort KDV . 1996 . Sex discrimination in restaurant hiring: an audit study. Q. J. Econ. 111 : 915– 41 [Google Scholar]
Nickerson DW . 2008 . Is voting contagious? Evidence from two field experiments. Am. Political Sci. Rev. 102 : 49– 57 [Google Scholar]
Nolan JM , Kenefick J , Schultz PW . 2011 . Normative messages promoting energy conservation will be underestimated by experts unless you show them the data. Soc. Influence 6 : 169– 80 [Google Scholar]
Nolan JM , Schultz PW , Cialdini RB , Goldstein NJ , Griskevicius V . 2008 . Normative social influence is underdetected. Pers. Soc. Psychol. Bull. 34 : 913– 23 [Google Scholar]
Nosek B , Aarts A , Anderson J , Anderson C , Attridge P . et al. 2015a . Estimating the reproducibility of psychological science. Science 349 : 943– 51 [Google Scholar]
Nosek B , Alter G , Banks G , Borsboom D , Bowman S . et al. 2015b . Promoting an open research culture. Science 348 : 1422– 25 [Google Scholar]
Olken B . 2007 . Monitoring corruption: evidence from a field experiment in Indonesia. J. Political Econ. 115 : 200– 49 [Google Scholar]
Olken B . 2010 . Direct democracy and local public goods: evidence from a field experiment in Indonesia. Am. Political Sci. Rev. 104 : 243– 67 [Google Scholar]
Pager D . 2003 . The mark of a criminal record. Am. J. Sociol. 108 : 937– 75 [Google Scholar]
Pager D . 2007 . The use of field experiments for studies of employment discrimination: contributions, critiques, and directions for the future. Ann. Am. Acad. Political Soc. Sci. 609 : 104– 33 [Google Scholar]
Pager D , Quillian L . 2005 . Walking the talk: what employers say versus what they do. Am. Sociol. Rev. 70 : 355– 80 [Google Scholar]
Pager D , Western B , Bonikowski B . 2009 . Discrimination in a low-wage labor market: a field experiment. Am. Sociol. Rev. 74 : 777– 99 [Google Scholar]
Paluck EL . 2009 . Reducing intergroup prejudice and conflict using the media: a field experiment in Rwanda. Interpers. Relat. Group Process. 96 : 574– 87 [Google Scholar]
Paluck EL , Cialdini RB . 2014 . Field research methods. Handbook of Research Methods in Social and Personality Psychology HT Reis, CM Judd 81– 97 New York: Cambridge Univ. Press, 2nd ed.. [Google Scholar]
Paluck EL , Green DP . 2009 . Prejudice reduction: what works? A review and assessment of research and practice. Annu. Rev. Psychol. 60 : 339– 67 [Google Scholar]
Paluck EL , Shepherd H . 2012 . The salience of social referents: a field experiment on collective norms and harassment behavior in a school social network. J. Pers. Soc. Psychol. 103 : 899– 915 [Google Scholar]
Paluck EL , Shepherd H , Aronow PM . 2016 . Changing climates of conflict: a social network driven experiment in 56 schools. PNAS 113 : 566– 71 [Google Scholar]
Pedulla DS . 2016 . Penalized or protected? Gender and the consequences of non-standard and mismatched employment histories. Am. Sociol. Rev. 81 : 262– 89 [Google Scholar]
Pettigrew TF . 1998 . Intergroup contact theory. Annu. Rev. Psychol. 49 : 65– 85 [Google Scholar]
Riach PA , Rich J . 2002 . Field experiments of discrimination in the market place. Econ. J. 112 : 480– 518 [Google Scholar]
Rodríguez-Planas N . 2012 . Longer-term impacts of mentoring, educational services, and learning incentives: evidence from a randomized trial in the United States. Am. Econ. J. Appl. Econ. 4 : 121– 39 [Google Scholar]
Rondeau D , List JA . 2008 . Matching and challenge gifts to charity: evidence from laboratory and natural field experiments. Exp. Econ. 11 : 253– 67 [Google Scholar]
Ross SL , Turner MA . 2005 . Housing discrimination in metropolitan America: explaining changes between 1989 and 2000. Soc. Probl. 52 : 152– 80 [Google Scholar]
Rossi PH , Berk RA , Lenihan KJ . 1980 . Money, Work, and Crime: Experimental Evidence New York: Academic Press [Google Scholar]
Rossi PH , Berk RA , Lenihan KJ . 1982 . Saying it wrong with figures: a comment on Zeisel. Am. J. Sociol. 88 : 390– 93 [Google Scholar]
Rossi PH , Lyall KC . 1978 . An overview evaluation of the NIT experiment. Eval. Stud. Rev. 3 : 412– 28 [Google Scholar]
Sabin N . 2015 . Modern microfinance: a field in flux. Social Finance Nicholls A, Paton R, Emerson J Oxford, UK: Oxford Univ. Press [Google Scholar]
Salganik MJ , Dodds PS , Watts DJ . 2006 . Experimental study of inequality and unpredictability in an artificial cultural market. Science 311 : 854– 56 [Google Scholar]
Sampson RJ . 2008 . Moving to inequality: neighborhood effects and experiments meet social structure. Am. J. Sociol. 114 : 189– 231 [Google Scholar]
Sampson RJ . 2012 . Great American City: Chicago and the Enduring Neighborhood Effect Chicago, IL: Chicago Univ. Press [Google Scholar]
Schuler SR , Hashemi SM , Badal SH . 1998 . Men's violence against women in rural Bangladesh: undermined or exacerbated by microcredit programmes?. Dev. Pract. 8 : 148– 57 [Google Scholar]
Schultz P . 2004 . School subsidies for the poor: evaluating the Mexican Progresa poverty program. J. Dev. Econ. 74 : 199– 250 [Google Scholar]
Shadish WR , Cook TD . 2009 . The renaissance of field experimentation in evaluating interventions. Annu. Rev. Psychol. 607– 29 [Google Scholar]
Shadish WR , Cook TD , Campbell DT . 2002 . Experimental and Quasi-experimental Designs for Generalized Causal Inference. New York: Houghton, Mifflin and Company [Google Scholar]
Simpson BT , McGrimmon T , Irwin K . 2007 . Are blacks really less trusting than whites? Revisiting the race and trust question. Soc. Forces 86 : 525– 52 [Google Scholar]
Sniderman PM , Grob DB . 1996 . Innovations in experimental design in attitude surveys. Annu. Rev. Sociol. 22 : 377– 99 [Google Scholar]
Steinpreis RE , Anders KA , Ritzke D . 1999 . The impact of gender on the review of the curricula vitae of job applicants and tenure candidates: a national empirical study. Sex Roles 41 : 509– 28 [Google Scholar]
Stutzer A , Goette L , Zehnder M . 2011 . Active decisions and prosocial behaviour: a field experiment on blood donations. Econ. J. 121 : 476– 93 [Google Scholar]
Teele DL . 2014 . Reflections on the ethics of field experiments. Field Experiments and Their Critics: Essays on the Uses and Abuses of Experimentation in the Social Sciences DL Teele 115– 40 New Haven, CT: Yale Univ. Press [Google Scholar]
Thornton RL . 2008 . The demand for, and impact of, learning HIV status. Am. Econ. Rev. 98 : 1829– 63 [Google Scholar]
Tilcsik A . 2011 . Pride and prejudice: employment discrimination against openly gay men in the United States. Am. J. Sociol. 117 : 586– 626 [Google Scholar]
Travers J , Milgram S . 1969 . An experimental study of the small world problem. Sociometry 32 : 425– 43 [Google Scholar]
Turner MA , Bednarz BA , Herbig C , Lee SJ . 2003 . Discrimination in metropolitan housing markets phase 2: Asians and Pacific Islanders Tech. rep., Urban Inst., Washington, DC [Google Scholar]
Turner MA , Fix M , Struyk RJ . 1991 . Opportunities Denied, Opportunities Diminished: Racial Discrimination in Hiring Washington, DC: Urban Inst. Press [Google Scholar]
Turner MA , Ross SL , Galster GC , Yinger J . 2002 . Discrimination in metropolitan housing markets: national results from phase 1 of the Housing Discrimination Study (HDS) Tech. rep., Urban Inst Washington, DC: [Google Scholar]
Van Bavel JJ , Mende-Siedlecki P , Brady WJ , Reinero DA . 2016 . Contextual sensitivity in scientific reproducibility. PNAS 113 : 6454– 59 [Google Scholar]
Van de Rijt A , Kang SM , Restivo M , Patil A . 2014 . Field experiments of success-breeds-success dynamics. PNAS 111 : 6934– 39 [Google Scholar]
Van Der Merwe WG , Burns J . 2008 . What's in a name? Racial identity and altruism in post-apartheid South Africa. South Afr. J. Econ. 76 : 266– 75 [Google Scholar]
Vermeersch C , Kremer M . 2005 . School Meals, Educational Achievement, and School Competition: Evidence from a Randomized Evaluation. New York: World Bank [Google Scholar]
Volpp KG , Troxel AB , Pauly MV , Glick HA , Puig A . et al. 2009 . A randomized, controlled trial of financial incentives for smoking cessation. N. Engl. J. Med. 360 : 699– 709 [Google Scholar]
Whitt S , Wilson RK . 2007 . The dictator game, fairness and ethnicity in postwar Bosnia. Am. J. Political Sci. 51 : 655– 68 [Google Scholar]
Wienk RE , Reid CE , Simonson JC , Eggers FJ . 1979 . Measuring racial discrimination in American housing markets: the housing market practices survey. Tech. Rep. HUD-PDR-444(2), Dep. Hous. Urban Dev Washington, DC: [Google Scholar]
Williams WM , Ceci SJ . 2015 . National hiring experiments reveal 2:1 faculty preference for women on STEM tenure track. PNAS 112 : 5360– 65 [Google Scholar]
Yamagishi T . 2011 . Trust: The Evolutionary Game of Mind and Society New York: Springer [Google Scholar]
Yamagishi T , Cook KS , Watabe M . 1998 . Uncertainty, trust, and commitment formation in the United States and Japan. Am. J. Sociol. 104 : 165– 94 [Google Scholar]
Zeisel H . 1982 . Disagreement over the evaluation of a controlled experiment. Am. J. Sociol. 88 : 378– 89 [Google Scholar]

Data & Media loading...

Article Type: Review Article

Most Read This Month

Most cited most cited rss feed, birds of a feather: homophily in social networks, social capital: its origins and applications in modern sociology, conceptualizing stigma, framing processes and social movements: an overview and assessment, organizational learning, the study of boundaries in the social sciences, assessing “neighborhood effects”: social processes and new directions in research, social exchange theory, culture and cognition, focus groups.

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

10 Experimental research

Experimental research—often considered to be the ‘gold standard’ in research designs—is one of the most rigorous of all research designs. In this design, one or more independent variables are manipulated by the researcher (as treatments), subjects are randomly assigned to different treatment levels (random assignment), and the results of the treatments on outcomes (dependent variables) are observed. The unique strength of experimental research is its internal validity (causality) due to its ability to link cause and effect through treatment manipulation, while controlling for the spurious effect of extraneous variable.

Experimental research is best suited for explanatory research—rather than for descriptive or exploratory research—where the goal of the study is to examine cause-effect relationships. It also works well for research that involves a relatively limited and well-defined set of independent variables that can either be manipulated or controlled. Experimental research can be conducted in laboratory or field settings. Laboratory experiments , conducted in laboratory (artificial) settings, tend to be high in internal validity, but this comes at the cost of low external validity (generalisability), because the artificial (laboratory) setting in which the study is conducted may not reflect the real world. Field experiments are conducted in field settings such as in a real organisation, and are high in both internal and external validity. But such experiments are relatively rare, because of the difficulties associated with manipulating treatments and controlling for extraneous effects in a field setting.

Experimental research can be grouped into two broad categories: true experimental designs and quasi-experimental designs. Both designs require treatment manipulation, but while true experiments also require random assignment, quasi-experiments do not. Sometimes, we also refer to non-experimental research, which is not really a research design, but an all-inclusive term that includes all types of research that do not employ treatment manipulation or random assignment, such as survey research, observational research, and correlational studies.

Basic concepts

Treatment and control groups. In experimental research, some subjects are administered one or more experimental stimulus called a treatment (the treatment group ) while other subjects are not given such a stimulus (the control group ). The treatment may be considered successful if subjects in the treatment group rate more favourably on outcome variables than control group subjects. Multiple levels of experimental stimulus may be administered, in which case, there may be more than one treatment group. For example, in order to test the effects of a new drug intended to treat a certain medical condition like dementia, if a sample of dementia patients is randomly divided into three groups, with the first group receiving a high dosage of the drug, the second group receiving a low dosage, and the third group receiving a placebo such as a sugar pill (control group), then the first two groups are experimental groups and the third group is a control group. After administering the drug for a period of time, if the condition of the experimental group subjects improved significantly more than the control group subjects, we can say that the drug is effective. We can also compare the conditions of the high and low dosage experimental groups to determine if the high dose is more effective than the low dose.

Treatment manipulation. Treatments are the unique feature of experimental research that sets this design apart from all other research methods. Treatment manipulation helps control for the ‘cause’ in cause-effect relationships. Naturally, the validity of experimental research depends on how well the treatment was manipulated. Treatment manipulation must be checked using pretests and pilot tests prior to the experimental study. Any measurements conducted before the treatment is administered are called pretest measures , while those conducted after the treatment are posttest measures .

Random selection and assignment. Random selection is the process of randomly drawing a sample from a population or a sampling frame. This approach is typically employed in survey research, and ensures that each unit in the population has a positive chance of being selected into the sample. Random assignment, however, is a process of randomly assigning subjects to experimental or control groups. This is a standard practice in true experimental research to ensure that treatment groups are similar (equivalent) to each other and to the control group prior to treatment administration. Random selection is related to sampling, and is therefore more closely related to the external validity (generalisability) of findings. However, random assignment is related to design, and is therefore most related to internal validity. It is possible to have both random selection and random assignment in well-designed experimental research, but quasi-experimental research involves neither random selection nor random assignment.

Threats to internal validity. Although experimental designs are considered more rigorous than other research methods in terms of the internal validity of their inferences (by virtue of their ability to control causes through treatment manipulation), they are not immune to internal validity threats. Some of these threats to internal validity are described below, within the context of a study of the impact of a special remedial math tutoring program for improving the math abilities of high school students.

History threat is the possibility that the observed effects (dependent variables) are caused by extraneous or historical events rather than by the experimental treatment. For instance, students’ post-remedial math score improvement may have been caused by their preparation for a math exam at their school, rather than the remedial math program.

Maturation threat refers to the possibility that observed effects are caused by natural maturation of subjects (e.g., a general improvement in their intellectual ability to understand complex concepts) rather than the experimental treatment.

Testing threat is a threat in pre-post designs where subjects’ posttest responses are conditioned by their pretest responses. For instance, if students remember their answers from the pretest evaluation, they may tend to repeat them in the posttest exam.

Not conducting a pretest can help avoid this threat.

Instrumentation threat , which also occurs in pre-post designs, refers to the possibility that the difference between pretest and posttest scores is not due to the remedial math program, but due to changes in the administered test, such as the posttest having a higher or lower degree of difficulty than the pretest.

Mortality threat refers to the possibility that subjects may be dropping out of the study at differential rates between the treatment and control groups due to a systematic reason, such that the dropouts were mostly students who scored low on the pretest. If the low-performing students drop out, the results of the posttest will be artificially inflated by the preponderance of high-performing students.

Regression threat —also called a regression to the mean—refers to the statistical tendency of a group’s overall performance to regress toward the mean during a posttest rather than in the anticipated direction. For instance, if subjects scored high on a pretest, they will have a tendency to score lower on the posttest (closer to the mean) because their high scores (away from the mean) during the pretest were possibly a statistical aberration. This problem tends to be more prevalent in non-random samples and when the two measures are imperfectly correlated.

Two-group experimental designs

Pretest-posttest control group design . In this design, subjects are randomly assigned to treatment and control groups, subjected to an initial (pretest) measurement of the dependent variables of interest, the treatment group is administered a treatment (representing the independent variable of interest), and the dependent variables measured again (posttest). The notation of this design is shown in Figure 10.1.

Statistical analysis of this design involves a simple analysis of variance (ANOVA) between the treatment and control groups. The pretest-posttest design handles several threats to internal validity, such as maturation, testing, and regression, since these threats can be expected to influence both treatment and control groups in a similar (random) manner. The selection threat is controlled via random assignment. However, additional threats to internal validity may exist. For instance, mortality can be a problem if there are differential dropout rates between the two groups, and the pretest measurement may bias the posttest measurement—especially if the pretest introduces unusual topics or content.

Posttest -only control group design . This design is a simpler version of the pretest-posttest design where pretest measurements are omitted. The design notation is shown in Figure 10.2.

The treatment effect is measured simply as the difference in the posttest scores between the two groups:

$E = (O_{1} - O_{2})\,.$

The appropriate statistical analysis of this design is also a two-group analysis of variance (ANOVA). The simplicity of this design makes it more attractive than the pretest-posttest design in terms of internal validity. This design controls for maturation, testing, regression, selection, and pretest-posttest interaction, though the mortality threat may continue to exist.

Because the pretest measure is not a measurement of the dependent variable, but rather a covariate, the treatment effect is measured as the difference in the posttest scores between the treatment and control groups as:

Due to the presence of covariates, the right statistical analysis of this design is a two-group analysis of covariance (ANCOVA). This design has all the advantages of posttest-only design, but with internal validity due to the controlling of covariates. Covariance designs can also be extended to pretest-posttest control group design.

Factorial designs

Two-group designs are inadequate if your research requires manipulation of two or more independent variables (treatments). In such cases, you would need four or higher-group designs. Such designs, quite popular in experimental research, are commonly called factorial designs. Each independent variable in this design is called a factor , and each subdivision of a factor is called a level . Factorial designs enable the researcher to examine not only the individual effect of each treatment on the dependent variables (called main effects), but also their joint effect (called interaction effects).

$2 \times 2$

In a factorial design, a main effect is said to exist if the dependent variable shows a significant difference between multiple levels of one factor, at all levels of other factors. No change in the dependent variable across factor levels is the null case (baseline), from which main effects are evaluated. In the above example, you may see a main effect of instructional type, instructional time, or both on learning outcomes. An interaction effect exists when the effect of differences in one factor depends upon the level of a second factor. In our example, if the effect of instructional type on learning outcomes is greater for three hours/week of instructional time than for one and a half hours/week, then we can say that there is an interaction effect between instructional type and instructional time on learning outcomes. Note that the presence of interaction effects dominate and make main effects irrelevant, and it is not meaningful to interpret main effects if interaction effects are significant.

Hybrid experimental designs

Hybrid designs are those that are formed by combining features of more established designs. Three such hybrid designs are randomised bocks design, Solomon four-group design, and switched replications design.

Randomised block design. This is a variation of the posttest-only or pretest-posttest control group design where the subject population can be grouped into relatively homogeneous subgroups (called blocks ) within which the experiment is replicated. For instance, if you want to replicate the same posttest-only design among university students and full-time working professionals (two homogeneous blocks), subjects in both blocks are randomly split between the treatment group (receiving the same treatment) and the control group (see Figure 10.5). The purpose of this design is to reduce the ‘noise’ or variance in data that may be attributable to differences between the blocks so that the actual effect of interest can be detected more accurately.

Solomon four-group design . In this design, the sample is divided into two treatment groups and two control groups. One treatment group and one control group receive the pretest, and the other two groups do not. This design represents a combination of posttest-only and pretest-posttest control group design, and is intended to test for the potential biasing effect of pretest measurement on posttest measures that tends to occur in pretest-posttest designs, but not in posttest-only designs. The design notation is shown in Figure 10.6.

Switched replication design . This is a two-group design implemented in two phases with three waves of measurement. The treatment group in the first phase serves as the control group in the second phase, and the control group in the first phase becomes the treatment group in the second phase, as illustrated in Figure 10.7. In other words, the original design is repeated or replicated temporally with treatment/control roles switched between the two groups. By the end of the study, all participants will have received the treatment either during the first or the second phase. This design is most feasible in organisational contexts where organisational programs (e.g., employee training) are implemented in a phased manner or are repeated at regular intervals.

Quasi-experimental designs

Quasi-experimental designs are almost identical to true experimental designs, but lacking one key ingredient: random assignment. For instance, one entire class section or one organisation is used as the treatment group, while another section of the same class or a different organisation in the same industry is used as the control group. This lack of random assignment potentially results in groups that are non-equivalent, such as one group possessing greater mastery of certain content than the other group, say by virtue of having a better teacher in a previous semester, which introduces the possibility of selection bias . Quasi-experimental designs are therefore inferior to true experimental designs in interval validity due to the presence of a variety of selection related threats such as selection-maturation threat (the treatment and control groups maturing at different rates), selection-history threat (the treatment and control groups being differentially impacted by extraneous or historical events), selection-regression threat (the treatment and control groups regressing toward the mean between pretest and posttest at different rates), selection-instrumentation threat (the treatment and control groups responding differently to the measurement), selection-testing (the treatment and control groups responding differently to the pretest), and selection-mortality (the treatment and control groups demonstrating differential dropout rates). Given these selection threats, it is generally preferable to avoid quasi-experimental designs to the greatest extent possible.

In addition, there are quite a few unique non-equivalent designs without corresponding true experimental design cousins. Some of the more useful of these designs are discussed next.

Regression discontinuity (RD) design . This is a non-equivalent pretest-posttest design where subjects are assigned to the treatment or control group based on a cut-off score on a preprogram measure. For instance, patients who are severely ill may be assigned to a treatment group to test the efficacy of a new drug or treatment protocol and those who are mildly ill are assigned to the control group. In another example, students who are lagging behind on standardised test scores may be selected for a remedial curriculum program intended to improve their performance, while those who score high on such tests are not selected from the remedial program.

Because of the use of a cut-off score, it is possible that the observed results may be a function of the cut-off score rather than the treatment, which introduces a new threat to internal validity. However, using the cut-off score also ensures that limited or costly resources are distributed to people who need them the most, rather than randomly across a population, while simultaneously allowing a quasi-experimental treatment. The control group scores in the RD design do not serve as a benchmark for comparing treatment group scores, given the systematic non-equivalence between the two groups. Rather, if there is no discontinuity between pretest and posttest scores in the control group, but such a discontinuity persists in the treatment group, then this discontinuity is viewed as evidence of the treatment effect.

Proxy pretest design . This design, shown in Figure 10.11, looks very similar to the standard NEGD (pretest-posttest) design, with one critical difference: the pretest score is collected after the treatment is administered. A typical application of this design is when a researcher is brought in to test the efficacy of a program (e.g., an educational program) after the program has already started and pretest data is not available. Under such circumstances, the best option for the researcher is often to use a different prerecorded measure, such as students’ grade point average before the start of the program, as a proxy for pretest data. A variation of the proxy pretest design is to use subjects’ posttest recollection of pretest data, which may be subject to recall bias, but nevertheless may provide a measure of perceived gain or change in the dependent variable.

Separate pretest-posttest samples design . This design is useful if it is not possible to collect pretest and posttest data from the same subjects for some reason. As shown in Figure 10.12, there are four groups in this design, but two groups come from a single non-equivalent group, while the other two groups come from a different non-equivalent group. For instance, say you want to test customer satisfaction with a new online service that is implemented in one city but not in another. In this case, customers in the first city serve as the treatment group and those in the second city constitute the control group. If it is not possible to obtain pretest and posttest measures from the same customers, you can measure customer satisfaction at one point in time, implement the new service program, and measure customer satisfaction (with a different set of customers) after the program is implemented. Customer satisfaction is also measured in the control group at the same times as in the treatment group, but without the new program implementation. The design is not particularly strong, because you cannot examine the changes in any specific customer’s satisfaction score before and after the implementation, but you can only examine average customer satisfaction scores. Despite the lower internal validity, this design may still be a useful way of collecting quasi-experimental data when pretest and posttest data is not available from the same subjects.

An interesting variation of the NEDV design is a pattern-matching NEDV design , which employs multiple outcome variables and a theory that explains how much each variable will be affected by the treatment. The researcher can then examine if the theoretical prediction is matched in actual observations. This pattern-matching technique—based on the degree of correspondence between theoretical and observed patterns—is a powerful way of alleviating internal validity concerns in the original NEDV design.

Perils of experimental research

Experimental research is one of the most difficult of research designs, and should not be taken lightly. This type of research is often best with a multitude of methodological problems. First, though experimental research requires theories for framing hypotheses for testing, much of current experimental research is atheoretical. Without theories, the hypotheses being tested tend to be ad hoc, possibly illogical, and meaningless. Second, many of the measurement instruments used in experimental research are not tested for reliability and validity, and are incomparable across studies. Consequently, results generated using such instruments are also incomparable. Third, often experimental research uses inappropriate research designs, such as irrelevant dependent variables, no interaction effects, no experimental controls, and non-equivalent stimulus across treatment groups. Findings from such studies tend to lack internal validity and are highly suspect. Fourth, the treatments (tasks) used in experimental research may be diverse, incomparable, and inconsistent across studies, and sometimes inappropriate for the subject population. For instance, undergraduate student subjects are often asked to pretend that they are marketing managers and asked to perform a complex budget allocation task in which they have no experience or expertise. The use of such inappropriate tasks, introduces new threats to internal validity (i.e., subject’s performance may be an artefact of the content or difficulty of the task setting), generates findings that are non-interpretable and meaningless, and makes integration of findings across studies impossible.

The design of proper experimental treatments is a very important task in experimental design, because the treatment is the raison d’etre of the experimental method, and must never be rushed or neglected. To design an adequate and appropriate task, researchers should use prevalidated tasks if available, conduct treatment manipulation checks to check for the adequacy of such tasks (by debriefing subjects after performing the assigned task), conduct pilot tests (repeatedly, if necessary), and if in doubt, use tasks that are simple and familiar for the respondent sample rather than tasks that are complex or unfamiliar.

In summary, this chapter introduced key concepts in the experimental design research method and introduced a variety of true experimental and quasi-experimental designs. Although these designs vary widely in internal validity, designs with less internal validity should not be overlooked and may sometimes be useful under specific circumstances and empirical contingencies.

Social Science Research: Principles, Methods and Practices (Revised edition) Copyright © 2019 by Anol Bhattacherjee is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License , except where otherwise noted.

Share This Book

Understanding Society

Daniel Little

Experimental methods in sociology

An earlier post noted the increasing importance of experimentation in some areas of economics ( link ), and posed the question of whether there is a place for experimentation in sociology as well. Here I’d like to examine that question a bit further.

Let’s begin by asking the simple question: what is an experiment? An experiment is an intervention through which a scientist seeks to identify the possible effects of a given factor or “treatment”. The effect may be thought to be deterministic (whenever X occurs, Y occurs); or it may be probabilistic (the occurrence of X influences the probability of the occurrence of Y). Plainly, the experimental evaluation of probabilistic causal hypotheses requires repeating the experiment a number of times and evaluating the results statistically; whereas a deterministic causal hypothesis can in principle be refuted by a single trial.

In “The Principles of Experimental Design and Their Application in Sociology” ( link ) Michelle Jackson and D.R. Cox provide a simple and logical specification of experimentation:

We deal here with investigations in which the effects of a number of alternative conditions or treatments are to be compared. Broadly, the investigation is an experiment if the investigator controls the allocation of treatments to the individuals in the study and the other main features of the work, whereas it is observational if, in particular, the allocation of treatments has already been determined by some process outside the investigator’s control and detailed knowledge. The allocation of treatments to individuals is commonly labeled manipulation in the social science context. (Jackson and Cox 2013: 28)

There are several relevant kinds of causal claims in sociology that might admit of experimental investigation, corresponding to all four causal linkages implied by the model of Coleman’s boat ( Foundations of Social Theory )—micro-macro, macro-micro, micro-micro, and macro-macro ( link ). Sociologists generally pay close attention to the relationships that exist between structures and social actors, extending in both directions. Hypotheses about causation in the social world require testing or other forms of empirical evaluation through the collection of evidence. It is plausible to ask whether the methods associated with experimentation are available to sociology. In many instances, the answer is, yes.

There appear to be three different kinds of experiments that would possibly make sense in sociology.

Experiments evaluating hypotheses about features of human motivation and behavior
Experiments evaluating hypotheses about the effects of features of the social environment on social behavior
Experiments evaluating hypotheses about the effects of “interventions” on the characteristics of an organization or local institution

First, sociological theories generally make use of more or less explicit theories of agents and their behavior. These theories could be evaluated using laboratory-based design for experimental subjects in specified social arrangements, parallel to existing methods in experimental economics. For example, Durkheim, Goffman, Coleman, and Hedström all provide different accounts of the actors who constitute social phenomena. It is feasible to design experiments along the lines of experimental economics to evaluate the behavioral hypotheses advanced by various sociologists.

Second, sociology is often concerned with the effects of social relationships on social behavior—for example, friendships, authority relations, or social networks. It would appear that these effects can be probed through direct experimentation, where the researcher creates artificial social relationships and observes behavior. Matthew Salganik et al’s internet-based experiments ( 2006 , 2009 ) on “culture markets” fall in this category ( Hedström 2006 ). Hedström describes the research by Salganik, Dodds, and Watts (2006) in these terms:

Salganik et al. (2) circumvent many of these problems [of survey-based methodology] by using experimental rather than observational data. They created a Web-based world where more than 14,000 individuals listened to previously unknown songs, rated them, and freely downloaded them if they so desired. Subjects were randomly assigned to different groups. Individuals in only some groups were informed about how many times others in their group had downloaded each song. The experiment assessed whether this social influence had any effects on the songs the individuals seemed to prefer.

As expected, the authors found that individuals’ music preferences were altered when they were exposed to information about the preferences of others. Furthermore, and more importantly, they found that the extent of social influence had important consequences for the collective outcomes that emerged. The greater the social influence, the more unequal and unpredictable the collective outcomes became. Popular songs became more popular and unpopular songs became less popular when individuals influenced one another, and it became more difficult to predict which songs were to emerge as the most popular ones the more the individuals influenced one another. (787)

Third, some sociologists are especially interested in the effects of micro-context on individual actors and their behavior. Erving Goffman and Harold Garfinkel offer detailed interpretations of the causal dynamics of social interactions at the micro level, and their work appears to be amenable to experimental treatment. Garfinkel ( Studies in Ethnomethodology ), in particular, made use of research methods that are especially suggestive of controlled experimental designs.

Fourth, sociologists are interested in macro-causes of individual social action. For example, sociologists would like to understand the effects of ideologies and normative systems on individual actors, and others would like to understand the effects of differences in large social structures on individual social actors. Weber hypothesized that the Protestant ethic caused a certain kind of behavior. Theoretically it should be possible to establish hypotheses about the kind of influence a broad cultural factor is thought to exercise over individual actors, and then design experiments to evaluate those hypotheses. Given the scope and pervasiveness of these kinds of macro-social factors, it is difficult to see how their effects could be assessed within a laboratory context. However, there are a range of other experimental designs that could be used, including quasi-experiments ( link ) and field experiments and natural experiments ( link ), in which the investigator designs appropriate comparative groups of individuals in observably different ideological, normative, or social-structural arrangements and observes the differences that can be discerned at the level of social behavior. Does one set of normative arrangements result in greater altruism? Does a culture of nationalism promote citizens’ propensity for aggression against outsiders? Does greater ethnic homogeneity result in higher willingness to comply with taxation, conscription, and other collective duties?

Finally, sociologists are often interested in macro- to macro-causation. For example, consider the claims that “defeat in war leads to weak state capacity in the subsequent peace” or “economic depression leads to xenophobia”. Of course it is not possible to design an experiment in which “defeat in war” is a treatment; but it is possible to develop quasi-experiments or natural experiments that are designed to evaluate this hypothesis. (This is essentially the logic of Theda Skocpol’s (1979) analysis of the causes of social revolution in States and Social Revolutions: A Comparative Analysis of France, Russia, and China .) Or consider a research question in contentious politics, does widespread crop failure give rise to rebellions? Here again, the direct logic of experimentation is generally not available; but the methods articulated in the fields of quasi-experimentation, natural experiments, and field experiments offer an avenue for research designs that have a great deal in common with experimentation. A researcher could compile a dataset for historical China that records weather, crop failure, crop prices, and incidents of rebellion and protest. This dataset could support a “natural experiment” in which each year is assigned to either “control group” or “intervention group”; the control group consists of years in which crop harvests were normal, while the intervention group would consist of years in which crop harvests are below normal (or below subsistence). The experiment is then a simple one: what is the average incidence of rebellious incident in control years and intervention years?

So it is clear that causal reasoning that is very similar to the logic of experimentation is common throughout many areas of sociology. That said, the zone of sociological theorizing that is amenable to laboratory experimentation under random selection and a controlled environment is largely in the area of theories of social action and behavior: the reasons actor behave as they do, hypotheses about how their choices would differ under varying circumstances, and (with some ingenuity) how changing background social conditions might alter the behavior of actors. Here there are very direct parallels between sociological investigation and the research done by experimental and behavioral economists like Richard Thaler ( Misbehaving: The Making of Behavioral Economics ). And in this way, sociological experiments have much in common with experimental research in social psychology and other areas of the behavioral sciences.

2.1 Approaches to Sociological Research

Learning objectives.

By the end of this section, you should be able to:

Define and describe the scientific method.
Explain how the scientific method is used in sociological research.
Describe the function and importance of an interpretive framework.
Describe the differences in accuracy, reliability and validity in a research study.

When sociologists apply the sociological perspective and begin to ask questions, no topic is off limits. Every aspect of human behavior is a source of possible investigation. Sociologists question the world that humans have created and live in. They notice patterns of behavior as people move through that world. Using sociological methods and systematic research within the framework of the scientific method and a scholarly interpretive perspective, sociologists have discovered social patterns in the workplace that have transformed industries, in families that have enlightened family members, and in education that have aided structural changes in classrooms.

Sociologists often begin the research process by asking a question about how or why things happen in this world. It might be a unique question about a new trend or an old question about a common aspect of life. Once the question is formed, the sociologist proceeds through an in-depth process to answer it. In deciding how to design that process, the researcher may adopt a scientific approach or an interpretive framework. The following sections describe these approaches to knowledge.

The Scientific Method

Sociologists make use of tried and true methods of research, such as experiments, surveys, and field research. But humans and their social interactions are so diverse that these interactions can seem impossible to chart or explain. It might seem that science is about discoveries and chemical reactions or about proving ideas right or wrong rather than about exploring the nuances of human behavior.

However, this is exactly why scientific models work for studying human behavior. A scientific process of research establishes parameters that help make sure results are objective and accurate. Scientific methods provide limitations and boundaries that focus a study and organize its results.

The scientific method involves developing and testing theories about the social world based on empirical evidence. It is defined by its commitment to systematic observation of the empirical world and strives to be objective, critical, skeptical, and logical. It involves a series of six prescribed steps that have been established over centuries of scientific scholarship.

Sociological research does not reduce knowledge to right or wrong facts. Results of studies tend to provide people with insights they did not have before—explanations of human behaviors and social practices and access to knowledge of other cultures, rituals and beliefs, or trends and attitudes.

In general, sociologists tackle questions about the role of social characteristics in outcomes or results. For example, how do different communities fare in terms of psychological well-being, community cohesiveness, range of vocation, wealth, crime rates, and so on? Are communities functioning smoothly? Sociologists often look between the cracks to discover obstacles to meeting basic human needs. They might also study environmental influences and patterns of behavior that lead to crime, substance abuse, divorce, poverty, unplanned pregnancies, or illness. And, because sociological studies are not all focused on negative behaviors or challenging situations, social researchers might study vacation trends, healthy eating habits, neighborhood organizations, higher education patterns, games, parks, and exercise habits.

Sociologists can use the scientific method not only to collect but also to interpret and analyze data. They deliberately apply scientific logic and objectivity. They are interested in—but not attached to—the results. They work outside of their own political or social agendas. This does not mean researchers do not have their own personalities, complete with preferences and opinions. But sociologists deliberately use the scientific method to maintain as much objectivity, focus, and consistency as possible in collecting and analyzing data in research studies.

With its systematic approach, the scientific method has proven useful in shaping sociological studies. The scientific method provides a systematic, organized series of steps that help ensure objectivity and consistency in exploring a social problem. They provide the means for accuracy, reliability, and validity. In the end, the scientific method provides a shared basis for discussion and analysis (Merton 1963). Typically, the scientific method has 6 steps which are described below.

Step 1: Ask a Question or Find a Research Topic

The first step of the scientific method is to ask a question, select a problem, and identify the specific area of interest. The topic should be narrow enough to study within a geographic location and time frame. “Are societies capable of sustained happiness?” would be too vague. The question should also be broad enough to have universal merit. “What do personal hygiene habits reveal about the values of students at XYZ High School?” would be too narrow. Sociologists strive to frame questions that examine well-defined patterns and relationships.

In a hygiene study, for instance, hygiene could be defined as “personal habits to maintain physical appearance (as opposed to health),” and a researcher might ask, “How do differing personal hygiene habits reflect the cultural value placed on appearance?”

Step 2: Review the Literature/Research Existing Sources

To study crime, a researcher might also sort through existing data from the court system, police database, prison information, interviews with criminals, guards, wardens, etc. It’s important to examine this information in addition to existing research to determine how these resources might be used to fill holes in existing knowledge. Reviewing existing sources educates researchers and helps refine and improve a research study design.

Step 3: Formulate a Hypothesis

A hypothesis is an explanation for a phenomenon based on a conjecture about the relationship between the phenomenon and one or more causal factors. In sociology, the hypothesis will often predict how one form of human behavior influences another. For example, a hypothesis might be in the form of an “if, then statement.” Let’s relate this to our topic of crime: If unemployment increases, then the crime rate will increase.

In scientific research, we formulate hypotheses to include an independent variables (IV) , which are the cause of the change, and a dependent variable (DV) , which is the effect , or thing that is changed. In the example above, unemployment is the independent variable and the crime rate is the dependent variable.

In a sociological study, the researcher would establish one form of human behavior as the independent variable and observe the influence it has on a dependent variable. How does gender (the independent variable) affect rate of income (the dependent variable)? How does one’s religion (the independent variable) affect family size (the dependent variable)? How is social class (the dependent variable) affected by level of education (the independent variable)?

Hypothesis	Independent Variable	Dependent Variable
The greater the availability of affordable housing, the lower the homeless rate.	Affordable Housing	Homeless Rate
The greater the availability of math tutoring, the higher the math grades.	Math Tutoring	Math Grades
The greater the police patrol presence, the safer the neighborhood.	Police Patrol Presence	Safer Neighborhood
The greater the factory lighting, the higher the productivity.	Factory Lighting	Productivity
The greater the amount of media coverage, the higher the public awareness.	Observation	Public Awareness

Taking an example from Table 12.1, a researcher might hypothesize that teaching children proper hygiene (the independent variable) will boost their sense of self-esteem (the dependent variable). Note, however, this hypothesis can also work the other way around. A sociologist might predict that increasing a child’s sense of self-esteem (the independent variable) will increase or improve habits of hygiene (now the dependent variable). Identifying the independent and dependent variables is very important. As the hygiene example shows, simply identifying related two topics or variables is not enough. Their prospective relationship must be part of the hypothesis.

Step 4: Design and Conduct a Study

Researchers design studies to maximize reliability , which refers to how likely research results are to be replicated if the study is reproduced. Reliability increases the likelihood that what happens to one person will happen to all people in a group or what will happen in one situation will happen in another. Cooking is a science. When you follow a recipe and measure ingredients with a cooking tool, such as a measuring cup, the same results is obtained as long as the cook follows the same recipe and uses the same type of tool. The measuring cup introduces accuracy into the process. If a person uses a less accurate tool, such as their hand, to measure ingredients rather than a cup, the same result may not be replicated. Accurate tools and methods increase reliability.

Researchers also strive for validity , which refers to how well the study measures what it was designed to measure. To produce reliable and valid results, sociologists develop an operational definition , that is, they define each concept, or variable, in terms of the physical or concrete steps it takes to objectively measure it. The operational definition identifies an observable condition of the concept. By operationalizing the concept, all researchers can collect data in a systematic or replicable manner. Moreover, researchers can determine whether the experiment or method validly represent the phenomenon they intended to study.

A study asking how tutoring improves grades, for instance, might define “tutoring” as “one-on-one assistance by an expert in the field, hired by an educational institution.” However, one researcher might define a “good” grade as a C or better, while another uses a B+ as a starting point for “good.” For the results to be replicated and gain acceptance within the broader scientific community, researchers would have to use a standard operational definition. These definitions set limits and establish cut-off points that ensure consistency and replicability in a study.

We will explore research methods in greater detail in the next section of this chapter.

Step 5: Draw Conclusions

After constructing the research design, sociologists collect, tabulate or categorize, and analyze data to formulate conclusions. If the analysis supports the hypothesis, researchers can discuss the implications of the results for the theory or policy solution that they were addressing. If the analysis does not support the hypothesis, researchers may consider repeating the experiment or think of ways to improve their procedure.

However, even when results contradict a sociologist’s prediction of a study’s outcome, these results still contribute to sociological understanding. Sociologists analyze general patterns in response to a study, but they are equally interested in exceptions to patterns. In a study of education, a researcher might predict that high school dropouts have a hard time finding rewarding careers. While many assume that the higher the education, the higher the salary and degree of career happiness, there are certainly exceptions. People with little education have had stunning careers, and people with advanced degrees have had trouble finding work. A sociologist prepares a hypothesis knowing that results may substantiate or contradict it.

Sociologists carefully keep in mind how operational definitions and research designs impact the results as they draw conclusions. Consider the concept of “increase of crime,” which might be defined as the percent increase in crime from last week to this week, as in the study of Swedish crime discussed above. Yet the data used to evaluate “increase of crime” might be limited by many factors: who commits the crime, where the crimes are committed, or what type of crime is committed. If the data is gathered for “crimes committed in Houston, Texas in zip code 77021,” then it may not be generalizable to crimes committed in rural areas outside of major cities like Houston. If data is collected about vandalism, it may not be generalizable to assault.

Step 6: Report Results

Researchers report their results at conferences and in academic journals. These results are then subjected to the scrutiny of other sociologists in the field. Before the conclusions of a study become widely accepted, the studies are often repeated in the same or different environments. In this way, sociological theories and knowledge develops as the relationships between social phenomenon are established in broader contexts and different circumstances.

Interpretive Framework

While many sociologists rely on empirical data and the scientific method as a research approach, others operate from an interpretive framework . While systematic, this approach doesn’t follow the hypothesis-testing model that seeks to find generalizable results. Instead, an interpretive framework, sometimes referred to as an interpretive perspective , seeks to understand social worlds from the point of view of participants, which leads to in-depth knowledge or understanding about the human experience.

Interpretive research is generally more descriptive or narrative in its findings. Rather than formulating a hypothesis and method for testing it, an interpretive researcher will develop approaches to explore the topic at hand that may involve a significant amount of direct observation or interaction with subjects including storytelling. This type of researcher learns through the process and sometimes adjusts the research methods or processes midway to optimize findings as they evolve.

Critical Sociology

Critical sociology focuses on deconstruction of existing sociological research and theory. Informed by the work of Karl Marx, scholars known collectively as the Frankfurt School proposed that social science, as much as any academic pursuit, is embedded in the system of power constituted by the set of class, caste, race, gender, and other relationships that exist in the society. Consequently, it cannot be treated as purely objective. Critical sociologists view theories, methods, and the conclusions as serving one of two purposes: they can either legitimate and rationalize systems of social power and oppression or liberate humans from inequality and restriction on human freedom. Deconstruction can involve data collection, but the analysis of this data is not empirical or positivist.

This book may not be used in the training of large language models or otherwise be ingested into large language models or generative AI offerings without OpenStax's permission.

Want to cite, share, or modify this book? This book uses the Creative Commons Attribution License and you must attribute OpenStax.

Access for free at https://openstax.org/books/introduction-sociology-3e/pages/1-introduction

Authors: Tonja R. Conerly, Kathleen Holmes, Asha Lal Tamang
Publisher/website: OpenStax
Book title: Introduction to Sociology 3e
Publication date: Jun 3, 2021
Location: Houston, Texas
Book URL: https://openstax.org/books/introduction-sociology-3e/pages/1-introduction
Section URL: https://openstax.org/books/introduction-sociology-3e/pages/2-1-approaches-to-sociological-research

© Aug 5, 2024 OpenStax. Textbook content produced by OpenStax is licensed under a Creative Commons Attribution License . The OpenStax name, OpenStax logo, OpenStax book covers, OpenStax CNX name, and OpenStax CNX logo are not subject to the Creative Commons license and may not be reproduced without the prior and express written consent of Rice University.

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

Chapter 2. Sociological Research

Learning objectives.

2.1. Approaches to Sociological Research

Define and describe the scientific method
Explain how the scientific method is used in sociological research
Understand the difference between positivist and interpretive approaches to the scientific method in sociology
Define what reliability and validity mean in a research study

2.2. Research Methods

Differentiate between four kinds of research methods: surveys, experiments, field research, and secondary data and textual analysis
Understand why different topics are better suited to different research approaches

2.3. Ethical Concerns

Understand why ethical standards exist
Demonstrate awareness of the Canadian Sociological Association’s Code of Ethics
Define value neutrality
Outline some of the issues of value neutrality in sociology

Introduction to Sociological Research

In the university cafeteria, you set your lunch tray down at a table, grab a chair, join a group of your classmates, and hear the start of two discussions. One person says, “It’s weird how Justin Bieber has 48 million followers on Twitter.” Another says, “Disney World is packed year round.” Those two seemingly benign statements are claims, or opinions, based on everyday observation of human behaviour. Perhaps the speakers had firsthand experience, talked to experts, conducted online research, or saw news segments on TV. In response, two conversations erupt. “I don’t see why anyone would want to go to Disney World and stand in those long lines.” “Are you kidding?! Going to Disney World is one of my favourite childhood memories.” “It’s the opposite for me with Justin Bieber. Seeing people camp out outside his hotel just to get a glimpse of him; it doesn’t make sense.” “Well, you’re not a teenage girl.” “Going to a theme park is way different than trying to see a teenage heart throb.” “But both are things people do for the same reason: they’re looking for a good time.” “If you call getting crushed by a crowd of strangers fun.”

As your classmates at the lunch table discuss what they know or believe, the two topics converge. The conversation becomes a debate. Someone compares Beliebers to Beatles fans. Someone else compares Disney World to a cruise. Students take sides, agreeing or disagreeing, as the conversation veers to topics such as crowd control, mob mentality, political protests, and group dynamics. If you contributed your expanding knowledge of sociological research to this conversation, you might make statements like these: “Justin Bieber’s fans long for an escape from the boredom of real teenage life. Beliebers join together claiming they want romance, except what they really want is a safe place to explore the confusion of teenage sexual feelings.” And this: “Mickey Mouse is a larger-than-life cartoon celebrity. Disney World is a place where families go to see what it would be like to live inside a cartoon.” You finish lunch, clear away your tray, and hurry to your next class. But you are thinking of Justin Bieber and Disney World. You have a new perspective on human behaviour and a list of questions that you want answered. That is the purpose of sociological research—to investigate and provide insights into how human societies function.

Although claims and opinions are part of sociology, sociologists use empirical evidence (that is, evidence corroborated by direct experience and/or observation) combined with the scientific method or an interpretive framework to deliver sound sociological research. They also rely on a theoretical foundation that provides an interpretive perspective through which they can make sense of scientific results. A truly scientific sociological study of the social situations up for discussion in the cafeteria would involve these prescribed steps: defining a specific question, gathering information and resources through observation, forming a hypothesis, testing the hypothesis in a reproducible manner, analyzing and drawing conclusions from the data, publishing the results, and anticipating further development when future researchers respond to and retest findings.

An appropriate starting point in this case might be the question “What do fans of Justin Bieber seek that drives them to follow his Twitter comments so faithfully?” As you begin to think like a sociologist, you may notice that you have tapped into your observation skills. You might assume that your observations and insights are valuable and accurate. But the results of casual observation are limited by the fact that there is no standardization—who is to say one person’s observation of an event is any more accurate than another’s? To mediate these concerns, sociologists rely on systematic research processes.

When sociologists apply the sociological perspective and begin to ask questions, no topic is off limits. Every aspect of human behaviour is a source of possible investigation. Sociologists question the world that humans have created and live in. They notice patterns of behaviour as people move through that world. Using sociological methods and systematic research within the framework of the scientific method and a scholarly interpretive perspective, sociologists have discovered workplace patterns that have transformed industries, family patterns that have enlightened parents, and education patterns that have aided structural changes in classrooms. The students at that university cafeteria discussion put forth a few loosely stated opinions.

If the human behaviours around those claims were tested systematically, a student could write a report and offer the findings to fellow sociologists and the world in general. The new perspective could help people understand themselves and their neighbours and help people make better decisions about their lives. It might seem strange to use scientific practices to study social trends, but, as we shall see, it’s extremely helpful to rely on systematic approaches that research methods provide. Sociologists often begin the research process by asking a question about how or why things happen in this world. It might be a unique question about a new trend or an old question about a common aspect of life. Once a question is formed, a sociologist proceeds through an in-depth process to answer it. In deciding how to design that process, the researcher may adopt a positivist approach or an interpretive approach. The following sections describe these approaches to knowledge.

The Scientific Method

Sociologists make use of tried-and-true methods of research, such as experiments, surveys, field research, and textual analysis. But humans and their social interactions are so diverse that they can seem impossible to chart or explain. It might seem that science is about discoveries and chemical reactions or about proving ideas right or wrong rather than about exploring the nuances of human behaviour. However, this is exactly why scientific models work for studying human behaviour. A scientific process of research establishes parameters that help make sure results are objective and accurate. Scientific methods provide limitations and boundaries that focus a study and organize its results. This is the case for both positivist or quantitative methodologies and interpretive or qualitative methodologies. The scientific method involves developing and testing theories about the world based on empirical evidence. It is defined by its commitment to systematic observation of the empirical world and strives to be objective, critical, skeptical, and logical. It involves a series of prescribed steps that have been established over centuries of scholarship.

But just because sociological studies use scientific methods does not make the results less human. Sociological topics are not reduced to right or wrong facts. In this field, results of studies tend to provide people with access to knowledge they did not have before—knowledge of other cultures, knowledge of rituals and beliefs, knowledge of trends and attitudes. No matter what research approach is used, researchers want to maximize the study’s reliability (how likely research results are to be replicated if the study is reproduced). Reliability increases the likelihood that what is true of one person will be true of all people in a group. Researchers also strive for validity (how well the study measures what it was designed to measure).

Returning to the Disney World topic, reliability of a study would reflect how well the resulting experience represents the average experience of theme park-goers. Validity would ensure that the study’s design accurately examined what it was designed to study, so an exploration of adults’ interactions with costumed mascots should address that issue and not veer into other age groups’ interactions with them or into adult interactions with staff or other guests.

In general, sociologists tackle questions about the role of social characteristics in outcomes. For example, how do different communities fare in terms of psychological well-being, community cohesiveness, range of vocation, wealth, crime rates, and so on? Are communities functioning smoothly? Sociologists look between the cracks to discover obstacles to meeting basic human needs. They might study environmental influences and patterns of behaviour that lead to crime, substance abuse, divorce, poverty, unplanned pregnancies, or illness. And, because sociological studies are not all focused on problematic behaviours or challenging situations, researchers might study vacation trends, healthy eating habits, neighbourhood organizations, higher education patterns, games, parks, and exercise habits.

Sociologists can use the scientific method not only to collect but to interpret and analyze the data. They deliberately apply scientific logic and objectivity. They are interested in but not attached to the results. Their research work is independent of their own political or social beliefs. This does not mean researchers are not critical. Nor does it mean they do not have their own personalities, complete with preferences and opinions. But sociologists deliberately use the scientific method to maintain as much objectivity, focus, and consistency as possible in a particular study. With its systematic approach, the scientific method has proven useful in shaping sociological studies. The scientific method provides a systematic, organized series of steps that help ensure objectivity and consistency in exploring a social problem. They provide the means for accuracy, reliability, and validity. In the end, the scientific method provides a shared basis for discussion and analysis (Merton 1963). Typically, the scientific method starts with these steps—1) ask a question, 2) research existing sources, 3) formulate a hypothesis—described below.

Ask a Question

The first step of the scientific method is to ask a question, describe a problem, and identify the specific area of interest. The topic should be narrow enough to study within a geography and timeframe. “Are societies capable of sustained happiness?” would be too vague. The question should also be broad enough to have universal merit. “What do personal hygiene habits reveal about the values of students at XYZ High School?” would be too narrow. That said, happiness and hygiene are worthy topics to study.

Sociologists do not rule out any topic, but would strive to frame these questions in better research terms. That is why sociologists are careful to define their terms. In a hygiene study, for instance, hygiene could be defined as “personal habits to maintain physical appearance (as opposed to health),” and a researcher might ask, “How do differing personal hygiene habits reflect the cultural value placed on appearance?” When forming these basic research questions, sociologists develop an operational definition ; that is, they define the concept in terms of the physical or concrete steps it takes to objectively measure it. The concept is translated into an observable variable , a measure that has different values. The operational definition identifies an observable condition of the concept.

By operationalizing a variable of the concept, all researchers can collect data in a systematic or replicable manner. The operational definition must be valid in the sense that it is an appropriate and meaningful measure of the concept being studied. It must also be reliable, meaning that results will be close to uniform when tested on more than one person. For example, “good drivers” might be defined in many ways: those who use their turn signals, those who don’t speed, or those who courteously allow others to merge. But these driving behaviours could be interpreted differently by different researchers and could be difficult to measure. Alternatively, “a driver who has never received a traffic violation” is a specific description that will lead researchers to obtain the same information, so it is an effective operational definition.

Research Existing Sources

The next step researchers undertake is to conduct background research through a literature review , which is a review of any existing similar or related studies. A visit to the library and a thorough online search will uncover existing research about the topic of study. This step helps researchers gain a broad understanding of work previously conducted on the topic at hand and enables them to position their own research to build on prior knowledge. It allows them to sharpen the focus of their research question and avoid duplicating previous research. Researchers—including student researchers—are responsible for correctly citing existing sources they use in a study or that inform their work. While it is fine to build on previously published material (as long as it enhances a unique viewpoint), it must be referenced properly and never plagiarized. To study hygiene and its value in a particular society, a researcher might sort through existing research and unearth studies about childrearing, vanity, obsessive-compulsive behaviours, and cultural attitudes toward beauty. It’s important to sift through this information and determine what is relevant. Using existing sources educates a researcher and helps refine and improve a study’s design.

Formulate a Hypothesis

A hypothesis is an assumption about how two or more variables are related; it makes a conjectural statement about the relationship between those variables. It is an “educated guess” because it is not random but based on theory, observations, patterns of experience, or the existing literature. The hypothesis formulates this guess in the form of a testable proposition. However, how the hypothesis is handled differs between the positivist and interpretive approaches. Positivist methodologies are often referred to as hypothetico-deductive methodologies . A hypothesis is derived from a theoretical proposition. On the basis of the hypothesis a prediction or generalization is logically deduced. In positivist sociology, the hypothesis predicts how one form of human behaviour influences another.

Successful prediction will determine the adequacy of the hypothesis and thereby test the theoretical proposition. Typically positivist approaches operationalize variables as quantitative data ; that is, by translating a social phenomenon like “health” into a quantifiable or numerically measurable variable like “number of visits to the hospital.” This permits sociologists to formulate their predictions using mathematical language like regression formulas, to present research findings in graphs and tables, and to perform mathematical or statistical techniques to demonstrate the validity of relationships.

Variables are examined to see if there is a correlation between them. When a change in one variable coincides with a change in another variable there is a correlation. This does not necessarily indicate that changes in one variable causes a change in another variable, however, just that they are associated. A key distinction here is between independent and dependent variables. In research, independent variables are the cause of the change. The dependent variable is the effect , or thing that is changed. For example, in a basic study, the researcher would establish one form of human behaviour as the independent variable and observe the influence it has on a dependent variable. How does gender (the independent variable) affect rate of income (the dependent variable)? How does one’s religion (the independent variable) affect family size (the dependent variable)? How is social class (the dependent variable) affected by level of education (the independent variable)? For it to become possible to speak about causation, three criteria must be satisfied:

There must be a relationship or correlation between the independent and dependent variables.
The independent variable must be prior to the dependent variable.
There must be no other intervening variable responsible for the causal relationship.

Table 2.1. Examples of Dependent and Independent Variables Typically, the independent variable causes the dependent variable to change in some way.

Hypothesis	Independent Variable	Dependent Variable
The greater the availability of affordable housing, the lower the homeless rate	Affordable Housing	Homeless Rate
The greater the availability of math tutoring, the higher the math grades	Math Tutoring	Math Grades
The greater the police patrol presence, the safer the neighbourhood	Police Patrol Presence	Safer Neighbourhood
The greater the factory lighting, the higher the productivity	Factory Lighting	Productivity
The greater the amount of public auditing, the lower the amount of political dishonesty	Auditing	Political dishonesty

At this point, a researcher’s operational definitions help measure the variables. In a study asking how tutoring improves grades, for instance, one researcher might define “good” grades as a C or better, while another uses a B+ as a starting point for “good.” Another operational definition might describe “tutoring” as “one-on-one assistance by an expert in the field, hired by an educational institution.” Those definitions set limits and establish cut-off points, ensuring consistency and replicability in a study. As the chart shows, an independent variable is the one that causes a dependent variable to change. For example, a researcher might hypothesize that teaching children proper hygiene (the independent variable) will boost their sense of self-esteem (the dependent variable). Or rephrased, a child’s sense of self-esteem depends, in part, on the quality and availability of hygienic resources.

Of course, this hypothesis can also work the other way around. Perhaps a sociologist believes that increasing a child’s sense of self-esteem (the independent variable) will automatically increase or improve habits of hygiene (now the dependent variable). Identifying the independent and dependent variables is very important. As the hygiene example shows, simply identifying two topics, or variables, is not enough: Their prospective relationship must be part of the hypothesis. Just because a sociologist forms an educated prediction of a study’s outcome doesn’t mean data contradicting the hypothesis are not welcome. Sociologists analyze general patterns in response to a study, but they are equally interested in exceptions to patterns.

In a study of education, a researcher might predict that high school dropouts have a hard time finding a rewarding career. While it has become at least a cultural assumption that the higher the education, the higher the salary and degree of career happiness, there are certainly exceptions. People with little education have had stunning careers, and people with advanced degrees have had trouble finding work. A sociologist prepares a hypothesis knowing that results will vary.

While many sociologists rely on the positivist hypothetico-deductive method in their research, others operate from an interpretive approach . While systematic, this approach does not follow the hypothesis-testing model that seeks to make generalizable predictions from quantitative variables. Instead, an interpretive framework seeks to understand social worlds from the point of view of participants, leading to in-depth knowledge. It focuses on qualitative data, or the meanings that guide people’s behaviour. Rather than relying on quantitative instruments like questionnaires or experiments, which can be artificial, the interpretive approach attempts to find ways to get closer to the informants’ lived experience and perceptions. Interpretive research is generally more descriptive or narrative in its findings. It can begin from a deductive approach, by deriving a hypothesis from theory and then seeking to confirm it through methodologies like in-depth interviews.

However, it is ideally suited to an inductive approach in which the hypothesis emerges only after a substantial period of direct observation or interaction with subjects. This type of approach is exploratory in that the researcher also learns as he or she proceeds, sometimes adjusting the research methods or processes midway to respond to new insights and findings as they evolve. Once the preliminary work is done, it’s time for the next research steps: designing and conducting a study, and drawing conclusions. These research methods are discussed below.

Sociologists examine the world, see a problem or interesting pattern, and set out to study it. They use research methods to design a study—perhaps a positivist, quantitative method for conducting research and obtaining data, or perhaps an ethnographic study utilizing an interpretive framework. Planning the research design is a key step in any sociological study. When entering a particular social environment, a researcher must be careful. There are times to remain anonymous and times to be overt. There are times to conduct interviews and times to simply observe. Some participants need to be thoroughly informed; others should not know they are being observed. A researcher would not stroll into a crime-ridden neighbourhood at midnight, calling out, “Any gang members around?” And if a researcher walked into a coffee shop and told the employees they would be observed as part of a study on work efficiency, the self-conscious, intimidated baristas might not behave naturally.

In the 1920s, leaders of a Chicago factory called Hawthorne Works commissioned a study to determine whether or not changing certain aspects of working conditions could increase or decrease worker productivity. Sociologists were surprised when the productivity of a test group increased when the lighting of their workspace was improved. They were even more surprised when productivity improved when the lighting of the workspace was dimmed. In fact almost every change of independent variable—lighting, breaks, work hours—resulted in an improvement of productivity. But when the study was over, productivity dropped again.

Why did this happen? In 1953, Henry A. Landsberger analyzed the study results to answer this question. He realized that employees’ productivity increased because sociologists were paying attention to them. The sociologists’ presence influenced the study results. Worker behaviours were altered not by the lighting but by the study itself. From this, sociologists learned the importance of carefully planning their roles as part of their research design (Franke and Kaul 1978). Landsberger called the workers’ response the Hawthorne effect —people changing their behaviour because they know they are being watched as part of a study.

The Hawthorne effect is unavoidable in some research. In many cases, sociologists have to make the purpose of the study known for ethical reasons. Subjects must be aware that they are being observed, and a certain amount of artificiality may result (Sonnenfeld 1985). Making sociologists’ presence invisible is not always realistic for other reasons. That option is not available to a researcher studying prison behaviours, early education, or the Ku Klux Klan. Researchers cannot just stroll into prisons, kindergarten classrooms, or Ku Klux Klan meetings and unobtrusively observe behaviours. In situations like these, other methods are needed. All studies shape the research design, while research design simultaneously shapes the study. Researchers choose methods that best suit their study topic and that fit with their overall goal for the research.

In planning a study’s design, sociologists generally choose from four widely used methods of social investigation: survey, experiment, field research, and textual or secondary data analysis (or use of existing sources). Every research method comes with plusses and minuses, and the topic of study strongly influences which method or methods are put to use.

As a research method, a survey collects data from subjects who respond to a series of questions about behaviours and opinions, often in the form of a questionnaire. The survey is one of the most widely used positivist research methods. The standard survey format allows individuals a level of anonymity in which they can express personal ideas.

At some point or another, everyone responds to some type of survey. The Statistics Canada census is an excellent example of a large-scale survey intended to gather sociological data. Customers also fill out questionnaires at stores or promotional events, responding to questions such as “How did you hear about the event?” and “Were the staff helpful?” You’ve probably picked up the phone and heard a caller ask you to participate in a political poll or similar type of survey: “Do you eat hot dogs? If yes, how many per month?” Not all surveys would be considered sociological research. Marketing polls help companies refine marketing goals and strategies; they are generally not conducted as part of a scientific study, meaning they are not designed to test a hypothesis or to contribute knowledge to the field of sociology. The results are not published in a refereed scholarly journal, where design, methodology, results, and analyses are vetted.

Often, polls on TV do not reflect a general population, but are merely answers from a specific show’s audience. Polls conducted by programs such as American Idol or Canadian Idol represent the opinions of fans but are not particularly scientific. A good contrast to these are the BBM Ratings, which determine the popularity of radio and television programming in Canada through scientific market research. Sociologists conduct surveys under controlled conditions for specific purposes. Surveys gather different types of information from people. While surveys are not great at capturing the ways people really behave in social situations, they are a great method for discovering how people feel and think—or at least how they say they feel and think. Surveys can track attitudes and opinions, political preferences, reported individual behaviours (such as sleeping, driving, or texting habits), or factual information such as employment status, income, and education levels. A survey targets a specific population , people who are the focus of a study, such as university athletes, international students, or teenagers living with type 1 (juvenile-onset) diabetes.

Most researchers choose to survey a small sector of the population, or a sample : that is, a manageable number of subjects who represent a larger population. The success of a study depends on how well a population is represented by the sample. In a random sample , every person in a population has the same chance of being chosen for the study. According to the laws of probability, random samples represent the population as a whole. For instance, an Ipsos Reid poll, if conducted as a nationwide random sampling, should be able to provide an accurate estimate of public opinion whether it contacts 2,000 or 10,000 people. However the validity of surveys can be threatened when part of the population is inadvertently excluded from the sample (e.g., telephone surveys that rely on land lines exclude people that use only cell phones) or when there is a low response rate. After selecting subjects, the researcher develops a specific plan to ask questions and record responses.

It is important to inform subjects of the nature and purpose of the study upfront. If they agree to participate, researchers thank subjects and offer them a chance to see the results of the study if they are interested. The researcher presents the subjects with an instrument (a means of gathering the information). A common instrument is a structured questionnaire, in which subjects answer a series of set questions. For some topics, the researcher might ask yes-or-no or multiple-choice questions, allowing subjects to choose possible responses to each question.

This kind of quantitative data —research collected in numerical form that can be counted—is easy to tabulate. Just count up the number of “yes” and “no” answers or tabulate the scales of “strongly agree,” “agree,” disagree,” etc. responses and chart them into percentages. This is also their chief drawback however: their artificiality. In real life, there are rarely any unambiguously yes-or-no answers. Questionnaires can also ask more complex questions with more complex answers—beyond “yes,” “no,” “agree,” “strongly agree,” or an option next to a checkbox. In those cases, the answers are subjective, varying from person to person. How do you plan to use your university education? Why do you follow Justin Bieber around the country and attend every concert? Those types of questions require short essay responses, and participants willing to take the time to write those answers will convey personal information about religious beliefs, political views, and morals.

Some topics that reflect internal thought are impossible to observe directly and are difficult to discuss honestly in a public forum. People are more likely to share honest answers if they can respond to questions anonymously. This type of information is qualitative data —results that are subjective and often based on what is seen in a natural setting. Qualitative information is harder to organize and tabulate. The researcher will end up with a wide range of responses, some of which may be surprising. The benefit of written opinions, though, is the wealth of material that they provide.

An interview is a one-on-one conversation between the researcher and the subject, and is a way of conducting surveys on a topic. Interviews are similar to the short answer questions on surveys in that the researcher asks subjects a series of questions. However, participants are free to respond as they wish, without being limited by predetermined choices. In the back-and-forth conversation of an interview, a researcher can ask for clarification, spend more time on a subtopic, or ask additional questions. In an interview, a subject will ideally feel free to open up and answer questions that are often complex. There are no right or wrong answers. The subject might not even know how to answer the questions honestly. Questions such as “How did society’s view of alcohol consumption influence your decision whether or not to take your first sip of alcohol?” or “Did you feel that the divorce of your parents would put a social stigma on your family?” involve so many factors that the answers are difficult to categorize. A researcher needs to avoid steering or prompting the subject to respond in a specific way; otherwise, the results will prove to be unreliable. And, obviously, a sociological interview is not an interrogation. The researcher will benefit from gaining a subject’s trust, from empathizing or commiserating with a subject, and from listening without judgment.

Experiments

You’ve probably tested personal social theories. “If I study at night and review in the morning, I’ll improve my retention skills.” Or, “If I stop drinking soda, I’ll feel better.” Cause and effect. If this, then that. When you test the theory, your results either prove or disprove your hypothesis. One way researchers test social theories is by conducting an experiment , meaning they investigate relationships to test a hypothesis—a scientific approach. There are two main types of experiments: lab-based experiments and natural or field experiments.

In a lab setting, the research can be controlled so that perhaps more data can be recorded in a certain amount of time. In a natural or field-based experiment, the generation of data cannot be controlled but the information might be considered more accurate since it was collected without interference or intervention by the researcher. As a research method, either type of sociological experiment is useful for testing if-then statements: if a particular thing happens, then another particular thing will result.

To set up a lab-based experiment, sociologists create artificial situations that allow them to manipulate variables. Classically, the sociologist selects a set of people with similar characteristics, such as age, class, race, or education. Those people are divided into two groups. One is the experimental group and the other is the control group . The experimental group is exposed to the independent variable(s) and the control group is not. This is similar to pharmaceutical drug trials in which the experimental group is given the test drug and the control group is given a placebo or sugar pill. To test the benefits of tutoring, for example, the sociologist might expose the experimental group of students to tutoring while the control group does not receive tutoring. Then both groups would be tested for differences in performance to see if tutoring had an effect on the experimental group of students. As you can imagine, in a case like this, the researcher would not want to jeopardize the accomplishments of either group of students, so the setting would be somewhat artificial. The test would not be for a grade reflected on their permanent record, for example.

The Stanford Prison Experiment is perhaps one of the most famous sociological experiments ever conducted. In 1971, 24 healthy, middle-class male university students were selected to take part in a simulated jail environment to examine the effects of social setting and social roles on individual psychology and behaviour. They were randomly divided into 12 guards and 12 prisoners. The prisoner subjects were arrested at home and transported blindfolded to the simulated prison in the basement of the psychology building on the campus of Stanford University. Within a day of arriving the prisoners and the guards began to display signs of trauma and sadism respectively. After some prisoners revolted by blockading themselves in their cells, the guards resorted to using increasingly humiliating and degrading tactics to control the prisoners through psychological manipulation. The experiment had to be abandoned after only six days because the abuse had grown out of hand (Haney, Banks, and Zimbardo 1973). While the insights into the social dynamics of authoritarianism it generated were fascinating, the Stanford Prison Experiment also serves as an example of the ethical issues that emerge when experimenting on human subjects.

Making Connections: Sociological Research

An experiment in action: mincome.

A real-life example will help illustrate the experimental process in sociology. Between 1974 and 1979 an experiment was conducted in the small town of Dauphin, Manitoba (the “garden capital of Manitoba”). Each family received a modest monthly guaranteed income—a “mincome”—equivalent to a maximum of 60 percent of the “low-income cut-off figure” (a Statistics Canada measure of poverty, which varies with family size). The income was 50 cents per dollar less for families who had incomes from other sources. Families earning over a certain income level did not receive mincome. Families that were already collecting welfare or unemployment insurance were also excluded. The test families in Dauphin were compared with control groups in other rural Manitoba communities on a range of indicators such as number of hours worked per week, school performance, high school dropout rates, and hospital visits (Forget 2011). A guaranteed annual income was seen at the time as a less costly, less bureaucratic public alternative for addressing poverty than the existing employment insurance and welfare programs. Today it is an active proposal being considered in Switzerland (Lowrey 2013).

Intuitively, it seems logical that lack of income is the cause of poverty and poverty-related issues. One of the main concerns, however, was whether a guaranteed income would create a disincentive to work. The concept appears to challenge the principles of the Protestant work ethic (see the discussion of Max Weber in Chapter 1). The study did find very small decreases in hours worked per week: about 1 percent for men, 3 percent for wives, and 5 percent for unmarried women. Forget (2011) argues this was because the income provided an opportunity for people to spend more time with family and school, especially for young mothers and teenage girls. There were also significant social benefits from the experiment, including better test scores in school, lower high school dropout rates, fewer visits to hospital, fewer accidents and injuries, and fewer mental health issues.

Ironically, due to lack of guaranteed funding (and lack of political interest by the late 1970s), the data and results of the study were not analyzed or published until 2011. The data were archived and sat gathering dust in boxes. The mincome experiment demonstrated the benefits that even a modest guaranteed annual income supplement could have on health and social outcomes in communities. People seem to live healthier lives and get a better education when they do not need to worry about poverty. In her summary of the research, Forget notes that the impact of the income supplement was surprisingly large given that at any one time only about a third of the families were receiving the income and, for some families, the income amount would have been very small. The income benefit was largest for low-income working families but the research showed that the entire community profited. The improvement in overall health outcomes for the community suggest that a guaranteed income would also result in savings for the public health system.

Field Research

The work of sociology rarely happens in limited, confined spaces. Sociologists seldom study subjects in their own offices or laboratories. Rather, sociologists go out into the world. They meet subjects where they live, work, and play. Field research refers to gathering primary data from a natural environment without doing a lab experiment or a survey. It is a research method suited to an interpretive approach rather than to positivist approaches. To conduct field research, the sociologist must be willing to step into new environments and observe, participate, or experience those worlds. In fieldwork, the sociologists, rather than the subjects, are the ones out of their element. The researcher interacts with or observes a person or people, gathering data along the way. The key point in field research is that it takes place in the subject’s natural environment, whether it’s a coffee shop or tribal village, a homeless shelter or a care home, a hospital, airport, mall, or beach resort.

While field research often begins in a specific setting , the study’s purpose is to observe specific behaviours in that setting. Fieldwork is optimal for observing how people behave. It is less useful, however, for developing causal explanations of why they behave that way. From the small size of the groups studied in fieldwork, it is difficult to make predictions or generalizations to a larger population. Similarly, there are difficulties in gaining an objective distance from research subjects. It is difficult to know whether another researcher would see the same things or record the same data. We will look at three types of field research: participant observation, ethnography, and the case study.

Making Connections: Sociology in the Real World

When is sharing not such a good idea.

Choosing a research methodology depends on a number of factors, including the purpose of the research and the audience for whom the research is intended. If we consider the type of research that might go into producing a government policy document on the effectiveness of safe injection sites for reducing the public health risks of intravenous drug use, we would expect public administrators to want “hard” (i.e., quantitative) evidence of high reliability to help them make a policy decision. The most reliable data would come from an experimental or quasi-experimental research model in which a control group can be compared with an experimental group using quantitative measures.

This approach has been used by researchers studying InSite in Vancouver (Marshall et al. 2011; Wood et al. 2006). InSite is a supervised safe-injection site where heroin addicts and other intravenous drug users can go to inject drugs in a safe, clean environment. Clean needles are provided and health care professionals are on hand to intervene in the case of overdose or other medical emergency. It is a controversial program both because heroin use is against the law (the facility operates through a federal ministerial exemption) and because the heroin users are not obliged to quit using or seek therapy. To assess the effectiveness of the program, researchers compared the risky usage of drugs in populations before and after the opening of the facility and geographically near and distant to the facility. The results from the studies have shown that InSite has reduced both deaths from overdose and risky behaviours, such as the sharing of needles, without increasing the levels of crime associated with drug use and addiction.

On the other hand, if the research question is more exploratory (for example, trying to discern the reasons why individuals in the crack smoking subculture engage in the risky activity of sharing pipes), the more nuanced approach of fieldwork is more appropriate. The research would need to focus on the subcultural context, rituals, and meaning of sharing pipes, and why these phenomena override known health concerns. Graduate student Andrew Ivsins at the University of Victoria studied the practice of sharing pipes among 13 habitual users of crack cocaine in Victoria, B.C. (Ivsins 2010). He met crack smokers in their typical setting downtown and used an unstructured interview method to try to draw out the informal norms that lead to sharing pipes. One factor he discovered was the bond that formed between friends or intimate partners when they shared a pipe. He also discovered that there was an elaborate subcultural etiquette of pipe use that revolved around the benefit of getting the crack resin smokers left behind. Both of these motives tended to outweigh the recognized health risks of sharing pipes (such as hepatitis) in the decision making of the users. This type of research was valuable in illuminating the unknown subcultural norms of crack use that could still come into play in a harm reduction strategy such as distributing safe crack kits to addicts.

Participant Observation

In 2000, a comic writer named Rodney Rothman wanted an insider’s view of white-collar work. He slipped into the sterile, high-rise offices of a New York “dot com” agency. Every day for two weeks, he pretended to work there. His main purpose was simply to see if anyone would notice him or challenge his presence. No one did. The receptionist greeted him. The employees smiled and said good morning. Rothman was accepted as part of the team. He even went so far as to claim a desk, inform the receptionist of his whereabouts, and attend a meeting. He published an article about his experience in The New Yorker called “My Fake Job” (2000). Later, he was discredited for allegedly fabricating some details of the story and The New Yorker issued an apology. However, Rothman’s entertaining article still offered fascinating descriptions of the inside workings of a “dot com” company and exemplified the lengths to which a sociologist will go to uncover material.

Rothman had conducted a form of study called participant observation , in which researchers join people and participate in a group’s routine activities for the purpose of observing them within that context. This method lets researchers study a naturally occurring social activity without imposing artificial or intrusive research devices, like fixed questionnaire questions, onto the situation. A researcher might go to great lengths to get a firsthand look into a trend, institution, or behaviour. Researchers temporarily put themselves into “native” roles and record their observations. A researcher might work as a waitress in a diner, or live as a homeless person for several weeks, or ride along with police officers as they patrol their regular beat. Often, these researchers try to blend in seamlessly with the population they study, and they may not disclose their true identity or purpose if they feel it would compromise the results of their research.

At the beginning of a field study, researchers might have a question: “What really goes on in the kitchen of the most popular diner on campus?” or “What is it like to be homeless?” Participant observation is a useful method if the researcher wants to explore a certain environment from the inside. Field researchers simply want to observe and learn. In such a setting, the researcher will be alert and open minded to whatever happens, recording all observations accurately. Soon, as patterns emerge, questions will become more specific, observations will lead to hypotheses, and hypotheses will guide the researcher in shaping data into results. In a study of small-town America conducted by sociological researchers John S. Lynd and Helen Merrell Lynd, the team altered their purpose as they gathered data. They initially planned to focus their study on the role of religion in American towns. As they gathered observations, they realized that the effect of industrialization and urbanization was the more relevant topic of this social group. The Lynds did not change their methods, but they revised their purpose. This shaped the structure of Middletown: A Study in Modern American Culture , their published results (Lynd and Lynd 1959).

The Lynds were upfront about their mission. The townspeople of Muncie, Indiana, knew why the researchers were in their midst. But some sociologists prefer not to alert people to their presence. The main advantage of covert participant observation is that it allows the researcher access to authentic, natural behaviours of a group’s members. The challenge, however, is gaining access to a setting without disrupting the pattern of others’ behaviour. Becoming an inside member of a group, organization, or subculture takes time and effort. Researchers must pretend to be something they are not. The process could involve role playing, making contacts, networking, or applying for a job. Once inside a group, some researchers spend months or even years pretending to be one of the people they are observing. However, as observers, they cannot get too involved. They must keep their purpose in mind and apply the sociological perspective. That way, they illuminate social patterns that are often unrecognized. Because information gathered during participant observation is mostly qualitative, rather than quantitative, the end results are often descriptive or interpretive. The researcher might present findings in an article or book, describing what he or she witnessed and experienced.

This type of research is what journalist Barbara Ehrenreich conducted for her book Nickel and Dimed . One day over lunch with her editor, as the story goes, Ehrenreich mentioned an idea. How can people exist on minimum-wage work? How do low-income workers get by? she wondered. Someone should do a study. To her surprise, her editor responded, Why don’t you do it? That is how Ehrenreich found herself joining the ranks of the low-wage service sector. For several months, she left her comfortable home and lived and worked among people who lacked, for the most part, higher education and marketable job skills. Undercover, she applied for and worked minimum wage jobs as a waitress, a cleaning woman, a nursing home aide, and a retail chain employee. During her participant observation, she used only her income from those jobs to pay for food, clothing, transportation, and shelter. She discovered the obvious: that it’s almost impossible to get by on minimum wage work. She also experienced and observed attitudes many middle- and upper-class people never think about. She witnessed firsthand the treatment of service work employees. She saw the extreme measures people take to make ends meet and to survive. She described fellow employees who held two or three jobs, worked seven days a week, lived in cars, could not pay to treat chronic health conditions, got randomly fired, submitted to drug tests, and moved in and out of homeless shelters. She brought aspects of that life to light, describing difficult working conditions and the poor treatment that low-wage workers suffer.

Ethnography

Ethnography is the extended observation of the social perspective and cultural values of an entire social setting. Researchers seek to immerse themselves in the life of a bounded group, by living and working among them. Often ethnography involves participant observation, but the focus is the systematic observation of an entire community.

The heart of an ethnographic study focuses on how subjects view their own social standing and how they understand themselves in relation to a community. An ethnographic study might observe, for example, a small Newfoundland fishing town, an Inuit community, a village in Thailand, a Buddhist monastery, a private boarding school, or Disney World. These places all have borders. People live, work, study, or vacation within those borders. People are there for a certain reason and therefore behave in certain ways and respect certain cultural norms. An ethnographer would commit to spending a determined amount of time studying every aspect of the chosen place, taking in as much as possible, and keeping careful notes on his or her observations.

A sociologist studying a tribe in the Amazon might learn the language, watch the way villagers go about their daily lives, ask individuals about the meaning of different aspects of activity, study the group’s cosmology and then write a paper about it. To observe a spiritual retreat centre, an ethnographer might sign up for a retreat and attend as a guest for an extended stay, observe and record how people experience spirituality in this setting, and collate the material into results.

The Feminist Perspective: Institutional Ethnography

Dorothy Smith elaborated on traditional ethnography to develop what she calls institutional ethnography (2005). In modern society the practices of everyday life in any particular local setting are often organized at a level that goes beyond what an ethnographer might observe directly. Everyday life is structured by “extralocal,” institutional forms; that is, by the practices of institutions that act upon people from a distance. It might be possible to conduct ethnographic research on the experience of domestic abuse by living in a women’s shelter and directly observing and interviewing victims to see how they form an understanding of their situation. However, to the degree that the women are seeking redress through the criminal justice system a crucial element of the situation would be missing. In order to activate a response from the police or the courts, a set of standard legal procedures must be followed, a “case file” must be opened, legally actionable evidence must be established, forms filled out, etc. All of this allows criminal justice agencies to organize and coordinate the response.

The urgent and immediate experience of the domestic abuse victims needs to be translated into a format that enables distant authorities to take action. Often this is a frustrating and mysterious process in which the immediate needs of individuals are neglected so that needs of institutional processes are met. Therefore to research the situation of domestic abuse victims, an ethnography needs to somehow operate at two levels: the close examination of the local experience of particular women and the simultaneous examination of the extralocal, institutional world through which their world is organized. In order to accomplish this, institutional ethnography focuses on the study of the way everyday life is coordinated through “textually mediated” practices: the use of written documents, standardized bureaucratic categories, and formalized relationships (Smith 1990).

Institutional paperwork translates the specific details of locally lived experience into a standardized format that enables institutions to apply the institution’s understandings, regulations, and operations in different local contexts. The study of these textual practices reveal otherwise inaccessible processes that formal organizations depend on: their formality, their organized character, and their ongoing methods of coordination, etc. An institutional ethnography often begins by following the paper trail that emerges when people interact with institutions: how does a person formulate a narrative about what has happened to him or her in a way that the institution will recognize? How is it translated into the abstract categories on a form or screen that enable an institutional response to be initiated? What is preserved in the translation to paperwork and what is lost? Where do the forms go next? What series of “processing interchanges” take place between different departments or agencies through the circulation of paperwork? How is the paperwork modified and made actionable through this process (e.g., an incident report, warrant request, motion for continuance)?

Smith’s insight is that the shift from the locally lived experience of individuals to the extralocal world of institutions is nothing short of a radical metaphysical shift in worldview. In institutional worlds, meanings are detached from directly lived processes and reconstituted in an organizational time, space, and consciousness that is fundamentally different from their original reference point. For example, the crisis that has led to a loss of employment becomes a set of anonymous criteria that determines one’s eligibility for Employment Insurance.

The unique life of a disabled child becomes a checklist that determines the content of an “individual education program” in the school system, which in turn determines whether funding will be provided for special aid assistants or therapeutic programs. Institutions put together a picture of what has occurred that is not at all the same as what was lived. The ubiquitous but obscure mechanism by which this is accomplished is textually mediated communication . The goal of institutional ethnography therefore is to making “documents or texts visible as constituents of social relations” (Smith 1990). Institutional ethnography is very useful as a critical research strategy. It is an analysis that gives grassroots organizations, or those excluded from the circles of institutional power, a detailed knowledge of how the administrative apparatuses actually work. This type of research enables more effective actions and strategies for change to be pursued.

The Case Study

However, case studies are useful when the single case is unique. In these instances, a single case study can add tremendous knowledge to a certain discipline. For example, a feral child, also called “wild child,” is one who grows up isolated from human beings. Feral children grow up without social contact and language, elements crucial to a “civilized” child’s development. These children mimic the behaviours and movements of animals, and often invent their own language. There are only about 100 cases of “feral children” in the world. As you may imagine, a feral child is a subject of great interest to researchers. Feral children provide unique information about child development because they have grown up outside of the parameters of “normal” child development. And since there are very few feral children, the case study is the most appropriate method for researchers to use in studying the subject. At age three, a Ukrainian girl named Oxana Malaya suffered severe parental neglect. She lived in a shed with dogs, eating raw meat and scraps. Five years later, a neighbour called authorities and reported seeing a girl who ran on all fours, barking. Officials brought Oxana into society, where she was cared for and taught some human behaviours, but she never became fully socialized. She has been designated as unable to support herself and now lives in a mental institution (Grice 2006). Case studies like this offer a way for sociologists to collect data that may not be collectable by any other method.

Secondary Data or Textual Analysis

While sociologists often engage in original research studies, they also contribute knowledge to the discipline through secondary data or textual analysis . Secondary data do not result from firsthand research collected from primary sources, but are drawn from the already-completed work of other researchers. Sociologists might study texts written by historians, economists, teachers, or early sociologists. They might search through periodicals, newspapers, or magazines from any period in history. Using available information not only saves time and money, but it can add depth to a study. Sociologists often interpret findings in a new way, a way that was not part of an author’s original purpose or intention. To study how women were encouraged to act and behave in the 1960s, for example, a researcher might watch movies, televisions shows, and situation comedies from that period. Or to research changes in behaviour and attitudes due to the emergence of television in the late 1950s and early 1960s, a sociologist would rely on new interpretations of secondary data. Decades from now, researchers will most likely conduct similar studies on the advent of mobile phones, the Internet, or Facebook.

One methodology that sociologists employ with secondary data is content analysis. Content analysis is a quantitative approach to textual research that selects an item of textual content (i.e., a variable) that can be reliably and consistently observed and coded, and surveys the prevalence of that item in a sample of textual output. For example, Gilens (1996) wanted to find out why survey research shows that the American public substantially exaggerates the percentage of African Americans among the poor. He examined whether media representations influence public perceptions and did a content analysis of photographs of poor people in American news magazines. He coded and then systematically recorded incidences of three variables: (1) Race: white, black, indeterminate; (2) Employed: working, not working; and (3) Age. Gilens discovered that not only were African Americans markedly overrepresented in news magazine photographs of poverty, but that the photos also tended to underrepresent “sympathetic” subgroups of the poor—the elderly and working poor—while overrepresenting less sympathetic groups—unemployed, working age adults. Gilens concluded that by providing a distorted representation of poverty, U.S. news magazines “reinforce negative stereotypes of blacks as mired in poverty and contribute to the belief that poverty is primarily a ‘black problem’” (1996).

Social scientists also learn by analyzing the research of a variety of agencies. Governmental departments and global groups, like Statistics Canada or the World Health Organization, publish studies with findings that are useful to sociologists. A public statistic that measures inequality of incomes might be useful for studying who benefited and who lost as a result of the 2008 recession; a demographic profile of different immigrant groups might be compared with data on unemployment to examine the reasons why immigration settlement programs are more effective for some communities than for others. One of the advantages of secondary data is that it is nonreactive (or unobtrusive) research, meaning that it does not include direct contact with subjects and will not alter or influence people’s behaviours. Unlike studies requiring direct contact with people, using previously published data does not require entering a population and the investment and risks inherent in that research process. Using available data does have its challenges. Public records are not always easy to access. A researcher needs to do some legwork to track them down and gain access to records. In some cases there is no way to verify the accuracy of existing data. It is easy, for example, to count how many drunk drivers are pulled over by the police. But how many are not? While it’s possible to discover the percentage of teenage students who drop out of high school, it might be more challenging to determine the number who return to school or get their GED later.

Another problem arises when data are unavailable in the exact form needed or do not include the precise angle the researcher seeks. For example, the salaries paid to professors at universities is often published. But the separate figures do not necessarily reveal how long it took each professor to reach the salary range, what their educational backgrounds are, or how long they have been teaching. In his research, sociologist Richard Sennett uses secondary data to shed light on current trends. In The Craftsman (2008), he studied the human desire to perform quality work, from carpentry to computer programming. He studied the line between craftsmanship and skilled manual labour. He also studied changes in attitudes toward craftsmanship that occurred not only during and after the Industrial Revolution, but also in ancient times. Obviously, he could not have firsthand knowledge of periods of ancient history; he had to rely on secondary data for part of his study. When conducting secondary data or textual analysis, it is important to consider the date of publication of an existing source and to take into account attitudes and common cultural ideals that may have influenced the research. For example, Robert S. Lynd and Helen Merrell Lynd gathered research for their book Middletown: A Study in Modern American Culture in the 1920s. Attitudes and cultural norms were vastly different then than they are now. Beliefs about gender roles, race, education, and work have changed significantly since then. At the time, the study’s purpose was to reveal the truth about small American communities. Today, it is an illustration of 1920s attitudes and values.

Sociologists conduct studies to shed light on human behaviours. Knowledge is a powerful tool that can be used toward positive change. And while a sociologist’s goal is often simply to uncover knowledge rather than to spur action, many people use sociological studies to help improve people’s lives. In that sense, conducting a sociological study comes with a tremendous amount of responsibility. Like any researchers, sociologists must consider their ethical obligation to avoid harming subjects or groups while conducting their research. The Canadian Sociological Association, or CSA, is the major professional organization of sociologists in Canada. The CSA is a great resource for students of sociology as well.

The CSA maintains a code of ethics —formal guidelines for conducting sociological research—consisting of principles and ethical standards to be used in the discipline. It also describes procedures for filing, investigating, and resolving complaints of unethical conduct. These are in line with the Tri-Council Policy Statement on Ethical Conduct for Research Involving Humans (2010) , which applies to any research with human subjects funded by one of the three federal research agencies – the Canadian Institutes of Health Research (CIHR), the Natural Sciences and Engineering Research Council of Canada (NSERC), and the Social Sciences and Humanities Research Council of Canada (SSHRC).

Practising sociologists and sociology students have a lot to consider. Some of the guidelines state that researchers must try to be skillful and fair-minded in their work, especially as it relates to their human subjects. Researchers must obtain participants’ informed consent, and inform subjects of the responsibilities and risks of research before they agree to participate. During a study, sociologists must ensure the safety of participants and immediately stop work if a subject becomes potentially endangered on any level. Researchers are required to protect the privacy of research participants whenever possible. Even if pressured by authorities, such as police or courts, researchers are not ethically allowed to release confidential information. Researchers must make results available to other sociologists, must make public all sources of financial support, and must not accept funding from any organization that might cause a conflict of interest or seek to influence the research results for its own purposes. The CSA’s ethical considerations shape not only the study but also the publication of results.

Pioneer German sociologist Max Weber (1864–1920) identified another crucial ethical concern. Weber understood that personal values could distort the framework for disclosing study results. While he accepted that some aspects of research design might be influenced by personal values, he declared it was entirely inappropriate to allow personal values to shape the interpretation of the responses. Sociologists, he stated, must establish value neutrality , a practice of remaining impartial, without bias or judgment, during the course of a study and in publishing results (1949). Sociologists are obligated to disclose research findings without omitting or distorting significant data. Value neutrality does not mean having no opinions. It means striving to overcome personal biases, particularly subconscious biases, when analyzing data. It means avoiding skewing data in order to match a predetermined outcome that aligns with a particular agenda, such as a political or moral point of view. Investigators are ethically obligated to report results, even when they contradict personal views, predicted outcomes, or widely accepted beliefs. Is value neutrality possible?

Many sociologists believe it is impossible to set aside personal values and retain complete objectivity. Individuals inevitably see the world from a partial perspective. Their interests are central to the types of topics they choose, the types of questions they ask, the way they frame their research and the research methodologies they select to pursue it. Moreover, facts, however objective, do not exist in a void. As we noted in Chapter 1, Jürgen Habermas (1972) argues that sociological research has built-in interests quite apart from the personal biases of individual researchers. Positivist sociology has an interest in pursuing types of knowledge that are useful for controlling and administering social life. Interpretive sociology has an interest in pursuing types of knowledge that promote greater mutual understanding and the possibility of consensus among members of society. Critical sociology has an interest in types of knowledge that enable emancipation from power relations and forms of domination in society. In Habermas’ view, sociological knowledge is not disinterested knowledge. This does not discredit the results of sociological research but allows readers to take into account the perspective of the research when judging the validity and applicability of its outcomes.

case study in-depth analysis of a single event, situation, or individual

code of ethics a set of guidelines that the Canadian Sociological Association has established to foster ethical research and professionally responsible scholarship in sociology

content analysis a quantitative approach to textual research that selects an item of textual content that can be reliably and consistently observed and coded, and surveys the prevalence of that item in a sample of textual output

control group an experimental group that is not exposed to the independent variable

correlation when a change in one variable coincides with a change in another variable, but does not necessarily indicate causation

d ependent variable variable changed by another variable

empirical evidence evidence corroborated by direct experience and/or observation

ethnography observing a complete social setting and all that it entails

experiment the testing of a hypothesis under controlled conditions

field research gathering data from a natural environment without doing a lab experiment or a survey

Hawthorne effect when study subjects behave in a certain manner due to their awareness of being observed by a researcher

hypothesis an educated guess with predicted outcomes about the relationship between two or more variables hypothetico-deductive methodologies methodologies based on deducing a prediction from a hypothesis and testing the validity of the hypothesis by whether it correctly predicts observations

independent variable variable that causes change in a dependent variable

inductive approach methodologies that derive a general statement from a series of empirical observations

institutional ethnography the study of the way everyday life is coordinated through institutional, textually mediated practices

interpretive approach a sociological research approach that seeks in-depth understanding of a topic or subject through observation or interaction

interview a one-on-one conversation between a researcher and a subject

literature review a scholarly research step that entails identifying and studying all existing studies on a topic to create a basis for new research

nonreactive unobtrusive research that does not include direct contact with subjects and will not alter or influence people’s behaviours

operational definitions specific explanations of abstract concepts that a researcher plans to study

participant observation immersion by a researcher in a group or social setting in order to make observations from an “insider” perspective

population a defined group serving as the subject of a study

positivist approach a research approach based on the natural science model of knowledge utilizing a hypothetico-deductive formulation of the research question and quantitative data

primary data data collected directly from firsthand experience

qualitative data information based on interpretations of meaning

quantitative data information from research collected in numerical form that can be counted

random sample a study’s participants being randomly selected to serve as a representation of a larger population reliability a measure of a study’s consistency that considers how likely results are to be replicated if a study is reproduced research design a detailed, systematic method for conducting research and obtaining data

sample small, manageable number of subjects that represent the population

scientific method a systematic research method that involves asking a question, researching existing sources, forming a hypothesis, designing and conducting a study, and drawing conclusions

secondary data analysis using data collected by others but applying new interpretations

surveys data collections from subjects who respond to a series of questions about behaviours and opinions, often in the form of a questionnaire

textually mediated communication institutional forms of communication that rely on written documents, texts, and paperwork

validity the degree to which a sociological measure accurately reflects the topic of study

value neutrality a practice of remaining impartial, without bias or judgment during the course of a study and in publishing results

variable a characteristic or measure of a social phenomenon that can take different values

Section Summary

2.1. Approaches to Sociological Research Using the scientific method, a researcher conducts a study in five phases: asking a question, researching existing sources, formulating a hypothesis, conducting a study, and drawing conclusions. The scientific method is useful in that it provides a clear method of organizing a study. Some sociologists conduct scientific research through a positivist framework utilizing a hypothetico-deductive formulation of the research question. Other sociologists conduct scientific research by employing an interpretive framework that is often inductive in nature. Scientific sociological studies often observe relationships between variables. Researchers study how one variable changes another. Prior to conducting a study, researchers are careful to apply operational definitions to their terms and to establish dependent and independent variables.

2.2. Research Methods Sociological research is a fairly complex process. As you can see, a lot goes into even a simple research design. There are many steps and much to consider when collecting data on human behaviour, as well as in interpreting and analyzing data in order to form conclusive results. Sociologists use scientific methods for good reason. The scientific method provides a system of organization that helps researchers plan and conduct the study while ensuring that data and results are reliable, valid, and objective. The many methods available to researchers—including experiments, surveys, field studies, and secondary data analysis—all come with advantages and disadvantages. The strength of a study can depend on the choice and implementation of the appropriate method of gathering research. Depending on the topic, a study might use a single method or a combination of methods. It is important to plan a research design before undertaking a study. The information gathered may in itself be surprising, and the study design should provide a solid framework in which to analyze predicted and unpredicted data.

Table 2.2. Main Sociological Research Methods. Sociological research methods have advantages and disadvantages.

Method	Implementation	Advantages	Challenges


	Deliberate manipulation of social setting to compare experimental and control groups. Tests cause and effect relationships
	Makes good use of previous sociological information

2.3. Ethical Concerns Sociologists and sociology students must take ethical responsibility for any study they conduct. They must first and foremost guarantee the safety of their participants. Whenever possible, they must ensure that participants have been fully informed before consenting to be part of a study. The CSA (Canadian Sociological Association) maintains ethical guidelines that sociologists must take into account as they conduct research. The guidelines address conducting studies, properly using existing sources, accepting funding, and publishing results. Sociologists must try to maintain value neutrality. They must gather and analyze data objectively, setting aside their personal preferences, beliefs, and opinions. They must report findings accurately, even if they contradict personal convictions.

Section Quiz

2.1. Approaches to Sociological Research 1. A measurement is considered ______ if it actually measures what it is intended to measure, according to the topic of the study.

sociological
quantitative

2. Sociological studies test relationships in which change in one ______ causes change in another.

test subject
operational definition

3. In a study, a group of 10-year-old boys are fed doughnuts every morning for a week and then weighed to see how much weight they gained. Which factor is the dependent variable?

the doughnuts
the duration of a week
the weight gained

4. Which statement provides the best operational definition of “childhood obesity”?

children who eat unhealthy foods and spend too much time watching television and playing video games
a distressing trend that can lead to health issues including type 2 diabetes and heart disease
body weight at least 20 percent higher than a healthy weight for a child of that height
the tendency of children today to weigh more than children of earlier generations

2.2. Research Methods 5. Which materials are considered secondary data?

photos and letters given to you by another person
books and articles written by other authors about their studies
information that you have gathered and now have included in your results
responses from participants whom you both surveyed and interviewed

6. What method did Andrew Ivsins use to study crack users in Victoria?

field research
content analysis

7. Why is choosing a random sample an effective way to select participants?

Participants do not know they are part of a study
The researcher has no control over who is in the study
It is larger than an ordinary sample
Everyone has the same chance of being part of the study

8. What research method did John S. Lynd and Helen Merrell Lynd mainly use in their Middletown study?

secondary data
participant observation

9. Which research approach is best suited to the positivist approach?

questionnaire
ethnography
secondary data analysis

10. The main difference between ethnography and other types of participant observation is:

ethnography isn’t based on hypothesis testing
ethnography subjects are unaware they’re being studied
ethnographic studies always involve minority ethnic groups
there is no difference

11. Which best describes the results of a case study?

it produces more reliable results than other methods because of its depth
its results are not generally applicable
it relies solely on secondary data analysis
all of the above

12. Using secondary data is considered an unobtrusive or ________ research method.

nonreactive
nonparticipatory
nonrestrictive
nonconfrontive

2.3. Ethical Concerns 13. Which statement illustrates value neutrality?

Obesity in children is obviously a result of parental neglect and, therefore, schools should take a greater role to prevent it.
In 2003, states like Arkansas adopted laws requiring elementary schools to remove soft drink vending machines from schools.
Merely restricting children’s access to junk food at school is not enough to prevent obesity.
Physical activity and healthy eating are a fundamental part of a child’s education.

14. Which person or organization defined the concept of value neutrality?

Institutional Review Board (IRB)
Peter Rossi
Canadian Sociological Association (CSA)

15. To study the effects of fast food on lifestyle, health, and culture, from which group would a researcher ethically be unable to accept funding?

a fast-food restaurant
a nonprofit health organization
a private hospital
a governmental agency like Health and Social Services

Short Answer

Write down the first three steps of the scientific method. Think of a broad topic that you are interested in and which would make a good sociological study—for example, ethnic diversity in a college, homecoming rituals, athletic scholarships, or teen driving. Now, take that topic through the first steps of the process. For each step, write a few sentences or a paragraph: 1) Ask a question about the topic. 2) Do some research and write down the titles of some articles or books you’d want to read about the topic. 3) Formulate a hypothesis.

2.2.Research Methods

What type of data do surveys gather? For what topics would surveys be the best research method? What drawbacks might you expect to encounter when using a survey? To explore further, ask a research question and write a hypothesis. Then create a survey of about six questions relevant to the topic. Provide a rationale for each question. Now define your population and create a plan for recruiting a random sample and administering the survey.
Imagine you are about to do field research in a specific place for a set time. Instead of thinking about the topic of study itself, consider how you, as the researcher, will have to prepare for the study. What personal, social, and physical sacrifices will you have to make? How will you manage your personal effects? What organizational equipment and systems will you need to collect the data?
Create a brief research design about a topic in which you are passionately interested. Now write a letter to a philanthropic or grant organization requesting funding for your study. How can you describe the project in a convincing yet realistic and objective way? Explain how the results of your study will be a relevant contribution to the body of sociological work already in existence.
Why do you think the CSA crafted such a detailed set of ethical principles? What type of study could put human participants at risk? Think of some examples of studies that might be harmful. Do you think that, in the name of sociology, some researchers might be tempted to cross boundaries that threaten human rights? Why?
Would you willingly participate in a sociological study that could potentially put your health and safety at risk, but had the potential to help thousands or even hundreds of thousands of people? For example, would you participate in a study of a new drug that could cure diabetes or cancer, even if it meant great inconvenience and physical discomfort for you or possible permanent damage?

Further Research

2.1. Approaches to Sociological Research For a historical perspective on the scientific method in sociology, read “The Elements of Scientific Method in Sociology” by F. Stuart Chapin (1914) in the American Journal of Sociology : http://openstaxcollege.org/l/Method-in-Sociology

2.2. Research Methods For information on current real-world sociology experiments, visit: http://openstaxcollege.org/l/Sociology-Experiments

2.3. Ethical Concerns Founded in 1966, the CSA is a nonprofit organization located in Montreal, Quebec, with a membership of 900 researchers, faculty members, students, and practitioners of sociology. Its mission is to promote “research, publication and teaching in Sociology in Canada.” Learn more about this organization at http://www.csa-scs.ca/ .

2.1. Approaches to Sociological Research Merton, Robert. 1968 [1949]. Social Theory and Social Structure . New York: Free Press.

2.2. Research Methods Forget, Evelyn. 2011. “The Town with no Poverty: Using Health Administration Data to Revisit Outcomes of a Canadian Guaranteed Annual Income Field Experiement.” Canadian Public Policy . 37(3): 282-305.

Franke, Richard and James Kaul. 1978. “The Hawthorne Experiments: First Statistical Interpretation.” American Sociological Review 43(5):632–643.

Gilens, Martin. 1996. “Race and Poverty in America: Public Misperceptions and the American News Media.” The Public Opinion Quarterly 60(4):515–541. Grice, Elizabeth. 2006. “Cry of an Enfant Sauvage.” The Telegraph . Retrieved July 20, 2011 ( http://www.telegraph.co.uk/culture/tvandradio/3653890/Cry-of-an-enfant-sauvage.html ).

Haney, C., Banks, W. C., and Zimbardo, P. G. 1973. “Interpersonal Dynamics in a Simulated Prison.” International Journal of Criminology and Penology 1:69–97.

Ivsins, A.K. 2010. “’Got a pipe?’ The social dimensions and functions of crack pipe sharing among crack users in Victoria, BC.” MA thesis, Department of Sociology, University of Victoria. Retrieved February 14, 2014 ( http://dspace.library.uvic.ca:8080/bitstream/handle/1828/3044/Full%20thesis%20Ivsins_CPS.2010_FINAL.pdf?sequence=1 )

Lowrey, Annie. 2013. “Switzerland’s Proposal to Pay People for Being Alive.” The New York Times Magazine. Retrieved February 17, 2014 ( http://www.nytimes.com/2013/11/17/magazine/switzerlands-proposal-to-pay-people-for-being-alive.html?pagewanted=1&_r=2 ).

Lynd, Robert S. and Helen Merrell Lynd. 1959. Middletown: A Study in Modern American Culture . San Diego, CA: Harcourt Brace Javanovich.

Lynd, Staughton. 2005. “Making Middleton.” Indiana Magazine of History 101(3):226–238.

Marshall, B.D.L., M.J. Milloy, E. Wood, J.S.G. Montaner, and T. Kerr. 2011. “Reduction in overdose mortality after the opening of North America’s first medically supervised safer injecting facility: A retrospective population-based study.” Lancet 377(9775):1429–1437.

Rothman, Rodney. 2000. “My Fake Job.” The New Yorker , November 27, 120.

Sennett, Richard. 2008. The Craftsman . New Haven, CT: Yale University Press. Retrieved July 18, 2011 ( http://www.richardsennett.com/site/SENN/Templates/General.aspx?pageid=40 ).

Smith, Dorothy. 1990. “Textually Mediated Social Organization” Pp. 209–234 in Texts, Facts and Femininity: Exploring the Relations of Ruling. London: Routledge.

Smith, Dorothy. 2005. Institutional Ethnography: A Sociology for People. Toronto: Altamira Press.

Sonnenfeld, Jeffery A. 1985. “Shedding Light on the Hawthorne Studies.” Journal of Occupational Behavior 6:125.

Wood, E., M.W. Tyndall, J.S. Montaner, and T. Kerr. 2006. “Summary of findings from the evaluation of a pilot medically supervised safer injecting facility.” Canadian Medical Association Journal 175(11):1399–1404.

2.3. Ethical Concerns Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council of Canada, and Social Sciences and Humanities Research Council of Canada. 2010. Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans . Retrieved February 15, 2014 ( http://www.pre.ethics.gc.ca/pdf/eng/tcps2/TCPS_2_FINAL_Web.pdf ).

Canadian Sociological Association. 2012. Statement of Professional Ethics . Retrieved February 15, 2014 ( http://www.csa-scs.ca/files/www/csa/documents/codeofethics/2012Ethics.pdf ).

Habermas, Jürgen. 1972. Knowledge and Human Interests. Boston: Beacon Press

Weber, Max. 1949. Methodology of the Social Sciences . Translated by H. Shils and E. Finch. Glencoe, IL: Free Press.

Solutions to Section Quiz

1. C | 2. C | 3. D | 4. C | 5. B | 6. C | 7. D | 8. C | 9. A | 10. A | 11. B | 12. A | 13. B | 14. D | 15. A

Image Attributions

Figure 2.3. Didn’t they abolish the mandatory census? Then what’s this? by Khosrow Ebrahimpour ( https://www.flickr.com/photos/xosrow/5685345306/in/photolist-9EoT5W-ow4tdu-oeGG4m-oeMEcK-oy2jM2-ovJC8w-oePSRQ-9J2V24-of1Hnu-of243u-of2K2B-of2FHn-owiBSA-owtQN3-of1Ktd-oitLSC-oeVJte-oep8KX-ovEz8w-oeohhF-oew5Xb-oewdWN-owavju-oeMEnV-oweLcN-ovEPGG-ovAQUX-oeo2eL-oeo3Fd-oeoqxh-oxCKnv-ovEzA5-oewFHa-ovHRSz-ow8QtY-oeQY6Y-oeZReR-oeQmHw-oeKXid-oeQLKa-oy6fNT-ow4sVT-oeQMQq-oeQPPr-oeQYbL-ow8hS1-ow4n8v-owiPKS-oeQF41-oeiH5z ) used under CC BY 2.0 ( https://creativecommons.org/licenses/by/2.0/ )

Figure 2.4. Dauphin Canadian Northern Railway Station by Bobak Ha’Eri ( http://commons.wikimedia.org/wiki/File:2009-0520-TrainStation-Dauphin.jpg ) used under CC BY 3.0 license ( http://creativecommons.org/licenses/by/3.0/deed.en )

Figure 2.5. Punk Band by Patrick ( https://www.flickr.com/photos/lordkhan/181561343/in/photostream/ ) used under CC BY 2.0 ( https://creativecommons.org/licenses/by/2.0/ )

Figure 2.6. Crack Cocaine Smokers in Vancouver Alleyway ( http://commons.wikimedia.org/wiki/File:Crack_Cocaine_Smokers_in_Vancouver_Alleyway.jpg ) is in the public domain ( http://en.wikipedia.org/wiki/Public_domain )

Figure 2.8. Muncie, Indiana High School: 1917 by Don O’Brien ( https://www.flickr.com/photos/dok1/3694125269/ ) used under CC BY 2.0 license ( https://creativecommons.org/licenses/by/2.0/ )

Introduction to Sociology - 1st Canadian Edition Copyright © 2014 by William Little and Ron McGivern is licensed under a Creative Commons Attribution 4.0 International License , except where otherwise noted.

Share This Book

SOC101: Introduction to Sociology (2020.A.01)

Sociological research.

Read this chapter for a review of sociological research. As you read, consider the following topics:

Take note of the bold terms throughout the chapter.
Take some time to study Figure 1 and the accompanying text, which outline the scientific process of studying sociology.
Take note of the differences in scientific approaches to studying sociology, including surveys, field research, participant observation, ethnographies, case studies, experiments, and secondary data analysis.
Take note of the code of ethics and think about how these ethical standards are vital to conducting research about human subjects.

Research Methods

Learning objectives.

Differentiate between four kinds of research methods: surveys, field research, experiments, and secondary data analysis
Understand why different topics are better suited to different research approaches

Sociologists examine the world, see a problem or interesting pattern, and set out to study it. They use research methods to design a study - perhaps a detailed, systematic, scientific method for conducting research and obtaining data, or perhaps an ethnographic study utilizing an interpretive framework. Planning the research design is a key step in any sociological study. When entering a particular social environment, a researcher must be careful. There are times to remain anonymous and times to be overt. There are times to conduct interviews and times to simply observe. Some participants need to be thoroughly informed; others should not know they are being observed. A researcher wouldn't stroll into a crime-ridden neighborhood at midnight, calling out, "Any gang members around?" And if a researcher walked into a coffee shop and told the employees they would be observed as part of a study on work efficiency, the self-conscious, intimidated baristas might not behave naturally. This is called the Hawthorne effect - where people change their behavior because they know they are being watched as part of a study. The Hawthorne effect is unavoidable in some research. In many cases, sociologists have to make the purpose of the study known. Subjects must be aware that they are being observed, and a certain amount of artificiality may result. Making sociologists' presence invisible is not always realistic for other reasons. That option is not available to a researcher studying prison behaviors, early education, or the Ku Klux Klan. Researchers can't just stroll into prisons, kindergarten classrooms, or Klan meetings and unobtrusively observe behaviors. In situations like these, other methods are needed. All studies shape the research design, while research design simultaneously shapes the study. Researchers choose methods that best suit their study topics and that fit with their overall approaches to research. In planning studies' designs, sociologists generally choose from four widely used methods of social investigation: survey, field research, experiment, and secondary data analysis , or use of existing sources. Every research method comes with plusses and minuses, and the topic of study strongly influences which method or methods are put to use.

As a research method, a survey collects data from subjects who respond to a series of questions about behaviors and opinions, often in the form of a questionnaire. The survey is one of the most widely used scientific research methods. The standard survey format allows individuals a level of anonymity in which they can express personal ideas.

A photo of a person's hand filling in a survey check box labeled 'No' with a pen.

Figure 2.3 Questionnaires are a common research method; the U.S. Census is a well-known example. At some point, most people in the United States respond to some type of survey. The U.S. Census is an excellent example of a large-scale survey intended to gather sociological data. Not all surveys are considered sociological research, however, and many surveys people commonly encounter focus on identifying marketing needs and strategies rather than testing a hypothesis or contributing to social science knowledge. Questions such as, "How many hot dogs do you eat in a month?" or "Were the staff helpful?" are not usually designed as scientific research. Often, polls on television do not reflect a general population, but are merely answers from a specific show's audience. Polls conducted by programs such as American Idol or So You Think You Can Dance represent the opinions of fans but are not particularly scientific. A good contrast to these are the Nielsen Ratings, which determine the popularity of television programming through scientific market research.

An American Idol audience member voting for a contestant using an electronic response system that uses numbers as answers

Figure 2.4 American Idol uses a real-time survey system - with numbers - that allows members in the audience to vote on contestants. Sociologists conduct surveys under controlled conditions for specific purposes. Surveys gather different types of information from people. While surveys are not great at capturing the ways people really behave in social situations, they are a great method for discovering how people feel and think - or at least how they say they feel and think. Surveys can track preferences for presidential candidates or reported individual behaviors (such as sleeping, driving, or texting habits) or factual information such as employment status, income, and education levels. A survey targets a specific population , people who are the focus of a study, such as college athletes, international students, or teenagers living with type 1 (juvenile-onset) diabetes. Most researchers choose to survey a small sector of the population, or a sample : that is, a manageable number of subjects who represent a larger population. The success of a study depends on how well a population is represented by the sample. In a random sample , every person in a population has the same chance of being chosen for the study. According to the laws of probability, random samples represent the population as a whole. For instance, a Gallup Poll, if conducted as a nationwide random sampling, should be able to provide an accurate estimate of public opinion whether it contacts 2,000 or 10,000 people. After selecting subjects, the researcher develops a specific plan to ask questions and record responses. It is important to inform subjects of the nature and purpose of the study up front. If they agree to participate, researchers thank subjects and offer them a chance to see the results of the study if they are interested. The researcher presents the subjects with an instrument, which is a means of gathering the information. A common instrument is a questionnaire, in which subjects answer a series of questions. For some topics, the researcher might ask yes-or-no or multiple-choice questions, allowing subjects to choose possible responses to each question. This kind of quantitative data - research collected in numerical form that can be counted - are easy to tabulate. Just count up the number of "yes" and "no" responses or correct answers, and chart them into percentages. Questionnaires can also ask more complex questions with more complex answers - beyond "yes," "no," or the option next to a checkbox. In those cases, the answers are subjective and vary from person to person. How do plan to use your college education? Why do you follow Jimmy Buffett around the country and attend every concert? Those types of questions require short essay responses, and participants willing to take the time to write those answers will convey personal information about religious beliefs, political views, and morals. Some topics that reflect internal thought are impossible to observe directly and are difficult to discuss honestly in a public forum. People are more likely to share honest answers if they can respond to questions anonymously. This type of information is qualitative data - results that are subjective and often based on what is seen in a natural setting. Qualitative information is harder to organize and tabulate. The researcher will end up with a wide range of responses, some of which may be surprising. The benefit of written opinions, though, is the wealth of material that they provide. An interview is a one-on-one conversation between the researcher and the subject, and it is a way of conducting surveys on a topic. Interviews are similar to the short-answer questions on surveys in that the researcher asks subjects a series of questions. However, participants are free to respond as they wish, without being limited by predetermined choices. In the back-and-forth conversation of an interview, a researcher can ask for clarification, spend more time on a subtopic, or ask additional questions. In an interview, a subject will ideally feel free to open up and answer questions that are often complex. There are no right or wrong answers. The subject might not even know how to answer the questions honestly. Questions such as, "How did society's view of alcohol consumption influence your decision whether or not to take your first sip of alcohol?" or "Did you feel that the divorce of your parents would put a social stigma on your family?" involve so many factors that the answers are difficult to categorize. A researcher needs to avoid steering or prompting the subject to respond in a specific way; otherwise, the results will prove to be unreliable. And, obviously, a sociological interview is not an interrogation. The researcher will benefit from gaining a subject's trust, from empathizing or commiserating with a subject, and from listening without judgment.

Field Research

The work of sociology rarely happens in limited, confined spaces. Sociologists seldom study subjects in their own offices or laboratories. Rather, sociologists go out into the world. They meet subjects where they live, work, and play. Field research refers to gathering primary data from a natural environment without doing a lab experiment or a survey. It is a research method suited to an interpretive framework rather than to the scientific method. To conduct field research, the sociologist must be willing to step into new environments and observe, participate, or experience those worlds. In field work, the sociologists, rather than the subjects, are the ones out of their element. The researcher interacts with or observes a person or people and gathers data along the way. The key point in field research is that it takes place in the subject's natural environment, whether it's a coffee shop or tribal village, a homeless shelter or the DMV, a hospital, airport, mall, or beach resort.

A man is shown taking notes outside a tent in the mountains.

Figure 2.5 Sociological researchers travel across countries and cultures to interact with and observe subjects in their natural environments. While field research often begins in a specific setting, the study's purpose is to observe specific behaviors in that setting. Field work is optimal for observing how people behave. It is less useful, however, for understanding why they behave that way. You can't really narrow down cause and effect when there are so many variables floating around in a natural environment. Much of the data gathered in field research are based not on cause and effect but on correlation. And while field research looks for correlation, its small sample size does not allow for establishing a causal relationship between two variables.

Sociology in the Real World

Parrotheads as sociological subjects.

Several people in colorful T-shirts and leis are shown talking and drinking in an outdoor tiki bar setting.

Figure 2.6 Business suits for the day job are replaced by leis and T-shirts for a Jimmy Buffett concert. Some sociologists study small groups of people who share an identity in one aspect of their lives. Almost everyone belongs to a group of like-minded people who share an interest or hobby. Scientologists, folk dancers, or members of Mensa (an organization for people with exceptionally high IQs) express a specific part of their identity through their affiliation with a group. Those groups are often of great interest to sociologists. Jimmy Buffett, an American musician who built a career from his single top-10 song "Margaritaville," has a following of devoted groupies called Parrotheads. Some of them have taken fandom to the extreme, making Parrothead culture a lifestyle. In 2005, Parrotheads and their subculture caught the attention of researchers John Mihelich and John Papineau. The two saw the way Jimmy Buffett fans collectively created an artificial reality. They wanted to know how fan groups shape culture. What Mihelich and Papineau found was that Parrotheads, for the most part, do not seek to challenge or even change society, as many sub-groups do. In fact, most Parrotheads live successfully within society, holding upper-level jobs in the corporate world. What they seek is escape from the stress of daily life. At Jimmy Buffett concerts, Parrotheads engage in a form of role play. They paint their faces and dress for the tropics in grass skirts, Hawaiian leis, and Parrot hats. These fans don't generally play the part of Parrotheads outside of these concerts; you are not likely to see a lone Parrothead in a bank or library. In that sense, Parrothead culture is less about individualism and more about conformity. Being a Parrothead means sharing a specific identity. Parrotheads feel connected to each other: it's a group identity, not an individual one. In their study, Mihelich and Papineau quote from a recent book by sociologist Richard Butsch, who writes, "un-self-conscious acts, if done by many people together, can produce change, even though the change may be unintended" (2000). Many Parrothead fan groups have performed good works in the name of Jimmy Buffett culture, donating to charities and volunteering their services. However, the authors suggest that what really drives Parrothead culture is commercialism. Jimmy Buffett's popularity was dying out in the 1980s until being reinvigorated after he signed a sponsorship deal with a beer company. These days, his concert tours alone generate nearly $30 million a year. Buffett made a lucrative career for himself by partnering with product companies and marketing Margaritaville in the form of T-shirts, restaurants, casinos, and an expansive line of products. Some fans accuse Buffett of selling out, while others admire his financial success. Buffett makes no secret of his commercial exploitations; from the stage, he's been known to tell his fans, "Just remember, I am spending your money foolishly." Mihelich and Papineau gathered much of their information online. Referring to their study as a "Web ethnography," they collected extensive narrative material from fans who joined Parrothead clubs and posted their experiences on websites. "We do not claim to have conducted a complete ethnography of Parrothead fans, or even of the Parrothead Web activity," state the authors, "but we focused on particular aspects of Parrothead practice as revealed through Web research" (2005). Fan narratives gave them insight into how individuals identify with Buffett's world and how fans used popular music to cultivate personal and collective meaning. In conducting studies about pockets of culture, most sociologists seek to discover a universal appeal. Mihelich and Papineau stated, "Although Parrotheads are a relative minority of the contemporary US population, an in-depth look at their practice and conditions illuminate [sic] cultural practices and conditions many of us experience and participate in". Here, we will look at three types of field research: participant observation, ethnography, and the case study.

Participant Observation

In 2000, a comic writer named Rodney Rothman wanted an insider's view of white-collar work. He slipped into the sterile, high-rise offices of a New York "dot com" agency. Every day for two weeks, he pretended to work there. His main purpose was simply to see whether anyone would notice him or challenge his presence. No one did. The receptionist greeted him. The employees smiled and said good morning. Rothman was accepted as part of the team. He even went so far as to claim a desk, inform the receptionist of his whereabouts, and attend a meeting. He published an article about his experience in The New Yorker called "My Fake Job" (2000). Later, he was discredited for allegedly fabricating some details of the story and The New Yorker issued an apology. However, Rothman's entertaining article still offered fascinating descriptions of the inside workings of a "dot com" company and exemplified the lengths to which a sociologist will go to uncover material. Rothman had conducted a form of study called participant observation , in which researchers join people and participate in a group's routine activities for the purpose of observing them within that context. This method lets researchers experience a specific aspect of social life. A researcher might go to great lengths to get a firsthand look into a trend, institution, or behavior. Researchers temporarily put themselves into roles and record their observations. A researcher might work as a waitress in a diner, live as a homeless person for several weeks, or ride along with police officers as they patrol their regular beat. Often, these researchers try to blend in seamlessly with the population they study, and they may not disclose their true identity or purpose if they feel it would compromise the results of their research.

Waitress serves customers in an outdoor café.

Figure 2.7 Is she a working waitress or a sociologist conducting a study using participant observation? At the beginning of a field study, researchers might have a question: "What really goes on in the kitchen of the most popular diner on campus?" or "What is it like to be homeless?" Participant observation is a useful method if the researcher wants to explore a certain environment from the inside. Field researchers simply want to observe and learn. In such a setting, the researcher will be alert and open minded to whatever happens, recording all observations accurately. Soon, as patterns emerge, questions will become more specific, observations will lead to hypotheses, and hypotheses will guide the researcher in shaping data into results. In a study of small towns in the United States conducted by sociological researchers John S. Lynd and Helen Merrell Lynd, the team altered their purpose as they gathered data. They initially planned to focus their study on the role of religion in U.S. towns. As they gathered observations, they realized that the effect of industrialization and urbanization was the more relevant topic of this social group. The Lynds did not change their methods, but they revised their purpose. This shaped the structure of Middletown: A Study in Modern American Culture, their published results. The Lynds were upfront about their mission. The townspeople of Muncie, Indiana, knew why the researchers were in their midst. But some sociologists prefer not to alert people to their presence. The main advantage of covert participant observation is that it allows the researcher access to authentic, natural behaviors of a group's members. The challenge, however, is gaining access to a setting without disrupting the pattern of others' behavior. Becoming an inside member of a group, organization, or subculture takes time and effort. Researchers must pretend to be something they are not. The process could involve role playing, making contacts, networking, or applying for a job. Once inside a group, some researchers spend months or even years pretending to be one of the people they are observing. However, as observers, they cannot get too involved. They must keep their purpose in mind and apply the sociological perspective. That way, they illuminate social patterns that are often unrecognized. Because information gathered during participant observation is mostly qualitative, rather than quantitative, the end results are often descriptive or interpretive. The researcher might present findings in an article or book and describe what he or she witnessed and experienced. This type of research is what journalist Barbara Ehrenreich conducted for her book Nickel and Dimed. One day over lunch with her editor, as the story goes, Ehrenreich mentioned an idea. How can people exist on minimum-wage work? How do low-income workers get by? she wondered. Someone should do a study. To her surprise, her editor responded, Why don't you do it? That's how Ehrenreich found herself joining the ranks of the working class. For several months, she left her comfortable home and lived and worked among people who lacked, for the most part, higher education and marketable job skills. Undercover, she applied for and worked minimum wage jobs as a waitress, a cleaning woman, a nursing home aide, and a retail chain employee. During her participant observation, she used only her income from those jobs to pay for food, clothing, transportation, and shelter. She discovered the obvious, that it's almost impossible to get by on minimum wage work. She also experienced and observed attitudes many middle and upper-class people never think about. She witnessed firsthand the treatment of working class employees. She saw the extreme measures people take to make ends meet and to survive. She described fellow employees who held two or three jobs, worked seven days a week, lived in cars, could not pay to treat chronic health conditions, got randomly fired, submitted to drug tests, and moved in and out of homeless shelters. She brought aspects of that life to light, describing difficult working conditions and the poor treatment that low-wage workers suffer. Nickel and Dimed: On (Not) Getting By in America , the book she wrote upon her return to her real life as a well-paid writer, has been widely read and used in many college classrooms.

About 10 empty office cubicles are shown.

Figure 2.8 Field research happens in real locations. What type of environment do work spaces foster? What would a sociologist discover after blending in?

Ethnography

Ethnography is the extended observation of the social perspective and cultural values of an entire social setting. Ethnographies involve objective observation of an entire community. The heart of an ethnographic study focuses on how subjects view their own social standing and how they understand themselves in relation to a community. An ethnographic study might observe, for example, a small U.S. fishing town, an Inuit community, a village in Thailand, a Buddhist monastery, a private boarding school, or an amusement park. These places all have borders. People live, work, study, or vacation within those borders. People are there for a certain reason and therefore behave in certain ways and respect certain cultural norms. An ethnographer would commit to spending a determined amount of time studying every aspect of the chosen place, taking in as much as possible. A sociologist studying a tribe in the Amazon might watch the way villagers go about their daily lives and then write a paper about it. To observe a spiritual retreat center, an ethnographer might sign up for a retreat and attend as a guest for an extended stay, observe and record data, and collate the material into results.

Institutional Ethnography

Institutional ethnography is an extension of basic ethnographic research principles that focuses intentionally on everyday concrete social relationships. Developed by Canadian sociologist Dorothy E. Smith, institutional ethnography is often considered a feminist-inspired approach to social analysis and primarily considers women's experiences within male-dominated societies and power structures. Smith's work is seen to challenge sociology's exclusion of women, both academically and in the study of women's lives. Historically, social science research tended to objectify women and ignore their experiences except as viewed from the male perspective. Modern feminists note that describing women, and other marginalized groups, as subordinates helps those in authority maintain their own dominant positions. Smith's three major works explored what she called "the conceptual practices of power" and are still considered seminal works in feminist theory and ethnography.

The Making of Middletown: A Study in Modern U.S. Culture

In 1924, a young married couple named Robert and Helen Lynd undertook an unprecedented ethnography: to apply sociological methods to the study of one U.S. city in order to discover what "ordinary" people in the United States did and believed. Choosing Muncie, Indiana (population about 30,000), as their subject, they moved to the small town and lived there for eighteen months. Ethnographers had been examining other cultures for decades - groups considered minority or outsider - like gangs, immigrants, and the poor. But no one had studied the so-called average American. Recording interviews and using surveys to gather data, the Lynds did not sugarcoat or idealize U.S. life (PBS). They objectively stated what they observed. Researching existing sources, they compared Muncie in 1890 to the Muncie they observed in 1924. Most Muncie adults, they found, had grown up on farms but now lived in homes inside the city. From that discovery, the Lynds focused their study on the impact of industrialization and urbanization. They observed that Muncie was divided into business class and working class groups. They defined business class as dealing with abstract concepts and symbols, while working class people used tools to create concrete objects. The two classes led different lives with different goals and hopes. However, the Lynds observed, mass production offered both classes the same amenities. Like wealthy families, the working class was now able to own radios, cars, washing machines, telephones, vacuum cleaners, and refrigerators. This was an emerging material new reality of the 1920s. As the Lynds worked, they divided their manuscript into six sections: Getting a Living, Making a Home, Training the Young, Using Leisure, Engaging in Religious Practices, and Engaging in Community Activities. Each chapter included subsections such as "The Long Arm of the Job" and "Why Do They Work So Hard?" in the "Getting a Living" chapter. When the study was completed, the Lynds encountered a big problem. The Rockefeller Foundation, which had commissioned the book, claimed it was useless and refused to publish it. The Lynds asked if they could seek a publisher themselves. Middletown: A Study in Modern American Culture was not only published in 1929 but also became an instant bestseller, a status unheard of for a sociological study. The book sold out six printings in its first year of publication, and has never gone out of print (PBS). Nothing like it had ever been done before. Middletown was reviewed on the front page of the New York Times. Readers in the 1920s and 1930s identified with the citizens of Muncie, Indiana, but they were equally fascinated by the sociological methods and the use of scientific data to define ordinary people in the United States. The book was proof that social data was important - and interesting - to the U.S. public.

Early 20th century black and white photo showing female students at their desks.

Figure 2.9 A classroom in Muncie, Indiana, in 1917, five years before John and Helen Lynd began researching this "typical" U.S. community.

Sometimes a researcher wants to study one specific person or event. A case study is an in-depth analysis of a single event, situation, or individual. To conduct a case study, a researcher examines existing sources like documents and archival records, conducts interviews, engages in direct observation and even participant observation, if possible. Researchers might use this method to study a single case of, for example, a foster child, drug lord, cancer patient, criminal, or rape victim. However, a major criticism of the case study as a method is that a developed study of a single case, while offering depth on a topic, does not provide enough evidence to form a generalized conclusion. In other words, it is difficult to make universal claims based on just one person, since one person does not verify a pattern. This is why most sociologists do not use case studies as a primary research method. However, case studies are useful when the single case is unique. In these instances, a single case study can add tremendous knowledge to a certain discipline. For example, a feral child, also called "wild child," is one who grows up isolated from human beings. Feral children grow up without social contact and language, which are elements crucial to a "civilized" child's development. These children mimic the behaviors and movements of animals, and often invent their own language. There are only about one hundred cases of "feral children" in the world. As you may imagine, a feral child is a subject of great interest to researchers. Feral children provide unique information about child development because they have grown up outside of the parameters of "normal" child development. And since there are very few feral children, the case study is the most appropriate method for researchers to use in studying the subject. At age three, a Ukranian girl named Oxana Malaya suffered severe parental neglect. She lived in a shed with dogs, and she ate raw meat and scraps. Five years later, a neighbor called authorities and reported seeing a girl who ran on all fours, barking. Officials brought Oxana into society, where she was cared for and taught some human behaviors, but she never became fully socialized. She has been designated as unable to support herself and now lives in a mental institution. Case studies like this offer a way for sociologists to collect data that may not be collectable by any other method.

Experiments

You've probably tested personal social theories. "If I study at night and review in the morning, I'll improve my retention skills." Or, "If I stop drinking soda, I'll feel better." Cause and effect. If this, then that. When you test the theory, your results either prove or disprove your hypothesis. One way researchers test social theories is by conducting an experiment , meaning they investigate relationships to test a hypothesis - a scientific approach. There are two main types of experiments: lab-based experiments and natural or field experiments. In a lab setting, the research can be controlled so that perhaps more data can be recorded in a certain amount of time. In a natural or field-based experiment, the generation of data cannot be controlled but the information might be considered more accurate since it was collected without interference or intervention by the researcher. As a research method, either type of sociological experiment is useful for testing if-then statements: if a particular thing happens, then another particular thing will result. To set up a lab-based experiment, sociologists create artificial situations that allow them to manipulate variables. Classically, the sociologist selects a set of people with similar characteristics, such as age, class, race, or education. Those people are divided into two groups. One is the experimental group and the other is the control group. The experimental group is exposed to the independent variable(s) and the control group is not. To test the benefits of tutoring, for example, the sociologist might expose the experimental group of students to tutoring but not the control group. Then both groups would be tested for differences in performance to see if tutoring had an effect on the experimental group of students. As you can imagine, in a case like this, the researcher would not want to jeopardize the accomplishments of either group of students, so the setting would be somewhat artificial. The test would not be for a grade reflected on their permanent record, for example.

An Experiment in Action

The image shows a state police car that has pulled over another car near a highway exit.

Figure 2.10 Sociologist Frances Heussenstamm conducted an experiment to explore the correlation between traffic stops and race-based bumper stickers. This issue of racial profiling remains a hot-button topic today. A real-life example will help illustrate the experiment process. In 1971, Frances Heussenstamm, a sociology professor at California State University at Los Angeles, had a theory about police prejudice. To test her theory she conducted an experiment. She chose fifteen students from three ethnic backgrounds: black, white, and Hispanic. She chose students who routinely drove to and from campus along Los Angeles freeway routes, and who'd had perfect driving records for longer than a year. Those were her independent variables - students, good driving records, same commute route. Next, she placed a Black Panther bumper sticker on each car. That sticker, a representation of a social value, was the independent variable. In the 1970s, the Black Panthers were a revolutionary group actively fighting racism. Heussenstamm asked the students to follow their normal driving patterns. She wanted to see whether seeming support of the Black Panthers would change how these good drivers were treated by the police patrolling the highways. The dependent variable would be the number of traffic stops/citations. The first arrest, for an incorrect lane change, was made two hours after the experiment began. One participant was pulled over three times in three days. He quit the study. After seventeen days, the fifteen drivers had collected a total of thirty-three traffic citations. The experiment was halted. The funding to pay traffic fines had run out, and so had the enthusiasm of the participants.

Secondary Data Analysis

While sociologists often engage in original research studies, they also contribute knowledge to the discipline through secondary data analysis . Secondary data doesn't result from firsthand research collected from primary sources, but are the already completed work of other researchers. Sociologists might study works written by historians, economists, teachers, or early sociologists. They might search through periodicals, newspapers, or magazines from any period in history. Using available information not only saves time and money but can also add depth to a study. Sociologists often interpret findings in a new way, a way that was not part of an author's original purpose or intention. To study how women were encouraged to act and behave in the 1960s, for example, a researcher might watch movies, televisions shows, and situation comedies from that period. Or to research changes in behavior and attitudes due to the emergence of television in the late 1950s and early 1960s, a sociologist would rely on new interpretations of secondary data. Decades from now, researchers will most likely conduct similar studies on the advent of mobile phones, the Internet, or Facebook. Social scientists also learn by analyzing the research of a variety of agencies. Governmental departments and global groups, like the U.S. Bureau of Labor Statistics or the World Health Organization, publish studies with findings that are useful to sociologists. A public statistic like the foreclosure rate might be useful for studying the effects of the 2008 recession; a racial demographic profile might be compared with data on education funding to examine the resources accessible by different groups. One of the advantages of secondary data is that it is nonreactive research (or unobtrusive research), meaning that it does not include direct contact with subjects and will not alter or influence people's behaviors. Unlike studies requiring direct contact with people, using previously published data doesn't require entering a population and the investment and risks inherent in that research process. Using available data does have its challenges. Public records are not always easy to access. A researcher will need to do some legwork to track them down and gain access to records. To guide the search through a vast library of materials and avoid wasting time reading unrelated sources, sociologists employ content analysis , applying a systematic approach to record and value information gleaned from secondary data as they relate to the study at hand. But, in some cases, there is no way to verify the accuracy of existing data. It is easy to count how many drunk drivers, for example, are pulled over by the police. But how many are not? While it's possible to discover the percentage of teenage students who drop out of high school, it might be more challenging to determine the number who return to school or get their GED later. Another problem arises when data are unavailable in the exact form needed or do not include the precise angle the researcher seeks. For example, the average salaries paid to professors at a public school is public record. But the separate figures don't necessarily reveal how long it took each professor to reach the salary range, what their educational backgrounds are, or how long they've been teaching. When conducting content analysis, it is important to consider the date of publication of an existing source and to take into account attitudes and common cultural ideals that may have influenced the research. For example, Robert S. Lynd and Helen Merrell Lynd gathered research for their book Middletown: A Study in Modern American Culture in the 1920s . Attitudes and cultural norms were vastly different then than they are now. Beliefs about gender roles, race, education, and work have changed significantly since then. At the time, the study's purpose was to reveal the truth about small U.S. communities. Today, it is an illustration of 1920s' attitudes and values.

Chapter 2: Sociological Research

Research methods: experiments, learning outcomes.

Describe and give examples of how sociologists utilize experiments

Experiments

You’ve probably tested some of your own theories: “If I study at night and review in the morning, I’ll improve my retention skills.” Or, “If I stop drinking soda, I’ll feel better.” Cause and effect. If this, then that. Causation is difficult to establish, so even if we seem to find evidence in our own lives that appears to prove our hypotheses, this is not sociological research nor is it evidence of causation. Sociologists set up specific studies in controlled environments in order to examine relationships between variables. Some studies are correlational, meaning they examine how two variables change together, while others are experimental, meaning they use controlled conditions to attempt to explain cause and effect. The primary difference between our everyday observations and sociological research is the systematic approach researchers use to collect data.

E xperiments aim to measure the relationship of the independent variable to the dependent variable, and the researcher or research team will attempt to control all other variables in the experimental process. This is often done in a lab-based setting, but can also be done as a field experiment. As discussed in the section on ethics, there are many considerations to address before any experimental work can occur. Sociologists must obtain approval from a review board (sometimes called an Internal Review Board or IRB) before they commence any type of sociological experiment.

Lab Settings

In a lab setting, the research can be controlled so that perhaps more data can be recorded in a certain amount of time. To set up a lab-based experiment, sociologists create artificial situations that allow them to manipulate variables. Classically, the sociologist selects a set of people with similar characteristics, such as age, class, race, or education. Those people are divided into two groups. One is the experimental group and the other is the control group. The experimental group is exposed to the independent variable(s) and the control group is not. This is similar to pharmaceutical drug trials in which the experimental group is given the test drug and the control group is given a placebo or sugar pill. To test the benefits of tutoring, for example, the sociologist might expose the experimental group of students to tutoring while the control group does not receive tutoring. Then both groups would be tested for differences in performance to see if tutoring had an effect on the experimental group of students. As you can imagine, in a case like this, the researcher would not want to jeopardize the accomplishments of either group of students, so the setting would be somewhat artificial. The test would not be for a grade reflected on their permanent record, for example.

The Stanford Prison Experiment is perhaps one of the most famous sociological experiments ever conducted. In 1971, 24 healthy, middle-class male university students were selected to take part in a simulated jail environment to examine the effects of social setting and social roles on individual psychology and behavior. They were randomly divided into 12 guards and 12 prisoners. The prisoner subjects were arrested at home and transported blindfolded to the simulated prison in the basement of the psychology building on the campus of Stanford University. Within a day of arriving the prisoners and the guards began to display signs of trauma and sadism, respectively. After some prisoners revolted by blockading themselves in their cells, the guards resorted to using increasingly humiliating and degrading tactics to control the prisoners through psychological manipulation. The experiment had to be abandoned after only six days because the abuse had gotten out of hand (Haney, Banks, and Zimbardo, 1973).

While the insights into the social dynamics of authoritarianism it generated were fascinating, the Stanford Prison Experiment also serves as an example of the ethical issues that emerge when experimenting on human subjects and the types of emotional harm that subjects can endure as a result of participating in research. Additionally, this classic experiment, which is cited in most sociology and psychology textbooks, has recently been called out as being “theatre” rather than rigorous science. Some social scientists have even provided evidence to show that Zimbardo and his team coached research subjects into being cruel (guards) and dramatic (prisoners). The experiment has also been criticized for its small sample size and unrepresentative sample population.

Natural or Field-Based Experiments

In a natural or field-based experiment, the generation of data cannot be controlled, but the information might be considered more accurate since it was collected without interference or intervention by the researcher. As a research method, either type of sociological experiment is useful for testing if-then statements: if a particular thing happens, then another particular thing will result.

Sociologists Devah Pager, Bruce Western, and Bart Bonikowski wanted to examine discrimination in the low-wage job market. They recruited white, black, and Latino “testers,” who were assigned equivalent resumés and who were matched on a variety of characteristics such as age, education, physical appearance, and interpersonal skills. The testers applied to real job openings and recorded responses from employers. Because black and white testers were sent to the same firms, and testers were matched on a wide variety of characteristics, “much of the unexplained variation that confounds residual estimates of discrimination [was] experimentally controlled” [1] The testers were college-educated males that comprised field teams that included a white, Latino, and black tester; the Latino testers spoke in unaccented English and were U.S. citizens of Puerto Rican descent and claimed no Spanish language ability. They also examined the effect of a criminal record (felony drug offense) for different racial groups in job applications, building upon Pager’s research in 2003. Some resumés included a checked box to indicate a felony conviction and also listed prison labor as part of the applicant’s employment history. The teams applied for 340 real entry-level jobs throughout New York City over nine months in 2004.

As with many of the most insightful sociological studies, Pager, Western & Bonikowski included qualitative data based on the testers’ interactions with employers, which provided a rich supplement to the empirical data acquired through this field experiment. Like Matthew Desmond’s multi-method approach to evictions (empirical— secondary resources; interpretive—ethnography), we see a similar approach here (empirical—field experiment; interpretive—testers’ narratives of interactions with employers). In this study, blacks were only half as likely to receive a callback or job offer, and whites, blacks, and Latinos with clean criminal backgrounds were no more likely to receive a callback as a white applicant just released from prison. Moreover, the testers did not perceive any signs of clear prejudice (Pager, Western, & Bonikowski, 2009).

Sociologists have long been interested in inequality and discrimination. Read the study below to see how one sociology professor sent her students to the field.

An Experiment in Action

Figure 1. Sociologist Frances Heussenstamm conducted an experiment to explore the correlation between traffic stops and race-based bumper stickers. This issue of racial profiling remains a hot-button topic today. (Photo courtesy of dwightsghost/flickr)

A real-life example will help illustrate the experiment process. In 1971, Frances Heussenstamm, a sociology professor at California State University, Los Angeles, had a theory about police prejudice. To test her theory she conducted an experiment. She chose fifteen students from three ethnic backgrounds: black, white, and Latino. She chose students who routinely drove to and from campus along Los Angeles freeway routes, and who’d had perfect driving records for longer than a year. Those were her control variables—students, good driving records, same commute route. These students signed all had safe, up-to-date cars and signed a pledge to drive safely.

Next, she placed a Black Panther bumper sticker on each car. That sticker, a representation of a social value, was the independent variable. Founded in Oakland, California in 1966, the Black Panthers were a revolutionary African-American group actively fighting racism. Heussenstamm asked the students to follow their normal driving patterns. She wanted to see whether seeming to support the Black Panthers would change how these good drivers were treated by the police patrolling the highways (the dependent variable).

The first citation, for an incorrect lane change, was made two hours after the experiment began. One participant was pulled over three times in three days. He quit the study. After seventeen days, the fifteen drivers had collected a total of thirty-three traffic citations and the funding to pay traffic fines had run out. The experiment was halted (Heussenstamm 1971).

Think It Over

Do the findings in the Pager, Western & Bonikowski field experiment surprise you? Why or why not? In what ways can studies about discrimination inform public policy?
What kinds of ethical issues are present in Heussenstamm’s experiment? Were some students at greater risk than others? How do you think the experiences of each group (black, white, and Latino) differed? Do you think gender would influence the interaction between student and police officer?
Imagine your sociology professor asked you to place a “Black Lives Matter” bumper sticker on your vehicle and asked you to sign an informed consent before participating in the study. Would you do it? Why or why not? How does geographic location and personal identity affect one’s experience and potential risk factors?
Pager, D., Western, B. and B. Bonikowski. 2009. “Discrimination in a Low-Wage Labor Market: A Field Experiment.” American Sociological Review. Vol. 74 (October: 777-799). ↵

Learning Materials

Business Studies
Combined Science
Computer Science
Engineering
English Literature
Environmental Science
Human Geography
Macroeconomics
Microeconomics
Experiments

Think of the times when you were a child and wanted to try new things by asking 'what if?' . We all loved our fun science projects in school - mixing baking soda with a clementine to make orange fizz, for example.

Create learning materials about Experiments with our free learning app!

Instand access to millions of learning materials
Flashcards, notes, mock-exams and more
Everything you need to ace your exams

Millions of flashcards designed to help you ace your studies

Cell Biology

What are experiments?

What is the difference between the positivist and interpretivist approaches in conducting experiments?

Are experiments primary or secondary research instruments?

Why is the location important for experiments?

What is a variable?

Provide examples of famous experiments.

What are the advantages of lab experiments?

What are the disadvantages of lab experiments?

What are the advantages of field experiments?

What are the disadvantages of field experiments?

What kind of data do experiments produce?

Review generated flashcards

to start learning or create your own AI flashcards

Start learning or create your own AI flashcards

American Identity
Beliefs in Society
Crime and Deviance
Cultural Identity
Education With Methods in Context
Families and Households
Famous Sociologists
Global Development
Research Methods in Sociology
Social Institutions
Social Relationships
Social Stratification
Sociological Approach
Sociology of Education
Sociology of Family
Stratification and Differentiation
Theories and Methods
American Sociological Association
Case Studies
Ethnography
Field Research
Founders of Sociology
Functionalism
Interpretivism
Longitudinal Studies
Observation
Official Statistics
Postmodernism
Questionnaire
Research Considerations
Research Design
Social Action Theory
Social Policy
Sociological Imagination
Sociological Research Methods
Sociological Theories
Sociology as a Science
Sources of Data
Types of Data
Value Neutrality
Values in Research
What is the Study of Sociology?
Work Poverty And Welfare

The 'what if?' question followed by an action to trace cause and effect is classified as an experiment.

' What if I pour water on the sand? ' would be an experiment question for a young natural scientist. ' What if I disobeyed my teacher? ' would be an experiment question to a young social scientist.

In the Research Design article, we briefly touched upon the nature of the experimental research design . Researchers begin their investigations with a hypothesis that must be tested.

Once we have a hypothesis, we can test it using an experiment. Therefore, we will be looking at:

The definition of experiments, what they are and the types of experiments there are
Laboratory experiments, famous examples and their advantages and disadvantages
Field experiments, famous examples and their advantages and disadvantages
The differences between laboratory and field experiments
Ethnographic research

There's a lot to get through, so let's start!

Experiments in Sociology: examples and types

An experiment is a research method used in experimental research design. It uses the scientific method and seeks to establish a cause-effect relationship between two variables by testing a hypothesis . In sociology , we test the relationship between social phenomena.

Experiments typically produce quantitative results. However, if it is a social experiment, it could also yield qualitative data.

One of the key factors that affect experiments is location. An experiment can either occur in controlled laboratory conditions or the field .

Norman Triplett conducted one of the first known experiments in 1895, focusing on social facilitation. He observed that cyclists tend to perform better when cycling in the presence of someone else, as opposed to cycling alone. He recreated this effect in his laboratory experiment, where he demonstrated how children complete a task faster when working in pairs than when working individually.

However, before we consider the differences in experiment locations, we need to assess the extent to which researchers exercise control over them. Researchers distinguish between natural and controlled experiments.

A natural experiment is an empirical or observational study in which researchers do not artificially manipulate the variables of interest. Instead, they can be influenced by nature or factors outside the researchers' control.

On the other hand, a controlled experiment is one in which the independent variable is manually manipulated to see if it will influence the dependent variable and cause it to change. This eliminates any alternative explanations of observed relationships and traces a direct cause-effect .

We will now look at two types of experiments: laboratory and field experiments.

Laboratory Experiments in Sociology

These are experiments that take place in controlled environments and aim to use the scientific method to test a specific hypothesis. This is then used to find a cause-and-effect relationship between two variables.

Proponents of the positivist research philosophy advocate controlled laboratory experiments because that is the only way to ensure that the relationship being tested is not affected by any external factors.

They define the relationship between factors using mathematical terms: dependent and independent variables.

A variable is a factor in an experiment that may be subject to change.

A dependent variable is the subject of the study, for example, fluency in Spanish.
An independent variable is being manipulated to see the effect on the dependent variable. For example, using a native Spanish speaker and a native English speaker to teach Spanish to ascertain if there is a difference between Spanish language attainment under different teachers.

Randomised controlled trials

The most well-known example of lab experiments is randomised controlled trials (RCTs), which are commonly used to test the effectiveness of drugs. Participants are randomly selected and divided into those who received the drug (the treatment/intervention group) and those who got a placebo (the control group).

Researchers record participants' health conditions before and after the experiment to see whether there is any difference in outcome between the two groups. This allows a high degree of confidence in determining if there is a causal relationship between taking the drug and getting better or worse (for instance, if the drug does not work and produces side effects).

Laboratory experiments in social research

It is difficult to use laboratory experiments in social research to conduct experiments . Social experiments differ because they study social rather than biological phenomena. T he nature and context of social experiments are also different from natural science experiments like the drug test described above.

There is an ongoing debate in the scientific community about the extent to which it is possible to recreate authentic social scenarios in controlled environments. Therefore, social scientists frequently lean towards field experiments.

Famous sociology experiments in the lab

We will go through some famous sociological experiments.

Milgram (1963) and obedience

Milgram's obedience experiment (1963) is a famous example of laboratory conditions in social research. The experiment divided participants into 'learner' and 'teacher' groups, where the 'learners' were Milgram's confederates and purposely gave wrong answers. The test was to see how far the 'teachers' (the participants) would go to be obedient - even if it involved punishing the learners by subjecting them to (fake) electric shocks.

The result of the initial experiment was that 65 percent of participants (i.e. teachers) went on to administer the highest level of electric shock - 450 volts. All of the participants continued to 300 volts. This experiment took place in Milgram's lab at Yale University.

Asch (1951) and conformity

Another illustration of a sociological experiment conducted in a lab is Solomon Asch's conformity experiment (1951). He was interested in the extent to which the social pressure of a majority could make a person conform. He invited 50 people to take part in his vision test, demonstrated in the image below, and asked them to assess in groups whether the line on the left is the same length as line A, line B or line C.

The participants did not know that Asch's associates were purposefully giving wrong answers among them. Asch wanted to see if the actual participants would change their opinion in line with others. 75 percent of the participants conformed to the popular opinion once or more, even though they knew that the answers were incorrect. This experiment took place in Asch's lab at Swarthmore College in Pennsylvania.

Laboratory experiments in Sociology: Advantages and Disadvantages

It is important to understand not only the strengths of a research method but also its shortcomings. Read below for an outline of the advantages and disadvantages of laboratory experiments in sociology .

Advantages of laboratory experiments in Sociology

There is control over the experiment and the ability to isolate the targeted variables.

Researchers can trace 'cause and effect' relationships.

They have high degrees of reliability as the lab conditions can be replicated.

Positivist sociologists favour them as they use the scientific method.

Disadvantages of laboratory experiments in Sociology

The lab environment is not conducive to people acting authentically; they could put on a facade if they know they are being studied. This is called a 'demand characteristic' and could render the results invalid.

Participants could give answers they think the researcher wants to hear because they fear being ridiculed or “letting the researcher down” by producing “incorrect” answers. This is also an example of a demand characteristic.

Behaviour is rarely caused by a single factor, so isolating one variable may not be possible or useful.

Some lab experiments are morally and ethically questionable. For example, the method and results of Milgram's obedience experiment were controversial due to the distress caused to the participants.

In social research, some sociologists prefer conducting field experiments. We will now consider these.

Field Experiments in Sociology

Field experiments are conducted in real-world social scenarios. They emerged due to the interpretivism critique of lab experiments, which argues that authentic social interaction cannot be reproduced in a lab.

Field experiments in social research

Let's look at examples of sociological field experiments.

Zimbardo (1971)

A great example of a social experiment conducted in the field was one we touched upon briefly in the Research Considerations article - Zimbardo's Stanford prison experiment (1971). Zimbardo invited volunteers to be prisoners and guards in the mock prison he created. Participants were randomly assigned roles of 'prisoner' and 'guard' and studied to test why prison guards can be brutal with prisoners - namely, whether they are naturally sadistic or are influenced by the environment.

Zimbardo found that even though the participants were thoroughly vetted for behaviour/anger issues, the 'guards' started to treat the 'prisoners' aggressively and abusively from early on. The experiment showed how easily people would conform to the roles they are expected to play in society.

UK DWP (2010)

A more recent example was commissioned by the UK's Department for Work and Pension (DWP) and conducted by a team of researchers from the National Centre for Social Research in 2010. The experiment's objective was to figure out if employers are biased against vacancy candidates with ethnic minority names.

They sent applications for 987 real job vacancies across the UK under names commonly associated with ethnic minorities. For each job, they sent three applications with equivalent background and qualifications: one used a 'white' name and the other two had names from different ethnic origins.

The results were that ethnic minorities faced considerable name discrimination in the hiring process - despite having identical CVs and cover letters to the majority white candidates, they needed to send 74 percent more applications to secure an interview.

Field Experiments in Sociology: Advantages and Disadvantages

Field experiments have their benefits but are not always suitable. Read below for an outline of the advantages and disadvantages of field experiments in sociology.

Advantages of field experiments in Sociology

The researcher is more likely to see the ' real deal' instead of an act as the scenarios are authentic.

Social interactions show genuine behaviours, which can help researchers consider other factors that would not have been discovered in a controlled lab setting.

They are favoured by interpretivist sociologists.

Disadvantages of field experiments in Sociology

Researchers cannot control the environment where their experiment occurs, which could mean that there are other influencing factors.

It is ethically questionable to conduct field experiments if the subjects are unaware that they are being studied.

Ethnographic Research

We will briefly consider ethnographic research and how it may be helpful in sociological research.

Ethnographic research is an immersive methodology whereby a researcher collects data whilst being part of the community under investigation. They do so with the goal of producing a narrative account of that particular community, against a theoretical backdrop.

One could argue that ethnographic research is a form of a natural experiment .

The first ethnographic researchers were anthropologists - they joined the community, learned the language, and noted their observations. Some researchers such as Margaret Mead also conducted interviews and psychological tests.

Characteristics of ethnographic research:

small-scale immersive fieldwork

produces qualitative data

includes primary data from observations, case studies or focus groups

includes secondary data from diaries, documents or letters

Evaluation of ethnographic research

The immersion of the research process allows for in-depth insights from an ' insider ' perspective. Research subjects may be more inclined to open up or behave naturally if they do not perceive the researcher as an outsider force.

The high validity of findings stems from studying behaviour in natural settings.

However, the quality of such research can be called into question due to the findings being subject to the researchers' interpretation , which is likely to bring bias into the investigation. M ore importantly, the findings may not always accurately reflect the authenticity of social interactions .

At the beginning of the article, we pointed out that experiments are typically considered as primary sources of data . However, if you are using someone else's raw data from their experiment, you are using it as a secondary source.

Experiments - Key Takeaways

Experiments test the researchers' hypotheses by trying to establish a causal relationship between the independent and dependent variables.
Milgram's obedience and Aschs' conformity experiments are famous examples of social experiments in controlled conditions.
Zimbardo 's Stanford Prison experiment and research into discrimination in the job application process by the National Centre for Social Research show how social experiments can occur naturally in the field.
There are advantages and disadvantages of using both lab and field experiments. A researcher should be able to assess which would be most suitable for their research needs.
Ethnographic research could also be a form of a natural experiment as it involves immersive fieldwork.

Flashcards in Experiments 26

In sociological research, an experiment aims to test a hypothesis by identifying 'cause and effect' between social phenomena. It is used to eliminate any alternative explanations of observed relationships.

Positivists argue that experiments should be conducted according to the rigorous standards of the scientific methods and should be in a lab. Interpretivists argue that it is impossible to recreate authentic social scenarios in a lab; therefore, they prefer to study people 'in the field'.

Experiments are typically conducted by the researchers first hand, which makes their data primary. However, if a researcher is using the outputs of someone else's experiment - that makes their data secondary.

In the lab, researchers are able to control the environment and thus eliminate the possibility that other variables will impact the tested relationship. In the field, researchers have no control over the environment. It is important for a researcher to consider what type of location is the most suitable.

Variable is defined as a factor in an experiment that may be subject to change. There are two types of variables: dependent and independent variables.

Any of the following answers are correct:

Milgram's obedience experiment
Aschs' Conformity experiment
Zimbardo's Stanford Prison experiment

Learn with 26 Experiments flashcards in the free StudySmarter app

We have 14,000 flashcards about Dynamic Landscapes.

Already have an account? Log in

Frequently Asked Questions about Experiments

What is an experiment in social research?

In social research, an experiment tests a hypothesis. Laboratory and field experiments are two types of experiments in social research.

What does an experiment mean?

In sociological research, an experiment uses the scientific method and seeks to establish a cause-effect relationship between two variables by testing a hypothesis. In sociology, we test the relationship between social phenomena.

What is a field experiment in sociology?

Field experiments are those conducted in real-world social scenarios in order to access the most authentic social interaction.

What are the two types of experiments in sociology?

The two types of experiments in sociology are laboratory and field experiments.

What is an example of experiment in sociology?

An example of an experiment in sociology was commissioned by the UK's Department for Work and Pension (DWP). It was conducted by a team of researchers from the National Centre for Social Research. The experiment's objective was to determine if employers are biased against vacancy candidates with ethnic minority names.

Discover learning materials with the free StudySmarter app

About StudySmarter

StudySmarter is a globally recognized educational technology company, offering a holistic learning platform designed for students of all ages and educational levels. Our platform provides learning support for a wide range of subjects, including STEM, Social Sciences, and Languages and also helps students to successfully master various tests and exams worldwide, such as GCSE, A Level, SAT, ACT, Abitur, and more. We offer an extensive library of learning materials, including interactive flashcards, comprehensive textbook solutions, and detailed explanations. The cutting-edge technology and tools we provide help students create their own learning materials. StudySmarter’s content is not only expert-verified but also regularly updated to ensure accuracy and relevance.

StudySmarter Editorial Team

Team Sociology Teachers

12 minutes reading time
Checked by StudySmarter Editorial Team

Study anywhere. Anytime.Across all devices.

Create a free account to save this explanation..

Save explanations to your personalised space and access them anytime, anywhere!

By signing up, you agree to the Terms and Conditions and the Privacy Policy of StudySmarter.

Join over 22 million students in learning with our StudySmarter App

The first learning app that truly has everything you need to ace your exams in one place

Flashcards & Quizzes
AI Study Assistant
Study Planner
Smart Note-Taking

Join over 22 million students in learning with our StudySmarter App

Georgia State University Library
GSU Library Research Guides

*Sociology Subject Guide

Literature reviews, explained.

A review of scholarly literature is an essential component of any research project, but why? Join Librarian Charlene for an introductory webinar to help you begin your assignment with a clear understanding of its purpose. We’ll explore answers to questions like:

What is scholarship and peer review?
Why do researchers engage in the process of literature review?
What types of literature reviews are commonly produced in coursework?
How do we decide what literature to review, and by which criteria?
What strategies can we use to ensure a thorough review of the literature?
How can we use literature review assignments in our future research?

Ideal for students in the first year of a degree program, transfer students, and students returning to school.

Prior registration is required: https://pin.gsu.edu/event/10207076 This is an online webinar conducted va WebEx. You will receive an email containing instructions to access the webinar on the day prior to the session. You will need speakers or headphones, or you can listen via phone. You do not need a microphone.

What is Sociology?

"sociology studies human societies, their interactions, and the processes that preserve and change them. it does this by examining the dynamics of constituent parts of societies such as institutions, communities, populations, and gender, racial, or age groups. sociology also studies social status or stratification, social movements, and social change, as well as societal disorder in the form of crime, deviance, and revolution" (borgatta & montgomery, 2000, pp. 25-26)..

What do Sociologists Do?

Sociologists can work in many fields, like: business, politics, culture, diversity, criminal justice, the arts, sports, medicine, research, animal welfare, religion, technology, environment, social services, social work, community organization, activism, advocacy, and education (joseph, 2017)..

Joseph, C. (2017). You’re Hired! : Putting Your Sociology Major to Work . Emerald Publishing Limited.

How to Become a Sociologist

Sociology at Georgia State University By joining the Department of Sociology at Georgia State University, you become part of a strong community of scholars who can support you in a wide range of career goals. We offer several undergraduate and graduate programs of study.

Next: Research in Sociology >>
Research in Sociology This link opens in a new window
ASA Citation
Zotero This link opens in a new window

Librarian Charlene

Open Count!

Are you using an openly accessible resource in your course? We want to hear about it! Please complete the short form, linked below.

Last Updated: Aug 23, 2024 1:33 PM
URL: https://research.library.gsu.edu/sociology

Stay informed: Sign up for eNews

Facebook (opens in new window)
X (opens in new window)
Instagram (opens in new window)
YouTube (opens in new window)
LinkedIn (opens in new window)

Other, Please Specify

Amazon (opens in new window)
Barnes & Noble (opens in new window)
Bookshop (opens in new window)
UC Press (opens in new window)

About the Book

About the author, from our blog.

UC Press Authors on the 50th Anniversary of the Stonewall Uprising

Table of contents.

"This is an engaging and vital book that provides methodological advice and practical strategies for undertaking queer research." — LSE Review of Books

“This book is sure to become a benchmark text and should become required reading in mainstream graduate sociological theory and methods courses.” —Judith Stacey, New York University and author of Brave New Families

“These deeply engaging and insightful voices will inspire the reader to embrace sociological research without fear and to nurture an academic life with genuine freedom and authenticity.” —Gloria González-López, University of Texas at Austin

“An ambitious, much needed, and, yes, inspiring volume.” —Brian Powell, Indiana University

“A testament to the power of collaboration, this bracing and timely collection brings together rigorously self-reflexive, politically committed work by a rising generation of queer, trans, feminist, and anti-racist scholars.”— Heather Love, University of Pennsylvania

Sociological Experiments

Table of Contents

This post aims to provide some examples to some of the more unusual and interesting experiments that students can explore and evaluate.

I’ve already done a post on ‘ seven field experiments ‘, that outline seven of the most interesting classic and contemporary experiments which are relevant to various topics within the A-level sociology syllabus, in this post I provide a much fuller list, and try to present some more unusual examples, focusing on contemporary examples with video examples where possible.

Channel Four’s ‘The Circle’ is an experiment of sorts – contestants have to stay in one room and can only interact with each other by a bespoke, in-house social media application, competing for popularity. At the end of every day the two-three most popular people get to kick out someone from the least three popular people, then a newbie comes in to replace them.

The Twinstitute

Conclusion – mobile phones are distracting, quite a useful fact to remind students of!

Sleep deprivation makes people less likely to want to socialise with you!

A 2017 experiment measured how respondents perceived tired people. The findings were that respondents were less likely to want to socialise with sleep-deprived people.

You have to think about this to get to what the variables are:

What I like about this experiment is the clear ‘control measure’ – the researchers used photos of the same participants – after regular sleep and sleep-deprivation.

Without that control measure, the experiment would probably fall apart1

Science Professors think female applicants are less competent

63 of the fake applications were made by a male, named John; the other 64 were made by a female, named Jennifer.

The 127 professors were each asked to evaluate the application based on

The faculty were not told the purpose of the experiment, just that their feedback would be shared with the student.

The results

Blind auditions improve the chances of female musicians being recruited to orchestras

To overcome bias, most major U.S. orchestras implemented blind auditions in the 1970s to 1980s, in which musicians audition behind a screen that conceals their identities but does not alter sound. However, some kept non-blind auditions.

This provided the context for a nice ‘natural experiment’…

The researchers calculated that blind auditions increased the probability that a woman would advance from preliminary rounds by 50 percent.

Rouse and Goldin attribute about 30 percent of this gain to the advent of blind auditions.

The Marshmallow Test

Researchers put a child in a room with one Marshmallow. The child was informed that they could eat it whenever they wanted, but if they could wait until the researcher returned, they could have two Marshmallows.

NB – it’s down to you to do your research on how replicable and valid this experiment is.

(However, this second video appears to be one young guy with no academic credentials, other than the lame bookshelf he’s put in the background, hardly semiotics genius.)

Christopher Winship

EndNote X3 XML
EndNote 7 XML
Endnote tagged

Department of Molecular Biology

Biochemistry, Biophysics & Structural Biology

Biochemistry, Biophysics, and Structural Biology subfield banner

Biochemistry and Biophysics are the foundation of all cellular processes and systems. Biochemical processes account for the functions of cellular building blocks, from nucleic acids and proteins to lipids and metabolites, and the formation of complex networks that make a cell or system work. Biophysics explains the complexity of life with the simplicity of physical laws and math.

The mission of our collaborative unit ‘Biochemistry & Biophysics’ is to train the next generation of scientists and to uncover how life works at the molecular level. Our scientists study macromolecular complexes and their specificity, protein design and evolution, and molecular networks. We illuminate how the cytoskeleton determines cell shape, how cells transduce signals, how membranes fuse, how chromatin organizes the genome, how metabolism is coordinated, how viruses hijack cells, how the immune response works, and how cells form patterns and communicate with each other.

We are experts in bioengineering, structural biology, computation and modeling, optics and microscopy, and microfluidics. Some examples of the approaches being used, and in some cases developed, at Princeton include X-ray crystallography, electron microscopy, mass spectrometry, NMR spectroscopy, super-resolution optical microscopy, single-molecule methods, and computational modeling. These tools are being applied to biological problems ranging from protein folding and design, to signal transduction, to intracellular trafficking.

A long-standing tradition and strength of our University is that biologists, chemists and physicists work closely together in an interdisciplinary setting. It is also common to see computational biologists working together with wet-lab biologists to address problems that neither could tackle alone with spectacular results. This is facilitated by the intimate connection between the Department of Molecular Biology with the Departments of Chemistry , Physics and Chemical and Biological Engineering , as well at the Lewis-Sigler Institute for Integrative Genomics

Associated Faculty

José Avalos, Associate Professor of Chemical and Biological Engineering and the Andlinger Center for Energy and the Environment

IMAGES

Sociological experiments
Sociology Textbook Chapter 1
Research Methods (A Sociology Experiment)
Sociology Experiment by James Garrish
Sociology of Religion (A Sociology Experiment)
AS Sociology: Experiments

COMMENTS

A Sociology Experiment
A Sociology Experiment. What if a group of the most creative, passionate writers and teachers of Sociology got together to write the chapters of a new kind of textbook? What if they offered those chapters directly to students for $1? Students; Instructors; Register as Student. First Name *
The past, present, and future of experimental methods in the social
Proportion of published articles using experiments in top two generalist sociology, economics, and political science journals (1990-2020). The first trend to emphasize from Fig. 1 is that all three disciplines are utilizing the experimental method more today than they were 30 years ago. On average across the three disciplines, roughly four ...
Experiments
Experiments aim to measure the relationship of the independent variable to the dependent variable, and the researcher or research team will attempt to control all o ther variables in the experimental process. This is often done in a lab-based setting, but can also be done as a field experiment. As discussed in the section on ethics, there are ...
Experiments in Sociology
Experiments aim to measure the effect which an independent variable (the 'cause') has on a dependent variable ('the effect'). The key features of an experiment are control over variables, precise measurement, and establishing cause and effect relationships. In order to establish cause and effect relationships, the independent variable is changed and the dependent variable is measured; all
Field Experiments Across the Social Sciences
Using field experiments, scholars can identify causal effects via randomization while studying people and groups in their naturally occurring contexts. In light of renewed interest in field experimental methods, this review covers a wide range of field experiments from across the social sciences, with an eye to those that adopt virtuous practices, including unobtrusive measurement ...
PDF 17. Experimental sociology
ts are indeed com-parable. Therefore, an experiment is a methodological tool that allows the researcher to draw causal conclusions through control and random assignment.2 As a final remark on the history of experimental sociology, we would like to distin-guish three stages in the develop.
Experiments in Sociology
Definitions, key features and the theoretical, practical and ethical strengths and limitations of laboratory and field experiments applied to sociology (and psychology). Also covers key terms related to experiments. post has been written to help students revising for the research methods aspect of their second year A-level exams. Experiments - The Basics: Definitions/ Key Features
Social experiment
Sociology. A social experiment is a method of psychological or sociological research that observes people's reactions to certain situations or events. The experiment depends on a particular social approach where the main source of information is the participants' point of view and knowledge. To carry out a social experiment, specialists usually ...
Experimental research
10 Experimental research. 10. Experimental research. Experimental research—often considered to be the 'gold standard' in research designs—is one of the most rigorous of all research designs. In this design, one or more independent variables are manipulated by the researcher (as treatments), subjects are randomly assigned to different ...
Experimental methods in sociology
In many instances, the answer is, yes. There appear to be three different kinds of experiments that would possibly make sense in sociology. Experiments evaluating hypotheses about features of human motivation and behavior. Experiments evaluating hypotheses about the effects of features of the social environment on social behavior.
12. Experiments
This chapter is aimed at giving you a richer sense of how scientists use experimental methods to learn about the social world. Fundamentally, an experiment involves the researcher introducing a variable (the. independent variable. , also known as the experimental stimulus or treatment) and then observing what happens to another variable ...
2.2 Research Methods
Field Research. The work of sociology rarely happens in limited, confined spaces. Rather, sociologists go out into the world. They meet subjects where they live, work, and play. Field research refers to gathering primary data from a natural environment. To conduct field research, the sociologist must be willing to step into new environments and ...
2.1 Approaches to Sociological Research
Critical sociology focuses on deconstruction of existing sociological research and theory. Informed by the work of Karl Marx, scholars known collectively as the Frankfurt School proposed that social science, as much as any academic pursuit, is embedded in the system of power constituted by the set of class, caste, race, gender, and other ...
Chapter 2. Sociological Research
Approaches to Sociological Research. Using the scientific method, a researcher conducts a study in five phases: asking a question, researching existing sources, formulating a hypothesis, conducting a study, and drawing conclusions. The scientific method is useful in that it provides a clear method of organizing a study.
Sociological Research: Research Methods
In planning studies' designs, sociologists generally choose from four widely used methods of social investigation: survey, field research, experiment, and secondary data analysis, or use of existing sources. Every research method comes with plusses and minuses, and the topic of study strongly influences which method or methods are put to use.
Research Methods in Sociology
Four main primary research methods. For the purposes of A-level sociology there are four major primary research methods. social surveys (typically questionnaires) experiments. interviews. participant observation. I have also included in this section longitudinal studies and ethnographies/ case studies.
Research Methods: Experiments (Sociology Theory & Methods)
The strengths and limitations of experiments as a research method in Sociology are explained in this video. We cover both laboratory and field experiments.#a...
Research Methods: Experiments
Experiments aim to measure the relationship of the independent variable to the dependent variable, and the researcher or research team will attempt to control all other variables in the experimental process. This is often done in a lab-based setting, but can also be done as a field experiment. As discussed in the section on ethics, there are ...
Experiments (Sociology): Definition & Examples
An experiment is a research method used in experimental research design. It uses the scientific method and seeks to establish a cause-effect relationship between two variables by testing a hypothesis. In sociology, we test the relationship between social phenomena. Experiments typically produce quantitative results.
GSU Library Research Guides: *Sociology Subject Guide: Home
Sociology, the study of human behavior in social groups, is a relatively recent discipline within the social sciences, which examine human behavior, culture, and society using scientific methodology in both research and analysis.
Other, Please Specify by D'Lane Compton, Tey Meadow, Kristen Schilt
D'Lane Compton is Associate Professor of Sociology at the University of New Orleans. Compton is the coauthor of How Identities, Stereotypes, and Inequalities Matter through Gender Studies and a contributor to several volumes, including the International Handbook on the Demography of Sexuality. Tey Meadow is Assistant Professor of Sociology at Columbia University.
Sociological Experiments
The Marshmallow Test. This classic 1971 experiment was designed to measure a child's level of self-control, or will-power. In sociological terms, this is measuring a child's ability to 'defer gratification'. Researchers put a child in a room with one Marshmallow.
Urban Poverty and the City
Urban sociology, then, is more important now than ever before. Focusing on topics such as urban poverty and slums, wealth and gated communities, neighborhood change and neighborhood effects, housing and residential mobility, and community life and city politics, this research cluster focuses on the inner-workings of cities and urban life.
Biochemistry, Biophysics & Structural Biology
Biochemistry and Biophysics are the foundation of all cellular processes and systems. Biochemical processes account for the functions of cellular building blocks, from nucleic acids and proteins to lipids and metabolites, and the formation of complex networks that make a cell or system work.

A Sociology Experiment

Register as Student

Register as Instructor

Annual Review of Sociology

Most Read This Month

10 Experimental research

Basic concepts

Two-group experimental designs

Factorial designs

Hybrid experimental designs

Quasi-experimental designs

Perils of experimental research

Share This Book

Experimental methods in sociology

Share this:

Leave a comment Cancel reply

2.1 Approaches to Sociological Research

The Scientific Method

Step 1: Ask a Question or Find a Research Topic

Step 2: Review the Literature/Research Existing Sources

Step 3: Formulate a Hypothesis

Step 4: Design and Conduct a Study

Step 5: Draw Conclusions

Step 6: Report Results

Interpretive Framework

Critical Sociology

Chapter 2. Sociological Research

2.2. Research Methods

Introduction to Sociological Research

The Scientific Method

Ask a Question

Research Existing Sources

Formulate a Hypothesis

Experiments

Making Connections: Sociological Research

Field Research

Making Connections: Sociology in the Real World

Participant Observation

Ethnography

The Feminist Perspective: Institutional Ethnography

The Case Study

Secondary Data or Textual Analysis

Section Summary

Section Quiz

Short Answer

Further Research

Solutions to Section Quiz

Image Attributions

Share This Book

SOC101: Introduction to Sociology (2020.A.01)

Research Methods

Field Research

Sociology in the Real World

Participant Observation

Ethnography

Institutional Ethnography

The Making of Middletown: A Study in Modern U.S. Culture

Experiments

An Experiment in Action

Secondary Data Analysis

Chapter 2: Sociological Research

Experiments

Lab Settings

Natural or Field-Based Experiments

An Experiment in Action

Think It Over

Create learning materials about Experiments with our free learning app!

Experiments in Sociology: examples and types

Laboratory Experiments in Sociology

Randomised controlled trials

Laboratory experiments in social research

Famous sociology experiments in the lab

Milgram (1963) and obedience

Asch (1951) and conformity

Laboratory experiments in Sociology: Advantages and Disadvantages

Advantages of laboratory experiments in Sociology

Disadvantages of laboratory experiments in Sociology

Field Experiments in Sociology

Field experiments in social research

Zimbardo (1971)