types of methodology in articles

• Privacy Policy

Home » Research Methodology – Types, Examples and writing Guide

Research Methodology – Types, Examples and writing Guide

Table of Contents

Research Methodology

Definition:

Research Methodology refers to the systematic and scientific approach used to conduct research, investigate problems, and gather data and information for a specific purpose. It involves the techniques and procedures used to identify, collect , analyze , and interpret data to answer research questions or solve research problems . Moreover, They are philosophical and theoretical frameworks that guide the research process.

Structure of Research Methodology

Research methodology formats can vary depending on the specific requirements of the research project, but the following is a basic example of a structure for a research methodology section:

I. Introduction

• Provide an overview of the research problem and the need for a research methodology section
• Outline the main research questions and objectives

II. Research Design

• Explain the research design chosen and why it is appropriate for the research question(s) and objectives
• Discuss any alternative research designs considered and why they were not chosen
• Describe the research setting and participants (if applicable)

III. Data Collection Methods

• Describe the methods used to collect data (e.g., surveys, interviews, observations)
• Explain how the data collection methods were chosen and why they are appropriate for the research question(s) and objectives
• Detail any procedures or instruments used for data collection

IV. Data Analysis Methods

• Describe the methods used to analyze the data (e.g., statistical analysis, content analysis )
• Explain how the data analysis methods were chosen and why they are appropriate for the research question(s) and objectives
• Detail any procedures or software used for data analysis

V. Ethical Considerations

• Discuss any ethical issues that may arise from the research and how they were addressed
• Explain how informed consent was obtained (if applicable)
• Detail any measures taken to ensure confidentiality and anonymity

VI. Limitations

• Identify any potential limitations of the research methodology and how they may impact the results and conclusions

VII. Conclusion

• Summarize the key aspects of the research methodology section
• Explain how the research methodology addresses the research question(s) and objectives

Research Methodology Types

Types of Research Methodology are as follows:

Quantitative Research Methodology

This is a research methodology that involves the collection and analysis of numerical data using statistical methods. This type of research is often used to study cause-and-effect relationships and to make predictions.

Qualitative Research Methodology

This is a research methodology that involves the collection and analysis of non-numerical data such as words, images, and observations. This type of research is often used to explore complex phenomena, to gain an in-depth understanding of a particular topic, and to generate hypotheses.

Mixed-Methods Research Methodology

This is a research methodology that combines elements of both quantitative and qualitative research. This approach can be particularly useful for studies that aim to explore complex phenomena and to provide a more comprehensive understanding of a particular topic.

Case Study Research Methodology

This is a research methodology that involves in-depth examination of a single case or a small number of cases. Case studies are often used in psychology, sociology, and anthropology to gain a detailed understanding of a particular individual or group.

Action Research Methodology

This is a research methodology that involves a collaborative process between researchers and practitioners to identify and solve real-world problems. Action research is often used in education, healthcare, and social work.

Experimental Research Methodology

This is a research methodology that involves the manipulation of one or more independent variables to observe their effects on a dependent variable. Experimental research is often used to study cause-and-effect relationships and to make predictions.

Survey Research Methodology

This is a research methodology that involves the collection of data from a sample of individuals using questionnaires or interviews. Survey research is often used to study attitudes, opinions, and behaviors.

Grounded Theory Research Methodology

This is a research methodology that involves the development of theories based on the data collected during the research process. Grounded theory is often used in sociology and anthropology to generate theories about social phenomena.

Research Methodology Example

An Example of Research Methodology could be the following:

Research Methodology for Investigating the Effectiveness of Cognitive Behavioral Therapy in Reducing Symptoms of Depression in Adults

Introduction:

The aim of this research is to investigate the effectiveness of cognitive-behavioral therapy (CBT) in reducing symptoms of depression in adults. To achieve this objective, a randomized controlled trial (RCT) will be conducted using a mixed-methods approach.

Research Design:

The study will follow a pre-test and post-test design with two groups: an experimental group receiving CBT and a control group receiving no intervention. The study will also include a qualitative component, in which semi-structured interviews will be conducted with a subset of participants to explore their experiences of receiving CBT.

Participants:

Participants will be recruited from community mental health clinics in the local area. The sample will consist of 100 adults aged 18-65 years old who meet the diagnostic criteria for major depressive disorder. Participants will be randomly assigned to either the experimental group or the control group.

Intervention :

The experimental group will receive 12 weekly sessions of CBT, each lasting 60 minutes. The intervention will be delivered by licensed mental health professionals who have been trained in CBT. The control group will receive no intervention during the study period.

Data Collection:

Quantitative data will be collected through the use of standardized measures such as the Beck Depression Inventory-II (BDI-II) and the Generalized Anxiety Disorder-7 (GAD-7). Data will be collected at baseline, immediately after the intervention, and at a 3-month follow-up. Qualitative data will be collected through semi-structured interviews with a subset of participants from the experimental group. The interviews will be conducted at the end of the intervention period, and will explore participants’ experiences of receiving CBT.

Data Analysis:

Quantitative data will be analyzed using descriptive statistics, t-tests, and mixed-model analyses of variance (ANOVA) to assess the effectiveness of the intervention. Qualitative data will be analyzed using thematic analysis to identify common themes and patterns in participants’ experiences of receiving CBT.

Ethical Considerations:

This study will comply with ethical guidelines for research involving human subjects. Participants will provide informed consent before participating in the study, and their privacy and confidentiality will be protected throughout the study. Any adverse events or reactions will be reported and managed appropriately.

Data Management:

All data collected will be kept confidential and stored securely using password-protected databases. Identifying information will be removed from qualitative data transcripts to ensure participants’ anonymity.

Limitations:

One potential limitation of this study is that it only focuses on one type of psychotherapy, CBT, and may not generalize to other types of therapy or interventions. Another limitation is that the study will only include participants from community mental health clinics, which may not be representative of the general population.

Conclusion:

This research aims to investigate the effectiveness of CBT in reducing symptoms of depression in adults. By using a randomized controlled trial and a mixed-methods approach, the study will provide valuable insights into the mechanisms underlying the relationship between CBT and depression. The results of this study will have important implications for the development of effective treatments for depression in clinical settings.

How to Write Research Methodology

Writing a research methodology involves explaining the methods and techniques you used to conduct research, collect data, and analyze results. It’s an essential section of any research paper or thesis, as it helps readers understand the validity and reliability of your findings. Here are the steps to write a research methodology:

• Start by explaining your research question: Begin the methodology section by restating your research question and explaining why it’s important. This helps readers understand the purpose of your research and the rationale behind your methods.
• Describe your research design: Explain the overall approach you used to conduct research. This could be a qualitative or quantitative research design, experimental or non-experimental, case study or survey, etc. Discuss the advantages and limitations of the chosen design.
• Discuss your sample: Describe the participants or subjects you included in your study. Include details such as their demographics, sampling method, sample size, and any exclusion criteria used.
• Describe your data collection methods : Explain how you collected data from your participants. This could include surveys, interviews, observations, questionnaires, or experiments. Include details on how you obtained informed consent, how you administered the tools, and how you minimized the risk of bias.
• Explain your data analysis techniques: Describe the methods you used to analyze the data you collected. This could include statistical analysis, content analysis, thematic analysis, or discourse analysis. Explain how you dealt with missing data, outliers, and any other issues that arose during the analysis.
• Discuss the validity and reliability of your research : Explain how you ensured the validity and reliability of your study. This could include measures such as triangulation, member checking, peer review, or inter-coder reliability.
• Acknowledge any limitations of your research: Discuss any limitations of your study, including any potential threats to validity or generalizability. This helps readers understand the scope of your findings and how they might apply to other contexts.
• Provide a summary: End the methodology section by summarizing the methods and techniques you used to conduct your research. This provides a clear overview of your research methodology and helps readers understand the process you followed to arrive at your findings.

When to Write Research Methodology

Research methodology is typically written after the research proposal has been approved and before the actual research is conducted. It should be written prior to data collection and analysis, as it provides a clear roadmap for the research project.

The research methodology is an important section of any research paper or thesis, as it describes the methods and procedures that will be used to conduct the research. It should include details about the research design, data collection methods, data analysis techniques, and any ethical considerations.

The methodology should be written in a clear and concise manner, and it should be based on established research practices and standards. It is important to provide enough detail so that the reader can understand how the research was conducted and evaluate the validity of the results.

Applications of Research Methodology

Here are some of the applications of research methodology:

• To identify the research problem: Research methodology is used to identify the research problem, which is the first step in conducting any research.
• To design the research: Research methodology helps in designing the research by selecting the appropriate research method, research design, and sampling technique.
• To collect data: Research methodology provides a systematic approach to collect data from primary and secondary sources.
• To analyze data: Research methodology helps in analyzing the collected data using various statistical and non-statistical techniques.
• To test hypotheses: Research methodology provides a framework for testing hypotheses and drawing conclusions based on the analysis of data.
• To generalize findings: Research methodology helps in generalizing the findings of the research to the target population.
• To develop theories : Research methodology is used to develop new theories and modify existing theories based on the findings of the research.
• To evaluate programs and policies : Research methodology is used to evaluate the effectiveness of programs and policies by collecting data and analyzing it.
• To improve decision-making: Research methodology helps in making informed decisions by providing reliable and valid data.

Purpose of Research Methodology

Research methodology serves several important purposes, including:

• To guide the research process: Research methodology provides a systematic framework for conducting research. It helps researchers to plan their research, define their research questions, and select appropriate methods and techniques for collecting and analyzing data.
• To ensure research quality: Research methodology helps researchers to ensure that their research is rigorous, reliable, and valid. It provides guidelines for minimizing bias and error in data collection and analysis, and for ensuring that research findings are accurate and trustworthy.
• To replicate research: Research methodology provides a clear and detailed account of the research process, making it possible for other researchers to replicate the study and verify its findings.
• To advance knowledge: Research methodology enables researchers to generate new knowledge and to contribute to the body of knowledge in their field. It provides a means for testing hypotheses, exploring new ideas, and discovering new insights.
• To inform decision-making: Research methodology provides evidence-based information that can inform policy and decision-making in a variety of fields, including medicine, public health, education, and business.

Advantages of Research Methodology

Research methodology has several advantages that make it a valuable tool for conducting research in various fields. Here are some of the key advantages of research methodology:

• Systematic and structured approach : Research methodology provides a systematic and structured approach to conducting research, which ensures that the research is conducted in a rigorous and comprehensive manner.
• Objectivity : Research methodology aims to ensure objectivity in the research process, which means that the research findings are based on evidence and not influenced by personal bias or subjective opinions.
• Replicability : Research methodology ensures that research can be replicated by other researchers, which is essential for validating research findings and ensuring their accuracy.
• Reliability : Research methodology aims to ensure that the research findings are reliable, which means that they are consistent and can be depended upon.
• Validity : Research methodology ensures that the research findings are valid, which means that they accurately reflect the research question or hypothesis being tested.
• Efficiency : Research methodology provides a structured and efficient way of conducting research, which helps to save time and resources.
• Flexibility : Research methodology allows researchers to choose the most appropriate research methods and techniques based on the research question, data availability, and other relevant factors.
• Scope for innovation: Research methodology provides scope for innovation and creativity in designing research studies and developing new research techniques.

Research Methodology Vs Research Methods

About the author

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Research Methods – Types, Examples and Guide

Research Questions – Types, Examples and Writing...

Background of The Study – Examples and Writing...

Future Research – Thesis Guide

Problem Statement – Writing Guide, Examples and...

Context of the Study – Writing Guide and Examples

• Interlibrary Loan and Scan & Deliver
• Course Reserves
• Purchase Request
• Collection Development & Maintenance
• Current Negotiations
• Ask a Librarian
• Instructor Support
• Library How-To
• Research Guides
• Research Support
• Study Rooms
• Research Rooms
• Partner Spaces
• Loanable Equipment
• Print, Scan, Copy
• 3D Printers
• Poster Printing
• OSULP Leadership
• Strategic Plan

Scholarly Articles: How can I tell?

• Journal Information
• Literature Review
• Author and affiliation
• Introduction
• Specialized Vocabulary

Methodology

• Research sponsors
• Peer-review

The methodology section or methods section tells you how the author(s) went about doing their research. It should let you know a) what method they used to gather data (survey, interviews, experiments, etc.), why they chose this method, and what the limitations are to this method.

The methodology section should be detailed enough that another researcher could replicate the study described. When you read the methodology or methods section:

• What kind of research method did the authors use? Is it an appropriate method for the type of study they are conducting?
• How did the authors get their tests subjects? What criteria did they use?
• What are the contexts of the study that may have affected the results (e.g. environmental conditions, lab conditions, timing questions, etc.)
• Is the sample size representative of the larger population (i.e., was it big enough?)
• Are the data collection instruments and procedures likely to have measured all the important characteristics with reasonable accuracy?
• Does the data analysis appear to have been done with care, and were appropriate analytical techniques used? 

A good researcher will always let you know about the limitations of his or her research.

• << Previous: Specialized Vocabulary
• Next: Results >>
• Last Updated: Apr 15, 2024 3:26 PM
• URL: https://guides.library.oregonstate.edu/ScholarlyArticle

Contact Info

121 The Valley Library Corvallis OR 97331–4501

Phone: 541-737-3331

Services for Persons with Disabilities

In the Valley Library

• Oregon State University Press
• Special Collections and Archives Research Center
• Undergrad Research & Writing Studio
• Graduate Student Commons
• Tutoring Services
• Northwest Art Collection

Digital Projects

• Oregon Explorer
• Oregon Digital
• ScholarsArchive@OSU
• Digital Publishing Initiatives
• Atlas of the Pacific Northwest
• Marilyn Potts Guin Library  
• Cascades Campus Library
• McDowell Library of Vet Medicine

• USC Libraries
• Research Guides

Organizing Your Social Sciences Research Paper

• 6. The Methodology
• Purpose of Guide
• Design Flaws to Avoid
• Independent and Dependent Variables
• Glossary of Research Terms
• Reading Research Effectively
• Narrowing a Topic Idea
• Broadening a Topic Idea
• Extending the Timeliness of a Topic Idea
• Academic Writing Style
• Applying Critical Thinking
• Choosing a Title
• Making an Outline
• Paragraph Development
• Research Process Video Series
• Executive Summary
• The C.A.R.S. Model
• Background Information
• The Research Problem/Question
• Theoretical Framework
• Citation Tracking
• Content Alert Services
• Evaluating Sources
• Primary Sources
• Secondary Sources
• Tiertiary Sources
• Scholarly vs. Popular Publications
• Qualitative Methods
• Quantitative Methods
• Insiderness
• Using Non-Textual Elements
• Limitations of the Study
• Common Grammar Mistakes
• Writing Concisely
• Avoiding Plagiarism
• Footnotes or Endnotes?
• Further Readings
• Generative AI and Writing
• USC Libraries Tutorials and Other Guides
• Bibliography

The methods section describes actions taken to investigate a research problem and the rationale for the application of specific procedures or techniques used to identify, select, process, and analyze information applied to understanding the problem, thereby, allowing the reader to critically evaluate a study’s overall validity and reliability. The methodology section of a research paper answers two main questions: How was the data collected or generated? And, how was it analyzed? The writing should be direct and precise and always written in the past tense.

Kallet, Richard H. "How to Write the Methods Section of a Research Paper." Respiratory Care 49 (October 2004): 1229-1232.

Importance of a Good Methodology Section

You must explain how you obtained and analyzed your results for the following reasons:

• Readers need to know how the data was obtained because the method you chose affects the results and, by extension, how you interpreted their significance in the discussion section of your paper.
• Methodology is crucial for any branch of scholarship because an unreliable method produces unreliable results and, as a consequence, undermines the value of your analysis of the findings.
• In most cases, there are a variety of different methods you can choose to investigate a research problem. The methodology section of your paper should clearly articulate the reasons why you have chosen a particular procedure or technique.
• The reader wants to know that the data was collected or generated in a way that is consistent with accepted practice in the field of study. For example, if you are using a multiple choice questionnaire, readers need to know that it offered your respondents a reasonable range of answers to choose from.
• The method must be appropriate to fulfilling the overall aims of the study. For example, you need to ensure that you have a large enough sample size to be able to generalize and make recommendations based upon the findings.
• The methodology should discuss the problems that were anticipated and the steps you took to prevent them from occurring. For any problems that do arise, you must describe the ways in which they were minimized or why these problems do not impact in any meaningful way your interpretation of the findings.
• In the social and behavioral sciences, it is important to always provide sufficient information to allow other researchers to adopt or replicate your methodology. This information is particularly important when a new method has been developed or an innovative use of an existing method is utilized.

Bem, Daryl J. Writing the Empirical Journal Article. Psychology Writing Center. University of Washington; Denscombe, Martyn. The Good Research Guide: For Small-Scale Social Research Projects . 5th edition. Buckingham, UK: Open University Press, 2014; Lunenburg, Frederick C. Writing a Successful Thesis or Dissertation: Tips and Strategies for Students in the Social and Behavioral Sciences . Thousand Oaks, CA: Corwin Press, 2008.

Structure and Writing Style

I.  Groups of Research Methods

There are two main groups of research methods in the social sciences:

• The e mpirical-analytical group approaches the study of social sciences in a similar manner that researchers study the natural sciences . This type of research focuses on objective knowledge, research questions that can be answered yes or no, and operational definitions of variables to be measured. The empirical-analytical group employs deductive reasoning that uses existing theory as a foundation for formulating hypotheses that need to be tested. This approach is focused on explanation.
• The i nterpretative group of methods is focused on understanding phenomenon in a comprehensive, holistic way . Interpretive methods focus on analytically disclosing the meaning-making practices of human subjects [the why, how, or by what means people do what they do], while showing how those practices arrange so that it can be used to generate observable outcomes. Interpretive methods allow you to recognize your connection to the phenomena under investigation. However, the interpretative group requires careful examination of variables because it focuses more on subjective knowledge.

II.  Content

The introduction to your methodology section should begin by restating the research problem and underlying assumptions underpinning your study. This is followed by situating the methods you used to gather, analyze, and process information within the overall “tradition” of your field of study and within the particular research design you have chosen to study the problem. If the method you choose lies outside of the tradition of your field [i.e., your review of the literature demonstrates that the method is not commonly used], provide a justification for how your choice of methods specifically addresses the research problem in ways that have not been utilized in prior studies.

The remainder of your methodology section should describe the following:

• Decisions made in selecting the data you have analyzed or, in the case of qualitative research, the subjects and research setting you have examined,
• Tools and methods used to identify and collect information, and how you identified relevant variables,
• The ways in which you processed the data and the procedures you used to analyze that data, and
• The specific research tools or strategies that you utilized to study the underlying hypothesis and research questions.

In addition, an effectively written methodology section should:

• Introduce the overall methodological approach for investigating your research problem . Is your study qualitative or quantitative or a combination of both (mixed method)? Are you going to take a special approach, such as action research, or a more neutral stance?
• Indicate how the approach fits the overall research design . Your methods for gathering data should have a clear connection to your research problem. In other words, make sure that your methods will actually address the problem. One of the most common deficiencies found in research papers is that the proposed methodology is not suitable to achieving the stated objective of your paper.
• Describe the specific methods of data collection you are going to use , such as, surveys, interviews, questionnaires, observation, archival research. If you are analyzing existing data, such as a data set or archival documents, describe how it was originally created or gathered and by whom. Also be sure to explain how older data is still relevant to investigating the current research problem.
• Explain how you intend to analyze your results . Will you use statistical analysis? Will you use specific theoretical perspectives to help you analyze a text or explain observed behaviors? Describe how you plan to obtain an accurate assessment of relationships, patterns, trends, distributions, and possible contradictions found in the data.
• Provide background and a rationale for methodologies that are unfamiliar for your readers . Very often in the social sciences, research problems and the methods for investigating them require more explanation/rationale than widely accepted rules governing the natural and physical sciences. Be clear and concise in your explanation.
• Provide a justification for subject selection and sampling procedure . For instance, if you propose to conduct interviews, how do you intend to select the sample population? If you are analyzing texts, which texts have you chosen, and why? If you are using statistics, why is this set of data being used? If other data sources exist, explain why the data you chose is most appropriate to addressing the research problem.
• Provide a justification for case study selection . A common method of analyzing research problems in the social sciences is to analyze specific cases. These can be a person, place, event, phenomenon, or other type of subject of analysis that are either examined as a singular topic of in-depth investigation or multiple topics of investigation studied for the purpose of comparing or contrasting findings. In either method, you should explain why a case or cases were chosen and how they specifically relate to the research problem.
• Describe potential limitations . Are there any practical limitations that could affect your data collection? How will you attempt to control for potential confounding variables and errors? If your methodology may lead to problems you can anticipate, state this openly and show why pursuing this methodology outweighs the risk of these problems cropping up.

NOTE:   Once you have written all of the elements of the methods section, subsequent revisions should focus on how to present those elements as clearly and as logically as possibly. The description of how you prepared to study the research problem, how you gathered the data, and the protocol for analyzing the data should be organized chronologically. For clarity, when a large amount of detail must be presented, information should be presented in sub-sections according to topic. If necessary, consider using appendices for raw data.

ANOTHER NOTE: If you are conducting a qualitative analysis of a research problem , the methodology section generally requires a more elaborate description of the methods used as well as an explanation of the processes applied to gathering and analyzing of data than is generally required for studies using quantitative methods. Because you are the primary instrument for generating the data [e.g., through interviews or observations], the process for collecting that data has a significantly greater impact on producing the findings. Therefore, qualitative research requires a more detailed description of the methods used.

YET ANOTHER NOTE:   If your study involves interviews, observations, or other qualitative techniques involving human subjects , you may be required to obtain approval from the university's Office for the Protection of Research Subjects before beginning your research. This is not a common procedure for most undergraduate level student research assignments. However, i f your professor states you need approval, you must include a statement in your methods section that you received official endorsement and adequate informed consent from the office and that there was a clear assessment and minimization of risks to participants and to the university. This statement informs the reader that your study was conducted in an ethical and responsible manner. In some cases, the approval notice is included as an appendix to your paper.

III.  Problems to Avoid

Irrelevant Detail The methodology section of your paper should be thorough but concise. Do not provide any background information that does not directly help the reader understand why a particular method was chosen, how the data was gathered or obtained, and how the data was analyzed in relation to the research problem [note: analyzed, not interpreted! Save how you interpreted the findings for the discussion section]. With this in mind, the page length of your methods section will generally be less than any other section of your paper except the conclusion.

Unnecessary Explanation of Basic Procedures Remember that you are not writing a how-to guide about a particular method. You should make the assumption that readers possess a basic understanding of how to investigate the research problem on their own and, therefore, you do not have to go into great detail about specific methodological procedures. The focus should be on how you applied a method , not on the mechanics of doing a method. An exception to this rule is if you select an unconventional methodological approach; if this is the case, be sure to explain why this approach was chosen and how it enhances the overall process of discovery.

Problem Blindness It is almost a given that you will encounter problems when collecting or generating your data, or, gaps will exist in existing data or archival materials. Do not ignore these problems or pretend they did not occur. Often, documenting how you overcame obstacles can form an interesting part of the methodology. It demonstrates to the reader that you can provide a cogent rationale for the decisions you made to minimize the impact of any problems that arose.

Literature Review Just as the literature review section of your paper provides an overview of sources you have examined while researching a particular topic, the methodology section should cite any sources that informed your choice and application of a particular method [i.e., the choice of a survey should include any citations to the works you used to help construct the survey].

It’s More than Sources of Information! A description of a research study's method should not be confused with a description of the sources of information. Such a list of sources is useful in and of itself, especially if it is accompanied by an explanation about the selection and use of the sources. The description of the project's methodology complements a list of sources in that it sets forth the organization and interpretation of information emanating from those sources.

Azevedo, L.F. et al. "How to Write a Scientific Paper: Writing the Methods Section." Revista Portuguesa de Pneumologia 17 (2011): 232-238; Blair Lorrie. “Choosing a Methodology.” In Writing a Graduate Thesis or Dissertation , Teaching Writing Series. (Rotterdam: Sense Publishers 2016), pp. 49-72; Butin, Dan W. The Education Dissertation A Guide for Practitioner Scholars . Thousand Oaks, CA: Corwin, 2010; Carter, Susan. Structuring Your Research Thesis . New York: Palgrave Macmillan, 2012; Kallet, Richard H. “How to Write the Methods Section of a Research Paper.” Respiratory Care 49 (October 2004):1229-1232; Lunenburg, Frederick C. Writing a Successful Thesis or Dissertation: Tips and Strategies for Students in the Social and Behavioral Sciences . Thousand Oaks, CA: Corwin Press, 2008. Methods Section. The Writer’s Handbook. Writing Center. University of Wisconsin, Madison; Rudestam, Kjell Erik and Rae R. Newton. “The Method Chapter: Describing Your Research Plan.” In Surviving Your Dissertation: A Comprehensive Guide to Content and Process . (Thousand Oaks, Sage Publications, 2015), pp. 87-115; What is Interpretive Research. Institute of Public and International Affairs, University of Utah; Writing the Experimental Report: Methods, Results, and Discussion. The Writing Lab and The OWL. Purdue University; Methods and Materials. The Structure, Format, Content, and Style of a Journal-Style Scientific Paper. Department of Biology. Bates College.

Writing Tip

Statistical Designs and Tests? Do Not Fear Them!

Don't avoid using a quantitative approach to analyzing your research problem just because you fear the idea of applying statistical designs and tests. A qualitative approach, such as conducting interviews or content analysis of archival texts, can yield exciting new insights about a research problem, but it should not be undertaken simply because you have a disdain for running a simple regression. A well designed quantitative research study can often be accomplished in very clear and direct ways, whereas, a similar study of a qualitative nature usually requires considerable time to analyze large volumes of data and a tremendous burden to create new paths for analysis where previously no path associated with your research problem had existed.

To locate data and statistics, GO HERE .

Another Writing Tip

Knowing the Relationship Between Theories and Methods

There can be multiple meaning associated with the term "theories" and the term "methods" in social sciences research. A helpful way to delineate between them is to understand "theories" as representing different ways of characterizing the social world when you research it and "methods" as representing different ways of generating and analyzing data about that social world. Framed in this way, all empirical social sciences research involves theories and methods, whether they are stated explicitly or not. However, while theories and methods are often related, it is important that, as a researcher, you deliberately separate them in order to avoid your theories playing a disproportionate role in shaping what outcomes your chosen methods produce.

Introspectively engage in an ongoing dialectic between the application of theories and methods to help enable you to use the outcomes from your methods to interrogate and develop new theories, or ways of framing conceptually the research problem. This is how scholarship grows and branches out into new intellectual territory.

Reynolds, R. Larry. Ways of Knowing. Alternative Microeconomics . Part 1, Chapter 3. Boise State University; The Theory-Method Relationship. S-Cool Revision. United Kingdom.

Yet Another Writing Tip

Methods and the Methodology

Do not confuse the terms "methods" and "methodology." As Schneider notes, a method refers to the technical steps taken to do research . Descriptions of methods usually include defining and stating why you have chosen specific techniques to investigate a research problem, followed by an outline of the procedures you used to systematically select, gather, and process the data [remember to always save the interpretation of data for the discussion section of your paper].

The methodology refers to a discussion of the underlying reasoning why particular methods were used . This discussion includes describing the theoretical concepts that inform the choice of methods to be applied, placing the choice of methods within the more general nature of academic work, and reviewing its relevance to examining the research problem. The methodology section also includes a thorough review of the methods other scholars have used to study the topic.

Bryman, Alan. "Of Methods and Methodology." Qualitative Research in Organizations and Management: An International Journal 3 (2008): 159-168; Schneider, Florian. “What's in a Methodology: The Difference between Method, Methodology, and Theory…and How to Get the Balance Right?” PoliticsEastAsia.com. Chinese Department, University of Leiden, Netherlands.

• << Previous: Scholarly vs. Popular Publications
• Next: Qualitative Methods >>
• Last Updated: Aug 21, 2024 8:54 AM
• URL: https://libguides.usc.edu/writingguide

• Research Process
• Manuscript Preparation
• Manuscript Review
• Publication Process
• Publication Recognition
• Language Editing Services
• Translation Services

Choosing the Right Research Methodology: A Guide for Researchers

• 3 minute read
• 49.7K views

Table of Contents

Choosing an optimal research methodology is crucial for the success of any research project. The methodology you select will determine the type of data you collect, how you collect it, and how you analyse it. Understanding the different types of research methods available along with their strengths and weaknesses, is thus imperative to make an informed decision.

Understanding different research methods:

There are several research methods available depending on the type of study you are conducting, i.e., whether it is laboratory-based, clinical, epidemiological, or survey based . Some common methodologies include qualitative research, quantitative research, experimental research, survey-based research, and action research. Each method can be opted for and modified, depending on the type of research hypotheses and objectives.

Qualitative vs quantitative research:

When deciding on a research methodology, one of the key factors to consider is whether your research will be qualitative or quantitative. Qualitative research is used to understand people’s experiences, concepts, thoughts, or behaviours . Quantitative research, on the contrary, deals with numbers, graphs, and charts, and is used to test or confirm hypotheses, assumptions, and theories. 

Qualitative research methodology:

Qualitative research is often used to examine issues that are not well understood, and to gather additional insights on these topics. Qualitative research methods include open-ended survey questions, observations of behaviours described through words, and reviews of literature that has explored similar theories and ideas. These methods are used to understand how language is used in real-world situations, identify common themes or overarching ideas, and describe and interpret various texts. Data analysis for qualitative research typically includes discourse analysis, thematic analysis, and textual analysis. 

Quantitative research methodology:

The goal of quantitative research is to test hypotheses, confirm assumptions and theories, and determine cause-and-effect relationships. Quantitative research methods include experiments, close-ended survey questions, and countable and numbered observations. Data analysis for quantitative research relies heavily on statistical methods.

Analysing qualitative vs quantitative data:

The methods used for data analysis also differ for qualitative and quantitative research. As mentioned earlier, quantitative data is generally analysed using statistical methods and does not leave much room for speculation. It is more structured and follows a predetermined plan. In quantitative research, the researcher starts with a hypothesis and uses statistical methods to test it. Contrarily, methods used for qualitative data analysis can identify patterns and themes within the data, rather than provide statistical measures of the data. It is an iterative process, where the researcher goes back and forth trying to gauge the larger implications of the data through different perspectives and revising the analysis if required.

When to use qualitative vs quantitative research:

The choice between qualitative and quantitative research will depend on the gap that the research project aims to address, and specific objectives of the study. If the goal is to establish facts about a subject or topic, quantitative research is an appropriate choice. However, if the goal is to understand people’s experiences or perspectives, qualitative research may be more suitable. 

Conclusion:

In conclusion, an understanding of the different research methods available, their applicability, advantages, and disadvantages is essential for making an informed decision on the best methodology for your project. If you need any additional guidance on which research methodology to opt for, you can head over to Elsevier Author Services (EAS). EAS experts will guide you throughout the process and help you choose the perfect methodology for your research goals.

Why is data validation important in research?

When Data Speak, Listen: Importance of Data Collection and Analysis Methods

You may also like.

Descriptive Research Design and Its Myriad Uses

Five Common Mistakes to Avoid When Writing a Biomedical Research Paper

Making Technical Writing in Environmental Engineering Accessible

To Err is Not Human: The Dangers of AI-assisted Academic Writing

Writing a good review article

Scholarly Sources: What are They and Where can You Find Them?

Input your search keywords and press Enter.

How To Choose Your Research Methodology

Qualitative vs quantitative vs mixed methods.

By: Derek Jansen (MBA). Expert Reviewed By: Dr Eunice Rautenbach | June 2021

Without a doubt, one of the most common questions we receive at Grad Coach is “ How do I choose the right methodology for my research? ”. It’s easy to see why – with so many options on the research design table, it’s easy to get intimidated, especially with all the complex lingo!

In this post, we’ll explain the three overarching types of research – qualitative, quantitative and mixed methods – and how you can go about choosing the best methodological approach for your research.

Overview: Choosing Your Methodology

Understanding the options – Qualitative research – Quantitative research – Mixed methods-based research

Choosing a research methodology – Nature of the research – Research area norms – Practicalities

1. Understanding the options

Before we jump into the question of how to choose a research methodology, it’s useful to take a step back to understand the three overarching types of research – qualitative , quantitative and mixed methods -based research. Each of these options takes a different methodological approach.

Qualitative research utilises data that is not numbers-based. In other words, qualitative research focuses on words , descriptions , concepts or ideas – while quantitative research makes use of numbers and statistics. Qualitative research investigates the “softer side” of things to explore and describe, while quantitative research focuses on the “hard numbers”, to measure differences between variables and the relationships between them.

Importantly, qualitative research methods are typically used to explore and gain a deeper understanding of the complexity of a situation – to draw a rich picture . In contrast to this, quantitative methods are usually used to confirm or test hypotheses . In other words, they have distinctly different purposes. The table below highlights a few of the key differences between qualitative and quantitative research – you can learn more about the differences here.

• Uses an inductive approach
• Is used to build theories
• Takes a subjective approach
• Adopts an open and flexible approach
• The researcher is close to the respondents
• Interviews and focus groups are oftentimes used to collect word-based data.
• Generally, draws on small sample sizes
• Uses qualitative data analysis techniques (e.g. content analysis , thematic analysis , etc)
• Uses a deductive approach
• Is used to test theories
• Takes an objective approach
• Adopts a closed, highly planned approach
• The research is disconnected from respondents
• Surveys or laboratory equipment are often used to collect number-based data.
• Generally, requires large sample sizes
• Uses statistical analysis techniques to make sense of the data

Mixed methods -based research, as you’d expect, attempts to bring these two types of research together, drawing on both qualitative and quantitative data. Quite often, mixed methods-based studies will use qualitative research to explore a situation and develop a potential model of understanding (this is called a conceptual framework), and then go on to use quantitative methods to test that model empirically.

In other words, while qualitative and quantitative methods (and the philosophies that underpin them) are completely different, they are not at odds with each other. It’s not a competition of qualitative vs quantitative. On the contrary, they can be used together to develop a high-quality piece of research. Of course, this is easier said than done, so we usually recommend that first-time researchers stick to a single approach , unless the nature of their study truly warrants a mixed-methods approach.

The key takeaway here, and the reason we started by looking at the three options, is that it’s important to understand that each methodological approach has a different purpose – for example, to explore and understand situations (qualitative), to test and measure (quantitative) or to do both. They’re not simply alternative tools for the same job. 

Right – now that we’ve got that out of the way, let’s look at how you can go about choosing the right methodology for your research.

2. How to choose a research methodology

To choose the right research methodology for your dissertation or thesis, you need to consider three important factors . Based on these three factors, you can decide on your overarching approach – qualitative, quantitative or mixed methods. Once you’ve made that decision, you can flesh out the finer details of your methodology, such as the sampling , data collection methods and analysis techniques (we discuss these separately in other posts ).

The three factors you need to consider are:

• The nature of your research aims, objectives and research questions
• The methodological approaches taken in the existing literature
• Practicalities and constraints

Let’s take a look at each of these.

Factor #1: The nature of your research

As I mentioned earlier, each type of research (and therefore, research methodology), whether qualitative, quantitative or mixed, has a different purpose and helps solve a different type of question. So, it’s logical that the key deciding factor in terms of which research methodology you adopt is the nature of your research aims, objectives and research questions .

But, what types of research exist?

Broadly speaking, research can fall into one of three categories:

• Exploratory – getting a better understanding of an issue and potentially developing a theory regarding it
• Confirmatory – confirming a potential theory or hypothesis by testing it empirically
• A mix of both – building a potential theory or hypothesis and then testing it

As a rule of thumb, exploratory research tends to adopt a qualitative approach , whereas confirmatory research tends to use quantitative methods . This isn’t set in stone, but it’s a very useful heuristic. Naturally then, research that combines a mix of both, or is seeking to develop a theory from the ground up and then test that theory, would utilize a mixed-methods approach.

Let’s look at an example in action.

If your research aims were to understand the perspectives of war veterans regarding certain political matters, you’d likely adopt a qualitative methodology, making use of interviews to collect data and one or more qualitative data analysis methods to make sense of the data.

If, on the other hand, your research aims involved testing a set of hypotheses regarding the link between political leaning and income levels, you’d likely adopt a quantitative methodology, using numbers-based data from a survey to measure the links between variables and/or constructs .

So, the first (and most important thing) thing you need to consider when deciding which methodological approach to use for your research project is the nature of your research aims , objectives and research questions. Specifically, you need to assess whether your research leans in an exploratory or confirmatory direction or involves a mix of both.

The importance of achieving solid alignment between these three factors and your methodology can’t be overstated. If they’re misaligned, you’re going to be forcing a square peg into a round hole. In other words, you’ll be using the wrong tool for the job, and your research will become a disjointed mess.

If your research is a mix of both exploratory and confirmatory, but you have a tight word count limit, you may need to consider trimming down the scope a little and focusing on one or the other. One methodology executed well has a far better chance of earning marks than a poorly executed mixed methods approach. So, don’t try to be a hero, unless there is a very strong underpinning logic.

Need a helping hand?

Factor #2: The disciplinary norms

Choosing the right methodology for your research also involves looking at the approaches used by other researchers in the field, and studies with similar research aims and objectives to yours. Oftentimes, within a discipline, there is a common methodological approach (or set of approaches) used in studies. While this doesn’t mean you should follow the herd “just because”, you should at least consider these approaches and evaluate their merit within your context.

A major benefit of reviewing the research methodologies used by similar studies in your field is that you can often piggyback on the data collection techniques that other (more experienced) researchers have developed. For example, if you’re undertaking a quantitative study, you can often find tried and tested survey scales with high Cronbach’s alphas. These are usually included in the appendices of journal articles, so you don’t even have to contact the original authors. By using these, you’ll save a lot of time and ensure that your study stands on the proverbial “shoulders of giants” by using high-quality measurement instruments .

Of course, when reviewing existing literature, keep point #1 front of mind. In other words, your methodology needs to align with your research aims, objectives and questions. Don’t fall into the trap of adopting the methodological “norm” of other studies just because it’s popular. Only adopt that which is relevant to your research.

Factor #3: Practicalities

When choosing a research methodology, there will always be a tension between doing what’s theoretically best (i.e., the most scientifically rigorous research design ) and doing what’s practical , given your constraints . This is the nature of doing research and there are always trade-offs, as with anything else.

But what constraints, you ask?

When you’re evaluating your methodological options, you need to consider the following constraints:

• Data access
• Equipment and software
• Your knowledge and skills

Let’s look at each of these.

Constraint #1: Data access

The first practical constraint you need to consider is your access to data . If you’re going to be undertaking primary research , you need to think critically about the sample of respondents you realistically have access to. For example, if you plan to use in-person interviews , you need to ask yourself how many people you’ll need to interview, whether they’ll be agreeable to being interviewed, where they’re located, and so on.

If you’re wanting to undertake a quantitative approach using surveys to collect data, you’ll need to consider how many responses you’ll require to achieve statistically significant results. For many statistical tests, a sample of a few hundred respondents is typically needed to develop convincing conclusions.

So, think carefully about what data you’ll need access to, how much data you’ll need and how you’ll collect it. The last thing you want is to spend a huge amount of time on your research only to find that you can’t get access to the required data.

Constraint #2: Time

The next constraint is time. If you’re undertaking research as part of a PhD, you may have a fairly open-ended time limit, but this is unlikely to be the case for undergrad and Masters-level projects. So, pay attention to your timeline, as the data collection and analysis components of different methodologies have a major impact on time requirements . Also, keep in mind that these stages of the research often take a lot longer than originally anticipated.

Another practical implication of time limits is that it will directly impact which time horizon you can use – i.e. longitudinal vs cross-sectional . For example, if you’ve got a 6-month limit for your entire research project, it’s quite unlikely that you’ll be able to adopt a longitudinal time horizon. 

Constraint #3: Money

As with so many things, money is another important constraint you’ll need to consider when deciding on your research methodology. While some research designs will cost near zero to execute, others may require a substantial budget .

Some of the costs that may arise include:

• Software costs – e.g. survey hosting services, analysis software, etc.
• Promotion costs – e.g. advertising a survey to attract respondents
• Incentive costs – e.g. providing a prize or cash payment incentive to attract respondents
• Equipment rental costs – e.g. recording equipment, lab equipment, etc.
• Travel costs
• Food & beverages

These are just a handful of costs that can creep into your research budget. Like most projects, the actual costs tend to be higher than the estimates, so be sure to err on the conservative side and expect the unexpected. It’s critically important that you’re honest with yourself about these costs, or you could end up getting stuck midway through your project because you’ve run out of money.

Constraint #4: Equipment & software

Another practical consideration is the hardware and/or software you’ll need in order to undertake your research. Of course, this variable will depend on the type of data you’re collecting and analysing. For example, you may need lab equipment to analyse substances, or you may need specific analysis software to analyse statistical data. So, be sure to think about what hardware and/or software you’ll need for each potential methodological approach, and whether you have access to these.

Constraint #5: Your knowledge and skillset

The final practical constraint is a big one. Naturally, the research process involves a lot of learning and development along the way, so you will accrue knowledge and skills as you progress. However, when considering your methodological options, you should still consider your current position on the ladder.

Some of the questions you should ask yourself are:

• Am I more of a “numbers person” or a “words person”?
• How much do I know about the analysis methods I’ll potentially use (e.g. statistical analysis)?
• How much do I know about the software and/or hardware that I’ll potentially use?
• How excited am I to learn new research skills and gain new knowledge?
• How much time do I have to learn the things I need to learn?

Answering these questions honestly will provide you with another set of criteria against which you can evaluate the research methodology options you’ve shortlisted.

So, as you can see, there is a wide range of practicalities and constraints that you need to take into account when you’re deciding on a research methodology. These practicalities create a tension between the “ideal” methodology and the methodology that you can realistically pull off. This is perfectly normal, and it’s your job to find the option that presents the best set of trade-offs.

Recap: Choosing a methodology

In this post, we’ve discussed how to go about choosing a research methodology. The three major deciding factors we looked at were:

• Exploratory
• Confirmatory
• Combination
• Research area norms
• Hardware and software
• Your knowledge and skillset

If you have any questions, feel free to leave a comment below. If you’d like a helping hand with your research methodology, check out our 1-on-1 research coaching service , or book a free consultation with a friendly Grad Coach.

Psst... there’s more!

This post was based on one of our popular Research Bootcamps . If you're working on a research project, you'll definitely want to check this out ...

Very useful and informative especially for beginners

Nice article! I’m a beginner in the field of cybersecurity research. I am a Telecom and Network Engineer and Also aiming for PhD scholarship.

I find the article very informative especially for my decitation it has been helpful and an eye opener.

Hi I am Anna ,

I am a PHD candidate in the area of cyber security, maybe we can link up

The Examples shows by you, for sure they are really direct me and others to knows and practices the Research Design and prepration.

I found the post very informative and practical.

I struggle so much with designs of the research for sure!

I’m the process of constructing my research design and I want to know if the data analysis I plan to present in my thesis defense proposal possibly change especially after I gathered the data already.

Thank you so much this site is such a life saver. How I wish 1-1 coaching is available in our country but sadly it’s not.

Submit a Comment Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

• Print Friendly

• Open access
• Published: 07 September 2020

A tutorial on methodological studies: the what, when, how and why

• Lawrence Mbuagbaw   ORCID: orcid.org/0000-0001-5855-5461 1 , 2 , 3 ,
• Daeria O. Lawson 1 ,
• Livia Puljak 4 ,
• David B. Allison 5 &
• Lehana Thabane 1 , 2 , 6 , 7 , 8  

BMC Medical Research Methodology volume  20 , Article number:  226 ( 2020 ) Cite this article

42k Accesses

58 Citations

61 Altmetric

Metrics details

Methodological studies – studies that evaluate the design, analysis or reporting of other research-related reports – play an important role in health research. They help to highlight issues in the conduct of research with the aim of improving health research methodology, and ultimately reducing research waste.

We provide an overview of some of the key aspects of methodological studies such as what they are, and when, how and why they are done. We adopt a “frequently asked questions” format to facilitate reading this paper and provide multiple examples to help guide researchers interested in conducting methodological studies. Some of the topics addressed include: is it necessary to publish a study protocol? How to select relevant research reports and databases for a methodological study? What approaches to data extraction and statistical analysis should be considered when conducting a methodological study? What are potential threats to validity and is there a way to appraise the quality of methodological studies?

Appropriate reflection and application of basic principles of epidemiology and biostatistics are required in the design and analysis of methodological studies. This paper provides an introduction for further discussion about the conduct of methodological studies.

Peer Review reports

The field of meta-research (or research-on-research) has proliferated in recent years in response to issues with research quality and conduct [ 1 , 2 , 3 ]. As the name suggests, this field targets issues with research design, conduct, analysis and reporting. Various types of research reports are often examined as the unit of analysis in these studies (e.g. abstracts, full manuscripts, trial registry entries). Like many other novel fields of research, meta-research has seen a proliferation of use before the development of reporting guidance. For example, this was the case with randomized trials for which risk of bias tools and reporting guidelines were only developed much later – after many trials had been published and noted to have limitations [ 4 , 5 ]; and for systematic reviews as well [ 6 , 7 , 8 ]. However, in the absence of formal guidance, studies that report on research differ substantially in how they are named, conducted and reported [ 9 , 10 ]. This creates challenges in identifying, summarizing and comparing them. In this tutorial paper, we will use the term methodological study to refer to any study that reports on the design, conduct, analysis or reporting of primary or secondary research-related reports (such as trial registry entries and conference abstracts).

In the past 10 years, there has been an increase in the use of terms related to methodological studies (based on records retrieved with a keyword search [in the title and abstract] for “methodological review” and “meta-epidemiological study” in PubMed up to December 2019), suggesting that these studies may be appearing more frequently in the literature. See Fig.  1 .

Trends in the number studies that mention “methodological review” or “meta-

epidemiological study” in PubMed.

The methods used in many methodological studies have been borrowed from systematic and scoping reviews. This practice has influenced the direction of the field, with many methodological studies including searches of electronic databases, screening of records, duplicate data extraction and assessments of risk of bias in the included studies. However, the research questions posed in methodological studies do not always require the approaches listed above, and guidance is needed on when and how to apply these methods to a methodological study. Even though methodological studies can be conducted on qualitative or mixed methods research, this paper focuses on and draws examples exclusively from quantitative research.

The objectives of this paper are to provide some insights on how to conduct methodological studies so that there is greater consistency between the research questions posed, and the design, analysis and reporting of findings. We provide multiple examples to illustrate concepts and a proposed framework for categorizing methodological studies in quantitative research.

What is a methodological study?

Any study that describes or analyzes methods (design, conduct, analysis or reporting) in published (or unpublished) literature is a methodological study. Consequently, the scope of methodological studies is quite extensive and includes, but is not limited to, topics as diverse as: research question formulation [ 11 ]; adherence to reporting guidelines [ 12 , 13 , 14 ] and consistency in reporting [ 15 ]; approaches to study analysis [ 16 ]; investigating the credibility of analyses [ 17 ]; and studies that synthesize these methodological studies [ 18 ]. While the nomenclature of methodological studies is not uniform, the intents and purposes of these studies remain fairly consistent – to describe or analyze methods in primary or secondary studies. As such, methodological studies may also be classified as a subtype of observational studies.

Parallel to this are experimental studies that compare different methods. Even though they play an important role in informing optimal research methods, experimental methodological studies are beyond the scope of this paper. Examples of such studies include the randomized trials by Buscemi et al., comparing single data extraction to double data extraction [ 19 ], and Carrasco-Labra et al., comparing approaches to presenting findings in Grading of Recommendations, Assessment, Development and Evaluations (GRADE) summary of findings tables [ 20 ]. In these studies, the unit of analysis is the person or groups of individuals applying the methods. We also direct readers to the Studies Within a Trial (SWAT) and Studies Within a Review (SWAR) programme operated through the Hub for Trials Methodology Research, for further reading as a potential useful resource for these types of experimental studies [ 21 ]. Lastly, this paper is not meant to inform the conduct of research using computational simulation and mathematical modeling for which some guidance already exists [ 22 ], or studies on the development of methods using consensus-based approaches.

When should we conduct a methodological study?

Methodological studies occupy a unique niche in health research that allows them to inform methodological advances. Methodological studies should also be conducted as pre-cursors to reporting guideline development, as they provide an opportunity to understand current practices, and help to identify the need for guidance and gaps in methodological or reporting quality. For example, the development of the popular Preferred Reporting Items of Systematic reviews and Meta-Analyses (PRISMA) guidelines were preceded by methodological studies identifying poor reporting practices [ 23 , 24 ]. In these instances, after the reporting guidelines are published, methodological studies can also be used to monitor uptake of the guidelines.

These studies can also be conducted to inform the state of the art for design, analysis and reporting practices across different types of health research fields, with the aim of improving research practices, and preventing or reducing research waste. For example, Samaan et al. conducted a scoping review of adherence to different reporting guidelines in health care literature [ 18 ]. Methodological studies can also be used to determine the factors associated with reporting practices. For example, Abbade et al. investigated journal characteristics associated with the use of the Participants, Intervention, Comparison, Outcome, Timeframe (PICOT) format in framing research questions in trials of venous ulcer disease [ 11 ].

How often are methodological studies conducted?

There is no clear answer to this question. Based on a search of PubMed, the use of related terms (“methodological review” and “meta-epidemiological study”) – and therefore, the number of methodological studies – is on the rise. However, many other terms are used to describe methodological studies. There are also many studies that explore design, conduct, analysis or reporting of research reports, but that do not use any specific terms to describe or label their study design in terms of “methodology”. This diversity in nomenclature makes a census of methodological studies elusive. Appropriate terminology and key words for methodological studies are needed to facilitate improved accessibility for end-users.

Why do we conduct methodological studies?

Methodological studies provide information on the design, conduct, analysis or reporting of primary and secondary research and can be used to appraise quality, quantity, completeness, accuracy and consistency of health research. These issues can be explored in specific fields, journals, databases, geographical regions and time periods. For example, Areia et al. explored the quality of reporting of endoscopic diagnostic studies in gastroenterology [ 25 ]; Knol et al. investigated the reporting of p -values in baseline tables in randomized trial published in high impact journals [ 26 ]; Chen et al. describe adherence to the Consolidated Standards of Reporting Trials (CONSORT) statement in Chinese Journals [ 27 ]; and Hopewell et al. describe the effect of editors’ implementation of CONSORT guidelines on reporting of abstracts over time [ 28 ]. Methodological studies provide useful information to researchers, clinicians, editors, publishers and users of health literature. As a result, these studies have been at the cornerstone of important methodological developments in the past two decades and have informed the development of many health research guidelines including the highly cited CONSORT statement [ 5 ].

Where can we find methodological studies?

Methodological studies can be found in most common biomedical bibliographic databases (e.g. Embase, MEDLINE, PubMed, Web of Science). However, the biggest caveat is that methodological studies are hard to identify in the literature due to the wide variety of names used and the lack of comprehensive databases dedicated to them. A handful can be found in the Cochrane Library as “Cochrane Methodology Reviews”, but these studies only cover methodological issues related to systematic reviews. Previous attempts to catalogue all empirical studies of methods used in reviews were abandoned 10 years ago [ 29 ]. In other databases, a variety of search terms may be applied with different levels of sensitivity and specificity.

Some frequently asked questions about methodological studies

In this section, we have outlined responses to questions that might help inform the conduct of methodological studies.

Q: How should I select research reports for my methodological study?

A: Selection of research reports for a methodological study depends on the research question and eligibility criteria. Once a clear research question is set and the nature of literature one desires to review is known, one can then begin the selection process. Selection may begin with a broad search, especially if the eligibility criteria are not apparent. For example, a methodological study of Cochrane Reviews of HIV would not require a complex search as all eligible studies can easily be retrieved from the Cochrane Library after checking a few boxes [ 30 ]. On the other hand, a methodological study of subgroup analyses in trials of gastrointestinal oncology would require a search to find such trials, and further screening to identify trials that conducted a subgroup analysis [ 31 ].

The strategies used for identifying participants in observational studies can apply here. One may use a systematic search to identify all eligible studies. If the number of eligible studies is unmanageable, a random sample of articles can be expected to provide comparable results if it is sufficiently large [ 32 ]. For example, Wilson et al. used a random sample of trials from the Cochrane Stroke Group’s Trial Register to investigate completeness of reporting [ 33 ]. It is possible that a simple random sample would lead to underrepresentation of units (i.e. research reports) that are smaller in number. This is relevant if the investigators wish to compare multiple groups but have too few units in one group. In this case a stratified sample would help to create equal groups. For example, in a methodological study comparing Cochrane and non-Cochrane reviews, Kahale et al. drew random samples from both groups [ 34 ]. Alternatively, systematic or purposeful sampling strategies can be used and we encourage researchers to justify their selected approaches based on the study objective.

Q: How many databases should I search?

A: The number of databases one should search would depend on the approach to sampling, which can include targeting the entire “population” of interest or a sample of that population. If you are interested in including the entire target population for your research question, or drawing a random or systematic sample from it, then a comprehensive and exhaustive search for relevant articles is required. In this case, we recommend using systematic approaches for searching electronic databases (i.e. at least 2 databases with a replicable and time stamped search strategy). The results of your search will constitute a sampling frame from which eligible studies can be drawn.

Alternatively, if your approach to sampling is purposeful, then we recommend targeting the database(s) or data sources (e.g. journals, registries) that include the information you need. For example, if you are conducting a methodological study of high impact journals in plastic surgery and they are all indexed in PubMed, you likely do not need to search any other databases. You may also have a comprehensive list of all journals of interest and can approach your search using the journal names in your database search (or by accessing the journal archives directly from the journal’s website). Even though one could also search journals’ web pages directly, using a database such as PubMed has multiple advantages, such as the use of filters, so the search can be narrowed down to a certain period, or study types of interest. Furthermore, individual journals’ web sites may have different search functionalities, which do not necessarily yield a consistent output.

Q: Should I publish a protocol for my methodological study?

A: A protocol is a description of intended research methods. Currently, only protocols for clinical trials require registration [ 35 ]. Protocols for systematic reviews are encouraged but no formal recommendation exists. The scientific community welcomes the publication of protocols because they help protect against selective outcome reporting, the use of post hoc methodologies to embellish results, and to help avoid duplication of efforts [ 36 ]. While the latter two risks exist in methodological research, the negative consequences may be substantially less than for clinical outcomes. In a sample of 31 methodological studies, 7 (22.6%) referenced a published protocol [ 9 ]. In the Cochrane Library, there are 15 protocols for methodological reviews (21 July 2020). This suggests that publishing protocols for methodological studies is not uncommon.

Authors can consider publishing their study protocol in a scholarly journal as a manuscript. Advantages of such publication include obtaining peer-review feedback about the planned study, and easy retrieval by searching databases such as PubMed. The disadvantages in trying to publish protocols includes delays associated with manuscript handling and peer review, as well as costs, as few journals publish study protocols, and those journals mostly charge article-processing fees [ 37 ]. Authors who would like to make their protocol publicly available without publishing it in scholarly journals, could deposit their study protocols in publicly available repositories, such as the Open Science Framework ( https://osf.io/ ).

Q: How to appraise the quality of a methodological study?

A: To date, there is no published tool for appraising the risk of bias in a methodological study, but in principle, a methodological study could be considered as a type of observational study. Therefore, during conduct or appraisal, care should be taken to avoid the biases common in observational studies [ 38 ]. These biases include selection bias, comparability of groups, and ascertainment of exposure or outcome. In other words, to generate a representative sample, a comprehensive reproducible search may be necessary to build a sampling frame. Additionally, random sampling may be necessary to ensure that all the included research reports have the same probability of being selected, and the screening and selection processes should be transparent and reproducible. To ensure that the groups compared are similar in all characteristics, matching, random sampling or stratified sampling can be used. Statistical adjustments for between-group differences can also be applied at the analysis stage. Finally, duplicate data extraction can reduce errors in assessment of exposures or outcomes.

Q: Should I justify a sample size?

A: In all instances where one is not using the target population (i.e. the group to which inferences from the research report are directed) [ 39 ], a sample size justification is good practice. The sample size justification may take the form of a description of what is expected to be achieved with the number of articles selected, or a formal sample size estimation that outlines the number of articles required to answer the research question with a certain precision and power. Sample size justifications in methodological studies are reasonable in the following instances:

Comparing two groups

Determining a proportion, mean or another quantifier

Determining factors associated with an outcome using regression-based analyses

For example, El Dib et al. computed a sample size requirement for a methodological study of diagnostic strategies in randomized trials, based on a confidence interval approach [ 40 ].

Q: What should I call my study?

A: Other terms which have been used to describe/label methodological studies include “ methodological review ”, “methodological survey” , “meta-epidemiological study” , “systematic review” , “systematic survey”, “meta-research”, “research-on-research” and many others. We recommend that the study nomenclature be clear, unambiguous, informative and allow for appropriate indexing. Methodological study nomenclature that should be avoided includes “ systematic review” – as this will likely be confused with a systematic review of a clinical question. “ Systematic survey” may also lead to confusion about whether the survey was systematic (i.e. using a preplanned methodology) or a survey using “ systematic” sampling (i.e. a sampling approach using specific intervals to determine who is selected) [ 32 ]. Any of the above meanings of the words “ systematic” may be true for methodological studies and could be potentially misleading. “ Meta-epidemiological study” is ideal for indexing, but not very informative as it describes an entire field. The term “ review ” may point towards an appraisal or “review” of the design, conduct, analysis or reporting (or methodological components) of the targeted research reports, yet it has also been used to describe narrative reviews [ 41 , 42 ]. The term “ survey ” is also in line with the approaches used in many methodological studies [ 9 ], and would be indicative of the sampling procedures of this study design. However, in the absence of guidelines on nomenclature, the term “ methodological study ” is broad enough to capture most of the scenarios of such studies.

Q: Should I account for clustering in my methodological study?

A: Data from methodological studies are often clustered. For example, articles coming from a specific source may have different reporting standards (e.g. the Cochrane Library). Articles within the same journal may be similar due to editorial practices and policies, reporting requirements and endorsement of guidelines. There is emerging evidence that these are real concerns that should be accounted for in analyses [ 43 ]. Some cluster variables are described in the section: “ What variables are relevant to methodological studies?”

A variety of modelling approaches can be used to account for correlated data, including the use of marginal, fixed or mixed effects regression models with appropriate computation of standard errors [ 44 ]. For example, Kosa et al. used generalized estimation equations to account for correlation of articles within journals [ 15 ]. Not accounting for clustering could lead to incorrect p -values, unduly narrow confidence intervals, and biased estimates [ 45 ].

Q: Should I extract data in duplicate?

A: Yes. Duplicate data extraction takes more time but results in less errors [ 19 ]. Data extraction errors in turn affect the effect estimate [ 46 ], and therefore should be mitigated. Duplicate data extraction should be considered in the absence of other approaches to minimize extraction errors. However, much like systematic reviews, this area will likely see rapid new advances with machine learning and natural language processing technologies to support researchers with screening and data extraction [ 47 , 48 ]. However, experience plays an important role in the quality of extracted data and inexperienced extractors should be paired with experienced extractors [ 46 , 49 ].

Q: Should I assess the risk of bias of research reports included in my methodological study?

A : Risk of bias is most useful in determining the certainty that can be placed in the effect measure from a study. In methodological studies, risk of bias may not serve the purpose of determining the trustworthiness of results, as effect measures are often not the primary goal of methodological studies. Determining risk of bias in methodological studies is likely a practice borrowed from systematic review methodology, but whose intrinsic value is not obvious in methodological studies. When it is part of the research question, investigators often focus on one aspect of risk of bias. For example, Speich investigated how blinding was reported in surgical trials [ 50 ], and Abraha et al., investigated the application of intention-to-treat analyses in systematic reviews and trials [ 51 ].

Q: What variables are relevant to methodological studies?

A: There is empirical evidence that certain variables may inform the findings in a methodological study. We outline some of these and provide a brief overview below:

Country: Countries and regions differ in their research cultures, and the resources available to conduct research. Therefore, it is reasonable to believe that there may be differences in methodological features across countries. Methodological studies have reported loco-regional differences in reporting quality [ 52 , 53 ]. This may also be related to challenges non-English speakers face in publishing papers in English.

Authors’ expertise: The inclusion of authors with expertise in research methodology, biostatistics, and scientific writing is likely to influence the end-product. Oltean et al. found that among randomized trials in orthopaedic surgery, the use of analyses that accounted for clustering was more likely when specialists (e.g. statistician, epidemiologist or clinical trials methodologist) were included on the study team [ 54 ]. Fleming et al. found that including methodologists in the review team was associated with appropriate use of reporting guidelines [ 55 ].

Source of funding and conflicts of interest: Some studies have found that funded studies report better [ 56 , 57 ], while others do not [ 53 , 58 ]. The presence of funding would indicate the availability of resources deployed to ensure optimal design, conduct, analysis and reporting. However, the source of funding may introduce conflicts of interest and warrant assessment. For example, Kaiser et al. investigated the effect of industry funding on obesity or nutrition randomized trials and found that reporting quality was similar [ 59 ]. Thomas et al. looked at reporting quality of long-term weight loss trials and found that industry funded studies were better [ 60 ]. Kan et al. examined the association between industry funding and “positive trials” (trials reporting a significant intervention effect) and found that industry funding was highly predictive of a positive trial [ 61 ]. This finding is similar to that of a recent Cochrane Methodology Review by Hansen et al. [ 62 ]

Journal characteristics: Certain journals’ characteristics may influence the study design, analysis or reporting. Characteristics such as journal endorsement of guidelines [ 63 , 64 ], and Journal Impact Factor (JIF) have been shown to be associated with reporting [ 63 , 65 , 66 , 67 ].

Study size (sample size/number of sites): Some studies have shown that reporting is better in larger studies [ 53 , 56 , 58 ].

Year of publication: It is reasonable to assume that design, conduct, analysis and reporting of research will change over time. Many studies have demonstrated improvements in reporting over time or after the publication of reporting guidelines [ 68 , 69 ].

Type of intervention: In a methodological study of reporting quality of weight loss intervention studies, Thabane et al. found that trials of pharmacologic interventions were reported better than trials of non-pharmacologic interventions [ 70 ].

Interactions between variables: Complex interactions between the previously listed variables are possible. High income countries with more resources may be more likely to conduct larger studies and incorporate a variety of experts. Authors in certain countries may prefer certain journals, and journal endorsement of guidelines and editorial policies may change over time.

Q: Should I focus only on high impact journals?

A: Investigators may choose to investigate only high impact journals because they are more likely to influence practice and policy, or because they assume that methodological standards would be higher. However, the JIF may severely limit the scope of articles included and may skew the sample towards articles with positive findings. The generalizability and applicability of findings from a handful of journals must be examined carefully, especially since the JIF varies over time. Even among journals that are all “high impact”, variations exist in methodological standards.

Q: Can I conduct a methodological study of qualitative research?

A: Yes. Even though a lot of methodological research has been conducted in the quantitative research field, methodological studies of qualitative studies are feasible. Certain databases that catalogue qualitative research including the Cumulative Index to Nursing & Allied Health Literature (CINAHL) have defined subject headings that are specific to methodological research (e.g. “research methodology”). Alternatively, one could also conduct a qualitative methodological review; that is, use qualitative approaches to synthesize methodological issues in qualitative studies.

Q: What reporting guidelines should I use for my methodological study?

A: There is no guideline that covers the entire scope of methodological studies. One adaptation of the PRISMA guidelines has been published, which works well for studies that aim to use the entire target population of research reports [ 71 ]. However, it is not widely used (40 citations in 2 years as of 09 December 2019), and methodological studies that are designed as cross-sectional or before-after studies require a more fit-for purpose guideline. A more encompassing reporting guideline for a broad range of methodological studies is currently under development [ 72 ]. However, in the absence of formal guidance, the requirements for scientific reporting should be respected, and authors of methodological studies should focus on transparency and reproducibility.

Q: What are the potential threats to validity and how can I avoid them?

A: Methodological studies may be compromised by a lack of internal or external validity. The main threats to internal validity in methodological studies are selection and confounding bias. Investigators must ensure that the methods used to select articles does not make them differ systematically from the set of articles to which they would like to make inferences. For example, attempting to make extrapolations to all journals after analyzing high-impact journals would be misleading.

Many factors (confounders) may distort the association between the exposure and outcome if the included research reports differ with respect to these factors [ 73 ]. For example, when examining the association between source of funding and completeness of reporting, it may be necessary to account for journals that endorse the guidelines. Confounding bias can be addressed by restriction, matching and statistical adjustment [ 73 ]. Restriction appears to be the method of choice for many investigators who choose to include only high impact journals or articles in a specific field. For example, Knol et al. examined the reporting of p -values in baseline tables of high impact journals [ 26 ]. Matching is also sometimes used. In the methodological study of non-randomized interventional studies of elective ventral hernia repair, Parker et al. matched prospective studies with retrospective studies and compared reporting standards [ 74 ]. Some other methodological studies use statistical adjustments. For example, Zhang et al. used regression techniques to determine the factors associated with missing participant data in trials [ 16 ].

With regard to external validity, researchers interested in conducting methodological studies must consider how generalizable or applicable their findings are. This should tie in closely with the research question and should be explicit. For example. Findings from methodological studies on trials published in high impact cardiology journals cannot be assumed to be applicable to trials in other fields. However, investigators must ensure that their sample truly represents the target sample either by a) conducting a comprehensive and exhaustive search, or b) using an appropriate and justified, randomly selected sample of research reports.

Even applicability to high impact journals may vary based on the investigators’ definition, and over time. For example, for high impact journals in the field of general medicine, Bouwmeester et al. included the Annals of Internal Medicine (AIM), BMJ, the Journal of the American Medical Association (JAMA), Lancet, the New England Journal of Medicine (NEJM), and PLoS Medicine ( n  = 6) [ 75 ]. In contrast, the high impact journals selected in the methodological study by Schiller et al. were BMJ, JAMA, Lancet, and NEJM ( n  = 4) [ 76 ]. Another methodological study by Kosa et al. included AIM, BMJ, JAMA, Lancet and NEJM ( n  = 5). In the methodological study by Thabut et al., journals with a JIF greater than 5 were considered to be high impact. Riado Minguez et al. used first quartile journals in the Journal Citation Reports (JCR) for a specific year to determine “high impact” [ 77 ]. Ultimately, the definition of high impact will be based on the number of journals the investigators are willing to include, the year of impact and the JIF cut-off [ 78 ]. We acknowledge that the term “generalizability” may apply differently for methodological studies, especially when in many instances it is possible to include the entire target population in the sample studied.

Finally, methodological studies are not exempt from information bias which may stem from discrepancies in the included research reports [ 79 ], errors in data extraction, or inappropriate interpretation of the information extracted. Likewise, publication bias may also be a concern in methodological studies, but such concepts have not yet been explored.

A proposed framework

In order to inform discussions about methodological studies, the development of guidance for what should be reported, we have outlined some key features of methodological studies that can be used to classify them. For each of the categories outlined below, we provide an example. In our experience, the choice of approach to completing a methodological study can be informed by asking the following four questions:

What is the aim?

Methodological studies that investigate bias

A methodological study may be focused on exploring sources of bias in primary or secondary studies (meta-bias), or how bias is analyzed. We have taken care to distinguish bias (i.e. systematic deviations from the truth irrespective of the source) from reporting quality or completeness (i.e. not adhering to a specific reporting guideline or norm). An example of where this distinction would be important is in the case of a randomized trial with no blinding. This study (depending on the nature of the intervention) would be at risk of performance bias. However, if the authors report that their study was not blinded, they would have reported adequately. In fact, some methodological studies attempt to capture both “quality of conduct” and “quality of reporting”, such as Richie et al., who reported on the risk of bias in randomized trials of pharmacy practice interventions [ 80 ]. Babic et al. investigated how risk of bias was used to inform sensitivity analyses in Cochrane reviews [ 81 ]. Further, biases related to choice of outcomes can also be explored. For example, Tan et al investigated differences in treatment effect size based on the outcome reported [ 82 ].

Methodological studies that investigate quality (or completeness) of reporting

Methodological studies may report quality of reporting against a reporting checklist (i.e. adherence to guidelines) or against expected norms. For example, Croituro et al. report on the quality of reporting in systematic reviews published in dermatology journals based on their adherence to the PRISMA statement [ 83 ], and Khan et al. described the quality of reporting of harms in randomized controlled trials published in high impact cardiovascular journals based on the CONSORT extension for harms [ 84 ]. Other methodological studies investigate reporting of certain features of interest that may not be part of formally published checklists or guidelines. For example, Mbuagbaw et al. described how often the implications for research are elaborated using the Evidence, Participants, Intervention, Comparison, Outcome, Timeframe (EPICOT) format [ 30 ].

Methodological studies that investigate the consistency of reporting

Sometimes investigators may be interested in how consistent reports of the same research are, as it is expected that there should be consistency between: conference abstracts and published manuscripts; manuscript abstracts and manuscript main text; and trial registration and published manuscript. For example, Rosmarakis et al. investigated consistency between conference abstracts and full text manuscripts [ 85 ].

Methodological studies that investigate factors associated with reporting

In addition to identifying issues with reporting in primary and secondary studies, authors of methodological studies may be interested in determining the factors that are associated with certain reporting practices. Many methodological studies incorporate this, albeit as a secondary outcome. For example, Farrokhyar et al. investigated the factors associated with reporting quality in randomized trials of coronary artery bypass grafting surgery [ 53 ].

Methodological studies that investigate methods

Methodological studies may also be used to describe methods or compare methods, and the factors associated with methods. Muller et al. described the methods used for systematic reviews and meta-analyses of observational studies [ 86 ].

Methodological studies that summarize other methodological studies

Some methodological studies synthesize results from other methodological studies. For example, Li et al. conducted a scoping review of methodological reviews that investigated consistency between full text and abstracts in primary biomedical research [ 87 ].

Methodological studies that investigate nomenclature and terminology

Some methodological studies may investigate the use of names and terms in health research. For example, Martinic et al. investigated the definitions of systematic reviews used in overviews of systematic reviews (OSRs), meta-epidemiological studies and epidemiology textbooks [ 88 ].

Other types of methodological studies

In addition to the previously mentioned experimental methodological studies, there may exist other types of methodological studies not captured here.

What is the design?

Methodological studies that are descriptive

Most methodological studies are purely descriptive and report their findings as counts (percent) and means (standard deviation) or medians (interquartile range). For example, Mbuagbaw et al. described the reporting of research recommendations in Cochrane HIV systematic reviews [ 30 ]. Gohari et al. described the quality of reporting of randomized trials in diabetes in Iran [ 12 ].

Methodological studies that are analytical

Some methodological studies are analytical wherein “analytical studies identify and quantify associations, test hypotheses, identify causes and determine whether an association exists between variables, such as between an exposure and a disease.” [ 89 ] In the case of methodological studies all these investigations are possible. For example, Kosa et al. investigated the association between agreement in primary outcome from trial registry to published manuscript and study covariates. They found that larger and more recent studies were more likely to have agreement [ 15 ]. Tricco et al. compared the conclusion statements from Cochrane and non-Cochrane systematic reviews with a meta-analysis of the primary outcome and found that non-Cochrane reviews were more likely to report positive findings. These results are a test of the null hypothesis that the proportions of Cochrane and non-Cochrane reviews that report positive results are equal [ 90 ].

What is the sampling strategy?

Methodological studies that include the target population

Methodological reviews with narrow research questions may be able to include the entire target population. For example, in the methodological study of Cochrane HIV systematic reviews, Mbuagbaw et al. included all of the available studies ( n  = 103) [ 30 ].

Methodological studies that include a sample of the target population

Many methodological studies use random samples of the target population [ 33 , 91 , 92 ]. Alternatively, purposeful sampling may be used, limiting the sample to a subset of research-related reports published within a certain time period, or in journals with a certain ranking or on a topic. Systematic sampling can also be used when random sampling may be challenging to implement.

What is the unit of analysis?

Methodological studies with a research report as the unit of analysis

Many methodological studies use a research report (e.g. full manuscript of study, abstract portion of the study) as the unit of analysis, and inferences can be made at the study-level. However, both published and unpublished research-related reports can be studied. These may include articles, conference abstracts, registry entries etc.

Methodological studies with a design, analysis or reporting item as the unit of analysis

Some methodological studies report on items which may occur more than once per article. For example, Paquette et al. report on subgroup analyses in Cochrane reviews of atrial fibrillation in which 17 systematic reviews planned 56 subgroup analyses [ 93 ].

This framework is outlined in Fig.  2 .

A proposed framework for methodological studies

Conclusions

Methodological studies have examined different aspects of reporting such as quality, completeness, consistency and adherence to reporting guidelines. As such, many of the methodological study examples cited in this tutorial are related to reporting. However, as an evolving field, the scope of research questions that can be addressed by methodological studies is expected to increase.

In this paper we have outlined the scope and purpose of methodological studies, along with examples of instances in which various approaches have been used. In the absence of formal guidance on the design, conduct, analysis and reporting of methodological studies, we have provided some advice to help make methodological studies consistent. This advice is grounded in good contemporary scientific practice. Generally, the research question should tie in with the sampling approach and planned analysis. We have also highlighted the variables that may inform findings from methodological studies. Lastly, we have provided suggestions for ways in which authors can categorize their methodological studies to inform their design and analysis.

Availability of data and materials

Data sharing is not applicable to this article as no new data were created or analyzed in this study.

Abbreviations

Consolidated Standards of Reporting Trials

Evidence, Participants, Intervention, Comparison, Outcome, Timeframe

Grading of Recommendations, Assessment, Development and Evaluations

Participants, Intervention, Comparison, Outcome, Timeframe

Preferred Reporting Items of Systematic reviews and Meta-Analyses

Studies Within a Review

Studies Within a Trial

Chalmers I, Glasziou P. Avoidable waste in the production and reporting of research evidence. Lancet. 2009;374(9683):86–9.

PubMed   Google Scholar  

Chan AW, Song F, Vickers A, Jefferson T, Dickersin K, Gotzsche PC, Krumholz HM, Ghersi D, van der Worp HB. Increasing value and reducing waste: addressing inaccessible research. Lancet. 2014;383(9913):257–66.

PubMed   PubMed Central   Google Scholar  

Ioannidis JP, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, Schulz KF, Tibshirani R. Increasing value and reducing waste in research design, conduct, and analysis. Lancet. 2014;383(9912):166–75.

Higgins JP, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JA. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.

Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001;357.

Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6(7):e1000100.

Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, Henry DA, Boers M. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol. 2009;62(10):1013–20.

Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, Moher D, Tugwell P, Welch V, Kristjansson E, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. Bmj. 2017;358:j4008.

Lawson DO, Leenus A, Mbuagbaw L. Mapping the nomenclature, methodology, and reporting of studies that review methods: a pilot methodological review. Pilot Feasibility Studies. 2020;6(1):13.

Puljak L, Makaric ZL, Buljan I, Pieper D. What is a meta-epidemiological study? Analysis of published literature indicated heterogeneous study designs and definitions. J Comp Eff Res. 2020.

Abbade LPF, Wang M, Sriganesh K, Jin Y, Mbuagbaw L, Thabane L. The framing of research questions using the PICOT format in randomized controlled trials of venous ulcer disease is suboptimal: a systematic survey. Wound Repair Regen. 2017;25(5):892–900.

Gohari F, Baradaran HR, Tabatabaee M, Anijidani S, Mohammadpour Touserkani F, Atlasi R, Razmgir M. Quality of reporting randomized controlled trials (RCTs) in diabetes in Iran; a systematic review. J Diabetes Metab Disord. 2015;15(1):36.

Wang M, Jin Y, Hu ZJ, Thabane A, Dennis B, Gajic-Veljanoski O, Paul J, Thabane L. The reporting quality of abstracts of stepped wedge randomized trials is suboptimal: a systematic survey of the literature. Contemp Clin Trials Commun. 2017;8:1–10.

Shanthanna H, Kaushal A, Mbuagbaw L, Couban R, Busse J, Thabane L: A cross-sectional study of the reporting quality of pilot or feasibility trials in high-impact anesthesia journals Can J Anaesthesia 2018, 65(11):1180–1195.

Kosa SD, Mbuagbaw L, Borg Debono V, Bhandari M, Dennis BB, Ene G, Leenus A, Shi D, Thabane M, Valvasori S, et al. Agreement in reporting between trial publications and current clinical trial registry in high impact journals: a methodological review. Contemporary Clinical Trials. 2018;65:144–50.

Zhang Y, Florez ID, Colunga Lozano LE, Aloweni FAB, Kennedy SA, Li A, Craigie S, Zhang S, Agarwal A, Lopes LC, et al. A systematic survey on reporting and methods for handling missing participant data for continuous outcomes in randomized controlled trials. J Clin Epidemiol. 2017;88:57–66.

CAS   PubMed   Google Scholar  

Hernández AV, Boersma E, Murray GD, Habbema JD, Steyerberg EW. Subgroup analyses in therapeutic cardiovascular clinical trials: are most of them misleading? Am Heart J. 2006;151(2):257–64.

Samaan Z, Mbuagbaw L, Kosa D, Borg Debono V, Dillenburg R, Zhang S, Fruci V, Dennis B, Bawor M, Thabane L. A systematic scoping review of adherence to reporting guidelines in health care literature. J Multidiscip Healthc. 2013;6:169–88.

Buscemi N, Hartling L, Vandermeer B, Tjosvold L, Klassen TP. Single data extraction generated more errors than double data extraction in systematic reviews. J Clin Epidemiol. 2006;59(7):697–703.

Carrasco-Labra A, Brignardello-Petersen R, Santesso N, Neumann I, Mustafa RA, Mbuagbaw L, Etxeandia Ikobaltzeta I, De Stio C, McCullagh LJ, Alonso-Coello P. Improving GRADE evidence tables part 1: a randomized trial shows improved understanding of content in summary-of-findings tables with a new format. J Clin Epidemiol. 2016;74:7–18.

The Northern Ireland Hub for Trials Methodology Research: SWAT/SWAR Information [ https://www.qub.ac.uk/sites/TheNorthernIrelandNetworkforTrialsMethodologyResearch/SWATSWARInformation/ ]. Accessed 31 Aug 2020.

Chick S, Sánchez P, Ferrin D, Morrice D. How to conduct a successful simulation study. In: Proceedings of the 2003 winter simulation conference: 2003; 2003. p. 66–70.

Google Scholar  

Mulrow CD. The medical review article: state of the science. Ann Intern Med. 1987;106(3):485–8.

Sacks HS, Reitman D, Pagano D, Kupelnick B. Meta-analysis: an update. Mount Sinai J Med New York. 1996;63(3–4):216–24.

CAS   Google Scholar  

Areia M, Soares M, Dinis-Ribeiro M. Quality reporting of endoscopic diagnostic studies in gastrointestinal journals: where do we stand on the use of the STARD and CONSORT statements? Endoscopy. 2010;42(2):138–47.

Knol M, Groenwold R, Grobbee D. P-values in baseline tables of randomised controlled trials are inappropriate but still common in high impact journals. Eur J Prev Cardiol. 2012;19(2):231–2.

Chen M, Cui J, Zhang AL, Sze DM, Xue CC, May BH. Adherence to CONSORT items in randomized controlled trials of integrative medicine for colorectal Cancer published in Chinese journals. J Altern Complement Med. 2018;24(2):115–24.

Hopewell S, Ravaud P, Baron G, Boutron I. Effect of editors' implementation of CONSORT guidelines on the reporting of abstracts in high impact medical journals: interrupted time series analysis. BMJ. 2012;344:e4178.

The Cochrane Methodology Register Issue 2 2009 [ https://cmr.cochrane.org/help.htm ]. Accessed 31 Aug 2020.

Mbuagbaw L, Kredo T, Welch V, Mursleen S, Ross S, Zani B, Motaze NV, Quinlan L. Critical EPICOT items were absent in Cochrane human immunodeficiency virus systematic reviews: a bibliometric analysis. J Clin Epidemiol. 2016;74:66–72.

Barton S, Peckitt C, Sclafani F, Cunningham D, Chau I. The influence of industry sponsorship on the reporting of subgroup analyses within phase III randomised controlled trials in gastrointestinal oncology. Eur J Cancer. 2015;51(18):2732–9.

Setia MS. Methodology series module 5: sampling strategies. Indian J Dermatol. 2016;61(5):505–9.

Wilson B, Burnett P, Moher D, Altman DG, Al-Shahi Salman R. Completeness of reporting of randomised controlled trials including people with transient ischaemic attack or stroke: a systematic review. Eur Stroke J. 2018;3(4):337–46.

Kahale LA, Diab B, Brignardello-Petersen R, Agarwal A, Mustafa RA, Kwong J, Neumann I, Li L, Lopes LC, Briel M, et al. Systematic reviews do not adequately report or address missing outcome data in their analyses: a methodological survey. J Clin Epidemiol. 2018;99:14–23.

De Angelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJPM, et al. Is this clinical trial fully registered?: a statement from the International Committee of Medical Journal Editors*. Ann Intern Med. 2005;143(2):146–8.

Ohtake PJ, Childs JD. Why publish study protocols? Phys Ther. 2014;94(9):1208–9.

Rombey T, Allers K, Mathes T, Hoffmann F, Pieper D. A descriptive analysis of the characteristics and the peer review process of systematic review protocols published in an open peer review journal from 2012 to 2017. BMC Med Res Methodol. 2019;19(1):57.

Grimes DA, Schulz KF. Bias and causal associations in observational research. Lancet. 2002;359(9302):248–52.

Porta M (ed.): A dictionary of epidemiology, 5th edn. Oxford: Oxford University Press, Inc.; 2008.

El Dib R, Tikkinen KAO, Akl EA, Gomaa HA, Mustafa RA, Agarwal A, Carpenter CR, Zhang Y, Jorge EC, Almeida R, et al. Systematic survey of randomized trials evaluating the impact of alternative diagnostic strategies on patient-important outcomes. J Clin Epidemiol. 2017;84:61–9.

Helzer JE, Robins LN, Taibleson M, Woodruff RA Jr, Reich T, Wish ED. Reliability of psychiatric diagnosis. I. a methodological review. Arch Gen Psychiatry. 1977;34(2):129–33.

Chung ST, Chacko SK, Sunehag AL, Haymond MW. Measurements of gluconeogenesis and Glycogenolysis: a methodological review. Diabetes. 2015;64(12):3996–4010.

CAS   PubMed   PubMed Central   Google Scholar  

Sterne JA, Juni P, Schulz KF, Altman DG, Bartlett C, Egger M. Statistical methods for assessing the influence of study characteristics on treatment effects in 'meta-epidemiological' research. Stat Med. 2002;21(11):1513–24.

Moen EL, Fricano-Kugler CJ, Luikart BW, O’Malley AJ. Analyzing clustered data: why and how to account for multiple observations nested within a study participant? PLoS One. 2016;11(1):e0146721.

Zyzanski SJ, Flocke SA, Dickinson LM. On the nature and analysis of clustered data. Ann Fam Med. 2004;2(3):199–200.

Mathes T, Klassen P, Pieper D. Frequency of data extraction errors and methods to increase data extraction quality: a methodological review. BMC Med Res Methodol. 2017;17(1):152.

Bui DDA, Del Fiol G, Hurdle JF, Jonnalagadda S. Extractive text summarization system to aid data extraction from full text in systematic review development. J Biomed Inform. 2016;64:265–72.

Bui DD, Del Fiol G, Jonnalagadda S. PDF text classification to leverage information extraction from publication reports. J Biomed Inform. 2016;61:141–8.

Maticic K, Krnic Martinic M, Puljak L. Assessment of reporting quality of abstracts of systematic reviews with meta-analysis using PRISMA-A and discordance in assessments between raters without prior experience. BMC Med Res Methodol. 2019;19(1):32.

Speich B. Blinding in surgical randomized clinical trials in 2015. Ann Surg. 2017;266(1):21–2.

Abraha I, Cozzolino F, Orso M, Marchesi M, Germani A, Lombardo G, Eusebi P, De Florio R, Luchetta ML, Iorio A, et al. A systematic review found that deviations from intention-to-treat are common in randomized trials and systematic reviews. J Clin Epidemiol. 2017;84:37–46.

Zhong Y, Zhou W, Jiang H, Fan T, Diao X, Yang H, Min J, Wang G, Fu J, Mao B. Quality of reporting of two-group parallel randomized controlled clinical trials of multi-herb formulae: A survey of reports indexed in the Science Citation Index Expanded. Eur J Integrative Med. 2011;3(4):e309–16.

Farrokhyar F, Chu R, Whitlock R, Thabane L. A systematic review of the quality of publications reporting coronary artery bypass grafting trials. Can J Surg. 2007;50(4):266–77.

Oltean H, Gagnier JJ. Use of clustering analysis in randomized controlled trials in orthopaedic surgery. BMC Med Res Methodol. 2015;15:17.

Fleming PS, Koletsi D, Pandis N. Blinded by PRISMA: are systematic reviewers focusing on PRISMA and ignoring other guidelines? PLoS One. 2014;9(5):e96407.

Balasubramanian SP, Wiener M, Alshameeri Z, Tiruvoipati R, Elbourne D, Reed MW. Standards of reporting of randomized controlled trials in general surgery: can we do better? Ann Surg. 2006;244(5):663–7.

de Vries TW, van Roon EN. Low quality of reporting adverse drug reactions in paediatric randomised controlled trials. Arch Dis Child. 2010;95(12):1023–6.

Borg Debono V, Zhang S, Ye C, Paul J, Arya A, Hurlburt L, Murthy Y, Thabane L. The quality of reporting of RCTs used within a postoperative pain management meta-analysis, using the CONSORT statement. BMC Anesthesiol. 2012;12:13.

Kaiser KA, Cofield SS, Fontaine KR, Glasser SP, Thabane L, Chu R, Ambrale S, Dwary AD, Kumar A, Nayyar G, et al. Is funding source related to study reporting quality in obesity or nutrition randomized control trials in top-tier medical journals? Int J Obes. 2012;36(7):977–81.

Thomas O, Thabane L, Douketis J, Chu R, Westfall AO, Allison DB. Industry funding and the reporting quality of large long-term weight loss trials. Int J Obes. 2008;32(10):1531–6.

Khan NR, Saad H, Oravec CS, Rossi N, Nguyen V, Venable GT, Lillard JC, Patel P, Taylor DR, Vaughn BN, et al. A review of industry funding in randomized controlled trials published in the neurosurgical literature-the elephant in the room. Neurosurgery. 2018;83(5):890–7.

Hansen C, Lundh A, Rasmussen K, Hrobjartsson A. Financial conflicts of interest in systematic reviews: associations with results, conclusions, and methodological quality. Cochrane Database Syst Rev. 2019;8:Mr000047.

Kiehna EN, Starke RM, Pouratian N, Dumont AS. Standards for reporting randomized controlled trials in neurosurgery. J Neurosurg. 2011;114(2):280–5.

Liu LQ, Morris PJ, Pengel LH. Compliance to the CONSORT statement of randomized controlled trials in solid organ transplantation: a 3-year overview. Transpl Int. 2013;26(3):300–6.

Bala MM, Akl EA, Sun X, Bassler D, Mertz D, Mejza F, Vandvik PO, Malaga G, Johnston BC, Dahm P, et al. Randomized trials published in higher vs. lower impact journals differ in design, conduct, and analysis. J Clin Epidemiol. 2013;66(3):286–95.

Lee SY, Teoh PJ, Camm CF, Agha RA. Compliance of randomized controlled trials in trauma surgery with the CONSORT statement. J Trauma Acute Care Surg. 2013;75(4):562–72.

Ziogas DC, Zintzaras E. Analysis of the quality of reporting of randomized controlled trials in acute and chronic myeloid leukemia, and myelodysplastic syndromes as governed by the CONSORT statement. Ann Epidemiol. 2009;19(7):494–500.

Alvarez F, Meyer N, Gourraud PA, Paul C. CONSORT adoption and quality of reporting of randomized controlled trials: a systematic analysis in two dermatology journals. Br J Dermatol. 2009;161(5):1159–65.

Mbuagbaw L, Thabane M, Vanniyasingam T, Borg Debono V, Kosa S, Zhang S, Ye C, Parpia S, Dennis BB, Thabane L. Improvement in the quality of abstracts in major clinical journals since CONSORT extension for abstracts: a systematic review. Contemporary Clin trials. 2014;38(2):245–50.

Thabane L, Chu R, Cuddy K, Douketis J. What is the quality of reporting in weight loss intervention studies? A systematic review of randomized controlled trials. Int J Obes. 2007;31(10):1554–9.

Murad MH, Wang Z. Guidelines for reporting meta-epidemiological methodology research. Evidence Based Med. 2017;22(4):139.

METRIC - MEthodological sTudy ReportIng Checklist: guidelines for reporting methodological studies in health research [ http://www.equator-network.org/library/reporting-guidelines-under-development/reporting-guidelines-under-development-for-other-study-designs/#METRIC ]. Accessed 31 Aug 2020.

Jager KJ, Zoccali C, MacLeod A, Dekker FW. Confounding: what it is and how to deal with it. Kidney Int. 2008;73(3):256–60.

Parker SG, Halligan S, Erotocritou M, Wood CPJ, Boulton RW, Plumb AAO, Windsor ACJ, Mallett S. A systematic methodological review of non-randomised interventional studies of elective ventral hernia repair: clear definitions and a standardised minimum dataset are needed. Hernia. 2019.

Bouwmeester W, Zuithoff NPA, Mallett S, Geerlings MI, Vergouwe Y, Steyerberg EW, Altman DG, Moons KGM. Reporting and methods in clinical prediction research: a systematic review. PLoS Med. 2012;9(5):1–12.

Schiller P, Burchardi N, Niestroj M, Kieser M. Quality of reporting of clinical non-inferiority and equivalence randomised trials--update and extension. Trials. 2012;13:214.

Riado Minguez D, Kowalski M, Vallve Odena M, Longin Pontzen D, Jelicic Kadic A, Jeric M, Dosenovic S, Jakus D, Vrdoljak M, Poklepovic Pericic T, et al. Methodological and reporting quality of systematic reviews published in the highest ranking journals in the field of pain. Anesth Analg. 2017;125(4):1348–54.

Thabut G, Estellat C, Boutron I, Samama CM, Ravaud P. Methodological issues in trials assessing primary prophylaxis of venous thrombo-embolism. Eur Heart J. 2005;27(2):227–36.

Puljak L, Riva N, Parmelli E, González-Lorenzo M, Moja L, Pieper D. Data extraction methods: an analysis of internal reporting discrepancies in single manuscripts and practical advice. J Clin Epidemiol. 2020;117:158–64.

Ritchie A, Seubert L, Clifford R, Perry D, Bond C. Do randomised controlled trials relevant to pharmacy meet best practice standards for quality conduct and reporting? A systematic review. Int J Pharm Pract. 2019.

Babic A, Vuka I, Saric F, Proloscic I, Slapnicar E, Cavar J, Pericic TP, Pieper D, Puljak L. Overall bias methods and their use in sensitivity analysis of Cochrane reviews were not consistent. J Clin Epidemiol. 2019.

Tan A, Porcher R, Crequit P, Ravaud P, Dechartres A. Differences in treatment effect size between overall survival and progression-free survival in immunotherapy trials: a Meta-epidemiologic study of trials with results posted at ClinicalTrials.gov. J Clin Oncol. 2017;35(15):1686–94.

Croitoru D, Huang Y, Kurdina A, Chan AW, Drucker AM. Quality of reporting in systematic reviews published in dermatology journals. Br J Dermatol. 2020;182(6):1469–76.

Khan MS, Ochani RK, Shaikh A, Vaduganathan M, Khan SU, Fatima K, Yamani N, Mandrola J, Doukky R, Krasuski RA: Assessing the Quality of Reporting of Harms in Randomized Controlled Trials Published in High Impact Cardiovascular Journals. Eur Heart J Qual Care Clin Outcomes 2019.

Rosmarakis ES, Soteriades ES, Vergidis PI, Kasiakou SK, Falagas ME. From conference abstract to full paper: differences between data presented in conferences and journals. FASEB J. 2005;19(7):673–80.

Mueller M, D’Addario M, Egger M, Cevallos M, Dekkers O, Mugglin C, Scott P. Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations. BMC Med Res Methodol. 2018;18(1):44.

Li G, Abbade LPF, Nwosu I, Jin Y, Leenus A, Maaz M, Wang M, Bhatt M, Zielinski L, Sanger N, et al. A scoping review of comparisons between abstracts and full reports in primary biomedical research. BMC Med Res Methodol. 2017;17(1):181.

Krnic Martinic M, Pieper D, Glatt A, Puljak L. Definition of a systematic review used in overviews of systematic reviews, meta-epidemiological studies and textbooks. BMC Med Res Methodol. 2019;19(1):203.

Analytical study [ https://medical-dictionary.thefreedictionary.com/analytical+study ]. Accessed 31 Aug 2020.

Tricco AC, Tetzlaff J, Pham B, Brehaut J, Moher D. Non-Cochrane vs. Cochrane reviews were twice as likely to have positive conclusion statements: cross-sectional study. J Clin Epidemiol. 2009;62(4):380–6 e381.

Schalken N, Rietbergen C. The reporting quality of systematic reviews and Meta-analyses in industrial and organizational psychology: a systematic review. Front Psychol. 2017;8:1395.

Ranker LR, Petersen JM, Fox MP. Awareness of and potential for dependent error in the observational epidemiologic literature: A review. Ann Epidemiol. 2019;36:15–9 e12.

Paquette M, Alotaibi AM, Nieuwlaat R, Santesso N, Mbuagbaw L. A meta-epidemiological study of subgroup analyses in cochrane systematic reviews of atrial fibrillation. Syst Rev. 2019;8(1):241.

Download references

Acknowledgements

This work did not receive any dedicated funding.

Author information

Authors and affiliations.

Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, Canada

Lawrence Mbuagbaw, Daeria O. Lawson & Lehana Thabane

Biostatistics Unit/FSORC, 50 Charlton Avenue East, St Joseph’s Healthcare—Hamilton, 3rd Floor Martha Wing, Room H321, Hamilton, Ontario, L8N 4A6, Canada

Lawrence Mbuagbaw & Lehana Thabane

Centre for the Development of Best Practices in Health, Yaoundé, Cameroon

Lawrence Mbuagbaw

Center for Evidence-Based Medicine and Health Care, Catholic University of Croatia, Ilica 242, 10000, Zagreb, Croatia

Livia Puljak

Department of Epidemiology and Biostatistics, School of Public Health – Bloomington, Indiana University, Bloomington, IN, 47405, USA

David B. Allison

Departments of Paediatrics and Anaesthesia, McMaster University, Hamilton, ON, Canada

Lehana Thabane

Centre for Evaluation of Medicine, St. Joseph’s Healthcare-Hamilton, Hamilton, ON, Canada

Population Health Research Institute, Hamilton Health Sciences, Hamilton, ON, Canada

You can also search for this author in PubMed   Google Scholar

Contributions

LM conceived the idea and drafted the outline and paper. DOL and LT commented on the idea and draft outline. LM, LP and DOL performed literature searches and data extraction. All authors (LM, DOL, LT, LP, DBA) reviewed several draft versions of the manuscript and approved the final manuscript.

Corresponding author

Correspondence to Lawrence Mbuagbaw .

Ethics declarations

Ethics approval and consent to participate.

Not applicable.

Consent for publication

Competing interests.

DOL, DBA, LM, LP and LT are involved in the development of a reporting guideline for methodological studies.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Mbuagbaw, L., Lawson, D.O., Puljak, L. et al. A tutorial on methodological studies: the what, when, how and why. BMC Med Res Methodol 20 , 226 (2020). https://doi.org/10.1186/s12874-020-01107-7

Download citation

Received : 27 May 2020

Accepted : 27 August 2020

Published : 07 September 2020

DOI : https://doi.org/10.1186/s12874-020-01107-7

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Methodological study
• Meta-epidemiology
• Research methods
• Research-on-research

BMC Medical Research Methodology

ISSN: 1471-2288

• General enquiries: [email protected]

What is Research Methodology? Definition, Types, and Examples

Research methodology 1,2 is a structured and scientific approach used to collect, analyze, and interpret quantitative or qualitative data to answer research questions or test hypotheses. A research methodology is like a plan for carrying out research and helps keep researchers on track by limiting the scope of the research. Several aspects must be considered before selecting an appropriate research methodology, such as research limitations and ethical concerns that may affect your research.

The research methodology section in a scientific paper describes the different methodological choices made, such as the data collection and analysis methods, and why these choices were selected. The reasons should explain why the methods chosen are the most appropriate to answer the research question. A good research methodology also helps ensure the reliability and validity of the research findings. There are three types of research methodology—quantitative, qualitative, and mixed-method, which can be chosen based on the research objectives.

What is research methodology ?

A research methodology describes the techniques and procedures used to identify and analyze information regarding a specific research topic. It is a process by which researchers design their study so that they can achieve their objectives using the selected research instruments. It includes all the important aspects of research, including research design, data collection methods, data analysis methods, and the overall framework within which the research is conducted. While these points can help you understand what is research methodology, you also need to know why it is important to pick the right methodology.

Why is research methodology important?

Having a good research methodology in place has the following advantages: 3

• Helps other researchers who may want to replicate your research; the explanations will be of benefit to them.
• You can easily answer any questions about your research if they arise at a later stage.
• A research methodology provides a framework and guidelines for researchers to clearly define research questions, hypotheses, and objectives.
• It helps researchers identify the most appropriate research design, sampling technique, and data collection and analysis methods.
• A sound research methodology helps researchers ensure that their findings are valid and reliable and free from biases and errors.
• It also helps ensure that ethical guidelines are followed while conducting research.
• A good research methodology helps researchers in planning their research efficiently, by ensuring optimum usage of their time and resources.

Writing the methods section of a research paper? Let Paperpal help you achieve perfection

Types of research methodology.

There are three types of research methodology based on the type of research and the data required. 1

• Quantitative research methodology focuses on measuring and testing numerical data. This approach is good for reaching a large number of people in a short amount of time. This type of research helps in testing the causal relationships between variables, making predictions, and generalizing results to wider populations.
• Qualitative research methodology examines the opinions, behaviors, and experiences of people. It collects and analyzes words and textual data. This research methodology requires fewer participants but is still more time consuming because the time spent per participant is quite large. This method is used in exploratory research where the research problem being investigated is not clearly defined.
• Mixed-method research methodology uses the characteristics of both quantitative and qualitative research methodologies in the same study. This method allows researchers to validate their findings, verify if the results observed using both methods are complementary, and explain any unexpected results obtained from one method by using the other method.

What are the types of sampling designs in research methodology?

Sampling 4 is an important part of a research methodology and involves selecting a representative sample of the population to conduct the study, making statistical inferences about them, and estimating the characteristics of the whole population based on these inferences. There are two types of sampling designs in research methodology—probability and nonprobability.

• Probability sampling

In this type of sampling design, a sample is chosen from a larger population using some form of random selection, that is, every member of the population has an equal chance of being selected. The different types of probability sampling are:

• Systematic —sample members are chosen at regular intervals. It requires selecting a starting point for the sample and sample size determination that can be repeated at regular intervals. This type of sampling method has a predefined range; hence, it is the least time consuming.
• Stratified —researchers divide the population into smaller groups that don’t overlap but represent the entire population. While sampling, these groups can be organized, and then a sample can be drawn from each group separately.
• Cluster —the population is divided into clusters based on demographic parameters like age, sex, location, etc.
• Convenience —selects participants who are most easily accessible to researchers due to geographical proximity, availability at a particular time, etc.
• Purposive —participants are selected at the researcher’s discretion. Researchers consider the purpose of the study and the understanding of the target audience.
• Snowball —already selected participants use their social networks to refer the researcher to other potential participants.
• Quota —while designing the study, the researchers decide how many people with which characteristics to include as participants. The characteristics help in choosing people most likely to provide insights into the subject.

What are data collection methods?

During research, data are collected using various methods depending on the research methodology being followed and the research methods being undertaken. Both qualitative and quantitative research have different data collection methods, as listed below.

Qualitative research 5

• One-on-one interviews: Helps the interviewers understand a respondent’s subjective opinion and experience pertaining to a specific topic or event
• Document study/literature review/record keeping: Researchers’ review of already existing written materials such as archives, annual reports, research articles, guidelines, policy documents, etc.
• Focus groups: Constructive discussions that usually include a small sample of about 6-10 people and a moderator, to understand the participants’ opinion on a given topic.
• Qualitative observation : Researchers collect data using their five senses (sight, smell, touch, taste, and hearing).

Quantitative research 6

• Sampling: The most common type is probability sampling.
• Interviews: Commonly telephonic or done in-person.
• Observations: Structured observations are most commonly used in quantitative research. In this method, researchers make observations about specific behaviors of individuals in a structured setting.
• Document review: Reviewing existing research or documents to collect evidence for supporting the research.
• Surveys and questionnaires. Surveys can be administered both online and offline depending on the requirement and sample size.

Let Paperpal help you write the perfect research methods section. Start now!

What are data analysis methods.

The data collected using the various methods for qualitative and quantitative research need to be analyzed to generate meaningful conclusions. These data analysis methods 7 also differ between quantitative and qualitative research.

Quantitative research involves a deductive method for data analysis where hypotheses are developed at the beginning of the research and precise measurement is required. The methods include statistical analysis applications to analyze numerical data and are grouped into two categories—descriptive and inferential.

Descriptive analysis is used to describe the basic features of different types of data to present it in a way that ensures the patterns become meaningful. The different types of descriptive analysis methods are:

• Measures of frequency (count, percent, frequency)
• Measures of central tendency (mean, median, mode)
• Measures of dispersion or variation (range, variance, standard deviation)
• Measure of position (percentile ranks, quartile ranks)

Inferential analysis is used to make predictions about a larger population based on the analysis of the data collected from a smaller population. This analysis is used to study the relationships between different variables. Some commonly used inferential data analysis methods are:

• Correlation: To understand the relationship between two or more variables.
• Cross-tabulation: Analyze the relationship between multiple variables.
• Regression analysis: Study the impact of independent variables on the dependent variable.
• Frequency tables: To understand the frequency of data.
• Analysis of variance: To test the degree to which two or more variables differ in an experiment.

Qualitative research involves an inductive method for data analysis where hypotheses are developed after data collection. The methods include:

• Content analysis: For analyzing documented information from text and images by determining the presence of certain words or concepts in texts.
• Narrative analysis: For analyzing content obtained from sources such as interviews, field observations, and surveys. The stories and opinions shared by people are used to answer research questions.
• Discourse analysis: For analyzing interactions with people considering the social context, that is, the lifestyle and environment, under which the interaction occurs.
• Grounded theory: Involves hypothesis creation by data collection and analysis to explain why a phenomenon occurred.
• Thematic analysis: To identify important themes or patterns in data and use these to address an issue.

How to choose a research methodology?

Here are some important factors to consider when choosing a research methodology: 8

• Research objectives, aims, and questions —these would help structure the research design.
• Review existing literature to identify any gaps in knowledge.
• Check the statistical requirements —if data-driven or statistical results are needed then quantitative research is the best. If the research questions can be answered based on people’s opinions and perceptions, then qualitative research is most suitable.
• Sample size —sample size can often determine the feasibility of a research methodology. For a large sample, less effort- and time-intensive methods are appropriate.
• Constraints —constraints of time, geography, and resources can help define the appropriate methodology.

Got writer’s block? Kickstart your research paper writing with Paperpal now!

How to write a research methodology .

A research methodology should include the following components: 3,9

• Research design —should be selected based on the research question and the data required. Common research designs include experimental, quasi-experimental, correlational, descriptive, and exploratory.
• Research method —this can be quantitative, qualitative, or mixed-method.
• Reason for selecting a specific methodology —explain why this methodology is the most suitable to answer your research problem.
• Research instruments —explain the research instruments you plan to use, mainly referring to the data collection methods such as interviews, surveys, etc. Here as well, a reason should be mentioned for selecting the particular instrument.
• Sampling —this involves selecting a representative subset of the population being studied.
• Data collection —involves gathering data using several data collection methods, such as surveys, interviews, etc.
• Data analysis —describe the data analysis methods you will use once you’ve collected the data.
• Research limitations —mention any limitations you foresee while conducting your research.
• Validity and reliability —validity helps identify the accuracy and truthfulness of the findings; reliability refers to the consistency and stability of the results over time and across different conditions.
• Ethical considerations —research should be conducted ethically. The considerations include obtaining consent from participants, maintaining confidentiality, and addressing conflicts of interest.

Streamline Your Research Paper Writing Process with Paperpal

The methods section is a critical part of the research papers, allowing researchers to use this to understand your findings and replicate your work when pursuing their own research. However, it is usually also the most difficult section to write. This is where Paperpal can help you overcome the writer’s block and create the first draft in minutes with Paperpal Copilot, its secure generative AI feature suite.  

With Paperpal you can get research advice, write and refine your work, rephrase and verify the writing, and ensure submission readiness, all in one place. Here’s how you can use Paperpal to develop the first draft of your methods section.  

• Generate an outline: Input some details about your research to instantly generate an outline for your methods section 
• Develop the section: Use the outline and suggested sentence templates to expand your ideas and develop the first draft.  
• P araph ras e and trim : Get clear, concise academic text with paraphrasing that conveys your work effectively and word reduction to fix redundancies. 
• Choose the right words: Enhance text by choosing contextual synonyms based on how the words have been used in previously published work.  
• Check and verify text : Make sure the generated text showcases your methods correctly, has all the right citations, and is original and authentic. .   

You can repeat this process to develop each section of your research manuscript, including the title, abstract and keywords. Ready to write your research papers faster, better, and without the stress? Sign up for Paperpal and start writing today!

Frequently Asked Questions

Q1. What are the key components of research methodology?

A1. A good research methodology has the following key components:

• Research design
• Data collection procedures
• Data analysis methods
• Ethical considerations

Q2. Why is ethical consideration important in research methodology?

A2. Ethical consideration is important in research methodology to ensure the readers of the reliability and validity of the study. Researchers must clearly mention the ethical norms and standards followed during the conduct of the research and also mention if the research has been cleared by any institutional board. The following 10 points are the important principles related to ethical considerations: 10

• Participants should not be subjected to harm.
• Respect for the dignity of participants should be prioritized.
• Full consent should be obtained from participants before the study.
• Participants’ privacy should be ensured.
• Confidentiality of the research data should be ensured.
• Anonymity of individuals and organizations participating in the research should be maintained.
• The aims and objectives of the research should not be exaggerated.
• Affiliations, sources of funding, and any possible conflicts of interest should be declared.
• Communication in relation to the research should be honest and transparent.
• Misleading information and biased representation of primary data findings should be avoided.

Q3. What is the difference between methodology and method?

A3. Research methodology is different from a research method, although both terms are often confused. Research methods are the tools used to gather data, while the research methodology provides a framework for how research is planned, conducted, and analyzed. The latter guides researchers in making decisions about the most appropriate methods for their research. Research methods refer to the specific techniques, procedures, and tools used by researchers to collect, analyze, and interpret data, for instance surveys, questionnaires, interviews, etc.

Research methodology is, thus, an integral part of a research study. It helps ensure that you stay on track to meet your research objectives and answer your research questions using the most appropriate data collection and analysis tools based on your research design.

Accelerate your research paper writing with Paperpal. Try for free now!

• Research methodologies. Pfeiffer Library website. Accessed August 15, 2023. https://library.tiffin.edu/researchmethodologies/whatareresearchmethodologies
• Types of research methodology. Eduvoice website. Accessed August 16, 2023. https://eduvoice.in/types-research-methodology/
• The basics of research methodology: A key to quality research. Voxco. Accessed August 16, 2023. https://www.voxco.com/blog/what-is-research-methodology/
• Sampling methods: Types with examples. QuestionPro website. Accessed August 16, 2023. https://www.questionpro.com/blog/types-of-sampling-for-social-research/
• What is qualitative research? Methods, types, approaches, examples. Researcher.Life blog. Accessed August 15, 2023. https://researcher.life/blog/article/what-is-qualitative-research-methods-types-examples/
• What is quantitative research? Definition, methods, types, and examples. Researcher.Life blog. Accessed August 15, 2023. https://researcher.life/blog/article/what-is-quantitative-research-types-and-examples/
• Data analysis in research: Types & methods. QuestionPro website. Accessed August 16, 2023. https://www.questionpro.com/blog/data-analysis-in-research/#Data_analysis_in_qualitative_research
• Factors to consider while choosing the right research methodology. PhD Monster website. Accessed August 17, 2023. https://www.phdmonster.com/factors-to-consider-while-choosing-the-right-research-methodology/
• What is research methodology? Research and writing guides. Accessed August 14, 2023. https://paperpile.com/g/what-is-research-methodology/
• Ethical considerations. Business research methodology website. Accessed August 17, 2023. https://research-methodology.net/research-methodology/ethical-considerations/

Paperpal is a comprehensive AI writing toolkit that helps students and researchers achieve 2x the writing in half the time. It leverages 21+ years of STM experience and insights from millions of research articles to provide in-depth academic writing, language editing, and submission readiness support to help you write better, faster.  

Get accurate academic translations, rewriting support, grammar checks, vocabulary suggestions, and generative AI assistance that delivers human precision at machine speed. Try for free or upgrade to Paperpal Prime starting at US$19 a month to access premium features, including consistency, plagiarism, and 30+ submission readiness checks to help you succeed.  

Experience the future of academic writing – Sign up to Paperpal and start writing for free!  

Related Reads:

• Dangling Modifiers and How to Avoid Them in Your Writing 
• Webinar: How to Use Generative AI Tools Ethically in Your Academic Writing
• Research Outlines: How to Write An Introduction Section in Minutes with Paperpal Copilot
• How to Paraphrase Research Papers Effectively

Language and Grammar Rules for Academic Writing

Climatic vs. climactic: difference and examples, you may also like, dissertation printing and binding | types & comparison , what is a dissertation preface definition and examples , how to write a research proposal: (with examples..., how to write your research paper in apa..., how to choose a dissertation topic, how to write a phd research proposal, how to write an academic paragraph (step-by-step guide), maintaining academic integrity with paperpal’s generative ai writing..., research funding basics: what should a grant proposal..., how to write an abstract in research papers....

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base

Methodology

• Types of Research Designs Compared | Guide & Examples

Types of Research Designs Compared | Guide & Examples

Published on June 20, 2019 by Shona McCombes . Revised on June 22, 2023.

When you start planning a research project, developing research questions and creating a  research design , you will have to make various decisions about the type of research you want to do.

There are many ways to categorize different types of research. The words you use to describe your research depend on your discipline and field. In general, though, the form your research design takes will be shaped by:

• The type of knowledge you aim to produce
• The type of data you will collect and analyze
• The sampling methods , timescale and location of the research

This article takes a look at some common distinctions made between different types of research and outlines the key differences between them.

Table of contents

Types of research aims, types of research data, types of sampling, timescale, and location, other interesting articles.

The first thing to consider is what kind of knowledge your research aims to contribute.

Prevent plagiarism. Run a free check.

The next thing to consider is what type of data you will collect. Each kind of data is associated with a range of specific research methods and procedures.

Finally, you have to consider three closely related questions: how will you select the subjects or participants of the research? When and how often will you collect data from your subjects? And where will the research take place?

Keep in mind that the methods that you choose bring with them different risk factors and types of research bias . Biases aren’t completely avoidable, but can heavily impact the validity and reliability of your findings if left unchecked.

Choosing between all these different research types is part of the process of creating your research design , which determines exactly how your research will be conducted. But the type of research is only the first step: next, you have to make more concrete decisions about your research methods and the details of the study.

Read more about creating a research design

If you want to know more about statistics , methodology , or research bias , make sure to check out some of our other articles with explanations and examples.

• Normal distribution
• Degrees of freedom
• Null hypothesis
• Discourse analysis
• Control groups
• Mixed methods research
• Non-probability sampling
• Quantitative research
• Ecological validity

Research bias

• Rosenthal effect
• Implicit bias
• Cognitive bias
• Selection bias
• Negativity bias
• Status quo bias

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

McCombes, S. (2023, June 22). Types of Research Designs Compared | Guide & Examples. Scribbr. Retrieved August 26, 2024, from https://www.scribbr.com/methodology/types-of-research/

Is this article helpful?

Shona McCombes

Other students also liked, what is a research design | types, guide & examples, qualitative vs. quantitative research | differences, examples & methods, what is a research methodology | steps & tips, "i thought ai proofreading was useless but..".

I've been using Scribbr for years now and I know it's a service that won't disappoint. It does a good job spotting mistakes”

Research Methodologies

• What are research designs?

What are research methodologies?

Quantitative research methodologies, qualitative research methodologies, mixed method methodologies, selecting a methodology.

• What are research methods?
• Additional Sources

According to Dawson (2019),a research methodology is the primary principle that will guide your research.  It becomes the general approach in conducting research on your topic and determines what research method you will use. A research methodology is different from a research method because research methods are the tools you use to gather your data (Dawson, 2019).  You must consider several issues when it comes to selecting the most appropriate methodology for your topic.  Issues might include research limitations and ethical dilemmas that might impact the quality of your research.  Descriptions of each type of methodology are included below.

Quantitative research methodologies are meant to create numeric statistics by using survey research to gather data (Dawson, 2019).  This approach tends to reach a larger amount of people in a shorter amount of time.  According to Labaree (2020), there are three parts that make up a quantitative research methodology:

• Sample population
• How you will collect your data (this is the research method)
• How you will analyze your data

Once you decide on a methodology, you can consider the method to which you will apply your methodology.

Qualitative research methodologies examine the behaviors, opinions, and experiences of individuals through methods of examination (Dawson, 2019).  This type of approach typically requires less participants, but more time with each participant.  It gives research subjects the opportunity to provide their own opinion on a certain topic.

Examples of Qualitative Research Methodologies

• Action research:  This is when the researcher works with a group of people to improve something in a certain environment.  It is a common approach for research in organizational management, community development, education, and agriculture (Dawson, 2019).
• Ethnography:  The process of organizing and describing cultural behaviors (Dawson, 2019).  Researchers may immerse themselves into another culture to receive in "inside look" into the group they are studying.  It is often a time consuming process because the researcher will do this for a long period of time.  This can also be called "participant observation" (Dawson, 2019).
• Feminist research:  The goal of this methodology is to study topics that have been dominated by male test subjects.  It aims to study females and compare the results to previous studies that used male participants (Dawson, 2019).
• Grounded theory:  The process of developing a theory to describe a phenomenon strictly through the data results collected in a study.  It is different from other research methodologies where the researcher attempts to prove a hypothesis that they create before collecting data.  Popular research methods for this approach include focus groups and interviews (Dawson, 2019).

A mixed methodology allows you to implement the strengths of both qualitative and quantitative research methods.  In some cases, you may find that your research project would benefit from this.  This approach is beneficial because it allows each methodology to counteract the weaknesses of the other (Dawson, 2019).  You should consider this option carefully, as it can make your research complicated if not planned correctly.

What should you do to decide on a research methodology?  The most logical way to determine your methodology is to decide whether you plan on conducting qualitative or qualitative research.  You also have the option to implement a mixed methods approach.  Looking back on Dawson's (2019) five "W's" on the previous page , may help you with this process.  You should also look for key words that indicate a specific type of research methodology in your hypothesis or proposal.  Some words may lean more towards one methodology over another.

Quantitative Research Key Words

• How satisfied

Qualitative Research Key Words

• Experiences
• Thoughts/Think
• Relationship
• << Previous: What are research designs?
• Next: What are research methods? >>
• Last Updated: Aug 2, 2022 2:36 PM
• URL: https://library.tiffin.edu/researchmethodologies

Types of Research Methodology

Updated August 30, 2023

Introduction to Types of Research Methodology

Research methodology refers to the methods and techniques used to portray the research effectively. It concerns the systematic design of a study to guarantee results that meet the aims and objectives of the study. The researcher is primarily responsible for presenting the idea and explaining different research methodology types.

Key Takeaways

• Researchers employ various types of research methods to ensure that the data gathered is valuable and reliable.
• Researchers categorize research methodology types according to different criteria. They are a general category, the nature of the study, the purpose of the study, the research design, and the data types.
• Surveys and case studies are two of the most frequent data collection tools in research.
• Employing research methods has many merits, including assisting the researcher in developing the study field and conducting the research more efficiently. Both contribute to the researcher’s knowledge of the subject matter.

List of Types of Research Methodology

Research methodology is classified based on different categories. They include a general category, nature of the study, purpose, research design, and data type. There are also interviews and case studies based on research methodology. In some research, the researcher combines more than two and very few methods.

Based on General Category:

1. Quantitative Research

As the name suggests, Quantitative data relies on quantifying a certain amount or quantity of a specific phenomenon. It focuses on gathering and analyzing numerical data and can be used to find averages and patterns or to predict outcomes.

Quantitative Research falls within the two primary categories of research and relies on numbers. It draws a conclusion using tables, facts, and graphs. Many scientific and field-based studies primarily use this form of research.

Some pros and cons of Quantitative Research are as follows:

It allows for larger sample sizes, enables thorough analysis of the findings, and helps draw broader conclusions about your target audience.

Since quantitative research uses surveys, experiments, and real-time data collection, there are minimal delays in gathering the data under study. Therefore, the researcher analyzes the information under study quite rapidly compared to other research methodologies.

Due to anonymity, researchers frequently use quantitative data while examining sensitive topics. Consequently, this setting lowers the possibility of producing inaccurate data.

Since the researcher may be unable to conduct the research in the subjects’ natural environments, it may appear artificial and regulated. Participants’ responses are claimed and may not reflect their actual real-life behavior.

Because survey responses are limited, you cannot go beyond that in delving more deeply into the behaviors, attitudes, and motives as you can with qualitative research.

There is a financial element to consider with quantitative research because it can be costly.

2. Qualitative Research

It refers to the non-numerical elements in the research. Qualitative research comes to the rescue when the researcher cannot grasp the information or data regarding numbers. Though not as reliable as Quantitative research, qualitative research helps to form a better summary of theories in the data.

Moreover, this type of research is interested in discovering the motivating factors behind human behavior, i.e., why people act or think in a particular way. Through this research, one can understand the variables driving people to behave in a certain way or which govern their inclinations toward one specific thing.

Its pros and cons are as follows:

Studies can be performed more quickly since qualitative research use a smaller sample size than other research methodologies. Social scientists can efficiently gather data from participants using this framework, resulting in a generalization that will be helpful to the general public.

It enables a more in-depth exploration of attitudes and behavior because it’s more intimate and can go into specifics to better comprehend their thoughts and actions to formulate or examine a hypothesis.

It allows for flexibility because the interviewer can go into the subject and probe any questions they feel are relevant, and they can even alter the setting.

The people you select to participate in the qualitative research may all have a particular opinion about the subject matter rather than a group with different views, implying bias in the sample selection.

It takes a long time to gather the data since it takes time to filter through the elements to decide what is useful and what is not.

Some participants may be concerned about privacy, particularly when discussing sensitive matters.

Based on the nature of the research:

3. Descriptive Research

Descriptive research is a type of analysis that outlines the features of the population or issues under study. This type of methodology focuses more on the “what” of the research problem than the “why.” Since the researcher cannot influence the variables in this research design, they can only report the facts precisely as they occurred or are occurring.

The primary methods used in descriptive research include observations, surveys, and case studies. One can use many variables in descriptive research to explain the facts.

Its advantages include a) being effective at analyzing topics and issues that cannot rely on numbers, b) being observable in an unaltered natural environment, and c) taking less time than quantitative experiments.

4. Analytical Research

Analytical research uses proven facts to form the basis for the research. Researchers frequently research to find supporting data that strengthens and authenticates their earlier findings. Also, it helps to develop new concepts related to the research subject. Thus, analytical research combines minute details to produce more tenable hypotheses. The analytical study thus explains why a claim is valid.

There are various ways to conduct this research, including meta-analysis, literary or scientific trials, and learning about public opinion.

Moreover, the researcher carries out a critical evaluation of the material in this method. Analytical methods also often make use of quantitative methods.

Based on the purpose of the study:

5. Applied Research

Action research that only studies one domain and usually generalizes the findings is called applied research. The researcher regards the variables as constant, and the researcher forecasts, making the methods easy to find in applied research.

Applied research aims to solve a current issue facing society or a business/industrial organization. Applied research is considered non-systematic inquiry; a business, government body, or individual typically conducts this research to address a particular issue.

An instance would be a study of marketing tactics to appeal to Millenials’ goals in China.

6. Fundamental Research

Formulating a theory and generalizations are the primary concerns of fundamental research. It seeks to discover facts with various applications, supplementing the ideas already known in a specific field or industry.

Several domains are connected, aiming to discover how one can change traditional things or develop something new. One can find the summary in everyday language and apply logical findings in the research.

Some examples of fundamental research are research on generalizing human behavior or research on pure mathematics.

Based on the research design:

7. Exploratory Research

Theories and their explanation are the basis of Exploratory Research. Its goal is only to investigate the study questions, not to provide definitive and conclusive solutions to current problems.

Exploratory research seeks to increase our understanding of the issue rather than offering conclusive evidence. The structure is improper, and the methods offer a flexible and investigative approach. Therefore, one does not test the hypothesis, and the results do not help the outside world. The findings are usually a related topic, which helps improve the research.

Exploratory research is usually qualitative, but a large-sample exploratory study can also be quantitative. Due to its flexible and open-ended nature, it is often known as interpretive research or a grounded theory approach.

8. Conclusive Research

Conclusive research has a clear design in the methodology and intends to answer the research question. A well-thought-out structure helps formulate and solve the hypotheses and gives the results. The results are generic here.

Furthermore, it is essential to establish this study’s research objectives and data requirements, as conclusive research findings typically have a specific purpose. The results of exploratory studies can be validated and quantified using a conclusive research design.

A conclusive research design typically employs quantitative methods of data collection and analysis . In addition, conclusive research frequently takes a deductive research approach.

Based on the type of data:

9. Primary Research vs. Secondary Research

The researchers gather new data for primary research . The research classifies as primary when the researcher collects information on a certain topic for the first time. Surveys, interviews, and observation are common ways of gathering data.

On the other hand, secondary research uses previously gathered data through primary research. Books, magazines, trade journals, and other media majorly serve as secondary data sources. Moreover, the researcher does not gather primary data in this case.

As all primary studies entail gathering and analyzing secondary data during the literature review stage, it is vital to remember that primary research also involves secondary research. However, the key distinction between primary and secondary research is whether or not any researcher has undertaken the research previously.

Primary and secondary research each have pros and cons. Primary data is more time-consuming and expensive, even though it is need-specific and high-quality. Contrarily, secondary research is inexpensive, and the data collection is simple, but there is a chance that the information will be obsolete or unsuitable for one’s needs. Therefore, one must first assess these two options’ requirements, sources, expenses, etc., before selecting one.

Some common data collection methods:

10. Surveys

Customer Service Feedback Form

Surveys play a prominent role in the research method. It helps collect a vast amount of real-time data and helps the research process. It is done cheaply and is usually faster than any other method. A researcher can conduct surveys in both quantitative and qualitative methods. The researcher usually prefers quantitative surveys over qualitative ones as they provide numerical outputs and accurate data.

Surveys are mainly used in the business to know the demand for a product in the market. It also helps to forecast the production based on the research results.

Questionnaires and interviews are two of the most common types of surveys. While interviews are conducted in person to reflect on feelings and experiences and explore issues with a greater emphasis, researchers use questionnaires to acquire information quickly.

11. Case Studies

A common technique for qualitative analysis is the case study method, which entails thorough observation of a social unit and focuses on the in-depth study. The case study emphasizes the detailed examination of a smaller set of circumstances and their interactions. Finding the elements that collectively account for the behavior patterns of the provided unit is the goal of the case study method.

In this method of research methodology, the researcher considers different cases, and the proper one for the research is selected. Case studies help to develop an idea of the research and help in the foundation of the research.

One considers various facts and theories from the case studies that help to form proper reviews about the research topic. Researchers can make the topic general or specific according to the literature reviews from the studies. The researcher can make an appropriate understanding of the research from the case study.

Also, we have focus groups and research interviews to understand the types of research methods in a well-defined manner. Various methods can follow structured and unstructured methods.

Tips to Consider While Selecting a Research Methodology Type

• A clear objective should be in mind before beginning any research, as a good research question will be precise, applicable, and valuable. This indicates that you can fully address the issue and base judgments thereon.
• For the study to be reliable, the researcher must ensure proper representation of the relevant population . You must create inclusive surveys and questionnaires to ensure proper representation.
• Your interview questions should gather the necessary data and subtly address your research questions. Building rapport with the subjects is essential to accomplish this.
• Another consideration is the time you have available . If there are time restrictions, consider methods like convenience or random sampling and tools that enable data collection in a few days. In-person interviews and observations are options for data collection if more time is available.

During the research, the researcher employs several methods to explain the ideas; we will study the various types in this article. The selection of the method is entirely up to the researcher, and there are no restrictions on the type.

Advantages of Using Different Types of Research Methodology

• These various methodologies help attain the aim of the research, which is effectively analyzing the subject data. They provide verification and fact-checking, which is vital in a critical evaluation. It also presents different perspectives to view a matter.
• Surveys are quantitative methods that help obtain numerical statistics regarding research. With the help of numerical surveys, researchers can skip elaborate theses and achieve the necessary results without much hassle.
• Qualitative methods, including case studies, help to gain insight into the study. The researcher can directly delve deeper into the subject and study the behavioral pattern.
• The different methods help validate the research and improve its reliability. It also helps generalize the analysis for the majority of the audience.

The researchers make developments in all fields, and their studies are helpful to society in general. Understanding the types of research methods is essential to verify and validate the research in different fields. Additionally, it offers a thorough plan that aids in keeping researchers on the course, facilitating a simple, efficient, and manageable process.

Frequently Asked Questions(FAQs)

Q1. what is a mixed research method.

Answer: In a mixed methods study, researchers collect and analyze quantitative and qualitative data within the same study.

Q2. What is sampling?

Answer: A sample is a small fraction of people drawn from a larger population. Sampling is choosing the group from whom you will draw data for your research.

Q3. What is a research design?

Answer: A research design is a strategy for addressing your research question. It establishes the scope of your strategy and specifies the methods for data collection and analysis.

Q4. What is the difference between research methods and research methodology?

Answer: While the method aims to find a solution to the research problem, the goal of the methodology types is to examine the appropriateness of the methods used to find a solution. After all, the types of methodology are merely behaviors or tools utilized to choose a research approach. The methodology assesses all of the investigation’s approaches and procedures.

Recommended Articles

This is a guide to Types of Research Methodology. Here we discuss the 11 types of research methodology and their respective advantages. You may also have a look at the following articles to learn more –

• Types of Arduino
• Types of Motherboard
• What is Methodology?
• Project Management Methodology

*Please provide your correct email id. Login details for this Free course will be emailed to you

By signing up, you agree to our Terms of Use and Privacy Policy .

Download Customer Service Feedback Form

Web development, programming languages, Software testing & others

Forgot Password?

This website or its third-party tools use cookies, which are necessary to its functioning and required to achieve the purposes illustrated in the cookie policy. By closing this banner, scrolling this page, clicking a link or continuing to browse otherwise, you agree to our Privacy Policy

Explore 1000+ varieties of Mock tests View more

Submit Next Question

🚀 Limited Time Offer! - 🎁 ENROLL NOW

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• Research Briefing
• Published: 26 August 2024

A structural learning method to uncover how information between single cells flows

Nature Methods ( 2024 ) Cite this article

Metrics details

• Cellular signalling networks
• Computational models

Single-cell RNA-sequencing and spatial transcriptomics data enable the inference of how information is transmitted from one cell to another and how it modulates gene expression within cells. Now, a learning method infers networks describing how the inflow of one signal, mediated by intracellular gene modules, drives the outflow of other signals for intercellular communication.

This is a preview of subscription content, access via your institution

Access options

Access Nature and 54 other Nature Portfolio journals

Get Nature+, our best-value online-access subscription

24,99 € / 30 days

cancel any time

Subscribe to this journal

Receive 12 print issues and online access

251,40 € per year

only 20,95 € per issue

Buy this article

• Purchase on SpringerLink
• Instant access to full article PDF

Prices may be subject to local taxes which are calculated during checkout

Armingol, E., Baghdassarian, H. M. & Lewis, N. E. The diversification of methods for studying cell–cell interactions and communication. Nat. Rev. Genet. 25 , 381–400 (2024). A review on methods to infer cell–cell communication from single-cell and spatial transcriptomics.

Article   CAS   PubMed   Google Scholar  

Welch, J. D. et al. Single-cell multi-omic integration compares and contrasts features of brain cell identity. Cell 177 , 1873–1887 (2019). This paper presents a method to infer gene expression modules from multi-condition scRNA-seq data.

Article   CAS   PubMed   PubMed Central   Google Scholar  

Sachs, K. et al. Causal protein-signaling networks derived from multiparameter single-cell data. Science 308 , 523–529 (2005). This paper applies a graphical model learning method to single-cell flow cytometry data to discover a directed signaling network.

Squires, C., Wang, Y. & Uhler, C. Permutation-based causal structure learning with unknown intervention targets. Proceedings of the 36th Conference on Uncertainty in Artificial Intelligence (UAI) 124 , 1039–1048 (2020). This paper develops a graphical model learning method that can handle both control datasets and datasets in which the perturbed targets are unknown.

Wang, L. et al. Dictys: dynamic gene regulatory network dissects developmental continuum with single-cell multiomics. Nat. Methods 20 , 1368–1378 (2023). A paper that uses a stochastic differential equations approach to infer dynamic gene regulatory networks from scRNA-seq and scATAC-seq data.

Download references

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This is a summary of: Almet, A. A., Tsai, Y.-C., Watanabe, M. & Nie, Q. Inferring pattern-driving intercellular flows from single-cell and spatial transcriptomics. Nat. Methods https://doi.org/10.1038/s41592-024-02380-w (2024).

Rights and permissions

Reprints and permissions

About this article

Cite this article.

A structural learning method to uncover how information between single cells flows. Nat Methods (2024). https://doi.org/10.1038/s41592-024-02381-9

Download citation

Published : 26 August 2024

DOI : https://doi.org/10.1038/s41592-024-02381-9

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

arXiv's Accessibility Forum starts next month!

Help | Advanced Search

Mathematics > Numerical Analysis

Title: an overview on machine learning methods for partial differential equations: from physics informed neural networks to deep operator learning.

Abstract: The approximation of solutions of partial differential equations (PDEs) with numerical algorithms is a central topic in applied mathematics. For many decades, various types of methods for this purpose have been developed and extensively studied. One class of methods which has received a lot of attention in recent years are machine learning-based methods, which typically involve the training of artificial neural networks (ANNs) by means of stochastic gradient descent type optimization methods. While approximation methods for PDEs using ANNs have first been proposed in the 1990s they have only gained wide popularity in the last decade with the rise of deep learning. This article aims to provide an introduction to some of these methods and the mathematical theory on which they are based. We discuss methods such as physics-informed neural networks (PINNs) and deep BSDE methods and consider several operator learning approaches.

Submission history

Access paper:.

• Other Formats

References & Citations

• Google Scholar
• Semantic Scholar

BibTeX formatted citation

Bibliographic and Citation Tools

Code, data and media associated with this article, recommenders and search tools.

• Institution

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• SAGE Open Nurs
• v.10; Jan-Dec 2024
• PMC11337188

Nursing Students’ Experiences and Challenges in Their Education During COVID 19 Pandemic: A Mixed-Method Study

Puvaneswari kanagaraj.

1 Department of Nursing, College of Applied Medical Sciences, University of Bisha, Bisha, Kingdom of Saudi Arabia

Judie Arulappan

2 Department of Maternal and Child Health, College of Nursing, Sultan Qaboos University, Al Khoudh, Muscat, Sultanate of Oman

Arpita Pradhan

3 Narayana Multi Specialty Hospital, Kolkata, West Bengal, India

* Current address: Durgapur City Hospital and Clinic Pvt. Limited, Durgapur, West Bengal, India.

Shimmaa Mansour Moustafa Mohammed

4 Faculty of Nursing, Zagazig University, Zagazig, Egypt

Associated Data

Supplemental material, sj-docx-1-son-10.1177_23779608241272484 for Nursing Students’ Experiences and Challenges in Their Education During COVID 19 Pandemic: A Mixed-Method Study by Puvaneswari Kanagaraj, Judie Arulappan, Arpita Pradhan and Shimmaa Mansour Moustafa Mohammed in SAGE Open Nursing

Supplemental material, sj-docx-2-son-10.1177_23779608241272484 for Nursing Students’ Experiences and Challenges in Their Education During COVID 19 Pandemic: A Mixed-Method Study by Puvaneswari Kanagaraj, Judie Arulappan, Arpita Pradhan and Shimmaa Mansour Moustafa Mohammed in SAGE Open Nursing

Introduction

The COVID-19 outbreak disrupted the nursing education across the world. The nursing students faced many challenges in their learning process.

The study explored the experiences and challenges faced by nursing students who had virtual education in India.

The study adopted an exploratory sequential mixed-methods design. The study was conducted as two phases. Phase 1: Qualitative data were collected using direct focus group interview with 18 students. Phase 2: Quantitative data were collected from 477 students using a Likert scale prepared by the investigators of the study on challenges experienced by nursing students on their education. The analysis was done using the descriptive and inferential statistics and thematic analysis.

Phase 1: The analyzed data produced seven themes and 10 sub-themes; (1) technical issues—a concern, (2) regular rhythm in educational training—but not complete, (3) stress and strain, (4) evaluation—a concern, (5) communication, (6) comfort zone, and (7) easy distraction. Phase 2: Majority of the students (54.71%) experienced high-level challenges with the nursing education during pandemic. The overall mean and SD of all the domain-wise challenges were 103.39 + 7.11 with the range from 30 to 150. The mean and SD with educational challenges were (20.27 + 3.04), environmental challenges (6.92 + 1.66), communication challenges (17.61 + 4.01), technical challenges (17.39 + 3.75), evaluation challenges (7.09 + 1.94), physical and mental challenges (20.47 + 4.33), career challenges (7.06 + 1.91), and financial challenges (6.61 + 2.1). The demographic variable gender ( P  = 0.045) showed a statistically significant association with the challenges.

Considering the experiences and challenges faced by the nursing students, the nursing administrators shall design educational strategies to mitigate these challenges in nursing education during a pandemic.

Implication

Virtual nursing education offers flexibility in teaching and learning, self-paced learning opportunity, lower the costs, career advancement, comfortable learning environment, more opportunities for participation, easier to track documentation and improves skills in technology. Therefore, the challenges in virtual nursing education should be lessened to have successful teaching learning experiences.

Introduction/Background

The world faced unprecedented challenges during COVID-19 global pandemic ( World Health Organization, 2020 ). The pandemic changed the lives of people at different levels. Additionally, social distancing shaped the social relationship and behavior ( Kaveh et al., 2022 ). COVID-19 significantly strained the healthcare system. In addition, it affected the education in academic institutions and universities to a greater extent ( Dewart et al., 2020 ). As a preventive and control measure, all the schools, colleges, and universities were closed ( Mustafa, 2020 ). In April 2020, 94% of learners worldwide were affected by the pandemic, representing 1.58 billion children and youth in 200 countries ( De Giusti, 2020 ). Likewise, nursing education has undergone many radical changes both in developed and developing countries. The situation affected the learning opportunities of nursing students as their clinical placements were suspended and the face-to-face teaching moved into online teaching. Additionally, the pre-clinical activities such as laboratory and simulation-based teaching were affected due to social and organizational restrictions to limit unnecessary access and contact with others ( Tomietto et al., 2020 ).

To continue the teaching–learning activity, the academic institutions adopted various digital platforms including Zoom, Google meet, WebEx, Udemy, Edmodo, Google classroom, etc. ( Mishra et al., 2020 ). Moreover, web-based conferences were routinely organized by educational institutions during this pandemic ( Kaware, 2022 ). In addition, educational institutions have placed greater emphasis on ERP systems, library modules, fee modules, and examination modules. The virtual learning enhanced the comfort, accessibility, and encouraged remote learning ( Mukhtar et al., 2020 ). Similarly, the learners found it easy to access the online material, were able to record meetings and sessions and retrieve information ( Alsayed & Althaqafi, 2022 ). The faculty and students expressed that online education is useful during the COVID-19 pandemic; it was convenient, flexible, cost low, and encouraged self-learning ( Almahasees et al., 2021 ). Likewise, online education improved the flexibility, ability to teach large classes, increased interaction between the teachers and students and increased learning opportunities for the learners ( Hako, 2021 ). Ultimately, these educational technologies have had significant positive impact on the learning of the students. Additionally, it paves the way toward the blending of technology synchronously or asynchronously into education ( Thaheem et al., 2022 ).

Review of Literature

Although online education was beneficial to both the teachers and learners, it posed various challenges to the faculty and students ( Nimavat et al., 2021 ). Poor student attendance, loneliness, issues with internet connectivity and lack of information and technology skills were reported as challenges of online education ( Hako, 2021 ). The faculty and students indicated that efficacy of online teaching and learning is less effective than face–face teaching and learning. Moreover, online learning is ineffective for deaf and hard of hearing students. Likewise, online education is linked to lack of interaction and motivation, data privacy and security and technical issues ( Almahasees & Amin, 2021 ; Alsayed & Althaqafi, 2022 ). Furthermore, online education was inefficient in terms of maintaining academic integrity ( Mukhtar et al., 2020 ). The teachers reported difficulties in motivating the students without visual connection during online teaching ( Moustakas & Robrade, 2022 ). Also, Atout et al., (2022) reported lack of resources for the clinical learning, distracting home environment and challenging evaluation of learners as the barriers for virtual learning.

The challenges faced by the instructors includes transitional difficulties from offline to online teaching, communication barriers, changes in the teaching style and additional time and resources for preparation of teaching. The institutions experienced challenges such as need for additional training for faculty and students, technical and multimedia support, online counselling sessions for teachers and the need to have technical troubleshooting team. Students experienced challenges related to having technical skills to learn online, lack of readiness, network and speed issues, and lack of identity, interaction and participation. There were challenges related to content such as development of new material, regular assignments, multimedia tools, and checking assignments and sharing regular feedback with the students. Technological challenges included device suitability, network stability and speed, tools of conferencing software for online teaching and ease of use. Lastly, the motivational factors included lack of sense of job security, non-availability of salary on time, and lack of family support, mental and emotional support from colleagues and higher authorities ( Siddiquei & Kathpal, 2021 ).

To enhance the online teaching and learning, technical aptitude enhancement, resource management and utilization, time management, control over the learning environment and help seeking are essential ( Barrot et al., 2021 ). Furthermore, formal training for the teachers, and enhancement of psychosocial wellbeing of both the learners and teachers are necessary to curb the feelings of loneliness and isolation. Moreover, the nature of the problems related to the shift from face to face to online learning should be identified to combat these challenges ( Hako, 2021 ). In India, both the undergraduate and postgraduate students were badly affected during the COVID-19 pandemic and experienced many challenges with online education ( Joshi et al., 2020 ; Kamal & Illiyan, 2021 ; Muthuprasad et al., 2021 ; Pandit & Agrawal, 2022 ; Rannaware et al., 2022 ; Sengupta, 2022 ). However, very few studies explored the challenges encountered by the nursing students during the online learning ( Gaur et al., 2020a ; George et al., 2022 ; Kanagaraj et al., 2022 ; Lata & Kudi, 2022 ). Therefore, the authors decided to understand the experiences and challenges encountered by nursing students in their nursing education during the COVID-19 pandemic. We believe that the study finding will be beneficial to the educational authorities, curriculum developers, and policy makers to design appropriate measures and strategies to enhance effective learning both in nursing education and practice.

An exploratory sequential mixed-methods design was utilized in this study. The study integrated qualitative data into quantitative data to understand the experiences and challenges experienced by nursing students’ during the pandemic.

Research Setting

The study was conducted among nursing students of Narayana Hrudayalaya College of Nursing, Koshy's College of Nursing and Kirubanidhi College of Nursing, Bengaluru, Karnataka, India. These colleges initiated virtual classes from April 2020. Therefore, these colleges were selected as settings for the study.

The target population of the study included both Diploma and BSN students. The accessible population included both Diploma and BSN students studying in Narayana Hrudayalaya College of Nursing, Koshy's College of Nursing and Kirubanidhi College of Nursing, Bengaluru, Karnataka, India.

Sample, Sample Size, and Sampling Techniques

Three nursing colleges were conveniently selected for the study. In Phase 1, the researchers used purposive sampling technique to collect the qualitative data from six students in each college (Narayana Hrudayalaya College of Nursing, Koshy's College of Nursing and Kirubanidhi College of Nursing, Bengaluru, Karnataka, India). The data collection was done face to face. Thus, in total, 18 students participated in the focused group interview during phase I. For Phase 2, the sample size calculation was done based on the previous cross-sectional study ( Thapa et al., 2021 ). Having the expected proportion of challenges experienced by nursing students as 15%, with 95% confidence interval, and with the precision, the minimum required sample size was 400. In total, all the three nursing colleges had 654 students. Convenient sampling technique was used to collect the data in phase II.

Inclusion and Exclusion Criteria

The study included nursing students who were enrolled for Diploma and BSN program, exposed to online learning, and second, third, and fourth year nursing students. The study excluded those who were not willing to participate, and first year nursing students as they had limited exposure to the virtual theory and clinical classes, which may give a limited and inaccurate data. Considering the inclusion and exclusion criteria, 477 students participated in the study.

Description and Interpretation of Study Instrument

The instruments used in the study were prepared by the researchers of the study. The qualitative data collected during the first phase of the study was utilized in preparing the tool used for the quantitative phase of the study. It included four parts namely demographic variables, background variables, open-ended questions to explore the participant's experiences and challenges and Likert scale to assess the challenges.

Part 1 included the demographic variables of the participants including age, gender, course of study, year of study, residence, and place of attending online classes.

Part 2 comprised of the background variables such as gadgets used for attending online classes, source of internet, mode of theory classes taken during the last 6 months, mode of practical training, methods of teaching theory classes, audio visual aids used, and the virtual platform used.

Part 3 consisted of a questionnaire related to students’ experiences and challenges. It included 15 open-ended questions related to the aspects of theoretical learning, practical learning, study materials, teaching methodology, evaluation process, issues related to physical and mental health, issues related to technology and issues related to finance.

Lastly, Part 4 included a Likert scale on challenges having 30 questions with eight domains; educational challenges (six items), environmental challenges (two items), communication challenges (five items), technical challenges (five items), evaluation challenges (two items), physical challenges (six items), career challenges (two items), and financial challenges (two items). Dimensions were evaluated using 5-point Likert scale varying from strongly disagree (1), disagree (2), neutral (3), agree (4) and strongly agree (5). The total score ranges from 30 to 150. The domain-wise challenges were interpreted as 1–50 = low challenges, 51–100 = moderate challenges, 101–150 = high challenges. The instrument was prepared in English and no translations were done.

Reliability and Validity of the Tool

Content validity was obtained from eight experts in the field of nursing education. The calculated content validity index was 0.80. Pilot study was conducted with 10% of the study participants (42 students) to test the reliability of the tool before administering to the main study participants. Using Cronbach's alpha (inter-item reliability), the internal consistency assessed was 0.89, which is highly reliable. The participants participated in the pilot study were excluded from the main study.

Ethical Considerations

Ethical approval was obtained from the Research and Ethics Committee of Narayana Hrudayalaya College of Nursing (NHH/AEC-CL.2022-BI5 dated 22/3/2022), Kirubhanidhi College of Nursing (KCC/22/22 dated 04/3/2022), and Koshy's College of Nursing (KCN/15 dated 07/3/2022) and Institutional review board. After getting the ethical approvals, formal permission was obtained from the Head of Nursing colleges to collect data. The researchers explained the purpose of the study to the participants involved in both quantitative and qualitative data collection. The participants were informed that their participation in the study was voluntary. Since the participants were not forced to participate in the study, they were given the freedom to withdraw from the study at any time without any penalty. The participants signed the informed consent and responded to all the questions and returned the completed questionnaire. All the audio recordings were coded and password protected. It was explained to the participants that they were not exposed to any kind of risk. To keep the data anonymous, no identifying information was collected from the participants. The researchers maintained confidentiality of information throughout the study period. All the collected data were stored in a password protected file. Only, the investigators of the study had access to the data.

Data Collection (Qualitative Phase)

In Phase I of the study, three focus groups were selected using purposive sampling technique. Each group included six participants with a total of 18 nursing students. After getting the consent, the participants shared their experiences and challenges faced during their educational training in the pandemic. The interviews were conducted from 25/2/2022 to 25/3/2022 and each interview lasted for 1.30 h to 2 h. The first and third authors conducted the interview. The first author is a PhD and the third author is a BSN holder. The first author is an assistant professor and the third author is a staff nurse. Both of them were females. Both of them were trained in qualitative data collection. The researchers established rapport with the study participants. The researcher used 15 open-ended probing questions and the participants were given the freedom to express additional views and comments. All the interviews were conducted in person in the college and audio recorded with their consent. Focus group discussions were continued till the data saturation occurred. The transcripts were returned to the participants for their correction.

Data Collection (Quantitative Phase)

In Phase II, the quantitative data were collected using convenient sampling technique. The total number of students participated in the study were 477. The questionnaires were transferred to Google forms and were circulated to the students after explaining the objectives and getting the informed consent. The quantitative data were collected from 11/04/2022 to 20 /04/2022. The response rate was 72.9% (477) which included Narayana Hrudayalaya College of nursing (88 participants), Koshy's College of nursing (235 participants) and Kirubanidhi College of nursing (154 participants).

Data Analysis (Qualitative Phase)

The data were analyzed using thematic analysis. The collected data were transcribed and analyzed using Braun and Clarke's thematic analysis. Reflexive thematic analysis was performed in this study ( Clarke & Braun, 2017 ).

Data Analysis (Quantitative Phase)

The quantitative data were analyzed using descriptive and inferential statistics using SPSS version 22.

Credibility, Dependability, and Transferability

To ensure credibility of the data, the researcher strongly engaged with the focused group interviews by means of observation, documentation, and taking notes. Dependability was achieved through reviews and comments given by the research guide, who is the second author of the study who has full knowledge of the study design and methodology. The data collected from participants and the findings could be applicable to other contexts, situations, times, and populations and the study setting. It ensures transferability.

The researcher adhered to rigor by carefully collecting data via audio recordings and by taking field notes. Each focus group interview was transcribed immediately after the interview. The transcripts were given to the participants for cross-checking and approval. In addition to ensuring rigor through trustworthiness criteria, the authors followed mixed-methods research legitimation criteria by ensuring design quality, design suitability, within design consistency, design fidelity, and analytic adequacy ( Teddlie & Tashakkori, 2009 ).

Trustworthiness

Trustworthiness was established by using an unbiased approach in selecting the participants and by participant's being honest, clearly recorded, and accurately presented inputs. The transcriptions, coding, and themes–subthemes were discussed by the research team for their verification. Then based on the themes and subthemes the quantitative questionnaire was created by the researchers.

Phase 1 Qualitative Phase

Table 1 shows the frequency and percentage distribution of background variables of 18 participants who shared their experiences and challenges faced during their educational training in the pandemic. Table 2 shows the frequency and percentage distribution of participants’ background variables.

Table 1.

Frequency and Percentage Distribution of Demographic Variables of Nursing Students.

Table 2.

Frequency and Percentage Distribution of Baseline Variables of Nursing Students.

Experiences and Challenges Faced by the Nursing Students

In Phase 1, the experiences and challenges experienced by nursing students with their educational training during the pandemic were analyzed using thematic analysis. Table 3 reports seven themes and 10 sub-themes. The themes identified includes: (1) technical issues—a concern, (2) regular rhythm in educational training—but not complete, (3) stress and strain, (4) evaluation—a concern, (5) communication, (6) comfort zone, and (7) easy distraction. The sub-themes were: (1.1) problems with internet connectivity, (1.2) issues with the digital platform, (2.1) theoretical learning experience-better, (2.2) deficient practical skills, (3.1) physical stress, (3.2) mental stress, (4.1) unfair evaluation and lack of feedback, (5.1) decreased quality of communication, (6.1) very convenient, and (7.1) difficult to concentrate.

Table 3.

Themes and Subthemes of Experiences and Challenges Faced by Nursing Students.

Theme 1: Technical Issues: A Concern

Modern technology is progressive in all sectors. With this technology, it was possible to deliver training in all educational sectors including nursing education during COVID-19. Though it was helpful, technical problems interrupted the teaching–learning process. Most of the participants expressed their concern related to technical issues. It includes issues with internet connectivity, and issues with the digital platform.

Subtheme 1: Problems with Internet Connectivity

Constant network issues were an unavoidable fact for many students. Students could not be connected to the virtual class on time due to the internet connectivity issues and they had to miss attending the classes.

“Sometimes it keeps on showing error code and by the time I get connected the class is completed by the faculty” (5A).

Students stated that they faced technical and network issues while attending the classes.

“During online classes, we have faced a lot of technical and network issues” (2A).

In addition, fluctuations in the network connectivity were another technical issue faced by students and it affected the virtual learning of the students.

“I faced fluctuations in my network during a natural calamity in my place so I missed many classes during that time” (13A).

Subtheme 2: Issues with the Digital Platform

There are various platforms used to deliver online educational training. The participants expressed their difficulties as they had hitches in updating the digital platforms, and mentioned that the lack of experience in using the platforms affected their learning.

Digital platform did not work if the application is not updated on time. This was stated as below;

“If I did not update the app on time, it will not work” (1A).

Students faced problems in joining the virtual platform due to issues with the virtual platform.

“Sometimes I faced problems with joining with the virtual platform” (8A).

Lack of experience in using the virtual platform by both the faculty and student was another challenge stated by the students.

“Had struggle to join the meeting initially for both students and faculties because it was very new to us” (5A).

Students faced difficulties in submitting the assignments and answer sheets, as they did not have previous experience in submitting it through digital platforms.

“I struggled while submitting the answer sheets /assignment through digital platforms” (4A).

Theme 2: Regular Rhythm in Educational Training: But not Complete

Virtual education is a boon during pandemic. It took the education system in a rhythmic manner. Though the online lectures were beneficial, at times, students faced few challenges.

Subtheme 1: Online Theoretical Learning Experience

The students utilized the opportunities to learn from online classes with few challenges in attending online classes.

Commencement of online classes helped the students to have continuity in their studies. As the online classes were started on time immediately, it did not affect their theoretical learning.

“…It was not at all possible for the colleges to continue the offline classes so that the apex body instructed to start with online classes and it's good that we were in touch with our studies” (12A).

Different methods and techniques of teaching adopted during online classes enhanced interest in their learning.

“During online classes teacher used to teach with PPTs, and some good videos to make the session interesting. Sometimes they used to conduct lecture cum discussion. That time I was interested to listen to the class” (15A).

“I was interested to attend the online theory classes when teachers used to take a class by showing some videos related to theory content. It was good” (16A).

Students encountered issues with the storage of study materials as they had minimal storage space in their gadgets.

“Teachers used to send notes in PDF form in the mail or by WhatsApp. When I have storage issues in my gadgets, I deleted the content because of storage issues” (18A).

Subtheme 2: Deficient Practical Skills

Practical training is a major part of nursing profession. Students faced many challenges while attending online practical classes.

Most of the students stated that their theoretical learning through virtual mode was excellent. However, students felt that learning practical skills through direct clinical experience is rewarding than learning through virtual platform.

“…theory classes were very good. But in case of practical, like IV infusion, it was very easy to watch the procedure in a virtual platform, but it was very difficult to perform. I feel offline clinical exposure is better than online” (3A).

Students stated that they learnt basic nursing skills through direct clinical experience before the pandemic. However, the students lack confidence in performing the skills that they learnt through videos. The students felt nervous while performing the skills directly on the patients, as they did not get hands-on experience during virtual learning.

“…During my first-year clinical posting, I learnt basic procedure like vital signs checking, wound care, surgical dressing, etc with the direct clinical experience, suddenly everything goes on online, the faculty used to show us best videos. While watching videos I feel I can do. But when it's time to do directly, my hands were shivering and I was not confident. I feel offline exposure is better, we can get more exposure” (1A).

Huge gap in practical learning due to the pandemic affected the learning of the students. Thus, the students did not recommend online learning for learning the skills.

“I did not get adequate practical posting in my first year because of COVID-19. It continued with the second year too. So I have a huge gap with practical learning. For practical learning, online learning is not appropriate” (7A).

Theme 3: Stress and Strain

Prolonged online training affects the students’ physical as well as mental health. They felt more stressful.

Subtheme 1: Physical Stress

Students experienced physical symptoms such as strain in the eyes, neck pain, back pain and numbness in the legs due to prolonged usage of phone and sitting.

“I have to write my notes by seeing my phone. Every time I need to continuously see my mobile and make notes. It was straining my eyes and stressful for me” (16A).

“While attending online classes I used to keep my video on and listen to the class. Due to prolonged sitting, I have neck pain, eye strain also” (5A).

“I felt back pain and numbness in my leg while attending the online classes with prolonged sitting. I used to walk in between for some time to reduce the numbness” (12A).

Subtheme 2: Mental Stress

Students were anxious, as they could not complete the given tasks in online classes.

“I was anxious because I did not complete my task given in online classes, I was lazy” (4A).

As the students did not get practical experience in the clinical area, their confidence levels were low during the pandemic. Moreover, as the students did not get any opportunity to practice directly in the clinical area during the pandemic, they felt tensed and lacked confidence to directly practice on the patient after the pandemic.

“Due to lack of practice in clinical, my confidence had come down” (8A).

“I felt stressed out when I am thinking about my practical learning. I did not get adequate opportunity to practice” (10A).

“After lockdown when I came in the clinical setting, I was tensed about how I will handle the patient” (15A).

Theme 4: Evaluation: A Concern

Evaluation is the process of providing feedback to the students to improve themselves. The test, examination, assignment, and evaluation were new for the students and faculty during the pandemic and there were malpractice incidences by the students.

Sub-Theme 1 - Unfair Evaluation and Lack of Feedback

Students felt conducting exam using Google form as useful.

“Some faculties conducted few exams in Google Form, it was good because at that time I studied and attend the exam” (16A).

Malpractice in the online exam could be observed in the students during virtual learning.

“For the online exam, I never used to study because I can copy from PPT, my screenshots, or from Google and score good marks” (2A, 8A, 17A, 18A).

Students stated that they did not get proper feedback on their assignments.

“In my point of view, some faculties did not give us proper feedback on my assignment writing” (6A).

One student stated the unfair evaluation as the students copied scored well.

“I feel very bad when I write without copying and score very less marks; while the students who did malpractice scored well. So the evaluation was going very wrong” (4A).

Theme 5: Communication

It is necessary to build proper communication between the teachers and students to continue a smooth training session online. However, students felt that this distance learning created a communication gap between teachers and students.

Sub Theme 1- Decreased Quality of Communication

Limited and disrupted communication with the friends and teachers created distress in the students.

“It was not possible for me to communicate face to face with my friends and teachers during the online classes. It was quite distressing” (1A).

“Online class communication was the major problem. We could not communicate with faculties and peers like offline” (18A).

Students felt that they could not clarify their doubts with the faculty. However, faculty responded to their queries through WhatsApp and social media.

“If it comes to communication, it was very limited… During offline we can directly ask doubts to the faculty, but not now” (2A).

“During the online classes communication was not easy like face to face communication. But teachers were responding by WhatsApp and other social media after class time also” (6A).

Theme 6: Comfort Zone

Online classes were attended by the students either from hostel or home.

Subtheme 1: Very Convenient

Students felt comfortable staying home and attending online classes.

“It was convenient for me. Because I can stay at home, take care of my family and attend class also” (8A).

“For me, it was convenient, I got more time and can get up late to attend classes” (2A, 3A, 7A).

Students expressed that their transport expenses could be minimized, as they were not required to travel during the pandemic.

“I could save time. Even transport expenses could be minimized” (10A).

Theme 7: Distraction

Distraction was very high in online classes.

Sub-Theme 1: Difficult to Concentrate

Students were distracted during the online classes due to many notifications received from other online applications and disturbance from their siblings.

“As my internet is on I will get many notifications from other apps during class, it was a distraction for me” (4A, 9A, 11A).

“I attended online classes from my home only. I had disturbance from siblings, during my online classes” (7A, 16A).

Students themselves got distracted as they were using social media in between the online classes.

“I used to browse on Facebook, Instagram, YouTube, etc. during the online classes” (13A).

Phase 2: Quantitative Phase

Table 1 shows the frequency and percentage distribution of participant's demographic variables. Majority (90.6%) of the participants were in the age group between 18 and 23 years. Most of them were females (76.7%). 69.4% of the students were undergraduate (BSN) nursing students, while the rest were in Diploma nursing program. 47.4% of the participants were in their second and 47.4% were in their third year of study. Nearly half (45.3%) were from urban areas and 23.7 were from semi-urban areas, while the remaining (31%) were from rural areas. A large number (83.4%) of students attended the online classes from their hostels.

Table 2 outlines the frequency and percentage distribution of participants’ background variables. The results showed that the majority (98.3%) of the students used mobile phones to attend online classes. Most of them (94.5%) used the mobile data to have the internet connection. Almost half of the participants (52.6%) attended both online and offline classes. More than half (52.6%) of the participants had both online and offline practical exposure, and around 33% had offline clinical exposure. Most of the students (94.5%) attended lecture and discussion sessions. A huge number (93.3%) used power point presentation, and 45.7% of them used videos for teaching. Majority (60%) used Google Meet, while 52.4% used Zoom. The remaining used multiple platforms like Cisco, and Webex.

Figure 1 describes the frequency and percentage of distribution of level of challenges. It was classified as low, moderate, and high level of challenges. Majority of them (54.71%) experienced high-level challenges, 44.6% encountered moderate-level challenges, and the remaining experienced low-level challenges related to their nursing education during the pandemic.

Frequency and Percentage Distribution of Challenges Faced by Nursing Students During Their Educational Training.

The domain-wise challenges with nursing education during pandemic were shown in Table 4 . The eight domains included educational challenges, environmental challenges, communication challenges, technical challenges, evaluation challenges, physical and mental challenges, career challenges, and financial challenges. The mean and standard deviations for educational challenges is (20.27 ± 3.04), environmental challenges (6.92 ± 1.66), communication challenges (17.61 ± 4.01), technical challenges (17.39 ± 3.75), evaluation challenges (7.09 ± 1.94), physical and mental challenges (20.47 ± 4.33), career challenges (7.06 ± 1.91), and financial challenges (6.61 ± 2.1). The overall mean and S.D. of all the domain was 103.39 ±  1 7.11 with the range from 30 to 150.

Table 4.

Assessment of Mean and Standard Deviation of Domain-Wise Challenges Faced by the Nursing Students n  = 477.

Table 5 displays the item-wise challenges. The results of Educational Challenges indicated that almost 38.57% responded that they lack interest in learning. 15.93% either strongly agreed or agreed that face-to-face learning is very effective than E-learning. A larger portion (78.62%) of participants mentioned that the notes and lectures were inadequate. More than half of the participants (54.3%) agreed that virtual demonstration is not very effective for the practical patient care, and 61.21% mentioned that they lack confidence while taking care of patients. The participants provided similar responses during the qualitative phase of the study. The students lack confidence in performing the skills that they learnt through videos. Similarly, the students felt nervous while performing the skills directly on the patients, as they did not get hands-on experience during virtual learning. However, one third of the respondents (33.75%) expressed that they could learn the modern ways of handling patients through videos.

Table 5.

Item-Wise/Domain-Wise Analysis of Challenges Faced by Nursing Students.

With regard to Environmental challenges , 41.51% expressed that they were comfortable with their home or hostel environment to attend online classes. However, more than half (58.91%) said that they were easily distracted while attending classes. Similar findings were seen in the qualitative phase of the study. Students were distracted during the online classes due to many notifications received from other online applications and disturbance from their siblings. Further, the students were distracted as they were using social media during the online class.

In terms of Communication challenges , almost half of them (46.96%) expressed that they had difficulty in sharing their view with the teachers, and 45.91% said that teacher–student interaction was passive. More than half (57.86%) of them expressed that peer group socialization has decreased, missed interaction (48.64%) with other college mates/seniors and experienced loneliness (56.6%) without interacting much with peer groups. Similar to these findings in the quantitative phase, in qualitative phase, the students mentioned that limited and disrupted communication with the friends and teachers created distress in the students. Moreover, the students could not clarify their doubts with the faculty.

Regarding Technical challenges , 44.03% had uncertain internet connection that interrupted the learning process. Around 37.32% expressed that the teachers had difficulty in using technical aspects of the online platforms initially. Around 39.63% had internet issues in their place. Almost 55.56% students faced technical issues with learning platform/device and around 59.54% had difficulty while submitting the answer sheets/assignment through digital platforms. Likewise, the qualitative findings revealed that the students faced technical and network issues while attending the classes. In addition, fluctuation in the network connectivity was another technical issue faced by students and it affected virtual learning. The participants expressed their concerns as they had difficulties in updating the digital platforms, and mentioned that the lack of experience in using the platforms affected their learning. Students faced difficulties in submitting the assignments and answer sheets, as they did not have previous experience in submitting it through digital platforms.

Related to Evaluation challenges , almost half of them (51.15%) mentioned that the online evaluation might create irrational discrimination between students with network issues, and 51.99% of them said that the evaluation/test conducted online was unfair. Consistent findings could be noted during the qualitative phase of study. Students mentioned that malpractice in the online exam occurred and it affected their grades. In addition, students stated that they did not get proper feedback on their assignments.

With respect to Physical and mental challenges , more than half 62.06% experienced physical strain like headache, backache, neck pain, and eye strain, 47.17% experienced insomnia, around 70.86% had mental stress, 46.75% got addicted to phone due to prolonged usage other than for learning purpose, 56.82% mentioned that the regular life style has changed, and lastly 48.21% were worried about the online teaching applications which lack proper security system. Likewise, same results are discovered in the qualitative phase of the study. Students experienced physical symptoms such as strain in the eyes, neck pain, back pain, and numbness in the legs due to prolonged sitting and continuous usage of phone. Additionally, students were anxious, as they could not complete the given tasks in online classes. Further, as the students did not get practical experience in the clinical area, their confidence levels were low and they felt tensed and lacked self-confidence to directly practice on the patients after the pandemic.

In terms of Career challenges , 56.4% agreed that virtual practical training may affect their career as a registered nurse, and 49.06% agreed that they may not be able to work as a skillful nurse with the virtual learning. Regarding Financial challenges , almost 58.07% agreed that extra money was spent for good internet package and 38.37% bought a new laptop/mobile/electric gadget to attend virtual classes.

With regard to association of demographic variables, only gender (χ 2  = 6.218, p  = 0.045) has shown statistically significant association with problems or challenges faced by the nursing students during educational training in the pandemic at p  < 0.05 level of significance.

During COVID-19 pandemic, face-to-face teaching and learning were converted to virtual learning and the clinical experiences were suspended to protect the students from the pandemic ( Agu et al., 2021 ). The experiences with the online classes were very new for the nursing students. Moreover, the online education became unavoidable and was a good choice for the faculty and students during this pandemic across the world. Even though, the students and teachers had a positive view of the technology, which helped in the teaching–learning process during pandemic, it posted many challenges ( Mousavizadeh, 2022 ).

We conducted a mixed-methods study to explore the experiences and challenges faced by nursing students in their education during COVID-19 in India. The study adopted an exploratory sequential mixed-methods design. The study was conducted as two phases; the qualitative data were collected during Phase I using focus group interview with the students. The qualitative data collected during the first phase of the study was utilized in preparing the tool for the quantitative phase of the study. The quantitative data were collected using a Likert scale prepared by the investigators of the study on challenges experienced by nursing students on their education. During Phase 1, the analyzed data produced seven themes and 10 sub-themes on the challenges. These themes produced during the qualitative phase further explained the challenges experienced by the nursing students in their education during COVID-19 pandemic in the quantitative phase.

Educational Challenges

Learning motivation encourages learners’ activities and directs and maintains their progress, allowing students to immerse themselves in learning ( Kim, 2020 ). However, virtual learning decreased students’ attention and interest in classes, which then decreased their motivation to learn ( Morfaki & Skotis, 2022 ). Likewise, in the current study most of the students expressed that they lost interest in their learning. Student's interest is very important for academic achievement, so different methods of teaching and learning need to be adopted in future to improve the learning among students during online education ( Mousavizadeh, 2022 ).

During COVID-19 pandemic, the medical and nursing institutions used learning management systems (LMS) and uploaded various reading materials, videos, quizzes, and presentations to encourage the engagement of students in asynchronous learning activities. In addition, online discussion forums were created to facilitate the virtual learning process ( Atwa et al., 2022 ). Some students preferred online learning as it provides structured learning materials and enables studying from home at their own pace and convenience ( Paechter et al., 2010 ; Zheng et al., 2021 ). However, most of the students in different studies conducted across the world preferred face-to-face learning for acquiring motor skills, for establishing interpersonal relationships, and for achieving student learning outcomes ( Arias et al., 2018 ; Faidley, 2021 ; Ramani & Deo, 2021 ; Lim et al., 2021 ). Similarly, Muthuprasad et al. (2021) advocated that the online mode of learning may not be a viable option for practical/skill-oriented courses and therefore hybrid/blended curriculum involving both face to face and online modes of learning shall be adopted by the institutions.

The faculty used different methods of teaching and audio visual aids to enhance the teaching–learning process during the pandemic ( Reimers et al., 2020 ). However, students in the present study mentioned that the notes/lecture content were inadequate. Similar findings were reported in other studies that the quality and effectiveness of lecture were low; and inconsistencies were observed in some professor's lecture during COVID-19 ( Cengiz et al., 2022 ; Dziurka et al., 2022 ; Mousavizadeh, 2022 ; Mukasa et al., 2021 ; Rohde et al., 2022 ). This warrants the educational institutions to monitor the quality of teaching delivered by the faculty to their students during this pandemic. In addition, the faculty should take self-initiatives for the professional empowerment ( Osmanovic Zajic et al., 2022 ).

The professional preparation of nurses involves many hours of practical and theoretical classes which is conducted face to face, which gives a real learning experience ( Dziurka et al., 2022 ). However, COVID-19 pandemic caused alterations, restrictions, limited clinical placements and simulation training in the campus ( Rohde et al., 2022 ). Thus, many nursing institutions adopted virtual theoretical and practical learning modes. Various studies across the world including the present study reported that virtual practical learning was inappropriate and ineffective in doing practical skills. Additionally, the nursing students lack confidence in taking care of the patients as they did not have hands on training ( Cengiz et al., 2022 ; Dziurka et al., 2022 ; Gheshlagh et al., 2022 ; Mukasa et al., 2021 ; Rohde et al., 2022 ; Wajid & Gedik, 2022 ). Therefore, in addition to direct face-to-face practical training in the clinical areas, more nursing simulations, virtual reality, artificial intelligence and telenursing should be utilized to enhance the practical learning of nursing students ( Dziurka et al., 2022 ).

Environmental Challenges

Student engagement during the virtual classes are very essential. The students are expected to actively participate, show positive conduct, self-regulated, display deep learning and understanding, and should demonstrate positive reactions to the learning environment, peers, and teachers ( Bond et al., 2020 ). However, students in the current study and many other studies were distracted very easily while attending online classes, which limited their learning during pandemic ( Bergdahl, 2022 ; Farrell & Brunton, 2020 ; Fazza & Mahgoub, 2021 ; Hollister et al., 2022 ). Therefore, more peer-to-peer conversations and faculty–student exchanges are recommended to enhance the engagement and learning during the pandemic.

Communication Challenges

Effective communication between the educator and the students enhances the learning experience and creates a positive learning environment. In addition, it improves the exchange of ideas, knowledge, and thought to fulfill the purpose of teaching and learning. However, ineffective communication creates frustration, impaired interpersonal relationships, and lack of motivation ( Alawamleh e al., 2020 ). In consistent to this study, the present participants had difficulty in sharing their view with the teachers, could not socialize with peer groups, and experienced loneliness. Furthermore, studies reported that impaired communication during online learning creates uncertainties and insufficiencies in learning ( Cengiz et al., 2022 ; Mousavizadeh, 2022 ; Mukasa et al., 2021 ). Thus, effective communication with the students should be streamlined for successful virtual learning ( Mukasa et al., 2021 ).

Technical Challenges

Online education can be effectively integrated in the nursing curriculum as it guarantees effective problem-based learning. However, the nursing colleges were not adequately prepared to effectively utilize the online teaching and learning in developing and under developed countries ( Molefe & Mabunda, 2022 ). Technical aptitude was lacking among the faculty and students, which posed various challenges ( Barrot et al., 2021 ). Moreover, technical challenges limited the satisfaction of students and faculty toward online teaching and learning ( Mahyoob, 2020 ). Furthermore, failure of internet services, website failures, problems in logging into the site disrupted the teaching–learning process during the pandemic ( Fuchs, 2022 ; Gaur et al., 2020b ). Similar to these studies, the present study participants mentioned that they experienced uncertain internet connection, faced technical issues with learning platform/device, and had difficulty while submitting the answer sheets /assignment through digital platforms. In addition, the teachers had difficulty in using technical aspects of the online platforms. This calls for improving the instructional design and pedagogical methods by training the faculty and students to utilize the digital platforms effectively, which might improve the motivation and engagement of faculty and students during the online education ( Aivaz & Teodorescu, 2022 ).

Evaluation Challenges

Significant changes in the teaching and learning during the pandemic created profound opportunities and threats. Stakeholders and students reported that the evaluation during online learning was biased and ineffective ( Krishnamurthy, 2020 ) and experienced uncertainty toward the examination ( Idris et al., 2021 ). Besides, online learning affects the test scores and grades, student outcomes, attitude, and overall satisfaction with learning ( Szopiński & Bachnik, 2022 ). In the same way, the students in the current study mentioned that the online evaluation created irrational discrimination between students and the evaluation conducted online was unfair. Therefore, standard setting in the evaluation is an essential step considering the learners and educator's perspective, which would improve the teaching–learning process ( Wasfy et al., 2021 ).

Physical and Mental Challenges

COVID-19 pandemic disproportionately affected the physical and mental health of students ( Ro et al., 2021 ). Students missed eating, did not participate in extracurricular activities, and experienced computer-related physical stress ( Idris et al., 2021 ). Likewise, students experienced increased stress due to homework, social isolation and lack of social interactions ( Rao & Rao, 2021 ). In congruent with these study findings, the participants in the present study experienced headache, backache, neck pain, eye strain, insomnia, and mental stress. The authors recommend addressing the physical and mental health issues of the students by promoting the utilization of physical, emotional, and mental health support programs ( Idris et al., 2021 ).

Career Challenges

COVID-19 pandemic impacted the career preference, career perspective, and ideal workplace ( Wang et al., 2022 ). In the same way, the students struggled with the career decision-making process during the pandemic ( Jemini-Gashi & Kadriu, 2022 ). Likewise, working students lost their jobs, which affected their lives, studies, and health ( Tsurugano et al., 2021 ). In line with these studies, students of the present study expressed that virtual practical training will affect their career as a registered nurse and they may not be able to work as a skillful nurse. This calls for the initiation of a structured and well-designed practical training program for the nursing students in the hospitals before their placement as a registered nurse in the clinical practice.

Financial Challenges

The pandemic put a number of students under financial strain, which severely affected their mental well-being ( Negash et al., 2021 ). Similarly, the university students were disproportionately affected by the economic consequences of the pandemic, which escalated the economic uncertainty ( Gewalt et al., 2022 ). The students who lost their economic resources during pandemic experienced higher prevalence of depressive symptoms ( Tancredi et al., 2022 ). Participants in the current study mentioned that they had to spend extra money for good internet package and bought a new laptop/mobile /electric gadget to attend virtual classes, which increased their economic burden. To counterbalance these economic challenges, financial aid schemes for students need to be made available to relieve distress and allow students to focus on their studies ( Gewalt et al., 2022 ).

Strengths and Limitations

The study findings are limited to only few nursing colleges in India. Therefore, the study findings may not be generalizable to other states of India. As the study population was not selected through probability sampling strategy, the representativeness of samples might be lacking in the current study. Moreover, the study instruments were prepared by the investigators of the study that did not undergo rigorous standardization process, which might limit the strength of the study. Based on the study findings, the institutions where the study was conducted should design strategies to mitigate the challenges to have effective teaching and learning.

Implications for Practice

Virtual nursing education can be improved by refining the content and delivery methods, training of nursing faculty to use online educational strategies, and by reducing the technical and environmental barriers. Hybrid and blended teaching–learning strategies may further improve the learning among nursing students.

Virtual education can be very successful if we address the challenges and experiences of the students by performing appropriate groundwork by upgrading the required hardware and software, teaching how to use the facilities, and developing innovative teaching techniques and standard protocols for virtual education.

Supplemental Material

Acknowledgments.

The authors thank the students and faculty members who participated in this study. The authors are thankful to the Deanship of Graduate Studies and Scientific Research at University of Bisha, Saudi Arabia for supporting this work through the Fast-Track Research Support Program. The authors would like to acknowledge the nursing students who have participated in the study. Special thanks to the administrators and faculty members of the institutions for their motivation and support during data collection.

Author Contributions: PK designed and conducted the study and wrote the initial draft of the manuscript. JA edited and added additional content and refined the manuscript. AP collected the data. SM edited the manuscript.

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Ethical Approval: Ethical approval was obtained from the Research and Ethics Committee of Narayana Hrudayalaya College of Nursing (NHH/AEC-CL.2022-BI5 dated 22/3/2022), Kirubhanidhi College of Nursing (KCC/22/22 dated 04/3/2022), and Koshy's College of Nursing (KCN/15 dated 07/3/2022).

Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The authors are thankful to the Deanship of Graduate Studies and Scientific Research at University of Bisha, Saudi Arabia for supporting this work through the Fast-Track Research Support Program.

ORCID iDs: Judie Arulappan https://orcid.org/0000-0003-2788-2755

Shimmaa Mansour Moustafa Mohammed https://orcid.org/0000-0002-2956-610X

Supplemental Material: Supplemental material for this article is available online.

• Agu C. F., Stewart J., McFarlane-Stewart N., Rae T. (2021). COVID-19 pandemic effects on nursing education: Looking through the lens of a developing country . International Nursing Review , 68 ( 2 ), 153–158. 10.1111/inr.12663 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Aivaz K. A., Teodorescu D. (2022). College students’ distractions from learning caused by multitasking in online vs. face-to-face classes: A case study at a public university in Romania . International Journal of Environmental Research and Public Health , 19 ( 18 ), 11188. 10.3390/ijerph191811188 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Alawamleh M., Al-Twait L. M., Al-Saht G. R. (2022). The effect of online learning on communication between instructors and students during COVID-19 pandemic . Asian Education and Development Studies , 11 ( 2 ), 380–400. 10.1108/AEDS-06-2020-0131 [ CrossRef ] [ Google Scholar ]
• Almahasees Z., Mohsen K., Amin M. O. (2021). Faculty’s and students’—perceptions of online learning during COVID-19. Frontiers in Education , 6 , 638470. 10.3389/feduc.2021.638470 [ CrossRef ] [ Google Scholar ]
• Alsayed R. A., Althaqafi A. S. A. (2022). Online learning during the COVID-19 pandemic: Benefits and challenges for EFL students . International Education Studies , 15 ( 3 ), 122–129. 10.5539/ies.v15n3p122 [ CrossRef ] [ Google Scholar ]
• Arias J. J., Swinton J., Anderson K. (2018). Online vs. face-to-face: A comparison of student outcomes with random assignment . E-Journal of Business Education and Scholarship of Teaching , 12 ( 2 ), 1–23. [ Google Scholar ]
• Atout M., Alrimawi I., Mohammed Ali A., Dreidi M., Abu Khader I., Jaghama M. (2022). Challenges to online education during the time of COVID-19: A focus group study . Nursing Forum , 57 ( 6 ), 1120–1128. 10.1111/nuf.12800 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Atwa H., Shehata M. H., Al-Ansari A., Kumar A., Jaradat A., Ahmed J., Deifalla A. (2022). Online, face-to-face, or blended learning? Faculty and medical students’ perceptions during the COVID-19 pandemic: A mixed-method study . Frontiers in Medicine , 9 , 15. 10.3389/fmed.2022.791352 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Barrot J. S., Llenares I. I., Del Rosario L. S. (2021). Students’ online learning challenges during the pandemic and how they cope with them: The case of the Philippines . Education and Information Technologies , 26 ( 6 ), 7321–7338. 10.1007/s10639-021-10589-x [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Bergdahl N. (2022). Engagement and disengagement in online learning . Computers & Education , 188 , 104561. 10.1016/j.compedu.2022.104561 [ CrossRef ] [ Google Scholar ]
• Bond M., Buntins K., Bedenlier S., Zawacki-Richter O., Kerres M. (2020). Mapping research in student engagement and educational technology in higher education: A systematic evidence map . International Journal of Educational Technology in Higher Education , 17 ( 1 ), 1–30. 10.1186/s41239-019-0176-8 [ CrossRef ] [ Google Scholar ]
• Cengiz Z., Gurdap Z., Işik K. (2022). Challenges experienced by nursing students during the COVID-19 pandemic . Perspectives in Psychiatric Care , 58 ( 1 ), 47–53. 10.1111/ppc.12923 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Clarke V., Braun V. (2017). Thematic analysis . The Journal of Positive Psychology , 12 ( 3 ), 297–298. 10.1080/17439760.2016.1262613 [ CrossRef ] [ Google Scholar ]
• De Giusti A. (2020). Book review: Policy brief: Education during COVID-19 and beyond . Revista Iberoamericana de Tecnología En Educación y Educación En Tecnología , ( 26 ), 110–111. https://doi.org//10.24215/18509959.26.e12 [ Google Scholar ]
• Dewart G., Corcoran L., Thirsk L., Petrovic K. (2020). Nursing education in a pandemic: Academic challenges in response to COVID-19 . Nurse Education Today , 92 , 104471. 10.1016/j.nedt.2020.104471 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Dziurka M., Machul M., Ozdoba P., Obuchowska A., Kotowski M., Grzegorczyk A., Pydyś A., Dobrowolska B. (2022). Clinical training during the COVID-19 pandemic: Experiences of nursing students and implications for education . International Journal of Environmental Research and Public Health , 19 ( 10 ), 6352. 10.3390/ijerph19106352 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Faidley J. K. (2021, March). A comparison of learning outcomes from online and face-to-face accounting courses at a four-year university. In ARBS 2021 Proceedings 8th Annual Conference Held Virtually on March 26, 2021, Hosted by Eastern Kentucky University Richmond, KY (Vol. 2, p. 44). [ Google Scholar ]
• Farrell O., Brunton J. (2020). A balancing act: A window into online student engagement experiences . International Journal of Educational Technology in Higher Education , 17 ( 1 ), 1–19. 10.1186/s41239-020-00199-x [ CrossRef ] [ Google Scholar ]
• Fazza H., Mahgoub M. (2021). Student engagement in online and blended learning in a higher education institution in the Middle East: Challenges and solutions . Studies in Technology Enhanced Learning , 2 ( 1 ), 417–431. https://doi.org//10.21428/8c225f6e.5bcbd385 [ Google Scholar ]
• Fuchs K. (2022). The difference between emergency remote teaching and e-learning . Frontiers in Education , 7 , 353. 10.3389/feduc.2022.921332 [ CrossRef ] [ Google Scholar ]
• Gaur R., Mudgal S. K., Dharni I. T., Sharma R., Suyal N. (2020a). Barriers encountered during online classes among undergraduate nursing students during COVID-19 pandemic in India . International Journal of Research in Medical Sciences , 8 ( 10 ), 3687–3693. 10.18203/2320-6012.ijrms20204252 [ CrossRef ] [ Google Scholar ]
• Gaur U., Majumder M. A. A., Sa B., Sarkar S., Williams A., Singh K. (2020b). Challenges and opportunities of preclinical medical education: COVID-19 crisis and beyond . SN Comprehensive Clinical Medicine , 2 ( 11 ), 1992–1997. 10.1007/s42399-020-00528-1 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• George R. J., Kunjavara J., Bagilkar V. V., Menon S. A., Sam S. T. (2022). Perceived benefits and challenges of online learning among nursing students during COVID-19 pandemic: A qualitative phenomenological approach . AIP Conference Proceedings , 2393 ( 1 ), 020103. AIP Publishing LLC. 10.1063/5.0074208 [ CrossRef ] [ Google Scholar ]
• Gewalt S. C., Berger S., Krisam R., Krisam J., Breuer M. (2022). University students’ economic situation during the COVID-19 pandemic: A cross-sectional study in Germany . Plos One , 17 ( 10 ), e0275055. 10.1371/journal.pone.0275055 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Gheshlagh R. G., Ahsan M., Jafari M., Mahmoodi H. (2022). Identifying the challenges of online education from the perspective of University of Medical Sciences Students in the COVID-19 pandemic: A Q-methodology-based study . BMC Medical Education , 22 ( 1 ), 1–7. 10.1186/s12909-022-03980-w [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Hako A. (2021). Benefits and challenges of online teaching during the COVID-19 pandemic at Rundu campus of the University of Namibia . European Journal of Educational Sciences , 8 ( 4 ), 53–64. 10.19044/ejes.v8no4a53 [ CrossRef ] [ Google Scholar ]
• Hollister B., Nair P., Hill-Lindsay S., Chukoskie L. (2022). Engagement in online learning: Student attitudes and behavior during COVID-19 . Frontiers in Education , 7 , 851019. Frontiers Media SA. 10.3389/feduc.2022.851019 [ CrossRef ] [ Google Scholar ]
• Idris F., Zulkipli I. N., Abdul-Mumin K. H., Ahmad S. R., Mitha S., Rahman H. A., Rajabalaya R., David S. R., Naing L. (2021). Academic experiences, physical and mental health impact of COVID-19 pandemic on students and lecturers in health care education . BMC Medical Education , 21 , 1–13. 10.1186/s12909-021-02968-2 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Jemini-Gashi L., Kadriu E. (2022). Exploring the career decision-making process during the COVID-19 pandemic: Opportunities and challenges for young people . SAGE Open , 12 ( 1 ), 21582440221078856. 10.1177/21582440221078856 [ CrossRef ] [ Google Scholar ]
• Joshi A., Vinay M., Bhaskar P. (2020). Online teaching amidst COVID-19 in India: An outlook . Asian Journal of Distance Education , 15 ( 2 ), 105–111. 10.5281/zenodo.4294477 [ CrossRef ] [ Google Scholar ]
• Kamal T., Illiyan A. (2021). School teachers’ perception and challenges towards online teaching during COVID-19 pandemic in India: An econometric analysis . Asian Association of Open Universities Journal , 16 ( 3 ), 311–325. 10.1108/AAOUJ-10-2021-0122 [ CrossRef ] [ Google Scholar ]
• Kanagaraj P., Sakthivel R., Christhumary P. C., Arulappan J., Matua G. A., Subramanian U., Kanagaraj A., Jacob J., Muniyandi H. (2022). Nursing student's satisfaction with virtual learning during COVID-19 pandemic in India . SAGE Open Nursing , 8 , 23779608221144933. 10.1177/23779608221144933 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Kaveh O., Charati F. G., Kamali M., Mojarrad F. A. (2022). Clinical nursing education during the COVID-19 pandemic: Perspectives of students and clinical educators . BMC Nursing , 21 ( 1 ), 286. 10.1186/s12912-022-01029-3 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Kaware S. S. (2022). Use of online teaching learning resources during COVID-19 pandemic: An overview . Sustainable Society: A New Beginning , 230. [ Google Scholar ]
• Kim J. W. (2020). The structure model analysis of cyber university learners’ academic self-efficacy, learning motivation, self-directed learning and learning flow . Journal of the Korea Academia-Industrial Cooperation Society , 21 ( 11 ), 443–454. [ Google Scholar ]
• Krishnamurthy S. (2020). The future of business education: A commentary in the shadow of the COVID-19 pandemic . Journal of Business Research , 117 , 1–5. 10.1016/j.jbusres.2020.05.034 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Lata K., Kudi S. R. (2022). Nursing students perception regarding online classes during 2nd COVID-19 wave in India . Asian Journal of Nursing Education and Research , 12 ( 3 ), 3. 10.52711/2349-2996.2022.00061 [ CrossRef ] [ Google Scholar ]
• Lim S., Yang I., Kim S. (2021). A survey on the perception of elementary school field education in the context of COVID-19 based on the teaching . Journal of Learner-Centered Curriculum and Instruction , 21 ( 2 ), 371–400. 10.29333/ejmste/11308 [ CrossRef ] [ Google Scholar ]
• Mahyoob M. (2020). Challenges of e-learning during the COVID-19 pandemic experienced by EFL learners . Arab World English Journal (AWEJ) , 11 ( 4 ), 351–362. 10.24093/awej/vol11no4.23 [ CrossRef ] [ Google Scholar ]
• Mishra L., Gupta T., Shree A. (2020). Online teaching-learning in higher education during lockdown period of COVID-19 pandemic . International Journal of Educational Research Open , 1 , 100012. 10.1016/j.ijedro.2020.100012 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Molefe L. L., Mabunda N. F. (2022). Online teaching and learning: Experiences of students in a nursing college during the onset of COVID-19 . Curationis , 45 ( 1 ), 10. 10.4102/curationis.v45i1.2372 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Morfaki C., Skotis A. (2022). Academic online learning experience during COVID-19—a systematic literature review based on personality traits . Higher Education, Skills and Work-Based Learning (ahead-of-print). 10.1108/HESWBL-03-2022-0062 [ CrossRef ] [ Google Scholar ]
• Mousavizadeh S. N. (2022). The experiences of nursing students using virtual education during the COVID-19 pandemic . Journal of Medicine & Life , 15 ( 9 ), 1090–1095. 10.25122/jml-2021-0315 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Moustakas L., Robrade D. (2022). The challenges and realities of e-learning during COVID-19: The case of university sport and physical education . Challenges , 13 ( 1 ), 9. 10.3390/challe13010009 [ CrossRef ] [ Google Scholar ]
• Mukasa J., Otim M., Monaco B., Al Marzouqi A., Breitener P., Jawahar L. (2021). Nursing students’ perspectives and readiness to transition to E-learning during COVID-19 in the UAE: A cross-sectional study . Advances in Medical Education and Practice , 1505–1512. 10.2147/AMEP.S335578 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Mukhtar K., Javed K., Arooj M., Sethi A. (2020). Advantages, limitations and recommendations for online learning during COVID-19 pandemic era . Pakistan Journal of Medical Sciences , 36 ( COVID19-S4 ), S27. 10.12669/pjms.36.COVID19-S4.2785 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Mustafa N. (2020). Impact of the 2019–20 coronavirus pandemic on education . International Journal of Health Preferences Research , 4 ( 1 ), 25–30. [ Google Scholar ]
• Muthuprasad T., Aiswarya S., Aditya K. S., Jha G. K. (2021). Students’ perception and preference for online education in India during COVID-19 pandemic . Social Sciences & Humanities Open , 3 ( 1 ), 100101. 10.1016/j.ssaho.2020.100101 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Negash S., Kartschmit N., Mikolajczyk R. T., Watzke S., Matos Fialho P. M., Pischke C. R., Busse H., Helmer S. M., Stock C., Zeeb H., Wendt C., Niephaus Y., Schmidt-Pokrzywniak A. (2021). Worsened financial situation during the COVID-19 pandemic was associated with depressive symptomatology among university students in Germany: Results of the COVID-19 international student well-being study . Frontiers in Psychiatry , 2298 . 10.3389/fpsyt.2021.743158 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Nimavat N., Singh S., Fichadiya N., Sharma P., Patel N., Kumar M., Chauhan G., Pandit N. (2021). Online medical education in India—different challenges and probable solutions in the age of COVID-19 . Advances in Medical Education and Practice , 237–243. 10.2147/AMEP.S295728 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Osmanović Zajic J., Maksimović J., Milanović N. M. (2022). Personal and professional empowerment of reflective practitioner teachers during the COVID-19 pandemic . Problems of Education in the 21st Century , 80 ( 2 ), 371–385. 10.33225/pec/22.80.371 [ CrossRef ] [ Google Scholar ]
• Paechter M., Maier B., Macher D. (2010). Students’ expectations of, and experiences in e-learning: Their relation to learning achievements and course satisfaction . Computers & Education , 54 ( 1 ), 222–229. 10.1016/j.compedu.2009.08.005 [ CrossRef ] [ Google Scholar ]
• Pandit D., Agrawal S. (2022). Exploring challenges of online education in COVID times . FIIB Business Review , 11 ( 3 ), 263–270. 10.1177/2319714520986254 [ CrossRef ] [ Google Scholar ]
• Ramani P., Deo S. (2021). Challenges faced by students due to online learning during this COVID-19 pandemic situation . Dimensions , 7 , 7. 10.35940/ijmh.I1297.055921 [ CrossRef ] [ Google Scholar ]
• Rannaware A., Shaikh U., Gaidhane A., Choudhari S. G., Zilate S. (2022). Challenges and barriers for accessing online education amongst school children in an urban slum area of Pune, India . Cureus , 14 ( 9 ). 10.7759/cureus.29419 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Rao M. E., Rao D. M. (2021). The mental health of high school students during the COVID-19 pandemic . Frontiers in Education , 6 , 719539. Frontiers Media SA. 10.3389/feduc.2021.719539 [ CrossRef ] [ Google Scholar ]
• Reimers F., Schleicher A., Saavedra J., Tuominen S. (2020). Supporting the continuation of teaching and learning during the COVID-19 pandemic . OECD , 1 ( 1 ), 1–38. [ Google Scholar ]
• Ro A., Rodriguez V. E., Enriquez L. E. (2021). Physical and mental health impacts of the COVID-19 pandemic among college students who are undocumented or have undocumented parents . BMC Public Health , 21 ( 1 ), 1–10. 10.1186/s12889-021-11606-x [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Rohde G., Johannessen B., Maaseide M., Flateland S., Skisland A. V., Moi E. B., Haraldstad K. (2022). Baccalaureate nursing students’ experiences of how the COVID-19 pandemic influenced learning—a mixed method study . BMC Nursing , 21 ( 1 ), 1–10. 10.1186/s12912-022-00955-6 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Sengupta S. (2022). Possibilities and challenges of online education in India during the COVID-19 pandemic . International Journal of Web-Based Learning and Teaching Technologies (IJWLTT) , 17 ( 4 ), 1–11. 10.4018/IJWLTT.285567 [ CrossRef ] [ Google Scholar ]
• Siddiquei M. I., Kathpal S. (2021). Challenges of online teaching during COVID-19: An exploratory factor analysis . Human Behavior and Emerging Technologies , 3 ( 5 ), 811–822. 10.1002/hbe2.300 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Szopiński T., Bachnik K. (2022). Student evaluation of online learning during the COVID-19 pandemic . Technological Forecasting and Social Change , 174 , 121203. 10.1016/j.techfore.2021.121203 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Tancredi S., Burton-Jeangros C., Ruegg R., Righi E., Kagstrom A., Quesnel Vallee A., Chiolero A., Bracke P., Buffel V., Van De Velde S., Cullati S. (2022). Financial loss and depressive symptoms in university students during the first wave of the COVID-19 pandemic: Comparison between 23 countries . International Journal of Public Health , 128 . 10.3389/ijph.2022.1604468 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Teddlie C., Tashakkori A. (2009). Foundations of mixed methods research: Integrating quantitative and qualitative approaches in the social and behavioral sciences . Sage. [ Google Scholar ]
• Thaheem S. K., Zainol Abidin M. J., Mirza Q., Pathan H. U. (2022). Online teaching benefits and challenges during pandemic COVID-19: A comparative study of Pakistan and Indonesia . Asian Education and Development Studies , 11 ( 2 ), 311–323. 10.1108/AEDS-08-2020-0189 [ CrossRef ] [ Google Scholar ]
• Thapa P., Bhandari S. L., Pathak S. (2021). Nursing students’ attitude on the practice of e-learning: A cross-sectional survey amid COVID-19 in Nepal . PloS One , 16 ( 6 ), e0253651. 10.1371/journal.pone.0253651 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Tomietto M., Comparcini D., Simonetti V., Cicolini G. (2020). Nursing education: challenges and perspectives in a COVID-19 age . Professioni infermieristiche , 73 ( 3 ), 131–132. 10.7429/pi.2020.733131 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Tsurugano S., Nishikitani M., Inoue M., Yano E. (2021). Impact of the COVID-19 pandemic on working students: Results from the Labour Force Survey and the student lifestyle survey . Journal of Occupational Health , 63 ( 1 ), e12209. [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Wajid G., Gedik G. (2022). Impact of COVID-19 on health professionals’ education in eastern Mediterranean region . Eastern Mediterranean Health Journal , 28 ( 7 ), 506–514. 10.26719/emhj.22.062 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Wang X. L., Liu M. X., Peng S., Yang L., Lu C., Shou S. C., Wang J.-R., Sun J.-Y., Wang J.-Q., Hu Y., Zhao J., Duan P. (2022). Impact of the COVID-19 pandemic on career intention amongst undergraduate medical students: A single-centre cross-sectional study conducted in Hubei province . BMC Medical Education , 22 ( 1 ), 1–11. 10.1186/s12909-022-03201-4 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Wasfy N. F., Abouzeid E., Nasser A. A., Ahmed S. A., Youssry I., Hegazy N. N., Shehata M. H., Kamal D., Atwa H., Atwa H. (2021). A guide for evaluation of online learning in medical education: A qualitative reflective analysis . BMC Medical Education , 21 ( 1 ), 1–14. 10.1186/s12909-021-02752-2 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• World Health Organization. (2020). Coronavirus disease 2019 (COVID-19). March 26, situation report—66. https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200326-sitrep-66-covid-19.pdf?sfvrsn=81b94e61_2
• Zheng M., Bender D., Lyon C. (2021). Online learning during COVID-19 produced equivalent or better student course performance as compared with pre-pandemic: Empirical evidence from a school-wide comparative study . BMC Medical Education , 21 , 1–11. doi: 10.1186/s12909-021-02909-z. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]

Benchmarking clustering, alignment, and integration methods for spatial transcriptomics

Aug 22, 2024, 4:36 PM

Hu, Yunfei; Xie, Manfei; Li, Yikang; Rao, Mingxing; Shen, Wenjun; Luo, Can; Qin, Haoran; Baek, Jihoon; Zhou, Xin Maizie. “Benchmarking clustering, alignment, and integration methods for spatial transcriptomics.” Genome Biology , volume 25, Article number: 212 (2024). https://doi.org/10.1186/s13059-024-02665-w . Published: 09 August 2024.

Understanding the complexities of tissues and organisms is no small feat. However, scientists are making great strides with a cutting-edge technique called spatial transcriptomics (ST). This method allows us to study tissues at a microscopic level, revealing valuable information about their structure and function.But here’s the catch: analyzing and integrating data from multiple tissue slices and finding meaningful patterns within a single slice can be quite challenging. To overcome this hurdle, researchers have developed several algorithms specifically tailored for ST data analysis. These algorithms help identify distinct spatial regions within a tissue slice and align data from different sources for further analysis.

To guide researchers in choosing the right methods and paving the way for future advancements, a team of scientists conducted a comprehensive benchmarking study. They evaluated various state-of-the-art algorithms by analyzing real and simulated datasets with different sizes, technologies, species, and complexities.The researchers assessed each algorithm using a range of quantitative and qualitative metrics. These metrics included measures of clustering accuracy, visualization techniques to understand spatial relationships, alignment accuracy, and even 3D reconstruction. By considering both method performance and data quality, they provided a holistic evaluation to aid researchers in selecting the best tools for their specific needs.

The team has made all their evaluation code available on GitHub, along with online notebooks and documentation. This ensures transparency and reproducibility, allowing other researchers to validate the benchmarking results and explore new methods using different datasets.In conclusion, this groundbreaking study provides comprehensive recommendations to researchers, offering guidance in choosing optimal tools and inspiring future developments. With these advanced techniques, we are unlocking new possibilities and gaining deeper insights into the fascinating world of complex tissues.

Explore Story Topics

• Genomic Analysis
• informatics