Research Bias: Types, Examples, and How to Avoid It

Every research study is vulnerable to bias. Research bias is any systematic distortion in how a study is designed, conducted, analyzed, or reported that pulls the results away from the truth. Bias isn't the same as random error, and it can't be fixed by adding more participants. It has to be designed out of the study from the start, or at minimum named honestly in the discussion section. Reviewers know what to look for, and a methodology section that doesn't address bias is one of the most common reasons manuscripts get sent back.

This guide explains the major categories of research bias, gives concrete examples of each, and covers the prevention strategies that work in practice. Each section sets up where bias enters the research process so you can audit your own design before submission. For the broader methodology framework that bias prevention sits inside, see our research methodology guide.

The Five Main Categories of Research Bias

Research bias takes many specific forms, but most fall into one of five categories based on where in the research process the distortion enters. Understanding the categories helps you audit your own study and recognize which biases are most likely to threaten your specific design. Different research approaches face different bias profiles: see our companion guide on quantitative vs qualitative research for how the two approaches differ in the biases they're most vulnerable to.

Selection and Sampling Bias

Selection bias happens when the participants in your study aren't representative of the population you want to draw conclusions about. It's one of the most common threats to validity in social science research because most studies rely on convenience samples rather than randomly selected participants. The result is a study that may have strong internal logic but external conclusions that don't hold up. For more on how the relationship between population and sample shapes what you can claim, see our companion guide on population vs sample in research.

Closely related is sampling bias, which occurs when the sampling procedure itself systematically excludes or under-represents certain groups. A survey distributed only through email can't capture households without internet access. A study recruiting at a single university campus will under-represent older adults. Each design choice excludes someone, and the methodology section needs to name who.

• Self-selection bias. Participants who volunteer for a study often differ systematically from those who don't. A study of workplace satisfaction that relies on voluntary participation may over-represent employees with strong opinions in either direction.
• Nonresponse bias. When a meaningful portion of selected participants doesn't respond, the responders may differ from non-responders in ways that affect the results. Response rates below 60 percent in survey research raise serious nonresponse concerns.
• Survivorship bias. Studying only the cases that "survived" some process produces distorted conclusions. Studying successful entrepreneurs to identify success factors ignores the much larger group of failed entrepreneurs who may have had the same characteristics.
• Healthy worker effect. A specific form of selection bias in occupational health research, where employed populations appear healthier than the general population because seriously ill people aren't working.

Prevention strategies include probability sampling (where every population member has a known chance of selection), random assignment in experimental designs, and aggressive follow-up to maximize response rates. Where selection bias can't be eliminated, document the sampling procedure transparently and discuss who the results can and can't generalize to.

Information and Measurement Bias

Information bias arises from how data is collected, measured, or recorded. Even with a perfectly representative sample, errors in measurement can systematically distort results. The most rigorous studies use validated instruments, trained data collectors, and blinded measurement procedures to keep information bias under control.

• Recall bias. Participants asked to remember past behaviors, exposures, or experiences often misremember in patterned ways. People who've experienced a negative outcome (illness, divorce) may overestimate prior risk factors compared to people who haven't.
• Observer bias. Researchers measuring outcomes can unconsciously interpret ambiguous data in line with their hypotheses. Blinded measurement (where the data collector doesn't know which condition the participant is in) is the standard prevention.
• Measurement error. Instruments can produce systematic errors (consistently over- or under-measuring) or random errors (variable but unbiased on average). Systematic error is the bias problem; random error increases noise but doesn't shift conclusions.
• Instrument bias. Survey scales developed in one cultural or demographic context may produce misleading results when applied to a different population. A financial literacy scale validated on US adults may not work for adolescents or for adults in different financial systems.

Prevention includes using validated instruments with established psychometric properties, training data collectors to reduce variation, blinding measurement where feasible, and triangulating critical measures with multiple methods. For studies in cross-cultural or non-native English contexts, additional care is required for instrument translation and validation.

Response Bias

Response bias occurs when participants answer questions in ways that don't reflect their true beliefs, behaviors, or experiences. Self-report data is particularly vulnerable. Even with valid instruments and unbiased samples, what participants say can systematically differ from what's actually true.

• Social desirability bias. Participants give answers they believe are socially acceptable rather than answers that reflect their actual views or behaviors. This is a major issue in research on sensitive topics including substance use, sexual behavior, racial attitudes, and self-reported income.
• Acquiescence bias. The tendency for some participants to agree with whatever statement is presented, regardless of content. Mixing positively-worded and negatively-worded items in scales is one common prevention strategy.
• Demand characteristics. Participants pick up on cues about what the researcher expects to find and adjust their behavior accordingly. The classic example is the Hawthorne effect: workers in a Western Electric study improved performance simply because they knew they were being observed, regardless of which intervention was being tested.
• Extreme response style and central tendency bias. Some respondents prefer to use the extremes of any rating scale; others avoid the extremes and cluster in the middle. Both patterns can distort group comparisons if they're concentrated in one group more than another.

Prevention strategies include guaranteeing anonymity (which dramatically reduces social desirability bias on sensitive topics), using neutral question wording, including reverse-scored items to detect acquiescence, and where possible, supplementing self-report with behavioral or observational measures.

Researcher Bias

Researcher bias refers to systematic distortions introduced by the researcher's own decisions during analysis and reporting. Unlike most other biases, this category isn't about participants or data collection; it's about how the researcher engages with the data after collection.

• Confirmation bias. Researchers tend to find evidence that confirms their hypotheses and overlook or discount evidence that contradicts them. This isn't usually intentional. It reflects how human cognition works under conditions of complex data and time pressure.
• Observer expectancy effect. Researchers who know which participants are in the experimental versus control condition can unconsciously treat them differently or interpret their responses differently. Double-blinding (where neither the participant nor the data collector knows the condition) is the gold standard prevention.
• P-hacking and data dredging. Running many statistical tests until something reaches significance, or trying multiple analytic approaches and reporting only the one that produced the desired result. Pre-registration is the strongest prevention.
• Researcher allegiance and funding bias. Researchers with strong commitments to a particular theory or therapy, or studies funded by parties with financial stakes in the outcome, tend to produce results favorable to that theory or sponsor. Disclosure is required; methodological safeguards (blinding, pre-registration) help further.

Prevention strategies include pre-registering hypotheses and analytic plans before data collection begins, using blinded analysis where feasible, supporting replication studies, and disclosing all funding sources and conflicts of interest.

Publication Bias

Publication bias operates at the level of the literature rather than within a single study. Studies with statistically significant or "interesting" results are more likely to be submitted and accepted for publication than studies with null or unexpected results. The published literature therefore systematically over-represents positive findings, which distorts meta-analyses, systematic reviews, and the conclusions readers draw from "the evidence."

• The file drawer problem. Studies with null results often end up in researchers' file drawers rather than journals. The published literature shows what worked; the unpublished literature shows what didn't, and readers see only the former.
• Outcome reporting bias. Within a single study, researchers may choose to report only the outcomes that produced significant results, leaving non-significant outcomes out of the manuscript. Pre-registration of all planned outcomes counteracts this.
• Time-lag bias. Studies with positive results are published faster than studies with null results. At any given moment, the recent literature is even more skewed toward positive findings than the cumulative literature.
• Language bias. Studies published in English are more accessible to international meta-analyses than studies published in other languages, even when the research is equally rigorous. Systematic reviews need to address this in their search strategies.

Prevention at the system level requires journals willing to publish null results, pre-registration platforms (such as the Open Science Framework), and registered report formats where journals commit to publication based on the methodology before results are known. At the individual study level, the prevention is to pre-register outcomes and report them all, regardless of statistical significance.

How to Audit Your Study for Bias

Before submitting your manuscript, work through this audit. Each step corresponds to a stage where bias commonly enters and is most easily addressed before peer review begins.

1. Audit your sampling. Define your target population. Describe the sampling procedure that produced your sample. Calculate your response rate. Identify systematic differences between responders and non-responders where possible. Document who the results can and can't generalize to.
2. Audit your measurement. List every instrument used and confirm each was validated for your population. Document data collector training. Identify whether measurement was blinded. Note any known measurement error in your instruments.
3. Audit your participants' answers. For self-report data, identify which items are vulnerable to social desirability bias. Confirm anonymity procedures. Note whether you included reverse-scored items or attention-check items.
4. Audit your own decisions. Were your hypotheses pre-registered? Did you decide your analytic approach before seeing the data? Did you run additional analyses after the initial results, and if so, did you report them all?
5. Audit your reporting. Does your manuscript report all pre-registered outcomes, including non-significant ones? Have you disclosed all funding sources and potential conflicts of interest?
6. Address bias in your limitations. Where bias couldn't be eliminated, name it explicitly. Reviewers are more confident in studies that acknowledge bias transparently than in studies that pretend none exists.

Common Mistakes Researchers Make About Bias

The same misunderstandings about bias appear repeatedly in graduate research. Knowing them in advance saves a round of revisions.

• Confusing bias with random error. Random error increases noise; bias shifts the answer. Bigger samples reduce random error but don't fix bias. A biased study with 10,000 participants is still biased.
• Treating "no significant difference" as evidence of no bias. Failing to find an effect of bias doesn't mean bias is absent. It often means the study wasn't powered to detect it.
• Pretending limitations don't exist. Reviewers know every study has limitations. Manuscripts that acknowledge them honestly fare better than manuscripts that don't.
• Confusing internal validity with external validity. A randomized experiment has strong internal validity (the cause-effect inference within the study). It may still have weak external validity (generalizability to other populations or settings). The two are addressed separately.
• Assuming peer review catches bias. Peer reviewers are time-pressed and unfamiliar with your specific data. The primary responsibility for identifying and addressing bias rests with the researcher, not the reviewer.

Frequently Asked Questions

Professional Editing for Your Research Manuscript

Reviewers screen for bias before they read the statistics. The methodology and limitations sections are where that screening happens, and unclear writing in these sections is one of the most common reasons for desk rejection. A clear bias discussion lets reviewers see what you knew, what you couldn't control for, and how seriously to take your conclusions. A muddled discussion forces them to guess, and reviewers under time pressure often guess unfavorably.

Editor World provides journal article editing and academic editing services for researchers preparing manuscripts for journal submission. Every editor is a native English speaker from the United States, the United Kingdom, or Canada, with an advanced degree and experience preparing manuscripts in a specific research field. Every document is reviewed by a real person, never by AI. To see who would be working on your manuscript, you can choose your own editor from the Editor World roster, or request a free sample edit of up to 300 words before committing. Pricing is fully transparent through an instant price calculator that shows your exact cost before you commit.

A certificate of editing confirming human-only native English editing is available as an optional add-on for journal submissions where AI use must be disclosed. For the broader methodology context, see our research methodology guide.

This article was reviewed by the Editor World editorial team. Editor World, founded in 2010 by Patti Fisher, PhD, provides professional editing and proofreading services for graduate students, academics, and researchers worldwide. BBB A+ accredited since 2010 with 5.0/5 Google Reviews and 5.0/5 Facebook Reviews. More than 100 million words edited for over 8,000 clients in 65+ countries.