The Field Guide
How to read science news
Short, plain explainers for the words and warning signs that decide how much a study is really worth. One page each, so you can tell a real breakthrough from a hopeful headline.
- 01 Clinical trial phases Phase 1 tests whether a drug is safe, phase 2 tests whether it works, and phase 3 confirms both in a large group before approval.
- 02 Animal model translation A result in mice is an early clue, not a cure, because most treatments that work in animals never work in people.
- 03 Effect size Effect size measures how big a difference is, which is the question that decides whether a real result actually matters in your life.
- 04 Relative and absolute risk A "50% risk cut" is relative; the absolute change can be tiny, so always ask what the risk went from and to in real numbers.
- 05 Preprint and peer review A preprint is a study posted before independent experts have vetted it, while peer review is that vetting step, so preprints deserve extra caution.
- 06 Correlation and causation Two things happening together does not prove one causes the other, so "linked to" headlines rarely establish cause and effect.
- 07 Reproducibility and replicability A finding earns trust when other scientists can repeat it, so one study is a data point, not a settled conclusion.
- 08 P-value A p-value measures how surprising the data would be if there were no real effect, not the probability that a finding is true.
- 09 Confidence interval A confidence interval is the plausible range around a result, which tells you how precise, or shaky, that single reported number really is.
- 10 Randomized and observational studies In a clinical trial, also called an interventional study, researchers assign the treatment, usually by chance; in an observational study, such as a cohort or case-control study, they only record what people already do, which is why trials are better at showing cause.
- 11 Meta-analysis A meta-analysis pools many separate studies into one combined estimate, which usually beats any single study, as long as the studies it pools are sound.
- 12 Survivorship bias Survivorship bias is drawing conclusions from the things that made it through while ignoring the ones that did not, which quietly warps the picture.
- 13 Regression to the mean Regression to the mean is the tendency for an unusually high or low measurement to be closer to average the next time, which can make a treatment look like it worked when nothing did.
- 14 Nutritional epidemiology Diet headlines reverse so often because most rest on observational studies with tiny effects and countless confounders, so the same food gets linked to both harm and benefit.
- 15 Number needed to treat The number needed to treat is how many people have to take a treatment for one of them to benefit, which is often the plainest measure of how much a drug really does.
- 16 Publication bias Publication bias is when a study's findings decide whether it gets published: positive results reach print more often than null ones, so the research you can read makes effects look bigger and surer than they are.
- 17 Funding effect (industry sponsorship bias) Studies funded by the company that sells the product tend to come out more favorably, a pattern strong enough that who paid for the research is part of how you should read it.
- 18 Lead-time bias Detecting a disease earlier automatically lengthens 'survival since diagnosis' even when it does not delay death by a single day, which makes screening look more effective than it is.
- 19 Healthy-user bias People who take a preventive treatment or follow health advice are, on average, already healthier and more careful, so their better outcomes can be mistaken for the effect of the treatment.
- 20 Composite endpoint A composite endpoint bundles several separate outcomes into one, which makes a trial smaller and faster but can blur together events of very different importance.
- 21 Base rate A base rate is how common something already is before any test result comes in, and ignoring it is the main reason an accurate test can still mislead.
- 22 Confounding Confounding happens when a third factor is tied to both the exposure and the outcome, so a real statistical link can appear where the exposure itself causes nothing.
- 23 Simpson's paradox Simpson's paradox is what happens when a trend appears in several separate groups of data but reverses, or disappears, once those groups are combined into one.
- 24 Ecological fallacy The ecological fallacy is assuming that a pattern true of a group, such as a country or a state, also holds for the individuals inside that group.
- 25 Immortal time bias Immortal time bias inflates a treatment's apparent benefit when part of the follow-up period could not, by design, have counted against it.
- 26 Recall bias Recall bias is the systematic difference in how accurately or completely people remember past events, and it can distort a study that relies on memory.
- 27 Attrition bias Attrition bias happens when the people who drop out of a study are systematically different from those who stay, skewing the results left behind.
- 28 Statistical power Statistical power is the probability that a study will detect a real effect if one truly exists, and a study with low power can miss it entirely.
- 29 Multiple comparisons problem The multiple comparisons problem is that running enough separate statistical tests will turn up some significant results by chance alone, even in pure noise.
- 30 Preregistration Pre-registration means a study's hypothesis, methods, and analysis plan are filed publicly before any data are collected, closing off room to change the question afterward.
- 31 Intention-to-treat analysis Intention to treat means every participant is counted in the group they were randomly assigned to, even if they dropped out or switched treatments; a per-protocol analysis counts only those who followed the plan, and can flatter the treatment.
- 32 Blinding Blinding keeps participants, caregivers, or the people measuring outcomes from knowing who received which treatment, so belief cannot quietly skew the result.
- 33 Placebo effect A placebo can measurably ease symptoms even when patients are told exactly what it is, and its mirror image, the nocebo effect, can produce real side effects from an inert pill.
- 34 Hazard ratio A hazard ratio compares how often an event, such as death, is happening in one group against another at each moment of a study: 0.7 means a 30 percent lower rate, 1 means no difference, 2 means double, and the number assumes that gap holds for the whole study.
- 35 Natural experiment A natural experiment uses a real-world circumstance that sorts people into different conditions as if at random, letting researchers compare outcomes without running a trial themselves.
- 36 Sensitivity and specificity Sensitivity and specificity describe how well a test tells sick from healthy, but neither one tells you the chance a positive result is real, which also depends on how common the condition is.
- 37 Difference-in-differences Difference-in-differences compares the change over time in a group exposed to a policy against the change in a similar unexposed group, canceling out trends both shared anyway.
- 38 Overdiagnosis Overdiagnosis is finding a real disease, often through screening, that would never have caused symptoms or death, so the diagnosis itself becomes the only harm the person experiences.
- 39 Regression discontinuity design Regression discontinuity compares people just above and just below an arbitrary cutoff, such as a legal age or a test-score threshold, treating them as close to randomly assigned to each side.
- 40 Surrogate endpoint A surrogate endpoint is a stand-in measure, like a lab value or scan result, used in place of a real outcome such as death, and moving the stand-in does not guarantee the real outcome moves with it.
- 41 Mendelian randomization Mendelian randomization uses a genetic variant, assigned randomly at conception, as a stand-in for a real experiment, to test whether an association between a trait and a disease is actually causal.
- 42 Levels of evidence Levels-of-evidence systems rank study designs by how much they can be trusted, from systematic reviews of randomized trials at the top to case reports and mechanism-based reasoning at the bottom.
- 43 Odds ratio A risk ratio, or relative risk, divides one group's risk by another's; an odds ratio divides their odds; the two agree only when the outcome is rare, and when it is common, reading an odds ratio as a risk ratio overstates the effect.
- 44 Digital object identifier (DOI) Most headlines are built on a real, findable paper, and locating it usually takes only a few minutes once you know to check the press release for a DOI or journal name, then search PubMed and PubMed Central.
- 45 Margin of error (polls) A poll's margin of error, about plus or minus 3 points for 1,000 people, covers each candidate's share; the gap between two candidates is roughly twice as uncertain, and one poll deserves less weight than an average of many.
- 46 Cohort and case-control studies A cohort study starts with people grouped by an exposure, such as smoking, and counts who develops a disease; a case-control study starts with people who already have the disease and compares their past exposures with similar people who do not.
- 47 Non-randomized trial A non-randomized trial is still an experiment, because researchers give the treatment, but people rather than chance decide who goes in which group, or there is no comparison group at all, which makes it easier for a new treatment to look better than it is.
- 48 Median survival Median overall survival is the time, counted from diagnosis or the start of treatment, at which half the people in a group are still alive; it is read where a Kaplan-Meier survival curve crosses 50 percent, and it says nothing about how long the longest survivors live.
- 49 Cross-sectional study A cross-sectional study measures a group of people once, recording exposures and outcomes at the same time, so it can show how common something is and whether two things go together, but not which one came first.
- 50 Excess mortality Excess deaths are the deaths that occurred minus the deaths expected without the crisis, so every figure is a model's estimate and only as good as its baseline.
- 51 Logarithmic scale A curve that flattens on a log chart can still track a count that keeps rising.
- 52 Lives saved estimate A lives-saved figure compares observed outcomes with a counterfactual, using deaths, intervention coverage and effectiveness to estimate the difference.
- 53 Age-adjusted rate A crude death rate can rise because a population is older; age adjustment gives each place the same standard age mix for comparison.
- 54 Life expectancy at birth Life expectancy at birth is an average over a hypothetical group of newborns, so deaths in infancy and childhood pull it down hard, and it is not a prediction for any one person.
- 55 Crime rate The FBI counts crimes that reach police records, while the federal victim survey also counts the crimes that were never reported, so the two numbers were never meant to match.
- 56 Probability of precipitation A 40% chance of rain is the chance that a given point in the forecast area gets at least 0.01 inch during the forecast period, which says nothing about how much of the area or the day will be wet.
- 57 Median The mean adds up every value, so a few very large ones can pull it far from the typical one. The median is the middle value, and raising the very top values leaves it where it was.
- 58 Percentage point A rate that goes from 4 percent to 5 percent rises one percentage point and 25 percent. Both numbers are right, and they answer different questions.
- 59 Real and nominal values A nominal record is a figure in the dollars of its own day. Restated with a price index, an older figure can turn out to be the higher one.
- 60 Per capita rate A rate divides a count by the people who could have the event: California had the most births of any state in 2024, 402,075, yet its birth rate of 10.2 per 1,000 people was below the national rate of 10.7.
- 61 Seasonal adjustment Seasonal adjustment takes the regular calendar pattern out of monthly figures. In the October 2026 jobs report, it turned an unadjusted unemployment rate of 3.9 percent into the 4.1 percent in the headline.
- 62 Nonfarm payrolls The jobs report draws on two surveys, and its first figures get revised: the October 2026 report lifted August and September by 84,000 jobs combined.
Every quoted line is verbatim from the source linked on its page. The explanations are ours, written plainly, so you can read a study for what it is worth without a statistics degree.
The best filter is a daily habit.
We find the day's real wins in science, medicine and beyond, and send you the proof every morning, told plainly. Free, forever.
Free for good. One click to leave.