Statistics
Statistics is the branch of mathematics concerned with collecting, organizing, analyzing, interpreting, and presenting data.
Definition
Statistics is the study of collecting, organizing, summarizing, analyzing, and interpreting data, the discipline that helps answer questions like "What is typical?" or "What is likely to happen?" It splits into descriptive statistics, which summarizes what was observed, and inferential statistics, which draws conclusions about a whole population from a sample. At a deeper level, statistics is the theory and methods for drawing inferences under uncertainty: frequentist statistics treats probability as a long-run frequency, while Bayesian statistics treats it as a degree of belief updated via Bayes' theorem, and both branches rest on probability theory, measure theory, and mathematical optimization.
Example
A teacher collecting test scores from a class and averaging them to decide whether to review a topic is statistics in its simplest form. A researcher who surveys $400$ voters and finds that $54\%$ support a candidate is doing the same thing at a larger scale: descriptive statistics summarizes that $54\%$ result, while inferential statistics uses it to estimate the broader population's opinion. Formally, maximum likelihood estimation (MLE) finds the parameter value $\theta$ that maximizes the likelihood function $L(\theta \mid \text{data})$, giving a principled estimator with known asymptotic properties such as consistency and efficiency.
Key Insight
Statistics turns raw numbers into useful knowledge: without it, a pile of data is just noise. Description tells you what you observed, inference tells you what it likely means beyond your sample, and together they underpin machine learning, clinical trials, econometrics, and scientific inference. The choice of statistical framework, frequentist versus Bayesian, shapes both the methodology and the interpretation of results.