2024

Core Concepts

  • Random Variable: Process generating random outcomes.

  • Sample: Outcomes from a random variable.

  • Descriptive Statistics: Summary of a sample.

  • Inferential Statistics: Educated guess about the random variable that generated a sample.

Random Variable

  • Process that generates random outcomes.

  • Tied to a population.

  • Has possible outcomes defined by a sample space.

  • Is fundamentally defined by a probability distribution.

Population

  • A population is the entire set of things under study.

  • E.g., all people in the world, all possible people in the world, all the neurons in the universe, the set of all possible action potential times relative to stimulus onset etc.

Sample Space

  • The set of all possible outcomes of a random variable.

  • E.g., the set of all possible rolls of a die is \(\{1, 2, 3, 4, 5, 6\}\). It is discrete and finite.

  • E.g., the set of all possible action potential times relative to stimulus onset spans the interval \((0, \infty)\). It is continuous and infinite.

Probability Distribution

  • Describes the likelihood of each outcome in the sample space.

  • Discrete: A function that gives the probability of each outcome.

  • Continuous: A function that gives the probability density for each outcome.

Probability Distribution Recipe

  • The sample space goes on the x-axis.

  • The probability of each outcome goes on the y-axis.

Probability Mass Function

  • For a discrete random variable, the probability mass function (PMF) gives the probability of each outcome.

  • For a biased coin, the PMF is \[ P(X = x) = \begin{cases} 0.3 & \text{if } x = \text{heads} \\ 0.7 & \text{if } x = \text{tails} \end{cases} \]

  • For a fair six-sided die, the PMF is \(P(X = x) = \frac{1}{6}\) for \(x \in \{1, 2, 3, 4, 5, 6\}\).

Probability Density Function

  • For a continuous random variable, the probability density function (PDF) gives the probability density for each outcome.

  • For a normal distribution with mean \(\mu = 0\) and standard deviation \(\sigma = 1\), the PDF is \[ f(x) = \frac{1}{\sqrt{2\pi}} e^{-\frac{x^2}{2}} \]

Sampling from a Random Variable: Discrete

  • Consider a biased coin with PMF \(P(X = x) = 0.3\) for heads and \(P(X = x) = 0.7\) for tails.

  • Samples obtained from this distrubtion are random sequences of heads and tails.

  • Because the coin is biased, we expect to see more tails than heads.

Sample from a Random Variable: Continuous

Summary

  • Random variables and probability distributions are clean and idealized.

  • Samples from random variables are… well… random.

  • We use samples from random variables to estimate their probability distributions.

  • For discrete random variables, we use relative frequency bar plots.

  • For continuous random variables, we use relative frequency histograms or density plots.