Realized versus implied volatility
Separating a backward-looking path estimate from a forward option-price coordinate
01Distinguish physical-path estimation from risk-neutral option pricing.
02Define the variance risk premium with sign and horizon conventions.
03Explain why implied volatility need not equal expected realized volatility.
04Build a horizon-matched comparison without look-ahead bias.
Build the state before the equation.
Realized and implied volatility answer different questions. One summarizes a path under the physical measure; the other translates an option price under a model and embeds risk premia, convexity and supply-demand effects.
Match horizon before comparing the two numbers.
The spread is not a pure forecast error.
Variance is the cleaner additive object for risk-premium analysis.
The product exists before the model.
The realized-implied relationship drives volatility carry, variance-swap analysis, option relative value and model backtesting.
listed options
variance swaps
VIX-style indices
delta-hedged option strategies
Compare annualized total variance over the same future window. State whether VRP means implied minus expected realized or the reverse.
Notation, units and exact claims.
IV_t(T): option-implied volatilityRV_{t,t+T}: subsequent realized volatilityw=σ²T: total varianceP and Q: physical and risk-neutral measuresVariance risk premium convention
A positive number under this convention compensates sellers of variance risk.
Ex-post variance spread
A realized outcome useful for backtests, not the ex-ante expected premium itself.
Do not jump to the final expression.
From option value to a variance premium
The two measures differ because pricing weights states by marginal utility and hedging demand, not historical frequency alone.
- 01
Fix a future window
Pair today’s implied quote with realized variance accumulated over exactly the option’s remaining horizon.
- 02
Express both sides in variance
Total variance is time-additive under idealized partitioning and avoids comparing square roots prematurely.
- 03
Separate probability measures
Physical expectation describes future outcomes; risk-neutral expectation prices hedgeable cash flows after discounting.
- 04
Define the premium
Subtract the physical expected variance from its risk-neutral counterpart and keep the sign convention attached.
- 05
Backtest without leakage
Use only information available at the option timestamp, preserve bid/offer and roll the realized window forward.
Implied-minus-realized is a priced risk spread plus forecast error and implementation effects—not a free return statistic.
Fit, compute, then challenge the assumptions.
Construct constant-maturity implied variance and pair it with non-overlapping or carefully adjusted subsequent realized windows.
Estimate the physical expectation with a documented forecast; infer risk-neutral variance from option prices or a model-consistent index.
Overlapping windows induce serial dependence.
Implied volatility is strike dependent.
Transaction costs and tail losses dominate simple carry stories.
Static fit is not dynamics.
| Question | Black–Scholes | Local volatility | Heston |
|---|---|---|---|
| Volatility state | One constant σ | σ(S,t) deterministic | vₜ stochastic |
| Fits today’s surface | No | Exactly, in ideal theory | Approximately by calibration |
| Forward dynamics | Flat smile | Spot-driven | Variance + correlation driven |
| Primary strength | Transparent baseline | Vanilla-consistent diffusion | Richer smile dynamics |
| Primary failure | No smile | Often unrealistic forward skew | Parameter and calibration instability |
| Compute | Low | Medium: PDE/MC | Medium–high: Fourier/PDE/MC |
| Hedge implication | Greeks at one σ | State-localized vol hedge | Variance and vol-of-vol risk |
Implementation with current QuantLib
Current QuantLib separates market structures, processes, instruments, engines and calibration helpers. Use those abstractions only after the lesson’s conventions, domains and numerical checks are explicit.
API authority: upstream QuantLib reference pinned in the source registry.Theory → implementation → checks.
Horizon-matched variance spread
Compute ex-post variance spreads without mixing volatility and variance units.
from __future__ import annotations import numpy as np def variance_spread(implied_vol: np.ndarray, realized_vol: np.ndarray) -> np.ndarray: if implied_vol.shape != realized_vol.shape or np.any(implied_vol < 0) or np.any(realized_vol < 0): raise ValueError("volatility arrays must align and be non-negative") return implied_vol**2 - realized_vol**2 iv = np.array([0.20, 0.24, 0.31])rv = np.array([0.17, 0.28, 0.25])spread = variance_spread(iv, rv)assert np.allclose(spread, np.array([0.0111, -0.0208, 0.0336]))print(np.round(spread * 10_000, 1))Move the state. Challenge the equation.
Volatility carry laboratory
Shock implied level and subsequent regimes; compare variance spread, carry and tail outcomes.
Where the model meets the book.
“Short volatility earns a premium until the distribution collects it back.”
constant-maturity IV
realized estimator
bid/offer
roll convention
transaction costs
Estimate the physical expectation with a documented forecast; infer risk-neutral variance from option prices or a model-consistent index.
RISKgap risk
short convexity
skew carry
roll-down
- align horizons
- normalize variance
- estimate carry
- stress tails
- attribute outcome
Production failure modes
- look-ahead leakage
- overlapping samples
- mid-only returns
- unmatched maturities
Map the transmission channel.
Insurance demand and the variance premium
Risk aversion and demand for crash protection can keep risk-neutral tail variance above the physical expectation.
raises protection demand
embeds state prices
moves above physical expectation
compensates tail exposure
Most failures begin outside the formula.
Calling IV the market’s unbiased forecast.
Subtracting volatilities instead of comparing variance.
Ignoring skew and maturity.
Backtesting with overlapping observations without robust inference.
Attribution with implementation authority.
Volatility, Monte Carlo and stochastic-volatility lectures
Research map for the mathematical progression and numerical experiments; prose, examples and code are original.
- Source
- Computational Finance Course
- Author
- L. A. Grzelak
- Ref
- main
Current volatility structures, processes, calibration helpers and tests
Implementation reference for production abstractions and validation patterns.
- Source
- QuantLib upstream
- Author
- QuantLib contributors
- Ref
- v1.42.1