Skip to main content

Model Comparison

This page ranks the three models with the Akaike and Bayesian information criteria on the combined dataset (N = 1,603 points: 1,590 SNe + 13 BAO). CPL is preferred by both criteria; Ξosc has the lowest raw χ² but pays for its two extra parameters.


Key results​

Modelχ²kAICBICΔAICAcceptance
CPL1531.82441539.8241561.3430.0000.594
Ξosc1529.76361541.7631574.0411.9390.180
ΛCDM1554.16521558.1651568.92418.3410.715

Rows are sorted by AIC; the first row has the lowest AIC. ΔAIC is relative to it.


Definitions​

AIC=χ2+2k\mathrm{AIC} = \chi^2 + 2k BIC=χ2+kln⁡N,N=NSNe+NBAO\mathrm{BIC} = \chi^2 + k\ln N, \qquad N = N_{\mathrm{SNe}} + N_{\mathrm{BAO}}

k is the number of free parameters (2 for ΛCDM, 4 for CPL, 6 for Ξosc).

How χ² is obtained​

run_mcmc does not minimise χ². It takes the sample with the highest log-probability in the retained chain and sets chi2_min = −2 ln p. With flat priors this is χ² at the best sampled point.

Approximate χ²

The value can only equal or exceed the true minimum: a longer chain could find a slightly better point. For Ξosc, whose ε and T posteriors extend to their prior bounds, the best sampled point is the least certain of the three. The AIC and BIC inherit that uncertainty.

Reading the table​

ComparisonResultMeaning
ΛCDM vs the dynamical modelsΔAIC = 18.3ΛCDM is clearly worse by AIC
CPL vs Ξosc (AIC)ΔAIC = 1.94close; CPL slightly ahead
ΛCDM vs Ξosc (BIC)BIC 1568.924 vs 1574.041the BIC puts ΛCDM ahead of Ξosc
Raw χ²Ξosc 1529.763 vs CPL 1531.824Ξosc fits best, by a small margin

Interpretation. The data suggest departures from w = −1 (both dynamical models beat ΛCDM by AIC), but they do not choose between a smooth CPL evolution and an oscillation. The oscillating model is the most flexible and is not rewarded for it by the BIC.

Limits of AIC and BIC here​

  • Prior volume is ignored. T, φ₀ and (near its bound) ε are weakly constrained; an information criterion that counts them as k = 6 does not capture how much of the prior volume they leave unconstrained. A Bayesian evidence (e.g. nested sampling) would — it is listed as future work in the project README.
  • N counts data points, not independent constraints. Supernova errors are correlated through the covariance matrix.
  • Models are not nested (Three Model Families), so differences in χ² do not follow a χ² distribution.
  • Fixed r_d and the fixed reference cosmology for the Ξosc time axis apply to every row (Known Limitations).