Skip to content

Held-out IBL regularized-AsLS comparison v0.1

Status: completed; frozen aggregate gate failed; no method promotion (26 July 2026).

Result

All 24 checksum-frozen held-out sessions loaded and all five declared method paths executed. The benchmark retained all 5,920 frozen event windows for every method. Nevertheless, the overall prospective gate failed, so regularized AsLS remains experimental.

The held-out sessions had been excluded from the earlier IBL v0.3 analysis solely because they lacked enough events in both feedback conditions. Their fluorescence values had not been loaded before the v0.1 protocol and exact source hashes were frozen.

Regularization fidelity

Double exponential and the published rolling baseline were applied both before and after regularization, isolating interpolation effects from baseline-method choice.

Raw versus regularized method Median trace r Minimum trace r Median normalized trace RMSE Event-delta r Event normalized median change
Double exponential 0.9964 0.9620 0.1136 0.9990 0.0146
Published rolling 0.9973 0.9612 0.1029 0.9990 0.0143

Trace correlations and every event-level gate passed. The prospective median normalized trace-RMSE threshold of 0.10 failed narrowly for both comparators. This is not relabelled a pass because downstream event summaries were stable: the contract explicitly required both.

The maximum target-to-source distance was 0.525 median sample intervals, exceeding the frozen 0.25 threshold. The target grid begins at the first source sample, but small interval errors accumulate phase relative to later acquired samples; almost all regularized targets are therefore interpolated rather than exact timestamp matches. Median-rate regularization is mechanically sound here, but interpolation provenance remains scientifically relevant.

Missingness and coverage

Every method retained all 5,920 selected event windows. Whole-recording finite coverage was different:

Method Minimum fitted-baseline fraction
Raw double exponential 97.46%
Regularized double exponential 97.46%
Regularized AsLS 97.46%
Raw published rolling 77.66%
Regularized published rolling 77.31%

The 99% frozen gate therefore failed. Double exponential and AsLS preserve manually excluded recording edges as missing. The rolling baseline additionally requires a complete centred 60-second window; one short session consequently had only about 77% fitted coverage. The event-selection intervals kept every analyzed event away from these regions. This distinction validates the product decision to report candidate, gated, and complete denominators separately from global trace coverage.

AsLS sensitivity

Regularized comparison Median baseline r Median baseline normalized RMSE Event-delta r Event normalized median difference Contrast sign agreement*
AsLS vs double exponential 0.9776 2.109 0.9997 0.0140 100%
AsLS vs published rolling 0.9816 2.863 0.9996 0.0199 100%

*Only six sessions contained usable events in both conditions; these are descriptive session contrasts, not population inference.

AsLS and the comparators produce highly correlated slow baselines but materially different baseline magnitudes relative to within-trace scale. Those differences mostly cancel in the short baseline-versus-response event contrast. This supports AsLS as an explicit sensitivity universe, not as a validated default: agreement on one short-window estimand cannot establish baseline truth or generalize to slower outcomes.

Decision

Regularization successfully makes AsLS executable on real irregular clocks and preserves these selected short-window event summaries. It did not pass the frozen whole-trace fidelity and coverage contract, and AsLS baseline identity remains method-dependent. SDR-0002 and SDR-0011 therefore remain conservative: expose the method and provenance, retain it as experimental, and do not promote it into a recommended default.

The complete machine-readable result is ibl-regularized-asls-results-v0.1.json, with fingerprint ed8ec3dc071957093790599f95122e5c4b30a738c6334c06d92a232fde6b365a.