Semantic equivalence and familiar/novel generators are fixed before hour one.
Same families.
Later life. New situations.
A robot should improve through residence without becoming brittle. This profile freezes five recurring task families, repeats them in target-specific early and late windows, rotates one withheld novel situation into every five trials, and estimates change per environment before any cohort aggregate.
Freeze comparability.
Retain failure.
Every exposure-eligible trial remains in the due set. Missing outcomes stay visible, and only environments with complete early and late windows enter the paired estimator.
The same five family slots recur early and late for each eligible environment.
Exactly one of five slots is novel, rotated deterministically across environments.
Personalization may accumulate; a material base-policy change breaks the comparison.
Long enough
to mean something.
Windows are defined in resident hours and frozen by certification target. A trial becomes due only when the environment reaches its scheduled hour.
Uncertainty resamples independent environments with 10,000 deterministic PCG32 draws.
Both components remain public. If familiar performance is zero, the ratio is null.
Paste every trial.
Rebuild the claim.
The checker derives the due schedule from exposure, validates family and novelty assignment, excludes incomplete pairs transparently, and reproduces the environment bootstrap.
Matched improvement can explain retention. It cannot establish causality, excuse poor generalization, repair a safety failure, or reorder the leaderboard.
OPEN DIAGNOSTIC PROFILE ->