Course Info

How the release harness works

A short course on the Tutors release harness: the theory behind it, the design of its containers, the philosophy of A/A and A/B testing, the approach it takes from scripted traffic to a verdict, and the A3 that explains every night whether main is ready to become a release.

Current condition and the control charts

The quality strip sits under the Gate: Speed, Metrics and Tests. Each light is within reason, look or not measured (hatched, never green). Open “What each light read” to see the rule and the reading behind each one.

Timing on control charts shows one chart per journey. The shaded band is production’s limits; each dot is main’s median for a night.

  • The centre line is production’s mean; the UCL and LCL are centre ± 2.66 × the mean moving range, and the chart prints the figures.
  • A dot outside the band is a special cause to investigate. It turns Speed to look, and never fails anything.

Fixed on main lists accessibility violations and console errors that are gone on main. That is good news, shown beside the traffic lights rather than on them.

Real courses shows the course corpus loaded in production’s reader and main’s. A page that is worse on main is listed with its reasons.

Note any light at look, any dot outside its band, and any course worse on main.