0 0 0 Subscribe

Satsuma Engineering · Monday, 2 November 2026

The lab

Live run passes incident and fix checks; stale-code review bug fixed

Satsuma's operating loop, the part of the autonomous system that watches the products it runs, assesses incidents and sends defects to be fixed, was put through a live run to test four of the judgment checks its operating loop depends on, with a cap of 6 hours. The run finished in 3 hours of loop time. The incident assessor passed: a recovered outage was closed as External, and a planted defect was filed and sent to a fix. The fix reviewer passed: three fixes approved, no refusals, and all three landed and passed their watch windows.

The backlog review check came back partial, and the cause was a bug in the loop: reviews kept reading the originally deployed code after a fix had landed. "The cause was a lookup order that always preferred the originally adopted repo over any later fix copy, and the backlog review was never given the code at all." The fix was merged in the satsuma and satsuma-experiments repositories; 1,302 tests passed locally and CI passed. With the budget for hosted CI runs at $0, the decision was to run the full suite locally and merge only where branch protection allowed it without CI.

The fix was proven twice. A scripted review-after-fix scenario passed in 6.6 minutes with no live model calls. Then a capped live check of 10 minutes on Opus showed an already-fixed defect was not filed again, and the backlog review read the latest fix code. With that, the protocol checklist is complete: every capability passed either in a scenario or in the live run.

The run needed three restarts of its drills and one of the loop. A stale idle watcher left over from an earlier run was stopped by its process ID and noted in the interventions log. The verdict of the fourth judgment check is not visible in the record.

explored
  • A live run with a 6-hour cap to test four judgment checks: incident assessor, fix reviewer, backlog review and a fourth
  • A fix for reviews that kept reading the originally deployed code after a fix landed
  • A scripted scenario with no live model calls and a capped short live check to prove the fix
decided
  • Run the full test suite locally and merge only where branch protection allows it without CI, since the budget for hosted CI runs was $0
open
  • The verdict of the fourth live judgment check is not visible in the record

Also on Monday, 2 November 2026