Back to the room

Pass 3 of 3 · Deep dive of PHAROSPass 1 · OverviewPass 2 · How it works

Code Observatory / Serve

Repository memory

Learned conventions and history. It failed its primary evaluation.

Failed its gate

PHAROS at 975a38dMIT license

How it works

Memory is mined from the index and Git history and added to the context after ranking, so it cannot change what retrieval returns.

The locked evaluation failed its primary recall gate and its precision gate. Repository Q&A improved, but that was a secondary measure.

Source evidence

Claims this supports

  • Repository memory v1 failed its primary source-file recall and precision gates; audited precision was 55%.

    ReportedLedger

    Primary source-file recall went from 0.827 to 0.823. Repo Q&A, a secondary measure, improved from 5 to 14 of 30.