Back to the room

Pass 3 of 3 · Deep dive of PHAROSPass 1 · OverviewPass 2 · How it works

Code Observatory / Index

Ingestion jobs

A durable queue in the database. Workers claim jobs atomically.

Source audited

PHAROS at 975a38dMIT license

How it works

Queue state lives in PostgreSQL, so a job survives a restart. Redis is optional and only wakes workers, which also poll.

Stalled workers are recovered, and retries back off. On the free deployment the API cannot index, so jobs wait for a separate worker.

Source evidence