Pass 3 of 3 · Deep dive of PHAROSPass 1 · OverviewPass 2 · How it works
Code Observatory / Index
Ingestion jobs
A durable queue in the database. Workers claim jobs atomically.
Source audited
PHAROS at 975a38dMIT license
How it works
Queue state lives in PostgreSQL, so a job survives a restart. Redis is optional and only wakes workers, which also poll.
Stalled workers are recovered, and retries back off. On the free deployment the API cannot index, so jobs wait for a separate worker.
