Lab notebook

Open questions.

Pass 1 of 3 Overview What the three badges mean 1 minute

Every entry carries one of three badges. Planned means nothing exists yet. Prototype means it runs but proves little. Measured means there is a result, including a failed one.

Pass 2 of 3 How it works The open questions, each with its badge 3 minutes

  1. prototype

    Bounded website actions

    Valerie runs on this site through a dependency-free kernel. Buttons and a phrase matcher propose actions; deterministic code validates and executes them. A visitor may also wake a small model, fine-tuned for this site, in their own browser. It proposes one action from the same closed list, the same code checks it, and nothing runs until the visitor presses it.

  2. measured

    PHAROS retrieval evaluation

    Two locked held-out sets, 101 questions. Reported nDCG@10 rose on both. One annotator, CPU, not reproduced for this site.

  3. measured

    Repository memory v1

    Failed its primary source-file recall gate and its precision gate. Kept here on purpose: a secondary improvement does not cancel a failed primary metric.

  4. planned

    Live PHAROS search

    The recorded explorer already runs on this site: real runs of PHAROS, replayed with their source. What is planned is different: live search against one approved public snapshot, through a read-only proxy, so a visitor’s own question gets a fresh answer.

  5. planned

    R&Bot model card

    Locate the source, tokenizer, logs and checkpoint, then publish what they actually support.

  6. planned

    Physical AI experiments

    An active interest. No experiment artifacts exist yet, so nothing here is a result.

Pass 3 of 3 Deep dive The next experiment for each, and where its evidence lives as long as you like

  1. Bounded website actions Measure the browser model on lines real recruiters type, and on phones; keep the phrase matcher for browsers without WebGPU.
  2. PHAROS retrieval evaluation Publish the exact experiment configuration beside the result.
  3. Repository memory v1 Memory earns a claim only by clearing its own gates.
  4. Live PHAROS search Pin a licensed snapshot, then build the read-only proxy contract. Nothing goes live before the security work does.
  5. R&Bot model card Inspect first. Nothing goes live before the evidence does.
  6. Physical AI experiments Choose a first experiment small enough to measure honestly.