output layer · research

Research

We're an applied lab. Our findings come out of real deployments — evaluation harnesses, fine-tunes, and routing systems for domains where "approximately right" isn't good enough.

ls published/
(empty) — first artifacts are still compiling
cat in-progress.md
→ an evaluation benchmark for tax-law LLMs (Indian GST)
→ a parameter-efficient fine-tuning playbook for regulated domains
→ routing across model tiers in production
→ distillation recipes for sovereign deployment budgets

The stack we care about

  1. layer 01

    evaluation

    Before anything is tuned, measure it. Eval suites that surface real failure modes in specialized domains — the kind users hit, not the kind benchmarks flatter.

  2. layer 02

    fine-tuning & distillation

    LoRA, adapters, and teacher→student compression — the math of parameter efficiency, applied where a specialist genuinely beats a generalist.

  3. layer 03

    retrieval & routing

    Grounding specialized models in the right context, and routing each query to the smallest model that can answer it well.

  4. layer 04

    sovereign deployment

    Your data, your weights, your infrastructure. Everything above, running inside your boundary — because for tax, law, and finance that's a requirement.

Until the first paper lands: read the blog, run the forward pass, or trace the intellectual traditions behind the math. Working on something in this space — or want to work on it with us? hello@attention.sh