$ attention.sh
1 / 9
The prompt
scroll, ◀ ▶ keys, or press play

One Forward Pass — attention.sh

$

Two ways to run a language model on your documents.
Same transformer. Different owner.
Your data is the token — watch both passes.

pass one · the rented brain

Every prompt is a disclosure.

This is how it works today: your document leaves your building, crosses the wire, and enters a model you can't see into — their weights, their logs, their jurisdiction.

The answer comes back. The copies don't. Watch the ghosts.

layer 01 · tokenization

Pass two: nothing leaves.

Same document, same physics — but now the machine lives with the data. Your contracts, filings, ledgers are broken into tokens by your own tokenizer, on your own metal.

When we build your LLM, this step already happens inside your boundary — your tokenizer, your infrastructure.

layer 02 · embedding

Meaning becomes geometry.

Every token becomes a point in space; understanding is distance. Watch the green constellation — that's a domain the model actually knows. In a generic API model, your domain's constellation is faint: nobody trained it to know your world.

We shape this space around your domain — what your model knows, and how precisely it knows it.

layer 03 · positional encoding

Order is context.

"Tax the exemption" is not "exempt the tax." In your domain, details this small are the whole job — and exactly where generic models quietly fail.

That's why every engagement starts with evaluation: we measure where off-the-shelf models fail on your real cases before tuning anything.

layer 04 · q·k·v projection

Every token becomes three tensors.

Three learned weight matrices — WQ, WK, WV — multiply each embedding into a query, a key, and a value. Those matrices are weights: the numbers where a model's knowledge lives.

Fine-tuning reshapes those numbers around your data. When we do it, the weights that result belong to you — owned, not rented.

layer 05 · multi-head self-attention

Attention is all you need.

Every token of your document asks every other: what do you mean to me? Eight heads read the same clause eight different ways — this is the mechanism that reads a contract whole instead of line by line.

It's what we're named after. We bend it to domains that can't afford to be approximately right — like yours.

layers 06…N · adaptation

You don't train a giant. You adapt one.

LoRA — the giant stays frozen; we train a thin sliver against your data and clip it beside the weights. Weeks, not quarters.

Distillation — then compress what works into a model your hardware budget can actually run.

Parameter-efficiency is the economics that makes a private, specialized model affordable. This is our craft.

output · softmax

A model is a decision-maker. The question is: whose?

Everything you just watched can run inside your boundary: your data never leaves, the weights belong to you, the infrastructure is yours.

Pass one needed your trust. Pass two never asked for it — for tax, law, and finance, that's not a preference, it's the requirement. We build it and hand it over.

$ ./attention.sh --compare

pass one: your data now lives in someone else's logs.

pass two: it never left. eval → fine-tune → deploy, on your infra.

hire us to build pass two — hello@attention.sh

meanwhile: the illustrated decoder · research · blog

attention.sh — a division of Jinacode Systems