Notes · 02 · Team knowledge

The wiki that writes itself.

Team knowledge doesn't get lost — it decays. Andrej Karpathy's LLM-wiki pattern, read through an actuary's eyes: the know-how earned in past experience studies, documented in a form that keeps itself true — an agent does the filing and the linting, a human curates and approves.

Every actuarial team I have worked in had a shared drive with a folder called something like Reports. Inside: the 2023 study report in three near-identical "final" versions, a data-definition sheet with two competing versions, a "how we treat split claims" note that half the team knows and the other half rewrote from scratch last quarter. None of it was wrong when written. Much of it has quietly drifted since. Nobody deleted anything, because nobody was sure what was still true.

That is the actual failure mode of team knowledge. It is rarely lost. It decays — the world moves, definitions drift, two documents start to disagree, and the disagreement sits unnoticed until it costs someone a week. Wikis, note-taking apps, SharePoint: every generation of tooling made it easier to store knowledge, and none of them made it cheaper to keep it true. The maintenance always fell to a person, and it was never anyone's job.

In 2026 Andrej Karpathy sketched a pattern that goes after exactly that maintenance cost, and gave it a plain name: the LLM wiki. I have been trying a version of it as a personal project — pointed at the build record of my own AI-agent experiment, the one behind the AAC talk. This note is the concept and the actuarial reading of it; the results will come later, once there is enough history to be honest about.

The problem was never storage. The problem is that nobody's job is to keep the knowledge true. An LLM wiki makes that somebody's job — and the somebody doesn't get tired.

What the pattern actually is

Strip away the tooling and it is three layers and three loops. The layers: raw sources (memos, papers, meeting notes — immutable, the LLM reads but never edits), the wiki (interlinked markdown pages for entities and concepts — owned and written entirely by the LLM), and the schema (one configuration file that says how pages are structured, what conventions hold, and how the loops run). If you read Note 01, you will recognise the schema for what it is: a harness.

The loops: ingest — a new source arrives, the LLM reads it, updates every page it touches, flags where it contradicts something already on file, and appends to a log. Query — you ask a question, it answers from the wiki with citations, and a good answer gets filed back as a page. Lint — periodically it walks the whole thing looking for contradictions, orphan pages, missing cross-references, and claims that a newer source has superseded.

The contrast Karpathy draws is with retrieval-augmented generation. RAG re-derives an answer from raw chunks every time you ask; nothing accumulates. The wiki compiles knowledge once and then keeps it current — in his words, "a persistent, compounding artifact." And the division of labour is stated plainly: the human's job is to curate sources, direct the analysis, and ask good questions; the LLM's job is everything else — the summarising, cross-referencing, filing, and bookkeeping that no one wanted to do.

Read it as an actuary and it looks familiar

Now put on the other hat. Think about what an experience-study team actually accumulates over the years: which cedant's data arrives in what shape, which checks caught what, how a judgment call was made and why, which treatment worked and which quietly didn't. That know-how is the team's real asset — and almost all of it lives in close-out memos, old workpapers, and people's heads. In my AAC talk I called this bottleneck by name: one-off fixes, no reuse — the records pile up, but most stay case-specific. The LLM wiki is the missing second half of that sentence. It is where one-off fixes go to become reusable: each study's lessons, filed as general pages, cross-referenced, and — this is the part no shared drive ever did — kept true after the next study contradicts them.

So the actuarial reading of the LLM wiki is not "a chatbot over our documents." It is: turn every study close-out into an ingest, and every pre-study "how did we handle this last time?" into a query against pages that are actually current. Every contradiction flag is a lesson from one study colliding with a lesson from another — exactly the collision you want surfaced before the next study, not during it. And the human role stays where the profession keeps it: curate what goes in, decide what a contradiction means, sign off. The agent proposes an edit; a person approves it. If you read the AAC experiment, you have already seen this working at miniature scale — the harness playbooks grew from zero to fifty rules precisely because every retrospective was ingested, generalized, and gated. That was an LLM wiki with one topic. This note is the same loop, pointed at everything a study teaches.

Study know-how — data quirks, treatments, judgment rationalesThe wiki: general, cross-referenced pages the model maintains
Close-out memos, workpapers, cedant correspondenceRaw sources: immutable, cited, never edited by the model
Study close-out / retrospectiveIngest: the lessons filed into every page they touch
"How did we handle this last time?"Query: answered from current pages, with citations
"Is this still how we do it?" before each studyLint: contradictions, orphans, superseded lessons
Sign-offStill a person. Always a person.

Why "writes itself" is the wrong thing to be impressed by

The demo everyone shares is the writing: drop in a memo, watch six pages update. It is impressive and it is not the point. Writing pages was never the bottleneck — junior staff have always been able to write pages. The bottleneck was keeping the pages true after the world moved, and that is a decay process, which means the honest way to evaluate any knowledge system is not "how much did it write" but "how much of what it holds can I still trust, and how many contradictions is it hiding right now."

Below is a toy model of that idea — no chart to decode, just the pages themselves. The same hundred pages of team knowledge, three times over. Every month the world changes a little, so pages quietly fade; stale pages that overlap start to disagree — the red-ringed ones are contradictions nobody has noticed. The only difference between the three panels is who maintains the wiki, and how often. Watch three years pass.

Same 100 pages, three fates
Each square is one page of team knowledge. Indigo = still true · gray = quietly stale · red ring = a hidden contradiction. Hover a square for its page name.
Month 0 / 36
Still trueStaleHidden contradiction

Illustrative toy model: each page has a small monthly chance of going stale as the world moves, stale overlapping pages breed contradictions, and each panel repairs on its own cadence and cost. The same random draws drive all three panels — the pages age identically; only the maintenance differs. Built to make one idea tactile, not to report data from any real team.

Three things the race makes visible. First, the shared drive doesn't fail — it fades; there is no cliff, which is exactly why nobody sounds the alarm. Second, the annual review panel pulses: bright on the day it happens, then a slow slide for eleven months — that rhythm is what "we do clean it up, honestly" looks like from the inside. Third — and this is the point — the wiki panel is not brighter because the model is clever. It is brighter because the review cadence became continuous: the same repairs, made the month they were needed, for fewer human hours spent approving instead of searching.

That is the macro view. Here is one turn of the micro loop — the thing that actually happens each time a document arrives. You play the actuary; the agent has already done the reading.

One ingest, start to finish
A new source arrives → the agent updates the pages it touches → flags what it contradicts → and waits. Nothing lands without you.
Incoming source

Press the button to receive a memo

Three sample memos are queued — the kind that land in an actuarial inbox every month.

The 30-page mini-wiki on the left is waiting.

There is a caveat worth stating, and Karpathy states it too. A wiki that only checks itself against itself can still hide contradictions with the world outside — a regulation that changed, a system that was re-cut — if no source about that change is ever ingested. Lint keeps the wiki internally consistent; it does not make it omniscient. Curating what goes in remains the human's job, and it is the job that matters most.

The agent does the filing, the cross-referencing, and the linting. The actuary curates the sources and approves the edits. Same division of labour as the experience study; smaller stakes, same shape.
What I am actually running, and what's missing from this note. I have this pattern pointed at the build record of my AI-agent experiment — how the harness was designed, why each rule was adopted, what each cycle changed, and the decisions behind the generator and the grader — with a schema that borrows directly from that same harness (a charter, conventions, and a rule that no edit lands without approval). What I don't have yet is enough months of history to say what the wiki caught, what it got wrong, and what it cost. That section is deliberately absent rather than guessed. When there is a real audit trail, it will be added here.

Until then, the argument stands on its own terms: the expensive part of team knowledge was never writing it down. It was keeping it true. That is a review problem, and review is what we do.