The Memory Palace Revival: How MemPalace Uses an Ancient Greek Technique to Top AI Memory Benchmarks
> "If you can't explain something complex to an ordinary person, you don't truly understand it yourself." — Richard Feynman
Introduction: Cicero's Memory Palace
Two thousand years ago, Roman orators like Cicero delivered hours-long speeches without notes, using the Method of Loci: imagining a grand building and placing each argument in a different room. To recall, you simply "walk" through the palace in your mind.
Two millennia later, developers Milla Jovovich and Ben Sigman digitized this technique as MemPalace — a completely free, fully local memory system that requires no internet connection. On the LongMemEval benchmark it achieved 96.6% Recall@5, the highest publicly reported score for a system with no commercial infrastructure behind it.
Chapter 1: The Vanishing Memory
The modern AI paradox: we have unprecedented computing power, but unprecedented memory loss. Every new chat session starts from scratch. With 19.5 million tokens of conversation over six months, no context window can hold everything — and LLM-generated summaries lose the crucial *why* behind decisions.
Traditional solutions are dead ends: 1. Load everything — impossible; context windows are too small. 2. LLM summaries — lossy; an AI deciding what's "important" discards reasoning context.
MemPalace's answer is simple: store everything, then make it findable.
Chapter 2: The Palace Blueprint
MemPalace organizes memory in six hierarchical levels:
- Wings — top-level domains (people, projects, topics), e.g.
wing_nebula - Rooms — specific subjects within a wing, e.g.
room_database - Halls — connections between related rooms within a wing (standard types: facts, events, discoveries, preferences, advice)
- Tunnels — cross-wing connections linking the same topic in different wings
- Closets — structured summaries for fast browsing
- Drawers — verbatim transcripts, never deleted
- L0: Identity (~100 tokens) — always loaded.
- L1: Essential Story (~500–800 tokens) — who the user is, key projects, preferences, decisions.
- L2: On-Demand (~200–500 tokens per topic) — dynamically loaded when a topic arises.
- L3: Deep Search (unbounded) — explicitly triggered full-palace search across all drawers.
- Vector store: ChromaDB — semantic search over summaries and transcripts.
- Knowledge graph: SQLite — a temporal knowledge graph of entity relations with timestamps (e.g.,
Bob -[assigned_to]-> auth module), supporting invalidation without losing history. - Full history: 19.5M tokens — impossible.
- LLM summaries: ~650K tokens, ~$507/year.
- MemPalace L0+L1: ~600–900 tokens, under $1/year — leaving 95%+ of the context window for actual work.
- Token counts used a flawed "characters ÷ 3" heuristic; a real tokenizer showed AAAK (73 tokens) was *larger* than the original (66 tokens).
- AAAK is lossy, not lossless: it scores 84.2% on LongMemEval vs 96.6% for raw verbatim mode.
- The "+34% palace structure gain" came from ChromaDB's standard metadata filtering, not a proprietary technique.
- Drawers store raw verbatim records — the source of the 96.6% score. Other systems summarize before storing and lose information.
- Closets store plain-text summaries for quick triage.
- GitHub: https://github.com/milla-jovovich/mempalace
- LongMemEval paper: https://arxiv.org/abs/2410.10813
- Cicero, *De Oratore*, Book II, Chapter LXXXVII
- Feynman, "Cargo Cult Science," 1974 Caltech commencement address
Why Structure Matters
| Search strategy | Recall@10 | Gain | |---|---|---| | Search all closets (no structure) | 60.9% | baseline | | Wing-limited search | 73.1% | +12% | | Wing + halls | 84.8% | +24% | | Wing + rooms | 94.8% | +34% |
Adding structured metadata alone improved retrieval accuracy by 34%. Structure is not decoration — structure is the product. Unlike flat RAG (a giant alphabetical filing cabinet), MemPalace mimics associative, spatial human memory.
Chapter 3: The Four-Layer Memory Stack
Technical Architecture
SQLite was chosen over Neo4j (used by competitor Zep) for simplicity: fully local, zero configuration, no network, free.
MCP Integration
MemPalace exposes 19 MCP tools so AI assistants operate the palace directly: search (mempalace_search), write/delete drawers, knowledge-graph queries and timelines, navigation (mempalace_traverse, mempalace_find_tunnels), and agent diary tools. For Claude Code, a Save Hook (every 15 messages) and PreCompact Hook automatically preserve important content.
Wake-Up Cost
Chapter 4: Honest About AAAK
Shortly after launch, the README claimed the experimental "AAAK" notation dialect achieved "30x lossless compression." Within 48 hours, the community found:
Milla and Ben's response became the story's highlight. Rather than quietly editing or issuing PR spin, they added a candid section: *"The community caught real problems in this README within hours of launch and we want to address them directly."* And: *"We're listening, we're fixing, and we'd rather be right than impressive."*
This echoes Feynman's Challenger investigation principle: "For a successful technology, reality must take precedence over public relations, for nature cannot be fooled."
Chapter 5: Resonance with Ancient Greece
Human memory is associative, contextual, and narrative — not random-access. The Method of Loci works because it exploits our evolutionarily honed spatial memory. MemPalace does the same: Wings, Rooms, Halls, and Tunnels are spatial metaphors that embed abstract information in navigable structure.
A concrete search example: asking "why did we choose Postgres?" — a flat RAG system returns truncated chunks ("better performance"). MemPalace navigates to wing_nebula/room_database, reads the closet summary ("2025-11-03: chose Postgres due to concurrent write needs, >10GB dataset, ACID requirements"), then opens the drawer for the full discussion, including who proposed what and who owns the migration.
Closet vs Drawer
Conclusion: Memory Sovereignty
As more of our memory migrates to corporate clouds, MemPalace offers the opposite: fully local operation, no API keys, no internet — your conversations never leave your machine. It is memory sovereignty: no one can audit, exploit, or delete your history.
Two thousand years after Cicero, the oldest memory technique remains the most effective — not because the ancients were smarter, but because the cognitive constraints are the same. The answer to "how do we make AI truly remember?" is surprisingly simple: remember like humans do — organize by structure, guide retrieval with spatial metaphor, keep the raw record, and accelerate access with metadata.
Appendix: Competitive Comparison
| System | LongMemEval R@5 | API required | Cost | Storage | |---|---|---|---|---| | MemPalace (hybrid) | 100% | optional | free | local | | Supermemory ASMR | ~99% | yes | — | — | | MemPalace (raw) | 96.6% | no | free | local | | Mastra | 94.87% | yes (GPT) | API fees | cloud | | Mem0 | ~85% | yes | $19–249/mo | cloud | | Zep | ~85% | yes | $25/mo+ | Neo4j cloud |