Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Introduction

llm-mem is a memory server for AI agents. It gives your AI assistant persistent, searchable memory that works across sessions — conversations, codebases, documents, and anything else you want it to remember.

It’s a single self-contained binary written in Rust. No databases to install, no cloud services required, no API keys needed by default. Everything runs locally on your machine, and data never leaves your computer.

Warning

Beta software —

This is beta software. Expect rough edges and breaking changes. Use it to try things out, not for anything important.

How it works

When connected to an AI assistant via the Model Context Protocol (MCP), llm-mem exposes a set of tools the assistant can call to:

  • Store raw text, documents, or AI-extracted facts as memories
  • Search by meaning (semantic search) or by keyword
  • Browse chronologically with timeline tools
  • Navigate a layered pyramid from raw content up to abstract insights
  • Manage isolated memory banks, backups, and document uploads

The assistant calls these tools just like any other MCP tool — no special prompting required.

What makes it different

Featurellm-mem
Local-firstRuns entirely on your machine by default. No cloud, no accounts, no data leaves your box.
Embedded vector storeUses LanceDB embedded. No separate database server.
Layered memoryL0 raw → L1 summaries → L2 connections → L3 concepts → L4 insights, with auto-abstraction.
AI in-processBundled llama.cpp for local LLM, fastembed for local embeddings. Zero-config.
MCP-nativeSpeaks MCP stdio. Drop into opencode, VS Code Copilot, or any MCP client.
Standalone CLIIncludes an interactive REPL and single-command mode for shell scripting.

Next steps