This source only provides a headline — there is no body to show. Use “Read the original” below to read it at the source.
Stanford Research Open-Sources Memorilla, a Latent Memory Module for Frozen LLMs
Stanford researchers have released Memorilla , an open-source memory system for LLMs. The Memorilla memory system reads a whole document collection and hands a frozen LLM just 16 memory tokens. On FactKG, a frozen Qwen3-8B scored 84.33% with Memorilla, against 80.43% with every document in context . It did that with 108x fewer document tokens. Code, training recipes and checkpoints are public under Apache 2.0 . You can check the deployment options and specs here through our GPULeaderboard.com chrome extension . TL;DR Size: 194M-parameter trainable memory module. It always outputs 16 memory tokens, whatever the collection size. The encoder ( Qwen3-Embedding-4B ) and decoder ( Qwen3-8B ) stay frozen. Runs on: Linux with CUDA GPUs and Python 3.11. The quickstart needs 1 GPU with 80 GB (recipes ran on H100 80GB). No quantized variants disclosed. Performance: Highest reported average across 8 benchmarks (49.68), top score on 5 of 8. Best: PersonaMem-v2 accuracy of 44.60%, versus 27.92% for…