whatisgithub

What is paperguru-benchmark?

paperguru-ai/paperguru-benchmark — explained in plain English

Analysis updated 2026-05-18

216TeXAudience · researcherComplexity · 2/5Setup · easy

In one sentence

A research paper and benchmark for a new AI memory system that helps agents track information across very long, multi-day tasks.

Mindmap

mindmap
  root((repo))
    What it does
      Lifecycle aware memory for AI
      Tracks outdated facts
      Tracks citation chains
    Tech stack
      TeX paper
      Capital Chunk Memory
      Routing plus raw content layers
    Use cases
      Studying agent memory systems
      Long horizon research tasks
      Benchmarking AI agents
    Audience
      AI researchers
      Academic readers
    Results
      PaperBench improvement
      SurveyBench improvement

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Read the paper to understand a new approach to long-term AI agent memory.

USE CASE 2

Compare results against PaperBench and SurveyBench benchmark scores.

USE CASE 3

Study how Capital Chunk Memory separates routing information from raw content.

USE CASE 4

Use the evaluation materials as a reference for research on long-horizon agents.

What is it built with?

TeX

How does it compare?

paperguru-ai/paperguru-benchmarksiriusfzh/novaforgemadnanrizqu/vibe-cv-resume
Stars21619972
LanguageTeXTeXTeX
Setup difficultyeasymoderate
Complexity2/52/52/5
Audienceresearchergeneralgeneral

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · easy Time to first run · 30min

This is primarily a paper and benchmark artifact, not a runnable application.

So what is it?

PaperGuru is a research project introducing a new memory architecture for AI agents that work on long, complex tasks. The core problem it addresses is that AI language models are good at answering questions within a single conversation, but they struggle to keep track of information across very long sessions, like spending multiple days reviewing research papers or reproducing a published study from scratch. The solution is called Lifecycle-Aware Memory, or LAM. The idea is that memory for AI should not just store facts but also track when facts become outdated, how documents relate to each other through citation chains, and where each claim originally came from. The system's central mechanism, called Capital Chunk Memory, separates memory into a compact routing layer and the full raw content, allowing the agent to find relevant information efficiently even as its knowledge archive grows without limit. The repository contains the benchmark results, paper, and evaluation materials demonstrating the system's performance. On two published research benchmarks, PaperBench and SurveyBench, PaperGuru outperforms the previously best-known results by a substantial margin. This is primarily a research artifact you would use if you are studying AI agent memory systems or evaluating long-horizon AI agents on scientific research tasks. It is written in TeX, reflecting its academic paper orientation.

Copy-paste prompts

Prompt 1
Summarize what Lifecycle-Aware Memory is and why it helps AI agents on long tasks.
Prompt 2
Explain how Capital Chunk Memory separates a routing layer from raw content, and why that helps as memory grows.
Prompt 3
How does PaperGuru's performance on PaperBench and SurveyBench compare to prior results?
Prompt 4
What kinds of long-horizon research tasks would benefit most from this memory architecture?
Prompt 5
Help me understand the citation chain tracking idea described in this paper.

Frequently asked questions

What is paperguru-benchmark?

A research paper and benchmark for a new AI memory system that helps agents track information across very long, multi-day tasks.

What language is paperguru-benchmark written in?

Mainly TeX. The stack also includes TeX.

How hard is paperguru-benchmark to set up?

Setup difficulty is rated easy, with roughly 30min to a first successful run.

Who is paperguru-benchmark for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.