Pain map
What breaks in document AI
290 production incidents from public threads. Every quote links to its source. Pick a category and check it yourself.
Indexing cost and re-indexing
8 of 8 quotes
“the removed documents, together with their text units, entities, relationships and community reports, stay in the index and remain retrievable by queries.”
GitHub, graphrag · 5 October 2026 · open the thread “Input: multilingual (non-English) group-chat transcripts.”
GitHub, graphiti · 25 September 2026 · open the thread “update_communities leaves dangling entity_ids/relationship_ids after an incremental update”
GitHub, graphrag · 3 September 2026 · open the thread “We're running `Neo4JStorage` in production against AuraDB on a Graph-RAG retrieval workload over real-world enterprise KGs”
GitHub, LightRAG · 24 May 2026 · in production · open the thread “I run a production deployment of Graphiti (Neo4j on NAS, bge-m3 embeddings via Ollama, custom `memory-curator-daemon` doing incremental cycles + weekly Leiden community rebuild).”
GitHub, graphiti · 22 May 2026 · in production · open the thread Hit this one too? We are building for it. Join the waitlist.
“In production this translates to hours of unnecessary processing time and significant LLM API costs.”
GitHub, LightRAG · 19 March 2026 · in production · open the thread “the process took approximately 60 minutes to complete (from 12:29:34 to 13:29:46), averaging 36 seconds per record.”
GitHub, graphiti · 23 February 2026 · open the thread “We split into multiple subgraphs to stay within limits, but this breaks the "single graph" benefit, cross-graph relationships are lost”
GitHub, graphiti · 10 February 2026 · open the thread Hit this one too? We are building for it. Join the waitlist.
Method
We collected 448 public posts published after 1 November 2025 in which a builder describes document AI failing. Each link was re-opened on 8 November 2026. We kept the 290 where the quote is on the page, the author describes an incident and not an opinion, and has no tie to a vendor. Quotes are verbatim and trimmed after 420 characters. The grouping is ours. A complaint is not a measurement.