EdgeQuake – 100% Local with Ollama: Fixes Broken RAG

EdgeQuake – 100% Local with Ollama: Fixes Broken RAG

More

Summary

Fahd Mirza installs and tests EdgeQuick, an open-source graph RAG framework written in Rust that implements the LightRAG algorithm, positioning it as a solution to a specific failure mode in standard retrieval-augmented generation: the inability to answer questions requiring understanding of relationships between concepts rather than simple text similarity. Where conventional RAG chunks documents and retrieves nearest embeddings, EdgeQuick extracts entities and relationships using a local LLM, stores them as a traversable knowledge graph in PostgreSQL with PG vector for embeddings, and supports six query modes ranging from naive vector search to full hybrid graph traversal.

The installation uses Docker for the full EdgeQuick stack — database, backend API, and frontend UI launched via a single quickstart command — paired with Ollama running Gemma 4 as the LLM and Nomic Embed Text for embeddings, keeping the entire pipeline local with no paid API dependencies. Mirza works through the setup on an Ubuntu server with a GPU, pulling the required Ollama models and verifying endpoint health before attempting document ingestion.

The video also surfaces a concrete integration gotcha: EdgeQuick running inside Docker cannot reach an Ollama instance running on the host by default, causing document processing to fail with a connectivity error. Mirza identifies this as a straightforward networking configuration issue that the repository maintainers should have addressed. Developers evaluating self-hosted, privacy-preserving alternatives to cloud RAG services will find the architecture comparison between graph-based and chunk-based retrieval useful for understanding when EdgeQuick’s approach offers a meaningful advantage.


📺 Source: Fahd Mirza · Published April 14, 2026
🏷️ Format: Hands On Build

1 Item

Channels