RAG
A method that fetches relevant documents at query time and feeds them to the model, so answers are grounded in real sources.
Why it matters
RAG solves one of AI's biggest problems: outdated or missing knowledge. Instead of relying only on training data, RAG lets a model search your documents, databases, or the web in real time and use that information to answer questions.
Tools that use RAG give more accurate, up-to-date answers with source citations. This is especially valuable for enterprise use cases where the AI needs access to internal company data.
How it works
4 stepsRelated terms
From the glossaryAI tools that use RAG
Hand-reviewedFrequently asked questions
What is the difference between RAG and fine-tuning?+
RAG retrieves fresh external data at query time, so it stays current without retraining. Fine-tuning bakes knowledge into the model weights permanently but goes stale as the world changes.
Does RAG work with any LLM?+
Yes. RAG is an architectural pattern, not a model-specific feature. You can pair it with GPT-4, Claude, Llama, or any model that accepts retrieved context in the prompt.
Is RAG expensive to run?+
The main costs are the vector database and the extra tokens from retrieved chunks added to each prompt. For most production use-cases this is far cheaper than fine-tuning.
Browse related categories
See the tools that use it.
The fastest way to understand RAG is to see it inside real products. Browse hand-reviewed tools that put it to work, each one checked by a person before it was listed.
Browse hand-reviewed AI tools