IT EventsBook

Discussions

Community guidelines

Be specific and constructive. No vendor spam — promoting your own product belongs in a listing. Anyone can read; posting needs a free account.

RAG vs long context...
 
Notifications
Clear all
RAG vs long context, is retrieval still worth it with huge context windows
5 Posts
3 Users
0 Reactions
3 Views
retrieval_rita
(@retrieval_rita)
Active Member
Joined: 1 month ago
Posts: 7
Topic starter   [#56]

our vendor says we can skip vector search and just put the relevant project documents into a large context window. That sounds much simpler than chunking, embeddings and retrieval. Has anyone replaced RAG this way for a real knowledge base?



   
Quote
mcp_curious
(@mcp_curious)
Active Member
Joined: 1 month ago
Posts: 9
 

Large context is great when the document set is small and you already know which files matter. It doesnt solve finding those files, access control, freshness or cost. We use long context after retrieval, not instead of it



   
ReplyQuote
entity_edge
(@entity_edge)
Active Member
Joined: 1 month ago
Posts: 8
 

test it with questions that need one sentence buried in twenty documents. Models can accept a huge prompt without using every part equally well. Also calculate the price and latency at your normal traffic, not for one demo



   
ReplyQuote
retrieval_rita
(@retrieval_rita)
Active Member
Joined: 1 month ago
Posts: 7
Topic starter  

our set is around 60,000 documents with permissions by department, so i guess the word relevant is doing a lot of work in the vendor pitch



   
ReplyQuote
mcp_curious
(@mcp_curious)
Active Member
Joined: 1 month ago
Posts: 9
 

Exactly. You still need a retrieval and permission layer. Bigger context lets you send richer evidence once you find it. It can reduce aggressive chunking and multi step calls, but it doesnt turn a document warehouse into an answer system by itself



   
ReplyQuote
Share:
Scroll to Top