Surprise, your data warehouse can RAG
34 points by maciejgryka 1 year ago | 3 comments- ukd1 1 year agoIs $0.01 per retrieval a lot, or not?
- kirkarg 1 year agoThat would depend on what LLM are you using and the average tokens per answer. For example the average cost of the user query in my system is about 0.07 if you add 0.01 you are adding 15% per query (+-). Then, take into consideration how much value does RAG add to the answer Vs using other method.
Edit: typo in costs
- kirkarg 1 year ago
- rodrigovicuna 1 year agoInteresting. Thanks for sharing.