Surprise, your data warehouse can RAG

34 points by maciejgryka 1 year ago | 3 comments
  • ukd1 1 year ago
    Is $0.01 per retrieval a lot, or not?
    • kirkarg 1 year ago
      That would depend on what LLM are you using and the average tokens per answer. For example the average cost of the user query in my system is about 0.07 if you add 0.01 you are adding 15% per query (+-). Then, take into consideration how much value does RAG add to the answer Vs using other method.

      Edit: typo in costs

    • rodrigovicuna 1 year ago
      Interesting. Thanks for sharing.