RAG customer support chatbot
High cache hit rate, medium output. Cache makes or breaks the unit economics.
Input
8,000 tokens
Output
300 tokens
Cached
85%
Calls / mo
200,000
High cache hit rate, medium output. Cache makes or breaks the unit economics.
Input
8,000 tokens
Output
300 tokens
Cached
85%
Calls / mo
200,000