What to store as agent memory
Difficulty 4 of 5
A support agent recalls past chats. Over 90 days there are 120 million messages, 8 million sessions, and 12 million customer facts. The index host has 32 GB. Recall in tests: messages 93 percent, summaries 78, facts 90. Target: 85. Choose what to store.
Options
- Every message
- One summary per session
- The facts customers state
Goals and limits
- p99 latency
- under 50 ms
- Error rate
- under 0.1%
- Monthly cost
- under 300 USD/mo
- Hosts
- 8 vCPU · 32 GB
- Traffic
- 500 req/s
Concepts
How players did
Player results load from the server.