Every message vs customer facts as memory
Storing every message keeps all detail, but the index must hold 120 million items. Storing the facts customers state needs 12 million items and still recalls 90 percent in tests. On a 32 GB index host, message memory gives p99 over 10 s and 53 percent errors. Fact memory gives p99 26 ms.
5 MB/s · logs kept on the host · disk full in 33 minutes
NVMe drive · 75 µs per read
Case 1
Over 90 days, a support agent has 120 million messages and 12 million customer facts. The index host has 32 GB. Recall in tests: messages 93 percent, facts 90 percent. The target is 85 percent.
| Measure | Goal | Store every message | Store customer facts |
|---|---|---|---|
| p99 latency | under 50 ms | 10.1 s Fail | 26 ms Pass |
| Error rate | under 0.1% | 53.2% Fail | 0% Pass |
| Monthly cost | 164 USD/mo | 164 USD/mo |