Challenges

Yearly batch analytics

Spotify: Wrapped

DifficultyStages: 0 / 4
  1. Log the listens
  2. Roll up the year
  3. Serve 500M summaries
  4. Render before launch
  5. Final test

Build a yearly summary pipeline. Log billions of listens, roll up a year of data before a deadline, serve 500 million summaries, and render share cards before launch.

Final testAt 10:00 a late partition arrives and adds 100,000 cards to render. Your final board runs once more with a new traffic seed.

The system, stage by stageTap, drag or use arrow keys to step through the stages

Stage 4 of 4 · 8 parts given · 102,320 requests/s

Mobile users 1Stream processor 1

Progress on this page stays on this device.

Product names belong to their owners. Cogore is not affiliated with them.