Rail-aligned leaf switches

Fabric 08
Data centerHostHostHostHostHostHostHostHost

Turn every goal green.

Goals

Not tested yet

Half of the requests finish faster than this.What the servers and services cost each month.

64 H100 in 8 servers: tensor parallel inside each server, data parallel 8 across them. The board has two cabling plans: one leaf switch per rail or one per server. Keep one plan and the spines you need. A step must take under 3.1 s, within 132,000 USD/mo.

A full batch keeps each GPU busyArrow keys change the GPUs. Tap or Space changes the batch

2 GPUs · batch 64 · job 1.5 h · 2.1 USD