GPUs.
Reserved on Runpod and Hot Aisle. Spot on Vast.ai. Rates: compute gpu list.
Reserved
Reserved.
| GPU | Provider | VRAM | CLI |
|---|---|---|---|
H100-SXM | Runpod | 80 GB | --gpu H100 |
A100-PCIe-80GB | Runpod | 80 GB | --provider runpod --gpu A100-PCIe-80GB |
A100-SXM-80GB | Runpod | 80 GB | --provider runpod --gpu A100-SXM-80GB |
H100-PCIe | Runpod | 80 GB | --provider runpod --gpu H100-PCIe |
H200 | Runpod | 141 GB | --provider runpod --gpu H200 |
MI300X | Hot Aisle | 192 GB | --gpu MI300X |
Spot
Spot. Can be reclaimed.
| GPU | Provider | VRAM | CLI |
|---|---|---|---|
RTX-3090 | Vast.ai | 24 GB | --provider vastai --gpu RTX-3090 |
RTX-6000-ADA | Vast.ai | 48 GB | --provider vastai --gpu RTX-6000-ADA |
L4 | Vast.ai | 24 GB | --provider vastai --gpu L4 |
A100-40GB | Vast.ai | 40 GB | --provider vastai --gpu A100-40GB |
RTX-4090 | Vast.ai | 24 GB | --provider vastai --gpu RTX-4090 |
RTX-5090 | Vast.ai | 32 GB | --provider vastai --gpu RTX-5090 |
A100-80GB | Vast.ai | 80 GB | --provider vastai --gpu A100-80GB |
H100-SXM | Vast.ai | 80 GB | --provider vastai --gpu H100-SXM |
H100-SXM is on Runpod and Vast.ai. Spot: --provider vastai.