Back to Ultralytics

Platform Gpu Table

docs/macros/platform-gpu-table.md

8.4.462.0 KB
Original Source
GPUGenerationVRAMCost/HourBest For
RTX 2000 AdaAda16 GB$0.24Small datasets, testing
RTX A4500Ampere20 GB$0.25Small-medium datasets
RTX 4000 AdaAda20 GB$0.26Medium datasets
RTX A5000Ampere24 GB$0.27Medium datasets
L4Ada24 GB$0.39Inference optimized
A40Ampere48 GB$0.40Larger batch sizes
RTX 3090Ampere24 GB$0.46General training
RTX A6000Ampere48 GB$0.49Large models
RTX PRO 4500Blackwell32 GB$0.54Great price/performance
RTX 4090Ada24 GB$0.59Best price/performance
RTX 6000 AdaAda48 GB$0.77Large batch training
L40SAda48 GB$0.86Large batch training
RTX 5090Blackwell32 GB$0.89Latest consumer generation
L40Ada48 GB$0.99Large models
A100 PCIeAmpere80 GB$1.39Production training
A100 SXMAmpere80 GB$1.49Production training
RTX PRO 6000Blackwell96 GB$1.69Recommended default
H100 PCIeHopper80 GB$2.39High-performance training
H100 SXMHopper80 GB$2.69Fastest training
H100 NVLHopper94 GB$3.07Maximum performance
H200 NVLHopper143 GB$3.39Maximum memory (Pro+)
H200 SXMHopper141 GB$3.59Maximum performance (Pro+)
B200Blackwell180 GB$4.99Largest models (Pro+)