Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions flash/configuration/gpu-types.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,9 @@ The `GpuGroup` enum provides access to GPU pools. Each pool contains specific GP
| `GpuGroup.ADA_48_PRO` | RTX 6000 Ada | 48GB | Professional inference |
| `GpuGroup.AMPERE_80` | A100 80GB PCIe, A100-SXM4-80GB | 80GB | XL models, intensive training |
| `GpuGroup.ADA_80_PRO` | H100 80GB HBM3 | 80GB | Cutting-edge inference |
| `GpuGroup.BLACKWELL_96` | RTX PRO 6000 Blackwell (Server, Workstation, Max-Q) | 96GB | Professional Blackwell workloads |
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Citation: New GPU groups and types added in PR #233. Changes in src/runpod_flash/core/resources/gpu.py add GpuGroup.BLACKWELL_96 and GpuGroup.BLACKWELL_180 pools, along with GpuType.NVIDIA_B200 and three RTX PRO 6000 Blackwell variants. VRAM specifications (96GB for RTX PRO 6000, 180GB for B200) are derived from the README update in the same PR.
View source

| `GpuGroup.HOPPER_141` | H200 | 141GB | Largest models, maximum VRAM |
| `GpuGroup.BLACKWELL_180` | B200 | 180GB | Maximum VRAM, next-gen training |

### Using GPU pools

Expand Down Expand Up @@ -81,7 +83,11 @@ The `GpuType` enum provides access to specific GPU models. Use these when you ne
| `GpuType.NVIDIA_A100_80GB_PCIe` | NVIDIA A100 80GB PCIe | 80GB | Ampere |
| `GpuType.NVIDIA_A100_SXM4_80GB` | NVIDIA A100-SXM4-80GB | 80GB | Ampere |
| `GpuType.NVIDIA_H100_80GB_HBM3` | NVIDIA H100 80GB HBM3 | 80GB | Hopper |
| `GpuType.NVIDIA_RTX_PRO_6000_BLACKWELL_SERVER_EDITION` | NVIDIA RTX PRO 6000 Blackwell Server Edition | 96GB | Blackwell |
| `GpuType.NVIDIA_RTX_PRO_6000_BLACKWELL_WORKSTATION_EDITION` | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 96GB | Blackwell |
| `GpuType.NVIDIA_RTX_PRO_6000_BLACKWELL_MAX_Q_WORKSTATION_EDITION` | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 96GB | Blackwell |
| `GpuType.NVIDIA_H200` | NVIDIA H200 | 141GB | Hopper |
| `GpuType.NVIDIA_B200` | NVIDIA B200 | 180GB | Blackwell |

### Using specific GPU types

Expand Down
Loading