Graphics accelerators (GPUs)

Compute Cloud provides graphics accelerators (GPUs) for different VM configurations. GPUs outperform CPUs in terms of processing certain types of data and are suitable for machine learning (ML), artificial intelligence (AI), and 3D rendering tasks. You can manage GPUs and RAM directly from your VM.

In Compute Cloud, you can use the following GPUs:

• NVIDIA A100 with 80 GB HBM2.
• NVIDIA T4 with 16 GB GDDR6.
• NVIDIA H100 with 80 GB HBM3.

By default, quotas for creating VMs with GPUs are set to zero. You can request a quota increase in the management console. To do this, you need the quota-manager.requestOperator role or higher.

Available GPUsAvailable GPUs

NVIDIA A100NVIDIA A100

The NVIDIA A100 GPU based on the Ampere® microarchitecture. It uses third-generation Tensor Cores and delivers 80 GB HBM2 memory with up to 2 TB/s throughput.

NVIDIA T4NVIDIA T4

NVIDIA Tesla T4 based on the Turing architecture uses Turing tensor cores, as well as the RT cores, and provides 16 GB of GDDR6 memory with a throughput of 300 GB/s.

NVIDIA H100NVIDIA H100

NVIDIA H100 GPU is powered by the NVIDIA Hopper architecture. It features fourth-generation Tensor Cores and has the capability to apply mixed FP8 and FP16 precisions to dramatically accelerate AI calculations for transformers – up to 4x faster training and up to 30x faster inference over the prior generation (NVIDIA A100). NVIDIA H100 offers 80 GB of HBM3 RAM and up to 3.35 TB/s memory bandwidth.

For more information, go to the NVIDIA website:

• NVIDIA H100 page
• NVIDIA H100 datasheet
• NVIDIA Hopper page

Configurations of VMs with GPUsConfigurations of VMs with GPUs

The configurations available for VMs with GPUs are listed below.

• AMD EPYC™ with NVIDIA® Ampere® A100 (gpu-standard-v3):

  Number of GPUs	VRAM, GB	Number of vCPUs	RAM, GB
  1	80	28	119
  2	160	56	238
  4	320	112	476
  8	640	224	952

• Intel Ice Lake with NVIDIA® Tesla® T4 (gpu-standard-v3-t4):

  Number of GPUs	VRAM, GB	Number of vCPUs	RAM, GB
  1	16	8	32
  1	16	16	64
  1	16	32	128

• Intel Sapphire Rapids with NVIDIA® Hopper® H100 (gpu-h100):

  Number of GPUs	VRAM, GB	Number of vCPUs	RAM, GB
  1	80	20	160
  2	160	40	320
  4	320	80	640
  8	640	160	1280

VM GPUs are provided in full. For example, if a configuration has four GPUs specified, your VM will have four full-featured GPU devices.

For more information about organizational and technical limitations for VMs, see Quotas and limits.

OS imagesOS images

For VMs with GPUs, you can use products with pre-installed NVIDIA drivers available from Cloud Marketplace, install the drivers on another standard image yourself, or create a custom image with pre-installed drivers.

See alsoSee also

• Creating a VM with a GPU
• Adding a GPU to an existing VM
• Changing the number of GPUs