GPUs are used to accelerate workloads, and Cloud Workstations supports attaching GPUs to workstations. Cloud Workstations supports many of the various GPU models that are available to attach to Compute Engine VMs. The model and quantity of GPUs to attach to each workstation are specified on the workstation configuration. Cloud Workstations handles attaching the GPUs and installing their device drivers.
Attaching GPUs to workstations will affect costs as described in the Cloud Workstations pricing overview.
Limitations
A workstation configuration may specify GPUs, subject to the following limitations:
- Cloud Workstations only supports GPUs for configurations that specify machine types in the N1 machine series, the A2 machine series, or the A3 machine series. Refer to supported GPU models for details.
- The configuration must specify replica zones where the chosen GPU model is available.
- It is not possible to configure workstations to have more than one model of GPU attached at a time.
Configurations that specify A2 Ultra machine types must not specify persistent storage. Consider using an NFS-based solution such as Filestore or Cloud Storage FUSE if persistent file storage is required. Note that A2 Standard machine types do support persistent storage. To create configurations without persistent storage, use the following Google Cloud CLI command:
gcloud workstations configs create CONFIG_NAME \ --project=PROJECT_ID \ --cluster=CLUSTER_NAME \ --region=LOCATION \ --machine-type=A2_MACHINE_TYPE \ --no-persistent-storageReplace the following:
PROJECT_ID: the ID of the project that contains the workstation configuration.LOCATION: the region of the workstation cluster.CLUSTER_NAME: the name workstation cluster that contains the workstation configuration.CONFIG_NAME: the name of the workstation configuration.A2_MACHINE_TYPE: the type of the A2 machine.
Configurations that specify A3 machine types only support Hyperdisk persistent volumes.
Using Google Cloud Hyperdisk disk types is only supported on these following machine series:
- A3
- C3
- C4
- G4
- M3
- N4
- N4D
- Z3
Supported GPU models
Cloud Workstations supports many of the GPU models that Compute Engine makes available. The models that are supported depend on the machine series chosen for the workstation configuration, as summarized in the following table.
N1 machine series
The N1 general-purpose machine series supports several GPU models, and workstation configurations that specify any of the N1 machine types can also specify one of the following GPU models. For the chosen GPU model, the configuration may specify a count of how many GPU cards to attach to each workstation.
| GPU model | GPU counts |
|---|---|
NVIDIA T4 (nvidia-tesla-t4) |
1, 2, or 4 GPUs |
NVIDIA P4 (nvidia-tesla-p4) |
1, 2, or 4 GPUs |
NVIDIA V100 (nvidia-tesla-v100) |
1, 2, 4, or 8 GPUs |
NVIDIA P100 (nvidia-tesla-p100) |
1, 2, or 4 GPUs |
A2 machine series
The A2 Standard and A2 Ultra accelerator-optimized machine series have a fixed number of NVIDIA A100 GPUs attached, based solely on the chosen machine type.
The following table shows the mapping from machine type to the number of cards that will be attached.
| GPU model | Machine type | GPU count |
|---|---|---|
NVIDIA A100 40GB (nvidia-tesla-a100) |
a2-highgpu-1g |
1 GPU |
a2-highgpu-2g |
2 GPUs | |
a2-highgpu-4g |
4 GPUs | |
a2-highgpu-8g |
8 GPUs | |
a2-megagpu-16g |
16 GPUs | |
NVIDIA A100 80GB (nvidia-a100-80gb) |
a2-ultragpu-1g |
1 GPU |
a2-ultragpu-2g |
2 GPUs | |
a2-ultragpu-4g |
4 GPUs | |
a2-ultragpu-8g |
8 GPUs |