Type: gpu
¶
GPU devices make the specified GPU device or devices appear in the instance.
Note
For containers, a gpu
device may match multiple GPUs at once.
For VMs, each device can match only a single GPU.
The following types of GPUs can be added using the gputype
device option:
physical
(container and VM): Passes an entire GPU through into the instance. This value is the default ifgputype
is unspecified.mdev
(VM only): Creates and passes a virtual GPU through into the instance.mig
(container only): Creates and passes a MIG (Multi-Instance GPU) through into the instance.sriov
(VM only): Passes a virtual function of an SR-IOV-enabled GPU into the instance.
The available device options depend on the GPU type and are listed in the tables in the following sections.
gputype
: physical
¶
Note
The physical
GPU type is supported for both containers and VMs.
It supports hotplugging only for containers, not for VMs.
A physical
GPU device passes an entire GPU through into the instance.
Device options¶
GPU devices of type physical
have the following device options:
Key |
Type |
Default |
Description |
---|---|---|---|
|
int |
|
GID of the device owner in the instance (container only) |
|
string |
- |
The DRM card ID of the GPU device |
|
int |
|
Mode of the device in the instance (container only) |
|
string |
- |
The PCI address of the GPU device |
|
string |
- |
The product ID of the GPU device |
|
int |
|
UID of the device owner in the instance (container only) |
|
string |
- |
The vendor ID of the GPU device |
gputype
: mdev
¶
Note
The mdev
GPU type is supported only for VMs.
It does not support hotplugging.
An mdev
GPU device creates and passes a virtual GPU through into the instance.
You can check the list of available mdev
profiles by running incus info --resources
.
Device options¶
GPU devices of type mdev
have the following device options:
Key |
Type |
Default |
Description |
---|---|---|---|
|
string |
- |
The DRM card ID of the GPU device |
|
string |
- |
The |
|
string |
- |
The PCI address of the GPU device |
|
string |
- |
The product ID of the GPU device |
|
string |
- |
The vendor ID of the GPU device |
gputype
: mig
¶
Note
The mig
GPU type is supported only for containers.
It does not support hotplugging.
A mig
GPU device creates and passes a MIG compute instance through into the instance.
Currently, this requires NVIDIA MIG instances to be pre-created.
Device options¶
GPU devices of type mig
have the following device options:
Key |
Type |
Default |
Description |
---|---|---|---|
|
string |
- |
The DRM card ID of the GPU device |
|
int |
- |
Existing MIG compute instance ID |
|
int |
- |
Existing MIG GPU instance ID |
|
string |
- |
Existing MIG device UUID ( |
|
string |
- |
The PCI address of the GPU device |
|
string |
- |
The product ID of the GPU device |
|
string |
- |
The vendor ID of the GPU device |
You must set either mig.uuid
(NVIDIA drivers 470+) or both mig.ci
and mig.gi
(old NVIDIA drivers).
gputype
: sriov
¶
Note
The sriov
GPU type is supported only for VMs.
It does not support hotplugging.
An sriov
GPU device passes a virtual function of an SR-IOV-enabled GPU into the instance.
Device options¶
GPU devices of type sriov
have the following device options:
Key |
Type |
Default |
Description |
---|---|---|---|
|
string |
- |
The DRM card ID of the parent GPU device |
|
string |
- |
The PCI address of the parent GPU device |
|
string |
- |
The product ID of the parent GPU device |
|
string |
- |
The vendor ID of the parent GPU device |