NVIDIA RTX A5000

Architecture

NVIDIA Ampere Architecture
GPU Memory

24 GB GDDR6 with ECC
Memory Bandwidth

768 GB/s
NVIDIA CUDA® Cores

8192
NVIDIA Tensor Cores

256
NVIDIA RT Cores

64
Single Precision Performance

27.8 TFLOPS¹
RT Core Performance

54.2 TFLOPS¹
Tensor Performance

222.2 TFLOPS^1,2
Max Power Consumption

230W
Thermal Solution

Active
Memory Bus

384-bit
Card Bus

PCI Express 4.0 x16
Output

4x DisplayPort 1.4
Card size

4.4″ H x 10.5″ L Dual Slot
Product Weight

1.025 kg
Power Connectors

8-pin x1
NVENC | NVDEC

1x | 2x (+ AV1 decode)
vGPU Software Support

NVIDIA^® Virtual PC/Virtual Applications (vPC/vApps), NVIDIA RTX^® Virtual Workstation (vWS), NVIDIA Virtual Compute Server (vCS)³
vGPU Profiles Supported

See the Virtual GPU Licensing Guide
NVIDIA NVLINK

2-way low profile (2-slot and 3-slot bridges) connect 2x NVIDIA RTX A5000
NVIDIA NVLINK Interconnect

112.5 GB/s (bidirectional)
NVIDIA Driver Downloads

https://www.nvidia.com/Download/index.aspx?lang=en-us
Accessory

1x Quick Start Guide
1x Support Guide
1x DisplayPort to HDMI cable
Footnotes

1. Peak rates are based on GPU boost clock.
2. Effective TOPS/TFLOPS using the new sparsity feature.
3. Virtualization support for the RTX A5000 GPU will be available in an upcoming NVIDIA virtual GPU (vGPU) release. Display ports are on by default for the RTX A5000. Display ports are not active when using vGPU software.

Gigabyte Nvidia NVIDIA RTX A5000 (rev. 1.0)