Premium
GPU Instances

Up to 8x on-demand NVIDIA® HGX B200 180GB GPUs using Blackwell Tensor Core technology.

This is the latest hardware from NVIDIA available on the market, purpose-built to accelerate inference for LLMs and MoE models.

We deploy the HGX platform with NVLink interconnect, offering up to 1.8TB/s P2P NVLink bandwidth.

Up to 8 NVIDIA H200 GPUs (141GB, 16896 CUDA cores, 528 Tensor Cores each) in SXM5 form-factor with 4.8TB/s memory bandwidth and 900GB/s P2P bandwidth.

Powered by 4th gen AMD Genoa processors with 384 threads at 3.7GHz boost clock.

The 8H200 VM maintains the same vCPU count as the 4H200 but delivers higher performance by using only physical cores instead of hyper-threads.

Up to 8 NVIDIA H100 80GB GPUs (16896 CUDA cores, 528 Tensor Cores each) in SXM5 NVLINK module with 3TB/s memory bandwidth and 900GB/s P2P bandwidth.

Powered by 4th gen AMD Genoa with 384 threads at 3.7GHz boost.

Model 8H100.80S.176V indicates 8 H100 SXM5 GPUs with 176 CPU threads, virtualized.

The 8H100 VM maintains same vCPU count as 4H100 but delivers higher performance using only physical cores instead of hyper-threads.

Up to 8 NVIDIA® A100 80GB GPUs, each containing 6912 CUDA cores and 432 Tensor Cores.

We only use the SXM4 'for NVLINK' module, which offers a memory bandwidth of over 2TB/s and Up to 600GB/s P2P bandwidth.

Second generation AMD EPYC Rome, up to 192 threads with a boost clock of 3.3GHz.

The name 8A100.176V is composed as follows: 8x RTX A100, 176 CPU core threads & virtualized.

Up to 8 NVIDIA® L40S 48GB GPUs, each containing 18176 CUDA cores and 568 fourth-generation Tensor Cores.

Featuring 864GB/s memory bandwidth, 1466 Tflops Tensor performance and 212 Tflops RT Core performance, L40S boasts excellent capability for handling large ML models, single-GPU training, and other 32-16-8 bit operations.

The name 8L40S.160V is composed as follows: 8x L40S, 160 CPU core threads & virtualized.

Up to 8 NVIDIA® RTX6000 ADA [2022] GPUs, each containing 18176 CUDA cores, 568 fourth-generation Tensor Cores and 142RT cores.

Features 48GB of GDDR6 memory for working with the largest 3D models, render images, simulation and AI datasets.

The name 8RTX6000ADA.80V is composed as follows: 8x RTX6000ADA, 80 CPU core threads & virtualized.

Up to 8 NVIDIA RTX A6000 [2021] GPUs (10752 CUDA cores, 336 Tensor Cores, 84 RT cores each) with faster tensor processing than V100 despite fewer tensor cores due to architectural improvements.

Powered by 2nd gen AMD EPYC Rome with 96 threads at 3.35GHz boost.

Features PCIe Gen4 for enhanced GPU communication.

Model 8A6000.80V indicates 8 RTX A6000 GPUs with 80 CPU threads, virtualized.

Up to 8 NVIDIA® Tesla V100 GPUs, each containing 5120 CUDA cores and 640 Tensor Cores.

Second generation Xeon Scalable 4214R CPUs [2020], up to 48 threads with a boost clock of 3.5GHz.

NVLink for high bandwidth P2P communication.

The name 4V100.20V is composed as follows: 4x V100, 20 CPU core threads & virtualized.

Second or Third generation AMD EPYC Rome or Milan.

All hardware is dedicated to your server for the best performance.

The name CPU.32V indicates the server runs on 32 virtualized core threads.