GPU Plans

G5 instances feature up to 8 NVIDIA A10G Tensor Core GPUs and second generation AMD EPYC processors. They also support up to 192 vCPUs, up to 100 Gbps of network bandwidth, and up to 7.6 TB of local NVMe SSD storage.

Amazon Elastic Compute Cloud (Amazon EC2) P4d instances deliver high performance for machine learning (ML) training and high performance computing (HPC) applications in the cloud. P4d instances are powered by NVIDIA A100 Tensor Core GPUs and deliver industry-leading high throughput and low-latency networking. These instances support 400 Gbps instance networking. P4d instances provide up to 60% lower cost to train ML models, including an average of 2.5x better performance for deep learning models compared to previous-generation P3 and P3dn instances.

G6 instances feature up to 8 NVIDIA L4 Tensor Core GPUs with 24 GB of memory per GPU and third generation AMD EPYC processors. They also support up to 192 vCPUs, up to 100 Gbps of network bandwidth, and up to 7.52 TB of local NVMe SSD storage.

P5 instances provide up to 8 NVIDIA H100 GPUs with a total of up to 640 GB HBM3 GPU memory per instance. P5e and P5en instances provide up to 8 NVIDIA H200 GPUs with a total of up to 1128 GB HBM3e GPU memory per instance. Both instances support up to 900 GB/s of NVSwitch GPU interconnect (total of 3.6 TB/s bisectional bandwidth in each instance), so each GPU can communicate with every other GPU in the same instance with single-hop latency.

Amazon EC2 G4 instances are the industry’s most cost-effective and versatile GPU instances for deploying machine learning models such as image classification, object detection, and speech recognition, and for graphics-intensive applications such as remote graphics workstations, game streaming, and graphics rendering. G4 instances are available with a choice of NVIDIA GPUs (G4dn) or AMD GPUs (G4ad).

Powered by cutting-edge NVIDIA GPUs, our GPU Cloud solutions are designed to maximize efficiency and performance while keeping costs low. Leveraging the power of cluster computing in a cloud compute environment ensures that your projects run smoothly without breaking the bank.

Reliably run training and inference on AI/ML models, process large data sets and complex neural networks for deep learning use cases, and serve additional use cases like high-performance computing (HPC)

A3 VMs are preconfigured in one shape with eight of NVIDIA H100 GPUs

G2 VMs come with NVIDIA L4 GPUs.

Virtualized GPU technology for sharing graphics processing & computing power.

Dedicated virtual machines equipped with NVIDIA GPUs to speed up complex compute jobs.

Balanced price-performance for machine learning, data analytics, and gaming harnessing the power of CUDA, Tensor, and RT cores. Currently available in limited core compute regions. Contact our sales team to get started.

The NVv3-series virtual machines are powered by NVIDIA Tesla M60 GPUs and NVIDIA GRID technology with Intel E5-2690 v4 (Broadwell) CPUs and Intel Hyper-Threading Technology. These virtual machines are targeted for GPU accelerated graphics applications and virtual desktops where customers want to visualize their data, simulate results to view, work on CAD, or render and stream content

NCv3-series VMs are powered by NVIDIA Tesla V100 GPUs. From 6 to 24 Intel Xeon E5-2690 v4 vCPUs.

The NCasT4_v3-series virtual machines are powered by Nvidia Tesla T4 GPUs and AMD EPYC 7V12(Rome) CPUs. The VMs feature up to 4 NVIDIA T4 GPUs with 16 GB of memory each, up to 64 non-multithreaded AMD EPYC 7V12 (Rome) processor cores(base frequency of 2.45 GHz, all-cores peak frequency of 3.1 GHz and single-core peak frequency of 3.3 GHz) and 440 GiB of system memory.

Cloud servers specially designed for processing AI, graphics and massively parallel tasks

Cloud servers designed for massive parallel processing.

A100 GPU with Xeon E5 CPUs

Combining professional graphics with powerful compute and AI, to meet today's design, creative, and scientific challenges.

Designed specifically for AI and HPC workloads, featuring fourth-generation Tensor Cores and the Transformer Engine with FP8 precision for accelerated performance. Hourly price is calculated based on 730 hours per month. Contact us for additional contract duration and payment options.

Breakthrough multi-workload acceleration for large language model (LLM) inference and training, graphics, and video applications based on the latest Ada Lovelace architecture. The prices shown in the table below reflect on-demand pricing. 36-month prepaid pricing for the NVIDIA L40S starts at $0.848/GPU/hr.