techlist.io
KREN
aws

Announcing Amazon EC2 G7 instances accelerated by NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs | Amazon Web Services (opens in new tab)

k8sawsamazon-ec2gpu-accelerationai-inferencenvidia-blackwellnvme-ssdefa

Amazon EC2 G7 instances are now generally available with NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs and custom sixth-generation Intel Xeon processors. Compared with G6 instances, they provide up to 4.6× higher AI inference performance and 2.1× better graphics performance. AWS positions them for AI inference, rendering, video, virtual desktops, spatial computing, and GPU-accelerated analytics.

GPU and Performance Improvements

  • Each GPU provides 32 GB of memory, with up to 256 GB across eight GPUs.
  • GPU memory capacity is 1.33× higher and bandwidth is 2.45× higher than G6.
  • GPUs include fifth-generation Tensor Cores and fourth-generation RT Cores.
  • G7 instances accelerate analytics workloads running on Amazon EMR with Amazon EKS.

Networking and Storage

  • Up to 700 Gbps of EFA-enabled networking—seven times the G6 throughput.
  • Up to 7.6 TB of local NVMe SSD storage keeps large models and datasets close to the GPUs.
  • Support for NVIDIA GPUDirect P2P and GPUDirect RDMA with EFA enables low-latency GPU communication across GPUs, nodes, and FSx for Lustre.

Video Processing

  • Ninth-generation NVENC and sixth-generation NVDEC engines support 4:2:2 encoding and decoding.
  • They deliver up to 1.5× more concurrent video streams than G6 instances.

Instance Configurations

  • Seven instance sizes are available.
  • Configurations offer up to:
    • 8 NVIDIA RTX PRO 4500 GPUs
    • 192 vCPUs
    • 768 GiB of system memory
    • 700 Gbps network bandwidth
    • 7.6 TB local NVMe storage
  • Detailed instance specifications were listed as “coming soon” in the announcement.

Software and Availability

  • AWS provides Deep Learning AMIs and NVIDIA Workstation AMIs with preinstalled drivers.
  • Amazon EKS users should build AMIs with NVIDIA driver version R595.
  • Supported operating systems include Amazon Linux, Ubuntu, RHEL, and Windows Server.
  • NVIDIA integration supports DirectX, Vulkan, and OpenGL.
  • G7 instances are initially available in US East (Ohio) and US West (Oregon).
  • Purchasing options include On-Demand, Savings Plans, Spot Instances, and Dedicated Instances for selected sizes.

G7 instances are a strong option for GPU-intensive workloads requiring higher inference, graphics, networking, and video performance. Organizations can launch them through the EC2 console and evaluate pricing across the available purchasing models.