Why Amazon EC2 G6 Instances?
Amazon EC2 G6 instances powered by NVIDIA L4 Tensor Core GPUs can be used for a wide range of graphics-intensive and machine learning use cases. The G6 instances offer 2x better performance for deep learning inference and graphics workloads compared to EC2 G4dn instances.
Customers can use G6 instances for deploying ML models for natural language processing, language translation, video and image analysis, speech recognition, and personalization as well as graphics workloads, such as creating and rendering real-time, cinematic-quality graphics and game streaming.
G6 instances feature up to 8 NVIDIA L4 Tensor Core GPUs with 24 GB of memory per GPU and third generation AMD EPYC processors. They also support up to 192 vCPUs, up to 100 Gbps of network bandwidth, and up to 7.52 TB of local NVMe SSD storage.
Benefits
Features
Product details
Instance Size | GPU | GPU Memory (GB) | vCPUs | Memory (GiB) | Storage (GB) | Network Bandwidth (Gbps) | EBS Bandwidth (Gbps) | On Demand Price/hr* | 1-yr ISP Effective Hourly (Linux) | 3-yr ISP Effective Hourly (Linux) | |
Single GPU VMs
|
g6.xlarge | 1 | 24 | 4 | 16 | 1x250 | Up to 10 | Up to 5 | $0.805 | $0.499 | $0.342 |
g6.2xlarge | 1 | 24 | 8 | 32 | 1x450 | Up to 10 | Up to 5 | $0.978 | $0.606 | $0.416 | |
g6.4xlarge | 1 | 24 | 16 | 64 | 1x600 | Up to 25 | 8 | $1.323 | $0.820 | $0.562 | |
g6.8xlarge | 1 | 24 | 32 | 128 | 2x450 | 25 | 16 | $2.014 | $1.249 | $0.856 | |
g6.16xlarge | 1 | 24 | 64 | 256 | 2x940 | 25 | 20 | $3.397 | $2.106 | $1.443 | |
Gr6 instances with 1:8 vCPU:RAM ratio | |||||||||||
gr6.4xlarge | 1 | 24 | 16 | 128 | 1x600 | Up to 25 | 8 | $1.539 | $0.954 | $0.654 | |
gr6.8xlarge | 1 | 24 | 32 | 256 | 2x450 | 25 | 16 | $2.446 | $1.517 | $1.040 | |
Multi GPU VMs | g6.12xlarge | 4 | 96 | 48 | 192 | 4x940 | 40 | 20 | $4.602 | $2.853 | $1.955 |
g6.24xlarge | 4 | 96 | 96 | 384 | 4x940 | 50 | 30 | $6.675 | $4.139 | $2.837 | |
g6.48xlarge | 8 | 192 | 192 | 768 | 8x940 | 100 | 60 | $13.35 | $8.277 | $5.674 |
Prices shown in the preceding table are for US East (Northern Virginia) AWS Region.
Customer and Partner testimonials
Here are some examples of how customers and partners have achieved their business goals with Amazon EC2 G6 instances.
-
Varjo
Varjo makes the highest-immersion virtual and mixed reality products for advanced VR users. Their solutions are used to train astronauts, pilots, and nuclear power plant operators, design cars, and conduct pioneering research.
-
Cloudinary
Cloudinary’s mission is to help companies unleash the full potential of their media to create the most engaging visual experiences.
-
SmugMug
Millions of customers use SmugMug’s photo and video sharing service to store billions of valuable photos and videos.
Getting started with G6 instances for ML
Using DLAMI or Deep Learning Containers
DLAMI provides ML practitioners and researchers with the infrastructure and tools to accelerate DL in the cloud, at any scale. Deep Learning Containers are Docker images preinstalled with DL frameworks to streamline the deployment of custom ML environments by letting you skip the complicated process of building and optimizing your environments from scratch.
Using Amazon EKS or Amazon ECS
If you prefer to manage your own containerized workloads through container orchestration services, you can deploy G6 instances with Amazon EKS or Amazon ECS.