General description
High performance at the lowest cost in Amazon EC2 for generative AI inference
-
Elastic Compute Cloud
Service
-
Inferentia 2
Series
-
AI
Type
Hardware description
The inf2.24xlarge shows the following characteristics:
-
Virtual machine
Type
-
96 CPUs
CPU number
-
arm64
CPU architecture
-
393216 MB
RAM
-
None
GPU
-
50000 Mbps
Maximum network bandwidth
-
None
Root volume
-
None
Extra volume(s)
CPU specifications
After analyse of the hardware our systems collected the following data about processors:
Pricing
Here's a cost sample of inf2.24xlarge:
| Zone | Hourly | Monthly | Yearly |
|---|---|---|---|
| Asia Pacific (Mumbai) | 8.438 | 3881.0 | 46568.0 |
| Asia Pacific (Singapore) | 9.087 | 4179.0 | 50151.0 |
| EU (Frankfurt) | 9.736 | 4478.0 | 53734.0 |
| EU (Ireland) | 8.113 | 3731.0 | 44772.0 |
| EU (London) | 9.736 | 4478.0 | 53734.0 |
| EU (Paris) | 9.087 | 4179.0 | 50151.0 |
| EU (Stockholm) | 7.140 | 3284.0 | 39402.0 |
| US East (N. Virginia) | 6.491 | 2985.0 | 35820.0 |
| US East (Ohio) | 6.491 | 2985.0 | 35820.0 |
| US West (Oregon) | 6.491 | 2985.0 | 35820.0 |
| Zone | Hourly | Monthly | Yearly |
|---|---|---|---|
| Asia Pacific (Mumbai) | 9.475 | 4638.0 | 55652.0 |
| Asia Pacific (Singapore) | 10.124 | 4936.0 | 59235.0 |
| EU (Frankfurt) | 10.773 | 5234.0 | 62809.0 |
| EU (Ireland) | 9.150 | 4488.0 | 53856.0 |
| EU (London) | 10.773 | 5234.0 | 62809.0 |
| EU (Paris) | 10.124 | 4936.0 | 59235.0 |
| EU (Stockholm) | 8.177 | 4041.0 | 48487.0 |
| US East (N. Virginia) | 7.527 | 3742.0 | 44904.0 |
| US East (Ohio) | 7.527 | 3742.0 | 44904.0 |
| US West (Oregon) | 7.527 | 3742.0 | 44904.0 |
Pricing in USD. Monthly is calculated from "hourly" . Yearly is calculated from "Yearly no upfront" .