General description
High performance at the lowest cost in Amazon EC2 for generative AI inference
-
Elastic Compute Cloud
Service
-
Inferentia 2
Series
-
AI
Type
Hardware description
The inf2.48xlarge shows the following characteristics:
-
Virtual machine
Type
-
192 CPUs
CPU number
-
arm64
CPU architecture
-
786432 MB
RAM
-
None
GPU
-
100000 Mbps
Maximum network bandwidth
-
None
Root volume
-
None
Extra volume(s)
CPU specifications
After analyse of the hardware our systems collected the following data about processors:
Pricing
Here's a cost sample of inf2.48xlarge:
| Zone | Hourly | Monthly | Yearly |
|---|---|---|---|
| Asia Pacific (Mumbai) | 16.876 | 7761.0 | 93136.0 |
| Asia Pacific (Singapore) | 18.174 | 8358.0 | 100293.0 |
| EU (Frankfurt) | 19.472 | 8955.0 | 107459.0 |
| EU (Ireland) | 16.227 | 7463.0 | 89553.0 |
| EU (London) | 19.472 | 8955.0 | 107459.0 |
| EU (Paris) | 18.174 | 8358.0 | 100293.0 |
| EU (Stockholm) | 14.279 | 6567.0 | 78805.0 |
| US East (N. Virginia) | 12.981 | 5970.0 | 71639.0 |
| US East (Ohio) | 12.981 | 5970.0 | 71639.0 |
| US West (Oregon) | 12.981 | 5970.0 | 71639.0 |
| Zone | Hourly | Monthly | Yearly |
|---|---|---|---|
| Asia Pacific (Mumbai) | 18.719 | 9107.0 | 109281.0 |
| Asia Pacific (Singapore) | 20.017 | 9704.0 | 116447.0 |
| EU (Frankfurt) | 21.315 | 10301.0 | 123612.0 |
| EU (Ireland) | 18.070 | 8808.0 | 105698.0 |
| EU (London) | 21.315 | 10301.0 | 123612.0 |
| EU (Paris) | 20.017 | 9704.0 | 116447.0 |
| EU (Stockholm) | 16.123 | 7912.0 | 94950.0 |
| US East (N. Virginia) | 14.824 | 7315.0 | 87784.0 |
| US East (Ohio) | 14.824 | 7315.0 | 87784.0 |
| US West (Oregon) | 14.824 | 7315.0 | 87784.0 |
Pricing in USD. Monthly is calculated from "hourly" . Yearly is calculated from "Yearly no upfront" .