AmazonLaunchDevelopersNovember 6, 2026

SageMaker Inference adds Multi-Instance GPU support

Read original source →aws.amazon.com

AWS says SageMaker GPU endpoints previously required a whole accelerator per model, so an ml.p4d.24xlarge with eight A100s held only eight models. MIG support lets multiple models share a single GPU to raise utilization.

1 source

More stories today

Open the live feed