GPU partitioning lets cloud users pack more models per accelerator and cut inference cost.
Amazon SageMaker Inference now supports Nvidia Multi-Instance GPU, splitting one GPU into isolated partitions so users can run separate models or right-sized fractions of a newer accelerator per endpoint.