ai-devtools —

AWS Lambda now supports GPU instances for Event Functions on Lambda Managed Instances

GPU support is now available for EC2 G-series GPU instances for Event Functions running on AWS Lambda Managed Instances (LMI).

AWS Lambda now supports GPU instances for Event Functions on Lambda Managed Instances

You can now run GPU-accelerated workloads, including machine learning inference, media processing, rendering, and scientific computing, on GPU instances with serverless simplicity. GPU-accelerated functions are deployed as container (Open Container Initiative, OCI) images.

You build an OCI image, point the function at it, and let Lambda handle provisioning, scaling, and event integration. There are no GPU drivers, CUDA versions, or AMIs to reconcile, and no clusters or device plugins to operate.

GPU-accelerated functions run on the same Lambda Managed Instances foundation that already gives you Amazon EC2 pricing and specialized compute without managing servers. Why customers need this Customers keep asking to run GPU workloads with the simplicity of serverless.

Building on self-managed GPU infrastructure means selecting instances, installing and reconciling GPU drivers and CUDA libraries, planning capacity, writing scaling logic, and hand-building the event integrations that connect the GPU step to the rest of the application. Serverless GPU services that hide that work often sit outside your AWS environment, with no native event sources, identity, or networking. GPUs are expensive, and utilization is usually low because a single workload rarely saturates a GPU.

Reported by aws.amazon.com.

ai-devtoolscloud

Related coverage

Elsewhere in this edition