Announcing SOCI-indexed images for faster SageMaker AI jobs

AWS announced Seekable OCI (SOCI) indexing for Amazon SageMaker AI Training and processing jobs, which lazy-loads container images so jobs start in seconds instead of minutes by fetching only the files needed to launch and streaming the rest in the background. Benchmarks across eight images from 1.8 GB to 35.4 GB showed download times dropping from as much as 7 min 17 s to 3–11 s, with training performance unaffected beyond a 3–16 s first-epoch penalty. Users can adopt it by switching to a pre-indexed AWS Deep Learning Container with the -soci tag or by creating an index for their own image, with no changes to job definitions, entry points, or data channels.