Hugging Face Blog·· 24 days agoAI score38
Does Your Model Run on AWS Trainium? Look It Up
Does Your Model Run on AWS Trainium? Look It Up
AI summary
Hugging Face introduces a Space that checks whether popular Hub models run unmodified on AWS Trainium via the torch-neuronx backend, reporting sharding, wall time, and peak memory, and providing the run.py script used. Results come from the public aws-neuron/torch-neuronx-model-support dataset, with one Parquet file per neuronx-cc and library version pair. Tests currently cover text-generation and image-text-to-text Transformers models fitting on at most 4 Trainium2 devices (16 cores), generating 32 tokens.
Source: Hugging Face Blog · huggingface.co