Optimizing Streaming Speech Recognition on Arm® Edge Devices with ExecuTorch

This PyTorch blog case study takes the multilingual Nemotron 3.5 streaming ASR model from PyTorch to ExecuTorch and profiles it on a Google Pixel 11, measuring how chunk size and precision affect streaming WER and processing time. Enabling Arm SME2 cut whole-recording processing time from 9.79 to 4.61 seconds for FP16 (2.12x) and from 5.20 to 3.24 seconds for QC8W (1.61x), with GEMM driving most of the gain, while longer chunks improved accuracy at the cost of latency. ETDump and Arm Streamline were combined to attribute speedups to operators and confirm which KleidiAI SME2 microkernels actually ran.