iCreatAI News
Back to main site
Skip to content
Only Models#On device
  1. Hacker News AI88

    Edge0-145B: Frontier AI Capabilities on Your Own Computer

    The company open-sourced Edge0-145B and Edge0-120B, describing Edge0-145B as the first open-source 145-billion-parameter on-device model, alongside a unified inference framework and deployment tools. It reports 29GB peak memory, 80+ tokens/s decoding, 1,100+ tokens/s prefill, roughly 120W typical power and 128K–256K context on a compatible laptop, with benchmark scores compared against named cloud models. The release also describes shared-matrix sparse experts, tiered GPU/system-memory/SSD loading and CPU-GPU co-scheduling, plus local demonstrations in video, Blender 3D scenes, games, drone control and PCB design.

    Why it matters: It offers a detailed, benchmark-backed look at how a 100B+ model is engineered to run locally, useful for readers weighing on-device versus cloud AI.

  1. Artificial Analysis Articles62

    Nanbeige has released Nanbeige4.3-33B scoring 20 on the Intelligence Index

    Nanbeige, the foundation model research team at BOSS Zhipin (operated by Kanzhun Limited), has released Nanbeige4.3-33B, an Apache 2.0 open-weights dense reasoning model with text-only input and output and a 524K-token context window. It scores 20 on the Artificial Analysis Intelligence Index v5, matching Qwen3.8 27B (xhigh) at 20, with relative strengths in terminal use (30% on Terminal-Bench 4.0 vs. 6%) and physics reasoning (16% on CritPt v2's Hard Subset vs. 4%), but trails on AA-Briefcase v1.1 (1162 vs. 1391 Elo), FrontierCode 2.0 (11% vs. 15%) and HLE-Diamond (7% vs. 15%). It shows high abstention and low hallucination on Omniscience (18% vs. 29% hallucination rate, declining 71% of questions) and used 158K output tokens per Intelligence Index task vs. 110K for Qwen3.8 27B.

    Why it matters: Useful for readers tracking small open-weights models, since it sets a new Pareto point for Intelligence Index versus total parameters and details trade-offs against Qwen3.8 27B.

  1. Hugging Face Blog71

    A Closer Look at Phonon TTS. Launching High-Quality On-Device Speech That Tops the Benchmarks.

    Gradium details Phonon, a small on-device text-to-speech model released two weeks ago that needs no server or network, with Phonon 31m (English) under Apache 2.0 and Phonon 40m covering English, French, German, Spanish and Portuguese under a non-commercial license. The models, about 65 MB and 75 MB, offer over 100 built-in voices plus voice cloning and voice design, and on Hugging Face's Open TTS Leaderboard Phonon ranks first in German and Spanish on intelligibility and tops the CPU streaming benchmark on time-to-first audio. The post also covers the ptts inference framework, Transformers integration from v5.21, launch demos, and more than 200,000 downloads in the first two weeks.

    Why it matters: It offers a detailed look at how a small on-device TTS model was built, benchmarked and integrated into developer tooling.

  1. Hugging Face Blog78

    Build specialized multimodal models with LFM3

    Liquid AI introduces LFM3, a generation of Liquid Foundation Models in the 2B parameter range that places text, vision, audio, omni, and decision models on one shared backbone built from LFM3-1.7B-Base, which was pre-trained on 22T tokens and uses a tri-hybrid layer mix with a 256K context window. The release includes six 2B-class models, new in-house vision and audio encoders, and LiquidCodec, with every model fine-tunable on a single GPU and the text model fitting in about 1 GB at 4-bit precision. All LFM3 models are open-weight and available on Hugging Face, with fine-tuning notebooks and agent harness guides provided.

    Why it matters: The post is a detailed technical release covering architecture changes, benchmark comparisons, and runnable code for six models, useful for developers evaluating small multimodal models for on-device deployment.

  1. Google DeepMind72

    EmbeddingGemma 2: an open, lightweight multimodal embedding model

    Google DeepMind announced EmbeddingGemma 2, a 740-million-parameter model built on the Gemma 4 architecture and released under the Apache 2.0 license, which maps text, code, images, video, and audio into a unified embedding space for on-device use. It offers modular encoders (as little as 270M parameters for text-only, with optional 170M vision and 300M audio encoders), Matryoshka Representation Learning to truncate vectors from 768 down to 128 dimensions, an 8K token context window, and on a Google Pixel 11 Pro requires as little as ~191MB active RAM for text-only weights and ~567MB for the full multimodal model. The company reports a 9.92-point improvement on MTEB Code (68.76 to 78.68) over EmbeddingGemma and says the model is available on Hugging Face and Kaggle, with support across tools including transformers, vLLM, llama.cpp, Ollama, and Qdrant.

    Why it matters: It documents a new open, commercially licensed embedding model with concrete size, memory, and benchmark figures relevant to developers building on-device search and RAG.

You have reached the end