#ondevice

Today SparkLLM releases and open-sources two on-device general models: Spark X2.5-4B and Spark...

Muse Glimmer is a 30-billion-parameter open model that codes, uses tools, and reasons offline on a single consumer GPU. No cloud. No login. It's yours.

Desert Ant Labs launched with 18 on-device models covering speech, vision and text, shipped as SDKs for Swift, Kotlin and JavaScript, with its headline transcription model a 489 MB download that the company says handles 10 minutes of audio in about 2

Liquid AI released LFM2.5-2.6B, a small model whose stack is mostly cheap convolution layers with attention rationed to eight of thirty, built for tool use and long context - and whose own model card says not to use it for agentic coding or knowledge

A developer fit a 28.9-million-parameter model onto an ESP32-S3 with 512KB of fast memory by keeping most of the model in flash storage and reading only about 450 bytes of it per word generated.

A 26-billion-parameter Gemma model ran on an iPhone by streaming expert weights from storage, AMD shipped a sparse mixture-of-experts model activating 2.8 billion parameters per token, and a llama.cpp fork began saving conversation caches to disk - t

PrismML shrank a 27-billion-parameter model from 54 gigabytes to 3.9 by storing each weight as a single bit, and published the benchmark table showing tool calling and vision falling off a cliff.

Moebius is a small inpainting model claiming far-larger-model quality, and a developer ported it to run on your own machine in a browser tab -- no server, no upload.

Researchers distilled a large AI agent's memory skills onto a compact 4-billion-parameter model, raising its success rate on a household-task benchmark from 4% to 78% while running three times faster than its 72B teacher.

Samsung R&D UK and Queen Mary University of London published DuoMem, a distillation method that took a 4-billion-parameter agent from a 4.3 percent task-success rate to 77.9 percent, nearly matching a 72-billion-parameter teacher model's 87.1 percent

导语 2026 年 WWDC 上，Apple 花了 40 分钟讲一个话题：AI 如何在 iPhone 上本地运行，不联网、不传数据、不消耗云端算力。这不是 Apple...

Quick answer: A local AI model is a language model that runs entirely on your own hardware — laptop,...