New whitepaperNext-Generation NI: A Vision, Philosophy, and Technical Path for Continual LearningRead now

Bring intelligence to the data.

AI Models That Grow for You. On Your Device.

Bring intelligence to the data. The device is the agent; the model is the product. Through continual learning, models grow with their users.

Vision film · 1:43

How it works

Neural Imprint

The device is the agent; the model is the product. Continual learning is our approach to adapting models to users and their environments.

01

Generate

Learning starts with the data you choose to record or authorize.

02

Learn

Extract a profile from local records and build Neural Imprint learning state on the device.

03

Save and restore

Base weights remain frozen. Learning state can be saved and restored with a compatible configuration.

Your data physically never leaves your device.

Learning state

Frozen base weights. Recoverable learning state.

Learning state can be saved and restored in later sessions, carrying local learning forward while base weights remain frozen.

Weights stay frozen

Consolidate local records into inference state while base weights remain frozen.

Persists · reverts · verifies

Save state across sessions, check compatibility before activation, and support restore and rollback.

Apple and Intel

Apple devices use a Metal backend; Intel uses OpenVINO.

In runtime tests, a 9B model completed 200 continuous turns on each of two iPhones.

Evidence and boundaries

Cross-silicon

On-device AI on Apple and Intel

We build local inference runtimes using Metal on Apple devices and OpenVINO on Intel Core Ultra.

Apple

Learning loop closed on device

iPhone / iPad / Mac

204,800tokens, 0 failures: 9B ran 200 consecutive turns on each of two iPhones, up to 7.1 hours
0.47 smedian wait before each answer starts, with context grown to 200K tokens (iPhone 17 Pro)
8/8life areas passed in one continuous run: profile questions answered directly, facts via the right tool (simulated data)
5.2 minfor 9B to learn from 361 real spending records on an iPhone 17e
  • Our own inference compute and runtime, with hand-written and fused kernels
  • Neural Imprint learning state captured, restored and incrementally updated on real devices
  • Incremental learning: unchanged records are reused, so re-learning 355 records with 9B on an iPhone Air drops from 117 s to 39–58 s
  • Multimodal: a 9B vision model passed all 5 turns on each of 8 images on an iPhone Air
Evidence and boundaries

Intel

Delivered to a PC manufacturer

Core Ultra · CPU + Arc iGPU

0.37 sto first sound; the open-source reference composes the whole sentence first, taking 15–20 s
0.73speech synthesis real-time factor (RTF), faster than playback; reference 2.1–2.9
0.45 s9B first token in the NI validation setup; full-text prefill of the same content took 0.97 s
0.4 sspeech recognition on the same 4.2 s Chinese clip; reference 0.9 s
  • Our own inference runtime on OpenVINO: stateful streaming vocoder, split predictor, CPU and iGPU pipeline
  • Speech recognition, a 9B language model and speech synthesis resident on one machine, all inference on the device
  • First successful validation of the NI algorithm and architecture on a non-Apple platform.
  • Two speech-runtime deliveries: fresh install in 5 min, ready 50 s after a power restart; 357/357 sentences complete in a 30-minute synthesis run
Read the technical write-up

More silicon platforms on the roadmap

Global
NVIDIAAMDQualcomm
China
CIXHoumo NPURockchipAxeraSophgoHuawei Ascend

We adapt the runtime, operators, and compute graph to Metal and OpenVINO separately.

Intel figures compare runs on the same machine with the same model, an Intel Core Ultra 5 225H. RTF = generation time ÷ audio duration; speech synthesis figures are medians from a 30-minute resident run.

Products

Validating the inference runtime through apps

Narrus, Dailyn, and Mealens serve as live validation of our inference runtime. Ururu remains in internal testing.

200200 turns per iPhone on two devices; 1,024 tokens per turn
9B4-bit model used in the continuous-conversation tests
16/16Separate evaluation: profile answers and tool lookup across 8 domains on 2 devices

Build with us

We are hiring for inference optimization, model interpretability, distributed on-device inference, and full-stack engineering.