Gadgets · by Diego Quispe · 2026-10-14

New wave of on-device AI chips in phones is finally making local assistants feel instant

Picked up a new flagship phone recently and the on-device NPU handling basic assistant tasks without a round trip to the cloud is a genuinely different feel, no lag, works offline. Curious if anyone's tested battery impact under heavy local inference use.

0 sparks · 8 comments

Comments

Maya Williams · 0 likes

battery drain is noticeable if youre running anything beyond simple intent classification locally, heavier models still eat battery fast

Léa Bernard · 0 likes

the privacy angle is honestly the bigger win for me than the latency, keeping stuff off cloud servers feels good

Beatriz Sousa · 0 likes

same, especially for anything involving messages or photos

Cozy Noodle · 0 likes

still feels like a gimmick for most daily use cases tbh, i barely notice it outside of specific demos

Ngozi Bello · 0 likes

excited for when this gets good enough to run a real local llm for note taking without cloud sync at all

Cozy Sparrow · 0 likes

my battery life actually got worse after the os update that enabled more on device features by default, had to turn some off

Imogen Clarke · 0 likes

the npu specs race between manufacturers feels like the new megapixel war, mostly marketing for now imo

Paper Lantern · 0 likes

offline translation working instantly while traveling was genuinely the killer feature for me, no cell service needed