https://www.infoq.com InfoQ RaspberryPi News feed https://www.infoq.com/news/2025/12/cactus-on-device-inference/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=RaspberryPi-news <img src="https://res.infoq.com/news/2025/12/cactus-on-device-inference/en/headerimage/cactus-on-device-inference-1766571403967.jpeg"/><p>Cactus, a Y Combinator-backed startup, enables local AI inference to mobile phones, wearables, and other low-power devices through cross-platform, energy-efficient kernels and a native runtime. It delivers sub-50ms time-to-first-token for on-device inference, eliminates network latency, and defaults to complete privacy.</p> <i>By Sergio De Simone</i> RaspberryPi Apple Mobile Mobile Privacy Large language models Android Wearable Tech Google iOS AI, ML & Data Engineering Development news Wed, 24 Dec 2025 11:00:00 GMT https://www.infoq.com/news/2025/12/cactus-on-device-inference/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=RaspberryPi-news Sergio De Simone 2025-12-24T11:00:00Z /news/2025/12/cactus-on-device-inference/en