1nm
On-device LLM inference for mobile apps.
An open-source toolkit that simplifies on-device LLM integration for Android apps, starting with Flutter. Abstracts the llama.cpp native setup so models run locally, keep user data on-device, and skip the native build pain.