On-device model execution
Run quantised open-weight models through llama.cpp on the phone's CPU and GPU. Once a model is downloaded, prompts can be processed without an internet round-trip.
KernelAI
KernelAI runs 53 open-weight AI models locally on iPhone, iPad, and Android. Chat, work with documents and images, code, and use AI offline without an account or subscription.
Private AI processing on mobile devices
KernelAI is a mobile AI app for running open-weight language and multimodal models locally on iPhone, iPad, and Android devices. It offers a catalog of 53 models from 15 labs, with each model downloaded to the device and used for tasks such as chat, coding, document questions, image understanding, and translation.
The app is designed for workflows that do not require a cloud account or a continuous connection. After a model download, conversations can continue offline; the device checks available memory and hides models that will not fit. Optional web search adds current information through a user-provided Tavily or Exa key, while remaining disabled until the user turns it on.
Capabilities
Model catalog
Choose from 53 models published by 15 labs, with downloads ranging from 112 MB to 3.11 GB. The catalog includes text, coding, multilingual, reasoning, vision, roleplay, and web-search models.
Document and image input
Attach a PDF, Word file, or spreadsheet and ask questions about it without uploading the attachment. Vision-capable models can also interpret photos, screenshots, signs, menus, charts, and receipts.
Optional sourced web search
Enable web search only when needed by adding a personal Tavily or Exa API key. Supported models return answers with sources, while the key remains in the iOS Keychain.
Custom instructions and model import
Set a system prompt or use presets to define tone, format, or persona across conversations. Users can also import compatible GGUF models from Files or a URL as an experimental feature.
Voice and Shortcuts
Use on-device dictation and system voices for spoken interaction, and trigger local AI through the Ask KernelAI and Extract Text from Document Shortcuts actions.
Practical uses
Offline writing and research
Download a suitable model before traveling, then draft text, ask questions, or work through ideas in airplane mode or places without reliable signal.
Private document review
Attach a PDF, Word file, or spreadsheet and ask for explanations or specific information while keeping the file on the device rather than uploading it to KernelAI.
Image and text interpretation
Use a vision model to read a photographed sign, menu, chart, receipt, or screenshot, including text contained in the image.
Mobile coding and automation
Ask for a function, debugging help, or an explanation and receive syntax-highlighted code even when disconnected. Shortcuts can also pass prompts or extract document text as part of a phone automation.
Pros and Cons
Pros
- Runs downloaded models locally on the phone and supports offline use.
- No account, subscription, usage caps, or required sign-in are stated for current features.
- Supports documents, images, coding, dictation, custom instructions, Shortcuts, and optional sourced web search.
- Shows device memory requirements and disables models that will not fit.
Cons
- Model files must be downloaded separately and range from 112 MB to 3.11 GB, so storage and device memory affect which models are practical.
- Larger models generally use more storage and may generate responses more slowly; the catalog's own-model import is experimental.
- Web search is not included by default and requires the user to supply a Tavily or Exa API key when current online information is needed.
FAQ
Is KernelAI free?
KernelAI is free to use with no account, subscription, usage caps, or feature-gated tip tier stated on the site. Optional tips support development but do not unlock features.
How do I get started and choose a model?
Install the app from the App Store or Google Play, choose a model, and download it separately. After the model is on the device, it can run without a network connection. The app measures available device memory and disables models it cannot fit.
Which devices and operating systems are supported?
The app supports iPhone and iPad with iOS 16.4 or later, and Android devices with Android 7.0 or later. Available models depend on the device's measured memory.
What data leaves the device?
Ordinary chat, attached documents, images, and dictation are processed on the device according to the site. Model downloads and optional web search use the network. Web search is off by default and requires the user's own Tavily or Exa API key; queries go to the selected provider.
Can I run my own model?
Yes. Users can import a GGUF file from Files or a direct URL, including a server on their own network. This feature is marked experimental because compatibility can vary between files.
Quick Facts
- Category
- AI Chat; Productivity; Developer Tool
- Platforms
- iOS 16.4 or later; Android 7.0 or later
- Model catalog
- 53 open-weight models from 15 labs
- Model downloads
- 112 MB to 3.11 GB; 18 models under 1 GB
- Offline workflow
- Download a model once, then use it without a network connection
- Web search
- Optional; user-provided Tavily or Exa key, off by default
KernelAI Alternatives
Grok 4.7
Grok 4.7 is an xAI model for coding and knowledge work, available via Grok Build, Cursor, the Grok API and more, from $2 per million input tokens.
ByteAsk
ByteAsk is a terminal-first AI coding agent for C and C++ that edits repos and verifies changes with compilers, debuggers, sanitizers, and tests.
GitBot
GitBot is a local browser workspace for reusable coding bots powered by Claude Code, Codex, or OpenCode, with persistent threads and configurable permissions.
Ghost
Ghost is a terminal-based AI assistant for chatting, code generation, and CLI tasks. Includes free models, supports Linux, macOS, Windows, and is open source.
Vi3ecode
Vi3ecode is a maintained development environment for AI coding agents, keeping project context, terminal, Git, memory, flows and review connected.
AakarDev AI
AakarDev AI helps teams manage AI provider access, project setup, logs, and analytics in one dashboard. BYOK support included.