Getting Started: 3 Steps to Your First Local AI

Get up and running with your private AI workspace in just a few minutes. You are already close to your first win. This guide walks you through 3 simple steps: installing the app, downloading your first model, and starting your first private chat.

On this page

Requirements

On Device AI runs on Apple devices with sufficient RAM for AI model inference:

💡 Tip

Devices with more RAM can run larger, more capable models. A Mac with 16GB+ RAM provides the best experience for large models.

Installation

  1. Download from the App Store

    Search for "On Device AI" in the App Store, or click here to download. The app is free.

  2. Open the app

    Launch On Device AI. You'll see the main screen with navigation tabs: AI Search, Text to Speech, AI Voice Note, AI Chat, and Knowledge.

  3. Grant permissions (optional)

    If you plan to use voice features, grant microphone access when prompted. This is only used for on-device recording — no audio is sent anywhere.

Download Your First Model

Before chatting, you need to download an AI model. The app will suggest models optimized for your device's RAM.

  1. Open the model picker

    Tap the model selector at the top of the AI Chat screen (it shows "Built In - Default Model" initially).

  2. Browse recommended models

    The app shows models suitable for your device's hardware. You'll see the model name, parameter count, and download size.

  3. Tap Download

    Select a model and tap the Download button. The model will download directly to your device. Models range from ~2GB to 20GB+ depending on size.

  4. Wait for download to complete

    The progress bar shows download status. Once complete, the model is ready to use — no setup needed.

ℹī¸ Model Recommendations

For iPhones (6-8GB RAM): Try Gemma 3 4B or Qwen 3 4B — compact but capable.
For Macs (16GB+ RAM): Try Qwen3 VL 32B Thinking — large model with vision and reasoning support.

Start Your First Chat

  1. Navigate to AI Chat

    Tap the "AI Chat" tab in the sidebar (macOS) or navigation bar (iOS).

  2. Type a message

    Type your question or prompt in the input field at the bottom of the screen.

  3. Send and wait

    Tap the send button. The AI model processes your request entirely on your device. You'll see the response stream in real-time.

💡 Tip

You can attach files, photos, or URLs to your conversation using the toolbar icons above the input field.

The app is organized into main modules accessible from the sidebar (macOS) or tab bar:

Next Steps

Now that you're set up, explore these guides to unlock the full power of On Device AI: