ALL SYSTEMS NOMINAL / ORCHESTRATOR :8765

A PERSONAL AI, NATIVE TO YOUR MAC.

JARVIS runs as a first-class citizen of macOS — not a browser tab, not a cloud dashboard. One assistant, every surface: Command Center HUD, menu bar orb, floating overlay, voice. Built on the Stark Industries visual language.

Memory Tiers
03
Native Tools
21
Voice Engines
05
Surfaces
04
COMMAND CENTER SIMULATED DEMO
00:00:01SYS jarvis-core online @ ws://localhost:8765
00:00:02MEM identity core loaded · 3 tiers synced
00:00:03VOX wake word armed — "Hey Jarvis"
00:00:04AUTO background daemon: briefing scheduled 07:30
00:00:05SYS awaiting input…
// 01 — CORE SYSTEMS

Capabilities

01

Native macOS Integration

Calendar, Reminders, Contacts, iMessage, Files, and system stats — controlled through reverse-RPC, not screen-scraping. JARVIS is a resident of your Mac, with FaceGate approval on anything world-changing.

Reverse-RPC Touch ID Gate
02

Voice Control

On-device wake word, streaming speech-to-text, and sentence-by-sentence TTS. Speak with the on-device cloned Jarvis voice (current builds), or pick Kokoro, system voice, ElevenLabs, or Google Cloud — voice is a pluggable engine, not a lock-in.

Wake Word Streamed TTS
03

Three-Tier Memory

Identity core, SQLite-FTS recall, and sqlite-vec semantic search working together — so JARVIS remembers who you are, what you said, and what you meant.

Identity Core Semantic Recall
04

Background Automation

Proactive daily briefings, an initiative pass that nudges you unprompted, and a nightly reflection cycle that rewrites what JARVIS has learned — all running while you work.

Daily Briefing Nightly Reflection
05

Live System Status

A Command Center HUD surfaces CPU, memory, connection state, and active tool calls in real time — the same telemetry JARVIS itself reasons over.

Command Center Live Telemetry
06

Hybrid Model Routing

Fast, standard, and deep reasoning tiers routed per-turn, so trivial requests stay instant and hard problems get the full orchestrator.

Per-Turn Routing Auto Tier
// 02 — SIGNAL PATH

How It Works

  1. 01

    You speak

    Wake word and streaming speech-to-text run on-device. Or type from the HUD or overlay.

  2. 02

    Orchestrator routes

    The local orchestrator on :8765 pulls memory, then picks a fast, standard, or deep model tier for the turn.

  3. 03

    Tools act

    Calendar, Reminders, Contacts, iMessage, Files and more are called over reverse-RPC into the Mac app.

  4. 04

    FaceGate approves

    Anything world-changing waits for your Touch ID before it runs.

  5. 05

    JARVIS replies

    The answer is spoken sentence by sentence while it is still being written.

// 03 — IN PRACTICE

Say It. It's Done.

“Hey Jarvis, what's on my calendar today?”
CAL Reads your Calendar and answers aloud.
“Remind me to call the dentist tomorrow at 9.”
REM Creates the reminder in Reminders.
“Text Sam that I'm running ten minutes late.”
MSG Drafts the iMessage and waits for FaceGate approval.
“What did I say about the Lisbon trip last week?”
MEM Searches full-text and semantic memory.
“How's my Mac doing?”
SYS Reports CPU, memory, and connection state.
“Play something to focus.”
SPT Controls Spotify through the mac__spotify tool.

Illustrative examples of the kinds of requests JARVIS handles through its native tools.

// 04 — MEMORY ARCHITECTURE

Three Tiers. One Mind.

TIER 01 · IDENTITY CORE PERSISTENT

Who you are, your preferences, standing instructions. Loaded on every boot, never forgotten, hand-curated over time.

LOADED ON EVERY BOOT
TIER 02 · SQLITE-FTS RECALL SEARCHABLE

Full-text search over everything said and done — fast, exact, and queryable the moment it happens.

INDEXED AS IT HAPPENS
TIER 03 · SQLITE-VEC SEMANTIC VECTOR

Embedding-based recall for meaning, not just keywords — JARVIS finds the relevant memory even when the words don't match.

MATCHES MEANING, NOT KEYWORDS
THE BRAIN 3D MIND MAP

A navigable 3D map of what JARVIS actually holds: memories wired together by meaning, skills and schedules, coding agents, and every tool. It lights up live as JARVIS recalls, writes, and calls tools.

Nothing is faked. A region with no data stays empty, and an event for a node that doesn't exist is dropped.

Drag to orbit · scroll to zoom · click a node to fly to it and read it

  • CoreJARVIS itself
  • MemoryPast exchanges, wired by meaning
  • WorkingRecent conversations
  • AgentsCoding agents and delegated jobs
  • KnowledgePrompt files, skills, schedules
  • CapabilitiesEvery tool, grouped by source
// 05 — TELEMETRY

Live System Status

Simulated preview. The values below are generated in your browser to show what the in-app Command Center looks like — they are not live data from a real install.

ORCHESTRATOR LINK
ConnectionSTABLE
Socketws://localhost:8765
Latency42ms
RESOURCE LOAD
CPU—
Memory—
ACTIVE TOOLS
mac__calendarREADY
mac__systemREADY
mac__uiAPPROVAL
mac__spotifyREADY
SECURITY GATE
FaceGateARMED
Touch IDENABLED
Sensitive ActionsGATED
// 06 — TRUST

Privacy & Security

LOCAL FIRST
  • The orchestrator, jarvis-core, runs on your Mac at localhost:8765.
  • Wake word and speech-to-text are on-device.
  • Identity, recall, and semantic memory are stored locally.
  • The cloned Jarvis voice (current builds, after v1.0.0) runs entirely on your Mac with PocketTTS on Core ML. No network, no server, no cost.
  • Kokoro, the v1.0.0 default, is also fully local.
  • The activity logger is opt-in and on-device.
WHAT LEAVES YOUR MAC
  • Model calls go to Gemini by default, or to Claude if you switch backends.
  • ScreenSense takes one screenshot only when you ask it to look, attaches it to that turn, and discards it. There is no continuous capture.
  • ElevenLabs and Google Cloud voices are opt-in.
FACEGATE
  • Sending a message or changing a file is held until you approve it, optionally with Touch ID.
  • Read-only tools are never gated.
  • Tools run in the app, so macOS shows its own permission prompts.
  • Computer control asks per app, shows a visible cursor, and stops on Esc.
// 07 — DEPLOYMENT

Install

REQUIREMENTS
  • OSmacOS 26+
  • AppNative SwiftUI
  • OrchestratorBundled (Node/TypeScript)
  • Model keyGemini API key
  • Claude backendOptional
  • Download~180 MB
FIRST FIVE MINUTES
  1. Download Jarvis.v.1.0.0.zip from the latest release, unzip it, and move Jarvis to Applications. Running from /Applications avoids two known debug-build quirks.
  2. Open Jarvis. It starts and monitors its own orchestrator, with a pinned Node runtime bundled inside the app.
  3. Add your GEMINI_API_KEY in Settings, then choose a voice engine. An ANTHROPIC_API_KEY is only needed for the Claude backend.
  4. Write a few real sentences in memory/identity.md. That is what makes it your assistant.
  5. Grant the macOS permissions as they come up, then double-tap ⌘ for Quick Prompt, or say Hey Jarvis.
GET JARVIS MARK OS v1.0.0

Bring JARVIS online.

macOS 26+. Native Swift app, bundled local orchestrator, and a choice of voice engines. Bring a Gemini API key and one assistant is on every surface.

// 08 — QUERIES

FAQ

Does JARVIS work offline?

The app, wake word, speech-to-text, memory, and the Kokoro voice (plus the cloned Jarvis voice in current builds) run on your Mac. Reasoning calls Gemini (or Claude), so answers need a connection.

What does it cost?

The app itself is free to download. Gemini or Claude usage is billed by those providers against your API key, and the on-device Jarvis and Kokoro voices are free. A per-turn trace log shows token and cost readouts.

Which voices and models can I use?

Voice: the cloned Jarvis voice (on-device), Kokoro (local), system voice, ElevenLabs, or Google Cloud. The Jarvis voice clones itself from a bundled reference clip the first time you use it, and you can re-clone it from your own audio clip in Settings. Current builds: the cloned voice is the default in current source builds. The v1.0.0 release predates it and ships with Kokoro as the default, so build from source or wait for the next release to get it. Models: Gemini by default, routed per turn across fast, standard, and deep tiers. Set MODEL_BACKEND=claude to let Claude run the turn loop instead.

Can it send messages or change things without asking?

No. Sensitive actions are gated by FaceGate and need your Touch ID approval first.

What does it remember, and can I control that?

An identity file you write, full-text recall over every turn, and semantic recall filled in passively in the background. A nightly reflection pass rewrites learned.md, and a memory timeline shows what JARVIS has learned. Everything is stored locally.

Which Macs are supported?

macOS 26 or later. iPhone and Apple Watch apps are built but still need on-device testing.

// 09 — TRAJECTORY

Roadmap & Release Notes

SHIPPED IN v1.0.0STABLE
  • Streaming chat with Markdown, code, and math
  • Hybrid per-turn model routing and deep research mode
  • Three-tier memory, nightly reflection, memory timeline
  • Brain view: a live 3D map of memories, skills, agents, and tools
  • Voice: wake word, on-device STT, Kokoro, system, ElevenLabs, and Google Cloud voices
  • About 21 native macOS tools, including Spotify and Mullvad
  • FaceGate approvals with Touch ID
  • Command Center HUD, floating orb, menu-bar orb
  • Quick Prompt, daily briefing, initiative pass
  • ScreenSense and computer control (mac__ui)
IN PROGRESSNEEDS TESTING
  • iPhone companion app over LAN and Tailscale, with CloudKit history (needs a paid Apple Developer account)
  • iPhone and watch voice, with replies spoken on the watch
  • Apple Watch app as a glanceable remote
  • Computer control is new and still being tested
PLANNEDNEXT
  • CameraSense: JARVIS sees through the iPhone camera on request
  • User-selectable model and thinking level
  • Mimic: record a click and keystroke sequence, replay it by name
  • MCP server wrapping jarvis-core
  • Telegram and Discord bridge
  • LAN-exposed core with shared-token auth
  • Smart home via HomeKit or Home Assistant

Full notes for each release are on the GitHub releases page. Plans can change.