Just A Digital Agent, Natively.
You've seen what AI assistants could be. JADEN is what they should be.
A voice-first, open-source Jarvis built on top of OpenClaw. Runs on your desktop. Talks back. Remembers you. Moves panels with your hands.
JADEN is not a chat window. It's a personal intelligence workspace β a dark, brutalist desktop environment where your AI lives, thinks out loud, and lets you see exactly what it's doing.
- Living Brutalism UI β neobrutalism Γ Iron Man HUD Γ nature. Dark forest palette, thick black borders, amber accents, panels you can stack, throw, and layer.
- Process stream β watch JADEN's tool calls, web fetches, and reasoning steps in real time. No black boxes.
- Mindmap panel β a Cytoscape graph that builds itself as JADEN thinks.
- Memory panel β a D3 force graph showing what JADEN knows about you, growing like a root system.
- Web panel β fetch and render anything inside JADEN without leaving.
- Gesture control β pinch to grab panels. Throw them across the screen. Two fingers up to spawn a new one. Fist to mute. Camera + MediaPipe, runs fully local.
Your voice ("hey jaden")
β
βΌ
Wake word β STT (local or cloud)
β
βΌ
OpenClaw Gateway ββ Skills, Tools, LLM
β
βΌ
TTS (local or cloud) β JADEN speaks back
β
βΌ
Process stream, Mindmap, Memory update in real time
JADEN is a client layer on top of OpenClaw. It connects to the OpenClaw Gateway WebSocket and adds voice, a UI, a personality, and gesture control. OpenClaw does the heavy lifting β tool execution, skill management, model routing.
| Layer | Tech |
|---|---|
| Desktop app | Tauri (Rust + React) |
| UI framework | React + Framer Motion |
| Panel system | react-grid-layout |
| Wake word + STT | Web Speech API β Deepgram (cloud) |
| TTS | SpeechSynthesis β ElevenLabs (cloud) |
| Gesture | MediaPipe Hands (WASM, fully local) |
| Mindmap | Cytoscape.js |
| Memory graph | D3 force layout |
| State | Zustand |
| Monorepo | Turborepo + pnpm |
| AI backend | OpenClaw |
- OpenClaw installed and running locally
- Node.js 22+
- pnpm 10+
- Rust (for Tauri native app)
git clone https://github.com/trojan0x/jaden
cd jaden
pnpm installpnpm desktop
# Open http://localhost:1420cargo install tauri-cli --version "^2"
cd apps/desktop
cargo tauri devCopy .env.example to .env.local in apps/desktop:
# OpenClaw Gateway (default β change if you've moved it)
VITE_OPENCLAW_GATEWAY=ws://127.0.0.1:18789
# STT β leave blank to use local WebSpeech API
VITE_DEEPGRAM_API_KEY=
# TTS β leave blank to use local SpeechSynthesis
VITE_ELEVENLABS_API_KEY=
VITE_ELEVENLABS_VOICE_ID=
# Remote access (Tailscale recommended)
VITE_REMOTE_GATEWAY=jaden/
βββ apps/
β βββ desktop/ # Tauri + React desktop app
β βββ web/ # PWA for mobile remote control (coming)
βββ packages/
βββ openclaw-client/ # WebSocket bridge to OpenClaw Gateway
βββ voice/ # Wake word, STT, TTS pipeline
βββ gesture/ # MediaPipe hand tracking + gesture engine
βββ personality/ # OpenClaw skill β JADEN's character + memory
βββ ui/ # Shared theme tokens (Living Brutalism)
| Gesture | Action |
|---|---|
| Pinch + drag | Move a panel |
| Two fingers up βοΈ | Spawn new panel |
| Fist β | Mute JADEN |
| Open palm β swipe | Switch context |
Enable gesture mode with the β GESTURE button (bottom right).
JADEN's character is defined in packages/personality/SKILL.md.
Short version: witty, direct, never says "certainly", thinks in nature analogies, remembers everything you tell it, speaks up when it notices something without being asked.
Boot response: Online. What do you need?
- PWA mobile app β remote control from your phone
- OpenWakeWord WASM β offline always-on wake word
- whisper.cpp WASM β fully local STT
- Kokoro.js WASM β fully local high-quality TTS
- Skill marketplace integration β pull from ClawHub
- Proactive nudges β calendar, weather, patterns
- Multi-display support β spread panels across monitors
- Plugin API β extend JADEN's panels
Built with TypeScript (ESM, strict). Run pnpm build before opening a PR. See AGENTS.md if you're using an AI coding agent.
MIT β do whatever you want with it.
JADEN is an independent project and is not affiliated with OpenClaw or Anthropic.