Percept — The Context Layer for AI Agents

Give your AI agent ears, eyes, and awareness.

Percept connects your real-world data to your AI agent through hardware capture, tool connectors, and a knowledge graph that enables your agent to take initiative.

What It Does

• 🎧 Hear — Omi pendant captures ambient audio. Chrome extension captures browser audio. Meetings, conversations, podcasts — all transcribed and searchable.
• ⌚ Interact — Apple Watch app with push-to-talk, raise-to-speak, and complications.
• 🔗 Connect — Gmail, GitHub, Linear, Calendar, Slack connectors sync your work context.
• 🧠 Understand — Knowledge graph connects people, projects, conversations, and events across all sources.
• ⚡ Act — Initiative engine detects patterns and triggers actions without being asked.

Quick Start

pip install getpercept
percept serve          # Start the audio pipeline
percept sync           # Sync all connected tools
percept status         # Check what your agent knows

Architecture

Hardware (Omi, Watch, Chrome)  → Audio Pipeline → Transcription
Tool Connectors (Gmail, GitHub, Linear) → Data Sync
                    ↓
    Knowledge Graph (entities, relationships, temporal)
                    ↓
    Initiative Engine (patterns → actions)
                    ↓
    Your AI Agent (OpenClaw, Claude, GPT, LangChain)

Package Structure

percept/
├── percept/                 # Python package
│   ├── audio/               # Audio pipeline (receiver, transcriber, context)
│   ├── core/                # Knowledge graph (graph DB, ingest, query, temporal)
│   ├── connectors/          # SDK + Gmail, GitHub, Linear, Calendar, Slack
│   ├── pipeline/            # Orchestration (sync → KG → signals → initiatives)
│   ├── initiatives/         # Rules engine, pattern matching, actions
│   ├── mesh/                # Team agent shared context
│   ├── memory/              # Entity extraction, FTS5 search
│   ├── mcp/                 # MCP server for Claude Desktop
│   └── cli.py               # Unified CLI entry point
├── src/                     # Legacy audio module (original package root)
├── watch-app/               # Apple Watch app (Swift)
├── extension/               # Chrome extension (browser audio capture)
├── web/                     # Landing page
├── docs/                    # Documentation
└── tests/                   # Test suite

Connectors

Connector	Status	What It Captures
Omi Pendant	✅ Live	Ambient audio, meetings, conversations
Apple Watch	✅ TestFlight	Push-to-talk, raise-to-speak
Chrome Extension	✅ Built	Browser tab audio (meetings, YouTube, podcasts)
Gmail	✅ Live	Emails, threads, contacts
GitHub	✅ Live	PRs, issues, commits, reviews
Linear	✅ Live	Tickets, projects, team activity
Calendar	🔶 Ready	Events, attendees (needs Google API enabled)
Slack	📋 Planned	Messages, channels, threads

CLI Commands

percept sync                    # Run all connectors → KG → initiatives
percept sync --connector gmail  # Single connector
percept status                  # KG stats + connector health + initiatives
percept query "..."             # Search the knowledge graph
percept serve                   # Start the audio pipeline + API
percept connectors              # List installed connectors
percept initiatives             # List triggered initiatives

Works With Any AI Framework

Percept is framework-agnostic. It provides context via:

• CLI — percept sync, percept query
• MCP Server — 8 tools for Claude Desktop integration
• REST API — HTTP endpoints for any framework
• Python SDK — from percept.core.graph.database import GraphDB

License

MIT