Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Real-time AI assistant for Meta Ray-Ban smart glasses -- voice + vision + agentic actions via Gemini Live and OpenClaw
| Date | Stars |
|---|---|
| 2026-07-31 | 2479 |
| 2026-08-01 | 2484 |
| 2026-08-06 | 2484 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# VisionClaw
A real-time AI assistant for Meta Ray-Ban smart glasses. See what you see, hear what you say, and take actions on your behalf -- all through voice.
Built on [Meta Wearables DAT SDK](https://github.com/facebook/meta-wearables-dat-ios) (iOS) / [DAT Android SDK](https://github.com/nichochar/openclaw) (Android) + [Gemini Live API](https://ai.google.dev/gemini-api/docs/live) + [OpenClaw](https://github.com/nichochar/openclaw) (optional).
**Supported platforms:** iOS (iPhone) and Android (Pixel, Samsung, etc.)
## What It Does
Put on your glasses, tap the AI button, and talk:
- **"What am I looking at?"** -- Gemini sees through your glasses camera and describes the scene
- **"Add milk to my shopping list"** -- delegates to OpenClaw, which adds it via your connected apps
- **"Send a message to John saying I'll be late"** -- routes through OpenClaw to WhatsApp/Telegram/iMessage
- **"Search for the best coffee shops nearby"** -- web search via OpenClaw, results spoken back
The glasses camera streams at ~1fps to Gemini for visual context, while audio flows bidirectionally in real-time.
## How It Works
```
Meta Ray-Ban Glasses (or phone camera)
|
| video frames + mic audio
v
iOS / Android App (this project)
|
| JPEG frames (~1fps) + PCM audio (16kHz)
v
Gemini Live API (WebSocket)
|
|-- Audio response (PCM 24kHz) --> App --> Speaker
|-- Tool calls (execute) -------> App --> OpenClaw Gateway
| |
| v
| 56+ skills: web search,
| messaging, smart home,
| notes, reminders, etc.
| |
|<---- Tool response (text) <----- App <-------+
|
v
Gemini speaks the result
```
**Key pieces:**
- **Gemini Live** -- real-time voice + vision AI over WebSocket (native audio, not STT-first)
- **OpenClaw** (optional) -- local gateway that gives Gemini access to 56+ tools and all your connected apps
- **Phone mode** -- test the full pipeline using your phone camera instead of glasses
- **WebRTC streaming** -- share your glasses POV live to a browser viewer
---
## Quick Start (iOS)
### 1. Clone and open
```bash
git clone https://github.com/sseanliu/VisionClaw.git
cd VisionClaw/samples/CameraAccess
open CameraAccess.xcodeproj
```
### 2. Add your secrets
Copy the example file and fill in your values:
```bash
cp CameraAccess/Secrets.swift.example CameraAccess/Secrets.swift
```
Edit `Secrets.swift` with your [Gemini API key](https://aistudio.google.com/apikey) (required) and optional OpenClaw/WebRTC config.
### 3. Build and run
Select your iPhone as the target device and hit Run (Cmd+R).
### 4. Try it out
**Without glasses (iPhone mode):**
1. Tap **"Start on iPhone"** -- uses your iPhone's back camera
2. Tap the **AI button** to start a Gemini Live session
3. Talk to the AI -- it can see through your iPhone camera
**With Meta Ray-Ban glasses:**
First, enable Developer Mode in the Meta AI app:
1. Open the **Meta AI** app on your iPhone
2. Go to **Settings** (gear icon, bottom left)
3. Tap **App Info**
4. Tap the **App version** number **5 times** -- this unlocks Developer Mode
5. Go back to Settings -- you'll now see a **Developer Mode** toggle. Turn it on.
Then in VisionClaw:
1. Tap **"Start Streaming"** in the app
2. Tap the **AI button** for voice + vision conversation
---
## Quick Start (Android)
### 1. Clone and open
```bash
git clone https://github.com/sseanliu/VisionClaw.git
```
Open `samples/CameraAccessAndroid/` in Android Studio.
### 2. Configure GitHub Packages (DAT SDK)
The Meta DAT Android SDK is Excerpt of 14,904 characters
Read on GitHub
187
Facebook Community Bot · @facebook · United States
3
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:1692997f728c8bac, desc:agentic, desc:ai assistant