An Observatory on Your Temples

See the world
through science.

TapInsight turns the RayNeo X3 Pro AR glasses into a companion that looks, listens, and understands — voice, vision, and a hands‑free browser united by Gemini AI. Ancient curiosity, modern instruments.

Release Notes

What's new in 0.4 beta

0.4 beta focuses on native media playback, YouTube stability, and release hygiene for the RayNeo X3 Pro.

Native media playback

  • Native ExoPlayer path for local and SMB videos.
  • Folder queue plus previous/next controls for native video playback.
  • CC language picker with available subtitle tracks and sidecar .srt support.
  • Longer media-controls timeout for subtitle selection.
  • HDR display correction tuned for the X3 Pro panel.

YouTube & dim mode

  • Fullscreen toolbars reveal from X3 Pro touchpad movement instead of click-to-reveal.
  • Dim-mode thermal and battery guardrails.
  • Frequency-reactive night-sky dim-mode visualizer that ripples to bass, mids, and highs.

Assistant & audio

  • URL read-aloud handling in the TTS reader for pages Gemini cannot fetch directly.
  • Song identification for TapRadio with optional AudD fingerprinting first, falling back to station metadata when no AudD token is configured.
  • Gemini research reports now save into Media Browser Text/ with date/time filenames.
  • Smoother Fish.audio chat-card readout handoffs.

Release hygiene

  • Maintainer-specific relay defaults and personal filesystem hints removed from the public build.
  • Generic companion-app host wording across macOS, Linux, and Windows.

Song Identification — AudD (optional)

Ask "what song is this?" while listening to TapRadio. With an AudD token, TapInsight asks AudD to fingerprint the current stream first so stale station metadata doesn't win. Without a token, TapInsight falls back to the free track metadata broadcast by many stations. Get a free token (300 IDs/month) at audd.io.

Public TODO

  • Bright mode: continue validating that bright-mode YouTube/video playback does not reboot the glasses.
Demonstrations

See it in motion

0.4 beta adds a RayNeo X3 Pro retrospective and overview, alongside setup, learning, and earlier TapInsight demos.

RayNeo X3 Pro & TapInsight 0.4 — Retrospective

A retrospective on the RayNeo X3 Pro glasses and an overview of the latest TapInsight 0.4 beta.

TapInsight OC Beta 3 — New Features

Customizable avatars, tap-left-arm camera toggle, companion bookmark editing, and tighter Gemini/TapClaw/OpenClaw agent handoffs.

How to Set Up TapInsight

A practical setup walkthrough for getting TapInsight running with the glasses and companion app.

Latest Walkthrough

The newest beta in action — voice, vision, and TapClaw telemetry running live on the glasses.

TapInsight - Learning Partner

A focused demo of TapInsight as a thoughtful learning partner, building on the earlier camera-learning examples described by the creator.

TapInsight Setup Overview

A short setup walkthrough that also covers the media-files flow, based on the creator’s description for this clip.

Stills

Frames from the demo

Auto‑captured moments from the walkthrough video above — the HUD, TapClaw telemetry, and the companion in motion. Click any frame to enlarge.

Opening TapInsight demo — opening frame Title card
~25% TapInsight demo — first-quarter frame First look
~50% TapInsight demo — midpoint frame Mid‑demo
~75% TapInsight demo — three-quarter frame Closing sequence
HD · Poster TapInsight demo — high-resolution poster Full resolution poster
Capabilities

An instrument for understanding

Interlocking tools turn the X3 Pro from a display into a research companion — now with more personal avatars, faster camera control, editable browser workflows, and cleaner agent handoffs.

Customizable Avatars

Personalize the assistant presence with avatar controls in the companion experience, so the HUD feels more like your own instrument.

Left-Arm Camera Toggle

Tap the left arm to toggle the camera on when you need vision, then drop back to audio-first use when you want privacy or battery savings.

Editable Bookmarks

Edit TapBrowser bookmarks directly from the companion app, keeping the glasses dashboard useful without manual file surgery.

Tighter Agent Integration

Gemini, TapClaw, OpenClaw, TapBrowser, and media tools hand off more deliberately, reducing stale context and wrong-media launches.

Gemini AI Assistant

Text + vision plus live voice conversation. Point the camera, ask a question, and the assistant answers while seeing exactly what you see.

Gesture Controls

Tap, double‑tap, swipe on the temple touchpad — navigate, scroll, select, go back. Hands‑free by design.

TapRadio

Internet radio optimized for the 960×480 display. 18 curated stations, favorites, genre tabs, and 30,000+ more from Radio Browser.

TapBrowser

A full web browser on your temples: dashboard quick‑launches, bookmarks, desktop/mobile switch, and a QR scanner for one‑glance URL entry.

TapClaw + OpenClaw

Link the glasses to an OpenClaw agent on your Mac, Linux, or Windows host. Voice‑directed tool use, smart‑home control, scene analysis.

Image Relay

Camera frames stream to a local HTTP service your agent can read — every observation permanently archived in dated folders.

Companion Web App

Configure the glasses from any phone or laptop over Wi‑Fi — API keys, OAuth, TapRadio sync, TapClaw gateway, HUD settings.

Media Library & Playlists

Play local audio, video, text, and .m3u playlists from the glasses, with companion-side uploads, playlist editing, and Gemini TTS for readable files.

HUD Heartbeat Ticker

A scrolling status line that surfaces what your OpenClaw agent is doing in real time — and parks the last message so you can read it.

Builds

Get the glasses flying

TapInsight 0.4 beta is the latest sanitized build from the active OpenClaw line.

Latest · 0.4 Beta

TapInsight OC Beta 4

0.4 beta adds native ExoPlayer playback for local and SMB videos with a folder queue and prev/next controls, a CC language picker with sidecar .srt support, X3 Pro HDR correction, YouTube fullscreen + dim-mode stability, TapRadio song identification (optional AudD), and release hygiene for the public build.

Download APK
Signed Debug Android · X3 Pro Tag: TapInsight-OC-Beta-4
Stable · v1.1.2

TapInsight v1.1.2

The last stable point release. Good if you want a calmer baseline before hopping onto the beta channel.

Browse Releases
Debug Build Android · X3 Pro Release: v1.1.2
Setup

Connect to the companion app

The companion runs on the glasses themselves — open it from your phone or laptop and tune every setting from one place.

  1. USB · Recommended

    Forward the companion port

    Plug the X3 Pro into your computer, then establish a local port forward over ADB:

    adb forward tcp:19110 tcp:19110
  2. Open the companion in your browser

    Head to the local HTTPS endpoint:

    https://localhost:19110/
  3. Accept the self‑signed certificate warning

    The glasses use a locally‑generated TLS certificate. Your browser will flag it as unknown — click Advanced → Proceed. This is one‑time per device.

  4. Wi‑Fi · Alternate

    For Wi‑Fi, try the HTTPS URL first

    If you'd rather go wireless, your computer and the glasses need to share a network. Find the glasses' IP in Settings → WiFi, then open:

    https://<glasses-ip>:19110/

    Accept the certificate warning once, and you're in. If the device falls back to non‑TLS, use http://<glasses-ip>:19110/ instead.

  5. Keep USB forwards sticky

    The port forward drops when the glasses disconnect, reboot, or ADB restarts. The bundled helper re‑establishes it automatically:

    ./setup_usb.sh --watch
Why

Old curiosity,
new instruments.

For thousands of years, people read the sky by eye and catalogued the world through notched bones, painted stones, and whispered songs. Observation is ancient technology.

TapInsight belongs to that same tradition, only with an extra pane of glass and a small AI on your temple. Point, ask, and listen — the glasses become a field notebook that writes itself while you work.

Understanding begins with paying attention. The rest is just instrumentation.
Further Reading

Field manuals

Everything you need to take the glasses from box to observatory.

Support

Help keep TapInsight moving

TapInsight is a real-world AR experiment built in public. Donations, contract work, and job leads help fund the time, devices, hosting, and testing needed to keep the project alive.

Acknowledgments

Built on the shoulders of others

TapInsight exists because of the generosity of the open-source community — especially the creators of TapLinkX3, whose AR-optimized browser is the quiet engine under TapBrowser.

T·X3

Special thanks to InformalTech and glxblt76

The developers of TapLinkX3, for creating the browser foundation and for allowing integration of their work into this project. The tapbrowser module is built on their excellent AR‑optimized web browser for the RayNeo X3 Pro.

Also thanks to the Gemini API team at Google, the RayNeo engineering team, and the OpenClaw community — every feature here stands on someone else's careful work.