The Orbit Apps

OrbitWalker

Install it, set up the helper once, then run any Android app on its own floating screen in VITURE Pro 2 glasses, with a voice agent on your own server.

Version 0.18.0Android 13+VITURE Pro 2Apache-2.0

Install the APK

OrbitWalker isn’t on Google Play. You install it straight from its GitHub release.

  1. On your phone, download the APK. OrbitWalker.apk always points at the latest release.
  2. Open the downloaded file. Android asks you to allow installs from your browser or Files app. Tap Settings, allow it for that app, go back and tap Install. You can turn this off again afterwards in Settings › Apps › Special app access › Install unknown apps.
  3. If Play Protect warns you, choose More details, then Install anyway. The source code and each release’s SHA-256 checksum are on GitHub, so you can check what you’re installing.

To update, download the new APK and install it over the old one.

You needDetails
GlassesVITURE Pro 2. Other VITURE models are untested.
PhoneAndroid 13 or newer (64-bit ARM) with USB-C video out (DisplayPort Alt Mode). Tested on a Samsung Galaxy Z Fold.
SamsungDeX turned off. Setup walks you through Auto Blocker.
Not neededVITURE’s SpaceWalker app, Shizuku or root.

First run and the helper

To give other apps their own screens, OrbitWalker needs a small helper with the access Android gives its debugging tools. The helper is built in. You connect it once over Wireless debugging and there’s nothing else to install. Mirror mode, which pins your phone’s own screen in the glasses, works without it.

  1. Samsung only: turn off Auto Blocker for now. Setup shows this step on Samsung phones. You can turn it back on once the helper is running.
  2. Turn on Developer options by tapping Build number seven times (in Settings, under About phone).
  3. Connect to Wi-Fi, not your phone’s own hotspot. Wireless debugging needs a Wi-Fi network.
  4. Pair. In OrbitWalker’s Setup, tap Pair. In Wireless debugging, tap Pair device with pairing code, then type the 6-digit code into OrbitWalker’s notification. In split screen you can use the field on the Setup screen instead.
  5. The helper starts. Leave Wireless debugging on while you use OrbitWalker.

The helper keeps running through app restarts and updates, until the phone restarts. After a restart, turn Wireless debugging back on and tap Start on OrbitWalker’s Home screen. You don’t need to pair again.

Connect the glasses

  • Turn off Samsung DeX (Settings › Connected devices › Samsung DeX), so the glasses act as a plain external display.
  • Plug the glasses into the phone’s USB-C port. When Android asks to let OrbitWalker use them, tap OK. That’s how it reads the glasses’ motion sensors and tracks your head on the phone.
  • Hold your head still for 2 seconds while it calibrates. Recenter at any time from the phone, or with Ctrl+Alt+R.
  • Screens can be pinned, so they stay put in space as you look around, or follow your head.

Screens, dock and app library

Screens

  • Up to 10 screens: five side by side on a gentle curve, then a second row above.
  • The focused screen has a title bar. Drag it to move the screen. Its buttons resize, push back, bring closer, reset or close it.
  • The Layout tab sets screen size (50–200%), distance, gap, height and the gap between rows. It also has Pixel-perfect size, where one app pixel is one glasses pixel. You can pinch to resize, and the layout is saved.
  • Sharpness: Standard (1280×800), Sharp (1920×1200) or Ultra (2560×1600, best for one to three screens).
  • Backgrounds: Orbit, Space, Logo or Pure black, plus a Still sky switch.

The dock and All apps

The dock sits under the centre screen. It shows the time, the date, your phone battery and, if you allow calendar access, your next event in the coming 12 hours. Then come up to eight recent apps, the Ask Orbit mic and All apps.

All apps opens your app library as a screen in the glasses. Type to search, then open any app without touching the phone.

Cinema, 3D and comfort

  • Cinema mode plays protected video (Netflix, Prime Video, Disney+) directly on the glasses’ own display. Cinema isn’t head-tracked. To play, pause and skip from the phone, give OrbitWalker notification access.
  • 3D desk renders the whole desk in side-by-side stereo, with an eye-distance slider (55–75 mm). Each screen can also show side-by-side or top-bottom 3D content.
  • Notifications appear as cards in the glasses. You can hide message contents.
  • Eye care reminds you to look far away for 20 seconds every 20, 30, 45 or 60 minutes. It holds off during Cinema and while a video plays.

Keyboard, mouse and shortcuts

Pair a Bluetooth keyboard and mouse with your phone. While OrbitWalker has them, they drive the glasses directly. Left click clicks, right click is Back and the wheel scrolls. You can type into any app. Volume, Power, Home and app-switch keys stay with the phone. The keyboard and mouse pause while the phone is locked.

OrbitWalker shortcuts

These work everywhere, and apps never see them.

KeysWhat it does
Ctrl+EscGive the keyboard and mouse back to the phone
Ctrl+Alt+CBring the pointer to where you’re looking
Ctrl+Alt+RRecenter the view and the pointer
Ctrl+Alt+SStart or stop recording
Ctrl+Alt+MOpen the camera studio in the glasses
Ctrl+Alt+OAsk Orbit: start listening

Esc on its own releases a captured mouse.

In Orbit Browser

KeysWhat it does
Ctrl+T / Ctrl+WNew tab / close tab
Ctrl+TabNext tab
Ctrl+LAddress bar (Esc leaves it)
Ctrl+R or F5Reload
Alt+← / Alt+→Back / forward

In the camera studio

Arrows move the virtual camera around you or up and down. Shift+arrows aim it. PgUp or + brings it closer and PgDn or − moves it away. ] and [ zoom in and out. 1–7 pick a spot: behind, either shoulder, either side, or front left or right. R resets, and Enter or Esc finishes.

Orbit Browser

  • A built-in browser, based on Android System WebView, that opens as a screen in the glasses. Open as many browser screens as you like.
  • Drag a tab down out of the tab strip, or use its ⧉ button, and that page gets a screen of its own.
  • Choose DuckDuckGo, Google or Bing for searches typed into the address bar.
  • Downloads go to your Downloads folder. File uploads, full-screen video and a Desktop site switch all work.

Recording

Tap Record on the Home screen, or press Ctrl+Alt+S. Choose a view:

  • Glasses view: what you see, at 1920×1080. You can add a face bubble.
  • Mixed reality: the phone’s camera films you, and OrbitWalker places you among your screens. The video is portrait or landscape depending on how the phone stands. Cutting you out of the background happens on the phone. You choose how the screens are staged (Framed, Bigger or Real) and what’s behind you (the real room or the virtual space). Use the camera studio (Ctrl+Alt+M) to place the virtual camera.
  • Clean screen: the screen you’re using, flat.

Every view records at 30 fps, with microphone audio if you turn it on. Videos are saved to Movies/OrbitWalker on your phone.

Some things are never recorded: the in-glasses keyboard (and the pointer while it’s showing, so typed passwords stay private), notification cards, the recording indicator, the agent’s caption and the Orbit character on the dock. Protected video records as black. That’s Android’s rule.

The Orbit agent

Say “Hey Orbit”, or click the mic in the dock, and ask. Orbit opens, moves and resizes apps, opens websites, types for you, starts recordings and answers questions about your ring data. It runs on your Orbit Server, not ours.

What you need

An Orbit Server you run, with a model chosen under Agent, and a phone that can reach it. With the recommended setup, that means Tailscale is on.

Pair with your server

  1. On your dashboard, open Pair a phone. Under “Pairing OrbitWalker (AR glasses)?” there’s a QR code and an orbitwalker://pair link.
  2. Scan the QR code with your phone’s camera, or open the link on the phone. OrbitWalker opens its Orbit agent screen with the details filled in. You can also go to Home › Orbit agent and paste the link.
  3. Check the server address it shows, then tap Pair. Only pair with your own server.

Each pairing code works once and expires after 10 minutes. If it has expired, make a new one on the dashboard. To disconnect, tap Unpair this phone, or revoke the phone under Devices on the dashboard.

“Hey Orbit”

Turn on Listen for “Hey Orbit” on the Orbit agent screen. It’s off by default. The first time, OrbitWalker downloads a small offline speech model (about 40 MB) once and checks its SHA-256 checksum before using it. While it listens, a notification says so. “Okay Orbit” and “Hi Orbit” work too.

Wake-word detection runs offline on the phone. Only what you say after it is sent to your server.

Push to talk and typing

Click Ask Orbit, the mic at the end of the dock, or press Ctrl+Alt+O. You can also type a request under Ask by typing on the Orbit agent screen.

Conversation mode

Once called, Orbit stays in the conversation, so you can just keep talking. After 30 seconds of quiet it stops listening. You can also end it by saying “that’s all” or “bye”, or by clicking the mic while Orbit is waiting. New conversation starts fresh.

Voices

Under Orbit’s voice, choose Server default, Phone voice (your phone’s own text-to-speech, which works offline) or one of your server’s voices. Voices from OpenAI, ElevenLabs, Inworld or AssemblyAI are set up on your server’s Voices page, and the keys stay there. If a server voice can’t be reached, the phone’s voice speaks instead.

Orbit on the dock

A small animated Orbit lives on the dock. It wanders and naps, pops up when you call it, and shows when it’s listening, thinking or talking. Turn it off with Show Orbit on the dock.

What it can and can’t do

It can

  • Open apps on screens, and open websites or a search
  • Focus, move, resize and close screens, close them all, or reset the layout
  • Type up to 500 characters into the focused screen, and press Back, Enter or Backspace
  • Change the background and open All apps
  • Start and stop recording, change how screens are staged in a video, and open the camera studio
  • Answer questions about the ring data on your server, such as sleep, heart rate and HRV

It can’t

  • See your screens. It gets a short text description only: which screens are open (app name, position, size), your recent apps and the names of your installed apps. It never gets screenshots or what’s inside an app.
  • Tap or click at a point, scroll, or read a page
  • Work without your Orbit Server
  • Diagnose anything. Health answers use only your data, and estimates are called estimates.

Try: “open YouTube and Chrome side by side”, “put Chrome on the left and make it bigger”, “start recording”, “how did I sleep?”.

Troubleshooting

  • No picture in the glasses: check that the phone has USB-C video out and that DeX is off.
  • Apps open on the phone, not the glasses: the helper isn’t running. Turn Wireless debugging on and tap Start on the Home screen.
  • Screens drift: recenter with Ctrl+Alt+R, and keep your head still during calibration.
  • Orbit doesn’t answer: make sure the phone can reach your server (Tailscale connected). Then check on the dashboard that a model is set under Agent and that Test works.
  • The pairing link doesn’t work: codes expire after 10 minutes and work once. Make a fresh one.