Shadowbrook - A Voice You Can Look At
Back to Projects
Realtime Voice & 3D Characters

Shadowbrook - A Voice You Can Look At

A face, a voice and a memory, in a room. Shadowbrook puts a realtime voice model inside a three-dimensional person you can look at, so a conversation feels like talking to someone who is there.

The Challenge

People will say things to someone who is present that they will not type into a box, and they will stay with the conversation. A voice model on its own is a waveform. The question this project asks is whether a face, a room and a memory change what people are willing to say, and how long they stay.

Our Solution

We built an invite-only web app. OpenAI Realtime or Gemini Live speaks; a Microsoft Rocketbox character lip-syncs in the browser and gestures from a library of recorded clips, standing or sitting in a photographed room. The character can recall what it has been told, and an invite can arrive with those facts already written in: the family, the dog, the routine. A locked invite opens one conversation the guest cannot reconfigure. A researcher invite opens the studio.

Key Features

Live voice from OpenAI or Gemini, with the mouth following the words
A cast of 33 Rocketbox characters and a library of gestures
Photographed rooms, including the study she waits in
Memory the character can recall, and facts preloaded on an invite
Invite-only access: a guest, a researcher, or an admin
An optional camera that reads mood during the conversation

Results & Impact

Live at shadowbrook.hampton.io
Two realtime voice models in one conversation
33 characters, MIT licensed, shipped with the site
A guest meets one person, already set up; researchers keep the studio

Project Details

Client
Hampton.io (research)
Year
2026
Duration
2026 (ongoing)
Engagement
Research project

Technologies Used

Next.js 16React 19TypeScripttRPCPrismaSupabaseThree.jsOpenAI RealtimeGemini LiveTurborepoVercel

Planning something similar?

We work as an embedded product and engineering partner, from first commit to launch. Tell us what you're building.