AI Companion in Mixed Reality
A native Unity mixed reality app for Meta Quest that places an AI-driven character in the user's real room through passthrough.
Role
Developer
Status
Delivered
Overview
The goal was an AI companion that shares the user's physical space instead of living on a screen. I built and delivered a native Unity mixed reality application for Meta Quest that makes this possible.
Challenge
A first attempt with WebXR hit the limits of browser camera access. The character also had to respect real walls and furniture, react to physical interaction and talk in real time.
Solution
A native Unity build with room-boundary calibration and spatial anchoring, floor-plane and scale correction to avoid collisions with the real room, controller-based interactions with particle feedback, and an external LLM plus TTS backend driving voice, text and facial expressions.
Outcome
The application was delivered to the client. A public build is not available.