← Back to Lab
Original headset recording, with the physical controller and room in view. Open recording ↗

Vision Pro

RCcAR

Drive a virtual toy through a real room with a physical controller.

My role
Interaction design, 3D & implementation
Project type
Personal prototype
Focus
Spatial
  1. 01Scan the room
  2. 02Drive with a controller
  3. 03Read feedback above the car

Watching my son play with a toy car sparked the idea. I wanted to drive a virtual RC car around the room with my Switch controller, with the vehicle and its feedback connected to the space around me.

I developed the model and materials in Blender, then moved through Reality Composer Pro and Xcode. The Blender rig separates the chassis, wheels, suspension, and drive shafts. Blender drivers do not run in RealityKit, so the app updates those moving parts at runtime.

Continuous room scanning hurt performance in the early version. I changed the flow to capture the room, save its geometry, and reload it for play. Later code freezes collision geometry while driving, with rescanning as a separate action.

I tried a head-locked display, but watching the car while its information stayed attached to my head felt strange. I moved speed feedback above the car. Holding A fills a turbo ring before a burst of motion, particles, and sound.

This is tuned game physics. Speed comes from the simulation; gear and RPM are expressive feedback. I would next evaluate room reacquisition, uneven surfaces, and whether people notice the turbo charge without losing track of the car.