Vision Pro
RCcAR
Drive a virtual toy through a real room with a physical controller.
- 01Scan the room
- 02Drive with a controller
- 03Read feedback above the car
Watching my son play with a toy car sparked the idea. I wanted to drive a virtual RC car around the room with my Switch controller, with the vehicle and its feedback connected to the space around me.
I developed the model and materials in Blender, then moved through Reality Composer Pro and Xcode. The Blender rig separates the chassis, wheels, suspension, and drive shafts. Blender drivers do not run in RealityKit, so the app updates those moving parts at runtime.
Continuous room scanning hurt performance in the early version. I changed the flow to capture the room, save its geometry, and reload it for play. Later code freezes collision geometry while driving, with rescanning as a separate action.
I tried a head-locked display, but watching the car while its information stayed attached to my head felt strange. I moved speed feedback above the car. Holding A fills a turbo ring before a burst of motion, particles, and sound.
This is tuned game physics. Speed comes from the simulation; gear and RPM are expressive feedback. I would next evaluate room reacquisition, uneven surfaces, and whether people notice the turbo charge without losing track of the car.