AI Digital Mirror.
ChalLenge.
Create an interactive exhibit using TouchDesigner for the Keith and Catherine Stein Luminary at Boise State. While the only requirement was to use TouchDesigner and work within the Luminary's display system, I wanted to incorporate AI as a commentary on how AI-generated art differs from traditional art, while still being a valid and expressive form of art in its own right.
Action.
I designed an installation that captures live webcam input and sends it through MediaPipe to extract body tracking data in real time. This data is then converted into an OpenPose format suitable for ControlNet, allowing us to guide AI-generated outputs with accurate joint positions. The processed data is fed into TouchDiffusion, a Stable Diffusion node by Olegchomp integrated within TouchDesigner, where we use prompts and preset backgrounds to generate avatars that match the viewer’s pose and movement. Due to technical limitations with the Luminary’s hardware and camera setup, I adapted the project into a mobile version using a rolling TV stand and webcam for the GIMM Senior Showcase.
Result.
Although the project could not be installed in the Luminary due to technical limitations, it was successfully adapted and showcased at the GIMM Senior Showcase. The final system responded in real time to user movement, generating AI-rendered avatars that mirrored body position and gestures. It demonstrated the successful integration of body tracking, prompt-driven generation, and live interaction within a fully self-contained TouchDesigner experience. The piece also invited reflection on how AI can serve as a new artistic medium while honoring the individuality and expression of each participant.