Body Tracking Flower Guy
This project uses Torin Blankensmith’s Mediapipe TouchDesigner component to capture full-body pose data, then decorates every joint with a flower image, effectively turning the tracked skeleton into a moving flower person.
The output is then sent to StreamDiffusion for AI-enhanced rendering.
Workflow Overview
- Mediapipe Pose Tracking – set up pose detection in TouchDesigner using Torin’s component.
- Skeleton → Flower Body – each tracked joint is given a flower image so the performer becomes a “flower rig.”
- Pipe to StreamDiffusion – the animated rig is fed to StreamDiffusion to stylize and enhance the final look.
For setup, first follow the Mediapipe install guide on YouTube, then watch the full build breakdown:
Technical Highlights
- Mediapipe skeleton tracking inside TouchDesigner
- Per-joint image placement for a floral avatar effect
- StreamDiffusion integration for style-transfer / diffusion-based enhancement
- Great for camera-based interactive installations, dance pieces, and playful VJ setups
Attachments
Tags
More to explore
StreamDiffusionSDXL
A starter project that includes a built in UI with all exposed parameters, and prompt box for Daydream users. No need to sift through various TouchDesigner UI pages to get started with SDXL! All you need to do is paste your API key in and then start the project.
Character After Shadow Project
This project file isolates a character using NVDIA background remover, and then creates a trail of after images using a feedback. By colouring the trail we can then send it in StreamDiffusion to make flower trails!