This project uses Torin Blankensmith’s Mediapipe TouchDesigner component to capture full-body pose data, then decorates every joint with a flower image, effectively turning the tracked skeleton into a moving flower person. The output is then sent to StreamDiffusion for AI-enhanced rendering.

Workflow Overview

1. Mediapipe Pose Tracking – set up pose detection in TouchDesigner using Torin’s component.
2. Skeleton → Flower Body – each tracked joint is given a flower image so the performer becomes a “flower rig.”
3. Pipe to StreamDiffusion – the animated rig is fed to StreamDiffusion to stylize and enhance the final look.

Mediapipe Pose Tracking – set up pose detection in TouchDesigner using Torin’s component.

Skeleton → Flower Body – each tracked joint is given a flower image so the performer becomes a “flower rig.”

Pipe to StreamDiffusion – the animated rig is fed to StreamDiffusion to stylize and enhance the final look.

For setup, first follow the Mediapipe install guide on YouTube, then watch the full build breakdown:

• Mediapipe install (https://www.youtube.com/watch?v=Cx4Ellaj6kk)Mediapipe install
• Full tutorial (https://www.youtube.com/watch?v=xFAaDeRJGcc&t=563s)Full tutorial

Mediapipe install (https://www.youtube.com/watch?v=Cx4Ellaj6kk)Mediapipe install

Full tutorial (https://www.youtube.com/watch?v=xFAaDeRJGcc&t=563s)Full tutorial

Technical Highlights

• Mediapipe skeleton tracking inside TouchDesigner
• Per-joint image placement for a floral avatar effect
• StreamDiffusion integration for style-transfer / diffusion-based enhancement
• Great for camera-based interactive installations, dance pieces, and playful VJ setups

Mediapipe skeleton tracking inside TouchDesigner

Per-joint image placement for a floral avatar effect

StreamDiffusion integration for style-transfer / diffusion-based enhancement

Great for camera-based interactive installations, dance pieces, and playful VJ setups