World Models & Interactive Video
This project utilizes TouchDesigner’s SOPs geometry family to generate a dynamic 3D metaball scene.
The render is then processed through StreamDiffusionTD, producing prismatic bubbles that merge seamlessly in a smooth visual union.
This setup demonstrates Daydream’s hosted StreamDiffusionTD multi-ControlNet strength — a unique capability that allows precise balancing between the video input and StreamDiffusion’s video-to-video prompt conversion.
Try disabling all but one prompt to observe how each influences the visual output.
To learn more about how ControlNets work, check out this explainer video:
Creating fluid digital motion through TouchDesigner and StreamDiffusion — where geometry meets dreamlike diffusion.
World Models & Interactive Video

A live webcam-based Playground project that reinterprets human movement into flowing clouds

Instantly restyle your live video stream with reference images and creative prompts using the Playground.

A deep dive into StreamDiffusion, a real-time diffusion pipeline for generative art, and its integration with TouchDesigner.