web based lucid dream simulation

IDEA: To create a multi-modal  showcase of realtime ai possibilities available for broad internet audience.

TOOLS:  SDXL DayDream pipeline visualising conversation driven by GPT realtimeAPI. 

STORY: For more than two years, I’ve been exploring generative storytelling and real-time AI as an instrument for narrative experiences. After creating several phygital art objects in this field, I realized that the internet is actually the perfect medium for this genre.

The only thing holding me back was the mismatch between an endless online audience and the limits of my own computing resources. So when I received the invitation to this hackathon, it immediately felt like the right way to spend my Christmas holidays—and I went all in.

At the same time, I was discussing another phygital project with my colleague and artist Oona Frost. This time, the physical world was not very kind to us. Constraints piled up, and eventually it became obvious that a web-based experience could offer a similar artistic direction, but without so many physical limitations.

Building a scalable user experience had attracted me for a long time, but for some reason I couldn’t see that this was themoment until the very last days. I went through several pivots before arriving at a surprisingly simple solution. I initially started in the Scope track, but quickly realized that TouchDesigner was the easiest and most direct way to achieve what I was aiming for.

At first, I built the experience using StreamDiffusionTD, with my own computer acting as the central backend. I was excited to discover how smoothly WebRTC worked in the DayDream environment—it made the process much easier than expected.

However, once everything was working, I felt I had missed something. Even though the experience was web-based, it was still fundamentally limited by my computer running the installation continuously. I didn’t want to leave it like that.

So, in the last two days, I decided to push further and make the experience scalable—free from that bottleneck.

And now, with 30 minutes left before the deadline, the work is finished. I love it. There’s just one small bug: sometimes SDXL skips parameters or prompts, so it can take a few stream restarts for the experience to fully lock in. If you decide to try it, I hope you’ll be lucky and it will work right away. Otherwise, be patient and refresh a few times.

If you see FLOWERS at the beginning — refresh the page.

RESULT:  http://hypnologue.art