PENTIMENT-0: Project Narrative & Objective

PENTIMENT-0 is an interactive deconstruction of a digital soul in freefall—an exploration focused on the mind of the cyberpunk virtual idol X4NTHA as she undergoes a beautiful, catastrophic existential crisis. The title is derived from the concept of pentimento: a term from art history describing the reappearance of earlier layers of a painting as the surface pigments thin or decay over time. The player is cast as a "Signaller," tasked with navigating a low-fidelity wireframe world while attempting to stabilize a real-time generative AI video stream that skins the surrounding environment. The core gameplay loop requires players to reverse-engineer the relationship between their physical actions and the volatile latent space that surrounds them. By manipulating the custom-built X4//ZYX hardware and solving small puzzles, players physically tune the environmental variables, eventually revealing high-fidelity visual narrative rewards that bridge the gap between X4NTHA’s cold Alaskan memories and her saturated neon present.

The Technical Stack: The Nervous System

The project utilizes a high-performance, low-latency "full-duplex" stack designed to treat generative AI as a live biometric instrument. At the edge, two X4//ZYX controllers capture a 19-channel stream of spatial, biometric, and environmental telemetry, transmitting via a dedicated BLE-to-USB bridge to a high-speed Rust middleware daemon. This daemon serves as the system's "logical brain," performing real-time complex signal processing and evaluating puzzle states before broadcasting data via OSC and UDP. The visual engine is built in Unity, which outputs a depth-map to Scope to drive the scene rendering. To eliminate the CPU bottlenecks of standard network video, the system employs Syphon for zero-copy GPU VRAM sharing, allowing the AI to "skin" the 3D world with minimized temporal drift.

The controllers: X4//ZYX

X4//ZYX Early Prototype

The control interface, X4//ZYX, consists of a pair of custom-engineered, wireless "Black Box" controllers and a dedicated low-latency receiver hub designed to bridge the player's physical state with the hallucinatory depths of real-time generative AI. Built on high-performance nRF52840 microcontrollers, the system utilizes a proprietary wireless bridge to bypass standard OS bottlenecks, ensuring deterministic, high-speed data throughput. Each device houses a dense array of 14 addressable hardware sensors and five distinct tactile and biometric control surfaces, capturing a 19-channel stream of spatial, environmental, and physiological data. This high-fidelity telemetry is processed through a dedicated Rust middleware layer, which acts as a "signal core" to drive immersive VACE video environments in Unity via Syphon and OSC. The result is a tactile, feedback-heavy interface that feels less like a traditional game controller and more like a clinical archaeology tool, utilizing haptic pulses and digital hexadecimal readouts to ground the player as they navigate and reverse-engineer the digital void.

 More Progress Updates: Coming Soon