Realtime AI Face Generator
Captain Climate — An innovative, interactive exhibition installation developed atSECTOR4 INTERACTIVE and showcased live at GITEX Global.
Project Overview & Vision
Captain Climate is an innovative, interactive experience developed bySECTOR4 INTERACTIVE. This cutting-edge project combines state-of-the-art AItechnology with environmental awareness, aiming to engage audiences at GITEXGlobal by allowing them to become part of a superhero narrative.
Visitors standing before the booth were greeted with high-speed camera tracking that instantlycaptured their facial likeness and expressions. Within fractions of a second, the AI seamlesslytransferred the user's face onto the 3D superhero character of Captain Climate on agiant curved display, letting attendees watch themselves actively battle to save planet Earthfrom destruction.
My Technical Role & Implementation
As the Unity 3D Developer on this project, I was responsible for engineeringthe real-time rendering architecture, camera pipeline, and interactive application layer:
Unity Real-Time Engine
Developed the core Unity client running the 3D scenes, cinematic camera transitions,dynamic lighting, and superhero model animations locked at a consistent 60 FPS.
Live AI Camera Stream
Engineered the low-latency video feed pipeline connecting the high-resolution kioskcamera to the neural network inference model for real-time face segmentation.
Shader & Texture Blending
Implemented custom shaders to blend the live user face textures naturally with the 3Dstylized superhero helmet and skin tones across diverse lighting conditions.
Exhibition Reliability
Designed unattended kiosk automation, continuous session loop logic, crash recovery, andperformance optimizations for multi-day live trade show demands.
The Exhibition Experience Flow
- 01
Presence Detection & Greeting
The installation detects an attendee standing on the interactive circular marker infront of the booth and triggers an eye-catching invite sequence.
- 02
Real-Time Face Capture & Alignment
The high-definition camera locks onto the user's face, normalizing lighting andextracting facial landmarks in under 150 milliseconds.
- 03
Instant Superhero Transformation
The user's face is seamlessly integrated onto the animated 3D Captain Climatecharacter on the main curved stadium screen in real-time.
- 04
Action Narrative & Eco Message
Captain Climate embarks on an environmental rescue mission, delivering an inspiring,gamified message on sustainability and climate action.
