Twin It (Virtual Doppelgänger - VFX, Unreal Engine, Blender)
Create a hyper-realistic virtual doppelgänger of a real person. The doppelgänger should convincingly mimic the person’s facial expressions, body movements, and emotions. This character will be integrated into a cinematic scene where it interacts with the environment.
Requirements
High-Quality 3D Modeling: Create a detailed 3D model of a real person, focusing on realistic textures and features.
Facial & Motion Capture: Use motion capture to track the person’s expressions and movements and apply this to the 3D model.
Cinematic Integration: Composite the doppelgänger into a live-action or CG scene, ensuring seamless blending with lighting and environment.
Emotional Depth: Ensure the doppelgänger portrays a range of emotions and reacts naturally to the environment.
Tech Stack
VFX Software: Unreal Engine for real-time rendering or Blender for 3D modeling and animation.
Motion Capture Tools: Rokoko or Faceware for tracking facial expressions and body movements.
Post-Processing: Adobe After Effects or Nuke for compositing the 3D doppelgänger into a live-action or CG environment.
Work Flow
Step 1: Build or import a 3D model of the person into Blender or Unreal Engine.
Step 2: Capture facial expressions and body movements using Rokoko or Faceware.
Step 3: Apply the motion data to the 3D model, adjusting for any discrepancies in movement or expression.
Step 4: Composite the doppelgänger into a video scene using After Effects or Nuke.
Evaluation Criteria
Realism: How closely does the doppelgänger resemble the real person in terms of appearance and movement?
Emotional Authenticity: Does the doppelgänger convincingly express emotions and react to events in the scene?
Cinematic Integration: Is the doppelgänger seamlessly blended into the scene?
Creativity: How engaging and innovative is the narrative showcasing the doppelgänger?