AI for VFX blog: ComfyUI tutorials, research and Bootcamp projects

Stay up to date with the latest AI research, models, tools and behind-the-scenes stories at the intersection of AI and VFX.

Shot-to-Set: from one film shot to a set you can visit in VR, built in the Bootcamp

Ersan Musa, Previs Supervisor, built Shot-to-Set: give it one shot from a film, and a chain of ComfyUI workflows breaks it down, identifies the characters, the wardrobe, the vehicles and the set, rebuilds them in 3D and assembles the scene in Unreal Engine, so you can put on a VR headset and stand on the set. This article covers how the pipeline works and where a human stays in control.

Read more →

Unreal Engine meets ComfyUI: an asset generator, camera mapping and style transfer, built in the Bootcamp

Kevin Bertelli, CG Supervisor and real-time specialist, built two Unreal Engine plugins on top of ComfyUI: one turns a text prompt into a 3D asset in the scene, with Z-Image Turbo and Pixal3D; the other captures the camera view, restyles it with Qwen Image Edit and projects the result back onto the geometry, so you can move around a watercolour or comic book version of the scene in Unreal. This article covers how each plugin works and what they are for.

Read more →

From rough sketch to clean storyboard: a ComfyUI tool built in the Bootcamp

Julien Chateau, CG Instructor, built a storyboard tool that turns a rough sketch into a clean storyboard frame, with the characters and the framing left where the artist put them. It runs in the browser on ComfyUI workflows, with a LoRA he trained for Qwen Image Edit. It is made for artists who are not comfortable with drawing, and for those who want to iterate faster with the same quality on every frame.

Read more →

Let's work together

Inquire now