Storyboard Builder — Scene Narrator
Build visual storyboards from procedurally-generated scenes, extract visual features, and generate connecting narration with automatic subtitle tracks.
How It Works
Choose from 8 procedurally-drawn scenes, then drag them into the storyboard timeline. The demo extracts visual features (color palette, brightness map, detected elements) and generates connecting narration with transition phrases.
| Action | How |
|---|---|
| Select a scene | Click any scene in the gallery to see its features |
| Build storyboard | Drag scenes from the gallery into the timeline |
| Reorder | Drag scenes within the timeline to rearrange |
| Remove | Click the X on a timeline scene to remove it |
| Generate narration | Automatic when 2+ scenes are in the timeline |
The Concept
Video scene narration involves extracting keyframes, understanding visual content using models like CLIP, and generating natural language descriptions. This demo simulates that pipeline with procedural scene generation, feature extraction from canvas pixel data, and template-based natural language generation.