Projects

Scope - September 2025-March 2026

• Repo
• Demos
  • Resolume controlled generative particle cloud visuals
  • Waypoint-1 video world model with real-time WASD and mouse controls
  • Reference images and control videos guiding real-time video generation
    • More on the general approach here
  • Real-time style transfer for interactive characters
  • Real-time replay and remix of a video generation timeline
• Talks
  • Real-Time Visual Prototyping with ComfyUI and Scope (December 2025)

ComfyStream - October 2024-January 2025

• Repo
• Nodes
  • Background edit
  • torch.compile
• Workflows
  • Real-time diffusion with ControlNet
• Demos
  • Real-time depth estimation
  • Real-time background blur and removal
  • Real-time diffusion with ControlNet

ai-rtc-agent - September 2024-October 2024

• Repo
• Demos
  • Real-time stylized fluid simulation
  • Real-time stylized visualizations using TouchDesigner and OBS

CLIP Feature Steering - June 2024-July 2024

• Repo (backend)
• Demos
  • Editing images with features from CLIP
  • Feature packs
  • Feature pack composition
  • Feature discovery using images of interest
  • Tuning image semantics by subtracting features and adjusting strength of feature packs

WidgetKit - July 2023

• Launch post