fbpx

with Toby Schachman

Real-time Video Manipulation in Quartz Composer

Module One: Basics

Quartz Composer (QC) is a patching environment (similar to Max/MSP, PD, vvvv, etc.) available for free on Mac OS. It is primarily geared toward real-time graphics effects. We'll go over the conceptual fundamentals of QC, a few workflow tips (keyboard shortcuts), and enough of the patches which come with QC to start playing with 2D and 3D graphics.

Module Two: Integration with other applications and the outside world

We'll learn how to pipe video between applications using Syphon. We'll look at QC's capabilities for taking input from MIDI, OSC, Kinect, etc.

Module Three: Techniques for recursion

We'll learn how to make "higher-level" patches in QC. We'll use the Queue and Iterator patches to produce video delay effects. We'll use the Accumulator patch to produce feedback effects.

Module Four: Introduction to GPU Programming

Programming the Graphics Processing Unit (GPU) -- a.k.a. the video card -- is increasingly becoming the only way to meet the real-time high-resolution demands at the cutting edge of computer video art. QC already exploits the GPU under the hood, but in this section we'll program the GPU directly.


Quartz Composer is a visual programming environment (like Max/MSP, PD, VVVV, etc.) which comes with Mac OS X. It is designed for creating real-time, interactive video and graphics. It is particularly useful for quickly prototyping and experimenting with interactive video art installations and performances.

In this workshop, we will learn to create and manipulate 2D and 3D graphics, interact with hardware ranging from webcams to the Kinect to MIDI hardware, and move video through the Mac OS system for integration with VJing, gaming, and other applications. We will also build a conceptual foundation for working with the graphics processor--the video card--which has a different programming model than the sequential model of traditional programming.

Mac OSX is required to run Quartz Composer. No prior programming experience is required for this workshop.

Examples of projects with Quartz Composer:

Datamoshed 3D game manipulating live Quake 3 engine

Custom rainbow delay effect

Quasicrystal rendered in realtime using Core Image

Find more examples on Vimeo.

Quartz Composer is increasingly being used by video artists for live, interactive video performances. It has been used by VJs to accompany
performances by Aphex TwinSimeon Mobile Disco, etc.

 

Toby Schachman

Toby Schachman is a researcher and designer who builds programming environments that support spatial reasoning. His works include Apparatus a dynamic canvas for drawing interactive diagrams, Shadershop an interface for programming GPU shaders and Cuttle a design tool for digital cutting machines.