I’m sure I’m not the only visualist to have been inspired by Autechre’s Gantz Graf video, nor the only person to have watched it and though “some day, we will be able to do that in realtime”:

I think we’re still quite a way off, but the latest project to set my mind thinking along these lines is Amoeba Dance - Caliper Remote (and the followup, Amoeba Dance with Mad Girls,) by CDMo reader Memo:

This is created realtime in VDMX from a quartz composer generator, controlled by 9-band audio analysis, and topped off with a very nice little effects chain.

A few people have mentioned they don’t get the same look when they use the QTZ file, this is because the QTZ file renders with very basic shading and there is quite a bit of post done in VDMX. The Effects I’m using (from top to bottom) are:
Serpia Tone (100%, Source Atop)
Shaded Material (0-40% tied to audio analysis, Soft Light)
City Lights (100%, Source Atop)
Bloom (100%, Screen)

I’ve also got a 9-band audio analysis going on, with different frequencies driving all the parameters of QTZ. You can just setup the frequencies randomly and it will do pretty cool stuff to almost any song (see http://www.memo.tv/amoeba_dance_v1_5 for an example!!), but it is best to taylor the frequencies to the specific song…

Memo shares the GLSL code and the QTZ file on his site, which contains some interesting nuggets of QC, Actionscript, Processing and other codey goodness. PK: Because this uses GLSL which runs in any OpenGL environment, you could also port the geometry stuff to Processing, Max/MSP/Jitter, Pd/GEM, or (with some adjustments) even things like vvvv, etc. — no need for Quartz Composer per se.

He also maintains a VDMX and Quartz Composer repository: http://vdmx.memo.tv/.

Awesome work, and more to come it seems.

For all of the other CDMo readers who are doing cool things, don’t wait for us to find you: Hit the comments or the contact page and tell us what you’re up to!

It’s still early in development (read: it often crashes), but The Bean Machine applies nodal, patch-based development to Java. The interface is mysteriously close to Quartz Composer, down to capabilities, UI, and even the 3D cube tutorial. Personally, I use Java because it can do things Quartz Composer can’t, but it’s interesting nonetheless — and raises, again, the question of why we don’t see more tools that try to meld the capabilities of code and patches.

The cool bit: nodes are Java Beans, so you really could use this to combine the best of both worlds if it matures. No download yet, but we’ll be watching … perhaps it will inspire other developers, as well.

The project is labeled “experimental”, but could be worth a look. Developer Jerry Huxtable has lots of other goodies for Java-heads on his page, including lots of 2D image processing stuff and a map editor — Processing lovers, might want to pop this into your del.icio.us.

Bean Machine @ JH Labs

JH Labs main page with lots o’ projects

Here in Los Angeles the weather is currently sunny and warm - great for going to the park, but not so much for creating that Xmas/New Year’s Wintry feeling. Here’s a patch you can use to fill the room with snowy interactive goodness. Fire up your Projector, Big Screen TV, or Wrist-worn LCD Display and let it snow!

Here’s a clip of the patch in action:

Interactive Snowflake Maker from momo_the_monster on Vimeo.

You can download the Quartz Composer patch here:
Momo the Monster: Interactive Snowflake Generator (Direct Download)

Open it up in Quartz Composer, and drag your mouse pointer over the output window to make beautiful silvery patterns. If you want to go full-screen with it, I recommend you set the monitor to 640×480 to keep a good framerate.

I’ve got a version controlled by a joystick that I put together for my Company’s holiday party - let me know if you make anything new out of it! Enjoy, and Happy Everything.

If you’ve been intrigued by all this talk of Quartz Composer, the free visual creation software that ships with Mac OS X 10.4 and 10.5, here’s your chance to actually learn how to do cool stuff with it. Our friend Momo walks us through a basic tutorial on simple 3D and audio processing, which you could easily apply to more complex ideas. With QC support in the upcoming VDMX5, you could drop this into a VJ set with traditional clips, as well. We’ve got step-by-step instructions, plus a video. Let us know if you create anything wild with this as its basis.

Quartz Composer: Lighting 3D Cubes and Moving them with Audio Input from momo_the_monster on Vimeo.

In this Quartz Composer tutorial, We’re going to make a 3D cube that responds to our voice.

First we start up Quartz Composer. The icon will be different depending on whether you’re running OS X 10.5 or 10.4.

From the File menu, choose New Blank (or simply ‘New’ in Tiger).

DVCreators has put up a half an hour tutorial on Quartz Composer detailing how they have created their introduction graphics:

I’ve always liked the super-dramatic light rays effect, but the light rays filters in Motion and Final Cut Pro take too long to render… and frankly, they are pretty lame. So I’ve been waiting for the right opportunity to help you create those super long, awesome godlike light rays, and preferably in real time! And finally, that opportunity is here.

So if you have some time to burn and have been putting off digging in to one of the nicest DIY visuals environments, head on over to DVCreators.net and get your learn on.

Quartz Composer gurus have had to face challenges bringing in network data: the problem is, to keep Quartz Compositions secure, Apple has largely crippled networking features. Celso Martinho has been hacking QC to make networking work in Leopard, and has a functional solution. He wrote us to tip us off on a detailed post at his blog.

First, if you’re still on Tiger, good news:

I needed a way to get data from the Network in the form of events that I could reuse in a quartz composition. So our resident mac programmer coded this custom made patch based on sparse non official documentation found on the internet. And it worked great. We have about 5 plasma screens with mac minis over at work running it for months, no problems whatsoever.

But while Leopard finally offered an official means of making your own patches (that’s what the rest of the patching world calls “objects”, Max/MSP, vvvv, and Pd users), Leopard also breaks their custom patch. Solution?

Then I found 2 patches in the new “Network” category: Network Broadcaster and Network Receiver. They are meant to connect several qtz compositions across the network and exchange messages between them. But maybe I can use them for something else…

I wrote a quartz composition to broadcast messages using UDP and multicast and started debugging and I discovered that the packets are really simple non-crippled text messages, four bytes per character iso-latin encoded chunks.

If you’re doing heavy-duty networking, I’d still investigate other alternatives to make sure Quartz Composer is your best choice. Processing and Max/MSP/Jitter both make short work of UDP send/receive, thanks to Java’s natural abilities there, as do objects in vvvv, Pd, and the like. Even Flash has some data features, with a little work. On the other hand, QC has some natural tricks of its own, and for multi-machine setups, the combination of this hack with QC’s new multi-computer features is very sweet indeed.

Full details, plus a PHP script that does the dirty work, here:

Leopard’s Quartz Composer and Network events [Celso Martinho]

Quartz Composer, first introduced in OS X 10.4 and rooted in the underground visual app PixelShox, is a hidden gem in Mac OS X. This free visual tool makes some sophisticated video and 3D magic possible without coding. While promising, the version in 10.4 had some significant shortcomings. We turn to Keith Lang of developer plasq, creators of Skitch and ComicLife, to give us an inside look. Keith is not a programmer — so he’s all the more eager to go the visual patching route — but he has had his hands on QC for some time in Leopard dev builds. And now, he’s free to tell us all he knows. -PK

Mac OS X 10.5 “Leopard” is here, and the initial hoopla about the reflective dock has died down. Now that we’ve all passed through the Seven Stages of Acceptance, we have an opportunity to take this brief slither of quiet to delve into the subtler changes within the big new cat. Those changes include improvements made to Quartz Composer, the quaint and oft-misunderstood visual processing environment bundled with the Developer Tools.

What You See: The Interface

For the uninitiated, Quartz Composer is an ‘environment’ tool which lets you patch together various elements in order to build screensavers, performance environments, and animated windows for use within an application. If you’ve ever looked at an Apple screensaver, played with the new iChat Effects or watched photos float and twirl on an Apple TV, then you’re familiar with what Quartz Composer can do. Its peers are tools like Pd (Pure Data), Processing, and Max/MSP/Jitter, with Quartz Composer heavily geared towards motion animation of processed video and images. Input can be everything ranging from your iSight to XML to audio to a Wiimote, with output being a window on 3d space containing all the sprites, effects and movement you care for. Because Quartz Composer is a real-time system, you can plug stuff together whilst watching and tweaking. The underlying engine is very efficient - and with a little work you can create teh cool, without ever needing to type teh code.

Click to play

Mrmr is an open protocol for mobile devices. It is used to dynamically create user interfaces on your iPod Touch or iPhone which respond to client apps in a multi-user performance environment.

Okay, that sounds awfully dry. Let’s try that again.

Mrmr lets you control Quartz Composer applications (or really , any compatible OSC implementation)over Wi-Fi from your iPod Touch or iPhone. Now you, too, can dance around like a lunatic while still controlling your visuals from the dance floor. Did we mention it’s multi-user, as well?

Mrmr is the brainchild of Eric Redlinger, researcher-in-residence at Brooklyn Polytechnic University’s Integrated Digital Media Program. He has leveraged the iPhone’s OS X underbelly and 10.5’s new Quartz Composer features to allow this sort of functionality.

I had the lucky* chance to interview Eric and ask him a few questions about Mrmr and the iPhone. Apologies for the quality of the interview, it was very spur of the moment.

Mrmr is a work in progress, but I think the results so far speak for themselves.

*(ok, no so lucky, my desk is right next to his, but somehow I had not seen Mrmr in action until just recently…)

Nice work if you can get it: visualist Toby / tobyz, aka *spark, had one heck of a live visual rig for the Geneva Motor Show’s Ford booth. One ongoing challenge for live VJs is making it clear what they’re doing. Solution: “VJ Crew” t-shirts, lovely women (can’t hurt), and, of course, giant touchscreens for interfacing with the Mac software. Live visuals made the client happy (interactive text!) and made guests happy by snapping photos (happier clients!). The software rig was the glue:

• VDMX5 from Vidvox (still in beta), which looks the ideal interface for the work they were doing. Custom, modular palettes and windows also lend themselves nicely to the touchscreen.
• Quartz Composer patches, built with Apple’s free visual-patching developer tool for custom visuals, integrate directly into VDMX5. Result: a modular, custom system that works live and gets the job done!

Documentation:
Photos and notes on the install/performance
Video montage of the event

Open Source Tool for Easy, Live Titling

But you don’t have to just silently drool over this setup. Toby is nice enough to give away one of the tools he built to make it happen, open sourced so the community can improve upon it.

Spark Titler, GPL-ed Quartz Composer patch for live text titles

Quick titling? No problem. Toby describes it thusly:

the titler’s interface allows you to take between two sets of title/subtitle, with the choice of four backgrounds: black / green / a quicktime movie or a folder of images. the output window will automatically go full-screen on the second monitor if it detects one is available at launch, otherwise it will remain a resizable conventional window.

it is released with the intention that it can be reused for other events without changing a single line of code: you can design the animation and incorporate quicktime movies in the design by editing the ‘GFX’ macro in the quartz composer patch, and its a matter of drag and drop replace the logo in the interface.

And if you’re up for patching some improvements (with a little light Xcode use), you can dig into the source, as well.

Why Live and Interactive Rules

But enough about the technology. Part of the whole philosophy of this site is that we believe “rendered”, wonderful as it can be, sometimes must make room for “live.” Quartz Composer is just one of a generation of tools that allow visualists to move in this direction. It’s part of our interest not just in the “Final Cut” (ahem), but the live cut. Artists are moving in this direction for creative reasons, but it’s equally encouraging to see it working well on gigs. It’s a practical, technical issue as much as it is a philosophical one. Toby explains in a caption to a recent blog entry on his Quartz Composer titling patch (pictured here):

this picture is but a snapshot of the revolution. it really feels like that. a real let-down of the geneva motor show pre-production was the inability to translate the creative agency’s after-effects rendered text animations into the live, dynamic setup. there just was no way to implement anything vaguely sophisticated without seeing the framerate drop to near zero. structure record, something driven by video sampling and seemingly tangental [sic] to text rendering, is the key to solving that problem… and so here it is solved, as if on cue for the frankfurt motor show.

(emphasis mine)

Structure Record looks like some kind of custom patch. Not sure how it works — Toby, if you want to enlighten us, please do!

So have a look at that patch, and viva la revolución!

(Via the Quartz Composer dev list and vade.)