CDMotion contributor vade has posted the first release of his v002 Screen Capture tool, which allows video from the screen (including video, 3D — anything output to OpenGL) to be routed between applications. It all happens on the GPU, which means it’s very, very fast. In vade’s words:

v002 Screen Capture allows you to capture your desktop, or a portion of it to a texture and further process it. This can be used to bring in other applications output or windows as a source input to VDMX or other Quartz Composer compatible patch hosts.

Screen Capture is fully GPU accelerated, and therefore is very fast.

Sample Processing, 3L, Modul8, Jitter, GEM, or any application, and mix them in VDMX, or your Quartz Composer patch host of choice.

Right now, the release is Quartz Composer and Mac-only. (Quartz Composer plug-in support means it’ll also drop nicely into software like VDMX.) But there’s an open call to port this to other environments (Pd, Max/MSP/Jitter, Processing, and such). It may even be possible to replicate the basic technique on another operating system, though the implementation would have to be reconsidered.

We’d love some feedback, so have at it! Especially interested in Processing support; see the thread on the Processing forums.

v002 Screen Capture Quartz Composer plug-in download

eMotion - Basic particles tool example from Adrien Mondot on Vimeo.

We saw eMotion last year — it’s a Mac OS-based 3D tool for particles and visual effects, with physics modeling, Wacom tablet control, input from sensors and OpenSoundControl, a text engine, and integrated Quartz Composer support. In other words: it’s a friendly tool for making pretty motion imagery, designed to be usable by performers.

Creator Adrien Mondot has new videos up and a beta available for download. (An Intel Mac running Leopard is required.)

eMotion on stage from eMotion for Animation on Vimeo.

More videos, including screencasts on features like forces and Quartz Composer:

Vimeo screencasts

Details on the software and a download link:

eMotion

The description is a bit hyperbolic ("a new way to define movement"?) given that a lot of this is indebted to 1970s "augmented reality" research by Myron Krueger and physics simulations by, well, a lot of people. (Particle systems were specifically invented by Bill Reeves of Pixar in the early 80s. Ahem — Khaaaaaaaaaan!) I don’t think that takes away from the coolness of this — on the contrary, I think acknowledging historical lineage helps demonstrate why the new, accessible, personal rendition of that is valuable. But there is a lot here that’s done very well. It’ll be fantastic to watch it develop.

Likewise, it’s interesting to see these tools (and vvvv, also mentioned today) working with proprietary, platform-specific technologies. There are certainly some advantages to hooking into the Mac’s Core Image and other app development tools (see Quartz Composer, VDMX, etc.), or Windows’ DirectX (as with vvvv). I think the challenge for people interested in open, cross-platform development is to make things just as usable and visually consistent with OpenGL and cross-platform APIs.

I’m sure I’m not the only visualist to have been inspired by Autechre’s Gantz Graf video, nor the only person to have watched it and though “some day, we will be able to do that in realtime”:

I think we’re still quite a way off, but the latest project to set my mind thinking along these lines is Amoeba Dance - Caliper Remote (and the followup, Amoeba Dance with Mad Girls,) by CDMo reader Memo:

This is created realtime in VDMX from a quartz composer generator, controlled by 9-band audio analysis, and topped off with a very nice little effects chain.

A few people have mentioned they don’t get the same look when they use the QTZ file, this is because the QTZ file renders with very basic shading and there is quite a bit of post done in VDMX. The Effects I’m using (from top to bottom) are:
Serpia Tone (100%, Source Atop)
Shaded Material (0-40% tied to audio analysis, Soft Light)
City Lights (100%, Source Atop)
Bloom (100%, Screen)

I’ve also got a 9-band audio analysis going on, with different frequencies driving all the parameters of QTZ. You can just setup the frequencies randomly and it will do pretty cool stuff to almost any song (see http://www.memo.tv/amoeba_dance_v1_5 for an example!!), but it is best to taylor the frequencies to the specific song…

Memo shares the GLSL code and the QTZ file on his site, which contains some interesting nuggets of QC, Actionscript, Processing and other codey goodness. PK: Because this uses GLSL which runs in any OpenGL environment, you could also port the geometry stuff to Processing, Max/MSP/Jitter, Pd/GEM, or (with some adjustments) even things like vvvv, etc. — no need for Quartz Composer per se.

He also maintains a VDMX and Quartz Composer repository: http://vdmx.memo.tv/.

Awesome work, and more to come it seems.

For all of the other CDMo readers who are doing cool things, don’t wait for us to find you: Hit the comments or the contact page and tell us what you’re up to!

It’s still early in development (read: it often crashes), but The Bean Machine applies nodal, patch-based development to Java. The interface is mysteriously close to Quartz Composer, down to capabilities, UI, and even the 3D cube tutorial. Personally, I use Java because it can do things Quartz Composer can’t, but it’s interesting nonetheless — and raises, again, the question of why we don’t see more tools that try to meld the capabilities of code and patches.

The cool bit: nodes are Java Beans, so you really could use this to combine the best of both worlds if it matures. No download yet, but we’ll be watching … perhaps it will inspire other developers, as well.

The project is labeled “experimental”, but could be worth a look. Developer Jerry Huxtable has lots of other goodies for Java-heads on his page, including lots of 2D image processing stuff and a map editor — Processing lovers, might want to pop this into your del.icio.us.

Bean Machine @ JH Labs

JH Labs main page with lots o’ projects

Here in Los Angeles the weather is currently sunny and warm - great for going to the park, but not so much for creating that Xmas/New Year’s Wintry feeling. Here’s a patch you can use to fill the room with snowy interactive goodness. Fire up your Projector, Big Screen TV, or Wrist-worn LCD Display and let it snow!

Here’s a clip of the patch in action:

Interactive Snowflake Maker from momo_the_monster on Vimeo.

You can download the Quartz Composer patch here:
Momo the Monster: Interactive Snowflake Generator (Direct Download)

Open it up in Quartz Composer, and drag your mouse pointer over the output window to make beautiful silvery patterns. If you want to go full-screen with it, I recommend you set the monitor to 640×480 to keep a good framerate.

I’ve got a version controlled by a joystick that I put together for my Company’s holiday party - let me know if you make anything new out of it! Enjoy, and Happy Everything.

If you’ve been intrigued by all this talk of Quartz Composer, the free visual creation software that ships with Mac OS X 10.4 and 10.5, here’s your chance to actually learn how to do cool stuff with it. Our friend Momo walks us through a basic tutorial on simple 3D and audio processing, which you could easily apply to more complex ideas. With QC support in the upcoming VDMX5, you could drop this into a VJ set with traditional clips, as well. We’ve got step-by-step instructions, plus a video. Let us know if you create anything wild with this as its basis.

Quartz Composer: Lighting 3D Cubes and Moving them with Audio Input from momo_the_monster on Vimeo.

In this Quartz Composer tutorial, We’re going to make a 3D cube that responds to our voice.

First we start up Quartz Composer. The icon will be different depending on whether you’re running OS X 10.5 or 10.4.

From the File menu, choose New Blank (or simply ‘New’ in Tiger).

DVCreators has put up a half an hour tutorial on Quartz Composer detailing how they have created their introduction graphics:

I’ve always liked the super-dramatic light rays effect, but the light rays filters in Motion and Final Cut Pro take too long to render… and frankly, they are pretty lame. So I’ve been waiting for the right opportunity to help you create those super long, awesome godlike light rays, and preferably in real time! And finally, that opportunity is here.

So if you have some time to burn and have been putting off digging in to one of the nicest DIY visuals environments, head on over to DVCreators.net and get your learn on.

Quartz Composer gurus have had to face challenges bringing in network data: the problem is, to keep Quartz Compositions secure, Apple has largely crippled networking features. Celso Martinho has been hacking QC to make networking work in Leopard, and has a functional solution. He wrote us to tip us off on a detailed post at his blog.

First, if you’re still on Tiger, good news:

I needed a way to get data from the Network in the form of events that I could reuse in a quartz composition. So our resident mac programmer coded this custom made patch based on sparse non official documentation found on the internet. And it worked great. We have about 5 plasma screens with mac minis over at work running it for months, no problems whatsoever.

But while Leopard finally offered an official means of making your own patches (that’s what the rest of the patching world calls “objects”, Max/MSP, vvvv, and Pd users), Leopard also breaks their custom patch. Solution?

Then I found 2 patches in the new “Network” category: Network Broadcaster and Network Receiver. They are meant to connect several qtz compositions across the network and exchange messages between them. But maybe I can use them for something else…

I wrote a quartz composition to broadcast messages using UDP and multicast and started debugging and I discovered that the packets are really simple non-crippled text messages, four bytes per character iso-latin encoded chunks.

If you’re doing heavy-duty networking, I’d still investigate other alternatives to make sure Quartz Composer is your best choice. Processing and Max/MSP/Jitter both make short work of UDP send/receive, thanks to Java’s natural abilities there, as do objects in vvvv, Pd, and the like. Even Flash has some data features, with a little work. On the other hand, QC has some natural tricks of its own, and for multi-machine setups, the combination of this hack with QC’s new multi-computer features is very sweet indeed.

Full details, plus a PHP script that does the dirty work, here:

Leopard’s Quartz Composer and Network events [Celso Martinho]

Quartz Composer, first introduced in OS X 10.4 and rooted in the underground visual app PixelShox, is a hidden gem in Mac OS X. This free visual tool makes some sophisticated video and 3D magic possible without coding. While promising, the version in 10.4 had some significant shortcomings. We turn to Keith Lang of developer plasq, creators of Skitch and ComicLife, to give us an inside look. Keith is not a programmer — so he’s all the more eager to go the visual patching route — but he has had his hands on QC for some time in Leopard dev builds. And now, he’s free to tell us all he knows. -PK

Mac OS X 10.5 “Leopard” is here, and the initial hoopla about the reflective dock has died down. Now that we’ve all passed through the Seven Stages of Acceptance, we have an opportunity to take this brief slither of quiet to delve into the subtler changes within the big new cat. Those changes include improvements made to Quartz Composer, the quaint and oft-misunderstood visual processing environment bundled with the Developer Tools.

What You See: The Interface

For the uninitiated, Quartz Composer is an ‘environment’ tool which lets you patch together various elements in order to build screensavers, performance environments, and animated windows for use within an application. If you’ve ever looked at an Apple screensaver, played with the new iChat Effects or watched photos float and twirl on an Apple TV, then you’re familiar with what Quartz Composer can do. Its peers are tools like Pd (Pure Data), Processing, and Max/MSP/Jitter, with Quartz Composer heavily geared towards motion animation of processed video and images. Input can be everything ranging from your iSight to XML to audio to a Wiimote, with output being a window on 3d space containing all the sprites, effects and movement you care for. Because Quartz Composer is a real-time system, you can plug stuff together whilst watching and tweaking. The underlying engine is very efficient - and with a little work you can create teh cool, without ever needing to type teh code.