Gavin Morris has been working on an audiovisual setup with Ableton Live and Isadora, a tasty combination for any Windows or Mac user. Isadora, for those of you who don’t know, is a visually-focused modular patching tool. It’s similar to tools like Max/MSP/Jitter, but by emphasizing the practical needs of visual performance, it’s unusually usable when putting together real-world gigs. Its use by A/V dance troupe Troika Ranch (co-founder Mark Coniglio is also the tool’s creator) has also popularized it in modern dance circles.

Gavin has two tutorials for us to start. The first syncs up Live and Isadora, along the lines we ran here using Live by momo the monster:

AV Cutup Secrets: Using Lucifer & Live

Gavin writes:

It’s similar to Momo’s recent Tutorial but uses a free tool for the VST (Pluggo) and allows control from the Live interface (as opposed to within the VST) This allows you a lot more flexibility and means you can use Follow Actions, adjust loop lengths/positions in realtime and even create a slicer. It is Live>Isadora via OSC but could equally be to many other softwares and could equally use MIDI.

I’ve written a VST to go in slicer channels tool.

Sync Ableton Live to Isadora using a Pluggo VST from digital funfair on Vimeo.

Gavin warns us that the video may "put us off." At first I thought that meant it was NSFW or something, but … well, that’s not the problem. You’ll see. I leave it up to you to decide how you feel about it.

The second tutorial gives you the power of Emergency Broadcast Network-style A/V slicing:

I’ve done a tutorial for a Video Slicer - synching up Live’s slicer to Isadora - same technique but a bit of maths to convert the midi notes Live creates to video position. You can make some quite glitchy s***!

AV Slicer Tutorial - Ableton 7 Slicer with Isadora from digital funfair on Vimeo.

Lots more information at Gavin’s site, Boredbrands Digital Funfair.

He needs someone to build the Mac plug-in, so Max users, if you’re game, go for it!

AV Sync Tutorial

AV Slicer Tutorial

Good as this is, I hope we see some audiovisual setups that work with more asynchronous relationships between music and motion — I know my own tastes for my personal work tend in the abstract. Maybe I’ll have to put my money where my mouth is and write it up myself.

It’s still early in development (read: it often crashes), but The Bean Machine applies nodal, patch-based development to Java. The interface is mysteriously close to Quartz Composer, down to capabilities, UI, and even the 3D cube tutorial. Personally, I use Java because it can do things Quartz Composer can’t, but it’s interesting nonetheless — and raises, again, the question of why we don’t see more tools that try to meld the capabilities of code and patches.

The cool bit: nodes are Java Beans, so you really could use this to combine the best of both worlds if it matures. No download yet, but we’ll be watching … perhaps it will inspire other developers, as well.

The project is labeled “experimental”, but could be worth a look. Developer Jerry Huxtable has lots of other goodies for Java-heads on his page, including lots of 2D image processing stuff and a map editor — Processing lovers, might want to pop this into your del.icio.us.

Bean Machine @ JH Labs

JH Labs main page with lots o’ projects

The Mac may be in the spotlight these days, but Windows may boast the broadest access to freeware and open source tools for live visuals.

The latest edition: VisualJockey, as pointed out (alongside other free Windows tools) by beatfix on comments.

VisualJockey: Real-time Animation

You get a pretty powerful set of tools in this app, first introduced in 1999:

• Full Windows support, including Vista
• Alpha support throughout; image, AVI, QuickTime file format compatibility
• Global keystone capability
• MIDI, multi-monitor support
• Compatible with FreeFrame plug-ins (open plug-in spec for visuals)
• Sound beatmatching, internal LFOs with lots of waveshapes
• Generators for particles, patterns
• 2D color filtering, effects, blue screen
• 20+ transitions or custom bitmap transitions
• 3D support for 3DS import, primitives, 3D animation
• Export to AVI (which means it can double as an editor)

In fact, VisualJockey’s approach I think is unique — a set of tabs controlling different approaches, a hybrid blend of other interface paradigms. Want a timeline? A reactive sound system? A modular, generative 3D patch? It’s all in there. The UI is decidedly retro, and you get more flexibility from true modular patching environments, but at this price, if you feel like you want another tool in your belt, it’s hard to resist. And with export, this could be handy to have around alongside your existing tool of choice.

But VisualJockey is just the start — here are a few more from beatfix (and me):

If you’ve been intrigued by all this talk of Quartz Composer, the free visual creation software that ships with Mac OS X 10.4 and 10.5, here’s your chance to actually learn how to do cool stuff with it. Our friend Momo walks us through a basic tutorial on simple 3D and audio processing, which you could easily apply to more complex ideas. With QC support in the upcoming VDMX5, you could drop this into a VJ set with traditional clips, as well. We’ve got step-by-step instructions, plus a video. Let us know if you create anything wild with this as its basis.

Quartz Composer: Lighting 3D Cubes and Moving them with Audio Input from momo_the_monster on Vimeo.

In this Quartz Composer tutorial, We’re going to make a 3D cube that responds to our voice.

First we start up Quartz Composer. The icon will be different depending on whether you’re running OS X 10.5 or 10.4.

From the File menu, choose New Blank (or simply ‘New’ in Tiger).

This week on VJ-U, Benton-C Bainbridge interviewed Ray Sweeten, an audio and visual artist who pushes the creative limits of the oscilloscope, creating gorgeous, abstract forms with intense waves of sound.

Watch VJ-U episode dvadeset i dva: Applications in cross-modal media

Though most of what’s new in Max 5 is concentrated in Max and MSP, there will be a few treats for Jitter users. First and foremost is the new Matrix Probe: hover your mouse over a green matrix patchcord and you’ll be presented with a floating preview of the matrix passing through it along with information such as dimensions, planecount and other info. This will be a great timesaver — no longer will you have to drop in four jit.pwindows, four jit.fps’s and jit.unpack to find out whether the video you’re sending is the video you think you’re sending. Gregory Taylor tried to demo the Matrix Probe for me at AES last weekend but it wasn’t working in the build he had on his laptop. Nonetheless, I offer this JPEG as proof:

Other features:

• The ability to drag and drop movies directly into patches will make a big difference for folks developing VJ patches (auto-creating “read foo.mov” messages and such), not to mention the slickness of the new file browser, even though its not yet as integrated as some would like. Ed.: The limitation of the new file browser, as I pointed out on CDMusic, is that you can only use it within a patcher, not in, say, Presentation Mode as a way of browsing files during a performance.
• There will be some performance improvements in Jitter’s matrix operations on the CPU thanks to a recent bug report on jit.rota on the Jitter list.

And, unfortunately, that’s about it — too bad Cycling doesn’t have ten more developers working on Jitter full time. Still, the new (dare I say it?) paradigm in Max 5 will bring much to explore even without, um, totally jitter-free playback of HD and SD footage.

Ed.: It’s possible we’ll see some other enhancements between now and Max 5 ship time, but as has happened in the past, Jitter appears to get a different “rotation” in development than Max — so Jitter got a huge 1.5 update while Max/MSP was largely standing still. We’ll certainly keep tabs on development and let you know more details as they arise. There are quite a lot of general improvements that I’m sure Jitter users will love while we wait on these other needed improvements to Jitter itself; see details in discussion in our general Max coverage from Create Digital Music. -PK

Cycling ‘74 Releases Max 5 Details: Bringing Max Out of the 80s, Into the Future
First Max 5 Preview: Music Patching, the Next Generation?

Finding the right tool for visual performance and VJing is always a challenge. Pre-built systems give you a few choices, but one doesn’t have the right kind of effects, and one doesn’t have the right routing, and one doesn’t have the interface or control you want, and none lets you use custom patches. Modular systems like Jitter and vvvv are fantastic, but require that you reinvent the wheel a bit by building video playback from scratch. What if there were something in between?

For those of you who like creating your own visual patches but would like a way to organize them in a modular, reusable fashion, v001 could be a revelation. Throw together some video processing (or 3D, or even MSP audio) patches, and quickly combine them, reuse them, save presets, assign MIDI and game controllers — all far more quickly than you could in Jitter alone. My friend Anton Marini (aka vade), the creator, showed me the results a couple of months ago and totally blew my mind.

If you’ve ever dreamed of a custom controller you could assemble in modular, Lego-like fashion, you’ll love the idea of the Mawzer custom control surface. Adrian Anders points our attention to a new online configurator, so you can try out your own controller creation. (The link is at the bottom right of the page, labeled “Demonstration.”) See Adrian’s 1380 Euros (1621.50 USD) design below, and if you come up with anything you’d like to share, send it in.

Previously:
Musikmesse: Customizable, Modular Mawzer Control Surface
More on Mawzer: Modular, Custom Control Surface