Visual Space Music: Generative Audiovisualizer with Surround Projection in Jitter

By Jaymis

mememamo writes in with his audio visual synthesizer exploration project, Visual Space Music.

Visual Space Music is an interactive audio visual installation created in Max/MSP and Ableton Live. It explores the possibilities of space based audio arrangement and mixing. The user navigates through the virtual space, moving through and manipulating audio/visual synthesis objects, creating anything from abstract virtual soundscapes to precise rhythmic space music.

Using a joystick and knob/fader based midi controller, the user navigates through the virtual space, while moving knobs manipulates each synthesis object, controlling how the object sounds and looks in realtime.

Movement in the space can both affect the arrangement of a composition (using space instead of traditional time-based methods) and also the surround mix. The object sounds project from the direction they are in, manipulated by the user’s exploration of the space.


Visual Space Music Introduction (HD) from Ian McKinlay on Vimeo.

There’s extensive software and hardware information on the project site. I’m especially loving the use of Ikea rear projection screens!

Live Visual Control: Processing + Multitouch, and Numark Total Control + Quartz Composer

Visualist duo Ivan and Jose have set up a new blog with some very inspiring experiments in live visual control:

http://tratadodeintegracion.cc/stream/

If you speak Spanish, you’ll find this to be an invaluable set of resources. If you don’t, you’ll simply enter a hacking wonderland with some mysterious images and videos and (even with no knowledge of the language) still some very handy links.

Among their accomplishments so far: a DIY multi-touch rig controlling Processing and Max/MSP (with MaxLink handling communication between the two).

And for those of you who prefer hardware, here’s the Numark Total Control working in concert with Apple’s free visual patching environment Quartz Composer. Live generative 3D visuals, ho! If you’re a Total Control owner, the blog post has complete details with screen shots and JavaScript scripts that do all the important translation work.

See also the i2offplusr3nder Flickr stream for lots more 3D/Processing goodies. We’ll be staying tuned to this one.

We are Hacks: Live Visual Lineup for the HOPE Hacker Conference, NYC Friday


Joshue Ott/superDraw +Ezekiel Honig live at monkeytown from superdraw on Vimeo.

I’m very excited about the music lineup we have planned for this Friday in New York at the CDM-curated evening of live audio and visuals – but the visual lineup should be a big draw, too. If you’re in New York, come say hi (and if not, hope to have more details on these projects for the rest of the planet soon):

  • Joshue Ott creates live visuals with his homemade superDraw generative illustration tool
  • Paris (Voltage Controlled) and Don Miller (No Carrier) create glitchy, lo-fi visuals from custom-created 8-bit visual software on Nintendo and Commodore systems
  • vade and Mary Ann Benedetto will visualize and reinterpret geeky things (possibly the Linux kernel, data packets, or both) using custom code and Quartz Composer stuff — we should even see a free release of some of those tools in time for the gig, so stay tuned to CDM
  • Bill Jones creates live cinematic worlds inspired by sci-fi noir

Where: The Hotel Pennsylvania, New York City (map); head to the main door, on your left is the entrance to Penn Pavilion and you should see a table there.

When: Friday, July 18 2008 – performances run 11pm – 2am

Cost: US$10 at the door. First come, first served. (free if you have a conference badge)

We Are Hacks: Music and Visual Performance at HOPE, NYC – Preview

http://www.thelasthope.org/

Facebook event page (RSVP if you’re coming! Also on Going.com)

Above: one of my favorite videos from superDraw (Processing-based) by Joshue Ott above, though it’s even better to see it in person with the live drawing capabilities. Below: all-custom 8-bit-style software generates visuals, via Paris.


Function Field System - PureData/GEM from Paris/VoltageControlled on Vimeo.

v002 Screen Capture Available: GPU-Accelerated Mac Inter-App Sampling

v002 Screen CaptureCDMotion contributor vade has posted the first release of his v002 Screen Capture tool, which allows video from the screen (including video, 3D — anything output to OpenGL) to be routed between applications. It all happens on the GPU, which means it’s very, very fast. In vade’s words:

v002 Screen Capture allows you to capture your desktop, or a portion of it to a texture and further process it. This can be used to bring in other applications output or windows as a source input to VDMX or other Quartz Composer compatible patch hosts.

Screen Capture is fully GPU accelerated, and therefore is very fast.

Sample Processing, 3L, Modul8, Jitter, GEM, or any application, and mix them in VDMX, or your Quartz Composer patch host of choice.

Right now, the release is Quartz Composer and Mac-only. (Quartz Composer plug-in support means it’ll also drop nicely into software like VDMX.) But there’s an open call to port this to other environments (Pd, Max/MSP/Jitter, Processing, and such). It may even be possible to replicate the basic technique on another operating system, though the implementation would have to be reconsidered.

We’d love some feedback, so have at it! Especially interested in Processing support; see the thread on the Processing forums.

v002 Screen Capture Quartz Composer plug-in download

Another Max/MSP 5 Preview, With Some Subtle Goodies Revealed

Vlad Spears, musician, programmer and maker of the Davel.Plugs audio plugins (previously reviewed on CDM) has a write-up about the forthcoming Max/MSP 5. Andrew Benson of Cycling ‘74 gave a presentation at the Bay Area Computer Music Technology Meetup and Vlad kindly drew up a report. Most of the features he describes will not be new to those who’ve been awaiting Max 5, with the possible exception of:

- Say goodbye to [prepend set] messages! Message boxes have a right inlet specifically for this function.

- Multiple live views on the same patch, at different magnification levels. As someone who often builds patches which spill beyond the bounds of a screen, this is fantastic. Changes update in all views simultaneously.

- Object name auto-completion. To quote Andrew, “Several of our developers bought iPhones during development and fell in love with auto-completion.” Arrow through the drop-down list of auto-complete object choices and the Clue window shows information and arguments for each.

The grapevine says that the public beta of Max 5 will drop within several weeks. /me twiddles thumbs…

Ed.: Word we got from Cycling ‘74 at NAMM was that you’ll have the final version by the end of first quarter. I’m actually wondering if they’ll either forgo public beta — or slim it down in length — but that means you’re still just a few weeks away from the next release of Max.

aka.iphone 2.1: More iPhone and iPod Touch Performance Tools

By vade

iPhone development continues despite a lack of SDK. Masayuki Akamatsu has updated his native iPhone OSC client aka.iphone to 2.1, and includes plethora of screen/input configurations to suit your mobile performance needs. The update should suit typical VJ and Dj applications with its range of GUI sliders, knobs, button grids, etc.

If you have an iPhone or iPod Touch, be sure and check out aka.iphone. Very cool stuff. Yes, sorry, another Apple oriented update. Shoot me.

[Ed.: Note you will want Max/MSP/Jitter to work with this app, though I think it should work with Windows, too; I just lack a machine that can test it. Be sure to see also Masayuki's complete Max collection, which now covers everything from Wii remotes to 3D SpaceNavigator controllers, Apple Remotes, and even the motion sensor in the MacBook Pro. Completely brilliant. And needless to say, even if you don't want to hop on AT&T's mobile network, this gives you options with iPod Touch, too, even if you can't play Phase on that. -PK]

akaremote-d.gifakaremote-c.gifakaremote-b.gifakaremote-a.gif

MIDI Control with iPhone and iPod Touch: i3L MIDI Bridge

i3L MIDI bridge for iPhone and iPod Touch

Mobile, touch control of visual apps? We’ve seen one way to do it; here’s an even more compatible MIDI approach. I think I’d stick to the iPod Touch, personally, just to conserve battery on a phone. But it’s interesting. -PK

Hot on the heels of Mrmr, ArtificialEyes (the Istanbul-based VJ collective) have released i3L MIDI Bridge for the iPhone, which builds on Masayuki Akamatsu’s aka.remote.app, giving those without Max/MSP skills a simple way to bridge their iPhone and audio/video performance software of choice.

i3L (pronounced “i thrill”) is Freeware, and was developed using Max/MSP from Cycling74 and is a support application for aka.remote by Masayuki Akamatsu i3L receives pre-defined UDP messages from aka.remote.app running on the iPhone, scales the values to MIDI, and allows you to configure the sending MIDI channel and control change message number. While this software was developed to work seamlessly with our Real-time 3D VJ software Thrill, you can use this program with any audio or video software which receives midi messages.

If you give i3L a try, let us know how it works out for you in the comments.

artificialeyes.tv
aka.objects by Masayuki Akamatsu — must-have stuff for Max/MSP/Jitter!

Ed.: Does anyone know if multi-touch gestures would be possible in DIY apps? Maybe in February when Apple shares the official SDK? -PK

What’s New for Jitter in Max 5

Though most of what’s new in Max 5 is concentrated in Max and MSP, there will be a few treats for Jitter users. First and foremost is the new Matrix Probe: hover your mouse over a green matrix patchcord and you’ll be presented with a floating preview of the matrix passing through it along with information such as dimensions, planecount and other info. This will be a great timesaver — no longer will you have to drop in four jit.pwindows, four jit.fps’s and jit.unpack to find out whether the video you’re sending is the video you think you’re sending. Gregory Taylor tried to demo the Matrix Probe for me at AES last weekend but it wasn’t working in the build he had on his laptop. Nonetheless, I offer this JPEG as proof:

Other features:

  • The ability to drag and drop movies directly into patches will make a big difference for folks developing VJ patches (auto-creating “read foo.mov” messages and such), not to mention the slickness of the new file browser, even though its not yet as integrated as some would like. Ed.: The limitation of the new file browser, as I pointed out on CDMusic, is that you can only use it within a patcher, not in, say, Presentation Mode as a way of browsing files during a performance.
  • There will be some performance improvements in Jitter’s matrix operations on the CPU thanks to a recent bug report on jit.rota on the Jitter list.

And, unfortunately, that’s about it — too bad Cycling doesn’t have ten more developers working on Jitter full time. Still, the new (dare I say it?) paradigm in Max 5 will bring much to explore even without, um, totally jitter-free playback of HD and SD footage.

Ed.: It’s possible we’ll see some other enhancements between now and Max 5 ship time, but as has happened in the past, Jitter appears to get a different “rotation” in development than Max — so Jitter got a huge 1.5 update while Max/MSP was largely standing still. We’ll certainly keep tabs on development and let you know more details as they arise. There are quite a lot of general improvements that I’m sure Jitter users will love while we wait on these other needed improvements to Jitter itself; see details in discussion in our general Max coverage from Create Digital Music. -PK

Cycling ‘74 Releases Max 5 Details: Bringing Max Out of the 80s, Into the Future
First Max 5 Preview: Music Patching, the Next Generation?

Refresh: Asides

Vade interviewed on VJ-U -

I’m sure the only reason he hasn’t posted it here is that he’s extremely humble, but Benton-C has a very interesting interview with Vade posted on VJ-U, discussing a whole range of subjects CDMo readers hold very dear.

First Max 5 Details Are Here (And More to Come)

It’s no secret that a major update to Max/MSP/Jitter is coming from Cycling ‘74, with a major overhaul of the underlying code and an entirely new, friendlier interface. What has been secret is just what that upgrade will look like. We still don’t know what it’ll look like visually, but Cycling ‘74 today released some new details about what it is and isn’t.

In short, it promises to be:

  • Easier to use: Multiple undo, debugging tools for patches, and a visual catalog for perusing objects.
  • Easier to learn: Integrated, rewritten documentation, even including Web links.
  • Easier on the eyes: A new, zoomable patching interface with lots of new goodies — that’s not only skin deep, but makes patches easier to navigate.
  • Mo cross-platform: A new code foundation should make Max more modern, reliable, easier to support on C74’s part, and better supported across OSes. It even opens the possibility of someday seeing Max/MSP/Jitter on Linux and not just Mac/Windows.
  • Not full of gobs of new objects: Normally this is not a feature, but here, it’s a good thing: by introducing only a few objects, the new Max focuses instead on improving existing objects and building a better environment / platform for the future.

I’m meeting with Cycling ‘74 this week at AES, so hope to have more details then, including more on what’s changed for Jitter users. Audio users should note a big caveat — Pluggo support won’t be present in Max 5 at launch, which is critical to using patches as audio effects and instruments in other hosts, though it sounds as though that may be added at an undetermined point in the future. But on the visual side, it looks like it could be a pretty smooth upgrade: most patches and externals should be compatible, with some potential updates needed for tools that have special UI features. (I imagine some patches will look a little odd, too, once they hit the new UI — worth keeping that older Max copy around, just in case.) Overall, looks like good news. Naturally, we want to know more. Lots more. Soon. I’ll keep you posted.

Java and JavaScript support will continue to work. And that means Processing is supported, as well (via mxj), so this could be a great Processing prototyping environment, or a way of coupling Processing with other features. (See jklabs MaxLink. And yeah, it really does work … very cool. Viva Java.)

Cycling ‘74 Releases Max 5 Details: Bringing Max Out of the 80s, into to the Future [Create Digital Music]