Blender 2.5, - Got flexible? from Pablo Vazquez on Vimeo.

In case the last post didn’t give you enough Blender goodness, here’s more for your pleasure.

Version 2.5 is coming of the open source 3D suite that’s also a nodal compositing engine and a video editor and a real-time game engine — basically, a visual operating system in which you can make just about anything. 3D software in general hasn’t been gifted with especially slick interfaces. But 2.5 changes that: check out the elegant pop-up menus and Spotlight-style menu searching. Every little detail can be Python scripted, which sounds geeky but could be an easy way to just tell the software what it is you want to do - and Python is a lovely language to dip your toes into as a beginning coder, too.

All that’s well and good. But the real highlight of the video above is the fact that working in Blender now happens much more in real-time. For those of us used to working with visuals in performance, this means our “studio” workflow can be dynamic and live, too. Whether you render and remix video later, export 3D objects, or move to the Blender Game Engine to take your Blender work onstage, that is likely to appeal to visualists.

And if you’re just getting started, here’s a tutorial on using video textures in the Blender Game Engine, even if you’re new to the whole environment:
Beginner’s tutorial: Using video textures in the Blender Game Engine

Via comments from Samuel Gaehwiler - thanks!

At the moment (<2.5), Blender follows the “do everything in one window” paradigm.
As jeff clermont stated above: Blender 2.5 will be the first blender release which will allow multiple windows. Hopefully, one can show the output of the game engine on one monitor in full screen while manipulating it on the other screen. The new event system in 2.5 might allow some nice possibilities for visualists. Pablo Vazquez has done a nice of manipulating a running animation (in the 3d view), which isn’t possible in Blender <2.5.

Part of what makes Resolume Avenue so compelling as a live visual solution is that it can mix, mash, and loop audio alongside video, in ways often resembling Ableton Live. But that, of course, doesn’t make Resolume nearly as deep a live sonic tool as Ableton. So, to combine two great tastes – live video in Resolume Avenue, plus live audio and elaborate sequencing control in Ableton Live – the folks at Resolume have assembled a recipe that allows Resolume to be controlled via Live using MIDI.

The basic process:

1. Route MIDI from Resolume to Ableton, using the IAC Driver on Mac and MIDI-Yoke on Windows.

2. Make a MIDI sequence in Ableton that controls clips in Resolume.

3. Add some audio clips and scenes in Live for some live audio goodness.

4. Link parameters and sync for effects and icing.

Controlling Resolume Avenue with Ableton Live

This does nothing to stop a fantasy I’ve heard other folks discussing of late: imagine if we had an OSC (OpenSoundControl) sequencer? OSC is by nature time-based as a protocol, and you could even still sequence MIDI events (using MIDI over OSC) – or arbitrary events that wouldn’t be restricted by overly rigid event types like the MIDI Note? Does anyone know if such a thing has been tried? (Maybe it’s time to write one.)

Live Plus…?

That’s not to take away from the beauties of Ableton Live in this sort of setup. Combining Live and visuals, whether to add audio or sequence visuals or both, has been an ongoing theme on this site.

Live + Resolume (like the above tutorial, but + Ethernet) Tutorial: Ableton Live + Resolume with MIDI Over Ethernet, Free on PC (Linux, Mac Soon)

Live + Isadora + Max + The Karate Kid: Karate Kid AV Remix – and a how-to using the awesome Lucifer plug-in (which could also be nice with Resolume): AV Cutup Secrets: Using Lucifer & Live

Live + Isadora: Ableton Live + Isadora: Slicing, Syncing Audiovisual Tutorials

Live + VDMX: Toby *spark and Live Cinema: Ableton and VDMX, Soundtrack and Narrative

Live + robotic mirrors on projectors: DMX For Dummies: Controlling iCue Robotic Mirrors with uDMX and Ableton Live

Live + Jitter: Christopher Willits on XLR8R with Live Jitter, Ableton Live Visual Setup

Live + robotic cameras: Interview: Josh Cardenas’ Robotic, Midi Controlled Cameras and tour with DJ Shadow and Cut Chemist

And one instance of Live failing to be the tool for the job, only to be replaced by Max: Progress Report: 8 Cameras Plus Vixid Plus Patching Gives Craziness (Pd would work, too, which would be nice for a Linux netbook)

Now that Bart has gotten the ball rolling for Resolume, though, I suspect we’ll see a lot more ideas for combining Resolume Avenue with Ableton Live, or using Avenue as an audiovisual tool in itself; it just makes sense. If you work up your own setup or add your own twist after following this tutorial, let us know!

Musician Christopher Willits has an ongoing series for XLR8R Magazine in which he talks his own technical workflow. In the latest episode, he adds live visuals to his Ableton Live set using Max/MSP/Jitter. What’s nice about this is you see how some clever mapping can make visuals integrate neatly with music.

I’m somewhat insane, so my own setup often involves simultaneously running visuals separately with no communication with my music software. That allows me to set up less-direct relationships between visuals and sound.

But, while the techniques could be combined to a variety of setups, this also serves as a nice introduction to how you might use patching in Jitter alongside your music software.

Curious to know what you think of the presentation and content here, as I hope we’ll do more videos like this ourselves.

What You Talkin’ Bout, Willits? Part 10 [XLR8R]

Add Max patch effects to DNA. from Livid Instruments on Vimeo.

Yesterday, we saw some splashy video distortion techniques applied to real-time video. You know what that means: it’s time to use these in live performance.

Liquidify Video, Live: Optical Flow GLSL Datamosh Technique

Here’s one start.Peter Nyboer, Max whiz and Livid developer, has run with the idea of squishing around video using optical flow analysis, and shows you how to add the effect to Livid’s Cell DNA VJ app. For Jitter users, this means you can rely on Cell for quick access to video taps and files, while adding unusual effects built in Jitter to get your custom processing on, not only with this example but any other patches you’ve created. One little detail of Cell DNA I missed – it requires Max 4 patches, not Max 5 patches. Peter has also posted a tutorial for working with that, after the jump.

And yes, if none of this is really making sense to you, you can go download the files and just try it out – no need to fully grasp all of the internals straight away.

Don’t want to use Jitter and/or Cell? The guts of Andrew Benson’s video datasplooshing technique is an OpenGL (GLSL) shader, so it doesn’t even rely on Jitter – Jitter can just be a convenient environment for playing around with such things. There’s word we may see a Quartz Composer wrapper around this shader, which would make it easy to use with software like VDMX.

Oh, by the way, I’m officially rescinding my editorial ban on the term “datamoshing.” Why? Because it means absolutely nothing, and therefore can be declared reasonably harmless. Also, unlike the term “glitch,” it comes without any baggage. We therefore have a nice, nonsense term for making video all mushy and unpredictable – a good thing.

In which this humble author, with tongue sometimes planted in cheek:
1. Shares a how-to video on datamoshing.
2. Forbids the use of the word datamoshing in future.
3. Challenges obscenely-gifted motion artist David O’Reilly to a rumble.

Here’s the story so far: there’s a compression artefact created when videos are compressed improperly, which causes frames to melt into one another like wax. And so, among others, we recently saw on CDM the music video Evident Utensil, a video that intentionally (ironically?) overused that effect until you started seeing missing p-frames and i-frames in real life and/or threw something at your computer in disgust. The most interesting part of that story wound up being a guy with a few dozen YouTube views who posted videos with this effect like they were home movies, and he seemed to actually speak in a language made up of compression artefacts, and he showed up in comments and said, insightfully I thought:

drul pixel the. teh pix pi pi aph afgh. $$$342agph. fafpht. :D :D :D !!!! teh. teh teh!!!!1 fteh ftehapple.>>>>VLC<<<< wmv &&&scrub vidcodec. mma ek :D S:D sence video. :D ghsg :) VLC VCKL :( wmv wmv ##raghg drool pixels<<<>>>_>baby. :D crazy like a fox. :P :D :D :D !!!! $$# ragha arugh pi pii pi squeez VLC%%%charflit, flarhfit. ckharlift. :( :( bad babyb, bad band. teh teh teh!!!! the

This is, of course, what baby boomlet parents fear will become the lingua franca of their children, as kids text nonsense to one another rather than paying attention to Pre-Algebra class. I think that probably doesn’t matter, because by the time those kids are grown up they’ll be jacked into the Matrix anyway, and to save money, the Matrix will be full of compression artefacts.

You probably think I post everything without remorse. You probably think I’m a hipster, lounging on a bed of PBR cans and spouting nonsense words for occasional blips of Boing Boing fame, that tomorrow I’ll have my own brand of steampunk datamosh. But believe it or not, thoughts do flash through my brain as I’m writing - well, at least some of the time. On those occasions, conflicting sentiments blink like so many p-frames in the frontal lobe of my brain: