Beatesthesia: Free, New Processing-Based Music Visualizer/VJ Tool

By vade


Beatesthesia Custom Visulizer from olly gore on Vimeo.

Beatesthesia is a new open-source, cross-platform VJing/music visualizer application programmed in Processing. It sports some interesting design decisions, including an audio-reactive user interface. Its an interesting idea, and is certainly pretty and definitely novel. At first glance, I didn’t like the blinking UI; it struck me as being far too distracting, but, after second thought, it’s a pretty decent way of conveying content and disambiguating a UI elements purpose. Well done. Check out the Vimeo video and home page to get a feel for its capabilities.

Beatesthesia strikes me as being more of a music visualizer than a fully featured VJ application, but it’s open source, which means it will grow as it pulls in a dedicated user base. Beatesthesia’s website also hosts shared projects, so you can explore other users visualizations. [Ed. For what it's worth, it looks like more than just a visualizer to me -- especially as you start to edit the ways in which it works and make more elements "performable" -- and if you don't like this specific implementation, you could certainly code your own in Processing! Anyone performing with this or building something similar, let us know. -PK]

Processing, Ported to JavaScript

imageProcessing derives its power from its use from Java, and using Java applets, you can run Processing sketches in a browser. (You can even use 3D — OpenGL included, with some trickery.) But what if you could use Processing syntax with JavaScript — even just for the heck of it?

John Resig has done just that, porting Processing’s syntax and basic functionality to JavaScript, using the browser support for the Canvas element:

Processing.js

Incredibly, the whole project fits in a svelte 5000 lines — a 10kb compressed download. Now that it’s done, is there any advantage? Well, I can see using it for simple, lightweight JavaScript visualizations in the context of a Web design in which an embedded Java applet didn’t make sense. You will want to keep your expectations realistic: you lose out on some of the performance and functionality advantages provided by Java, and John has the additional warnings:

NOTE: I highly recommend that you use the latest Firefox 3 beta to view the demos. Most will work in the latest WebKit Nightly and a majority will work in Opera 9.5, but all will work in Firefox 3.

Note again: A lot of these demos will peg your CPU. As I mentioned above, I’m trying to squeeze the most out of the browser, as possible - be ready for it!

That said, I’m running Firefox 2 on a modest CPU and most of the demos are actually just fine. Anyone out there who, for some reason, has been waiting for this, I’ll be curious to hear more about how you think it might be used. But for the rest of us, it proves that some of the power of Processing is in the underlying concept and syntax, not just the literal implementation — and that’s a cool thing. As for those crazy hackers out there, well, keep on hacking!

For a previous example of this kind of in-browser insanity on Create Digital Music:

Lily: Browser Beatboxes and the Rebirth of Max-Like Patching

Play the NY Times Website Like an Instrument, and Other New Lily Tricks

uDMX Review: Tiny, Open Source USB DMX Controller with MIDI Translation Software

By Jaymis

udmx5pin.png As we strive for more immersive, cohesive shows, DMX is a great tool to have in our visualist kit. Whether a full theatre lighting rig or just a couple of dimmers and a strobe in a club, the ability to plug in and take control of an existing rig means that lighting can now work with your projections, not compete with them.

One very exciting piece of gear brought to Perth last year by artificialeyes was the uDMX USB DMX controller. The uDMX is exciting in a different way to gear such as the VJX16-4 or the VMS, rather than being a new and more VJ-friendly take on existing tech, it very common concept - the DMX controller - distilled down to its tiniest, purest form, and then open-sourced for good measure.

udmx-3838.jpg

The Anyma guys have managed to fit all of the DMX control circuitry inside a regular XLR jack. This makes the uDMX about as compact as it’s possible for a DMX controller to be. As DMX uses regular 3- or 5-pin XLR jacks for cabling, you can literally grab the uDMX, some spare mic cable, an adapter or two, and then get your DMX on straight away! The uDMX-Midi Interface Software (Mac) is extremely simple, monitoring a MIDI input source and converting (scaling from 0-255 to 0-127) either Note-on or CC messages into DMX messages. These are sent through the uDMX on the same DMX channel as the MIDI message controller or note number. It also has the ability to offset messages, which gives a simple method of scanning around DMX channels to find out where lights and other gear are located without following cables or looking at jumpers. Anyma have also released a Max/MSP external (Mac, Linux and Windows), PD external, and a command line utility (Windows, Mac and Linux).

read more

Why FreeFrameGL 1.5, Open 3D Plug-in Format, Rocks Our Teenage Party World

image Bart from Resolume has posted some details of the release of FreeFrame 1.5, including OpenGL-based FreeFrameGL:

FreeFrame 1.5 Release

Here’s why it makes us smiling, happy visualists:

  • Open and wide: It’s open, and supported by multiple hosts (the creators of VJamm, Resolume, and Salvation all contributed to the 1.5 team)
  • GPU, go! It gives you GPU-powered goodness, meaning more flexibility, power, and speed for 2D and 3D effects alike
  • More pixels, more frames: It runs at higher resolutions and frame rates
  • Third Dimension: It supports 3D functions and pixel shaders for joyous new eye candy
  • Timing: A timing function allows time-dependent visual effects like particle systems and physical simulations (tasty!)
  • Developer-friendly: Sample projects (Microsoft Visual Studio, Delphi, Xcode) and source should help get coders up and running — and the coders then turn out goodness for you non-coders
  • User-friendly: If you don’t want to code, you can expect lots more awesome plug-ins for your VJ app of choice.

Join us in CDM Labs: If you’re interested in joining a special CDMotion team working on additional documentation and sample projects, give me a holler. Otherwise, stay tuned.

Pictured: one of the Resolume team’s plug-ins in development.

Anyone up for doing the Death Star?

FreeFrameGL 1.5, Hardware-Accelerated Open Plug-ins, Plus Resolume 3 Preview in Paris

Resolume at work: Miki Grahame VJing. Photo by yoz.

Those of you not on the mailing list for Resolume missed a double bombshell coming this weekend at Paris’ Vision’r VJ festival.

Big story #1: open visual plug-in standard gets hardware savvy. the official release of FreeFrameGL 1.5 will happen, hosted by Resolume’s Edwin and Bart and VJamm’s Russel. FreeFrame is already a big deal; it’s an open plug-in format for visual effects, a bit like VST for visuals, except open-source instead of chained to, ahem, Steinberg. (Music folks know why that’s annoying.) With OpenGL support in FF 1.5, FreeFrame plug-ins get hardware-accelerated visuals.

Big story #2: a new Resolume will be revealed soon. This weekend we finally get to see what’s in the future for Resolume, the cult favorite VJ app on Windows. It’s a preview, but it’s good news, and it’s a year and a half in the making according to Resolume’s makers.

I was trying to explain to someone why Resolume is still important. "But it looks toy-like, like the rest of them," they said. "But there’s all this stuff hidden, this quick access to basic techniques," I said. I do believe that. Of course, I may be even happier with what Resolume 3 brings.

Hey, happiness is mixing visuals with a Mac in one hand and a PC in the other…

We hope to have more details on Resolume 3 and FreeFrameGL 1.5 for you soon.

Anyone in Paris at Vision’r? Take photos, take video, write some quick thoughts — we’d love to hear from you!

WiiWhorld Released: Generative Visuals with Wiimote and Windows

By Jaymis

Aforementioned visual synthsizer slash exercise tool WiiWhorld has been released for public consumption.

Jeff Mission has tied together GlovePIE (for Bluetooth/Wiimote input (previously on CDMo)), Whorld, and his own secret sauce (a GlovePIE script to control Whorld).

Put them all together with a dash of virtual midi port, and you get this:

Or as Jeff describes it:

Whorld is a free, open-source, live visual synthesizer for sacred geometry. It uses math to create a seamless animation of mesmerizing psychedelic images. You can VJ with it, make unique digital artwork with it, or sit back and watch it like a screensaver. The WiiWhorld project makes it possible to control the Whorld visualizer with the Nintendo Wiimote.

WiiWhorld.

Faux Quartz Composer in Java, for Cross-Platform Nodal Visuals: Bean Machine

beanmachine

It’s still early in development (read: it often crashes), but The Bean Machine applies nodal, patch-based development to Java. The interface is mysteriously close to Quartz Composer, down to capabilities, UI, and even the 3D cube tutorial. Personally, I use Java because it can do things Quartz Composer can’t, but it’s interesting nonetheless — and raises, again, the question of why we don’t see more tools that try to meld the capabilities of code and patches.

The cool bit: nodes are Java Beans, so you really could use this to combine the best of both worlds if it matures. No download yet, but we’ll be watching … perhaps it will inspire other developers, as well.

The project is labeled “experimental”, but could be worth a look. Developer Jerry Huxtable has lots of other goodies for Java-heads on his page, including lots of 2D image processing stuff and a map editor — Processing lovers, might want to pop this into your del.icio.us.

Bean Machine @ JH Labs

JH Labs main page with lots o’ projects

Refresh: Asides

Free VJ Clips: MoRpH Releases First of Series on Archive.org -

Australian VJ MoRpH is planning to release a pack of free videos each month leading up to a European tour in August. CDMo readers may have seen some of MoRpH’s work projected on buildings in the intro to our VMS video. The first pack is now available on Archive.org (Screenshots here). (Update: Follow-up pack released).

If you’re still looking for some more free stuff, then also mentioned in the VJForums thread is VJVault, which currently contains 900 videos for download (sign up required).

WiiWhorld: Wii-Controlled Generative Visuals Make Your Partygoers Say Wiiiiii

Jeff Mission writes to say he’s been working on a new project that couples the Wii remote with generative visuals — all built in free software. Like it, but think it could go further? It’s free, so have a go (soon, at least). Jeff writes:

Chris Korda, developer of the open-source VJ softwares Whorld and FFRend, and I have been working on a project to control real-time, generative geometric visuals with the ever-popular Nintendo Wiimote. We dubbed the project WiiWhorld.

I am pleased to announce that the first proper WiiWhorld demo video is now available online:

http://youtube.com/watch?v=bw1bHVPHk_g

Swirly colors, techno, dancing, and lots of smiling faces! Anyway, I think it does a decent job of capturing people having fun playing with our little digital toy.

The video was cobbled together from about 90 minutes of party footage shot a couple months ago. We set up our rig and invited people to play around, with a minimum of instruction. It was great fun to watch people play around, figure it out, and then teach new techniques to one another.

As for the project itself, it requires a Wiimote and a bluetooth-enabled computer. All the software involved (GlovePIE, Whorld, and FFRend) is 100% free, making this (we hope) a project that others can adopt and expand in the future, at minimal cost. We hope to publish more detailed information soon, so that others can try WiiWhorld for themselves.

Please give it a look, leave comments and ratings, and pass it on!

The project is apparently brand new — and Jeff says more web content and videos and documentation and such are all coming soon.

And yes, GlovePIE, Whorld, and FFRend are all free and open-source Windows apps. (And you thought Linux had all the fun.) beatfix (aka Jeff) suggested them and got our Windows free apps round-up going:

VisualJockey Goes Freeware; Free Windows and Cross-Platform VJ - Visualist Round-Up

Anyone who wants to get us rolling on a similar Mac or Linux list, drop us a line.

Java3D, Now Open Source, with a New Name

lg3d

Project Wonderland, rendered in Java3D, which was just open sourced. Not so awesome-looking, aesthetically. (The point here is more lightweight, online collaboration and utility.) But J3D can be useful, and this announcement is another win for open Java — not to mention, between JOGL and J3D, you can make a 3D project in Java look just about however you like.

Attention, vector math fans! Wait … stop. That’s a terrible lead. Let me try again.

Open source advocates, your attention, please! Okay, slightly better.

Anyway, Java3D, the fully object-oriented Java API to 3D visuals, is now fully open source. That actually is big news to vector math coder types, because the vector math packages are now all modifiable if you like. For visualists, the news is that even the relatively sophisticated portions of Java are going fully open — including, in this case, a key 3D component for the ubiquitous taste sensation Processing I keep talking about ad infinitum.

Much as Cat Stevens became Yusuf Islam and Lesley Hornby became Twiggy, Java3D won’t be called Java3D any more. Since 3D graphics programmers excel at marketing, it’ll instead be called “3D Graphics API for the Java Platform.”

On the off chance you’re not confused yet, Java3D isn’t the only open source 3D graphics API for the … um … Java platform. JOGL, the Java binding to OpenGL, is also open source (under the BSD instead of the GPL). So, what’s the difference between JOGL and the API Formerly Known as Java3D? (Speaking of which, can we just call the latter Fred? Fred is a great name for an API.)

Earth, viewed in NASA’s WorldWind Java — powered by JOGL, both also open source. Photo: C_Zimmerman.

read more