Musicians have thousands of years of history when it comes to interfaces and instruments, but visuals are relatively new. Little wonder, then, that visualists are eager to try new interfaces to help make visuals akin to performance instruments. Or, in less lofty terms, let’s get Wii remote wagging in the club tonight.

Over on createdigitalmusic.com, we’re celebrating Game Day — basically, I’m squeezing as many game-related posts into 24 hours, because a whole bunch of tips came in at once. A couple of Wii-related controller solutions jumped out.

Wii + Flash

Getting hardware control in Adobe Flash requires some work: basically, you need a client-server model. The good news is, there are already two Wii-specific solutions out there.

MoteDaemon, Mac OS X
WiiFlash.org, Windows Blog, Download, Google Code

Pretty soon, people are cooking up Minority Report demos with Flash (using Papervision for 2.5D-style 3D in Flash’s 2D world, and Open Dynamics Engine for physics):

I’d loved to see this coupled with something like Onyx for an all-Wii, all-Flash performance app. With Flex and AIR (Adobe Integrated Runtime), this could be the basis for some really hard-core, full-blown apps … though you will be limited by Flash’s slower performance, at least in comparison to C/C++-based tools like Max or even Java.

Looks like Linux users are presently out of luck, unless I’m missing something (feel free to chime in if you know a cross-platform alternative).

Wii + MIDI, OpenSoundControl (OSC)

For a more app-agnostic solution, you can hook up a Wii to send MIDI or, ideally, OpenSoundControl (OSC) to apps that support it (vvvv, Max, Pd, and hopefully VJ apps soon — I’ve heard a couple of developers working on it).

On Mac, you can send both OSC and MIDI with one app, perfectly-suited to taking data from the Wii controller:
OSCulator. OSCulator is a great tool for the Wii, but it also shows promise of what a hardware input hub could generally look like, with open-ended inputs controlling visuals and sound rather than pre-defined, MIDI-style keyboards and knob and faderboxes as have traditionally been used in music.

On PC, GlovePIE is an awesomely-powerful scripting tool for use with Wii and other game devices. I’ve talked about it endlessly before, but I’ll stay quiet — just go. Get it. Enjoy. In fact, with OSCulator on Mac and GlovePIE on Windows, it’s hard not to be insanely happy on either platform.

Another interesting out-of-the-box alternative, though, is the new Wiinstrument. It’s largely geared for playing back drum samples, but it’s not hard to take that metaphor and use those control changes and other MIDI messages as visual controls — especially if you think of your “drum kit” as sets of visual clips (video or other visuals).

Wiinstrument on createdigitalmusic.com

If you’re using a Wii on Windows, VJ Kung Fu has posted a full walkthrough:
Wii to MIDI Windows Walkthrough

And here’s an example on Vimeo of using the Wii with Processing: (I’m sure there are others)
Wii + Processing

Much of the focus for the Wii controller has been on the music and VJ side, but they’re equally compelling as live visual controllers. Our friends at the uber-hip French visualist blog antivj have translated their slick Wii-to-MIDI tutorial into English, and added a video using Arkaos:

Wiimote to MIDI [Tutorial, antivj]

The instructions are PC-based; if you’re on the Mac, you’ll want to use wiitomidi. With Max/MSP/Jitter on Mac, try the superb aka.wiiremote external. I’d also really like to see an OpenSoundControl (OSC) application, which would be ideal for Flash and Processing. (Any ideas, anyone, on the best way to implement this? It’d be great if the core of the implementation could be cross-platform; you still need to do platform-specific stuff to talk to Bluetooth, as near as I can figure.)

What should be immediately apparent from the video, as well, is that there are many different ways of using the Wii remote in a visual patch. Here, scratching is linked to tilt; in a project I built, I used acceleration instead, with very different results. And a lot of what the results look like will depend on your visual style; I could see some great applications using interactive Processing animations, etc.

Jaymis has been working on using the Wii with Resolume on Windows; we should hear from him soon. I’ve been working with Jitter and VDMX on the Mac. And soon we should have Processing (here) and Reaktor (on cdmusic), as well.

Thanks for the great tutorial, antivj!

Light Emitting Textiles is a technological theme which keeps reappearing year after year. In fact, a year ago for the Internationale Funkaustellung (IFA) Phillips announced their Photonic Textile Prototypes - rather blocky but undeniably cool flexible LED arrays.

For this year’s IFA, Phillips have upped the ante with: better resolution? Cliched example loops? Come on people, an @ symbol hasn’t meant “super cutting edge technological stuff” for at least eight years now. This is just showing that you’re as out of touch with the cool kids as the corporations who will pay to use this for their marketing.

Motion design weakness aside: I think this would go beautifully with something like the Remote VJs Control, which is way too limited for serious VJ action, but probably just daft enough to work with a fabric-embedded display.

via Processing Blogs

You wear it on your shoulder, but it’s not a guitar. It’s a US$425 MIDI controller, powered by SONAR and photocell sensors for Theremin-like control in the air. It could be none other than the latest creation from instrument builder Tony Amendolare, aka ElectroKraft.

You might have seen this instrument in November (see post and discussion on Music thing from when I was on vacation), but since then Tony has posted some video files. (Still more discussion: GetLoFi) It’s a lot easier to follow how the thing works in the video, and as for the spacey lab coats and welder’s masks, well, costumes just help add atmosphere:

Performance demonstrations by Dr. Modulus [QuickTime videos]

Audio sample [MP3]

The sound file is particularly stunning: the genius of the instrument is that it sends cascades of synth notes and percussion, either triggered as discrete events by tapping the, erm, globe, or as continuous series of notes by moving your hand through the air relative to the SONAR sensor. [Read the full description]

It’s a great demonstration of how changing the interface is more than just a gimmick: it can change the way your music sounds. You might be able to play something like this on a keyboard or MIDI guitar, but you’d be limited in live control and it would require a lot of trickery. And, of course, this model sends MIDI — so it’d be a blast to hook up to Logic’s Sculpture, Max/MSP, or Reaktor (among others). As usual, more is coming: Tony promises a model with rhythmic sequencing features.

Previously:

ElectroKraft Lunar Module: Spacey Handmade “Optical Theremin” Photocell Controller

Space Invaders Invades Synth, Guitar
Space Box: Theremin + Effects Box
Axe*Synth Theremin Guitar