moiré (piano and organ) from defetto on Vimeo.

I expect I’m not alone in this: I use to spend time as a kid listening to long records of Beethoven and other stuff I loved, doodling endlessly in a sketchbook. I immediately found stimulation in the challenges of synesthesia: did that squiggle that was so much fun to draw while listening to a phrase really mean anything? Did the art look like chaos, or could I lose myself in the tunes the right way so that somehow I recorded what I was hearing? Later, composing scores and experimenting with graphical notation and struggling to play piano parts for Cage scores, I wondered about the same things in reverse, as a record for musicians.

So, amidst the various experimentation with visual coding tools and reactive visuals, I enjoy experiencing people’s code ideas. Even those sketches that seem to be unsuccessful or incomplete are interesting, because they show potential.

It’s terrific looking through defetto’s Vimeo stream, with lots of synesthetic ideas. It’s a digital take on my old sketchbook, only it’s instantly shared and the music plays along:

http://vimeo.com/defetto/videos

defetto, aka Pedro Mari, has lots of good stuff going. Above, a recent take on Jan Jelinek (Loop-finding-jazz-records) – Moiré (Piano and Organ). See also his photo stream on Flickr and behance portfolio. Other reflections as you’ve tried these sorts of things?

Updated: As noted in comments, the tool in question here is the superb Windows-only, free-for-non-commercial-use vvvv, a visual patching tool for multimedia and real-time visual synthesis. [CDM tag | site] I had Processing on the brain and forgot to make that clear.

If you’ve only been watching passively, have a go with vvvv. Or try Processing 1.0: the download now includes the terrific, stable, and accessible Minim audio library standard.

  • defetto

    what should i say.. thank you so much for posting this, it really makes me feel proud and happy :) tnx

    p.s. stay tuned, more is coming..

  • bjoern

    I think this was done with vvvv.

  • http://www.postlude.co.uk Jamie Bullock

    This is really beautiful. Nice find Peter.

  • apalomba

    This is interesting, but I don't really feel like
    it is a musical sketch book. It is more like a
    music visualization. Don't get me wrong, it is
    very beautiful and all, but I think of a musical
    sketch book as something that allows me to depict
    the relationship between elements of music and
    how the evolve over time. The idea of using
    3d geometry to represent aspects of the music
    does have potential.

  • Pingback: superhumanoids blog » Pedro Mari

  • Subvert

    I'm not sure you're using the word "synesthesia" correctly. It's not just that you're involved with two different senses at once, it's that your senses either have additional information, or they're sorta "mixed" with different senses. Just because you're drawing while listening to music doesn't mean that you're experiencing anything like synesthesia.