MSA Remote + VDMX + Ableton Live from Memo Akten on Vimeo.
MSA Remote is a remote control application for iPhone & iPod Touch that sends OSC messages over the wifi network. This allows you to control any OSC supporting applications such as Max/MSP/Jitter, PureData, Reaktor, VDMX, vvvv, Resolume, Quartz Composer etc.
In this video, OSCulator is routing the OSC (& TUIO) messages coming from MSA Remote to midi and forwarding to Ableton Live and VDMX simultaneously. Nothing is done in post, the same signal is controlling both audio and video.
At the beginning of the video you can see the polyphonic velocity sensitive keys in action (yes, the harder you hit the keys, the louder the sound - works equally well when the iphone is laid on a table), and later on the faders, triggers and multitouch tuio-pad.
You can see MSA Remote controlling a Java fluid simulation at vimeo.com/3975324
There is a slight lag in the video feed so apologies for that.
Should be in the app store soon.
memo.tv/msaremote_for_iphone
Blog post about this video at
memo.tv/msa_remote_rejected_again_velocity_sensitive_pads_on_iphone_and_patents
P.S. you can download the original video at the bottom if you wanna read the effects in VDMX or Live.