Leap motion & spatialisation

[gwennaelle]

Hello
I'd like to control spatialisation with LeapMotion.
Do you know if it is possible in Usine ? Should rec and process finger movement in Midi signal? ...How?
if you have an idea, thank you !
Gw.

[sephult]

Yes you can use the leap motion to track fingers and control midi.
There are some examples in the Factory Library, also once you start digging in let me know and Ill see if I can help.

I did a few patches with Left/Right recognition of hand I can dig up.

-s

[gwennaelle]

Thanks to reply Sephult,
but... I don't find the Factory Library (...), let alone the examples...
Could you write me the path?
Thx again

[sephult]

browser -Usine Library -Leap

There are like 9 leap motion examples, some like the Piano, Theramin, Shots, and Wind possibly can or are already midi capable.

-s

[gwennaelle]

Ok, I didn't understand.
So I open the patch of Leap Drone.
Which patch to transpose the movement in midi?
Should I create midi links from fingers pos x,y,z? or from Array CombineX3?
Could you explain me how to do? or would it be possible to show me your patch?
Thx

[sephult]

Leap Two Hand


Try this, had modified so that leap would recognize the left and right hand individually.
The matrix controls which midi parameter to output for the X or Y, LX/LY being the left hand etc...
M1C1 = Midi left code 1 output, M1C2 = Midi left code 2 output and so forth.

Once a hand is recognized it should automatically record the movements, the top left handles quantizing or recording parameters.

-s

[gwennaelle]

Thank you Sephult.

I still have questions, I don't understand how your patch is working.
When I move my hands, the balls move but I don't hear the movement of the sound in the space.
I add a sampler and a surround 4 out, but don't hear the effect of the patch.
By spatialisation, I ment: if I move my hand, I displace the sound like in a surround, and this, with the leap motion not with the mouse.
Is your patch complet or should I connect in the patch Audio Outputs from Matrix? Or from something else?

Why should I rec mouvement? Is it necessary if I'd like use the leap in live? like in the other cases, "one movement => on effect". Or perhaps the record in the leap case has different meaning than in audio case?

[sephult]

This previous was based on MIDI Controller and recording the left and right fingers. At least a way to show you how to extract arrays.

This new patch is a basic for surround:

Leap Surround

You can take the hand outputs, all of these leap outputs are based on arrays, I just extracted the 3D array to an XY and fed into the Surround Panner.
I do not have a surround setup so I had never applied to this.

-s