Welcome to %s forums

BrainModular Users Forum

Login Register

control windows items?

Tell us what you'd like Usine to do
Post Reply
23fx23
Member
Posts: 2545
Contact:

Unread post by 23fx23 » 08 Feb 2010, 22:25

forget if too complex,
but just i remember using "glove pie", a nice tool to control any in to any out, ie a joystick controls the mouse, a midi key trig a key ect,
but boring (for me) it was script only. It would be so friendly and powerfull with a patch approach like usine.

I imagine it can create lot's of problems, but controlling the mouse or windows keyboard might have interesting applications..
and what i m especially more after is accessing the multitouch data to drive wiimote ir leds to multitouch W7 data, or maybe in other way make usine be able to "cach those infos" as if was mouse input.

just a though, if possible in some 'not too hard' way...

maybe you already saw it, but i would so enjoy controlling usine with 4 ir leds and experiment multitouch for quasi free"..
usine with wiimote as touchscreen, single touch test:
http://www.youtube.com/watch?v=uPWKYfTAM7s

User avatar
senso
Site Admin
Posts: 4424
Location: France
Contact:

Unread post by senso » 09 Feb 2010, 09:21

In the V5 I've started to implement windows messages management.
Like in the following module:
http://www.sensomusic.com/wiki/doku.php ... _mouse_msg

But it's a long way... especially for multi-touch messages which require memory allocation.
They are so many possibilities!
The easiest solution should be to create a SendMessage procedure in scripts, but you don't like scripts.

23fx23
Member
Posts: 2545
Contact:

Unread post by 23fx23 » 09 Feb 2010, 10:52

If it will be doable any sort in future with script, i'll for sure will love scripts!, cool.
in fact i like scripts, i would just like ideally to avoid to use sereveral apps/conversion layerz, but for sure script is a handy way for that..

woa very cool that mouse_msg!, it's a very appreciated good news for me!!
windows messages management is a very cool idea, not only for that, great!

relating multitouch,
by waiting i should have find tools therorically allowing this,
a wiimote to tuio tool (from jonny lee), tuio to W7 with an hybrid driver.
http://multitouchvista.codeplex.com/
I ll test and report. anyway Im on xp actually, need to go to W7 or buy a new laptop...

what i find wrong with any wii related tool, is that it's clicking then ir is on, make we cannot move, check the cursor /clic separately, cause as long ir is on, mousedown is on.
if we ave such indedendant control of XY and mousedown via usine script, we could track continuously, and be able to free move, then clic with a second input . it already brings me tons of ideas.. I wonder if W7 is able to receive dots xy infos sepatate from Z (mouse down)info, seems yes for a single mouse, but for multipoints, do you know?

..so +1 for script implementation!!! but take your time ! very excited by those news :)

Pipotron3000
New member
Posts: 5
Contact:

Unread post by Pipotron3000 » 16 Dec 2010, 16:14

Hi guys !

About using wiimote and multitouch windows 7, there is an amazing app to get TUIO and native windows 7 multi :
WiiTUIO

Original post

As you can see, i already made some advertisement for Usine :lol:

User avatar
nay-seven
Site Admin
Posts: 5684
Location: rennes France
Contact:

Unread post by nay-seven » 16 Dec 2010, 16:37

Thanks for advertisement pipotron3000 and welcome !
what about hardware used..?

23fx23
Member
Posts: 2545
Contact:

Unread post by 23fx23 » 16 Dec 2010, 17:52

awesome!!

this is exactly what i was waiting for a while. cool, gonna get back into wiimotes ;) thanks pipotron

Nay: hardware seems just some custom made IRpens. basically open a pen, put some batteries and a swich powering
the IR led, we can make some for very low cost, but gonna buy same ringz as joffo i think.

also a big advantage of wiimote is it can performs in the air too, not necessary touching the screen.

User avatar
nay-seven
Site Admin
Posts: 5684
Location: rennes France
Contact:

Unread post by nay-seven » 16 Dec 2010, 18:01

yes 23fx23, i was more talking of the video inside the post , projection is on the table so he use a video projector over the table..?and where is the wii...

23fx23
Member
Posts: 2545
Contact:

Unread post by 23fx23 » 16 Dec 2010, 18:43

oh yeah sorry, yup i think it's projected from top, so i guess the wiimote is just above or aside the projector, pointing in same direction, this is what would get the best tracking results.

Pipotron3000
New member
Posts: 5
Contact:

Unread post by Pipotron3000 » 16 Dec 2010, 19:20

I think the same about position ;)

It's time to go back to my mono IR LED glove , with multiple LEDs now ;)
The only trouble i got is to trigger LEDs individually...

I'm thinking about an individual micro switch on each finger, covered with soft pad, so i can press and move my finger on my laptop screen.
The LEDs will be near my nails, so they don't touch the screen but only reflect on it.
May be i will move them on a side.
And battery holder is on my wrist :P

I will try this soon, once i bought additional LEDs and glove.

I'm already planning to install Windows 7 on my laptop :D

23fx23
Member
Posts: 2545
Contact:

Unread post by 23fx23 » 16 Dec 2010, 19:53

cool, let us know your tweaks, im gonna study some system too, but it will be quite similar i think :),
the trigger question is the most important, indeed find something to make it 'soft' would be nice...

Pipotron3000
New member
Posts: 5
Contact:

Unread post by Pipotron3000 » 17 Dec 2010, 01:13

I just thought about something : put the switches INSIDE the glove fingers, so the contact surface would be the glove fabric itself ;)
I will tell you if it work :D

I use this kind of micro switches :
Image

They are cheap, sensitive and easy to find anywhere (i un soldered mines ;) )

waolelaid
Member
Posts: 339
Location: Ecouen 95
Contact:

Unread post by waolelaid » 17 Dec 2010, 18:18

Hi all great technicians i've several questions about wiimote IR detection
apparently if i well understand wiituio is kind of driver for the recognition of
multitouch in win 7
23fx says "what i find wrong with any wii related tool, is that it's clicking then ir is on, make we cannot move, check the cursor /clic separately, cause as long ir is on, mousedown is on.
if we ave such indedendant control of XY and mousedown via usine script, we could track continuously, and be able to free move, then clic with a second input . it already brings me tons of ideas.. I wonder if W7 is able to receive dots xy infos sepatate from Z (mouse down)info, seems yes for a single mouse, but for multipoints, do you know? "
So wiituio makes what you were wondering ? tell me if i'm wrong i'd like to understand
another thing i don't know is what is " glove pie " if some one has a link where i could find a description on it
it's welcome after i think i will try make or buy one and modify it as pipotron3000 wants to do
i ain't electronic engineer but i already made some electric assembly it changes of plumbing :lol:
if you have time to answer
thanx :D
Avant l'effet on croit à d'autres causes qu'après
Friedrich Nietzsche

Pipotron3000
New member
Posts: 5
Contact:

Unread post by Pipotron3000 » 17 Dec 2010, 19:21

"Glove pie" is a MIDI software converting diverse inputs (wiimote, joystick...) into MIDI only

We were speaking about an infra red glove that send infra red to the wiimote.
This is not related to Glove Pie, but to WiiTUIO only ;)

This is an example of IR glove:
Infra red glove

And this is a video of our servitor 23fx23 with IR glove and Usine ;)
Usine with IR glove

Some ppl reported using double click as action : when you click once and hold, you just track pointer, and when you double click and hold, you keep mouse down.
Of course, if you just double click and release, you get an action...but with this method, you spend your time double clicking :lol: and this is only for mouse, as far as i know. And not very cool with fingers on a laptop screen :lol:

As i understand W7, it can use "mouse down" like info, but the wiimote only track points. May be WiiTUIO could track distance (Z value of the point) and assign it to "mouse down", but for now, only XY are tracked.

23fx23
Member
Posts: 2545
Contact:

Unread post by 23fx23 » 17 Dec 2010, 20:59

hi mates, pipotron you seem well on the way :cool:

note that glovepie don't only handle midi as output, it can ie convert a wiimote move to windows native mouse move,
wich was my first wiimote tests before i discovered usine.(that's why i originally was suggesting this as an usine possible add, for usine to have a control over mouse or keyboard as outputs too).
In fact every device plugged in glovePie can be used as input, but also as output.
you can convert a keyboard keystroke to a joypad keystroke to be used in a game or vice versa.
convert a press on wiimote to a keystroke shortcut to control a media player like winamp, vlc, or stuff like that
from your bed using a wiimote. the wiimote virtually acting as a universal remote for any soft that accept keyboard shortcuts.
However glovePie is a script only environment, so not very user friendly. I don't advice you to dive into walolelaid,
but if you want to check it (it's free), you can find it overthere:
http://glovepie.org/glovepie.php

cause pipotron is right, you don't need glovepie now, as WiiTuio should directly provide the conversion layer to make
wiimote act as a native W7 mouse, like Wiimote whiteboard, but difference is it is working also with multiple leds.
to make the mouse move, the led has to be on, but the pb is that when you light it on, wiimote whiteboard was considering
that as if you cliqued on the mouse, and keep holding as long as the led is on. So it's still very usable, but you can't see
your mouse move without clicqing. Mind ya in most touch screen cases you don't care, cause you just point your finger
where you wanna click and light on the led. so if you want first to test that in a very simple way, just build a IR led you can swich
on, and install wiimote whiteboard wich is very simple to use and setup if you are on a 32bits Os.
http://johnnylee.net/projects/wii/Wiimo ... ardv03.zip

so another solution to this move pb, as pipotron suggest, is to make a simple hold to move the mouse, and a double click to get a real mouse down and drag. But this was unfortunately impossible to get with wiimote whiteboard. (neither multitouch)
So i first thought that if usine could handle mouse moves, we could easy patch or script such beaviour directly in usine.

@pipotron
Wiimote can get a rough Z estimation, provided by the Led Size variable, but it's not very accurate, going from 1 to 5.
I was thinking of using two wiimotes, one tracking XY pointing at the screen, and one located 90° on the left or right to
track precise Z, so if this one detect the points are getting close to the screen, they woul enable the 'mouse down',
that would avoid the double clic thing, but not sure it will be easy to make the correlations between multiples points...
that would also make a real 3D instrument, but maybe kinnekt will make this easier.. still im convinced IR tracking
returns faster low latency.

edit: mmm maybe we could use 2leds: a smaller led low powered constantly running, and a bigger one that would be feed by
higher voltage when cliquing, so the wiimote could get a noticeable size variation used to trig the mouse down...

so I have not tested wiituio yet, as i fail to connect my bluetooth wiimote now on my setup :/ but maybe it allow such feature, but i think pipotron will be faster to build his glove and report than me ;)

sorry for way to long post :lol:

Pipotron3000
New member
Posts: 5
Contact:

Unread post by Pipotron3000 » 17 Dec 2010, 23:00

Thanks about Glove pie description (i missed all possibilities) ;)

About Bluetooth / wiimote, i bought a mini dongle with a Broadcom chip inside.
And it use the internal windows bluetooth software : plugged, installed, working.

No BLue soleil, because it seems to worsen things :D

Most troubles seems due to non genuine wiimote and bad bluetooth chip on computer.And may be Blue soleil, because when you don't use Broadcom chip, you're obliged to install it ;)

waolelaid
Member
Posts: 339
Location: Ecouen 95
Contact:

Unread post by waolelaid » 18 Dec 2010, 05:16

Hello Usiners thanx to both of you for the explanations
I know now what is glovepie and you're right i don't need it
in fact i'm more interested by the multi IR touch but as you told me
it's better for me to begin with only one IR ( i've bought a wiimote and a bluetooth dongle )
i also have a hold CRT screen to try less fragile and after seeing the video i can build an IRglove
i don't remember what was installed with the blue tooth dongle but it is not "Blue soleil"
and i didn't try the wiimote i bought it yesterday so i'll see that next week
and i let you build the most difficult i've not enought knowledge in computing
wish you a good day for me here's comes the night :lol:
thanx once again
Avant l'effet on croit à d'autres causes qu'après
Friedrich Nietzsche

23fx23
Member
Posts: 2545
Contact:

Unread post by 23fx23 » 18 Dec 2010, 19:56

pipotron , yup i think im gonna buy a broadcom dongle, i quick tested with a cheap one that came with my phone
i guess pb come from here. thanx for info

cool waolelaid, let'us know.

Post Reply

Who is online

Users browsing this forum: No registered users and 65 guests