TUIO Marker Support

[flaboratorium]

As Touchscript is my prefered solution for Touch-TUIO based Unity Applications i wonder if there will be a version in the future that is able to track marker informations (id, position, angle etc.).

[valyard]

There's actually code which should support TUIO1.1 and markers. It's in separate branch: https://github.com/InteractiveLab/Touch ... re/TUIO1.1
You set up tags for objects in TUIOInput.
The problem is that I had a challenge to test it. If you can help me we can integrate it into Master branch!

[flaboratorium]

Is there actually a compiled package of this branch? i would love to help since we have several Cornerstone Multitaction Cells with Marker support available to test on. Unfortunatly i have no clue how to use the "not compiled/unpackaged" versions of Touchscript. Right now i'm trying to setup cygwin/git, managed to compile the master branch and dev branch without errors, but compiling the tuio1.1 branch gives me errors. I'm pretty sure im missing something.

[valyard]

Yeah, Multitaction cells are good.

This is the branch: https://github.com/InteractiveLab/Touch ... ee/TUIO1.1
How to build from source: https://github.com/InteractiveLab/Touch ... Contribute
Built package: https://dl.dropboxusercontent.com/u/360 ... itypackage

Import TUIO package first (this is important), import TUIO examples package, open a scene, Tap for example.
You will see additional properties on TUIO input.

Also can you please record TUIO data and send me the file?
You can read how to do so here: https://github.com/InteractiveLab/Touch ... t-42437019

[valyard]

Looking at the error you are getting you probably haven't pulled git submodules.

[flaboratorium]

Wow thanks for the quick reply. Im back in the office tomorrow. I will test the package (thanks for that!) and record you some cornerstone tuio data then.

[flaboratorium]

Back in the office, i have done some tests and recorded you the tuio output of the cell.
Device is: MT550W7 MultiTaction Cell 55″ Full HD LCD Embedded Windows 7
http://www.multitaction.com/products/displays/embedded/

The Files are here:
Touch only: http://www.flaboratorium.org/data4u/touchscript/touch-tuio.yml
Marker only: http://www.flaboratorium.org/data4u/touchscript/marker-tuio.yml

Video showing fullscreen interaction: https://www.youtube.com/watch?v=IgbMybbSfk4
[flickering of marker detection has to do with calibration of the cell, not the script]

Video showing Touch Playback: https://www.youtube.com/watch?v=VDrVUgkxas0

Video showing Marker Playback: https://www.youtube.com/watch?v=ZY16Rt5kO-M

As you can see the playback result is a bit odd, but as the script works in normal mode i think
the problem has to do with the simulated playback.

Is there already a possbibility to get the angle of the marker (can't tell from the Touch prefab).

Hope this is helpful to you.

[valyard]

Err... yeah, the last video is weird.

But from the first video I see that it indeed works. You are getting object name in tags and can do something with it now.

As for getting object's angle it should be stored in touch.Properties["Angle"]. Which I think is a bit ugly API but I haven't yet come to a good solution for this.
The other properties are: ObjectId, RotationVelocity, RotationAcceleration.

[flaboratorium]

Great news, Yes i can get the values from the touchpoints properties. There seems to be one problem though, if a marker gets rotated and is NOT moved simultaneously there is no event for updating the gui since the "moved" event just gets called when a marker updates its position. Maybe this isn't a big deal since in real world applications rotating the marker without moving it (by fault) is nearly impossible, but nevertheless it could be nice to have an event for touchpoint "updates rotation", or maybe i'm missing something?

[flaboratorium]

Nevertheless, as supposed, the missing event does not seem to be a big problem, i set up a very simple project which shows that it works very good. i think i will build a simple example (for now there is only one marker and it is not removed when the fiducial is taken off the screen) and post the result as a unity project here.

See here: https://www.youtube.com/watch?v=0uny859cd-0

So far, many thanks for helping me out and kudos for the nice Touchscript in general!