Here is an attempt to make the thing follow my eyes and also detect in which direction i look.
To understand what is happening in the video, the circles appearing are here to materialize a region of interest the code detected. Inside of the circle you will see a segment starting from center and showing the heading of the move that happens.
After filtering i'm pretty sure that i can get it simplified and be usable as a mouse cursor, still have work with it but it's fun :)
Please note that the purpose of this video is not to be nice to watch, if i can do what i plan to do, the video shown actually won't even be visible. Actually it is just to show a feedback of what is happening inside the computer.