[Haskell-cafe] xmonad: eyes based navigation between monitors.

[Tikhon Jelvis]

I've thought about this myself, although not seriously. At one point, I
even considered buying a monitor with eye-tracking built in :).

There's a commercial eye-tracking product from Tobii aimed at gamers, and
my instinct is that starting from a purpose-built eye-tracker would work
much better than using a webcam or Kinect. However, it seems the Tobii
product is fundamentally limited to one monitor at a time and only has
unofficial Linux support.

If you do make something work, I'd love to hear about it.

On Fri, Nov 20, 2020, 12:24 Ivan Perez <ivanperezdominguez at gmail.com> wrote:

> Hi all
>
> In case it's useful, the following two projects I built a few years ago
> might help:
>
> Kinect control for the game Haskanoid:
>
>
> https://github.com/ivanperez-keera/haskanoid/blob/develop/src/Input.hs#L237-L280
>
> Webcam-based face position/distance detection module for a posture monitor:
>
>
> https://github.com/keera-studios/keera-posture/blob/develop/src/AI/CV/PostureProcessors.hs#L40
>
> Either method could achieve something like what you want. I'd recommend
> playing with having the kinect/webcam in different positions (not just
> between the monitors, and potentially even slightly to the right of the
> rightmost monitor, or to the left of the leftmost one).
>
> I never managed to make eye detection work on Kinect. I heard the very
> latest version of the kinect (under development in 2017) was able to detect
> eye movement well, but never tried it myself. It would have been a cool
> accessibility feature for haskanoid.
>
> All the best,
>
> Ivan
>
> On Fri, 20 Nov 2020 at 14:10, John Z. <johnz at pleasantnightmare.com> wrote:
>
>> Don't have a ready solution, but this is such an interesting idea since I
>> have same setup. I might try a toy weekend project using a random kinect
>> I have lying around.
>>
>>
>> > Hello,
>> >
>> > I'm using xmonad in a setup with 3 monitors and I'm curious if anybody
>> > here got kind of eyes-based navigation working between
>> monitors/workspaces.
>> >
>> > Explanation: I need to type into windows on different monitors but in
>> > not specific order. Sometime I got too deep into thinking that I forget
>> > to switch workspace and then I type to different window in different
>> > workspace than is intended (and which I see with eyes). Basically I'd
>> > like some mode where xmonad will switch workspaces based on my eye/head
>> > position so only workspace I follow with eyes will be active.
>> >
>> > I see that such software (following head/eyes) already exist in AI
>> > domain (E.g. NV's xavier NX developer kit demo: from 16:00:
>> > https://www.youtube.com/watch?v=aUz1bNGm04w) but I'm more interested in
>> > amd64/linux setup as this is for my workstation...
>> >
>> > Any idea highly appreciated!
>> >
>> > Thanks!
>> > Karel
>> > _______________________________________________
>> > Haskell-Cafe mailing list
>> > To (un)subscribe, modify options or view archives go to:
>> > http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe
>> > Only members subscribed via the mailman list are allowed to post.
>>
>> --
>> John Z.
>> "Its too bad she won't live... but then again, who does?"
>> _______________________________________________
>> Haskell-Cafe mailing list
>> To (un)subscribe, modify options or view archives go to:
>> http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe
>> Only members subscribed via the mailman list are allowed to post.
>
> _______________________________________________
> Haskell-Cafe mailing list
> To (un)subscribe, modify options or view archives go to:
> http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe
> Only members subscribed via the mailman list are allowed to post.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.haskell.org/pipermail/haskell-cafe/attachments/20201120/9c5e8753/attachment.html>