[Haskell-cafe] xmonad: eyes based navigation between monitors.

[Ivan Perez]

Hi all

In case it's useful, the following two projects I built a few years ago
might help:

Kinect control for the game Haskanoid:

https://github.com/ivanperez-keera/haskanoid/blob/develop/src/Input.hs#L237-L280

Webcam-based face position/distance detection module for a posture monitor:

https://github.com/keera-studios/keera-posture/blob/develop/src/AI/CV/PostureProcessors.hs#L40

Either method could achieve something like what you want. I'd recommend
playing with having the kinect/webcam in different positions (not just
between the monitors, and potentially even slightly to the right of the
rightmost monitor, or to the left of the leftmost one).

I never managed to make eye detection work on Kinect. I heard the very
latest version of the kinect (under development in 2017) was able to detect
eye movement well, but never tried it myself. It would have been a cool
accessibility feature for haskanoid.

All the best,

Ivan

On Fri, 20 Nov 2020 at 14:10, John Z. <johnz at pleasantnightmare.com> wrote:

> Don't have a ready solution, but this is such an interesting idea since I
> have same setup. I might try a toy weekend project using a random kinect
> I have lying around.
>
>
> > Hello,
> >
> > I'm using xmonad in a setup with 3 monitors and I'm curious if anybody
> > here got kind of eyes-based navigation working between
> monitors/workspaces.
> >
> > Explanation: I need to type into windows on different monitors but in
> > not specific order. Sometime I got too deep into thinking that I forget
> > to switch workspace and then I type to different window in different
> > workspace than is intended (and which I see with eyes). Basically I'd
> > like some mode where xmonad will switch workspaces based on my eye/head
> > position so only workspace I follow with eyes will be active.
> >
> > I see that such software (following head/eyes) already exist in AI
> > domain (E.g. NV's xavier NX developer kit demo: from 16:00:
> > https://www.youtube.com/watch?v=aUz1bNGm04w) but I'm more interested in
> > amd64/linux setup as this is for my workstation...
> >
> > Any idea highly appreciated!
> >
> > Thanks!
> > Karel
> > _______________________________________________
> > Haskell-Cafe mailing list
> > To (un)subscribe, modify options or view archives go to:
> > http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe
> > Only members subscribed via the mailman list are allowed to post.
>
> --
> John Z.
> "Its too bad she won't live... but then again, who does?"
> _______________________________________________
> Haskell-Cafe mailing list
> To (un)subscribe, modify options or view archives go to:
> http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe
> Only members subscribed via the mailman list are allowed to post.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.haskell.org/pipermail/haskell-cafe/attachments/20201120/1c58cd5e/attachment.html>