magurp244
Posts: 14
Joined: Wed Feb 06, 2019 9:25 am

Re: Move a mouse with its head

Sat Mar 18, 2023 3:13 pm

Hm, if you have a bit of cash lying around I might also suggest something like the OpenBCI + cEEGrids. Although they also have dry contact headsets available with varying channels/price ranges, can also get it a bit cheaper i you can 3D print your own frame.

ame
Posts: 7099
Joined: Sat Aug 18, 2012 1:21 am
Location: New Zealand

Re: Move a mouse with its head

Sat Mar 18, 2023 7:35 pm

How about no tracking dot? Just use a webcam to detect the user's face and track movement. Here's an example which could be extrapolated to this application:

https://hackaday.com/2023/03/12/immersi ... le-webcam/
Hmm. What can I put here?

PiGraham
Posts: 5298
Joined: Fri Jun 07, 2013 12:37 pm
Location: Waterlooville

Re: Move a mouse with its head

Sun Mar 19, 2023 9:49 am

ame wrote:
Sat Mar 18, 2023 7:35 pm
How about no tracking dot? Just use a webcam to detect the user's face and track movement. Here's an example which could be extrapolated to this application:

https://hackaday.com/2023/03/12/immersi ... le-webcam/

Apparently that wont do for foufouner :
foufouner wrote:
Thu Mar 16, 2023 10:29 am
PiGraham wrote:
Thu Mar 16, 2023 9:59 am
OpenCV could be a good option

https://pyimagesearch.com/2019/04/01/pa ... nd-opencv/
I would prefer an object rather than the face. I'll explain why: when you're in front of the computer, it will always recognize the face. Whereas when we are in front of the computer, but without the object, it will not recognize us.
Suggestions that tacking of head, eyes, marker etc) could be enabled and disabled as needed were dismissed.
I'm not sure why.
The request seems to be to make a copy of Tracker Pro. and nothing else.

foufouner
Posts: 44
Joined: Sat Mar 11, 2023 7:14 am

Re: Move a mouse with its head

Sun Mar 19, 2023 9:54 am

PiGraham wrote:
Sun Mar 19, 2023 9:49 am
The request seems to be to make a copy of Tracker Pro. and nothing else.
Exactly

ame
Posts: 7099
Joined: Sat Aug 18, 2012 1:21 am
Location: New Zealand

Re: Move a mouse with its head

Sun Mar 19, 2023 10:12 am

foufouner wrote:
Sun Mar 19, 2023 9:54 am
PiGraham wrote:
Sun Mar 19, 2023 9:49 am
The request seems to be to make a copy of Tracker Pro. and nothing else.
Exactly
Ok. Well I posted a link to a list of such projects at GitHub. But I would speculate that Tracker Pro is probably quite simple, and its fundamental operations could be described precisely and re-implemented easily.
Hmm. What can I put here?

foufouner
Posts: 44
Joined: Sat Mar 11, 2023 7:14 am

Re: Move a mouse with its head

Thu Mar 23, 2023 9:56 am

Here are the characteristics of the dots.
Which fire camera to cap

PiGraham
Posts: 5298
Joined: Fri Jun 07, 2013 12:37 pm
Location: Waterlooville

Re: Move a mouse with its head

Mon Apr 03, 2023 7:56 am

This might be interesting to some. head tracking Mouse device in glasses.
https://www.kickstarter.com/projects/gw ... escription
HiiDii lets you interact with computers, tablets, and smartphones just by blinking your eyes and moving your head.

foufouner
Posts: 44
Joined: Sat Mar 11, 2023 7:14 am

Re: Move a mouse with its head

Mon Apr 03, 2023 1:43 pm

PiGraham wrote:
Mon Apr 03, 2023 7:56 am
This might be interesting to some. head tracking Mouse device in glasses.
https://www.kickstarter.com/projects/gw ... escription
HiiDii lets you interact with computers, tablets, and smartphones just by blinking your eyes and moving your head.
I don't see the price?

User avatar
rpiMike
Posts: 2387
Joined: Fri Aug 10, 2012 12:38 pm
Location: Cumbria, UK

Re: Move a mouse with its head

Mon Apr 03, 2023 2:56 pm

Under the rewards tab.

PiGraham
Posts: 5298
Joined: Fri Jun 07, 2013 12:37 pm
Location: Waterlooville

Re: Move a mouse with its head

Mon Apr 03, 2023 3:13 pm

foufouner wrote:
Mon Apr 03, 2023 1:43 pm
PiGraham wrote:
Mon Apr 03, 2023 7:56 am
This might be interesting to some. head tracking Mouse device in glasses.
https://www.kickstarter.com/projects/gw ... escription
HiiDii lets you interact with computers, tablets, and smartphones just by blinking your eyes and moving your head.
I don't see the price?
Pledge US$ 69 or more
Super Early Bird (1 Pair - Black/White)
Get a pair of HiiDii glasses (Black/White), at 63% off the expected retail price of $189.

INCLUDES:
HiiDii Frames
2× Plano (non-corrective) Lenses

jfedor
Posts: 16
Joined: Tue Apr 17, 2012 5:30 pm

Re: Move a mouse with its head

Sun Apr 16, 2023 10:33 pm

ame wrote:
Fri Mar 17, 2023 6:08 pm
Could you post a link to such a project? Somebody must have made one.
https://blog.jfedor.org/2020/09/hat-mouse.html

User avatar
Gavinmc42
Posts: 7501
Joined: Wed Aug 28, 2013 3:31 am

Re: Move a mouse with its head

Sun Apr 16, 2023 11:00 pm

Use a Microbit as a tilt BT mouse?
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

PiGraham
Posts: 5298
Joined: Fri Jun 07, 2013 12:37 pm
Location: Waterlooville

Re: Move a mouse with its head

Mon Apr 17, 2023 8:32 am

jfedor wrote:
Sun Apr 16, 2023 10:33 pm
ame wrote:
Fri Mar 17, 2023 6:08 pm
Could you post a link to such a project? Somebody must have made one.
https://blog.jfedor.org/2020/09/hat-mouse.html
That looks good.
Uses https://www.adafruit.com/product/4516

foufouner
Posts: 44
Joined: Sat Mar 11, 2023 7:14 am

Re: Move a mouse with its head

Mon Apr 17, 2023 8:40 am

Good morning
This system could be suitable, the problem is that it is not discreet! The advantage of the pellet is that you can walk around and it doesn't take up space on your head and above all it can't be seen.

PiGraham
Posts: 5298
Joined: Fri Jun 07, 2013 12:37 pm
Location: Waterlooville

Re: Move a mouse with its head

Mon Apr 17, 2023 9:35 am

foufouner wrote:
Mon Apr 17, 2023 8:40 am
Good morning
This system could be suitable, the problem is that it is not discreet! The advantage of the pellet is that you can walk around and it doesn't take up space on your head and above all it can't be seen.
I think the opposite is true, The inertial 'air mouse' can be hidden, in a cap, headband, headphones, at the back or side of the head, etc, but the reflective dots must be visible on the front of the face.

pidd
Posts: 4641
Joined: Fri May 29, 2020 8:29 pm
Location: Wirral, UK

Re: Move a mouse with its head

Mon Apr 17, 2023 4:43 pm

Pi3A+ are appearing regularly now and to a slightly lesser degree so are Pi Zero W

User avatar
Gavinmc42
Posts: 7501
Joined: Wed Aug 28, 2013 3:31 am

Re: Move a mouse with its head

Mon Apr 17, 2023 10:12 pm

but the reflective dots must be visible on the front of the face.
QR code in the middle of your forehead?
Retro reflectors on ear pods, everyone wears those now.
Build tilt BT sensor into headphones, not as many wear those but it is a noticeable % of the population now.
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

foufouner
Posts: 44
Joined: Sat Mar 11, 2023 7:14 am

Re: Move a mouse with its head

Tue Apr 18, 2023 8:20 am

PiGraham wrote:
Mon Apr 17, 2023 9:35 am

I think the opposite is true, The inertial 'air mouse' can be hidden, in a cap, headband, headphones, at the back or side of the head, etc, but the reflective dots must be visible on the front of the face.
I will prove to you that yes. Look at the image below, this is the current system I have. If you look closely, the reflective pad is placed on a plastic tip which is connected to a pipe for a breath switch. When I arrive in front of my computer, I just have to position the pipe in the mouth. When I want to stop doing computer work, I just have to drop the pipe from my mouth. I have no equipment on my face or on my head. You understand why I'm looking for something with a reflective pad because it doesn't take up space and is very practical to use
Image

ame
Posts: 7099
Joined: Sat Aug 18, 2012 1:21 am
Location: New Zealand

Re: Move a mouse with its head

Tue Apr 18, 2023 8:37 am

Excellent photo. And makes sense when put together with your first post.

In some ways I am disappointed that this is the best we can do to help people use computers. On the other hand, if this system works well for you I can understand why you want to replicate it, so that you can carry on uninterrupted if the current system should fail.

So, we should probably re-visit the content of this thread with this new, and clearer, information.
Hmm. What can I put here?

foufouner
Posts: 44
Joined: Sat Mar 11, 2023 7:14 am

Re: Move a mouse with its head

Tue Apr 18, 2023 8:44 am

ame wrote:
Tue Apr 18, 2023 8:37 am
. On the other hand, if this system works well for you I can understand why you want to replicate it, so that you can carry on uninterrupted if the current system should fail.
If I try to reproduce it, it is because unfortunately it is no longer developed. And what I'm afraid of is breaking down with it and ending up without emergency equipment. So I'm looking to provide something that in case of failure I can continue to make the computer.

User avatar
Gavinmc42
Posts: 7501
Joined: Wed Aug 28, 2013 3:31 am

Re: Move a mouse with its head

Wed Apr 19, 2023 2:20 am

Understand more now, replacement for existing unit.
Same operation.
USB PID/VID issues could cause problems.
The Pico now had VID/PID numbers for HID.

Found a few sensors that should work and low price.
These are from my local supplier but available worldwide through other suppliers.
https://core-electronics.com.au/vga-ov7 ... 0x480.html
https://core-electronics.com.au/usb-cam ... vidia.html
https://core-electronics.com.au/pimoron ... akout.html

Retro reflectors do need those IR leds around the camera.
A visible light filter, unexposed but developed 35mm film makes IR filter?

The optical flow sensor has white LEDs on it, replace those with IR leds?

Yikes , that is a ridiculous price for a fancy mouse.
What can be adapted off the shelf?
IR webcam? That already has IR LEDs and filter.
Or ordinary USB webcam with added IR LEDs,, remove the IR filter.

The hardware would be cheap, the driver then becomes the problem.
Are there any open source versions?
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

foufouner
Posts: 44
Joined: Sat Mar 11, 2023 7:14 am

Re: Move a mouse with its head

Wed Apr 19, 2023 7:18 am

Afterwards, if we can replace the reflective pad with something colored, that doesn't bother me! What is needed is that the thing that will move the mouse fits easily like my pad. Also, I need to be able to get the mouse to work when I'm in the dark, hence the need for an infrared system.

User avatar
Gavinmc42
Posts: 7501
Joined: Wed Aug 28, 2013 3:31 am

Re: Move a mouse with its head

Wed Apr 19, 2023 8:01 am

A retro reflective dot, IR LEDs and IR bandpass filter on the camera should drop the vision processing requirements right down.
That lowers the cost of hardware and simplifies the software a lot.

They still make Wii remotes?
They had IR tracking.

There is a black acrylic that block visible light and passes IR light, might be useful.

A Pi with Noir camera and lots of dots on a body suit could make for a motion capture system.
A network of them for 3D capture, total overkill for your application.

I have used Arduinos for USB keyboards, have not tried mouse.
If a PicoW was used that would be Bluetooth mouse, handy for Smartphone/tablets and PC's?
https://github.com/raspberrypi/pico-exa ... -bluetooth

What are these guys using?
https://github.com/opentrack/opentrack

Been thinking about Retro reflective tape system for years, for indoor robot position triangulation.
Thinking it might work outside with a IR laser diode scanner that look for vertical stripes of tape, robot lawnmower etc.

Do you use Windows or Linux?
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

foufouner
Posts: 44
Joined: Sat Mar 11, 2023 7:14 am

Re: Move a mouse with its head

Wed Apr 19, 2023 8:05 am

I'm on macOS 13.3 but the system should also work on Android. If in addition it would work on Windows, that would be the best
Gavinmc42 wrote:
Wed Apr 19, 2023 8:01 am
What are these guys using?
https://github.com/opentrack/opentrack
I've heard of open track before, but never got them to work on macOS. Do you have any idea how it works?

I had also found this system which could correspond to my needs. Only, I tried to install it, but the python version being so old that I could not put it to work on my Python 3.9.6 version

ame
Posts: 7099
Joined: Sat Aug 18, 2012 1:21 am
Location: New Zealand

Re: Move a mouse with its head

Wed Apr 19, 2023 8:33 am

I clicked on the video in your link, and YouTube offered me several related videos, including this one:
https://m.youtube.com/watch?v=XkB6UPRTel0
The description says "Starting with macOS Catalina 10.15.4 you can use Accessibility to control your cursor with your head, and even click and drag with facial expressions. Even if you don't need this functionality, it can be useful as a temporary way to control your Mac is some situations, or just a way to give your hands a rest."

Would that work? Sorry if you've been round this loop before.
Hmm. What can I put here?

Return to “Assistive technology and accessibility”