Hand Tracking

A hand tracking program that uses machine learning to allow you to control your computer with your webcam

Installation

Step 1 Install Python Step 2 Download Zip File with Software Step 3 Install Dependancies

Execute the command below in the installation folder:

pip install -r requirements.txt
Step 4 Run the Program

Execute the command below in the installation folder:

python main.py

Gestures

There are 4 main gestures that are used in this software:

Pinching
This gesture is used for the primary action in each mode.
Grabbing
This gesture is used for the secondary action in each mode
Pointing
This gesture is used to select the mode
Thumbs Up / Down
This gesture is used to confirm / reject an input

Modes

Workflow Moving Windows / Desktops around

List of Gestures

Pinching
This gesture is used to move windows around (Win + Arrow Keys)
Grabbing
This gesture is used to move around desktops (Ctrl + Win + Arrow Keys)
Media Controlling Audio / Music

List of Gestures

Pinching Up / Down
This gesture is used to control the volume
Pinching Left / Right
This gesture is used to skip forward / back on tracks
Grabbing Up
This gesture is used to play / pause media
Grabbing Down
This gesture is used to select media
Mouse Moving the mosue around

List of Gestures

Pinching
This gesture is used to move the mouse
Pinch in place
This gesture is used to click
Meetings Controlling Meetings

List of Gestures

Pinching Right
Mute / Unmute
Pinching Left
Video On / Off
Pinching Up / Down
Raise / Lower Hand

Other Notes

WIP