Hand Tracking

A hand tracking program that uses machine learning to allow you to control your computer with your webcam

Installation

Step 1

Install Python

Python Download

Step 2

Download Zip File with Software

Download Hand Tracking Software (WIP)

Step 3

Install Dependancies

Execute the command below in the installation folder:

pip install -r requirements.txt

Step 4

Run the Program

Execute the command below in the installation folder:

python main.py

Gestures

There are 4 main gestures that are used in this software:

Pinching

This gesture is used for the primary action in each mode.

Grabbing

This gesture is used for the secondary action in each mode

Pointing

This gesture is used to select the mode

Thumbs Up / Down

This gesture is used to confirm / reject an input

Modes

Workflow

Moving Windows / Desktops around

List of Gestures

Pinching

This gesture is used to move windows around (Win + Arrow Keys)

Grabbing

This gesture is used to move around desktops (Ctrl + Win + Arrow Keys)

Media

Controlling Audio / Music

List of Gestures

Pinching Up / Down

This gesture is used to control the volume

Pinching Left / Right

This gesture is used to skip forward / back on tracks

Grabbing Up

This gesture is used to play / pause media

Grabbing Down

This gesture is used to select media

Mouse

Moving the mosue around

List of Gestures

Pinching

This gesture is used to move the mouse

Pinch in place

This gesture is used to click

Meetings

Controlling Meetings

List of Gestures

Pinching Right

Mute / Unmute

Pinching Left

Video On / Off

Pinching Up / Down

Raise / Lower Hand

Other Notes

WIP