A computer vision project that enables users to control their computer using hand gestures detected through a webcam. The system uses MediaPipe for hand tracking and OpenCV for real-time video processing. Different gestures trigger different system actions such as opening applications, minimizing windows, or locking the screen.
- Real-time hand detection using MediaPipe
- Finger counting based on hand landmark coordinates
- Gesture-based computer control
- Webcam-based real-time interaction
- Automation of system commands using PyAutoGUI
- The webcam captures live video frames.
- Frames are processed using OpenCV.
- MediaPipe detects hand landmarks in the frame.
- The program analyzes finger positions to determine how many fingers are raised.
- Each finger count corresponds to a predefined system action.
| Finger Count | Action |
|---|---|
| 1 | Show Desktop |
| 2 | Open Google Chrome |
| 3 | Open Notepad |
| 4 | Lock Screen |
| 5 | Open Task Manager |
- Python
- OpenCV
- MediaPipe
- PyAutoGUI
Clone the repository:
git clone https://github.com/yourusername/hand-gesture-controller.git
cd hand-gesture-controllerInstall the required dependencies:
pip install opencv-python mediapipe pyautoguiRun the Python script:
python main.pyPress Q to exit the application.
- Add custom gesture recognition (thumbs up, peace sign, etc.)
- Implement gesture smoothing to avoid repeated triggers
- Add a graphical interface to display detected gestures
- Integrate volume and media control
- Support for multiple gesture commands
- Touchless computer control
- Accessibility tools for hands-free interaction
- Gesture-based human-computer interaction systems
- Smart home automation
Your Name GitHub: https://github.com/joy-programs LinkedIn: https://linkedin.com/in/joy-kh