Build An AI Virtual Mouse With OpenCV

August 7, 2021Artis Modus

The Assembly

In our continuing deep dive into practical real-time computer vision, we’ll show you how to code a hands-free webcam-based controller for your computer mouse using the OpenCV library on Python. This will allow you to control your computer without any physical peripheral required—Iron Man style!

In this session, we’ll first obtain our live camera feed using OpenCV and then estimate hand poses using MediaPipe Hands, an open-source framework that employs machine learning to infer 3D landmarks of the hand from single frames in real-time without any fancy hardware acceleration, working even on mobile phones. Following this, we’ll set up our simulated mouse movement in response to the poses using the AutoPy automation module.

GitHub Repo Link: https://github.com/The-Assembly/Build-An-AI-Virtual-Mouse-With-OpenCV

Prerequisites:
✅ Python (latest release: https://www.python.org/downloads/release/python-395/)
✅ PyCharm (https://www.jetbrains.com/pycharm/download/) or any other Python code editor
✅ pip install: OpenCV (https://pypi.org/project/opencv-python/), MediaPipe, AutoPy

—————————————–

To learn more about The Assembly’s workshops, visit our website, social media or email us at workshops@theassembly.ae

Our website: http://theassembly.ae
Instagram: http://instagram.com/makesmartthings
Facebook: http://fb.com/makesmartthings
Twitter: http://twitter.com/makesmartthings

Source