The Assembly
In our continuing deep dive into practical real-time computer vision, we’ll show you how to code a hands-free webcam-based controller for your computer mouse using the OpenCV library on Python. This will allow you to control your computer without any physical peripheral required—Iron Man style!
In this session, we’ll first obtain our live camera feed using OpenCV and then estimate hand poses using MediaPipe Hands, an open-source framework that employs machine learning to infer 3D landmarks of the hand from single frames in real-time without any fancy hardware acceleration, working even on mobile phones. Following this, we’ll set up our simulated mouse movement in response to the poses using the AutoPy automation module.
GitHub Repo Link: https://github.com/The-Assembly/Build-An-AI-Virtual-Mouse-With-OpenCV
Prerequisites:
✅ Python (latest release: https://www.python.org/downloads/release/python-395/)
✅ PyCharm (https://www.jetbrains.com/pycharm/download/) or any other Python code editor
✅ pip install: OpenCV (https://pypi.org/project/opencv-python/), MediaPipe, AutoPy
—————————————–
To learn more about The Assembly’s workshops, visit our website, social media or email us at workshops@theassembly.ae
Our website: http://theassembly.ae
Instagram: http://instagram.com/makesmartthings
Facebook: http://fb.com/makesmartthings
Twitter: http://twitter.com/makesmartthings
Source
I can't install autopy how to install it
I am not able to install autopy , please help …..
I got error on installing autopy . Plz make a video on install autopy.
Can you make a video on how mediapipe works on android
Can you help me with the other clicking functions?
line 13 "ret, frame = cap.read()" is incorrect gives error
thank you for making the this video
good job
very thank you
I can't locate the virtual mouse code on Github. Can you please share the code?
i try if len(lmList) != 0:
finger = fingers(lmList)
but it also error
if landmarks[tipIds[0]][1] > landmarks[tipIds[0] – 1][1]:
IndexError: list index out of range
4:33 pip3 install –upgrade tensorflow-gpu –user
How to display only 10 landmarks instead of 21. Plz reply
It's incomplete project!!! Where are the other functions dude, like drag and drop, right click etc.?