Hand Gesture

Track hands and recognise gestures such as victory, thumbs up and pinch.

AI VisionMicroPythonC++

Hand Gesture tracks 21 points on each hand and recognises gestures, so a program can be controlled with a hand in front of the camera.

Before you start

  • Add the Hand Gesture extension to your project. Every program starts with its enable block, which starts the camera and loads the model.
  • The camera image comes from an ESP32-CAM or from your browser webcam. The first run downloads the model (about 3 MB), so it takes a moment.
  • Detection runs in the browser while you test. Generated C++ uses the ArduinoJson library to read results.

Blocks

Drawing the blocks…

Tips

  • Use events ("when ... is detected") for things that should react to the camera and value blocks inside a loop for things you check over time.
  • Lighting matters: a bright, even light on the subject gives much steadier results.
  • Keep the hand fully inside the picture and clear of the face for steadier tracking.
Hand Gesture — OMS Parts