Pose Detection

Track the body as a skeleton of 33 points: read the position of a joint such as a shoulder, elbow or knee.

AI VisionMicroPythonC++

Pose Detection tracks a person as 33 skeleton points (the BlazePose model), so a program can follow body movement.

Before you start

  • Add the Pose Detection extension to your project. Every program starts with its enable block, which starts the camera and loads the model.
  • The camera image comes from an ESP32-CAM or from your browser webcam. The first run downloads the model (about 3 MB), so it takes a moment.
  • Detection runs in the browser while you test. Generated C++ uses the ArduinoJson library to read results.

Blocks

Drawing the blocks…

Tips

  • Use events ("when ... is detected") for things that should react to the camera and value blocks inside a loop for things you check over time.
  • Lighting matters: a bright, even light on the subject gives much steadier results.
  • Stand far enough from the camera to show the joints you need.
Pose Detection — OMS Parts