A real-time hand-tracking painting application built in TouchDesigner. This project utilizes MediaPipe for gesture recognition, allowing users to paint on screen using hand movements, pinch gestures to control brush size, and specific gestures to clear the canvas or switch brush textures.
This is my first project in TouchDesigner, developed to explore the intersection of computer vision and interactive art.
Key Features:
- Real-time Hand Tracking: Uses MediaPipe to track index finger and thumb pinch-midpoints.
- Gesture Control:
- Pinch: Adjust brush size dynamically.
- Thumbs Up: Cycle through different brush textures (Video/Noise).
- Point Up: Clear the canvas (Feedback reset).
- Feedback Loops: Creates a "painterly" trail effect using feedback displacement.
📌 Tutorial: Watercolor Hand Tracking Brush in TouchDesigner Tutorial by Torin Blankensmith
📌 Download Clamp Math Component
📌 Download MediaPipe Plugin for TouchDesigner
Handbrush/
├── assets/ # Project textures and background images
├── toxes/ # [MANUALLY ADD THESE FILES HERE]
│ ├── clamp_math.tox
│ ├── hand_tracking.tox
│ └── MediaPipe.tox
├── handbrush.toe # Main project file
└── README.md # Project documentation
