This project is an Indian Sign Language (ISL) recognition model that translates ISL gestures into English text. It recognizes static signs, including alphabets and numbers, captured by a camera and provides real-time translation through a web interface.
The project consists of the following components:
-
Image Collection Program: A Python script to collect images of ISL gestures for training the model. It captures images, adjusts aspect ratios, and saves them for further processing.
-
Recognition Script with Flask: The core of the project, written in Python using OpenCV, Flask, and TensorFlow. It includes the following functionalities:
- Hand detection using the HandTrackingModule from the cvzone library.
- Gesture classification using pre-trained TensorFlow and Keras models.
- Real-time video processing to recognize ISL gestures and display the corresponding English text translation.
- Web interface using Flask to provide user interaction and translation capabilities.
-
HTML Templates and CSS: The project includes HTML templates for the web interface and CSS stylesheets for frontend styling.
To use the ISL recognition model, follow these steps:
Image Collection:
- Run the
image_collection.pyscript to collect images of ISL gestures. - Press 's' to save images. Images will be saved in the specified folder for further processing.
Training (Optional):
- Train the recognition model using the collected images and TensorFlow/Keras. This step is optional if pre-trained models are used.
Run the Recognition Script:
- Start the Flask web server by running the
app2.pyscript. - Access the web interface through a browser to interact with the recognition model.
- Navigate to different pages for sign-to-text translation, text-to-sign conversion, and other functionalities.
