AI-Powered Sign Language Assistant
A sign language and gesture-based AI assistant that connects sign language and computer interaction is Echo Motion. It translates finger patterns into complex hands-free system commands, web searches, and natural language conversations using computer vision and large language models (LLMs).
Streamlit Website URL is: https://echomotionai.streamlit.app
Demo Video URL is: https://youtu.be/qyzW39SMC7o
Python 3.12
Windows (Preferably, for the voice output if you need it)
OpenCV
MediaPipe
NewsAPI
Gemini API
Google GenAI
Streamlit
Win32Com
- Visit the Streamlit website link or follow the steps below.
git clone https://github.com/ayaskant007/Echo-Motion.git
cd Echo-Motionpython -m venv .venv
.venv\Scripts\activatepip install -r requirements.txtpython -m streamlit run "app.py"or just visit the Streamlit link!
If you encounter the mediapipe dependency error make sure you are using Python 3.12
You can see the gesture map its in the side bar of the website.
AI was just used for code debugging purposes and to implement cross-platform compatibility with Streamlit.