VisionAI is an AI-powered software solution that seamlessly integrates speech recognition, computer vision, and natural language processing to enhance user interactions. Designed to process voice and image inputs from any connected camera and microphone, the system leverages the Gemini API to generate AI-driven responses, which are delivered through high-quality synthesized speech. This technology aims to improve accessibility, efficiency, and user experience across various applications.
- Speech Recognition: Converts spoken language into text using Google's Speech Recognition API.
- Computer Vision: Captures and analyzes images using OpenCV and the Gemini API.
- Natural Language Processing: Generates AI-driven responses using the Gemini API.
- Text-to-Speech: Converts AI-generated text into natural-sounding speech using pyttsx3.
- Real-time Processing: Provides instant responses through a user-friendly interface.
- Interactive GUI: Built with Tkinter for seamless user interaction.
Ensure you have the following installed:
- Python 3.8+
- pip package manager
- Webcam and Microphone enabled on your device
Install the required dependencies using:
pip install -r requirements.txtCreate a .env file and add your Gemini API key:
GEMINI_API_KEY=your_api_key_hereRun the application using:
python visionai.py- The system starts and initializes the camera and microphone.
- The user speaks a command or query.
- Speech is converted into text and analyzed by the Gemini AI.
- The system captures an image (if necessary) and processes visual context.
- AI generates a response based on the input data.
- The response is displayed in the chat panel and spoken aloud.
- Multi-Language Support: Expanding speech recognition and synthesis for global users.
- Cloud Integration: Storing and retrieving data from cloud services.
- Gesture Recognition: Enhancing user experience through hand gesture commands.
- Khurram Riaz Bhutto
This project is licensed under the MIT License - see the LICENSE file for details.