QuizzHero Learning App

In this project, we created a webapp where students can take pictures of their handwritten notes or pages from the book. The AI will capture and process the information and creates several questions based on the input. The student can answer the questions via voice and the AI will give feedback whether the answer is wrong or correct also with voice. The idea is that the conversation between the AI and the student should be conversational like the student is talking to a tutor. The AI tries to keep the student motivated to keep going. After finishing all the questions, the user will receive a precise summarization / report. The AI will respond e.g. on which aspects the student should focus on.

SHORT DEMO

short-demo-quizz-hero.mp4

Used Tools

• Backend: FastAPI
• Frontend: NextJS
• Voice: Elevenlabs
• AI: Mistral

Features

• Understand taken notes
• Generate Quiz
• Answer evaluation
• Follow up question for lacking knowledge

Set up

Set Mistral and Elevenlabs API keys

export MISTRAL_API_KEY=
export ELEVENLABS_API_KEY=

Set up env

cd back
python3 -m venv venv
./venv/bin/activate
pip install -r requirements.txt
cd ../front
pnpm i

Run app

# Frontend
pnpm dev
# Backend
uvicorn main:app --host 0.0.0.0 --port 8000

FULL DEMO

0526.mp4