A full-stack web application for managing website crawling, content curation, indexing, and querying with RAG (Retrieval-Augmented Generation).
cd backend
python app.pyBackend runs on http://localhost:5005
cd frontend
npm install
npm run devFrontend runs on http://localhost:3000
See DASHBOARD_DOCS.md for complete documentation.
- Website management with per-website configuration
- Web crawling with header/footer link extraction
- Content curation with XPath/CSS selector rules
- Weight-based page prioritization
- Background job management
- RAG query system with weight boosting
- Custom system prompts per website
Default credentials (change in backend/config.py):
- Username:
admin - Password:
darui2024