NerdCrawler is a fully self-hosted search engine built entirely from scratch — including both the frontend and backend. No external APIs, no third-party engines — just raw crawling power.
- 🌐 Self-hosted backend using Python Flask
- ⚛️ Frontend built with React and TailwindCSS
- 🧭 Custom crawler indexing real websites
- 🎨 Modern UI with support for theming
| Layer | Tech |
|---|---|
| Frontend | React, TailwindCSS, Vite |
| Backend | Flask (Python) |
| Crawler | Custom Python-based system |
| Hosting | Fully self-hosted |
To run NerdCrawler locally, you’ll need to:
- Clone the repository
- Set up your environment
- Create a
config.pyfile (see the example included) - Start the Flask server and React frontend with app.py
The Crawler can be run with main.py
Make sure you create your own config.py file in the backend directory. Use the included example as a reference for necessary fields like API keys, port numbers, or crawler settings.
Version 1 is up and running and actively being improved!
Expect bugs, layout changes, and big feature drops.
While this project is currently solo-developed, contributors and testers are always welcome. Feel free to fork the repo or drop suggestions in issues!