This Python script is designed to crawl specific URLs from the Albion Online Character Builder website and download all rendered images from the database. It organizes these images into folders based on build ID, with separate folders for armor-related images and abilities.
This tool is particularly beneficial for guilds that utilize build templates and prefer not to download each image manually.
You can enter multiple URLs in url.txt, and they will be processed sequentially, with each URL having its own designated folder. If you prefer not to enter URLs in the text file, you can leave it empty and input them directly in the console.
Before running the crawler, ensure you have the following installed:
- Python 3.x: Make sure Python is installed on your system. You can download it from python.org.
- ChromeDriver: Download and install the ChromeDriver version that matches your Chrome browser. You can find it here. Once downloaded, set the path in
config.txt.
-
Download the files in this repo
-
Install Required Packages: Use pip to install the necessary Python packages. You can install all dependencies listed in requirements.txt by running:
pip install -r requirements.txt
-
Set Up Configuration: Open the config.txt file and specify the path to your ChromeDriver.
CHROME_DRIVER_PATH=C:\path\to\your\chromedriver.exe OUTPUT_FOLDER_PATH=\path\to\your\desired folder
-
Input URLs: Edit the url.txt file and add the URLs you want to crawl, one per line.
Example: https://albiononline.com/characterbuilder/solo-builds/view/3917 https://albiononline.com/characterbuilder/solo-builds/view/3917
- Open CMD and cd to the path you saved the tool in
cd Desktop\Crawler
- To run the crawler, execute the following command in your terminal:
python crawler.py
- wait for the program to finish and enjoy your crawled images :)