this repo has scripts to prepare the data for the EUROCONTROL Data mobile app.
The scripts prepare a set of json files saved in the network folder:
//ihx-vdm05/LIVE_var_www_performance$/briefing
The main scripts are:
copy_to_production: Main script executing all the other necessary ones. It’s the one automated to be run every morning.generate_json_files_nw/ao/states/ap: Retrieve the raw data, generate the json files and saves them locally in the repo’s data folder.
Support scripts:
helpers: contains the functions used in other scripts.params: sets the necessary parameters.get_common_data: retrieves some datasets used for other scripts to avoid loading them multiple times, a.o. the dimension tables.
Generation of archive csvs:
generate_archive_data: Generates source csv files necessary to generate json files for past dates. Only needs to be run if further dates are needed.nw/ao/state_queries: Contains SQL queries with the date as a parameter used by the previous script to generate past csv viles.