Skip to content

Document output retention policy #3

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
sid-plt merged 2 commits into from
Aug 23, 2026
Merged

Document output retention policy #3

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
f8a0473
Document output retention policy
sid-plt Aug 23, 2026
5821922
Merge branch 'main' into output-retention
sid-plt Aug 23, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 15 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,21 @@ player data from SofaScore, FotMob, Transfermarkt, KBStats, and Analyst.
Generated JSON, CSV, and debug HTML must be written through `project_paths.py`;
do not write generated files beside a notebook or into the project root.

## Timestamped output retention

Timestamped output exporters invoke the shared cleanup in `project_paths.py`. The
cleanup uses the final timestamp in a filename as the output creation time and
retains the 10 newest files in each applicable family. Files without a supported
creation timestamp in their filename are never removed.

Most families are distinguished by output directory, filename pattern with
timestamps removed, and file extension. Meaningful labels such as matchday,
percentile, and datatype remain separate. Two high-volume CSV directories use a
single limit across their methods: `outputs/expected_points` retains its 10 newest
expected-points CSVs, and `outputs/optimized_squad` retains its 10 newest optimizer
CSVs. Run timestamped-output notebooks through their final retention cell to apply
the same cleanup after notebook exports.

## Setup

From PowerShell in the project root:
Expand Down
Loading