Skip to content

Run the experiments on your own sessions and report the numbers #4

Description

@sepehrsadri

Every number in docs/EXPERIMENTS.md was measured on a handful of projects on a single machine. This is the single biggest weakness of the research, and it is the easiest one to fix — no Rust, no reverse engineering.

The task

Run the prototypes against your own sessions and report what you get.

python3 experiments/als_semantic_diff.py --chain '/path/to/YourProject/Backup/*.als'
./experiments/storage_bench.sh '/path/to/YourProject/Backup'
python3 experiments/flp_parse.py '/path/to/project.flp'

Ableton keeps timestamped autosaves in your project's Backup/ folder, so you already have a version chain.

Claims most in need of independent checking

  • Consecutive Ableton saves differ by 0.07–0.25% of XML lines
  • Track IDs are stable across the save chain
  • A median of 3 of 28 tracks change per save
  • Delta chains cost ~11 KB per save

Please include the material context — genre, track count, project size, how many versions, DAW version. No file names needed. Context matters enormously: sparse stems and dense masters behave completely differently, and a number without material is close to meaningless.

Results that contradict ours are the most valuable outcome. Use the "Measurement report" issue template.

Everything in experiments/ is read-only and never modifies your projects.

Metadata

Metadata

Labels

good first issueGood entry point for new contributorshelp wantedExtra attention is neededmeasurementReproduce or extend a published measurement

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions