Pinned Loading

1. attention-head-emergence attention-head-emergence Public

   a 2-layer attention-only transformer in numpy, testing whether induction heads actually compose

   Python

2. factor-zoo-postpublication factor-zoo-postpublication Public

   testing whether five fama-french style factor premia survive their own publication date, in numpy against ken french's own data

   Python

3. kv-cache-crossover kv-cache-crossover Public

   causal self attention from scratch in numpy, with and without a kv cache, measuring the actual per step compute

   Python

4. int4-quantization-recovery int4-quantization-recovery Public

   post training quantization from scratch in numpy, measuring how much gptq style compensation recovers from int4 rounding

   Python

5. actuarial actuarial Public

   cox survival validation of 8 dna methylation clocks against 20 year nhanes mortality data

   Python

6. grokking-replication grokking-replication Public

   grokking on modular addition from scratch in numpy, measuring whether weight decay sets the delay

   Python