olmoe

Star

Here are 5 public repositories matching this topic...

Steve8323 / moe-legibility

Star

Reading the Router: plain-language, legible profiles of Mixture-of-Experts (OLMoE) expert specialization. Paper + code.

router legibility ai-safety interpretability ai-alignment mixture-of-experts mechanistic-interpretability olmoe

Updated Jul 25, 2026
TeX

manjunathbhaskar / expert-atlas

Star

Context-length degradation ("context rot"), mechanistically localized to retrieval-head attention collapse and causally repaired — replicated across OLMoE, Granite, and Pythia

nlp machine-learning transformers language-models attention-mechanism interpretability mixture-of-experts llm long-context mechanistic-interpretability context-length olmoe

Updated Sep 2, 2026
Python

toolanzyhhh1234 / HELLoRA-replication

Sponsor

Star

Unofficial single-GPU HELLoRA replication on OLMoE and GSM8K

pytorch lora peft mixture-of-experts gsm8k olmoe hellora

Updated Jul 10, 2026
Python

k7xfgj269v-hash / SchemaLite-MoE

Star

Deterministic residual Tool Expert for compressed tool schemas on OLMoE

schema moe llm olmoe tool-expert

Updated Aug 16, 2026
Python

cUDGk / pi5-llm

Star

Raspberry Pi 5 16GB で 30B クラス LLM を 5.2 t/s 動作させる全層最適化スタック — 実機ベンチ + 失敗事例ログ込み

raspberry-pi benchmark optimization arm64 aarch64 dietpi edge-ai llm llama-cpp llm-inference qwen raspberry-pi-5 olmoe

Updated May 15, 2026
Shell

Add this topic to your repo

To associate your repository with the olmoe topic, visit your repo's landing page and select "manage topics."

Learn more