Popular repositories Loading

1. WarpGroup-backend WarpGroup-backend Public

   A high-performance C++ backend for extreme-context LLM inference. It replaces item-count batching with dynamic, VRAM-aware First-Fit Decreasing (FFD) bin packing. By using PyBind11 for async queuei…

   Python 5 1

2. swarmkv swarmkv Public

   C++ inference runtime for llama.cpp that shares a single document KV-cache prefill across multiple analytical branches via snapshot fan-out. Eliminates redundant GPU compute and dramatically reduce…

   C++ 3 1

3. sionna-munich-ai-ran sionna-munich-ai-ran Public

   GPU-accelerated Network Digital Twin for AI-RAN experiments in Munich. Powered by NVIDIA Sionna RT and PyTorch for ray-traced RF simulation. Includes real-world Munich simulation, Mitsuba 3 backend…

   Python 2 1

4. ILCP-for-Agents ILCP-for-Agents Public

   Inductive Latent Context Persistence (ILCP) for Agentic AI. This infrastructure persists, routes, and reuses LLM latent context across multi-agent DAGs. By eliminating redundant prefix-prefill comp…

   Python 2

5. SysAdminToolbox SysAdminToolbox Public

   A bunch of PowerShell scripts to automatize the management of windows computers

   PowerShell 1

6. Shapley_values Shapley_values Public

   A tool that provides 3 different method to calculate Shapley values in a graph

   Python 1 1