Pinned Loading

1. jax jax Public

   Forked from jax-ml/jax

   Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

   Python

2. pytorch pytorch Public

   Forked from pytorch/pytorch

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python

3. LLM-from-scratch LLM-from-scratch Public

   Implement a ChatGPT-like LLM in PyTorch from scratch

   Jupyter Notebook

4. llm-observability-pack llm-observability-pack Public

   Ready-to-run observability stack for LLM inference servers (vLLM, Triton) with Prometheus, Grafana dashboards, and load testing scripts

   Python

5. vLLM-ops-lab vLLM-ops-lab Public

   vLLM Ops Lab

   Python

6. LLM-zero-downtime-update LLM-zero-downtime-update Public

   Kubernetes (Argo Rollouts) implementation for zero-downtime model updates for an LLM serving stack

   Shell