Pinned Loading

1. Inference-Engineering-Handbook Inference-Engineering-Handbook Public

   A practical handbook for software engineers to learn AI, Large Language Models (LLMs), and Inference Engineering—from fundamentals to production systems.

   2

2. litellm-gateway litellm-gateway Public

   A local OpenAI-compatible AI gateway built using: LiteLLM (LLM routing + API server) PostgreSQL (DB backend) Caddy (reverse proxy + HTTPS) Custom portal UI

   HTML 1

3. xdge xdge Public

   A complete, zero-dependency implementation of the XDG Base Directory Specification v0.8 for Linux and Unix systems.

   Rust 1

4. llm-gateway-guardrails-poc llm-gateway-guardrails-poc Public

   Exploring whether LiteLLM's built-in guardrail hooks are sufficient for enforcing PII and prompt-injection policy at the gateway, or whether a separate guardrail service is needed. Wires Presidio (…

   Python

5. nix-remote-builder-lab nix-remote-builder-lab Public

6. scanx-cve-llm scanx-cve-llm Public

   OWASP Top 10 Vulnerability Detection LLM built on the Ornith model and hosted on Ollama.

   Python