You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
inference-hive is a toolkit to run distributed LLM inference on SLURM clusters. Configure a few cluster, inference server and data settings, and scale your inference workload across thousands of GPUs.
End-to-end MLOps platform for HPC workload management — auto-discovery training pipelines (Prefect), Slurm job orchestration, MLflow model registry, Ray Serve multi-model serving, Prometheus/Grafana/Loki observability, a React 19 + FastAPI dashboard, and the `exa` platform CLI.