LMOS is modular, scalable AI system for deploying full-featured language models, transcription, embeddings, and reranking, with support for Docker and Kubernetes orchestration.
Coming Soon to Apache 2.0
LMOS - Language Model Orchestration System
A modular, scalable AI system for deploying full-featured language models, transcription, embeddings, and reranking, with support for Docker and Kubernetes.
Pinned Loading
Repositories
Showing 10 of 22 repositories
- LMOS-openai-types Public
Contains Pydantic and MsgSpec models derived from OpenAI's OpenAPI spec. Used across the organization.
LMOS-IO/LMOS-openai-types’s past year of commit activity - llm-runner-template Public template
A template repo for creating a new LLM runner within LMOS ecosystem
LMOS-IO/llm-runner-template’s past year of commit activity - LMOS-config Public
The LMOS-Config repo contains a shared config provider for the entire LMOS system.
LMOS-IO/LMOS-config’s past year of commit activity - LMOS-exl2-runner Public
LMOS-IO/LMOS-exl2-runner’s past year of commit activity - vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
LMOS-IO/vllm’s past year of commit activity - litellm Public Forked from BerriAI/litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
LMOS-IO/litellm’s past year of commit activity - exllamav2 Public Forked from turboderp-org/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
LMOS-IO/exllamav2’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…