Skip to content
#

gguf-runner

Star

Here are 5 public repositories matching this topic...

Language: All
Filter by language
All 5 Python 2 Go 1 Rust 1

flatseek / flatrun

Star 0

A complete inference runtime for open-weight large language models, enabling efficient execution through streaming weights, quantization, and memory-aware scheduling

machine-learning deep-learning numpy inference quantization inference-engine memory-mapping inference-optimization kv-cache ai-inference cpu-inference large-language-models llm model-runtime safetensors llm-inference gguf streaming-inference gguf-runner streaming-inference-engine
  • Updated Aug 5, 2026
  • Python

atomneo / Easy-Local-AI-Image-Generator-Stable-Diffusion-FLUX-Render

Star 0

Render is a lightweight, easy-to-use CLI and local server for generating AI images. Run Stable Diffusion (SD 1.5, SDXL) and FLUX models locally with simple commands like pull and run. Powered by Vulkan acceleration and GGUF support for ultra-fast performance. Think Ollama, but for local image generation.

cli flux local vulkan image-generation vulkan-api client-server vulkan-renderer image-gen stable-diffusion local-ai sdxl stable-diffusion-xl gguf stable-diffusion-ai image-generation-ai image-generation-tool gguf-model-support image-generation-api gguf-runner
  • Updated Aug 4, 2026
  • Go

Improve this page

Add a description, image, and links to the gguf-runner topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the gguf-runner topic, visit your repo's landing page and select "manage topics."

Learn more