Pinned Loading

1. advanced-gguf-quantizer advanced-gguf-quantizer Public

   A CUDA-accelerated GGUF quantization tool for NVFP4/MXFP6/Q_K, utilizing layer by layer quantization and selection techniques to reduce error.

   C++ 15 4

2. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++ 3 1