BitNet GPU Demo

This is a GPU demo ver. of BitNet by SHY

Name		Name	Last commit message	Last commit date
Latest commit History 161 Commits
3rdparty		3rdparty
assets		assets
docs		docs
gpu_dense		gpu_dense
gpu_sparse		gpu_sparse
include		include
nano_vllm_bench		nano_vllm_bench
preset_kernels		preset_kernels
src		src
utils		utils
.gitignore		.gitignore
.gitmodules		.gitmodules
CMakeLists.txt		CMakeLists.txt
CODE_OF_CONDUCT.md		CODE_OF_CONDUCT.md
LICENSE		LICENSE
README.md		README.md
SECURITY.md		SECURITY.md
benchmark_vllm_new.sh		benchmark_vllm_new.sh
benchmark_vllm_old.sh		benchmark_vllm_old.sh
requirements.txt		requirements.txt
run_inference.py		run_inference.py
run_inference_server.py		run_inference_server.py
setup_env.py		setup_env.py

Provide feedback