Skip to content
Open-Source Registry

cargo / quat_llm

quat_llm

bitbison: no public build no release has built yet

A high-performance, lightweight 2-bit quantized LLM inference engine in Rust

26 downloads · source · cargo aiinferencellmquantizationtransformer

1.0.0 did not build; the badge stands for .

Releases1FindingsBuild timeBuilt
1.0.0not built1d ago