[AI combat] llama.cpp quantitative deployment llama-33B

Introduction to llama.cpp Quantization

The quantized model is a new model obtained by converting high-precision floating-point numbers in the model into low-precision int or other types, which costs less and runs faster.

Inference of LLaMA model in pure C/C++。

llama.cpp takes up less memory during runtime, and the inference speed is faster. The same model, 7