Archives mensuelles : octobre 2023

Effective Weight-Only Quantization for Large Language Models with Intel® Neural Compressor

Publié le 2 octobre 2023 par

Weight-only quantization provides better performance and accuracy tradeoff for large language models

Publié dans Non classé | Commentaires fermés sur Effective Weight-Only Quantization for Large Language Models with Intel® Neural Compressor