LLM.int8() and Emergent Features
LLM.int8() and Emergent Features
2022-08-17 by Tim Dettmers
“…I use advanced quantization methods to achieve no performance degradation transformer inference at scale that makes large models more accessible. The other pitch talks about emergent outliers in transformers and how they radically change what transformers learn… “