LLM.int8() and Emergent Features LLM.int8() and Emergent Features2022-08-17 by Tim Dettmers “…I use advanced quantization methods to achieve no performance degradation transformer inference at scale that makes large models more
What I Read: Self-Taught AI, Brain
https://www.quantamagazine.org/self-taught-ai-shows-similarities-to-how-the-brain-works-20220811/ Self-Taught AI Shows Similarities to How the Brain WorksAnil AnanthaswamyContributing WriterAugust 11, 2022 “Self-supervised learning allows a neural network to figure out for itself what matters. The process might
What I Read: Comparing quantiles at scale
https://engineering.atspotify.com/2022/03/comparing-quantiles-at-scale-in-online-a-b-testing/ Comparing quantiles at scale in online A/B-testingMarch 23, 2022Published by Mårten Schultzberg (Senior Data Scientist) and Sebastian Ankargren (Data Scientist) “…we have been able to reduce the computational complexity
What I Read: Challenging AI to Learn Better
https://www.quantamagazine.org/the-computer-scientist-trying-to-teach-ai-to-learn-like-we-do-20220802/ The Computer Scientist Challenging AI to Learn BetterAllison WhittenContributing WriterAugust 2, 2022Christopher Kanan is building algorithms that can continuously learn over time — the way we do. “Instead of