https://ruder.io/recent-advances-lm-fine-tuning/ Recent Advances in Language Model Fine-tuningThis article provides an overview of recent methods to fine-tune large pre-trained language models.Sebastian Ruder24 Feb 2021 “While pre-training is compute-intensive, fine-tuning can be
What I Read: Data Quality Management
https://medium.com/dataseries/inside-the-architecture-powering-data-quality-management-at-uber-543d5e00ad19 Inside the Architecture Powering Data Quality Management at UberData Quality Monitor implements novel statistical methods for anomaly detection and quality management in large data infrastructures.Jesus RodriguezFeb 10 “Data quality
What I Read: Neural Nets, How Brains Learn
https://www.quantamagazine.org/artificial-neural-nets-finally-yield-clues-to-how-brains-learn-20210218/ Artificial Neural Nets Finally Yield Clues to How Brains LearnAnil AnanthaswamyContributing WriterFebruary 18, 2021 “The learning algorithm that enables the runaway success of deep neural networks doesn’t work in
What I Read: Continual Learning, Amnesia, Neural Networks
https://medium.com/dataseries/ibm-uses-continual-learning-to-avoid-the-amnesia-problem-in-neural-networks-ae8241e1f3a3 IBM Uses Continual Learning to Avoid The Amnesia Problem in Neural NetworksUsing continual learning might avoid the famous catastrophic forgetting problem in neural networks.Jesus RodriguezJan 25 “Building neural networks
What I Read: technical debt, ML pipelines
https://towardsdatascience.com/avoiding-technical-debt-with-ml-pipelines-3e5b6e0c1c93?gi=8f8c9d302be Avoiding technical debt with ML pipelinesStrike a balance between rapid results and high-quality coding.Hamza Tahir “ML practitioners in many organizations are heavily incentivized to make quick-wins to produce early