https://huggingface.co/blog/optimize-llm Optimizing your LLM in productionSeptember 15, 2023Patrick von Platen “…efficient LLM deployment…. pros and cons of adopting lower precision, provide a comprehensive exploration of the latest attention algorithms, and
What I Read: LLM Chatbots, Browser
https://www.kdnuggets.com/2023/05/webllm-bring-llm-chatbots-browser.html Web LLM: Bring LLM Chatbots to the BrowserBala Priya CMay 22, 2023 “Wouldn’t it be cool if you can run LLMs and LLM chatbots natively in your browser?”