https://nlpnewsletter.substack.com/p/nlp-research-in-the-era-of-llms
NLP Research in the Era of LLMs
5 Key Research Directions Without Much Compute
Sebastian Ruder
Dec 19, 2023
“In an era where running state-of-the-art models requires a garrison of expensive GPUs, what research is left for academics, PhD students, and newcomers to NLP without such deep pockets?”