GPT-3: The New Mighty Language Model from OpenAI
Pushing Deep Learning to the Limit with 175B Parameters
Moiz Saifee
May 31
“While this type of transfer learning obviates the need to use task specific model architectures, but you still need task specific datasets, which are a pain to collect, to achieve good performance…. GPT-3 aims to address this specific pain point, that is, its a task agnostic model, which needs zero to very limited examples to do well and achieve close to state of the art performance on a number of NLP tasks”