https://ai.googleblog.com/2021/05/kelm-integrating-knowledge-graphs-with.html
KELM: Integrating Knowledge Graphs with Language Model Pre-training Corpora
Thursday, May 20, 2021
Posted by Siamak Shakeri, Staff Software Engineer and Oshin Agarwal, Research Intern, Google Research
“Alternate sources of information are knowledge graphs (KGs), which consist of structured data…. we explore converting KGs to synthetic natural language sentences to augment existing pre-training corpora, enabling their integration into the pre-training of language models…”