Whatโ€™s new for KGs in NLP?

Knowledge Graphs in NLP @ EMNLP 2020

Your guide to the KG-related research in NLP, November edition.

KG-Augmented LMs: Empower your Transformer

Overall, multilingual LMs can recover barely 15% of facts in EN. The rest is below 10%. Source: Jiang et al

Entity Representations in LMs

Source: Yamada et al
Source: Fรฉvry et al

Autoregressive KG-augmented LMs

KGPT encoder. Source: Chen et al
GRF intuition. Source: Ji et al
Source: Xu et al

NLG (Data to text): New Folks in Datasetlandia

ENT-DESC task. Source: Cheng et al
Logic2Text. Source: Chen et al
Source: Parikh et al
Still using BLEU?

Entity Linking: Massive and Multilingual

Entity Linking in 100 Languages. Source: Botha, Shan, and Gillick
BLINK intuition. Source: Wu et al
ELQ. Source: Li et al
COMETA example. Source: Basaldella, Liu et al

Relation Extraction: OpenIE 6 and Neural Extractors

Source: Kolluru, Adlakha et al
Source: Hohenecker, Mtumbuka et al
Animated DualTKB intuition! Source: Dognin, Melnyk, Padhi et al , GitHub repo

Knowledge Graph Representation Learning: Temporal KGC and Successor to FB15K-237

Source: Wu et al
DyERNIE intuition. Source: Han et al
Source: Jain, Rathi et al
Time to come up with more diverse and complex benchmarks. Meme image adjusted by me.
Source: Fisher et al
The red node is an out-of-sample entity. Source: Albooyeh, Goel, and Kazemi

ConvAI + KGs: On the Shoulders of OpenDialKG

Source: Jung et al
Source: Madotto et al

Wrapping Up

1900 NeurIPS 2020 papers awaiting

--

--

AI Research Scientist @ Intel Labs. Working on Graph ML, Geometric DL, and Knowledge Graphs

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Michael Galkin

AI Research Scientist @ Intel Labs. Working on Graph ML, Geometric DL, and Knowledge Graphs