Knowledge graphs are usually integrated into question answering by encoding a retrieved subgraph with a graph neural network and fusing it with the language model in the online inference path.
The same subgraph is therefore re-encoded from scratch every time a pair is scored, across training epochs, seeds, and evaluation runs, even though the knowledge graph never changes.
We ask whether the retrieved knowledge graphs can instead be compiled once, offline, and then accessed as read-only memory.
VisKG-LM
VisKG-LM shows that it can, by decoupling graph encoding from language reasoning.