首页 > AI前沿 > VisKG-LM: Compiling Knowledge Graphs into Visual Memory for Multiple-Choice Question Answering

VisKG-LM: Compiling Knowledge Graphs into Visual Memory for Multiple-Choice Question Answering

arXiv自然语言 2026-07-30 01:02 3 阅读 查看原文

Knowledge graphs are usually integrated into question answering by encoding a retrieved subgraph with a graph neural network and fusing it with the language model in the online inference path.

The same subgraph is therefore re-encoded from scratch every time a pair is scored, across training epochs, seeds, and evaluation runs, even though the knowledge graph never changes.

We ask whether the retrieved knowledge graphs can instead be compiled once, offline, and then accessed as read-only memory.

VisKG-LM

VisKG-LM shows that it can, by decoupling graph encoding from language reasoning.

Inference

Performance