首页 > AI前沿 > Beyond Raw Transcripts: Structured Persona Extraction for LLM-Based Digital Twins

Beyond Raw Transcripts: Structured Persona Extraction for LLM-Based Digital Twins

arXiv自然语言 2026-06-14 03:00 10 阅读 查看原文

LLM-based "digital twins" aim to simulate how an individual would behave in new environments or respond to novel questions, given some representation of that individual's prior responses. A common approach constructs this representation from survey transcripts or summaries responses.

Prior work shows that compressing long transcripts into shorter LLM-generated summaries does not significantly reduce predictive accuracy, suggesting that information volume is not the primary bottleneck.

In this work, we argue that the key limitation is instead structural: how persona information is organized before being provided to the simulator model. We study this by comparing unstructured summaries with structured persona representations.

Methodology

First, we introduce a hand-crafted schema (BDE: Background, Decision procedure, Evaluation), grounded in consumer-behavior theory, and show that it improves predictive accuracy over raw transcripts by +1.91 percentage points on a homogeneous benchmark (Twin-2K-500), with similar gains on gpt-5.4-mini and Qwen3-8B as robustness checks.

However, this fixed structure does not generalize across more heterogeneous tasks, where performance is statistically indistinguishable from the raw transcript baseline.

Proposed Solution

To address this limitation, we propose an automatic structure-discovery pipeline in which an LLM iteratively proposes and refines task-specific persona structures and extraction prompts.

On a benchmark of 13 diverse sub-studies, this approach restores performance, improving mean accuracy by +1.91 percentage points over the raw transcript baseline and eliminating significant losses observed with the fixed schema.

Conclusion

Overall, our results suggest that the main constraint in LLM-based digital twins is not how much information is provided, but how it is structured -- and that the optimal structure depends on the task.