基于大语言模型引导的多目标优化实现物理合理且多样化的三维人体运动生成

LLM-Guided Multiobjective Optimization for Physically-Plausible and Diverse 3D Human Motion Generation

IEEE Transactions on Evolutionary Computation · 2026
被引 0
ABS 4

中文导读

提出LMPGen框架,将文本驱动的三维人体运动生成转化为多目标优化问题,利用大语言模型切分文本为细粒度动作片段,结合进化算法和物理约束,生成语义一致、多样且物理合理的运动序列。

Abstract

Text-driven 3D human motion generation aims to synthesize diverse motion sequences that are semantically aligned with textual descriptions. Most existing generative approaches encode the entire sentence into a single semantic embedding, which inevitably compromises the semantic consistency of the generated motions. Furthermore, in long sequences, the lack of explicit physical constraints often leads to physically implausible motions, particularly in the later segments. To address these limitations, we propose LMPGen, a novel framework that formulates text-driven 3D human motion generation as a multiobjective optimization problem. Without introducing additional parameters, LMPGen enhances both the diversity and quality of the generated motions. Leveraging the semantic understanding capabilities of a large language model (LLM), we slice the input text into fine-grained action segments, each guiding the construction of semantically grounded objective functions. To effectively balance conflicting objectives, we adopt an evolutionary algorithm (EA) augmented by a pretrained generative model to initialize and guide population evolution. Each action segment serves as a semantic anchor, steering the search process toward diverse yet semantically faithful motion sequences. Furthermore, we incorporate physical criterion into the optimization process to ensure that the generated motions are smooth, stable, and physically plausible. Experimental results on mainstream human motion datasets demonstrate that our method outperforms existing approaches in terms of both semantic consistency and diversity, providing a robust solution for generating high-quality, text-aligned human motion sequences.

三维人体运动生成多目标优化大语言模型进化算法文本驱动生成