A Multimodal World-state Reasoning Method for Embodied Autonomous Agents on Low-earth-orbit Satellites
Author:
Affiliation:

Clc Number:

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    This paper presents a multimodal world-state method for task planning and anomaly recovery in low-Earth-orbit (LEO) satellite missions, where heterogeneous observations, tightly coupled hard constraints, and costly global replanning make closed-loop autonomy difficult. The method aligns imagery, telemetry, orbital context, and mission semantics at each decision instant to form a unified world-state layer with modality-availability masks. It then propagates hard constraints over a dynamic task-resource-environment-action graph and uses a learned transition model to assess future reachability. Anomalies and their impact paths are localized through prediction-observation residuals, after which recovery is restricted to the affected temporal window. For training, an offline MILP solver subject to the same hard constraints generates teacher trajectories; behavior-cloning pretraining is followed by closed-loop interaction and advantage-weighted updates in the digital twin. On a self-built LEO digital-twin benchmark, the method achieves task success, recovery success, and constraint satisfaction rates of 89.8%, 81.6%, and 96.3%, respectively, outperforming the strongest baseline by 6.7, 12.2, and 3.3 percentage points while maintaining 59 ms online latency. These results support the four proposed mechanisms within the digital-twin setting.

    Reference
    Related
    Cited by
Get Citation

李倩,黄茜,王哲,王尚广.低轨卫星具身自主体的多模态世界状态推理方法.软件学报,2027,38(5):

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:April 22,2026
  • Revised:August 20,2026
  • Adopted:
  • Online: September 14,2026
  • Published:
You are the firstVisitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063