We introduce a minimal hierarchical partially observed control model with latent dynamics, structured episodic memory, observer-belief state, option-level actions, and delayed verifier signals.
大多数人认为AI系统应专注于实时控制和即时反馈，但作者提出了一种包含延迟验证信号的分层控制模型，挑战了实时控制优于延迟验证的常规认知，强调了延迟验证在复杂环境中的重要性。
For example, we may choose a song to play to regulate our emotions or influence co-present others.
Many things we do with computers, such as listening to music or postingmessages, are about control.
Moreover, control theory offers a broad view of interaction; itis not limited to input.