HappyHorse is built around a 15-billion-parameter unified self-attention Transformer that processes text, image, video, and audio tokens within a single token sequence. Unlike many competitors that stitch together separate models for video and audio
大多数人认为多模态AI模型需要整合多个专门模型来处理不同类型的数据，但作者认为Alibaba的HappyHorse使用统一架构处理所有模态，这挑战了'多模态AI需要模块化设计'的行业共识。这种统一架构可能代表AI模型设计的范式转变，暗示未来多模态系统将更加一体化而非模块化。