TriAttention matches Full Attention reasoning accuracy while achieving 2.5x higher throughput or 10.7x KV memory reduction
大多数人认为在KV缓存压缩中，准确率和效率之间存在不可避免的权衡，但作者提出的TriAttention方法能够在保持全注意力推理准确度的同时，实现2.5倍的吞吐量提升或10.7倍的内存减少。这一结果挑战了当前领域内的效率-准确度权衡范式，表明可以通过创新方法打破这一传统限制。
The development of the card system and itsmore universal adoption within recent years isundoubtedly due in the mail to the development in modernbusiness and factory organisation ; it may be regarded as anoffspring of manufacture in quantities. (Massenfabrikation, Gross-industrie.) The recognised principle in manufacture in quantities ismaximum of output with minimum of labour. The means to attainthis end is specialisation, which in its turn yields greater precisionand accuracy as it^ result. All this is equally applicable to thecard system, and the last factor, greater precision and accuracy,is one of its most conspicuous claims.
Julius Kaiser contemporaneously posits that mass manufacture and maximizing efficiency (greater output for minimum input) are the primary drivers of card index system use in the early 20th century. These also improve both precision and accuracy in handling information which allow for better company or factory operation, which would have been rising concerns for businesses and manufacturing operations at the rise of scientific management during the time period.