DeepSeek tests sparse attention to reduce AI costs

October 01, 2025 Ti AI ṣe iroyin

Chinese AI firm DeepSeek is experimenting with sparse attention mechanisms to significantly lower the processing costs of large language models. The approach focuses computations on key parts of input data, potentially halving resource demands. This development could make advanced AI more accessible amid rising energy concerns.