DeepSeek tests sparse attention to reduce AI costs

01 ottobre 2025 Riportato dall'IA

Chinese AI firm DeepSeek is experimenting with sparse attention mechanisms to significantly lower the processing costs of large language models. The approach focuses computations on key parts of input data, potentially halving resource demands. This development could make advanced AI more accessible amid rising energy concerns.