DeepSeek tests sparse attention to reduce AI costs

1 Mwezi wa kumi, 2025 Imeripotiwa na AI

Chinese AI firm DeepSeek is experimenting with sparse attention mechanisms to significantly lower the processing costs of large language models. The approach focuses computations on key parts of input data, potentially halving resource demands. This development could make advanced AI more accessible amid rising energy concerns.