#linear-attention

2 pages search “linear-attention” ↳ all tags

Wiki 2

Kimi Delta Attention (KDA) DeltaNet linear attention derived from softmax attention up to KDA's per-key-channel forget gate
Qwen4: The Architecture of the Future (Qwen3.8-Flash-Next) Habr piece from reseller gptunnel on Qwen3.8-Flash-Next, the open-weight preview of Qwen4's architecture; Qwen4 itself is not out