- Repository
- https://github.com/BlinkDL/RWKV-LM
- Owner
- BlinkDL (User)
- Stars
- 14,748
- Forks
- 1,024
- Open issues
- 159
- Language
- Python
- License
- Apache-2.0
- Created
- 2021-08-08
- Last push
- 2026-09-28
- Topics
- attention-mechanism, chatgpt, deep-learning, gpt, gpt-2, gpt-3, language-model, linear-attention, lstm, pytorch, rnn, rwkv
- Snapshot
- 2026-10-18
GitHub · #551
BlinkDL/RWKV-LM
BlinkDL/RWKV-LM is #551 in this GitHub directory, with 14,748 stars. RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 'Goose'. So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training…