GitHub · #747

karpathy/minbpe

karpathy/minbpe is #747 in this GitHub directory, with 10,831 stars. Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Repository: https://github.com/karpathy/minbpe
Owner: karpathy (User)
Stars: 10,831
Forks: 1,118
Open issues: 59
Language: Python
License: MIT
Created: 2024-02-16
Last push: 2024-07-01
Snapshot: 2026-10-18

Back to the GitHub directory · Methodology