interviewpath
  • 0day streak
  • 10total XP
  • Level 1

Implement byte-level BPE tokenization (minbpe)

Train byte-level BPE merges, encode and decode text, and inspect how the merges split rare words, numbers, code and non-English text.

Not attemptedAndrej Karpathy (GitHub)Access: free

The exercise happens on Andrej Karpathy (GitHub). Canonical link: https://github.com/karpathy/minbpe. Link check: link responded (5 Oct 2026). Opened from this app 0 times; opening is not counted as an attempt.

Supports: Tokenization questions in LLM interviews; a smaller warm-up for the CS336 tokenizer assignment.

Record an attempt

Outcome

A date is suggested from the outcome.

Attempt history

No attempts recorded yet.