interviewpath
  • 0day streak
  • 10total XP
  • Level 1

Add a KV cache to nanoGPT generation and prove equivalence

Cache keys and values per layer, handle positions and masks for incremental decoding, and test that cached logits equal full-forward logits at every step.

Not attemptedSelf-directed project (nanoGPT as the base)Access: free

The exercise happens on Self-directed project (nanoGPT as the base). Canonical link: https://github.com/karpathy/nanoGPT. Link check: link responded (5 Oct 2026). Opened from this app 0 times; opening is not counted as an attempt.

Supports: Inference-path understanding for research-engineering and AI-infrastructure roles.

Record an attempt

Outcome

A date is suggested from the outcome.

Attempt history

No attempts recorded yet.