Resources
About link checks
npm run links:verify.A Critique of ANSI SQL Isolation Levels
paperMicrosoft Research; Hal Berenson, Phil Bernstein, Jim Gray, Jim Melton, Elizabeth O’Neil, Patrick O’Neil; ACM SIGMOD 1995 (1995)
Shows that the ANSI SQL isolation levels, defined by forbidden phenomena, are ambiguous; adds dirty write and lost update; and gives the first careful definition of snapshot isolation, including write skew. Short, foundational and still the basis of most isolation discussions.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (The Microsoft Research page may block automated requests; the arXiv copy is identical in content.)Uses: Learning, ResearchLinked from 1 topicAlternatives: arXiv version (cs/0701157)(opens in a new tab)
A Google engineer shares her technical interview tips (2022)
Primary listarticleGoogle (The Keyword blog) (2022)
A 2022 Google blog post with an engineer’s advice on technical interviews. Treat it as dated, personal advice published by Google, not as a current process specification.
A guide on good usage of non_blocking and pin_memory() in PyTorch
documentationPyTorch tutorials; Vincent Moens
Careful, measured tutorial on what page-locked memory and non-blocking copies really do, the conditions under which a copy can overlap with kernels, why pinning a tensor right before copying it can be slower than a plain copy, and the wrong results that unsynchronized device-to-host copies produce.
A Metric Learning Reality Check
paperarXiv; Kevin Musgrave, Serge Belongie, Ser-Nam Lim; ECCV 2020 (2020)
Re-evaluates deep metric learning methods under matched architectures, embedding sizes and hyperparameter search without test-set feedback, and finds that reported improvements largely disappear. Read it to see exactly which uncontrolled factors inflated earlier comparisons.
A Recipe for Training Neural Networks
articleAndrej Karpathy's blog; Andrej Karpathy (2019)
A practitioner process for training networks without silent failures: inspect the data, build an end-to-end skeleton with simple baselines, overfit a single batch, then regularize and tune. Its checklist maps directly onto "my model does not learn" questions.
A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning
paperarXiv; Stéphane Ross, Geoffrey J. Gordon, J. Andrew Bagnell; AISTATS 2011 (2011)
Introduces DAgger, which repeatedly collects expert labels on the states the learned policy actually visits, and analyzes why plain behavior cloning suffers from compounding errors. The foundational reference for covariate shift in imitation learning.
A Scalable, Commodity Data Center Network Architecture
paperUC San Diego (author copy); Mohammad Al-Fares, Alexander Loukissas, Amin Vahdat; ACM SIGCOMM 2008 (2008)
Shows how to build a fat-tree (Clos) data-center fabric with high bisection bandwidth from identical commodity switches, and the addressing and multipath routing it needs. A good starting point for data-center topology questions.
A Simple Approach to Thesis Writing
articleUniversity of Waterloo (author page); Tim Brecht (adapted from Alan Mackworth)
Practitioner advice in the form of a chapter-by-chapter outline of a graduate thesis: thesis statement and hypothesis, motivation, goals, contributions, background, design, evaluation and conclusions. Use it to scope a thesis proposal backwards from what the finished document must show.
A Tour of Go
courseThe Go Project (go.dev)
The official interactive introduction, organized into Basics, Methods and interfaces, Generics and Concurrency modules with runnable examples and short exercises. The quickest route to writing Go fluently in an interview; do the exercises rather than only reading the slides.
Accounting for Variance in Machine Learning Benchmarks
paperarXiv; Xavier Bouthillier et al.; MLSys 2021 (2021)
Models the whole benchmarking process and shows that data sampling, parameter initialization and hyperparameter choice each move results markedly; recommends randomizing more sources of variation when comparing models. A good reference for "how many seeds and splits?" discussions.
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
paperarXiv; Priya Goyal, Piotr Dollár, et al. (2017)
Describes the linear learning-rate scaling rule for growing batch sizes together with a gradual warmup, and reports where the recipe stops working. A concrete reference for how batch size, learning rate and warmup interact; treat the rule as an empirical recipe for its setting.
Active Benchmarking
articleBrendan Gregg's website; Brendan Gregg
Argues that a benchmark number means little until you have identified what limited it, and shows how to analyze a benchmark while it runs to catch configuration and measurement errors. A compact antidote to run-it-and-report-the-number benchmarking.
Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations
paperarXiv; Evan Miller (2024)
Applies basic statistics to LLM evaluations: standard errors from the central limit theorem, clustered errors when questions are related, paired comparisons between models, variance reduction by resampling answers, and power analysis. A concise reference for reporting eval results honestly.
AI in the interview is not cheating, it is the job, according to Meta (CoderPad blog)
Primary listarticleCoderPad (interview-platform vendor)
A platform partner’s account of a Meta pilot of AI-enabled coding interviews. It describes a specific program, not a universal Meta policy; follow the instructions in your own interview invitation.
Airbnb careers: candidate FAQ
Primary listcareers pageAirbnb
Airbnb’s candidate FAQ. It answers general hiring questions; the current technical loop is not fully established from this source.
Algorithms (Jeff Erickson) with companion lecture notes
bookJeff Erickson, University of Illinois Urbana-Champaign; Jeff Erickson (2019); 1st edition (June 2019)
A rigorous but readable textbook focused on designing algorithms and arguing that they are correct: recursion, dynamic programming, greedy exchange arguments and graph search. Use single chapters to understand why a technique works; the companion notes cover disjoint sets, proof by induction and solving recurrences.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (The electronic edition and per-chapter PDFs are free on the author’s site; a paperback edition is sold separately.)Uses: Learning, ReferenceLinked from 7 topics10 chapter or section links
- Ch. 1: Recursion(opens in a new tab)
- Ch. 3: Dynamic Programming(opens in a new tab)
- Ch. 4: Greedy Algorithms(opens in a new tab)
- Ch. 5: Basic Graph Algorithms(opens in a new tab)
- Ch. 6: Depth-First Search(opens in a new tab)
- Ch. 8: Shortest Paths(opens in a new tab)
- Ch. 9: All-Pairs Shortest Paths(opens in a new tab)
- Lecture notes: Disjoint Sets(opens in a new tab)
- Lecture notes: Appendix I, Proof by Induction(opens in a new tab)
- Lecture notes: Appendix II, Solving Recurrences(opens in a new tab)
Algorithms (Jeff Erickson): Recursion and Backtracking chapters, with amortized-analysis notes
bookJeff Erickson, University of Illinois Urbana-Champaign; Jeff Erickson (2019)
Two chapters of a free algorithms textbook that teach recursion as reduction to smaller instances and backtracking as recursive search over a sequence of decisions, with careful running-time analysis. The companion amortized-analysis notes work through aggregate, accounting and potential arguments.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Chapter PDFs and lecture notes are free on the author’s site; a paperback edition is sold separately.)Uses: Learning, ReferenceLinked from 3 topicsAlgorithms, 4th Edition booksite
bookPrinceton University; Robert Sedgewick, Kevin Wayne
Free companion site to the Sedgewick and Wayne textbook, with section summaries, tested Java implementations and exercises. The union-find case study builds from naive versions to weighted quick-union with path compression, and the graph pages pair each algorithm with working code.
Open(opens in a new tab)Link responded, 5 Oct 2026Partly free, partly paid (The booksite summaries, Java code and exercises are free; the full textbook is sold separately.)Uses: Learning, ReferenceLinked from 3 topicsAlgorithms, 4th Edition booksite: sorting, searching and trie sections
bookPrinceton University; Robert Sedgewick, Kevin Wayne
Section pages from the free companion site to the Sedgewick and Wayne textbook, each pairing a concise explanation with tested Java code. The quicksort, priority-queue, search-tree, hash-table and trie sections back the data-structure topics in this curriculum.
Open(opens in a new tab)Link responded, 5 Oct 2026Partly free, partly paid (The booksite summaries, Java code and exercises are free; the full textbook is sold separately.)Uses: Learning, ReferenceLinked from 6 topicsAlibaba Cluster Trace Program
datasetAlibaba (GitHub)
Production traces from Alibaba data centers, including co-located online services and batch jobs, GPU clusters for machine-learning workloads, microservice call graphs and microarchitectural contention metrics. Especially relevant for co-location and interference questions.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Some trace versions ask for a short survey before the download link is shown.)Uses: Research, PracticeLinked from 1 topicAll File Systems Are Not Created Equal: On the Complexity of Crafting Crash-Consistent Applications
paperUSENIX; Thanumalayan Sankaranarayana Pillai et al.; OSDI 2014 (2014)
Shows that crash guarantees differ across file systems and configurations and that widely used applications silently depend on ordering and atomicity the file system does not promise. Read it to see why durable-update recipes exist and where real applications got them wrong.
Amazon Leadership Principles
careers pageAmazon Jobs
Amazon’s official list of its Leadership Principles, each with a short description. Amazon’s SDE preparation pages tie its behavioral interviews to these principles; use the page to map your own true stories to stated values, not to invent new ones.
Amazon SDE II interview prep
Primary listofficial guideAmazon Jobs
Official Amazon preparation page for Software Development Engineer II candidates, covering the technical areas and Leadership Principles-based behavioral preparation.
Amazon SDE III interview prep
Primary listofficial guideAmazon Jobs
Official Amazon preparation page for senior (SDE III) candidates; expectations differ from SDE II, notably around system design scope and behavioral depth.
Amazon software development topics
Primary listofficial guideAmazon Jobs
Official Amazon list of technical topics software development candidates should review.
Amazon SQS Developer Guide: at-least-once delivery, visibility timeout and exactly-once processing
documentationAmazon Web Services
Concrete documentation of a managed queue: standard queues may deliver a message more than once, the visibility timeout governs redelivery, and FIFO queues deduplicate only within a bounded interval. A good example of how narrow "exactly-once" claims are in practice.
2 chapter or section links
Amdahl's Law in the Multicore Era
paperUniversity of Wisconsin–Madison (Multifacet project); Mark D. Hill, Michael R. Marty; IEEE Computer, July 2008 (2008)
Short, readable article that restates Amdahl’s law and extends it to symmetric, asymmetric and dynamic multicore designs under a fixed chip budget. Useful for naming what the basic law assumes (fixed work, identical cores, no parallel overhead) and how conclusions change when those assumptions move.
An Analysis of Network-Partitioning Failures in Cloud Systems
paperUSENIX; Ahmed Alquraan, Hatem Takruri, Mohammed Alfatafta, Samer Al-Kiswany; OSDI 2018 (2018)
Analyzes partition-induced failures across widely used distributed systems: most are catastrophic, many can be triggered by isolating a single node, and many were avoidable through design review or partition testing. Includes a testing framework for injecting partition faults.
An Empirical Evaluation of In-Memory Multi-Version Concurrency Control
paperPVLDB (VLDB Endowment); Yingjun Wu, Joy Arulraj, Jiexi Lin, Ran Xian, Andrew Pavlo; PVLDB, vol. 10, no. 7 (2017)
Breaks MVCC into design dimensions (concurrency protocol, version storage, garbage collection, index management) and evaluates combinations in one system. Read it for the design-space map and for how the experiments isolate each dimension.
An Empirical Model of Large-Batch Training
paperarXiv; Sam McCandlish, Jared Kaplan, et al. (2018)
Introduces the gradient noise scale as a predictor of the critical batch size, beyond which larger batches give diminishing returns per example. Read the definitions and main figures to reason quantitatively about SGD noise and batch-size choices.
An Evaluation of Distributed Concurrency Control
paperPVLDB (VLDB Endowment); Rachael Harding, Dana Van Aken, Andrew Pavlo, Michael Stonebraker; PVLDB, vol. 10, no. 5 (2017)
Compares six distributed concurrency-control protocols, including a deterministic one, in a common framework on cloud machines and identifies how contention, update rate and commit coordination limit scalability. Useful both for its results and as a template for fair protocol comparisons.
An Evaluation of the Ninth SOSP Submissions, or How (and How Not) to Write a Good Systems Paper
articleUSENIX (reprinted with the authors’ permission); Roy Levin, David D. Redell; ACM SIGOPS Operating Systems Review 17(3), 1983 (1983)
Practitioner advice from two program-committee chairs on how they judged systems papers: original ideas, reality of the system, lessons, design choices, context and focus. Old, but still a sharp checklist for asking whether an idea is new and how it relates to prior work.
1 chapter or section link
- Criteria for Evaluation of Submissions
Anthropic careers
Primary listcareers pageAnthropic
Anthropic’s careers page with open roles and hiring information.
Anthropic: Guidance on candidates’ AI usage
Primary listofficial guideAnthropic
Anthropic’s published policy on when candidates may and may not use AI tools during the application and interview process.
Apache Flink concepts: timely and stateful stream processing
documentationApache Flink documentation
Official concept pages on event time versus processing time, watermarks, lateness and windowing, and on keyed state, checkpoint barriers and recovery. They describe one engine, but the vocabulary transfers to other stream processors.
Check note: Not requested: the site's robots.txt disallows automated access to this path.
2 chapter or section links
- Timely Stream Processing(opens in a new tab) (not checked)
- Stateful Stream Processing(opens in a new tab) (not checked)
Apache Kafka documentation: Design (4.3)
documentationApache Software Foundation; 4.3
The official design notes for Kafka: how consumer positions are tracked, what at-most-once, at-least-once and exactly-once mean for producers and consumers, and how idempotent producers and transactions narrow duplicates within Kafka.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Documentation is versioned; the unversioned documentation page redirects to the latest release.)Uses: Learning, ReferenceLinked from 1 topicApache Parquet: file format
documentationApache Parquet documentation
Describes how a Parquet file is organized into row groups, column chunks and pages with metadata and statistics. A compact real-world example of hybrid columnar layout and of the min/max statistics that let readers skip data.
Apple careers: Software and Services teams
Primary listcareers pageApple
Describes Apple software and services teams and areas of work. It provides role context only; it does not describe a universal interview loop.
Architecture of a Database System
paperUC Berkeley (author-hosted PDF); Joseph M. Hellerstein, Michael Stonebraker, James Hamilton; Foundations and Trends in Databases, vol. 1, no. 2 (2007)
A long survey of how real relational systems are assembled: process models, parallelism, the query processor and optimizer, storage and buffer management, and transactional storage with locking and logging. Use it to see how textbook algorithms fit into one system; skim it once, then return to the chapter that matches the topic you are studying.
3 chapter or section links
- Chapter 4: Relational Query Processor
- Chapter 5: Storage Management
- Chapter 6: Transactions: Concurrency Control and Recovery
Are We Ready For Learned Cardinality Estimation?
paperarXiv; Xiaoying Wang, Changbo Qu, Weiyuan Wu, Jiannan Wang, Qingqing Zhou; PVLDB, vol. 14, no. 9 (arXiv version) (2021)
Evaluates learned single-table cardinality estimators against traditional methods under one setup, including dynamic data, and examines training cost, update handling and unpredictable errors. Essential for an honest view of the learned-estimation debate.
Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches
paperarXiv; Maurizio Ferrari Dacrema, Paolo Cremonesi, Dietmar Jannach; RecSys 2019 (2019)
Attempts to reproduce recently published neural recommendation methods and compares them with carefully tuned simple baselines; only a minority could be reproduced and most of those were beaten by the simple methods. A concrete case study of weak baselines, untuned comparisons and missing artifacts.
Are You Sure You Want to Use MMAP in Your Database Management System?
paperCIDR; Andrew Crotty, Viktor Leis, Andrew Pavlo; CIDR 2022 (2022)
Argues, with correctness problems and experiments, why relying on mmap and the OS page cache instead of a DBMS-managed buffer pool causes transactional-safety, I/O-stall, error-handling and scalability issues. Good evidence for a common interview question.
Alternatives: Project page at CMU(opens in a new tab)
ARIA Authoring Practices Guide (APG)
documentationW3C Web Accessibility Initiative
W3C guidance for building accessible widgets: design patterns with keyboard interaction tables and working examples (dialogs, menus, tabs, comboboxes and more) plus practice pages on keyboard interfaces and accessible names. Start with Read Me First, which explains why incorrect ARIA is worse than none.
Artifact Review and Badging, Version 1.1
standardACM (2020)
ACM policy defining repeatability, reproducibility and replicability (the latter two swapped in version 1.1 to match other sciences) and the badges for available, functional and reusable artifacts and for reproduced and replicated results. The reference vocabulary for artifact evaluation at ACM venues.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026Free (Scripted requests receive a bot-check page (HTTP 403); the page opens normally in a browser.)Uses: Reference, ResearchLinked from 2 topicsCheck note: The site refused or challenged the automated request (HTTP 403). This is common for bot protection and does not mean the link is broken.
asyncio — Asynchronous I/O (Python documentation)
documentationPython Software Foundation (docs.python.org)
Official asyncio documentation. The Coroutines and tasks page covers tasks, task groups, timeouts, cancellation and why you must keep references to tasks; Developing with asyncio explains debug mode and how a blocking call stalls every task on the loop.
2 chapter or section links
Atomic Commit In SQLite
documentationSQLite documentation
Walks step by step through how SQLite makes a transaction atomic and durable with a rollback journal, and lists the assumptions it makes about the OS and hardware (what fsync does, sector writes, disks that acknowledge writes early). A concrete case study in reasoning about persistence boundaries.
Attention Is All You Need
Primary listpaperarXiv; Ashish Vaswani et al.; NeurIPS 2017 (2017)
Introduces the Transformer: scaled dot-product attention, multi-head attention, positional encodings and an encoder-decoder built without recurrence. The baseline vocabulary for every later LLM paper.
Avoiding insurmountable queue backlogs
articleAmazon Builders' Library; David Yanacek
Covers how queue-based systems fall so far behind that they cannot recover, and the countermeasures: measuring backlog age, isolating tenants, prioritizing fresh work and bounding retries. Useful for job-scheduler and fan-out designs.
Alternatives: Official PDF version(opens in a new tab)
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
paperarXiv; Ji Lin et al.; MLSys 2024 (2023)
Weight-only quantization that identifies salient weight channels from activation statistics and protects them with per-channel scaling instead of keeping them in higher precision, without backpropagation. Also discusses the kernels needed to turn smaller weights into faster decoding.
AWS Lambda: Understanding the Lambda execution environment lifecycle
documentationAmazon Web Services
Official description of the init, invoke and shutdown phases of a Lambda execution environment, what happens during a cold start, and the platform features meant to reduce cold-start latency. A concrete production view to compare with the research papers.
Azure Public Dataset
datasetMicrosoft Azure and Microsoft Research (GitHub)
Collection of sanitized Azure traces with documentation per dataset: VM workloads, a VM packing trace, Azure Functions invocations, LLM inference request traces with token counts, and benchmark noise data. Each dataset page names the paper it accompanies, which you should read before drawing conclusions.
BBR Congestion Control (IETF Internet-Draft draft-ietf-ccwg-bbr)
standardIETF Datatracker; Neal Cardwell, Ian Swett, Joseph Beshay
Working-group draft specifying the current version of BBR (BBRv3), with its path model, state machine and use of the packet loss rate. Use it to state precisely which BBR version a result applies to; the original 2016 article describes BBRv1.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Work in progress: an Internet-Draft, not an RFC. Check the revision you cite.)Uses: Reference, ResearchLinked from 1 topicBBR: Congestion-Based Congestion Control
Primary listpaperGoogle Research; Neal Cardwell, Yuchung Cheng, C. Stephen Gunn, Soheil Hassas Yeganeh, Van Jacobson; ACM Queue, vol. 14, 2016 (2016)
Introduces BBR, which estimates bottleneck bandwidth and round-trip propagation time instead of treating loss as the congestion signal. Read it as a design argument plus deployment observations; later independent studies examined fairness and buffer-dependent behavior across versions.
Beej's Guide to Network Programming
bookbeej.us (author site); Brian "Beej Jorgensen" Hall
Long-standing free guide to the BSD sockets API in C: addresses, socket, bind, listen, accept, connect, send and recv, blocking versus non-blocking sockets and poll. Write the examples yourself rather than reading them.
BenchBase: multi-DBMS SQL benchmarking framework
toolGitHub (CMU Database Group)
JDBC-based framework (the successor of OLTP-Bench) that runs implementations of TPC-C, YCSB and other workloads against many relational databases with controlled rates and mixes. Useful for reproducible OLTP experiments without writing a load generator.
Benchmarking Learned Indexes
paperarXiv; Ryan Marcus, Andreas Kipf, Alexander van Renen, et al.; arXiv preprint (2020) (2020)
Compares tuned learned index structures with strong traditional baselines on several real datasets and analyzes why learned structures win where they do (read-only, in-memory lookups over sorted arrays). The counterweight to reading the original learned-index paper alone.
Berkeley CS 185/285: Deep Reinforcement Learning
courseUC Berkeley
Graduate deep-RL course with public slides and homework handouts covering imitation learning, policy gradients, actor-critic, value-based and model-based RL. Its behavioral-cloning lectures and imitation-learning homework are a practical entry point to robot learning.
Berkeley CS186 Database Systems course notes
courseUC Berkeley CS186
Concise, free course notes covering SQL, storage, B+ trees, sorting and hashing, join costs, query optimization, concurrency control, recovery, parallel query processing and distributed transactions, with worked examples and, in most notes, practice questions with solutions. A good second explanation next to the CMU lecture notes, especially for I/O cost arithmetic.
14 chapter or section links
- Note 1: SQL Part 1 - Basic Queries(opens in a new tab)
- Note 2: SQL Part 2 - Joins & Subqueries(opens in a new tab)
- Note 4: B+Trees(opens in a new tab)
- Note 5: Buffer Management(opens in a new tab)
- Note 6: Relational Algebra(opens in a new tab)
- Note 8: Sorting(opens in a new tab)
- Note 9: Iterators and Joins(opens in a new tab)
- Note 10: Query Optimization(opens in a new tab)
- Note 11: Transactions & Concurrency I(opens in a new tab)
- Note 12: Transactions & Concurrency II(opens in a new tab)
- Note 13: DB Design(opens in a new tab)
- Note 14: Recovery(opens in a new tab)
- Note 15: Parallel Query Processing(opens in a new tab)
- Note 16: Distributed Transactions(opens in a new tab)
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
paperarXiv; Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova; NAACL 2019 (2018)
Introduces masked-language-model pretraining for a bidirectional transformer encoder, followed by task-specific fine-tuning. Read it to contrast the masked objective with next-token prediction and to see why encoder models still underpin many embedding and reranking systems.
Beyond Jain's Fairness Index: Setting the Bar For The Deployment of Congestion Control Algorithms
paperSwarthmore College (author copy); Ranysha Ware, Matthew K. Mukerjee, Srinivasan Seshan, Justine Sherry; ACM HotNets 2019 (2019)
Position paper arguing that new congestion-control algorithms should be judged by the harm they cause to existing traffic rather than by equal shares. Useful for choosing and defending fairness metrics in an evaluation.
BIND 9 manual pages (dig)
documentationInternet Systems Consortium (BIND 9 documentation)
Official manual pages for the BIND tools, including dig. Use the dig page for query options such as +trace, +norecurse and choosing which server to ask.
1 chapter or section link
Bit Twiddling Hacks
articleStanford University (author page); Sean Eron Anderson
A long-standing catalogue of bit-level tricks for C, such as power-of-two tests, counting and reversing bits, and sign manipulation. Use it as a pattern reference and verify each trick with your own tests; many assume fixed-width unsigned arithmetic that does not carry over to Python.
Borg, Omega, and Kubernetes
articleGoogle Research; Brendan Burns, Brian Grant, David Oppenheimer, Eric Brewer, John Wilkes; ACM Queue, vol. 14, 2016 (2016)
Design lessons from three generations of container managers: why pods, labels, a uniform API and independent reconciling controllers replaced a monolithic master. Explains the reasoning behind Kubernetes rather than its commands.
BoundedContext
articlemartinfowler.com; Martin Fowler (2014)
Short explanation of the domain-driven design practice of dividing a large domain model into bounded contexts, each internally consistent, with explicit relationships between them. Useful vocabulary for discussing data ownership across teams and services.
Bufferbloat: Dark Buffers in the Internet
articleACM Queue; Jim Gettys, Kathleen Nichols (2011)
Accessible article on bufferbloat: oversized, persistently full buffers in home routers and access links that add large delays without adding throughput. Read it for the mechanism and the motivation for AQM.
Open(opens in a new tab)Not checked, 5 Oct 2026Free (Free to read; the site may show a browser check to automated clients.)Uses: LearningLinked from 2 topicsCheck note: Not requested: the site's robots.txt disallows automated access to this path.
Building Effective Agents
Primary listarticleAnthropic Engineering
Practitioner guidance distinguishing predefined workflows (prompt chaining, routing, parallelization, orchestrator-workers, evaluator-optimizer) from autonomous agents, and arguing for the simplest pattern that works.
C++ Core Guidelines
documentationStandard C++ Foundation (isocpp.github.io); Bjarne Stroustrup, Herb Sutter (editors)
A large, continuously maintained set of rules for modern C++, each with a reason, examples and enforcement notes. Use it by rule number for ownership, lifetime, class design and concurrency questions rather than reading it front to back.
13 chapter or section links
- R: Resource management(opens in a new tab)
- R.1: Manage resources automatically using resource handles and RAII(opens in a new tab)
- R.21: Prefer unique_ptr over shared_ptr unless you need to share ownership(opens in a new tab)
- C.20: If you can avoid defining default operations, do(opens in a new tab)
- C.21: If you define or =delete any copy, move, or destructor function, define or =delete them all(opens in a new tab)
- C.35: A base class destructor should be either public and virtual, or protected and non-virtual(opens in a new tab)
- C.64: A move operation should move and leave its source in a valid state(opens in a new tab)
- F.43: Never (directly or indirectly) return a pointer or a reference to a local object(opens in a new tab)
- ES.56: Write std::move() only when you need to explicitly move an object to another scope(opens in a new tab)
- ES.63: Don't slice(opens in a new tab)
- CP: Concurrency and parallelism(opens in a new tab)
- CP.2: Avoid data races(opens in a new tab)
- CP.8: Don't try to use volatile for synchronization(opens in a new tab)
Caching challenges and strategies
articleAmazon Builders' Library; Matt Brinkley, Jas Chhabra
Practitioner guidance on local versus external caches, choosing TTLs, negative caching, cold caches after deploys, and the danger of a service silently depending on its hit rate to stay within capacity.
Alternatives: Official PDF version(opens in a new tab)
Calvin: Fast Distributed Transactions for Partitioned Database Systems
paperYale University (author-hosted PDF); Alexander Thomson, Thaddeus Diamond, Shu-Chun Weng, Kun Ren, Philip Shao, Daniel J. Abadi; ACM SIGMOD 2012 (2012)
Deterministic transaction processing: replicate and order transaction inputs first, then execute them in that order on every replica, which removes the need for two-phase commit at commit time. Read it as the main contrast to Spanner’s clock-based approach, paying attention to the requirement to know read and write sets.
Alternatives: Copy on Daniel Abadi’s UMD page(opens in a new tab)
Can Applications Recover from fsync Failures?
paperUSENIX; Anthony Rebello et al.; USENIX ATC 2020 (2020)
Studies how file systems behave after an fsync failure and how several applications, including databases, react, finding cases of data loss and corruption. Read it to see how durability assumptions in logging protocols can fail underneath them.
Canarying Releases (The Site Reliability Workbook, Ch. 16)
bookGoogle (free online edition); Betsy Beyer, Niall Richard Murphy, David K. Rensin, Kent Kawahara, Stephen Thorne (eds.) (2018)
Practical chapter on canarying: how it fits into release engineering, choosing and evaluating metrics, comparing a canary with a control population, dependencies and isolation, and canarying non-interactive systems. Read it before designing any progressive rollout.
Catalog of Refactorings
documentationrefactoring.com (martinfowler.com); Martin Fowler
Online index of named, behavior-preserving transformations from Fowler’s Refactoring. Useful for planning a restructuring as a sequence of small, testable steps and for naming what you are doing in a review or interview.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (The online catalog summarizes each refactoring; the full step-by-step mechanics are in the book Refactoring (2nd edition).)Uses: ReferenceLinked from 1 topicCFS Bandwidth Control and cgroup v2 (Linux kernel documentation)
documentationThe Linux Kernel documentation (docs.kernel.org)
Kernel documentation for container resource control. The main page explains CPU quota and period, throttling statistics and the caveats for multithreaded groups; the linked cgroup v2 specification defines the CPU, memory, I/O and PID controllers and every interface file. Use them to state precisely what cpu.weight, cpu.max, memory.high and memory.max do and where throttling and OOM kills are counted.
2 chapter or section links
Challenges with distributed systems
articleAmazon Builders' Library; Jacob Gabrielson
Decomposes one request-reply exchange into its separate steps, shows that each can fail independently, and stresses the outcome where the caller cannot know whether the server acted. A good template for failure-mode tables.
Alternatives: Official PDF version(opens in a new tab)
Chaos Engineering
paperarXiv; Ali Basiri, Niosha Behnam, Ruud de Rooij, Lorin Hochstein, Luke Kosewski, Justin Reynolds, Casey Rosenthal; IEEE Software, 2016 (2016)
Describes chaos engineering as controlled experimentation on a production distributed system: define steady state, hypothesize it continues, introduce real-world events, and automate the experiments. Pair it with the community principles page for a concise checklist.
1 chapter or section link
Chrome DevTools: Analyze runtime performance
toolGoogle (developer.chrome.com)
Step-by-step tutorial for recording and reading a Performance panel trace: CPU throttling, the main-thread flame chart, warnings on long tasks and forced reflows. The features reference and the Lighthouse introduction cover the remaining measurement tools.
2 chapter or section links
Citadel: Our engineering interview process
Primary listofficial guideCitadel
Citadel/Citadel Securities description of its campus engineering interview process.
Check note: The site refused or challenged the automated request (HTTP 403). This is common for bot protection and does not mean the link is broken.
Clang sanitizers: UndefinedBehaviorSanitizer, AddressSanitizer and ThreadSanitizer
toolLLVM Project (clang.llvm.org)
Official documentation for the runtime checkers that turn silent undefined behavior, memory errors and data races into reports with stack traces. Use it to learn the -fsanitize flags, what each checker detects and what it cannot detect.
2 chapter or section links
Cloudflare careers
Primary listcareers pageCloudflare
Cloudflare’s careers page with roles and hiring information.
CMU 15-445/645 Intro to Database Systems
Primary listcourseCarnegie Mellon University Database Group
Database internals course with public lecture videos and slides on storage, buffer pools, indexes, query execution, optimization, concurrency control and recovery. Its BusTub projects (buffer pool, index, execution, concurrency control) are excellent implementation practice.
CMU 15-721 Advanced Database Systems
Primary listcourseCarnegie Mellon University Database Group
Graduate course on modern analytical database internals: storage formats, vectorized and compiled execution, scheduling, joins, optimizers and system case studies, with a paper reading list. Use it for database research preparation after 15-445-level foundations.
CNCF Platforms White Paper
articleCNCF TAG App Delivery
Vendor-neutral description of internal platforms: what capabilities they offer, treating the platform as a product for internal users, self-service interfaces and how to measure success. Good vocabulary for platform-engineering conversations.
Column-Stores vs. Row-Stores: How Different Are They Really?
paperUniversity of Maryland (author-hosted PDF); Daniel J. Abadi, Samuel R. Madden, Nabil Hachem; ACM SIGMOD 2008 (2008)
Asks whether a row store can imitate a column store through physical design, and which column-store techniques (compression, late materialization, block iteration, invisible joins) account for the difference. A good example of an ablation-style systems evaluation.
Competitive Programmer’s Handbook
bookCSES; Antti Laaksonen (2018)
A compact, implementation-oriented book with C++ examples. Its chapters on greedy algorithms, dynamic programming, bit manipulation and graph algorithms give short, code-level explanations; it is contest-oriented, so pair it with a course for proofs and with interview practice for communication.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Free PDF from the author (draft of July 2018); the expanded printed successor is a separate paid book.)Uses: Learning, ReferenceLinked from 7 topics7 chapter or section links
- Ch. 6: Greedy algorithms
- Ch. 7: Dynamic programming
- Ch. 10: Bit manipulation
- Ch. 12: Graph traversal
- Ch. 13: Shortest paths
- Ch. 15: Spanning trees
- Ch. 16: Directed graphs
Competitive Programmer’s Handbook: search, amortized-analysis, range-query and trie sections
bookCSES; Antti Laaksonen (2018)
A compact, implementation-oriented book with C++ examples. Its short sections on the two-pointer method, nearest smaller elements, the sliding-window minimum, prefix sums and difference arrays explain the amortized patterns in this curriculum together with the argument for why each is linear.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Free PDF linked from the book page (draft of July 2018).)Uses: Learning, ReferenceLinked from 6 topicsComputer Networks: A Systems Approach
bookSystems Approach (open online edition); Larry Peterson, Bruce Davie; Open online edition; section numbers as shown on the site
Free, continuously updated edition of a standard networking textbook (listed as an optional text by Stanford CS144). Each section pairs a mechanism with the design reasoning behind it; read the linked sections per topic rather than cover to cover.
Open(opens in a new tab)Link responded, 5 Oct 2026FreeUses: Learning, ReferenceLinked from 10 topics17 chapter or section links
- 1.3 Architecture(opens in a new tab)
- 1.5 Performance(opens in a new tab)
- 3.2 Switched Ethernet(opens in a new tab)
- 3.3 Internet (IP)(opens in a new tab)
- 3.4 Routing(opens in a new tab)
- 4.1 Global Internet(opens in a new tab)
- 4.2 IP Version 6(opens in a new tab)
- 5.1 Simple Demultiplexor (UDP)(opens in a new tab)
- 5.2 Reliable Byte Stream (TCP)(opens in a new tab)
- 6.1 Issues in Resource Allocation(opens in a new tab)
- 6.2 Queuing Disciplines(opens in a new tab)
- 6.3 TCP Congestion Control(opens in a new tab)
- 6.4 Advanced Congestion Control(opens in a new tab)
- 8.5 Example Systems(opens in a new tab)
- 9.1 Traditional Applications(opens in a new tab)
- 9.3 Infrastructure Applications(opens in a new tab)
- 9.4 Overlay Networks(opens in a new tab)
Concrete Problems in AI Safety
paperarXiv; Dario Amodei, Chris Olah, Jacob Steinhardt, Paul Christiano, John Schulman, Dan Mané (2016)
Frames practical safety research problems: negative side effects, reward hacking, scalable oversight, safe exploration and robustness to distribution shift. A short conceptual map that gives shared vocabulary for alignment-evaluation discussions.
Congestion Avoidance and Control
paperLawrence Berkeley National Laboratory (author copy); Van Jacobson, Michael J. Karels; ACM SIGCOMM 1988 (revised version, November 1988) (1988)
The paper that introduced slow start, RTT-variance-based retransmission timeouts and AIMD congestion avoidance after the congestion collapses of the mid-1980s. Read it for the conservation-of-packets argument that still frames congestion control.
Consensus on Transaction Commit
paperarXiv; Jim Gray, Leslie Lamport; arXiv preprint (published in ACM TODS, 2006) (2004)
Explains why two-phase commit blocks when the coordinator fails and presents Paxos Commit, which runs consensus on each participant’s vote. The clearest bridge between atomic commit and consensus.
Consistency Models (Jepsen)
articleJepsen; Kyle Kingsbury
A map of consistency models ordered by strength, with one short page per model saying what it allows and whether it can remain available during a partition. Use it to place linearizability, serializability, strict serializability, causal consistency and the session guarantees relative to each other.
8 chapter or section links
- Linearizability(opens in a new tab)
- Strong (strict) serializability(opens in a new tab)
- Serializability(opens in a new tab)
- Sequential consistency(opens in a new tab)
- Causal consistency(opens in a new tab)
- Read your writes(opens in a new tab)
- Monotonic reads(opens in a new tab)
- Snapshot isolation(opens in a new tab)
Consistency Tradeoffs in Modern Distributed Database System Design
paperUniversity of Maryland (author copy); Daniel J. Abadi; IEEE Computer, vol. 45, 2012 (2012)
Introduces the PACELC framing: beyond the partition-time choice between availability and consistency, replicated systems trade latency against consistency in normal operation. Useful for explaining why systems weaken consistency even when the network is healthy.
Consumer-Driven Contracts: A Service Evolution Pattern
articlemartinfowler.com; Ian Robinson (2006)
Introduces consumer-driven contracts: each consumer states the parts of a provider’s interface it relies on, and the provider checks itself against those expectations so it can evolve without breaking them. The conceptual basis of today’s contract-testing tools.
1 chapter or section link
Controlling Queue Delay
articleACM Queue; Kathleen Nichols, Van Jacobson (2012)
Introduces CoDel by separating queues that absorb bursts from standing queues that only add delay, and controls the latter using packet sojourn time. A model of reasoning from queue dynamics to a mechanism.
Open(opens in a new tab)Not checked, 5 Oct 2026Free (Free to read; the site may show a browser check to automated clients.)Uses: Learning, ResearchLinked from 1 topicCheck note: Not requested: the site's robots.txt disallows automated access to this path.
Coz: Finding Code that Counts with Causal Profiling
paperarXiv; Charlie Curtsinger, Emery D. Berger; SOSP 2015 (2015)
Causal profiling runs virtual-speedup experiments, slowing everything else down to estimate how much end-to-end throughput or latency would improve if one code region were faster. Read it to understand why the hottest code is not always the code that matters.
1 chapter or section link
CPI²: CPU performance isolation for shared compute clusters
paperGoogle Research; Xiao Zhang, Eric Tune, Robert Hagmann, Rohit Jnagal, Vrigo Gokhale, John Wilkes; EuroSys 2013 (2013)
Uses cycles-per-instruction measurements from hardware counters to notice when a task is slowed by interference in shared caches or memory, identify likely antagonists and throttle them. A concrete answer to "how would you detect and handle a noisy neighbor?"
cppreference: C++ containers library, priority_queue, sort and lower_bound
documentationcppreference.com
Community-maintained reference that tracks the C++ standard closely. The container pages state complexity guarantees and per-operation iterator-invalidation rules; read them with the std::sort, std::priority_queue and std::lower_bound pages if C++ is your interview language.
9 chapter or section links
- std::vector (complexity and iterator invalidation)(opens in a new tab)
- std::deque(opens in a new tab)
- std::unordered_map(opens in a new tab)
- std::map(opens in a new tab)
- std::priority_queue(opens in a new tab)
- std::sort(opens in a new tab)
- std::stable_sort(opens in a new tab)
- std::lower_bound(opens in a new tab)
- Named requirement: Compare (strict weak ordering)(opens in a new tab)
cppreference.com: C++ reference
documentationcppreference.com (community-maintained reference)
The most precise freely available reference for the C++ language and standard library, organized by feature and annotated by standard version. Treat the pages below as ground truth for lifetime, move, ownership, container invalidation, undefined behavior and atomics questions.
13 chapter or section links
- RAII(opens in a new tab)
- Lifetime (including temporary object lifetime)(opens in a new tab)
- Value categories(opens in a new tab)
- Move constructors(opens in a new tab)
- std::move(opens in a new tab)
- The rule of three/five/zero(opens in a new tab)
- std::unique_ptr(opens in a new tab)
- std::shared_ptr(opens in a new tab)
- std::weak_ptr(opens in a new tab)
- Containers library: Iterator invalidation(opens in a new tab)
- virtual function specifier(opens in a new tab)
- Undefined behavior(opens in a new tab)
- std::memory_order(opens in a new tab)
CS229 section notes: Review of Probability Theory
courseStanford University (CS229 section notes); Arian Maleki, Tom Do
Compact refresher on probability spaces, random variables, expectation, variance, covariance, joint and conditional distributions and the common distributions. Read it in one sitting with the CS229 linear algebra review before redoing likelihood-based derivations.
CUDA C++ Best Practices Guide
documentationNVIDIA Documentation
Practical guide organized around assessing, parallelizing, optimizing and deploying GPU code. Its memory-optimization chapter (pinned memory, overlapping transfers with computation, coalesced access, shared memory) and its occupancy discussion are the parts most relevant to ML systems work.
CUDA Programming Guide
documentationNVIDIA Documentation
The reference description of the CUDA programming model: grids, thread blocks and warps, the memory hierarchy, streams and asynchronous execution, multi-GPU systems and CUDA Graphs. Read the programming-model chapter for vocabulary and use the rest as reference when a profiler trace raises a question.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (NVIDIA reorganized this guide (formerly the CUDA C++ Programming Guide); use the section links below rather than older chapter numbers.)Uses: Learning, ReferenceLinked from 1 topicData Center TCP (DCTCP)
paperMIT CSAIL (author copy); Mohammad Alizadeh, Albert Greenberg, David A. Maltz, Jitendra Padhye, Parveen Patel, Balaji Prabhakar, Sudipta Sengupta, Murari Sridharan; ACM SIGCOMM 2010 (2010)
Characterizes data-center traffic and its impairments (incast, queue buildup, buffer pressure), then proposes ECN marking at a queue threshold with a sender that reduces its window in proportion to the fraction of marked packets. Combines measurement, analysis and testbed evaluation.
Data Distribution Shifts and Monitoring
articleChip Huyen's blog (practitioner); Chip Huyen (2022)
Long practitioner essay on why deployed models degrade: covariate, label and concept shift, how to detect shifts statistically, and what to monitor when labels arrive late or never. A good bridge from textbook definitions of shift to operational practice.
Data Race Detector (Go documentation)
toolThe Go Project (go.dev)
How to run the race detector with go test -race, how to read its reports, and a catalogue of typical races such as loop-counter capture and unsynchronized send and close. It only reports races on code paths that actually execute, so realistic test coverage matters.
2 chapter or section links
Databricks engineering interview prep guide (April 2025, PDF)
Primary listofficial guideDatabricks (2025)
Databricks’ April 2025 engineering interview preparation PDF, including guidance on systems-programming and database-specific assessments.
Databricks interview prep hub
Primary listofficial guideDatabricks
Databricks’ official interview preparation hub linking role-specific guides.
dblp computer science bibliography
toolSchloss Dagstuhl – Leibniz Center for Informatics
Open bibliography of computer science venues and authors. Use it to list a venue’s proceedings by year, read a lab’s or author’s complete publication record and check for closely related work before claiming novelty.
Open(opens in a new tab)Not checked, 5 Oct 2026Free (Scripted requests may see a bot check; the site opens normally in a browser.)Uses: Research, ReferenceLinked from 1 topicCheck note: Not requested: the site's robots.txt disallows automated access to this path.
Decoupled Weight Decay Regularization
paperarXiv; Ilya Loshchilov, Frank Hutter; ICLR 2019 (2017)
Shows that an L2 penalty and weight decay stop being equivalent under adaptive optimizers such as Adam, and proposes applying the decay directly to the weights (AdamW). Read the introduction and method to explain why AdamW became the usual choice for transformer training.
Deep Learning
bookMIT Press (free online edition at deeplearningbook.org); Ian Goodfellow, Yoshua Bengio, Aaron Courville (2016)
Standard deep-learning textbook. Its applied-math chapters and its chapters on regularization, optimization and practical methodology remain solid references; it predates transformers and current LLM practice, so use newer material for those.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Chapters can be read free on the book site; the printed book is sold by MIT Press.)Uses: Learning, ReferenceLinked from 2 topics8 chapter or section links
- Ch. 2: Linear Algebra(opens in a new tab)
- Ch. 3: Probability and Information Theory(opens in a new tab)
- Ch. 4: Numerical Computation(opens in a new tab)
- Ch. 5: Machine Learning Basics(opens in a new tab)
- Ch. 6: Deep Feedforward Networks(opens in a new tab)
- Ch. 7: Regularization for Deep Learning(opens in a new tab)
- Ch. 8: Optimization for Training Deep Models(opens in a new tab)
- Ch. 11: Practical Methodology(opens in a new tab)
Deep Learning Tuning Playbook
articleGoogle Research on GitHub (not an officially supported Google product); Varun Godbole, George E. Dahl, Justin Gilmer, Christopher J. Shallue, Zachary Nado (2023)
Systematic guidance on choosing an architecture, optimizer, batch size and initial configuration, then running incremental, hypothesis-driven tuning experiments. Useful for explaining how you would tune under a fixed compute budget instead of listing hyperparameters.
Deep Reinforcement Learning that Matters
paperarXiv; Peter Henderson, Riashat Islam, Philip Bachman, Joelle Pineau, Doina Precup, David Meger; AAAI 2018 (2017)
Shows how random seeds, hyperparameters, environment details and codebase differences change deep-RL results, and recommends reporting practices and significance testing. Essential context for RL claims and a vivid general demonstration of seed variance.
Defeating Prompt Injections by Design
paperarXiv; Edoardo Debenedetti et al. (2025)
Proposes CaMeL, a system layer that extracts control and data flow from the trusted user query so untrusted tool data cannot change the program flow, and uses capabilities to enforce policies on what data may reach which tool calls. Read it as a systems-security answer to injection rather than a better prompt.
Defining Liveness
paperCornell University (author copy); Bowen Alpern, Fred B. Schneider; Information Processing Letters, 1985 (1985)
Gives formal definitions of safety and liveness properties and shows that every property is the intersection of a safety property and a liveness property. Short; read it for precise vocabulary when classifying guarantees.
Demystifying evals for AI agents
Primary listarticleAnthropic Engineering
Practitioner article on designing evaluations for agents: defining tasks and success, grading approaches, handling nondeterminism and using evals during development. Use it alongside classic ML evaluation material.
Dense Passage Retrieval for Open-Domain Question Answering
paperarXiv; Vladimir Karpukhin et al.; EMNLP 2020 (2020)
Trains a dual encoder (separate question and passage encoders) with in-batch negatives and BM25-mined hard negatives, so retrieval becomes a maximum inner-product search over precomputed passage vectors. Read it for the training recipe and for how retrieval accuracy is reported separately from answer accuracy.
Design Docs at Google
articleIndustrial Empathy (Malte Ubl’s blog); Malte Ubl
Describes the informal design documents used at Google: context and scope, goals and non-goals, the design itself, alternatives considered and cross-cutting concerns. The same structure works for preparing a project deep dive or a written design proposal.
Designing Access Methods: The RUM Conjecture
paperOpenProceedings (EDBT); Manos Athanassoulis, Michael S. Kester, Lukas M. Maas, Radu Stoica, Stratos Idreos, Anastasia Ailamaki, Mark Callaghan; EDBT 2016 (2016)
Short vision paper arguing that access methods trade read overhead, update overhead and memory (space) overhead, and that improving two costs the third. A useful frame for comparing B+ trees, LSM trees, hash indexes and filters.
Designing and Interpreting Probes with Control Tasks
paperarXiv; John Hewitt, Percy Liang; EMNLP 2019 (2019)
Introduces control tasks and selectivity to separate what a representation encodes from what a flexible probe can learn on its own, and shows how probe-capacity choices change conclusions. The standard reference for doing probing carefully.
Designing Data-Intensive Applications
Primary listbookO'Reilly Media (author's book site); Martin Kleppmann (2nd edition with Chris Riccomini); 1st edition (2017) chapter numbering; 2nd edition reorganized
The standard bridge between databases and distributed systems: storage engines, replication, partitioning, transactions, consistency, consensus, batch and stream processing. Chapter references below use the 1st edition numbering; the 2nd edition reorganizes some chapters, so match by chapter title.
Open(opens in a new tab)Link responded, 5 Oct 2026Paid (Commercial book; the site links to purchase options and the author’s supporting material.)Uses: Learning, ReferenceLinked from 16 topics12 chapter or section links
- Ch. 1: Reliable, Scalable, and Maintainable Applications
- Ch. 2: Data Models and Query Languages
- Ch. 3: Storage and Retrieval
- Ch. 4: Encoding and Evolution
- Ch. 5: Replication
- Ch. 6: Partitioning
- Ch. 7: Transactions
- Ch. 8: The Trouble with Distributed Systems
- Ch. 9: Consistency and Consensus
- Ch. 10: Batch Processing
- Ch. 11: Stream Processing
- Ch. 12: The Future of Data Systems
Designs, Lessons and Advice from Building Large Distributed Systems (LADIS 2009 keynote slides)
articleCornell University (LADIS 2009 workshop site); Jeff Dean; LADIS 2009 keynote (2009)
Keynote slides that include a table of approximate latencies for memory, disk, network and datacenter operations and short back-of-the-envelope design examples. The absolute numbers are dated (hardware has moved on); the habit of estimating before designing is the point.
Dev.java: Learn Java
documentationOracle (dev.java)
Oracle’s current official Java tutorials, updated for recent releases. The collections framework, generics, records and virtual-threads tutorials cover most of what an interviewer checks when Java is your chosen language.
Difficulties in Simulating the Internet
paperICSI (author copy); Sally Floyd, Vern Paxson; IEEE/ACM Transactions on Networking (2001)
Classic methodology paper on why the Internet is hard to model: heterogeneity of links, protocols and traffic, and constant change. Its advice to search for results that hold across wide parameter ranges applies to emulation and testbeds too.
Diffusion Policy: Visuomotor Policy Learning via Action Diffusion
paperarXiv; Cheng Chi, Zhenjia Xu, et al.; RSS 2023 (2023)
Represents a robot policy as a conditional denoising diffusion process over short action sequences, which handles multimodal demonstrations and improves temporal consistency. A representative modern imitation-learning method to read after behavior cloning and DAgger.
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Primary listpaperarXiv; Rafael Rafailov et al.; NeurIPS 2023 (2023)
Derives a classification-style loss on preference pairs that optimizes the same KL-regularized objective as RLHF without training a separate reward model or running RL. Study the derivation and the role of the reference policy.
Disaster Recovery of Workloads on AWS: Recovery in the Cloud
documentationAmazon Web Services (whitepaper)
Defines recovery time and recovery point objectives and compares DR strategies from backup-and-restore through pilot light and warm standby to active-active, with their cost and recovery tradeoffs. The concepts transfer to any provider.
1 chapter or section link
Distill (journal archive)
articleDistill
Archive of interactive, peer-reviewed explanatory articles on machine learning, including foundational interpretability work on feature visualization, circuits and attribution baselines. The journal stopped publishing new articles in 2021, so treat it as a high-quality archive rather than a current venue.
Distributed Systems (Cambridge Concurrent and Distributed Systems, 2021/22)
courseUniversity of Cambridge; Martin Kleppmann (2021)
A compact, rigorous undergraduate course on system models, clocks, broadcast, quorum replication, Raft, two-phase commit, linearizability and eventual consistency, with free lecture notes and recorded lectures. The clearest short source for fault and timing models and for consistency definitions.
1 chapter or section link
DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving
paperUSENIX; Yinmin Zhong et al.; OSDI 2024 (2024)
Frames serving quality as goodput, the request rate that can be served while meeting time-to-first-token and time-per-output-token targets, and argues for running prefill and decode on separate GPUs to avoid their interference. Read the problem framing even if you never deploy disaggregation.
Dive into Deep Learning
Primary listbookd2l.ai (open-source book); Aston Zhang, Zachary C. Lipton, Mu Li, Alexander J. Smola
Interactive deep-learning book with runnable code for every concept, from linear models through attention, transformers, optimization and computational performance. Good for implementing ideas yourself rather than only reading about them.
Do ImageNet Classifiers Generalize to ImageNet?
paperarXiv; Benjamin Recht, Rebecca Roelofs, Ludwig Schmidt, Vaishaal Shankar; ICML 2019 (2019)
Rebuilds test sets by following the original dataset-creation process and measures accuracy drops across many published models. Read it to understand test-set reuse, sensitivity to small collection differences, and why model rankings can be more stable than absolute numbers.
Documenting Architecture Decisions
articleCognitect blog; Michael Nygard (2011)
The short post that introduced architecture decision records: one small document per significant decision with its context, the decision, its status and its consequences. A lightweight format for recording and later explaining design choices.
Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus
paperarXiv; Jesse Dodge, Maarten Sap, et al.; EMNLP 2021 (2021)
Audits a widely used web-scale pretraining corpus, including how much benchmark data it contains and what its filtering removes. A practical model for contamination checks against pretraining data and for documenting a corpus before trusting evaluations of models trained on it.
Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World
paperarXiv; Josh Tobin, Rachel Fong, Alex Ray, Jonas Schneider, Wojciech Zaremba, Pieter Abbeel; IROS 2017 (2017)
Trains an object-localization network only on simulated images with heavily randomized textures, lighting and camera poses and uses it on a real robot. The canonical reference for visual domain randomization.
Dominant Resource Fairness: Fair Allocation of Multiple Resource Types
paperUSENIX; Ali Ghodsi, Matei Zaharia, Benjamin Hindman, Andy Konwinski, Scott Shenker, Ion Stoica; NSDI 2011 (2011)
Generalizes max-min fairness to several resource types by equalizing each user’s dominant share, and proves that the result provides sharing incentive, strategy-proofness, envy-freeness and Pareto efficiency, comparing it with asset fairness and competitive equilibrium. The standard reference for multi-resource fairness.
Don't Block the Event Loop (or the Worker Pool)
documentationNode.js documentation (Learn)
Explains why one slow callback delays every client of an event-loop server, what the worker pool is for, and two remedies for expensive work: partitioning it into short steps or offloading it. The lessons carry over directly to asyncio, Tokio and other event-loop runtimes.
Dynamo: Amazon's Highly Available Key-value Store
Primary listpaperAll Things Distributed (Werner Vogels); Giuseppe DeCandia et al.; SOSP 2007 (2007)
Design of a leaderless, always-writable key-value store using consistent hashing, sloppy quorums, hinted handoff, vector clocks and anti-entropy. A key example of choosing availability and pushing conflict resolution to the application.
Effective Go
documentationThe Go Project (go.dev)
The classic guide to idiomatic Go: slices and maps, interfaces, errors, panics, goroutines and channels. Its sections on data, interfaces and concurrency remain the reference for idiom even though later language features are missing.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Written for the 2009 release and not actively updated; it does not cover generics, modules or newer libraries.)Uses: Learning, ReferenceLinked from 1 topicEfficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM
paperarXiv; Deepak Narayanan et al.; SC 2021 (2021)
Combines tensor, pipeline and data parallelism and analyzes how they interact: the pipeline bubble as a function of stages and micro-batches, an interleaved schedule that shrinks it, and why tensor parallelism belongs inside a node. Read the analysis sections for the reasoning, not only the throughput plots.
Efficient Memory Management for Large Language Model Serving with PagedAttention
Primary listpaperarXiv; Woosuk Kwon et al.; SOSP 2023 (2023)
The vLLM paper: stores the KV cache in fixed-size blocks managed like virtual-memory pages, reducing fragmentation and enabling sharing, which lets continuous batching admit more concurrent requests.
Efficiently Compiling Efficient Query Plans for Modern Hardware
paperPVLDB (VLDB Endowment); Thomas Neumann; PVLDB, vol. 4, no. 9 (2011)
Introduces data-centric code generation: compile each pipeline into tight code that pushes tuples from one pipeline breaker to the next, keeping them in registers. The reference design for compiling query engines.
Engineering and interviewing at HRT (October 2025)
Primary listarticleHudson River Trading (HRTbeat) (2025)
HRT’s October 2025 post describing engineering work and its interview process.
Check note: The site refused or challenged the automated request (HTTP 403). This is common for bot protection and does not mean the link is broken.
Ensuring data reaches disk
articleLWN.net; Jeff Moyer (2011)
Follows data through each buffering layer between an application and stable storage (library buffers, page cache, device cache) and shows which calls move it across each boundary: fflush, fsync, fdatasync, O_SYNC, O_DIRECT and fsync on the parent directory. Direct preparation for “what does durable mean?”.
Envoy documentation: load balancing overview
documentationEnvoy Proxy project
Concise reference for how a modern L7 proxy chooses backends (round robin, least request, ring hash, Maglev and others) and the related pages on health checking, outlier detection and panic thresholds.
etcd documentation (v3.6): API guarantees and API model
documentationetcd project (CNCF)
States precisely which consistency etcd offers for reads and writes and how revisions, leases and watches behave. A concrete example of a Raft-backed coordination store, and the store behind the Kubernetes control plane.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Documentation is versioned; newer releases live under a different version path.)Uses: Learning, ReferenceLinked from 1 topicEverything curl
documentationcurl project; Daniel Stenberg
Free book from the curl project. The write-out section lists the timing variables that split a request into name lookup, connect, TLS handshake, time to first byte and total time.
1 chapter or section link
Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask
paperPVLDB (VLDB Endowment); Timo Kersten, Viktor Leis, Alfons Kemper, Thomas Neumann, Andrew Pavlo, Peter Boncz; PVLDB, vol. 11, no. 13 (2018)
Implements both execution paradigms in one testbed so that differences come from the paradigm rather than from different systems, and compares them on several query types and hardware effects. Read it for the controlled-comparison method as much as for the findings.
Evolutionary Database Design
articlemartinfowler.com; Pramod Sadalage, Martin Fowler (2016)
Treats every schema change as a versioned, automated migration integrated continuously with application code, and describes a transition phase in which the database supports old and new access patterns at the same time. The practical basis for expand-and-contract schema changes without downtime.
Experimental Evaluation of BBR Congestion Control
paperKarlsruhe Institute of Technology (authors' copy); Mario Hock, Roland Bless, Martina Zitterbart; IEEE ICNP 2017 (2017)
Early independent testbed evaluation of BBRv1 that varies buffer size, RTT and competing flows. Read it next to the original article and record each experiment's conditions alongside its finding.
Fair Benchmarking Considered Difficult: Common Pitfalls In Database Performance Testing
paperHannes Mühleisen (author-hosted PDF); Mark Raasveldt, Pedro Holanda, Tim Gubner, Hannes Mühleisen; DBTest 2018 (SIGMOD workshop) (2018)
A short catalog of the ways database performance comparisons go wrong: unequal tuning, cold versus hot runs, incorrect results, client overheads and more, with a checklist. Read before designing or judging any database benchmark.
Fast Transformer Decoding: One Write-Head is All You Need
paperarXiv; Noam Shazeer (2019)
Introduces multi-query attention (all heads share one key and value projection) and argues from memory-bandwidth analysis that incremental decoding is limited by loading keys and values. A short paper whose performance reasoning is worth reproducing by hand.
Feature Toggles (aka Feature Flags)
articlemartinfowler.com; Pete Hodgson (2017)
Long-form guide to feature toggles: release, experiment, ops and permissioning toggles, how long each kind should live, how toggle configuration can be managed, and how to keep the extra code paths testable and the toggle count under control.
Finding and Understanding Bugs in C Compilers
paperUniversity of Utah (author preprint); Xuejun Yang, Yang Chen, Eric Eide, John Regehr; PLDI 2011 (2011)
Introduces Csmith, a generator of random C programs used for randomized differential testing: the same program is compiled by several compilers and differing outputs reveal bugs. A clear large-scale example of checking an implementation against independent references.
Firecracker repository documentation
documentationFirecracker project (GitHub)
Source and documentation of the Firecracker VMM. The design document covers scope, host integration, internal architecture and threat containment, the machine model, I/O rate limiting and sandboxing as maintained today; the getting-started guide boots a microVM; the production host setup lists hardening steps, including noisy-neighbor and side-channel mitigations.
Firecracker: Lightweight Virtualization for Serverless Applications
Primary listpaperUSENIX; Alexandru Agache et al.; NSDI 2020 (2020)
Describes the microVM monitor behind AWS Lambda and Fargate: a minimal KVM-based VMM chosen to get VM-grade isolation with container-like density and startup time. A good case study in isolation versus overhead tradeoffs.
Fixing retries with token buckets and circuit breakers
articleMarc Brooker's blog; Marc Brooker (2022)
Compares fixed retry counts with token-bucket retry budgets and circuit breakers by how much extra load each adds as the failure rate grows. A compact quantitative argument for retry budgets.
Flame Graphs
articleBrendan Gregg's website; Brendan Gregg
The originator’s guide to flame graphs: how sampled stacks are merged, how to read width and ancestry, and variants for CPU, off-CPU, memory and differential analysis, with instructions for common profilers. The off-CPU page explains how to find time spent blocked rather than running.
2 chapter or section links
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning
paperarXiv; Tri Dao; ICLR 2024 (2023)
Follow-up to FlashAttention that keeps the IO-aware algorithm but changes how work is split across thread blocks and warps, parallelizes over sequence length and trims non-matmul operations. Read after the original to see how kernel-level work partitioning affects utilization.
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Primary listpaperarXiv; Tri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra, Christopher Ré; NeurIPS 2022 (2022)
Computes exact attention with tiling and an online softmax so the full attention matrix never travels to GPU high-bandwidth memory. The key lesson is that memory traffic, not FLOPs, often bounds performance.
FoundationDB: Simulation and Testing
documentationFoundationDB documentation
Describes how FoundationDB runs its distributed database inside a deterministic simulator with injected network, disk and machine faults, so failures reproduce from a seed. The clearest public description of deterministic simulation testing; the SIGMOD paper gives more detail.
git-bisect documentation
documentationGit project (git-scm.com)
Official reference for finding the commit that introduced a change by binary search over history, including skipping untestable commits and automating the search with bisect run and a test script whose exit status marks each commit.
Go documentation: slices, maps, sort and container/heap
documentationThe Go Authors (go.dev)
Official Go blog posts and package documentation covering the behaviors that matter for algorithmic Go: slices sharing a backing array, append growth, unspecified map iteration order, sort stability and the heap.Interface contract. Start with the slices post.
6 chapter or section links
- Go Slices: usage and internals(opens in a new tab)
- Go maps in action(opens in a new tab)
- Language specification: for statements with range clause(opens in a new tab)
- Package sort (sort.Search, sort.Slice, sort.SliceStable)(opens in a new tab)
- Package slices (Sort, SortFunc, SortStableFunc, BinarySearch)(opens in a new tab)
- Package container/heap(opens in a new tab)
Good enough practices in scientific computing
paperPLOS Computational Biology (open access); Greg Wilson, Jennifer Bryan, Karen Cranston, Justin Kitzes, Lex Nederbragt, Tracy K. Teal; PLOS Computational Biology 13(6), 2017 (2017)
Minimum practical habits for research projects: data management, software, collaboration, project organization, tracking changes and manuscripts. Pitched at researchers rather than professional software engineers, which makes it a realistic baseline for prototype code.
Google API Improvement Proposals (AIPs)
documentationGoogle
Google’s numbered API design guidance, each AIP covering one decision such as pagination, request identifiers, errors, conditional updates, compatibility or versioning. The individual AIPs are short enough to use as checklists during an API design exercise; they encode Google’s conventions, so adapt rather than copy them.
8 chapter or section links
- AIP-121: Resource-oriented design(opens in a new tab)
- AIP-134: Standard methods: Update(opens in a new tab)
- AIP-154: Resource freshness validation(opens in a new tab)
- AIP-155: Request identification(opens in a new tab)
- AIP-158: Pagination(opens in a new tab)
- AIP-180: Backwards compatibility(opens in a new tab)
- AIP-185: API Versioning(opens in a new tab)
- AIP-193: Errors(opens in a new tab)
Google cluster workload traces (google/cluster-data)
datasetGoogle (GitHub)
Documentation and access instructions for Borg cluster traces: a single cell from 2011 and eight cells from May 2019 with resource requests, CPU usage histograms, alloc sets and parent-job information, plus a bibliography of papers that used the traces.
Open(opens in a new tab)Link responded, 5 Oct 2026Free account may be required (The 2019 traces are available only through BigQuery, which needs a Google Cloud account; check query costs before running large analyses. The 2011 trace documentation is in the same repository.)Uses: Research, PracticeLinked from 1 topic2 chapter or section links
Google DeepMind careers
Primary listcareers pageGoogle DeepMind
Google DeepMind’s careers page describing teams, roles and hiring information.
Google Engineering Practices: code review guide
official guideGoogle (eng-practices documentation)
Google’s published guidance for reviewers and authors of code changes: the standard for approving a change, what to look for, how to write and label comments, and why small changes review better. Short, concrete and directly usable for code review exercises.
Google Research careers
Primary listcareers pageGoogle Research
Describes research roles and programs at Google Research. Useful for understanding how research scientist, research engineer and student researcher roles are framed; it is not an interview-format guide.
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
paperarXiv; Elias Frantar, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh; ICLR 2023 (2022)
One-shot, layer-by-layer weight quantization that uses approximate second-order information from a small calibration set to adjust the remaining weights as each one is quantized. The reference method for low-bit weight-only quantization.
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
paperarXiv; Joshua Ainslie et al.; EMNLP 2023 (2023)
Proposes grouped-query attention, where groups of query heads share key/value heads, as a middle ground between multi-head and multi-query attention, and shows how to convert existing multi-head checkpoints by uptraining. Read it for the KV-cache and bandwidth motivation.
Heracles: Improving Resource Efficiency at Scale
paperGoogle Research; David Lo, Liqun Cheng, Rama Govindaraju, Parthasarathy Ranganathan, Christos Kozyrakis; ISCA 2015 (2015)
A feedback controller that lets best-effort batch tasks share servers with latency-critical services by coordinating several isolation mechanisms (cores, cache partitioning, memory bandwidth, network and power) based on the latency slack of the critical service. The reference design for interference-aware co-location.
Hermitage: testing transaction isolation levels
toolGitHub (Martin Kleppmann); Martin Kleppmann and contributors
A set of two-session test scripts that probe which anomalies each isolation level of several databases allows. Use the PostgreSQL scripts as a ready-made lab for reproducing dirty writes, lost updates, read skew and write skew by hand.
Hexagonal Architecture (Ports and Adapters)
articleAlistair Cockburn's website; Alistair Cockburn (2005)
The original description of ports and adapters: the application core reaches databases, user interfaces and external services only through ports, with adapters at the edges. Explains why that boundary lets the core be tested with in-memory substitutes and run without its infrastructure.
High Performance Browser Networking
bookO'Reilly (free online edition); Ilya Grigorik (2013)
Performance-oriented explanations of latency, TCP, TLS, HTTP/1.x and HTTP/2 with careful round-trip accounting. It predates TLS 1.3 and HTTP/3, so pair its TLS and HTTP chapters with the current RFCs.
HotSpot Virtual Machine Garbage Collection Tuning Guide (Java SE 25)
documentationOracle (docs.oracle.com)
Oracle’s guide to how the HotSpot collectors work and how to choose and tune them. The early chapters on generations and the available collectors are the right depth for interviews; the tuning chapters matter once you operate JVM services.
How Good Are Query Optimizers, Really?
paperPVLDB (VLDB Endowment); Viktor Leis, Andrey Gubichev, Atanas Mirchev, Peter Boncz, Alfons Kemper, Thomas Neumann; PVLDB, vol. 9, no. 3 (2015)
Introduces the Join Order Benchmark and measures how cardinality estimation, the cost model and plan enumeration each affect query performance, by injecting estimated and true cardinalities into one engine. The reference methodology for optimizer research.
How NOT to Measure Latency (talk)
videoInfoQ; Gil Tene (2016)
Talk on latency measurement: why percentiles and maxima matter more than averages, how coordinated omission makes load generators under-report latency exactly when the system stalls, and how to record latency with histograms. The usual reference for coordinated omission.
How to do distributed locking
articleMartin Kleppmann's blog; Martin Kleppmann (2016)
Shows why a lock that expires on a timer cannot by itself protect a resource from a client that pauses, and why fencing tokens checked by the resource fix it. The clearest short treatment of leases, process pauses and timing assumptions.
How to Give a Bad Talk
articleUC Berkeley (author page); David A. Patterson
Practitioner advice in satirical form: a one-page list of commandments for a bad talk, from cluttered slides to ignoring the time limit. Invert each item to get a checklist for your own explanations.
How to Give a Great Research Talk
articleSimon Peyton Jones's website; Simon Peyton Jones
Practitioner advice (slides, a short paper and links) on structuring research talks: aim to make listeners want to read the work, cover only part of it, lead with examples and keep the key idea unmistakable. Directly applicable to 10-minute and longer explanations.
How to Quantify Scalability (Universal Scalability Law)
articlePerformance Dynamics; Neil J. Gunther
The author’s overview of the Universal Scalability Law, which extends Amdahl-style reasoning with contention and coherency terms so that throughput can peak and then fall as threads or nodes are added. Use it to fit measured scaling curves rather than to memorize formulas.
How to Read a Paper
paperS. Keshav (author's site, University of Cambridge); S. Keshav; ACM SIGCOMM Computer Communication Review, 2007 (2007)
Two-page note describing a three-pass method for reading papers and a short procedure for surveying a new area. Use it as the default reading routine and as the starting point for bounded literature searches.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Latest author version (2016 revision of the 2007 note).)Uses: Learning, ResearchLinked from 2 topicsAlternatives: Author's page for the note (updated reading links and translations)(opens in a new tab)
How to Scale Your Model: A Systems View of LLMs on TPUs
bookGoogle DeepMind (online book); Jacob Austin et al. (2025)
Free online book on rooflines, accelerator memory and interconnects, transformer FLOP and memory accounting, parallelism for training and the arithmetic of inference. Written mainly around TPUs with a dedicated GPU chapter; the estimation habits transfer directly to GPU interviews.
How to Write a Great Research Paper
articleSimon Peyton Jones's website; Simon Peyton Jones
Practitioner advice: seven concrete suggestions for research writing, including identifying one clear idea, stating contributions explicitly, using examples before generalities and placing related work deliberately. The same structure works for spoken explanations of a project.
HTML Living Standard: Event loops
standardWHATWG
The normative definition of tasks, task queues, microtask checkpoints and the rendering update that browsers implement. Dense and algorithmic; read the definitions and the processing model once so you can tell which simplifications in articles are safe.
2 chapter or section links
HTTP/3 explained
bookhaxx.se (author site); Daniel Stenberg
Short free booklet by the curl maintainer on why HTTP/3 and QUIC exist, how they differ from HTTP/2 over TCP, and what deployment issues remain. A readable first pass before the RFCs.
Hugging Face PEFT documentation
documentationHugging Face documentation
Documentation for a library of parameter-efficient fine-tuning methods, including LoRA and its variants, with conceptual guides and configuration options such as rank, scaling and target modules. Use it to connect the LoRA paper to the settings you would actually choose.
1 chapter or section link
Hypothesis quickstart (property-based testing for Python)
documentationHypothesis documentation
Official quickstart for a Python library that generates test inputs from strategies and shrinks failing cases to minimal examples. Use it to differential-test optimized research code against a naive reference.
Implementing health checks
articleAmazon Builders' Library; David Yanacek
Contrasts shallow liveness checks with deeper local and dependency checks, shows how a deep check can remove an entire healthy fleet when a shared dependency fails, and discusses failing open. Directly applicable to probe design.
Alternatives: Official PDF version(opens in a new tab)
Impossibility of Distributed Consensus with One Faulty Process
paperMIT CSAIL Theory of Distributed Systems group (author copy); Michael J. Fischer, Nancy A. Lynch, Michael S. Paterson; Journal of the ACM, 1985 (1985)
The FLP result: in an asynchronous system no deterministic protocol can guarantee consensus if even one process may crash. Read the statement and the proof idea (bivalent configurations) to understand why practical protocols keep safety unconditionally and need timing assumptions only for liveness.
Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)
paperarXiv; Joelle Pineau et al.; JMLR 2021 (arXiv 2020) (2020)
Describes the three parts of the NeurIPS 2019 reproducibility program (a code submission policy, a community reproducibility challenge and a checklist) and what the organizers learned. Read it to understand why ML venues ask the questions they now ask.
In Search of an Understandable Consensus Algorithm (Extended Version)
Primary listpaperraft.github.io; Diego Ongaro, John Ousterhout; USENIX ATC 2014 (extended version) (2014)
The Raft paper: leader election, log replication, safety argument and membership changes, designed for understandability. Read with the Figure 2 summary at hand and connect it to the 6.5840 Raft lab.
Inspect: an open-source framework for large language model evaluations
toolUK AI Security Institute and Meridian Labs
An evaluation framework with datasets, solvers, scorers (including model-graded scoring), agents and logging for reproducible LLM evaluations. Use it to build small evals quickly and to see how a mature harness separates tasks, generation and grading.
Introducing Contextual Retrieval
articleAnthropic Engineering (2024)
Practitioner article on a common chunking failure: chunks lose the document context needed to retrieve them. It prepends generated context to each chunk before embedding and BM25 indexing, combines both retrievers and adds reranking. The reported gains are the vendor’s measurements on its own data; reproduce them on yours.
Introduction to Information Retrieval
bookCambridge University Press (free online edition hosted by the Stanford NLP Group); Christopher D. Manning, Prabhakar Raghavan, Hinrich Schütze (2008)
The standard IR textbook: inverted indexes, tf-idf and the vector space model, probabilistic retrieval including BM25, and evaluation of ranked results. It predates dense retrieval, but its scoring and evaluation chapters are still the right foundation for retrieval work in RAG systems.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Free HTML and PDF editions on the book site; the printed book is sold by Cambridge University Press.)Uses: Learning, ReferenceLinked from 2 topicsIs Parallel Programming Hard, And, If So, What Can You Do About It?
bookkernel.org (author-maintained free book); Paul E. McKenney (editor); Continuously updated; chapter numbers below follow the 2026.06.21a release, so match chapters by title
Free book by the long-time maintainer of Linux RCU on making parallel code both correct and fast: hardware realities, counting, partitioning, locking, deferred processing (reference counting, hazard pointers, sequence locks, RCU), validation and memory ordering. Dense and practical; read the named chapters rather than the whole book.
7 chapter or section links
- Ch. 3: Hardware and its Habits
- Ch. 5: Counting
- Ch. 7: Locking
- Ch. 9: Deferred Processing
- Ch. 14: Advanced Synchronization
- Ch. 15: Advanced Synchronization: Memory Ordering
- Appendix C: Why Memory Barriers?
Jane Street: Mock interview (retired question)
Primary listofficial guideJane Street
An official mock interview built on a retired question, showing how an interviewer extends a problem and evaluates the conversation.
Open(opens in a new tab)Link responded, 5 Oct 2026FreeUses: Company guidance, PracticeLinked from 2 topicsJane Street: Preparing for a software engineering interview
Primary listofficial guideJane Street
Jane Street’s official guidance for software engineering candidates, which differs from its trading-role preparation.
Java Language Specification (Java SE 25), 15.19 Shift Operators
standardOracle
The normative definition of Java’s <<, >> and >>> operators: shift distances are masked to the low five bits for int (six for long), >> sign-extends and >>> fills with zeros. Read it if Java is your interview language.
1 chapter or section link
Java SE 25 API documentation
documentationOracle (docs.oracle.com)
The Javadoc for Java SE 25, a long-term-support release. The java.lang.Object page states the equals and hashCode contracts precisely, and the java.util.concurrent package summary maps executors, queues, synchronizers, concurrent collections and their memory-consistency guarantees.
Java SE 25 API documentation: java.util collections
documentationOracle
Official Javadoc for the collection classes used in interview code. The class descriptions state the costs and behaviors that matter: PriorityQueue ordering and linear-time removal, HashMap iteration order and resizing, ArrayDeque as the preferred stack and queue, TreeMap navigation methods and the algorithms behind Arrays.sort.
JavaScript execution model (MDN)
Primary listdocumentationMDN Web Docs
Explains agents, realms, the job queue and the event loop as JavaScript specifies them. Read it before reasoning about promise ordering, microtasks versus tasks, and why long synchronous work blocks rendering.
Jepsen consistency models: serializability, snapshot isolation and weaker levels
articleJepsen; Kyle Kingsbury
Short pages defining serializability, strict serializability, snapshot isolation, repeatable read and read committed, with the anomalies each excludes and pointers to the formal literature. Useful for placing database isolation levels within the wider map of consistency models.
Jepsen: distributed systems safety research
articleJepsen (jepsen.io); Kyle Kingsbury
Independent analyses of databases and queues under injected faults, a map of consistency models with precise definitions, and the open-source testing library and history checkers behind them. Read two or three analyses to absorb the method: workload, nemesis faults, recorded history and checker.
Open(opens in a new tab)Link responded, 5 Oct 2026FreeUses: Learning, Research, ReferenceLinked from 2 topics8 chapter or section links
- Analyses(opens in a new tab)
- Consistency models(opens in a new tab)
- Consistency model: Linearizability(opens in a new tab)
- Jepsen testing library (GitHub)(opens in a new tab)
- Elle transactional consistency checker (GitHub)(opens in a new tab)
- Elle: Inferring Isolation Anomalies from Experimental Observations (paper)(opens in a new tab)
- Knossos linearizability checker (GitHub)(opens in a new tab)
- Maelstrom workbench for toy distributed systems (GitHub)(opens in a new tab)
Join Order Benchmark (JOB) queries
datasetGitHub (community-maintained copy)
The JOB schema and multi-join queries over IMDB data, with a pointer to the original data snapshot. The standard workload for studying cardinality estimation and join ordering on real, correlated data; the repository is a convenience copy, not maintained by the original authors.
Alternatives: IMDB data snapshot used in the paper (CWI)(opens in a new tab)
JSON Schema: Creating your first schema
documentationJSON Schema (json-schema.org)
Official getting-started guide to JSON Schema: types, required properties, enums, numeric ranges and nested objects. LLM tool and structured-output definitions are commonly expressed in this vocabulary, so it is the contract language for validating model-produced arguments.
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
paperarXiv; Lianmin Zheng et al.; NeurIPS 2023 Datasets and Benchmarks Track (2023)
Studies strong LLMs as graders of open-ended answers, documents position, verbosity and self-enhancement biases and mitigations, and measures agreement with human preferences. Read the bias analysis before trusting any model-graded evaluation.
Karl Popper (Stanford Encyclopedia of Philosophy)
articleStanford Encyclopedia of Philosophy; Stephen Thornton
Scholarly overview of Popper’s philosophy of science. Sections 3 and 4 explain demarcation and falsifiability: why a useful empirical claim must forbid some observable outcomes. Read those two sections only; the rest is optional background.
Kubernetes components (official documentation)
Primary listdocumentationKubernetes project
Official overview of the control plane (API server, etcd, scheduler, controller manager) and node components (kubelet, kube-proxy, container runtime). Start here to understand Kubernetes as a set of reconciling controllers around a consistent store.
7 chapter or section links
Kubernetes: Horizontal Pod Autoscaling
documentationKubernetes project
Official description of the HorizontalPodAutoscaler control loop: how metrics are collected, the proportional replica calculation, handling of unready pods and missing metrics, tolerance, stabilization windows and scaling policies. The walkthrough lets you watch it react to load on a test cluster.
Kubernetes: Pod Quality of Service classes, CPU management and bin packing
documentationKubernetes project
How Kubernetes classifies pods as Guaranteed, Burstable or BestEffort from their requests and limits and uses that class under node pressure, plus the related pages on exclusive CPUs with the static CPU manager policy, bin-packing scoring strategies, priority and preemption, and eviction.
Large-scale cluster management at Google with Borg
paperGoogle Research; Abhishek Verma, Luis Pedrosa, Madhukar Korupolu, David Oppenheimer, Eric Tune, John Wilkes; EuroSys 2015 (2015)
Describes Google’s production cluster manager, which mixes latency-sensitive services and batch jobs: cells, jobs, tasks and allocs, priorities and quota, feasibility checking and scoring, reclaiming reserved but unused resources, and isolation. Its lessons shaped Kubernetes, and its cell-compaction methodology is a model for evaluating packing policies.
Alternatives: Full paper PDF hosted by Google(opens in a new tab)
Leakage and the Reproducibility Crisis in ML-based Science
paperarXiv; Sayash Kapoor, Arvind Narayanan; Patterns (2023) (2022)
Surveys published studies whose results were inflated by data leakage and organizes the causes into a taxonomy: no clean separation between training and test data (including preprocessing and duplicates), illegitimate features that proxy the outcome, and test sets not drawn from the distribution of interest (such as temporal leakage and non-independence). Use it as a review checklist.
Alternatives: Project page with the taxonomy and a model info sheet(opens in a new tab)
Learned Cardinalities: Estimating Correlated Joins with Deep Learning
paperarXiv; Andreas Kipf, Thomas Kipf, Bernhard Radke, Viktor Leis, Peter Boncz, Alfons Kemper; CIDR 2019 (arXiv version) (2018)
Introduces MSCN, a query-driven model that represents tables, joins and predicates as sets and adds sample information to estimate cardinalities of correlated joins. A representative learned-estimator design to analyze for training data, generalization and evaluation choices.
Learning from Mistakes: A Comprehensive Study on Real World Concurrency Bug Characteristics
paperShan Lu's publications page (University of Chicago); Shan Lu, Soyeon Park, Eunsoo Seo, Yuanyuan Zhou; ASPLOS 2008 (2008)
Empirical study of concurrency bugs in large open-source applications that classifies non-deadlock bugs into atomicity and order violations and examines how deadlocks arise and how developers fixed both kinds. OSTEP’s concurrency-bugs chapter builds on it; read it for the taxonomy and the fix strategies.
Check note: Not requested: robots.txt could not be fetched (UNABLE_TO_VERIFY_LEAF_SIGNATURE).
LeetCode 75 study plan
Primary liststudy planLeetCode
Compact official LeetCode list grouped by technique. Useful as a first pass across the core patterns once you know each pattern; it is a practice sequence, not an explanation of the ideas.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026Free account may be required (Problems are viewable on LeetCode; tracking progress on the platform needs a free account.)Uses: PracticeLinked from 5 topicsCheck note: The site refused or challenged the automated request (HTTP 403). This is common for bot protection and does not mean the link is broken.
LeetCode SQL 50 study plan
Primary liststudy planLeetCode
Official LeetCode sequence of SQL exercises covering selection, joins, aggregation, subqueries and window-style problems. Use it to build query fluency; pair it with a reference on NULL semantics and window functions.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026Free account may be required (Problems are viewable on LeetCode; tracking progress on the platform needs a free account.)Uses: PracticeLinked from 1 topicCheck note: Not requested individually: leetcode.com refused or challenged earlier automated requests (HTTP 403), so the check stopped contacting it. Open the link in a browser.
LeetCode Top Interview 150 study plan
Primary liststudy planLeetCode
Broader official LeetCode list with more problems per pattern. Good for review rotation after a pattern is understood, so you can revisit an idea through a problem you have not seen.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026Free account may be required (Problems are viewable on LeetCode; tracking progress on the platform needs a free account.)Uses: PracticeLinked from 3 topicsCheck note: The site refused or challenged the automated request (HTTP 403). This is common for bot protection and does not mean the link is broken.
LeRobot
toolHugging Face (GitHub)
A PyTorch library of robot-learning datasets in a common format, pretrained policies and training tools, with support for low-cost hardware. Optional; useful to see how imitation-learning data and policies are packaged in practice.
libuv: Design overview
documentationlibuv documentation
Compact description of the event loop underneath Node.js: loop phases, handles and requests, the platform pollers it wraps (epoll, kqueue, event ports, IOCP) and the thread pool it uses for file I/O because no portable non-blocking file interface exists. A concrete model of a production event loop.
Lightweight Asynchronous Snapshots for Distributed Dataflows
paperarXiv; Paris Carbone, Gyula Fóra, Stephan Ewen, Seif Haridi, Kostas Tzoumas; arXiv preprint (2015)
Describes the barrier-based asynchronous snapshot algorithm behind Flink’s checkpoints, adapted from distributed snapshot ideas to dataflow graphs, including the handling of cycles. Read it to understand how exactly-once state is achieved without pausing the pipeline.
Linearizability: A Correctness Condition for Concurrent Objects
paperMaurice Herlihy's page (Brown University); Maurice P. Herlihy, Jeannette M. Wing; ACM Transactions on Programming Languages and Systems 12(3), 1990 (1990)
The paper that defines linearizability: histories, the real-time order of non-overlapping operations, locality (linearizable objects compose) and the comparison with sequential consistency and serializability. Sections 1–3 give interview depth; Sections 4–5 cover verification and reasoning techniques.
Linux kernel documentation: User Interface for Resource Control (resctrl)
documentationThe Linux Kernel documentation
Kernel interface for partitioning the last-level cache and throttling memory bandwidth per group of tasks on hardware that supports it, plus monitoring of cache occupancy and bandwidth. It covers exactly the resources that cgroup CPU and memory controllers (linked below) do not partition, which makes it central to interference experiments.
1 chapter or section link
Linux memory management: Concepts overview (kernel documentation)
documentationThe Linux Kernel documentation (docs.kernel.org)
Short kernel-written overview of how Linux realizes virtual memory: huge pages, zones and nodes, page cache, anonymous memory, reclaim, compaction and the OOM killer. It bridges textbook paging and the vocabulary you meet when debugging memory pressure in production.
Linux perf Examples
articleBrendan Gregg's website; Brendan Gregg
Large, example-driven reference for Linux perf: counting events with perf stat, sampling stacks with perf record, tracepoints, symbol and stack-walking problems, and many one-liners. Keep it open during hands-on profiling rather than reading it end to end.
Linux tcp(7), socket(7) and listen(2) manual pages
documentationman7.org (Linux man-pages project)
Exact Linux semantics for TCP sockets: socket options such as TCP_NODELAY and keepalive settings, buffer sysctls, socket-level options, and what the listen backlog bounds. Read the option lists and NOTES rather than the whole pages.
3 chapter or section links
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
paperarXiv; Tim Dettmers, Mike Lewis, Younes Belkada, Luke Zettlemoyer; NeurIPS 2022 (2022)
Documents emergent large-magnitude outlier features in transformer activations and handles them with vector-wise quantization plus a mixed-precision decomposition that keeps outlier dimensions in 16-bit. Read it for the outlier analysis that later methods build on.
Lock-freedom without garbage collection
articleAaron Turon's blog; Aaron Turon (2015)
Accessible explanation of epoch-based memory reclamation as used by Rust’s crossbeam library: why a lock-free structure cannot free an unlinked node immediately, how epochs bound when freeing becomes safe, and what the scheme costs. Good intuition before the hazard-pointer literature.
LoRA: Low-Rank Adaptation of Large Language Models
Primary listpaperarXiv; Edward J. Hu et al.; ICLR 2022 (2021)
Freezes pretrained weights and learns a low-rank update for selected matrices, cutting trainable parameters and optimizer memory while allowing the update to be merged for inference.
Machine Learning Crash Course
courseGoogle for Developers
Short interactive modules on core ML practice. The pages on dividing datasets, classification metrics, ROC and thresholds, embeddings and production ML systems are fast refreshers; they stay introductory, so pair them with deeper sources.
8 chapter or section links
- Datasets: Dividing the original dataset(opens in a new tab)
- Datasets: Data characteristics(opens in a new tab)
- Overfitting: L2 regularization(opens in a new tab)
- Thresholds and the confusion matrix(opens in a new tab)
- Classification: Accuracy, recall, precision, and related metrics(opens in a new tab)
- Classification: ROC and AUC(opens in a new tab)
- Embeddings(opens in a new tab)
- Production ML systems: Monitoring pipelines(opens in a new tab)
Machine Learning Reproducibility Challenge (MLRC)
documentationMLRC organizers
Annual venue for reproducing recent ML papers; recent editions publish through TMLR and the 2026 edition is a NeurIPS track. Past proceedings show how reproduction reports separate what was confirmed, what was not and why.
Maglev: A Fast and Reliable Software Network Load Balancer
paperUSENIX; Danielle E. Eisenbud, Cheng Yi, Carlo Contavalli, Cody Smith, Roman Kononov, Eric Mann-Hielscher, Ardas Cilingiroglu, Bin Cheyney, Wentao Shang, Jinnah Dylan Hosein; USENIX NSDI 2016 (2016)
Design of a software L4 load balancer that scales out behind ECMP, using a consistent-hashing lookup table plus connection tracking so connections survive changes in the balancer and backend sets. A concrete case study for L4 balancing questions.
Mahimahi: Accurate Record-and-Replay for HTTP
paperUSENIX; Ravi Netravali, Anirudh Sivaraman, Somak Das, Ameesh Goyal, Keith Winstein, James Mickens, Hari Balakrishnan; USENIX ATC 2015 (2015)
Describes Mahimahi, a set of composable shells for record-and-replay of web traffic and for emulating delay, loss and trace-driven link capacity. Its link shell replays recorded cellular traces, and later congestion-control platforms such as Pantheon build their emulators on it.
1 chapter or section link
Making Deep Learning Go Brrrr From First Principles
articleHorace He's website; Horace He (2022)
Sorts the time a model spends into compute, memory bandwidth and overhead, and shows how operator fusion and framework overhead fit that picture. The fastest way to acquire the vocabulary used in GPU performance discussions.
Making retries safe with idempotent APIs
articleAmazon Builders' Library; Malcolm Featonby
Describes caller-supplied request identifiers, recording the identifier atomically with the effect, returning an equivalent response to duplicates and rejecting a reused identifier whose parameters differ. A concrete design for idempotency keys.
MANRS: Mutually Agreed Norms for Routing Security
documentationMANRS initiative
Global initiative that defines baseline routing-security actions for network operators (filtering, anti-spoofing, coordination, validation) and runs an observatory of routing-security data. Good for awareness of how leaks and hijacks are mitigated in practice.
MapReduce: Simplified Data Processing on Large Clusters
Primary listpaperGoogle Research; Jeffrey Dean, Sanjay Ghemawat; OSDI 2004 (2004)
The programming model and runtime for fault-tolerant batch processing on commodity clusters: deterministic re-execution, the master, stragglers and backup tasks, and locality. Short and foundational; it is the subject of 6.5840 Lab 1.
Mathematics for Machine Learning
bookCambridge University Press (free PDF on the companion site); Marc Peter Deisenroth, A. Aldo Faisal, Cheng Soon Ong (2020)
Builds the linear algebra, matrix decompositions, vector calculus, probability and optimization that ML relies on, then applies them to regression, PCA, mixture models and SVMs. Use the decomposition and vector-calculus chapters to make SVD and gradient identities routine.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (The companion site links a free PDF; the printed edition is sold by Cambridge University Press.)Uses: Learning, ReferenceLinked from 1 topic3 chapter or section links
- Full book PDF(opens in a new tab)
- Ch. 4: Matrix Decompositions
- Ch. 5: Vector Calculus
MDN JavaScript Guide and reference
documentationMDN Web Docs
Mozilla’s guide and reference for the JavaScript language, precise enough to settle most semantics questions. The pages below cover closures, this, the prototype chain, equality algorithms, number encoding and promises.
MDN Web Docs: HTTP
documentationMDN Web Docs (Mozilla)
Readable guides and reference pages for HTTP: the message model, methods, status codes, headers, cookies, authentication, CORS and caching. Use the guides to refresh concepts and the reference pages to check exact semantics while designing endpoints.
7 chapter or section links
MDN Web Docs: HTTP guides
documentationMDN Web Docs (Mozilla)
Concise reference guides on HTTP. The evolution guide gives a version-by-version overview through HTTP/3, the connection-management guide explains keep-alive, pipelining and connection limits, and the caching guide covers Cache-Control and validators.
MDN: Accessibility
documentationMDN Web Docs
MDN’s accessibility hub, linking a learning path and reference material. The learning pages on semantic HTML and WAI-ARIA basics explain the accessibility tree and when ARIA is needed; the ARIA reference documents each role and attribute.
MDN: Array.prototype.sort(), shift(), Map and Set
documentationMDN Web Docs
Reference pages for JavaScript behaviors that matter in algorithmic code: default string comparison and stability in sort, comparator requirements, front removal with shift(), and key equality and ordering in Map and Set.
MDN: Using microtasks in JavaScript with queueMicrotask()
documentationMDN Web Docs
Explains tasks versus microtasks with runnable examples and when queueMicrotask is appropriate; the in-depth companion page walks through execution contexts, the window, worker and worklet event loops, and why microtasks queued by microtasks still run before the next task.
1 chapter or section link
MDN: Using the Fetch API, AbortController and AbortSignal
documentationMDN Web Docs
How fetch reports success and failure (it resolves on HTTP error statuses), how to cancel a request with an AbortController, and how AbortSignal helpers such as timeouts and combined signals work. The reference for the request-race and error-handling exercises in the frontend topics.
Memory Models (essay series)
articleresearch!rsc (Russ Cox); Russ Cox (2021)
Clear essays on hardware memory models (sequential consistency, x86-TSO, ARM) and programming-language memory models (Java, C++, Go), built around small litmus tests and the idea of data-race-free programs. The best intuition-level preparation for explaining happens-before and acquire/release.
2 chapter or section links
Meta software engineer full-loop interview guide (Meta-authored PDF, third-party mirror)
Primary listofficial guideMeta (mirrored on a third-party CloudFront host)
Meta-authored preparation guide for the software engineering full loop, hosted by a third party. Treat its format details as a dated snapshot and confirm current applicability with your recruiter.
Metastable Failures in Distributed Systems
paperACM SIGOPS (HotOS proceedings); Nathan Bronson, Abutalib Aghayev, Aleksey Charapko, Timothy Zhu; HotOS 2021 (2021)
Names a class of outages in which a temporary trigger pushes a system into a bad state that sustains itself (for example through retries or cache misses) after the trigger is gone. Short and useful for explaining why mitigation often means shedding load rather than fixing the trigger.
micrograd
toolGitHub (Andrej Karpathy); Andrej Karpathy
A tiny scalar reverse-mode autodiff engine with a small neural-network library on top. Reading engine.py makes topological ordering, gradient accumulation and the chain rule inside backward() concrete before you study how PyTorch does the same for tensors.
1 chapter or section link
Microsoft hiring tips: technical interviewing
Primary listofficial guideMicrosoft Careers
Official Microsoft guidance on preparing for technical interviews.
Microsoft Research careers
Primary listcareers pageMicrosoft Research
Overview of research careers, internships and programs at Microsoft Research. Use it for role context and program types; it does not describe a standardized interview loop.
Migrations: the sole scalable fix to tech debt
articleIrrational Exuberance (Will Larson’s blog); Will Larson (2018)
Argues that well-run migrations are the main way to pay down technical debt at scale and describes a derisk, enable and finish playbook. Useful for structuring migration stories and plans in senior interviews.
Mistral AI careers
Primary listcareers pageMistral AI
Mistral AI’s careers page with open roles.
MIT 6.006 Introduction to Algorithms (Spring 2020)
Primary listcourseMIT OpenCourseWare; Erik Demaine, Jason Ku, Justin Solomon (2020)
Full undergraduate algorithms course with lecture notes, recitations, problem sets and videos. Use it to relearn the reasoning behind data structures, graph algorithms and dynamic programming rather than memorizing solutions; the recitation notes are especially compact.
Open(opens in a new tab)Link responded, 5 Oct 2026FreeUses: Learning, ReferenceLinked from 23 topics2 chapter or section links
MIT 6.046J Design and Analysis of Algorithms (Spring 2015)
courseMIT OpenCourseWare; Erik Demaine, Srini Devadas, Nancy Lynch (2015)
The follow-on course to 6.006, with lecture notes on greedy proofs, divide and conquer, amortized analysis and randomized algorithms. Use the selected lectures for the correctness and expected-time arguments behind interval scheduling, median finding, quicksort and union-find-based MST.
6 chapter or section links
- Lecture notes index(opens in a new tab)
- Lecture 1: Overview, Interval Scheduling(opens in a new tab)
- Lecture 2: Divide & Conquer: Convex Hull, Median Finding(opens in a new tab)
- Lecture 5: Amortization: Amortized Analysis(opens in a new tab)
- Lecture 6: Randomization: Matrix Multiply, Quicksort(opens in a new tab)
- Lecture 12: Greedy Algorithms: Minimum Spanning Tree(opens in a new tab)
MIT 6.102 Software Construction (readings)
courseMIT EECS
Readings from MIT’s software construction course on testing, specifications, abstract data types, representation invariants, code review and debugging, each with short exercises. The testing reading shows how to choose test cases by partitioning the input space and including boundaries; the debugging reading treats debugging as reproduce, hypothesize, experiment.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Readings are public; problem sets rely on MIT-internal repositories. The root URL redirects to the current semester; section links point to the Spring 2026 offering. Examples are in TypeScript, but the methods are language-independent.)Uses: Learning, PracticeLinked from 4 topics6 chapter or section links
MIT 6.1810 Operating System Engineering (xv6)
Primary listcourseMIT PDOS
Hands-on OS course built around the small xv6 teaching kernel. The labs (system calls, page tables, traps, copy-on-write fork, locks, file system) turn OS concepts into code you must get right; the xv6 book explains the kernel source.
2 chapter or section links
- xv6: a simple, Unix-like teaching operating system (book)
- Labs (syscall, pgtbl, traps, cow, lock, fs)
MIT 6.5840 Distributed Systems
Primary listcourseMIT PDOS
Graduate distributed-systems course organized around reading classic papers (MapReduce, GFS, Raft, ZooKeeper, Spanner and more) with Go labs that build MapReduce, a key/value service, Raft and a sharded store. The labs are the best available practice for fault-tolerance reasoning.
Open(opens in a new tab)Link responded, 5 Oct 2026FreeUses: Learning, Practice, ResearchLinked from 10 topics2 chapter or section links
Mixed Precision Training
paperarXiv; Paulius Micikevicius et al.; ICLR 2018 (2017)
Introduces the standard recipe for half-precision training: an fp32 master copy of the weights, loss scaling to keep small gradients representable, and higher-precision accumulation. Read it to understand why each piece exists rather than treating autocast as magic.
Mocks Aren't Stubs
articlemartinfowler.com; Martin Fowler (2007)
Explains the test-double vocabulary (dummy, fake, stub, spy, mock) and contrasts state verification with behavior verification, and the classical with the mockist testing style. Read it to argue precisely about when a mock helps and when it ties tests to implementation details.
1 chapter or section link
Modeling BBR's Interactions with Loss-Based Congestion Control
paperSwarthmore College (author copy); Ranysha Ware, Matthew K. Mukerjee, Srinivasan Seshan, Justine Sherry; ACM IMC 2019 (2019)
Models why BBRv1 competing with Cubic or Reno becomes limited by its in-flight cap, which then sets its share of the link, and validates the model experimentally. A good example of explaining a measured unfairness with a mechanism.
MonetDB/X100: Hyper-Pipelining Query Execution
paperCIDR; Peter Boncz, Marcin Zukowski, Niels Nes; CIDR 2005 (2005)
Analyzes why tuple-at-a-time execution uses modern CPUs poorly and proposes vectorized execution over column batches. The starting point for vectorized engines.
mutilate: high-performance memcached load generator
toolGitHub (Jacob Leverich)
Open-source memcached load generator built for high request rates and tail-latency measurement. Its README explains why one connection that waits for each reply cannot load a server realistically and how threads, connections, pipelining and remote agents change that. Later GitHub forks such as memcache-perf (whose binary is also called mcperf) and its dynamic-load variant build on it; an unrelated tool, twemperf, is also known as mcperf.
nanoGPT
toolGitHub (Andrej Karpathy); Andrej Karpathy
A compact GPT training and sampling codebase whose model.py holds causal self-attention, MLP blocks and generation in a few hundred lines. Read it as a reference decoder-only implementation and use it as the base for exercises such as adding a KV cache; it is not a current production training stack.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Since a November 2025 README update the author describes the repository as old and deprecated in favour of nanochat; the code is still a stable, readable reference.)Uses: Learning, PracticeLinked from 1 topicNCCL User Guide: Collective Operations
documentationNVIDIA Documentation
Precise definitions of AllReduce, Broadcast, Reduce, AllGather, ReduceScatter and related collectives as implemented by NCCL. The linked nccl-tests performance note explains algorithm bandwidth versus bus bandwidth, which you need to interpret collective benchmarks.
1 chapter or section link
Netflix new graduate careers
Primary listcareers pageNetflix Jobs
Netflix’s public page for new-graduate candidates. Its process description applies to the new-grad program, not to experienced hires.
Neural Machine Translation of Rare Words with Subword Units
paperarXiv; Rico Sennrich, Barry Haddow, Alexandra Birch; ACL 2016 (2015)
Adapts byte-pair encoding to learn a subword vocabulary by repeatedly merging the most frequent adjacent symbol pair, giving open-vocabulary models without unknown-word tokens. Short; read it for the merge algorithm that LLM tokenizers build on.
NeurIPS Paper Checklist Guidelines
official guideNeurIPS
The checklist NeurIPS submissions must include, with guidance on claims, limitations, theory assumptions, result reproducibility, access to data and code, experimental details, statistical significance, compute resources, ethics and licenses. A good self-review for any ML project report or thesis chapter.
Next.js installation
Primary listdocumentationVercel / Next.js documentation
Official Next.js App Router setup guide. Listed because this planner is built with Next.js; it is not part of the interview curriculum.
NIST AI Risk Management Framework (AI RMF 1.0)
standardNational Institute of Standards and Technology (NIST) (2023)
Voluntary US framework for managing AI risks across the lifecycle, organized around the Govern, Map, Measure and Manage functions; NIST later published a Generative AI Profile (NIST-AI-600-1) linked from this page. Useful vocabulary for senior discussions of risk ownership, documentation and monitoring.
Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection
paperarXiv; Kai Greshake, Sahar Abdelnabi, Shailesh Mishra, Christoph Endres, Thorsten Holz, Mario Fritz (2023)
Introduces indirect prompt injection: instructions planted in content that an LLM application later retrieves (web pages, emails, documents) and then acts on with the user’s privileges. Read the threat taxonomy to reason about any system that feeds untrusted text to a model with tools.
NumPy user guide: NumPy fundamentals
documentationNumPy project (numpy.org)
The user-guide chapters on how arrays behave. Broadcasting, Copies and views, Data types and Indexing together explain most silent bugs in array code: unexpected result shapes, writes through views, hidden copies from advanced indexing, and overflow or precision loss from dtype choices.
NVIDIA Deep Learning Performance guides (GPU background, matrix multiplication, mixed precision)
documentationNVIDIA Documentation
Short official guides on how streaming multiprocessors, tensor cores and memory bandwidth bound deep-learning operations, how to compute arithmetic intensity, and how to tell math-limited from memory-limited work. The matrix-multiplication guide adds tile and wave quantization; the mixed-precision guide covers formats and loss scaling.
NVIDIA NIM LLM Benchmarking: Metrics
documentationNVIDIA Documentation
Concise definitions of time to first token, end-to-end latency, inter-token latency, tokens per second and requests per second, with explicit notes on where benchmarking tools disagree (for example whether the first token is included in inter-token latency). Use it to pin down definitions before comparing numbers.
NVIDIA Nsight Systems User Guide
toolNVIDIA Documentation
Documentation for NVIDIA’s system-wide timeline profiler, which places CPU threads, CUDA API calls, kernels, memory copies and communication on one timeline. Use it to find idle gaps and missing overlap; move to Nsight Compute (linked below) only when one kernel needs explaining.
1 chapter or section link
NVIDIA: How we hire
Primary listofficial guideNVIDIA
Official NVIDIA description of its hiring process and candidate guidance.
On Calibration of Modern Neural Networks
paperarXiv; Chuan Guo, Geoff Pleiss, Yu Sun, Kilian Q. Weinberger; ICML 2017 (2017)
Shows that modern deep classifiers tend to be overconfident, defines reliability diagrams and expected calibration error, and finds temperature scaling (one scalar fitted on validation data) to be a strong post-hoc fix. Short and directly usable.
On the Criteria To Be Used in Decomposing Systems into Modules
paperCommunications of the ACM (ACM Digital Library); D. L. Parnas; Communications of the ACM 15(12), 1972 (1972)
The classic short paper arguing that modules should hide design decisions that are likely to change, instead of mirroring the steps of a processing flowchart. Read it for the core idea behind information hiding, interfaces and module boundaries; the example system is dated, the argument is not.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026Free (The DOI resolves to the ACM Digital Library, which may show a browser check to automated clients.)Uses: Learning, ResearchLinked from 1 topicCheck note: The site refused or challenged the automated request (HTTP 403). This is common for bot protection and does not mean the link is broken.
On the State of the Art of Evaluation in Neural Language Models
paperarXiv; Gábor Melis, Chris Dyer, Phil Blunsom; ICLR 2018 (2017)
Re-evaluates several recurrent language-model architectures with large-scale automatic hyperparameter tuning and concludes that properly regularized standard LSTMs compare favourably with newer models. A widely cited case study for why baselines need the same tuning effort as the proposed method.
Online migrations at scale
articleStripe Engineering Blog; Jacqueline Xu (2017)
A worked account of moving a large dataset to a new data model while the system stays live: dual writing, backfilling, switching reads with verification, then removing the old path. Shows each step and what it protects against.
Online normalizer calculation for softmax
paperarXiv; Maxim Milakov, Natalia Gimelshein (2018)
Shows how to compute the softmax normalizer in one pass by keeping a running maximum and rescaling the partial sum. This is the trick that lets tiled attention kernels stream over keys; read it before deriving blocked attention yourself.
Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback
paperarXiv; Stephen Casper, Xander Davies, et al. (2023)
Surveys challenges across RLHF: collecting human feedback, training reward models and optimizing policies, separating tractable problems from fundamental limitations. A good map for questions about preference data quality and reward hacking.
Open Versus Closed: A Cautionary Tale
paperUSENIX; Bianca Schroeder, Adam Wierman, Mor Harchol-Balter; NSDI 2006 (2006)
Compares closed, open and partly-open workload models and shows that the choice of load generator changes measured response times and the apparent benefit of scheduling policies. Read it before choosing a load generator for any latency experiment.
OpenAI interview guide
Primary listofficial guideOpenAI
Official OpenAI guide describing its interview process and preparation expectations.
Check note: The site refused or challenged the automated request (HTTP 403). This is common for bot protection and does not mean the link is broken.
OpenTelemetry: Observability primer
documentationOpenTelemetry documentation (CNCF)
Short introduction to observability vocabulary as OpenTelemetry uses it: telemetry, logs, spans, distributed traces and reliability measures. Continue to the signals pages for how traces, metrics and logs relate and how context propagates between services.
1 chapter or section link
Operating Systems: Three Easy Pieces
Primary listbookUniversity of Wisconsin–Madison (free online book); Remzi H. Arpaci-Dusseau, Andrea C. Arpaci-Dusseau
Readable, free OS textbook organized around virtualization, concurrency and persistence. Each chapter is short and ends with homework simulations; use the chapter PDFs listed per topic rather than reading cover to cover.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Chapters are free PDFs; printed and e-book editions are sold separately.)Uses: Learning, ReferenceLinked from 16 topics33 chapter or section links
- Ch. 4: The Abstraction: The Process(opens in a new tab)
- Ch. 5: Interlude: Process API(opens in a new tab)
- Ch. 6: Mechanism: Limited Direct Execution(opens in a new tab)
- Ch. 7: Scheduling: Introduction(opens in a new tab)
- Ch. 8: Scheduling: The Multi-Level Feedback Queue(opens in a new tab)
- Ch. 10: Multiprocessor Scheduling(opens in a new tab)
- Ch. 13: The Abstraction: Address Spaces(opens in a new tab)
- Ch. 14: Interlude: Memory API(opens in a new tab)
- Ch. 15: Mechanism: Address Translation(opens in a new tab)
- Ch. 17: Free-Space Management(opens in a new tab)
- Ch. 18: Paging: Introduction(opens in a new tab)
- Ch. 19: Paging: Faster Translations (TLBs)(opens in a new tab)
- Ch. 20: Paging: Smaller Tables(opens in a new tab)
- Ch. 21: Beyond Physical Memory: Mechanisms(opens in a new tab)
- Ch. 22: Beyond Physical Memory: Policies(opens in a new tab)
- Ch. 26: Concurrency: An Introduction(opens in a new tab)
- Ch. 27: Interlude: Thread API(opens in a new tab)
- Ch. 28: Locks(opens in a new tab)
- Ch. 29: Lock-based Concurrent Data Structures(opens in a new tab)
- Ch. 30: Condition Variables(opens in a new tab)
- Ch. 31: Semaphores(opens in a new tab)
- Ch. 32: Common Concurrency Problems(opens in a new tab)
- Ch. 33: Event-based Concurrency(opens in a new tab)
- Ch. 36: I/O Devices(opens in a new tab)
- Ch. 37: Hard Disk Drives(opens in a new tab)
- Ch. 39: Interlude: Files and Directories(opens in a new tab)
- Ch. 40: File System Implementation(opens in a new tab)
- Ch. 42: Crash Consistency: FSCK and Journaling(opens in a new tab)
- Ch. 43: Log-structured File Systems(opens in a new tab)
- Ch. 44: Flash-based SSDs(opens in a new tab)
- Ch. 45: Data Integrity and Protection(opens in a new tab)
- Ch. 48: Distributed Systems(opens in a new tab)
- Ch. 49: Sun's Network File System (NFS)(opens in a new tab)
Optimal Probabilistic Cache Stampede Prevention
paperVLDB Endowment; Andrea Vattani, Flavio Chierichetti, Keegan Lowenstein; PVLDB vol. 8, 2015 (2015)
Analyzes probabilistic early recomputation: each reader refreshes a still-valid entry with a probability that rises as expiry approaches, scaled by how long recomputation takes. Read the algorithm and the intuition; skip the proofs on a first pass.
Orca: A Distributed Serving System for Transformer-Based Generative Models
paperUSENIX; Gyeong-In Yu, Joo Seong Jeong, Geon-Woo Kim, Soojeong Kim, Byung-Gon Chun; OSDI 2022 (2022)
Introduces iteration-level scheduling, where the batch is re-formed at every model iteration so finished requests leave and new ones join immediately, plus selective batching for operations that cannot be batched across different sequence lengths. The origin of what is now called continuous batching.
OWASP Cheat Sheet Series
documentationOWASP Foundation
Concise, practitioner-maintained guidance on specific application security problems. Read the relevant sheets as checklists when designing authentication, sessions, authorization, tenant isolation, input handling and secrets, and cite them when explaining a mitigation.
15 chapter or section links
- Authentication Cheat Sheet(opens in a new tab)
- Session Management Cheat Sheet(opens in a new tab)
- Authorization Cheat Sheet(opens in a new tab)
- Insecure Direct Object Reference Prevention Cheat Sheet(opens in a new tab)
- Multi-Tenant Application Security Cheat Sheet(opens in a new tab)
- Input Validation Cheat Sheet(opens in a new tab)
- SQL Injection Prevention Cheat Sheet(opens in a new tab)
- Query Parameterization Cheat Sheet(opens in a new tab)
- Cross Site Scripting Prevention Cheat Sheet(opens in a new tab)
- Cross-Site Request Forgery Prevention Cheat Sheet(opens in a new tab)
- Server-Side Request Forgery Prevention Cheat Sheet(opens in a new tab)
- Secrets Management Cheat Sheet(opens in a new tab)
- Password Storage Cheat Sheet(opens in a new tab)
- REST Security Cheat Sheet(opens in a new tab)
- Logging Cheat Sheet(opens in a new tab)
OWASP Top 10
documentationOWASP Foundation; 2025 edition (current when this entry was written)
Awareness document ranking the most critical web application security risk categories, revised every few years from contributed data. Use it as a map of what can go wrong; each category page describes the risk, examples and prevention. The 2025 edition files SSRF under Broken Access Control and cross-site scripting under Injection.
OWASP Top 10 for LLM Applications (2025)
documentationOWASP Gen AI Security Project
Community-maintained list of major security risks in LLM applications: prompt injection, sensitive information disclosure, supply chain, data and model poisoning, improper output handling, excessive agency, system prompt leakage, vector and embedding weaknesses, misinformation and unbounded consumption. Each entry gives scenarios and mitigations.
2 chapter or section links
Palantir: Students and early talent
Primary listcareers pagePalantir
Palantir’s page for students and early-career candidates. The detailed current technical loop is not verified from this source.
Pantheon: the training ground for Internet congestion-control research
toolStanford University; Francis Y. Yan, Jestin Ma, Greg D. Hill, Deepti Raghavan, Riad S. Wahby, Philip Levis, Keith Winstein; USENIX ATC 2018 (paper) (2018)
Community platform that ran many congestion-control schemes over real wired, cellular and cloud paths, published the results, and provided emulators calibrated to those paths. Valuable as a model of reproducible, multi-path comparison and for its archived results.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (The project announces end of support: no new schemes or experiments. The results archive, paper and code remain available.)Uses: ResearchLinked from 1 topic2 chapter or section links
Paxos Made Simple
paperLeslie Lamport (lamport.azurewebsites.net); Leslie Lamport; ACM SIGACT News, 2001 (2001)
A short, plain-language presentation of the Paxos consensus algorithm and its use for state-machine replication. Read it as background for Raft and for safety arguments built on quorum intersection and ordered proposal numbers.
Alternatives: Microsoft Research publication page(opens in a new tab)
Performance Evaluation of Computer and Communication Systems
bookEPFL (free online edition by the author); Jean-Yves Le Boudec (2010)
Textbook from an EPFL course covering methodology, summarizing data, confidence intervals, model fitting, tests, simulation and queueing. Chapters 1 and 2 matter most here: factors and hidden-factor paradoxes, then intervals for means, medians and quantiles and what to do when samples are not independent.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Free PDF from the author; a printed edition is published by EPFL Press.)Uses: Learning, ReferenceLinked from 3 topics3 chapter or section links
- Latest version of the full book (PDF)(opens in a new tab)
- Ch. 1: Methodology
- Ch. 2: Summarizing Performance Data, Confidence Intervals
Playwright: Getting started
Primary listdocumentationPlaywright documentation
Official Playwright introduction. Used for this app’s browser tests; also a reasonable reference for end-to-end testing questions.
Please stop calling databases CP or AP
articleMartin Kleppmann's blog; Martin Kleppmann (2015)
Spells out what the CAP theorem formally assumes (a single register, linearizability, every non-failed node answering) and why most real databases meet neither definition, so CP/AP labels mislead. Read it before any interview discussion of CAP.
Porcupine: a fast linearizability checker
toolGitHub (Anish Athalye); Anish Athalye
A Go linearizability checker for operation histories that renders interactive visualizations of failing histories; the MIT 6.5840 lab testers use it to produce their failure timelines. Pair it with the author’s blog post on testing distributed systems for linearizability.
1 chapter or section link
PostgreSQL documentation (current release)
documentationPostgreSQL Global Development Group
The official manual. Beyond the isolation, EXPLAIN and index pages listed under the core PostgreSQL entry, the pages below cover NULL semantics, constraints, WAL reliability and checkpoints, page layout, HOT updates, vacuuming, row estimation, two-phase commit and pgbench. Section numbers change between releases, so navigate by page title.
20 chapter or section links
- Comparison Functions and Operators(opens in a new tab)
- Subquery Expressions(opens in a new tab)
- Constraints(opens in a new tab)
- Serialization Failure Handling(opens in a new tab)
- Data Consistency Checks at the Application Level(opens in a new tab)
- Reliability(opens in a new tab)
- Asynchronous Commit(opens in a new tab)
- WAL Configuration(opens in a new tab)
- Database Page Layout(opens in a new tab)
- Heap-Only Tuples (HOT)(opens in a new tab)
- Routine Vacuuming(opens in a new tab)
- Index-Only Scans and Covering Indexes(opens in a new tab)
- BRIN Indexes(opens in a new tab)
- Row Estimation Examples(opens in a new tab)
- Multivariate Statistics Examples(opens in a new tab)
- Controlling the Planner with Explicit JOIN Clauses(opens in a new tab)
- Genetic Query Optimizer(opens in a new tab)
- Parallel Query(opens in a new tab)
- PREPARE TRANSACTION(opens in a new tab)
- pgbench(opens in a new tab)
PostgreSQL documentation: SQL tutorial and SQL language sections
documentationPostgreSQL Global Development Group
Part II of the PostgreSQL manual (The SQL Language) plus the matching tutorial sections. The pages listed here pin down join, grouping, NULL, subquery, ordering and window-function semantics precisely; other databases differ in details, so note which features are PostgreSQL-specific.
14 chapter or section links
- Tutorial: Joins Between Tables(opens in a new tab)
- Tutorial: Aggregate Functions(opens in a new tab)
- Joined Tables(opens in a new tab)
- The GROUP BY and HAVING Clauses(opens in a new tab)
- Combining Queries (UNION, INTERSECT, EXCEPT)(opens in a new tab)
- Sorting Rows (ORDER BY)(opens in a new tab)
- LIMIT and OFFSET(opens in a new tab)
- Comparison Functions and Operators(opens in a new tab)
- Conditional Expressions(opens in a new tab)
- Subquery Expressions(opens in a new tab)
- Aggregate Functions(opens in a new tab)
- Window Functions (function reference)(opens in a new tab)
- Window Function Calls (syntax and frames)(opens in a new tab)
- Row Security Policies(opens in a new tab)
PostgreSQL documentation: Transaction Isolation
Primary listdocumentationPostgreSQL Global Development Group
Precise description of what each isolation level permits in PostgreSQL, including serialization failures under Serializable and the difference between the SQL standard levels and PostgreSQL’s snapshot-based implementation.
8 chapter or section links
- MVCC introduction(opens in a new tab)
- Explicit Locking(opens in a new tab)
- Write-Ahead Logging (WAL)(opens in a new tab)
- Using EXPLAIN(opens in a new tab)
- Tutorial: Window Functions(opens in a new tab)
- WITH Queries (Common Table Expressions)(opens in a new tab)
- Index Types(opens in a new tab)
- Statistics Used by the Planner(opens in a new tab)
PostgreSQL wiki: Fsync Errors
articlePostgreSQL wiki
Project wiki page recording how operating systems report (and sometimes lose) write-back errors after fsync, and how PostgreSQL changed its handling as a result. A concrete reminder that durability depends on the whole storage stack, not only on the database’s log.
Prisma ORM: SQLite
Primary listdocumentationPrisma documentation
Official Prisma guide for SQLite, including the driver adapter required by Prisma ORM 7. Used to build this app’s persistence layer.
Producing Wrong Data Without Doing Anything Obviously Wrong!
paperUSI Lugano, SAPE research group (co-author page with a free ACM download); Todd Mytkowicz, Amer Diwan, Matthias Hauswirth, Peter F. Sweeney; ASPLOS 2009 (2009)
Shows that innocuous setup details, the size of the UNIX environment and the link order of object files, shift memory layout enough to change conclusions about compiler optimizations, and proposes setup randomization and causal analysis. Core reading on hidden confounders in performance measurement.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (The page links a free download through the ACM Digital Library.)Uses: Learning, ResearchLinked from 1 topicAlternatives: ACM Digital Library (DOI)(opens in a new tab) (not checkable automatically)
Prompt injection (article series)
articleSimon Willison's Weblog (practitioner); Simon Willison
A practitioner series running since 2022 that tracks prompt-injection attacks and proposed defenses. The "lethal trifecta" post gives a crisp design rule: an agent combining private data, exposure to untrusted content and a way to communicate externally can be made to exfiltrate that data.
Protocol Buffers Language Guide (proto 3)
documentationProtocol Buffers documentation (Google)
Official proto3 guide; its section on updating a message type states which schema changes are wire-safe, wire-unsafe or conditionally safe, why field numbers must never be reused, and how unknown fields let old binaries read data written by new ones. It also notes that JSON and text encodings have different rules, a useful reminder that compatibility depends on the encoding.
Proximal Policy Optimization Algorithms
paperarXiv; John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, Oleg Klimov (2017)
Introduces the clipped surrogate objective and the multi-epoch minibatch update scheme that made PPO a default policy-optimization method and later the optimizer in classic RLHF pipelines. Short; read the objective, the comparison of surrogate variants and the hyperparameter tables.
Python documentation: bitwise operations on integer types
documentationPython Software Foundation
Defines how Python applies bitwise operators to unbounded integers: results behave as if negative numbers had infinitely many sign bits, and negative shift counts raise an error. Read it to understand why inversion gives -x - 1 and why 32-bit tricks need explicit masking in Python.
1 chapter or section link
Python documentation: costs of built-in types and the container modules
documentationPython Software Foundation (docs.python.org)
Official CPython documentation of operation costs for list, tuple, dict, set and str, together with the modules that interview code relies on: collections (deque, Counter, defaultdict), heapq, bisect and functools. Use it to check every cost on a Python cheat sheet instead of relying on memory.
9 chapter or section links
- Time complexity of operations on built-in types(opens in a new tab)
- Tutorial 5.1.2: Using Lists as Queues(opens in a new tab)
- collections: deque, Counter, defaultdict(opens in a new tab)
- heapq: Heap queue algorithm(opens in a new tab)
- bisect: Array bisection algorithm(opens in a new tab)
- Sorting Techniques (HOWTO)(opens in a new tab)
- Built-in Types: common sequence operations and mapping types(opens in a new tab)
- sys.setrecursionlimit(opens in a new tab)
- functools: cache, lru_cache, cmp_to_key(opens in a new tab)
Python HOWTOs (official documentation)
documentationPython Software Foundation (docs.python.org)
Topic guides inside the official documentation. The Functional Programming HOWTO explains iterators, generators, generator expressions and itertools with small examples; the free-threading HOWTO describes the optional CPython build without the global interpreter lock, how to detect it and its current limitations.
Python Language Reference: Data model
documentationPython Software Foundation (docs.python.org)
The authoritative description of how Python objects behave: identity, type and value, which built-in types are mutable, and the special methods behind iteration, context managers and coroutines. Read the opening section to settle aliasing questions, and the protocol sections before implementing your own iterators or context managers.
PyTorch documentation: developer notes and reference pages
documentationPyTorch documentation
Official notes on broadcasting, extending autograd, reproducibility and numerical accuracy, plus the reference pages this branch relies on (gradcheck, scaled_dot_product_attention, tensor views). Open the specific section a topic names; together they explain most silent bugs in research code.
10 chapter or section links
- Broadcasting semantics(opens in a new tab)
- Extending PyTorch (custom autograd Functions, gradcheck)(opens in a new tab)
- Reproducibility(opens in a new tab)
- Numerical accuracy(opens in a new tab)
- Frequently asked questions (memory growth, data-loader seeding)(opens in a new tab)
- Tensor views(opens in a new tab)
- torch.autograd.gradcheck(opens in a new tab)
- torch.nn.functional.scaled_dot_product_attention(opens in a new tab)
- torch.testing (assert_close)(opens in a new tab)
- Tutorial: double backward with custom functions(opens in a new tab)
PyTorch Profiler recipe
documentationPyTorch tutorials
Step-by-step introduction to torch.profiler: recording CPU and CUDA activity, grouping by operator and input shape, profiling memory, exporting a timeline trace and profiling long-running jobs with a schedule. The right first tool before reaching for Nsight.
PyTorch: Autograd mechanics
Primary listdocumentationPyTorch documentation
How PyTorch records operations into a graph, saves tensors for backward, handles in-place operations, no-grad and inference modes, and multithreaded backward. Read it to explain gradient bugs instead of guessing.
PyTorch: Automatic Mixed Precision package (torch.amp)
documentationPyTorch documentation
Reference for autocast and gradient scaling, including the operator lists that show which operations run in lower precision and which are kept in float32. Use the op reference to explain why softmax, normalization, reductions and losses stay in higher precision.
2 chapter or section links
PyTorch: CUDA semantics
documentationPyTorch documentation
Explains how PyTorch drives CUDA: asynchronous execution, streams and their synchronization rules, the caching memory allocator, TF32 and reduced-precision settings, pinned memory buffers and CUDA Graphs. Read it before trusting any timing or memory number you collect.
PyTorch: Getting Started with Distributed Data Parallel
Primary listdocumentationPyTorch tutorials
Official walkthrough of DistributedDataParallel: process groups, one process per device, gradient all-reduce during backward, checkpointing and combining with model parallelism. A practical anchor for data-parallel training questions.
PyTorch: Getting Started with Fully Sharded Data Parallel (FSDP2)
documentationPyTorch tutorials
Official tutorial on sharding parameters, gradients and optimizer state across data-parallel ranks with fully_shard: parameters are all-gathered before use and resharded afterwards, gradients are reduce-scattered, and prefetching and mixed-precision policies are configurable. The hands-on counterpart to the ZeRO paper.
PyTorch: torch.utils.checkpoint
documentationPyTorch documentation
API documentation for activation checkpointing: how recomputation handles random state such as dropout masks, the reentrant and non-reentrant variants, and checkpointing sequential models. Read it next to the memory-cost papers to connect the theory to the API you will actually call.
PyTorch: torch.utils.data (Dataset and DataLoader)
documentationPyTorch documentation
Reference for map-style and iterable datasets, samplers, automatic batching and collate functions, multi-process loading with worker processes, randomness in workers and memory pinning. Read the multi-process and memory-pinning sections before tuning a slow input pipeline.
2 chapter or section links
React documentation: Managing State and Effects
documentationReact team (react.dev)
The official React guide to structuring state. Even outside React, its rules against redundant, duplicated and contradictory state and its handling of stale responses in data-fetching effects state framework-independent principles clearly.
Reconciling High Server Utilization and Sub-millisecond Quality-of-Service
paperStanford University (author PDF); Jacob Leverich, Christos Kozyrakis; EuroSys 2014 (2014)
Studies memcached co-located with other workloads and attributes quality-of-service violations to queueing delay, scheduling delay and thread load imbalance, then tests mitigations including a different CPU scheduler. Directly relevant if you measured memcached tail latency under interference in coursework; it also introduced the mutilate load generator.
Red Teaming Language Models with Language Models
paperarXiv; Ethan Perez, Saffron Huang, et al. (2022)
Uses one language model to generate test cases that elicit harmful outputs from another, comparing zero-shot, few-shot, supervised and RL-based generation and tracking the diversity of the failures found. The reference point for automated red teaming.
Reducing Activation Recomputation in Large Transformer Models
paperarXiv; Vijay Korthikanti et al.; MLSys 2023 (2022)
Derives the activation memory of a transformer layer term by term, then introduces sequence parallelism and selective recomputation that recomputes only the cheap but memory-hungry parts of attention. The clearest worked example of activation accounting.
Redundancy Does Not Imply Fault Tolerance: Analysis of Distributed Storage Reactions to Single Errors and Corruptions
paperUSENIX; Aishwarya Ganesan, Ramnatthan Alagappan, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau; FAST 2017 (2017)
Injects single file-system faults (corruptions, read and write errors) under replicas of popular distributed storage systems and finds that one fault can cause data loss, corruption or unavailability despite redundancy. A model for targeted storage fault injection.
Reinforcement Learning: An Introduction (2nd edition)
bookMIT Press; Richard S. Sutton, Andrew G. Barto (2018); 2nd edition (2018)
The standard RL textbook: MDPs, dynamic programming, Monte Carlo and temporal-difference methods, function approximation and policy-gradient methods in one consistent notation. Use selected chapters for depth after Spinning Up; it is not needed for awareness-level preparation.
Open(opens in a new tab)Not checked, 5 Oct 2026Free (The authors host a free PDF of the complete second edition on incompleteideas.net, which is served over plain HTTP (its HTTPS certificate is self-signed), so it is not linked here. The MIT Press page sells the printed book and may block automated requests.)Uses: Learning, ReferenceLinked from 1 topicCheck note: Not requested: the site's robots.txt disallows automated access to this path.
ReScience C (journal of computational replications)
documentationReScience initiative
Open-access, peer-reviewed journal for replications of computational studies, where each submission is a new implementation reviewed in public on GitHub and failed replications are explicitly welcome. Read a few reports to see how differences from the original work are documented.
Research advice: doing research, evaluating papers, giving talks
articleS. Keshav (author's site, University of Cambridge); S. Keshav
Short practitioner checklists from an experienced networking and systems researcher on choosing and executing research, judging paper quality and structuring a talk. Treat them as one researcher’s advice: useful checklists, not rules.
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Primary listpaperarXiv; Patrick Lewis et al.; NeurIPS 2020 (2020)
Combines a dense retriever with a sequence-to-sequence generator and treats retrieved passages as latent variables. Today’s “RAG” systems differ a lot from this setup, so read it for the problem framing and evaluation, not as a production recipe.
Retry with backoff pattern (AWS Prescriptive Guidance)
Primary listdocumentationAmazon Web Services
Concise description of retrying transient failures with exponential backoff and jitter, including when retries are unsafe. Pair it with idempotency and retry budgets so retries do not amplify an outage.
RFC 3168: The Addition of Explicit Congestion Notification (ECN) to IP
standardIETF (RFC Editor) (2001)
Defines the ECN codepoints in the IP header and how TCP negotiates ECN and echoes congestion marks. Long; read Sections 5 and 6.1 and treat the rest as reference.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026FreeUses: ReferenceLinked from 1 topicCheck note: Not requested individually: www.rfc-editor.org rate-limited an earlier automated request (HTTP 429), so the check stopped contacting it.
2 chapter or section links
- Section 5: Explicit Congestion Notification in IP(opens in a new tab) (not checkable automatically)
- Section 6.1: TCP(opens in a new tab) (not checkable automatically)
RFC 4271: A Border Gateway Protocol 4 (BGP-4)
standardIETF (RFC Editor) (2006)
The BGP-4 specification. For interview and research purposes, read the decision process to see that local preference is applied before path length and tie-breakers; the message formats and state machine are reference material.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026FreeUses: ReferenceLinked from 1 topicCheck note: Not requested individually: www.rfc-editor.org rate-limited an earlier automated request (HTTP 429), so the check stopped contacting it.
1 chapter or section link
- Section 9.1: Decision Process(opens in a new tab) (not checkable automatically)
RFC 4632: Classless Inter-domain Routing (CIDR): The Internet Address Assignment and Aggregation Plan
standardIETF (RFC Editor) (2006)
Explains prefix notation, why classful addressing was abandoned and how aggregation keeps routing tables small. Section 3 is a short, authoritative statement of how prefixes work.
1 chapter or section link
RFC 5681: TCP Congestion Control
standardIETF (RFC Editor) (2009)
The standard statement of slow start, congestion avoidance, fast retransmit and fast recovery. Use it to check the exact rules after learning them from a textbook.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026FreeUses: ReferenceLinked from 1 topicCheck note: Not requested individually: www.rfc-editor.org rate-limited an earlier automated request (HTTP 429), so the check stopped contacting it.
3 chapter or section links
- Section 3: Congestion Control Algorithms(opens in a new tab) (not checkable automatically)
- Section 3.1: Slow Start and Congestion Avoidance(opens in a new tab) (not checkable automatically)
- Section 3.2: Fast Retransmit/Fast Recovery(opens in a new tab) (not checkable automatically)
RFC 6298: Computing TCP's Retransmission Timer
standardIETF (RFC Editor) (2011)
The standard algorithm for TCP retransmission timeouts: smoothed RTT, RTT variance, minimum values and exponential backoff. Short enough to read fully; compute an RTO by hand afterwards.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026FreeUses: ReferenceLinked from 1 topicCheck note: The site rate-limited the automated request (HTTP 429).
2 chapter or section links
- Section 2: The Basic Algorithm(opens in a new tab) (not checkable automatically)
- Section 5: Managing the RTO Timer(opens in a new tab) (not checkable automatically)
RFC 7908: Problem Definition and Classification of BGP Route Leaks
standardIETF (RFC Editor) (2016)
Short document that defines route leaks and classifies them by the customer, peer and provider relationships they violate, using documented incidents. Useful for explaining a leak precisely rather than as a vague misconfiguration.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026FreeUses: Learning, ReferenceLinked from 1 topicCheck note: Not requested individually: www.rfc-editor.org rate-limited an earlier automated request (HTTP 429), so the check stopped contacting it.
2 chapter or section links
- Section 2: Working Definition of Route Leaks(opens in a new tab) (not checkable automatically)
- Section 3: Classification of Route Leaks Based on Documented Events(opens in a new tab) (not checkable automatically)
RFC 8085: UDP Usage Guidelines
standardIETF (RFC Editor) (2017)
Best-current-practice guidance for protocols built on UDP: congestion control, message sizes, reliability, checksums and middlebox traversal. It is the clearest list of what an application takes on when it chooses UDP.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026FreeUses: ReferenceLinked from 1 topicCheck note: Not requested individually: www.rfc-editor.org rate-limited an earlier automated request (HTTP 429), so the check stopped contacting it.
1 chapter or section link
- Section 3: UDP Usage Guidelines(opens in a new tab) (not checkable automatically)
RFC 8257: Data Center TCP (DCTCP): TCP Congestion Control for Data Centers
standardIETF (RFC Editor) (2017)
Informational description of DCTCP as implemented in operating systems, with practical notes the original paper does not emphasize: deployment only in controlled environments and segregation from conventional TCP traffic.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026FreeUses: ReferenceLinked from 1 topicCheck note: Not requested individually: www.rfc-editor.org rate-limited an earlier automated request (HTTP 429), so the check stopped contacting it.
2 chapter or section links
- Section 3: DCTCP Algorithm(opens in a new tab) (not checkable automatically)
- Section 5: Deployment Issues(opens in a new tab) (not checkable automatically)
RFC 8446: The Transport Layer Security (TLS) Protocol Version 1.3
standardIETF (RFC Editor) (2018)
The TLS 1.3 specification. Section 2 is a readable overview of the full handshake, resumption with pre-shared keys and 0-RTT data; Section 8 explains why 0-RTT data can be replayed.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026FreeUses: ReferenceLinked from 1 topicCheck note: Not requested individually: www.rfc-editor.org rate-limited an earlier automated request (HTTP 429), so the check stopped contacting it.
3 chapter or section links
- Section 2: Protocol Overview(opens in a new tab) (not checkable automatically)
- Section 2.3: 0-RTT Data(opens in a new tab) (not checkable automatically)
- Section 8: 0-RTT and Anti-Replay(opens in a new tab) (not checkable automatically)
RFC 9000: QUIC: A UDP-Based Multiplexed and Secure Transport
standardIETF (RFC Editor) (2021)
The core QUIC specification. Read the sections on streams, flow control, connection IDs and migration; the packet-format sections are reference material.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026FreeUses: ReferenceLinked from 1 topicCheck note: Not requested individually: www.rfc-editor.org rate-limited an earlier automated request (HTTP 429), so the check stopped contacting it.
4 chapter or section links
- Section 2: Streams(opens in a new tab) (not checkable automatically)
- Section 4: Flow Control(opens in a new tab) (not checkable automatically)
- Section 5.2.3: Considerations for Simple Load Balancers(opens in a new tab) (not checkable automatically)
- Section 9: Connection Migration(opens in a new tab) (not checkable automatically)
RFC 9110: HTTP Semantics
standardIETF (RFC Editor); R. Fielding, M. Nottingham, J. Reschke (eds.) (2022)
The current specification of the semantics shared by all HTTP versions: methods and their safety and idempotency, status codes, conditional requests and the authentication framework. Use it to settle precise questions rather than as a first introduction.
7 chapter or section links
- Section 9.2.1: Safe Methods(opens in a new tab)
- Section 9.2.2: Idempotent Methods(opens in a new tab)
- Section 11: HTTP Authentication(opens in a new tab)
- Section 13.1.1: If-Match(opens in a new tab)
- Section 15: Status Codes(opens in a new tab)
- Section 15.5.2: 401 Unauthorized(opens in a new tab)
- Section 15.5.4: 403 Forbidden(opens in a new tab)
RFC 9114: HTTP/3
standardIETF (RFC Editor) (2022)
Maps HTTP semantics onto QUIC. The introduction states concisely which head-of-line blocking problem HTTP/3 addresses; Section 3 covers endpoint discovery and connection reuse.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026FreeUses: ReferenceLinked from 1 topicCheck note: Not requested individually: www.rfc-editor.org rate-limited an earlier automated request (HTTP 429), so the check stopped contacting it.
2 chapter or section links
- Section 1.1: Prior Versions of HTTP(opens in a new tab) (not checkable automatically)
- Section 3: Connection Setup and Management(opens in a new tab) (not checkable automatically)
RFC 9293: Transmission Control Protocol (TCP)
Primary liststandardIETF (RFC Editor) (2022)
The current consolidated TCP specification. Use it as the authoritative reference for the state machine, sequence numbers, the three-way handshake, connection teardown and TIME-WAIT; do not read it linearly as a first introduction.
RFC 9438: CUBIC for Fast and Long-Distance Networks
standardIETF (RFC Editor) (2023)
Standards-track specification of CUBIC, the default loss-based algorithm in major operating systems and the usual baseline in congestion-control research. The design-principle and discussion sections state its fairness goals and the environments its authors consider difficult.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026FreeUses: Reference, ResearchLinked from 1 topicCheck note: Not requested individually: www.rfc-editor.org rate-limited an earlier automated request (HTTP 429), so the check stopped contacting it.
3 chapter or section links
- Section 3: Design Principles of CUBIC(opens in a new tab) (not checkable automatically)
- Section 4: CUBIC Congestion Control(opens in a new tab) (not checkable automatically)
- Section 5: Discussion(opens in a new tab) (not checkable automatically)
RFC 9457: Problem Details for HTTP APIs
standardIETF (RFC Editor); M. Nottingham, E. Wilde, S. Dalal (2023)
Defines a standard format for machine-readable error details in HTTP API responses, replacing RFC 7807. Useful as a ready-made error model to propose, or to compare against, in API design discussions.
RFC 9743: Specifying New Congestion Control Algorithms (BCP 133)
standardIETF (RFC Editor) (2025)
Best current practice (obsoleting RFC 5033) on how proposed congestion-control algorithms should be evaluated before wide use: single-algorithm and mixed-algorithm behavior, tail-drop and AQM paths, wireless, high delay, reordering and data centers. A ready-made checklist for designing or critiquing an evaluation.
Open(opens in a new tab)Not checkable automatically, 5 Oct 2026FreeUses: Research, ReferenceLinked from 1 topicCheck note: Not requested individually: www.rfc-editor.org rate-limited an earlier automated request (HTTP 429), so the check stopped contacting it.
3 chapter or section links
- Section 5: Evaluation Criteria(opens in a new tab) (not checkable automatically)
- Section 6: General Use(opens in a new tab) (not checkable automatically)
- Section 7: Special Cases(opens in a new tab) (not checkable automatically)
Ringing in a new asynchronous I/O API
articleLWN.net; Jonathan Corbet (2019)
Introduces io_uring as it was merged: submission and completion rings shared between user space and the kernel, batching of many operations per system call, and why the older Linux AIO interface fell short. Enough for awareness-level discussion of completion-based I/O; check io_uring(7) for current details.
RocksDB wiki: overview, compaction, Bloom filters and tuning
documentationRocksDB project (GitHub wiki)
Engineering documentation for a widely used LSM-tree storage engine. The compaction, Bloom filter and tuning pages make read, write and space amplification concrete and show which knobs trade one for another; read them after the textbook LSM description.
Roofline: An Insightful Visual Performance Model for Floating-Point Programs and Multicore Architectures
paperUC Berkeley EECS (technical report); Samuel Webb Williams, Andrew Waterman, David A. Patterson; UC Berkeley Technical Report UCB/EECS-2008-134 (2008)
Introduces the roofline model: attainable throughput is bounded by peak compute or by arithmetic intensity times memory bandwidth, whichever is lower. A one-picture way to decide whether a kernel or service is compute-bound or bandwidth-bound before profiling.
Rules of Machine Learning: Best Practices for ML Engineering
articleGoogle for Developers; Martin Zinkevich
Practitioner rules for shipping ML products: launch with heuristics before ML, design metrics first, keep the first model simple, watch for silent failures and measure training-serving skew. Read it as engineering judgment from large production systems, not as universal law.
4 chapter or section links
- Before Machine Learning (Rules #1 to #3)
- ML Phase I: Your First Pipeline (Rules #4 to #7)
- Monitoring (Rules #8 to #11)
- Training-Serving Skew (Rules #29 to #37)
Safe and Effective Fine-grained TCP Retransmissions for Datacenter Communication
paperCarnegie Mellon University (author copy); Vijay Vasudevan, Amar Phanishayee, Hiral Shah, Elie Krevat, David G. Andersen, Gregory R. Ganger, Garth A. Gibson, Brian Mueller; ACM SIGCOMM 2009 (2009)
Analyzes TCP incast in synchronized many-to-one workloads and argues for retransmission timers with fine granularity. Clear on why a timeout floor sized for wide-area paths is disastrous at data-center RTTs.
Sanity Checks for Saliency Maps
paperarXiv; Julius Adebayo, Justin Gilmer, Michael Muelly, Ian Goodfellow, Moritz Hardt, Been Kim; NeurIPS 2018 (2018)
Proposes model-parameter and data randomization tests for attribution methods and shows that some popular saliency methods barely depend on the trained weights. Read it before trusting any attribution figure, including your own.
Scalability! But at what COST?
paperUSENIX; Frank McSherry, Michael Isard, Derek G. Murray; HotOS 2015 (2015)
Defines COST, the hardware configuration a system needs before it outperforms a competent single-threaded implementation, and finds that several published data-parallel systems have a large COST or never beat one thread. A short lesson in choosing honest baselines for performance claims.
Scaling Laws for Neural Language Models
paperarXiv; Jared Kaplan, Sam McCandlish, et al. (2020)
Early systematic power-law fits of language-model loss against parameters, data and compute, with advice on allocating a compute budget. Read it for the fitting methodology and contrast it with later compute-optimal analyses that reached a different allocation.
Scaling Laws for Reward Model Overoptimization
paperarXiv; Leo Gao, John Schulman, Jacob Hilton (2022)
Uses a synthetic setup in which a large "gold" reward model labels preferences for smaller proxy reward models, then measures how gold reward changes as policies optimize the proxy with best-of-n sampling or RL. A clean quantitative study of reward hacking with learned rewards.
Scaling Memcache at Facebook
paperUSENIX; Rajesh Nishtala et al.; NSDI 2013 (2013)
A look-aside cache deployment described end to end: invalidation after database writes, leases against stale sets and thundering herds, pools, regional replication and cold-cluster warm-up. Pairs well with hands-on memcached experience; it is also a lecture in MIT 6.5840.
Scaling your API with rate limiters
articleStripe Engineering Blog; Paul Tarjan (2017)
Describes several distinct limiters in one API (per-user request limits, concurrency limits and load shedders that protect critical traffic) and how token buckets implement them. A practical anchor for rate-limiter design discussions.
Scientific Benchmarking of Parallel Computing Systems: Twelve Ways to Tell the Masses when Reporting Performance Results
paperETH Zürich SPCL (author copy); Torsten Hoefler, Roberto Belli; SC 2015 (2015)
Surveys how performance results are reported in HPC papers and proposes twelve rules: report the base case of speedups, choose means that fit costs or rates, give confidence intervals for nondeterministic data, check normality, consider percentiles and document every varying factor. The rules transfer directly to cloud, systems and ML performance work.
Open(opens in a new tab)Link responded, 5 Oct 2026FreeUses: Learning, Research, ReferenceLinked from 2 topicsAlternatives: SPCL publication page(opens in a new tab)
scikit-learn User Guide
documentationscikit-learn documentation
Library reference that doubles as a careful methods text. The pages on cross-validation iterators, pipelines, metrics, probability calibration and decision-threshold tuning are among the clearest practical treatments of evaluation design. Section numbers change between releases, so navigate by title.
5 chapter or section links
- Cross-validation: evaluating estimator performance(opens in a new tab)
- Pipelines and composite estimators(opens in a new tab)
- Metrics and scoring: quantifying the quality of predictions(opens in a new tab)
- Probability calibration(opens in a new tab)
- Tuning the decision threshold for class prediction(opens in a new tab)
scikit-learn: Common pitfalls and recommended practices
Primary listdocumentationscikit-learn documentation
Short guide to inconsistent preprocessing, data leakage through fitting on the full dataset, and controlling randomness. Directly maps to frequent interview questions about evaluation mistakes.
Sentence Transformers documentation
documentationSentence Transformers documentation (sbert.net)
Documentation for a widely used library of bi-encoder embedding models and cross-encoder rerankers, with worked examples of semantic search and retrieve-then-rerank. Use it to build a small retrieval pipeline and to see the bi-encoder versus cross-encoder tradeoff concretely.
Open(opens in a new tab)Link responded, 5 Oct 2026FreeUses: Learning, Practice, ReferenceLinked from 1 topic2 chapter or section links
Serializable Snapshot Isolation in PostgreSQL
paperPVLDB (VLDB Endowment); Dan R. K. Ports, Kevin Grittner; PVLDB, vol. 5, no. 12 (2012)
Experience paper on implementing serializable snapshot isolation in a production database: detecting dangerous read-write dependency structures, predicate (SIREAD) locks, memory bounds, read-only optimizations and interaction with replication. A rare look at the engineering compromises behind an isolation guarantee.
Alternatives: arXiv version (1208.4179)(opens in a new tab)
Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider
paperUSENIX; Mohammad Shahrad et al.; USENIX ATC 2020 (2020)
Characterizes the production Azure Functions workload (invocation rates, triggers, execution times, memory) and proposes a per-application, histogram-based policy that chooses pre-warming and keep-alive windows to trade cold starts against idle memory. Comes with a public trace.
Show Your Work: Improved Reporting of Experimental Results
paperarXiv; Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith; EMNLP 2019 (2019)
Argues that test scores alone cannot rank models because conclusions depend on the computation spent on hyperparameter search, and proposes reporting expected validation performance as a function of the tuning budget. Use it to make baseline comparisons budget-aware.
Sim-to-Real Transfer of Robotic Control with Dynamics Randomization
paperarXiv; Xue Bin Peng, Marcin Andrychowicz, Wojciech Zaremba, Pieter Abbeel; ICRA 2018 (2018)
Randomizes physical parameters such as masses, friction and latency during simulated training so that a control policy transfers to a real robot without real-world training. Pair it with visual domain randomization to see both halves of the reality gap.
Simple Testing Can Prevent Most Critical Failures: An Analysis of Production Failures in Distributed Data-Intensive Systems
paperUSENIX; Ding Yuan, Yu Luo, Xin Zhuang, Guilherme Renna Rodrigues, Xu Zhao, Yongle Zhang, Pranay U. Jain, Michael Stumm; OSDI 2014 (2014)
Studies randomly sampled user-reported failures in widely used distributed data systems and finds that most need only a few nodes to reproduce and that the majority of catastrophic ones stem from mishandled, explicitly signalled errors. Use its findings to aim fault injection at error-handling paths.
Simple, Fast, and Practical Non-Blocking and Blocking Concurrent Queue Algorithms
paperMichael L. Scott's papers page (University of Rochester); Maged M. Michael, Michael L. Scott; PODC 1996 (1996)
Short paper presenting a lock-free linked-list queue that many libraries later adopted, alongside a two-lock blocking queue. Ideal for practicing linearization-point arguments and for seeing counted pointers used against the ABA problem.
Site Reliability Engineering (Google SRE book)
Primary listbookGoogle (free online edition); Betsy Beyer, Chris Jones, Jennifer Petoff, Niall Richard Murphy (eds.) (2016)
Practitioner book on running production services: SLOs and error budgets, monitoring, overload handling, cascading failures, incident response and postmortems. Read selected chapters per topic; it is descriptive of Google practice, not a universal standard.
Open(opens in a new tab)Link responded, 5 Oct 2026FreeUses: Learning, ReferenceLinked from 13 topics13 chapter or section links
- Ch. 3: Embracing Risk(opens in a new tab)
- Ch. 4: Service Level Objectives(opens in a new tab)
- Ch. 6: Monitoring Distributed Systems(opens in a new tab)
- Ch. 8: Release Engineering(opens in a new tab)
- Ch. 12: Effective Troubleshooting(opens in a new tab)
- Ch. 14: Managing Incidents(opens in a new tab)
- Ch. 15: Postmortem Culture(opens in a new tab)
- Ch. 19: Load Balancing at the Frontend(opens in a new tab)
- Ch. 20: Load Balancing in the Datacenter(opens in a new tab)
- Ch. 21: Handling Overload(opens in a new tab)
- Ch. 22: Addressing Cascading Failures(opens in a new tab)
- Ch. 23: Managing Critical State: Distributed Consensus for Reliability(opens in a new tab)
- Ch. 26: Data Integrity: What You Read Is What You Wrote(opens in a new tab)
Sizing Router Buffers
paperStanford University (author copy); Guido Appenzeller, Isaac Keslassy, Nick McKeown; ACM SIGCOMM 2004 (2004)
Challenges the one-BDP rule of thumb for router buffers, arguing that with many desynchronized long-lived flows much smaller buffers keep core links busy. Read it for how assumptions about flow count and synchronization drive the conclusion.
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
paperarXiv; Guangxuan Xiao et al.; ICML 2023 (2022)
Explains why activation outliers make 8-bit activation quantization of LLMs hard and moves the difficulty into the weights with an offline, mathematically equivalent per-channel rescaling, enabling 8-bit weights and activations. A clear entry point to the outlier problem.
Snowflake: Get hired
Primary listofficial guideSnowflake Careers
Snowflake’s official page describing its hiring process.
Software Engineering at Google: Lessons Learned from Programming Over Time
bookAbseil (free HTML edition of the O'Reilly book); Titus Winters, Tom Manshreck, Hyrum Wright (eds.) (2020)
Book on the practices that keep a large codebase healthy over time: testing at different sizes, test doubles, code review, deprecation, dependency management, large-scale changes, continuous integration and delivery, and technical leadership. It describes one organization’s choices, so treat specifics as examples rather than rules.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (The HTML edition on abseil.io is free; print and e-book editions are sold separately.)Uses: Learning, ReferenceLinked from 2 topics12 chapter or section links
- Ch. 5: How to Lead a Team(opens in a new tab)
- Ch. 6: Leading at Scale(opens in a new tab)
- Ch. 9: Code Review(opens in a new tab)
- Ch. 11: Testing Overview(opens in a new tab)
- Ch. 12: Unit Testing(opens in a new tab)
- Ch. 13: Test Doubles(opens in a new tab)
- Ch. 14: Larger Testing(opens in a new tab)
- Ch. 15: Deprecation(opens in a new tab)
- Ch. 21: Dependency Management(opens in a new tab)
- Ch. 22: Large-Scale Changes(opens in a new tab)
- Ch. 23: Continuous Integration(opens in a new tab)
- Ch. 24: Continuous Delivery(opens in a new tab)
Spanner: Google's Globally-Distributed Database
Primary listpaperGoogle Research; James C. Corbett et al.; OSDI 2012 (2012)
Globally distributed database providing externally consistent transactions by combining Paxos-replicated shards, two-phase commit and TrueTime’s bounded clock uncertainty with commit wait. Separate the guaranteed semantics from the measured performance when reading it.
Spanner: TrueTime and external consistency (Google Cloud documentation)
documentationGoogle Cloud documentation
Product documentation explaining what external consistency means for clients and how TrueTime supports it. Useful as a plain-language companion to the 2012 paper; it describes the current managed service, which has evolved since the paper.
Specification gaming: the flip side of AI ingenuity
articleGoogle DeepMind (blog); Victoria Krakovna, Jonathan Uesato, Vladimir Mikulik, Matthew Rahtz, Tom Everitt, Ramana Kumar, Zac Kenton, Jan Leike, Shane Legg (2020)
Explains specification gaming, where an agent satisfies the literal objective but not the intended one, with examples and a discussion of why reward design is hard. Useful vocabulary and examples for reward-hacking questions.
Spinning Up in Deep RL
courseOpenAI; Josh Achiam (primary developer) (2018)
Concise introduction to RL concepts, a taxonomy of algorithms and a clear derivation of policy gradients, with documented reference implementations (VPG, PPO, SAC and others), exercises and a key-papers list. The best starting point for policy-gradient fluency.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (The written material remains a good introduction; the accompanying code targets older library versions and may need an older environment.)Uses: Learning, PracticeLinked from 1 topic6 chapter or section links
- Part 1: Key Concepts in RL(opens in a new tab)
- Part 2: Kinds of RL Algorithms(opens in a new tab)
- Part 3: Intro to Policy Optimization(opens in a new tab)
- Proximal Policy Optimization (algorithm docs)(opens in a new tab)
- Exercises (problem sets 1 and 2)(opens in a new tab)
- Key Papers in Deep RL(opens in a new tab)
SQLite documentation: commit protocol, WAL, file format and query planning
documentationSQLite (sqlite.org)
SQLite’s design documents state their failure assumptions unusually plainly. The pages below explain the rollback-journal commit, the alternative write-ahead-log design and its tradeoffs, the hardware and OS behaviors that can corrupt a database, the on-disk B-tree page format and how the planner uses indexes.
7 chapter or section links
ss(8): socket statistics (Linux manual page)
documentationman7.org (Linux man-pages project)
Reference for ss, the iproute2 replacement for netstat: filtering sockets by state and port, queue columns, and the per-connection TCP information shown with -i (RTT, congestion window, retransmissions, pacing and delivery rate).
StaffEng guides
articleStaffEng (staffeng.com); Will Larson
Essays on operating as a senior or staff engineer: archetypes of the role, choosing work that matters, writing engineering strategy and managing technical quality. Useful for understanding what senior scope and influence look like in practice.
Stanford CS144 Introduction to Computer Networking
Primary listcourseStanford University
Networking course whose checkpoints build a working TCP implementation in C++ (byte streams, reassembly, sender/receiver, then IP and routing). Ideal for turning transport concepts into implementation-level understanding.
1 chapter or section link
- Lab checkpoints (byte stream, reassembler, TCP receiver/sender, network interface, router)
Stanford CS229 Machine Learning
Primary listcourseStanford University
Mathematically grounded ML course: supervised learning, generalized linear models, generative models, kernels, learning theory, unsupervised learning and RL basics. The main lecture notes are the right depth for interview-level derivations.
Stanford CS231n Deep Learning for Computer Vision
Primary listcourseStanford University
Deep learning course with famously clear notes on backpropagation, optimization, convolutional networks and training practicalities. Use the notes and assignments to make backprop and training-loop debugging concrete.
1 chapter or section link
Stanford CS336 Language Modeling from Scratch
Primary listcourseStanford University
Builds a language model end to end: tokenization, transformer implementation, training, systems efficiency (kernels, parallelism), scaling laws, data and alignment. Its assignments are the closest public analogue to research-engineer implementation work on LLMs.
Open(opens in a new tab)Link responded, 5 Oct 2026FreeUses: Learning, Practice, ResearchLinked from 6 topicsStaring into the Abyss: An Evaluation of Concurrency Control with One Thousand Cores
paperPVLDB (VLDB Endowment); Xiangyao Yu, George Bezerra, Andrew Pavlo, Srinivas Devadas, Michael Stonebraker; PVLDB, vol. 8, no. 3 (2014)
Implements classic concurrency-control protocols in one engine and runs them on a simulated many-core machine, finding a different scalability bottleneck for each. A model of how to attribute performance to protocol versus implementation components.
Static stability using Availability Zones
articleAmazon Builders' Library; Becky Weiss, Mike Furr
Argues that surviving a zone failure should not require any new action, such as launching capacity or calling a control plane, and shows how pre-provisioned capacity and data-plane independence achieve that.
Alternatives: Official PDF version(opens in a new tab)
Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations
paperPubMed Central (open access); Sander Greenland, Stephen J. Senn, Kenneth J. Rothman, John B. Carlin, Charles Poole, Steven N. Goodman, Douglas G. Altman; European Journal of Epidemiology 31, 2016 (2016)
A numbered catalogue of common misreadings of p-values, significance tests, confidence intervals and power, each with a short correction. Written for empirical scientists in general; use it to check how you phrase statistical conclusions.
Statistically Rigorous Java Performance Evaluation
paperDries Buytaert's website (co-author copy); Andy Georges, Dries Buytaert, Lieven Eeckhout; OOPSLA 2007 (2007)
Shows that common ad hoc reporting of managed-runtime benchmarks (best run, single invocation, ignoring warm-up) can lead to wrong conclusions, and advocates repeated invocations, separate startup and steady-state measurement and confidence intervals. The lessons apply to any JIT-, cache- or warm-up-dominated measurement.
std::memory_order (cppreference)
documentationcppreference.com
Reference for the C++ memory orders (relaxed, acquire, release, acq_rel, seq_cst) with the definitions of sequenced-before, synchronizes-with and happens-before and small litmus examples. Use it to check precise wording once you have the intuition; the same vocabulary transfers to C, Rust and Java atomics.
Strangler Fig
articlemartinfowler.com; Martin Fowler
Describes replacing a legacy system gradually: build new capability around it, divert behavior piece by piece, and remove the old system only when nothing depends on it. A standard reference for incremental migration strategy.
Streaming 101 and Streaming 102: The world beyond batch
articleO’Reilly Radar; Tyler Akidau (2015)
Two long articles by an author of the Dataflow model that build intuition for unbounded data, event time versus processing time, windowing, watermarks, triggers and accumulation, with diagrams. Read 101 first, then 102, before the Dataflow paper.
1 chapter or section link
Stripe API reference: Idempotent requests
documentationStripe documentation
A concise, real-world contract for idempotency keys on a public API: how clients supply keys, how long the server keeps them, which results are saved and replayed, and that a reused key with different parameters is rejected. Useful as a concrete model when you specify retry semantics for your own API.
Stripe Atlas guide: Scaling your engineering team
Primary listarticleStripe
Stripe Atlas guide on building engineering teams that discusses Stripe’s historical use of practical, work-like interviews. Historical context, not a current candidate guide.
Students' Guide to Raft
articleJon Gjengset's blog; Jon Gjengset (2016)
Written for students of the MIT distributed-systems course: collects the Raft details implementers most often get wrong (when to reset election timers, replies from old terms, only advancing the commit index for current-term entries) and how to debug them. Read it alongside the Raft lab.
SYN packet handling in the wild
articleCloudflare Blog; Marek Majkowski (2018)
Engineering post explaining the Linux SYN queue and accept queue, what happens when each overflows, and how to observe them. Useful for turning "the listen backlog" into concrete, observable behavior.
Systems Benchmarking Crimes
articleGernot Heiser's website; Gernot Heiser
A reviewer’s catalogue of misleading benchmarking practice in systems papers (selective benchmarking, improper handling and comparison of results, wrong benchmarks, missing information) followed by best-practice rules. Practitioner opinion from an experienced systems researcher; use it as a pre-submission checklist.
Systems Research Artifacts (artifact evaluation for systems conferences)
documentationsysartifacts community site
Community site collecting artifact-evaluation results for systems conferences such as OSDI, SOSP, EuroSys, ATC and FAST, with guides for authors, evaluators and chairs. Use the packaging guide for your own artifacts and the result lists to find papers whose artifacts you can try to reproduce.
Open(opens in a new tab)Link responded, 5 Oct 2026FreeUses: Practice, Reference, ResearchLinked from 1 topicTaming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve
paperUSENIX; Amey Agrawal et al.; OSDI 2024 (2024)
Shows how long prefills stall ongoing decodes in iteration-level batching and proposes chunked prefills with a per-iteration token budget so decodes are not interrupted. Useful for reasoning about the throughput versus inter-token-latency trade-off.
TanStack Query documentation (React): server-state guides
documentationTanStack (tanstack.com)
Documentation of a data-fetching library whose guides articulate the server-state model well: cached queries keyed by their inputs, staleness defaults, invalidation after mutations, and optimistic updates with rollback. Read for the concepts; the API is one implementation among several.
TCP Congestion Control: A Systems Approach
bookSystems Approach (open online edition); Larry Peterson, Lawrence Brakmo, Bruce Davie
Short free book on the congestion-control design space: control-based (Reno, CUBIC) and avoidance-based (Vegas, BBR) algorithms, AQM and ECN, and transports beyond TCP. Its design-space chapter covers evaluation criteria and an explicit experimental methodology, which makes it a good bridge from textbook TCP to congestion-control research.
tcpdump(1) manual page
documentationThe Tcpdump Group
Official manual for tcpdump: interface selection, capture filters, snapshot length, timestamps and writing pcap files for later analysis in Wireshark.
Tech at Bloomberg
Primary listcareers pageBloomberg
Describes Bloomberg’s engineering organization and technology. Engineering context only; not a verified description of the current interview loop.
Telling Stories About Little's Law
articleMarc Brooker's blog; Marc Brooker (2018)
Builds intuition for L = λW in services and then shows where the long-run-average framing misleads: latency that rises with concurrency, clients whose arrival rate reacts to latency (closed loops, retries), and non-stationary, spiky load. A practical companion to the formal statement.
Ten Simple Rules for Reproducible Computational Research
paperPLOS Computational Biology (open access); Geir Kjetil Sandve, Anton Nekrutenko, James Taylor, Eivind Hovig; PLOS Computational Biology 9(10), 2013 (2013)
Ten short rules for traceable computational results, from recording how every result was produced and avoiding manual steps to archiving program versions, noting seeds and keeping the raw data behind plots. Domain-neutral despite the venue; use it as a checklist for an experiment harness.
Terraform documentation: core workflow, plan and drift
documentationHashiCorp Developer
The write, plan, apply loop of a declarative infrastructure tool, what a plan compares (configuration, recorded state and real infrastructure), and how drift is detected and handled. The concepts carry over to other infrastructure-as-code tools.
2 chapter or section links
The Annotated Transformer
articleHarvard NLP; Austin Huang, Suraj Subramanian, Jonathan Sum, Khalid Almubarak, Stella Biderman (2022 version); original by Sasha Rush (2022)
A runnable, line-by-line PyTorch implementation of the original encoder-decoder Transformer placed next to the paper text. Use it as a second implementation to compare your attention, masking and decoding code against; the data-loading parts depend on older library versions, so concentrate on the model code.
The Case for Learned Index Structures
paperarXiv; Tim Kraska, Alex Beutel, Ed H. Chi, Jeffrey Dean, Neoklis Polyzotis; arXiv preprint (published at ACM SIGMOD 2018) (2017)
Proposes treating indexes as models of the key distribution and replacing parts of B-trees, hash indexes and Bloom filters with learned models. An exploratory paper whose headline results come from read-only, in-memory settings; read it together with later benchmarks.
The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing
paperGoogle Research; Tyler Akidau et al.; PVLDB, vol. 8, no. 12 (2015)
Defines the windowing, trigger and accumulation model that later stream processors adopted, treating batch as a bounded special case. Focus on the model sections (event time, watermarks, triggers, refinements); the implementation notes describe Google-internal systems.
Alternatives: PDF on vldb.org(opens in a new tab)
The Go Blog (selected articles)
articleThe Go Project (go.dev)
Articles by the Go team that explain language and library design in more depth than the reference documentation. The selection below covers slice internals, maps, error wrapping, context, cancellation in pipelines and the Go 1.22 change to loop variables.
6 chapter or section links
- Go Slices: usage and internals(opens in a new tab)
- Go maps in action(opens in a new tab)
- Working with Errors in Go 1.13(opens in a new tab)
- Go Concurrency Patterns: Context(opens in a new tab)
- Go Concurrency Patterns: Pipelines and cancellation(opens in a new tab)
- Fixing For Loops in Go 1.22(opens in a new tab)
The Go Memory Model
documentationThe Go Project (go.dev)
Defines when a read in one goroutine is guaranteed to observe a write from another (through channels, locks, sync.Once and sync/atomic) and what racy programs may do, including memory corruption from races on slices, maps, strings and interfaces. The advice and informal overview are essential; the formal sections are optional.
The Heilmeier Catechism
articleDARPA
Eight questions, from former DARPA director George Heilmeier, covering what a project tries to do, how it is done today, what is new, who cares, risks, cost, duration and the mid-term and final checks for success. A compact template for research pitches and thesis proposals.
The Illustrated TLS 1.3 Connection: Every Byte Explained
articlexargs.org (author site); Michael Driscoll
Annotated, byte-by-byte walkthrough of a real TLS 1.3 handshake and its key derivation. Use it side by side with your own packet capture to see which messages are visible on the wire and which are encrypted.
The Java Language Specification, Java SE 25 Edition: Chapter 17, Threads and Locks
standardOracle (docs.oracle.com)
The normative definition of synchronization, wait/notify, volatile, final-field semantics and the Java Memory Model. Read the happens-before rules and examples in 17.4 and the final-field section; the formal execution model matters only if you work on concurrent runtimes.
2 chapter or section links
The Java Tutorials: Concurrency lesson
documentationOracle (docs.oracle.com)
A compact path from threads and synchronization to the high-level java.util.concurrent objects: lock objects, executors and thread pools, fork/join, concurrent collections and atomic variables. Read it for the concepts and check details against the current API documentation.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Legacy tutorial written for JDK 8; the concepts still hold, while newer APIs such as virtual threads are covered on dev.java.)Uses: LearningLinked from 1 topic1 chapter or section link
The Linux man-pages project (man7.org)
documentationman7.org (Linux man-pages project)
Reference pages for Linux system calls, library functions and kernel interfaces. Open the specific page a topic names and read its DESCRIPTION, ERRORS and NOTES: that is where the semantics interviewers probe live (edge-triggered epoll, what fsync promises, O_DIRECT caveats, spurious wakeups).
24 chapter or section links
- epoll(7)(opens in a new tab)
- poll(2)(opens in a new tab)
- io_uring(7)(opens in a new tab)
- fsync(2)(opens in a new tab)
- open(2)(opens in a new tab)
- rename(2)(opens in a new tab)
- mmap(2)(opens in a new tab)
- fork(2)(opens in a new tab)
- clone(2)(opens in a new tab)
- sched(7)(opens in a new tab)
- vdso(7)(opens in a new tab)
- futex(7)(opens in a new tab)
- pthread_cond_wait(3p)(opens in a new tab)
- pthread_cancel(3)(opens in a new tab)
- namespaces(7)(opens in a new tab)
- cgroups(7)(opens in a new tab)
- user_namespaces(7)(opens in a new tab)
- capabilities(7)(opens in a new tab)
- seccomp(2)(opens in a new tab)
- numa(7)(opens in a new tab)
- proc(5)(opens in a new tab)
- perf-stat(1)(opens in a new tab)
- perf-record(1)(opens in a new tab)
- perf-c2c(1)(opens in a new tab)
The Little Book of Semaphores
bookGreen Tea Press; Allen B. Downey
Free collection of synchronization puzzles with hints and worked solutions: signaling, rendezvous, barriers, producer-consumer, readers-writers, dining philosophers, building H2O and many less classical problems. Use it as a practice bank and attempt each puzzle before reading its solution.
3 chapter or section links
- Ch. 3: Basic synchronization patterns
- Ch. 4: Classical synchronization problems
- Ch. 5: Less classical synchronization problems
The Log-Structured Merge-Tree (LSM-Tree)
paperUMass Boston (author-hosted PDF); Patrick O’Neil, Edward Cheng, Dieter Gawlick, Elizabeth O’Neil; Acta Informatica (1996)
The original argument for batching index inserts in memory and merging them into larger on-disk components, with a cost analysis against B-trees. Modern engines differ in detail, but the rolling-merge idea and its cost reasoning are the foundation.
The Matrix Calculus You Need For Deep Learning
articleexplained.ai; Terence Parr, Jeremy Howard (2018)
Works up from scalar derivatives to Jacobians, element-wise operations and the vector chain rule, aimed at readers who want to derive neural-network gradients rather than look them up. Good for building shape discipline when differentiating batched expressions.
The ML Test Score: A Rubric for ML Production Readiness and Technical Debt Reduction
paperGoogle Research; Eric Breck, Shanqing Cai, Eric Nielsen, Michael Salib, D. Sculley; IEEE Big Data 2017 (2017)
A checklist of concrete tests for features and data, model development, ML infrastructure and monitoring, with a scoring rubric for production readiness. Good raw material for answering "how would you test and monitor this model?"
The Mystery Machine: End-to-end Performance Analysis of Large-scale Internet Services
paperUSENIX; Michael Chow, David Meisner, Jason Flinn, Daniel Peek, Thomas F. Wenisch; OSDI 2014 (2014)
Infers a causal model of request execution from existing component logs at large scale, then uses it for critical-path analysis and to estimate the benefit of optimizations without implementing them. A reference for trace-based bottleneck attribution.
The Python Standard Library (module reference)
documentationPython Software Foundation (docs.python.org)
Reference pages for every standard module. For interviews and research code the collections, heapq, copy, contextlib and concurrent.futures pages below are worth knowing well, including the deque performance notes and the heapq priority-queue recipe with a tie-breaking counter.
5 chapter or section links
The QUIC Transport Protocol: Design and Internet-Scale Deployment
paperGoogle Research; Adam Langley, Al Riddoch, Alyssa Wilk, Antonio Vicente, Charles Krasic, et al.; ACM SIGCOMM 2017 (2017)
Design rationale and deployment experience for the pre-standard version of QUIC: why a user-space transport over UDP, how it reduces handshake latency and head-of-line blocking, and what was measured in production. Treat its measurements as specific to that deployment and version.
The Raft Consensus Algorithm (website)
documentationraft.github.io
Hub for Raft with an interactive cluster visualization, the papers, talks, the TLA+ specification and a list of implementations. Use the visualization to replay elections, partitions and log repair before and while implementing Raft.
2 chapter or section links
The Seven Deadly Sins of Cloud Computing Research
paperUSENIX; Malte Schwarzkopf, Derek G. Murray, Steven Hand; HotCloud 2012 (2012)
Short workshop paper naming seven recurring shortcuts in cloud and data-processing research: unnecessary distributed parallelism, assuming performance homogeneity, weak baselines, forcing an abstraction, unrepresentative workloads, assuming perfect elasticity and ignoring fault tolerance. Use it as an audit checklist for evaluations.
The Site Reliability Workbook
bookGoogle (free online edition); Betsy Beyer, Niall Richard Murphy, David K. Rensin, Kent Kawahara, Stephen Thorne (eds.) (2018)
Practical companion to the SRE book with worked examples: implementing SLOs, burn-rate alerting, incident response, managing load, canarying and a non-abstract system design exercise. More hands-on than the first book; still one organization's practice.
11 chapter or section links
- Ch. 2: Implementing SLOs(opens in a new tab)
- Ch. 4: Monitoring(opens in a new tab)
- Ch. 5: Alerting on SLOs(opens in a new tab)
- Ch. 9: Incident Response(opens in a new tab)
- Ch. 10: Postmortem Culture: Learning from Failure(opens in a new tab)
- Ch. 11: Managing Load(opens in a new tab)
- Ch. 12: Introducing Non-Abstract Large System Design(opens in a new tab)
- Ch. 16: Canarying Releases(opens in a new tab)
- Ch. 17: Identifying and Recovering from Overload(opens in a new tab)
- Appendix A: Example SLO Document(opens in a new tab)
- Appendix B: Example Error Budget Policy(opens in a new tab)
The Tail at Scale
paperGoogle Research; Jeffrey Dean, Luiz André Barroso; Communications of the ACM, vol. 56, 2013 (2013)
Explains why rare slow responses dominate end-to-end latency in services that fan out to many machines, and catalogs tail-tolerant techniques such as hedged and tied requests, micro-partitioning and selective replication. Short and directly usable in latency discussions.
The TLA+ home page
documentationLeslie Lamport (lamport.azurewebsites.net); Leslie Lamport
Entry point to TLA+, the specification language for concurrent and distributed systems, and to its tools including the TLC model checker. For awareness level, use the video course and the industrial-experience paper to learn what a specification, an invariant and a model-checking counterexample are.
The TypeScript Handbook
documentationMicrosoft (typescriptlang.org)
The official guide to the TypeScript type system. Everyday Types, Narrowing and Generics cover what most application code needs; Type Compatibility explains structural typing and the places where the checker is deliberately unsound.
The Ultra-Scale Playbook: Training LLMs on GPU Clusters
articleHugging Face (nanotron team) (2025)
Long-form, illustrated walkthrough of distributed training: data parallelism and ZeRO stages, tensor, sequence, context and pipeline parallelism, pipeline schedules, and how to combine them, with memory and communication reasoning throughout. Read it selectively per parallelism dimension rather than end to end.
The USE Method
Primary listarticleBrendan Gregg's website; Brendan Gregg
A checklist for performance investigations: for every resource, check utilization, saturation and errors. Useful as an interview-ready structure for "the service got slow, what do you do?" questions and for avoiding random tool-driven debugging.
ThreadSanitizer (Clang documentation)
documentationLLVM Project
How to build and run C and C++ programs under ThreadSanitizer, a dynamic data-race detector whose runtime also underlies Go’s race detector. It turns “fails sometimes” into a report naming two conflicting accesses, but only for races on paths your tests actually execute.
Time, Clocks, and the Ordering of Events in a Distributed System
paperLeslie Lamport's publications page; Leslie Lamport; Communications of the ACM, vol. 21, 1978 (1978)
Defines the happened-before relation, logical clocks consistent with it and a way to extend them to a total order, then discusses what logical time cannot capture about externally observed events. Short and the origin of most ordering vocabulary used in interviews.
Alternatives: Microsoft Research publication page(opens in a new tab)
Timeouts and cancellation for humans
articleNathaniel J. Smith's blog (vorpus.org); Nathaniel J. Smith (2018)
Essay by the author of the Trio async library on why ad hoc timeout parameters compose badly and how deadlines with cancel scopes make cancellation reliable. Read it with the companion essay on structured concurrency to reason about cleanup and about tasks that outlive their caller.
1 chapter or section link
Timeouts, retries, and backoff with jitter
articleAmazon Builders' Library; Marc Brooker
How to pick timeouts from measured latency, why retries add load exactly when a dependency is struggling, and how capped exponential backoff, jitter and retrying at a single layer keep retries from turning a blip into an outage.
Alternatives: Official PDF version(opens in a new tab)
Training Compute-Optimal Large Language Models
paperarXiv; Jordan Hoffmann, Sebastian Borgeaud, et al. (2022)
Estimates how to split a fixed compute budget between model size and training tokens with three complementary fitting approaches and concludes that both should grow together. Useful at awareness level for compute-optimal training and for seeing how fitted conclusions depend on schedules and the range of runs.
Training Deep Nets with Sublinear Memory Cost
paperarXiv; Tianqi Chen, Bing Xu, Chiyuan Zhang, Carlos Guestrin (2016)
The classic statement of gradient checkpointing: keep only selected intermediate results and recompute the rest during backward, trading extra forward computation for memory that grows sublinearly with depth. Short and readable.
Training language models to follow instructions with human feedback
paperarXiv; Long Ouyang et al.; NeurIPS 2022 (2022)
The InstructGPT paper: supervised fine-tuning on demonstrations, a reward model trained on human rankings, then PPO against that reward with a KL penalty to the supervised policy. The clearest description of the classic RLHF pipeline and of how its results were evaluated.
Transaction Processing Performance Council (TPC) benchmarks
standardTPC
Home of the standard OLTP and decision-support benchmark specifications. Read the TPC-C and TPC-H overviews to know what each workload stresses and how results are reported; informal “TPC-like” runs do not follow the official rules.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Specifications and tools are downloadable from the TPC site; published results follow audited rules.)Uses: Reference, ResearchLinked from 2 topics3 chapter or section links
Transactional outbox pattern (AWS Prescriptive Guidance)
documentationAmazon Web Services
Describes the dual-write problem between a database and a message broker and the outbox fix: store the event in the same local transaction as the state change, then relay it asynchronously. Note that the relay still delivers at least once.
Transformer Circuits Thread
articletransformer-circuits.pub (Anthropic interpretability research)
A series of long-form mechanistic-interpretability papers: a mathematical framework for attention-only transformers, induction heads, superposition in toy models and dictionary learning of features. Read the framework paper first; the rest is optional depth for interpretability-focused roles.
5 chapter or section links
TransformerLens
toolGitHub (TransformerLensOrg)
Library for mechanistic interpretability of GPT-style models: load pretrained models, cache and edit activations with hooks and run patching experiments. The usual tool for reproducing circuit-style analyses on small models.
Triton tutorials (including Fused Attention)
documentationTriton documentation
Official tutorials for writing GPU kernels in Triton, from vector addition and fused softmax to matrix multiplication and a fused attention kernel. Work through them in order before attempting a tiled attention implementation of your own.
1 chapter or section link
Troubling Trends in Machine Learning Scholarship
paperarXiv; Zachary C. Lipton, Jacob Steinhardt; Presented at the ICML 2018 Debates workshop (arXiv preprint) (2018)
Essay on four recurring problems in ML papers: speculation presented as explanation, gains not attributed to their real source (for example tuning rather than architecture), mathematics that obscures, and loaded terminology. A useful mirror when writing contribution statements and a lens for reading.
Two Sigma: Interviewing for software engineering
Primary listofficial guideTwo Sigma
Two Sigma’s official guidance for software engineering candidates.
Uber Engineering: the engineering interview process (historical blog post)
Primary listarticleUber Engineering Blog
Historical Uber Engineering post describing its coding interview approach. The current process may differ. When checked in October 2026 the original address no longer served the post; the Internet Archive copy below preserves it.
Check note: The server answered HTTP 404.
Alternatives: Internet Archive copy of the same post (captured 2025-09-22)(opens in a new tab)
Using load shedding to avoid overload
articleAmazon Builders' Library; David Yanacek
Explains why goodput collapses when a server accepts more work than it can finish before callers give up, and how to reject excess work early and cheaply, prioritize it and load-test the overloaded regime.
Alternatives: Official PDF version(opens in a new tab)
Using the STAR method for your next behavioral interview (worksheet included)
articleMIT Career Advising & Professional Development
University career-office guide to structuring behavioral answers as situation, task, action and result, with a downloadable worksheet. Use it to draft stories, and add a reflection step on what you learned or would change.
vLLM documentation
documentationvLLM project
Documentation for a widely used open-source LLM serving engine. The design pages explain paged KV-cache management and automatic prefix caching as implemented; the tuning, metrics, quantization and benchmarking pages are practical references for serving experiments. Pages change between releases, so match them to the version you run.
Web Content Accessibility Guidelines (WCAG) 2.2
standardW3C
The W3C Recommendation that defines testable accessibility success criteria at levels A, AA and AAA. Navigate with the Quick Reference and use the Understanding documents to learn the intent and edge cases of each criterion.
5 chapter or section links
- New Features in WCAG 2.2(opens in a new tab)
- How to Meet WCAG (Quick Reference)(opens in a new tab)
- Understanding Success Criterion 1.4.3: Contrast (Minimum)(opens in a new tab)
- Understanding Success Criterion 2.4.7: Focus Visible(opens in a new tab)
- Understanding Success Criterion 2.5.8: Target Size (Minimum)(opens in a new tab)
web.dev: Rendering performance
articleGoogle Chrome team (web.dev)
Explains the pixel pipeline from JavaScript through style, layout, paint and composite, and which kinds of change skip which stages. The companion articles below cover layout thrashing, compositor-only animation and breaking up long tasks.
web.dev: Web Vitals
articleGoogle Chrome team (web.dev)
Defines the Core Web Vitals (LCP, INP, CLS), their thresholds and the 75th-percentile assessment, and points to field and lab tooling. The per-metric articles define exactly what is measured; the optimization articles list common causes and fixes.
6 chapter or section links
- Largest Contentful Paint (LCP)(opens in a new tab)
- Interaction to Next Paint (INP)(opens in a new tab)
- Cumulative Layout Shift (CLS)(opens in a new tab)
- Optimize Largest Contentful Paint(opens in a new tab)
- Optimize Interaction to Next Paint(opens in a new tab)
- Optimize Cumulative Layout Shift(opens in a new tab)
What Every Programmer Should Know About Memory
paperUlrich Drepper's website (akkadia.org); Ulrich Drepper (2007)
Long, hardware-first explanation of DRAM, CPU caches, TLBs and NUMA, and of what software can do about them, with measurements. The figures are from 2007 hardware, but the mechanisms (cache lines, associativity, coherence traffic, prefetching, NUMA placement) still explain most memory-bound behavior. Read it selectively.
Open(opens in a new tab)Link responded, 5 Oct 2026Free (Use the author’s copy or the LWN serialization; the author does not permit redistribution, so avoid third-party mirrors.)Uses: Learning, ReferenceLinked from 1 topicAlternatives: LWN.net serialization of the same paper (Part 1 links to the rest of the series)(opens in a new tab)
5 chapter or section links
- Section 3: CPU Caches
- Section 4: Virtual Memory
- Section 5: NUMA Support
- Section 6: What Programmers Can Do
- Section 7: Memory Performance Tools
What is Property Based Testing?
articleHypothesis (hypothesis.works); David R. MacIver (2016)
Short essay by the author of the Hypothesis library on what distinguishes property-based testing from example-based testing, including input generation and shrinking of failing cases. Pair it with the Hypothesis documentation if you test Python code.
1 chapter or section link
What is RCU, Fundamentally?
articleLWN.net; Paul E. McKenney, Jonathan Walpole (2007)
Explains read-copy update through three building blocks: a publish-subscribe pattern for inserting data, waiting for pre-existing readers before reclaiming old data, and keeping multiple versions so readers never block. The shortest reliable path to explaining RCU’s read-mostly tradeoff.
What the Proofs Assume (seL4 verification)
documentationseL4 Foundation
Plain-language list of what the seL4 microkernel proofs assume, such as correct assembly code, hardware behaving as modelled, correct hardware management and boot. A concrete template for asking what any correctness guarantee rests on.
When to use and when not to use BBR: An empirical analysis and evaluation study
paperStony Brook University (author copy); Yi Cao, Arpit Jain, Kriti Sharma, Aruna Balasubramanian, Anshul Gandhi; ACM IMC 2019 (2019)
Short empirical study across emulated and real testbeds that maps the conditions (buffer size, loss, bandwidth, RTT) under which BBR beats or loses to loss-based algorithms. A direct illustration that rankings depend on the operating regime.
Why Momentum Really Works
articleDistill; Gabriel Goh; Distill (2017)
Interactive analysis of gradient descent and momentum on convex quadratics through their eigenvalues: why ill-conditioning slows descent, where step-size limits come from and how momentum changes the convergence rate. The best single source for the quadratic intuition behind most optimizer behaviour.
Wireshark User's Guide
documentationWireshark Foundation
Official guide to opening and filtering captures, following TCP streams, using expert information and statistics graphs. Use the chapters on display filters and statistics; skip installation details.
Workload isolation using shuffle-sharding
articleAmazon Builders' Library; Colm MacCárthaigh
Shows how assigning each tenant a small, randomly chosen subset of workers limits how many other tenants a misbehaving or overloaded tenant can affect, and compares this with plain sharding. Service-level isolation to complement machine-level mechanisms.
Alternatives: Official PDF version(opens in a new tab)
Writing effective tools for agents — with agents
articleAnthropic Engineering (2025)
Practitioner guidance on designing tools for LLM agents: choosing fewer, task-shaped tools, namespacing, returning meaningful and token-efficient results, writing precise descriptions, and evaluating tools with realistic tasks. Treat it as the tool-contract side of agent design.
Writing reviews for systems conferences
articleETH Zürich (author page); Timothy Roscoe (2007)
Practitioner advice: notes written for a systems shadow program committee on how to read a submission, judge its contribution and write a specific, constructive review. Reading the way a reviewer does is a quick route to finding weak evidence and unclear positioning.
YCSB: Yahoo! Cloud Serving Benchmark
toolGitHub (YCSB project)
Key-value benchmark framework with standard workload mixes and configurable request distributions (uniform, Zipfian, latest) and bindings for many stores. Good for controlled experiments on skew and read/write mix; it has no multi-key transactions.
1 chapter or section link
You and Your Research (talk transcript)
articleUniversity of Virginia (hosted transcript); Richard W. Hamming (1986)
Practitioner advice: transcript of a 1986 Bellcore colloquium on choosing important problems and the working habits behind significant research. Personal and dated in places; read it for the habit of asking which problems in your field matter and why you are not working on them.
Your AI Product Needs Evals
articleHamel Husain's blog (practitioner); Hamel Husain (2024)
Practitioner case study of evaluation for an LLM product: scoped assertion tests, logging and reading traces, human and model grading, A/B testing, and using what you find to drive fixes. Opinionated; use it for process ideas rather than as a standard.
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
paperarXiv; Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, Yuxiong He; SC 2020 (2019)
Breaks training memory into model states (parameters, gradients, optimizer state) and residual states, then removes data-parallel redundancy by sharding optimizer state, gradients and parameters in stages, with an analysis of the communication each stage adds. The source of the bytes-per-parameter accounting used in interviews.