interviewpath
  • 0day streak
  • 10total XP
  • Level 1
0/6

Unit 9 · Research methods · Lesson 2 of 12

Prior work, positioning and novelty

Positioning means knowing the closest prior work well enough to state exactly what your contribution adds and under which assumptions. It decides whether an idea is research or engineering, and research interviewers routinely ask how an idea differs from the obvious related systems.
About 4 hFocus mode

Step 1: Learn the ideas

  • Seed papers and citation chasing
  • Venues and bibliographies (dblp, proceedings, course reading lists)
  • Surveys and their limits
  • Positioning tables: assumptions, mechanisms, evaluations
  • Kinds of novelty: problem, mechanism, measurement, design point, negative result
  • Novelty versus engineering contribution
  • Contribution statements tied to evidence
  • Concurrent work and claims of being first
  • Related work organized by idea

Why it matters

"How is this different from X?" is one of the most predictable questions in a research conversation and one of the most damaging to answer badly. Positioning is also how you avoid spending months rediscovering a known result. For a thesis or internship, placing a proposed idea next to the lab's own papers shows that you can work independently.

Core ideas

Search is a procedure. Start from two or three seed papers. Chase references backwards and citing papers forwards (Semantic Scholar and Google Scholar list citing papers; dblp lists venue proceedings and complete author records). Scan recent proceedings of the venues where the seeds appeared and the reading lists of graduate courses in the area. Keshav's note describes a compact version of this loop. Stop when new candidates mostly cite papers you already have, and record queries and dates so you can repeat the search before submitting anything.

Positioning table. For the five to ten closest works, write one row each: problem, assumptions (failure model, hardware, workload, data, threat model), mechanism, evaluation setup and stated limitations. Columns expose the gap better than prose. Often the opening is an assumption that has stopped holding: a workload became burstier, memory became cheap relative to network bandwidth, a model no longer fits on one accelerator, or an agent's tool calls now have side effects.

Kinds of novelty. A contribution can be a new problem formulation, a new mechanism, a new measurement or characterization, a design point that changes a known tradeoff, a negative result, or an explanation that unifies observations. Each is legitimate, and each needs different evidence.

Novelty versus useful engineering. Re-implementing a known design in a new framework, integrating components or scaling a pipeline can be valuable work, and much research engineering is exactly that. It becomes research when it produces knowledge that transfers: why something works, a tradeoff nobody had quantified, or a measurement that changes what others should build. A useful test is to ask what a reader who never runs your code would learn. If the honest answer is "that it can be done with enough effort", call it engineering, and say so plainly in interviews. Levin and Redell's review criteria (original ideas, reality, lessons, choices, context) remain a sharp checklist.

Contribution statements. Write each as a claim plus its evidence: "we show that ..., measured on ... (Section N)". A contribution without planned evidence is a hope.

Related work, written fairly. Organize by idea, not paper by paper. Describe each line of work in terms its authors would accept, state the assumption or regime where it falls short for your problem, and acknowledge where it is better than your approach.

Common misconceptions

  • "Nobody has done this; I searched." One query is not a search. After a documented procedure, the most you can claim is "to our knowledge", and that phrase should mean something.
  • "Novelty means a completely new idea." Many strong papers apply known techniques in a new regime or explain known behaviour; the novelty is the precise delta.
  • "More engineering effort makes the work more novel." Effort is not a contribution; insight and evidence are.
  • "Related work is a list of systems to beat." It shows that you understand the design space; dismissing prior work without engaging its assumptions costs credibility.
  • "Concurrent work makes my project worthless." Overlap is common. Position honestly and emphasize differences in assumptions, setting or evidence.

How to approach it

Take one hypothesis from the research-questions topic and spend a bounded session (about three hours) searching from two seed papers. Build the positioning table, write three contribution statements and one sentence on why the closest work does not already answer your question. Before a thesis or internship interview, read the target lab's most recent relevant papers and prepare a two-sentence answer to "how does your idea relate to our work?". Interviewers at every level check that you can name the closest work and its assumptions; senior candidates are also expected to judge which direction is worth pursuing and why now.

Suggested order

  1. 1Read the literature-survey part of Keshav's "How to Read a Paper" and use it to plan a bounded search with an explicit stopping rule.
  2. 2From two seed papers, collect candidates through references, citing papers (Semantic Scholar or Google Scholar) and recent proceedings on dblp; record queries and dates.
  3. 3Read Levin and Redell's "Criteria for Evaluation of Submissions", focusing on Original Ideas and Context, then Roscoe's notes on what reviewers check.
  4. 4Do the "Bounded literature search and positioning table" exercise for the five closest works and mark the gap.
  5. 5Write three contribution statements with their planned evidence and label each as research novelty or engineering.
  6. 6If you target a specific lab, repeat the table for its three most recent relevant papers and draft a two-sentence answer to "how does this relate to our work?".

Step 2: Check off what you can do

Tap each one you can genuinely do or explain. Each earns 10 XP.

Step 3: Go deeper

  • How to Read a PaperStart here

    S. Keshav (author's site, University of Cambridge)

    Section: Doing a literature survey

    A compact procedure for surveying an area from seed papers, venues and key researchers.

    Open(opens in a new tab)Link responded, 5 Oct 2026
  • An Evaluation of the Ninth SOSP Submissions, or How (and How Not) to Write a Good Systems PaperStart here

    USENIX (reprinted with the authors’ permission)

    Section: Criteria for Evaluation of Submissions

    Reviewer questions on original ideas, context and lessons for judging novelty in systems work.

    Open(opens in a new tab)Link responded, 5 Oct 2026
  • Writing reviews for systems conferences

    ETH Zürich (author page)

    How systems reviewers judge contribution and positioning; read it to anticipate "how is this different?".

    Open(opens in a new tab)Link responded, 5 Oct 2026
  • dblp computer science bibliography

    Schloss Dagstuhl – Leibniz Center for Informatics

    Venue proceedings and complete author or lab publication lists for checking the closest work.

    Open(opens in a new tab)Not checked, 5 Oct 2026
  • Troubling Trends in Machine Learning Scholarship

    arXiv

    Examples of overstated or misattributed claims; use it to keep contribution statements honest.

    Open(opens in a new tab)Link responded, 5 Oct 2026

Step 4: Practice

Fix the time budget before searching and log every query. The table is done when each row names an assumption that differs from your setting. Ask someone outside the area to read your three contribution statements and say which one they would challenge first.

Record attempts on each problem’s page (+15 XP, +10 more when solved on your own).

Step 5: Test yourself

Answer each one out loud or on paper before you finish the lesson.

  1. Question 1Which assumption of the closest prior work does your idea relax or change?
  2. Question 2What would a reader who never runs your code learn from your work?
  3. Question 3When did you last search for concurrent work, and with which queries?
  4. Question 4Which of your contributions is a mechanism, which a measurement and which an engineering artifact?
  5. Question 5How would the authors of the closest paper describe the difference?

You’re done when you can

  • Produce a positioning table of at least five closest works with assumptions and limitations for one hypothesis.
  • Write three contribution statements, each tied to planned evidence, and defend each against "isn't this just engineering?".
  • Answer "how is this different from the closest work?" in under one minute, naming the specific assumption that differs.
  • Document a literature search (seeds, queries, venues, date) that someone else could repeat.

Finish the lesson

How confident do you feel?

Lesson complete!

+50 XP

Reviews will come up on the Practice tab so it sticks.

Unlocks next: Research internship and Master's thesis interview preparation

Your notes and study time

Log study time