AI interviews · AI system design and from-scratch coding

The from-scratch coding round for AI engineers

Many AI engineer loops include a round where you implement a piece of a model or an LLM application with no frameworks. This lesson covers the nineteen challenges that come up most, what each one asks, the idea that solves it, the edge cases to test and the bug interviewers wait for, with five of them worked as runnable code.

24 min read Full lesson in the app Patterns: mask before softmax, log space, not products, inject the clock and the RNG, push parser with buffers, test invariants, not outputs

What you'll be able to do

Before this: how-llms-work, complexity-honestly

Log in to read the rest of this lesson

Many AI engineer loops include a round where you implement a piece of a model or an LLM application with no frameworks. This lesson covers the nineteen challenges that come up most, what each one asks, the idea that solves it, the edge cases to test and the bug interviewers wait for, with five of them worked as runnable code. This walkthrough runs about 24 minutes, with runnable code you can edit and re-run as you read. A new account gets 7 days of Pro free, no card required.

Log in to continue

The first module of every track is free to read on the web: see what's open in AI interviews.