Links: my little whisper.cpp bug fix why the logits were calculated inconsistently wav2vec2 on arxiv and huggingface the openai whisper asr model announcement beam search patience top notch guide to CTC the bitter lesson (and in meme form) And one erratum: I referred in the show to LLMs as encoder-decoder models. Most modern LLMs are decoder-only.…

In which I ramble about randomness and random algorithms. Now with theme music! Paper Cuts planned reading: Habitability and Piecemeal Growth, in Patterns of Software (just pages 7–16 of the book, which is pages 25-32 of the PDF) Selected links: * SIEVE cache replacement algorithm * Power of two random choices * Marc Brooker's blog * Random forests…

Shay Nehmad on how writing is the key to becoming a better engineer, how to do it, and more. Links: * Cup O' Go podcast * Code Complete book * Shay's blog * Obsidian and LogseqBy Josh Bleecher Snyder

This was a fun and decidedly humbling conversation with Ben Johnson about SQLite, databases, Litestream, and LiteFS. Links: Ben on GitHub Litestream LiteFSBy Josh Bleecher Snyder

No guest for this inaugural episode--just me this round. I cover the basics of rolling hashes and FastCDC, which appears to be the state of the art in content defined chunking. Mentioned in the episode: 8 bit hash bug FastCDC paper Perkeep (once called Camlistore, oops) bup rsync I know the audio is slightly subpar (to say nothing of the content). …

The plan: Guests teach me substantive topics in software engineering, and I ask dumb questions. Please send guest suggestions, topic ideas, excitement, and monopoly money to josh@sigpod.devBy Josh Bleecher Snyder