#testing

Wiki 14

  • Anatomy of a test Jonathan Frere dissects one real Gleam test line by line - a test constructor, a real database, arrange through the public API, whole-value asserts
  • appsec.guide β€” Fuzzing Chapter (Trail of Bits Testing Handbook) Trail of Bits' Testing Handbook fuzzing chapter β€” terminology, the mutation-based evolutionary algorithm, fuzzer components, and a taxonomy of bug classes; entry point to language-specific subsections
  • appsec.guide β€” Trail of Bits Testing Handbook Trail of Bits' open testing handbook; security-testing guidance organized by language and technique, covering fuzzing, static analysis, cryptographic testing, web app testing
  • Coverage-Guided Fuzzing The dominant modern fuzzing algorithm β€” evolutionary loop over a corpus of test cases, fitness measured by code coverage, mutated offspring kept when they reach new coverage
  • Dan Luu (danluu.com) Dan Luu's blog β€” measurement-driven engineering writing from a CPU-verification background, covering testing, reliability, org dynamics, and now AI coding
  • Dan Luu on AI Coding, Testing, and Variance Dan Luu applies a CPU-verification background to agentic coding β€” testing-heavy no-review workflows, the meaninglessness of single-number model benchmarks, and working around agent failure modes
  • Data races and the limits of ThreadSanitizer Phil Eaton rebuilds a FastTrack-style race detector, then shows TSan missing obvious races in C and Golang once its fixed budgets run out
  • Delightful integration tests in Rust RAII plus testcontainers-rs gives every Rust integration test its own isolated infrastructure
  • Differential Fuzzing Run the same input through two implementations of the same spec and treat disagreement as a bug; finds spec-conformance issues neither implementation would catch alone
  • Grammar-Based Fuzzing Generate fuzzing inputs from a context-free grammar instead of random bytes, so inputs survive early parsing stages and exercise downstream logic
  • Many-Step Sequences in Go State machine pattern for multi-step tasks where each step returns the next, enabling independent testing
  • Structure-Aware Fuzzing Fuzz a function by generating valid in-language values (structs, slices, pointers) instead of raw bytes; the fuzzer mutates bytes underneath and the runtime handles encode/decode
  • T.Context in Go Testing Jonathan Hall's quick reader-prompted note on when to use Go 1.24's testing.T.Context (and when not to)
  • Testing-heavy, no-review workflow Ship large volumes of unreviewed (including agent-generated) code by trusting randomized testing over human code review β€” the CPU-verification model applied to software

Toolbox 2

  • agent-skills-eval Test runner that measures a skill's lift by grading with-skill and without-skill runs side by side
  • floci Free local AWS emulator covering 46 services, a drop-in replacement for LocalStack Community

talks 1