Skip to content
CB
  • Experience
  • Projects
  • Writing
  • About
  • Contact
  • Experience
  • Projects
  • Writing
  • About
  • Contact

Writing

Posts and essays on software, AI, and building things.

  • TensorRT-LLM on an RTX A6000: Part 2 — Concurrency, TTFT, and the Benchmark Trap Pushing TensorRT-LLM under load on an RTX A6000: why synthetic prompt size misleads, why TTFT is a cleaner signal, and what it shows about Dynamo.
    Jun 2026
  • TensorRT-LLM on an RTX A6000: Part 1 — GPU Passthrough, KV Cache, and Single-GPU Serving Serving Qwen2.5-7B-Instruct with NVIDIA TensorRT-LLM on a single RTX A6000 — Docker GPU passthrough, KV cache, prefill/decode, Dynamo, and parallelism strategies.
    May 2026
  • Building AI Systems That Last Lessons learned from deploying computer vision in production logistics environments.
    Mar 2026
  • Design-First Development Why I plan before I build, and how a design-first workflow changes the quality of the output.
    Feb 2026
  • Tools I Use A snapshot of the tools, languages, and workflows I rely on in 2026.
    Jan 2026
CB

AI systems that are meant to be used, not just demoed.

  • Experience
  • Projects
  • Writing
  • About
  • Contact
  • GitHub
  • LinkedIn
  • Resume
© 2026 Carl Broker · Duluth, Minnesota