Carl Broker
Agentic AI Engineer, IBM
Duluth, Minnesota
Experience
Advisory AI Engineer
IBM
Building enterprise AI systems, multi-agent architectures, and retrieval pipelines — from prototype to production.
- Architected multi-agent orchestration systems with orchestrator and specialist sub-agents
- Built RAG systems with chunking, embeddings, vector retrieval, and grounded generation
- Developed Python tool-calling frameworks for enterprise APIs and workflows
- Built evaluation and testing pipelines for agent quality and workflow success
- Authored production deployment of enterprise AI systems and published agents to IBM Agent Catalog
- watsonx
- Orchestrate ADK
- Python
- RAG
- embeddings
- vector databases
- LoRA
- LLM evaluation
- tool calling
- multi-agent systems
AI Engineer / Data Scientist
IBM
Building machine learning, NLP, and early generative AI systems for enterprise clients.
- Built enterprise data science and NLP solutions
- Developed generative AI proof-of-concepts and pilot systems
- Led customer-facing architecture and design sessions
- Worked across machine learning, LLMs, and applied enterprise AI delivery
- Python
- NLP
- LLMs
- LangChain
- data science
- enterprise architecture
Applied Research Scientist
General Dynamics (Environmental Protection Agency)
Research and engineering work focused on OCR, NLP, and document intelligence in high-performance computing environments.
- Deployed OCR systems across document databases
- Trained and deployed NLP and document classification models
- Used transfer learning with RoBERTa and Hugging Face tooling
- Built similarity workflows using transformer embeddings and cosine similarity
- PyTorch
- Hugging Face
- OCR
- Tesseract
- RoBERTa
- NLP
- cosine similarity
- HPC
Senior Data Analyst
Johns Hopkins Hospital
Analytics, reporting systems, and healthcare data workflows.
- Built Python and pandas workflows for difficult-to-access datasets
- Performed exploratory factor analysis on client survey data
- Supported executive and stakeholder reporting needs
- Improved stability, security, and performance of an internal case management system
- Python
- pandas
- analytics
- factor analysis
- reporting systems
Research
Johns Hopkins, National Institutes of Health, University of Minnesota
Neuroscience, psychology, and clinical research grounded in data, signals, and behavior.
- Worked on neuroscience and psychology research projects
- Analyzed electrophysiological and behavioral data
- Helped launch clinical research workflows and research operations
- Authored published research
- statistics
- PCA
- time series analysis
- experimental design
- research methods
- electrophysiology
I build software, AI systems, and tools — then write about what I learn along the way.
Writing
- Building AI Systems That Last Lessons learned from deploying computer vision in production logistics environments.Mar 2026
- Design-First Development Why I plan before I build, and how a design-first workflow changes the quality of the output.Feb 2026
- Tools I Use A snapshot of the tools, languages, and workflows I rely on in 2026.Jan 2026
About
I build AI systems that are meant to be used, not just demoed.
My work sits at the intersection of agentic AI, retrieval systems, LLM platforms, and production engineering. I like designing systems where models, tools, and data work together to solve real problems — whether that means multi-agent orchestration, vector retrieval, OCR pipelines, or enterprise AI deployment.
Over the course of my career, I’ve moved through neuroscience research, healthcare analytics, government research, data science, and enterprise AI engineering. That path gave me a strong bias toward systems that are grounded, testable, and useful in the real world.
Today, I focus on building enterprise AI systems that include:
- multi-agent orchestration
- retrieval-augmented generation
- embeddings and vector databases
- tool-calling architectures
- evaluation and guardrails
- production-ready LLM workflows
I enjoy the engineering side of AI just as much as the strategy side: choosing the right model for the job, designing the surrounding system, and getting the full thing to work reliably.
Education
- Johns Hopkins University (M.S.)
- The College of St. Scholastica (B.S. Pt1)
- James Cook University, Australia (Pt2)
Interests
Outside of work, I’m into mountain biking, flying my paramotor, scuba diving, and building side projects that usually start as “just for fun” and turn into something much bigger.