Engineering Blog

QA & AI Automation Blog

Practical insights on Playwright, self-healing tests, AI-driven QA, and scaling engineering teams. Real lessons from 20+ years in quality engineering.

150 posts

Test the Trace Before You Trust the Dashboard
AI & AutomationOct 10, 20265 min
1

Test the Trace Before You Trust the Dashboard

A correct AI answer can hide a broken trace. Use a synthetic request and a deliberately stripped context header to test whether your debugging evidence survives service boundaries.

Read article
The Evaluator Needs an Abstain State
AI & AutomationSep 16, 20265 min
1

The Evaluator Needs an Abstain State

A judge that must choose pass or fail will turn uncertainty into false confidence. Add an abstain state, calibrate it, and test the cases where the evaluator should refuse to decide.

Read article
A Valid JSON Response Can Still Be a Bad Contract
AI & AutomationSep 15, 20265 min
1

A Valid JSON Response Can Still Be a Bad Contract

JSON parsing is not schema testing. For AI features, QA needs to verify types, allowed values, relationships, and what the model was actually permitted to claim.

Read article
The Tool-Call Checklist for QA Engineers
AI & AutomationSep 12, 20264 min
1

The Tool-Call Checklist for QA Engineers

An agent can produce a polished answer while calling the wrong tool, using the wrong arguments, or exceeding its authority. Here is a practical test boundary.

Read article
A Fallback That Looks Healthy Can Still Be Wrong
AI & AutomationSep 11, 20267 min
1

A Fallback That Looks Healthy Can Still Be Wrong

A fallback can keep an AI workflow available while quietly changing the question it answers. Test the degraded path as a contract, not as a successful HTTP response.

Read article
The Cheapest Test Is the One You Run Before You Build
Career & Best PracticesSep 04, 20264 min
1

The Cheapest Test Is the One You Run Before You Build

The most expensive engineering mistakes in my systems were not hard bugs. They were reasonable implementations of questions nobody had defined.

Read article
A Signal Is Not a Decision
Quantitative TradingSep 03, 20265 min
1

A Signal Is Not a Decision

A signal says that conditions are interesting. It does not say that the portfolio should trade. The missing layer is the decision record between detection and execution.

Read article

Page 1 of 22

...

Stay in the Loop

Get weekly insights on AI-driven QA, engineering leadership, and automation strategies.

No spam, ever. Unsubscribe anytime.

Built with Vite, React, and Tailwind CSS.

View Source