Will AI Replace Testers? Make Your Judgment the Evidence
AI drafts test cases, code and bug summaries in seconds, which moves a tester's value from producing artifacts to judging them. Review AI output like a junior's work, refuse unverifiable claims, and show your judgment through a portfolio, outcome-based CV bullets and a yearly career check.
Key takeaways
- AI tools draft test cases, test code and bug summaries in seconds, which moves a tester's value from producing those artifacts to judging them.
- A generated test that runs green but asserts nothing is worse than no test, because it adds false confidence.
- Agentic test tools are for finding things; merge gates should stay on deterministic tests that fail the same way twice.
- A tester's portfolio should show judgment through real documents such as test designs, risk tables, release memos and design docs, never an employer's internal material.
- CV bullets that state what changed because you were there, with numbers you can defend, stand out from bullets that list duties.
Contents
FAQ
Will AI replace software testers?
The source's view is that AI takes over producing drafts (test cases, test code, summaries) and moves the tester's value to judging them: what would make a test fail, whether the evidence holds, and which risks matter. Automation does not replace testers; it frees them for the testing only humans do.
What is an AI eval engineer?
A role in companies that ship LLM features: building and maintaining eval sets, calibrating LLM judges against human labels, running adversarial passes and watching for drift after model updates. Test design, oracles and risk thinking transfer directly.
What should a QA portfolio contain?
Documents that show judgment for your level: test design and reproducible bug reports for an engineer, a risk-based plan and a readable automation project for a senior, a release plan, crisis memo and sign-off for a lead, a cross-team design doc for staff.
Sources
Only you and the owner see your answer and rating. Send private feedback
Enjoyed it? Support fx-blog with a coffee.
Related posts
QA Manager to Head of QA: The Escape Bill That Wins Budget
QA managers lose arguments with activity counts and pleas of overload. Refuse anti-metrics like bugs per tester, lead every report with a judgment, and price last quarter's escapes against the cost of prevention. At Head of QA, the organisation itself is the product.
After Senior QA: Lead the Release or Own the Platform?
After Senior, testers often take the only step their company shows them and burn out as player-coaches, or stall as invisible SDETs. Lead and Staff are both promotions: one produces a team that works, the other a problem that stays solved. Try one of each, then choose.
Senior QA: Depth Everywhere Is Depth Nowhere
A senior QA engineer who tests everything equally leaves the risky areas thin. Score each area by impact times likelihood, test the top deepest, tell the PM in writing what gets only a smoke pass, and make every production escape leave a regression test behind.
Comments
Oldest firstNo comments yet. Start the conversation.
Part 6 ended with the SDET funded and a vendor demo: an agent that "tested all of FieldFlow in 20 minutes, 0 failures". If tests are that cheap to produce, what is a tester's work worth, and how do you show it to the next employer?
Zero failures in 20 minutes is a claim about the agent. Whether it says anything about FieldFlow is the question a tester is paid to ask.
QA Career Path, in seven parts:
What AI takes, and the catch you keep
AI output is a draft with confidence, and QA's trade is refusing to confuse confidence with evidence.
Four rules apply at every level:
The vendor demo, checked
An agentic tool drives a real browser from a plain-language goal. Three rules answer the demo:
Your judgment, made visible
Your best work is the escape that never happened, and nobody sees that. Documents that show judgment do; the exercises this series followed already are a portfolio.
On a CV, "executed test cases" describes every tester. The repo's examples:
One new door, and a yearly check
AI also opened a role: the AI quality or eval engineer, who builds eval sets, calibrates LLM judges and watches for drift after model updates. Its core is test design, oracles and refusing a confident report, plus enough Python to run an eval harness.
Whatever the move (up, sideways into development, SRE or product, or out and back), answer four questions once a year, in writing:
A brag document kept all year (problems solved, results, feedback) answers them. And if every release needs heroics, the process is broken, not you.
Try it
How to check what AI writes is in AI in Testing: Use It Without Trusting It, and Test AI Features, the last part of the QA Skills Path.
Seven parts ago you placed yourself on the ladder by scope. The repo's exercises are there for your next move.
Read this with your AI