Skip to content
fx-blog

Senior QA: Depth Everywhere Is Depth Nowhere

A senior QA engineer who tests everything equally leaves the risky areas thin. Score each area by impact times likelihood, test the top deepest, tell the PM in writing what gets only a smoke pass, and make every production escape leave a regression test behind.

Harry4 min readIntermediate
  • Judgment
  • Verification
MarkdownSave

Key takeaways

  • Testing every area equally spreads depth so thin that the riskiest changes get no more attention than a copy edit.
  • Risk-based testing scores each area for impact and likelihood from 1 to 5 and multiplies them; the top of the list gets the deepest testing.
  • Money movement, data loss and legal exposure raise impact; new code, complex logic, buggy history and many integrations raise likelihood.
  • Telling stakeholders in writing what gets only a smoke pass turns a hidden gap into a decision someone owns.
  • Every production escape should leave behind a regression test, found by asking where it was introduced, where it should have been caught, and what one change would have caught it.
Contents

TL;DR A senior QA engineer who tests everything equally spreads the time so thin that a risky rework gets the same attention as a copy change, and the bugs escape where the risk was. Score each area by impact × likelihood, test the top deepest, write down what you will not test, and make every escape leave a test behind.

Do this: Before your next release, list its areas, score impact and likelihood from 1 to 5, and send your PM three sentences on what gets only a smoke pass.

Part 3 left you owning FieldFlow's smoke suite with R25 on the way: the sync rework, bulk invoicing, the planner facelift, 30 small fixes and the rounding option, 6 tester-days before code freeze, and 11 escapes last quarter, 3 of them in invoice totals. Where should the depth go?

Six days across five items is a little over a day each: fair, and the sync rework gets the same day as the planner's new paint. The repo calls this perfectionism. Depth everywhere means depth nowhere.

QA Career Path, in seven parts:

  1. The QA Career Path: Map Yourself by Scope, Not by Title
  2. New QA Engineer? Test the Risk, Not the Ticket
  3. Manual to Automation Testing in Six Months: Skip the Tutorial Loop
  4. Senior QA: Depth Everywhere Is Depth Nowhere (you are here)
  5. After Senior QA: Lead the Release or Own the Platform?
  6. QA Manager to Head of QA: The Escape Bill That Wins Budget
  7. Will AI Replace Testers? Make Your Judgment the Evidence

Score risk, then spend the days

Exhaustive testing is impossible, so a senior QA engineer decides depth by risk: likelihood × impact, each scored 1 to 5.

  1. List the areas in the release.
  2. Score impact: what happens if this fails? Money movement, data loss and legal exposure score high.
  3. Score likelihood: new code, complex logic, historically buggy areas and many integrations score high.
  4. Multiply. Test the top deepest. The bottom may get only a smoke pass, and the plan says so.

This is the repo's own FieldFlow-shaped table:

Area Impact Likelihood Risk Depth
Invoicing calculation changes 5 4 20 Full technique-based coverage + regression
Offline sync (new conflict handling) 5 4 20 Full + exploratory + field-condition tests
Job scheduling screen (minor UI change) 3 2 6 Targeted regression
Help page text updates 1 1 1 Smoke only

For R25 the repo's exercise lands the same way: sync rework and bulk invoicing on top with deep coverage, and someone told in writing what's thin. FieldFlow and its numbers are fictional.

Say what you won't test, in writing

The risk table is also your communication tool: when someone asks "why wasn't X tested more?", it shows the decision was deliberate and shared.

textThree sentences to the PM (a draft for R25)
R25: the sync rework and bulk invoicing get full coverage plus exploratory sessions.
The planner facelift gets targeted regression, and the 30 small fixes a smoke pass only.
If you want more depth on the planner, tell me which of the top two it comes from.

Every escape leaves a test behind

Bugs will leak. A Senior makes sure the same one can't leak twice, with three blameless questions:

The escape loop: three questions, one regression test, and a monthly review of patterns

Take an escape titled "Invoice total ignores 2nd discount line when VAT-exempt" (the repo's example). Introduced in the requirement, design, code, config or data? Should review, a unit test, test design or regression have caught it? Which one change would have? That change lands as a test.

Monthly, look for patterns: requirement gaps point at refinement, regression gaps at automation priorities, one module clustering at targeted exploratory testing. With 3 of FieldFlow's 11 escapes in invoice totals, invoicing is the cluster.

Seniors multiply, or stall

From the Senior checklist, you are ready for the next step when:

  • your risk calls, including what not to test, have been right more often than wrong;
  • juniors visibly improve because of your reviews and pairing;
  • you estimate a feature's testing with the assumptions stated;
  • you coordinate testing when the lead is away, and nothing falls over.

Seniors stall as the hero tester, whose area nobody else can cover, or by rewriting juniors' work instead of teaching.

Try it

textPaste into your AI
Here are the areas in my next release, with what changed in each: <list>.
Help me score impact and likelihood from 1 to 5 for each, asking me
questions where you lack facts (money, data loss, new code, integrations).
Then draft three sentences to my PM saying what gets only a smoke pass.

Your risk calls hold, and when the lead is away you run R25's testing without anything falling over. The Senior checklist then asks: does that coordination work appeal to you, or the hard technical problems? At FieldFlow one is waiting: six squads share one staging database that every test mutates, and nobody trusts a red build. Part 5, After Senior QA: Lead the Release or Own the Platform?, is that choice.

Read this with your AI

textPaste into your AI
Read the post "Senior QA: Depth Everywhere Is Depth Nowhere".
1. Summarise it in 5 bullets for a senior tester.
2. Ask me 3 questions to check I understood; wait, then correct me.
3. Take my last production escape and walk me through the three RCA questions.

FAQ

What separates a senior QA engineer from a QA engineer?

A Senior owns a feature area's test approach and decides depth by risk, including what not to test. They also multiply others through reviews and pairing, and localise defects through the API, database and logs.

How do I build a risk table for a release?

List the areas in the release, score impact and likelihood from 1 to 5 for each, multiply them, and set depth from the result: full coverage at the top, targeted regression in the middle, a smoke pass at the bottom, written into the plan.

What should happen after a bug escapes to production?

Run a blameless review: where the defect was introduced, where it should have been caught, and what single change would have caught it. Leave a regression test behind, and look at the month's escapes together for patterns.

Sources

  1. QA Career Path repo: test strategy and planning (docs/03)
  2. QA Career Path repo: defect management and RCA (docs/05)
  3. QA Career Path repo: Senior QA role (roles/02)
  4. Google SRE book: postmortem culture

Was this useful?

Only you and the owner see your answer and rating. Send private feedback

Enjoyed it? Support fx-blog with a coffee.

Comments

Oldest first

No comments yet. Start the conversation.

You sign in first; what you typed stays here. · 0 / 2,000