Quality bandits

thought piece
a movie still from Catch Me If You Can from 2002
Catch Me If You Can, 2002

Here’s a curious thing I’ve been thinking about these past few days… If you work (or have worked) in a modern tech corporate environment, you might have run across this particular scenario.

Picture a few top brass folks, typically folks that don’t care for testing, but for the variables of this scenario let’s not even consider that bit, they all gather up and proclaim:

“Let us devise an initiative to reduce the number of defects in production services!”

Stop here for a moment. What would you do in such a situation?

Did you think about it? Are you ready? Ok, let’s go on.

I’ll tell you a secret - it doesn’t matter what you thought about so far. You see… the top brass folks are already convinced of what they need to do. They did a TODO list of fancy corporate lorem-ipsum things like “standardize tooling”, “standardize results”, “automate as much testing as possible”, keep track of everything in graphs, measure pass/fail values across the entire company, label and enforce a standardized structure on bug reports, and “strongly encourage” QA folks and their teams to increase those pass/fail ratios, and increase the amount of “quality metrics” they expose. All in a standardized way so top-brass can assign KPIs to it. It doesn’t matter what those KPIs are. They will likely be cryptic and meaningless.

If you know me personally, you already know what I think about most of the aforementioned hogwash. But let’s try and be constructive for a moment, and offer an alternative. I’ve gone way to many times into the rabbit hole of why these folks are acting stupid, if you want to go deeper on that, you can read more in posts like this big boring one and this other one.

The scam

There’s a reason this mindless “jump to action” of these folks is oftentimes the case. My personal running theory about it is:

Their minds and ideas and concepts about Software Testing and quality have been victims of grifting.

Grifting” in the sense that they’ve been “victims” of fraud and scams (oftentimes self-inflicted) when it comes to looking at Software Testing problems.

These same big bosses that are quick to try and “sooth the waters”, and seemingly care about “quality” and take every public opportunity to voice their concerns on “quality”, they all make the same mistake: they attack the problem of “our apps/services/infra are in a fecal state” by fooling themselves and others in tackling the problem with brute force (brute as in ignorant, barbaric and belligerent) instead of actually taking a step back and thinking about the testing problems they have at hand.

The ruse, which you might be able to observe in corporate environments where the testing culture is poor, turns over time into big balls of mud:

Alternative path

I can tell you what I would do. I would stop the buck in its place and do the one thing that a lot of these top brass folks are forgetting:

I would (try) to look at the problem.

There’s just so much to tidy up on the problem before we jump at solutions!

Let’s look at the “technical” part of the problem first:

Then there are often other factors, the old “where are all the dead bodies buried”? Let’s look at the “human” part of the problem:

All of these questions (and many, many more) help paint a picture of the organization, and serve as a map for software testers and developers alike. You may have narrowed down the options to solve your Software Testing problems in your organization through some of these answers. Experience tells me, the solutions rarely look like the ones the typical brute force approach described above entails.

I invite you now to take a moment to think: have you ever seen a top-brass person deeply search for answers to any these questions before tackling a Software Testing / Quality problem? If they didn’t… did they give empty excuses?

I’m posing these questions because, from past personal experience, if I gave any “low brass/ grunt” colleague a “pen and paper”… they would often be able to answer almost all of these questions truthfully in less than a few hours, BUT, the actual competent top brass folks that reached out and cared for stuff like this, I count to this day with the fingers of one hand. Maybe just my personal experience, who knows, right?

Wrapping up

Long story short: Trying to solve a problem like “reducing number of defects” needs, first, more than a blind jump to action, a careful review of the context one is in. Listen to your Testers. Listen with critical ears. Otherwise, you will play yourself, seduced by the siren song of “control of quality”. And somewhere, trust me, a grifter is filling their pockets. Such is life, some would say.

The path to less problems in Software Testing, is the one where we are hunting for more of them.

If you read this far, thank you. Feel free to reach out to me with comments, ideas, grammar errors, and suggestions via any of my social media. Until next time, stay safe, take care! If you are up for it, you can also buy me a coffee ☕