How AI Saves Me Hours Every Week Without Replacing My Thinking
AI dismantles repetitive work — not engineering judgment. A practical look at toolchains, rulesets, the AI-to-AI echo chamber, and why experience still generates confidence.
By Alok Giri
When people hear that I weave Artificial Intelligence into my daily engineering workflow, the first assumption is almost always defensive: "So, does AI just write all your test suites now?"
Not even close. The reality is far less dramatic and infinitely more practical. AI hasn't replaced my work; it has systematically dismantled the repetitive, mechanical parts of it. And as any experienced engineer knows, that distinction changes everything.
As a Senior Quality Engineering Lead, my value to an organization isn't measured by the raw volume of automation code I churn out. My responsibility is to help my team release stable software with absolute confidence. AI helps me reach that state of confidence faster, but it doesn't make the hard engineering decisions for me.
Operating a Diversified AI Toolchain
One of the earliest realizations I had when integrating these tools is that "AI" is not a singular entity—it is a diverse, highly nuanced ecosystem. The exact same engineering prompt will yield entirely different structural answers depending on the model you use. Because of this, I don't believe in having a "favorite" AI model. I believe in maintaining a highly specialized, diversified toolchain where each model acts as a distinct technical specialist:
- Gemini and ChatGPT for Documentation: When I need to draft comprehensive test strategies, summary reports, or release notes, these models excel at structuring and phrasing documentation beautifully.
- Claude Opus for Deep Coding: When it comes to writing clean, maintainable, and structurally sound Playwright or Cypress automation from scratch, Opus consistently delivers the highest quality code abstractions.
- Codex and Claude Sonnet for Planning and Discovery: Both of these models are spectacular during the initial planning phase. They act as exceptional sounding boards because they are incredibly analytical; they proactively fire back a barrage of architectural and logical questions, forcing me to think about edge cases, race conditions, and integration blind spots I might have completely missed.
Choosing the right AI tool has become just as critical as selecting the right testing framework. You wouldn't dream of using a performance tool like JMeter for front-end functional testing. The modern engineer's competitive edge belongs to whoever knows how to orchestrate these diverse models together.
Guarding the Repository: Skillset and Ruleset Configuration Files
To keep this ecosystem from turning into a chaotic digital Wild West, I've established a strict personal framework: I feed the models custom Skillset .md and Ruleset .md files before starting any major task.
Left to their own devices, LLMs have a bad habit of overstepping their bounds. For instance, a common annoyance I faced early on was models constantly spinning up unnecessary, cluttered documentation or separate markdown files every single time they refactored a piece of code.
By engineering a definitive Ruleset.md—which clearly outlines our core framework architecture, strict coding constraints, and folder structure parameters—I can enforce exactly how the AI behaves. Paired with a Skillset.md that defines the technical persona and domain expertise required for the task, these files act as programmatic anchors. The AI focuses strictly on refining code rather than generating administrative noise, keeping our repositories exceptionally clean and predictable.
The Day the Product Owners Broke the Pipeline
However, having the perfect internal engineering setup won't save you if your foundational inputs are corrupted. We've all heard the phrase Garbage In, Garbage Out (GIGO), but I lived through a brutal, real-world challenge that proved just how dangerous this reality is in the age of generative AI.
A while back, our Product Owners (POs) started using AI to write all of their JIRA user stories. Instead of focusing strictly on business value and user acceptance criteria, the AI dumped massive, overly prescriptive technical details directly into the tickets. The issue was that these technical details were completely buggy, highly hallucinated, and utterly detached from our actual application architecture.
When my QA automation AI ingested those JIRA stories to map out test coverage, the entire execution catastrophically failed. The foundational requirements themselves were fundamentally flawed. Even my strict technical rulesets couldn't save the run because the root source of truth was built on a hallucination.
You cannot trust AI implicitly, no matter who on the team is deploying it. When product management delegates its core critical thinking to an LLM without rigorous human verification, it creates a toxic ripple effect that breaks the entire engineering pipeline downstream.
The AI-to-AI Echo Chamber: A Unique Modern Risk
This breakdown led me to discover a highly unique phenomenon that I call The AI-to-AI Echo Chamber Breakdown. This is a hidden tax that very few engineering teams are talking about yet, but it is incredibly dangerous.
When a PO uses AI to write a requirement, a developer uses AI to generate the feature code, and a QE uses AI to write the automated test based on that requirement, you create a closed feedback loop of automated confirmation bias. The QE's AI looks at the faulty JIRA story, matches it to the developer's AI-generated code, and writes a test that passes perfectly.
Everything looks beautifully green on the CI/CD dashboard. The metrics are flawless. But in reality, you have built a house of cards. The AI tools have essentially agreed with each other's hallucinations, completely bypassing human logic. The first time real human logic touches that feature is when a frustrated customer encounters a devastating bug in production.
To prevent this echo chamber, we implemented a strict rule: Human-in-the-loop circuit breakers. We stop using AI as a bridge between roles. Humans must own the alignment meetings, humans must validate the context, and most importantly, we must bridge our prompt contexts. If our POs are going to use AI for drafting, they must be forced to anchor their prompts using the engineering team's unified Ruleset.md so that the AI understands the physical boundaries of our actual software stack.
The Senior QA Golden Rule
Treat every single line of AI-generated content—whether it is code from an engineer or a requirement from a Product Owner—exactly like a rough draft from an eager junior teammate. It's a helpful starting point, it's often deeply impressive, but it must always be thoroughly reviewed by a human before it is trusted.
Whenever an AI hands me an answer, I ask myself one simple question: "Would I be willing to confidently defend this exact implementation during a live, high-stakes architecture review with our principal engineers?" If the answer is no, the work isn't done. AI is meant to drive engineering velocity, not lower our engineering standards.
What AI Can't Replicate
At the end of the day, the core of true quality engineering happens away from the keyboard. AI cannot sit in a refinement session and sense the subtle, unspoken ambiguity in a team's feature discussion. It cannot genuinely negotiate realistic scope, pair program with a developer to reproduce an intermittent race condition in a staging environment, or deeply cross-examine the emotional pain points of our end users.
Most importantly, AI cannot build a culture of shared quality ownership or establish trust within an engineering squad. Those high-leverage outcomes require human experience, political acumen, and acute engineering judgment.
AI has radically transformed how I work, but it hasn't altered why I work. My mission remains exactly what it was when I started my career: to mitigate systemic risk, optimize engineering velocity, and empower teams to ship great products without fear. AI simply grants me the time to focus on the parts of quality engineering that matter most.
"AI can generate code in seconds. Experience still generates confidence."