Vibe Coding Is Everywhere — But Nobody Is Vibe Testing. That's a Problem.
Suneet Malhotra
Mar 13, 2026
Vibe Coding Is Everywhere — But Nobody Is Vibe Testing. That's a Problem.
If you have been anywhere near tech Twitter or LinkedIn in the past few months you have seen it: "vibe coding." The term coined by Andrej Karpathy has gone from a meme to a movement. Developers — and increasingly non-developers — are building entire applications by describing what they want to an AI and letting it generate the code. Cursor, Claude Code, Copilot, Windsurf, Bolt — the tools are everywhere and they are genuinely impressive.
But here is the uncomfortable question nobody seems to be asking: who is testing all this AI-generated code?
The Vibe Coding Explosion
The numbers are staggering. Cursor hit millions of users. GitHub Copilot is embedded in nearly every IDE. Entire startups are being built in a weekend by founders who have never written a for-loop. Y Combinator partners openly admit that a growing percentage of their portfolio companies have codebases that are 95 percent AI-generated.
This is not hype. I have seen it firsthand. A friend who works in marketing built a fully functional SaaS dashboard in two days using Cursor and Claude. It looked great. It worked — mostly. But when I asked about test coverage he just stared at me blankly.
That blank stare is the canary in the coal mine.
The Quality Gap Nobody Talks About
Here is what I see happening as someone who has spent 20 years in QA engineering: vibe coding makes creation trivially easy but does nothing to make verification easier. In fact it makes verification harder because:
The developer does not understand the code. When you write code yourself you build a mental model of how it works, where the edge cases live, and what could break. When an AI generates 500 lines of React in response to a prompt, that mental model does not exist. The developer is shipping code they cannot fully reason about.
AI-generated code has subtle patterns. LLMs tend to produce code that looks clean but hides assumptions. Default error handling that swallows exceptions silently. Race conditions in async flows that only surface under load. Security vulnerabilities that pass a casual code review because the structure looks professional.
Volume is exploding. When it takes 10 minutes to generate what used to take a week, people generate a lot more code. More code means more surface area for bugs. But QA team sizes have not scaled proportionally — if anything they are shrinking.
What Vibe Testing Could Look Like
I think we need a matching paradigm shift on the quality side. If "vibe coding" means describing what you want and having AI build it, then "vibe testing" should mean describing what should work and having AI verify it.
Some of this already exists. I have been building self-healing test agents that use local LLMs to discover elements and adapt when the UI changes. But we need to go further:
- AI-generated test plans from PRDs. You describe the feature in plain English and the agent generates comprehensive test scenarios including edge cases the developer never considered.
- Autonomous exploratory testing. Agents that crawl an app like a real user, clicking through flows, submitting forms with unexpected inputs, and reporting anything that looks wrong.
- Continuous regression agents. Always-on testing bots that watch your deployment pipeline and automatically run context-aware tests against every commit — not just the tests a human wrote months ago.
The Real Opportunity for QA Engineers
Here is the thing that excites me: this is the biggest opportunity for QA engineers in a decade. When everyone can build software but few can verify it, quality becomes the bottleneck. And the people who know how to think about testing — who understand edge cases, security implications, accessibility requirements, and system integration — become incredibly valuable.
The QA engineers who will thrive are not the ones writing Selenium scripts by hand. They are the ones building AI-powered testing frameworks and orchestrating agents that can keep pace with the speed of AI-generated code.
If you are in QA right now, learn prompt engineering. Learn how to build and configure AI agents. Learn how to set up autonomous testing pipelines. The developers are vibe coding — your job is to make sure the vibes are actually correct.
The Bottom Line
Vibe coding is not going away. It is accelerating. And that is genuinely exciting for what it means for democratizing software creation. But every wave of creation needs a corresponding wave of verification. Right now the creation side is sprinting and the verification side is walking.
That gap is where the next generation of QA innovation will happen. And honestly, I cannot wait to build it.
Fight On. ✌️
Share this post
You Might Also Like
AWS Just Replaced My DevOps Team With AI Agents — Here's What That Means for QA
Amazon Web Services just launched autonomous AI agents that investigate production incidents and run penetration tests without human oversight. As a QA engineering leader, I have thoughts — and some of them are uncomfortable.
Industry TrendsI Watched Agentic AI Eat the Software Industry This Week — And I'm Not Going Back
From autonomous code reviewers to AI agents that ship features end-to-end, the software engineering landscape in 2026 looks nothing like it did 18 months ago. Here's what I'm seeing — and what every engineer needs to know right now.
AI & AutomationTest AI Latency from First Token to Finished Answer
A fast first token can hide a late or invalid answer. Test queueing, streaming, and completion with a synthetic workload before accepting a model-serving change.
AI & AutomationTest the Trace Before You Trust the Dashboard
A correct AI answer can hide a broken trace. Use a synthetic request and a deliberately stripped context header to test whether your debugging evidence survives service boundaries.
Latest Blog Posts
Test AI Latency from First Token to Finished Answer
A fast first token can hide a late or invalid answer. Test queueing, streaming, and completion with a synthetic workload before accepting a model-serving change.
Test the Trace Before You Trust the Dashboard
A correct AI answer can hide a broken trace. Use a synthetic request and a deliberately stripped context header to test whether your debugging evidence survives service boundaries.
The Evaluator Needs an Abstain State
A judge that must choose pass or fail will turn uncertainty into false confidence. Add an abstain state, calibrate it, and test the cases where the evaluator should refuse to decide.
Related Tools & Demos
The QA Field Manual to Language Models
A free 24-chapter book. Start at “what is AI, really?” and finish with a small language model you built yourself — one that reads a failing Playwright test and proposes a fix you can run. Read it in your browser, or download the PDF or the Mac app.
View Source Code →Multi-Model LLM Harness
One interface to call any AI model — capability routing, fallback chains, budgets, circuit breakers, and a quality feedback loop. A practical architecture pattern write-up.
Automated Trading System
Multi-engine trading platform with real-time risk management, regime-based strategy selection, and automated order execution.
View Source Code →
Stay in the Loop
Get weekly insights on AI-driven QA, engineering leadership, and automation strategies.
No spam, ever. Unsubscribe anytime.