The Business Leaders Series

Penetration Testing for Business Leaders

What to test, what to ask, and how to turn findings into action.

By J.W. Walker · Updated October 2026
33 pages · PDFFree · No email

The full framework, ten questions to ask any testing firm, regulatory guidance across financial services and other industries, vendor selection criteria, and the executive glossary.

Read the Full Guide (PDF) →
Why It Matters

Scope, depth, cadence, and partner. Those are yours.

Penetration testing is a business decision that most organizations make without the full picture. Most executives know they should care. Few have a clear picture of what penetration testing actually is, what it really costs when something goes wrong, or how to tell whether they are getting genuine value from it.

Most of a penetration test is technical work you should delegate. A handful of choices are business decisions, not technical ones, and they shape whether the test measures your real risk or just produces an artifact to get filed away.

The objective is to close the distance between what you believe about your security and what is actually true. That distance is where breaches live.
Key Takeaways

Six things to walk away with.

  1. 01

    Four business decisions shape the value of any penetration test: scope, depth, cadence, and partner.

  2. 02

    Compliance-driven testing and security-driven testing should be the same engagement.

  3. 03

    A firm whose methodology is primarily automated is running a vulnerability scan at penetration test prices.

  4. 04

    A penetration test that produces a report nobody acts on has delivered no security value.

  5. 05

    Every significant change made after a test is a change that has never been tested.

  6. 06

    The point is to be reasonable. Protect what matters most, at a level proportionate to what its compromise would cost you.

Problems It Solves

If one of these is you, the guide covers it.

WHERE YOU ARE
WHAT THE GUIDE GIVES YOU
You’ve been sold a “penetration test” that’s really a vulnerability scan.
The guide names the distinctions, the credentials that actually matter, and the questions that force a firm to prove what you are buying.
You need to explain testing to your board and don’t want to sound like an IT briefing.
Executive-level framing of what to test, what it costs to get wrong, and what a defensible testing program should be able to show.
Compliance requires testing but you don’t know how much is enough.
Current guidance across NCUA, FFIEC, GLBA, PCI-DSS, HIPAA, GDPR, CMMC, and SOC 2, with the compliance-as-floor-not-ceiling framing.
You’re a credit union and examiners are asking about testing.
NCUA’s Information Security Examination program, how it scales to asset size, and what defensible documentation actually looks like.
You need to choose a testing firm and can’t tell them apart.
Ten specific questions to ask any testing firm, the certifications that matter, the credentials that don’t, and how to evaluate report quality before you buy.
Your last test produced a report that went in a drawer.
How to treat the report as a prioritized work plan, assign remediation ownership, and validate that critical fixes actually closed the gap.
Cyber insurance is asking for evidence of testing.
Why insurers now scrutinize testing history, what a mature program can do for premiums and coverage, and how to position for underwriting.
You have AI in your environment and don’t know how to test it.
The emerging discipline of AI and LLM system testing, and the questions any organization deploying AI in a sensitive workflow should be asking.
You know you should be testing more, but not what “enough” looks like.
Right-sizing based on what you hold, the regulatory environment you operate in, and the realistic threat landscape for your industry and size.
Who I Send Testing To

When you need the testing done, call Bryan.

I back people I trust, and only people I trust.
Bryan FaithVice President, Advanced Security Services
Stickley on Security

I don’t run tests anymore. When a leader needs one, I send them to Bryan. Like me, he’s worked both sides of the table, as the client and as the provider, so he knows what a test is supposed to tell you. And he reads findings the way a leader has to: what they mean strategically, financially, and for your reputation, not just for the network.

25+Years in IT
12Years focused on cybersecurity
BothClient side and provider side
Tell them J.W. sent you. I don’t take a referral fee for this one.

Read the complete guide.

Thirty-three pages of plain-language reference material. The full framework, ten questions to ask any testing firm, regulatory guidance, vendor selection criteria, and the executive glossary.

Questions

What leaders ask first.

What is a penetration test?

An authorized, simulated attack on your systems, conducted by skilled professionals, to identify security vulnerabilities before a malicious actor can exploit them. The key word is authorized. Without it, it is just hacking.

How is a penetration test different from a vulnerability scan?

A vulnerability scan is an automated check for known weaknesses. A penetration test actively attempts to exploit them and demonstrates real-world impact. Confusing the two is one of the most common ways organizations overpay for less than they think they are getting.

How often should you conduct a penetration test?

Annual testing is a common baseline, especially in regulated environments. Cadence should also respond to significant change and risk, because every change made after a test is a change that has never been tested.

How much does a penetration test cost?

Cost varies significantly with type, scope, and depth. A focused test of a single application sits at the lower end. A comprehensive network test with internal coverage sits meaningfully higher. Red team engagements are the most expensive by a significant margin. Prioritize testing around your most critical systems: a thorough test of what matters most delivers more value than a shallow test of everything.

What is the difference between a penetration test and a red team engagement?

A penetration test is a scoped, time-boxed engagement that identifies vulnerabilities in a defined environment. A red team engagement is a full-scope adversarial simulation, typically covert, that tests whether your organization would detect and respond to a real attack. Red teams are appropriate for mature security programs, not as an entry point.

Do you need external penetration testing if your internal team already tests?

Yes. Internal testing is valuable and should continue. Independent external testing brings fresh perspective, methodologies, and the credibility your board, examiners, insurers, and customers increasingly expect. Most regulatory expectations assume independence.

What should a good penetration test report include?

An executive summary a non-technical leader can read and act on, severity-rated findings with evidence, specific actionable remediation guidance, and a clear distinction between confirmed exploitable vulnerabilities and those identified but not tested. The report is the product. If the executive summary reads like a technical manual, ask for a different firm.

About the Author
J.W. Walker

J.W. Walker has spent his career in information security across commercial and government environments. He has sat in the tester’s chair, built a company from the ground up through exit, and serves as CTO of an information security firm. Today he advises executives and boards on how to get genuine value from security testing.

He writes plain-language guides that help leaders make confident decisions about technology and risk without needing to become technical experts.