How We Test

No lab. No benchmarks.
Here's what we actually do.

Get The Verdict evaluates software through documented research, pricing analysis, and user evidence — not invented testing claims. This page explains our process precisely.

The honest version

Most software review sites claim they tested every tool for months. They didn't. The economics don't allow it — a site covering 40 categories and 300 tools cannot employ a team large enough to actually use every product to a level that would constitute meaningful testing. The claims are padding.

Get The Verdict doesn't claim that. We evaluate tools through documentation analysis, changelog review, pricing research, compatibility investigation, and aggregated user evidence from the places working professionals actually talk about software. Then we apply editorial judgment to synthesize it into a verdict you can act on.

This is more useful than the alternative. Choosing between seven email marketing tools isn't a six-month hands-on testing question — it's a research question. Which one covers the core use case without hidden limits? Which free tier is genuinely useful? Which one has been actively maintained for the past year? Those questions have answers, and they don't require a lab to find them.

What you will never read here

“We tested this for six months.” “After extensive benchmarking.” “In our hands-on lab review.” “Our proprietary scoring methodology.”

These phrases don't appear on Get The Verdict because they would be false. We are not a testing lab. We do not have a proprietary scoring algorithm. We do not run speed benchmarks or load tests or conduct A/B experiments on tool outputs. Any site claiming to do all of that across dozens of categories is not telling you the truth about how it works.

What we claim instead is what we can actually support: what the documentation says, what the changelog shows, what the pricing page specifies, what users in professional communities consistently report, and what editorial judgment — applied consistently — concludes from that body of evidence.

§
What we look at

Eight things we evaluate for every tool

1

Documentation analysis

We read the vendor's documentation in full — feature lists, limits, integrations, and what requires a paid tier. Documentation tells you what a tool actually does, stripped of marketing language. A tool with vague or incomplete documentation is itself a signal about the vendor's reliability.

2

Changelog review

We check when a tool was last updated and what the update contained. A plugin last updated 18 months ago on a platform with weekly security releases is a risk, regardless of how good the feature list looks. Active changelogs signal active maintenance. Stale ones signal abandonment risk.

3

Pricing evaluation

We document the actual cost — including renewal pricing, not just introductory rates. We calculate multi-year cost of ownership where relevant, because a $2.99/month hosting plan that renews at $10.99 has a very different real cost than it appears. Hidden pricing mechanics are disclosed directly in the pick.

4

Free-plan-first evaluation

We evaluate the free tier as a first-class product, not as a footnote. If a tool's free plan is genuinely useful for most readers, we say so and give it a Use Free Plan verdict. If it's a crippled trial disguised as a free tier, we say that too. Recommending paid upgrades readers don't need is not something we do.

5

User consensus aggregation

We read what working professionals say about tools in the places they actually talk: WordPress.org support forums, Reddit communities, G2 and Trustpilot verified reviews, and professional community discussions. Patterns across these sources carry more weight than any single review or star rating.

6

Compatibility research

We check how tools interact with the platforms and workflows readers are most likely running. A WordPress plugin that conflicts with common hosting configurations is a problem the documentation won't tell you about — but the support forums will. Compatibility issues get flagged in the pick, not buried.

7

Update frequency and vendor stability

We look at how often a tool ships updates and whether the vendor responds to support requests. For WordPress plugins, we check the WordPress.org page: active install count, last updated date, support response rate, and outstanding unresolved issues. A great feature set still makes a poor recommendation if the vendor is unresponsive or the codebase is drifting.

8

Editorial judgment

The evidence rarely points in one clean direction. Editorial judgment is applied at the end of the process to weigh what matters most for the specific audience reading that roundup. A tool that's the right choice for a solo blogger is not automatically the right choice for an agency. The verdict reflects who the recommendation is actually for, stated explicitly in every pick.

On commissions

Affiliate relationships don't change verdicts.

Some tools on this site earn us a commission when you purchase through our links. The commission rate varies by tool — some pay nothing, some pay a meaningful amount. We disclose affiliate relationships on every page that contains them.

The discipline we apply: when we research a roundup, we identify the evidence-based verdict before looking at commission rates. Bluehost earns us one of the highest commissions in the hosting category. It still gets a Skip verdict on this site, because the evidence — renewal pricing, support quality, real-world performance reports — doesn't support recommending it. That verdict costs us money. That's the point.

If a tool has no affiliate program at all but the evidence supports recommending it, we recommend it. Ghost has no affiliate program. Substack has no affiliate program. Both appear in our Email Marketing roundups with honest verdicts because leaving them out to protect affiliate income would make the roundup worse, not better.

Commissions are disclosed in the pick card for every tool that pays one. Readers can see exactly which tools earn us money and make their own judgment about what that means for the recommendation.

Keeping verdicts current

Verdicts are not permanent

A verdict reflects the evidence at the time it was assigned. Software changes. Pricing changes. Vendors are acquired or abandoned. A tool that earned a Solid Pick two years ago may not earn one today.

We review verdicts when pricing changes materially, a significant feature ships or is removed, community sentiment shifts clearly, or a better alternative enters the category. Updated articles carry the revision date at the top of the page. The revision date refers to a substantive editorial review, not a cosmetic update.

If you read something on this site and believe it's out of date — wrong pricing, a removed feature, a vendor change we haven't caught — the About page has a contact route. We take corrections seriously and update quickly when the evidence supports it.