Testing methodology

How evidence becomes a verdict.

A transparent process for separating editorial plans, vendor claims, hands-on observations, and tested conclusions.

Status labels

StatusWhat it meansWhat may be published
Testing plannedA scenario and criteria exist, but hands-on work has not begun.Scope, hypotheses, criteria, and known constraints. No scores or verdict.
In testingHands-on work has started but evidence collection or verification is incomplete.Progress notes and clearly provisional observations. No final winner.
TestedThe stated scenario has been completed and the article checked against the notes.Findings, scores, recommendations, limitations, and evidence dates.

1. Define the decision

Each test begins with an audience, a job to be done, and a decision the article should help with. For the initial niche, that means a solo agent or small real-estate team choosing a manageable system—not an enterprise buying committee.

2. Lock the workflow and criteria

For a comparison, the same synthetic records, pipeline stages, tasks, and expected outcomes are used in each product. Criteria are published or recorded before a winner is considered.

3. Capture evidence

Testing notes should record product plan, test date, setup steps, blockers, limitations, and observations. Screenshots may be used where licensing and privacy allow. No real client data belongs in a test account.

4. Separate sources

  • Hands-on evidence: actions completed in the tested product.
  • Vendor evidence: official documentation, pricing, or product claims, attributed as such.
  • External context: credible third-party sources, clearly cited.

5. Score only what was tested

A missing capability is not assumed from a failed search, and an inaccessible feature is not scored as if it were tested. The article states when access, plan limits, geography, or time prevented verification.

6. Recheck before publication

Capabilities and pricing can change quickly. Time-sensitive claims are rechecked close to publication, and the article carries an updated date when material facts change.

Editorial independence

Commercial relationships do not determine rankings or conclusions. Any active affiliate relationship must be disclosed near the relevant link and in the site-wide disclosure.