Methodology

How ratings work

The rules in plain words: what makes a verdict Solid, Mixed or Avoid, when the data is too thin to say, and how fast old reports fade.

Rule 1Per activity

One verdict per activity

Logging in, paying, uploading files and writing notes are rated separately. A site can be Solid for notes and Avoid for payments. The headline is always the weakest activity — never an average that hides the bad part.

Rule 2Minimum 5

Thin data stays labeled

Below 5 weighted reports an activity shows Not enough reports, never a guess. 3 reports of “fine” can never outrank 300 reports at 90%: ranking uses the Wilson lower bound, so deep evidence always beats thin evidence.

Rule 370 / 50

The thresholds

At least 70% “fine” → Solid. At least 50% “avoid” → Avoid. Anything between → Mixed. The raw split (41 fine, 12 mixed, 9 avoid) is always shown next to the word, so you see disagreement.

Rule 4180-day half-life

Recent reports count more

Each report’s weight halves every 180 days. A fixed problem stops hurting a site; a new problem shows fast. The newest report’s date is on every page.

For the curious. The code that applies these rules ships with the site. Read verdict.js — it is the same module the server uses.

What CMS does not claim

Ratings report what people said. They are not audits, not scam verdicts, and not legal conclusions. A good rating is not a guarantee. Nobody can pay to change a rating. Only approved reports count; spam, duplicates and brigading are held for review.

A worked example

Illustrative numbers, not a real site. Imagine 40 recent reports about paying: 10 fine, 8 mixed, 22 avoid.

PayingExample
22 of 40 say avoidAvoid

55% is above the 50% line, so the verdict is Avoid, shown with the full 10 / 8 / 22 split. If the site is Solid for logging in, that stays visible too. The headline still shows the weakest activity.

Questions

Why a lower bound instead of a plain percentage?
A plain percentage rewards tiny samples: 3 of 3 is 100%. The Wilson lower bound asks how bad the true rate could plausibly be given the sample, so 270 of 300 outranks 3 of 3.
Can a site get a rating without any reports?
No. Below five weighted reports an activity shows Not enough reports.
How are fake or spam reports handled?
Only approved reports count. Spam, duplicates and brigading are held for review by a person.
Look up a site