Methodology
How we counted Reddit's espresso machines, and how often the count is wrong
345,816 machine mentions, 102 machines, dataset 2026-11-17. The study is on this page. Below is every rule it was built under, starting with the part most studies leave out.
How accurate the labels are
Matches a human
80.4%
218 of 271 hand-checked mentions, seven labels
Positive, negative or neither
86.3%
The same check with the labels reduced to three
Our target
85%
We missed it and are publishing the number we got
One person hand-labeled 300 mentions, spread across popular and obscure machines. 271of the 300 are in the final data. The same person later re-read every mention where the model disagreed, plus 30 where it agreed, without seeing the model's answer, and changed 11 of their own labels. Reddit comments are not always clear about what they think, even to the people reading them.
Bigger models did not fix it. On the same 271 mentions, Claude Sonnet 5.5 scored 81.9% and Claude Opus 5.5 scored 77.1%. The disagreement that is left is mostly about where a question ends and a neutral remark begins, which matters little to the rankings.
The full error table
Each row is what the human said. Each column is what the model said. The shaded diagonal is where they agree.
| Human label | Rec | Own + | Own - | Regret | Question | Neutral | Non-owner - | Found |
|---|---|---|---|---|---|---|---|---|
| Recommendation | 38 | 0 | 1 | 0 | 0 | 6 | 2 | 81% |
| Owner, positive | 2 | 51 | 3 | 0 | 0 | 3 | 0 | 86% |
| Owner, negative | 0 | 1 | 22 | 1 | 0 | 1 | 0 | 88% |
| Regret or return | 0 | 0 | 1 | 11 | 0 | 1 | 0 | 85% |
| Question | 1 | 0 | 2 | 0 | 30 | 9 | 0 | 71% |
| Neutral | 1 | 5 | 5 | 2 | 1 | 54 | 1 | 78% |
| Non-owner, negative | 0 | 1 | 1 | 1 | 0 | 1 | 12 | 75% |
| Right when it says so | 90% | 88% | 63% | 73% | 97% | 72% | 80% |
The table scrolls sideways on a phone.
What that does to the published numbers
- Vouch Rate is the sturdiest. 90% of what the model calls a recommendation is one, and it finds 81% of them. Every Vouch Rate is a little low, by about the same proportion for every machine.
- Regret Rate is the shakiest. Regret is the rarest label (13 hand-checked examples). The model finds 85% of them, but 4 of its 15 regret calls were something else. Read Regret Rates as a ranking, and look at the counts next to them.
- Praise-to-Gripe Ratio leans on the least precise label. Only 63%of the model's owner complaints were owner complaints, because fault questions and troubleshooting leak in. The ratios compare fairly between brands. The absolute amount of griping is overstated.
The rulebook
What we publish, and what we do not.
Aggregate counts of how machines are discussed. No comment is republished, no username appears in the dataset or on the page, and the raw archive is not redistributed. Author identifiers were hashed at extraction, used once to build the Upgrade Ladder, and are not in any published file.
Where the comments came from.
The Arctic Shift archive of Reddit, a community-run mirror, read one month at a time with every request logged. The window is January 1, 2023 to September 1, 2026. Six subreddits: r/espresso (273,945 mentions), r/superautomatic (32,315 mentions), r/gaggiaclassic (16,195 mentions), r/LaMarzocco (14,119 mentions), r/Coffee (8,432 mentions), r/breville (810 mentions). r/cafe was dropped because it is about cafes.
How a machine gets recognized.
A dictionary of 109 machines and the names Reddit uses for them, including model codes and shorthand, matched at word boundaries with the longest name first. Words that usually mean one machine but not always (a bare "silvia", "robot", "bianca" or "gaggia") only count when the brand appears in the same text. Otherwise the mention is set aside as ambiguous and stays out of every ranking. Variants Reddit does not reliably tell apart are counted together: the Bambino and Bambino Plus, the Gaggia Classic generations, and the Flair models.
What was removed before counting.
Quoted lines, so replying to a recommendation does not count as making one. Comments from AutoModerator, other bots and deleted accounts. Deleted or removed text. A second identical comment from the same author.
How each mention was labeled.
Every clear mention gets one of seven labels describing the writer's stance toward that machine: recommendation, positive from an owner, negative from an owner, regret or return, question, neutral, or negative from someone who does not own it. The labeler is a language model (Anthropic Claude Haiku 5.5 with reasoning on, run November 16 and 17, 2026). It reads the comment, the thread title and up to two comments above it. That text is used for labeling only. A keyword-rule version was built first and dropped: it agreed with a human 43% of the time. The run labeled all 345,816 clear mentions, with identical text about the same machine labeled once.
The floor.
Rankings include only machines with at least 1,466 mentions, the smallest set that covers 90% of all mentions. That is 43 of 102 machines. The rest are in the table and the download, marked as small samples.
Vouch Rate.
Recommendations divided by all clear mentions of the machine. It is a share of talk, so a machine people mostly ask questions about scores lower than one people mostly evangelize.
Price brackets and Bracket Champions.
Each machine sits in one of four brackets by its typical US street price for the base model: under $400, $400 to $900, $900 to $2,500, and over $2,500. The brackets were set by hand when the dictionary was built and are not live prices. A Bracket Champion is the ranked machine with the highest Vouch Rate in its bracket. We did not divide recommendations by price: prices move weekly, and a per-dollar score would look more exact than it is.
Regret Rate.
Regret and return mentions divided by those plus positive owner mentions. In words: of the owners who said how it turned out, the share who wished they had not bought it. Ordinary complaints and troubleshooting are not regret and are not in this number.
Praise-to-Gripe Ratio.
Positive owner mentions divided by negative owner mentions, per brand, shown for brands with at least 500 of the two combined. Troubleshooting posts read as negative, so the level is pulled down for every brand. Compare brands with each other.
Upgrade Ladder.
For each hashed author, the first time they wrote as the owner of each machine, in date order. Two machines in a row at least 30 days apart count as one move. A move is published only when at least 20 people made it and it outnumbers the reverse by 65 to 35 or more. 6,002 authors owned two or more machines by this test. It only sees people who posted about both machines, so it is indicative.
What this is not.
Not failure data, not sales data and not a quality test. A machine can be regretted because it was the wrong machine for the buyer. A machine can be loved by the small group willing to pull a lever before breakfast. Both show up here as numbers.
Download the dataset (CSV). Found a mistake? Email hello@baristabench.com and we will fix it and say so here.