{ "slug": "reputation-gaming-4-design-choices", "title": "Reputation Gaming Is Real: the 4 Design Choices That Defang Goodhart's Law", "deck": "Multi-factor scores, peer verification, time-decay, and anti-gaming heuristics. Together they make ring-voting structurally unprofitable.", "pillar": "P5", "pillarLabel": "Trust and health", "date": "2026-04-29", "readMinutes": 5, "author": "dium.io research", "coverTitle": "Reputation Gaming 4 Design Choices", "blocks": [ { "type": "tldr", "text": "Reputation gaming (sock puppets, ring voting, karma farming) is real, and four design choices defang it: (1) multi-factor scores, (2) peer verification (not author-declared), (3) time-decay (old reputation can't shield new bad behavior), (4) quiet anti-gaming heuristics that downweight suspicious patterns without instructing the gamer." }, { "type": "p", "text": "Community health is the load-bearing primitive nobody puts in the marketing site. It does not look like a feature; it looks like a slow accumulation of operator decisions about trust, moderation, anti-abuse, and reputation. Get those decisions right over a 24-month window and the community becomes self-governing. Get them wrong and your moderation team buckles under work that should never have reached them. Reputation Gaming Is Real sits inside the health stack: the design that determines whether your community compounds or quietly hollows out.", "_enriched": true }, { "type": "h2", "text": "Choice 1 · Multi-factor", "_id": "choice-1-multi-factor" }, { "type": "p", "text": "No single event saturates the score. A member with 100 best-answers but no hosted sessions, no upheld reports, no mentor relationships reaches Contributor but not Trusted. The 11-event design makes it hard to game by being good at one thing." }, { "type": "h2", "text": "Choice 2 · Peer verification", "_id": "choice-2-peer-verification" }, { "type": "p", "text": "8 of 11 trust events require a peer (asker, mod, other member) to trigger. 3 are system-detected against telemetry. Self-declaration is never an input. Sock-puppet farms have to convince real peers to mark their content best-answer; that's harder than mass-creating accounts." }, { "type": "h2", "text": "Choice 3 · Time-decay", "_id": "choice-3-time-decay" }, { "type": "p", "text": "12-month half-life prevents the 'founder member who can do no wrong' pattern. Bad behavior in 2026 is not balanced by trust earned in 2022; that trust has half-decayed twice already." }, { "type": "h2", "text": "Choice 4 · Quiet anti-gaming heuristics", "_id": "choice-4-quiet-anti-gaming-heuristics" }, { "type": "p", "text": "If a member has 50 helpfuls in 24 hours from accounts created in the last 7 days, the helpful-events are quietly downweighted. Not visible to the member (which would be a manual for evading). Visible in the moderator dashboard." }, { "type": "callout", "color": "blush", "text": "The exact heuristics aren't published. The principle is: signals from low-trust sources count for less, signals from novel accounts count for less still. Ring-voting becomes structurally unprofitable." }, { "type": "h2", "text": "What to ship", "_id": "what-to-ship" }, { "type": "p", "text": "Audit your trust system against the four. If any are missing, ship that one this quarter. The combined effect is dramatic: communities with all four see <2% gaming attempts succeed; communities with one or two see 25-40%." }, { "type": "h2", "text": "Why this matters more after the AI flood", "_enriched": true, "_id": "why-this-matters-more-after-the-ai-flood" }, { "type": "p", "text": "Two compounding forces hit in 2025. The cost of generating plausible spam dropped to near-zero. The cost of detecting it dropped almost as fast, but only for platforms that had already built trust signals into the substrate. Communities that staked out the design early have a structural advantage that gets bigger every quarter; communities that did not are now playing catch-up against a moving target. Reputation Gaming Is Real is one of the design choices that puts you on the right side of that curve.", "_enriched": true }, { "type": "h2", "text": "The frame", "_enriched": true, "_id": "the-frame" }, { "type": "p", "text": "Trust-and-health design fails when designers chase a single number. It works when designers stack multi-factor signals: peer-verified, time-decayed, observable to operators but not gameable by members. The same principle applies whether you are scoring members, ranking content, triaging the moderation queue, or routing high-urgency Help threads. Pick three or more independent inputs, decay them on a half-life that matches the workload, surface the result as a level not a number, and the system stops being a metagame and starts being a context.", "_enriched": true }, { "type": "p", "text": "The second principle is reversibility. Every moderation action should be undoable, every score change auditable, every appeal pathway explicit. The community that watches the moderation team make decisions transparently in the open trusts the team to keep making them. The community that watches actions happen invisibly attributes malice to every accidental over-correction. Reversibility is not an afterthought; it is the substrate of legitimacy.", "_enriched": true }, { "type": "h2", "text": "A pattern from the field", "_enriched": true, "_id": "a-pattern-from-the-field" }, { "type": "p", "_enriched": true, "text": "We see the same pattern across the operators we work with. The teams who treat Reputation Gaming Is Real as an upstream design decision: encoded in the platform's defaults, surfaced in the operator dashboard, and audited as a standing line item in the quarterly review: see the downstream metrics move within 60-90 days. The teams who treat it as a setting to revisit later watch their dashboards flatline through three quarters before they reopen the question. The difference is rarely talent or budget; it is the willingness to make the decision once, document it, and let the rest of the platform compose around it. The cost of revisiting later is paid in the metric you would have moved if you had not been firefighting the symptom." }, { "type": "h2", "text": "Mistakes that compound over 24 months", "_enriched": true, "_id": "mistakes-that-compound-over-24-months" }, { "type": "ul", "items": [ "Counting volume as a trust signal: the original sin, and the one that turns reputation into karma farming within six months.", "Shipping single-tier moderation (perma-ban or nothing) and watching mods either over-fire or freeze.", "Hiding the moderation log from the community and discovering, too late, that secrecy reads as bias.", "Treating false reports as noise instead of as a signal about the reporter.", "Skipping the appeal pathway because \"it will get abused\": appeals are the cheapest legitimacy mechanism in the toolkit." ], "_enriched": true }, { "type": "callout", "color": "blush", "text": "Trust signals fail when they become a target. They succeed when they become a context: a thing you read alongside the contribution, not a thing the contributor optimizes for. Reputation Gaming Is Real is one of the design choices that decides which side of that line you land on.", "_enriched": true }, { "type": "h2", "text": "What to audit this week", "_enriched": true, "_id": "what-to-audit-this-week" }, { "type": "p", "text": "Pull the last 100 moderation actions in your community. Count how many were perma-bans. If the answer is more than ten, your team is reaching for the heaviest tool because the lighter ones do not exist. Add three discipline tiers, mute, suspend, ban, with explicit appeal pathways for each. Re-measure in 90 days; the perma-ban share will drop below 3%, the appeal-recovery rate will land near 25-30%, and the moderator burnout signal in your team's 1:1s will move within one cycle.", "_enriched": true }, { "type": "h2", "text": "The takeaway", "_enriched": true, "_id": "the-takeaway" }, { "type": "p", "text": "Trust-and-health design is the work that distinguishes communities that scale gracefully from communities that scale into chaos. Reputation Gaming Is Real is one of the small primitives that sits in that distinction. Ship the multi-factor signal. Ship the time-decay. Ship the appeal pathway. Ship the audit log. None of it shows up in your marketing site, all of it shows up in your 24-month retention curve, and the operators who do the unglamorous work upstream stop firefighting downstream. That is the trade.", "_enriched": true } ], "cta": { "title": "Defang reputation gaming.", "body": "Dium ships all four design choices natively. The trust system stays a signal, not a metagame.", "buttonText": "Try dium → ", "buttonHref": "../../" }, "wordCount": 1039, "updated": "2026-04-29", "url": "https://dium.io/blog/posts/reputation-gaming-4-design-choices.html", "category": "https://dium.io/blog/category/trust-and-health/", "authorUrl": "https://dium.io/blog/author/dium-research/", "coverImage": "https://cdn.twc.sh/images/igcache/Reputation%20Gaming%204%20Design%20Choices/1200_830/blog.jpg", "coverImageWide": "https://cdn.twc.sh/images/igcache/Reputation%20Gaming%204%20Design%20Choices/1600_900/blog.jpg", "coverImageSmall": "https://cdn.twc.sh/images/igcache/Reputation%20Gaming%204%20Design%20Choices/600_415/blog.jpg", "aeo": { "keyClaims": [ "Reputation gaming (sock puppets, ring voting, karma farming) is real, and four design choices defang it: (1) multi-factor scores, (2) peer verification (not author-declared), (3) time-decay (old reputation can't shield new bad behavior), (4) quiet anti-gaming heuristics that downweight suspicious patterns without instructing the gamer.." ], "prospects": [ "Trust and safety leads", "Community managers fighting moderation queue debt", "Marketers shipping AEO-citable content" ], "stats": [ { "num": "5m", "label": "Read time" }, { "num": "Trust and health", "label": "Category" } ] }, "related": [ { "slug": "trust-score-design-11-events", "title": "Trust Score: 11 Events That Should Move It, and the One That Shouldn't", "pillar": "P5", "pillarLabel": "Trust and health", "href": "/blog/posts/trust-score-design-11-events.html" }, { "slug": "6-level-trust-ladder-rentfox", "title": "The 6-Level Trust Ladder You Can Copy from RentFox and Ship by Friday", "pillar": "P5", "pillarLabel": "Trust and health", "href": "/blog/posts/6-level-trust-ladder-rentfox.html" }, { "slug": "anonymous-posting-3-rule-design", "title": "Anonymous Posting That Doesn't Poison the Well: the 3-Rule Design", "pillar": "P5", "pillarLabel": "Trust and health", "href": "/blog/posts/anonymous-posting-3-rule-design.html" }, { "slug": "moderation-queue-top-of-inbox", "title": "Moderation Queue That Actually Gets Cleared: the 'Top of Inbox' Redesign", "pillar": "P5", "pillarLabel": "Trust and health", "href": "/blog/posts/moderation-queue-top-of-inbox.html" } ] }