Home/Guides

Why a losing method is demoted not deleted

Why does my model still use a method that keeps losing?

The engine de-vigs every market with 4 methods and weights them by how badly each has missed. The worst, additive, holds 5.9% of the vote. It did not earn all of that. A floor of 5% was reserved for it before any weight was handed out, and its share of the remainder lifted it the rest of the way. The tempting move is to drop the loser instead. That is the error.

Deleting a method destroys the evidence that would clear it

These weights are fitted over 60 graded bets. That sample cannot separate a bad method from an unlucky one. Across 220 graded bets this engine measures 5.91% flat-bet ROI with an interval running from -7.0% to 18.9%, which spans zero and is indistinguishable from break-even. If that many bets cannot settle whether a strategy makes money, a smaller sample cannot settle which de-vig method is right.

A deleted method stops making predictions. No predictions means no errors, no errors means no evidence, and the record that would have exonerated it is never written. The pruning is self-sealing: it removes the only thing that could reverse it. Demotion costs almost nothing and stays reversible.

Reserve the floor first then distribute the remainder

Order matters, and it is where implementations go wrong. The tempting version normalises the inverse errors to a full allocation, raises anything below the floor up to it, then renormalises so the total sums back to a full allocation. That last step scales every weight down again, and the methods just lifted to the floor land back underneath it. The floor is enforced and undone in one operation, arriving at the outcome it exists to prevent.

Reserving 5% per method first and dividing only what is left needs no renormalisation, so nothing falls through.

MethodErrorWeight
power0.1665.2%
shin0.6420.1%
multiplicative2.568.8%
additive10.245.9%

That log is constructed, not a record of live markets. Each method was handed a fixed offset from the target before the run, so the ranking was known in advance and the error column is those offsets squared and rescaled. It shows the mechanism turning error into weight, not which devig method wins on any real market — your own graded bets are what put real standings in it.

The floor is a prior

Named as a prior, because that is what it is: the 5% floor asserts, ahead of any evidence, that no method is worthless. Measured error moves everything above it. Each error in the table is a multiple of the one above it, yet the weights do not fall in that proportion — the gaps compress toward the bottom, which is the floor doing its work. power leads at 65.2%: the same floor as every other method, plus the largest share of the remainder.

How to tell if your model actually works →