⚽ Tomulator
Overview
◈Dashboard📅Today's games◎State of play
Money
💷Bets & strategies
Explore
⊞Leagues & seasons📐Metrics▤Data sources
Engine room
🎲Simulations🧪Lab≣Catalog?How this works

strategy & model leaderboard

← lab · 24 backtests ranked by skill vs the market · ran 7/7/2026

What this is: Ranks every backtested model by skill against the bookmaker's closing prices — the fairest single scoreboard we have.
Ranked by skill first (Brier edge vs the de-vigged market — positive means sharper than the bookmaker), then CLV, then ROI. Note: entries differ in markets/periods; same-competition rows are the fair comparisons. Armed strategies await their forward paper trials.
BacktestModelCompBetsROICLVBrier edge
#29ml_gbm_v1PPL3,581-3.8%0.68%-0.00063
#28ml_gbm_v1DED4,313-1.8%-0.14%-0.00207
#27ml_gbm_v1FL15,766-5.1%0.10%-0.00221
#26ml_gbm_v1BL15,468-4.4%0.49%-0.00237
#25ml_gbm_v1SA6,574-7.2%0.52%-0.00243
#22ml_gbm_v1PD6,843-7.3%0.15%-0.00318
#10ml_gbm_v1EPL336-4.7%0.28%-0.00357
#21ml_gbm_v1EPL8,430-3.3%0.40%-0.00391
#18ml_gbm_v1EPL9,586-1.5%0.53%-0.00465
#1poisson_twEPL353-5.8%-1.05%-0.00526
#19ml_gbm_v1EPL9,793-1.9%0.38%-0.00563
#16ml_gbm_v1EPL9,588-2.9%0.42%-0.00575
#12poisson_twEPL1,442-11.4%-0.44%-0.00595
#17poisson_twEPL1,442-11.4%-0.44%-0.00595
#2poisson_twEPL2,322-7.0%-0.25%-0.00617
#20ml_gbm_v1EPL9,900-2.4%0.40%-0.00637
#14ml_gbm_v1EPL9,248-2.2%0.31%-0.00702
#15ml_gbm_v1EPL9,659-1.0%0.31%-0.00718
#13ml_gbm_v1EPL9,247-1.4%0.42%-0.00764
#7ml_gbm_v1EPL8,235-1.3%0.28%-0.00875
#11ml_gbm_v1EPL8,203-2.7%0.42%-0.00966
#6ml_gbm_v1EL29,818-5.5%-0.04%-0.01067
#4ml_gbm_v1EPL10,506-2.1%0.07%-0.02901
#3ml_gbm_v1EPL10,616-3.0%0.06%-0.03131

Registered strategies

CodeStatusDescription
draw_family_v1dormantThe sweep survivor: back the DRAW when model edge > 10% in high-tempo matchups. Verdict window +12.6% on 324 unseen bets (upper bound). [BLOCKED: model 'gbm' needs a forward-serving job the executor doesn't have yet — review finding #12; was mislabeled 'armed'.]
draw_calm_books_v1dormantSibling survivor: back the DRAW when edge > 15% and bookmaker margin is low. Verdict +4.5% on 429 unseen bets. [BLOCKED: model 'gbm' needs a forward-serving job the executor doesn't have yet — review finding #12; was mislabeled 'armed'.]
mlb_dog_variance_v1liveBaseball is the highest-variance major sport (rating->win only +0.12) yet the public loves favorites. Back MLB underdogs priced 2.2-3.5 when our Elo edge is at worst -3%.
elo_value_mlb_v1liveStraight Elo value on MLB moneylines: bet either side when Elo win probability beats the best price by 4%.
drought_fade_v1liveLaw-derived (winless-run replicates in 4 sports): bet AGAINST any side whose opponent... no — whose own winless run is 4+ games, when priced under 2.8. Fade the drought.
steam_confusion_v1liveMarket-structure play: when bookmakers DISAGREE hard on a price (cross-book spread > 8%), take the best available price on the side with any positive Elo edge — someone is wrong, take the generous one.
fatigue_fade_nba_v1armedLaw-derived (NBA congestion is real, r=-0.067): fade NBA teams playing their 4th+ game in 7 days against fresher opponents.
hot_hand_fade_v1liveMean-reversion creative: fade sides whose Elo momentum is scorching (opponent momentum in top band) — the market overprices streaks. Expected to be humbled; that is the point of testing it.
chaos_parlay_v1liveThe fun one: a $2 three-leg parlay of the day's highest-edge independent legs across all live strategies' candidates. Margin math says it should bleed; it exists to make the math visible.
placebo_rain_unders_v1

Reading the columnswhat each number actually means

ROIprofit per unit staked at opening prices
CLVhow much better our price was than the closing price — the earliest sign of real skill
Brier edgeprobability accuracy vs the de-vigged closing market; positive = sharper than the bookmaker
Spec · the reproducible recipe
{
  "kind": "leaderboard"
}
dormant
CONTROL: bet football unders when heavy rain is forecast. Our own discovery says rain does NOT reduce goals — so this placebo SHOULD lose at the margin rate. If it wins long-term, our discovery engine has a bug. Science. [BLOCKED: model 'gbm' needs a forward-serving job the executor doesn't have yet — review finding #12; was mislabeled 'armed'.]
cards_closeness_v1dormantDiscovery-derived (closeness->fouls, r=+0.19 emergent): cards/fouls overs in evenly-matched games. Dormant until a live cards-odds feed exists. UPDATE 2026-07-03: referee identity alone swings P(4+ cards) from 33.6% to 54.0% (quartile split, n=21,870) — add match.ref_cards_avg regime when the odds feed exists.
value_all_v1retiredBaseline engine: any market, 5% edge, fractional Kelly. Backtest verdict: -2.05% over 20 EPL seasons. Kept as the reference corpse.
wc_sim_value_v1liveWorld Cup: back any 1x2 selection where the Poisson fixtures-sim beats the best live price by 8%. Caveat honored: the sim runs hot on tournament data, hence the high bar.
wc_upset_hunter_v1liveWorld Cup knockout chaos: longshots priced 4-10 where the sim still sees positive edge. Small stakes, big stories.
wc_ko_unders_v1liveKnockout football is cagey (legs tighten when losing means going home): under 2.5 goals when the sim agrees (any positive edge). Hypothesis-tagged.
steam_chaser_v1liveLine-movement study (78k selections, 20yr): big steam (4+ prob-pt moves) is the one bucket the close doesn't fully absorb (+2.3pts residual), concentrated in soft leagues (+5.9% EL2) and away sides (+6.4%). Hypothesis-grade (CI spans zero) — this forward trial is the judge. Bets any selection whose consensus implied prob rose 4+ pts across our own daily snapshots.
portfolio_v1liveLayer 3, the bet-maker: builds the best BASKET across everything priced (ballast/value/longshot buckets, one bet per contest, quarter-Kelly, model blended 50/50 with the market) and Monte Carlos each slate before betting. Historical replay verdict: with the current football model's edge it would have gone bust over 21 seasons ($1000 -> $0.76) — this forward trial tests whether the newer, humbler probabilities change that.
pitcher_edge_v1liveWho's on the mound matters most in baseball. Bet an MLB moneyline side when its probable starter's season ERA is at least 1.00 better than the opponent's (mlb.starter_era_gap, signed to the bet side) AND our Elo sees any positive edge at the best live price. First strategy to use contest-scoped context metrics.
prop_scorer_v1liveThe first player-level strategy: a gradient-boosted scorer model (rolling goals/shots per 90, starting rate, team attack vs opponent defence, confirmed lineups when available) prices every Kalshi anytime-goalscorer market and bets where its probability beats the fee-adjusted ask by 10%+. Settles from Kalshi's own results.
ref_cards_draw_v1livePromoted from the matrix tournament (won ALL 4 backtest seasons, worst season +$471): when the referee's card average is in the top tercile (>=3.52/game), the match tightens — back the DRAW blind. Model-free context bet; forward trial to survive multiple-comparisons doubt.
cards_over_ref_v1liveThe referee signal finally bettable: card-happy ref (top tercile, >=3.52/game) -> back total cards OVER at the main line from the new odds feed. Settles from post-match team stats.
corners_style_over_v1liveTwo corner-hungry teams meet (style clash top tercile, >=11.4 combined corner averages) -> back total corners OVER at the main line. Model-free; the relational miner showed corners follow style and mismatch.
wc_sim_value_kor_v1liveStaking A/B twin of wc_sim_value_v1: identical signal (Poisson sim beats best price by 8%) but sized by kelly_of_ruin — half-Kelly scaled by the posterior probability this bankroll's edge is real, from its own settled record. Measures the staking policy, not the signal.
mls_sim_value_v1liveMLS forward trial: back any 1x2 selection where the fixtures sim beats the best price by 10%. Higher bar than WC — the sim is new to this league and MLS draws are notoriously frequent.
wc_sim_value_gf_v1liveGap-filtered twin of wc_sim_value_v1: identical sim signal, but each edge must ALSO be blessed by the gap-survival classifier (P(model side right) >= 0.55, trained on 21 seasons of model-vs-market disagreements). The meta-filter's live A/B.
dutch_cover_v1liveHalf-cover dutch: back the sim's 1x2 pick (edge >= 5%) AND the draw, draw stake sized to refund HALF the outlay on a draw. The 21-season backtest (exp #203) found full cover overpays for insurance (median $898) while half-cover beats straight outright: median $1,060 vs $995, worst season $87 vs $17.