Every Solana trader running a bot has a PnL screenshot. Most of those screenshots are misleading.
The classic case: trader runs a sniper bot for three months in a memecoin bull market, sees their wallet up 4×, posts the green chart, and concludes the bot works. The honest analysis is different. If they'd held SOL over the same three months and SOL went up 3.5×, the bot generated 50% of alpha, not 400% of returns. If they'd bought BONK at the start of the window and held, they might have done 6×. Bot performance isn't return — it's return relative to the right alternative.
This post is about how to actually measure that. We work with data from over 1,000 tracked Solana wallets — bots, KOLs, copy-traders, manual traders. The patterns that separate the genuinely-good from the deluded are clearer in the data than the narratives suggest.
The benchmark question
Performance attribution starts with picking the right benchmark. For Solana memecoin trading, three benchmarks matter:
1. Hold SOL. The simplest. If your bot's USD-denominated PnL would have been higher by just holding SOL through the period, the bot is destroying value. This is the floor.
2. Hold a market-cap-weighted memecoin index. Slightly harder to construct, but more honest. If your bot trades memecoins, the right comparison is "the basket of memecoins" rather than SOL itself. A reasonable proxy: equal-weight the top 20 Solana memecoins by daily volume, rebalanced weekly.
3. Hold the specific names your bot traded. The hardest and most honest comparison. For every trade your bot made, ask: what if I'd just bought that token at the same entry and held to the same exit? If your bot consistently exits too early or chases pumps too late, this benchmark exposes it instantly.
Most bot users only look at the first. The second is a better benchmark for portfolio comparison. The third is the gold-standard attribution.
What the data shows
Looking at our tracked-wallet dataset, broad patterns by archetype:
Successful KOLs (~3% of tracked wallets). Win rate of 55-65% on individual trades. Average winner is 2.5-4× the average loser. They generate genuine alpha over a SOL-hold benchmark by an order of magnitude, and over a memecoin-basket benchmark by 2-5× depending on period.
Aspirational copy-traders (~30% of tracked wallets). Following 3-10 KOLs via copy-trade bots. Win rate around 40-50%. They under-perform their KOL targets because of execution slippage, the lag between KOL entry and copy-trade fill, and the missing exit discipline (most copy-traders chase entry signals but don't follow exit signals).
Sniper bots (~15% of tracked wallets). Targeting fresh pump.fun launches. Win rate often above 60% on individual trades but completely dominated by a long tail of small wins offset by occasional large rugpulls. Median performance: slightly better than zero on a properly-attributed basis.
Manual chasers (~50% of tracked wallets). No bot, no signal source, buying tokens 5-15 minutes after they pump. Win rate around 30%, average loser 50% larger than average winner. Catastrophic underperformance vs. any benchmark.
Pure scammers (~2% of tracked wallets). Wallets that appear successful but show telltale patterns — coordinated entries with insider accounts, exit liquidity recycling, wash-trading their own tokens. Their public PnL looks excellent, but the on-chain attribution shows they're farming a private ecosystem rather than generating alpha.
The distribution matters because most bot pitches reference the first archetype — successful KOLs — when describing what their product will do. The actual outcome distribution is much more bimodal: a small group of genuinely-skilled traders, a long tail of everyone else, and bots accelerate whichever side you're naturally on.
The right metrics to track
If you're running a Solana bot and want to do honest attribution, here's the actual stack:
1. Token-level P&L, not portfolio-level. Aggregate PnL hides bad trades inside good ones. If you have a winning portfolio, you want to know which trades drove it — and which trades you should have skipped. Per-trade attribution lets you find your patterns.
2. Mark-to-market at trade-time, not realized PnL. Realized PnL is "what you closed at." Mark-to-market is "what was the position worth at every point." The gap between MtM peak and your eventual exit is your "missed gains" — and it's often larger than your realized gains. If your bot held a token from $30k market cap to $300k and exited at $100k, the realized profit is real but you also "missed" $200k in MtM. That's actionable information.
3. Slippage attribution. Sometimes a 10% loss is 5% market and 5% bad fills. Splitting these out tells you whether you have a strategy problem or an execution problem. Each requires a different fix.
4. Win/loss asymmetry. Win rate is one number. Average winner / average loser is the more important ratio. A bot with a 40% win rate and a 4× win/loss ratio is great. A bot with a 70% win rate and a 0.5× win/loss ratio is terrible. Most chasers fall into the second pattern.
5. Time-to-fill latency. For sniper and copy-trade bots, the time between signal and fill is often the single biggest performance driver. A bot that fills in 200ms after a KOL's entry consistently outperforms one that fills in 1.5s. Track this explicitly.
The pattern that separates winners
In the 3% of wallets we track that consistently generate alpha, one pattern recurs more than any other:
They exit on losses faster than they exit on wins.
The losing exits happen within 30 minutes of entry. Median time-to-exit for a losing position in the top tier: 18 minutes. For the bottom tier (the chasers): 4 hours.
The winning exits stretch much longer. Top tier holds winners for a median of 6-12 hours. Bottom tier panics at the first +20% and books a small gain that becomes a missed multi-bagger 50% of the time.
This isn't a bot configuration. It's a discipline pattern. The wallets that win on Solana are not running magic strategies — they're running ruthless stop-losses on losers and patient holds on winners. Most bots can be configured to do this. Most users don't bother to set up the configuration properly.
What tools actually help
For honest attribution, three classes of tools matter:
Portfolio trackers like Wallet Master and Step Finance give you the raw PnL across your wallet. Useful but high-level. They don't tell you which trades drove the number.