Why Smart Investors Get Bad Results: The Surprising Truth About the “Behavior Gap”

The fundamental logic of investing is deceptively simple: buy low and sell high. Yet, for decades, data has revealed a persistent and painful paradox. While market indices consistently post long-term gains, the average person participating in those same markets captures only a fraction of those returns. Over the 30-year period ending in 2015, the S&P 500 outperformed the average investor in 22 out of those 30 years. In other words, there was only an eight-year window where the individual stayed ahead of the index.

Why does the average person consistently earn less than the very market they are trying to track? The answer isn't found in the market’s volatility, but in the person in the mirror. This is the "behavior gap"—a chasm created by our own psychological wiring that translates into hundreds of billions of dollars in lost wealth.

The 6.69% Performance Chasm

The most startling evidence of this gap comes from DALBAR’s 30-year analysis of investor behavior. During this three-decade window (ending December 31, 2015), the market and the people in it lived in two different financial realities:

• S&P 500 Annualized Return: 10.35%
• Average Equity Investor Return: 3.66%
• The "Diminished Returns" Gap: 6.69%

This 6.69 percentage point deficit is not just a statistical curiosity; it represents a catastrophic erosion of compounding power. When extrapolated across the entire investing public, this gap represents hundreds of billions of dollars in wealth that vanished—not because the market failed, but because investors failed to stay in their seats.

“Stay the course. No matter what happens stick to your program. I've said stay the course a thousand times and I meant it every time. It is the most important single piece of investment wisdom I can give to you.” — John C. Bogle

It’s You, Not Your Advisor: The Primary Cause of Loss

For years, the public has blamed fund expenses, management fees, and poor advisor recommendations for their underperformance. While costs matter, the data suggests they are not the primary culprit. In a 20-year analysis of equity investor underperformance, the results were clear:

• Fund Expenses and Fees: Accounted for $65 billion in losses.
• Voluntary Investor Behavior: Accounted for $122 billion in losses.

"Voluntary behavior"—the choice to panic sell during a downturn or chase a hot trend—is nearly twice as destructive as the fees we pay. This self-inflicted "carnage" is fueled by specific psychological traps. Loss Aversion causes us to feel the pain of a market dip more intensely than the joy of a gain, leading to panic. Herding drives us to copy the behavior of the crowd at the exact moment the crowd is most exuberant and overpriced. Finally, Anchoring keeps us tied to past prices or familiar experiences, even when market conditions have fundamentally shifted. Remarkably, the DALBAR study found no material evidence linking underperformance to predictably poor investment recommendations. The failure is almost entirely behavioral.

The "Guess Right" Trap: Why Being 75% Correct Isn't Enough

In 2015, the "Guess Right Ratio"—which measures how often investors correctly anticipated market direction through their fund flows—was a staggering 75%. Investors "guessed right" in 9 out of 12 months. Yet, despite this high accuracy, the average equity investor still suffered a loss of -2.28% while the S&P 500 gained 1.38%.

How can you be right 75% of the time and still lose? The answer lies in the volume and timing of those guesses. In January 2015, investors bought into a -3% correction with a fund flow of 0.15%. However, in February, when the market surged by 5.75%, the flow dropped to 0.10%. Investors committed more capital when the market was falling than they did during the subsequent recovery. "Guessing right" on direction is a useless skill if the magnitude of your commitment is smaller during the surge than it was during the dip.

The "4-Year Itch": Our Inability to Wait

Success in the market requires a long-term vision, but the data shows we are remarkably impatient. Over the past 20 years, equity fund retention rates have seldom exceeded four years (averaging 4.10 years in 2015). Fixed-income investors are even more restless, rarely staying in a fund for three years (2.93 years in 2015).

This short-term focus is a direct contradiction to the "60-year career" Bogle described—30 years of accumulating and 30 years of distributing wealth. We treat market volatility as a surprise signal to flee, rather than a scheduled event.

"Corrections (a 10% drop) occur on average every 19 months... Bear markets (a 20% plus drop) occur on average every 3.6 years. This is an expected event... It shouldn't be a surprise when it happens." — John C. Bogle

The Mathematical Disaster of "Plan B"

In the investing community, the urge to bail when markets get "bad enough" is often referred to as "Plan B." Mathematically, Plan B is a financial catastrophe because it converts a temporary decline into a Permanent Loss of Capital. The disaster occurs when an investor sells at the low and waits for the market to recover to its prior high before buying back in. By doing so, they miss the entire recovery phase required to break even.

Historical data reveals the permanent damage of this strategy:

• March 2003 (Tech Bubble): 46% permanent loss of capital.
• March 2009 (Financial Crisis): 52% permanent loss of capital.
• 2020 (Pandemic Start): 34% permanent loss of capital.

Once that capital is gone, it never comes back. You haven't just lost money; you’ve lost the future compounding power of that money.

When Diversification Fails: The Correlation Convergence

Many investors rely on diversification as a "shield." However, when "stock market carnage" actually arrives, asset classes that usually move independently tend to move in lockstep. This is Correlation Convergence, and it reveals most diversification as "fake" when it matters most.

During the 2008 mortgage meltdown, correlations to the S&P 500 (where 1.0 is moving in perfect unison) surged:

• Emerging Markets: Correlation jumped from 0.41 to 0.90.
• REITs: Correlation rose from 0.67 to 0.83.
• Commodities: Correlation swung from -0.13 to 0.60.

Investors who thought Emerging Markets would save them were horrified to find their "safety net" had tightened into a noose, doubling its correlation to the crashing S&P 500. True diversification requires a downside protection strategy that understands these correlations will converge toward +1 under stress.

Conclusion: The Power of Standing Still

To bridge the behavior gap, you must stop managing your portfolio and start managing your temperament. We recommend four Behavioral Guardrails to protect your future self:

1. Set Expectations Below Indices: Stop using broad market benchmarks as your yardstick. The "average" investor cannot be above average; judge your success based on your personal goals, not a ticker on CNBC.
2. Control Exposure to Risk: Incorporate portfolio protection to limit the psychological impact of market stress.
3. Monitor Risk Tolerance: Realize that tolerance is not stable. It changes when the "carnage" starts; reevaluate your ability to stomach volatility before the next bear market arrives.
4. Use Probability Forecasts: View market progress in terms of statistical ranges and probabilities rather than certainties. This creates a healthy sense of caution without triggering the urge to flee.

As John C. Bogle famously advocated: “Don’t do something, just stand there.”

If the history of the market shows positive returns in 78% of years, the ultimate question is this: Are you willing to gamble 100% of your retirement on the 22% of the time the market is in retreat?