How Index Investing Was Born
Index investing, the practice of buying a fund that passively tracks a market benchmark rather than trying to beat it, is the dominant force in equity markets today. More money now sits in passively managed U.S. equity funds than in actively managed ones. The idea that investors should simply own the market, accept average returns, and minimize costs was once considered absurd. The story of how it went from an academic theory mocked on Wall Street to the most popular investment strategy in the world is one of the most consequential developments in financial history.
The Academic Foundation
The intellectual case for index investing was built in stages by economists and financial theorists working at major universities in the 1950s and 1960s. None of them set out to create a product. They were testing a hypothesis about how markets process information.
Harry Markowitz published "Portfolio Selection" in the Journal of Finance in 1952. His paper demonstrated mathematically that investors could reduce risk without sacrificing expected return by holding diversified portfolios. The key insight was that the risk of a portfolio depended not just on the risk of its individual holdings but on the correlations between them. Markowitz's work established modern portfolio theory and earned him the Nobel Prize in Economics in 1990.
William Sharpe, a student of Markowitz, extended this work with the Capital Asset Pricing Model (CAPM) in 1964. CAPM implied that the "market portfolio," a portfolio containing all available assets weighted by their market value, was the theoretically optimal risky portfolio. Every investor, according to the model, should hold the same market portfolio, adjusting only the split between that portfolio and risk-free assets based on their tolerance for risk.
Eugene Fama's efficient market hypothesis, published in its definitive form in 1970, provided the theoretical explanation for why the market portfolio was hard to beat. If stock prices reflected all available information, then trying to identify mispriced securities was a waste of time and money. Active managers who charged fees for stock selection were, on average, providing negative value after costs.
The empirical evidence supported this conclusion. Studies consistently showed that the majority of actively managed funds underperformed their benchmarks over extended periods. Michael Jensen's 1968 study of mutual fund performance found that, on average, funds did not earn enough excess return to justify their expenses. This finding has been replicated in dozens of subsequent studies across different time periods and markets.
The First Attempts
The gap between academic theory and a practical investment product was bridged in the early 1970s. Several groups independently attempted to create funds that would track a stock market index.
Wells Fargo Bank's management science group, led by John McQuown and influenced by academic consultants including William Sharpe and Fischer Black, created the first index fund in 1971. It was an equal-weighted portfolio tracking the stocks on the NYSE, designed for the Samsonite Corporation's pension fund. The equal-weighted approach proved operationally difficult, requiring constant rebalancing, and was eventually converted to a capitalization-weighted S&P 500 index fund in 1976.
American National Bank of Chicago (later merged into Northern Trust) launched its own index fund for institutional clients in 1973. Batterymarch Financial Management, a Boston firm, also developed an index strategy in the early 1970s, though it struggled to attract clients initially.
These early index funds were available only to institutional investors, primarily pension funds and endowments. They demonstrated that the concept worked in practice, but they had limited impact on the broader investment industry. The transformation of index investing from an institutional strategy to a mass-market product required a different kind of entrepreneur.
Jack Bogle and Vanguard
John Clifton Bogle, known universally as Jack, was the person most responsible for bringing index investing to individual investors. His path to creating the first retail index fund was shaped by academic conviction, personal experience, and a confrontation with the mutual fund industry's business model.
Bogle's Princeton senior thesis, written in 1951, analyzed the mutual fund industry and concluded that most funds did not outperform market averages. He joined Wellington Management Company after graduation and eventually became its CEO. In 1974, he was fired from Wellington after a merger he had championed turned into a disaster. The experience left him bitter about the fund industry's governance and its tendency to prioritize the interests of management companies over those of fund shareholders.
Bogle founded the Vanguard Group in 1974 with a structure unlike any other fund company. Vanguard was owned by its own funds, which were in turn owned by their shareholders. This mutual ownership structure meant that Vanguard operated at cost, with no outside shareholders demanding profits. Fees could be as low as operationally possible.
On August 31, 1976, Vanguard launched the First Index Investment Trust, which tracked the S&P 500. The initial public offering raised $11.3 million, well short of the $150 million target. Wall Street was derisive. Fidelity's chairman Edward Johnson said he could not "believe that the great mass of investors are going to be satisfied with just receiving average returns." An advertisement from another fund company called it "un-American." The fund was nicknamed "Bogle's Folly."
The early years were difficult. The fund was small, illiquid, and attracted minimal interest from financial advisers who had no incentive to recommend a low-cost product that paid them no commissions. Bogle persisted, continuing to make the case that most active managers failed to beat the index after fees and that the mathematical certainty of low costs outweighed the uncertain possibility of outperformance.
The Slow Build
Index investing grew slowly through the late 1970s and 1980s. The fund's assets increased but remained a tiny fraction of the overall mutual fund industry. Several factors gradually worked in its favor.
First, the data kept confirming Bogle's thesis. Each year, the majority of actively managed large-cap funds underperformed the S&P 500. The S&P's own SPIVA (S&P Indices Versus Active) scorecard, first published in 2002, would eventually show that over any 15-year period, roughly 85-90% of large-cap active managers failed to beat the S&P 500 after fees. The longer the time period, the worse active management looked.
Second, the 401(k) retirement plan, created by the Revenue Act of 1978, began to transform how Americans saved for retirement. Employer-sponsored defined-contribution plans grew rapidly in the 1980s and 1990s, replacing traditional defined-benefit pensions. These plans offered workers a menu of investment options, and index funds gradually gained inclusion on those menus. For plan sponsors, including a low-cost index fund reduced their legal liability. For participants, the index option was often the cheapest and simplest choice.
Third, Vanguard's mutual ownership structure and low costs created a compounding advantage. A fund charging 0.05% per year leaves the investor with significantly more money over decades than a fund charging 1.0%. On a $100,000 investment earning 10% annually, the difference in fees amounts to more than $300,000 over 30 years. As this math became more widely understood, investors increasingly voted with their feet.
The ETF Revolution
The introduction of exchange-traded funds (ETFs) in the 1990s accelerated the growth of passive investing. The first ETF, the SPDR S&P 500 ETF Trust (ticker: SPY), launched in January 1993. It tracked the same S&P 500 index as Bogle's fund but traded on an exchange like a stock, allowing investors to buy and sell throughout the day at market prices.
ETFs offered several advantages over traditional index mutual funds: intraday liquidity, tax efficiency through the in-kind creation and redemption mechanism, and accessibility through any brokerage account. They also attracted new categories of users, including institutional traders, hedge funds, and financial advisers building diversified portfolios.
Barclays Global Investors (later acquired by BlackRock) launched the iShares family of ETFs in 2000, covering U.S. and international equity indices, bond indices, and sector-specific indices. The proliferation of ETFs extended index investing far beyond the S&P 500. Investors could passively track virtually any segment of the market: small-cap value, emerging markets, real estate investment trusts, corporate bonds, commodities.
BlackRock's iShares, Vanguard's ETF lineup, and State Street's SPDR products became the three dominant families. BlackRock's total assets under management grew to over $10 trillion by the mid-2020s, making it the largest asset manager in the world, largely on the strength of its iShares ETF business.
International Adoption
The index fund concept spread beyond the United States, though with varying speed. In the United Kingdom, index trackers grew through the 1990s and 2000s, helped by the Individual Savings Account (ISA) framework that encouraged retail investment. European investors adopted ETFs enthusiastically after the iShares family launched locally listed products on exchanges in London, Frankfurt, and Amsterdam.
In Japan, the Government Pension Investment Fund (GPIF), the world's largest pension fund with over $1.5 trillion in assets, shifted a significant portion of its equity allocation to passive strategies in 2014. This single decision moved tens of billions of dollars from active to passive management.
Emerging market index products allowed investors worldwide to gain exposure to developing economies without the difficulty and cost of direct investment in local markets. The MSCI Emerging Markets Index, tracked by multiple ETFs, became the primary benchmark for investors seeking exposure to China, India, Brazil, South Korea, and other developing economies.
The international growth of indexing reinforced the domestic trend. Global index fund and ETF assets grew from roughly $5 trillion in 2010 to over $15 trillion by the mid-2020s, spanning equity, fixed income, and commodity strategies across every major market.
The Tipping Point
The shift from active to passive management accelerated dramatically after the 2008 financial crisis. The crisis exposed the failure of many active managers to protect investors during the downturn. It also highlighted the role of fees in eroding long-term returns. Investors pulled hundreds of billions of dollars from actively managed equity funds and redirected the money into index funds and ETFs.
In 2019, a milestone arrived: passively managed U.S. equity funds surpassed actively managed funds in total assets for the first time. By the mid-2020s, passive funds hold approximately 55-60% of U.S. equity fund assets. The top three index fund providers (BlackRock, Vanguard, and State Street) collectively own 20-25% of the shares of most large U.S. companies.
Vanguard, the firm Wall Street laughed at in 1976, grew to manage more than $9 trillion in assets. Its Total Stock Market Index Fund and S&P 500 Index Fund are among the largest investment funds in the world. Jack Bogle, who died in January 2019 at the age of 89, lived to see his idea vindicated on a scale he could not have imagined when he raised $11.3 million for the First Index Investment Trust.
The Debate That Continues
The dominance of index investing has raised new questions. If passive funds own an ever-larger share of the market, who is performing the price discovery that makes markets efficient in the first place? Active managers argue that they play an indispensable role in identifying mispriced securities and that a market composed entirely of passive investors would be prone to mispricings and bubbles.
Others worry about the concentration of ownership. When three firms collectively hold a quarter of the shares in most S&P 500 companies, the implications for corporate governance, competition, and market structure are significant. Legal scholars have debated whether common ownership by index funds might reduce competition among companies in the same industry, as the funds' incentive is for the industry to be profitable overall rather than for individual firms to compete aggressively.
These are real questions, but they have not slowed the movement of capital from active to passive strategies. The mathematics of costs, the empirical record of active underperformance, and the simplicity of the index approach continue to drive the trend. The birth of index investing may have been quiet and mocked, but its consequences for the structure of global financial markets have been profound.
Put these principles into practice. Track fundamentals, build portfolios, and analyze stocks with AI-powered insights.
Start Free on GridOasis →