Index Fund Investing: Low-Cost Diversification Explained

A $10 Trillion Idea Born from a Radical Simplicity

On August 31, 1976, the Vanguard Group launched the First Index Investment Trust — a mutual fund that simply held all 500 stocks in the S&P 500 index, in proportion to their market caps, and charged investors nothing for stock selection. Fidelity's Edward Johnson called it un-American. Merrill Lynch called it a sure path to mediocrity. By 2024, U.S. index funds held over $15 trillion in assets. The idea won.

How an Index Fund Is Constructed

An index fund does not pick stocks. It mechanically holds all securities in a benchmark index according to a set of construction rules. For a market-cap weighted index fund tracking the S&P 500, the process is systematic.

• The fund manager identifies all 500 companies in the S&P 500 (determined by S&P Dow Jones Indices, not the fund manager)
• Each company's weight in the portfolio equals its float-adjusted market cap divided by the total float-adjusted market cap of all 500 companies
• When investors buy or redeem shares, the fund buys or sells proportional slices of all holdings simultaneously
• When the index adds or removes a company (quarterly reconstitution), the fund trades accordingly

Total replication — holding every security in the index — works well for large, liquid indices like the S&P 500 or Russell 1000. For broader indices with thousands of constituents, funds may use sampling, holding a representative subset that closely tracks index returns while avoiding the cost of trading illiquid small positions.

Mutual Fund vs. ETF Structure

ETFs have a structural tax advantage through their creation and redemption mechanism. When large institutional investors (authorized participants) create or redeem ETF shares, they exchange baskets of securities in kind rather than cash. This sidesteps the need for the fund to sell holdings and trigger capital gains, meaning ETF holders typically receive fewer taxable distributions than mutual fund holders with the same underlying portfolio.

Expense Ratios: The Compounding Cost

An index fund's expense ratio is the annual fee deducted from assets, expressed as a percentage. The fee is not charged separately — it reduces the net asset value proportionally. On a $100,000 portfolio, the difference between a 0.03% expense ratio and a 0.50% expense ratio is $470 per year. That difference compounds over decades.

The competitive pressure among Vanguard, Fidelity, and Schwab has driven expense ratios to near zero for broad market index funds. Fidelity launched zero-expense-ratio index funds (FZROX, FZILX) in 2018, charging no annual fee at all.

Tracking Error and Tracking Difference

No index fund perfectly replicates its benchmark. Tracking difference is the gap between the fund's return and the index return over a given period. Tracking error is the standard deviation of the daily return differences — a measure of how consistently close the fund stays to its benchmark.

Sources of tracking difference include expense ratios (the primary drag), transaction costs when reconstituting the portfolio, securities lending income (which can actually help performance), cash drag from uninvested dividends between collection and reinvestment, and sampling error in funds that don't hold every index constituent.

• The Vanguard S&P 500 ETF (VOO) had a 5-year tracking difference of approximately -0.01% as of 2023 — meaning it actually outperformed its stated benchmark, largely from securities lending income
• Securities lending generates income when the fund lends out its holdings to short sellers in exchange for collateral and fees
• A fund with a 0.03% expense ratio that earns 0.04% from securities lending can net slightly better than index performance before any other factors

Major Index Families and Their Differences

Different index providers define their benchmarks differently. Three major families dominate the U.S. market.

• S&P Dow Jones Indices — S&P 500 (500 large U.S. companies, committee-selected), S&P 400 (mid-cap), S&P 600 (small-cap)
• Russell (FTSE Russell) — Russell 1000 (1,000 largest), Russell 2000 (next 2,000 by market cap), Russell 3000 (full market); rules-based, no committee
• CRSP (Center for Research in Security Prices) — used by Vanguard's total market funds; includes micro-cap stocks below Russell's threshold

Because S&P 500 membership requires a profitability screen (positive earnings in the most recent quarter), the index excludes some large companies. The Russell 1000 has no such screen. A company like Amazon was excluded from the S&P 500 for years due to losses before achieving consistent profitability.

Global Index Fund Investing

Index funds exist for virtually every market segment globally. The MSCI ACWI (All Country World Index) covers approximately 3,000 companies across 47 countries and is the most comprehensive global equity benchmark. Vanguard's Total World Stock ETF (VT) tracks this index at an expense ratio of 0.07%, providing single-fund exposure to developed and emerging market equities worldwide.

This article is for informational purposes only and does not constitute financial advice.