Benchmarks: Measuring Performance Against Something Real

What this means

Someone tells you their investments returned 9 percent last year. You cannot evaluate that. If comparable investments returned 4 percent, it is impressive. If they returned 18 percent, it is a disaster wearing a positive number. A raw return is an uninterpretable fact until it is placed against something.

A benchmarkA standard of comparison, usually a market index, used to judge whether an investment's performance is good relative to its market. supplies that something. It is normally an indexA measurement of a defined group of securities, used to represent the performance of a market or market segment., meaning a rule-based basket of securities that represents a market or a slice of one. The comparison separates two things that look identical in a single number: how the market moved, and what the investor's decisions contributed on top of that.

The indices are not interchangeable, and their construction determines what they measure. The S&P 500 IndexAn index of 500 large U.S. companies, weighted so that larger companies have more influence on the index. tracks 500 large U.S. companies and is market-capitalization weightedAn index construction method where each company's influence is proportional to its total market value., so the biggest companies move it most. It is not literally the 500 largest companies; a committee selects members against criteria. The Dow Jones Industrial Average holds only 30 companies and is price weighted, an unusual method that gives a high-priced share more influence than a larger company with a lower share price, which is why professionals rarely use it as a serious benchmark despite its fame. The Nasdaq Composite includes thousands of companies listed on one exchange and leans heavily toward technology. The Russell 2000 covers small companies. Total-market indices attempt to capture nearly all investable U.S. stocks. International indices cover developed or emerging markets abroad. Broad bond indices track large portions of the U.S. investment-grade bond market.

The rule that follows is the one students most often break: a benchmark is only meaningful if it matches what the portfolio actually holds. Judging a portfolio that is half bonds against a pure large-company stock index tells you almost nothing about the manager, because you have measured an allocation difference and called it performance. A small-company fund compared to a large-company index is measured against the wrong market entirely.

Why it matters

Benchmarking is what makes the case for index investing legible, and that case rests on arithmetic before it rests on evidence. Before costs, the average dollar in a market must earn the market's return, because all the dollars together are the market. After costs, the average actively managed dollar must therefore trail the market by roughly the amount it paid in fees, trading costs, and taxes. This is not a claim about whether managers are talented. It is subtraction.

The empirical record has been consistent with that arithmetic. Regularly published studies comparing actively managed funds to appropriate benchmarks have found that a majority underperform over long horizons, and that the share underperforming rises as the period lengthens. Some managers do beat their benchmarks. The difficulty is that identifying them in advance is a different and much harder problem than identifying them afterward, and strong past performance has proven to be a weak predictor of future performance.

An exchange-traded fundA pooled investment fund that trades on an exchange throughout the day, often built to track an index. tracking a broad index therefore offers a specific bundle: instant diversification across hundreds or thousands of securities, typically very low ongoing costs, intraday tradability, generally high tax efficiency in taxable accounts, and full transparency about holdings. What it does not offer is any protection from market declines. When the index falls, the fund falls, and nothing about indexing guarantees a positive return.

It is worth naming the trade-offs honestly, because index funds are now marketed as aggressively as anything else. Index investing accepts the market return and gives up the possibility of beating it. Cap-weighted indices concentrate more in whatever has already grown largest, which is a real characteristic and not a neutral one. Intraday tradability is a convenience that can also encourage exactly the frequent trading that hurts outcomes. And not everything labeled an ETF is a broad low-cost index fund; the wrapper accommodates narrow, expensive, and leveraged products too.

Try it

1. Research index composition. For the S&P 500, the Dow Jones Industrial Average, the Nasdaq Composite, the Russell 2000, a total U.S. stock market index, a broad international index, and a broad U.S. bond index, record for each: how many securities it holds, what kind, how members are selected, and how they are weighted.
2. Identify what each one cannot tell you. For each index above, write one sentence naming a part of the market it excludes.
3. Examine weighting. Find the approximate combined share of the S&P 500 represented by its ten largest holdings on the day you look, and record the date. Then explain what that concentration means for someone who believed they were buying 500 equally important companies.
4. Compare recent performance. Using a reputable data source, gather returns for those indices over the most recent one-year, five-year, and ten-year periods available. Record the source and the date you retrieved them, and note that these are historical figures that will change and do not predict anything.
5. Explain the dispersion. The indices will not have performed alike. Write a paragraph explaining the differences using composition, not narrative. Point to company size, sector concentration, geography, and asset class rather than to a story about the year.
6. Practice benchmark matching. Assign the appropriate benchmark to each portfolio: 100 percent large U.S. company stocks; 60 percent U.S. stocks and 40 percent U.S. bonds; a small-company U.S. fund; a fund of European stocks; a portfolio of individual technology companies. Then explain what goes wrong if each is measured against the S&P 500 instead.
7. Do the cost arithmetic. Take a hypothetical starting balance and a hypothetical constant annual return of your choosing. Calculate the ending balance over 30 years with an annual fee of 0.05 percent and with an annual fee of 1.00 percent. Report the difference as a share of the ending balance. Label clearly that the return assumption is invented for the exercise and that real returns vary.
8. Build the balanced argument. List the advantages of a broad index ETF over active management and individual securities, then list the genuine disadvantages and the cases where an index fund is the wrong tool. A one-sided answer is an incomplete answer.
9. Constraint: name no fund, ticker, or company anywhere in your written work. Describe index types, fund structures, and cost levels only, and treat every number you record as accurate on the day you looked and not thereafter.

Check yourself