Key Takeaways
- What it is: a benchmark is not a thing, it is a rule – a recipe that selects securities, assigns each a weight, and recalculates continuously. To understand an index, read its recipe, not its level.
- Selection: every index first defines its universe – minimum size, liquidity, listing, free float. What goes in and what comes out is anything but obvious: it is a choice, revised periodically.
- Weighting: the most common method weights each security by its market capitalization. Its rarely stated consequence: you hold more of a security the more it has already risen. Other methods – equal weight, fundamental weight – are different bets, not competing truths.
- The return trap: a "price" index ignores dividends; a "total return" index puts them back in. Over long horizons, the gap between the two is large – comparing a performance to a price index flatters it artificially.
- "Beating the market": before costs, the average active dollar can, by simple arithmetic, earn only the index return; after costs, it earns less. Outperforming an index often means taking a different risk – you just have to know it.
- Key reflex: before judging a performance "above the market," check three things – which index, built how, and net of which costs. The choice of benchmark is itself an active decision.
Introduction
"The market returned 8% this year." The sentence sounds factual. It is not: it depends entirely on what you call "the market" – that is, on the index chosen to represent it, on its composition, its weighting method, and how it treats dividends. Change the index, and the same "market" shows a different number.
Benchmarks are everywhere and yet rarely explained. They are quoted like neutral thermometers, when they are constructions – rules written by someone, with choices that carry consequences. Knowing how to read an index means telling the measure apart from the reality it claims to capture, and understanding why "beating the market" means very different things depending on the market you set yourself.
This article describes how an index is built – selection, weighting, rebalancing, treatment of dividends – then what "outperforming" really means once those mechanics are understood. The scope is structural and timeless: no levels, no dated performance. It complements our article on quantitative ratings, which was about picking securities; an index is, in its own way, a fixed rule for selecting and weighting them, against which every active manager measures up.
An Index Is a Rule, Not a Thing
The first idea to unlearn is the index-as-object. An index does not exist the way a security exists: it is an algorithm applied to a universe of securities. It has three families of rules – which securities to keep, what weight to give them, and when to revise those choices – and its published level is only the continuous output of that calculation.
This rule-like nature has an immediate implication: two indices meant to represent "the same market" can diverge sharply, simply because their rules differ. The relevant question is therefore never "where is the index?" but "what is its recipe, and what bets does that recipe contain without saying so?"
Selection: Who Enters the Universe
Every index begins by drawing the boundary of its universe. The criteria are explicit but far from trivial: minimum size (capitalization), sufficient liquidity (so the securities can actually be bought and sold), listing on a given exchange, and above all free float – the share of stock genuinely available to trade, as opposed to shares locked up by a controlling shareholder, the state, or a founder.
The free-float adjustment captures an index's hidden sophistication well: it is not enough for a company to be large, its shares must also circulate. Two companies of equal capitalization but very different float will weigh very differently in a well-built index. Additions and deletions, finally, are reviewed on fixed dates under published criteria – a process that, as we will see, carries a cost of its own.
Weighting: The Choice That Determines Everything
Once the universe is fixed, each security's weight must be decided. It is the most consequential decision, and the least understood.
| Weighting method | How the weight is set | The implicit bet |
| Market cap (free float) | proportional to tradable market value | holding more of what has already risen |
| Equal weight | the same weight for every member | a tilt toward the smaller members |
| Price weight | proportional to the share price | an artifact of the price level, with no economic meaning |
| Fundamental weight | by sales, equity, dividends | a tilt toward what is "cheap" on those measures |
Market-cap weighting dominates the index world, for good reasons – it reflects economic size, rebalances itself as prices move, and represents the collective portfolio of all investors. But it carries a rarely stated bias: the more a security rises, the larger its weight grows. The index therefore mechanically buys more and more of what is already expensive, and less and less of what is neglected. This is neither good nor bad; it is a choice, one that advocates of fundamental weighting – Robert Arnott and his coauthors in particular – have criticized by proposing to weight securities by their economic size rather than their price.
To keep a single giant from crushing the index, many constructions impose a weight cap per security. This capping rule is a diversification constraint written into the index recipe itself – an acknowledgment that pure cap weighting can concentrate risk beyond what is reasonable.
Rebalancing: An Index Is Managed Too
An index is not frozen: at regular intervals, it adds new securities, drops others, and readjusts weights. This process, invisible to the observer, is not free. When a security is announced as joining a widely followed index, the funds that replicate that index have to buy it – which tends to push its price up even before it formally enters. This phenomenon, long documented by research on the demand for stocks, is known as the "index effect": mere membership in an index influences the price, independently of any news about the company.
The lesson is twofold. First, replicating an index carries real, often underestimated transaction costs – a point our article on what investing really costs echoes. Second, an index is not a passive snapshot of the market: it is a portfolio actively maintained under rules, with its own turnover and its own frictions.
Price or Total Return: Do Not Compare the Incomparable
One technical distinction has enormous consequences over long horizons. A "price index" tracks only the securities' prices and ignores dividends. A "total return" index instead assumes each dividend is reinvested. Over decades, the difference between the two is large, because reinvested dividends compound.
The trap is classic: comparing a portfolio's performance – which did collect its dividends – to a price index that ignores them. The comparison flatters the portfolio artificially, since it is set against a benchmark stripped of part of its return. The rule is simple: compare a performance that includes reinvested dividends only to a total-return index, never to a price index. On the Swiss market, this distinction separates, for instance, a broad total-return index from a flagship price index – two equally legitimate ways to measure, but never to be confused.
What "Beating the Market" Means – and Does Not
Now to the question that justifies the very existence of indices: serving as a yardstick for active management. Here, a result as simple as it is relentless, stated by William Sharpe, holds. Since all investors together hold, collectively, the entire market, the return of the average dollar invested is, before costs, exactly that of the index. Active investors, taken together, can therefore beat the index only at the expense of other active investors: their average, before costs, equals the index. After costs, it is necessarily below it. This is not a fragile empirical observation: it is an accounting identity.
It does not follow that no manager can outperform – some do. It follows that outperformance is a zero-sum game before costs and a negative-sum one after, and that it must be judged rigorously. Three precautions apply.
- The right index. Outperformance means something only against a benchmark of the same universe and the same risk. Beating a global equity index with a portfolio concentrated on a single country that did well is not skill, it is a mismatch of reference.
- The real risk. Outperforming a cap-weighted index by tilting toward small caps or discounted securities often means capturing a known risk premium, not demonstrating selection talent. The question is always: does this edge come from a different exposure or from genuine skill?
- Fees and costs. A gross edge that vanishes once fees and transaction costs are subtracted is not an edge – it is a cost assumption, as our article on backtests points out.
In Practice
Three reflexes are enough to read any comparison to an index.
- Read the recipe before the level. For any index quoted, know its weighting, its free-float adjustment, its treatment of dividends, and its rebalancing frequency. Those four parameters determine what the index actually measures.
- Check that the benchmark is the right one. A benchmark must share the universe and the risk of what it is compared to. A poorly chosen yardstick makes "outperformance" meaningless.
- Remember that choosing your index is already an act of management. Deciding to measure yourself against the Swiss, global, or sector market is taking a position on what "the market" is for you – an active decision disguised as a neutral given.
Conclusion
A benchmark is not a neutral thermometer, it is a written rule: a particular way of selecting, weighting, and maintaining a basket of securities. Its choices – capitalization or fundamentals, price or total return, capped or not, revision frequency – determine what it measures, and therefore what "beating the market" means against it. The same performance can look brilliant or mediocre depending on the index it is set against.
Clear thinking means treating any index for what it is: a useful convention, not a truth. Understanding its construction lets you judge a manager at fair value – net of fees, adjusted for risk, compared to the right universe – and recognize that an investor's first active choice is not a security, but the yardstick against which they agree to be measured.
Sources
- Sharpe, W. F., "The Arithmetic of Active Management", Financial Analysts Journal, 1991
- Arnott, R. D., Hsu, J. and Moore, P., "Fundamental Indexation", Financial Analysts Journal, 2005
- Shleifer, A., "Do Demand Curves for Stocks Slope Down?", The Journal of Finance, 1986
- SIX Swiss Exchange, index methodology (selection rules, free float, weighting)
