How Can a Family Office Tell Whether Returns Came From Skill or Market Conditions?
Short answer. Compare fund results with suitable market benchmarks and peers, accounting for the risks taken over the same periods. Examine investment-level decisions and attribution to identify what drove gains and losses. Ask how the strategy performed as conditions changed, and test whether its stated value creation process explains the outcomes.
To judge whether returns came from skill or market conditions, trace gains and losses to specific exposures and decisions. A strong result alone does not show that a manager added value. Ask for evidence of what the team controlled and what the market supplied.
Set a Fair Comparison
Choose benchmarks and peers that match the strategy's asset class, region, liquidity needs, and risk profile. Ask the manager why each comparison fits and whether the fund's exposures changed during the period. A broad index can mislead when the fund held different assets or took risks the index does not capture.
Compare results across rising and falling markets, and examine volatility and drawdowns alongside returns. Where records allow, separate broad market exposure and sector allocation from security selection and timing. Account for borrowing effects as well. The goal is to learn which parts of the result market movement can explain. No benchmark will capture every difference.
Connect Returns to Decisions
Request investment-level attribution covering winners and losers. For each material position, ask for the original thesis, expected source of value, decision points during ownership, and result against the original plan. If a gain is attributed to operating improvements, look for evidence in revenue, costs, or cash flow. If it came from a favorable market, identify the exposure that benefited.
Separate realized gains from unrealized marks. Ask how much of the reported outcome depends on a few holdings, and whether a sale or distribution supports the reported result. For records supporting performance claims, see how to verify a reported track record. For the valuation methods behind unsold holdings, see valuation methods for illiquid assets.
Test the Value Creation Story
Map the mechanism the manager says created value. It might be operating improvements, revenue growth, a development spread, or financing. Test the mechanism against the evidence. Who pays, what drives demand, which costs can the team control, and what assumptions must hold for investors to recover capital? A plausible story should connect specific actions to observable results.
Ask what measurable event would disprove the thesis. A manager who cannot name a failure condition may be explaining outcomes after the fact. Consider whether risks appeared in the original analysis and whether the team responded when conditions moved against the position. Distinguish an explanation documented at the time from one created after a gain or loss.
Questions to Put to the Manager
- "Which benchmark best reflects the risks we actually took, and why?"
- "What share of results came from market exposure, and what came from decisions made by the team?"
- "Which investment most clearly demonstrates the stated value creation process, and what records support that account?"
- "What observable result would have shown that the thesis was wrong?"
- "How would the result look without the largest winning position or the favorable market exposure?"
Write down the explanation, supporting evidence, and remaining uncertainty. Skill is difficult to isolate, so assess whether the account fits the holdings and decisions across different conditions. For a related look at whether the approach can be repeated, see questions about the manager's investment process.
Checklist
- Select benchmarks that fit the fund's actual exposures.
- Review gains and losses at the investment level.
- Separate realized results from unrealized marks.
- Trace claimed operating value to operating evidence.
- Record market effects, decision effects, and unresolved assumptions.
Go deeper: How should a family office evaluate a fund's use of borrowing?; How should past performance be adjusted for changes in a manager's team or strategy?.
Anyone can put 30 % IRR on a piece of paper.
Sources: Family Office Club investor due diligence framework, Richard C. Wilson solo transcripts. Informational only, not financial, legal or tax advice.
