lionel martellini risk and asset management research center, edhec graduate school of business

44
Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business [email protected] Conférence Gestion Alternative 2 Avril 2004 The Alpha and Omega of Hedge Fund Performance Evaluation Joint work with Noël Amenc (EDHEC) and Susan Curtis (USC)

Upload: jack

Post on 13-Jan-2016

47 views

Category:

Documents


3 download

DESCRIPTION

Conférence Gestion Alternative 2 Avril 2004. The Alpha and Omega of Hedge Fund Performance Evaluation Joint work with Noël Amenc (EDHEC) and Susan Curtis (USC). Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business [email protected]. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Lionel Martellini

Risk and Asset Management Research Center, EDHEC Graduate School of Business

[email protected]

Conférence Gestion Alternative2 Avril 2004

The Alpha and Omega of Hedge Fund Performance Evaluation

Joint work with Noël Amenc (EDHEC) and Susan Curtis (USC)

Page 2: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Outline

• Introduction• Standard CAPM Model• Adjusting CAPM for the Presence of Stale Prices• Payoff Distribution Model• Multi-Factor Models • Implicit Factor Model• Explicit Factor Model• Explicit Index Model• Peer Benchmarking• Comparative Performance Analysis• Impact on Attributes on Funds’ Performance• Conclusion

Page 3: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

IntroductionPapers on MF and HF Performance

• There is ample evidence that portfolio managers following traditional active strategies on average under-perform passive investment strategies

– Examples are: Jensen (1968), Sharpe (1966), Treynor (1966), Grinblatt and Titman (1992), Hendricks, Patel and Zeckhauser (1993), Elton, Gruber, Das and Hlavka (1993), Brown and Goeztman (1995), Malkiel (1995), Elton, Gruber and Blake (1996), or Carhart (1997), among many others

• Recently, many papers have focused on hedge fund performance evaluation

– Examples are: Ackermann, McEnally, and Ravenscraft (1999), Amin and Kat (2001), Agarwal and Naik (2000a, 2000b), Brown, Goetzmann and Ibbotson (1999), Edwards and Caglayan (2001), Fung and Hsieh (1997, 2001a, 2001b), Gatev, Goetzmann and Rouwenhorst (1999), Liang (2000), Lhabitant (2001), Lo (2001), Mitchell and Pulvino (2001), Schneeweis and Spurgin (1999, 2000)

Page 4: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

• Because these studies are based on a variety of models for risk-adjustment, and also differ in terms of data used and time period under consideration, they yield very contrasted results

• The present paper can be viewed as an attempt to provide an unified picture of hedge fund managers to generate superior performance

• To alleviate the concern of model risk on the results of performance measurement, we consider an almost exhaustive set of pricing models that can be used for assessing the risk-adjusted performance of hedge fund managers.

IntroductionModels

Page 5: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

• While we find significantly positive alphas for a sub-set of hedge funds across all possible models, our main finding is perhaps that the dispersion of alphas across models is very large

– Hedge funds appear to have significantly positive alphas on average when normal returns are measured by an explicit factor model, even when multiple factors serving as proxies for credit or liquidity risks are accounted for

– However, hedge funds on average do not have significantly positive alphas once the entire distribution is considered or implicit factors are included

• On the other hand, all pairs of models have probabilities of agreement greater than .50

– In other words, while different models strongly disagree on the absolute risk-adjusted performance of hedge funds, they largely agree on their relative performance in the sense that they tend to rank order the funds in the same way

IntroductionPreview of the Results

Page 6: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

• Our analysis is conducted on a proprietary data base of 1,500 individual hedge fund managers (MAR-CISDM data base)

• We use the 581 hedge funds in the MAR database that have performance data as early as January 1996

• The data base contains monthly returns and also– Fund size (asset under management)– Fund type (MAR classification system)– Fund age (defined as the length of time in operation prior to the beginning of our

study)– Location (US versus non US)– Incentive fees– Management fees– Minimum purchase amount

IntroductionData

Page 7: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Standard CAPM ModelNormal and Abnormal Returns

• Factor models allow us to decompose managers’ (excess) returns into

– Normal returns (risk premium)– Abnormal returns (investment opportunity)– Statistical noise (illusion)

• Normal returns are generated as a fair reward for the risk(s) taken by fund managers

• Abnormal returns are generated managers’ unique ability to “beat the market” in a risk-adjusted sense, generated through superior access to information or better ability to process commonly available information

• Need some model to understand what a “normal” return is; benchmark model is the CAPM (Sharpe (1964))

Page 8: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Standard CAPM Model Results

• The average alpha across all funds is significantly positive• The majority of hedge funds have positive alphas, and

about a third are statistically significant• Very few funds have significantly negative alphas

Statistic Value under CAPM

Alpha (average fund) 5.83%

Std. Err. Alpha (average fund) 2.85%

p-value (for average alpha not 0) 0.045

St.Dev. Alpha (across funds) 10.02%

% of funds with alpha significantly 0 31.3%

% of funds with alpha significantly 0 0.7%

Page 9: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Standard CAPM Model Distribution of CAPM Alphas

Distribution of CAPM Alphas

0%

2%

4%

6%

8%

10%

12%

14%

16%

-15 -13 -11 -9 -7 -5 -3 -1 1 3 5 7 9 11 13 15 17 19 21 23 25

Alpha Value (annual %, midpoint of bin)

Percentof

Funds

Page 10: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Standard CAPM Model Distribution of CAPM Betas

Distribution of CAPM Betas

0%

5%

10%

15%

20%

25%

-1 -0.8 -0.6 -0.4 -0.2 0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2

Beta Value (midpoint of range)

Percentof

Funds

Page 11: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Adjusting CAPM for Stale Prices The Presence of Stale Prices

• It has been documented (Asness, Krail and Liew (2001)) that a fair number of hedge funds hold illiquid securities

• For monthly reporting purposes, they typically price these securities using either the last available traded price or estimates of current market prices

• Such non-synchronous return data can lead to understated estimates of actual market exposure, and therefore to mismeasurement of hedge fund risk-adjusted performance

• In that context, some adjustment must be performed to account for the presence of stale prices

Page 12: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Adjusting CAPM for Stale Prices Model and Results

• Model: run regressions of returns on both contemporaneous and lagged market returns

• Results: the number of funds with alpha values significantly greater than zero has been cut in half

r i,t r f,t i k 0

K

ikrM,t k r f,t k i,t

Statistic Value under CAPM Value under Lagged CAPM

Alpha (average fund) 5.83% 2.14%

Std. Err. Alpha (average fund) 2.85% 3.21%

p-value (average fund alpha not 0) 0.045 0.51

% of funds with alpha significantly 0 31.3% 16.9%

% of funds with alpha significantly 0 0.7% 2.8%

Page 13: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Adjusting CAPM for Stale Prices Model and Results

• CAPM has more funds with alphas near 10%, and lagged CAPM model has more funds with alphas between -10% and 0

Comparison of Alphas under CAPM and Lagged CAPM

0%

2%

4%

6%

8%

10%

12%

14%

16%

-23 -21 -19 -17 -15 -13 -11 -9 -7 -5 -3 -1 1 3 5 7 9 11 13 15 17 19 21 23

Alpha Values (bin midpoints)

Percentof

Funds

CAPM

Lagged CAPM

Page 14: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Payoff Distribution Function ApproachNon-Linear Exposure to Standard Asset Classes

• Hedge fund returns exhibit non-linear option-like exposures to standard asset classes because

– They can use derivatives– They follow dynamic trading strategies

• Furthermore, the explicit sharing of the upside profits under the form of incentive fees implies that post-fee returns have option-like element even if pre-fee returns do not

• In this context, mean-variance CAPM based performance measures will fail to account for non trivial preferences about skewness and kurtosis

• There exists a method allowing an investor to account for the whole distribution of returns

Page 15: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Payoff Distribution Function ApproachMethodology

• Methodology introduced by Dybvig (see Dybvig (1988a, 1988b)), applied to hedge fund performance evaluation by Amin and Kat (2001)

• First step: recover the cumulative probability distribution of the monthly hedge fund payoffs as well as the S&P 500 from the available data set assuming $100 are invested at the beginning of the period

– A normal distribution is assumed for the S&P 500 (i.e., we only need to estimate the mean and standard deviation of the monthly return on the S&P 500 over the period), but not for the hedge funds

• Second step: generate payoff functions for each hedge fund

– A payoff function is a function f that maps the return distribution of the S&P 500 into a relevant return distribution for the hedge fund

Page 16: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Payoff Distribution Function Approach Methodology (con’t)

• Third step: we use a discrete version of a geometric Brownian motion as a model for the underlying S&P price process generate 20,000 end-of-month value

– From these 20,000 values, we generate 20,000 corresponding payoffs for each hedge fund, average them, and discount them back to the present to obtain a fair price for the payoff

– This “price” thus obtained can be thought of the minimum initial amount that needs to be invested in a dynamic strategy involving the S&P and cash to generate the hedge fund payoff function

– If the price thus obtained is higher than 100, this means that more than $100 needs to be invested in S\&P to generate a random terminal payoff comparable to the one obtained from investing a mere $100 in the hedge fund. We therefore take this as evidence of superior performance.

– On the other hand, if the price obtained is lower than $100, we conclude that one may achieve a payoff comparable to that of the hedge fund for a lower initial amount.

– The percentage difference is computed as a relative measure of efficiency loss

Page 17: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Payoff Distribution Function Approach Cumulative Probability Distributions

• The slope for the average hedge fund is much steeper than for the S&P 500, indicating a much narrow distribution of returns

Comparison of Hedge Funds with S&P 500 (Real Data)

0.0

0.2

0.4

0.6

0.8

1.0

85 90 95 100 105 110 115 120

Final Fund Value (Initial=100)

CumulativeProbability

Distribution

S&P

Average Fund

Page 18: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Payoff Distribution Function Approach Performance of High- and Low-Rated Funds

• The low-rated fund has a wide distribution of returns• Top rated funds were found to be of two types: high volatility funds with

exceptionally high returns, and low volatility funds

Comparison of Hedge Funds with S&P 500 (Real Data)

0.0

0.2

0.4

0.6

0.8

1.0

85 90 95 100 105 110 115 120

Final Fund Value (Initial=100)

CumulativeProbabilityDistribution

S&P

Top High Risk Fund

Top Low Risk Fund

Worst Fund

Page 19: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Payoff Distribution Function Approach Distribution of Efficiency Gain or Loss

Distribution of Hedge Fund Efficiency

0%

10%

20%

30%

40%

50%

60%

< -3% -3 to -2% -2 to -1% -1 to 0% 0 to 1% 1 to 2% 2 to 3% > 3%

Efficiency Gain or Loss

Percentof

HedgeFunds

Page 20: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Payoff Distribution Function Approach Performance of Hedge Funds

• On average, hedge funds do not outperform the market• However, the statistics are influenced by a few funds with large negative

efficiencies. Over half of the funds have positive efficiency measures

• Note that in the implementation of PDPM, we must make an assumption about the volatility of the S&P 500

• Here, we used a16% volatility as measured during the time period of the data• When we repeated the analysis with a higher volatility of 20%, the average

hedge fund has a slightly higher efficiency and is no longer significantly different from zero

PDPM

Mean Efficiency (annual rate) -0.92%

St.Dev. Efficiency 10.66%

% of funds with efficiency 0 58%

Page 21: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Multi-Factor ModelsOther Sources of Risk

• Hedge funds are typically exposed to a variety of risk sources including volatility risks, credit or default risks, liquidity risks, etc., on top of standard market risks

• If one uses CAPM while the “true” model is a multi-factor model, then estimated alpha will be higher than true alpha

• Modern portfolio theory and practice is based upon multi-factor models (Merton (1973), Ross (1976))

• The return on asset or find i is Rit = i + i1F1t + ... + iKFKt + eit

– Fkt is factor k at date t (k = 1,…,K)

– eit is the asset specific return

– ik measures the sensitivity of Ri to factor k, (k = 1,…,K)

Page 22: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Multi-Factor Models Four Types of Factor Models

• Implicit factor models – Factors: principal components, i.e., uncorrelated linear combinations of

asset returns

• Explicit factor models – macro factors– Factors (Chen, Roll, Ross (1986)): inflation rate, growth in industrial

production, spread long-short treasuries, spread high-low grade corporate interest rate

• Explicit factor models – micro “factors”– Factors (actually attributes): size, country, industry, etc.

• Explicit factor model – index “factors”– Factors are stock and bond market indices

Page 23: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Implicit Factor Model The Model

• Use principal component analysis to extract statistical factors (linear combinations of returns)

• Challenge is determine the optimal # of factors (K’) – Select K’ by applying results from the theory of random matrices

– Compare the properties of an empirical covariance matrix to a null hypothesis purely random matrix

– Distribution function for eigenvalues under the null hypothesis

– Here, we regard as statistical noise all factors associated with an eigenvalue lower than lambda min

T

N

T

N

T

N

T

N

N

Tf

21

21

2

min

max

minmax

Page 24: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Implicit Factor Model The Results

• The mean alpha is less than zero under this model• This suggests that there are factors influencing

hedge fund performance that are captured in the Implicit Factor Model but not captured in CAPM

Statistic Value under Implicit Factor Model

Mean Alpha (annual rate) -1.04%

Std. Dev. Alpha 12.59%

p-value (for mean alpha not 0) 0.047

% of funds with alpha 0 44%

Page 25: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Explicit Factor Model The Model

• We test an explicit macro factor model where we use financial variables to proxy deeper economic effects

• The following factors are used– US equity risk is proxied by the return on the S\&P 500 index, and world equity risk is

proxied by the return on the MSCI World Index ex US

– Equity volatility risk, proxied by using the changes in the average of intra-month values of the VIX

– Fixed-income level risk is proxied by the 3 months T-Bill rate

– Slope risk or term premium risk is proxied by monthly differences between the yield on 3 months Treasuries and 10-year Treasuries

– Currency risk is proxied by changes in the level of an exchange volume-weighted index of currencies versus US dollar

– Commodity risk is proxied by changes in the level of a volume-weighted index of commodity prices

– Credit risk is proxied by changes in the monthly observations of the difference between the yield on long term Baa bonds and the yield on long term AAA bonds

– Liquidity risk is proxied by changes in the monthly market volume on then NYSE

Page 26: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Explicit Factor Model The Results

• Some of the above variables do not appear to command a premium

• The following variables seems to be rewarded risk factors: S&P 500, MSCI ex-US, oil price return, change in credit spread, change in VIX

• This is the 5-factor model that we use

Statistic Value under 5-Factor Macro Model

Alpha (average fund) 7.25%

Std. Err. Alpha (average fund) 2.35%

p-value (for average alpha not 0) 0.01

Std .Dev. Alpha (across funds) 9.81%

% of funds with alpha significantly 0 39%

% of funds with alpha significantly 0 1%

Page 27: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Explicit Factor Model The Analysis

• The average alpha is higher than under the CAPM• This is primarily due to the inclusion of the MSCI ex-

US index– Many of the funds in our database are global funds, with a higher beta on

the MSCI index than on the S&P 500. – Since the MSCI index underperformed the S&P 500 during this time period,

the inclusion of the MSCI factor makes the alpha values higher for these funds

– Thus, in fact, these funds are outperforming the world index but are underrated in the CAPM\ model since their performance is compared to the S&P 500

– The inclusion of other factors (oil prices, change in credit spread, change in VIX) tends to lower the alphas (compared to a 2-variable model using S&P500 and MSCI only), but does not erase the gains made by including the MSCI

– Thus, we conclude that when all of these significant factors are included, the average hedge fund still has a positive alpha

Page 28: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

• Style analysis– Sharpe (1992): equity styles are as important as asset classes– Examples: growth/value, small cap/large cap, etc.

• Model: Rit = i1F1t + i2F2t + ... ikFkt + eit – Rit = (net of fees) excess return on a given portfolio or fund

– Fkt = excess return on index j for the period t– wik = style weight (add up to one)

– eit = error term

• Divide the fund return into two parts– Style: i1F1t + i2F2t + ... ikFkt (part attributable to market movements)

– “Skill”: eit (part unique to the manager), emanates from 3 sources• manager’s exposure to other asset classes not included in the analysis• manager’s active bets: active picking within classes and/or class timing• statistical error: if zero, Var(eit) can be regarded as selection return risk

Explicit Multi-Index Model Return-Based Style Analysis

Page 29: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Explicit Multi-Index Model Style Analysis and Performance Evaluation

• Step 1: select a set of indices to perform return-based style analysis

– CSFB/Tremont indices or (preferably!) EDHEC indices

• Step 2: perform style analysis of fund returns– Constrained regression

• Step 3: form peer groups – Use cluster analysis on style exposure

• Step 4: perform a risk-adjusted analysis of each fund’s performance

– Unconstrained regression

Page 30: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Explicit Multi-Index Model Performance Results

• We measure the excess return of hedge funds using the primary indexes appropriate to each cluster as factors in the model (average weight > 10%)

• The mean hedge fund has alpha not significantly different from zero

• These results suggest that the CSFB indexes effectively capture risk factors that are not captured by the standard CAPM, and that fund managers with positive CAPM alphas are often not outperforming hedge fund indexes

Statistic Value under Multi-Index Model

Mean Alpha (annual rate) 0.79%

Std. Dev. Alpha 16.27%

p-value (for mean alpha not 0) 0.24

% of funds with alpha 0 57%

Page 31: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Peer Benchmarking Cluster-Based Index

• Next, we regress hedge fund excess returns on the excess return of the equally-weighted portfolio of all hedge funds within a cluster

• This is formally similar to Sharpe's (1963) single-index model except that perform a relevant peer benchmarking

• Cluster-index model has average alpha very close to zero– This should not be surprising since the same funds are used in the computation

of the index as are used for computation of alpha

– Useful to spot the best performing funds in a peer group

Statistic Value under Cluster-Index

Mean Alpha (annual rate) 0.06%

St.Dev. Alpha 15.02%

p-value (for mean alpha not 0) 0.92

% of funds with alpha 0 60%

Page 32: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Comparative Performance AnalysisSynthesis

• The standard deviations are across funds (not across time periods)

Average St. Dev. % 0

CAPM 5.8% 10% 82.3%

Stale 2.1% 11.4% 65.2%

Cond 5.5% 10.2% 80.2%

Leland 5.3% 10.3% 78.7%

PPDM -0.9% 10.7% 58.3%

PCA -1% 12.6% 43.9%

Macro 7.3% 9.8% 86.7%

Index 0.8% 16.3% 56.5%

Cluster 0.1% 15% 59.4%

Av. Return 15.7% 9.8% 97.1%

Page 33: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Comparative Performance AnalysisSynthesis (con’t)

• Hedge funds appear to have significantly positive alphas for CAPM-like models, even with multiple factors

– However, hedge funds on average do not have significantly positive alphas once the entire distribution is considered (PDPM) or implicit factors are included (PCA)

– Nevertheless, many individual funds do have significantly positive alphas

Average St. Dev. % 0

CAPM 5.8% 10% 82.3%

Stale 2.1% 11.4% 65.2%

Cond 5.5% 10.2% 80.2%

Leland 5.3% 10.3% 78.7%

PPDM -0.9% 10.7% 58.3%

PCA -1% 12.6% 43.9%

Macro 7.3% 9.8% 86.7%

Index 0.8% 16.3% 56.5%

Cluster 0.1% 15% 59.4%

Av. Return 15.7% 9.8% 97.1%

Page 34: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Comparative Performance AnalysisCross-Sectional Distribution of Average Alphas

• The mean of that distribution is 4.07%, the standard deviation is 9.56%

• 276 (out of 581 hedge funds) have an average alpha across methods larger than 4.5%

Cross-Sectional Distribution of Average Alphas

0

10

20

30

40

50

60

70

80

90

-38

-36

-34

-32

-30

-28

-26

-24

-22

-20

-18

-16

-14

-12

-10 -8 -6 -4 -2 0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40

Mor

e

average alpha across models

nu

mb

er o

f fu

nd

s

Page 35: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Comparative Performance AnalysisCross-Sectional Distribution of Standard Deviation

• The mean of that distribution is 7.66%, the standard deviation is 4.60%

• One fund has a dispersion of alpha across methods larger than 40%!

Cross-Sectional Distribution of Standard Deviation of Alphas

0

20

40

60

80

100

120

140

160

0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 More

dispersion of alphas across models

nu

mb

er

of

fun

ds

Page 36: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Comparative Performance AnalysisCorrelation of Alphas

• CAPM-related methods are highly correlated with each other, indicating that the adjustments have small effects

• The implicit factor model and clustering based methods have a smaller correlation with the other methods, indicating that they pick up different factors

Stale Cond Leland PPDM PCA Macro Index Cluster

CAPM 0.90 0.96 0.998 0.72 0.52 0.97 0.59 0.73

Stale 1.00 0.88 0.90 0.71 0.44 0.86 0.53 0.74

Cond 1.00 0.96 0.66 0.50 0.93 0.58 0.71

Leland 1.00 0.71 0.51 0.97 0.60 0.73

PPDM 1.00 0.42 0.68 0.38 0.73

PCA 1.00 0.55 0.27 0.33

Macro 1.00 0.54 0.64

Index 1.00 0.61

Cluster 1.00

Page 37: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Comparative Performance AnalysisProbability of Agreement

• For any two models, we compute the probability that the two models will agree on the rank order of a randomly-chosen pair of hedge funds

• All pairs of models have probabilities of agreement > 0.50, even the model that only computes the average return

Stale Cond Leland PPDM PCA Macro Index Cluster Av. Ret

CAPM 0.84 0.91 0.98 0.81 0.64 0.92 0.69 0.74 0.77

Stale 1.00 0.83 0.85 0.80 0.61 0.81 0.69 0.76 0.70

Cond 1.00 0.90 0.81 0.63 0.87 0.70 0.74 0.75

Leland 1.00 0.80 0.63 0.91 0.70 0.75 0.77

PPDM 1.00 0.62 0.77 0.66 0.77 0.70

PCA 1.00 0.65 0.57 0.56 0.67

Macro 1.00 0.67 0.70 0.80

Index 1.00 0.76 0.58

Cluster 1.00 0.60

Page 38: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Impact on Attributes on Fund PerformanceImpact of Fund Size on Performance

• Note that for all methods, the mean alpha for large funds exceeds the mean alpha for small funds

• This fact, combined with the observation that most of the results are statistically significant, suggests that large funds do indeed outperform small funds on average

ModelCAPM Stale Cond Leland PDPM PCA Macro Index Cluster Avg Ret

Large Fundsmean 6.75% 3.30% 6.30% 6.21% 0.95% -0.50% 8.15% 1.70% 1.88% 15.94%N 289 289 289 289 289 289 289 289 289 289sd 9.25% 10.22% 9.09% 9.44% 8.57% 12.75% 9.34% 15.01% 12.67% 8.88%stderr 0.54% 0.60% 0.53% 0.56% 0.50% 0.75% 0.55% 0.88% 0.75% 0.52%

Small Fundsmean 4.96% 1.01% 4.72% 4.49% -2.72% -1.51% 6.39% -0.01% -1.72% 15.58%N 290 290 290 290 290 290 290 290 290 290sd 10.66% 12.79% 11.29% 10.76% 12.11% 12.43% 10.20% 17.33% 16.88% 10.63%stderr 0.63% 0.75% 0.66% 0.63% 0.71% 0.73% 0.60% 1.02% 0.99% 0.62%

Differencemean 1.79% 2.29% 1.57% 1.73% 3.68% 1.01% 1.76% 1.71% 3.61% 0.36%p value 0.03 0.02 0.07 0.04 < 0.01 0.33 0.03 0.21 < 0.01 0.66

Page 39: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Impact on Attributes on Fund Performance Impact of Fund Type on Performance

• Most models rate market neutral funds as outperforming the average of other funds at a statistically significant level. However, two of the factor models do not. Presumably a typical market neutral fund has a favorable probability distribution of returns but is subject to some implicit or macroeconomic risks not well captured by the other models.

• The CAPM models rate short-selling funds the highest, although other models did not. Short-selling funds tend to have negative betas, so even absolute performance near the risk-free rate will result in positive CAPM alphas.

# of Funds CAPM Stale Cond Leland PDPM PCA Macro Index Cluster Avg RetEvent Driven 66 4.96% 1.05% 4.45% 4.26% 0.44% -1.13% 6.05% 1.79% 1.95% 13.46%GL Macro 28 4.15% 1.19% 2.56% 3.73% -3.53% -3.87% 5.75% 1.39% 1.79% 14.06%Global Emerg. 27 -2.66% -5.33% -0.96% -3.98% -14.20% -0.66% 1.07% -11.57% -15.14% 13.89%Global Est. 125 6.93% 2.39% 6.71% 6.48% -0.54% -1.45% 8.75% -1.04% -3.55% 21.05%Global Intl. 20 2.87% -1.13% 1.77% 2.35% -7.26% -2.84% 5.56% -2.23% -7.38% 10.67%Long Only 5 2.32% -1.53% -0.06% 1.53% -3.41% -5.18% 3.56% -7.37% -6.47% 18.02%Median 14 4.87% 2.61% 4.63% 4.42% 1.89% -2.77% 5.83% 1.25% 0.82% 11.75%Mkt Neutral 101 9.40% 6.74% 9.28% 9.04% 2.88% -0.52% 9.73% 8.17% 9.67% 15.48%Sector 27 10.47% 5.57% 8.44% 9.81% -0.73% 3.27% 12.06% -1.14% -2.44% 25.68%Short Sales 8 13.65% 14.80% 15.11% 14.21% -19.62% -0.24% 13.34% 20.34% -2.96% 6.45%Unknown 160 4.20% 0.20% 3.85% 3.72% 0.05% -0.83% 5.65% -0.94% -0.06% 12.96%

Page 40: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Impact on Attributes on Fund Performance Impact of Fund Age on Performance

• Note that for all methods, the mean alpha for newer funds exceeds the mean alpha for older funds

• The differences vary in significance across the methods

CAPM Stale Cond Leland PDPM PCA Macro Index Cluster Avg RetNewer Fundsmean 7.34% 2.90% 6.88% 6.84% -0.02% -0.50% 8.67% 2.40% 1.63% 17.65%st.dev. 11.67% 13.11% 12.21% 11.74% 11.16% 14.62% 11.30% 16.75% 16.91% 11.41%

Older Fundsmean 4.59% 1.43% 4.27% 4.10% -1.50% -1.66% 6.03% -0.26% -0.95% 13.99%st. dev. 8.16% 10.10% 8.19% 8.37% 10.05% 10.39% 8.13% 15.54% 12.97% 7.75%

Differencemean 2.76% 1.47% 2.61% 2.74% 1.48% 1.16% 2.63% 2.66% 2.58% 3.66%p-value < 0.01 < 0.01 < 0.01 < 0.01 < 0.01 0.289846 < 0.01 0.011266 < 0.01 < 0.01

Page 41: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Impact on Attributes on Fund Performance Impact of Incentive Fee on Performance

• High incentive fees (>=20%; most were exactly 20%) versus low incentive fees (<20%)

• Note that for all methods, the mean alpha for high incentive funds exceeds the mean alpha for low incentive funds

• A strong significant effect is obtained with almost all of the methods

CAPM Stale Cond Leland PDPM PCA Macro Index Cluster Avg RetHigh Incentive Funds (N=334)mean 6.11% 2.40% 5.56% 5.64% -0.66% -1.10% 7.57% 2.49% 0.55% 15.48%st. dev. 8.43% 9.97% 8.22% 8.52% 10.57% 11.58% 8.60% 15.30% 13.29% 9.12%

Low Incentive Funds (N=99)mean 0.73% -2.81% 0.45% 0.04% -4.38% -2.54% 2.55% -5.23% -4.76% 12.02%st.dev. 8.26% 10.75% 7.85% 8.56% 10.99% 11.12% 8.03% 12.27% 13.82% 8.27%

Differencemean 5.38% 5.22% 5.10% 5.60% 3.72% 1.44% 5.02% 7.72% 5.32% 3.46%p-value < 0.01 < 0.01 < 0.01 < 0.01 < 0.01 0.26 < 0.01 < 0.01 < 0.01 < 0.01

Page 42: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Impact on Attributes on Fund Performance Impact of Management Fee on Performance

• High management fees (>=2%) versus low management fees (<2%)

• None of the reported differences is significant at the 0.05 level

• This suggests that there is no significant difference between funds with higher or lower administrative fees

CAPM Stale Cond Leland PDPM PCA Macro Index Cluster Avg RetHigh Fee Funds (N=133)mean 4.46% 0.58% 3.78% 3.92% -1.60% -1.11% 5.94% -1.71% -0.47% 14.17%st. dev. 9.17% 10.83% 8.31% 9.38% 10.72% 12.03% 9.22% 12.61% 13.37% 8.64%

Low Fee Funds (N=242)mean 5.09% 1.41% 4.52% 4.55% -1.43% -1.09% 6.68% 1.07% -1.39% 15.60%st.dev. 8.56% 10.24% 8.73% 8.69% 10.21% 10.57% 8.59% 16.04% 13.69% 9.40%

Differencemean -0.63% -0.82% -0.75% -0.63% -0.17% -0.02% -0.74% -2.78% 0.92% -1.43%p-value 0.52 0.47 0.41 0.52 0.88 0.99 0.45 0.07 0.53 0.14

Page 43: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

Impact on Attributes on Fund Performance Impact of Minimum Purchase Amount on Performance

• Minimum purchase amounts for the hedge funds in our study ranged from 0 to \$25 million.

• High MPA (>=$300,000) versus low MPA (<$300,000) • For all methods, the mean alpha for funds with the larger

minimum purchase amounts exceeds the mean alpha for the other funds (statistically significant difference)

CAPM Stale Cond Leland PDPM PCA Macro Index Cluster Avg RetHigh Mininum Purchase Funds (N=285)mean 7.47% 4.34% 7.32% 7.00% 0.44% 0.17% 8.66% 3.00% 2.01% 16.98%st. dev. 10.60% 11.52% 11.23% 10.67% 10.25% 12.94% 10.41% 16.93% 16.39% 10.43%

Low Minimum Purchase Funds (N=251)mean 3.63% -0.58% 3.19% 3.09% -2.80% -2.69% 5.28% -1.92% -2.46% 14.09%st.dev. 0.63% 0.68% 0.67% 0.63% 0.61% 0.77% 0.62% 1.00% 0.97% 0.62%

Differencemean 3.84% 4.93% 4.13% 3.91% 3.24% 2.86% 3.38% 4.92% 4.47% 2.89%p-value < 0.01 < 0.01 < 0.01 < 0.01 < 0.01 0.01 < 0.01 < 0.01 < 0.01 < 0.01

Page 44: Lionel Martellini Risk and Asset Management Research Center, EDHEC Graduate School of Business

ConclusionAt the HF world's lies the Impersonal

• Alphas on active strategies, if they exist, are not easy to measure with any degree of certainty

• In a companion paper, we test the impact of uncertainty in alpha estimates on optimal allocation decision in a CT Bayesian setting

• Hedge fund are exposed to a variety of risk factors, and, as a result, generate normal, as opposed to abnormal, returns

• The hedge fund industry should perhaps focus on promoting the beta-benefits of hedge fund investing, which are significant and less arguable, as opposed to promoting the alpha-benefits of hedge fund investing, which are very hard to measure with any degree of accuracy

• This also suggests that the future of alternative investments may lie in “the impersonal”, i.e., in passive indexing strategies