global commercial scoring

23
© 2007, Experian Ltd Proprietary and Confidential #1 Global Commercial Scoring Paul Orton Senior Business Consultant

Upload: i167003

Post on 03-Feb-2016

7 views

Category:

Documents


0 download

DESCRIPTION

Global Commercial Scoring

TRANSCRIPT

Page 1: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #1

Global Commercial Scoring

Paul OrtonSenior Business Consultant

Page 2: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #2

Global Commercial Scoring - examples

Swiss based manufacturer supplies to clients all ar ound the worlSwiss based manufacturer supplies to clients all ar ound the worl dd

50 – 100 cases per monthAverage deal size €50 000

Page 3: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #3

Global Commercial Scoring - examples

Finance arm of US based computer manufacturer looki ng to expand Finance arm of US based computer manufacturer looki ng to expand its overseas businesses its overseas businesses

In the region of 100 000 credit reports per annum

Page 4: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #4

Global Commercial Scoring - examples

StartStart --up Commercial Credit Bureau wants to have a risk sc oreup Commercial Credit Bureau wants to have a risk sc ore

Page 5: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #5

The Vision

• One risk score that is available online for any business in the world.

• It will…� Work for any known business

� Large and small, not just those that are S&P rated� Limited and non-limited

� Have a common score : odds / PD scale� Use a common definition of “Bad” across all countries� Be based on all the data available in that market in the scorecards� Meet all the local regulatory requirements� Be as predictive as any other generic score in that market� Come with a credit limit that will take account of the local trading

environment

Page 6: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #6

The Issues

• Connectivity• Do we produce meta-data or not?• How do we use the data?• Score Calibration

� what scale� What outcome� How should it fit in with other international ratings agencies

• Avoiding lowest common denominator• How to develop scorecards in countries where we have no

experience.• How to benchmark scores in countries where we little

experience• Should we factor in the point in the economic cycle for

countries or regions?

Page 7: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #7

Connectivity

• The architectural part of the problem has been largely solved.

Page 8: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #8

Connectivity Solution: Connect+

Connect+ is a unique solution that manages the complexity of gathering the right information from

multiple data sources*

A Global Credit Bureaux Framework * Other solutions providers are available

Page 9: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #9

Connect+

Hosted Service

Commercial Credit Bureaux

Consumer Credit Bureaux

FraudDatabases

OtherDatabases

External Data Providers

Data Formatter

& Filter

Data enrichment

Risk Scores Predictive Summary Variables

Security Layer

xml files of raw data

Connect+ Structure

Client

Enquiring System

Dat

a E

xcha

nge

Laye

r Validate Bureau Enquiry

Data Formatter

& Filter

Page 10: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #10

Connectivity

• The architectural part of the problem has been largely solved.

• Issues remain about � Costs

� Establishing and maintaining links

� Reselling data

� Flexibility� Transporting data across national boundaries

Page 11: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #11

Meta-data

• There is a lot of potential added value from the creation of a ‘Meta-data’ layer within the bureau connectivity solution� Credit bureaux hold different data in different formats� Just for company accounts bureaux may hold

� Full accounts

� Modified / abbreviated accounts

� In UK GAAP or IFRS standards

• There is also a huge amount of effort involved in setting up and maintaining the mappings from every credit bureau to the meta-data layer.

• Manage this by maintaining only a basic layer of data and value adds

Page 12: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #12

Countries where we have little experience

• Scorecard development� Difficult where we don’t own data� Need to rely on client samples which have inherent biases

• Use of scorecards from other countries / regions� Differences in data

� Many variables are consistently predictive across geographies

� E.g. age of business, size of business, slow payment activity, weak balance sheet, profitability

� Misalignments� Alignment shifts – may need to re-weight the scorecards

� Scoreband migration – not an issue, just results in lower average scores

� Use of Expert validation is important

Page 13: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #13

Universal Scoring Characteristics

• Limited Companies – generally we can define many of the financial attributes that define risk and we have observed that these variables behave consistently across different markets.

– e.g. TurnoverActivity

– e.g. Current RatioLiquidity

– e.g. Equity GearingBorrowing

– e.g. Percentage change in Shareholders FundsGrowth

– e.g. Return on AssetsProfitability

– e.g. Total AssetsSize

Given the structural link between the measure of behaviour and outcome then we would expect this data to be highly predictive but finances are only a small part of the picture when defining business risk.

Page 14: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #14

Contribution of a company’s financial statement

• In recent developments financial statement data was only as influential on the final scorecard as payment data.

Shareholders funds percentile

0

10

20

30

40

50

60

70

80

90

5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

failure odds

For the lowest 40% of the population the balance sheet strength is not strongly predictive .

Page 15: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #15

Contribution of a company’s financial statement

• In recent developments financial statement data was only as influential on the final scorecard as payment data.

This data is only present for 45% of companies and the pattern of predictiveness is not straightforward to model or interpret.

Return on Assets (%)

0.00

5.00

10.00

15.00

20.00

25.00

30.00

35.00

40.00

NoData

to -41 to -7 to 0 to 3 to 7 to 15 to 29 to 69 70+

Odd

s

0.00

10.00

20.00

30.00

40.00

50.00

60.00

%ag

e

Failureodds

% ofpopulation

Page 16: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #16

Other scoring variables

• Experience from the consumer market shows us that non-causal data can be highly influential in predictive models.� E.g. Marital status / residential status

• Previous papers have commented on the other influences on a company’s riskiness* e.g.

* (How Can Corporate Performance Be Measured? YC Hu / J Ansell 2005)

• Compliance with regulationsNon-Financial company performance measures

• Regional and National industrial performanceEnvironmental factors

• Group structureOrganisational resources

• Industry sector performance

• Profile informationIndustrial factors

• Directors’ track record

• Director’s personal credit historyManagement experience

Page 17: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #17

Benchmarking

• Market specific models will directly measure risk.

• Out of market scorecards will rank risk but how do we calibrate them to market specific bad rates?

• Combine nationally reported data with indexed score distributions to produce nationally specific bad rate estimates.

0.4%4.0%1041 to 50

1.0%4.0%431 to 40

4.0%4.0%121 to 30

8.0%4.0%0.511 to 20

16.0%4.0%0.251 to 10

Score Band

failure rate

National Failure

RateIndex Score

Page 18: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #18

Calibration

• Big issues with scale. Differences in predictiveness of scorecards between countries can cause loss of granularity at the extremes or mid-range

• For example, weak scorecards will have large numbers clumped in the mid-ranges.

• Strong scorecards may run into problems with large numbers in the top score band

Scorecard with Gini of 45

0.0

5.0

10.0

15.0

20.0

25.0

30.0

35.0

40.0

45.0

1 2 to 15 16 t o 25 25 to 50 51 t o 80 81 to 90 91 to 100

Scorecard with a Gini of 68

0.0

5.0

10.0

15.0

20.0

25.0

30.0

35.0

40.0

45.0

1 2 to 15 16 to 25 25 to 50 51 to 80 81 to 90 91 to 100

Page 19: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #19

Calibration - solution

• Supply a ranking alongside a calibrated score, i.e. this company lies in the 37th percentile of companies from this country.

• Include a measure of scorecard accuracy with credit opinion

• Calibrate scores to a standard score to odds (P(bad)) scale� Can we define a common definition of bad?

� Twelve month outcome

� Copy Basel II definitions of default� Use concept of company failure

• Should we align our scales with other agencies such as S&P / Moody’s� They cover only a tiny fraction of larger companies but it would be helpful at the

top end of companies where the two scales overlap to show what correspondences there are.

Page 20: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #20

Alignment to Moody’s

0.5%Baa397 to 100

0.6%Baa391 to 96

0.8%Ba185 to 90

1.4%Ba281 to 84

2.8%Ba364 to 80

5.5%B138 to 63

7.7%B224 to 37

11.9%B316 to 23

20.8%Caa19 to 15

33.1%Caa26 to 8

71.0%Caa31 to 5

One year failure rateMoody's equivalentUK Commercial Delphi Score

Page 21: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #21

Long-term Economic factors

• Use techniques from Basel II stress testing analysis such as sensitivity analysis to estimate impacts of economic factors on components of scorecards.

• Forecasts of economic factors can then be used to modify risk estimates. This assumes the existence of economic forecasts for the countries in question.

Page 22: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #22

How do we achieve this?

E.g. China, India which are developing credit markets with new bureau (if any)

E.g. Turkey where there is an active credit markets but little current sophistication in commercial bureau services

E.g. UK / US / Italy / Denmark where there are highly competitive markets in data, scores and other value added services

Ranking score3rd Rank

Ranking scoreCalibrated score

2nd Rank

Ranking scoreCalibrated scoreEconomic factors weightedCredit limits

1st Rank

Vary the level of service with the market

Page 23: Global Commercial Scoring

© 2007, Experian Ltd Proprietary and Confidential #23

Global Commercial Scoring

Paul OrtonSenior Business Consultant