márquez , javier - an introduction to credit scoring for small and medium size enterprises
TRANSCRIPT
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
1/47
An Introduction to Credit Scoring
For
Small and Medium Size Enterprises.
Javier Mrquez.1
February 2008
I. INTRODUCTION.
This paper is intend ed as a q uick primer on c red it scoring , and how itapp lies to the assessment of risk of sma ll and med ium size ente rprises (SMEs). It
is part o f a la rge r study on how c red it sc oring is c urrently be ing applied for this
purpose, and exploring the possibility of broadening the applicability of the
technique to enc om pass a w ider spec trum of SMEs. Thus, the a im has bee n to
provide the reader who wishes to understand what credit scoring is about but
do esnt wa nt to be come a spe c ialist, with enough informa tion o n c red it sc oring
fundamentals so as to feel comfortable with the subject in terms of its
mechanics, scientific foundations, applicability and the practical issues that
must be addressed for a successful application. It was deemed important to
specifically compare credit scoring with ratings, since they are often confused
and erroneously addressed as if they we re the sam e or a t least c lose
relatives. Essentially, the only thing they have in common, is that both are
systematic approaches to appraise the risk of an individual debtor;
methodologically however, they are extreme opposites.
Ratings live in the realm of big companies that issue or contract large
debt, and the evaluation of the risk of the debtor is done employing the
traditional techniques of fundamental analysisand experience. In contrast,
credit scoring is based on discriminant analysis; a statistical methodologydesigned to optimally classify a population (e.g. debtors) into clearly
distinguishable groups (e.g. good and bad). As such, it requires large
populations so that the statistical parameters estimated are reliable, and
provide a reasonable degree of certainty as to what group a particular
me mb er of the pop ulation b elong s. Thus, for single ob ligor risk measurem ent ,
1The a uthor wishes to tha nk Mr. Albe rto Jones of Mood ys , Vic tor Ma nuel Herrera of Standard
and Poo rs, and Guillermo Ma ss and Juan Ram on Bernal o f Banc o San ta nder-Serfn fo r their
ge nerous c ontributions to this effo rt. I wo uld p a rticula rly like to tha nk Augusto de la Torre w ho,
in spite of m y relucta nce , enco urag ed me to und ertake this project.
1
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
2/47
the technique only makes sense for large populations of debtors with fairly
hom og eno us c ha rac teristics. Fina lly, whe rea s a rating is an o rd inal risk ind ica to r
in the sense tha t higher ra tings mea n less risk and lower rat ings imp ly more risk in
the opinion of whoever did the rating, credit scores are actual estimates of
default probabilities of debtors in a group, and their reliability depends on thesample in terms of size, the proportions of good and bad debtors it contains,
and the mathema tic al mod el used to d istinguish be twee n them.
Ratings however, are by far the most common reference on individual
c red it risk in the industry, for prac tica l and reg ulato ry reasons. Thus, no matte r
how individual credit risk is assessed, or how precise the technique used to
estimate a default probability, it will eventually have to be related to a rating;
either as a means to communicate in terms that are readily understood across
all levels of a lender organization and regulators, as a means to comply with
reg ula tion, or both.
Sec tion two g ives a b rief histo ry of ra tings and c red it sc oring . Besides
explaining how ea c h tec hnique c ate rs to d ifferent types of d eb tor pop ulations,
it is interesting to see that, contrary to popular belief, credit scoring is not a
recent fad, but dates back to over sixty years when consumer lenders were
overwhelmed in their capacity to process personal loan applications, and
something ha d to b e d one. In sec tion three, the ana tom y of c red it scoring is
explained: building scorecards, sample design, discriminant analysis and the
issues tha t must b e a ddressed in prac tice fo r suc c essful ap p lica tions. In the nextsec tion, we c ome full c irc le a nd show how , desp ite their d ifferenc es, sc ores c an
be mapped into ratings, establishing an indispensable link between the two
which, as already mentioned, is important both for practical and regulatory
purposes. In this sec tion, we a lso go into some d eta il on how it c an b e a pplied
in the Basel II frame wo rk. The paper conc ludes with a d isc ussion of the sta tus of
c red it scoring as it app lies to SME lend ing. It is see n why the too l is very useful at
the low end of the scale, and substantiate the claim that in this population the
use of credit scoring is widespread. However, it is also explained why the
technique becomes less and less applicable as one moves up the ladder, untilit bec om es d iffic ult or impossible to apply for the larger SMEs.
II. ABRIEF HISTORY OF THE SYSTEMATIC ASSESSMENT OFCREDITRISK:
CREDITRATINGS VS.CREDITSCORING.
The e ssenc e o f lend ing mo ney ha s be en und erstoo d from the ve ry
beg inning a nd it is unlikely to c hange ; namely, one needs to estab lish potential
2
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
3/47
deb to rs c apac ity and willingness to p ay. Trad itiona lly, since the re is a rec orde d
histo ry o f c red it over 4000 yea rs ago 2 and of banking from the midd le a ges up
to the beg inning of the twentieth c entury, the assessme nt b y bankers of the risk
represented by potential debtors, in terms of their capacity and willingness to
pay had hard ly change d. There wa s a c ertain mystique surround ing the shrewdand exquisite banker with an infallible judgment who could, at a glance,
dete rmine the qua lity of a wo uld be c lient. Thus, any banker wo rth his salt wa s
supp osed to have a profound knowledg e o f his c lients and c ompe tition, which
allowed him to decide by trade, pure instinct and trusting in a bit of luck 3, who
he c ould lend money to, how muc h he c ould lend them, how muc h he c ould
charge, how he would be paid, and what collateral he could demand. Over
the last half of the last century to the present day, this perception of banking
has p rac tica lly disappea red a nd ove r the pa st twenty five years, there has
been a radica l cha nge in the wa y risk in genera l and c red it risk in particular, is
perceived, mea sured and ma nage d.
Basically, the change is a direct response to the dramatic increase in
complexity of the credit business, technology and financial knowledge.
Whereas well into the nineteenth century bankers generally dealt with a
relatively small client base (by todays standards), of elite customers who could
be dissected and evaluated on an individual basis, and a manageable
number of relatively large loans could be tailored to individual needs, by the
first q uarter of the twentieth c entury, the potential client b ase had expanded
enormously.
Although it is not the main subject of this paper, it is important to talk
about ratings since they are often confused with scores. As shall be seen later,
this does not mean however, that a relationship between ratings and credit
scores cannot be established. In fact, a correspondence can be established
and it ha s bec ome a nec essity fo r reg ula tory purposes, pa rticularly in the light
of the new Basel II accord, where capital charges due to risky assets can be
either ratings dependent in the standardized approach or PD driven, in the
Inte rna l Ra tings Based (IRB) approac h.
2.1. Rating s.
Large corporations, besides having access to banks, have been able to
place debt in public offerings in the market for centuries. As the number of
2Lew is reported in 1992, tha t a Bab ylonian stone tab let reads the insc rip tion: Two sheke ls of silver
have be en b orrowe d by Ma s-Sc ham ac h, the son o f Ad rad imeni, from the sun p riestess Ama t-
Sc hama c h, the d aughter of Warad Enlil. He will pa y the sun god dess interest. At the time of the
harvest he will pay ba c k the sum a nd the interest up on it.3No trad itiona l banker will ad mit grac efully to this luck c omp onent!
3
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
4/47
participants grew, this led to an increasing demand by investors, of obtaining
reliab le info rma tion o n the solvenc y of the issuers. Thus, la rge firms, whic h have
always been given a special treatment, did not escape being labeled with
som e kind of indic ator of the risk they represented ; indeed , they w ere the first to
have suffered the onslaught! As early as the late eighteen hundreds and thebeginning of the twentieth century, the first rating agencies came into play on
the p rincip le of the investo r's right to know. In 1860 Henry Varnum Poor
pub lished his Histo ry of Railroads and Ca na ls of the United Sta tes and his
suc c ess led to the foundation o f Poo r s Pub lishing w ith the intention o f informing
investors on the financial soundness of issuers of publicly traded debt. In 1900,
John Moody and Co. published Moodys Manual of industrial and
Miscellaneous securities providing investors with financial information and
statistics on listed companies and issuers of debt. In 1906, the Standard Statistics
Bureau was formed to provide previously unavailable financial information on
U.S. companies and in 1916, they b eg an ra ting c orporate bo nds, with sove reign
debt ratings following shortly thereafter. Having sold his company in 1907,
Moody is back in the financial information business in 1909, with the idea of
offering investors research and analysis on publicly traded debt issues, starting
with railroads. Moodys investor services was created in 1914, and has been
publishing their Weekly Review of Financial conditions known today as
Moodys credit perspectives for nearly one hundred years, and claims to be
the first to devise the let te rs based rat ing system. The Sta nd ard Sta tistic s burea u
a lso expa nde d c onsistent ly to an eve r inc rea sing universe o f c om panies both in
the p rivate and pub lic sec to r and in 1941, Poo r's Pub lishing and Sta ndardSta tistics merge d to form the Standard & Poo r's Corpo ra tion we know tod ay.
Initial publications consisted of a brief analysis of financial ratios with certain
industry c om parisons and so on, and of c ourse, the rating. Anothe r ag enc y tha t
trac es its histo ry to the ea rly twent ieth c entury is Fitch (1913). Fitch a lso c laims
to be the first to devise the letters based rating system and has been
consistently gaining in international presence, specially after it acquired Duff &
Phelps in April of 20004. Tab le 2.1 com pares the let te ring systems used by the
d ifferent ra ting ag enc ies.
A rating is an indicatorof the creditworthiness of a debtor5. In Moodys
ow n wo rds:
A credit rating is an opinion of the credit quality of individual obligations
or of an issuers gene ral c red itworthiness, without respec t to ind ividua l
deb t ob ligations or othe r spec ific sec urities.
4It should b e p ointed o ut that the ab ove mentioned are not the only existing rating a ge ncies inthe world. We ha ve only mentioned those with the largest internationa l presenc e.
5Taken d irec tly from the rating a ge nc ys web sites.
4
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
5/47
Speculative Grade
Invest-mentGrade
Associated Risk
Low
High
CCC
CaCCCC
CaaCCCCCC
BBBBaBBBB
BaaBBBBBB
AAA
AaAAAA
AaaAAAAAA
MoodysS&PFitch
MoreMore
RiskRisk
LessLess
RiskRisk
Tab le 2.1: Compa rison o f Rating Catego ries by Rating Ag enc y.
Other ra ting a genc ies have simila r definitions:
Standard & Poo rs:
A c red it rating is Sta nda rd & Poo r s op inion o f the g enera l
creditworthiness of an obligor, or the creditworthiness of an obligor with
respect to a particular debt security or other financial obligation, based
on releva nt risk fac tors. A ra ting does not c onstitute a rec om mendat ion to
purchase, sell, or hold a particular security. In addition, a rating does not
c om ment on the suita b ility of a n investment fo r a pa rticular investor .
Fitch:
Fitc h's c red it ratings p rovide an op inion o n the relative a b ility of an entity
to meet financial commitments, such as interest, preferred dividends,
repayment of principal, insurance claims or counterparty obligations.
Credit ratings are used by investors as indications of the likelihood of
receiving their money back in accordance with the terms on which they
invested.
Evidently, credit rating has come a long way since the first agenciesap pe ared a hundred years ag o. Not only have they expa nded the ir op erations
to cover the vast spectrum of firms and government agencies that publicly
issue debt, but they have consistently refined and systematized their methods.
There has a lso b een a para llel development by ba nks, whic h emp loy very
similar methods to evaluate the risk of their larger loans. In essence, and with
the peculiarities pertaining to each agency or bank, the risk assessment or
ra ting of a particular deb t issue o f a large deb tor, is a rrived at after a thoroug h
fund ame nta l ana lysis of the issuer and his ob liga tions in rela tion to the particular
issue. The q uantita tive a na lysis derived from historica l da ta and future
projections of financial statements under different business, market and
5
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
6/47
economic scenarios, is contrasted with qualitative appreciations of particular
c ha rac te ristics of the issuer, and the env ironm ent . Thus, things like the qua lity o f
management and the business strategy of the issuer, along with the
c om petition a nd the reg ula tory req uirem ents it fa c es, whose c ont ribution to risk
are not e asily qua ntifiab le, are c arefully weighed be fore a rec omm endation orra ting is prop osed by the resea rc h te am responsible for the a na lysis. The final
rec om mendation or ra ting is assigne d , only a fter the findings, both quantitative
and qua litat ive, and the p rop osal of the resea rc h tea m have be en d iscussed in
a top level co mm ittee . Sc hem atica lly, the p roc ess is p resented in figure 2.1.
below. It is interesting to see all the things that are considered, and the
hierarchy assigned to each, in order to arrive at a rating and that qualitative
ana lysis is p lac ed a t the very top of the pyramid.
QUALITATIVEQUALITATIVE
ANALYSISANALYSIS
ManagementManagement
StrategicStrategic ManagementManagement
FinancialFinancial FlexibilityFlexibility
QUANTITATIVE ANALYSISQUANTITATIVE ANALYSIS
Financial StatementsFinancial Statements
Previous OutstandingPrevious Outstanding
ProjectionsProjections
MARKET POSITIONSMARKET POSITIONS
SECTOR COMPETITIVE ENVIRONMENTSECTOR COMPETITIVE ENVIRONMENT
Global / DomesticGlobal / Domestic
REGULATORY ENVIRONMENTREGULATORY ENVIRONMENT
SECTORIAL ANALYSIS (I NDUSTRY)SECTORIAL A NALYSIS (I NDUSTRY)
MACROECONOMIC AND SOVEREIGN ANALYSISMACROECONOMIC AND SOVEREIGN ANALYSIS
Global / DomesticGlobal / Domestic
QUALITATIVEQUALITATIVE
ANALYSISANALYSIS
ManagementManagement
StrategicStrategic ManagementManagement
FinancialFinancial FlexibilityFlexibility
QUANTITATIVE ANALYSISQUANTITATIVE ANALYSIS
Financial StatementsFinancial Statements
Previous OutstandingPrevious Outstanding
ProjectionsProjections
MARKET POSITIONSMARKET POSITIONS
SECTOR COMPETITIVE ENVIRONMENTSECTOR COMPETITIVE ENVIRONMENT
Global / DomesticGlobal / Domestic
REGULATORY ENVIRONMENTREGULATORY ENVIRONMENT
SECTORIAL ANALYSIS (I NDUSTRY)SECTORIAL A NALYSIS (I NDUSTRY)
MACROECONOMIC AND SOVEREIGN ANALYSISMACROECONOMIC AND SOVEREIGN ANALYSIS
Global / DomesticGlobal / Domestic
Figure 2.1. Standard Conside rations in the rating process.
(Courtesy of Mood ys Investo r Services.)
Although the general principles of fundamental analysis, as regards the
evaluation of the credit worthiness of a debtor are well established, the actual
methodologies of the rating agencies, and the internal rating systems used by
banks a re no t p ub lic ly d isc losed . In a ll ca ses they a re c onsidered an important
pa rt of the intellec tual property of the ba nks and the a genc ies and key fac tors
of their competitiveness in the industry. Indeed, both the rating agencies and
the b anks go to g rea t lengths in trying to c onvince the ma rket and the financ ial
autho rities tha t they d o it a s we ll as, or be tte r than the rest. There is an
important difference between the banks and the rating agencies however;
name ly, whereas banks a re unde r no ob liga tion to d isc lose their internal rat ings
to any one other than the financ ial authorities, disc losure of ratings is a t the very
hea rt o f the ra ting a genc ies business. This permits the ma rket a nd any
interested observer to see what the actual track record of the agencies is, and
how we ll the ra tings ac tua lly cap ture the risk in ra ted deb t issues.
6
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
7/47
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
8/47
Data such as that of table 1.1 can be used to estimate default
probabilities by rating category. Figure 2.2 shows Moodys default probability
estimates by rating category over time. It is interesting to see that default
probabilities increase as ratings go down the scale, which is consistent with the
be havior ob served in the m ortality rate d ata shown ab ove6
.
Figure 2.2: Default Probability by Rating Categ ory(Courtesy of Moodys Investor Services.)
More recently, and specially after the Basel II initiative, banks who
havent already done so, are strongly urged to work towards using ratingsystems which, to each rating category, can explicitly associate a default
probability such as shown above, and an expected recovery rate in case of
defa ult. An exam ple o f rec ove ry rates is p resente d in tab le 2.3 be low .
Senio rity No. of Bond s Rec overy Rate
(Mean)
Standard
Deviation
Senior guaran tee d 89 57.94% 23.12%
Senior non gua rantee d 225 47.70% 26.60%
Senio r sub ord inated 186 35.09% 25.28%
Subo rd inated 218 31.58% 22.50%
Junior subordinated 34 20.81% 17.76%
Table 2.3: Rec overy Rates on Co rporate Bond s by Senio rity.(% o f fac e va lue of $100). Altman and Kishore(1997).
As seen above, the scrupulous recording of performance data by theagencies, has permitted the estimation of a wide variety of risk relatedmeasures. Simp ly to c onc lude this sec tion with ano ther rec om mendation of theBasel Committee, table 2.4 below shows a transition matrix, which provides
6 Although the numbers dont necessarily coincide due to differences in rating scales andmetho do logies of the d ifferent rating a ge ncies.
8
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
9/47
the probability of migration of rated bonds from one rating category toanother.
Fina lly, it should b e fa irly ob vious tha t rating a la rge c orpora te loa n b y aba nk o
Rating AAA AA A BBB BB B CCC Default
r an agency, is a lengthy, labor intensive and costly affair, which is only
justified by the magnitude of the debt relative to the analytical effort (cost)involved, and the broad interest manifest by the investor community. As onegoes down the scale, doing such an in depth analysis becomes ever morecostly, to the point of becoming prohibitive, and some would argueunnec essary. This doe s not mea n tha t rating other types of loa ns is not done ;quite the c ontrary. Over the yea rs, ra ting systems for all sorts of loa ns(businesses,
AAA 94.30% 5.50% 0.10% 0.00% 0.00% 0.00%0.00% 0.00%
AA 0.70% 92.60% 6.40% 0.20% 0.10% 0.10% 0.00% 0.00%
A 0.00% 2.60% 92.10% 4.70% 0.30% 0.20% 0.00% 0.00%
BBB 0.00% 0.00% 5.50% 90.00% 2.80% 1.00% 0.10% 0.30%
BB 0.00% 0.00% 0.00% 6.80% 86.10% 6.30% 0.90% 0.00%
B 0.00% 0.00% 0.20% 1.60% 1.70% 93.70% 1.70% 1.10%
CCC 0.00% 0.00% 0.00% 0.00% 9.00% 2.80% 92.50% 4.60%
Table 2.4: Transition Ma trix.
Source :Altma n and Kao (1992), estima ted from d ata on b ond s issued be twe en 1971 and 1989,
consumer or personal loans) have been devised, where loan applicants
.2. Cred it Scoring.
With the growth of the middle class in the eighteen hundreds, money
lender
rate d b y S&P.
provide information through a questionnaire of some sort, which is then
processed by a credit analyst, who rates and decides to grant or reject the
loan, based on experience and intuition. Initially the information required was
purely judgmental, and depended heavily on analysts personal opinions of
what determined capacity and willingness to pay. It quickly became evident
that in many cases, there were rating inconsistencies due to differences of
opinion between analysts. Furthermore, the number of applications kept
grow ing, to the point that a na lysts we re overwhelmed , and som ething e lse was
nee ded . This b rings us to the main sub jec t.
2
s realized there was a rapidly growing market in smaller loans with the
added attraction of diversification and the ensuing protection in large
9
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
10/47
numbers. This g ives rise to the c rea tion o f the first c om me rcial banks, pa wn
brokers and even mail order services7; a ll c a tering to c onsumer cred it. The
process really takes off in the 1920s with the possibility of the public at large to
buy auto mob iles. This howeve r req uired a rad ic a l c hang e in the wa y of do ing
business; namely, there was a need to standardize products and systematizethe loan originat ion a nd m anage ment p roc ess. In tod ays environm ent, this has
bec om e a n imp erative. Sinc e the typ ica l deb tor is lost in the a nonymity of the
grea t m ass of individuals tha t owe banks or othe r consumer cred itors mo ney, it
is prohibitive to carry out an evaluation of the risk they represent based solely
on secrets of the trade, intuition, pure experience or even a rating process as
previously described; some kind of automatic classification of the quality of
deb tors has be c om e a nec essity.
Cred it sc oring is the first fo rma l approa ch to the p rob lem o f assessing the
credit
Shortly a fter the wa r, with the adve nt of automa tic c alculators that
eventu
risk of a single debtor in a scientific and automated way, in direct
respo nse to the need of p roc essing la rge volumes of app lica tions for relatively
small loans. During the nineteen thirties some mail order companies already
overwhelmed with demand, devised scoring systems in an attempt to
overcome the inconsistencies detected in the credit granting decisions of
d ifferent ana lysts. Thus, ob servable at tributes of g oo d or ba d deb to rs we re
identified, measured and numerically graded accordingly, to produce a final
score as a simple sum of the individual components. In many cases the score
was associated with a rating. When credit analytical talent and expertise
became scarce during WWII, companies engaged in consumer credit on ala rge sc a le, asked experience d ana lysts to write down the rules which led them
to d ec ide whethe r or not they would g ive som eone c red it. The result was a
hybrid assortment of different kinds of scoring systems and a variety of
c ond itions which experienc e ha d taug ht should be met , if a loan wa s to ha ve a
rea sonable c hanc e o f pe rforming8.
ally led to full fledged computers, the processes described became
sub jec t to a utom ation. The sc ientific bac kground to m od ern credit scoring is
provided by the pioneering work of R. A. Fisher(1936) who devised a statistical
technique called discriminant analysis, to differentiate groups in a population
through measurable attributes, when the common characteristics of the
7Mail order services began as clubs in Yorkshire in the 1800s, and were restricted to small segments of
the population for very special purposes.
8Note that this is very similar to an expert system.
10
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
11/47
members of the group are unobservable 9. In 1941 D. Durand recognized that
the same approach could be used to distinguish between good and bad
loans. Mating automation with statistical discriminant analysis was a natural
route for credit scoring to follow, eliminating the largely subjective rules of
thumb adhered to by analysts, regardless of their validity10
. Ob viously, the routeto success was heavily mined, since establishing creditworthiness of a debtor
using an automated process based on discriminant analysis was viewed as a
frontal attack on conventional banking wisdom, painstakingly acquired
throug h several millennia. The most famo us anec dote is tha t of E. F. Wond erlic,
president of Household Finance Corp. (HFC) in the early 1940s. Wonderlic was
well versed in statistics through his training in psychology, and tried to
implement credit scoring in HFC. His frustration at the rejection of the technique
is evident in his 1948 report where, after proving that credit scoring actually
worked, in a way that any audience technically qualified in statistical
techniques would have readily accepted, he pleaded: These figures from
actual results should prove conclusively to the most skeptical that the Credit
Guide Score is a too l11 which is consistently able to point out the degree of risk
in any personal loan, provided, of course, that it is correctly scored. Tha t his
c onc ern wa s we ll founde d wa s c orrob orated when it wa s later discovered that
ma ny ana lysts approved loa ns first, and then filled in the sc orecard to show a
passing score.
Perseverance prevailed however, and more systems were developed.
Initially, both the variables selected and the scores assigned were mainly judgmental, but the systematic application of the methods contributed with
uniformity of scoring criteria providing the credit origination process with sorely
needed c onsistenc y and p red ic tab ility. The ec onomics of p roc essing the
exponential growth in personal loan applications, along with increasingly
refined statistical techniques with the ensuing improvement of the predictive
power of the models, and the constant advances in available computing
power, which inexorably reduced application processing time, ultimately
forced the a c c ep ta nce o f sta tistica lly ba sed , automa ted sc oring system s. The
introduction of credit cards in the 1960s provided further impulse for the
extensive use of credit scoring in banks, retailers, and any large consumer
lend er. Curiously, the issua nc e in the U. S. of the Equa l Credit Op portunity Ac ts
9 Fisher was concerned with the problem of differentiating between two varieties of Iris by the size of the
plants and the origins of skulls by their physical measurements.
10 As previously mentioned, hybrid systems where scoring interacts with expert rules is the domain of
artificial intelligence. See for example Cuena, et. al. (1990).
11 The Credit Guide Score was the manual distributed through HFC indicating how credit applications
should be scored.
11
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
12/47
and its amendments in 1975-76 ensured the complete acceptance of credit
scoring. It became illegal to reject a loan on the basis of gender, religion, or
rac e, unless it wa s em pirica lly derived and sta tistica lly based . Thus, the
imp artiality in the a ssessment o f would b e d eb tors is ge nerally ac c ep ted as one
of credit scorings main virtues, and leave it to statistics to decide whether aparticular cha rac te ristic is riskier tha n another.
This has not gone unc ontested howe ver. In several countries d ifferent
types of activists have lobbied intensively to forbid the use of variables relative
to gender, race and creed arguing they could produce discriminatory results,
despite evidence to the contrary. In 1976 for example, Chandler and Ewert
showed that if gender were allowed to be a scoring variable, more women
than me n would have a c c ess to c red it12. Many c onsumers a lso o bjec t to c red it
scoring, feeling demeaned by being treated impersonally as just a number or
ano ther memb er of the g roup , and helpless to p lea their c ase w hen rejecte d.
The issue is rea lly one o f imp ersona l versus impartial which g ives rise to a
lively, endless and largely unsettled discussion, since deciding which variables
are po litic ally co rrec t and which a re not, and if and when p ersona l attention
is warranted for some cases, pertains more to the realms of ethics or business
practice and is therefore highly subjective 13. The va riab les ac tua lly used in
sc orec ards for co nsumer loa ns a re no sec ret, and anybo dy who has filled in an
application for a credit card, mortgage or car loan knows what they are:
Besides name and address, the relevant variables refer to education,
employment, how many years in the job, number of dependants, salary andother sources of income (investments etc.), properties and possessions (houses,
c ars etc .), othe r deb ts, ba nk and persona l refe renc es and so on. This
information is usually complemented with payment history data obtained from
the public registries.
Tod ay, it is lite ra lly prohib itive, both fo r considerations of financ ial risk
assessment and in terms of required manpower, to engage in consumer
lend ing ac tivities in any othe r wa y. To the c hag rin of d ie-hard trad itional
analysts, by 1963 default rates in consumer loans screened with credit scoring
techniques, had dropped by 50% or more.14 This suc c ess invariab ly led money
lenders to try credit scoring in other types of loans, e.g. personal, car or
mortgage loans. A case which is of particular interest, is the parallel effort by E.
Altman (1968) who first proposed a scoring technique to predict the risk of
12Among other things, the main reason is that in low income groups with part time employment, women
are generally better than men at repaying their debts.
13See for example Churchill and Nevin (1979), Capon (1982) and Saunders (1985) for arguments on both
sides of the table.
14See Meyers and Forgy(1963) and Churchill et. al.(1977).
12
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
13/47
c om panies going b ankrup t. The d isc ussion of Altman s z-sc ore method will help
to illustrate the c onc ep t, be fore go ing into c red it sc oring in a m ore rigorous wa y
in the next sec tion.
2.3. A c lassica l exa mp le o f Credit Scoring: Altma ns Z-Score.
As previously mentioned, as soon as it became accepted as a useful
tool to asses the creditworthiness of a debtor for consumer loans, the search for
other applications was on. In particular, Edward Altman (1968) pioneered the
application of discriminant analysis to the prediction of corporate bankruptcy
with what he called the Z-Sc ore. Using accounting data on healthy and
bankrupt companies, Altman calculated the financial ratios used by
ac c ounta nts and ana lysts to assess the solvenc y of b usiness firms, and ob ta ined
the following discriminant function to distinguish healthy companies from
those with a high probab ility of ba nkruptc y:
54321 998.420.107.3847.717.0 XXXXXZScoreZ ++++==
The va riab les tha t be st d isc riminate d b etw een hea lthy and ba nkrupt
c ompa nies were:
X1 = Working Capita l / Tota l assets.
X2= Reta ined Earnings / Tota l assets.
X3= EBITT
15 / Tota l assets.
X4= Ma rket Va lue o f Sha res / Tota l assets.
X5= Sa les / Tota l assets.
Altma n s sta tistica l stud y show ed tha t the Z-Sc ore w as Norma lly
distributed for both groups and the respective means of the distributions was
4.14 for hea lthy co mpanies and 0.15 for those tha t were b ankrup t. Thus, by
ob taining the Z-Score for a pa rtic ular comp any one c an d ec ide which group
it is more likely to belong (healthy or bankrupt) by performing the
c orrespond ing sta tistica l tests of hypothesis. This c om me nt und erlines one of the
main characteristics of all statistical techniques, and discriminant analysis is no
exception; namely, that absolute certainty as to what group a company
belongs to is impossible. One can only place a company16 in one group or the
other with a certain probability or confidence level. This mea ns tha t m ista kes
c an and will be m ade; but this is true o f any method . The imp ortant thing he re is
15Earnings before Interest and Taxes.16Obviously this refers to companies outside the sample that was used to estimate the model.
13
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
14/47
that in discriminant analysis, as opposed to more traditional techniques, the
actual probability of making a mistake and the associated costs can be
estimated.
Figure 2.3 illustrates the conc ep t. Spea king in genera l terms, disc riminantana lysis identifies a d istribution of Sc ores for goo d deb to rs and a nother for
bad debtors. Notice that the shaded area is ambiguous, in the sense that
there are small probabilities of comparable orders of magnitude, that debtors
with sc ores in this reg ion can belong to one g roup or the o the r. This points out to
the well known type one and type two errors in statistics, which in the
language of credit scoring means: 1)Placing the debtor in the healthy group
when it rea lly belong s in the b ad one (Type I error); or 2) Plac ing the d eb to r in
the bad group when it is ac tua lly goo d (Type II error). In the first c ase, a loa n
would be granted and some money would be lost if and when the default
oc c urs. In the sec ond c ase the loa n would be rejecte d and the c orrespo nding
profit fo reg one . Thus, when a score fa lls in the fuzzy a rea , in the dec ision o f
which group to place the debtor, there are two elements which must be
c onside red ; name ly, the p rob ab ilities of the de bto r belonging to o ne g roup or
the other, and the c osts assoc iated w ith misc lassific a tion.
BankruptBankrupt GroupGroup Healthy Group
ZZ--scorescore0.15 4.14
Type I and II Errors
Number
Numberofoffirms
firms
((Frequen
cy
Frequen
cy))
BankruptBankrupt GroupGroup Healthy Group
ZZ--scorescore0.15 4.14
Type I and II Errors
Number
Numberofoffirms
firms
((Frequen
cy
Frequen
cy))
Figure 2.3 The d isc riminating d istributions in
Altma ns Z-Score a nd type I a nd II errors.
The exam ple ac c entua tes the simp lic ity and p rac tica lity of cred it
scoring. As a weighted sum of the values of certain attributes of a debtor,
which are obtained directly from loan application formats, internal data and
public registries, once the data is captured, the processing is fully automatic.
Both the relevant attributes and their weights are obtained by statistical
techniques, using criteria that seek to differentiate as muc h as possib le, the
sc ores of hea lthy d eb tors from those tha t a re not. Thus, the c umb ersom e part o f
imp lementing c red it sc oring is the e stimation of the mo del and its ca lib ra tion to
ensure its p red ict ive capab ility. This proc ess is done d irec tly with ea c h particularba nks da ta and mode ls should b e reca librated pe riod ic ally to ensure tha t the
14
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
15/47
model adapts to economic conditions and the dynamics of the market. All of
this is explained in the next section, and the main techniques of discriminant
ana lysis a re p resented in som e d eta il in append ix A .
III. The Anatom y of Cred it Scoring Tec hniques.
In this sec tion we d isc uss the wha t and how of c red it sc oring. We
begin by describing the scorecard , followed by a discussion of its principal
elements and the relevant practical issues; namely, the applicants
characteristics and attributes, accept/reject cut-offs, the definition of good
and bad deb tors, sam ple d esign a nd so o n. The sec tion ends with a b rief
description of d isc riminant analysis, which is the main statistical tool used forbuilding scorecards17.
3.1. The Mec hanics of Cred it Sc oring.
As illustrated by the previous example, credit scoring is an eminently
pragmatic and empirical approach to the problem of risk assessment of
individual debtors. The e mp hasis is on p red ict ing d efa ults, not on e xplaining
why they do or do nt oc c ur. The b asic e lements of c red it sc oring a re: 1) A set of
categories of information called Cha rac teristics or Variab les with theircorresponding attributes, which qualify and/or quantify how each
c harac teristic app lies to an individual deb tor, 2) The po ints assoc ia ted to a
particular attribute as it pertains to an applicant and 3) A threshold or cut-off
value.
In credit scoring terms, characteristics refer to the questions asked,
whereas attributes are the specific answers to these questions, whether they be
provided by the applicants or obtained from other sources, such as internal
bank da ta or public reg istries. The wo rds charac teristic and va riab le are
synonymous18, a lthough the first is desc rip tive of the type o f information
comprised in each category, while the latter emphasizes the random nature of
the information within a particular category. For example, a typical
Characteristic or Variable considered in consumer loans is, Residentia l Sta tus.
Note however, tha t the ac tua l numb er of at tributes (possible a llowed a nswe rs
to a question) pertaining to this category can vary widely from one creditor to
ano ther. Wherea s one might b e ha pp y with only two (dichotomous) attributes
17A mo re d eta iled presenta tion will be found in App end ix A.
18 Characteristic would be the word used by the credit analyst using the model, whereas variab le wo uld be the wo rd used by the statistician do ing the estimation and c alibration.
15
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
16/47
like owner-renting, another might require more specifics such as: owner with no
mo rtgage , owner with a mo rtg ag e, rent unfurnished , rent furnished or living with
parents. Assuming for the mo ment tha t a ttributes are sc ored with integers from
naught to five, where higher is be tter, in the first c ase ow ner m ight me rit a five
while renting might merit a two. In the second case, five could be the scoreof owner no-mortga ge , four for owner with mortga ge and so o n do wn the
line to a zero for living with parents .
This little examp le illustrate s the typ ica l sc oring struc ture used in prac tice;
namely: Although, as was the case for Altmans z-score, characteristics with
single attributes scored with continuous values can be used, current practice
favors a finite number of attributes (at least two) associated with each
c harac teristic and in ge neral, the po ints assoc iated to e ac h a ttribute are two
digit numbers. Attributes associated to each characteristic are intended to be
comprehensive and mutually exclusive; i.e. only one in each characteristic is
pe rtinent to a n ap plic ant, and no question c an g o unanswered . In the nam e o f
practicality, parsimony is the name of the game; the less characteristics,
attributes and scores you can get away with, without sacrificing the predictive
capability of the model, the better. In principle, characteristics and attributes
are d ete rmined solely on the b asis of their pred ic tive c apac ity. As such, save for
legal restrictions such as those mentioned in the previous section, anything
goes: regardless of whether or not a characteristic conforms to intuition or
conventional wisdom, If it aids prediction it is included, and discarded
otherwise.
In its simplest form, the typical scoring sequence of an application, is to
score each characteristic with the points of the pertinent attribute, and add
over all the characteristics to obtain a total score. Now the third element
c om es into p lay: The to ta l sc ore is c om pared to the threshold o r c ut-off value
and, if it exceeds the threshold, the loan is granted; it is rejected otherwise.
3.2. The Scorec ard.
The sc oreca rd is the orga nizer of the mec hanica l proced ure of c red it
scoring described in the preceding section, and is best explained with an
example. Consider a simple scoring exercise in a small regional bank for a loan
to a small local business, and assume that only six characteristics are required
to asses the risk of app lic ants in this c red it ca tegory; namely: The Age o f the
Applicant, Years of the Business, Liquidity Ratio, Debt to Net Worth, Previous
Experience with the Bank, and Maximum Delinquency Ever from the Public
Reg istry. Tab le 2.1 shows how c ha rac te ristics, attributes and points are
orga nized in the correspond ing Score Card . Notice tha t charac teristics 3 & 5are directly related with the capacity to pay, 2 & 4 directly address the
16
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
17/47
willingness to pay, and the first two are behavioral and indirect indicators of
c apa c ity/ willingness, as d icta ted by experienc e. The ta b le shows the a ttributes
that correspond to each characteristic and their associated points.
The sc oring p roc ess is straight forwa rd . For example, consider a 43 yearold entrepreneur whos been in business for 8 years. His financials show a
liquidity ratio of 62% and a Debt to Net worth of 37%. Finally, His previous
experience with the bank shows no past due payments over 30 days and the
information from the public registry confirms this, showing maximum
delinquency ever to be thirty days. Referring to the scorecard presented in
ta b le 3.1, this app licants score is 12.5 :
SCORE = 2.0 + 1.5 + 1.0 + 3.5 + 2.0 + 2.5 = 12.5
Notic e tha t in the last row o f ea c h panel is a line lab eled NEUTRAL , which is
the c ut off referenc e for ea c h cha rac teristic; i.e. 1.5 for Age of Ap p lica nt , 1.0
for Years of Business and so on . The Neut ral att ribute serves several purpo ses;
first and foremost, the sum of their points (1.5 + 1.0 + 2.0 + 1.0 + 2.0 + 3.0 = 10.5) is
the o verall accept/reject threshold. Since h is sc ore (12.5) exceed s the thresho ld
(10.5), our 43 year old entrepreneur will be granted his loan. Notice that this is
the case, despite the fact that his points in two of the characteristics were
below the neutral value; namely (1.0 < 2.0) in Liquidity Ratio and (2.5 < 3.0) in
Ma ximum Delinquenc y Ever. Thus, the sec ond rea son tha t the Neut ra l
attribute is important is that it allows the analyst who oversees the automatic
scoring process, to detect where the weaknesses of the applicant lie, and
override the systems assessment (one way or the other) if warranted 19.
Ob viously, this only happens when the score s p roximity to the threshold c asts a
doubt on the verdict from the mechanical procedure. Although in most
insta nc es of c onsume r lend ing the rule is app lied b lind ly, in the case o f SMEs,
this grey area is in the order of 10% around the overall accept/reject
threshold. In ma ny cases, there a re even a utom at ic overrides p rog ram me d into
the system; in other words, if a score falls in the grey area, another set of tests
are performed automatically which either narrow down the grey area or
ultimately decide the issue mechanically. In countries like the U.K.20 lenders areencouraged to give rejected applicants the right to appeal, anticipating
mistakes such as typographical errors or incorrectly captured data.
Furthermore, a rejected applicant may consider that there is relevant
information outside that contemplated in the application form, and therefore
merits a persona l revision tha t c an help his c ase a nd c hange the dec ision.
19 Normally, in the best case he would have to have authorization from his supervisor. If theap plication is for a relatively large loan, he wo uld have to g o through a c om mittee.
20 The U.K. Guid e to Cred it Sc oring (2000).
17
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
18/47
Another important property of the Neutral attribute is that it honors its
name; that is, scoring a characteristic with the Neutral attributes points, does
not incline the b a lanc e one w ay or the othe r. This is bec ause in this c ase, the
points a re p ic ked so tha t they a re p red iction neutral; neither a id ing o r hurting
the app lica nts c ause, when a c harac te ristic is scored so. This is useful when forsom e reason o r othe r, the answe r provided by the a pp licant is amb iguo us. (e.g.
marking more than one attribute etc.), the default choice is the Neutral
attribute.
1. AGE OF APPLICANT(Owner)
2. YEARS OF THE BUSINESS(Company)
ATTRIBUTES POINTS ATTRIBUTES POINTS
Less than 30 years 0.0 Less than 2 years 0.030 years 34 years 0.5 2 years 3 years 11 months 0.535 years 39 years 1.5 4 years 4 years 11 months 1.040 years 49 years 2.0 5 years 9 years 11 months 1.550 years 59 years 2.5 10 years or more 2.560 years or more 2.0 No Answer 0.0No Answer 0.0 NEUTRAL 1.0
NEUTRAL 1.5
3. LIQUIDITY RATIO(Company)
4. PREVIOUS EXPERIENCE WITH THE BANK(Company)
ATTRIBUTES POINTS ATTRIBUTES POINTS
Less than .25 0.0 New client, Less than 6 months 1.0
.25 - .74 1.0 More than 30 past due 0.0
.75 - .99 1.5 No past due payments over 30 days 2.01.00 1.24 2.0 No past due payments 2.01.25 1.74 3.0 No enquiries 1.01.75 or more 3.5 NEUTRAL 1.0
Cannot be calculated 0.0NEUTRAL 2.0
5. DEBT / NET WORTH(Company)
6. MAXIMUM DELINQUENCY EVER(Company and/or Owner)
(Public Registry)
ATTRIBUTES POINTS ATTRIBUTES POINTS
Less than .25 4.0 No investigation (Q) 3.0.25 - .49 3.5 No record (R) 3.0.50 - .74 3.0 No Trade Lines (N) 2.5.75 - .99 2.5 No Usable Trade Line (I) 2.51.00 1.24 2.0 Charge Off 0.51.25 1.74 1.5 120 + Days Delinquent (1) 1.01.75 2.99 1.0 90 Days Delinquent (2) 1.53.00 or more 0.5 60 Days Delinquent (3) 2.0Cannot be calculated 0.5 30 Days Delinquent (4) 2.5NEUTRAL 2.0 Unknown Delinquency (5) 3.0
Current and Never Delinquent (7) 4.5Too new to Rate(8) 3.0All other (9) 3.0
NEUTRAL 3.0
18
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
19/47
Table 3.1: Simple Sc orec ard Example.21
21 This is a sample of six c ha rac teristics from a n ac tua l SME sc orec ard used in a Mexican Bank.The p oints have be en c hang ed in com plianc e with the ba nks req uest.
19
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
20/47
As to the sources of information, the example clearly shows how the
data in the form filled by the applicant is complemented with data from the
banks own records, and external sources; in this example, the Public Registry.
But there may be others. Information such as regional, economic and financialindicators for the industry where the applicant performs his activity, may have
predictive capacity as to the applicants expected performance, and should
be included in the sc orec ard.
3.3. Prac tica l co nside rations in building scorec ards.
Befo re g et ting into spec ific estima tion method s, som e p relimina ries a re in
order about sample design, the definitions of good and bad applicants
and c ut-off va lues. This is bec ause the a va ilab ility of da ta as we ll as the
decisions on the classification criteria of good and bad, and the type of
accept/reject rules dictated by business objectives and culture, will condition
the e stima tion m ethod ology c hosen a nd its rea c h.
3.3.1. Sam ple de sign a nd Rejec t inference.
As regards the sample, besides the obvious fact that it should be
random , rep resenta tive of individua ls tha t a re likely to app ly for a loa n the so
called through the door population and enough to guarantee statistical
significance, it is important to point out that there is an inherent bias in all creditsc oring metho do log ies; name ly, that the d ata on g ood and ba d risks be longs
mo stly to deb tors who se a pplic a tions we re a c c ep ted . This means tha t only the
probability of an accepted debtor going bad can be estimated, but the
inferred proba bility that a rejected ap plicant wa s in fac t g ood, is biased .
The stud y of rejec ts22 is only justified to the degree that it somehow
improves the accept/reject criteria; either because it distinguishes better
between good and bad, and/or is more in tune with the lenders business
ob jec tives; for example, by improving p rofitab ility. The only wa y to study thebehavior of rejects is to buy data; i.e. carry out an experiment where
applicants that would be rejected are in fact accepted. Because of the
implied costs, the studies conducted for the sake of acquiring information on
rejects are partial, in the sense that lenders are only willing to carry out such
experime nts on as small a samp le of rejec ts as possible. The tec hniques va ry
depending on how fast one wishes to acquire data on rejects and how much
the orga niza tion is willing to spend . Thus, if spee d is of the essenc e , the best
method is to accept all applications for a limited time, until a statistically
22 The inclusion of rejec ts in the samp le wa s first p rop osed by Reic hert, Cho and Wagner(1983).
20
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
21/47
representative sample of rejects is obtained. If the decision is to reduce costs
and spread them over time, what is generally done is to accept a random
numb er of rejec ts (e.g. eve ry tenth rejec t) until a go od samp le is ob ta ined . This
last scheme can be mixed with a scheme where all applicants with scores not
too far below the rejection threshold (say 5 to 10%) are a c c ep ted , and be lowthat, ac cep t a random number.23
Apart from this, the determination of sample size, and the proportion of
goods and bads that should be put in the sample, are estimated
according to standard statistical techniques. It is also standard practice to set
aside a control sample containing good and bad loans on which to back
test the model. Although the more the merrier, one must strike a balance
between available data, the size of the sample and its relevance in terms of
how w ell the da ta represents the c urrent market situat ion. This me ans tha t
information should be as recent as possible -12 to 24 months old - and that
there should be enough data to ensure statistical significance of the results.
According to Lewis (1992) sample sizes of 3000 where the proportion of goods
to bads is a round 50-50 is a good p lac e to sta rt; Sidd iqi (2006) says tha t a
samp le o f 2000 ea ch of go od s and ba ds is adeq uate. If rejec t study is desired ,
then an additional 2000 rejects should be considered in the sample. An
imp ortant p rac tica l conside ra tion is tha t typ ic a lly, the pop ulat ion is strongly one
sided sinc e the go od s outnum ber the b ads in ra tios of a t least twenty to o ne, so
that ac tually having sam ples with equa l numbers of g ood s and ba ds, may b e
difficult to obtain. In this case put in all the bads you can get, and enoughgoods so as to minimize statistical error.
Other issues on sample selection have to do with things like
seg menta tion, augm enta tion, ad justments and so on. The nee d fo r
segmentation arises from the fact that applicants in different regions, income
categories or lines of business, may behave differently to the same
c harac teristics and a ttributes, so tha t the we ights which c lassify them into go od
or ba d a re d ifferent. Augmenta tion has to d o w ith the fea sib ility and de sirability
of augmenting the sample as new data is received. Adjustment has to dowith over sampling when there is apriori knowledge on the goods/bads ratio
of the through the door population, and the differences with the available
data 24.
23 See for exam p le Thom as et. a l. Ch. 8. and Sidd iqi Ch. 6.24 There are many other technical considerations that must be addressed which cannot be
disc ussed here d ue to limita tions of spa c e. The read er who w ishes to e xpa nd o n the subjec t isenc ourag ed to c onsult the spe c ialized bib liog raphy e.g. Thom as et. al. Ch. 8 and Sidd iqi Ch.6.
21
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
22/47
3.3.2. The definition o f ba d .
Notice that the selection of the sample requires in all cases that the
good debtors can be distinguished from the bad which must be defined25
.Again, pragmatism, in the sense that the classification rule resulting from the
definition is easy to interpret and the performance of the accounts can be
trac ked over time, is essent ial. The d efinition m ust a lso c onform to p rod uc t
c harac teristics and business c ulture and ob jec tives, so tha t d efinitions can
vary widely from one creditor to another. For example, whereas a very
common rule is to classify any debtor delinquent in three consecutive
payments as bad, there are creditors that favor distinguishing between
different levels of delinquency as they are related to pricing and profitability.
For example, an account that is consistently thirty days overdue, but never rolls
over to two or three, can be very profitable if properly priced. Other definitions
c an a lso ta ke into a c c ount the d olla r va lue o f losses in case o f delinque nc y.
Notice that the definition adopted will have a direct impact on the
sample selection and size, for the reasons previously explained. In general, the
tighter the definition (e.g . write-off or 120 days delinquent ), the ha rder it
will be to get the required number of bad accounts for the sample, whereas
the op posite is true in looser definitions (e.g . 30 da ys in arrea rs ). This points
out the trade off between the precision in the definition of bad, and the data
c ount required for a g ood sta tistica l fit, and lea ds to the next top ic .
3.3.3. The c ut-o ff value .
Determining the accept/reject threshold is basically a balancing act
between data availability which is a structural constraint, and the business
priorities of the lender in terms of number of accounts that leads to the
ac hievement o f the o b jec tives of the firm. Thus, if lowering the c ut-off means
inc rea sing the numb er of a c c ounts and mo re p rofits in sp ite of highe r costs, and
profits a re the p rime o b jec tive, it should be done . Howeve r, there are ca seswhere profits dont even enter the equation. For example, the objective may
be to simp ly red uc e losses to a c erta in proportion of a sset va lue; or increa se the
approval rate to gain market share while maintaining costs at a certain level;
define a cut-off that improves the overall turn around and reduce
organizationalcosts or simply maximize the predictive power of the model. All
of these c riteria are c urrently used to dete rmine the threshold.
25By co nvention, go od is everything tha t isnt ba d .
22
-
8/6/2019 Mrquez , Javier - An Introduction to credit scoring for small and medium size enterprises
23/47
Cut-off parameters are obtained directly from the statistical estimation
procedure used to fit the model to the sample data, and minimally, should
correspond to expected accept and reject rates in line with company
objectives. A rigorous analysis however, demands the examination of other
metrics where the impact of the accept/reject rates are associated to thecorresponding expected ratio of goods to bads of the accepted accounts,
and the impact of the rule on profitability, revenues and costs, should be
c arefully a ssessed .
The simp lest c ut-o ff rule w as illustrated in sec tion 3.2, and it is c a lled a
hard low side cut-off because it leaves no room for overriding the
mec hanica l ac cep t/ reject d ec ision. As mentioned in that sec tion, bec ause we
are dealing with uncertainty, the most common rule is to define a gray area
around the hard c ut-off of 5 to 10% where a pp lic a tions whose sc ores lie in this
interval, are referred to autom at ic ove rride tests and / or ma nual sc rutiny for the
final dec ision. Som e orga niza tions use mo re c om plex c ut-off rules, assoc iating
scores to different credit limits. For example, suppose that Tmin=T0 ,, T1, T2,
.Tn=Tmaxare the finite numb er n of thresholds or cut-offs defined by a lend er
to determine credit limits Li dep end ing on a pp lica nts sc ores. Then , the rule
c ould go along the follow ing lines26:
niTScoreifL
TTifL
Tif
LimitCredit iii ,...2,1;Score
Score0
maxmax
1
min
=
>