dm performance: decile (lift) analysis. decile maximization(dmax) objective find model f(x)...

22
DM Performance: Decile (Lift) Analysis Decile N um berof Custom ers N um berof R esponses R esponse Rate (%) Cumulative R esponses Cumulative R esponse R ate (% ) Cumulative R esponse Lift top 2500 2179 87.2 2179 87.2 447 2 2500 1753 70.1 3932 78.6 403 3 2500 396 15.8 4328 57.7 296 4 2500 111 4.4 4439 44.4 228 5 2500 110 4.4 4549 36.4 187 6 2500 85 3.4 4634 30.9 158 7 2500 67 2.7 4701 26.9 138 8 2500 69 2.8 4770 23.9 122 9 2500 49 2.0 4819 21.4 110 bottom 2500 55 2.2 4874 19.5 100 Total 25,000 4874 19.5 100. * e performanc avg. overall decile e performanc avg. cum. = decile Lift Cumulative

Upload: abel-chambers

Post on 15-Jan-2016

226 views

Category:

Documents


0 download

TRANSCRIPT

  • DM Performance: Decile (Lift) Analysis

    Decile

    Number of Customers

    Number of Responses

    Response Rate

    (%)

    Cumulative Responses

    Cumulative Response Rate (%)

    Cumulative Response Lift

    top

    2500

    2179

    87.2

    2179

    87.2

    447

    2

    2500

    1753

    70.1

    3932

    78.6

    403

    3

    2500

    396

    15.8

    4328

    57.7

    296

    4

    2500

    111

    4.4

    4439

    44.4

    228

    5

    2500

    110

    4.4

    4549

    36.4

    187

    6

    2500

    85

    3.4

    4634

    30.9

    158

    7

    2500

    67

    2.7

    4701

    26.9

    138

    8

    2500

    69

    2.8

    4770

    23.9

    122

    9

    2500

    49

    2.0

    4819

    21.4

    110

    bottom

    2500

    55

    2.2

    4874

    19.5

    100

    Total

    25,000

    4874

    19.5

  • Decile Maximization(DMAX)ObjectiveFind model f(x) (predictor variables x)such that performance in upper deciles (specified depth-of-file) is maximized

    Explicitly manages resource constraint mailings to particular depths-of file Performance at different mailing depthsmodels optimized for different mailing depths

  • DMAX: Illustrative Example

  • $10

    $4

    $2

    $6

    $9

    $7

    $3

    $1

    $5

    $8

    OLS($28)

    DMAX 40% ($32)

    OLS: .14 X1 + .06 X2DMAX 40%: .19 X1 + .07 X2

    Profit

    X1

    X2

    $10

    45

    5

    $9

    35

    21

    $8

    31

    38

    $7

    30

    30

    $6

    6

    10

    $5

    45

    37

    $4

    30

    10

    $3

    23

    30

    $2

    16

    13

    $1

    12

    30

  • Case II: 2% Response RateCum Response Lift Comparison

  • Response Model: Experimental StudyTwo aspects to fitnessdecile performance, overall fit to dataModeling ResponseModel =1/(1+exp(-wx))Fitness f=w1D + w2CDecile performance (responders in top d deciles) Fit-to-data (Hosmer-Lemeshow goodness-of-fit)

    Bhattacharyya, S., Direct Marketing Response Models using Genetic Algorithms,KDD-98 Proceedings.

  • Top decile (DMAX 10%)2nd decile (DMAX 20%)3rd decile (DMAX 30%)7th decile (DMAX 70%)

    Cum

    Lift

    100%dmax 0%fit

    75%dmax 25% fit

    50%dmax 50% fit

    Logit

    Train

    453.4

    423.8

    417.2

    407

    Test

    352.3*

    346.0*

    330.1

    328

    Cum

    Lift

    100%dmax 0%fit

    75%dmax 25% fit

    50%dmax 50% fit

    Logit

    Train

    335.1

    317.6

    304

    297

    Test

    258.9*

    269.5

    253.5*

    247

    Cum

    Lift

    100%dmax 0%fit

    75%dmax 25% fit

    50%dmax 50% fit

    Logit

    Train

    269.9

    252.5

    243.1

    237

    Test

    212.6

    230.2*

    225.1*

    207

    Cum

    Lift

    100%dmax 0%fit

    75%dmax25% fit

    50%dmax50% fit

    Logit

    Train

    138.8

    132

    127.9

    129

    Test

    118.5

    126.1*

    125.9*

    125

  • Learning with ResamplingFitness as average of performance over multiple sub-samplescross-validationhigh variance in performancesampling with replacementmember-wise, generation-wise, run-wiseDMAXLogit

    Improvement10.1 %10.9 %13.0 %-0.2 %

    Cum Lift

    First

    Decile

    Second Decile

    Third Decile

    Seventh Decile

    Train

    409

    293

    240

    125

    Test

    361

    274

    234

    124

    Train

    407

    297

    237

    129

    Test

    328

    247

    207

    125

  • Modeling on Multiple ObjectivesModel [y1,..,yk] = f (x) simultaneously optimize on multiple objectives

    Some common DM modeling desirablesresponse and high purchase revenueslikely churners with high usage of serviceshigh tenure and usage purchase and non-returncross-selling, etc.

    [or CPR (Combined Profit and Response) Models]

  • Multiple objectivesTraditional approachesmultiple single-objective models, and combineweighted average of objectives

    conflicting objectivesdifferent levels of tradeoffs frontier of non-dominated solutionschoice of final model based on diverse decision-maker objectives, can also be subjective

  • Pareto FrontierNon-dominated solutionsmultiple objectives i, f a(x) better than f b(x) if

    Single GA run obtains tradeoff frontier of non-dominated solutions f k(x)

    12non-dominated modelsdominated models

  • Experimental Study: DataCellular-phone provider seeking to identify potential high-value churnerstwo dependent variablesbinary Churn variable continuous variable measuring revenue ($)predictors: minutes-of-use (peak and off-peak), average charges, and payment information, etc.obtained after EDA, normalized to 0 mean 1 s.d

    50,000 sample: 25,000 for training, 25,000 for test set

  • Multiple Objectives: PerformanceChurn lift model capturing more churners in top deciles is better$-Lift

    model giving high revenue customers in upper deciles is better

    overall modeling objectivemaximize expected revenue saved through identification of high-value churnersChurn-Lift * $-Lift

  • Decile 1 (trg)0501001502002503003504000100200300400500600Churn-Lift$-LiftGPGALogisticOLS5 independent GA runs, aggregate the sets of non-dominated solutionsExperimental StudyNon-dominated models: Decile 1 (Training)

  • Experimental StudyNon-dominated models: Decile 1 (Test)Decile 1 (Test)0501001502002503003504000100200300400500Churn-Lift$-LiftGPGALogisticOLS

  • Experimental StudyNon-dominated models: Decile 2 (Test)Decile 2 (Test)050100150200250300050100150200250300350400450Churn-Lift$-LiftGPGALogisticOLS

  • Experimental StudyNon-dominated models: Decile 3 (Test)Decile 3 (Test)050100150200250050100150200250300350Churn-Lift$-LiftGPGALogisticOLS

  • Experimental StudyNon-dominated models: Decile 7 (Test)GPGALogisticOLS

    Chart5

    131.444126.65666.6971421669136

    133.836129.994

    134.606136.077

    134.596136.077

    107.663132.357

    137.061132.357

    136.797136.133

    134.813133.268

    131.208135.15

    136.571134.586

    136.945126.387

    137.061130.8

    137.093133.839

    137.004114.185

    137.133134.547

    133.155135.942

    136.514133.789

    137.025134.93

    137.207133.984

    136.958135.821

    136.702135.821

    136.807127.813

    136.894131.768

    136.272135.897

    137.233126.873

    131.595130.308

    135.355136.04

    136.113136.573

    135.75124.796

    136.13130.783

    136.111129.207

    135.48131.475

    136.336132.573

    136.576127.702

    135.606131.403

    135.719132.813

    134.725124.377

    135.726

    136.531

    134.449

    136.233

    136.478

    135.665

    133.47

    135.2

    GP

    GA

    Logistic

    OLS

    Churn-Lift

    $-Lift

    Decile 7 (Test)

    Decile 1

    GPParetoDMAX -- CHURN ExampleTrg_Tot-$:10079910.5Tst_Tot-$:10049453Logistic:455.2113.03447.07111.8min207.716498976213.39543057LogisticTrg514.51256

    Trg_Tot-Resp:4789Tst_Tot-Resp:4874Min138.44243.9768132.1346.0013max822.5447956797.76600429LogisticTst499.82426

    Decile 198Total SolutionsMax:472.332368.194464.711361.475Product of LiftsProdcut of Lifts

    SizeResp-fit$-fitTrgNRespTrgRLiftTrg-$Trg$LiftTstNRespTstRLiftTst-$tst$LiftTrgRespLiftTrg$LiftTestRespLiftTest$LiftTrgTestTrgRespLiftTrg$LiftTestRespLiftTest$LiftTrgTest

    40.4627270.0964932216462.72797264696.49352199451.169935213.993.0612462.72796.4935451.16993.0612446.501477745419.863285428Logistic:455.2113.03447.07111.8514.51256499.82426

    40.3934020.1865181884393.4021880087.9186.5181869383.4631905040.4189.567393.402186.518383.463189.567733.76554236726.91930521OLS119367116361418.76

    40.3313840.2482151587331.3842501982.2248.2151570322.1172476077.4246.389331.384248.215322.117246.389822.5447956793.66085513

    40.363750.2196221742363.752213767.5219.6221737356.3812190189.7217.941363.75219.622356.381217.941798.875025776.70031521X1X2X3X4

    40.2628940.3002071259262.8943026055.7300.2071216249.4873075597.2306.046262.894300.207249.487306.046789.22619058763.54498402BestGa Solution0.07160120.362166-0.1900620.200957

    40.2086030.338122999208.6033408244.5338.122974199.8363409425.4339.265208.603338.122199.836339.265705.33263566677.9736054

    40.2869070.2842891374286.9072865609.5284.2891335273.9022866414.2285.231286.907284.289273.902285.231815.64504123781.25341362

    40.3236580.2483971550323.6582503816.5248.3971545316.9882474555.4246.238323.658248.397316.988246.238803.95676226780.54491144

    40.4121950.1630211974412.1951643241.3163.0211948399.6721633018.3162.498412.195163.021399.672162.498671.96441095649.45900656

    40.2441010.3180491169244.1013205907.8318.0491128231.4323197463.3318.173244.101318.049231.432318.173776.36078949736.35413736

    40.2441010.3180491169244.1013205907.8318.0491128231.4323197463.3318.173244.101318.049231.432318.173776.36078949736.35413736

    40.3082060.2622731476308.2062643690.4262.2731445296.4712653854.6264.08308.206262.273296.471264.08808.34112238782.9206168

    40.1482560.365106710148.2563680231.4365.106693142.1833612045.1359.427148.256365.106142.183359.427541.29155136511.04409141

    40.3230320.2514321547323.0322534414.2251.4321530313.9112514442250.207323.032251.432313.911250.207812.20581824785.42729577

    40.2695760.2971121291269.5762994859.6297.1121246255.6423024311.3300.943269.576297.112255.642300.943800.94264512769.33670406

    40.2808520.284551345280.8522868239284.551297266.1062885153.8287.096280.852284.55266.106287.096799.164366763.97968176

    40.1967010.341179942196.7013439055.4341.179921188.9623392303.2337.561196.701341.179188.962337.561671.10250479637.86201682

    40.1967010.341179942196.7013439055.4341.179921188.9623392303.2337.561196.701341.179188.962337.561671.10250479637.86201682

    40.1891840.349335906189.1843521262.5349.335883181.1653456714.5343.97189.184349.335181.165343.97660.8859264623.1532505

    40.254750.3066611220254.753091112.1306.6611180242.1013116521.3310.119254.75306.661242.101310.119781.2188975750.80120019

    40.1937770.34661928193.7773493801346.61913187.323461889344.485193.777346.61187.32344.485671.6504597645.289302

    40.1557740.363384746155.7743662882.2363.384738151.4163576562.2355.896155.774363.384151.416355.896566.05779216538.88348736

    40.4572980.1127792190457.2981136802.9112.7792170445.221138334113.273457.298112.779445.22113.273515.73611142504.3140506

    40.3604090.2204061726360.4092221672.4220.4061730354.9452215292.2220.439360.409220.406354.945220.439794.36306054782.43720855

    40.3136350.2618351502313.6352639275261.8351486304.8832629568.4261.663313.635261.835304.883261.663821.20620225797.76600429

    40.3343080.2443221601334.3082462747.8244.3221631334.6332389296.4237.754334.308244.322334.633237.754816.78799176795.60334282

    40.4090620.1710151959409.0621723816.3171.0151958401.7231733230.4172.47409.062171.015401.723172.47699.5573793692.8516581

    40.4355820.1411352086435.5821422625.3141.1352083427.371391629.8138.478435.582141.135427.37138.478614.7586557591.8134286

    40.2328250.3234651115232.8253260495.9323.4651092224.0463221249.2320.54232.825323.465224.046320.54753.10738625718.1570484

    40.3900610.1909071868390.0611924330.2190.9071873384.2841928570.7191.908390.061190.907384.284191.908744.65375327737.47173872

    40.2775110.2871091329277.5112894030.3287.1091297266.1062890644.8287.642277.511287.109266.106287.642796.75905699765.43262052

    40.3856760.1925171847385.6761940559.1192.5171820373.411963671.3195.401385.676192.517373.41195.401742.49186492729.6468741

    40.3977870.1782281905397.7871796521.1178.2281922394.3371775199.3176.646397.787178.228394.337176.646708.96781436696.58053702

    40.2100650.3364191006210.0653391069.1336.419998204.763340330.5332.389210.065336.419204.76332.389706.69857235680.5997164

    40.1683020.35799806168.3023608509.2357.99776159.2123548982.6353.152168.302357.99159.212353.152602.5043298562.26036224

    40.2937980.2775191407293.7982797363.1277.5191381283.342801615.7278.783293.798277.519283.34278.783815.34527162789.9037522

    40.4387140.1388782101438.7141399877.9138.8782097430.2421352922.1134.626438.714138.878430.242134.626609.27722892579.21759492

    40.2896220.2826141387289.6222848725.9282.6141351277.1852846465.4283.246289.622282.614277.185283.246818.51231908785.1154251

    40.3631240.2202071739363.1242219666.4220.2071734355.7652203345.4219.25363.124220.207355.765219.25799.62446668780.0147625

    40.4723320.0439772262472.332443281.943.97682261463.89462287.446.0013472.33243.9768463.8946.0013207.716498976213.39543057

    40.4278560.1520992049427.8561533142152.0992048420.1891523788.9151.629427.856152.099420.189151.629650.76469744637.12837881

    40.448110.1265292146448.111275396.4126.5292136438.2441242617.5123.65448.11126.529438.244123.65566.9891019541.888706

    40.3499690.2315821676349.9692334322.6231.5821678344.2762299970.5228.865349.969231.582344.276228.865810.46520958787.9272674

    40.2079770.339139996207.9773418487.9339.139988202.7083370795.1335.421207.977339.139202.708335.421705.33111803679.92520068

    40.3061180.2679461466306.1182700874.4267.9461442295.8562694018.7268.076306.118267.946295.856268.076820.23093628793.11893056

    40.3781580.2034141811378.1582050396203.41418183732023618.6201.366378.158203.414373201.366769.22631412751.09518

    40.3925660.1884841880392.5661899897.8188.4841871383.8741930672192.117392.566188.484383.874192.117739.92409944737.48721258

    40.4721240.0507012261472.124511057.550.70062265464.711507046.250.4551472.12450.7006464.71150.4551239.369700744234.470399761

    40.1883480.35075902188.3483535529.3350.75883181.1653486933.7346.977188.348350.75181.165346.977660.63061628.60088205

    40.3756530.206911799375.6532085637.2206.911780365.2032094396.2208.409375.653206.91365.203208.409777.2636223761.11592027

    40.2198790.3288541053219.8793314819328.8541028210.9153290162.8327.397219.879328.854210.915327.397723.08088666690.52938255

    40.1384420.368194663138.4423711358.9368.194644132.133632621.6361.475138.442368.194132.13361.475509.73513748477.6169175

    40.216120.3356811035216.123383630.7335.6811015208.2483352712.6333.621216.12335.681208.248333.621725.4737772694.75906008

    40.449990.1191312155449.991200824.8119.1312159442.9631198903.8119.3449.99119.131442.963119.3536.0775869528.454859

    40.2301110.3240711102230.1113266609.4324.0711088223.2253219066.9320.323230.111324.071223.225320.323745.72301881715.04101675

    40.1768640.35514847176.8643579782.3355.14815167.2143545114352.767176.864355.14167.214352.767628.1148096589.87581138

    40.2273960.3249681089227.3963275645.7324.9681062217.8913285239.2326.907227.396324.968217.891326.907738.96423328712.30093137

    40.1825020.35246874182.5023552769.9352.46870178.4983471877.4345.479182.502352.46178.498345.479643.2465492616.67310542

    40.2253080.3271471079225.3083297615.4327.1471031211.5313320318.1330.398225.308327.147211.531330.398737.08836276698.89419338

    40.2785550.2864331334278.5552887216.9286.4331301266.9272886292.7287.209278.555286.433266.927287.209797.87344315766.63836743

    40.3662560.2140651754366.2562157756.1214.0651762361.512145411.6213.485366.256214.065361.51213.485784.0259064771.7696235

    40.3842140.1988631840384.2142004518.5198.8631843378.1292002487.9199.263384.214198.863378.129199.263764.05948682753.47118927

    40.3566510.2253871708356.6512271880.3225.3871703349.4052260538.2224.941356.651225.387349.405224.941803.84498937785.95510105

    40.4702440.088032252470.244887331.588.02972255462.659872166.286.7874470.24488.0297462.65986.7874413.954382468401.529716966

    40.4545830.1131352177454.5831140391.9113.1352171445.4251141127.8113.551454.583113.135445.425113.551514.29247705505.78454175

    40.2090210.3367381001209.0213394290.3336.738976200.2463397092.3338.038209.021336.738200.246338.038703.85313498676.90757348

    40.4240970.1555832031424.0971568257.8155.5832029416.2911548347.8154.073424.097155.583416.291154.073659.82283551641.39203243

    40.3424510.2382341640342.4512401380.8238.2341627333.8122375080.8236.339342.451238.234333.812236.339815.83471534788.92794268

    40.4698270.0886282250469.827893367.288.62852249461.428884393.488.0041469.82788.6285461.42888.0041416.400622695406.075558548

    40.42890.1498532054428.91510509149.8532056421.831495566.1148.821428.9149.853421.83148.821642.719517627.7716243

    40.2035920.339693975203.5923424076.2339.693943193.4763410432.2339.365203.592339.693193.476339.365691.58777256656.5898274

    40.4704530.0857322253470.453864166.185.73152251461.838838633.583.4507470.45385.7315461.83883.4507403.326413695385.407043866

    40.2031740.340821973203.1743435441.5340.821970199.0153407218.8339.045203.174340.821199.015339.045692.45965854674.75040675

    40.4491540.1221852151449.1541231613.9122.1852147440.5011199956.7119.405449.154122.185440.501119.405548.7988149525.98021905

    40.2743790.2921711314274.3792945059.3292.1711262258.9252985715.1297.102274.379292.171258.925297.102801.65586809769.2713535

    40.2447280.3127451172244.7283152439.2312.7451132232.2533162132.7314.657244.728312.745232.253314.657765.3745836730.80032221

    40.2484860.3114621190248.4863139510.4311.4621144234.7153170328.6315.473248.486311.462234.715315.473773.93946532740.46245195

    40.196910.340822943196.913435451.8340.822910186.7053431169.6341.428196.91340.822186.705341.428671.1126002637.4631474

    40.4583420.1126742195458.3421135748.3112.6742180447.2711119129.5111.362458.342112.674447.271111.362516.43226508498.08993102

    40.1536860.364155736153.6863670650.2364.155714146.4923584970.4356.733153.686364.155146.492356.733559.6552533522.58530636

    40.4032160.1721791931403.2161735549.2172.1791937397.4151714058.1170.562403.216172.179397.415170.562694.25327664677.8389723

    40.3017330.2706911445301.7332728543.1270.6911428292.9832730513.7271.708301.733270.691292.983271.708816.76407503796.05824964

    40.4197120.156122010419.7121573680.3156.122015413.4181579064.5157.129419.712156.12413.418157.129655.2543744649.59956922

    40.370850.2118321776370.852135245.2211.8321781365.4082108272.6209.79370.85211.832365.408209.79785.578972766.5894432

    40.3489250.2319351671348.9252337886.4231.9351667342.0192313301230.192348.925231.935342.019230.192809.27919875787.30037648

    40.4679470.09082241467.947915255.390.79992237458.966911187.190.6703467.94790.7999458.96690.6703424.895408053416.145849098

    40.2745880.287271315274.5882895651.5287.271295265.6962897764.2288.35274.588287.27265.696288.35788.8089476766.134416

    40.3150970.2605951509315.0972626769.9260.5951507309.1922584967257.225315.097260.595309.192257.225821.12702715795.319122

    40.3996660.1753871914399.6661767888.3175.3871924394.7481755484.2174.685399.666175.387394.748174.685700.96220742689.5655438

    40.2165380.3326851037216.5383353438.7332.6851009207.0173344146.5332.769216.538332.685207.017332.769720.3894453688.88840073

    40.1875130.350881898187.5133536851.6350.881879180.3453498551.2348.133187.513350.881180.345348.133657.94748953627.84045885

    40.235540.3197431128235.543222984.8319.7431090223.6363198533.3318.279235.54319.743223.636318.279753.1226622711.78642444

    40.2915010.2819011396291.5012841539.2281.9011350276.982845721.9283.172291.501281.901276.98283.172821.74423401784.3298056

    40.1624560.359823778162.4563626987.6359.823755154.9043584791.9356.715162.456359.823154.904356.715584.55405288552.5658036

    40.2597620.3023761244259.7623047922.7302.3761196245.3843077461.6306.232259.762302.376245.384306.232785.45794512751.44433088

    40.2597620.3023761244259.7623047922.7302.3761196245.3843077461.6306.232259.762302.376245.384306.232785.45794512751.44433088

    40.2585090.3034451238258.5093058700.5303.4451189243.9473082852306.768258.509303.445243.947306.768784.43263505748.35133296

    40.2702030.2950161294270.2032973730.5295.0161250256.4633006773.1299.198270.203295.016256.463299.198797.14208248767.33216674

    Decile 1

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    Decile 2

    000

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    GA

    Logit

    OLS

    Churn-Lift

    $-Lift

    Decile 1 (Trg)

    Decile 3

    000

    00

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    GA

    Logit

    OLS

    Churn-Lift

    $-Lift

    Decile 1 (Test)

    Decile 7

    GPParetoDMAX -- CHURN ExampleTrg_Tot-$:10079910.5Tst_Tot-$:10049453Logistic:410.106494048971.8670092483403.36479277872.5681359646min353.816010045348.240158376

    Trg_Tot-Resp:4789Tst_Tot-Resp:4874Min143.24586.8045136.02886.7752max563.7940533550.35101888

    Decile 1112Total SolutionsMax:407.601273.441401.313271.557Product of LiftsProdcut of Lifts

    SizeResp-fit$-fitTrgNRespTrgRLiftTrg-$Trg$LiftTstNRespTstRLiftTst-$tst$LiftTrgRespLiftTrg$LiftTestRespLiftTest$LiftTrgTestTrgRespLiftTrg$LiftTestRespLiftTest$LiftTrgTest

    40.8051790.20993856402.5892115775.2104.953853395.2612128202.3105.886402.589104.95395.261105.886422.5171555418.52606246Logistic:410.106494048971.8670092483403.36479277872.5681359646294.7312720059292.7143112565

    40.7567340.2613143624378.3672634017.9130.6573596368.8962685740.5133.626378.367130.657368.896133.626494.36297119492.94096896OLS108272293.76

    40.8152020.1736093904407.6011749962.386.80453912401.3131744086.386.7752407.60186.8045401.31386.7752353.816010045348.240158376

    40.7028610.3033823366351.433058060.8151.6913341342.7373073114.8152.9351.43151.691342.737152.9533.0876813524.044873X1X2X3X4

    40.5654630.3958052708282.7313989676.4197.9022689275.8513967984.2197.423282.731197.902275.851197.423559.53030362544.59331973BestGa Solution1.453830.63928-0.1340520.352144

    40.7264560.283173479363.2282854327.8141.5853457354.6372881006.6143.341363.228141.585354.637143.341514.2763638508.34022217

    40.6228860.3583542983311.4433612177.4179.1772957303.3443536741.8175.967311.443179.177303.344175.967558.03422411533.78533648

    40.4297350.4889122058214.8674928184.5244.4562042209.4794838609.1240.74214.867244.456209.479240.74525.25527352504.2997446

    40.4696180.4627552249234.8094664527.4231.3772230228.7654566030.3227.178234.809231.377228.765227.178543.29401993519.7037517

    40.6794740.3230073254339.7373255878161.5033191327.3493202498.6159.337339.737161.503327.349159.337548.68544711521.58807613

    40.486740.4519652331243.374555769.3225.9832313237.2794520006.4224.888243.37225.983237.279224.888549.9748271533.61199752

    40.5101270.4404632443255.0644439831.8220.2322410247.234431788.5220.499255.064220.232247.23220.499561.73254848545.1396777

    40.6086870.3681852915304.3433711269.3184.0922903297.8053662946.6182.246304.343184.092297.805182.246560.27111556542.7377003

    40.6086870.3681852915304.3433711269.3184.0922903297.8053662946.6182.246304.343184.092297.805182.246560.27111556542.7377003

    40.5180620.4339732481259.0314374404.2216.9862451251.4364370190.7217.434259.031216.986251.436217.434562.06100566546.70735224

    40.5095010.4411132440254.754446382220.5572412247.4354427292.6220.275254.75220.557247.435220.275561.8689575545.03744625

    40.7080810.2977433391354.0413001223.3148.8723370345.7123013780.9149.948354.041148.872345.712149.948527.06791752518.38822976

    40.6013780.3727982880300.6893757772.4186.3992841291.4443707193184.448300.689186.399291.444184.448560.48128911537.56262912

    40.5627480.3980892695281.3744012696.8199.0442670273.9024001425.1199.087281.374199.044273.902199.087560.05806456545.30327474

    40.2869070.5464091374143.4545507752.1273.2041336137.0545451291.2271.223143.454273.204137.054271.223391.92206616371.72197042

    40.7059930.3007013381352.9963031037.5150.353358344.4813045181.2151.51352.996150.35344.481151.51530.729486521.9231631

    40.5671330.3954642716283.5673986237.5197.7322671274.0053992114.5198.623283.567197.732274.005198.623560.70270044544.23695115

    40.3789940.5119311815189.4975160213.9255.9651770181.5765074012252.452189.497255.965181.576252.452485.04599605458.39224352

    40.4213820.493682018210.6914976248.5246.841995204.6574885772.9243.087210.691246.84204.657243.087520.0696644497.49456159

    40.3766970.5149181804188.3485190330.2257.4591773181.8835101397.5253.815188.348257.459181.883253.815484.91887732461.64633645

    40.286490.5468821372143.2455512525.1273.4411326136.0285457996.1271.557143.245273.441136.028271.557391.69056045369.39355596

    40.2898310.54631388144.9155506651.7273.151350138.495450891.4271.203144.915273.15138.49271.203395.8353225375.5890347

    40.6197540.3605412968309.8773634221180.272930300.5743575364.9177.889309.877180.27300.574177.889558.6152679534.68808286

    40.3616620.5187591732180.8315229043.1259.3791708175.2155127098.6255.093180.831259.379175.215255.093469.03763949446.96119995

    40.3424510.5300151640171.2265342500.1265.0071611165.2655255452.5261.48171.226265.007165.265261.48453.76088582432.134922

    40.402380.4998821927201.195038762.4249.9411880192.864963969.5246.977201.19249.941192.86246.977502.8562979476.3198422

    40.7811650.2391153741390.5832410255.5119.5573724382.0272452272122.01390.583119.557382.027122.01466.96931731466.1111427

    40.5498020.4063452633274.9014095923.7203.1732624269.1834073871.4202.691274.901203.173269.183202.691558.52460873545.60971453

    40.42180.4933012020210.94972430.3246.6511998204.9654885391.2243.068210.9246.651204.965243.068520.186959498.2043262

    40.2935890.5450241406146.7955493793.2272.5121367140.2345444448.8270.883146.795272.512140.234270.883400.0339904379.87006622

    40.3455840.5277981655172.7925320160.6263.8991633167.5225214547.7259.444172.792263.899167.522259.444455.99636008434.62577768

    40.46920.4658682247234.64695906.8232.9342251230.9194633713.3230.546234.6232.934230.919230.546546.463164532.37451774

    40.4554190.4759622181227.7094797655.2237.9812185224.1494682750.7232.985227.709237.981224.149232.985541.90415529522.23354765

    40.7485910.2665253585374.2952686543.4133.2623565365.7162720570.6135.359374.295133.262365.716135.359498.7930029495.02952044

    40.8135310.1975343896406.7661991127.298.76713904400.4921966409.497.8366406.76698.7671400.49297.8366401.750981986391.827756072

    40.5295470.4238822536264.7734272695.4211.9412492255.6424283978.5213.145264.773211.941255.642213.145561.16254393544.8881409

    40.7331380.2765593511366.5692787690.9138.283493358.332811224139.87366.569138.28358.33139.87506.8916132501.196171

    40.7932760.227843799396.6382296606.7113.923790388.7982329018.8115.878396.638113.92388.798115.878451.8500096450.53134644

    40.4840260.4551372318242.0134587740.7227.5692293235.2284541499.2225.958242.013227.569235.228225.958550.74656397531.51648424

    40.6109840.3667712926305.4923697014.3183.3852906298.1123666578.6182.427305.492183.385298.112182.427560.2265042543.83677824

    40.7738570.2456693706386.9282476326.2122.83536753772558458.1127.293386.928122.835377127.293475.2830088479.89461

    40.6876170.3148223293343.8093173374.5157.4113271335.5563178360.5158.136343.809157.411335.556158.136541.19318499530.63483616

    40.3683440.5184491764184.1725225921.9259.2251750179.5245162020.8256.831184.172259.225179.524256.831477.419867461.07328444

    40.4048860.4965361939202.4435005034.7248.2681914196.3484935534245.562202.443248.268196.348245.562502.60118724482.15607576

    40.4583420.4726312195229.1714764075.6236.3152200225.6874684327233.064229.171236.315225.687233.064541.56544865525.99514968

    40.3904780.5073131870195.2395113672.2253.6571831187.8335032476.8250.386195.239253.657187.833250.386495.23739023470.30753538

    40.3574860.5231811712178.7435273616.7261.591692173.5745221403.2259.785178.743261.59173.574259.785467.5738137450.9192159

    40.3531010.5250321691176.555292274.2262.5161654169.6765250099.9261.213176.55262.516169.676261.213463.471998443.21576988

    40.6517020.33633121325.8513389874.9168.153108318.8353363936.3167.369325.851168.15318.835167.369547.9184565533.63095115

    40.7193570.2888993445359.6782912072144.4493421350.9442957761.3147.16359.678144.449350.944147.16519.55127422516.4491904

    40.7790770.2393073731389.5392412193.8119.6543704379.9752507622.9124.764389.539119.654379.975124.764466.09899506474.072009

    40.3067450.5407261469153.3725450474.2270.3631441147.8255397593.6268.552153.372270.363147.825268.552414.66114036396.986994

    40.527250.4256592525263.6254290602.8212.8292479254.3094293979.4213.642263.625212.829254.309213.642561.07045125543.31083378

    40.6627690.3293383174331.3843319693164.6693143322.4253300011.5164.189331.384164.669322.425164.189545.68671896529.38638325

    40.7886820.2341643777394.3412360347.8117.0823755385.2072405689119.693394.341117.082385.207119.693461.70232962461.06581451

    40.4000840.5050751916200.0425091113.2252.5381872192.0394999249.9248.732200.042252.538192.039248.732505.18206596477.66244548

    40.5105450.4388052445255.2724423115.8219.4032427248.9744395893.3218.713255.272219.403248.974218.713560.07442616544.53850462

    40.7675920.2517033676383.7962537143.6125.8513655374.9492579095.4128.32383.796125.851374.949128.32483.01110396481.1345568

    40.7272920.2797783483363.6462820136.5139.8893463355.2522856643.7142.129363.646139.889355.252142.129508.70075294504.91611508

    40.6418880.3443143074320.9443470650.8172.1573067314.6293415537.9169.937320.944172.157314.629169.937552.52756208534.67108373

    40.7621630.2545313650381.0822565650.1127.2663635372.8972597339.9129.228381.082127.266372.897129.228484.98781812481.88733516

    40.5445810.4125992608272.2914158962.7206.32564263.0284187030.7208.321272.291206.3263.028208.321561.736333547.94255988

    40.5727710.391782743286.3853949111.6195.892712278.2113939967.5196.029286.385195.89278.211196.029560.9995765545.37424119

    40.6815620.3185813264340.7813211270159.2913262334.6333191736.9158.802340.781159.291334.633158.802542.83346271531.40389666

    40.5775740.3892672766288.7873923773.5194.6332748281.9043909182.5194.497288.787194.633281.904194.497562.07480171548.29482288

    40.4917520.4489572355245.8764525445.2224.4782330239.0234487862.8223.289245.876224.478239.023223.289551.93752728533.71206647

    40.599290.3763082870299.6453793147.1188.1542836290.9313730910.4185.628299.645188.154290.931185.628563.7940533540.04939668

    40.4572980.4732442190228.6494770258.6236.6222188224.4564688269.7233.26228.649236.622224.456233.26541.03383678523.5660656

    40.5999160.3755612873299.9583785625.2187.7812841291.4443721615.6185.165299.958187.781291.444185.165563.26413198539.6522826

    40.650240.340713114325.123434328.8170.3553107318.7323374592.1167.899325.12170.355318.732167.899553.858176535.14784068

    40.534350.4199482559267.1754233041209.9742507257.1814252401.8211.574267.175209.974257.181211.574560.9980345544.12812894

    40.3856760.5077671847192.8385118248.4253.8841810185.6795026658.5250.096192.838253.884185.679250.096489.58482792464.37575184

    40.3783670.5138771812189.1845179836.6256.9391781182.7045109972.8254.241189.184256.939182.704254.241486.08747776464.50847664

    40.8103990.2025913881405.1992042098.8101.2953873397.3122054429.6102.216405.199101.295397.312102.216410.44632705406.11643392

    40.8070580.2066653865403.5292083165.8103.3333856395.5682102030104.584403.529103.333395.568104.584416.97862157413.70083712

    40.3217790.5375911541160.895418873.5268.7961504154.2885356773.6266.521160.89268.796154.288266.521432.4658844411.20992048

    40.3217790.5375911541160.895418873.5268.7961504154.2885356773.6266.521160.89268.796154.288266.521432.4658844411.20992048

    40.6911670.3143363310345.5843168480.8157.1683287337.1973151004.4156.775345.584157.168337.197156.775543.14746112528.64059675

    40.6368760.3463783050318.4383491457.9173.1893024310.2173438036.1171.056318.438173.189310.217171.056551.49958782530.64479152

    40.611610.3620492929305.8053649424.1181.0252918299.3433589497178.592305.805181.025299.343178.592553.58350125534.60265056

    40.8018380.219463840400.9192212139109.733838393.7222199611.4109.439400.919109.73393.722109.439439.9284187430.88541958

    40.6692420.3254443205334.6213280446.8162.7223193327.5543227137160.563334.621162.722327.554160.563544.50198362525.93052902

    40.7216540.2861733456360.8272884595143.0863440352.8932910096.1144.789360.827143.086352.893144.789516.29292122510.95024577

    40.6057630.3687872901302.8823717342.5184.3942903297.8053630102.1180.612302.882184.394297.805180.612558.49623508537.8715666

    40.5040720.4441372414252.0364476858.7222.0682399246.1024436097.8220.713252.036222.068246.102220.713559.69130448543.17910726

    40.5230740.4295982505261.5374330308.8214.7992465252.8724332315.6215.55261.537214.799252.872215.55561.77886063545.065596

    40.6437670.3429123083321.8833456525.8171.4563070314.9363425253.5170.42321.883171.456314.936170.42551.88771648536.7139312

    40.3361870.5333961610168.0945376587.3266.6981575161.5725309485.3264.168168.094266.698161.572264.168448.30333612426.82152096

    40.3178120.5394851522158.9065437960.5269.7421473151.1085388015.4268.075158.906269.742151.108268.075428.63622252405.082771

    40.4946750.4471072369247.3384506803223.5542351241.1784486948.8223.243247.338223.554241.178223.243552.93399252538.41300254

    40.5245350.426822512262.2684302308.3213.412478254.2064285910.1213.241262.268213.41254.206213.241559.7061388542.07141646

    40.5577360.4027022671278.8684059195.1201.3512635270.3124063164.9202.159278.868201.351270.312202.159561.50350668546.46003608

    40.6588010.3319753155329.4013346276.6165.9873121320.1683324005.3165.382329.401165.987320.168165.382546.76283787529.50024176

    40.637920.345963055318.963487247.8172.983059313.8083444127.4171.359318.96172.98313.808171.359551.737008537.73825072

    40.5579450.401512672278.9734047188.5200.7552642271.034067300.4202.364278.973200.755271.03202.364560.05224615548.4671492

    40.5873880.3826822813293.6943857403.8191.3412796286.8283833530.9190.733293.694191.341286.828190.733561.95703654547.07564924

    40.6299850.3518533017314.9933546648.3175.9273015309.2943506935174.484314.993175.927309.294174.484554.15773511539.66854296

    40.5811230.3854922783290.5623885724192.7462758282.933861198.7192.11290.562192.746282.93192.11560.04663252543.536823

    40.5859260.3841012806292.9633871702.7192.052795286.7253845645.9191.336292.963192.05286.725191.336562.6354415548.608146

    40.5763210.390332760288.163934493.2195.1652732280.2633932261195.646288.16195.165280.263195.646562.387464548.32334898

    40.321570.5382251540160.7855425256269.1121498153.6735377987.6267.576160.785269.112153.673267.576432.6917292411.19206648

    40.557110.4043562668278.5554075873.7202.1782641270.9274078309.7202.912278.555202.178270.927202.912563.1769279549.74339424

    40.4838170.4570592317241.9094607112.5228.5292313237.2794546433.4226.203241.909228.529237.279226.203552.83221861536.73221637

    40.5896850.3787882824294.8423818144.9189.3942813288.5723785051.6188.321294.842189.394288.572188.321558.41305748543.44167612

    40.5896850.3787882824294.8423818144.9189.3942813288.5723785051.6188.321294.842189.394288.572188.321558.41305748543.44167612

    40.5604510.3993972684280.2264025888.8199.6992663273.1844025181.2200.269280.226199.699273.184200.269559.60851974547.10286496

    40.5460430.4114792615273.0224147671.7205.742587265.3884168034.2207.376273.022205.74265.388207.376561.7154628550.35101888

    Decile 7

    00

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    GA

    Logistic

    Churn-Lift

    $-Lift

    Churn - Decile 2 (Trg)

    GPDecile1

    000

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    GA

    Logit

    OLS

    Churn-Lift

    $-Lift

    Decile 2 (Test)

    GPDecile2

    GPParetoDMAX -- CHURN ExampleTrg_Tot-$:10079910.5Tst_Tot-$:10049453Logistic:297.55690123256.4006862115295.992340309157.4209688998min277.89353397268.52630424LogisticTrg167.8241341646

    Trg_Tot-Resp:4789Tst_Tot-Resp:4874Min123.12995.8309119.95697.4067max431.8902003422.1916487LogisticTst169.9616696748

    Decile 1106Total SolutionsMax:309.807225.693309.807223.923Product of LiftsProdcut of Lifts

    SizeResp-fit$-fitTrgNRespTrgRLiftTrg-$Trg$LiftTstNRespTstRLiftTst-$tst$LiftTrgRespLiftTrg$LiftTestRespLiftTest$LiftTrgTestTrgRespLiftTrg$LiftTestRespLiftTest$LiftTrgTest

    40.5926080.603242838197.5366080606.2201.082832193.6815967507.1197.938197.536201.08193.681197.938397.2053888383.36829778Logistic:297.55690123256.4006862115295.992340309157.4209688998167.8241341646169.9616696748

    40.8651080.444574143288.3694481227148.194158284.3664435166.4147.111288.369148.19284.366147.111427.3340211418.33366626OLS100223223

    40.894550.4018964284298.1834051073.9133.9654281292.7784003203.5132.783298.183133.965292.778132.783399.46085595388.75941174

    40.7178950.5267813438239.2985309902.4175.5943440235.2625216805.8173.038239.298175.594235.262173.038420.19293012407.09265956X1X2X3X4

    40.8843180.4143864235294.7734176974138.1294251290.7264118600.8136.611294.773138.129290.726136.611407.16699717397.16369586BestGa Solution2.24850.780813-0.441880.672331

    40.776780.4973893720258.9275013635.4165.7963739255.7114926622.7163.413258.927165.796255.711163.413429.29060892417.86501643

    40.9164750.3670574389305.4923699899.7122.3524417302.0793669436.1121.713305.492122.352302.079121.713373.77557184367.66941327

    40.8135310.476043896271.1774798437.7158.683930268.7734718959.9156.525271.177158.68268.773156.525430.3036636420.69693825

    40.9294220.2874934451309.8072897901.295.83094530309.8072936651.397.4067309.80795.8309309.80797.4067296.890836363301.772775069

    40.9189810.3552414400306.2573582568.5118.4724434303.2423578992.1118.713306.257118.472303.242118.713362.82879304359.98767546

    40.5520990.6225192644184.0336274932.9207.5062614178.7726167388.7204.568184.033207.506178.772204.568381.87951698365.71030496

    40.5520990.6225192644184.0336274932.9207.5062614178.7726167388.7204.568184.033207.506178.772204.568381.87951698365.71030496

    40.6005430.5944832876200.1815992330.5198.1612903198.5365834623.8193.53200.181198.161198.536193.53396.68067141384.2267208

    40.6387550.5704643059212.9185750225.8190.1553069209.8895603093.3185.851212.918190.155209.889185.851404.8742229390.08080539

    40.5028190.6382692408167.6066433695.4212.7562405164.4786321133209.668167.606212.756164.478209.668356.59182136344.85773304

    40.7972440.4841323818265.7484880002.6161.3773846263.0284789073.1158.85265.748161.377263.028158.85428.85614996417.819978

    40.6055540.5893142900201.8515940228196.4382938200.935799559.6192.367201.851196.438200.93192.367396.51206738386.5230131

    40.4856960.6508892326161.8996560907.6216.9632294156.8876493759.7215.393161.899216.963156.887215.393351.26092737337.92361591

    40.9047820.3917234333301.5943948528130.5744366298.5913898354.3129.306301.594130.574298.591129.306393.80334956386.09607846

    40.7659220.5046193668255.3075086515.6168.2063684251.9494984951.5165.347255.307168.206251.949165.347429.44169242416.59011303

    40.915640.368214385305.2133711518.9122.7374406301.3273693749.1122.519305.213122.737301.327122.519374.60927981369.18282713

    40.7350180.5179213520245.0065220599.6172.643517240.5285111750.4169.553245.006172.64240.528169.553422.9783584407.82243984

    40.8617670.4460974127287.2564496615148.6994125282.1094436566.7147.158287.256148.699282.109147.158427.14679944415.14596222

    40.6809350.5485623261226.9785529454.3182.8543276224.0465407653.9179.368226.978182.854224.046179.368415.03835212401.86682928

    40.8745040.4330114188291.5014364715.8144.3374208287.7864337834.5143.883291.501144.337287.786143.883420.74379837414.07513038

    40.5268320.6324012523175.6116374545.3210.82486170.0186293702.7208.758175.611210.8170.018208.758370.187988354.92617644

    40.8433910.4593324039281.134630347.6153.1214060277.6644551472.4150.969281.13153.121277.664150.969430.4690673419.18656416

    40.8037170.4812813849267.9064851267.7160.4273898266.5854764593.7158.038267.906160.427266.585158.038429.79355862421.3056023

    40.6299850.5736193017209.9955782025.8191.2063076210.3685701497.9189.115209.995191.206210.368189.115401.5230397397.8374432

    40.4343290.6630872080144.7766683859221.0292063141.0896635719.2220.102144.776221.029141.089220.102319.99694504310.53971078

    40.8816040.4181014222293.8684214424.6139.3674240289.9744160141.8137.989293.868139.367289.974137.989409.55501556400.13222286

    40.6245560.5776112991208.1855822268.9192.5373014206.1285755766.5190.915208.185192.537206.128190.915400.83315345393.5292712

    40.703070.5364533367234.3575407400.6178.8183360229.7915291967.8175.531234.357178.818229.791175.531419.07250026403.35444021

    40.6370850.5727943051212.3625773711.9190.9313052208.7275663370.5187.85212.362190.931208.727187.85405.46489022392.0936695

    40.878680.4224364208292.8934258114.6140.8124243290.1794221910.7140.038292.893140.812290.179140.038412.42849116406.36086802

    40.662560.5586293173220.8535630926.5186.213191218.2335507357.2182.675220.853186.21218.233182.675411.2503713398.65713275

    40.8285650.4675693968276.1884713050.9155.8564008274.1084636364.4153.785276.188155.856274.108153.785430.45556928421.5369878

    40.7327210.5212723509244.245254379.1173.7573537241.8965108041.7169.43244.24173.757241.896169.43424.3840968409.8443928

    40.9214870.3389714413307.1623416802.2112.994457304.8153435866.9113.965307.162112.99304.815113.965347.0623438347.38241475

    40.6072250.5883882908202.4085930898.7196.1292912199.1525811492.8192.763202.408196.129199.152192.763396.98078632383.89136976

    40.5859260.6053692806195.3096102064201.792775189.7835980820.6198.38195.309201.79189.783198.38394.1140311376.4915154

    40.7080810.5330543391236.0275373133.9177.6853401232.5955275873.3174.997236.027177.685232.595174.997419.38457495407.03427215

    40.4650240.6558182227155.0086610584.7218.6062177148.8856533419.8216.709155.008218.606148.885216.709338.85678848322.64719465

    40.5619130.6171632691187.3046220946.4205.7212660181.9186113133.8202.768187.304205.721181.918202.768385.32366184368.87149024

    40.8935060.4037594279297.8354069856.8134.5864320295.4454064145.8134.805297.835134.586295.445134.805400.8442131398.27463225

    40.8448530.4555374046281.6184591768.6151.8464061277.7324581317.3151.959281.618151.846277.732151.959427.62566828422.03876988

    40.6890790.5446533300229.6935490049.8181.5513307226.1665376151.5178.323229.693181.551226.166178.323417.00993843403.30599618

    40.908540.3823974351302.8473854530.3127.4664405301.2583794256.6125.853302.847127.466301.258125.853386.02695702379.14223074

    40.8053870.4805033857268.4624843430.9160.1683878265.2174759589.9157.872268.462160.168265.217157.872429.99021616418.70338224

    40.4013360.6732841922133.7796786640.8224.4281910130.6256717232.6222.806133.779224.428130.625222.806300.23753412291.0403375

    40.3877640.6755431857129.2556809418225.1811851126.596738366223.507129.255225.181126.59223.507291.05770155282.9375113

    40.4240970.6694412031141.3666747900.8223.1472004137.0546687540.1221.821141.366223.147137.054221.821315.45398802304.01455334

    40.3967430.6746411900132.2486800324.2224.881878128.4376731583223.282132.248224.88128.437223.282297.3993024286.77670234

    40.4295260.666912057143.1756722390.1222.3032048140.0636651632.8220.63143.175222.303140.063220.63318.28232025309.0209969

    40.3693880.6770791769123.1296824894.8225.6931754119.9566748832.9223.854123.129225.693119.956223.854277.89353397268.52630424

    40.8479850.454034061282.6624576579.7151.3434081279.14546008.6150.788282.662151.343279.1150.788427.78915066420.849308

    40.3819170.676781829127.3066821877.2225.5931806123.5136750902.7223.923127.306225.593123.513223.923287.19342458276.57401499

    40.9074960.3871684346302.4993902621.3129.0564386299.9593850521.3127.719302.499129.056299.959127.719390.39310944383.10463521

    40.8749220.4290164190291.6414324441.5143.0054214288.1964283456.3142.079291.641143.005288.196142.079417.06121205409.46599484

    40.827730.46963964275.914733524156.5333995273.2184637687.5153.829275.91156.533273.218153.829431.8902003420.28851722

    40.5946960.6016272848198.2326064342.6200.5422823193.0655944177.8197.164198.232200.542193.065197.164397.53841744380.6546766

    40.6844850.5478263278228.1625522033.6182.6093297225.4825412018.5179.513228.162182.609225.482179.513416.64434658404.76950266

    40.6585930.5600933154219.5315645688.3186.6983193218.375545001.1183.924219.531186.698218.37183.924409.85998638401.6348388

    40.7460850.5140073573248.6955181144.6171.3363578244.75095779.2169.023248.695171.336244.7169.023426.1040652413.599281

    40.5387350.6273362580179.5786323495.5209.1122552174.5326210251.2205.99179.578209.112174.532205.99375.51914736359.5184668

    40.7193570.5262513445239.7865304559.8175.4173429234.515204829.2172.641239.786175.417234.51172.641420.62540762404.8604091

    40.5700560.6145842730190.0196194955.8204.8612706185.0646075356.9201.515190.019204.861185.064201.515389.27482359372.9317196

    40.8571730.4482784105285.7244518597.9149.4264115281.4254477246.4148.507285.724149.426281.425148.507426.94594424417.93582475

    40.5982460.5992172865199.4156040052.4199.7392849194.8435915531.5196.214199.415199.739194.843196.214398.30952685382.30924402

    40.7815830.4933813743260.5284973241.2164.463758257.014888701.3162.155260.528164.46257.01162.155428.4643488416.7545655

    40.7815830.4933813743260.5284973241.2164.463758257.014888701.3162.155260.528164.46257.01162.155428.4643488416.7545655

    40.6228860.5788092983207.6295834343.1192.9362999205.1025771595.2191.44207.629192.936205.102191.44400.59108744392.6472688

    40.6243470.5780762990208.1165826955.9192.6923005205.5125759155.4191.027208.116192.692205.512191.027401.02288272392.58340824

    40.8005850.4838233834266.8624876887.5161.2743867264.4654795969159.079266.862161.274264.465159.079430.37902188420.70827735

    40.855920.451344099285.3074549463.6150.4474100280.3994511138.8149.631285.307150.447280.399149.631429.23582229419.56382769

    40.855920.451344099285.3074549463.6150.4474100280.3994511138.8149.631285.307150.447280.399149.631429.23582229419.56382769

    40.78910.4892063779263.0334931152.3163.0693815260.9084863065.9161.304263.033163.069260.908161.304428.92528277420.85504032

    40.78910.4892063779263.0334931152.3163.0693815260.9084863065.9161.304263.033163.069260.908161.304428.92528277420.85504032

    40.8248070.4702773950274.9364740350.5156.7593982272.3294673909155.03274.936156.759272.329155.03430.98692424422.1916487

    40.8062230.4794973861268.7414833291.2159.8323885265.6964737919.2157.153268.741159.832265.696157.153429.53411512417.54923488

    40.4792230.6527182295159.7416579341.5217.5732256154.2886497769.3215.526159.741217.573154.288215.526347.55328593332.53075488

    40.4700350.6544572251156.6786596871.7218.1522215151.4846553244.2217.367156.678218.152151.484217.367341.79619056329.27622628

    40.8310710.4648593980277.0244685734.4154.9534015274.5864626267.7153.45277.024154.953274.586153.45429.25699872421.352217

    40.9060350.389274339302.0123923808.9129.7574369298.7963896225.3129.235302.012129.757298.796129.235391.88171084386.1490106

    40.8701190.4386764167290.044421813.4146.2254192286.6914371574145.002290.04146.225286.691145.002424.11099415.70768382

    40.5406140.6255742589180.2056305726.1208.5252560175.0796223169206.418180.205208.525175.079206.418375.77247625361.39457022

    40.7110040.5275293405237.0015317449.4175.8433421233.9635212773172.904237.001175.843233.963172.904416.74966843404.53138552

    40.7832530.4921733751261.0844961060.6164.0583771257.8994872730.6161.625261.084164.058257.899161.625428.32918872416.82925875

    40.8103990.4783753881270.1334821978159.4583920268.0894740365.5157.235270.133159.458268.089157.235430.74867914421.52973915

    40.6210060.5822012974207.0025868535.9194.0672989204.4185732321.1190.137207.002194.067204.418190.137401.72257134388.67425266

    40.6514930.5641693120217.1645686769.6188.0563145215.0875547221.1183.997217.164188.056215.087183.997408.38993184395.75362739

    40.4527040.6613322168150.9016666170.9220.4442121145.0556588065.2218.522150.901220.444145.055218.522332.65220044316.9770871

    40.5182710.6359322482172.7576410141.1211.9772445167.2146349501.6210.609172.757211.977167.214210.609366.20510589352.16773326

    40.8768010.4257564199292.2674291583.3141.9194230289.294222423.4140.055292.267141.919289.29140.055414.78240373405.1651095

    40.6297770.57543016209.9265799980.6191.83041207.9745662578.1187.824209.926191.8207.974187.824402.638068390.62508576

    40.4890370.6491752342163.0126543620.9216.3922300157.2976469159.9214.578163.012216.392157.297214.578352.74492704337.52475666

    40.4128210.6711671977137.6076765298.5223.7221943132.8826691949.9221.967137.607223.722132.882221.967307.85713254294.95418894

    40.543120.6244612601181.046294514.3208.1542584176.726196409205.531181.04208.154176.72205.531376.8420016363.2143832

    40.7709330.500153692256.9785041467.9166.7173706253.4544959725.8164.511256.978166.717253.454164.511428.42601226416.95970994

    40.4564630.6594842186152.1546647535.6219.8282163147.9286596149.6218.79152.154219.828147.928218.79334.47709512323.6516712

    40.7588220.5079923634252.9415120516.3169.3313642249.0775051042.6167.54252.941169.331249.077167.54428.30752471417.3036058

    40.7951560.4866353808265.0524904653.5162.1923831262.0024809998159.544265.052162.192262.002159.544429.89313984418.00847088

    40.7698890.502673687256.635066864.7167.5573690252.3594967322.4164.763256.63167.557252.359164.763430.0015291415.79425917

    40.5199420.6353642490173.3146404408211.7882443167.0776333814.4210.088173.314211.788167.077210.088367.05825432351.00872776

    40.4986430.6465712388166.2146517376215.5242349160.6486449617.9213.929166.214215.524160.648213.929358.23106136343.67265992

    40.4055130.6721181942135.1716774887.9224.0391916131.0356702085.8222.304135.171224.039131.035222.304302.83575669291.2960464

    GPDecile2

    0202.21233445810

    0159.3966368385

    0169.2761723099

    0193.9136000596

    0135.0805809899

    0189.9225097286

    0216.7218614358

    0149.2852772188

    0143.7306677144

    0169.3407264545

    0211.9365742384

    0212.2187427491

    0181.2669732203

    080.1586912238

    0180.39204151

    0117.3680857583

    0189.6783144387

    0198.8181574959

    0161.7123286958

    0203.0877622045

    0192.7106826329

    0202.4791456895

    0196.2333527994

    0198.7862722921

    0202.5879231104

    0203.9203291206

    0204.0551219841

    0202.8792550622

    0198.8832605872

    0203.0459000603

    0204.1658736289

    0202.2298279996

    0209.7387967879

    0161.525468571

    0175.1552886639

    0153.4650762359

    0178.9125541674

    0162.2982730518

    0105.090361004

    0185.1216238478

    0213.4075727491

    0196.0353252475

    0204.4847884975

    0208.7568436248

    0200.7262531415

    0213.4620672806

    0155.9771984087

    0150.4860484624

    0195.0413911579

    0131.3420590391

    0186.1543115884

    0164.6406913368

    0139.5247077508

    0160.9366472054

    0139.5009046294

    0179.7657594943

    0187.3098774042

    0139.4989171779

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    GA

    GP

    Logistic

    Churn-Lift

    $-Lift

    Churn - Decile 3 (Trg)

    GPDecile3

    000

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    GA

    Logit

    OLS

    Churn-Lift

    $-Lift

    Decile 3 (Test)

    GPDecile7

    GPParetoDMAX -- CHURN ExampleTrg_Tot-$:10079910.5Tst_Tot-$:10049453Logistic:137.994809533866.1767269346137.786505656866.6971421669min145.88258664145.0268687LogisticTrg91.320448289

    Trg_Tot-Resp:4789Tst_Tot-Resp:4874Min106.584115.122106.19114.185max176.4466248176.07815559LogisticTst91.8996615648

    Decile 145Total SolutionsMax:139.874136.871139.545136.573Product of LiftsProdcut of Lifts

    SizeResp-fit$-fitTrgNRespTrgRLiftTrg-$Trg$LiftTstNRespTstRLiftTst-$tst$LiftTrgRespLiftTrg$LiftTestRespLiftTest$LiftTrgTestTrgRespLiftTrg$LiftTestRespLiftTest$LiftTrgTest

    40.9693050.88984642138.4728969101.1127.1144722138.4028909758126.656138.472127.114138.402126.656176.01729808175.29443712Logistic:137.994809533866.1767269346137.786505656866.697142166991.32044828991.8996615648

    40.933180.9107264469133.3119180038.4130.1044509132.1599144549.5129.994133.311130.104132.159129.994173.44294344171.79877046OLS92136125.12

    40.7857590.9543383763112.2519619638.1136.3343811111.7019572491.2136.077112.251136.334111.701136.077153.03627834151.99936977

    40.7857590.9543383763112.2519619638.1136.3343811111.7019572491.2136.077112.251136.334111.701136.077153.03627834151.99936977X1X2X3X4

    40.8955940.9269834289127.9429343909.9132.4264370128.0859310806.3132.357127.942132.426128.085132.357169.42847292169.52946345BestGa Solution1.540310.283195-0.246871.50959

    40.8955940.9269834289127.9429343909.9132.4264370128.0859310806.3132.357127.942132.426128.085132.357169.42847292169.52946345

    40.7828360.9544143749111.8349620410.3136.3453792111.1449576423.6136.133111.834136.345111.144136.133152.4800673151.30366152

    40.8824390.9332674226126.0639407243133.3244288125.6819374882133.268126.063133.324125.681133.268168.07223412167.49255508

    40.8141570.9469263899116.3089544926.6135.2753957115.989507275.9135.15116.308135.275115.98135.15157.335647156.74697

    40.8477760.9431754060121.1119507116.7134.7394129121.0219467630.7134.586121.111134.739121.021134.586163.18375029162.87732306

    40.9732720.886114661139.0398931910.7126.5874734138.7548890865.4126.387139.039126.587138.754126.387176.00529893175.36701798

    40.9292130.9161474450132.7459234682.9130.8784497131.8079201256.1130.8132.745130.878131.807130.8173.7340011172.403556

    40.8577990.9380354108122.5439455307.1134.0054203123.199415055.7133.839122.543134.005123.19133.839164.21374715164.8762641

    40.9791190.8058514689139.8748122907.9115.1224761139.5458032473.5114.185139.874115.122139.545114.185161.02574628159.33945825

    40.8486110.9430964064121.239506323.2134.7284131121.089464882134.547121.23134.728121.08134.547163.3307544162.9095076

    40.7870120.9529543769112.439605695.4136.1363801111.4079563008.8135.942112.43136.136111.407135.942153.0577048151.44890394

    40.8586340.9374744112122.6629449658.9133.9254205123.2499411538.1133.789122.662133.925123.249133.789164.2750835164.89360461

    40.8227190.946593940117.5319541545.5135.2274111120.4949491833.3134.93117.531135.227120.494134.93158.93364537162.5825542

    40.8565460.9386384102122.3649461391.9134.0914176122.3999425243.3133.984122.364134.091122.399133.984164.07911124163.99507616

    40.78910.9525863779112.7299601978.1136.0843815111.8189554472.2135.821112.729136.084111.818135.821153.40613236151.87232578

    40.78910.9525863779112.7299601978.1136.0843815111.8189554472.2135.821112.729136.084111.818135.821153.40613236151.87232578

    40.9496760.8966244548135.6689037887128.0894608135.0618991135127.813135.668128.089135.061127.813173.77578452172.62551593

    40.9049910.9230934334129.2849304691.5131.874402129.0239269398.3131.768129.284131.87129.023131.768170.4868108170.01102664

    40.7886820.9528023777112.6699604162.8136.1153818111.9069559867.6135.897112.669136.115111.906135.897153.35940935152.07689682

    40.9720190.8894784655138.868965856.9127.0684735138.7838925005.6126.873138.86127.068138.783126.873176.4466248176.07815559

    40.931510.9123594461133.0739196501.7130.3374520132.4819166682.3130.308133.073130.337132.481130.308173.44335601172.63334148

    40.7690540.9546863683109.8659623152.9136.3843715108.8879569926.5136.04109.865136.384108.887136.04149.8382816148.1298748

    40.7460850.9580953573106.5849657512.8136.8713623106.199607354.7136.573106.584136.871106.19136.573145.88258664145.0268687

    40.9768220.8768364678139.5468838426125.2624746139.1058778914.8124.796139.546125.262139.105124.796174.79811052173.5974758

    40.9290040.9166034449132.7159239274.7130.9434494131.7199200112.3130.783132.715130.943131.719130.783173.78100245172.26605977

    40.9488410.9044754544135.5499117025.9129.2114589134.5049089205.1129.207135.549129.211134.504129.207175.14421839173.78858328

    40.9114640.9209844365130.2099283431.9131.5694407129.1699248791.8131.475130.209131.569129.169131.475171.31467921169.82494275

    40.8901650.9280334263127.1669354492.7132.5764335127.0599326038.1132.573127.166132.576127.059132.573168.59159616168.44592807

    40.950720.8965324553135.8179036959.8128.0764595134.688983355.6127.702135.817128.076134.68127.702173.94898092171.9890536

    40.9177280.9209424395131.1049283015.2131.5634445130.2839243708.5131.403131.104131.563130.283131.403172.48435552171.19577049

    40.8847360.9303664237126.3919378005.3132.9094323126.7079342855.8132.813126.391132.909126.707132.813167.98501419168.28336791

    40.9778660.8713574683139.6958783197.3124.484750139.2238749462.5124.377139.695124.48139.223124.377173.892336173.16139071

    40.7897260.9513353782112.8189589374.6135.9053818111.9069547808.1135.726112.818135.905111.906135.726153.3253029151.88553756

    40.7525580.9567393604107.5089643848.1136.6773656107.1589604430.4136.531107.508136.677107.158136.531146.93870916146.30388898

    40.8561290.9416334100122.3049491574134.5194162121.9889457972134.449122.304134.519121.988134.449164.52211776164.01164612

    40.766340.9552793670109.4779629123.3136.4683702108.5069583478.6136.233109.477136.468108.506136.233149.40107236147.82097898

    40.7554810.9562243618107.9269638651.9136.6033666107.4519600678.9136.478107.926136.603107.451136.478147.43015378146.64697578

    40.7995410.9511673829114.229587675.6135.8813869113.4019543484.5135.665114.22135.881113.401135.665155.2032782153.84546665

    40.8730420.9355934181124.729430689.1133.6564240124.2759389087.7133.47124.72133.656124.275133.47166.6957632165.8698425

    40.804970.9483313855114.9969559092.1135.4763911114.6329510794.5135.2114.996135.476114.632135.2155.79198096154.982464

    GPDecile7

    0129.6492690656

    0132.2474242207

    0132.7099113203

    0135.9599741911

    0133.9045576985

    0135.9875254561

    0134.3880781481

    0134.7183106721

    0135.9560810159

    0135.6114733643

    0134.4086863243

    0135.9573409478

    0134.5793213428

    0135.9571807989

    0135.253722172

    0135.7071233066

    0127.0901562072

    0130.3607067883

    0132.752931827

    0136.1268279968

    0134.4812266509

    0135.8285671286

    0132.6596132546

    0132.7483356977

    0135.8176373264

    0135.3050732515

    0135.2895884202

    0135.3695735408

    0135.2896847929

    0134.4493159367

    0134.9893689178

    0134.2282907316

    0129.6753520636

    0135.7922501962

    0129.5962980737

    0135.6088273658

    0135.8167472958

    0134.3503879042

    0134.2475213446

    0134.3846739229

    0132.464149501

    0135.9229387149

    0

    0

    0

    GA

    GP

    Churn-Lift

    $-Lift

    Churn - Decile 7 (Trg)

    000

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    GA

    Logit

    OLS

    Churn-Lift

    $-Lift

    Decile 7 (Test)

    GP (pop=200, maxcreate=8, maxcross=15)

    Max901.74015232881.4466608

    Decile 195Total SolutionsMax:481.311378.412475.174372.728Product of Lifts

    SizeResp-fit$-fitTrgNRespTrgRLiftTrg-$Trg$LiftTstNRespTstRLiftTst-$tst$LiftTrgRespLiftTrg$LiftTestRespLiftTest$LiftTrgTest

    360.4195030.180552009419.5031819928.6180.551993408.9041876795.9186.756419.503180.55408.904186.756757.4126665763.65275424

    590.4491540.1309052151449.1541319506.8130.9052150441.1161309084.5130.264449.154130.905441.116130.264587.9650437574.61534624

    250.3792020.2269971816379.2022288111.6226.9971783365.8192315364.9230.397379.202226.997365.819230.397860.77716394842.83600143

    140.4681560.1037722242468.1561046012.8103.7722239459.3761021254.9101.623468.156103.772459.376101.623485.81484432466.83167248

    640.2770930.3054561327277.0933078973.3305.4561297266.1063052292.7303.727277.093305.456266.106303.727846.39719408808.23577062

    320.1710170.360184819171.0173630624.3360.184798163.7263580142356.252171.017360.184163.726356.252615.97587128583.27714952

    420.1754020.357319840175.4023601745357.319831170.4973562332.5354.48175.402357.319170.497354.48626.74467238604.3777656

    200.1674670.361762802167.4673646530361.762781160.2383608318359.056167.467361.762160.238359.056605.83196854575.34415328

    460.2631030.318351260263.1033208944318.351226251.5393186453.5317.077263.103318.35251.539317.077837.5884005797.57231503

    220.1315510.367164630131.5513700981.3367.164610125.1543621460.6360.364131.551367.164125.154360.364483.00791364451.00996056

    240.1524330.36704730152.4333699729.2367.04723148.3383638664.7362.076152.433367.04148.338362.076559.4900832537.09629688

    500.2543330.3185251218254.3333210704.2318.5251179241.8963203101.2318.734254.333318.525241.896318.734810.11418825771.00479664

    460.1188140.375637569118.8143786383.2375.637550112.8443702560.1368.434118.814375.637112.844368.434446.30934518415.75566296

    930.20380.343738976203.83464850.9343.738944193.6813431313.1341.443203.8343.738193.681341.443700.538044661.31021683

    130.1797870.356469861179.7873593171.1356.469848173.9843568593.2355.103179.787356.469173.984355.103640.88492103617.82240352

    240.253080.3195431212253.083220963.6319.5431160237.9983188369.2317.268253.08319.543237.998317.268808.6994244755.09149464

    640.1526410.364579731152.6413674923.3364.579700143.6193638152.6362.025152.641364.579143.619362.025556.49703139519.93668475

    710.1760280.356552843176.0283594009.1356.552816167.4193565529.1354.798176.028356.552167.419354.798627.63135456593.99926362

    560.2781370.3049661332278.1373074032.5304.9661302267.1323047097.7303.21278.137304.966267.132303.21848.22328342809.9709372

    190.3136350.2811261502313.6352833728281.1261491305.9092767877.8275.426313.635281.126305.909275.426881.7095301842.55292234

    400.4618920.107272212461.8921081275.1107.272236458.761995438.699.054461.892107.27458.76199.054495.4715484454.42112094

    290.3890160.2134751863389.0162151808.7213.4751855380.5912125561211.51389.016213.475380.591211.51830.451906804.9880241

    210.2837750.3029151359283.7753053358.2302.9151329272.6712954293.5293.976283.775302.915272.671293.976859.59704125801.58729896

    350.4543750.1153952176454.3751163173115.3952201451.581094538.9108.915454.375115.395451.58108.915524.32603125491.838357

    1150.4207560.1687142015420.7561700623.7168.7142008411.9821719330.7171.087420.756168.714411.982171.087709.87427784704.84764434

    480.2428480.3268661163242.8483294781.3326.8661154236.7673250882.3323.488242.848326.866236.767323.488793.78754368765.91283296

    540.1286280.372935616128.6283759155.5372.935607124.5383704093.1368.587128.628372.935124.538368.587479.6988318459.03087806

    250.1994150.34536955199.4153481202.2345.36945193.8863475469.9345.837199.415345.36193.886345.837688.699644670.52952582

    260.3334730.2679831597333.4732701241.4267.9831555319.042676318.5266.315333.473267.983319.04266.315893.65094959849.651376

    90.1799960.356266862179.9963591126.2356.266850174.3953572045355.447179.996356.266174.395355.447641.26454936619.88179565

    680.2422220.3268871160242.2223294989.2326.8871153236.5613248689.2323.27242.222326.887236.561323.27791.79222914764.7307447

    680.1570270.362071752157.0273649641.4362.071729149.5693589348.8357.169157.027362.071149.569357.169568.54922917534.21410161

    310.4813110.0635052305481.311640121.763.50472316475.174621489.861.8431481.31163.5047475.17461.8431305.655106617293.862331994

    900.2384630.3295111142238.4633321444.5329.5111118229.383287172.9327.1238.463329.511229.38327.1785.76181593750.30198

    240.2111090.3437271011211.1093464736.6343.7271006206.4013437950.7342.103211.109343.727206.401342.103725.63863243706.10401303

    330.2148670.3378051029214.8673405043.5337.8051023209.8893410378.6339.36214.867337.805209.889339.36725.83146935712.2793104

    880.2397160.328391148239.7163310146.2328.391134232.6633265481.2324.941239.716328.39232.663324.941787.2033724756.01747883

    710.2200880.3340291054220.0883366982.8334.0291061217.6863302047.8328.58220.088334.029217.686328.58735.15774552715.2726588

    630.0927130.37841244492.71253814359.5378.41246294.78873745711.3372.72892.7125378.41294.7887372.728350.8352255353.304025736

    160.212570.3388621018212.573415696.5338.862989202.9133385643.5336.898212.57338.862202.913336.898720.3189534683.60983874

    550.2451450.3259351174245.1453285391325.9351164238.8183239839.5322.39245.145325.935238.818322.39799.01335575769.9253502

    740.3295050.2690551578329.5052712052269.0551570322.1172684533.6267.132329.505269.055322.117267.132886.54967775860.47758444

    350.2012950.344891964201.2953476465.8344.891953195.5273468557.6345.149201.295344.891195.527345.149694.24833845674.85948523

    480.4172060.19051998417.2061920221.6190.51974405.0061918247.4190.881417.206190.5405.006190.881794.77743773.07950286

    130.3695970.2369881770369.5972388822.3236.9881736356.1762328537.4231.708369.597236.988356.176231.708875.90053836825.28828608

    220.2716640.3062531301271.6643087005.5306.2531282263.0283017433.1300.258271.664306.253263.028300.258831.97914992789.76261224

    240.4299440.1658422059429.9441671669165.8422041418.7531691679.7168.336429.944165.842418.753168.336713.02772848704.91205008

    1460.4704530.0858462253470.453865323.385.84632260463.685860319.185.6086470.45385.8463463.68585.6086403.866493739396.95423691

    1480.4708710.0855482255470.871862312.585.54762261463.89856915.185.2698470.87185.5476463.8985.2698402.818839596395.55807522

    150.3090420.2824331480309.0422846896.4282.4331439295.242803209.3278.941309.042282.433295.24278.941872.83659186823.5454084

    140.3677180.2385431761367.7182404489.3238.5431727354.3292336882.3232.538367.718238.543354.329232.538877.16554874823.94957002

    810.3457920.2552061656345.7922572452.5255.2061628334.0172515225.3250.285345.792255.206334.017250.285882.48193152835.99444845

    330.3877640.2201631857387.7642219221.2220.1631852379.9752186333217.557387.764220.163379.975217.557853.71285532826.66221075

    80.2497390.3200591196249.7393226171320.0591154236.7673165657.7315.008249.739320.059236.767315.008799.31214601745.83499136

    930.3372310.2628161615337.2312649160.8262.8161575323.1432562710.7255.01337.231262.816323.143255.01886.29702496824.0469643

    170.3420340.2625211638342.0342646186.4262.5211612330.7352567474255.484342.034262.521330.735255.484897.91107714844.9750074

    360.4806850.0652192302480.685657403.565.21922309473.738667048.466.3766480.68565.2192473.73866.3766313.49891152314.451177308

    1430.304030.2947581456304.032971131.3294.7581433294.0092935551.3292.111304.03294.758294.009292.111896.1527474858.83262999

    610.4307790.1586762063430.7791599443.8158.6762027415.881690143.8168.183430.779158.676415.88168.183683.54288604699.4394604

    630.3336810.2635911598333.6812656976.1263.5911590326.2212569429.7255.679333.681263.591326.221255.679879.55308471834.07859059

    1300.36730.245081759367.32470388.6245.081714351.6622510421.7249.807367.3245.08351.662249.807900.17884878.47629234

    210.4554190.1097932181455.4191106707.8109.7932170445.221107394.1110.194455.419109.793445.22110.194500.01818267490.6057268

    1470.4441430.1429852127444.1431441271.4142.9852087428.191536123.8152.856444.143142.985428.19152.856635.05786855654.5141064

    500.3942370.2103071888394.2372119873.8210.3071845378.5392170255.8215.958394.237210.307378.539215.958829.10800759817.48525362

    1490.4096890.1932731962409.6891948170.2193.2731923394.5422027729.1201.775409.689193.273394.542201.775791.81822097796.0871205

    170.4570890.1089372189457.0891098073.7108.9372181447.4761084322.1107.899457.089108.937447.476107.899497.93904393482.82212924

    920.3052830.2912291462305.2832935565.9291.2291443296.0612898090.5288.383305.283291.229296.061288.383889.07262807853.78959363

    600.1812490.355393868181.2493582331.9355.393860176.4463554869353.738181.249355.393176.446353.738644.14625857624.15655148

    70.1795780.356542860179.5783593910.9356.542849174.193566879.3354.933179.578356.542174.19354.933640.27099276618.2577927

    110.170390.360452816170.393633320.1360.452794162.9053585830.4356.818170.39360.452162.905356.818614.1741628581.2743629

    520.1852160.352319887185.2163551348.1352.319883181.1653520941.6350.362185.216352.319181.165350.362652.55115904634.7333173

    540.4086450.193981957408.6451955306193.981939397.8251991220.2198.142408.645193.98397.825198.142792.689571788.2584115

    1310.282940.3048231355282.943072587.5304.8231322271.2353037063.7302.212282.94304.823271.235302.212862.4661962819.7047182

    410.4589680.1073532198458.9681082111.2107.3532186448.5021080070.2107.476458.968107.353448.502107.476492.71591704482.03200952

    430.175820.357097842175.823599504.3357.097829170.0863581483356.386175.82357.097170.086356.386627.8479454606.16269196

    210.1674670.361762802167.4673646530361.762780160.0333607311.9358.956167.467361.762160.033358.956605.83196854574.44805548

    1510.3591560.2510721720359.1562530779251.0721675343.662577567.6256.488359.156251.072343.66256.488901.74015232881.4466608

    1510.3614530.2484781731361.4532504632248.4781686345.9172557141.8254.456361.453248.478345.917254.456898.13118534880.20656152

    580.4034250.201111932403.4252027166.4201.111912392.2862011755.3200.186403.425201.11392.286200.186811.3280175785.30165196

    1420.4111510.1907271969411.1511922509.4190.7271933396.5942003515.8199.366411.151190.727396.594199.366784.17596777790.67359404

    570.435790.1530182087435.791542403.5153.0182053421.2151644510163.642435.79153.018421.215163.642666.8371422689.2846503

    410.4328670.1565682073432.8671578192.3156.5682043419.1631657416164.926432.867156.568419.163164.926677.73120456691.30876938

    420.1751930.357364839175.1933602194357.364826169.4713589155.1357.149175.193357.364169.471357.149626.07671252605.26398179

    470.3756530.2295511799375.6532313855.6229.5511798368.8962263960.1225.282375.653229.551368.896225.282862.31521803831.05628672

    480.3228230.2782411546322.8232804649.2278.2411506308.9862757526.1274.396322.823278.241308.986274.396898.22594343847.84522456

    320.3146790.2794721507314.6792817055.4279.4721479303.4472730544.6271.711314.679279.472303.447271.711879.43969488824.49887817

    200.1603680.361873768160.3683647645.5361.873753154.4933585734.3356.809160.368361.873154.493356.809580.32849264551.24492837

    480.3888080.2151281862388.8082168467.5215.1281853380.1812154963.5214.436388.808215.128380.181214.436836.43487424815.24492916

    440.1921070.351159920192.1073539648.3351.159889182.3963481919.4346.478192.107351.159182.396346.478674.60102013631.96201288

    910.4456050.1342182134445.6051352904.8134.2182138438.6541309149.9130.271445.605134.218438.654130.271598.0821189571.43895234

    350.1854250.351619888185.4253544290.9351.619844173.1643478925.2346.181185.425351.619173.164346.181651.98953075599.46086684

    550.1543120.364396739154.3123673078.1364.396728149.3643596367.3357.867154.312364.396149.364357.867562.30675552534.52446588

    430.1559820.364361747155.9823672724.9364.361724148.5433603573.4358.584155.982364.361148.543358.584568.33757502532.65143112

    420.3495510.2548191674349.5512568553.7254.8191646337.712503694249.137349.551254.819337.71249.137890.72236269841.3605627

    750.463980.104012222463.981048407.7104.012222455.8881026703.8102.165463.98104.01455.888102.165482.585598465.7579752

    096.4935113.03367

    0186.518

    0248.215

    0219.622

    0300.207

    0338.122

    0284.289

    0248.397

    0163.021

    0318.049

    0318.049

    0262.273

    0365.106

    0251.432

    0297.112

    0284.55

    0341.179

    0341.179

    0349.335

    0306.661

    0346.61

    0363.384

    0112.779

    0220.406

    0261.835

    0244.322

    0171.015

    0141.135

    0323.465

    0190.907

    0287.109

    0192.517

    0178.228

    0336.419

    0357.99

    0277.519

    0138.878

    0282.614

    0220.207

    043.9768

    0152.099

    0126.529

    0231.582

    0339.139

    0267.946

    0203.414

    0188.484

    050.7006

    0350.75

    0206.91

    0328.854

    0368.194

    0335.681

    0119.131

    0324.071

    0355.14

    0324.968

    0352.46

    0327.147

    0286.433

    0214.065

    0198.863

    0225.387

    088.0297

    0113.135

    0336.738

    0155.583

    0238.234

    088.6285

    0149.853

    0339.693

    085.7315

    0340.821

    0122.185

    0292.171

    0312.745

    0311.462

    0340.822

    0112.674

    0364.155

    0172.179

    0270.691

    0156.12

    0211.832

    0231.935

    090.7999

    0287.27

    0260.595

    0175.387

    0332.685

    0350.881

    0319.743

    0281.901

    0359.823

    0302.376

    302.376

    303.445

    295.016

    GP

    GA

    Logistic

    OLS

    Churn-Lift

    $-Lift

    Decile 1 (trg)

    093.0612111.8361

    0189.567

    0246.389

    0217.941

    0306.046

    0339.265

    0285.231

    0246.238

    0162.498

    0318.173

    0318.173

    0264.08

    0359.427

    0250.207

    0300.943

    0287.096

    0337.561

    0337.561

    0343.97

    0310.119

    0344.485

    0355.896

    0113.273

    0220.439

    0261.663

    0237.754

    0172.47

    0138.478

    0320.54

    0191.908

    0287.642

    0195.401

    0176.646

    0332.389

    0353.152

    0278.783

    0134.626

    0283.246

    0219.25

    046.0013

    0151.629

    0123.65

    0228.865

    0335.421

    0268.076

    0201.366

    0192.117

    050.4551

    0346.977

    0208.409

    0327.397

    0361.475

    0333.621

    0119.3

    0320.323

    0352.767

    0326.907

    0345.479

    0330.398

    0287.209

    0213.485

    0199.263

    0224.941

    086.7874

    0113.551

    0338.038

    0154.073

    0236.339

    088.0041

    0148.821

    0339.365

    083.4507

    0339.045

    0119.405

    0297.102

    0314.657

    0315.473

    0341.428

    0111.362

    0356.733

    0170.562

    0271.708

    0157.129

    0209.79

    0230.192

    090.6703

    0288.35

    0257.225

    0174.685

    0332.769

    0348.133

    0318.279

    0283.172

    0356.715

    0306.232

    306.232

    306.768

    299.198

    GP

    GA

    Logistic

    OLS

    Churn-Lift

    $-Lift

    Decile 1 (Test)

    GP (pop=200, maxcreate=8, maxcross=15)

    Max646.02371295625.51054965

    Decile 299Total SolutionsMax:423.784278.346417.932276.511Product of Lifts

    SizeResp-fit$-fitTrgNRespTrgRLiftTrg-$Trg$LiftTstNRespTstRLiftTst-$tst$LiftTrgRespLiftTrg$LiftTestRespLiftTest$LiftTrgTest

    330.6565040.3866853144328.2523897746193.3423111319.1423847282.1191.417328.252193.342319.142191.417634.64898184610.89204214

    320.7744830.3073393709387.2423097948.3153.6693711380.6933024045.1150.458387.242153.669380.693150.458595.07090898572.78307394

    250.6166210.4074112953308.3114106663.7203.7052930300.5744051286.6201.568308.311203.705300.574201.568628.04492255605.86100032

    380.3800380.5218031820190.0195259723.2260.9011797184.3465217852.3259.609190.019260.901184.346259.609495.76147119478.57880714

    300.7590310.3237033635379.5163262892.5161.8513650374.4363152576.6156.853379.516161.851374.436156.853614.25044116587.31409908

    460.4263940.5021922042213.1975062048.1251.0962019207.1195011286.4249.331213.197251.096207.119249.331535.32913912516.41187389

    110.2802260.5476271342140.1135520035273.8141296132.955474693.9272.388140.113273.814132.95272.388383.64900982362.139846

    580.318020.5370321523159.015413235.5268.5161498153.6735307700264.079159.01268.516153.673264.079426.9672916405.81812167

    30.2798080.547641340139.9045520163.8273.821294132.7455473096.8272.308139.904273.82132.745272.308383.0851328361.4752546

    290.2716640.5491251301135.8325535127274.5621288132.135452824.8271.3135.832274.562132.13271.3372.94305584358.46869

    60.279390.548061338139.6955524394.3274.031293132.6435474622.4272.384139.695274.03132.643272.384382.8062085361.29830912

    190.2975570.5421051425148.7785464364.9271.0521393142.9015425395269.935148.778271.052142.901269.935403.26574456385.73981435

    570.3203170.5363591534160.1595406451.4268.181503154.1855303166.1263.853160.159268.18154.185263.853429.5144062406.82174805

    300.6529550.3884823127326.4773915859.7194.2413079315.863876777.5192.885326.477194.241315.86192.885634.15218957609.246561

    280.2768850.5481051326138.4425524850.8274.0531285131.8225473270.3272.317138.442274.053131.822272.317379.40445426358.97371574

    480.2839840.5457021360141.9925500623.1272.8511327136.135445651.3270.943141.992272.851136.13270.943387.42659192368.8347059

    530.3142620.5390331505157.1315433408269.5171483152.1345326916.4265.035157.131269.517152.134265.035423.49475727403.2083469

    220.332220.5359181591166.115402004.9267.9591574161.4695337153.3265.544166.11267.959161.469265.544445.1066949428.77124136

    660.3173940.5378771520158.6975421754268.9391497153.575313522.4264.369158.697268.939153.57264.369426.79812483405.9914733

    190.2910840.5453131394145.5425496709.7272.6571375141.0555406464.4268.993145.542272.657141.055268.993396.83045094379.42807615

    500.425350.5031242037212.6755071448.4251.5621998204.9655026040.9250.065212.675251.562204.965250.065535.0094835512.54572725

    160.3050740.542081461152.5375464114.8271.041455149.2615358799.9266.621152.537271.04149.261266.621413.4362848397.96117081

    630.6527460.3904613126326.3733935810.6195.233106318.6293909089.2194.493326.373195.23318.629194.493637.1780079619.71110097

    410.7970350.2551073817398.5172571459.6127.5543852395.1582535223.4126.137398.517127.554395.158126.137508.32437418498.44044646

    120.2795990.547961339139.85523392.2273.981321135.5155441385.8270.73139.8273.98135.515270.73383.02404366.8797595

    330.6391730.3999063061319.5874031018.2199.9533032311.0383996633.7198.848319.587199.953311.038198.848639.02379411618.49284224

    650.5418670.4465642595270.9334501324.4223.2822579264.5674511679.6224.474270.933223.282264.567224.474604.94462106593.88412758

    130.3230320.5359921547161.5165402754.8267.9961513155.2115326114.7264.995161.516267.996155.211264.995432.85641936411.30138945

    510.4328670.4989742073216.4335029611.1249.4872090214.4034966690.1247.112216.433249.487214.403247.112539.97219871529.81554136

    630.709960.3557563400354.983585987177.8783399348.6873500515.9174.164354.98177.878348.687174.164631.4313244607.28722668

    580.5055340.4631552421252.7674668560.2231.5772389245.0764654131.8231.561252.767231.577245.076231.561585.35023559567.50043636

    100.3226140.536081545161.3075403637.3268.041512155.1095331488.6265.263161.307268.04155.109265.263432.3672828411.44678667

    560.6268530.4067893002313.4274100399.3203.3952968304.4734081092.9203.05313.427203.395304.473203.05637.49484665618.2324265

    350.3148880.5387431508157.4445430479.3269.3711488152.6475371270.3267.242157.444269.371152.647267.242424.10847724407.93689574

    710.3113380.5392391491155.6695435476269.6191467150.4925376718.5267.513155.669269.619150.492267.513419.71320111402.58566396

    690.792650.2886773796396.3252909838.1144.3383782387.9772894015.1143.989396.325144.338387.977143.989572.0475785558.64420253

    300.5322610.4613912549266.1314650782.3230.6962547261.2844576387.6227.693266.131230.696261.284227.693613.95357176594.92537812

    360.7408640.3400693548370.4323427860.6170.0343565365.7163314151.2164.892370.432170.034365.716164.892629.86034688603.03642672

    410.6500310.3910943113325.0163942187.8195.5473147322.8353836956.7190.904325.016195.547322.835190.904635.55903752616.3049284

    490.6349970.4038593041317.4984070860.3201.9293039311.7564022314.6200.126317.498201.929311.756200.126641.12053642623.90481256

    870.7062020.3567583382353.1013596086.3178.3793382346.9433596661.5178.948353.101178.379346.943178.948629.85803279620.84755964

    520.4882020.4765522338244.1014803599.4238.2762322238.2034805058239.071244.101238.276238.203239.071581.63409876569.47429413

    310.3560240.5325531705178.0125368086266.2761666170.9075280281.1262.715178.012266.276170.907262.715474.00323312448.99832505

    240.4121950.5097041974206.0975137774.1254.8521958200.8625079444.5252.722206.097254.852200.862252.722525.24232644507.62246364

    310.695970.3712943333347.9853742610.1185.6473348343.4553660467.2182.123347.985185.647343.455182.123646.02371295625.51054965

    510.7746920.3053653710387.3463078052.4152.6833708380.3863021489.3150.331387.346152.683380.386150.331591.41149318571.83807766

    500.6128630.4146312935306.4314179440.5207.3152955303.1394119136.1204.943306.431207.315303.139204.943635.27742765621.26216077

    100.2754230.5485071319137.7115528902.5274.2541283131.6175472400.2272.274137.711274.254131.617272.274377.67792594358.35887058

    110.3593650.5295021721179.6835337334.7264.7511707175.1135244681.5260.944179.683264.751175.113260.944475.71253933456.94686672

    640.5385260.4481842579269.2634517651.2224.0922596266.3114448978.5221.354269.263224.092266.311221.354603.39684196589.49005094

    350.3188560.5365111527159.4285407978.5268.2551479151.7235340361.1265.704159.428268.255151.723265.704427.6735814403.13407992

    420.7502610.3258343593375.1313284378.9162.9173595368.7943187615.1158.596375.131162.917368.794158.596611.15217127584.89253224

    630.8212570.2525623933410.6292545801.7126.2813934403.572570217.4127.878410.629126.281403.57127.878518.54640749516.0772446

    320.7333470.3458323512366.6743485957.2172.9163522361.3053392073.7168.769366.674172.916361.305168.769634.03801384609.77083545

    280.7868030.2936443768393.4022959901.7146.8223764386.132935682146.062393.402146.822386.13146.062577.60068444563.9892006

    210.2937980.5451091407146.8995494647.5272.5541370140.5425435356.8270.43146.899272.554140.542270.43400.37910046380.0677306

    610.4612650.4925542209230.6334964899.3246.2772181223.7384935884.7245.58230.633246.277223.738245.58567.99603341549.4557804

    870.7214450.3461323455360.7223488975.5173.0663480356.9963458013.7172.05360.722173.066356.996172.05624.28713652614.211618

    310.8475670.1674844059423.7841688221.483.74194074417.9321702968.284.7294423.78483.7419417.93284.7294354.884773496354.111276008

    550.3950720.5186651892197.5365228100.2259.3331878192.6555145076.1255.988197.536259.333192.655255.988512.27603488493.1736814

    380.4437250.4971032125221.8635010750.8248.5512093214.7114940498245.809221.863248.551214.711245.809551.44270513527.77896199

    530.4046770.5100691938202.3395141448.8255.0341920196.9635046127.2251.065202.339255.034196.963251.065516.03324526494.50515595

    340.5700560.4399142730285.0284434292.3219.9572751282.2124384492.9218.146285.028219.957282.212218.146626.93903796615.63418952

    500.627480.4054783005313.744087177.8202.7393000307.7554042405.9201.126313.74202.739307.755201.126636.0733386618.9753213

    720.615160.4125482946307.584158442.1206.2742935301.0874117201.6204.847307.58206.274301.087204.847634.4575692616.76768689

    230.2635210.5501981262131.765545944.6275.0991235126.6935493358.8273.316131.76275.099126.693273.316362.4704424346.27223988

    580.5353940.4495282564267.6974531201.9224.7642589265.5934454802.5221.644267.697224.764265.593221.644601.68648508588.67094892

    270.6671540.3796343195333.5773826681.2189.8173202328.4783772412.6187.692333.577189.817328.478187.692633.18585409616.52692776

    640.5387350.4479672580269.3674515471.7223.9842596266.3114448978.5221.354269.367223.984266.311221.354603.33898128589.49005094

    610.3952810.5184481893197.645225911.3259.2241880192.865143713.5255.92197.64259.224192.86255.92512.3303136493.567312

    310.3576950.5315841713178.8475358321.8265.7921679172.245270568.8262.232178.847265.792172.24262.232475.36101824451.66