introducing power laws - amazon s3 · summary of unit four introducing power laws introduction to...
TRANSCRIPT
![Page 1: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/1.jpg)
Summary of Unit Four
Introducing Power Laws
Introduction to Fractals and Scaling
David P. Feldman
http://www.complexityexplorer.org
![Page 2: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/2.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Initial Observations
● Box-Counting: ● If equation is true, there is self-similarity,
and we see a line on a log-log plot.● Reverse logic: If we see linear behavior
on log-log plot, there must be self-similarity.
● Power law:
![Page 3: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/3.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Example: Word Frequencies in Moby Dick
● Determine frequencies of all words.● Plot histogram of frequencies.● There are 18,855 different words. There is one word that appears 14,086
times. There are 9161 words that appear only once.
● Data from: http://tuvalu.santafe.edu/~aaronc/powerlaws/data.htm
![Page 4: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/4.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Normal Probability Disribution
● Average a, standard deviation sigma
● Strong central tendency.
● Small range of outcomes
● Fig source: https://explorable.com/normal-probability-distribution
![Page 5: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/5.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Central Limit Theorem
● Let X_i be a set of random variables● Then the sum of N such random variables is
normally distributed as N gets large...● Regardless of the distribution of X_i.● (Provided that the distribution of the X_i's has
finite variance.)● A variable that is the result of a number of
additive influences should be normal.
![Page 6: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/6.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Exponential Distribution● Also called geometric
distribution● Large range of
outcomes, but probability decreases very quickly
● Waiting times between events that happen with constant probability.
![Page 7: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/7.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Power Laws have Long Tails●Power laws decay much more slowly than exponentials.
●Very large x values, while rare, are still observed.●Exponential: p(50) = 0.00000000078●Power Law: p(50) = 0.000244
![Page 8: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/8.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Power Laws are Scale Free
● Power laws look like the same at all scales.
![Page 9: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/9.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Exponentials are not Scale Free
● Exponential functions do not look the same at all scales
![Page 10: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/10.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Power Laws are Scale Free
● Power Law
● Same ratio no matter what x is.
● Exponential
Ratio depends on x
![Page 11: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/11.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Some Mathematical Notes
● Power laws are the only distribution that is scale free
● Discrete and Continuous probability distributions are different mathematical entities and need to be handled differently.
● However, from “20,000 feet” the difference is usually not crucial.
![Page 12: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/12.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Power Laws and Averages
● Non-power law example: toss coin, get $1 if Heads, $0 otherwise.
● Average winnings quickly approaches $0.5.
![Page 13: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/13.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
St. Petersberg Game
● Keep tossing a coin until you get Heads. You win 2x, where x is the number of tosses.
● Rarely you get very large payoffs.● The average winnings does not exist: it is
infinite.
![Page 14: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/14.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
St. Petersberg Game
![Page 15: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/15.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Power Laws and Averages
● the average does not exist.● the standard deviation does not exist.● Ex:
![Page 16: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/16.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Power Laws and Averages
● the average does not exist.● the standard deviation does not exist.● Ex:
![Page 17: Introducing Power Laws - Amazon S3 · Summary of Unit Four Introducing Power Laws Introduction to Fractals and Scaling David P. Feldman](https://reader030.vdocument.in/reader030/viewer/2022040607/5ebd8ca3f3a9ad2ec20da9df/html5/thumbnails/17.jpg)
David P. Feldman Introduction to Fractals and Scaling http://www.complexityexplorer.org
Power Laws
● Long tails.● Self-similar.● Sometimes averages or standard deviation
does not exist.● Very different from most distributions we're
used to.