all that movies
DESCRIPTION
All That Movies. BIFE Presentation. Agenda. Brief Introduction Dashboard Showcase Other Interesting Discoveries Technical Design Team Work. Brief Introduction. Cereal Killers. Jiang Yongli. Peng Cen. Xia Bing. Motivation. What we want to do is all about movies - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/1.jpg)
All That Movies
BIFE Presentation
![Page 2: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/2.jpg)
Agenda
• Brief Introduction• Dashboard Showcase• Other Interesting Discoveries• Technical Design• Team Work
![Page 3: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/3.jpg)
BRIEF INTRODUCTION
![Page 4: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/4.jpg)
Cereal Killers
Jiang Yongli Peng Cen Xia Bing
![Page 5: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/5.jpg)
Motivation
• What we want to do is all about movies– Analyze movies and movie business
from different perspectives– Give suggestions for different kinds of
people
![Page 6: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/6.jpg)
Target Customers
• Movie fans• Movie Journalists• Movie companies• Directors and Actors/Actresses• Investors
![Page 7: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/7.jpg)
Data source
• IMDB website• 11,000+ movies from 1898 to
present• 81,000+ actors/actresses• 4,700+ directors• 11,000+ movie companies
![Page 8: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/8.jpg)
DASHBOARD SHOWCASE
![Page 9: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/9.jpg)
OTHER INTERESTING DISCOVERIES
![Page 10: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/10.jpg)
Sex Battle
Males’ FavoriteThe Shawshank Redemption
The Godfather
Hababam sinifi
The Godfather: Part II
Inception
Pulp Fiction
The Good, the Bad and the Ugly
Tosun Pasa
The Dark Knight
Star Wars: Episode V - The Empire Strikes Back
Females’ FavoriteThe Code Conspiracy
Little Ghost
The Shawshank Redemption
Inception
Toy Story 3
The Belly of the Beast
The Lord of the Rings: The Return of the King
Schindler's List
My Father and My Son
The Dark Knight
![Page 11: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/11.jpg)
Our Parents’ FavoriteMovie Name Movie Year
Casablanca 1943
The Godfather 1972
12 Angry Men 1957
Rear Window 1955
North by Northwest 1959
To Kill a Mockingbird 1962
The Treasure of the Sierra Madre 1948
The Godfather: Part II 1974
Raiders of the Lost Ark 1981
One Flew Over the Cuckoo's Nest 1976
![Page 12: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/12.jpg)
And many more…
• Directors born in Maryland are fond of Comedy movies (36/55 movies) and have no interest in Animation movies (0/55 movies)
• Directors born in Rome love Horror movies (40/83 movies) and hate Romance movies (4/83 movies)
• …
![Page 13: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/13.jpg)
TECHNICAL DESIGN
![Page 14: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/14.jpg)
Working Progress
ETL Processing
Design Logical Data Model
Design Data Warehouse Schema
Create Project
Create Report and Dashboard
![Page 15: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/15.jpg)
ETL Processing
• Data scale:– 131,000+ web pages
• Crawler:– Simulate HTTP request
• Extraction:– XPath + Regular Expressions
• Save to DB:– ODBC + SQL
![Page 16: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/16.jpg)
Logical Data Model
• Time Hierarchy
Year
Month of YearQuarter
Month
Day
![Page 17: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/17.jpg)
Logical Data Model (continued)
• Geography HierarchyContinent
State
City
Country Language
Movie
![Page 18: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/18.jpg)
Logical Data Model (continued)
• Production Hierarchy
Company
Gender
Director
Birth DateBirth Country
Movie
Genres
Performer
![Page 19: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/19.jpg)
Data Warehouse Schema
• 16 Look Up Tables
![Page 20: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/20.jpg)
Data Warehouse Schema (continued)
• 2 Fact TablesMOVIE_BUSINESS
MOVIE_ID
BUDGET
BUDGET_RANGE_ID
BOX_OFFICE_US
BOX_OFFICE_WORLDWILD
BOX_OFFICE_OPENING_WEEKEND
…
RATING_FACT
MOVIE_ID
WEIGHTED_AVERAGE_RATING
AVERAGE_RATING
AVG_FEMALE_RATING
AVG_MALE_RATING
AVG_UNDER18_RATING
AVG_ABOVE45_RATING
…
![Page 21: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/21.jpg)
Data Warehouse Schema (continued)
• 6 Relationship TablesMOVIE_DIRECTORMOVIE_PERFORMERMOVIE_GENRESMOVIE_COUNTRYMOVIE_LANGMOVIE_COMPANY
![Page 22: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/22.jpg)
Project/Report/Dashboard Design
• 25 Tables including one Data Mart table• 21 Attributes• 53 Facts• 3 User Hierarchies• 72 Metrics• Used smart metric, level metric, evaluation order,
derived metric, view filter, conditional metric, report as filter, etc. in our reports
• Widgets used: Interactive Stack Graph, Interactive Bubble Graph, Media, Data Cloud, Heat Map, Time Series Sliders, etc.
• Miscellaneous selectors
![Page 23: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/23.jpg)
Problems We Met
• Media widget automatically shrinks image whenever we resize it
We set filling color the same as the border color and put it in another container with same filling color to make this not obvious.
![Page 24: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/24.jpg)
Problems We Met
• We cannot use dynamic text for different attributes with the same name(e.g. Director’s Birth Date and Performer’s Birth Date), even if we use {[dataset name]}:{[object name]}.
• We use grid to show these attributes and using formatting tricks.
![Page 25: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/25.jpg)
Problems We Met
• View Filter on most Metrics is not valid in dashboard.
• We try to make sophisticated level metric and report filter to solve the problem.
![Page 26: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/26.jpg)
Problems We Met
• Flash mode always timeout when loading after we merged all dashboards together.
• We divided our dashboards into two.
![Page 27: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/27.jpg)
Problems We Met
• And many more problems…• And many more solutions…
![Page 28: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/28.jpg)
TEAM WORK
![Page 29: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/29.jpg)
Cooperation
• Face to face discussion• Communicator• Email• Shared Folders• Shared Intelligence Server• Everyone took part in each section
more or less
![Page 30: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/30.jpg)
Work Foucuses
• Xia Bing:– Team leader, ETL process, recommended
directors and performers dashboard and related reports
• Jiang Yongli:– Warehouse design, project building, movie
business dashboard and related reports• Peng Cen:– Logical model design, top and bottom movies
dashboard and related reports, dashboard formatting
![Page 31: All That Movies](https://reader036.vdocument.in/reader036/viewer/2022081503/56815e78550346895dccfaab/html5/thumbnails/31.jpg)
THANKS
Do Not Imitate! We Are Professional!