Download - Using FME to Create Open Data Datasets
![Page 1: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/1.jpg)
Use of FME Workbench in Edmonton’s Open Data Catalogue
Bohdan HrynyshynCity of EdmontonIT Business Analyst, Open Data Team
Edmonton, Alberta - April 12, 2013
![Page 2: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/2.jpg)
What is Open Data?
Certain data to be freely available for everyone to use and republish as they wish, without restrictions or control
Rationale
Data generated or collected by public organizations belong to taxpayers, and where releasing it will not violate any laws or rights to privacy
Component of Open Government Building and maintaining relationships between
government and citizens by sharing ideas and information
![Page 3: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/3.jpg)
Make Local Government More …. Open Accountable Accessible
Why Open Data?
![Page 4: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/4.jpg)
Open Government …..
Encourage a Constant Exchange of Ideas
Want Government to make better decisions for all of us
![Page 5: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/5.jpg)
Openness ……..
Laws and Decisions Open for Discussion Collaboration in policy-making, policy
implementation, and policy enforcement
![Page 6: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/6.jpg)
Accessibility ……..
Budgets may be reviewed by anyone Government does not have all the answers – participation
through various communication tools Public may have necessary knowledge and experience to
deal with issues
Economic opportunities by turning data into apps, web-sites or other useful products
![Page 7: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/7.jpg)
Accountability ……
Public Officials are Accountable Government meetings are open to everyone Civic engagement, stakeholder groups collaboration,
collaborative public management, and dispute resolution with citizens and stakeholders have answerability
![Page 8: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/8.jpg)
Why Open Data Edmonton?
make accessible, data about Edmonton’s municipal services to Edmonton's citizens, media, and public
Why Are We Doing This?
City committed to better manage business information Provide easy access to public Data Assets Improve accessibility, transparency and accountability for City Of Edmonton data Increase engagement of citizens, community organizations and private businesses
in creative community problem solving and development of innovative services, applications and solutions
Promote ‘One City’ concept - one location for all city data Integrate data from various discrete data-sets to provide more value and
intelligence
![Page 9: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/9.jpg)
About Edmonton’s Open DataThe City of Edmonton - dedicated to using technology to make municipal information more open, transparent and accessible.
History
![Page 10: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/10.jpg)
Open Data Principles ……
1. Complete Data not subject to privacy, legislative, security or privilege limitations
2. Primary Data collected at source Granularity at lowest level possible not in aggregate or modified form
3. Timely Data is current and relevant
4. Accessible to wide range of users for many different purposes
![Page 11: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/11.jpg)
Open Data Principles ……
5. Machine processable Data structured for automated processing
6. Non-discriminatory Access Data available to anyone, with no requirements
7. Non-Proprietary Format Data available in format no entity has exclusive control
8. Data license-free Data not subject to any copyright, patent, trademark or
regulations
![Page 12: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/12.jpg)
Open Data Infrastructure
![Page 13: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/13.jpg)
Why Use FME?
Transform (restructure, reformat, and integrate) spatial and non-spatial data into proper format and structure for loading into Socrata’s Open Data Catalogue
Add spatial components to non-spatial data so it can be readily visualized on a map in Socrata’s Open Data Catalogue
![Page 14: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/14.jpg)
How to publish Open Data Cycle
Choose Data for Release Prepare data extract in Open Format (csv, xls,
shp) Create Open Data page on Catalogue Create Meta Data for dataset Make Dataset public
![Page 15: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/15.jpg)
FME Transformers
AttributeKeeper AttributeRenamer CoordinateExtractor NullAttributeReplacer Reprojector Sorter StringConcatenator StringSearcher Tester
![Page 16: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/16.jpg)
• extract data from SLIM (Oracle)• format and filter in FME• output as csv file
https://data.edmonton.ca/Environmental-Services/Trees-Species-Map-View-/cggb-hzzm
TreesList of all trees owned and maintained by the City of Edmonton
![Page 17: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/17.jpg)
https://data.edmonton.ca/City-Administration/City-of-Edmonton-s-Properties-for-Sale/yutc-c5ju
• extract view data from SLIM (Oracle) and POSSE
• format and filter in FME• output as csv file
City Properties for SaleList of all City-owned properties for sale
![Page 18: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/18.jpg)
City of Edmonton/NAIT Solar Panel Reference System - Daily Power Production
Daily production of electrical power from solar panels located at NAIT
https://data.edmonton.ca/Environmental-Services/City-of-Edmonton-NAIT-Solar-Panel-Reference-System/ysgw-us2d
• assemble “scraped” data for each panel from vendor using FME
• format and consolidate each panel• output as csv file
![Page 19: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/19.jpg)
Portable SignsList of all licensed portable signs in the City
https://data.edmonton.ca/Sustainable-Development/Temporary-Signs-Map/xt3a-rjpj
• extract data from POSSE Data Warehouse
• format and filter in FME• output as csv file
•
![Page 20: Using FME to Create Open Data Datasets](https://reader035.vdocument.in/reader035/viewer/2022081413/546f7cefaf795935168b4886/html5/thumbnails/20.jpg)
Thank You!
Questions?
For more information: Bohdan Hrynyshyn – City of Edmonton, IT Branch