interagency data team meeting - washington, d.c. · • microstrategy integration guidelines for...

CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.

Interagency Data Team

January 23, 2019

CUSTOMER SERVICE. ACCOUNTABILTY. EFFICIENCY. SECURITY.

WELCOME, AGENDADATA TEAM NEWS

Michael BentivegnaData Visualization and Analysis Program Manager

Office of the Chief Technology Officer


AGENDA• Welcome, News & Updates

Michael Bentivegna, Data Visualization and Analysis Program ManagerOffice of the Chief Technology Officer

• New GIS Database & Affects to Existing ApplicationsMario Field, Data Curation Program ManagerOffice of the Chief Technology Officer

• Enterprise Data Inventory in ProgressEva Reid, Data Visualization and Analysis Senior AnalystOffice of the Chief Technology Officer

• Data Stewardship & IT Contract Language for Data CollectionJames Graham, GIS and Applications ManagerDistrict Department of Transportation

• Mayor’s Opendata.dc.gov Analytics Hub Pages Alex Santos, Enterprise Mapping GIS IT SpecialistOffice of the Chief Technology Officer


BUSINESS INTELLIGENCE SOFTWARE UPDATES

• Tableau Production version 2018.1.1

• Major upgrade to move to 2018.3• Setting up test servers for the migration

• Targeting the end of February for the upgrade

• Hold off on Desktop upgrades (keep at 2018.1.x if publishing to the server)

• Architecture review session• Sized appropriately and have room for growth with best practices

• Feed back: clean up unused data/work books, use more incremental extracts, 7 am schedule bottleneck. Will be reaching out to select agencies.

• Tableau Public w/automated ETL updates • Hyper not currently supported by Informatica Tableau extension at this time

• Box plug-in will be tested as a public data source

• Tableau Site Administrators Quarterly meetings• First meeting will be held later in this quarter (date TBD)


BUSINESS INTELLIGENCE SOFTWARE UPDATES

• MicroStrategy Production Version 10.11 • Public MicroStrategy Environment (expected end of February)

• Moving MicroStrategy Web servers from Linux to Windows (WebLogic to IIS) – testing done, migration steps planning

• Created public facing MicroStrategy web servers, back end integration is underway.

• MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed.

• New physical servers with more CPU power and memory in the final stages of deployment as the MicroStrategy Production servers, expected FY19 end of Q2.

• Self services BI Best practices guideline including security.

• Beta Testing with DGS


GIS SOFTWAREDC AGOL – ARCGIS ONLINE/PORTAL

• ArcGIS Server Upgraded to version 10.6

• 10.6.1 being tested

• Streaming services

• ESRI GeoEvent will be in production @10.6.1

• Apache Kafka® distributed streaming platform –real time IOT Streaming data (FY 19 Q2 production)

• ArcGIS Portal version at 10.6.1


BI TRAININGHTTPS://OCTO.IN.DC.GOV/PAGE/GIS-AND-BI-APPS-AND-SERVICES

• Tableau Intro & Intermediate (Eventbrite – search Tableau)

• Introductory training (February is wait listed)

• March 20 and 21

• April 3 and 4

• Intermediate training (February is wait listed)

• March 26 and 27

• April 10 and 11

• MicroStrategy Intro Classes (Eventbrite – search MicroStrategy)

• February 12 and 13

• March 12 and 13

• April 30 and May 1

• May 28 and 29


GIS TRAINING

• GIS (PeopleSoft – request training – Search by name “GIS” or course number)

• 230 Overview DC GIS Services February 6, April 10th, May 8th, September 11th

• 233 ArcGIS Online Virtual Sessions to be scheduled in the near future.

• ArcGIS Pro training is under development

• ESRI Federal User Conference (Jan. 29th -30th) https://www.esri.com/en-us/about/events/federal-gis-conference/overview


NEW GIS DATABASE & AFFECTS TO APPLICATIONS

Mario Field, Data Curation Program Manager



GIS 2.0 STATUS• Built 2.0 Database Framework

• Setting up FME infrastructure

• Production database on Exadata

• Map services published to AGS 10.6

• Live database Available 3/31/19


GIS 2.0 ARCHITECTUREGEODEV• GIS development database• Versioning, archiving, replication, editor

tracking, standardization• Only geospatial layers• Agency Editing

GEOTEST• GIS Testing database\

GEOPROD (Exadata)• GIS Production/Publication database

FMEReplication


GIS 2.0 ATTRIBUTION RULESOLD COLUMN NAME NEW COLUMN NAME ACTIONADDRID MAR_IDADDRESS_ID MAR_IDADDR_ID MAR_IDX XCOORDX_COORDINATE XCOORDPOINT_X XCOORDY YCOORDY_COORDINATE YCOORDPOINT_Y YCOORDWEB_URL note it as in layerWEBURL note it as in layerURL note it as in layerLAT LATITUDELONG LONGITUDENAME if no name is present in table, note itADDR ADDRESSADDRES ADDRESSLOCATION ADDRESSDESCRIPTIO DESCRIPTIONDIFFX removeDIFFY remove


GIS 2.0: SCREENSHOTS


OPEN DATA HANDBOOK


DATA SUBMISSION PROCESS

Preparation (AGENCY AND OCTO): Initiate and document submission

Consultation (AGENCY AND OCTO): Work with Customer to finalize submission

Curation (OCTO): Perform QA/QC, Data Transformation, Metadata, and Testing

Publication (OCTO): Publish Data


DATASET RULES


METADATA


ENTERPRISE DATA INVENTORYPROGRESS

Eva Reid, Data Visualization and Analysis Senior Analyst



DATA STEWARDSHIP & IT CONTRACT LANGUAGE FOR DATA COLLECTION

James Graham, GIS and Applications ManagerDistrict Department of Transportation


MAYOR’S OPENDATA.DC.GOV HUB PAGES

Alex Santos, Enterprise Mapping GIS IT SpecialistOffice of the Chief Technology Officer


• Request for,

• Economic Development

• Housing

• Education

• Public Safety

• Environment

• Transportation

• An exercise in using existing content

1. Quick Stats with Open Data Cards

2. Analytics using Tableau, MicroStrategy & ArcGIS Online

3. Existing Web Apps

4. Highlighted Data (data.dc.gov, dc.gov…)

5. DC Programs for Residents


• DMPED Econ Intelligence Dashboard

• OSSE School Report Card(next get this into data.dc.gov)

• DDOT UFA / VZ / Circulator

• Data.dc.gov

• MPD Crime Cards

http://open.dc.gov/economic-intelligence/

https://dcschoolreportcard.org/

https://urban-forestry-dcgis.opendata.arcgis.com/


• http://opendata.dc.gov/pages/mayor-housing

• -economic-development

• …

http://opendata.dc.gov/pages/mayor-housing

http://opendata.dc.gov/pages/mayor-housing


LEARNED…

• Inconsistent field types

• Check statistic results

• Tableau embeds

• Large dashboards

• More ArcGIS Insights


OPEN DISCUSSION

NEXT MEETING TENTATIVELY SCHEDULED FOR MARCH 2019

THANK YOU

interagency data team meeting - washington, d.c. · • microstrategy integration guidelines for...

Documents