danny bryant city of atlanta. information technology manager, sr. – city of atlanta user...
TRANSCRIPT
![Page 1: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/1.jpg)
Database Migration:DBA Stuff for the Non-DBA
Danny BryantCity of Atlanta
![Page 2: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/2.jpg)
About the Presenter
Information Technology Manager, Sr. – City of Atlanta
User Groups: ODTUG, OAUG, IOUG
Publications: ODTUG – Why I Joined ODTUGRMOUG – SQL>UPDATE
Regular Expressions: A Love/Hate Relationship
IOUG – SELECT Journal XML Gateway Setup
Podcast – SQL Dev 4.0 City of Atlanta
Danny Bryant
@dbcapoeira
http://implementoracle.blogspot.com
Danny Bryant
![Page 3: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/3.jpg)
Agenda The City of Atlanta “You want to do WHAT?” SQL Developer to the Rescue
o Setupo Migrationo Populating Tableso Reporting
Lessons Learned Q&A
![Page 4: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/4.jpg)
The City of Atlanta Overview
o Includes the Mayor/Executive Offices (13 Departments), Judicial and Board Officers, and City Council (16 Members)
o Metropolitan Statistical Area (MSA) is the 9th largest metropolitan area in the country
o Population of 443,775 citizens (2012 US Census estimate)
o Manages Hartsfield-Jackson International Airport, the world's busiest airport by serving over 95MM passengers in 2012
o Approximately 7,500 active employees and 5,000 retirees
o $1.8B Operating Budget
![Page 5: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/5.jpg)
The City of Atlanta Oracle Footprint
o Enterprise Resource Planning (ERP) Applications (eBS 11.5.10.2)
● Financials
● Human Resources Management System
● Procurement
● Discoverer Reporting
o Siebel Customer Relationship Management (CRM) Applicationso Enterprise Performance Management (EPM) Applications
(v11.1.2)● Hyperion Public Sector Planning and Budgeting
● Hyperion Financial Management
o Oracle Business Intelligence Enterprise Edition (OBIEE v11.1.1.2)
● Human Resources Analytics
● Financial Analytics
![Page 6: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/6.jpg)
History
Oracle EBSDatabase (10g)
PeopleSoftMS SQL Server
2 years of historical data
In the beginning there was ….
2005 - 2007
Beginning of time - 2005 2005 - 4712
MARS-GMS SQL Server
![Page 7: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/7.jpg)
You want to do WHAT?
![Page 8: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/8.jpg)
Problem We need historical data prior to 2005
o Pension Reformo Open Records Requestso Retiree Information
![Page 9: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/9.jpg)
Solution Gather Requirements Query PeopleSoft for < 2005 data
o Export to Excel Query EBS for > 2005 data
o Export to Excel Stitch data together Email results to requestor Cross your fingers
![Page 10: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/10.jpg)
There’s Got to be a Better Way
How can we speed up this process? How can we empower the end users? How do we take advantage of our existing
reporting tools? -- Discoverer
![Page 11: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/11.jpg)
SQL Developer To the Rescue
![Page 12: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/12.jpg)
Database Migration Tool
Why SQL Developer?o Integrated UIo Wizard Driven o DDL Script Generationo Online Data Modeo Offline Data Moveo Repository Based (we will see this shortly)o Log File
![Page 13: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/13.jpg)
Enough Already – Get to it!
Pre-Requisites1. Install 3rd party driver for source DB connectivity2. Admin access to the MSSQL database3. Build repository in a new schema for the meta-data,
the user requires the following role and system privileges:● RESOURCE● CREATE SESSION● CREATE VIEW● UNLIMITED TABLESPACE (If using 12c)
![Page 14: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/14.jpg)
What Did I Do? Four Phases
1. Verify Source DB Access2. Create Migration Repository3. Set up SQL Developer4. Perform the Migration and Wait
![Page 15: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/15.jpg)
Phase I – Verify Source DB Access
For MSSQL, I needed db_owner permissions
![Page 16: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/16.jpg)
Phase II – Create the Repository
Create your Migration Repository in your new schema. In this example:migrationdemo
![Page 17: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/17.jpg)
Phase III – Set up SQL Developer
Launch the Migration Wizard
![Page 18: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/18.jpg)
Phase III – Set up SQL Developer
![Page 19: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/19.jpg)
Phase III – Set up SQL Developer
This will coincide with the 3rd party driver. In this case my source was SQLServer.
![Page 20: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/20.jpg)
Phase III – Set up SQL Developer
![Page 21: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/21.jpg)
Phase III – Set up SQL Developer
![Page 22: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/22.jpg)
Phase III – Set up SQL Developer
This is your Migration Repository schema
![Page 23: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/23.jpg)
Phase III – Set up SQL Developer
![Page 24: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/24.jpg)
Phase IV – Perform Migration
![Page 25: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/25.jpg)
Phase IV – Perform Migration
![Page 26: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/26.jpg)
What’s Happening
![Page 27: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/27.jpg)
What’s Happening
![Page 28: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/28.jpg)
What’s Happening
![Page 29: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/29.jpg)
Phase V – Set up Reporting
![Page 30: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/30.jpg)
Lessons Learned
![Page 31: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/31.jpg)
Lessons Learned - Migrate
Directly to Target DB
1. Compatibility issues with DDL when DB versions are different.
PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING STORAGE(INITIAL 131072 NEXT 131072 MINEXTENTS 1 MAXEXTENTS 2147483645 PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
DB 10.2.0.4 doesn’t like this.
![Page 32: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/32.jpg)
Lessons Learned - Migrate
Directly to Target DB
2. Extra Step to Populate DB Tables
3. Use Database Copy
![Page 33: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/33.jpg)
Lessons Learned – Get Familiar
with the Logs
![Page 34: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/34.jpg)
What’s Next
![Page 35: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/35.jpg)
What’s Next?
![Page 36: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/36.jpg)
Useful Links 3rd Party Drivers
o IBM DB2: http://www-306.ibm.com/software/data/db2/express/additional-downloads.html
o Microsoft SQL Server and Sybase: jTDS driver available from http://jtds.sourceforge.net/. Use version 1.2
o MySQL: http://dev.mysql.com/downloads/connector/j/5.0.htmlo Teradata: http://www.teradata.com/downloadcenter/
Oracle documentation on Database Migrationo http://
www.oracle.com/technetwork/database/migration/omwb-getstarted-093461.html
![Page 37: Danny Bryant City of Atlanta. Information Technology Manager, Sr. – City of Atlanta User Groups:ODTUG, OAUG, IOUG Publications:ODTUG – Why I Joined](https://reader030.vdocument.in/reader030/viewer/2022020111/56649d745503460f94a5458a/html5/thumbnails/37.jpg)
Thank You
Danny Bryant
ODTUG Marketing Committee
Kscope14 Abstract Review Committee
Editor's Choice review team
Student Day Hackathon Judge
@dbcapoeira
http://implementoracle.blogspot.com
Danny Bryant