data and database administration. data and database administration cisb514 advanced database...

43
CISB 314 –Database 2 Data and database administration

Upload: barbra-hensley

Post on 26-Dec-2015

284 views

Category:

Documents


7 download

TRANSCRIPT

  • Slide 1
  • Data and database administration
  • Slide 2
  • Data and Database Administration CISB514 Advanced Database Database administrator
  • Slide 3
  • Data and Database Administration CISB344 Database 2 Here are the monthly salaries for DBA Position levelMin (RM)Average(RM)Max(RM Senior Executive5,5007,0008,892
  • Slide 4
  • Data and Database Administration CISB344 Database 2 DBA salary NoPosition level Position title stateageex p industryqualificati on Salary (RM) 1ManagerDBA Manager selangor3312retailmaster7,300 2Senior executive DBAPenang266electricalbachelor5,500 3Senior executive DBAKL286Finance/insuranceProfessional degree 6,800 4Senior executive Oracle DBAKL276IT / softwarePost. Grad diploma 5,500 5Senior executive SQL DBAselangor357IT (Hardware)Bachelor6,800 6Senior executive Senior oracle DBA KL4119IT (software)Diploma8,300
  • Slide 5
  • Data and Database Administration CISB344 Database 2 Tan Chong & Sons Motor Co. Sdn Bhd DBA Assistant Kuala Lumpur - Jalan Ipoh Responsibilities: Manage Both Oracle DB and SQL Server - support in the area in supporting to DB Administrator and also Tan Chong Database requirement. Systems Delivery Responsible for change management, administrator for SQL Server and Oracle, timely patch management, deployment of business systems. Conduct post-implementation reviews and recommend continual improvements. IT Governance Ensuring, enforcing and Compliance to IT policy and procedures. User Management Ensuring and maintenance of the users access to the Database system. Requirements: Candidate must possess at least a Degree in Computer Science / IT or equivalent. A minimum of 2 years working experience in process definition, analysis, design and implementation. In-depth domain knowledge in operations, planning, services and customer support preferably in the automotive industry. Ability to work under time pressure, manage multiple groups of users while maintaining a positive and patient attitude. Excellent command of both written and spoken English. Self motivated with attention to detail. Organizes own workload, sets priorities and works within deadlines. Excellent organization, communication and interpersonal skills. Ability to process assignments in an efficient, accurate and timely manner. Able to work with minimum supervision, as well as able to contribute to team development. People and results oriented and committed with a strong sense of urgency. Professional certification in IT or customer service will be an added advantage.
  • Slide 6
  • Data and Database Administration CISB344 Database 2 T-Systems Malaysia Sdn Bhd Oracle DBA (Data Administrator) Kuala Lumpur Cyberjaya Responsibilities: Working on a team of 5 professional Oracle DBAs (database administrators), you participate in the support and development of the nearly 120 Oracle based applications within the organization and globally as well. Oracle based applications are mostly downstream with some corporate systems. Oracle has been the strategic DB toolset, and there are some non-critical implementations of SQL Server. Key activities as part of this role on the team include: Administration, tuning, installation, upgrading, data management and security of the Oracle databases. Consulting functions, working with a variety of IT teams implementing Oracle based applications (Group developed, in-house developed and vendor purchased). Participate in pager rotating Oracle support team (5 members), which includes 7x24 for currently 3 database instances supporting highly critical business functions. Rotate with other members on Support or Projects. Skills: UNIX, Oracle, SQL
  • Slide 7
  • Data and Database Administration CISB344 Database 2 AmBank Database Administrator (Technical Services) Responsibilities: The Database Administrator is responsible to support and maintain databases on open system platform of AmBank Group. The incumbent will also manage the IT implementation / maintenance of the banks key and strategic business initiatives and projects Provide database administration services to users, operation support and projects Maintains an efficient of database system as to ensure maximum uptime of application system as expected in service level agreement Key person in troubleshooting, maintaining and ensuring that the technical components of the system are integrated to provide maximum efficiency Perform variety of tasks, which include feasibility studies, system reviews, security assessments and long-term planning Provide technical consultancy to application developers and users Develop technical enhancement and documentation on database aspect for project deployment and operation Requirements: Candidate must possess at least a Bachelor's Degree or Professional Degree in Computer Science/Information Technology or equivalent (CGPA at least 3.00) Possess at least 2 years extensive hands-on experience in Oracle, DB2 (LUW) or Sybase RDMS. Certified with Oracle (OCP), DB2 or Adaptive Server Enterprise Administrator is an advantage Knowledge in other RDMS such as MS SQL, MY SQL and PostgreSQL would be an added advantage Comprehensive knowledge of the database programming environments, including optimization, tuning and application interfaces Candidate must possess good communication skills, negotiation skills, problem-solving, analytical skills and ability to work under pressure (tight deadlines) Able to work independently with minimum supervision
  • Slide 8
  • Data and Database Administration CISB344 Database 2 Other job advertisements Ventyx Database Administrator Requirements: 3 - 5 years experience in SQL Server Database Administration. 1 - 2 years experience in Oracle Database Administration. Skilled in a scripting language (ie. UNIX shell, Perl, etc). NT Administration skills. Formal training in database theory, (ie. IT degree or diploma from a recognised institution) Industry certifications. Experience in one or more of the following an advantage: DB2 database administration, PostgreSQL database administration, UNIX administration, Zenoss administration. GenesisH Infotech (M) Sdn Bhd Database Administrator Skill & Requirement Sets: Needs SQL, MYSQL, Oracle 9i and 10g, Access, Tomcat and Appache experience. At least 5 year(s) of working experience in the related field is required for this position. Full-Time position available.
  • Slide 9
  • Data and Database Administration CISB514 Advanced Database Data Quality
  • Slide 10
  • Data and Database Administration CISB344 Database 2 10 Learning Outcomes At the end of this lecture, you should be able to: Define terms Describe importance and goals of data governance Describe importance and measures of data quality Define characteristics of quality data Describe reasons for poor data quality in organizations Describe a program for improving data quality
  • Slide 11
  • Data and Database Administration CISB344 Database 2 Data Governance Data governance A set of processes and procedures aimed at managing the data within organization. To achieve high-level objectives such as availability, integrity and compliance with regulations. Data steward A person responsible for ensuring that organizational applications properly support the organizations goals for data quality. 11
  • Slide 12
  • Data and Database Administration CISB344 Database 2 Requirements for Data Governance Sponsorship from both senior management and business units A data steward manager to coordinate data stewards Data stewards for different business units, subjects, and/or source systems A governance committee to provide data management guidelines and standards 12
  • Slide 13
  • Data and Database Administration CISB344 Database 2 13 Importance of Data Quality Minimize IT project risk Make timely business decisions Ensure regulatory compliance Expand customer base
  • Slide 14
  • Characteristics of Quality Data Uniqueness Accuracy Consistency Completeness Timeliness Currency Conformance Referential integrity 14
  • Slide 15
  • Data and Database Administration CISB344 Database 2 15 Causes of poor data quality External data sources Lack of control over data quality Redundant data storage and inconsistent metadata Proliferation of databases with uncontrolled redundancy and metadata Data entry Poor data capture controls Lack of organizational commitment Not recognizing poor data quality as an organizational issue
  • Slide 16
  • Data and Database Administration CISB344 Database 2 16 Data quality improvement Get business buy-in Perform data quality audit Establish data stewardship program Improve data capture processes Apply modern data management principles and technology Apply total quality management (TQM) practices
  • Slide 17
  • Data and Database Administration CISB344 Database 2 Business Buy-in Executive sponsorship Building a business case Prove a return on investment (ROI) Avoidance of cost Avoidance of opportunity loss 17
  • Slide 18
  • Data and Database Administration CISB344 Database 2 Data Quality Audit Statistically profile all data files Document the set of values for all fields Analyze data patterns (distribution, outliers, frequencies) Verify whether controls and business rules are enforced Use specialized data profiling tools 18
  • Slide 19
  • Data and Database Administration CISB344 Database 2 Data Stewardship Program Roles: Oversight of data stewardship program Manage data subject area Oversee data definitions Oversee production of data Oversee use of data Report to: business unit vs. IT organization? 19
  • Slide 20
  • Data and Database Administration CISB344 Database 2 Improving Data Capture Processes Automate data entry as much as possible Manual data entry should be selected from preset options Use trained operators when possible Follow good user interface design principles Immediate data validation for entered data 20
  • Slide 21
  • Data and Database Administration CISB344 Database 2 TQM Principles and Practices TQM Total Quality Management TQM Principles: Defect prevention Continuous improvement Use of enterprise data standards Balanced focus Customer Product/Service 21
  • Slide 22
  • Data and Database Administration CISB514 Advanced Database Data Administration & Database Administration
  • Slide 23
  • Data and Database Administration CISB344 Database 2 Learning outcomes At the end of this lecture, you should be able to: Define terms related to data & database administration List several major functions of data/database administration Describe the changing roles of the data and database administrator in the current business environment
  • Slide 24
  • Data and Database Administration CISB344 Database 2 Traditional Administration Definitions Data Administration Data Administration: A high-level function that is responsible for the overall management of data resources in an organization, including maintaining corporate-wide definitions and standards Database Administration Database Administration: A technical function that is responsible for physical database design and for dealing with technical issues such as security enforcement, database performance, and backup and recovery
  • Slide 25
  • Data and Database Administration CISB344 Database 2 Traditional Data Administration Functions 1. Data policies, procedures, standards 2. Planning 3. Data conflict (ownership) resolution 4. Managing the information repository 5. Internal marketing of DA concepts
  • Slide 26
  • Data and Database Administration CISB344 Database 2 Traditional Data Administration Functions Data policies, procedures, standards Data Policies: statements that make explicit the goals of DA Every user must have a valid password Data procedure: written outlines of actions to be taken to perform certain activity Data Standard: explicit conventions and behaviors that are to be followed and that can be used to help evaluate database quality Minimum characters for password: 8
  • Slide 27
  • Data and Database Administration CISB344 Database 2 Traditional Data Administration Functions Planning Provide leadership in developing the organizations Information Architecture (IA)Information Architecture (IA) Requires both an understanding the needs of the organization for data and information and the ability to lead the development of an information architecture
  • Slide 28
  • Data and Database Administration CISB344 Database 2 Traditional Data Administration Functions Data conflict (ownership) resolution Who owns the data? DA: suitable person because DA is not associated with a certain department Procedures must be established
  • Slide 29
  • Data and Database Administration CISB344 Database 2 Traditional Data Administration Functions Managing the information repository Repositories contain metadata describe an organizations data and data processing resources Replacing Data Dictionaries Serves as an essential source of information and functionality for: Users: who must understand data definitions, business rules and relationships among data objects CASE tools used to specify and develop IS Applications that access and manipulate data DBMS: maintain the repository and update system privileges, passwords, object definitions
  • Slide 30
  • Data and Database Administration CISB344 Database 2 Traditional Data Administration Functions Internal marketing of DA concepts The importance of procedures and policies Effective internal marketing reduce resistance to change and data ownership problems
  • Slide 31
  • Data and Database Administration CISB344 Database 2 Traditional Database Administration Functions 1. Analyzing and designing databases 2. Selection of DBMS and software tools 3. Installing/upgrading DBMS 4. Tuning database performance 5. Improving query processing performance 6. Managing data security, privacy, and integrity 7. Data backup and recovery
  • Slide 32
  • Data and Database Administration CISB344 Database 2 Traditional Database Administration Functions Analyzing and designing databases Prioritizing application transactions by volume, importance and complexity Specifications should be reviewed as quickly as the transactions are developed Selection of DBMS and software tools Establish policies regarding the DBMS and related system software that will be supported within the organization
  • Slide 33
  • Data and Database Administration CISB344 Database 2 Traditional Database Administration Functions Installing/upgrading DBMS All the correct versions of different modules are in place, all the proper device drivers are present and the DBMS works correctly with any third party software products User accounts must be created and maintained. Tuning database performance Performance of a database (query and update processing time as well as data storage utilization) needs to be monitored Design of a database must be frequently changed to meet new requirements Database rebuilt, reorganized, and re-indexed: recover wasted space and to correct poor data allocation and fragmentation
  • Slide 34
  • Data and Database Administration CISB344 Database 2 Traditional Database Administration Functions Improving query processing performance Queries may need to be rewritten in a more efficient form Index may need to be added or deleted Data may need to be relocated to different devices Managing data security, privacy, and integrity Data backup and recovery
  • Slide 35
  • Data and Database Administration CISB344 Database 2 Functions of DA & DBA DATABASE PLANNING Develop corporate database strategy/policies Develop enterprise model (information architecture) Develop cost/benefit models Design database environment/select technologies Develop and market data administration plan DATABASE ANALYSIS Define and model data requirements (conceptual) Define and model business rules Define operational requirements Resolve requirements conflicts Maintain corporate data dictionary/repository
  • Slide 36
  • Data and Database Administration CISB344 Database 2 Functions of DA & DBA DATABASE DESIGN Perform logical database design Design external model (sub schemas) Design internal (physical) models Design integrity controls DATABASE IMPLEMENTATION Specify database access policies Establish security controls Install DBMS Supervise database loading Specify test procedures Develop application programming standards Establish procedures for backup and recovery Conduct user training
  • Slide 37
  • Data and Database Administration CISB344 Database 2 Functions of DA & DBA OPERATIONS AND MAINTENANCE Backup and recover databases Upgrade DBMS Monitor database performance Tune and reorganize databases Resolve access conflict Tune and rewrite queries Enforce standards and procedures Support users GROWTH AND CHANGE Implement change-control procedure Plan growth and change Evaluate new technology
  • Slide 38
  • Data and Database Administration CISB344 Database 2 Trends in Database Administration Trends and new skills needed: Increased used of procedural logic Triggers, stored procedures Triggers Ensure it is well planned, tested, implemented, shared and reused Proliferation of e-business applications Able to manage applications and database that are Internet enabled. Increase use of Smart phones How to design personal DB, how to manage data synchronization.
  • Slide 39
  • Data and Database Administration CISB344 Database 2 Data Warehouse Administration New role, coming with the growth in data warehouses Similar to DA/DBA roles Emphasis on integration and coordination of metadata/data across many data sources Specific roles: Support DSS applications Manage data warehouse growth Establish service level agreements regarding data warehouses and data marts
  • Slide 40
  • Data and Database Administration CISB344 Database 2 Open Source DBMS s DEFINITION: Free DBMS source code software that provides the core functionality of an SQL-compliant DBMS Free DBMS source code software that provides the core functionality of an SQL-compliant DBMS An alternative to proprietary packages such as Oracle, Microsoft SQL Server, or Microsoft Access mySQL is an example of an open-source DBMS Advantages: Less expensive than proprietary packages Source code available, for modification Have different version (simple to complex, free to some cost(additional features) No additional cost for copies or licensing
  • Slide 41
  • Data and Database Administration CISB344 Database 2 Open Source DBMS s Disadvantages: Absence of complete documentation Ambiguous licensing concerns Not as feature-rich as proprietary DBMSs Vendors may not have certification programs
  • Slide 42
  • Data and Database Administration CISB344 Database 2 Open Source DBMSs Consider these factors when choosing an open source DBMS: Features Support Ease-of-use Stability Speed Training Licensing
  • Slide 43
  • END OF CHAPTER