oracle on linux for zseries an emea customer experience...space experiences data archived on a z/os...
TRANSCRIPT
1
EMEA ATS - PSSC
© 2005 IBM Corporation
Oracle on Linux for zSeries
An EMEA Customer Experience
Gerard LAUMAYEMEA ATS PSSC, Montpellier, [email protected]
EMEA ATS - PSSC
© 2003 IBM Corporation
Agenda
�EMEA ATS PSSC & JSC introduction
�Recent EMEA customer projects
�A benchmark experience with Oracle 10g on Linux zSeries
2
EMEA ATS - PSSC
© 2003 IBM Corporation
EMEA ATS PSSC Activities
Briefings, Seminars, Architecture Design,Technical Support
Education, Training & Hands-on Workshops
Customer Test, Benchmark & Proof of Concept
Loaners & remote platforms
High Performance ComputingDesign Center for On Demand Business
Grid Computing Autonomic Computing
Solutions: SAP, Oracle, Siebel, AmdocsLinux Expertise
Advanced Technology & Solutions
EMEA ATS - PSSC
© 2003 IBM Corporation
50 Terabytes FAStT &
1300 fibre channel ports, including FICON
40 ESS, 10 SAN Directors,
10 SAN Switches,
12 SVCs
TotalStorage
Including IA64, AMD Opteron & BladeCenter
technology250 serversxSeries
34 Terabytes85,000 CPW,
15 serversiSeries
55 Terabytes10 TeraflopspSeries
150 Terabytes140,000 MipszSeries
Latest Technologies
Missions � Benchmark and proof of concept activity� Briefing � Education� Technical Support� Porting & Testing Services� Loaners & Remote platforms ‘on demand’
People� A unique IBM investment in EMEA� Skill set: 200 professionals (150 IT Specialists & 30 IT Architects)� eServer & TotalStorage infrastructure:
• ALL Platforms• ALL Models• ALWAYS the latest technology
The environment� 4 machine rooms (2500 sqm)� 10 briefing rooms (from 12 to 150 seats)� 11 education rooms� 18 benchmarking rooms� 1 TotalStorage lab
5,000+ visitors per year� 25% of the top 500 clients each year
EMEA PSSC Strengths
3
EMEA ATS - PSSC
© 2003 IBM Corporation
A joint team:
…dedicated to customer projects.
EMEA Oracle/IBM Joint Solutions Center Six years of experience
� How the JSC can help� Perform benchmarks� Demonstrations and customer briefings� Workshops and educational events� Architecture validation and sizing for Oracle solutions on IBM eServers� The JSC is located in the PSSC, the IBM training, benchmarking and support
center in Montpellier (France).� The JSC is permanently staffed by Oracle as well as IBM. Its mission is to assist
the Oracle and IBM sales divisions. If you have an issue related to IBM and Oracle, the center might be able to help you.
� Need to test� The JSC can provide you with IBM hardware (pSeries, zSeries, xSeries, iSeries
clusters) for tests when performance is not the main issue. � Need to validate an architecture
� Make sure your solution will work and its components are compatible with each other.
� Need to benchmark� Need to run a benchmark or proof of concept? The JSC will be your interface to
the IBM Benchmark Center in Montpellier and ensure that the test or prototype will run under optimal conditions.
� Want to demonstrate� Use zSeries, pSeries, xSeries, iSeries and Oracle products to show the latest
technology level of our products to your customers.
EMEA ATS - PSSC
© 2003 IBM Corporation
IBM-Oracle JSC contribution in pre-sales project cycle
Aw
aren
ess
Pre-
sales
Educ
ation
Tests
Benc
hmar
k
Post-
Sales
Interface withOracle and IBM Support Teams
Architecture validations,
Sizing,
PoCor
FunctionalTests
Technologies & Solutions Awareness
Hands-ontraining
Performance&
Tuning
Pre-sales Technical Support
4
EMEA ATS - PSSC
© 2003 IBM Corporation
zSeries Linux Trial (zLT)
Softwarez/VM Linux Distributions
SuSE, RedHat
Linux Server2 virtual CPs512 MB storageDASD 20 GBGBit Ethernet OSA card
Latest TechnologyVirtual servers 64-bit environmentHiperSockets, Guest LAN
Internet
OPNFirewall
zSeriesESS
EMEA ATS - PSSC
© 2003 IBM Corporation
EMEA zSeries Benchmark Center, Montpellier
� Functionality - Scalability - Performance Tests
� Customer and/or ISV benchmarks (MOP Qualification Committee / WW Benchmark Council)
� Build Customer references and publish technical papers on the latest solutions
� Easy access to the latest IBM eServer hardware technology - on site or remote
5
EMEA ATS - PSSC
© 2003 IBM Corporation
EMEA Oracle/IBM Joint Solutions CenterMontpellier, France
[email protected] : +33 4 67 34 67 49Fax : +33 4 67 34 64 77
EMEA ATS - PSSC
© 2003 IBM Corporation
Agenda
�EMEA ATS PSSC & JSC introduction
�Recent EMEA customer projects
�A benchmark experience with Oracle 10g on Linux zSeries
6
EMEA ATS - PSSC
© 2003 IBM Corporation
Oracle on zSeries: Recent EMEA customer projects
� Dundee City Council, UK – Scotland (Government)� New zSeries customer in 2004 (no zSeries before)� Consolidation of Oracle databases and Open Source applications on
Linux zSeries (z890)� About 30 Linux guests under z/VM
� Sitec, France (Transportation)� Run WAS and Oracle applications on Linux on a z890 server� Integration with an IMS application on z/OS via Hipersockets� About 100 Linux guests under z/VM
� CNES, France (National Space Agency)� Space experiences data archived on a z/OS and Linux Archiving
application (Satellites, Ariane, ESA projects)� Java-Oracle application linked to DFHSM z/OS environment through
zSeries Hipersockets (z800)� zSeries provides full data integrity, availability and automation
EMEA ATS - PSSC
© 2003 IBM Corporation
Agenda
�EMEA ATS PSSC & JSC introduction
�Recent EMEA customer projects
�A benchmark experience with Oracle 10g on Linux zSeries
7
EMEA ATS - PSSC
© 2003 IBM Corporation
A typical Customer benchmark request
�Customer wanted to deploy a new banking applicationon a robust and reliable platform
�The overall goal of this benchmark was to determine appropriate zSeries hardware configuration
�Oracle 10g on Linux on zSeries was a very new software. There were no reference to determine the resources needed. A real-sizing benchmark was needed
�The ISV was new to zSeries and had no implementation of the application on Linux for zSeries
EMEA ATS - PSSC
© 2003 IBM Corporation
DEF3000 Application description
� Banking application for Pensions payment
� DEF3000 application is a centralized, complex IT system ensuring:– Record-accountant service,
– Economic analyses,
– Risk management,
– Evaluation of profitability of bank activity and the whole range of electronic banking.
� DEF3000 is based on an Oracle 9i Database EE
� Certified Hardware and Operating Systems:– IBM AIX, SUN Solaris, and HP-UX
– No Linux implementation before the test
� System ensures high efficiency, durability and scalability.
8
EMEA ATS - PSSC
© 2003 IBM Corporation
Customer Application implementation� Oracle Database:
– 5,000,000 accounts– Database size = 229 GB– 5 main Tables (Read/Write)– 18 Tables (Read only)– Need Oracle SGA size > 2GB to reach target performance
� Transactions are executed in batch processes– Oracle Stored Procedures– Read and Write operations– I/O intensive application
� Transactions description: – Data validation– Calculation of amount and account’s balance– Write data into the database
� Batch process started from a Windows 2000 server
EMEA ATS - PSSC
© 2003 IBM Corporation
Customer Application Sizing
� Customer objectives: – Run the whole chain of batch processes (End Of Month) within 12
hours
� Needs 400,000 tpmC on UNIX� Targeted UNIX configurations:
– IBM p4-690 / 32 processors / 64 GB : 403,255 tpmC– IBM p5-570 / 8 processors / 64 GB : 429,899 tmpC– HP9000 Superdome PA-RISC 8700 / 64 processors / 64 GB :
423,000 tpmC
� Initial sizing done on Linux zSeries: – IBM zSeries 990 / 16 IFL processors– Oracle 10g, just announced on Linux for zSeries. – No experience with 10g.
9
EMEA ATS - PSSC
© 2003 IBM Corporation
Project Steps
� Application porting from Oracle 9i to 10g on Linux for zSeries– Needed to support large SGA size on Linux for zSeries
� Application functional validation on Linux for zSeries� Project objectives validation� Hardware and Software Installation and configuration� Oracle Database load
– Data generation and DB expansion using a customer tool (Epsilio)– AIX workstation (Oracle Clients) used for data generation
� Batch Test cases definition � Batch Runs on different hardware configurations
– Batch processes initiated from a Windows Server
EMEA ATS - PSSC
© 2003 IBM Corporation
Application migration to Linux for zSeries� Migration from Oracle 9i to Oracle 10g (64-bit)� First experience with Oracle 10g on Linux zSeries� Migration and functional validation in 1 week
– Easy database migration
� Use of zSeries Linux Trial (zLT) free offering (PSSC Montpellier)– Internet remote connection to a Linux zSeries environment– Secure connectivity (SSH)– Linux virtual servers under z/VM
Softwarez/VM Linux Distributions
SuSE, RedHat
Linux Server2 virtual CPs512 MB storageDASD 20 GBGBit Ethernet OSA card
Latest TechnologyVirtual servers 64-bit environmentHiperSockets, Guest LAN
Internet
OPNFirewall
z800ESS
10
EMEA ATS - PSSC
© 2003 IBM Corporation
Overall Batch Tests Objectives
� 1- BATCH processing on DB_A (simple accounts): – Process 1,000,000 simple account transactions on 5,000,000 current
accounts within 7 hours.
� 2- END OF DAY processing on DB_A (simple accounts):– Process Batch application within 7 hours.
� 3- BATCH processing on DB_B (regular accounts): – Process 1,000,000 simple account transactions on 5,000,000 current
accounts within 7 hours.
� 4- END OF DAY processing on DB_B (regular accounts): – Process Batch application within 7 hours
� 5- END OF MONTH processing on DB_B (regular accounts): – Process Batch application within 7 hours
� 6- BATCH + END OF MONTH on DB_B (regular accounts) processing:– Process Batch applications combination within 12 hours
� 7- Determine the optimal Oracle configuration (parameter file)
EMEA ATS - PSSC
© 2003 IBM Corporation
The Benchmark Team: 8 specialists
� ISV & Customer Team
– 1 Project Manager
– 1 Linux Specialist
– 1 Application Administrator
� IBM PSSC Team
– 1 Project Manager
– 1 Linux zSeries and Oracle for Linux on zSeries Specialist
� IBM - Oracle JSC Montpellier Team
– 1 Oracle Specialist
� IBM Poland Team
– 1 Linux zSeries and Oracle Specialist
– 1 zSeries Sales Specialist
� IBM WW support
11
EMEA ATS - PSSC
© 2003 IBM Corporation
DP Rooms
Benchmark InfrastructurezSeries z990 – S53 ESS 800 – D9A3
pSeriesAIX x335 softapps
Win2000 SP4
Admin network
�Model D32
�128GB Mem
�32 processors �DDS4 Tape driver
�2-way, 4GB mem
WorkstationsInternet
Cam21
ESS 800 – D992
8 FICON channels
to ESS
8 FICON channels to ESS
Private network
Oracle ClientSQL* Plus
EMEA ATS - PSSC
© 2003 IBM Corporation
IBM zSeries z990 partitions (3 LPARs)� IBM ESS 800– 6.6TB capacity– 64GB cache– 8 FICON channels– Processor Turbo2– Disks size 73GB– Disks speed 15K RPM
SLES 8 SP3 – 64-bitOracle 10g 10.1.0.3128 DASD defined:3390 mod9, 7GB eachTotal of 870 GB.
9.100.195.228
10.10.1.228
Native Linux LPAR11 to 16 IFLs,
4 to 16GB memory
SLES 8 SP3 – 64-bitOracle 10g 10.1.0.3128 DASD defined:3390 mod9, 7GB eachTotal of 870 GB.
9.100.195.215
10.10.1.215
Native Linux LPAR21 to 16 IFLs,
4 to 16GB memory
Used for admin
purposes ESS
FlashCopy
z/VM LPAR32 IFLs, 32GB
memory
Benchmark Configuration
DB_BDB_A
12
EMEA ATS - PSSC
© 2003 IBM Corporation
Linux file system definitions
� Both z990 LPARs had identical definitions:– LPAR1 : DB_A (for Simple accounts runs)– LPAR2 : DB_B (for Regular accounts runs – more calculations)– 128 DASD defined on Linux Servers (3390 mod 9)– Mount points :
• 1 DASD (6.8GB) for /• 1 DASD (6.8GB) for /opt/oracle• 102 DASD (689GB) in LVM for /dba_fs1• 6 DASD (41GB) in LVM for /dba_fs2• 1 DASD (6.8GB) for /dba_fs3• 5 DASD (34GB) in LVM for /dba_fs4• 5 DASD (34GB) in LVM for /dba_fs5
– Logical Volume Manager (LVM): Disks are stripped and split across ESS LCU’s (Logical Control Units)
– Oracle RAC feature not used
EMEA ATS - PSSC
© 2003 IBM Corporation
Oracle Database Tables and Size
�������������������������� ���
���������������������������� ���
������������������������������������� ���
�������������������������������������������� ���
��������������������������������������������� ���
�������������������������������������������� ���
������������������������������������������ ���
���������������������������������� ���
���������������������������������� ���
���������������������������������� ���
���������������������������������� ���
���������������������������������� ���
���������������������������������� ���
������������������������������������ ���
���������������������������������� ���
���������������������������������� ���
������������������������������� ���
�������������������������������� ���
���������������������������������� ���
������������������������������������ ���
������������������������������ ���������� ���
����������������������������������� ������������ ���
�������������������������������� ����� ���
�!""#$%&�!""#$��&�'("#$��&�)*"�+,"�-+-./
Database Size:
229 GB
5 major Tables
2 Databases:
DB_A and DB_B
Data Generation
and DB load
in 3 days
13
EMEA ATS - PSSC
© 2003 IBM Corporation
Oracle DB server settings (major init.ora parameters)
defa1.__db_cache_size=3271557120
defa1.__large_pool_size=16777216
defa1.__shared_pool_size=771751936
*.db_block_size=8192
*.db_file_multiblock_read_count=16
*.db_writer_processes=8
*.disk_asynch_io=TRUE
*.dispatchers='(PROTOCOL=TCP) (SERVICE=defa1XDB)'
*.filesystemio_options='asynch'
*.job_queue_processes=512
*.log_archive_max_processes=4
*.log_buffer=200000000
*.open_cursors=6000
*.pga_aggregate_target=1512000000
*.processes=2500
*.sessions=1500
*.sga_max_size=4294967296
*.sga_target=4294967296
*.sort_area_size=256000000
*.statistics_level='ALL'
SGA: 4 to 12 GB
EMEA ATS - PSSC
© 2003 IBM Corporation
Tested configurations
� Main goal: determine the best configuration to reach performance objectives (maximum Batch Elapsed time)
� Tests were done on 4 different configurations:
– TEST A: 8 processors with 16 GB of RAM, SGA size 12 GB and 16 jobs
– TEST B: 8 processors with 8 GB of RAM, SGA size 4 GB and 16 jobs
– TEST C: 4 processors with 8 GB of RAM , SGA size 4 GB and 12 jobs
– TEST D: 2 processors with 8 GB of RAM , SGA size 4 GB and 6 jobs
14
EMEA ATS - PSSC
© 2003 IBM Corporation
Tests Results
02:28:201- Batch processing Simple transactionsD - 2CPU, 8GB RAM, SGA 4GB, 6jobs
01:20:161- Batch processing Simple transactionsC - 4CPU, 8GB RAM, SGA 4GB, 12jobs
02:26:022- Batch processing Regular transactionsC - 4CPU, 8GB RAM, SGA 4GB, 12jobs
01:12:363- Batch END OF DAY C - 4CPU, 8GB RAM, SGA 4GB, 12jobs
00:42:451- Batch processing Simple transactionsB - 8CPU, 8GB RAM, SGA 4GB, 16jobs
01:22:462- Batch processing Regular transactionsB - 8CPU, 8GB RAM, SGA 4GB, 16jobs
02:24:023- Batch END OF DAY D - 2CPU, 8GB RAM, SGA 4GB, 6jobs
05:22:442- Batch processing Regular transactionsD - 2CPU, 8GB RAM, SGA 4GB, 6jobs
00:53:433- Batch END OF DAY B - 8CPU, 8GB RAM, SGA 4GB, 16jobs
01:00:313- Batch END OF DAY A - 8CPU, 16GB RAM, SGA 12GB, 16jobs
01:42:022- Batch processing Regular transactionsA - 8CPU, 16GB RAM, SGA 12GB, 16jobs
00:58:081- Batch processing Simple transactionsA - 8CPU, 16GB RAM, SGA 12GB, 16jobs
Elapsed TimeTest caseConfiguration
Elapsed Time objectives (2+3 EOD): 7h00
EMEA ATS - PSSC
© 2003 IBM Corporation
Tests Results
Tests Results (1/2)
00:00:00
01:12:00
02:24:00
03:36:00
04:48:00
06:00:00
SimpleBatch
RegularBatch
End Of Day
Workload Type
Ela
psed
Tim
e
TEST B (8Px8GB)
TEST C (4Px8GB)
TEST D (2Px8GB)
zSeries reached 15,000 SQL queries/second on 4 IFL processorswith around 300,000 buffers/second
1.78
1.35
3.92
2.71
15
EMEA ATS - PSSC
© 2003 IBM Corporation
Tests Results
Tests Results (2/2)
00:00:0001:12:0002:24:0003:36:0004:48:0006:00:0007:12:0008:24:00
TEST B(8Px8GB)
TEST C(4Px8GB)
TEST D(2Px8GB)
HW Configuration
Ela
psed
Tim
e
End Of Day
Regular Batch
Elapsed Time objectives (2+3 EOD): 7h00
EMEA ATS - PSSC
© 2003 IBM Corporation
Lessons learned and Conclusions (1/2)� Customer objectives:
– Process ‘Batch + End of Day’ within 7 hours
– Process ‘Batch + End of Month’ within 12 hours
� All performance objectives reached using a smaller zSeries server hardware configuration than estimated (initial sizing: 16 IFLs)
– ‘Batch + End of Day’ performed in 3 hours and 38 minutes with 4 IFLs
– ‘Batch + End of Month’ performed in 11 hours and 12 minutes with only 4 IFL processors
� 4 IFL processors and 8 GB memory for an optimal configuration (good price/performance ratio)
� 8 IFL processors and 8 GB memory for best performance
� Need less processors compared to UNIX alternatives (TCO impact)
� zSeries performance is very sensitive to application workload
� Sizing is a difficult exercise. Run sizing test when appropriate
16
EMEA ATS - PSSC
© 2003 IBM Corporation
Lessons learned and Conclusions (2/2)
� Oracle 9i to Oracle 10g migration was very easy� Customer Application scalability is good� No specific Linux tuning needed during the test
– SLES 8 Service Pack 3 default caching mode (Normal use vs. Sequential read) improves I/O performance
� Need to carefully manage I/O parallelism for better I/O performance – Use Logical Volume Manager (LVM = data striping)– Don’t see ESS as a black box (spread data over LCUs)
� Asynchronous I/O do not influence performance� Oracle tuning was needed� A too large SGA size can reduce performance
EMEA ATS - PSSC
© 2003 IBM Corporation
Thank you for Listening!