Download - Exadata Management for DBAs
![Page 1: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/1.jpg)
Exadata Management for DBAs
Arup NandaLongtime DBA and Now DMA
![Page 2: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/2.jpg)
2Arup Nanda
What it this About?• How Exadata is different?• Who manages it?– Oracle DBAs– System Admins– Composite Team
• Who does what?• What you need to know about managing it• What must you learn about potential issues
![Page 3: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/3.jpg)
Arup Nanda
What is Exadata• Looks like an appliance• But is not an appliance. Why?– It contains additional software to make it a better
database machine– The components are individually adminstered
• That’s why Oracle calls it a Database Machine (DBM)
• DMA – Database Machine Administrator
3
![Page 4: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/4.jpg)
Arup Nanda
The Magic #1
4
CPU
Memory
Network
I/O Controller
Disk
Get NAME … STATUS =
‘ANGRY’
iDB
![Page 5: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/5.jpg)
Arup Nanda
Magic #2 Storage Cell Server
5
Disk1
Cell Server
Disk2 Disk3
• Cells are Sun Blades• Run Oracle Enterprise
Linux• Software called Exadata
Storage Server (ESS) which understands iDBESS
iDB
![Page 6: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/6.jpg)
Arup Nanda
Magic #3 Storage Indexes
6
1 2 3 4
Disk4
MIN = 3
MAX = 5
MIN = 4
MAX = 5
MIN = 3
MAX = 5
MIN = 1
MAX = 2
Disk1
Cell Server
Disk2 Disk3
ESSStorage Indexes store in memory of the Cell Server the areas on the disk and the MIN/MAX value of the column and whether NULL exists. They eliminate disk I/O.
Storage Index
SELECT …FROM TABLEWHERE COL1 = 1
![Page 7: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/7.jpg)
Arup Nanda
Disk1Disk1
Database Node 7
Cell 1Cell 1Cell 1
Put Together: One Full Rack
7
Database Node 1
Database Node 8
Cell 1 Cell 14
Disk1 Disk 12
InfiniBand Switch
Flash
Network SwitchClients connect to the database nodes.
RAC Cluster
![Page 8: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/8.jpg)
Arup Nanda
Disk Layout
8
Storage Cell
Disk1Disk1
Disk1 Disk 12
Flash
Compute Nodes
• Disks (hard and flash) are connected to the cells.
• The disks are partitioned at the cell
• Some partitions are presented as filesystems
• The rest are used for ASM diskgroups
• All these disks/partitions are presented to the compute nodes
![Page 9: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/9.jpg)
Arup Nanda
Disk Presentation
9
Physical Disk
Partition 1 Partition 2
Celldisk
Griddisk
filesystem
LUN LUN
ASM Diskgroup
ASM Disk
Disk
filesystem
Cell
Node
![Page 10: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/10.jpg)
Arup Nanda
Command Components
10
Storage Cell
Disk1Disk1
Disk1 Disk 12
Flash
Compute Nodes
Disk1
Linux Commands – vmstat, mpstat, fdisk, etc.
Linux Commands – vmstat, mpstat, fdisk, etc.
CellCLI – command line tool to manage the Cell
ASM Commands – SQL*Plus, ASMCMD, ASMCA
Clusterware Commands – CRSCTL, SRVCTL, etc.Database Commands – startup, alter database, etc.
5-part Linux Commands article series http://bit.ly/k4mKQS4-part Exadata Command Reference article series http://bit.ly/lljFl0
![Page 11: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/11.jpg)
Arup Nanda
Disk Failures
11
Cell 1 Cell 2
Datafile
block1 block1
block1
![Page 12: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/12.jpg)
12Arup Nanda
Server Management• Sun Blades and Oracle Enterprise Linux• Normal Sysadmin Work– Shutdown, fdisk, etc.
• ILOM – Integrated Lights Out Management• KVM allows physical access– But you can use ILOM for virtual console
• Needs Pure Linux Skills
![Page 13: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/13.jpg)
13Arup Nanda
Network Management• Two types of network– Ethernet– Infiniband
• Tools– ibstatus– iblinkinfo– verify-topology
![Page 14: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/14.jpg)
14Arup Nanda
Special Oracle Provided Tools• All tools are found at
/opt/oracle.SupportTools• CheckHWnFWProfile– to check the HW profile
• Directory ibdiagtools/opt/MegaRAID/MegaCli/MegaCli64# ipmitool -H prolcel01-ilom -U root chassis
power on# imageinfo# imagehistory
![Page 15: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/15.jpg)
15Arup Nanda
Database and Cluster Management• Cluster– crsctl, srvctl
• ASM– asmcmd, SQL*Plus
• Database– srvctl, SQL*Plus
![Page 16: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/16.jpg)
16Arup Nanda
Storage Management• Two ways to manage the storage– Enterprise Manager– CellCLI
![Page 17: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/17.jpg)
17Arup Nanda
Checking Storage Index Useselect decode(name, 'cell physical IO bytes saved by storage index', 'SI Savings', 'cell physical IO interconnect bytes returned by smart scan', 'Smart Scan' ) as stat_name, value/1024/1024 as stat_valuefrom v$mystat s, v$statname nwhere s.statistic# = n.statistic#and n.name in ( 'cell physical IO bytes saved by storage index', 'cell physical IO interconnect bytes returned by smart
scan’)
![Page 18: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/18.jpg)
18Arup Nanda
Smart Scan Savings• Output
STAT_NAME STAT_VALUE---------- ----------SI Savings 0.000Smart Scan 0.000
• Smart Scan did not yield any savings• Why not?• Disable Smart Scans, if needed– cell_offload_processing = true;– _kcfis_storageidx_disabled = true;
![Page 19: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/19.jpg)
19Arup Nanda
Why Not?• Pre-requisite for Smart Scan– Direct Path– Full Table or Full Index Scan– > 0 Predicates– Simple Comparison Operators
• Other Reasons– Cell is not offload capable• The diskgroup attribute cell.smart_scan_capable set to
FALSE;
– Not on clustered tables, IOTs, etc.
![Page 20: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/20.jpg)
Arup Nanda
One Cluster?
20
1 2 3 4 5 6 7 8One Cluster
QA1 QA2 QA3 Prod1 Prod2 Prod3 Dev1 Int1
QA1 QA2 Prod4 Prod1 Prod2 Prod3 Dev1 Int1
QA1 QA2 QA3 Prod1 Prod2 Prod3 Dev1 Int1
Dev2
![Page 21: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/21.jpg)
Arup Nanda
Many Clusters?
21
1 2 3 4 5 6 7 8QA Cluster
QA1 QA2 QA3 Prod1 Prod2 Prod3 Dev1 Int1
Prod Cluster Dev Int
1 2 3 4 5 6 7 8QA Cluster Prod Cluster Dev Int
![Page 22: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/22.jpg)
22Arup Nanda
DBA
Sys Admin
Network Admin
Cell Admin
Administration SkillsSkill NeededSystem Administrator 10%Storage Administrator 0%Network Administrator 5%Database Administrator 60%Cell Administration 25%
![Page 23: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/23.jpg)
23Arup Nanda
Resources• My Papers– 5-part Linux Commands article series http://bit.ly/k4mKQS– 4-part Exadata Command Reference article series
http://bit.ly/lljFl0• OTN Page on Exadata– http://www.oracle.com/technetwork/database/exadata/inde
x.html• Tutorials– http://www.oracle.com/technetwork/tutorials/index.html
• OTN Exadata Forum– https://forums.oracle.com/forums/forum.jspa?forumID=829
![Page 24: Exadata Management for DBAs](https://reader036.vdocument.in/reader036/viewer/2022081512/56815ce7550346895dcaec50/html5/thumbnails/24.jpg)
24Arup Nanda
Thank You!