database & technology 1 _ marcelle kratchvil _ why you should be storing unstructured data in...
DESCRIPTION
TRANSCRIPT
The most comprehensive Oracle applications & technology content under one roof
Speaker Name Speaker Organisa/on Speaker Date
The most comprehensive Oracle applications & technology content under one roof
Why you should be storing unstructured data in the Oracle database
"Over 80% of data is unstructured and not managed - Isn't it about time you decided to manage it?"
Marcelle Kratochvil CTO Pic/on marcelle@pic/on.com
The most comprehensive Oracle applications & technology content under one roof
Inaugural International Unstructured Data with Multimedia SIG
For more information go to : http://eternal-donut.blogspot.com/
At OpenWorld – Sunday 9am (Moscone West)
To gather experts in the field to share ideas and to help those who are learning about multimedia and any unstructured data be able to find resources and share programs, papers, and ideas on anything in this field.
If you can't make OpenWorld, register at the blog site.
The most comprehensive Oracle applications & technology content under one roof
What is your jus/fica/on for not storing it in the database?
This is not the right ques/on to be asked
It should be
Why should I store unstructured data in the database?
The most comprehensive Oracle applications & technology content under one roof
What is Unstructured Data ?
l Mul/media l Photos
l Audio
l Video
l Documents
l Files
l Raw Data
Structured = Relational Semi Structured = XML
The most comprehensive Oracle applications & technology content under one roof
Who needs it ?
l Museums
l Educa/on
l Government
l Marke/ng
l Defence
Image Warehouses
Its now hard to find a business that doesn't need it
The most comprehensive Oracle applications & technology content under one roof
The Rules Change
l Rela/onal is a well structured subset, with clearly defined rules
l XML is structured but has variable rules
l Mul/media introduces fuzzy concepts, normal referen/al rules stop making sense
l Other data is the wild west
The most comprehensive Oracle applications & technology content under one roof
Interface
l iPhone and iPad changed the interface
l Augmented reality
l More intui/ve
l Simpler is beUer
l Users are demanding this simplicity
The most comprehensive Oracle applications & technology content under one roof
Searching
l Exact search doesn't make sense (unless rela/onal) l Metadata is the rela/onal link
l Fuzzy Searching l Find images that look like
l Find a scene with this actor in it
l Find the posi/on in the audio file where the person says
l Find the audio file with this bird song in it
The most comprehensive Oracle applications & technology content under one roof
Exactness
l Does Image A = Image B? l At what point are they different?
l What if a byte changes?
l What if there is a subtle color change
l Checksums ?
l Enforcing compliance and copyright
l What about two images of the same scene?
The most comprehensive Oracle applications & technology content under one roof
Processing
l Transform l DNG, raw
l Convert l One format to another
l Modify l Crop, watermark
l The data needs exercising
There is no “right” format�to store an Image in
The most comprehensive Oracle applications & technology content under one roof
So why Store it?
l Manageability
l Security
l Backup/Recovery
l Extensibility
l Flexibility
The most comprehensive Oracle applications & technology content under one roof
Manageability
l Focus is Metadata
l Kept in Sync l Metadata to External Images is painful
l Try changing a loca/on
l SQL / Object access
l Well understood
l PL/SQL access
The most comprehensive Oracle applications & technology content under one roof
Security
l Row level protec/on
l Audi/ng
l Dynamic Security
l Encryp/on
l Proven
The most comprehensive Oracle applications & technology content under one roof
Backup/Recovery
l Block level checking and recovery
l Unified backup rela/onal + objects using rman
l Simpler restore
l Full use of rman features
The most comprehensive Oracle applications & technology content under one roof
Extensibility
l Indexing
l Object Oriented
l Processing and Conversion
The most comprehensive Oracle applications & technology content under one roof
Flexibility
l Manage metadata
l Process en-‐masse
l Link images together
l Image Warehouse
l RAC, Streams, Replica/on, Data Guard, Flashback
The most comprehensive Oracle applications & technology content under one roof
And the concerns?
l Maturity
l Performance
l Database Size
l Complexity
The most comprehensive Oracle applications & technology content under one roof
Maturity
l Oracle is way ahead of the other vendors
l Not all features are mature l Oracle Mul/media
l RAC
l Exadata
l Rman
l Streams
l Gateways
The most comprehensive Oracle applications & technology content under one roof
Performance
l Loading and Retrieval l Securefiles is very fast
l Processing l Java and Mul/media do not mix well
l You need a GPU to process mul/media
l VM's do not process mul/media well
The most comprehensive Oracle applications & technology content under one roof
Database Size
l Block overhead wastage l Larger block size needed
l Securefiles addresses this
The most comprehensive Oracle applications & technology content under one roof
Complexity
l Mul/media is hidden
l Its not tangible like a file
l You need an applica/on to get to it l Solved by Oracle FileSystem (Linux Only)
The most comprehensive Oracle applications & technology content under one roof
Finally
l There are more benefits to store all your data in the database
l Protect it
l Secure it
l Add value to it
The most comprehensive Oracle applications & technology content under one roof
For more informa/on
l marcelle@pic/on.com
l hUp://eternal-‐donut.blogspot.com/