resource management 1. ccdb big tables problem mysql packet size is limited by 1 mb by default...
DESCRIPTION
Resources Usual frameworks application structure Configs Data Resources Resources are : Static Not changing during app. run Seldom change during app. life Too big to compile into the app. Config manager Data connectors Resource manager Qt, Java, GTK Application Mono, MFC, GTK, 3TRANSCRIPT
![Page 1: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until](https://reader036.vdocument.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/1.jpg)
1
Resource management
![Page 2: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until](https://reader036.vdocument.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/2.jpg)
2
CCDB big tables problem
• MySQL packet size is limited by 1 mb by default• gzipping doesn’t help.• No partial blob transfers until MySQL 6• ‘root’ privileges needed to configure MySQL • Vulnerability for DDos attacks• Since CCDB is ‘do not delete’ storage it will lead
to redundant database grow
![Page 3: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until](https://reader036.vdocument.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/3.jpg)
3
Resources
Usual frameworks application structure
Configs
Data
Resources
Resources are:
• Static
• Not changing during app. run
• Seldom change during app. life
• Too big to compile into the app.
Config managerData
connectorsResource manager
Qt, Java, GTKApplicationMono, MFC, GTK,
![Page 4: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until](https://reader036.vdocument.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/4.jpg)
4
Very simple resource manager
fopen
![Page 5: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until](https://reader036.vdocument.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/5.jpg)
5
Resource manager idea
ResorceManager Server
./resources/mydata.datdata cached
?
YES
NO
Caching
mydata
• Easy to use • Automated • Flexible• Updatable
• Less mistakes • Easy to change• Easy to maintain
![Page 6: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until](https://reader036.vdocument.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/6.jpg)
6
What other use for resources
• QT 4+, QResource is a part of libqtcore.• GTK, use gtk_rc_* functions to read resources• OSX API NSBundle, CFBundleRef, etc…• Mono – System.Resources namespace• Java – lots of stuff (depends on framework)• wxWidgets – RC, WXR , XRC…
![Page 7: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until](https://reader036.vdocument.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/7.jpg)
7
What should we do• Store link to resource in the DB• Make simple resource API through JANA or CCDB.
(we already have most of the code!)
vector<vector> GetTable(“/w/HallD/data/Magnets/table.txt”)
vector<vector> GetTable(“res:Magnets/table”)
• “res:” means open files from resource directory (which is known by JANA)
• No “res:” means just open that file by that path.