enhanced model deployment in gams4 1. deployment frameworks like ampl quandec, fico xpress insight,...
TRANSCRIPT
![Page 1: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/1.jpg)
GAMS Development Corp. GAMS Software GmbH www.gams.com
Enhanced Model Deployment in GAMS
Using R/Shiny to deploy and visualize GAMS models in a Web Interface
Lutz WestermannFrederik Proske
GAMS Software GmbH
![Page 2: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/2.jpg)
Motivation
![Page 3: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/3.jpg)
3
• AMLs are powerful tools for developing solver-independent optimization models
• However, end-users of optimization software are very often not modeling experts
→ Models should be robust (informative error messages, no infeasibility, … )
• Need for easy-to-use tool to visualize data and compare results
Motivation
![Page 4: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/4.jpg)
4
1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, …Drawback: High price (costs for these frameworks easily exceed the cost of the modeling system by a factor of 10 to 15)
2. Highly flexible APIs to develop applications (e.g. GAMS comes with several APIs in C++, C#, Java, Python, …)Drawback: Requires a lot of programming effort
How to address the Need for Visualization?
![Page 5: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/5.jpg)
Using R/Shiny to deploy GAMS Models
![Page 6: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/6.jpg)
6
• A language and environment for statistical computing and graphics
• Highly extensible
• Allows to produce well-designed publication-quality plots, including mathematical symbols and formulae
• Runs on Unix, Windows and MacOS
• Available as Free Software under the terms of the Free Software Foundation’s GNU General Public License
Background – R
Source: www.r-project.org
![Page 7: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/7.jpg)
7
• Open source R package to build interactive web applications
• Provides extensive visualization options
• Allows to host standalone apps on a webpage or embed them in R Markdown documents or build dashboards
Background – Shiny
Source: shiny.rstudio.com
![Page 8: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/8.jpg)
8
From GAMS Model to Visual User Interface
![Page 9: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/9.jpg)
9
From GAMS Model to Visual User Interface
1Initialization:
✓ Annotating GAMS model (defining the input and output data to be displayed in the WebUI)
![Page 10: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/10.jpg)
10
Initialization –Connection of GAMS and the User Interface
✓ Fully functional interface by only specifying input and output data
✓ Tabular view of input (editable) and output data
✓ Graphical visualization via pivot charts
![Page 11: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/11.jpg)
11
Initialization –Connection of GAMS and the User Interface
![Page 12: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/12.jpg)
12
Initialization –Connection of GAMS and the User Interface
![Page 13: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/13.jpg)
13
Initialization –Connection of GAMS and the User Interface
![Page 14: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/14.jpg)
14
Initialization –Connection of GAMS and the User Interface
![Page 15: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/15.jpg)
15
From GAMS Model to Visual User Interface
1
2 Basic setup (optional): ✓ Configuration of graphics and UI
Initialization:
✓ Annotating GAMS model (defining the input and output data to be displayed in the WebUI)
![Page 16: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/16.jpg)
16
Basic Setup –Configuration
✓ Configuration via JSON file✓ Access to a number of pre-
implemented tools for graphical representation
✓ Focus on configuration, not programming
![Page 17: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/17.jpg)
17
From GAMS Model to Visual User Interface
1
2
3
Basic setup (optional): ✓ Configuration of graphics and UI
Advanced setup (optional):✓ Sophisticated graphics ✓ User- and Application management
Initialization:
✓ Annotating GAMS model (defining the input and output data to be displayed in the WebUI)
![Page 18: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/18.jpg)
18
Advanced Setup –Sophisticated graphics
✓ Sophisticated graphics created in R can be included as modules
✓ Access to the entire R ecosystem
✓ Easily extendable with the wide spectrum of the R programming language
![Page 19: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/19.jpg)
19
Advanced Setup –User and Application Management
✓ Local or server-based solution✓ User authentication (e.g. LDAP,
Keycloak, Google, GitHub, Facebook)
✓ Multi-Application support with docker-based technology
Yaml config file
![Page 20: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/20.jpg)
Example – Pickstock
![Page 21: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/21.jpg)
21
• Goal: Definition of an index fund that follows the Dow Jones (DJ)
• Optimization model: Select a small subset of DJ stocks, along with weights, so that this portfolio behaves similarly to the overall index
Model Definition
![Page 22: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/22.jpg)
22
Annotating the GAMS Model
![Page 23: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/23.jpg)
23
Setting the Model Input Data
✓ Data exchange via local files or database connection
✓ Visualization and modification of input data with intuitive controls
✓ From a GAMS model to the first interface within minutes
✓ Comprehensive configurability
![Page 24: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/24.jpg)
24
Communication with GAMS
✓ Start and Stop model execution
✓ Access to GAMS Log file and Listing file
![Page 25: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/25.jpg)
25
Inspecting the Results
✓ Extensive visualization options of the model output
✓ Interactive analysis of the results
✓ On-the-fly switch between different options to inspect the results
![Page 26: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/26.jpg)
26
Scenario Management
✓ Solve multiple scenarios or load saved data for comparison
![Page 27: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/27.jpg)
27
Visualization / Graphics Libraries – Examples
![Page 28: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/28.jpg)
Summary & Outlook
![Page 29: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/29.jpg)
29
What we have done so far
• Application connects Web User Interface with a GAMS model
• User Interface allows ✓ Data exchange via local files or database✓ Modification of the input data ✓ Extensive visualization options✓ Comparison of different scenarios✓ Multi-user support based on Docker technology✓ User authentication
• Tool with intuitive interface for planners
• This “product” is currently under development. If you are interested in getting involved, please contact [email protected] (or talk to me directly)
![Page 30: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/30.jpg)
30
What we plan to do
• Batch configuration and execution→ Running GAMS in a separate container to share resources
between different models
• Use docker orchestration tools (Docker Swarm, Kubernetes)
→ Load balancing→ High availability and scalability
![Page 31: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/31.jpg)
GAMS Development Corp. GAMS Software GmbH www.gams.com
Thank You
Meet us at the GAMS booth!
Reminder: This “product” is currently under development. Ifyou are interested in getting involved, please [email protected]
![Page 32: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/32.jpg)
32
Welcome to Jupyter @ GAMS!
![Page 33: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/33.jpg)
33
GAMS Jupyter Example
![Page 34: Enhanced Model Deployment in GAMS4 1. Deployment frameworks like AMPL Quandec, FICO Xpress Insight, IBM Decision Optimization Center, … Drawback: High price (costs for these frameworks](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcae3555c40fe23853b14a1/html5/thumbnails/34.jpg)
34
• Runs in a browser/on a server No local installation needed
• Allows to use notebook technology in combination with GAMS
• Notebooks allow to combine GAMS and Python• GAMS works great with well structured data and optimization
models• Python is very rich in features to retrieve, manipulate, and
visualize data that comes in all sort of ways• Combining GAMS and Python in a notebook it is relatively
easy to tell an optimization story with text, data, graphs, math, and models
• This “product” is currently under development.Give it a try at https://jupyterhub.gams.com/hub/login
Using GAMS Jupyter Notebooks to tell “optimization stories”