algebraic modeling past, present and future - gams …old.gams.com/presentations/or2010_ca.pdf ·...
TRANSCRIPT
![Page 1: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/1.jpg)
Algebraic Modeling
Past, Present and Future
Michael Bussieck [email protected]
Alex Meeraus [email protected]
Franz Nelissen [email protected]
GAMS Software GmbH
www.gams.com
![Page 2: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/2.jpg)
Model Structure
![Page 3: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/3.jpg)
Model Data
![Page 4: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/4.jpg)
Matrix Generator
![Page 5: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/5.jpg)
Matrix Generator Input
![Page 6: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/6.jpg)
MPS File – Column Section
![Page 7: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/7.jpg)
MPS Revision File
![Page 8: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/8.jpg)
MPS Output
![Page 9: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/9.jpg)
WB Old Slide 1
![Page 10: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/10.jpg)
WB Old Slide 2
![Page 11: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/11.jpg)
WB Old Slide 3
![Page 12: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/12.jpg)
WB Old Slide 4
![Page 13: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/13.jpg)
WB Old Slide 5
![Page 14: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/14.jpg)
WB Old Slide 6
![Page 15: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/15.jpg)
WB Old Slide 7
![Page 16: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/16.jpg)
Computation Past
• Algorithm limits
applications
• Problem
representation is low
priority
• Large costly projects
• Long development
times
• Centralized expert
groups
• High computational
cost, mainframes
• Users left out
Model Present
• Modeling skill limits
applications
• Algebraic model
representation
• Smaller projects
• Rapid development
• Decentralized
modeling teams
• Low computational
cost, workstations
• Machine
independence
• Users involved
ApplicationFuture
• Domain expertise
limits application
• Off-the-shelf
graphical user
interfaces
• Links to other types
of models
• Models embedded in
business applications
• New computing
environments
• Internet/web
• Users hardly aware of
model
Change in Focus
![Page 17: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/17.jpg)
• Successful PhD level professional in any field often
outside of traditional OR
• 10 years of experience
• Wants to add value to his work by using Optimization
Typical GAMS User
![Page 18: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/18.jpg)
Who is the User of a Model?
• (Academic) Researcher– One time use (Research Paper)
• Domain&Model Expert– Model Results used for Consulting
• Black Box User– Model integrated in (Optimization) Application
• Each Category has its own needs– Development & Deployment
![Page 19: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/19.jpg)
GAMS at a Glance
General Algebraic Modeling System
• Roots: World Bank, 1976
• Went commercial in 1987
• GAMS Development Corp.
• GAMS Software GmbH
• Broad academic & commercial
user community and network
19
![Page 20: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/20.jpg)
GAMS Software GmbH
• Founded 1995
• Tool Provider: Software Sales, Support, and Development,
Research, Technical Consulting
• Offices at Cologne and Braunschweig
• GAMS used in 41 European Countries
• Transnational Organizations: EC, FAO, NATO, OECD, UN,
WTO
• Germany:
• More than 50% of the DAX 30 enterprises
• The top five consulting companies
• More than 300 academic institutes
• 100 different universities and research institutes
20
![Page 21: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/21.jpg)
GAMS at a Glance
General Algebraic Modeling System
• Algebraic Modeling Language
• 25+ Integrated Solvers
• 10+ Supported MP classes
• 10+ Supported Platforms
• Connectivity- & Productivity Tools
• IDE
• Model Libraries
• GDX, Interfaces & Tools
• Grid Computing
• Benchmarking
• Compression & Encryption
• Deployment System
• …
21
![Page 22: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/22.jpg)
GAMS at a Glance
10+ Supported MP classes
22
CNS
MCP
LP
NLP
QC
P
MIP
DNLP
![Page 23: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/23.jpg)
GAMS at a Glance
25+ Integrated Solvers
23
XA
XPRESS
COIN-OR
BDMLPCPLEX
BA
RO
N
LIN
DO
GL
OB
AL
GUROBI
![Page 24: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/24.jpg)
GAMS’ Fundamental concepts
• Platform independence
• Open architecture and interfaces to other systems
• Different layers with separation of
• model and data
• model and solution methods
• model and operating system
• model and interface
24
![Page 25: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/25.jpg)
Market Demands
• Minimize Risks for new Clients / Management:
• Deliver (expected) Results
• Support Rapid Prototyping
• Increase Productivity
• Do not lock user into a certain environment
• Provide cutting edge technology: Models and users must benefit from:
• Changing environments (Hardware, OS, GUI)
• Enhanced / new modeling & solver technology
• Improved / new interfaces to other systems
• Protect user investments: Deployed modelsoften have 15+ years lifecycle
25
![Page 26: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/26.jpg)
Dissemination of OR into other fields I
• A global agricultural sector model system with
focus on 27 countries of the European Union
and Norway
• Covers agricultural production in 18 trade blocks
and about 250 regions
• Evaluates regional and aggregate impacts of
trade policies on production, income, markets,
trade and environment
• Used by network of ~ 37 research institutions
and EU Commission services
26
Common Agricultural Policy Regional Impact Analysis (CAPRI)
![Page 27: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/27.jpg)
CAPRI
27
![Page 28: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/28.jpg)
CAPRI – Some Technical Aspects• System bridged several generations of GAMS,
solvers, hardware, platforms, and GUIs.
• System includes both large scale
• Non linear Problems
• Mixed Complementarity Problems
• Distributed Model Code, Databases and User
Communities
• Java based GUI (Reports / GIS)
• Coordinated by the Institute for Food and
Resource Economics, University of Bonn
(Wolfgang Britz)
28
![Page 29: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/29.jpg)
Dissemination of OR into other fields II
• A global energy• economy •climate model in a multi-regional setting
• 11 world regions and 7 types of traded energy (incl. emission rights)
• Climate policy analysis:
• Business as usual
• Different climate policies
• Combines complex optimization and simulation models
• Developed by group of experts from different fields
• Model documentation, code and data available
• Coordinated by Marian Leimbach (PIK)
29
REMIND-R by Potsdam Institute for Climate Impact Research (PIK)Potsdam Institute for Climate Impact Research (PIK)
![Page 30: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/30.jpg)
REMIND-R
30
Welfare
LabourCapital
Energy system costs
Output
ConsumptionInvestments
Final energy
Energy transformations and conversion technologies
Fuel
costsInvestments
Operation and
Maintenance
Labourefficiency
Emissions
Learningby doing
Ressource and potential
constraints
Makroeconomic
module
Energy system-
module
Hard link
Exogenous Data
Energy efficiency
Trade
Trade
Trade
Climate
module
![Page 31: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/31.jpg)
CO2 - Emissions
31
Reaching a 2°C target requires a fast and drastic decrease of emissions of all regions:
• 50% until 2035
• 78% until 2050
Policy scenarioReference scenario
![Page 32: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/32.jpg)
Primary energy production (regional)
32
Europe Middle-East/Africa (SS)
![Page 33: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/33.jpg)
Trading of Emission Rights
33
![Page 34: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/34.jpg)
R&D at GAMS
• 30% of revenue invested in R&D
• Product Development
• Research with academic & commercial
partners
– Emerging technologies (5-15 years)
• Computing (grid, cloud, parallel, …)
• Mathematics/Algorithms
• Modeling
– Dissemination of technology from
academia/research labs to clients
![Page 35: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/35.jpg)
R&D at GAMS
• GAMS is a platform for
– implementing research ideas
quickly
– assuring quality to achieve
commercial strength software
– deploying at minimal cost and risk
to the user
![Page 36: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/36.jpg)
Global Optimization
• Various research codes for Global Optimization:
BARON, LGO, OQNLP, LindoGlobal
• Deterministic GO codes need more than function
and gradient values (provide algebra to the solver)
• Establish quality assurance
procedures and test
model libraries
• Performance testing
(set expectations right)
Performance Analysis and Visualization for
Effortless Reproducibility
![Page 37: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/37.jpg)
Relative Sales of Global Optimization
![Page 38: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/38.jpg)
ScenRed
• Prof. Römisch et. al. at HU Berlin
• Stochastic Optimization
• Scenario reduction aims to reduce the
number of scenarios and to maintain the
probability information as good as possible
![Page 39: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/39.jpg)
ScenRed
• ScenRed helps reducing the size of
stochastic linear programs so they can be
solved by today's LP technology.
• Seamless integration into GAMS
![Page 40: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/40.jpg)
• Extended Nonlinear Programs
• Embedded Complementarity Systems
• Bilevel Programs
• Disjunctive Programs
• …
Breakouts of traditional MP classes
No conventional syntax
Limited support with common model representation
Incomplete/experimental solution approaches
Lack of reliable/any software
Extended Mathematical Programming (EMP)
40
![Page 41: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/41.jpg)
• Bilevel Program:
• Additional Information:
• EMP Tool automatically creates an MPEC by expressing
the lower level optimization problem through its
optimality conditions
Hierarchical Models
41
$onecho > %emp.info%
Bilevel x min v h
$offecho
![Page 42: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/42.jpg)
Model Users & Model Use
DomainExpertResearcher
BlackBox
Combining models and algorithms to find answers for problems in the application domain
Model used to write Research Paper/Thesis
“Innocent” user of sophisticated optimization based approaches
Solution Technology
Model Management
ITAPIs
![Page 43: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/43.jpg)
![Page 44: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/44.jpg)
Distributed Models – Distributed Modelers
![Page 45: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/45.jpg)
Planning & Scheduling at BASF
Planning and Scheduling for
batch and continuous
plants
Hybrid Methods
MIP & Local Search
SAP/APO Interface
Decomposition of MIP model for state-task
model formulations
Floudas, Princeton
Eremeev/BorisovskiSobolev Inst., Omsk
Kallrath/SchreieckBASF Scientific Computing GroupLudwigshafen
BASF IS, SAP,Mathesis
PolyleticModeling
KallrathBASF
![Page 46: Algebraic Modeling Past, Present and Future - GAMS …old.gams.com/presentations/or2010_ca.pdf · · 2015-08-07Algebraic Modeling Past, Present and Future ... • 11 world regions](https://reader031.vdocument.in/reader031/viewer/2022020315/5b188ecc7f8b9a1e258be58e/html5/thumbnails/46.jpg)
Thank you !
Europe
GAMS Software GmbH
Eupener Str. 135-137
50933 Cologne
Germany
Phone: +49 221 949 9170
Fax: +49 221 949 9171
http://www.gams.com
USA
GAMS Development Corp.
1217 Potomac Street, NW
Washington, DC 20007
USA
Phone: +1 202 342 0180
Fax: +1 202 342 0181
http://www.gams.com
46