open sourcebi
DESCRIPTION
about open source platforms and dataTRANSCRIPT
The State of Open Source Business IntelligenceChristian Donner
www.molecular.com 2
Getting from data to the source of a problem can be hard ...
A czar learned that the most disease-ridden province of his empire was also the province with the most doctors.
His solution?
He promptly ordered all the doctors shot dead.
Folktale from: Freakonomics - A Rogue Economist Explores the Hidden Side of Everything (Steven D. Levitt, Stephen J. Dubner)
(He clearly lacked Business Intelligence)
www.molecular.com 3
… or easy …"How would you rate the overall job President George W. Bush is
doing as president -- excellent, pretty good, only fair, or poor?
Source: Harris Poll, published by the Wall Street Journal Online on 5/12/2006
Excellent or pretty good
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
80.00%
90.00%
Ma
yA
pri
lM
arc
hF
eb
rua
ryJ
an
ua
ryN
ov
em
be
rA
ug
us
tJ
un
eA
pri
lF
eb
rua
ryN
ov
em
be
rO
cto
ber
Sep
tem
be
rA
ug
us
tJ
un
eA
pri
lF
eb
rua
ryD
ece
mb
er
Oct
ob
erA
ug
us
tJ
un
eA
pri
l
Fe
bru
ary
Dec
em
be
rN
ov
em
be
rO
cto
ber
Sep
tem
be
rA
ug
us
tJ
uly
Ju
ne
Ma
yA
pri
lM
arc
hF
eb
rua
ryJ
an
ua
ryD
ece
mb
er
No
ve
mb
er
Oct
ob
erA
ug
us
tJ
uly
Ju
ne
Ma
yM
arc
hF
eb
rua
ry
200620052004200320022001
www.molecular.com 4
Poll
• Who has implemented something that you would define as a BI solution before, either in your own organization or for someone else?
• Out of this group, who has used an Open Source BI product?
• Survey on http://cdonner.com (20 responses):
Currently using BI 85%Currently using OSBI 40%Evaluated OSBI in the past 40%Planning to use OSBI 35%
www.molecular.com 5
Why this presentation?
• 2 years ago I started a low-budget BI project • Researched many products and technologies• OSBI was practically non-existent• Decided to go with Microsoft DTS and SQL RS• Today, the landscape has changed dramatically• I wanted to know: would I go with Open Source BI
today?
www.molecular.com 6
Agenda
• What is Business Intelligence?• BI Trends• OSBI Trends• Products
• Pentaho• Jaspersoft• OpenI• BIRT• Bizgres• Mondrian
• Demo
www.molecular.com 7
Business Intelligence – A Definition
• Business Intelligence • In 1989 Howard Dresner (Gartner Group) created the term
"BI“:“A set of concepts and methods to improve business decision-making by using fact-based support systems.”
• Wikipedia:• the technology used for collecting and analyzing business
information• a set of business processes for this purpose• the information obtained from these processes
• Includes:• ETL Tools• OLAP/Data Analysis Tools• Reporting Tools• Databases
www.molecular.com 8
Business Intelligence - Components
Operational Datastore
ETL
Extraction
Relational Datastore Multi-dimensional Datastore
Storage
ROLAP
MOLAP
Aggregation
Reporting BI Platform
Delivery
www.molecular.com 9
Business Intelligence Platform
• Integrate with business processes
• Manage and schedule reports
• Deliver reports through multiple channels, push and pull model support
• Maintain user security• Seamlessly integrate via
open standards with portals and applications
www.molecular.com 10
Agenda
• What is Business Intelligence?• BI Trends• OSBI Trends• Products
• Pentaho• Jaspersoft• OpenI• BIRT• Bizgres• Mondrian
• Demo
www.molecular.com 11
Forecast: Business intelligence market growth
2003 2004 2005 2006 2007 2008
$5,253M $5,596M $5,997M $6,506M $7,005M $7,331M
6.5% 7.2% 8.5% 7.7% 4.7%N/A
BI services revenueBI maintenance revenueBI license revenue
Size
Growth
Actual Forecast
BI market size
(US$ millions)
Source: Forrester Research, “Business Intelligence Growth Is Driven By Compliance, Standardization, And Performance Initiatives”
$0
$2,000
$4,000
$6,000
$8,000
www.molecular.com 12
Mainstream BI Theme
• Keith Gile, Forrester Research:“We are witness to a change in BI that shifts the emphasis away from functionally powerful tools for power-user “producers” toward context-sensitive BI solutions for a large community of “consumers” of information.”
• Paul Doscher, CEO Jaspersoft:“The big commercial tool providers can handle performance management applications well, but left Operational BI behind.”
• License bottleneck•Lower-level in-house user•Public web sites
www.molecular.com 13
Forrester Wave™: BI Enterprise Reporting, Q1 ‘06
Where are the Open Source contenders?
Source: Forrester Research
www.molecular.com 14
Agenda
• What is Business Intelligence?• BI Trends• OSBI Trends• Products
• Pentaho• Jaspersoft• OpenI• BIRT• Bizgres• Mondrian
• Outlook
www.molecular.com 15
Why Open Source?
Source: Survey by Computer Economics, Frank Scavo
www.molecular.com 16
The Jaspersoft Story: BI for Everyone
Operational executives are being asked to make decisions more critical to the Corporation more frequently especially with the added scrutiny of SOX
compliance.
Legacy BI Companies have failed to solve the Problem
“We have Business Objects installed on our corporate data warehouse and 80% of our users only use 20% of
the functionality.”Michael Heschel, EVP Information Systems and Services, The Kroger Company
“A typical installation for a 1000 users for the full BI suite could run
As high as $450k - $700k for software licenses alone.”Intelligent Enterprise, August 2005
The full Business Objects product takes
180 CDs to install!!!
This slide © 2005 JasperSoft, Inc.
www.molecular.com 17
Organizational Involvement with OS BI
21%
19%43%
8%9%
Has deployed open source BI software
In development with open source BI softwareConsidering open
source BI software
Not Considering open source BI software
Don’t Know
(c) 2006 Ventana Research Open Source and BI Research
www.molecular.com 18
Comparison of OS BI with Commercial BI
Cost of Ownership
(c) 2006 Ventana Research Open Source and BI Research
Scalability/Performance
Openness/Flexibility
Database Support
Reliability
Metadata Support
Manageability
Ease of Use
77%
80%
72%
69%
62%
57%
61%
57%
Significantly more Capable More Capable Equivalently Capable Less Capable Significantly less Capable Don’t know
www.molecular.com 19
Extranet Applications - The “Beachhead” of Open Source BI?
• Technology requirements favor open source• Pure J2EE offerings provide a better technology fit
than legacy BI technology• Licensing requirements contradict prevailing proprietary
models• “Named user” only – doesn’t map to extranet usage• Role-based – meaningless in extranets• >$1,000 USD per name user – cost prohibitive• Net/net: The “old school” BI licensing model breaks
down
www.molecular.com 20
Free software for sale!
• Community-based vs. for-profit companies• Open Source has become a business model• Acquisition of your vendor can change the terms
under which you use OS SW• Example: Bill Venners account of using Jive for Artima.com
• Example: Snort, Sale of Martin Roesch’s Checkpoint Software
• Whatever you do, factor in that your Open Source product may not always remain that.
www.molecular.com 21
Example: Jaspersoft Business Model
JasperIntelligence Product Family• JasperReports, iReports• Jasper Decisions, Jasper Server• Soon: JasperAnalytics, JasperETL
Commercial / Dual license
• Services packages on Subscription basis (JS & JR)• Commercial License, Support, Training, Documentation
• CPU based Pricing plus Support (JD)• Support pricing (JR)
• Incident support plus three annual support options from web based self-service to comprehensive 24x7x265
Leveraging strong and loyal community• SourceForge JasperForge
This slide © 2005 JasperSoft, Inc.
www.molecular.com 22
Agenda
• What is Business Intelligence?• BI Trends• OSBI Trends• Products
• Pentaho• Jaspersoft• OpenI• BIRT• Bizgres• Mondrian
• Outlook
www.molecular.com 23
OSBI Explosion
• There are about 25 products competing in this space, about half of which did not exist prior to 2005.
• Many of them will probably return to insignificance
• Because we are so early in the maturity cycle, it is difficult to make judgments about who will make it.
www.molecular.com 24
Open Source Reporting Tools
• Eclipse BIRT (Actuate)• Jasper Reports• JFreeReport• DataVision• Open Reports• OpenRPT• Agata Reports
www.molecular.com 25
Eclipse BIRT• (Business Intelligence) and Reporting Tools
• Eclipse Report Designer (ERD)• Eclipse Report Engine (ERE)• Eclipse Charting Engine (ECE)• Web Based Report Designer (WRD)
Source: Actuate
www.molecular.com 26
BIRT 2.0 Features
• Released January 20, 2006• Re-Use Library – A report component environment allows
developers with a range of expertise to share report components or functions for reuse.
• Page-on-Demand HTML- A page-on-demand navigation mechanism enables the efficient viewing of large report documents over the internet.
• CSS Style Sheets – External style sheets can be used across multiple report designs, making it easy to establish a common look across all reports in one application.
• Scripting Editor – BIRT supports the ability to code or script the behavior of reports using a perspective for Java Code Editing for BIRT reports.
• Large, Persistent Reports – Report developers can generate a report and then distribute a URL to end-users.
• Improved Charting Facility, Scripting – BIRT 2.0 includes a wizard for building common usage charts and advanced capabilities for including detailed charts within a report design.
www.molecular.com 27
Open Source OLAP Tools
• Mondrian• JPivot• gOLAP• PALO• pocOLAP
www.molecular.com 28
Open Source ETL Tools
• Clover ETL• CPluSQL• Enhydra Octopus• JetStream• KETL• Kettle• OpenDigger
www.molecular.com 29
Open Source BI Suites
• BEE• Bizgres• Openi• Pentaho• SpagoBI
www.molecular.com 30
JasperIntelligence Architecture
Customers Business Analyst Domain User Executive
USERCOMMUNITY
Operational DataSource
Content Store
Report Definition
Rendered Content
Images, Fonts, etc
Meta Data
JasperServer
Cube /Data Mart
InventoryPurchasingFinanceCORPORATE
DATA…
JDBC, POJO, XML, XML/A
HTTP, SOAP, Web Services, Java API
OUTPUT
Reporting Services Metadata Services OLAP Services
JasperETL
JasperIntelligence Platform
ETL Services
JasperReports JasperDecisions JasperAnalysis JasperETL
PDFHTML + AJAX MS EXCEL MS WORDJasperExplorer
This slide © 2005 JasperSoft, Inc.
www.molecular.com 31
Pentaho
Source: Pentaho
www.molecular.com 32
OpenI
Source: OpenI/Loyalty Matrix
www.molecular.com 33
OpenI at a Glance
• J2EE Web Application• Standards-based, integrates other Open Source
components• Connectors for Relational (JDBC), OLAP (XMLA), and
data mining data sets (RServe) currenly only XMLA• Supports Jasper .jrxml and custom RDL • JPivot for Pivot tables, JFreeChart • Supports JSP-168• Form-based authentication with J2EE Security
www.molecular.com 34
Bizgres
• Sponsored by Greenplum• Bizgres is a distribution of PostgreSQL (Open Source
DB)• Bizgres includes the following components:
• PostgreSQL 8.1.3 (Open Source RDBMS)• Bizgres Loader (Mass data loading utility)• Demonstration Programs and Utilities• KETL Integration (ETL solution for web log analysis)• JasperReports Integration• Bizgres Clickstream
www.molecular.com 35
Bizgres Clickstream Architecture
Source: Greenplum
www.molecular.com 36
Who leads the pack?
Downloads by Month
0
10000
20000
30000
40000
50000
60000
Feb-05
Mar-05
Apr-05
May-05
Jun-05
Jul-05
Aug-05
Sep-05
Oct-05
Nov-05
Dec-05
Jan-06
Feb-06
Mar-06
Apr-06
Mondrian JFreeReport Pentaho Jasper Reports
Source: sourceforge.net
www.molecular.com 37
Agenda
• What is Business Intelligence?• BI Trends• OSBI Trends• Products
• BI suites• ETL tools• OLAP• Reporting tools• Databases
• Demo
www.molecular.com 38
The State of Open Source Business Intelligence
• “Business intelligence” is a broad umbrella term• Lot of buzz in the media and from analysts• Young and growing market• Immature, but rapidly improving products• No clear market leader
www.molecular.com 39
Thank you!
Would I go with Open Source BI today? How about you?
Q&A