the enterprise architecture you always wanted has been hiding in plain sight since 1991
DESCRIPTION
The Enterprise Architecture you always wanted has been hiding in plain sight since 1991. Jim Webber http:// jim.webber.name Twitter: @ jimwebber. Or: A Billion Transactions Per Month Using the Web for Enterprise Heavy Lifting. Jim Webber http:// jim.webber.name Twitter: @ jimwebber. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/1.jpg)
The Enterprise Architecture you always wanted has been hiding in plain sight since 1991
Jim Webberhttp://jim.webber.name
Twitter: @jimwebber
![Page 2: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/2.jpg)
Or: A Billion Transactions Per MonthUsing the Web for Enterprise Heavy Lifting
Jim Webberhttp://jim.webber.name
Twitter: @jimwebber
![Page 3: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/3.jpg)
![Page 4: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/4.jpg)
Today’s Enterprise ArchitectureAccounting Marketing
SupportProduct Development
![Page 5: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/5.jpg)
SOA to the rescue!
![Page 6: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/6.jpg)
“SOA: Principles of Service Design underwent a thorough technical review involving over 60 reviewers from different vendors, organizations, and professions across North America, Europe, and Asia. The book has been formally endorsed by members of major SOA vendors, including IBM, Microsoft, Oracle, BEA, and Intel.”
-- Thomas Erl
![Page 7: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/7.jpg)
Tomorrow’s Enterprise Architecture
![Page 8: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/8.jpg)
Nirvana Enterprise Architecture, or…
![Page 9: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/9.jpg)
ESB - Erroneous Spaghetti Box?Enterprise Service Bus
![Page 10: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/10.jpg)
Archite
ctural
Fant
asy
![Page 11: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/11.jpg)
Ungovernable
![Page 12: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/12.jpg)
Doesn’t Scale
![Page 13: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/13.jpg)
But we still do it.
![Page 14: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/14.jpg)
Why?
Because it’s “less risky”
![Page 15: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/15.jpg)
Why?
Because that’s what the market does
![Page 16: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/16.jpg)
Why?
Because we need the -ilities
![Page 17: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/17.jpg)
So let’s talk about those -ilities
![Page 18: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/18.jpg)
Scalability
![Page 19: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/19.jpg)
Enterprise Scalability?
![Page 20: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/20.jpg)
Web
Sca
le!
![Page 21: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/21.jpg)
Trad
ition
al E
nter
pris
e S
ecur
ity
![Page 22: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/22.jpg)
End to End Secure Messaging
End to End Secure Conversations
![Page 23: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/23.jpg)
Security Tokens and claims
Federating access with tokens
![Page 24: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/24.jpg)
Enterprise security is awesome, but…
![Page 25: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/25.jpg)
…you wouldn’tuse it at home!
![Page 26: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/26.jpg)
Reliability
![Page 27: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/27.jpg)
![Page 28: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/28.jpg)
Transactions
![Page 29: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/29.jpg)
Problem
solved!
Bottleneck
No trustCrash recovery?
Denial of Service
![Page 30: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/30.jpg)
Contracts
![Page 31: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/31.jpg)
<?xml version="1.0" encoding="UTF-8"?><definitions name="HelloService" targetNamespace="http://www.ecerami.com/wsdl/HelloService.wsdl" xmlns="http://schemas.xmlsoap.org/wsdl/" xmlns:soap="http://schemas.xmlsoap.org/wsdl/soap/" xmlns:tns="http://www.ecerami.com/wsdl/HelloService.wsdl" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <message name="SayHelloRequest"> <part name="firstName" type="xsd:string"/> </message> <message name="SayHelloResponse"> <part name="greeting" type="xsd:string"/> </message> <portType name="Hello_PortType"> <operation name="sayHello"> <input message="tns:SayHelloRequest"/> <output message="tns:SayHelloResponse"/> </operation> </portType> <binding name="Hello_Binding" type="tns:Hello_PortType"> <soap:binding style="rpc" transport="http://schemas.xmlsoap.org/soap/http"/> <operation name="sayHello"> <soap:operation soapAction="sayHello"/> <input> <soap:body encodingStyle="http://schemas.xmlsoap.org/soap/encoding/" namespace="urn:examples:helloservice" use="encoded"/> </input> <output> <soap:body encodingStyle="http://schemas.xmlsoap.org/soap/encoding/" namespace="urn:examples:helloservice" use="encoded"/> </output> </operation> </binding> <service name="Hello_Service"> <documentation>WSDL File for HelloService</documentation> <port binding="tns:Hello_Binding" name="Hello_Port"> <soap:address location="http://localhost:8080/soap/servlet/rpcrouter"/> </port> </service></definitions>
Hello
Wor
ld!
![Page 32: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/32.jpg)
The Web is a coordination platformSt
atus
code
s Verbs
hypermedia
Sem
antic
sMicr
oformats
Med
ia
Type
s
![Page 33: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/33.jpg)
Pie in the sky?
Not at all
![Page 34: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/34.jpg)
A Case Study
Client• UK-based telecoms service provider• Global customers (no easy downtime)Problem• Scalability and system resilience issues• Huge growth curve to from a million to a
billion messages per month• Costs
![Page 35: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/35.jpg)
Platform Architecture
CarrierCarrier
CarrierCarrier
Gateway
Voice to Text Algorithms
Integration Database
Post Processing
Shared Filesystem
Bottleneck Nightmare! Where’s my file gone?
Shoehorn it in that other program
Fix things up here
![Page 36: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/36.jpg)
Three Months’ Enterprise Consulting Later…
![Page 37: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/37.jpg)
The £10 Million Solution
CarrierCarrier
CarrierCarrier
Gateway
Voice to Text Algorithms
“Queue”Database
Post Processing
Shared Filesystem
Enterprise Service Bus
*
* Solution does not include actual implementation
![Page 38: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/38.jpg)
CEO’s Response
![Page 39: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/39.jpg)
ThoughtWorks was given the output from a previous enterprise consultancy…
…and told to “do that, but cheaper”
![Page 40: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/40.jpg)
Jim’s Response
![Page 41: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/41.jpg)
Thinkdifferently!
(or even just stop and think)
![Page 42: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/42.jpg)
Architecture is still important
![Page 43: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/43.jpg)
Agile EA: Prioritise Service Delivery
CarrierCarrier
CarrierCarrier
Gateway
Voice to Text Algorithms
Integration Database
Post Processing
Shared Filesystem
Start by fixing
storage
![Page 44: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/44.jpg)
![Page 45: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/45.jpg)
![Page 46: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/46.jpg)
This is how risk is
mitigated. Not by buying
middleware up-
front!
![Page 47: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/47.jpg)
![Page 48: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/48.jpg)
Storage Manager Project Delivery
Small team
3 Week Inception
14 iterations
Java solution
Performance testing throughout– See Jones and Kua paper,
Agile 2009
Continuously built and deployed for testing
![Page 49: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/49.jpg)
Web-friendly Architecture(mostly wallet-friendly too!)
Storage Manager
Jboss/Tomcat
GPFS SAN
Cacheable!
Optimised disk access!
Optimised server config
Free!
Encapsulates storage detail!
Fast!
Spend £ on the right
Infrastructure
![Page 50: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/50.jpg)
![Page 51: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/51.jpg)
We love testin
g
![Page 52: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/52.jpg)
What is going on here?
What is going on with these peaks?
![Page 53: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/53.jpg)
Hypothesis
Directories are becoming full, slowing random access to files
![Page 54: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/54.jpg)
Prediction
A single directory will result in linearly degrading performance
![Page 55: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/55.jpg)
![Page 56: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/56.jpg)
Outcome
Adapt the directory structure to take advantage of the underlying file
system
![Page 57: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/57.jpg)
Improving Enterprise Architecture
CarrierCarrier
CarrierCarrier Gateway
Voice to Text Algorithms
Integration Database
Post Processing
Storage Manager
Reduced Load
Just shoehorn it in that other
program
“She’ll be right”
Scalable!
![Page 58: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/58.jpg)
Storage Manager Benefits
• Immediate reduced load on integration database
• Enabled removal of code from systems• Delivered business value by keeping
customers happy
• “The best software we have ever deployed”– Operations director I’ll come back to this
![Page 59: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/59.jpg)
What’s wrong with this picture?
![Page 60: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/60.jpg)
What if…
We took our inspiration from successful Web-scale companies?
![Page 61: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/61.jpg)
What if…
And took the time to understand our SLAs?
![Page 62: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/62.jpg)
What if…
And picked the right technology solution?
Not just the one we’re being sold?
![Page 63: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/63.jpg)
What if…
We built a scalable compute platform?
![Page 64: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/64.jpg)
![Page 65: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/65.jpg)
Grid Project Delivery
Larger team
3.5 Week Inception
18 iterations
Java solution
Performance testing throughout
Continuously built and deployed for testing
![Page 66: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/66.jpg)
Web-friendly Architecture(very wallet-friendly!)
Grid Manager
Embedded Jetty
Grid Manager
Embedded Jetty
Grid Manager
Embedded Jetty
Grid Manager
Embedded Jetty
Grid Manager
Embedded Jetty
ASR ASR ASR ASR
Grid Pipeline
ASR ASR ASR ASR
Grid Pipeline
Just HTTP
Fault Tolerant
Fault Tolerant
Just HTTP
Sustainable container for business logic
£0Software
Infrastructure
![Page 67: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/67.jpg)
Improving Enterprise Architecture
CarrierCarrier
CarrierCarrier Gateway
Grid
Integration Database
Post Processing
Storage Manager
Massively Reduced
Load
“She’ll be right”
Scalable!
Scalable, sustainable!
Scalable Processing Platform
![Page 68: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/68.jpg)
Grid Benefits
• Scalable, resilient platform• Aligned with business goals• Further reduced load on integration database• Set architectural patterns• Deliver business value by processing more
messages at lower cost than ever before
• “The best software we have ever deployed”– Operations director Better every time!
![Page 69: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/69.jpg)
£10,000,000Up-Front Cost of Bus Architecture
![Page 70: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/70.jpg)
£1,000,000Actual Cost of Completed Project
![Page 71: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/71.jpg)
£0Cost of Middleware
![Page 72: The Enterprise Architecture you always wanted has been hiding in plain sight since 1991](https://reader035.vdocument.in/reader035/viewer/2022070503/568156ce550346895dc4671f/html5/thumbnails/72.jpg)
The Web works
And its economies of scale eclipse your vendors’