long version - adventures in agility: how one online publisher changed their approach to online...
TRANSCRIPT
How One Publisher Changed Its Approachto Online Development in 45 Days
ADVENTURESIN AGILITY
Larry M. BelmontManager, Online Developmentlabelmo at aip dot org
Society for Scholarly Publishing30th Annual Meeting, Boston, MAMay 30, 2008
About AIP• Founded in 1931 as a service organization …
– Charter: to diffuse and advance the knowledge of physics and its application to human welfare
– Service mission: to supply economy-of-scale publishing services to Member Societies
– Currently has 10 member societies, 23 affiliated societies, and several other organizations under its umbrella (most have a publishing program)
• A publisher in its own right …– 10 journals, conference proceedings, database products
• Scitation …– AIP’s online hosting platform; on the web since 1996– Aggregation of 180 publications for 25 publishing partners
About me• 27 years in publishing, all at AIP …
– 9 years in print journal production (most as a technical copy-editor)
– 3 years in desktop publication production– 15 years in electronic/online products (8 as a
manager)• Currently an online product development
manager in a business unit• Not a programmer; more of a technical
projects manager/product manager
Our goals• Increase development speed in order to meet
customer and customer constituency demands, as well as our own needs to evolve our services more regularly
• Position ourselves to innovate or deploy new features quickly in response to unpredictable “market conditions,” major paradigm shifts (like Web 2.0), or good ole competitive one-upsmanship
• Create the atmosphere for sustained agility throughout the enterprise
The enemies of agility• Project (micro)management• Fear of failure (culture of “that won’t work”)• Distributed decision-making• Fixed recipes; rigid, opaque processes; and
“perfect-plan-ism”• Monolithic release mentality (anti-iterative)• Design by committee• Disconnect from users and customers at all
but latest stages• Compartmentalization, thick-walled bizunit-
bizunit and bizunit-IT silos
Did anyone read a software manual?• No. (Well, I didn’t anyway.)• I read and applied what I learned from these books
into a new way to approach projects:– Good to Great (Collins)– The Starfish and the Spider (Brafman and Beckstrom)– Execution: The Discipline of Getting Things Done (Bossidy)– Boyd: The Fighter Pilot Who Changed the Art of War
(Coram)– Project Lessons from The Great Escape (Kozak-Holland)– Winston Churchill, the Agile Project Manager (Kozak-
Holland)– Patton on Leadership (Axelrod)
From many schools of agility …• Observe – Orient – Decide – Act (Boyd’s “OODA
Loop”)• Observe – Model – Test – Reflect (Kolb’s “Learning
Model”)• Plan – Do – Check – Act (Shewhart’s “QC Cycle”)
… we stewed an “agile approach”
Just what is agility?• Richard Feynman (a physicist, BTW) once said:
– “You can know the name of a bird in all the languages of the world, but when you’re finished, you’ll know absolutely nothing whatever about the bird … so let’s look at the bird and see what it’s doing – that’s what counts. I learned very early the difference between knowing the name of something and knowing something”
• So, at the end of the day, agility is still just a word.• But when we “observed the bird,” we saw agility was
mostly about:– “Feeling it”– Collaboration– An enabling organizational climate (a “let’s try it” culture that
understands that perfecting a product is a process, not an event)
Agility demands the right roles• The Agile “X Organization”
– The Leader, a/k/a “Big X”– The Stakeholder– The Timekeeper– The User Advocate– The Visualizer– The Architect– The Coder– The Bulletproofer– The Tester– The Gatekeeper
What was our “Big X” like?• Did not act like a certified project manager; more of
an engager-resonator-cultivator-harmonizer• Articulated clear intent/goal (co-signed “the contract
of leadership” with the team)• Provided vision and focus• Asked the team to accomplish the goal, but did not
tell them how to do it• A master of tasks, not a task-master• Served as “Solomon” when needed• Led with a light hand; inspired more peer-to-peer
coaching
Team attributes• Highly motivated, highly skilled• Zen-like, intuitive understanding• Mix of experienced hands, fresh POVs• Rank did not dictate leadership role(s)• Business-technology blend• Self-mobilizing at all levels• Cross-pollinating• Credibility, mutual respect, passion, trust• Subjugation of personal agendas
Team behaviors• Highly verbal• No blame, no fear• No assumptions, projections, conceits• Dialogue over monologue• Sublimation of egos, but wide berth given to
passionate POVs• Devil’s advocacy tempers evangelism• “Reverse-mentoring”• Belief in user input and test-driven
development as primary design driver
Inspiration• Agile project managers we admire …
– Prime Minister Winston Churchill– General George S. Patton– Colonel John R. Boyd
Lessons in Agility I• The Battle of Britain forced Churchill to turn England in May
1940 into an agile enterprise– The essential requirement: defeat the enemy with little resourcing
(600 British aircraft versus 2,500 German aircraft)• As project manager, Churchill ran the battle within an adaptive
“solution-motivated” architecture (which in business can be applied at the enterprise, unit, or project level):– Rapid sensing and response to events (Chain-Home Radar,
Observer Corps)– Informed decision making in the moment (sector level dispatch)– Agile implementation (squadron level scramble)– Agile tools (the Supermarine Spitfire)– Deliver results that satisfy the “user community” (shoot down more
aircraft than you lose – while keeping production going and preventing a German invasion of England)
Lessons in Agility II • The Battle of the Bulge in December 1944 required Patton to
completely change 3rd Army’s axis of attack in 48 hours.– The essential requirement: Halt the eastward advance of three
divisions in full attack (50,000 men, equipment), wheel them 90 degrees, and rush them 100 miles due north to attack again – ASAP
• As project manager, Patton ran the attack within a similar adaptive “solution-motivated” architecture:– Rapid sensing and response to events (driven by tactical planning
being put in the hands of empowered frontline commanders)– Informed decision-making in the moment (“humint” from high-speed
advance recon)– Agile implementation (the ease of deploying smaller, self-contained
“combat commands” versus entire divisions)– Agile tools: the Sherman tank– Deliver results that satisfy the “user community” (reinforce the 101st
Airborne at Bastogne, and deny the Germans use of its key road network and prevent German reoccupation of liberated territory)
Lessons in Agility III• Korean War jet pilot Boyd believed the perfect fighter
plane’s key characteristic was agility – the ability to change its energy state rapidly to move from patrol to attack mode, and for a pilot to do the same mentally to gain advantage once engaged in a dog-fight– Pilot advantage hinged on highly intuitive Observe-Orient-
Decide-Act (OODA) looping– The more agile pilot was the one who could change the
situation more quickly than his opponent could update his orientation to it (“getting inside” the enemy’s OODA loop)
– OODA grants us the ability to balance continuity and change (a pretty good definition of agility)
– This not only has import for gaining competitive edge in business, but also for gaining control over projects
What do aerial warfare and projects have in common?• Shared “adversaries”
– Rapid, unanticipated changes that lead to disorientation
– An uncertain environment– Constant threats to any initiative gained– Time itself
• OODA helps in dogfights and projects– Allows us to control the environment (esp. change)– Can help identify threats faster– Is iterative by design
OODA, cheap DC comics version
OODA, expensive O’Reilly book version
Starting small• Riddle me this … How do you eat an elephant?• Answer … One bite at a time• On Sept. 6, 2007 we challenged ourselves to change the
“abstract” views in AIP’s online journals by November 14, giving us 48 biz-days to:– Assemble the team; adopt new planning and implementation
methods and tools– Redesign everything and add as much “catch-up” and Web 2.0
functionality as possible– Prototype quickly; get stakeholders and users involved, giving input– Make sure we had a recipe we could repeat
• We wanted to:– Go live and announce the deployment at our annual publishing
partners meeting– Begin iterating the release in advance of rolling out the new
abstract views platform-wide
Our 1st OODA loopOODA Component What We Did
Observe Noted that 46% of Scitation user sessions started on the abstract view; began cultivating a vision that our platform was made up of 2 million article homepages where the users engaged us and one another, and where we engaged them
Orient Studied the competition, to see what they had on the abstract page that we didn’t, and what we could add quickly; ID’d customer and user wants and needs; increased Web 2.0 savvy; assigned values to deliverables
Decide Installed an agile “framework” (people, process, tools); planned a 1st iteration and an agile user testing/feedback loop
Act Implemented the 1st iteration
Here’s how it turned outWhat We Did How Long We Took
Assemble the team; retool approach, applications, and presentation framework (GUI) to facilitate
“working agile”; plan version 1.537 business days
Implement version 1.5 8 business days
Plan and implement Version 1.6 20 business days
Plan and implement Version 1.7 14 business days
Plan and implement Version 1.8 10 business days
Plan and implement Version 1.9 12 business days
How did we change our MO?What We Do Now What We Used to Do
Prototype on paper (easy to change) Produce exhaustive Visio wireframes and workflows
Practice user-centered design Practice designer-centered design
Quick-cook requirements in social environments (wiki, basecamp)
Slow-cook requirements via multiple meetings, mockup reviews, documentation reviews
Run the project on the web and reference a 1-2-page “roadmap” and document it on virtual writeboards
Run the project via meetings, e-mail, and reference a 50-page “plan” and document it on the LAN
Test end-user functionality modularly as it’s built – and course-correct as we go
Wait until everything is hard-wired together before alpha testing
Engage key internal stakeholders and customers/users at every stage
Wait until everything is changed and re-wired together before beta testing
Never consider work really complete; continue evaluating feedback and surveying users to drive
followup iterations
Declare work done and move onto next thing without reassessing value or need to modify/optimize behavior
Our obligatory process diagram
Keys to speed: paper• Went “retro” for planning, design, and
visualization– Used index card bleachers to organize the high-level project
components– User stories were literally story-boarded– Used presentation boards and Post-Its in multiple colors like
Colorforms to arrange GUI elements – and wire-framed the results
– Used dozens of 3x5 index cards and Post-Its to map the deeper logic underlying screen flows
– Captured certain visualizations with a digital camera on the spot and posted them to the project Basecamp as a point of reference for the team
Keys to speed: new “environments”• Ergonomics, creature comforts
– Dual monitors• Development framework
– AJAX– Apache Tiles– Spry– XML
• Management framework (still playing with these)– Basecamp, JIRA (web-based project collaboration)– Jabber (IM-like messaging and conferencing)– Pbwiki, Confluence, Drupal (online documentation)– surveymonkey (online user feedback collector-analyzer)
Keys to speed: the “war room”• Leveraged the social-ness inherent in teams• Provides an extremely high signal-to-noise ratio
Keys to speed: optimized meetings• Daily meetings of the action team (team
leaders, developers, designers)– 15 minutes or less
• Twice-weekly meetings of the entire team.– 30 minutes or less
• All other communication handled on the teamlet level, via short-burst online chat/IM or face-to-face
• Collectively, this communication “style” quickens every circuit of the OODA loop
Keys to speed: eating the elephant• To build is human; to iterate, divine• Build first out of necessity, and then iterate
aggressively to grant user flexibility, comfort, and – if desired – luxury:– Dirt track single-lane cobblestone road two-
lane asphalt road Autobahn• Start with one “story,” and then …
– Rewrite it– Rewrite it again (embrace “change”)– And (possibly) again
• Even perfection is a processEven perfection is a process
Our agile “mythology” scorecard“Agile Myths” We Confirmed “Agile Myths” We DebunkedPeople first, then ideas, then tools – the correct route from fragile to agile
Agility is just for programmers
OODA worked (though no one explictly knew it was OODA)
Agility requires no discipline
“Fail fast” or “fail early and often” is a speed-enhancing attribute; “gotta build it to break it” (best to break it sooner)
Agility is a silver bullet
User stories and personae were critical to getting at REAL functionality with VALUE
Plan-driven projects are always un-agile
Some form of 80/20 analysis increases design speed and helps plan product iteration(s)
Agility means “perpetual beta”
How we plan to stay agile• “A good plan … executed now is better than a perfect plan
executed next week” (Patton)
• Use a Pareto-like principle to organize your iterations and focus on the important features (shoot to get 80% of the value in any release from 20% of your efforts)
• Agility is learned behavior; therefore, we must educate and mentor staff relentlessly. Practice OODA until it becomes unconscious
• Maintain the discipline and emphasis on quality that will allow us to repeat success consistently
It’s Alive!• Project your agility – allow the
public/users/potential partners to look behind the curtain at select products before launch– “Scitation Labs” – a proving ground for new,
experimental, or evolving features– “Test Tubing” – introduce the new alongside the
old, and let the users compare
Thanks!
AIPAgility in Practice
Learn more at http://www.aip.org/
CREDIT WHERE IT’S DUERedrawn version of John Boyd's OODA Loop by Patrick E. Moran. Agile Lifecycle and other diagrams, courtesy Scott W. Ambler, Javapolis.A lifetime of project-management inspiration via http://www.lessons-from-history.com/Other images and sound bytes from the Great Internet Hard Drive.