planning building and managing data center facilities at international locations

This presentation was given during the Spring, 2012 Data Center World Conference and Expo. Contents contained are owned by AFCOM and Data Center World and can only be reused with the express permission of ACOM. Questions or for permission contact: [email protected].

Interested in learning more about data center building and design?

Learn about the data center management building and design sessions offered at the upcoming Fall 2012 Data Center World Conference at:

www.datacenterworld.com.

Harley-Davidson’s International Data Center

Growth

International Growth

Agenda HD history Site History Growth Demands Define Five year IT Site plan International Standards Infrastructure Site Selection Equipment Selection Equipment Installation Installation Results Long Term Support Model Lessons Learned


HD History 1903 Harley-Davidson Motor Company is founded 1907 Harley-Davidson is incorporated 1909 First V-Twin engine is introduces 1907 Bar and Shield logo is introduced 1912 HD goes global exports first motorcycles to Japan 1918 Harley-Davidson goes to war 1/2 of all bikes 1931 only Harley and Indian remain as US motorcycle

manufacturers 1941 HD goes to war and suspends almost all civilian

production 1953 Harley’s only US competitor, Indian, goes out of business 1969 Harley-Davidson merges with AMF 1981 Senior Leadership at Harley buys the company from AMF 1986 Harley-Davidson goes public and is listed on the

American Stock Exchange 2003 Harley celebrates 100 years


International GrowthCurrently managed Sites



Site History at HD 2008 consolidated to 13 domestic site

(not all have DC operations) International sites contained to mostly

Europe and Asia Latin America growth kicked off in 2009 CKD operation in Manaus Brazil since

2005 (Complete Knock Down)


Current international HD sites (managed sites) China - Beijing, Shanghai India - Bawal, Gurgaon (New Delhi) Japan - Tokyo, Osaka Brazil - Manaus, Sao Paulo Mexico - Monterey Singapore England – Oxford Australia – Plympton


Growth Demands Significant sales growth in Latin and

South America Growth potential in India – Tariffs

required CKD operation in country Consolidation / Sales office growth in

western and eastern Europe Asia sales growth in Singapore, China,

Japan, Malaysia and Australia


Five year IT site requirements Server Client devices Shop floor devices Infrastructure devices Support model

International Growth Pre-define International Standards

Server needs What servers if any will be required on site Blade chassis are HD standard (IBM Blade H) No single servers allowed

Network needs Switch Router Wireless WAAS (network application acceleration device)

Storage needs TSM server (exception to the rule) IBM storage shelf

Why??? What’s your IT budget look like? What loads do you need to support?

Cont. Site coverage?

Will workstations / printers be on UPS Will any shop floor devices be on UPS


Infrastructure UPS

Decide on single phase or 3 phase We standardized on 3 phase to allow for required capacities

and growth Your design should included a UPS that is readily available

internationally We sized ours estimated load plus 50% Use easily scalable systems

Racks We tried to standardize on the same racks in our DC –

may not be available in county more flexibility here Power distribution

Standardized power PDU / outlets allows for easy IT equipment connection

We standardized on c-13 / c-14 and c-19 / c-20 for all IT and network gear


Infrastructure (Cont.) Generators

If generators are to be included try to use common generator manufacturers’ if possible

Spec generators for specific use, Emergency Standby or Continuous Duty

Size to allow for load growth for IT as well as site non-IT requirements Complete as much engineering as possible

Engineer as much of solution as possible down to breaker type and gauge of distribution wire

Panel structure and bypass panel layout Recommend over head power distribution if possible

HVAC DON’T USE STANDARD ROOM AC GEAR Data center specific gear


Site Selection Things to look for

Power to site (quality, provider, capacity) Connectivity to the site Residence proximity to site Lead time for getting IT and support equipment in

country Supportability

Use known support vendors (HD uses Eaton for all services)

Support vendors within driving distance of site Quality of support vendors available


Equipment Selection The value of standardization

Standardize across all international sites if possible All gear is known and makes monitoring much easier Leverage relationship for support and pricing Most major manufacturers are available everywhere

Availability overseas (Most major manufacturers are available everywhere)

Be aware of Lead times of equipment when planning Support of equipment

Look at establishing support contract as soon as gear is commissioned to ensure site support

If site personnel will support equipment make sure they have good understanding of equipment

Make sure equipment materials are available in site language


Equipment Selection (cont.) Generator selection (ES, CD)

Depending on power to site evaluate the use of continuous duty versus emergency stand-by

We recommend diesel fuel versus natural gas

In line electrical protection Power to site may require an inline protection device Flywheel or SAG rid through UPS protection, batteries Short term (15ms) events will kill your gear

A four module system had to have three modules replaced within first year


Equipment Installation Leave it to the professionals

Contract local electricians that will install based on your design and can adapt to local / country codes

Ensure contractor will work with equipment providers for installations

Contract should cover rework if required post installation Contract should install using all manufacturer standards and

requirements Contract a local electrical engineer if needed

Feet on the street (witness if possible) If at all possible witness as much of the installation as possible Know the design if present for installation to direct Have your electrical engineer available if possible Have translator


Equipment Installation (Cont.) Commission

Depending on the complexity of the installation commission as much of the system as possible

Load banks and test gear should be available in most countries If your budget allows use your local (US) commissioning

contractor or have them write the commissioning script for you

Ensure quality work If possible personally interview site support vendor / personnel Make sure support vendor is qualified / certified to work on

equipment Knowledge of local codes (??)

Adherence to local electrical standards Meet manufacturer installation base requirements Connection standards IT gear and distribution equipment


Unsupervised resultsInternational Growth

Unsupervised Results (cont.)


Remote Monitoring Ability to remote monitor equipment

Monitor as many of your remote systems as possible Record everything – mitigate, trend future risk

Alerts to support contract holder (establishing) If possible include your local support contract holder on

your distribution for equipment alerts We have most of our UPS gear monitored at all our sites

Cover required changes based in monitoring data Much easier to justify future changes if historical data is

available You may capture the pre-failure alerts and mitigate before

failure


Long Term Support Model Structured support plan

Structure your international support model as close to your domestic plan as possible

Single model keeps things simple

RFI and RFP of international support providers Find your preferred support contractors that have international

capabilities and use formal bid process for contract decision Weigh cost with international coverage and gear specific

supportability Ensure providers are capable of working on standardized

equipment

Provider is a known commodity Make sure you are comfortable with your provider Have a single point contact for all sites if possible!!


Lessons Learned Hire local electrical engineer for local design help

We have seen issues not knowing local electrical requirements Didn’t have local installer review design prior to install Design was not followed and we didn’t oversee the installation

Don’t deviate from design Politics or money may get in the way try not to allow this from

happening – bad things may follow If your design is complete and complies with in-country codes there

should be no reason for any deviation Do not allow for replacement / substitution of designed systems (if

possible) If design deviation is unavoidable make sure required capacity and

scalability are maintained


Lessons Learned (Cont.) Test all installations if possible (commissioning)

HD is a huge proponent of commissioning something we did not do at our international sites – have paid the price

Manufacturer saved us at one site (value of standardization) Keep detailed logs of all systems at each site

Detailed logs justify change spend We saw issues at a site – trended power issues and forecasted

failure First module failure occurred 6 months after equipment

installation Event log for one site exceeds 16,000 events for one year


Questions? Fragen? 问题？

質問はありますか？ सवा�ल?

Preguntas?


This presentation was given during the Spring, 2012 Data Center World Conference and Expo. Contents contained are owned by AFCOM and Data Center World and can only be reused with the express permission of ACOM. Questions or for permission contact: [email protected].

Interested in learning more about data center building and design?

Learn about the data center management building and design sessions offered at the upcoming Fall 2012 Data Center World Conference at:

www.datacenterworld.com.

planning building and managing data center facilities at international locations

Technology

international growth

international growth

site support

load growth

support equipment

support of equipment

significant sales growth

domestic site