chapter 12higheredbcs.wiley.com/.../level2_chapter_exercise.docx · web viewfor tpm tracking...

System Engineering Analysis, Design, and Development 5/13/23 02:39:37Author: Charles Wasson Wiley Editor: Brett KurzmanFile: document.docx

Level 2 Exercisesfor

System Engineering Analysis, Design, and Development

Author: Charles S. Wasson

© 2004-2016 Wasson Strategics, LLCAll Rights Reserved

1


Introduction

This document provides Level 2 upper undergraduate / graduate exercises for the textbook System Engineering Analysis, Design, and development. Level 2 Exercises, which complement the Level 1 Exercises provided at the ends of Chapters 1 – 34, enable the reader to apply chapter-based knowledge to real-world Systems Engineering problems.


2


Example Systems for Level 2 ExercisesAir Transportation Systems

1. Airline System2. Aircraft System 3. Airport Baggage Handling

System4. Airline Flight Check-in Process

Public Transportation Systems5. Subway System6. Bus System

Automobile Systems7. Automobile Systems8. Global Positioning System (GPS)9. AM/FM/Satellite/CD Audio

System10. Rear Mounted Camera System11. Cruise Control System12. Dashboard System13. Fuel System14. Electrical System15. Braking System16. Lighting System17. Steering System

Parking Lot18. Ticketing and Fee Collection

Devices19. Shuttle Service

Heavy Equipment20. Snow Plow21. Truck-Mounted Snow Plow22. Bulldozer23. Excavator

24. Front-End Loader

Roadways25. Traffic Light System26. Routing27. Entry/Exit Ramp

Emergency Response Systems28. Fire Department29. Emergency Medical System30. Law Enforcement31. Emergency Mgt. System (EMS)

Public Services32. City/County Water System33. Sanitation System34. Trash Pick-Up System35. Recycling Pick-Up System36. Fire Department37. Emergency Medical Services

(EMS)

Residential Systems38. Electronic Oven39. Home Security System40. Garage Door Opener System41. Fire Detection System42. Carbon Monoxide Detection

System43. Remote Controlled Fireplace44. Automatic Dishwasher45. Clothes Washer46. Clothes Dryer47. Heating, Ventilation, and Air

Conditioning (HVAC) System


3


48. Remote Controlled Lighting System

Home Appliances49. Bread Toaster50. Refrigerator-Freezer System51. Coffeemaker52. Microwave

Home Entertainment System53. Remote Controlled CD Player54. Remote Controlled DVD Player55. Remote Control Television

Sports Systems56. Auto Racing Stadium57. Auto Racing – Pit Crew System58. Football, Soccer, Baseball,

Basketball, Hockey, others59. Soccer Game60. Football Game61. Baseball Game62. Scoreboard System63. Sailboat64. Fishing Boat65. Spinning Rod and Reel66. Fly Rod and Reel

Recreational Vehicles67. Recreational Utility Vehicle68. Jet Ski

Exercise Equipment Systems69. Treadmill System70. Elliptical System71. Multi-Function Exercise

Equipment72. Health Monitoring

Medical Devices73. Intravenous Medical Device74. Blood Pressure Device75. Digital thermometer76. Pacemaker - Remote Monitoring

Personal Electronic Devices77. Tablet Computer78. Smartphone79. Multi-Function Watch80. Health Monitor – Watch81. Hand-Held Calculator

Banking & Financial Systems82. Automatic Teller Machine (ATM)83. Credit Card Systems84. Personal Bank Account System

Professional Conference Systems85. Registration System86. Presentation System87. Exhibit System

Corporate Systems88. Accounting Systems89. Payroll Systems90. Systems Engineering

Organization91. Information Management

Systems92. Manufacturing & Production93. Shipping and Receiving


4


94. Emergency Fire Escape System95. Security Access System96. Distribution System97. Theft Prevention System

Office Devices98. Desktop Computer System99. Multi-Purpose Office Copier100. FAX Machine101. Presentation & Video

Conferencing102. Local Area Network (LAN)

System103. Wide Area Network (LAN)

System

Retail / Discounter Store Systems104. Customer Service System105. Stocking System106. Security System107. Checkout System

Restaurant Systems108. Restaurant System109. Restaurant Seating System110. Restaurant Ordering System111. Restaurant Billing and Payment

System112. Fast Food Drive Through

Facilities Equipment113. Elevator System114. Security System115. Primary and Auxiliary Power

Generator System116. Heating, Ventilation, and Air

Conditioning (HVAC) System

117. Soft Drink Vending Machine118. Automatic Car Wash119. Manual Car Wash120. Fuel Station Gas Pump

Website121. Website architecture122. Authorized Account Access

Farm Equipment123. Tractor124. Hay Mower125. Hay Baler126. Fertilize Spreader127. Harvester128. Wheel Rake

Lawn & Garden Equipment129. Lawn Irrigation System130. Lawnmower131. Zero Turn Lawnmower132. Lawn Edger133. Leaf Blower – Hand-held134. Leaf Blower – Backpack135. Garden Shovel136. Garden Rake137. Garden Hoe138. Pick-Axe

Woodworking Systems139. Table Saw140. Drill Press141. Router System142. Lathe System143. Paint Sprayer System


5



6


Chapter 1Systems, Engineering, and Systems Engineering

Level 2—Knowledge Application Exercises

Definitions of System and Systems Engineering1. Research the definitions for a “System” and “Systems Engineering” provided in the

list below. For each term, compare and contrast these definitions and determine which one best fits your experiences?

a. Author’s definitions (p. 2)b. Former MIL-STD-499B (Draft)c. ISO 15288d. IEEE 1220-1998e. Defense Acquisition University (DAU)f. International Council on Systems Engineering (INCOSE) SE Handbook SEHv4

(2015).2. What is your Enterprise’s command media definition of a "System" and “System

Engineering”? a. Where are the definitions documented? b. Are the definitions universally understood and accepted by all members of the

Enterprise or project?c. On a scale of 1 (Low) to 10 (High), what is the level of understanding you

would assess your Enterprise’s understanding of a “System” and “System Engineering” based on the definition provided in Chapter 1 (p.2)?

3. Do you and your project team have a definition for a "System" and “System Engineering”? If not, ask members to independently develop their definition of what a system is.

a. Summarize the results and present individual viewpoints (without names) to the team.

b. What challenges and paradigms does your Enterprise or project face in defining SE?

c. Why should your project have agreement on what constitutes “The System”?d. What range of opinions did you observe? Did they tend to be individual-based

or discipline-based views?e. What concept or semantic obstacles did the team have to overcome to get to

consensus?f. As a leader in your Enterprise or project, how would you objectively propose

resolving these issues?


7


System Tools4. For the systems, products, or services your Enterprise produces, what support

products and tools (e.g., accessories, instruments, et al) are required to create, maintain, and sustain its operation?

Systems, Product, and Services5. Systems Engineering concepts, principles, and practices apply to Enterprise Systems

and their Engineered systems, products, or services. Explain the statement and provide illustrative examples.

6. Enterprises often create organizations around personalities, not subject matter competency and leadership. Using the “System” definition as a frame of reference, how does this impact Enterprise or project “System” performance and success?

Precedented and Unprecedented Systems7. For the systems, products, or services your Enterprise produces, what support

products and tools (e.g., accessories, instruments, et al) are required to create, maintain, and sustain its operation?

8. Identify three examples of precedented SYSTEMS or PRODUCTS.9. Identify three examples of unprecedented SYSTEMS or PRODUCTS.10. Identify three examples of precedented SYSTEMS OR PRODUCTS that contain

unprecedented SYSTEMS or PRODUCTS.

Systems Thinking1. Identify 2 newsworthy examples of System Thinking in the development of:

a. New systems, products, or services. b. Avoidance of incidents or accidents.

2. Engineers tend to perceive Systems and Systems Engineering and Development (SE&D) in terms of Engineered Systems such as aircraft, automobiles, smart phones, computers, et al. Based on the definition of a “System,” develop a compelling rationale that explains the following statements.

a. “A document or manual is a system.” b. “A Enterprise and each of its organizations are systems.”c. “An informal social network is a system.”d. “A service is a system.”e. “Every entity in the universe is part of a larger system – e.g., a System of

Systems (SoS).”


8


Chapter 2The Evolving State of SE Practice—Challenges and

OpportunitiesLevel 2—Knowledge Application Exercises

Enterprise Engineering and SE Paradigms3. How do Enterprise Engineering and SE paradigms impact project performance? Be

specific.4. What roles do SE standards, processes, and Enterprise capability assessments have

in Enterprise and project performance outcomes?5. Identify the Engineering and SE paradigms you observe in your: (i) Enterprise, (ii)

customers, and (iii) business domain that influence SYSTEM or PRODUCT design. a. For each paradigm, what are the characteristic phrases Stakeholders use that

demonstrate that the paradigm is thriving.b. How have those paradigms impacted project performance and compliance –

technical, cost, schedule, and risk?6. What are the risks, challenges, and outcomes of being part of a Plug & Chug …

Specify-Design-Build-Test-Fix (SDBTF) – Design Process Model (DPM) Paradigm Enterprise or project that decides to apply Lean SE principles?

7. For those with 10+ years of industry experience:a. What percentage of your time do you spend applying cross-discipline courses

such as Engineering Statics and Dynamics, Thermodynamics, Strength of Materials, Engineering Economy, et al. in your undergraduate curriculum?

b. What percentage of your weekly labor hours do you spend in meetings and other activities:

(1) Performing technical problem-solving and solution development? (2) Making system decisions?

c. Did you have an SE course in undergraduate or graduate level Engineering programs?

(1) How would you characterize the SE course in terms of System Acquisition & Management versus System Engineering & Development (SE&D) in preparing you being able to translate a User’s abstract operational needs from a blank piece of paper to the physical realization of a system, product, or service?

(2) What is your perspective as to its preparation for your professional role in industry or government?


9


Chapter 3System Attributes, Properties, and Characteristics


Analytical Representation of a System8. Select a SYSTEM or PRODUCT from the list provided in the Level 2 Exercises

Introduction. Using Figure 3.2 as a reference guide, develop its Analytical System Entity Construct consisting of:

a. Acceptable Inputs?b. Unacceptable Inputs?c. Missions, Mission, and Objectivesd. Resource requirements?e. Controls?

(1) Local ordinances or state and federal regulations?(2) Range of operation before replenishment of power?

f. Physical Constraints?g. Threats?h. Opportunities?i. Acceptable Outputs?j. Unacceptable Outputs?

9. Based on the definitions of a System User and System End User established in Chapter 3, identify the Stakeholder Users and End Users for each of the SYSTEMS or PRODUCTS listed in the table below.

System or Product Users End UsersAircraft

Airport Baggage Handling System

Airline Flight Kiosk Check-In System

Building ElevatorIntravenous Device

Medical Blood Pressure DeviceOffice CopierFAX Machine

Automobile GPS


10


System or Product Users End UsersTelevision Remote Control

TelephoneFire Truck

Conference Registration WebsiteVending Machine

Heating, Ventilation, and Air Conditioning (HVAC) System

10. Select a SYSTEM or PRODUCT from the list provided in the Level 2 Exercises Introduction.

a. Explain its contextual roles as a MISSION SYSTEM and as an ENABLING SYSTEM.b. Provide examples of ENABLING SYSTEMS that support its MISSION SYSTEM role. c. In its ENABLING SYSTEM role, what MISSION SYSTEM(S) does it support?


11


Chapter 4Enterprise Roles, Missions, and System Applications


Problem, Opportunity, & Solution Spaces11. Select an Enterprise or project. Identify the systems, products, or services it produces

or provides for a specific market segment. Then, describe how they addresses marketplace needs in terms of:

a. Problem Space(s)b. Opportunity Space(s)c. Solution Space(s)

12. Select a SYSTEM or PRODUCT listed in the Level 2 Exercises Introduction. From the User's mission perspective, bound and describe the following:

a. Problem Space(s) including a Problem Statement.b. Opportunity Space(s).c. Solution Space(s) including systems, products, or services to address the

overall Problem or Opportunity Space.13. Select a SYSTEM or PRODUCT listed in the Level 2 Exercises Introduction.

a. If the System or Product represents the Solution Space to the User’s operational needs, bound the Problem Space that lead to the Solution.

b. What role does the system, product, or service serve in terms of the User or their Enterprise?

c. What types of User missions does it support?

Mission Statements14. Prepare outcome-based Mission Statements for each of the following:

a. Airline Systemb. Aircraft Systemc. Airline ticket counter agentd. Airline gate agente. Airline flight attendantf. Aircraft flight baggage handlerg. Fast food business drive-through order takerh. Bank Card Automatic Teller Machine (ATM)i. Self-Service Fueling Station.


12


Chapter 5User Mission Analysis, Use Cases, and Scenarios


Mission Analysis1. Select a SYSTEM or PRODUCT listed in the Level 2 Exercises Introduction. Using the

steps of the Mission Definition Methodology, characterize the typical User’s mission.

MOEs, MOSs, KPPs, and MOPs2. Assume you are the User of the SYSTEM or PRODUCT list4ed in the Level 2 Exercises

Introduction and plan to procure it from a System Developer. a. Identify examples of the following you would establish and why:

(1) Measures of Effectiveness (MOEs) and their Technical Performance Measures?

(2) Measures of Suitability (MOS)? (3) Key Performance Parameters (KPPs)

b. Express each one quantitatively?3. Select an example specification and one of its MOEs. Using Figure 5.9 as a reference

guide, construct a similar diagram for three different MOEs based on derived requirements

Use Cases and Scenarios4. Select a SYSTEM or PRODUCT listed in the Level 2 Exercises Introduction. For the

selected SYSTEM or PRODUCT: a. Identify the Actors that interact with it.b. Identify at least 2–3 Use Cases (UCs) for each Actor and depict via a UC

Diagram (UCD).c. For each UC, define its performance-based outcomes, potential scenarios and

likelihood of occurrence, and consequences that must be considered.5. Select one UC from Exercise 5.5.

a. Identify examples of UC scenarios in which an Actor could misuse, misapply, or abuse the SYSTEM or PRODUCT.

b. Why is it important to identify these in the UC? c. What design features or mitigations did the System Developer design into the

product to minimize the effects of misuse, misapplication, or abuse?d. Develop a notional UC Description Document using the attributes identified in

chapter discussions.e. Based on the UC Description, graphically model interactions between a User

(Actor) and the SYSTEM or PRODUCT using a Sequence Diagram.


13


6. Identify Use Cases (UCs) and their Scenarios for the following SYSTEMS or PRODUCTS:a. Pencilb. Tablet Computerc. Compact Disk (CD) Playerd. Digital Video Disk (DVD) Playere. Microwave Ovenf. Coffee Makerg. Smart Phoneh. Automobilei. Aircraft passenger seat areaj. Aircraft attendantsk. Aircraft pilot.

Sequence Diagrams7. Select a specific brand of coffeemaker.

a. Identify its Users and End users.b. Create a Use Case Diagram (UCD).c. Using Table 5.1 as a reference, develop the sequence of interactions between

the User(s) and the coffeemaker.(1) Develop a Sequence Diagrams representing these sequences complete

with Sequence # and title annotations using Figure 5.10 as a reference.


14


Chapter 6System Concepts Formulation and Development


System Concept Formulation and Development1. What is the value of System Concept Formulation and Development and why is it

important to:a. A project?b. Stakeholder Users and End Users?

ConOps Document2. When you develop and write a ConOps, what is the most important point to

remember concerning the role it performs in a project?3. Within your Enterprise and project, what is the standard Engineering practice

concerning the following:a. Who are the Users of the ConOps?b. Who is accountable for developing the ConOps?c. Who is accountable for maintaining the ConOps?d. How long should a ConOps be maintained during the development of a

system?e. What does a ConOps communicate and to what depth?f. How many different system concepts should be documented as Operational

Concept Descriptions (OCDs) in a ConOps? g. Define “Fitness for Use” criteria for each type of concept documented in a

ConOps.4. If a ConOps considered to be a system? Explain why and provide compelling

rationale.5. Locate a ConOps for an existing SYSTEM or PRODUCT.

a. What operational concepts are addressed in the ConOps?b. Are there missing concepts?c. Based on the information provided in the ConOps, does it provide information

that is necessary and sufficient to initiate the design of a SYSTEM or PRODUCT?d. Is the System Performance Specification (SPS) for the SYSTEM or PRODUCT

addressed by the ConOps accessible?e. How well does the ConOps comply with the SPS requirements?


15


System Operations Model6. Select one of the SYSTEMS or PRODUCTS listed in the Level 2 Exercises Introduction.

a. Using the System Operations Model in Figure 6.2 as a reference, which operations apply to the selected SYSTEM or PRODUCT?

b. Does the SYSTEM or PRODUCT have operations that are not identified in the model? If so, how would you correct the deficiency graphically?

c. Using the System Operations Model as the initial starting point, tailor the model to the SYSTEM or PRODUCT and its application.

User StoriesRefer to Chapter 15 Level 2 Exercises.

Use Cases and Scenarios7. For the SYSTEM or PRODUCT in Exercise 6.6, develop a table consisting of the following

attributes:a. Column 1—List each of the System Operations Model’s (Figure 6.2) mission

cycle operations bubble identifiers. b. Column 2—List each operation’s title. c. Column 3—Identify UCs by title for each operation – i.e., box in Figure 6.2.

8. Referring to Exercise 6.6, pick one of the more challenging UCs. Using the UC Description attributes on pp. 119 – 125, develop the description for the UC.

9. Referring to Exercise 6.8, what corrective or mitigating actions (Figure 34.17) did the SYSTEM or PRODUCT developer take to eliminate or minimize the negative outcomes and consequences of one of the scenarios.

a. In the design implementation?b. In the Operator’s Manual?


16


Chapter 7System Command & Control - Phases, Modes, and States


Purpose of System Phases, Modes, and States of Operation1. Engineers, in general, perceive System Phases, Modes, and States of Operation as an

academic exercise to satisfy a required contract deliverable and are typically uninformed, by virtue of Engineering education, why they exist. Explain the statement “System Phases, Modes, and States of Operation are mechanisms that enable the conceptualization of how a User will be able to Command & Control (C2) the architectural implementation a system, product, or service.

System, Operational, Configuration, and Dynamic States2. Select one of the following types of systems listed below. Describe its System (pp.

154 – 156), Operational, Physical, and Dynamic States of operation and provide illustrative examples.

a. Automobileb. Desktop Computer Systemc. Smartphoned. Home Heating, Ventilation, and Air Conditioning (HVAC) Systeme. Lawn Mowerf. Office Copier

3. Using Table 7.12 as a reference guide, develop a similar table for one of the SYSTEMS OR PRODUCTS in the list above:

Configuration States4. If an automobile is in DRIVE, characterize its potential Operational and Physical

Configuration States based on its UCs?

Dynamic or Transitory States5. Select one of the SYSTEMS or PRODUCTS listed in the Level 2 Exercises Introduction.

a. Provide 3 examples of Dynamic or Transitory States?b. Define the Phase Mode Configuration State Dynamic State linkages. c. Provide written examples with descriptions of the dynamic conditions.d. What design mitigating actions (Figure 34.17) or operator compensating

actions would be required to avoid any instabilities in the SYSTEM or PRODUCT during the transitions?


17


Phases and Modes of Operation and Use Cases6. Select one of the SYSTEMS or PRODUCTS listed in the Level 2 Exercises Introduction.

a. Identify Use Cases (UCs) for the SYSTEM or PRODUCT WITH IDS – e.g. UC#1, UC#2, etc.

b. Identify the SYSTEM or PRODUCT’S Life Cycle Phases – e.g., Deployment; Operations – Pre-Mission, Mission, and Post-Mission; Maintenance; and Sustainment Phases.

c. Using Table 7.2 as a reference guide, allocate (align) the UCs to the Phases of Operation.

Mode-Based UCs7. Referring to Exercise 7.6, analyze the UCs assigned to each Phase and abstract them

into Modes of Operation. For each Mode, define its:a. Objectiveb. UCs and UC outcomes

8. Using Figure 7.7 as a guide, develop a Modes of Operation diagram including:a. The objective and outcome for each Mode.b. Annotations for the UC IDs that have been allocated to the Mode of Operation.

9. Create a table similar to Table 7.1 that depicts modal transitions including triggering conditions.

10. Using the same SYSTEM or PRODUCT in Exercise 7.6, create a new Phases and Modes diagram using Figure 7.8 as a reference guide.

a. Compare the Phases and Modes diagrams in Exercises 7.7 and 7.8.c. What differences do you observe?

(1) Which approach – abstracted UCs (Exercise 7.6) or Template (Figure 7.8) works best for this SYSTEM or PRODUCT? Elaborate your findings and supporting rationale.

(2) What graphical update would be required to reconcile the template in Figure 7.8 to meet specific needs?

11. If an automobile is configured in PARK, NEUTRAL, DRIVE, REVERSE, or LOW, is it in a mode or a state?

12. Assume an automobile has two power gears, LOW1 and LOW2. Are those modes, submodes, or states? Provide compelling rationale for your answer.

13. Using the same SYSTEM or PRODUCT in Exercise 7.6, identify the Allowable and Prohibited Actions that would be imposed on the SYSTEM or PRODUCT for each of its Modes and associated UCs.


18


Modes & States Constraints – Allowable and Prohibited Actions14. Select one of the SYSTEMS or PRODUCTS from the Level 2 Exercises Introduction.

j. Identify its modes of operation.k. Select one of the modes of operation and identify its

(1) Allowable Actions(2) Prohibited Actions

15. Select a desktop or computer office application such as a word processor, graphics, or spreadsheet.

a. Identify its various modes of operation.b. For each Mode of Operation, identify its Allowable and Prohibited Actions such

as drop down menus that “gray out” specific capabilities. For example, a graphics application requires selection of an object as a pre-condition for an Edit Object Use Case (UC).


19


Chapter 8System Levels of Abstraction, Semantics, and Elements


System Levels of Abstraction1. Select one of the SYSTEMS or PRODUCTS listed in the Level 2 Exercises Introduction.

a. Equate the SYSTEM Levels of Abstraction shown in Figure 8.7 to its multi-level Product Structure.

b. Using Figure 8.11 as a reference, develop an Entity Relationships Diagram (ERD) that identifies:

(3) Internal physical Entity Relationships (ERs) within each Level of Abstraction

(4) External inputs and outputs.c. Link the contents in the SYSTEM or PRODUCT’S packaging or shipping container

to the System Elements categories. If unknown, create your own view of the Product Structure.

d. Prepare a brief, summary paper entitled "An Architectural Description (AD) of the ________ System" that incorporates the information above.

System Elements and Their Interactions2. Select one of the SYSTEMS or PRODUCTS listed in the Level 2 Exercises Introduction.

Using the System Element interactions matrix shown in Figure 8.10, develop an N2 Diagram (Figure 8.11) depicting the relationships.

Architectural Product Structures3. You have been hired as a consultant for a new project developing the following types

of SYSTEMS or PRODUCTS. Analytically, what hierarchical Product Structure would you recommend for the following?

a. Automobileb. Desktop computerc. Homed. Office Building.e. Sports Stadiumf. Commercial Aircraft


20


Organizational Breakdown Structures (OBS) and Product Work Breakdown Structure (PWBS) Accountability

4. Assume that a project is developing an automobile composed of SUBSYSTEMS, ASSEMBLIES, SUBASSEMBLIES, AND PARTS Levels of Abstraction. Within the SYSTEM is a central processor that provides supervisory control over a distributed system of Command and Control (C2) processors located at specific Input/Output (I/O) devices such as the Braking System. Assume the project has only one electronics design team that must design all the distributed processors. Using Figure 8.7 as a reference, create:

a. A diagram that represents the analytical decomposition of the SYSTEM into SUBSYSTEMS—e.g., Braking—and ASSEMBLIES—e.g., I/O C2 capability.

b. A diagram that illustrates the physical integration—composition—of the I/O C2 processors into the SYSTEM’S Product Structure.

c. Write a brief description concerning:(1) How the Braking SUBSYSTEM I/O C2 processors will be developed

(subcontracted) by the Central Processor SUBSYSTEM Product Development Team (PDT) and integrated into the Braking SUBSYSTEM by its PDT.

(2) Provide details concerning how the accountability for the analysis and integration will be accomplished.

5. A common problem in many projects it that the Project’s Work Breakdown Structure (PWBS) used to estimate and accumulate labor and material costs is often based on a functional decomposition rather than the multi-level physical System Architecture Product Structure—Product Work Breakdown Structure (PWBS).

a. How would you propose reconciling and correcting this disconnect between Project Management and Systems Engineering (SE) using the System Architecture as the focal point solution?

b. Prepare a brief presentation that includes the following:(1) A Problem Statement that describes this issue.(2) Impacts to the project labor accounting and Engineering tasks.(3) Proposed corrective actions to reconcile WBS-Product Structure issue.(4) Develop a draft procedure based on your proposed corrective action

for review.

Performing Entities1. Principle 8.2 states that Enterprise and Engineered Systems, as performing entities,

may or may not consist of some System Elements.a. Explain why this is true.b. Explain the relevance of the System Elements at each Level of Abstraction.

2. Figure 8.14 represents various levels of abstraction of performing entities. For each of the systems listed below, identify their performing entities.

a. Airline System


21


b. Automobilec. Automobile gasoline station

3. Figure 24.14 illustrates how abstract performing entities such as a SUBSYSTEM, which originate as abstract objects without regard to implementation, are ultimately analyzed and determined to be composed of PERSONNEL, EQUIPMENT, or integrated PERSONNEL-EQUIPMENT entities based on their respective capabilities and limitations (McCormick and Sanders, p. 509, 1964, 1982, or later editions). From these PERSONNEL, EQUIPMENT, or integrated PERSONNEL-EQUIPMENT entities interaction decisions, EQUIPMENT specifications are written and/or PERSONNEL are trained to operate the EQUIPMENT using PROCEDURAL DATA operator’s manuals.

a. Identify three different types of systems that would follow this analytical decision making path at various levels of abstraction during development.

b. Provide specific examples.4. Figure 8.15, which depicts a Race Car System Pit Crew in action. Explain the various

contexts of the statement “The Race Car System is composed of systems, products, and services.”

5. If Figure 8.15 represents a Race Car System Pit Crew System:a. Characterize the System in terms of MISSION SYSTEMS and ENABLING SYSTEMS

performing entities using Figure 9.2 as a reference guide.b. Develop its System Element Architecture (SEA), interfaces between the

System Elements, and describe their interactions using Sequence Diagramsc. Develop an Organizational Breakdown Structure (OBS) for the Pit Crew.d. Develop the Race Car System Product Breakdown Structure (PBS).

References McCormick, Ernest J. (1964), Human Factors Engineering, 2nd Edition, New York: McGraw-Hill Company. McCormick, Ernest J. and Sanders, Mark S. (1982), Human Factors in Engineering Design, 5th Edition, New York:

McGraw-Hill Company.


22


Chapter 9Architectural Frameworks of the SOI

& Its Operating EnvironmentLevel 2—Knowledge Application Exercises

Higher Order Systems and Physical Environment Domains1. Select a SYSTEM, product, or service. Identify the following:

A. HIGHER ORDER SYSTEMS Domain and its System Elements.b. Physical Environment Domain, its System Elements, and levels of abstraction.c. Types of interfaces.d. Specific interfaces and objectives.e. Concepts for how a specific interface may evolve over time to resolve Critical

Operational and Technical Issues (COIs/CTIs) such as safety.

USER OPERATING ENVIRONMENT Architecture2. Select one of the SYSTEMS or PRODUCTS listed in the Level 2 Exercises Introduction.

Graphically illustrate and characterize the architecture of its OPERATING ENVIRONMENT in terms of its Levels of Abstraction.

3. Using Figure 10.11 as a reference, illustrate a User’s perspective of their OPERATING ENVIRONMENT for a retail business with various consumer departments such as an automobile dealership, department store, et al. How would you analyze the dynamics of the OPERATING ENVIRONMENT in terms of its customer flow for determining staffing needs by:

a. Day of the Week (DOW)?b. Time of Day (TOD)?

4. Using Figure 9.4 as a reference, describe the OPERATING ENVIRONMENT conditions – Levels of Abstraction and System Elements - for a commercial passenger aircraft during all phases of flight (Figure 5.5).

5. Using Figure 9.5 as a reference, develop OPERATING ENVIRONMENT requirements one or more of the following:

a. Mission to Marsb. Commercial passenger aircraftc. Intravenous medical deviced. Cell phone


23


Chapter 10Modeling Mission and Enabling System Operations &

BehaviorLevel 2—Knowledge Application Exercises

System Command & Control Constructs15. Select a SYSTEM or PRODUCT identified in the Level 2 Exercises Introduction.

a. If applicable, identify whether the System operates in a closed loop or an open loop context. Provide supporting rationale.

b. If by a closed loop, how does the system process stimuli, excitations, and cues and provide measured behavioral responses.

16. Using the various System Command & Control (C2) Constructs in Figures 10.2 – 10.7, identify different systems that represent implementation of the construct.

Modeling System Operations17. NASA's Space Shuttle employed a launch configuration that integrated the Orbiter

Vehicle (OV), Solid Rocket Boosters (SRBs), and External Tank (ET) into a “Stack.” During the launch the SRBs are jettisoned. Later the ET is jettisoned and the Orbiter Vehicle continues in flight. If you were to model the system from the SRB or ET perspective, how would you model the time-based control flow operations?

18. Develop a multi-phase operations model (Figure 6.2) that includes control flow and data flow operations for one of the systems listed below. What embedded cyclical operations occur in each of the systems?

a. Automobile dealership and customers.b. Retail business such as a movie theatre, fast food restaurant, or baseball

stadium.c. Commercial aircraft flight.

19. Assume your project is developing an office copier for the marketplace. How would you model the office PERSONNEL and EQUIPMENT interactions and tasks for:

a. Printing up to “n” copies?b. Collating and stapling each copy?c. Prompting the Operator to manually insert a special, single sheet of paper and

proceeding with the copying?d. Prompting the Operator that the copier is:

(1) Out of paper and resume operation?(2) Need to remove a jamb and resume operation?


24


20. You recognize and appreciate the importance and value of modeling system behavioral performance using Model-Based Systems Engineering (MBSE) analytical methods. How would you approach the task if you had:

a. No staffing resources but had a modeling tool available?b. Some staffing resources but no modeling tool?c. How would you approach the task in terms of Levels of Abstraction?

21. Select one of the SYSTEMS or PRODUCTS listed in the Level 2 Exercises Introduction. Model one of the PERSONNEL—EQUIPMENT Use Case (UC) interactions including one Scenario of the UC.

22. The User interface for a passenger on a commercial aircraft includes the following features (Use Case capabilities): seat belts, reclining seats, reading light, air vent flow direction and control, flight attendant call button, safety indicators. Viewing each feature as a UC, model the Passenger (PERSONNEL)—Aircraft (EQUIPMENT) interactions for each of the Use Cases. Observe that visual call button indicators are typically controlled by the Stewardesses and Stewards—as Users—for immediate action by the Passengers—End Users.

23. Your automobile has a flat tire (UC Scenario). As a MISSION SYSTEM – performing entity, you exit the vehicle with a mission to change the tire using the automobile’s jack as an ENABLING SYSTEM – performing entity.

a. Model the end-to-end – i.e., Pre-Mission, Mission, and Post-Mission PERSONNEL-EQUIPMENT interactions required to change the tire.

b. Model the respective Driver-Car Jack Modes and States of operation including Allowable and Prohibited Actions.

c. How would these activities be documented in the PROCEDURAL DATA Element – User’s Manual - of the automobile?

24. Cyclical systems typically consist of multiple loops of Operations, Maintenance, and Sustainment activities. Model the operational loops for one of the following SYSTEMS or PRODUCTS:

a. Automobileb. Home Irrigation Systemc. Home Security Systemd. Aircraft Systeme. Desktop Computer System


25


Chapter 11Analytical Problem-Solving and Solution Development

SynthesisLevel 2—Knowledge Application Exercises

Four Domain Solutions Methodology25. Define how the Four Domain Solutions methodology avoid the pitfalls of the:

a. Plug & Chug … Specify-Design-Build-Test-Fix (SDBTF) Design Process Model (DPM) Paradigm reflected in the quantum leap from Requirements to Physical Solution depicted in Figure 2.3.

b. SE Process—Requirements Analysis Functional Analysis Synthesis—used by many Enterprises and projects.

Multi-Level System Design Strategy26. Assume you are the Lead Systems Engineer (LSE) for a project that will include two

Subsystems—SUBSYSTEM #1 and SUBSYSTEM #2—that include both HARDWARE and SOFTWARE. Write a brief description for a section within a Systems Engineering Management Plan (SEMP) that describes the multi-level strategy for implementing Figure 11.2.

27. Figure 11.3 illustrates the relationship between Archer’s Design Process Model (DPM) and the Four Domain Solutions. Select one of the SYSTEMS or PRODUCTS in the Level 2 Exercises.

a. Using the Four Domain Solutions process flow shown at the top of Figure 11.3, describe how Archer’s DPM relates to the development of each of the solutions.

b. Explain how the Four Domain Solutions overcome the fallacies (Figure 2.3) of the Plug & Chug … Specify-Design-Build-Test-Fix (SDBTF) Engineering Paradigm corrects problem-solving and solution-development in Enterprises that erroneously perceive the DPM as the Systems Engineering Process methodology.


26


Chapter 12System Development Workflow Strategies


System Development Workflow Strategy Practices28. Based on your project experiences:

a. Graphically depict the System Development Strategy used. b. Compare and contrast the strategy with the “V” Model shown in Figure 15.2.

29. Have you implemented a Quality Function Deployment (QFD) Approach in previous projects?

a. What were your experiences pro and con?b. What value did QFD provide to the project?c. What types of projects would you recommend using QFD?d. How would you employ QFD methods to derive and prioritize requirements for

your project and identify potential conflicts between requirements that require trade-offs?

30. Analyze a Systems Engineering Management Plan (SEMP) for a project. a. Using Figure 12.2 as a general guide, is a System Development Workflow

Strategy explicitly communicated? What is missing?b. Is the strategy provided as a graphical overview such as Figure 12.2 or other

type of graphic?c. Based on what is communicated in the SEMP, if you were a System Acquirer

evaluating the SEMP as part of a System Developer proposal, on a scale of 1 (low) to 10 (high), what grade you assign the SEMP as a level of confidence the System Developer knew what they were doing?

d. What other strategy-based deficiencies did you find in the SEMP?e. Would you hire or contract with the System Developer based on the SEMP?


27


Chapter 13System Verification and Validation (V&V) Strategies


Verification & Validation (V&V)1. Select a SYSTEM or PRODUCT identified in the Level 2 Exercises Introduction.

a. Describe how you would implement the V&V process shown in Figure 13.6 for each of the workflow processes.

b. Identify what documentation work products—specifications, drawings, etc.—you would create and how they would be used as the basis for V&V activities.

c. Write a mini-plan that describes DT&E activities such as prototyping, technology demonstrations, etc. you would conduct—subject to resource limitations—to reduce technical risk and how those activities support specific project technical decisions.

System Verification & Validation (V&V) Planning2. Write a brief 2-page technical plan that describes the following will be performed for

your project. a. Developmental Test & Evaluation (DT&E) b. Operational Test & Evaluation (OT&E)

Elimination of Latent Defects3. You have been assigned as Project Engineer for a new System Development Project

and establish an initiative to eliminate latent defects prior to delivery. Describe the V&V Process to be implemented during the System Design Process to avoid the pitfalls of the Error Avalanche shown in Figure 13.1. Create a table consisting of:

f. Column 1—List 5 examples (rows) of specific types of latent defects that entered the System Design Solution.

g. For each latent defect example (row):(1) Column 2—Identify how and where the defect entered the System

Development (Figure 13.6).(2) Column 3—Identify when the defect was discovered (Figure 13.6).(3) Column 4—Identify how the defect was corrected.(4) Column 5—What corrective measures the project instituted to prevent

the defect’s reoccurrence.(5) Column 6—What corrective measures the Enterprise instituted to

prevent the defect’s reoccurrence.


28


4. Research and identify 3 real-world instances of latent defects that contributed to a failure that lead to an incident or accident. Write a brief description of each concerning how the defect contributed to the incident or accident.

5. Review observations made by Shull, et al. (2006, p. 3) concerning latent defects and their cost impact.

a. Develop an ideal, multi-faceted System Development Strategy (Part A) of preventive measures to address and implement the lessons learned in the paper. Write a brief description—up to two pages—that describes the overall strategy, objectives, and preventive measures by System Development Process (Figure 13.6).

b. Assume the resources available to address these issues are unknown—zero to ideal. You cannot afford to wait until the resources are known to develop the implementation strategy. You decide to prioritize the preventive measures in each System Development Process (Figure 13.6) to achieve the greatest Return on Investment (ROI). As the second part of the strategy above, prepare a 1—2 page tabular prioritization of the preventive measures and provide rationale for the your selection.

6. Hardware and software peer reviews do not always discover and capture latent defects for at least three primary reasons:

a. Focus on grammar.b. Reluctance to critique someone’s design, analyzes, or other work.c. No time to prepare for a substantive review.

Reference: Shull, Forrest; Basili, Vic; Boehm, Barry; Brown, A. Winsor; Costa, Patricia; Mikael;

Lindvall, Dan Port; Rus, Ioana; Tesoriero , Roseanne; and Zelkowitz , Marvin (2003), What We Have Learned About Fighting Defects NSF Center for Empirically Based Software Engineering CeBASE). Retrieved on 4/9/14 from http://www.cs.umd.edu/%7Emvz/pub/eworkshop02.pdf.


29


Chapter 14The Wasson System Engineering Process


SE Process Model31. Your project team needs a problem-solving and solution development methodology

based SE Process. As the Lead Systems Engineer (LSE), you recommend and the team selects the Wasson SE Process Model. In response to a contract requirement, write a section to be included in an SE Management Plan (SEMP) that will communicate how the SE Process (Figure 14.1) will be applied to System Development as a problem-solving and solution-development methodology. Articulate how the Wasson SE Process Model and each of the following steps will be applied to your project.

a. The System or Entity’s Problem/Opportunity Space and Solution Space(s).b. The Requirements Domain Solution.c. The Operations Domain Solution.d. The Behavioral Domain Solution.e. The Physical Domain Solution.f. Evaluate and Optimize the Four Domain Solutions.g. Decision Support.

32. Graphically model the SE Process used by your Enterprise and project. Compare and contrast it with the Wasson SE Process Model shown in Figure 14.1.

33. Some Enterprises view the SE Process as a method performed only once at the SYSTEM Level based on its title – “System” Engineering Process - versus every Level of Abstraction—SUBSYSTEM, ASSEMBLY, SUBASSEMBLY—and ENTITY within each level.

a. Describe your professional experiences and observations?b. Where the Enterprise or project believes the SE Process is only performed at

the SYSTEM Level:c. What effects have you seen in the System Design Solution and project

performance as a result of the paradigm?d. How would you propose shifting the paradigm?

34. Regarding Exercise 14.3, assume executive management has tasked you to develop a point paper contrasting the pitfalls in performing the SE Process only at the SYSTEM Level versus every Level of Abstraction—SUBSYSTEM, ASSEMBLY, SUBASSEMBLY and ENTITIES within each level. Respond to the request and include technical, cost, schedule, and risk impacts.

SE Processes Evolution35. Chronologically analyze and characterize how the SE Process has evolved since World

War II in terms of its methodology and content.


30


a. What changes do you observe in the SE process evolution that may indicate corrective actions or paradigm shifts in thinking that lead to new SE processes? For example, AFSCM-375, FM-770-78, MIL-STD-499 MIL-STD-499B (DRAFT). Then, the formulation of IEEE 1220–1998, et al.

b. If each SE Process chronologically was a Solution Space, identify the Problem Space that it was intended to solve?

c. How would you characterize - with supporting rationale - each succeeding SE Process in terms of correcting:

(1) What was then a “current” Engineering paradigm? (2) A Problem Space that had always existed but was unrecognized or

ignored in the previous SE Process?(3) Simply an evolution of human thought processes?


31


Chapter 15System Development Process ModelsLevel 2—Knowledge Application Exercises

System Development Models36. Select a SYSTEM or PRODUCT identified in the Level 2 Exercises Introduction.

a. What type of System Development Model would you recommend for the:(1) SYSTEM Level.(2) SUBSYSTEM Level. (3) SUBSYSTEM Level Hardware.(4) SUBSYSTEM Level Software.

b. For each of the other System Development Models not selected, provide supporting rationale on their degree of relevance and why they should not be used.

37. Identify three systems, products, services, or product upgrades that may be ideal candidates for the:

a. Spiral Development Model strategy.b. “V” Development Model strategy.c. Incremental Development Model.

38. As a functional SE Manager, engineers in your department are vaguely familiar with the various System Development Models due to a lack of SE courses in Engineering education. Project managers and executives are unfamiliar as well. As an initiative to improve your organization’s SE capabilities, write a 1 page description about each of the following models and its application to the System Development Process that will enable Engineers, PMs, and executives to understand the models, their differences, and applications.

a. Waterfall Approachb. “V” Model Approachc. Evolutionary Approachd. Incremental Approache. Spiral Approachf. Agile Development Approach


32


Agile Development39. Agile software developers tend to prefer either User Stories or Use Cases; others

prefer both. Research the web for rationale that support both sets of preferences. a. From an SE perspective what is the stronger case: User Stories, Use Cases, or

both—User Stories Use Cases?b. Based on what you have learned in this chapter, what is your position or

experience on User Stories, Use Cases, or both. Provide supporting rationale.40. As a Lead SE, an Agile Development methodology may be appropriate for specific

aspects of your project using the model shown Figure 15.11. Agile software developers protest that they either employ User Stories or Use Cases as a personal preference.

a. Based on what you have learned in this chapter, how would you deal with this challenge?

b. Provide compelling rationale that would convince Agile software developers to use the model.

41. Agile software development User Stories originate from external Customers. However, “User Stories originating from within the System Developer’s project influence multiple levels of a specification requirements being flowed down to lower levels (Figure 15.12).” Provide a rational explanation for this statement by illustrating what you have learned from previous chapters.

42. During a recent project review, one of the System Acquirer personnel asks what System Development Model is being used on the project.

a. How should you respond to the question? b. Write a brief description of your response and present it to class members for

review and comment.


33


Chapter 16System Configuration Identification and Component Selection StrategyLevel 2—Knowledge Application Exercises

Selection of Configuration Items (CIs)43. Select a SYSTEM or PRODUCT identified in the Level 2 Exercises Introduction. Assume

your Enterprise has some limited hardware and software development capability as well as a small machine shop. Based on an analysis of the multi-level system architecture, which items would you:

a. Designate as Configuration Items for development in-house?b. Procure as COTS or NDIs?

44. Contact a medium to large contract development project within an Enterprise. Interview the Project Engineer, Lead Systems Engineer (LSE), and Configuration Manager.

a. How were CIs selected for the project and by whom?b. What were the CI selection criteria?c. Was the CI selection process defined in Enterprise command media?d. What were the lessons learned – pros and cons - from the exercise?

Contract Protocol45. Assume you are a project engineer. By contract, the project is required to identify its

Configuration Items (CIs). So, you create a list and send it directly to the System Acquirer.

a. Was this action appropriate or inappropriate? b. Describe your rationale.

46. Your project and the User have decided to employ Integrated Process Teams (IPTs) with representation from both Enterprises to ensure better “system integration” of the organizations. During one of the IPT meetings, one of the User personnel suggested that you should paint a box “green” that is specified to be “orange” in the System Performance Specification (SPS).

a. Was this action appropriate or inappropriate?b. If not, why?

Configuration Items, HWCIs, CSCIs, and Firmware47. Research the Internet sites for instances of how Enterprises specify and control CIs,

HWCIs, CSCIs, COTS, NDIs, and firmware.48. Contact a System Developer project.

a. Does the project have a SYSTEM or PRODUCT decomposition that identifies each


34


item as AFP, COTS, NDI, Modified COTS/NDI, or CIs?b. If not, what is the project’s rationale?

49. Assume you work for a commercial Enterprise that has a standard product line of SYSTEMS and PRODUCTS that have evolved over time. Each has a multi-level System Architecture with associated specifications that evolve through various revisions. Each new SYSTEM or PRODUCT has its own System Performance Specification (SPS) but may leverage reuse of SUBSYSTEMS, ASSEMBLIES, SUBASSEMBLIES from legacy SYSTEMS or PRODUCTS —previous projects. Each new SYSTEM or PRODUCT typically modifies the Subsystem, Assembly, or Subassembly to some degree—for example, NDI of in-house legacy design.

To facilitate a Enterprise-wide Engineering policy decision, executive management has tasked you write a brief, one–two page talking points paper that highlights the virtues—advantages and disadvantages of:

a. Maintaining each SUBSYSTEM, ASSEMBLY, or PART Level specification as a single document with effectivity assigned to specific requirements or

b. Creating a new SUBSYSTEM, ASSEMBLY, or SUBASSEMBLY specification unique to the SYSTEM or PRODUCT. Prepare and present the point paper.

50. Traditionally, one Software Requirements Specification (SRS) documented one CSCI. Today, some organizations are documenting multiple CSCIs in one SRS.

a. Develop a position paper highlighting the pros and cons of both approaches.b. Recommend a solution and provide compelling rationale.

COTs and NDI Products51. Contact a System Developer that acquires COTS and NDI products or modifies COTs

in its SYSTEM or PRODUCT designs. a. Identify COTS issues and lessons learned the System Developer has

encountered in dealing with COTS/NDI vendors?b. What NDI issues and lessons learned has the System Developer encountered?c. What issues has the System Developer encountered in modifying COTS or NDI

in-house?d. Prepare a summary report of your findings and the System Developer’s

lessons learned.52. Contact a COTS/NDI vendor that designs, manufactures, sells, and modifies SYSTEMS

or PRODUCTS to/for the marketplace. a. Identify COTS issues and lessons learned the COTS/NDI vendor has

encountered in dealing with System Developers?b. What NDI issues and lessons learned has the COTS/NDI vendor encountered?c. What issues has the COTS/NDI vendor encountered concerning System

Developer in-house modification of COTS or NDI?d. Prepare a summary report of your findings and the COTS/NDI vendor’s lessons

learned.


35



36


Chapter 17System Documentation Strategy


Contract Data Requirements List (CDRL)53. Select a SYSTEM or PRODUCT identified in the Level 2 Exercises Introduction. If you were

the Acquirer of the System, a. Identify the types of Contract Data Requirements List (CDRL) documents you

would require for the system design and development effort and rationale for selection.

b. What documents would you need to maintain the SYSTEM or PRODUCT after delivery?

Decision Artifacts54. Assume your System is comprised two (2) SUBSYSTEMS, each with one (1) HWCI and

one (1) CSCI. You have been tasked to propose SE documentation for the various Levels of Abstraction based on the format listed below. Fill in the appropriate documentation.

a. Column 1—SYSTEM Level or SUBSYSTEM Level.b. Column 2—Within each SYSTEM Level or SUBSYSTEM Level, identify SE design

and development documentation would you require for the SYSTEM Level and Subsystems.

c. Column 3—User’s—readers.d. Column 4—Rationale for each document based on User—reader needs.

55. Assume you are building a new home. During the construction of most homes, electrical subcontractors simply install wiring, switches, wall outlets, and lighting in compliance with the local electrical code—standard—and leave no documentation. In general, wiring is strung ad hoc in all directions making it difficult to determine all the electrical devices—switches, outlets, et al.—on given circuit. Typically, the power breaker box may have a listing of general circuits inside its door with no details as to the number of loads on a circuit.

a. What would be the minimum documentation requirements you would levy on electrical documentation sketches—may be handwritten—to be delivered on completion of the project?

b. Assume you perform verification on the completed electrical system. What documentation would you require the contractor as objective evidence to provide to check-off each circuit?


37


Documentation Formality56. For each of the types of SE documentation listed below, identify the levels of

formality – how documented, reviews, approvals, etc. - that you could implement to preserve the integrity of the SE technical decision making process while minimizing the cost to develop.

a. Use Case (UC) documentb. Specificationsc. Designsd. Trade Studiese. Analysesf. Test Cases (TCs) Documentg. Test Procedures

57. Referring to Exercise 17.4:a. Does Enterprise command media provide standard outlines for developing the

documents?b. If so:

(1) What tailoring guidelines are provided?(2) Since standard outlines represent lessons learned, what constraints are

placed on tailoring the outlines to ensure a topic is not inadvertently deleted from an outline that may be relevant at a later date.

Personal Engineering Data Records58. Does the Enterprise or project have command media that specifies what Engineering

Data are to be recorded and maintained?59. Are Engineers, System Analysts, et al required to maintain personal Engineering

records – e.g., Quality Records - of meeting notes, decisions, analyses, test results, et al?

60. What media are required for those records?a. Engineering Notebooks?b. On-Line Project Network Drive?c. How are those records archived for future decision-making reference?

61. If a project employs an on-line network drive for Engineering Data records:a. Does the Enterprise or project have command media that addresses how the

drive will be:(1) Structured?(2) Partitioned into personal and team workspaces?

b. Who determines read/write access to the files on the project network drive?


38


Chapter 18Technical Reviews Strategy


Enterprise Technical Review Command Media62. Research an Enterprise’s and project’s command media and plans.

a. What requirements and guidance is established for conducting formal technical reviews?

b. What guidance is provided concerning In-Process Reviews (IPRs)?c. What requirements are levied for documenting the review conference minutes

and action items?d. What requirements are levied for disciplinary participants in the reviews?e. Why is it important to establish Entry and Exit Criteria for project technical

before the contract is signed?

Enterprise Project Level Technical Review Practices63. Contact several small to large contract projects in an Enterprise.

a. What type of contract—Firm-Fixed Price (FFP) or Cost Plus Incentive Fee (CPIF)—does the project have?

b. Based on contract type, what degree of approvals or concurrence does the Acquirer have oversight of technical review decisions and baselines?

c. What technical review requirements are imposed by the contract?d. How do the reviews differ from those specified in this section?e. Where were the technical review requirements specified?f. How are results of the reviews to be documented?g. What entry and exit criteria have been established as for the reviews?h. Are PDRs, CDRs, and TRRs at the PRODUCT, SUBSYSTEM, and other levels

sequenced relative to the SYSTEM Level PDRs, CDRs, and TRRs such as Figure 18.1? If not, create the Enterprise’s version of Figure 18.1.

64. One of the challenges of project reviews is a human condition in which reviews are scheduled 2 – 3 days prior to a major technical review. As a result, schedule conflicts emerge due to the same people being required to attend multiple reviews simultaneously or have inadequate time to prepare.

a. Interview the Project Manager (PM), Project Engineer, and Lead SE on the project.

b. How does Enterprise or project command media deal with this topic?65. As a result of the condition addressed in Exercise 18.3, plans, specifications, designs,

testing, et al technical reviews often turn into grammar and punctuation checking exercises. As a result, they fail to objectively assess and challenge the contents, strategy, rationale, etc. This situation is typically driven by a lack of time to prepare


39


for the review, lack of having the right Subject Matter Experts (SMEs), or competency to perform the review.

a. Interview the Project Manager (PM), Project Engineer, and Lead SE on the project.

b. How does Enterprise or project command media deal with this topic?66. Does the Enterprise or project command media specify:

a. Specify accountability for who reviews, concurs, and approves project decision artifacts such as plans, specification, analyses, trade studies, designs, et al. project documents?

b. How corrective actions will be documented, tracked, and verified?

Types of Technical Reviews67. Aerospace & Defense (A&D)—government—contract reviews typically include an IBR,

SRR, SDR, HSR, SSR, PDR, CDR, TRRs, SVR, et al. reviews. Commercial, private industry Enterprises typically use a Stage-Gate Process. Research the various types of commercial system/product development reviews.

a. Create a table that compares the various A&D reviews to Stage Gate reviews.b. Compare and contrast the approaches and document the advantages and

disadvantages of each?68. Select a commercial Enterprise that develops custom SYSTEMS or PRODUCTS based on

contracts. What contract and project protocols govern interactions between the two Enterprises? List rules concerning:

a. Contract Directionb. Reviewsc. Approvalsd. Configuration Managemente. Formal Test Acceptancef. Joint technical meetings and contract direction.

Systems Engineering Process Application69. Based on an assessment of the technical review materials:

a. What SE Process was used as a problem-solving and solution-development methodology to create the decision artifacts?

(1) The SE Process methodology in Chapter 14?(2) The ad hoc, endless loop, Plug & Chug SDBTF-DPM Engineering

Paradigm?(3) Neither of the above?

b. What objective evidence is available in the set of review materials to make this determination? Provide supporting rationale.

c. If the SE Process is a “System” and Figure 14.1 represents “schematic” of the system, how would you troubleshoot the “system” to determine the answer to


40


Item b. without asking the review materials originator directly?


41


Chapter 19System Specification Concepts


System Specification Concepts70. Select a SYSTEM or PRODUCT specification for analysis. As you read Chapter 19, analyze

the specification in terms of the topics addressed in the chapter. Prepare a summary report of your findings and recommendations of what could have been done to improve the specification.

a. Refer to the list of SYSTEMS or PRODUCTS identified in the Level 2 Exercises Introduction. If you were a consultant to a System Acquirer that had ample resources:

b. What types of specifications would you recommend as Contract Data Requirements List (CDRL) items. Provide rationale for your decisions.

c. Annotate each of the specification outline topics with a brief synopsis of what you would recommend the Acquirer's SEs address in the System Performance Specification (SPS).

71. Refer to the list of SYSTEMS or PRODUCTS identified in the Level 2 Exercises Introduction. Identify and describe the four (4) types operations (Figure 19.5) —Normal, Abnormal, Emergency, and Catastrophic, as applicable—that apply to the selected system.

Types of Specifications72. Research your Enterprise’s command media – Engineering Practices - for guidance

concerning development of specifications.a. What requirements do the command media impose on contract programs for

types of specifications —performance, development, et al.?b. What does the media specify about timing for developing and approving the

specifications?73. Does the Enterprise specify outlines and file templates for each type of specification?74. What types of specifications (Figure 19.1) are typically developed for your industry?

a. Identify each type.b. Briefly describe the contents and applications of each.c. What are their hierarchical relationships?

Specification Tree75. As a standard Engineering practice within your Enterprise:

a. Do the System Development projects within your Enterprise require a Specification Tree?

b. If so, how well does the Specification Tree match the System Architecture,


42


specifications, and interface documents?

Contract/Subcontract Data Requirements List (CDRL/SDRL)76. Contact a contract project.

a. What specifications are required to be delivered as Contract Data Requirements List (CDRL) items?

b. What delivery requirements are levied on the project specification CDRL deliveries during the System Development Stage?

c. Does the project have a Specification Tree?d. Contrast the Specification Tree structure with the multi-level System

Architecture (Figure 19.2). (1) Do they identically match? (2) How do they differ? (3) What is the project’s rationale for the difference?

e. What specifications are required that are viewed as unnecessary?f. What specifications did the project develop that were not required by

contract?

Types of Specification Requirements77. Contact several contract projects within your Enterprise. Request an opportunity to

analyze the System Performance Specification (SPS) for each project. Based on what you have learned in this chapter:

a. Identify and evaluate three (3) examples of operational requirements.b. Identify and evaluate three (3) examples of capability requirements.c. Identify and evaluate three (3) examples of non-functional requirementsd. Identify and evaluate three (3) different examples of verification

requirements.e. Identify and evaluate three (3) examples of design and construction

constraints.f. Are threshold and objective requirements identified?

78. Based on the Chapter 9’s Specification Requirements Categories—operational, capability, et al.—requirements, research a project specification.

a. Analyze how well it addresses these categories and identify deficiencies.b. Interview project technical management and SEs. c. What methods were used to identify and collect requirements from

Stakeholders for use in the System Performance Specification (SPS)? Document your findings and observations?

d. What lessons learned did project learn in the following areas and how did they resolve the issue?

(1) Missing requirements


43


(2) Misplaced requirements(3) Conflicting requirements(4) Duplicated requirements(5) Non-functional requirements(6) Verification requirements

e. What types of metrics are used to identify and track specification latent defects—deficiencies?

79. Select a project contract specification for analysis:a. Identify defects and deficiencies in the specification and suggest

recommendations for improvement.b. Identify three different types of poorly written requirements statements. For

each type:(1) Highlight their deficiencies.(2) Rewrite the requirement and explain why the rewrite is better in terms

of avoiding conflicts during design, verification, and SYSTEM acceptance.

80. Research several contract specifications and identify those that specify the precedence of requirements—priorities—for decision-making.

81. For a project contract SPS:a. Derive who the SPS stakeholders are based on the specified requirements.

Develop a table with the requirement statement in the left column and link to Stakeholder in the adjoining columns.

b. How would you use this information in a Requirements Management Tool (RMT) database to concerning each requirement statement’s origin and formal change control.

Specification Scope82. Some Enterprises “stuff” requirements for multiple levels of abstraction (Figure 8.4)

for a SYSTEM or PRODUCT into a single specification versus partitioning requirements into specification for Entities at various Levels of Abstraction—SUBSYSTEM, ASSEMBLY, SUBASSEMBLY. What is your Enterprise’s Engineering practice?

83. Select an example specification. Does the specification as a technical document inappropriately include work task statements that belong in a project Statement or Scope of Work (SOW) document?

Requirements Semantics84. Some Enterprises view “requirements” as drawings. Other Enterprises view

“requirements” as being specified in text-based specifications and drawings—design requirements. How does your Enterprise define “requirements”?


44



45


Chapter 20Specification Development Approaches


Specification Outlines1. Refer to the list of SYSTEMS or PRODUCTS identified in the Level 2 Exercises

Introduction. Annotate how you believe the System Performance Specification (SPS) Section 3.0 outline should be structured.

2. Select a component of the system. Annotate the Section 3.0 outline for the contents to be provided in the component's development specification.

3. Select a SYSTEM or PRODUCT specification for analysis. As you read Chapter 20, analyze the specification in terms of the topics addressed in the chapter. Prepare a summary report of your findings and recommendations of what could have been done to improve the specification.

4. Does your Enterprise:a. Require the use of a standard specification outline?b. Permit tailoring of the outline? If so, at what levels of indenture?

Specification Development Approaches5. Within your Enterprise:

a. What types of approaches —Feature-based, Architecture-based, Reuse-based, et al.—are used to develop specifications?

b. Write a brief description concerning the advantages and disadvantages of each approach.

6. What is your Enterprise’s stance and experiences on Architecture Block Diagrams (ABDs) and performance graphs in specifications? Write a brief description of the advantages and disadvantages of including these in specifications?

Technical Specification Requirements versus Statement of Work Tasks7. Select an example specification. Determine if it contains work tasks that should have

been documented in a Statement or Scope of Work (SOW), not in a technical specification.

Graphics in Specifications8. Does your Enterprise insert performance graphs into specifications as requirements?

c. How is verification of the graphical data performed? d. If sampled, what wording is used to bind the specific points? Provide

examples.


46


Specification Reviews9. What requirements and outcomes does your Enterprise impose on specification peer

reviews concerning:a. How and when are they conducted?b. Stakeholder notification and participation?c. Objectivity and quality of technical assessments?d. Review minutes approvals?e. Action item tracking?f. How are action items as corrective actions implemented and verified?g. How well the technical reviews eliminate latent defects based on metrics data

collected over several projects?

Common Deficiencies in Specifications10. Select an example specification.

a. Figure 20.3 highlights common deficiencies in specifications such as missing, conflicting, misplaced, and duplications of requirements. Using the selected specification, analyze it to determine if any of these deficiencies are present and document the results in a summary of findings.

b. Figure 20.4 illustrates the concept of: (1) Acceptable and Unacceptable Inputs and (2) Acceptable and Unacceptable Outputs Products, By-Products, and Services. Analyze the specification and document the requirement statements in a table by paragraph number and category.

c. Analyze the specification and construct a System Architecture similar to Figure 20.5 that may have been used to develop the specification beginning with the contents of the outline, MBSE, or other analytical methods.


47


Chapter 21Requirements Derivation, Allocation, Flow Down,

and Traceability Level 2—Knowledge Application Exercises

Derived Requirements1. Select a SYSTEM or PRODUCT specification for analysis. As you read Chapter 21, analyze

the specification in terms of the derived requirements. If the requirements allocations, flow down, and traceability are available, include them in your analysis. Prepare a summary report of your findings and recommendations of what could have been done to improve the specification.

2. Select a SYSTEM or PRODUCT from the Level 2 Exercises Introduction. Create a SYSTEM Level Use Case (UC).

a. Derive sibling requirements.b. Allocate and flow down the requirements to PRODUCTS or SUBSYSTEMS.c. Graphically depict a UC I/O thread between the respective PRODUCT or

SUBSYSTEM capability requirements.

MOEs, MOSs, and MOPs3. Based on the preceding System's UCs:

a. Identify its Measures of Effectiveness (MOEs).b. Identify its Measures of Suitability (MOSs).c. For each MOE and MOS, identify a hypothetical hierarchy of contributory

levels of Measures of Performance (MOPs).d. For TPM tracking purposes, which MOPs would you track and provide

supporting rationale?4. Select an example specification. Analyze it to determine the SYSTEM or PRODUCT’S

required MOEs or MOSs – capabilities. a. Do the MOEs or MOSs cover all aspects of the SYSTEM or PRODUCT’S mission life

cycle such as Figure 20.2?b. Using Figure 20.2 as a reference, do the derived requirements support the

parent level MOE or MOS?c. If each MOE or MOS represents a Use Case (UC), can the derived requirements

be assembled within a UC thread as illustrated in Figures 21.6 and 21.7? If not, what would be the appropriate derived requirements?

d. If this specification is for a PRODUCT, SUBSYSTEM, ASSEMBLY, et al, analytically, can you link its Input/Output (I/O) Model to an interfacing entity’s specification? Figure 21.7 illustrates how SUBSYSTEM A’s Entity Development Specification (EDS) Requirements trace horizontally to SUBSYSTEM B’s EDS requirements


48


User Needs, Wants, Can Afford, and Willingness to Pay Requirements5. Principle 21.1 addresses User Needs, Wants, Can Afford, and Willingness to Pay

(Figure 21.4). Provide a real-word application example of a SYSTEM or PRODUCT that illustrates this principle. Provide a written description of the methodology you use to reconcile these differences.

Requirements Allocation and Flow Down6. Your customer has requested a description about how you allocate and flow down

requirements from an SPS to lower level specification using a text-base specification - left side of Figure 21.3 – based on publicity – “brochureware” – they perceive from verbal presentations. They ask if you will help them understand the process by writing a 1-page narrative describing the requirements allocation and flow down process in your own words. Use Figure 21.3 as a reference to develop the narrative.

7. Contact a contract project within your Enterprise and interview the Technical Director, Project Engineer, and Lead SEs to answer the following questions:

a. How were lower level requirements derived from User requirements?b. Did the contract mandate traceability of requirements or was this an

Enterprise initiative?c. Did the project employ a Requirements Management Tool (RMT) to provide

traceability between specifications? If not, how were requirements traced?d. What analysis tools were used to reconcile and balance performance

allocations?e. What were the lessons learned?

Standard Engineering Practices Requirements8. Well-disciplined Engineering organizations often have standard design practices such

as a Design Practices Manual (DPM) for EEs, MEs, et al. that establish best practices for implementing wiring, connections, grounding, et al. for safety. How does your Enterprise or project incorporate these practices into SYSTEM or PRODUCT specifications as design guidelines?

a. Analyze a SYSTEM or PRODUCT specification.b. Count how many requirements contain ambiguous words such as “User

Friendly”, “Intuitively Obvious”, et al.c. Select three of the requirements statements in an example specification and

rewrite them avoiding the same pitfall in ambiguous working.

Operational Requirements9. Analyze an example specification.

a. Based on the SYSTEM or PRODUCT’S mission life cycle, does the specification specify operational requirements for each phase of operation?

b. If not, develop an update to the specification outline and specify the set of operational requirements you would recommend. Review with colleagues.


49


How Many Requirements in a Specification10. A common question about specifications is: how many requirements should a

specification contain (Figure 21.5). Due to the variations in systems complexities and their applications, there are no right answers. Using the general specification outline structure in Table 20.1, develop a strategy for estimating the total number of “shall” based requirements statements and make a presentation that includes assumptions and supporting rationale to your colleagues.

Enterprise Guidance – Requirements Allocation, Flow down, MOEs, MOSs, and TPMs

11. Research an Enterprise’s command media. e. What guidance and direction is provided for deriving, allocating, flowing down,

and tracing requirements?f. What minimum requirements does the Enterprise impose for selection of TPMs

relative to higher-level MOEs and MOSs and their tracking?g. What tools and methods are recommended for tracking TPMs?h. What TPM training does the Enterprise provide and who is accountable?

12. Identify a small, a medium, and a large contract project within an Enterprise. Interview project personnel concerning TPMs.

a. Does the Contract Statement of Work (CSOW) require TPM tracking?b. What requirements does the CSOW impose on TPM reporting?c. What method did the project use to select the TPMs?d. How were TPMs supporting a key MOE coordinated across multiple Product

Development Teams (PDTs) e. How were TPMs linked to risk tracking thresholds?f. What lessons did the project learn from TPMs?


50


Chapter 22Requirements Statement Development


Requirements Statement Development Practices13. Select a SYSTEM or PRODUCT specification for analysis. As you read Chapter 22, analyze

the specification’s requirements statements. Prepare a summary report of your findings and recommendations of what could have been done to improve the specification.

14. Select an example specification. a. Select an example specification. Does Section 1.0 identify the system,

product, or service and establish its context within the next higher level SYSTEM or PRODUCT?

b. Are the requirements statements written as brief, concise statement or paragraphs of compound sentences?

c. Does each requirement statement:(1) Structure complies with the Requirements Statement Guidelines on

pp. 459 – 462?(2) Have a verification method?

15. Select one of the SYSTEMS or PRODUCTS listed in the Level 2 Exercises Introduction. Based on four (4) to six (6) Use Case (UC) based capabilities identified for the SYSTEM or PRODUCT:

a. Write requirements statements for each UC capability.b. For each capability requirement, derive the next level of sibling requirements

that constitute what must be completed to achieve the higher-level capability.

Requirements Verification Matrix (RVM)16. Create a Requirement Verification Matrix (RVM).

a. Identify the verification methods required to prove compliance with various types of requirements.

b. Append a separate column that defines the plan for employing the verification methods to prove compliance to the specification requirement statement.

Primitive Requirements Statements17. Select an example specification. Analyze the specification to locate three a poorly

written requirements statement. a. Using the Primitive Requirements Approach, extract key parts of each

requirement statement and develop a table similar to Table 22.1.b. Now, rewrite the original requirements statement focusing on content first and

grammar second.


51



52


Chapter 23Specification Analysis


Specification Analysis Practices1. Select a SYSTEM or PRODUCT specification for analysis. As you read Chapter 23, analyze

the specification in terms of the topics addressed in the chapter. Prepare a summary report of your findings and recommendations of what could have been done to improve the specification.

2. Using the specification above, create a table that contains the following information:a. Column 1—Specification Assessment Checklist (pp. 467 – 471) items as rows.b. Column 2—Applicability of each checklist item to this SYSTEM or PRODUCT or

specification—Yes or No—using color-coding.c. Column 3—Your assessment of how well each checklist item is addressed.

3. Assume your project is planning to submit this specification as part of its Request for Proposal (RFP) response.

a. What Critical Operational / Technical issues (COIs/CTIs) did you identify that need to be addressed in the specification prior to submittal?

b. What strategy would you propose resolving the issues? Provide details.

Specification Assessment Checklist4. Using the Specification Assessment Checklist on p. 467 - 471, assess how well an

example specification covers the list of requirements, assuming they are applicable to the SYSTEM or PRODUCT being specified.

Specification Deficiencies Checklist5. Using the Specification Deficiencies Checklist on pp. 472 - 476, assess how well an

example specification avoids common specification deficiencies.


53


Chapter 24User-Centric System Design (UCSD)Level 2—Knowledge Application Exercises

User-Centric System Design (UCSD) Practices1. Select a SYSTEM or PRODUCT listed in the Level 2 Exercises Introduction. As you read

Chapter 24, analyze the system in terms of the topics addressed in the chapter. Prepare a summary report of your findings and recommendations of what could have been done to improve the specification.

a. Based on the SYSTEM or PRODUCT selected above, b. What types of I/O devices are employed as Human–System interfaces?

Personnel-Equipment Task Allocations Decisions2. Identify three examples of Human-System interaction tasks that represent decisions

the System Developer may have made regarding EQUIPMENT Element versus PERSONNEL Element decision-making trade-offs and allocations.

Human Factors (HF)3. Select a SYSTEM or PRODUCT listed in the Level 2 Exercises Introduction. Identify three

examples of each Human Factor (HF) listed below that should be considered in the system's design:

a. Anthropometric factorsb. Sensory factorsc. Cognitive factorsd. Psychological factorse. Physiological factors.

4. Based on the HF objectives presented in Table 24.2, which ones should be the key focus areas for consumer products, office environments, medical devices, and military systems?

Create a table consisting of HF Objectives in Column 1. For each HF objective, annotate the intersecting cell for each of the following concerning how the objective applies:

a. Column 1—Consumer productsb. Column 2—Office environmentsc. Column 3—Medical devicesd. Column 4—Military systems.

5. You have been hired as a consultant to support the types of System Developers listed below to tailor the list of Human-System Design Factors provided in Section 24.5.2 Operator C2 Devices for general application to SYSTEMS and PRODUCTS in their domain.


54


What would be your recommendations for the following domains?c. Transportation—aircraft, automobiles, trains, et al.d. Medical—blood pressure monitoring devices.e. Consumer products—smartphones, tablet computers et al.

Human Errors - Slips, Lapses, Mistakes, and Violations6. One of the challenges in SE is development of a System Design Solution eliminates or

minimizes the impacts of errors, slips, lapses, mistakes, and violations. Choose a SYSTEM or PRODUCT from the Level 2 Exercises Introduction. Using reverse engineering and analysis, describe how the SYSTEM or PRODUCT’S developer addressed this challenge.

7. Research incidents or accidents. Using Five Whys Analysis (pp. 104 – 105), identify examples of human errors - slips, lapses, mistakes, and violations – that may have lead to a chain of events resulting in the incident or accidents.

Work Task Environments8. As a Lead SE, you are responsible for overseeing the specialty engineering

integration of each of the three (3) common types of Task Environments shown in Figure 24.7. For each Task Environment, in collaboration with Human Factors Engineering (HFE), identify the Physical, Physiological, and Psychological considerations that should be considered in the PERSONNEL-EQUIPMENT interactions.

HSI Domains9. Assume you are developing an automobile. During a recent presentation, a review

team asked what your project is doing to assess the nine (9) HSI domains (pp. 492 – 493) for applicability to a SYSTEM or PRODUCT being developed by a subcontractor. Specifically, identify example HF areas of concerns in each domain that should be considered. Prepare a response that lists examples by HSI domain.


55


Chapter 25Engineering Standards of Units,

Coordinate Systems, and ConventionsLevel 2—Knowledge Application Exercises

Engineering Standards of Units, Coordinate Systems, and Conventions Practices1. Locate a specification for one of the types of SYSTEMS or PRODUCTS listed below. As you

read Chapter 25, analyze the specification in terms of the topics addressed in the chapter. Prepare a summary report of your findings and recommendations of what could have been done to improve the specification.

a. NASA’s Space Shuttleb. NASA’s International Space Station (ISS)c. Mars Roverd. Automobile GPS Devicee. Numerical Control (NC) Machinef. Medical device

Dimensional Coordinate Systems2. Referring to Figure 25.6 illustrating the Space Shuttle’s Dimensional Coordinate

System, assume you have been tasked to develop this diagram. Prepare a presentation that includes a written technical description of the diagram for review and approval.

Polar, Cylindrical, and Cartesian Coordinate Systems3. Referring to Figure 25.8, identify three (3) examples of real-world systems that

employ the following types of reference systems:a. Polar Reference Systemb. Cylindrical Reference Systemc. Cartesian Reference System.

Enterprise Command Media4. Executive management has tasked you to define an Enterprise Engineering Practice

Standard that defines an annotated outline for every project’s Standards of Units, Weights, and Measures and Coordinate System(s).

a. Define what you would propose as the standard outline with subsections based on what you have learned in this chapter.

b. Annotate the expected contents of each section and subsection.


56



57


Allowing Mixed Sets of Standards of Measurement on a Project 5. Best practices state that you should standardize on the British Engineering Standards

(English) System of Metric System of units and measures. Members of your technical team want to use some of both due to usage by vendors of products—some use English units, others Metric—you plan to integrate into your System or Product.

a. How would you deal with this challenge? b. Prepare a presentation to brief your team and present your solution to the

challenge.6. The NASA Mars Climate Orbiter (MCO) ended in failure due to a communications

breakdown concerning the usage of English versus Metric Units. Research the accident.

a. Identify the probable causeb. Describe safeguards you would verify standards of units across the project

across the System Development Phase to avoid the same mistakes.7. Identify historical instances where the lack of Engineering standards and conventions

or their misapplication contributed to SYSTEM or PRODUCT failures or accidents.


58


Chapter 26System and Entity Architecture Development


Formulating and Developing the Four Domain Solution Architectures1. Using an automobile as an example, develop the following architectures using the

Wasson SE Process Model shown in Figure 14.1 and show traceability between each of the architectures. Assume to your class members as surrogate Users for review and discussion.

a. Operational Architectureb. Logical Capability Architecturec. Behavioral Architectured. Physical Architecture

Conceptual Architecture Template2. You have been selected as the System Architect for a project developing one of the

SYSTEMS or PRODUCTS listed below. The User is familiar with the Conceptual Architectural Model shown in Figure 26.8 and requests that you tailor it for their application and briefly describe the contents of each of the remaining architectural capabilities using Table 26.1 as a reference. Present your proposal as a presentation for review by colleagues or class members serving as surrogate Users.

a. Aircraftb. Automobilec. Desktop, laptop, or tablet computerd. Medical blood pressure devicee. Home Heating, Ventilation, and Air Conditioning (HVAC) System.f. Home Security System

Latent Defects3. Shull, et al. (2006, p. 5) make the following observation: “Defects causing high

amounts of rework are likely to be those that are ‘architecture breakers’ or that are found “inappropriately” late in the development process.” What reasonable measures would you institute to avoid this problem on your next project?


59


Architectural Completeness4. Investigate existing SYSTEM or PRODUCT architectures available on the web. Identify

the SYSTEM or PRODUCT by name, website, etc. and make a presentation of your findings concerning the following considerations:

a. 10 Architectural Attributesb. Power and loss of power considerationsc. Security and protection considerationsd. Environmental, Safety, and Occupational Health (ES&OH) considerationse. Fire detection and suppression considerationsf. Remote Situational Assessment considerations

Architecture Fault Detection, Isolation, and Containment5. Key attributes of an architecture include fault detection, isolation, and containment.

Identify three (3) examples of SYSTEMS or PRODUCTS that exhibit architectural capabilities to address these attributes.

Reference: Shull, Forrest; Basili, Vic; Boehm, Barry; Brown, A. Winsor; Costa, Patricia; Mikael;

Lindvall, Dan Port; Rus, Ioana; Tesoriero , Roseanne; and Zelkowitz , Marvin (2003), What We Have Learned About Fighting Defects: NSF Center for Empirically Based Software Engineering CeBASE). Retrieved on 4/9/14 from http://www.cs.umd.edu/%7Emvz/pub/eworkshop02.pdf.


60


Chapter 27System Interface Definition, Analysis,

Design, and Control Level 2—Knowledge Application Exercises

Interface Definition, Analysis, and Control Practices1. Select a project’s Interface Control Document (ICD) for analysis.

a. As you read Chapter 27, analyze the ICD in terms of the topics addressed in the chapter.

b. Prepare a summary report of your findings and recommendations of what could have been done to improve the specification.

Seamless Interface Integration 2. You have been selected to be the Lead Systems Engineer (LSE) for a very large

System Development project proposal. The Request for Proposal (RFP) requires that offerors develop a large System XYZ that will operate under the Command and Control (C2) of a User’s Level 0 SYSTEM. The User’s facility is located in different parts of a country from your System Development facility.

The User is very concerned about achieving a seamless System Integration, Test, and Evaluation (SITE) with their system. System XYZ is required to match existing bolt holes in the User’s legacy system for electrical power and several data communications cables linking the two systems. To mitigate technical, schedule, and cost risks, the RFP requires each offeror formulate and propose an interface verification strategy that will provide a level of assurance that the System XYZ being developed will achieve this goal and will identically match on system integration.

Define your interface integration strategy describing how you will demonstrate that your proposed System’s mechanical, electrical power, and data communications interface designs will be verified prior to delivery to the User’s facility.

Interface Data Formatting Requirements3. You have been requested develop a centralized display console for remotely

monitoring the status of electrical power; heating ventilation, and air conditioning (HVAC), environmental—temperature, humidity, et al. parameters; water pressure, exterior and office lighting and door status; etc. This information is collected and stored in a Central computer system.

Using Figures 27.3 and 27.4 as an example, how would you propose formatting the central computer data for transmission over a Single Mode fiber to a computer in your facility for processing and display?

a. What resolution units would you propose for each data item?b. In digitizing sensor data, what data rates would you propose as adequate for

updating the display system?


61


Interfaces as Functional Entities4. Interfaces are more than simply connect lines between two entities that provide

mechanical linkages, electrical signals, fiber optic data, et al. They also provide capabilities to such as crumple zones in vehicles to fail in a specific manner. Identify 3 examples of interfaces that provide additional capabilities.

11.


62


Chapter 28System Integration, Test, and Evaluation (SITE)


System Integration, Test, and Evaluation (SITE) Practices5. Select a System or Product System Integration and Verification Plan (SIVP) for

analysis. As you read Chapter 28, analyze the plan in terms of the topics addressed in the chapter. Prepare a summary report of your findings and recommendations of what could have been done to improve the specification.

a. Describe the primary phases and test configurations for testing the SYSTEM or PRODUCT.

b. If you were the Acquirer of this SYSTEM or PRODUCT, would you require procedure-based ATPs or scenario-based ATPs'? Provide supporting rationale.

c. What special considerations are required for testing this System such as simulated OPERATING ENVIRONMENT, tools, test equipment, and facility?

d. Identify the basic integration and test strategy of steps you would specify in the SIVP.

System Integration & Verification Plan6. Although Engineers are generally competent in designing Equipment – Hardware and

Software, they are often reluctant to propose ways of integrating various levels of abstraction that involve system dependencies – I/O, etc.

a. Analyze a SIVP to determine how the project intends to integrate various levels of abstraction and SITE locations.

b. Does the SIVP provide this level of detail or is it simply a generic plan expressing the philosophy of SITE?

c. If the SIVP is simply a generic plan, where are the SITE integration sequences documented?

SITE Integration Activities7. Interview the Project Engineer or Lead Systems Engineer (LSE). Did Test & Evaluation

(T&E) personnel:a. Participate in the SPS and EDS reviews b. Approve the specifications?

4. During SITE:a. What types of forms are used in your Enterprise or project to capture Test

Discrepancies (TDs)—non-compliances—Discrepancy Reports (DRs)? b. What is the process for prioritizing and correcting DRs?c. Are DRs prioritized for corrective action?


63


d. If so, what prioritization criteria are used and who makes the determination?e. If applicable, is an Acquirer's Test Representative (ATR) part of the review,

prioritization, and approval process?

Project Approaches to SITE8. Contact a System Development project within your Enterprise.

a. Interview the individual accountable for developing the SIVP for SITE. To minimize costs and schedule time, how do they analyze and group multiple specification requirements for verification by the least number of test configuration changes and tests?

b. How does the project verify ICD compliance between two (2) Entities—SUBSYSTEMS, ASSEMBLIES, SUBASSEMBLIES—that each have their own specifications that include related interface requirements?

c. How do they verify interoperability of two (2) Entities (Figure 27.3)—SUBSYSTEMS, ASSEMBLIES, SUBASSEMBLIES—communicating via data messages such as shown in Figures 27.4 and 27.5.

User Test and Evaluation Master Plan (TEMP)9. A Test and Evaluation Master Plan (TEMP) identifies Critical Operational / Technical

Issues (COIs/CTIs) the User wants to resolve concerning missions and a new System Development or upgrade.

10. Select an example SYSTEM or PRODUCT from the listing below. a. What COIs/CTIs do you think a System Acquirer would address in their TEMP

for the SYSTEM or PRODUCT that will serve as the basis for System Validation exercises?

(1) Laptop or Tablet Computer(2) Office Copier(3) Smart Phone(4) Automobile

b. What Measures of Effectiveness (MOEs) and Suitability (MOSs) would you suggest they assign to each COI/CTI?


64


Chapter 29 System Deployment, Operations and Sustainment,

Retirement, and Disposal Level 2—Knowledge Application Exercises

System Deployment, Installation and Checkout (I&CO)11. Select one of the following SYSTEMS or PRODUCTS from the list below. Make a

presentation that identifies requirements, options, design considerations, and diagrams concerning how you would deploy, install, & checkout (I&CO) one of the following systems to/from your city or a facility:

a. New automobile from its manufacturing plant to a dealer.b. TV station remote broadcast vehicle to a news site and return to the station.c. Construction crane to a new building site and return.d. Home from one location in a town or city to another.e. New portable medical device to a hospital and within a hospital to a patient’s

room.f. Laptop or tablet computer system.g. Military system requiring land transport to an airport, air transport to another

airport, and land transport to a deployment site.12. Make a presentation that describes the deployment, installation & checkout (I&CO) of

the:a. International Space Station (ISS) modules.b. NASA James Web Space Telescope https://www.youtube.com/watch?

v=bTxLAGchWnA

Next Generation System Requirements13. Assume that you have been contracted to develop requirements for a next-

generation of a SYSTEM or PRODUCT.a. What are the SYSTEM Level questions you would pose to System Owners and

Users concerning the performance of current SYSTEM or PRODUCT operations and capability gaps?

b. What are some of the lessons learned from the current SYSTEM or PRODUCT, they want to avoid and take forward in acquisition of the next SYSTEM or PRODUCT or upgrade?

c. Using the System Elements as the frame of reference, what questions would you ask regarding the performance of each System Element in the new SYSTEM or PRODUCT?


65

https://www.youtube.com/watch?v=bTxLAGchWnA

https://www.youtube.com/watch?v=bTxLAGchWnA


System Retirement14. Research and develop a presentation concerning how NASA’s remaining Space

Shuttles were phased-out of service and dispositioned for disposal including their components.

New System Operations, Maintenance, and Sustainment (OM&S)15. Contact a User concerning OM&S for a system, product, or service.

a. What COIs/CTIs were forefront prior to the acquisition and development of the new system.

b. Now that the system, product, or service has been fielded, what efforts has the User initiated to monitor the performance of the System relative to its? System Performance specification (SPS)?

c. Where off-nominal performance occurs, how is the User dealing with the matter?

d. Was the off-nominal performance due to:(1) Performance specification requirements? (2) Design?(3) Component variations?(4) Other? Be specific?

16. Research the Internet for examples of large, heavy equipment deployment. Develop a paper outlining the steps, constraints, and technical issues that had to be addressed prior to and during the deployment.


66


Chapter 30Introduction to Analytical Decision Support


Analytical Decision Support Practices17. Locate an Engineering analysis developed for a project. As you read Chapter 30,

assess the analysis based on terms of the topics addressed in the chapter. a. Prepare a summary report of your findings and recommendations of what

could have been done to improve the specification. b. Refer to the list of SYSTEMS or PRODUCTS listed in the Level 2 Exercises

Introduction. If you were the Project Engineer or Lead SE (LSE):(1) What types of engineering analyses would you recommend?(2) How would you collect data to support those analyses?

Analytical Task Charter Statement18. Referring to the analyses in Exercise 30.1, write an analysis task charter statement

based on the attributes of a technical decision discussed at the beginning of this section. Specifically, identify the following:

a. Critical Operational or Technical Issues (COIs/CTIs) to be resolved.b. The objective of the analysis.c. What aspects of the analysis can be characterized by statistical distributions?d. What you would expect the analysis to address the need for establishing the

methodology “up front”, recommendations, et al.e. How is Analytical Decision Support viewed in your Enterprise and project?

(1) As a cohesive integrated framework of Enterprise organizations?(2) As ad hoc, stovepipe organizations?

19. Research examples of analysis charter statements. Without identifying the Enterprise, personnel, and other sensitive data, assess the charter and present findings and recommendations to your colleagues.


67


Chapter 31System Performance Analysis, Budgets, and Safety

Margins Level 2—Knowledge Application Exercises

System Performance Analysis, Budgets, and Safety Margins Practices20. Contact a project within your Enterprise and inquire about the availability of its

Performance Budgets and Safety Margins. As you read Chapter 31, the system in terms of the topics addressed in the chapter. Prepare a summary report of your Findings and Recommendations of what specification developers need to do to improve the quality of the specification.

21. For the project in Exercise 31.1:a. Is there a single Performance Budgets and Safety Margins document for the

entire SYSTEM or PRODUCT? Are there multiple Performance Budgets and Safety Margins documents? What are your views? Document your findings and recommendations.

b. What types of budgets and safety margins are controlled for electrical power, mass properties, and time-based performance parameters?

c. Who exercises control authority over changes to the Performance Budgets and Safety Margins document? An individual? A multi-discipline team? Document your findings and recommendations.

d. Is the Performance Budgets and Safety Margins document maintained under formal Configuration Management control?

e. What role does the Performance Budgets and Safety Margins document plan in allocating and integrating parameter performance values to/from specifications?

f. How are safety margins established for the project? By contract? Enterprise Engineering practices?


68


Chapter 32Trade Study Analysis of Alternatives (AoA)


AoA Practices22. Locate a trade study for analysis. As you read Chapter 31, analyze the trade study in

terms of the topics addressed in the chapter. Prepare a summary report of your findings and recommendations of what could have been done to improve the specification.

Trade Study Approaches2. You have been tasked to conduct a trade study that will minimize the subjectivity of

Stakeholder and Trade Study Team evaluations. You and your team decide to employ the Auto-Normalize Method. The team interviews Stakeholders to assess their level of importance concerning each Decision Factor and Criterion. As a result, the Trade Study Team summaries the results of Stakeholder value assessments and Trade Study Team evaluation scores for Candidates A–C in the table below.

Decision Factor

Decision Criteria

Stakeholder Importance

(1–10)

Candidate A

Score

Candidate B Score

Candidate C Score

OM&S Cost 8Operations 8 8 6 7

Maintenance 8 8 5 7Sustainment 6 6 4 5

Technology 4Maturity 9 5 3 2

Risk 7 3 7 5Performanc

e7

Range 8 7 6 7Capacity 5 5 7 3

23. You and your team develop a spreadsheet application based on the Auto-Normalize Method. Based on the information it provides, answer the following questions:

a. For each of the Decision Factors, what is its relative weight allocation?b. For each of Decision Criterion, what is its relative weight allocation?c. For each Decision Criteria, what are the normalized scores for Candidates A–


69


C?d. What are the final Figures of Merit (FOMs) scores for Candidates A–C?e. Based on the results, what are the prioritized recommendations that will be

presented to the decision authority via the Trade Study Report?

Motivations for AoA24. Referring to one of the example SYSTEMS or PRODUCTS provided in the Level 2

Exercises Introduction, apply your knowledge derived from Chapter 32’s topical discussions. Specifically identify the following:

a. Critical Operational and Technical Issues (COIs/CTIs) that have to be resolved.b. What is the sequence of COI/CTI trade studies that should be conducted?c. Based on your own needs, what decision factors and criteria would you

establish for each COI/CTI? d. How would you establish weights for each of the Decision Factors and allocate

to its Decision Criteria for analytical purposes?


70


Chapter 33System Modeling and Simulation (M&S)


Modeling Systems and Components25. Select one of the SYSTEMS or PRODUCTS listed in the Level 2 Exercises Introduction. As

a System Acquirer, you need to model a physical component’s operations and physical interactions internally and externally for a range of OPERATING ENVIRONMENT conditions. Searching on the web, you find two (2) models that may potentially fill your needs. Develop the list of questions you need to investigate to assess each model’s:

a. Relevance to your applicationb. Degree of compliance to need-based requirementsc. Developer assumptionsd. Developer documentatione. Latent defectsf. Verification and Validation (V&V)

M&S Facility26. Your project is planning a System Integration Laboratory (SIL) facility including a

Modeling and Simulation (M&S) capability for a specific product line. You have been tasked by executive management to develop a set of talking points that highlight the items listed below. Prepare a presentation to address these concerns.

a. How models will be validated.b. What team of stakeholders will evaluate proposed changes due to:

(1) SYSTEM or PRODUCT capability and performance requirements changes, (2) Interface changes, (3) OPERATING ENVIRONMENT changes, (4) Technology, (5) Correction of latent defects—design errors, flaws, deficiencies, et al.

Testbed27. Identify a project that employs a testbed for developing a SYSTEMS or PRODUCTS.

a. Interview the Project Manager, Project engineer, and Lead SS (LSE) to learn how the testbed was developed and maintained.


71



72


Chapter 34System Reliability, Maintainability, and Availability (RMA)


Enterprise Command Media28. Research your Enterprise’s command media for Engineering Processes and Methods

to be employed when conducting RMA practices. Report your findings concerning the following.

a. Component models and performance characteristics.b. Validation of component math models.c. How this information is catalogued, stored, and retrieved for use on future

projects.

Enterprise Project Practices29. Contact several contract programs within your Enterprise and research the

requirements for RMA. Interview project personnel to determine the following:a. What method did they use to did they allocate and document the

requirements allocations to the System Elements?b. What lessons did the System Development Team (SDT) or System Engineering

and Integration Team (SEIT) learn?c. How would they advise approaching RMA on future projects?d. What sources of RMA data and models did they use to develop RMA

estimates?

FMEAs and FMECAs 30. For the SYSTEM or PRODUCT in Exercise 34.2, contact a project or search the web for an

example of a FMEA.a. Was the project required to perform a FMEA or did they perform FMEA as part

of normal Engineering practice?b. What challenges did they encounter in performing the FMEA?c. How did the project use the FMEA outcome data on the project to mitigate the

System Design Solution?d. Compare the FMEA form shown in Figure 34.19 with the form used by the

project? Document your findings. 31. For the SYSTEM or PRODUCT in Exercise 34.2, contact a project or search the web for an

example of a FMECA.a. Compare and contrast the data provided in the FMECA versus the FMEA?b. How did the project use the FMECA outcome data on the project?


73



74


Failure Reporting and Corrective Action System (FRACAS)32. For the SYSTEM or PRODUCT in Exercise 34.2:

a. Did the User have a Failure Reporting and Corrective Action System (FRACAS) that was operational?

b. How were types of FRACAS information collected?c. Did the System Development Team use the FRACAS information?d. What type of availability was required to be computed for the SYSTEM or

PRODUCT?

Preventive, Periodic, Planned, and Scheduled Maintenance33. Retrieve the Scheduled Maintenance Recommendations for your automobile. Develop

a summary presentation that provides examples to delineate the following terms: a. Preventive Maintenanceb. Periodic Maintenancec. Planned Maintenanced. Scheduled Maintenance

Reliability Modeling and Validation34. Contact a project that mass produces SYSTEMS or PRODUCTS. Interview the Reliability &

Maintainability (R&M) Engineers to answer the following questions:a. How were R&M data collected, stored, analyzed, and employed:

(1) On an existing project?(2) Future projects?

b. What types of statistical distributions were used to model components, in general?

c. How well do the R&M models perform and correlate with actual component data.

d. What degree of correlation have the R&M Engineers been able to achieve.e. Where the actual correlation results are less than desired, how do the R&M

Engineers validate the results and at what point do they employ other methods?

Bathtub Curve Concept35. Concerning the Bathtub Concept:

a. What are the Enterprise and project views concerning the relevance and validity of the Bathtub Curve?

b. What types of statistical distributions are used to model the SYSTEM, PRODUCT, or ENTITY’S reliability by phase of development and operation (Figure 34.6)? Specifically:


75


(1) Decreasing Failure Region (DFR)(2) Stabilized Failure Region (SFR)(3) Increasing Failure Region (IFR)

c. Does the SYSTEM, PRODUCT, or ENTITY enter the IFR before it is typically disposed or does the IFR lead to disposal?

d. Identify three commercial products in which entering the IFR lead to disposal of the SYSTEM or PRODUCT or one of its components.

Condition-Based Maintenance (CBM) or Prognostic Health Management (PHM)36. Identify a project that develops a SYSTEM or PRODUCT that employs Condition-Based

Maintenance (CBM) or Prognostic Health Management (PHM).a. What types of sensors are used to assess the current condition of the

EQUIPMENT?b. Based on the condition data, what tools are used to estimate the timely need

for maintenance?c. Have there been instances in which a SYSTEM or PRODUCT has failed randomly

between scheduled maintenance? Was the probable cause identified?d. What was the business case used to justify a decision to implement CBM or

PHM?

Statistical Distributions37. Describe the differences between mean, median, and mode of a Lifetime Data

Distribution in Figure 34.3 Panel B.38. Select a SYSTEM or PRODUCT from the Level 2 Exercises Introduction. Assume that each

Chapter 34 graphic answers potential questions submitted by a User concerning development of the SYSTEM or PRODUCT. Using your own words, describe how each of the graphics referenced below answers a specific User’s question for the SYSTEM or PRODUCT.

a. Describe Figure 34.1b. Describe Figure 34.2c. Describe Figure 34.21d. Describe Figure 34.22e. Describe Figure 34.23f. Describe Figure 34.24g. Describe Figure 34.25

39. Describe the contents of Figure 34.3 in your own words. What is the relationship between Panels A and C and how are they determined mathematically?

40. Describe the contents of Figure 34.5 in your own words. Explain how Panels A and B are interrelated?

41. Describe the contents of Figure 34.9 in your own words in terms of the technical strategy and its intent.


76


42. Describe the contents of Figure 34.10 in your own words. Provide 3 real-world examples to illustrate the key points.

43. Describe the contents of Figure 34.11 in your own words. Provide real-world examples to illustrate the key points.

44. Describe the contents of Figure 34.12 in your own words.45. Using Figure 34.16 as a reference, describe how you would allocate SPS RMA

requirements to System Architecture SUBSYSTEMS.46. Describe the contents of Figure 34.17 in your own words. Pick a component that has

been identified as a FMEA risk item and describe the technical process for reducing its risk.

47. Describe the interrelationships between the various curves in Figure 34.21 in your own words..

48. Develop a description of Figure 34.22 in your own words to answer the question “What factors must be considered when performing maintenance actions on a SYSTEM OR PRODUCT.

49. Using Figure 34.24 as a reference, discuss the challenges of finding the optimal balance in Reliability and Maintainability.

50. Using Figure 34.25 as a reference, describe how it can be applied to the lifecycle of a specific component in optimizing a SYSTEM or PRODUCT component’s service life.

RMA Trade Space51. Explain what is meant by the RMA trade space? 52. How do you achieve an optimal balance between cost and performance of RMA?


77

chapter 12higheredbcs.wiley.com/.../level2_chapter_exercise.docx · web viewfor tpm tracking...

Documents