cste - testing new technologies by yogesh khairnar

TESTING NEW TECHNOLOGIES

Skill Category 10

Testing New Technologies

Risks Associated with New Technology

Newer IT Technologies that Impact Software Testing

Testing the Effectiveness of Integrating New Technology

Risks Associated with New Technology

Questions we must ask Is new technology utilized on the project being

tested? If so, what are the concerns and risks

associated with using that technology? If significant risks exist how will the testing

process address those risks?

Risks Associated with New Technology

1. Unproven technology There is not enough experience

2. Technology is defective It doesn’t work like it should

3. Inefficient technology It fails to achieve the productivity gains associated with

it.

4. Technology incompatible with other implemented technologies It might not be useful if you can’t incorporate it with

existing technologies

5. New technology obsoletes existing implemented technologies We should assume that because of the new technology,

some old technology will probably be classified as obsolete

Risks (cont)6. Variance between documentation and technology

execution The documentation may be inaccurate leading to

believing that the technology is inefficient.7. Staff not competent to use new technology

Training may be required and deployment processes will most likely need to be updated

8. Lack of understanding how to optimize the new technology Not all aspects of it may be used, therefore the company is

missing something9. Technology not incorporated into the

organization’s work processes It may be hit or miss. Typical at technology maturity Level

110.Obsolete testing tools

New testing tools and new methodologies may be required11. Inadequate vendor support

The vendor may not be as helpful as IT would like

Newer IT Technologies that Impact Software Testing

Web-Based Applications Distributed Application Wireless Technologies New Application Business Models New Communication Methods New Testing Tools

Web-Based Applications

Consists of hardware, software, and users Having an understanding of its

components leads to better testing Understanding the interaction between the components

offers a different perspective than that of the developers

Client based components are on the front end Web browsers, plug-ins, and embedded objects

Server Side components are on the back end Web server components, database applications, third-

party modules, and cross-component communication

Distributed Application

Components are grouped into clusters of related services

Traditional Client-Server Systems UI, Business logic code, Data-access service code, Data

Storage Thin-client system

Majority of processing is done on the server UI is usually the only part that runs on the client Testing should focus on server and network

performance Thick-client system

Majority of processing is done on the client ActiveX and Java applets run on the client, instead of

the server Testing should focus on client performance and

compatibility

Wireless Technologies

Common Issues Electromagnetic interference and physical

obstacles that limit coverage of wireless network Specific Issue:

Standards Constraints in deployment of Wireless Network

since multiple standards are exist Data security

WLANs use different authentication and encryption methods

Throughput or Coverage The farther you get from a transmitter or access

point, the throughput of the network decreases

New Application Business Models

e-Commerce Buying and selling of goods & services, and

the transfer of funds, through digital communications.

e-Business The conduct of business on the Internet Buying and selling of goods, servicing

Customers and collaborating with business partners

Web sites that are elaborate brochures

New Communication Methods

Voice and Messaging Cell-phones, pagers, and commercial two-way

business radios Analog standard is AMPS Digital standards are GSM, TDMA, CDMA FCC allocates different frequencies to different carriers 3G will provide 30-times faster transfer rates

Interoperability issues galore Hand-Held and Internet-Enabled Devices

Internet-enabled cell phones and PDAs Limitations include: Low bandwidth, low quality of

service, high cost, the need for additional equipment, and high utilization of devices’ battery power

Data Networking WLANs and broadband wireless

New Testing Tools – Test Automation

Test Automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions

Often seen as a time saver Testing frameworks are also used

JUnit and NUnit Helped to drive test driven development

Partial automation tools are useful as well Product installation, test data creation, GUI interaction,

problem detection, defect logging

Testing the Effectiveness of Integrating New Technologies

Determine the Process Maturity Level of the Technology

Test the Controls over Implementing the New Technology

Test the Adequacy of Staff Skills to Use the Technology

Determine the Process Maturity Level of the Technology

1. People-Dependent Technology The technology is available to use by individuals at their

discretion2. Use Description-Dependent Technology

Processes There are processes in place for the technologies use,

but projects can vary from those processes if desired3. Use of Technology

The processes are determined to be effective and compliance to those processes are required

4. Quantitatively Measured Technology Once the processes are determined to be effecting, they

should be measured – need to make sure that the data collected is reliable before optimizing processes

5. Optimized Use of Technology The data from level 4 will enable the optimization of the

use of technology

Test the Controls over Implementing New Technologies Testing actual performance vs. Stated

performance Does the technology accomplish its stated benefits? Assumptions about new technology don’t have the

experience behind them that older technologies have Documentation represents actual technology execution Training courses transfer the needed knowledge to use

the technology New technology is compatible with existing technology Stated performance criteria represent actual

performance criteria Promised vendor support equals actual vendor support Expected test processes and tools are effective in

testing new technologies

Test the Controls over Implementing New Technologies Test the Adequacy of the Current

Processes to Control the Technology Do implemented work processes assure the technology

will be used in an effective and efficient manner? Work Process – Standards, Procedure, and Quality

Control Compliance – Management’s desires that workers follow

the procedures Enforcement – What happens when procedures aren’t

followed

If testers determine that processes are not adequate Identify risk and report it Identify potentially ineffective parts of the process Conduct tests to identify specific problems and

assessing the potential impact on the end product

Test the Adequacy of Staff Skills to Use the Technology

Professional processes have two parts Process itself Competency of the process user to use that process

effectively

To test the adequacy of Staff skills to use the new technology tester should look into: Technological process maturity level Training available in the new technology The performance evaluation of individuals to use the new

technology

THANKS

YOGESH KHAIRNAR