paweł gutowski - test automation for database solutions

12
© 2013 Acxiom Corporation. All Rights Reserved. © 2013 Acxiom Corporation. All Rights Reserved. Paweł Gutowski Test Automation for Database Solutions 2015-04-09

Upload: trojmiejska-grupa-testerska

Post on 06-Aug-2015

93 views

Category:

Software


2 download

TRANSCRIPT

© 2013 Acxiom Corporation. All Rights Reserved. © 2013 Acxiom Corporation. All Rights Reserved.

Paweł Gutowski

Test Automation for Database Solutions

2015-04-09

© 2013 Acxiom Corporation. All Rights Reserved.

Agenda

• Acxiom• Solution description• Engine test automation framework• End 2 End test automation framework• CI approach• Questions

© 2013 Acxiom Corporation. All Rights Reserved.

Acxiom

• Who we are?• What do we do?

© 2013 Acxiom Corporation. All Rights Reserved.

Project Description

• Brief description• Engine vs configuration• Why different approaches to automate testing?

© 2013 Acxiom Corporation. All Rights Reserved.

Tools

• Tools & Technologies• Why use similar set as dev team?• Need for reporting

© 2013 Acxiom Corporation. All Rights Reserved.

Engine Test Automation

• Isolated scripts• Golden tables approach

© 2013 Acxiom Corporation. All Rights Reserved.

Engine Test Automation

• Approach pros:- Easy to automate- Quick to run - Catches severe defects early- Can help Test Driven Development

Approach cons:- Harder to maintain (hard to add more data,

easy to add new test)- Harder to get good test documentation

© 2013 Acxiom Corporation. All Rights Reserved.

End 2 End test automation

• End 2 End integration with semi prod files• Configuration changes are frequent• Over 770 audits, but how to make them right?

© 2013 Acxiom Corporation. All Rights Reserved.

End 2 End test automation

• Tests are environment independent (schema etc)• Test framework is data independent (where possible)• Audits SQLs not care about intermediate

processing• Audits use dynamic SQL

© 2013 Acxiom Corporation. All Rights Reserved.

End 2 End test automation

Approach pros:- Easy to add more data files- Easier to maintain - Regression testing for the whole solution- Independent from environment

Approach cons:- Hard to build- Long to run- Does not tell what the failure root cause is

© 2013 Acxiom Corporation. All Rights Reserved.

CI environment

• CI advantages • Nightly vs commit based approach• How did it work for us?

12