Upload File

“an automated tool designed to ease the pain of test creation and maintenance.” nil weerasinghe...

  • Home
  • Documents
  • “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim
16
“An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

Upload: lorraine-gallagher

Post on 20-Jan-2016

219 views

Category:

Documents


6 download

Report

TRANSCRIPT

Page 1: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

“An automated tool designed to ease the pain of test creation and maintenance.”

Nil WeerasingheBryan RobbinsMohamed Ibrahim

http://www.wnilkamal.com/
http://www.cs.umd.edu/~brobbins/js/index.html#default
http://mibrahim.com/
Page 2: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 2

About FINRA

￭ Financial Industry Regulatory Authority

• Largest independent regulator for all securities firms doing business in the U.S.

• ~4,500 brokerage firms• ~163,500 branch offices• ~634,400 registered securities

representatives

Arial Body Copy

Providing independent, vigorous regulation

Educating & informing investors

Inviting active industry involvement

& input

Actively supportingfirms’ compliance

efforts

Our Mission:Investor Protection. Market Integrity.

Computerized certification and continued education.

Series 7, 63 …etc.

Page 3: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 3

FINRA Open Source Projects

￭ Increase Community Involvement

￭ FINRA Open Source Projects• http://finraos.github.io/

￭ DataGenerator• http://finraos.github.io/DataGenerator/

￭ JTAF-ExtWebDriver• http://finraos.github.io/JTAF-ExtWebDrive

r/

http://finraos.github.io/
http://finraos.github.io/
http://finraos.github.io/DataGenerator/
http://finraos.github.io/DataGenerator/
http://finraos.github.io/JTAF-ExtWebDriver/
http://finraos.github.io/JTAF-ExtWebDriver/
http://finraos.github.io/JTAF-ExtWebDriver/
Page 4: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 4

How to get involved.

￭ Use it

￭ Extend it• Fork it• Discuss idea

– Open ticket– Google group discussion– [email protected]

• Commit– DCO and ApacheV2

￭ Report bugs

￭ Help document http://finraos.github.io/DataGenerator/

https://github.com/FINRAOS/DataGenerator

mailto:[email protected]
http://finraos.github.io/DataGenerator/
http://finraos.github.io/DataGenerator/
https://github.com/FINRAOS/DataGenerator
https://github.com/FINRAOS/DataGenerator
https://github.com/FINRAOS/DataGenerator
Page 5: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 5

Agenda

• What is the DataGenerator?

• Demo.–Dependency Modeling

–Pairwise Data Generation.

• Current Limitations.

• Re-architecture plan.

• Questions

Page 6: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 6

Video

http://www.youtube.com/watch?v=Wxa1T0gp56k

http://finraos.github.io/DataGenerator/

http://www.youtube.com/watch?v=Wxa1T0gp56k
http://www.youtube.com/watch?v=Wxa1T0gp56k
http://www.youtube.com/watch?v=Wxa1T0gp56k
http://finraos.github.io/DataGenerator/
http://finraos.github.io/DataGenerator/
Page 7: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 7

Current Approach

￭ Two ways to describe and generate datasets• Equivalence Classes + Combinations• Dependency Model + Graph Coverage

￭ Both use Apache Velocity to generate output from templates

DataSpec

Model Datasets Outputs

Page 8: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 7

Demo

￭ Pairwise Combinations• Uses equivalence classes from

DataSpec to populate datasets

￭ All Paths• Uses annotations from graphical

model to populate datasets

DataSpec

Model

Page 9: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 8

Limitations of Current Approach

￭ Limited set of graph annotations• Can only set variable values within model• No support for logic, pos/neg equivalence classes in current version• We need more powerful annotation

￭ Logic often split across spec, model, and templates• Anything dynamic must be injected into Velocity template, as model and

spec are both static• We need more dynamic evaluation

￭ Performance considerations• Breadth-first enumeration doesn’t scale well as domain becomes more

complex• We need more performant implementation

Page 10: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 10

Re-architecting Data Generator

￭ Replacing Visio with SCXML, an open standard to represent the state machine.

<scxml xmlns="http://www.w3.org/2005/07/scxml" xmlns:cs="http://commons.apache.org/scxml" version="1.0" initial="start">

<state id="start"> <transition event="RECORD_TYPE" target="RECORD_TYPE"/> </state>

<state id="RECORD_TYPE"> <!-- Mandatory --> <onentry> <assign name="var_out_RECORD_TYPE" expr="set:{a,b,c}"/> </onentry> <transition event="REQUEST_IDENTIFIER" target="REQUEST_IDENTIFIER"/> </state>...

Page 11: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 11

Re-architecting Data Generator

￭ SCXML Allows for complex modelling using embedded EL

<state id="PRODUCT_TYPE_CODE"> <!-- Mandatory --> <onentry> <assign name="var_out_PRODUCT_TYPE_CODE" expr="#ProductTypeCode_Cycle"/> </onentry> <transition event="OPTIONS_SYMBOLOGY_IDENTIFIER" target="OPTIONS_SYMBOLOGY_IDENTIFIER" cond="${var_out_PRODUCT_TYPE_CODE=='Derivatives-Options'}" /> <transition event="OPTIONAL_SECURITY_SYMBOL" target="OPTIONAL_SECURITY_SYMBOL" cond="${var_out_PRODUCT_TYPE_CODE!='Derivatives-Options'}" /> </state>...

Page 12: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 12

Re-architecting Data Generator

￭ SCXML Allows for complex modelling: A state can be written as a state machine itself

￭ We’re using apache commons-scxml in out POC

Page 13: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 13

Re-architecting Data Generator

￭ Overcoming memory issues by enhancing the all-paths algorithm, use DFS with minimal memory overhead

Page 14: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 14

Re-architecting Data Generator

￭ Short demo:<scxml xmlns=http://www.w3.org/2005/07/scxml xmlns:cs=http://commons.apache.org/scxml version="1.0" initial="start"> <state id="start"> <transition event="RECORD_TYPE" target="RECORD_TYPE"/> </state>

<state id="RECORD_TYPE"> <onentry> <assign name="var_out_RECORD_TYPE" expr="set:{a,b,c}"/> </onentry> <transition event="REQUEST_IDENTIFIER" target="REQUEST_IDENTIFIER"/> </state>

<state id="REQUEST_IDENTIFIER"> <onentry> <assign name="var_out_REQUEST_IDENTIFIER" expr="set:{1,2,3}"/> </onentry> <transition event="MANIFEST_GENERATION_DATETIME" target="MANIFEST_GENERATION_DATETIME"/> </state>

<state id="MANIFEST_GENERATION_DATETIME"> <onentry> <assign name="var_out_MANIFEST_GENERATION_DATETIME" expr="#{nextint}"/> </onentry> <transition target="end"/> </state>

<state id="end"> </state></scxml>

http://www.w3.org/2005/07/scxml
http://www.w3.org/2005/07/scxml
http://www.w3.org/2005/07/scxml
http://commons.apache.org/scxml
http://commons.apache.org/scxml
http://commons.apache.org/scxml
Page 15: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 15

Re-architecting Data Generator

￭ Restructure the code to allow Hadoop Map Reduce and Giraph to operate on it.

￭ Data Generator won’t itself directly depend on Hadoop or Girpah, but will abstract the following:• Input: Allow input from files• Execution: Allow the execution from a middle state provided input variables• Output: Allow outputs to different formats text files, several files, gz. The

user will be able to extend the output to support: sequence files, redshift, hbase

Page 16: “An automated tool designed to ease the pain of test creation and maintenance.” Nil Weerasinghe Bryan Robbins Mohamed Ibrahim

American University Presentation Copyright 2011 FINRA 16

Re-architecting Data Generator


Multifarious Website for Indian Railway Engineersirtsa.net/...Railway-Officers-Rest...Centers-Halls.pdf · AC room Non AC AC Room Non AC AC Room Non AC Nil Nil Nil Room Nil Nil Nil

Sir Visvesvaraya Institute Of Technology, Nashiksvitnashik.in/NAAC/Criteria_5/5.4.1_Audited_Statement_of_Association.pdfPlace: Nashik Date:- Nil Nil Nil Nil Nil Nil Nil Nil Nil 120823

~ SAKTHI FINANCE · 11 Sakthi Financial Services (Cochin) P Ltd 1861336 6.18 Nil Nil Nil Nil Nil Nil Nil 6.18 12 Sakthifinance Financial Services Ltd 3391775 11.27 3391775 100.00

Scanned by CamScanner · NIL NIL NIL cast in against resolution of NIL NIL NIL whose votes E-V0tin Ballot TOTAL (iii) Invalid votes: Type Votin E-Votin Ballot of Total number of members

House of Lords Publication of Financial Support for Members … · 2020. 8. 28. · Lord Alton of Liverpool Lancashire 15 0 4,695 1,359 Nil Nil 32 1,135 Nil Nil Nil 192 Nil Nil Nil

lakshitha weerasinghe

SUNRISE ENTERPRISES · Rexona Deodorant Stick (Invisible Dry) 45 ml 8718114202389 6 Nil Nil Nil Europe English Nil NIL TRESemme Shampoo 500 ml `022400624181 Nil Nil Nil Nil Nil Nil

Certified True Copy - National Stock Exchange of India . intimates . 2890500 . 20.0318 . nil . nil . nil. fasidon limited. 2: harshad hirji . 230177 . 1.5952 . nil : nil. nil. thakkar

Primary ( STC CODE ) - JK Cement plant’s kiln. NIL NIL NIL (b) From Pollution Control Facilities Nil Nil Nil PART –E ... No discharge of rain water or waste water from the mine

CloudCamp. Richard Weerasinghe, ElasticBox - 'Cloud-Enabling Enterprise Applications

THE AEROSPACE CORPORATION...039 nil nil 085 nil nil 086 nil nil 114 nil nil 207 59 50 Table I lists all McMath plage regions observed at 3. 3 -mm wave-length from 1 July 1972 - 15

,Wi...Mizo 01 Nit Nil Nil Nil 01 1.2 Economics Nil 08 14 Nit Nil 22 13 Sanskrit Nil Nil t2 01 01 14 1.4 Commerce Nil 01 L5 01 01 18 15 Kak-barak 10 04 05 Nil Nil 19 1.6 Geography

cgwb.gov.incgwb.gov.in/INTRA-CGWB/documents/IPR 2018.pdfResale Flat Purchased vide Sale deed No-586/481 date 0902.2017 of Ranchi ( Nil Nit Nil Self occupied Nii Nil Nil Nil Nil Nil

citi settlement signed by biden weerasinghe maverick graber west $7b

BROOKEFIELDS REAL ESTATES AND PROJECTS PRIVATE LIMITED · Mr. Roshin Mathew 4 (Four) Yes Nil Nil Mr. Dinesh Meel 5 (Five) Yes Nil Nil Mr. Mohan Parvatikar 5 (Five) No Nil Nil Ms

Human – Computer Interaction By: Tharindu Weerasinghe BSc.Eng(Hons), AMIE(SL), AMCS(SL)

Phyto80n04 336 - American Phytopathological Society manufacturer's instructions and the restriction digests were ... Nil Nil Nil Nil Nil Nil VCG group 0021 0021 0021 0021 0021 0021

Scanned by CamScanner - Nagaon ISLAM.pdf · b) UBI, Haibargaon Branch A/C No- 2062010044679 Rs.1000/- Nil Nil Nil Spouse 40,000 Nil Nil Nil Nil Dependen Nil SBI, Khutik atia Branch

r.saregama.comr.saregama.com/resources/pdf/Annexure_C_20160723.pdfNil NIL NIL NIL NIL NIL NIL NIL NIL NIL % of Votes in favour on votes Polled *100 100 NIL NIL 100 NIL NIL NIL NIL

 · Prerana Mordina Dipannita Ghosh Kuldeep Sharma Akarsh Bajpai Remarks Nil Nil a) Copy of original M.Sc. pass certificate not produced Nil Nil Nil Nil Academic Registrar Indian

I ilEtrffi - Warangal · 2018. 11. 17. · 1)TVS Scooty (2010) value of Rs.10,000/-Nit Nil Nil N.A Nit Nit Nil Nit N.A VIII NiI Nil Nil Nil N.A IX Gross Total Value 1,60,000/-Nit

of Contract/Arti.pdf · Nil Nil Nil Nil Nil Nil Nil Compliance Compliance Compliance Better Compliance ... or Airway Bill (Tenderers may quote the earliest delivery period)

103.23.150.75103.23.150.75/Affpdf/48ManeArvind.pdf · Swapnil Arvind Mane Nil Nil Nil Nil Nil Nil Nil Depen dent -3 Etc Name Sourabh Arvind Mane Nil Nil Nil Nil Nil Nil Nil Description

MASTER OF OPERATIONAL RESEARCH (MOR) (Effective ......III 03 04 12 01 04 04 01 04 04 Nil Nil Nil 20 IV Nil Nil Nil Nil Nil Nil 03 04 12 01 08 08 20 Total Credits for the Course 48

LPMA Madeira - ivao.ptivao.pt/book/public/files/LPMA.pdf · Airport • NIL Navaids • NIL Runway • NIL SID • NIL STAR • NIL Procedures • NIL Minima • NIL Others • NIL

Fo (sc) Bjorn Behr A Window in Bo Kaap Altered Reality (ar) Nil Nil Portrait (po) Nil Nil Still Life (sl) Nil Nil Open (op) John Coumbias Stroll in the Park Beginner (bg) Nil Nil 14

REPORT ON CORPORATE GOVERNANCE FORMING ...A NNUAL EPORT 201819 71 Shri Sanjiv Singh Nil 5 Nil Nil 4000 Shri B. C. Tripathi Nil 4 Nil Nil Nil Dr. T. Natarajan 6 3 4 Nil Nil Dr. Jyoti

No Email Address...Comments Nil Return Nil Return Nil Return Nil Return Nil Return Nil Return Nil Return Nil Return Nil Return Nil Return Nil Return

GST GST VER 2.7/SUVIDHA SOC/WPC/03-20 · Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil ^# GST GST Speed Clearing Nil Nil Nil Nil - Nil Nil Nil - The following benefits will be applicable

sindh.gov.pk · Web viewAkbar Ali Lala PresidentMuhammad khan G.Secretary Nil Nil Nil Nil Nil membership Fee Nil Not paid not audited unactive 54 Al Ithad welfare Association village

A F ENTERPRISES LIMITED - valueresearchonline.com F ENTERPRISES LIMITED ... 61,206 27,677 1,65,716 3,90,000 Nil Nil Nil Nil Nil ... DIN : 02994228 DIN : 03603706M. No. A40303 Neeraj

ceoassam.nic.inceoassam.nic.in/election/AE2016/AbstractStatement/19/BidyaSingEngleng.pdf3199856044300 Nil Nil Nil Nil Nil (Rupees, Fifteen lakhs) only Sl. No. Date 18-03-16 Nil Nil

INFORMATION CIRCULAR - ArcWest Exploration Inc....Nil Nil Nil Nil Nil Nil Nil Donald Lay Former Director 2018 2017 13,560 Nil Nil 15,000 Nil Nil Nil Nil 13,560 (5) 15,000 (5) Brien

 · 2019-10-21 · Total uanti 2017-18 4922651 MT Nil Nil Nil Nil durin the ear 2018-19 4123077 MT Nil Nil Nil Nil All the tailings of beneficiation plant are being discharged to

DEPT: ENERGY HOD: NREDCAP · 1 Sri Y. Yella Reddy, DGM (F&A) 1 .. CPIO HO NIL 07 07 05 02 04 2 13 PIOs for 13 Districts headed by District Managers Nil Nil Nil Nil Nil Nil 3 Total