Print Page | Close Window

Efficient and Effective Test Design

Printed From: One Stop Testing
Category: Quality Assurance @ OneStopTesting
Forum Name: Quality Methodologies / Streams @ OneStopTesting
Forum Discription: Any Good Testing Engineer must know about All the Quality Certifications & Methodologies like ISO, IEEE, CMM, PCCM, CMMMi, XP, Agile and many more.
URL: http://forum.onestoptesting.com/forum_posts.asp?TID=7035
Printed Date: 26Nov2024 at 9:54pm


Topic: Efficient and Effective Test Design
Posted By: JustinH
Subject: Efficient and Effective Test Design
Date Posted: 22Sep2009 at 2:18am

I gave http://hexawise.wordpress.com/2009/09/18/efficient-and-effective-test-design/ - this presentation to software testers at a recent meeting of TISQA (a regional, American testing organization).  It addresses how tools like Hexawise can help software testers quickly identify the test cases they should execute to find as many defects as possible while using as few tests as possible. 

The presentation focused on combinatorial testing techniques, such as pairwise testing, orthogonal array-based testing methods, and more thorough combination testing strategies (capable of identifying all defects that could be captured by, say, any possible combination of three or four “things” that you’ve decided to test for (regardless of whether those “things” include features configurations or equivalence class of data or type of user a mix of each).

The middle of the presentation also highlights empirical evidence that shows this method of identifying test cases often has an enormous impact on how quickly software testers are able to identify defects; citing the IEEE Computer article I co-wrote last month on Combinatorial Testing, this approach – on average – led to more than twice as many defects found per tester hour.

The final section of the presentation was delivered by Lester Bostic of Blue Cross Blue Shield and addresses his lessons learned.  Lester used Hexawise to reduce 1,356,136,048,589,996,428,428,909,447,344,392,489,476,985,674,792,960 possible tests (that would have been necessary to achieve comprehensive testing of the application he was testing) to only 220 tests that proved to be extremely effective at identifying defects.  <Side note: No, that absurdly large number that has 51 digits after the “1″ is not a typo;  it makes me smile every time I see it>.

Comments and questions are welcome.

Free access to the Hexawise test case generator is available at http://www.hexawise.com/users/new - http://www.hexawise.com/users/new





-------------
- Justin
___________________________
Founder and CEO of Hexawise
www.hexawise.com
"More coverage. Fewer tests."



Print Page | Close Window