I gave http://hexawise.wordpress.com/2009/09/18/efficient-and-effective-test-design/ - this presentation to software testers at a recent meeting of TISQA (a regional, American testing organization). It addresses
how tools like Hexawise can help software testers quickly identify the
test cases they should execute to find as many defects as possible while using
as few tests as possible.
The presentation focused on combinatorial testing techniques, such
as pairwise testing, orthogonal array-based testing methods, and more
thorough combination testing strategies (capable of identifying all
defects that could be captured by, say, any possible combination of
three or four “things” that you’ve decided to test for (regardless of
whether those “things” include features configurations or equivalence
class of data or type of user a mix of each).
The middle of the presentation also highlights empirical evidence
that shows this method of identifying test cases often has an enormous
impact on how quickly software testers are able to identify defects;
citing the IEEE Computer article I co-wrote last month on Combinatorial
Testing, this approach – on average – led to more than twice as many
defects found per tester hour.
The final section of the presentation was delivered by Lester Bostic
of Blue Cross Blue Shield and addresses his lessons learned. Lester
used Hexawise to reduce 1,356,136,048,589,996,428,428,909,447,344,392,489,476,985,674,792,960 possible tests (that would have been necessary to achieve comprehensive testing of the application he was testing) to only 220 tests
that proved to be extremely effective at identifying defects. <Side
note: No, that absurdly large number that has 51 digits after the “1″
is not a typo; it makes me smile every time I see it>.
Comments and questions are welcome. Free access to the Hexawise test case generator is available at http://www.hexawise.com/users/new - http://www.hexawise.com/users/new
------------- - Justin
___________________________
Founder and CEO of Hexawise
www.hexawise.com
"More coverage. Fewer tests."
|