I am evaluating various test automation tools and was wondering which one has the best error recovery (for batch processing). I am currently looking at QTP and RFT, but it appears that you have to manually code for script playback errors in RFT. At least with QTP you can set scripts to be skipped if an error occurs, so others can continue to process. Any comments from experienced users on this?
test partner is a good of eror recovery tool
TestComplete can continue processing after an error, and additionally provides exception handling within the scripting languages used for more precisely controlled error handling. Personally, I find this useful on large regression tests that are typically run unattended at night. All the results are presented in the log file in a tree view, with red for failure and green for pass. If the root is green, everything passed, if not I can drill down for failures at project, suite, test, and line level. While I haven't used the other vendors tools, I imagine that this type of approach would be pretty common.
Note that for any type of automation effort where you intend to re-use the same scripts with a changing application under test, you will have to do a fair amount of manual coding, even if you are using the recorder to build your initial scripts.
RFT can be configured to abort the tests upon encountering an exception, or continuing with the script, or even on to the next script in the suite. Any exception handling is derrived from the exception hadling set in it's own super helper class.
I run a few different suites of test on a few machines ranging from 2 - 48 hours, dependant on release, and from the results file (html or text), and additional text from the exception handling.
I think Shane hit the nail on the head in the above post, it is a farly common approach. It would probably depend on your app, and the types of errors you encounter.
Are you looking for a tool that will run a suite of tests, aborting on each script with exceptions, and continue processing the next? Most tools should be able to do this.
You must log in to post.
Video embedded using Easy Video Embed plugin