Rerunning failed tests using IRetryAnalyzer,ITestResult in TESTNG
TESTNG is a java framework used by JAVA Developers to perform unit testing of their code.
We can even use TESTNG for Selenium to automate the manual testcases and verify the output by inserting
the Soft Assertions and Hard Assertions. TESTNG generates the reports once the testcase run completed.
It generates the test-output directory with results in index.html and emailable-report.html. It also generates the testng-failed.xml for the tests which are failed in the Suite. Now it is possible to re-run the failed tests.
Mostly the Selenium tests will fail due to multiple reasons, one of them is NoSuchElementException this occurs due to TimeOut Issues where the element takes time to display. In those cases it would be good to re-run and fix the issues.
Steps for Implementing the Retry Logic:
1. IRetryAnalyzer is an interface which has to be implemented the Class RerunTests.java.
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
import org.testng.IRetryAnalyzer; import org.testng.ITestResult; public class RerunTests implements IRetryAnalyzer { private int retryCount = 0; private static final int maxRetryCount = 2; @Override public boolean retry(ITestResult result) { if (retryCount < maxRetryCount) { retryCount++; return true; } return false; } } |
2. Write the TestNG Testcase that has to be re-run. Use TESTNG attribute retryAnalyzer and provide the value for the attribute as RerunTests.java.
|
1 2 3 4 5 6 7 8 9 10 11 12 |
import org.testng.Assert; import org.testng.annotations.Test; public class SanityTests { @Test(retryAnalyzer = RerunTests.class) public void m1() { Assert.assertTrue(false);//Fail the testcase } } |
3. Finally the failed testcase executes as per the retryCount mentioned in the RerunTests.java.
Rerun Failed Tests using Retry Logic