19-Dec-2017
Reporting In Test Automation And Features of “Extent Report” In Automation Test Reports
By Amit Rajput
19-Dec-2017
By Amit Rajput
In software test automation after completion of the test suite execution we need to have a report for the execution status and it is the only way of evidence for the “Pass” and “Fail” status of the tests. And most of the clients bother about the detailed report of the execution status. Most of the licensed automation testing tools will have an inbuilt rich report option to show the execution status. But coming to open source automation tools lacking in this option. Same way, Selenium also does not have the test automation report generation option by default. But to execute the test suite, selenium is depending on unit testing frameworks like TestNG and Junit.
Automation test engineers are supposed to test the application by running their automation test suit, find bugs and report it to the team in such a manner that they can easily understand the execution result.
After test suite executions using TestNG or Junit, by default they will give the HTML reports, but the information provided by these extent reports are not so good in terms of one page summary of the test, though that can also be emailed to the team and stakeholders of the project but still have a good scope of improvement.
To avoid this, we have other options like XSLT reports, these are much better than normal TestNG and Junit reports. These will give a pie chart to represent the PASS, FAIL and SKIP test cases. Apart from this PIE Chart, it will not give any more information in the generated HTML report. If we want any other information we need to write separate code.
To overcome the above type of reporting issues, we would like to suggest using Extent Reports, which provide very interactive and one-page email-able reports. These are very good and rich HTML reports. By using these reports we can provide a lot of information to the reports. These will also give the status in the form of PIE Charts, tables, list view and mixed-mode.
In automation testing importance of reporting is so high. Reporting format varies from stage to stage. It may be category wise, types of testing involved or on an individual basis. Graphical representation using pie charts, tables and graphs make the presentation of the report better and easy to understand.
Extent Report is an HTML reporting library for Selenium WebDriver for Java which is to a great degree simple to use and makes excellent execution reports. We can use this tool within our TestNG automation framework. We just need to define core objects of Extent Report in our automation framework after that we can call and user required features of Extent Reporting in our test scripts.
As an automation tester its an obligation to catch great reporting and present it to the administration group. So below are more interactive features that Extent Report provides and we need to know:
1. Status will be shown in the form of a PIE chart.
2. Can replace the existing report with the new report or append the new status to the existing report.
3. We can change the display order of the tests (i.e. oldest test at the top, newest at the end or newest test at the top, oldest at the end)
4. Can generate ONLINE or OFFLINE reports.
5. Can give our own name to the test method (i.e. can change the test method name in the report).
6. Can generate stepwise log information in the report.
7. Can segregate the tests using Test Categories.
8. Can give author name to display in the report.
9. Can add a text node as a child of another test.
10. Can insert custom HTML in the logs by using an HTML tag.
11. Can show the screenshots in the report wherever we need.
12. Can add a recording of your test runs in the report.
13. Can add our own information in the report.
14. Can give our own name to the HTML report.
15. It will give the System information in the report (i.e. HostName and OS used to execute the test suite.)
1. Extent Reports will create the report file.
2. Extent Test will log the information in the report.
3. StartTest()method of ExtentReports class is the starting point of the test and it will return the ExtentTest object.
4. We need to capture that object into the ExtentTest object.
5. Used this reference to log the information into the report.
6. ExtentReports object will be used to add the report information like Title, Header and Theme etc..
7. And the above configuration needs to pass from the external XML file using the loadConfig()method of ExtentReports class. It will take the XML file path as an argument.
8. EndTest()method of ExtentReports will stop capturing information about the test log.
9. Flush()method of ExtentReports will push/write everything to the document.
10. Close()method of ExtentReports will clear/close all resources of the ExtentReports object.
Extent Report comes in HTML Format having 3 sections:
1. Dashboard: Overall Report of the Test Case
2. Category: Category wise Result
3. Tests: Individual Test Case Result
As you open the HTML report you will be redirected to Dashboard. It will display the overall execution report status.
It will display category-wise execution report status.
It will display individual execution report status. It’s a useful storehouse having an extraordinary Extent HTML report. Each association ought to utilize this report as the yield of the UI Automation is in an easy to use report in which non-technical or management people can understand easily which test case is working appropriately and which is not.
Amit Rajput
Amit works as a Senior Performance Test Engineer and has conducted load/ performance test executions for various mobile, web and client server applications. He has good analytical skills of system performance and behavior.
Interested to share your
Read More
BugRaptors is one of the best software testing companies headquartered in India and the US, which is committed to catering to the diverse QA needs of any business. We are one of the fastest-growing QA companies; striving to deliver technology-oriented QA services, worldwide. BugRaptors is a team of 200+ ISTQB-certified testers, along with ISO 9001:2018 and ISO 27001 certifications.
Corporate Office - USA
5858 Horton Street, Suite 101, Emeryville, CA 94608, United States
+1
(510) 371-9104
Test Labs - India
2nd Floor, C-136, Industrial Area, Phase - 8, Mohali -160071, Punjab, India
+91 77173-00289
Corporate Office - India
52, First Floor, Sec-71, Mohali, PB 160071,India
United Kingdom
97 Hackney Rd London E2 8ET
Australia
Suite 4004, 11 Hassal St Parramatta NSW 2150
UAE
Meydan Grandstand, 6th floor, Meydan Road, Nad Al Sheba, Dubai, U.A.E
