TestRail Reviews

Great product allowing us to keep history of our testing and specifically regression testing of our software development team

Find some reporting can be difficult, but in general it is a great tool for managing our regression testing test cases, and ensuring that they have all been run.

Hello Bruce, thank you for taking the time to share such a detailed review of your experience using TestRail. We are always looking to improve the experience for all users. If you could share any more detailed feedback around what you'd like to see differently in the reporting capabilities (either here or by sending us a few screenshots at contact@gurock.com) that would be very much appreciated!

Ease of use. Simple and intuitive flow for the workflows that can be customized based on your work.

Traceability is based on how you configure. Little confusing if you try to explain to users not familiar with the tool.

Thank you for your review! Our experts are working hard towards improving TestRail's user experience, especially for beginners.

TestRail's simple UI and functionality is straight forward. Easy for people to jump in and use the tool, assuming that the tool fits Dev/QA's team workflow and method of usage. For the administrator, access is easily manageable, and provides multiple categories for restricting access and defining user roles within the organization.

TestRail is no different than other test management systems, beside the front end and UI benefits. TestRail is good for teams who initiate test planning, test case creation, and management specific to older QA management styles. When introducing continuous integration testing into a development/QA' teams methodology, this is where TestRail needs improvement . TestRail does not do a good job logging...

Read more

The product is constantly developing. A lot of functionalities - API, test structure, reports, bug integrations, milestones, etc. Ease of use. Customizability. Integration with other software (e.g. Jira, Cypress, etc.)

Minor bugs. Quite a high price. Rather plain design (not really intuitive)

I love the way they setup billing, every month you it automatically detects how many active users you have and you pay for that instead of being roped into a set amount of licenses. This has been incredibly helpful as we've gone through hiring, layoffs, and bringing on offshore contracted workers. Great flexibility! Another thing I like a lot are the UI Scripts, where you can customize the instance adding in or removing features and functionality. They are very powerful and super useful for us.

It bugs me that every time you close a test run the test case id numbers have a huge spike, a case we created today had the id number of over 11 million even though we have less than 50,000 cases total in our library. I also do not like the way you add and remove tests from a run. It is a bit awkward and hard to see exactly what tests you're adding and removing.

I think report generation is the strong suit of Test rail, the percentage pie chart of passed, failed blocked cases at a glance make daily reporting for scrum stand up meetings ideal. Integration with Jira is excellent, although some room for improvement.

Trying to do something simple like import test case steps from a .csv is not so easy. You can import a suite but that is not ideal. Trying to duplicate cases can be tedious, let's say you have a lot of cases, trying to copy paste them in to various projects is a lot of hassle, it is surprising they have not addressed issues like this after so many years.

Thank you, Neil, for taking the time to share such a detailed review of your experience using TestRail. We are always looking to improve the experience for all users. If you could share any more detailed feedback around what you'd like to see differently in the interface for importing and copying test cases (either here or by sending us a few screenshots at contact@gurock.com) that would be very much appreciated!

I'm using this tool everyday at my work, create test cases, tracking their status, and also create different reports to see the status. This tool works fast, has good user friendly design, by tracking results you can get an email notification.

Didn't find any drawbacks its really fast and convenient in using, also help to keep all info in one place.

Hi Yana, thanks so much for leaving us a review! Super glad to hear how useful TestRail has been for supporting and streamlining your QA work. Feel free to reach out to us at contact@gurock.com if there's ever anything we can do to help! - Matt C from TestRail

- Web based - doesn't require a localized server installation (unless you want to) and can be accessed by anyone with credentials, no matter where they are located without any effort - Very easy to use and gives you a very neat category division when it comes to test cases, test runs and milestones

Can't search and replace words in multiple test cases at the same time which makes it harder to re-use existing test cases with only small changes

It's very easy to use, with different kind of configurarions and customizations.

The tests scenarios are not versioned. There's not possibility to see previous changes or have different versions of them.

Thanks David! We'll take your feedback into consideration!

I like test case creation and test case execution also one of the best features is the variety of test reporting. Testrail also supports UI Customization.

Administration navigation bit confusing. Some browsers in encountered issues with Jira integration.

The ease of use for maintaining, connecting and sharing test cases are unrivaled. The platform is so feature rich every time I think of a feature I want to request they already have it!

Takes a good amount of time to spin up a valuable framework. I think this can be mitigated by some test case best practices or maybe a super-user demo within the platform.

Thank you for your review. TestRail's team regularly holds free live webinars on how to use TestRail - the are also available on demand: https://www.gurock.com/testrail/webinars?utm_source=adwords&utm_medium=cpc&utm_campaign=dach_en_dsa&utm_content=&gclid=Cj0KCQjw09HzBRDrARIsAG60GP_ehxFpBMXyq4LpRnrpbUWQtfZSisx5yVS9728coJKu3wSHmoKbsesaAlTxEALw_wcB You can also watch our training videos here: https://www.youtube.com/watch?v=O-KDkGJYA2k&list=PL0VF8QJoqsVjVIr-KFpquhGidVQxGbSIo

- This is the receipt of real-time test results (creating reports on completely different criteria: Defect Summary, Comparison for Cases, test results for projects / components, etc.) - This is an easy organization and convenient tracking of the load of the testing department (the ability to fully customize the "working dashboard" of the QA department) - Easy installation, deployment and support -...

Read more

As one of the drawbacks - until recently, Test Report system was poorly implemented reporting system: scant results on test-wounds, lack of customization of reports, etc.

Thank you so much for the detailed feedback, Vladimir! We really appreciate it. We have improvised on the reporting capabilities of TestRail and would love to hear from you in case of any additional feedback or comments.

First of all, TestRail is an extremely smarter way to track and maintain test cases than using Excel. I like how easy it is to create new projects, create custom fields, create test runs, and generate good looking reports to submit to your managers. The GUI takes a little bit to get used to, but once you get a hand of all of the key-shortcuts moving around the application is easy!

My least favorite part about this software is the JIRA plug in. In order to see the linked test cases from TestRail in JIRA, you need to have a TestRail account. In my company only the testing team had TestRail accounts, while the rest of R&D didn't. While it was helpful for me as a tester to see the linked test cases on a JIRA bug, when we started off with TestRail we had assumed everyone in the R&D department would be able to see this information so we could be more transparent in our testing. My company was not willing to pay for 100 TestRail accounts, so this was a bummer. If yours is then TestRail might be right for you!

1. Ability to create test plans and test case for multiple features at once. 2. Ability to configure test cases in combination for different environments and browsers, OS etc. 3. Ability to present detailed reports to stakeholder and management. 4. Integration with Jira eases the need to map to a user story. 5. The test plan hierarchy helps to create test cases easily and it helps reduce redundancy between test cases. 6. Very easy to navigate using the user interface. 6. Ability to lock a test plan where it can no further be modified. 7. Able to run test cases in multiple environment and check the run history. 8. Able to download and email reports to management.

Searching for a past completed story is difficult unless to navigate from Jira. Marking a test case run as passed has too many steps involved. Id love if it has ability to record screen as well as attaching screenshot to a test step/ I'd also love if I can pass/fail each step of a test case and not the test case as a whole.

-TestRail provides easy management of test-suites, test-cases, test-runs. Easy management for maintaining agile methodology in the project. -Feature to export/import files for test-cases from xml, csv and xls files. -The provision to define milestones can be useful for maintaining release-wise goals. -The User can define the expected duration and priority for a test-case. - The representation and reporting are the best part of this software, the user can see the progress of the test-run in various formats as pie-chart.

- Test results should be editable as required in some cases.

Hello Prasuk, thanks for your awesome feedback. We really appreciate it. Also, you can now modify test results. This permission can be enabled by administrators using the Administration > Site Settings > User Interface > Editing Test Results field. Please note that any test modifications must still take place within the period defined in Admin > Site Settings > User Interface > Editing Test Results field. Please do not hesitate to write to us at contact@gurock.com in case of any additional feedback/comments.

For me the best thing about TestRail is the visual representation of the test results in the form of graphs, This gives me a quick and easy idea about the stability of the tested software, another thing that is very useful is the format of test suites and test runs.

I think importing testcases from excel can be made a little easier with better mapping and easy uploads.

i have using this tool for my every day test execution before this i was using our own company proprietary tool and then we switched to TestRail as we switched to agile methodology. i have found this quite useful in agile environment. it is scalabe and can be customised accordingly to suite the customer/test requirement. it is now integrated to our companies other tools like JIRA(bug tracker tool),github,automated...

Read more

No cons were added to this review

Thanks so much from the TestRail team Bheesam for taking the time to complete this review.

- The system of test suites (a master list of all your test cases) and test runs (individual lists of specific test cases) is well-built and allows you to manage your test cases easily. - Product is consistently stable. - Test cases in different parts of the product have synced states, which makes it easy to make changes to a test case when necessary. - Tools for sorting test cases in a run/suite are powerful.

- There isn't a good tutorial for the product (or at the very least I never saw anything like a tutorial). As a result, it took me a while to notice some of the more unintuitive features. - Collaboration can be a bit clunky sometimes (multiple users editing a single test case, notifications at email level only).

Thank you so much for your detailed feedback, Chandler! We have added a few useful video content to make the onboarding experience better. Please check out this page for more details: https://www.gurock.com/testrail/support Let us know in case of any additional feedback/comments. We're actively listening :)

One thing I like the most about the software is the ability to create and share reports on test results.

The thing I like least about the software is the test-case review process is not very streamlined.

TestRail helps to manage the test runs and test plan in much simpler way. Adding or changing test plan is allowed during execution is a huge plus.

Unable to recover deleted test cases, as once I accidentally deleted a test suite when I was trying to delete a test plan. Also bulk option to mark test cases Pass / Failed / Blocked is not possible Don't know if there is a option to link Jira test cases.

Thank you for your review! We hope you can find some useful answers here: https://discuss.gurock.com/t/is-there-any-way-to-recover-deleted-test-cases/2967

The best thing about TestRail is their REST API. Thanks to it we were able to easily implement its integration with our test automation framework. In particular we were able to map test exucution statuses to TestRail test case statuses and allow updating them easily for test reruns. Second good thing is reports they allow to generate. That's what our managers wanted.

Sometimes UI is not intuitive. For instance, it took a while to figure out how to change test cases status in bulk.

Thank you so much for your review. We have forwarded the feedback to the concerned team in TestRail. Please do not hesitate to write to us at contact@gurock.com in case of any additional feedback/comments.

Its very easy to add the test scenarios in the existing Test Run. We can create multiple Test runs and could create a lot many reports with different filters. As an admin too its very easy for me to give specific access to different members in my team.

There should be some report format where I could show the Stories, linked Test scenarios, linked defects and their status in more readable way. As of now its there but I feel their is a need of more clarity in the reports.

Hello Manish, thank you for taking the time to share such a detailed review of your experience using TestRail. We are always looking to improve the experience for all users. If you could share any more detailed feedback around what you'd like to see differently in the reports (either here or by sending us a few screenshots at contact@gurock.com) that would be very much appreciated!

- Intuitive UI system that allows you yo easily organize test suites, test runs, and projects. - Sync logged bugs to the test cases you're testing for transparency. - Reporting and the ability to estimate testing allows for you to gather more information easily.

- It can be quite expensive for small teams, but it's well worth it. - Creating test cases in TestRail is pretty tedious (which is why I typically just import them). - Reporting system is a little complicated to understand and utilize effectively.

Thank you! Your feedback means a lot to us. Can definitely appreciate your feedback on the price point too; the tier-based pricing discounts on TestRail don't really start to kick in until you have 20 or more users. That said, we'll take your comment into consideration as we continue to plan how we can make TestRail more accessible to teams like yours in the future.

Right off the bat the software is very easy to use The software allow us to manage our time effectively focussing on running regression tests on any particular task. It has been a useful tool for our Quality Assurance team to prioritize and organize test cases. The fact that we can implement the use of Jira is also a huge plus since this is a tool we also use within our organization.

Not many cons, the only two minor aspects that come to mind are one if you have no knowledge of how to use it does take some time to learn it. However if you have even the basic background on a tool like this the learning time does shorten. The other is the fact that results can only be shared with the registered users, so we are having to take screen shots of results to share with the rest of our company teams.

1- versatility to create Projects which allow base line Test Cases to be used in a variety of different test runs for different products. 2- ease of being able to import test cases from existing methods

The main issue I have is the Projects are listed as a flat-file. We have several different groups which have created Projects and even though they might be testing a given entity from different sides, they have to name their Projects differently. We prefix each project with a Group Name so the Projects can be "grouped" and easily referenced from the main dashboard. Another less important issue is there isn't really an easy way to make a backup of our entire Dashboard. We can Export each Project but I don't see any way to make backups of anything else outside of offloading each individual entity which really isn't all that hard.