TechValidate Research on TestRail by Gurock

These pages present data that TechValidate has sourced via direct research with verified customers and users of TestRail by Gurock. TechValidate stands behind the authenticity of all published data. Learn more »



990 Customers Surveyed

7,971 Data Points Collected

85 Published TechFacts

15 Published Charts

19 Published Case Studies



Selected Research Highlights


TestRail Customer Research

As a Tester, what are your top pain points?

Identifying risks and issues (bugs) - testing the product/project/people/process
48%
Communicating what has been identified, in the right way, to the right person, at the right time - so it gets the necessary attention
43%
Technology - staying on top of trends, tools, techniques, and technologies so as to be best placed to deal with current and emerging challenges
42%
Managing their environment - for testing and often for development (of scripts, test code etc) also
39%
Time - focusing energies on the most important things, knowing when to escalate or ask for help
38%
Learning about the product/project/domain - to better identify and contextualize risks/issues and how best to communicate them
31%
People - developing strong relationships with developers, other testers, BA’s/PO’s/PM’s
23%

TestRail Customer Research

80% of teams using Zephyr for Jira saw measurable increases in productivity after switching to TestRail.

Since adopting TestRail, what increase in productivity have you realized?

More than 20% (save 6+ hours per week): 18%
10% - 20% (save 3 – 6 hours per week): 37%
5% - 10% (save 2 – 3 hours per week): 25%
Less than 5% (save less than 2 hours per week): 20%

TestRail Case Study

Medium Enterprise Agriculture Company

Introduction

This case study of a medium enterprise agriculture company is based on a June 2019 survey of TestRail customers by TechValidate, a 3rd-party research service. The profiled company asked to have their name blinded to protect their confidentiality.

Love that we can use the API to populate test results. Great for automated and manual tests.

Challenges

The business challenges that led the profiled company to evaluate and ultimately select TestRail:

  • Said the following are their top software testing pain points:
    • Identifying defects in the application
    • Keeping up with changes in techniques and technology

Use Case

The key features and functionalities of TestRail that the surveyed company uses:

  • Has 2-20 Testers on their team.
  • Used TestLink prior to using TestRail by Gurock.
  • Integrated TestRail by Gurock with the following issue tracking tools:
    • JIRA
  • Using the following as test automation tools:
    • Selenium

Results

The surveyed company achieved the following results with TestRail:

  • Seen a more than 20% (save 6+ hours per week) increase in productivity since adopting TestRail by Gurock.
  • TestRail by Gurock helped solve the top challenges of:
    • Documenting test cases and plans
    • Tracking the progress of test runs
    • Producing useful testing reports
    • Analyzing testing trends over time
  • Realized the following benefits with TestRail:
    • Increased efficiency

TestRail Case Study

Ript Labs

Introduction

This case study of Ript Labs is based on a July 2017 survey of TestRail customers by TechValidate, a 3rd-party research service.

“The value is incredible. Efficiency executing daily / weekly tests, simplicity of usability, UI friendliness, ability to integrate a broad number of 3rd party tools. So far only one of the Test Management tools that completely meets our needs.”

“With Jira integration, failing test cases and creating bugs instantly works as a charm and really saves a lot of time for other team needs. In the long term, we plan to automate most of our test cases, which also will be very beneficial having Jira integration.”

Challenges

The business challenges that led the profiled company to evaluate and ultimately select TestRail:

  • Top pain points as a Tester:
    • Testing the product / project / people / process to identify risks and issues (bugs)
    • Communicating what has been identified, in the right way, to the right person, at the right time so it gets the necessary attention
    • Managing their environment for testing and development (of scripts, test code, etc.)
    • Learning about the product / project / domain to better identify and contextualize risks / issues and how best to communicate them
    • Focusing energies on the most important things and knowing when to escalate or ask for help
    • Developing strong relationships with developers, other testers, BA’s/PO’s/PM’s
    • Staying on top of trends, tools, techniques, and technologies so as to be best placed to deal with current and emerging challenges
  • Top challenges that require Test Management:
    • Clearing requirements (dev team is building the wrong product)
    • Insight into development progress (tests as indicators of progression, tests as documentation, bugs and issues as indicators of risks, process challenges, etc.)
    • Deployment and the idea that progressing through various environments with associated (possibly automated) testing will increase confidence that the product can be deployed successfully and will work properly in a production situation
    • Maintenance and reproduction / documentation / communication of customer support issues, production telemetry, and testing

Use Case

The key features and functionalities of TestRail that the surveyed company uses:

  • Has a single Testers on their team.
  • Used the following test management tools prior to TestRail:
    • TestLink
    • Zephyr Enterprise
    • Spira Team
  • Integrated the following tool with TestRail:
    • JIRA

Results

The surveyed company achieved the following results with TestRail:

  • Increased their productivity by more than 20% (saved 6+ hours a week) after switching their software testing solution.
  • Realized the following benefits with TestRail:
    • Increased efficiency
    • Improved flexibility due to ease of use
    • Received transparent pricing with good value
    • Enjoyed the user and team friendly User Interface (UI)
    • Agreed it was easy to integrate with 3rd party tools
    • Improved productivity because it was easy to train users

TestRail Customer Testimonial

While still running manual e2e tests for new versions TestRail was an invaluable tool for ensuring that we had really good coverage of our app.

QA Analyst, Medium Enterprise Retail Company

TestRail Customer Testimonial

Due to the integration with JIRA, the test-coverage for the user-stories can be easily exposed to the whole team, test-cases and test-results are exposed to the JIRA user. The traceability for test-automation and past defects is also helping us to increase efficiency.

QA Manager, Medium Enterprise Computer Software Company



More to Explore



About TestRail by Gurock

Gurock builds tools for software teams and quality assurance departments.

TestRail by Gurock Website   Idera, Inc. Website