Original Research on TestRail

TestRail Case Study

Pumb

Introduction

This case study of PUMB is based on a June 2019 survey of TestRail customers by TechValidate, a 3rd-party research service.

“Using TestRail improves efficiency and quality in the product life cycle.”

Challenges

The business challenges that led the profiled company to evaluate and ultimately select TestRail:

Said the following are their top software testing pain points:
- Identifying defects in the application
- Reporting and tracking defects from discovery to resolution
- Collaborating with other team members: testers, developers, product owners, etc.

Use Case

The key features and functionalities of TestRail that the surveyed company uses:

Has more than 150 Testers on their team.
Integrated TestRail by Gurock with the following issue tracking tools:
- JIRA
Using the following as test automation tools:
- Selenium
- SoapUI

Results

The surveyed company achieved the following results with TestRail:

Seen a 10% – 20% (save 3 – 6 hours per week) increase in productivity since adopting TestRail by Gurock.
TestRail by Gurock helped solve the top challenges of:
- Documenting test cases and plans
- Tracking the progress of test runs
- Accurately estimating the time remaining in a test cycle
- Balancing the testing team’s workload
- Producing useful testing reports
- Analyzing testing trends over time
Realized the following benefits with TestRail:
- Increased efficiency
- Improved flexibility due to ease of use
- Enjoyed the user and team-friendly User Interface (UI)
- Improved productivity because it was easy to train users

TestRail Customer Research

Since switching Software Testing solutions, what increase in productivity have you realized?

More than 20% (save 6+ hours a week): 17%

10% - 20% (save 3 – 6 hours a week): 33%

5% – 10% (save 2 – 3 hours a week): 30%

Less than 5% (save less than 2 hours a week): 20%

TestRail Case Study

Ript Labs

Introduction

This case study of Ript Labs is based on a July 2017 survey of TestRail customers by TechValidate, a 3rd-party research service.

“The value is incredible. Efficiency executing daily / weekly tests, simplicity of usability, UI friendliness, ability to integrate a broad number of 3rd party tools. So far only one of the Test Management tools that completely meets our needs.”

“With Jira integration, failing test cases and creating bugs instantly works as a charm and really saves a lot of time for other team needs. In the long term, we plan to automate most of our test cases, which also will be very beneficial having Jira integration.”

Challenges

The business challenges that led the profiled company to evaluate and ultimately select TestRail:

Top pain points as a Tester:
- Testing the product / project / people / process to identify risks and issues (bugs)
- Communicating what has been identified, in the right way, to the right person, at the right time so it gets the necessary attention
- Managing their environment for testing and development (of scripts, test code, etc.)
- Learning about the product / project / domain to better identify and contextualize risks / issues and how best to communicate them
- Focusing energies on the most important things and knowing when to escalate or ask for help
- Developing strong relationships with developers, other testers, BA’s/PO’s/PM’s
- Staying on top of trends, tools, techniques, and technologies so as to be best placed to deal with current and emerging challenges
Top challenges that require Test Management:
- Clearing requirements (dev team is building the wrong product)
- Insight into development progress (tests as indicators of progression, tests as documentation, bugs and issues as indicators of risks, process challenges, etc.)
- Deployment and the idea that progressing through various environments with associated (possibly automated) testing will increase confidence that the product can be deployed successfully and will work properly in a production situation
- Maintenance and reproduction / documentation / communication of customer support issues, production telemetry, and testing

Use Case

The key features and functionalities of TestRail that the surveyed company uses:

Has a single Testers on their team.
Used the following test management tools prior to TestRail:
- TestLink
- Zephyr Enterprise
- Spira Team
Integrated the following tool with TestRail:
- JIRA

Results

The surveyed company achieved the following results with TestRail:

Increased their productivity by more than 20% (saved 6+ hours a week) after switching their software testing solution.
Realized the following benefits with TestRail:
- Increased efficiency
- Improved flexibility due to ease of use
- Received transparent pricing with good value
- Enjoyed the user and team friendly User Interface (UI)
- Agreed it was easy to integrate with 3rd party tools
- Improved productivity because it was easy to train users

TestRail Customer Fact

Integral Technology Solutions Inc has integrated TestRail by Gurock with FogBugz and Manuscript.

TestRail Customer Satisfaction Rating

A QA Manager at a medium enterprise computer software company would be very likely to recommend TestRail for this reason:

TestRail Customer Research

76% of TestRail users report measurable increases in productivity.

Since adopting TestRail, what increase in productivity have you realized?

More than 20% (save 6+ hours per week): 15%

10% - 20% (save 3 – 6 hours per week): 28%

5% - 10% (save 2 – 3 hours per week): 32%

Less than 5% (save less than 2 hours per week): 24%

TechValidate Research on TestRail

These pages present data that TechValidate has sourced via direct research with verified customers and users of TestRail. TechValidate stands behind the authenticity of all published data. Learn more »

About TechValidate Research

Selected Research Highlights

Pumb

Introduction

Challenges

Use Case

Results

Company Profile

About TestRail

Ript Labs

Introduction

Challenges

Use Case

Results

Company Profile

About TestRail

76% of TestRail users report measurable increases in productivity.

More to Explore

About TestRail

Gurock builds tools for software teams and quality assurance departments.