Original Research on TestRail

TestRail Case Study

Creative Mobile Technologies

Introduction

This case study of Creative Mobile Technologies is based on a July 2017 survey of TestRail customers by TechValidate, a 3rd-party research service.

“The initial test ‘solution’ had great risks of not catching issues before being deployed. Now we test every piece of functionality, adding new test points as issues are found, and going back in time should questions arise about when an issue was found, noted as still an issue, fixed and still fixed.”

Challenges

The business challenges that led the profiled company to evaluate and ultimately select TestRail:

Top pain points as a Tester:
- Testing the product/project/people/process to identify risks and issues (bugs)
- Communicating what has been identified, in the right way, to the right person, at the right time so it gets the necessary attention
- Learning about the product/project/domain to better identify and contextualize risks/issues and how best to communicate them
Top challenges that require Test Management:
- Deployment and the idea that progressing through various environments with associated (possibly automated) testing will increase confidence that the product can be deployed successfully and will work properly in a production situation
- Maintenance and reproduction/documentation/communication of customer support issues, production telemetry, and testing

Use Case

The key features and functionalities of TestRail that the surveyed company uses:

Has 2-20 Testers on their team.
Used the following test management tools prior to TestRail:
- None
Integrated the following tools with TestRail:
- JIRA

Results

The surveyed company achieved the following results with TestRail:

Realized the following benefits with TestRail:
- Increased efficiency
- Improved flexibility due to ease of use
- Enjoyed the user and team friendly User Interface (UI)
- Improved productivity because it was easy to train users
- Being able to track the progress of our solutions

TestRail Customer Fact

Metersit has integrated TestRail by Gurock with Mantis.

TestRail Customer Research

Number of Testers on the team?

150+: 2%

101-150: 2%

61-100: 2%

41-60: 3%

21-40: 8%

2-20: 71%

Individual Tester: 11%

TestRail Case Study

Autodesk, Inc.

Introduction

This case study of Autodesk, Inc. is based on a July 2019 survey of TestRail customers by TechValidate, a 3rd-party research service.

TestRail works really fast. It has a clean simple UI. . . .
Most important is that TestRail has a really good workflow and intuitive test case management.

Challenges

The business challenges that led the profiled company to evaluate and ultimately select TestRail:

Said the following are their top software testing pain points:
- Identifying defects in the application
- Managing the test environment including data, scripts, automation code, etc.
- Learning about the application under test
- Having adequate time for testing
- Collaborating with other team members: testers, developers, product owners, etc.

Use Case

The key features and functionalities of TestRail that the surveyed company uses:

Has more than 150 Testers on their team.
Used ClearQuest prior to using TestRail by Gurock.
Integrated TestRail by Gurock with the following issue tracking tools:
- JIRA
Using the following as test automation tools:
- Ranorex Webtestit

Results

The surveyed company achieved the following results with TestRail:

Seen a more than 20% (save 6+ hours per week) increase in productivity since adopting TestRail by Gurock.
TestRail by Gurock helped solve the top challenges of:
- Documenting test cases and plans
- Tracking the progress of test runs
- Managing exploratory testing sessions
- Accurately estimating the time remaining in a test cycle
- Balancing the testing team’s workload
- Producing useful testing reports
- Analyzing testing trends over time
- Having and organizing all in one place.
Realized the following benefits with TestRail:
- Improved flexibility due to ease of use
- Enjoyed the user and team-friendly User Interface (UI)
- Agreed it was easy to integrate with 3rd party tools
- Improved productivity because it was easy to train users

TestRail Customer Research

76% of TestRail users report measurable increases in productivity.

Since adopting TestRail, what increase in productivity have you realized?

More than 20% (save 6+ hours per week): 15%

10% - 20% (save 3 – 6 hours per week): 28%

5% - 10% (save 2 – 3 hours per week): 32%

Less than 5% (save less than 2 hours per week): 24%

TestRail Customer Testimonial

The main point is that it forces us to have strong practices for authoring and running test cases; maintaining consistency across global teams is a challenge. Now I can ask a team to tell me:
a) how much it will cost (in hours) to run a test suite
b) when testing will be complete and
c) what the results of test runs are (reports)

— Development Manager, Medium Enterprise Computer Software Company

TechValidate Research on TestRail

These pages present data that TechValidate has sourced via direct research with verified customers and users of TestRail. TechValidate stands behind the authenticity of all published data. Learn more »

About TechValidate Research

Selected Research Highlights

Creative Mobile Technologies

Introduction

Challenges

Use Case

Results

Company Profile

About TestRail

Autodesk, Inc.

Introduction

Challenges

Use Case

Results

Company Profile

About TestRail

76% of TestRail users report measurable increases in productivity.

More to Explore

About TestRail

TestRail is the only platform that empowers QA teams to build, connect, and optimize all their testing processes. Lift your team out of chaos and toward faster, frictionless releases. TestRail – Orchestrate testing, elevate quality.