TechValidate Research on TestRail by Gurock

15 Charts


TestRail Customer Research

TestRail helps QA and development teams solve their business challenges.

What are the top business challenges that TestRail helps you solve?

Documenting test cases and plans
85%
Tracking the progress of test runs
79%
Producing useful testing reports
37%
Balancing the testing team's workload
24%
Tracking defects from discovery to resolution
20%
Managing exploratory testing sessions
17%
Analyzing testing trends over time
16%
Accurately estimating the time remaining in a test cycle
14%
Other
4%

TestRail Customer Research

76% of TestRail users report measurable increases in productivity.

Since adopting TestRail, what increase in productivity have you realized?

More than 20% (save 6+ hours per week): 15%
10% - 20% (save 3 – 6 hours per week): 28%
5% - 10% (save 2 – 3 hours per week): 32%
Less than 5% (save less than 2 hours per week): 24%

TestRail Customer Research

80% of teams using Zephyr for Jira saw measurable increases in productivity after switching to TestRail.

Since adopting TestRail, what increase in productivity have you realized?

More than 20% (save 6+ hours per week): 18%
10% - 20% (save 3 – 6 hours per week): 37%
5% - 10% (save 2 – 3 hours per week): 25%
Less than 5% (save less than 2 hours per week): 20%

TestRail Customer Research

Which test management tool did you use prior to TestRail?

Zephyr for Jira: 16%
TestLink: 15%
Test Management for Jira: 11%
Microfocus ALM (HP QC/ALM): 10%
Microsoft Test Manager: 5%
HipTest: 2%
QAComplete: 2%
QTest: 2%
Xray: 2%
Zephyr Enterprise: 1%
Microfocus Octane: 0%
Other: 34%

TestRail Customer Research

What are your top software testing pain points?

Having adequate time for testing
49%
Managing the test environment including data, scripts, automation code, etc.
48%
Identifying defects in the application
37%
Reporting and tracking defects from discovery to resolution
32%
Collaborating with other team members: testers, developers, product owners, etc.
29%
Keeping up with changes in techniques and technology
23%
Learning about the application under test
16%
Other
8%

TestRail Customer Research

Number of Testers on the team?

150+: 2%
101-150: 2%
61-100: 2%
41-60: 3%
21-40: 8%
2-20: 71%
Individual Tester: 11%

TestRail Customer Research

What are the top benefits your organization has realized with TestRail?

Increased efficiency
67%
User & team friendly User Interface (UI)
63%
Improved flexibility due to ease of use
49%
Ease of training resulting in faster productivity
37%
Easy integration with 3rd party tools
35%
Transparent pricing with good value
18%

TestRail Customer Research

As a Tester, what are your top pain points?

Identifying risks and issues (bugs) - testing the product/project/people/process
48%
Communicating what has been identified, in the right way, to the right person, at the right time - so it gets the necessary attention
43%
Technology - staying on top of trends, tools, techniques, and technologies so as to be best placed to deal with current and emerging challenges
42%
Managing their environment - for testing and often for development (of scripts, test code etc) also
39%
Time - focusing energies on the most important things, knowing when to escalate or ask for help
38%
Learning about the product/project/domain - to better identify and contextualize risks/issues and how best to communicate them
31%
People - developing strong relationships with developers, other testers, BA’s/PO’s/PM’s
23%

TestRail Customer Research

Business Challenges that Require Test Management

What are your top business challenges that require Test Management?

Insight into development progress -- tests as indicators of progression, tests as documentation, bugs & issues as indicators of risks, process challenges etc.
51%
Maintenance -- reproduction/documentation/communication of customer support issues, production telemetry, and testing
49%
Deployment -- progression through various environments with associated (possibly automated) testing increases confidence that the product can be deployed successfully and will work properly in a production situation
47%
Clear requirements -- dev team building the wrong product
41%
Fit for purpose development practices -- dev team building the product wrong
19%

TestRail Customer Research

What are the top benefits your organization has realized with TestRail?

Increased efficiency
65%
Improved flexibility due to ease of use
50%
Transparent pricing with good value
14%
User & team friendly User Interface (UI)
59%
Easy integration with 3rd party tools
37%
Ease of training resulting in faster productivity
34%

TestRail Customer Research

Tools Integrated with TestRail

What Tools have you integrated with TestRail?

JIRA
78%
GitHub
10%
Redmine
4%
TFS
3%
Visual Studio
2%
Bugzilla
1%

TestRail Customer Research

What are your top business challenges that require Test Management?

Clear requirements - dev team is building the wrong product
41%
Fit for purpose development practices - dev team building the product wrong
18%
Insight into development progress - tests as indicators of progression, tests as documentation, bugs & issues as indicators of risks, process challenges etc
50%
Deployment - progression through various environments with associated (possibly automated) testing increases confidence that the product can be deployed successfully and will work properly in a production situation
42%
Maintenance - reproduction/documentation/communication of customer support issues, production telemetry, and testing
47%

TestRail Customer Research

Since switching Software Testing solutions, what increase in productivity have you realized?

More than 20% (save 6+ hours a week): 17%
10% - 20% (save 3 – 6 hours a week): 33%
5% – 10% (save 2 – 3 hours a week): 30%
Less than 5% (save less than 2 hours a week): 20%

TestRail Customer Research

Switched to TestRail From:

What Test Management Tool did you use prior to TestRail?

Quality Center
22%
TestLink
17%
Zephyr Enterprise
13%
QAComplete
4%
Test Collab
3%
TestMonitor
3%
qTest
3%

TestRail Customer Research

Which JIRA add-on tool did you switch from?

Zephyr
70%
Adaptavist Test Management (Kanoah)
3%
PractiTest
3%
QMetry
3%
Other
20%



More Research on TestRail by Gurock