Observations from the new Mobile Sandboxes – a series that centers on areas of improvement as we work on raising the bar for the community and increase value for our customers.
At this time, some test cycles still require that "first to the bug" competition, so we are not removing that part of the community culture. However, we are adding to it and raising the bar for some of the tester community. Through the Sandbox 201 programs, we are pushing for only high quality bugs.
Customers challenge us to find the Exceptionally valuable bugs and the Sandbox 201 program requires testers to meet that challenge.
At this time, some test cycles still require that "first to the bug" competition, so we are not removing that part of the community culture. However, we are adding to it and raising the bar for some of the tester community. Through the Sandbox 201 programs, we are pushing for only high quality bugs.
- •Quality over speed – clearly documented, Exceptionally valuable bugs over quick, first found Somewhat valuable bugs. Observations from the initial pilots of our Premier/Plus and Mobile Sandbox 201 projects, show that there is a twist in the method that infuses the uTester Community - first to the app, first to the bug, first to the money. That does not guarantee high quality bugs which create higher value engagements for the customer. Some customers do not want to see the Somewhat valuable bugs, only the Exceptionally valuable bugs. In most cases, it takes time to discover and clearly document these bugs, so they are unlikely the first in the issues list or be found in the first 10 minutes of a cycle.
•Quality over quantity – one Exceptionally valuable over 10 Somewhat valuable bugs. In the Mobile Sandbox cycles, I am consistently seeing many testers rush to cut a bug/any bug instead of finding an EXCEPTIONAL bug. Because many of our customers now demand the highest quality bugs for any pay out, the Sandbox 201 test cycles are graded based on the quality of the bug and the quality of the documentation. Testers cannot pass the Sandbox 201 test cycles with a Somewhat valuable bug at all or an Exceptionally valuable bug that is poorly documented. Testers need to take time and find the quality bugs in these sandboxes. That is the goal, as the customers push uTest to raise the bar.
Customers challenge us to find the Exceptionally valuable bugs and the Sandbox 201 program requires testers to meet that challenge.