Crowdsourced Quality Assurance & Code Coverage

Crowdsourced QA is on the rise – and for good reason. Companies offering the service boast faster times to market, reduced testing costs, higher product quality, increased peace of mind, and better confidence during release. Disadvantages to this testing approach exist, too, like the lack of the testers’ code coverage information. Does this mean that black-box testing and code coverage are mutually exclusive? No.

We’ll explore four scenarios where crowdsourced QA is beneficial for a development team and where code coverage analysis coupled to it enhances the product quality. These scenarios are:

[1 – ] manual testers who are spread geographically
[2 – ] outsourced testing to a firm that uses a dedicated framework for, e.g., GUI testing
[3 – ] Beta-version testing coupled with profiling to determine which sections of the source code are most utilized
[4 – ] Security-conscious teams who are not permitted to share source code to the “crowd.”

We’ll examine each scenario using a commercial code coverage toolchain, and, through practical Qt application examples, we’ll demo application instrumentation, merging the crowd’s coverage reports, profiling, and more.

All QtDevCon22 Videos: https://www.youtube.com/playlist?list=PL6CJYn40gN6h5jKSLw0cEsKficprxd2iX

QtDevCon22 Website:
https://www.qtdevcon.com/