Infrastructure
- automated tests run on each build on a predefined set of supported OS
- automated bugs creation
- full set of artifacts should be automatically collected for bug analysis. Ex.: logs, dumps, VM snapshots
Product test checklist
In additional to product specific functional/integration testing some general checks should be setup:
- checks for app crash
- checks for app hang
- checks for app timings: ex. service start/stop in a reasonable time
- (optional) checks for errors in logs. Ex.: when component trace something with defining ERROR trace level meaning that something going wrong with It