July 29th, 2016: This version of the Windows App Certification Kit is available to test apps for Windows 10, Version 1607 and earlier.
The following is a list of known issues with the Windows App Certification Kit:
The App Prelaunch Validation test will fail if you run the kit on a version of Windows 10 released before version 1607. Note that this test is not run as part of the final certification for Windows Store submissions.
Resolution: To ensure the results of this test are accurate, test with version 14393 of the Windows 10 SDK (14393) on Windows 10, Version 1607.
During testing, if an installer terminates but leaves active processes or windows running, the app certification kit may detect that there is still work to be done by the installer. In this case, the kit appears stuck running the "Process Install Trace Files" task and it's not possible to move forward with the UI.
Resolution: After your installer is complete, manually close any active processes or windows spawned by the installer.
For ARM UWA, or any UWA app that doesn't target the device family desktop or OneCore, a message may appear in the final report that states “Not all tests were run during validation. This may impact your Store submission.”. This message does not apply in cases where the user didn't manually deselect tests.