That start button screw up wasnt nice... it turned out to be something that only happened occasionally, and on some devices more often than others. Our test challenge is obviously the growing number of Android devices running different versions of Android, coupled with the growing number of features within the app which need to be validated. To address this problem, we actually have been working on an internal tool to validate each release. The plan was to move Party PhotoBooth onto this validation tool after the 1.7 release, which means running each new version through a set of automated tests that simulate user behaviour, on many devices in parallel. Its unfortunate that the plan was one release too late to prevent this start button bug from going into production, but the good news is that Party is now on our new test tool—yksp The video is showing yksp running two test scripts, one after another, on a few devices concurrently. One script goes through the UI, clicking buttons to create 10 photo strips as a user would in Self-serve mode, while the other script does the same in Automatic mode. The entire test took about 10 minutes, and a lot of data was collected throughout the process to ensure the app was behaving as expected on every connected device. Version 1.8 passed this test, while version 1.7 failed when the start button eventually became inactive. Over time, more tests will be added, and each release will be put through the cumulated set of fully-automated test cases before it reaches our beta track. Bugs... gotta catch em all before they make it out the door! Our new Python-based test tool, yksp, is now available as open-source—benhylau.github.io/yksp/ Feel free to fork and/or contribute!
Posted on: Mon, 06 Oct 2014 05:08:11 +0000
Trending Topics
Recently Viewed Topics
© 2015