Home » 2012

Tag: 2012

Mobile App Update Testing

During the development process of mobile apps manual and automated testing is highly recommended. But there is another test you should do before releasing or submitting your app to a store. Testing the update procedure! Testing the update procedure from the current store version to the new release candidate is really important and it is often not done by developers or QA experts. With this test you verify, that the new app is not affecting the old installed version. Here are three facts that will be covered with that test.

Test that the update…

  • … will not logout a user from the app e.g. before the update he was logged in.
  • … will not affect the local database e.g. existing data will not be modified or deleted.
  • … will be installed correctly from the store (simulation).

You can also test the update from far older versions to the latest one, to see what is happening.
For the two big players Android and iPhone I will describe, how to test the update from one version to another using different tools.

iOS
On the iOS side there are two ways of testing the update procedure. The first one can be done with iTunes. See also the Technical Note TN2285 from Apple.

  1. Build an adhoc app version of the app that is currently live in iTunes store. HINT: This version must have the same bundle identifier as the new app.
  2. Be sure that no older versions of the app are installed within iTunes and on your test iOS device (Sync with iTunes to be sure).
  3. Drag the app from step 1 into iTunes and sync the version to your test device.
  4. Launch the app and do some manual testing to see that the app is working.
  5. Build the new release candidate version of the app and drag it to iTunes and sync to the device. iTunes should confirm, that the older version will be removed. HINT: DO NOT delete the old build! In the next step iTunes will install the new app over the old one and will simulate the update from the app store.
  6. Launch the new version and see if everything is ok.

The second way of testing the update procedure for iOS is using the iPhone Configuration Utility. Using this tool is more comfortable, especially if you want to test the update procedure on more iOS test devices like iPhone 3G, iPhone 3GS, iPhone 4(S), iPhone 5 or iPads.

  1. Build an adhoc app version of the app that is currently live in iTunes store. HINT: This version must have the same bundle identifier as the new app.
  2. Be sure that no older versions of the app are installed on the test device.
  3. Install the app from step 1 to the devices you want to check.
  4. Launch the app and do some manual testing to see that the app is working.
  5. Build the new release candidate version of the app and install it with the tool. The update procedure will be simulated.
  6. Launch the new version and see if everything is ok.


Android
The same can be done also on the Android side. To test the update for Android you can use adb to simulate the procedure.

  1. Install the current Google Play store version of your app to your phone.
  2. Check that the version is working.
  3. Build a release candidate of the Android app. HINT: Be sure to sign the release candidate with the Play store keystore.
  4. Use the following command to test the update procedure:
    ./adb install -r APPNAME.apk. The option -r means reinstall the app and keeping its data.
  5. The new version is now installed and can be tested.

That’s it! Try it for your next release!

Greets!

Tap Into Mobile Application Testing by Jonathan Kohl

Mobile mobile mobile is everywhere!
If you are in the field of mobile app testing you maybe want to read the book “Tap Into Mobile Application Testing” from Jonathan Kohl (@jonathan_kohl). Jonathan gathered lots of very interesting topics about mobile app testing. His book ist currently in a beta phase! If you buy the e-book now, you get all the updates for free. The book costs $14,99 and you will get a PDF, EPUB and MOBI format to read it of course on your mobile device!Tap Into Mobile Application Testing

In this book, you will learn:

  1. How mobile devices work: features, affordances and how to effectively use them when testing.
  2. How to use thinking tools to provide structure to your testing and test idea generation.
  3. How to test and recognize common failures on devices.
  4. How to log bugs well on mobile projects.
  5. How to create a test strategy that makes the best use of your time and resources.
  6. How important it is to incorporate physical movement into your testing.

Get the book here.

Greets!

Video collection of the mobile testing summit 2012

Today I found a youtube video collection of the mobile testing summit that took place this year in San Francisco (1st Nov. 2012). The Mobile Testing Summit is a 1 day event organized and hosted by Sauce Labs (http://saucelabs.com). For those who missed the summit, check out the nice video collection on youtube!

Topics:

  • iOS Driver for Native Apps
  • Sikuli for Mobile Testing
  • Intro to Bwoken
  • Calabash: Cross-Platform, Automated Acceptance Testing for Mobile Apps
  • Shared Cross-Platform Tests with Frank
  • Lightning Talks!
  • Closing Lightning Talks & Remarks by Jason Huggins
  • Opening Keynote by Jason Huggins
  • Mobile First: Rebuilding Facebooks’s engineering and testing for mobile
  • Eideticker & Orangutan: Measuring real-world browser performance
  • Settings Apple’s UI Automation Free wit Appium
  • iOS Automated Testing with Calabash: Tips and Tricks
  • MOET: Mobile End-to-End Testing
  • iOS Automation with iPhone Driver
  • Automating Firefox OS: One Solution to Rule them All

http://www.youtube.com/MobileTestingSummit

Have fun!

 

 

A mnemonic for mobile app testing

Again a big thank you to @the_qa_guy who pointed me to the COP FLUNG GUN created by Dhanasekar Subramanian. The nice mnemonic (overview) of mobile app testing give a good overview of the complexity of mobile app testing. I found the overview of the blog of Adam Goucher who extended the mnemonic with the section of mobile automation.

created by Adam Goucher

Find a similar mind map here.