Adventures in QA https://adventuresinqa.com Software Testing, Mobile Testing and Agile Development by Daniel Knott Mon, 15 Jul 2019 07:00:50 +0000 en-US hourly 1 80347956 Comparison of Test Automation Platforms https://adventuresinqa.com/2019/07/15/comparison-of-test-automation-platforms/ Mon, 15 Jul 2019 07:00:50 +0000 https://adventuresinqa.com/?p=5705 Test automation, being it web or mobile test automation should be part of every software development team. However, this is still not the case for most of the companies on the market. Whenever I talked to developers, testers or product managers e.g. on conferences the majority of people mention the lack of knowledge, infrastructure or …

The post Comparison of Test Automation Platforms appeared first on Adventures in QA.

]]>
Test automation, being it web or mobile test automation should be part of every software development team. However, this is still not the case for most of the companies on the market. Whenever I talked to developers, testers or product managers e.g. on conferences the majority of people mention the lack of knowledge, infrastructure or time pressure are the biggest hurdles for them to start with automation. But starting with test automation can be much easier when using a test automation platform*. Test automation platforms usually offer e.g. the infrastructure, a list of supported test automation tools and a setup guide.

Test Automation Platforms

In this article, I want to briefly introduce you to test automation platforms with their pros and cons. For the comparison I picked the following platforms:

Depending on the own software development cycle, the used programming languages and toolchain a test automation platform must fulfill different requirements in order to be used most efficiently.

Saucelabs

Pros:

  • Provide support for many browsers, OS and mobile devices
  • Offers a testing cloud with real and emulated devices
  • Support for many open source testing frameworks (Appium, Selenium and more)
  • Visual testing support
  • Rest API access
  • Parallel test execution
  • Infrastructure hosted in the cloud
  • Test execution dashboard
  • Integration to different continuous integration systems
  • VPN Connection to own network
  • Offers lots of resources

Cons:

  • Test execution time can be slower
  • Depending on your setup the price of the hosted service can get expensive

TestProject

Pros:

  • Support for many open source testing frameworks (Appium, Selenium and more)
  • Testing on real devices, web browsers and emulators/ simulators
  • Offers a smart test recorder
  • SDK for Java and .Net Core  for test automation developers
  • Community based Add-ons
  • Rest API access
  • Test execution & report dashboards
  • Ability to easily collaborate with the entire team anywhere around the globe
  • The first test automation platform that offers a free forever plan, that includes all the small-medium size organizations test automation needs (for enterprises or highly advanced clients there’s a pro plan for only $8 per month)
  • Integration to different continuous integration systems
  • Community & team support
  • Offers lots of resources
  • Parallel test execution
  • Supports iOS on Windows

Cons:

  • Currently offers no cloud hosting of devices and browser setups

bitbar

Pros:

  • Real device testing in the cloud or with own hardware
  • Many mobile testing frameworks are supported
  • Test result dashboard
  • REST API access
  • Parallel test execution
  • Integration to different continuous integration systems
  • VPN Connection to own network
  • Lots of resources

Cons:

  • Focus “only” on mobile testing, no web browser testing capabilities
  • Depending on your setup the price of the hosted service can get expensive

BrowserStack

Pros:

  • Provide support for many browsers, OS and mobile devices
  • Many mobile testing frameworks are supported
  • Test result dashboard
  • Parallel test execution
  • Integration to different continuous integration systems
  • REST API access
  • VPN Connection to own network
  • Lots of resources

Cons:

  • Response time of endpoint sometimes slow
  • Depending on your setup the price of the hosted service can get expensive

Summary

As you can see, most of the automation platforms offer a similar feature set. It’s not easy to pick the right platform just by reading the feature specs and the support information material. Every company or team who wants to establish a test automation platform need to invest time to evaluate them. As a starting point, a company should write down their own requirements and the current setup. With this information it might be easier to find the right test automation platform that fits best into the own development infrastructure.

While using the test automation platforms for this post, I was impressed by – TestProject and their offerings, being a first of its kind end-to-end solution that’s completely free and community based. As mentioned in the pros, they offer a smart test recorder (I know what you think now ;), but I will give it a try) and the community add-on support which sounded really interesting to me. To satisfy my curiosity, I will check this platform out and will provide you with some further posts in the next weeks or months.

*Disclaimer: A minimum set of programming skills must be available in order to work with test automation platforms.

Featured Image Source: https://unsplash.com/photos/I5E5e21HRvw

The post Comparison of Test Automation Platforms appeared first on Adventures in QA.

]]>
5705
Including User Feedback to Future Roadmap Planning https://adventuresinqa.com/2019/06/25/including-user-feedback-to-future-roadmap-planning/ Tue, 25 Jun 2019 07:00:28 +0000 https://adventuresinqa.com/?p=5699 Receiving user feedback for digital products can be very painful for companies and especially for the teams developing the product. With the rise of smartphones and mobile apps, mobile users having much higher expectations to the overall product quality and features. According to Google, more than 50% of the customers will leave a web product …

The post Including User Feedback to Future Roadmap Planning appeared first on Adventures in QA.

]]>
Receiving user feedback for digital products can be very painful for companies and especially for the teams developing the product. With the rise of smartphones and mobile apps, mobile users having much higher expectations to the overall product quality and features. According to Google, more than 50% of the customers will leave a web product if the page doesn’t load within 3 seconds. Similar numbers have been revealed by techbeacon for mobile applications.

Leaving bad reviews and rating was never easier than before, as you can see on the image before. For most products, it’s just finger tap away to leave a bad review or feedback. However, companies and software development teams can turnaround the bad and negative feedback and use it to improve the product and to make the customers more happy.

Selecting User Feedback The Right Way

Companies have several ways to collect user feedback inside a product or service. Here is an overview of things that companies can do:

  • Product surveys inside the product
  • Make use of mobile app store reviews
  • Asking people in cafes for direct feedback
  • Invite users to the office or user lab
  • Talk to the customer care department

In my latest post that I wrote for Applause I explained in detail the pros and cons of each feedback collection approach. Furthermore, I explain how the collected feedback can be used to plan future roadmaps.

Read the full article here: https://www.applause.com/blog/how-include-user-feedback-in-roadmap

#HappyTesting

The post Including User Feedback to Future Roadmap Planning appeared first on Adventures in QA.

]]>
5699
Mobile Testing – Online Course https://adventuresinqa.com/2019/06/21/mobile-testing-online-course/ Fri, 21 Jun 2019 06:44:15 +0000 https://adventuresinqa.com/?p=5677 In the beginning of 2019, I launched my mobile testing course in cooperation with Ministry of Testing. In case you haven’t heard about it, this short blog post will give you an idea what to expect from the course which is available on the Dojo from Ministry of Testing. The course name is: A Beginners …

The post Mobile Testing – Online Course appeared first on Adventures in QA.

]]>
In the beginning of 2019, I launched my mobile testing course in cooperation with Ministry of Testing. In case you haven’t heard about it, this short blog post will give you an idea what to expect from the course which is available on the Dojo from Ministry of Testing. The course name is: A Beginners Guide to Mobile Testing and was made for software testers who are new to mobile testing or want to switch from another industry field to mobile. The course teaches you the foundations and will cover all the basics of mobile testing and have even sprinkled in some quick, fun tasks throughout to help you develop new mobile related use cases to implement at your company.

This 9-part course will take you through the fundamentals of testing mobile applications and help you kick start your activities.

The Course Content

The course will cover:

  • The different mobile data networks including the pros and cons.
  • The technical specifications of mobile devices including the architecture as well as the built-in sensors which are used by millions of mobile apps.
  • The different mobile app types and how they can affect your testing activities.
  • The different business models behind apps to aid you in defining a solid mobile testing strategy.
  • The different mobile app stores focusing on Apple and Google.

Beginners Guide to Mobile Testing is approximately 1 hour 30 minutes long and packed with around 3 hours worth of tasks for you to try out as well as extra resources to support you.

Course Resources

There are lots of open resources suggested in the individual Lesson Resources sections, as well as, links to The Club forum where you can share your progress and findings from the authentic testing tasks recommended throughout this course.

In addition, you can take a look at my book “Hands-On Mobile App Testing” which can be used to support your learnings while taking this course.

Prerequisites

It would be advantageous if you have a basic understanding of software testing, but no mobile skills are required.

If you want to checkout the course, take a look at the introduction video here.

#HappyTesting

The post Mobile Testing – Online Course appeared first on Adventures in QA.

]]>
5677
How to Decide on Mobile Bug Fixes https://adventuresinqa.com/2019/06/17/how-to-decide-on-mobile-bug-fixes/ Mon, 17 Jun 2019 08:53:40 +0000 https://adventuresinqa.com/?p=5684 Any software product being it a web, mobile or desktop application is under suspicion unless it proves that the features are working as expected. In short, software is never bug free. Depending on the software product, fixing bugs in production is not easy and in most cases it’s expensive. Let’s take a look on how …

The post How to Decide on Mobile Bug Fixes appeared first on Adventures in QA.

]]>
Any software product being it a web, mobile or desktop application is under suspicion unless it proves that the features are working as expected. In short, software is never bug free. Depending on the software product, fixing bugs in production is not easy and in most cases it’s expensive.

Let’s take a look on how to integrate bug fixes into a native mobile application after the app was released.

Test the App Before the Release

Before a mobile development team is shipping a native app to the app store an intensive testing phase must happen. To minimize the likelihood of doing a hotfix, an extended internal testing phase within the team or company is needed. If the team has the possibility to distribute the app to beta testers or external testing providers to gain early feedback is another approach to take. However, we all know that the real nasty bugs happen in the wild on the customer phones in sometimes weird circumstances.

But how to deal with bugs that have been reported by customers, or the team has found them, after the app was available in the app store?

Is the bug a critical one? Or is it something the team can fix in an upcoming release? Finding the right balance between performing a hotfix or not is not easy.

However, if you want to know how to decide which mobile bugs is worth doing a hotfix and which not, I highly recommend you to read my latest blog post I wrote for Applause here:

https://www.applause.com/blog/how-to-decide-mobile-bug-fixes

#HappyTesting

The post How to Decide on Mobile Bug Fixes appeared first on Adventures in QA.

]]>
5684
5 Tips to Improve your Mobile Testing Skills https://adventuresinqa.com/2019/05/15/5-tips-to-improve-your-mobile-testing-skills/ Wed, 15 May 2019 08:00:45 +0000 https://adventuresinqa.com/?p=5670 The overall quality should always have the highest priority on every software product. This is especially the case for mobile products, since mobile customers have much higher expectations of the software running on their personal devices. To keep up with the constantly changing mobile world, especially software testers must improve their testing skills constantly to …

The post 5 Tips to Improve your Mobile Testing Skills appeared first on Adventures in QA.

]]>
The overall quality should always have the highest priority on every software product. This is especially the case for mobile products, since mobile customers have much higher expectations of the software running on their personal devices. To keep up with the constantly changing mobile world, especially software testers must improve their testing skills constantly to not lose the race.

In the latest article that I wrote for TestProject.io, you will read about five areas where you can improve your testing skills as a mobile tester. Read the first two tips on my blog and the rest at the blog from TestProject.io.

1. Be Part of Testing Communities

One of the best ways to stay up to date with the latest trends and new technology on the rise is to be actively part of testing and development communities. A very vital, active and healthy testing community every tester should be part of is the Ministry of Testing Community. The main communication channel of this community is slack where testers from around the world share their knowledge not only about mobile testing but also about other fields of interest.

Next to the online community, there are plenty of software testing conferences, where you can learn from other testers while listening to their talks or to attend the hands-on workshops. During such sessions, lots of knowledge is usually transferred and gives you the possibility to talk to the speakers afterwards.

2. Invest in Learning

Being part of a testing community or attending a conference might not be enough to stay up to date. There are formal training courses available on the market, such as BBSTISTQB and others. In these courses, every software tester can learn more about different testing techniques. However, these trainings can be expensive and might not cover the needs of mobile testers. There are alternatives ways, so called mnemonics, to learn about mobile testing and to remember the techniques. The two most known mobile testing heuristics are I SLICED UP FUN from Jonathan Kohl and MOBILE APP TESTING from Daniel Knott. Both mnemonics are great to learn new mobile testing techniques and provide an easy way to keep them in mind.

Next to trainings, courses, mnemonics I highly recommend to read testing related blogs online. There are many great bloggers out there sharing their knowledge for free. A list of great bloggers can be found here.

Read the full article here.

#HappyTesting

Header Image Source: https://unsplash.com/photos/sfL_QOnmy00

The post 5 Tips to Improve your Mobile Testing Skills appeared first on Adventures in QA.

]]>
5670