Adventures in QA https://adventuresinqa.com Software Testing, Mobile Testing and Agile Development by Daniel Knott Mon, 14 Oct 2019 06:13:06 +0000 en-US hourly 1 80347956 TestProject Resources https://adventuresinqa.com/2019/09/16/testproject-resources/ Mon, 16 Sep 2019 07:00:57 +0000 https://adventuresinqa.com/?p=5719 In the last article, I wrote about the easy setup of TestProject and what the platform offers to you. If you are interested in using it as well in your project, I took some time and collected a bunch of really useful resources. The resources might help you to kickstart your TestProject workspace and to …

The post TestProject Resources appeared first on Adventures in QA.

]]>
In the last article, I wrote about the easy setup of TestProject and what the platform offers to you. If you are interested in using it as well in your project, I took some time and collected a bunch of really useful resources. The resources might help you to kickstart your TestProject workspace and to start testing your Android and iOS app with a single test automation tool.

General TestProject Documentation

TestProject Videos

Tutorials for Using and Developing Addons

Tutorials for Creating Coded Tests Using TestProject’s SDK

I hope you enjoyed my little series about TestProject. If you notice a new testing tool on the market that is worth mentioning or writing about, don’t hesitate to contact me.

#HappyTesting

Featured Image: https://unsplash.com/photos/Oaqk7qqNh_c

The post TestProject Resources appeared first on Adventures in QA.

]]>
5719
Test Automation with TestProject https://adventuresinqa.com/2019/09/10/test-automation-with-testproject/ Tue, 10 Sep 2019 07:30:39 +0000 https://adventuresinqa.com/?p=5726 In my previous article, I promised to write more about the free test automation platform TestProject. With this post, I will introduce you to the TestProject platform, the setup process of the so-called agent, the rich feature set and more things that make TestProject a special single test automation solution. Sign-Up and First Steps Let’s …

The post Test Automation with TestProject appeared first on Adventures in QA.

]]>
In my previous article, I promised to write more about the free test automation platform TestProject. With this post, I will introduce you to the TestProject platform, the setup process of the so-called agent, the rich feature set and more things that make TestProject a special single test automation solution.

Sign-Up and First Steps

Let’s start from the beginning. The sign-up process is easy and takes no more than one minute after you created your account. Right after the first sign in, a wizard offers you a quick five minute tutorial where the initial setup of the TestProject agent is happening. In the first step you need to download the TestProject agent for your operating system. TestProject supports Windows, Mac OS and Linux.

While the download is running, the wizard is providing a short YouTube video, where the next steps are explained once the agent is installed.

Click to view slideshow.

Once the TestProject agent is installed, the wizard asks you to register your local agent by giving it an alias. The alias will be checked and registered. The setup takes some minutes and then the TestProject dashboard is presented.

On the dashboard another onboarding guide is helping you to find all the features and options TestProject offers. The onboarding suggests to add another team member for a better collaboration. The really cool thing here is, that there is NO limitation in the amount of team members you can add and this way you can easily collaborate with your entire team. Actually, there are NO limitations on any of the TestProject features, and they are ALL offered for free which is really cool.

TestProject Feature Set

Before I show you how to create a test step in the TestProject dashboard, I want to briefly highlight the rich feature set. As already mentioned, after the sign-up process you need to download and register a TestProject agent. The agent wraps already the most used open source test automation frameworks on the market for web and mobile. It’s Selenium and Appium.

The really cool thing is, that there is no further configuration needed. Furthermore, there are no coding skills required to start the test automation activities for web or mobile right after the initial setup.

To create a new test, just hit new test on the dashboard and answer some of questions to get the testing started.

Click to view slideshow.

If you want to explore the features of TestProject and you don’t know where to start, I recommend to take a look at the sample project waiting for you in the dashboard.

Test Automation with TestProject - Adventures in QA

Take a look at the short video I created. In the video the TestProject agent is

  1. Connecting to my blog
  2. Is checking for a navigation entry
  3. Is firing a search request
  4. Is checking for the result headline

For my simple test, I used the smart recorder of TestProject and I must say, I am really impressed. Once you start the recorder with the provided test application or mobile app, the application will be loaded in an additional browser window. An overlay will be provided and offers further actions on every mouse placement or movement. For example, you can evaluate the DOM structure of the element to identify it manually or you can use options like

  • Actions, to e.g. get a text, click, insert data and more
  • Validations, to verify e.g. if an element is present or clickable
  • Attributes, you get the XPATH of the element, the URL and text on the element
Click to view slideshow.

With the overlay feature you can easily create a test scenario in recording mode and save it to your test dashboard. At the end of the test case creation, all the recorded or manually added steps are shown.

Test Automation with TestProject - Adventures in QA

In addition, once you complete your recorded test, you can also generate source code from your recorded test, make code alterations to extend your test even further, and upload back to TestProject!

TestProject Dashboard

If you take another look at the TestProject dashboard, you will notice some more sections worth mentioning. There is the Job Monitor section, where you get an overview of the current jobs running. The Addons section, where you can enrich your own test project with Addons like image comparison or JS actions just to name a few. The cool thing is, that the Addons are free of usage. The Addons are developed and maintained by the TestProject community, and give you the power to extend both recorded tests and coded tests to save valuable time.

Test Automation with TestProject - Adventures in QA

In the reports section you get an overview of executed test runs with passed and failed test cases, including screenshots, testing trends, error messages and you can even download a PDF of your reports. In the agent’s section you get an overview of running agents and their configuration setup and the status if they are connected or not.

Test Automation with TestProject - Adventures in QA

In the developer’s section you can download the TestProject SDK if you want to get your hands dirty with programming languages and to enrich your own testing setup. Currently, TestProject supports Java and .NET Core as programming languages, and JS, Python and Groovy are coming soon. Furthermore, you can generate an API key to access to TestProject via REST API.

As you can see, the features and options the TestProject dashboard offers is amazing. It’s covering the needs of non-technical persons to create stable test automation suites as well as developers to enable them developing and extending TestProject for their own needs.

Test Automation with TestProject - Adventures in QA
TestProject offers so many features and options that I can’t mentioned them all in one blog post. If you are looking for a new or a replacement for your test automation solution for either web and or mobile, I highly recommend to take some minutes to check out TestProject. Just go and sign-up here, and let me know what you think about the platform.

While using TestProject for the last days, I found more and more useful information about the setup process, the features and more. Therefore, I will write another blog post about TestProject, where I will link and highlight useful resources I found, to get the own TestProject setup up and running as well as dive deeper into Addons and the SDK development.

#HappyTesting

The post Test Automation with TestProject appeared first on Adventures in QA.

]]>
5726
Testing Mobile Apps with a Single Automation Solution https://adventuresinqa.com/2019/09/02/testing-mobile-apps/ Mon, 02 Sep 2019 08:00:18 +0000 https://adventuresinqa.com/?p=5721 My summer vacation is over and I am back at writing :). In my last article, I compared test automation frameworks with pros and cons. Today’s article is focusing on the important topic of testing mobile apps. Especially with a focus on mobile test automation and how this can be done with a single automation …

The post Testing Mobile Apps with a Single Automation Solution appeared first on Adventures in QA.

]]>
My summer vacation is over and I am back at writing :). In my last article, I compared test automation frameworks with pros and cons. Today’s article is focusing on the important topic of testing mobile apps. Especially with a focus on mobile test automation and how this can be done with a single automation solution.

Most organizations support both mobile platforms for their product, Android as well as iOS. Both platforms together have a world-wide market share of 98% and therefore it is essential to develop and release the own mobile product on both systems. Sure, there might be products, markets and services that are used more on one of the platforms, but for the majority of companies both platforms are critical for their business.

For those software testers working already in the field of mobile testing hopefully know that both platforms have similarities as well as differences. In both cases this knowledge is key to success, especially when you want focus on the field of mobile test automation. If you don’t know the key differences of the mobile platforms and apps, I recommend to take a look at my book Hands-On Mobile App Testing or at my mobile testing online course A Beginners Guide To Mobile Testing.

Why Mobile Test Automation is Important?

According to user surveys conducted by Arctouch and TechBeacon, more than 50% of mobile app users will uninstall an app after the first usage. One of the main reasons for the uninstallation is an app crash or freeze at the first launch. Furthermore, the surveys found out that mobile users have a much higher expectation to mobile apps than to any other software products. Up to 80% of mobile users will delete an app after the first usage if the design is bad, the app has a poor user experience or is not fast enough.

Many of the findings in mobile apps are hard to automate. Especially things like loading times depend heavily on other transport layers like the data network and the backend infrastructure. Furthermore, a bad design or bad user experience is hard to automate. That doesn’t mean that mobile test automation is not important for a mobile app, but should rather be the best friend of a software development team. A mobile test automation solution should support the developing and testing activities in a team to free up time for the developers and testers to focus on the real challenges when it comes to mobile testing and developing.

Good candidates for test automation are repetitive tasks that needs to be performed after every code change. For example, a login to an app, a purchase from the shop or the signup process. These are things that are easy and valuable to automate.

Last but not least mobile test automation is key to success to shorten the release cycles of mobile apps. Mobile users expect that bugs are fixed within days, not weeks or months. They expect to receive new features on a regular basis to keep engage with the own product or service.

Mobile Test Automation Solutions can be Challenging

However, mobile test automation doesn’t come for free. Some of the existing mobile testing frameworks are challenging in the setup process and require technical skills. In most of the cases programming skills are essential in order to setup a continuous integration pipeline that supports all the developing and testing activities.

Since many companies focus on both platforms Android and iOS, it’s worth looking for test automation solutions that support both platforms. This will save lots of time in setting up the infrastructure for the test automation solution. In some cases, testing code can be shared between the platforms or with a community, too.

As written earlier, in my last blog post I compared test automation solutions. While checking the vendors for the post, I was impressed by – TestProject and their offerings, being a first of its kind end-to-end solution that’s completely free and community based. TestProject offers an easy setup and configuration process to kickstart the own mobile testing activities in really fast way.

Just take some minutes and watch the introduction video of TestProject:

Since I am really impressed by the easy installation and configuration setup of TestProject, I will write another article the next days about the TestProject platform and how easy it is to setup a mobile test automation project for you and your team. Furthermore, I will guide you through the feature set of TestProject, which might help you testing mobile apps much faster and reliable.

#HappyTesting

Featured Image: https://unsplash.com/photos/4Ennrbj1svk

The post Testing Mobile Apps with a Single Automation Solution appeared first on Adventures in QA.

]]>
5721
Comparison of Test Automation Platforms https://adventuresinqa.com/2019/07/15/comparison-of-test-automation-platforms/ Mon, 15 Jul 2019 07:00:50 +0000 https://adventuresinqa.com/?p=5705 Test automation, being it web or mobile test automation should be part of every software development team. However, this is still not the case for most of the companies on the market. Whenever I talked to developers, testers or product managers e.g. on conferences the majority of people mention the lack of knowledge, infrastructure or …

The post Comparison of Test Automation Platforms appeared first on Adventures in QA.

]]>
Test automation, being it web or mobile test automation should be part of every software development team. However, this is still not the case for most of the companies on the market. Whenever I talked to developers, testers or product managers e.g. on conferences the majority of people mention the lack of knowledge, infrastructure or time pressure are the biggest hurdles for them to start with automation. But starting with test automation can be much easier when using a test automation platform*. Test automation platforms usually offer e.g. the infrastructure, a list of supported test automation tools and a setup guide.

Test Automation Platforms

In this article, I want to briefly introduce you to test automation platforms with their pros and cons. For the comparison I picked the following platforms:

Depending on the own software development cycle, the used programming languages and toolchain a test automation platform must fulfill different requirements in order to be used most efficiently.

Saucelabs

Pros:

  • Provide support for many browsers, OS and mobile devices
  • Offers a testing cloud with real and emulated devices
  • Support for many open source testing frameworks (Appium, Selenium and more)
  • Visual testing support
  • Rest API access
  • Parallel test execution
  • Infrastructure hosted in the cloud
  • Test execution dashboard
  • Integration to different continuous integration systems
  • VPN Connection to own network
  • Offers lots of resources

Cons:

  • Test execution time can be slower
  • Depending on your setup the price of the hosted service can get expensive

TestProject

Pros:

  • Support for many open source testing frameworks (Appium, Selenium and more)
  • Testing on real devices, web browsers and emulators/ simulators
  • Offers a smart test recorder
  • SDK for Java and .Net Core  for test automation developers
  • Community based Add-ons
  • Rest API access
  • Test execution & report dashboards
  • Ability to easily collaborate with the entire team anywhere around the globe
  • The first test automation platform that offers a free forever plan, that includes all the small-medium size organizations test automation needs (for enterprises or highly advanced clients there’s a pro plan for only $8 per month)
  • Integration to different continuous integration systems
  • Community & team support
  • Offers lots of resources
  • Parallel test execution
  • Supports iOS on Windows

Cons:

  • Currently offers no cloud hosting of devices and browser setups

bitbar

Pros:

  • Real device testing in the cloud or with own hardware
  • Many mobile testing frameworks are supported
  • Test result dashboard
  • REST API access
  • Parallel test execution
  • Integration to different continuous integration systems
  • VPN Connection to own network
  • Lots of resources

Cons:

  • Focus “only” on mobile testing, no web browser testing capabilities
  • Depending on your setup the price of the hosted service can get expensive

BrowserStack

Pros:

  • Provide support for many browsers, OS and mobile devices
  • Many mobile testing frameworks are supported
  • Test result dashboard
  • Parallel test execution
  • Integration to different continuous integration systems
  • REST API access
  • VPN Connection to own network
  • Lots of resources

Cons:

  • Response time of endpoint sometimes slow
  • Depending on your setup the price of the hosted service can get expensive

Summary

As you can see, most of the automation platforms offer a similar feature set. It’s not easy to pick the right platform just by reading the feature specs and the support information material. Every company or team who wants to establish a test automation platform need to invest time to evaluate them. As a starting point, a company should write down their own requirements and the current setup. With this information it might be easier to find the right test automation platform that fits best into the own development infrastructure.

While using the test automation platforms for this post, I was impressed by – TestProject and their offerings, being a first of its kind end-to-end solution that’s completely free and community based. As mentioned in the pros, they offer a smart test recorder (I know what you think now ;), but I will give it a try) and the community add-on support which sounded really interesting to me. To satisfy my curiosity, I will check this platform out and will provide you with some further posts in the next weeks or months.

*Disclaimer: A minimum set of programming skills must be available in order to work with test automation platforms.

Featured Image Source: https://unsplash.com/photos/I5E5e21HRvw

The post Comparison of Test Automation Platforms appeared first on Adventures in QA.

]]>
5705
Including User Feedback to Future Roadmap Planning https://adventuresinqa.com/2019/06/25/including-user-feedback-to-future-roadmap-planning/ Tue, 25 Jun 2019 07:00:28 +0000 https://adventuresinqa.com/?p=5699 Receiving user feedback for digital products can be very painful for companies and especially for the teams developing the product. With the rise of smartphones and mobile apps, mobile users having much higher expectations to the overall product quality and features. According to Google, more than 50% of the customers will leave a web product …

The post Including User Feedback to Future Roadmap Planning appeared first on Adventures in QA.

]]>
Receiving user feedback for digital products can be very painful for companies and especially for the teams developing the product. With the rise of smartphones and mobile apps, mobile users having much higher expectations to the overall product quality and features. According to Google, more than 50% of the customers will leave a web product if the page doesn’t load within 3 seconds. Similar numbers have been revealed by techbeacon for mobile applications.

Leaving bad reviews and rating was never easier than before, as you can see on the image before. For most products, it’s just finger tap away to leave a bad review or feedback. However, companies and software development teams can turnaround the bad and negative feedback and use it to improve the product and to make the customers more happy.

Selecting User Feedback The Right Way

Companies have several ways to collect user feedback inside a product or service. Here is an overview of things that companies can do:

  • Product surveys inside the product
  • Make use of mobile app store reviews
  • Asking people in cafes for direct feedback
  • Invite users to the office or user lab
  • Talk to the customer care department

In my latest post that I wrote for Applause I explained in detail the pros and cons of each feedback collection approach. Furthermore, I explain how the collected feedback can be used to plan future roadmaps.

Read the full article here: https://www.applause.com/blog/how-include-user-feedback-in-roadmap

#HappyTesting

The post Including User Feedback to Future Roadmap Planning appeared first on Adventures in QA.

]]>
5699