Parallel execution with list of devices

We are writing a mobile phone automation framework, running in parallel on the selenium grid. We have an idea - having our own device farm, launch tests without being tied to specific devices, but make it so that the framework itself knows which devices (for example, ios) are now free and runs tests on them. Has anyone done this?

I did it. One macMini (16Gb, SSD) ables to run 20 phones (10 iPhones and 10 Android phones). Android runs a bit faster (20-30%). Total output we have about 700 our tests per hour. All tests record video (20 video where 10 ios streams cording on mac side, while on Android it does on device). CPU load about 80%. Memory consumption about 85-90%. We select devices to run in jenkins but programatically check on start what device actually connected and eliminate absent.

TestNG and Java.

Wow… Sounds great! Can you show the part of your framework where you do parallel launches ?

no. as always we write code for some company we are working. but I can point or share details how to make some particular part. start from something. have some problem - ask here…

Ok. As I mentioned above we want to run tests and not to be tied to specific devices. I can get list of UDIDs and device names in gradle task, like that:

def stdout = new ByteArrayOutputStream()
exec {
    commandLine('zsh', './script.zsh')
    standardOutput = stdout;
String udids = stdout.toString()

where script is pretty simple


xcrun simctl list devices | grep “(Booted)” | grep -E -o -i “([0-9a-f]{8}-([0-9a-f]{4}-){3}[0-9a-f]{12})”

This data is needed for Desired caps.
As I saw in articles and videos about selenium grid, specific driver instance should be created in test class. It means that I should specify Desired caps in that class. How to avoid it ? How to create DriverFactory that will produce driver instances with different devices for different classes ?

our approach a bit different but you can adapt. we know! devices we have.

  1. grab online devices uuid with:
instruments -s devices
  1. have file with known devices which have associations: device and appium port. in our case:
  "iphone8_1": {
    "platformName": "iOS",
    "platformVersion": "14.1",
    "deviceName": "iPhone QA1",
    "udid": "xxxx",
    "appiumPort": 6001
  1. now first before running tests we start appium servers with needed ports: 6001, 6002 …
  2. now we assign number of test threads = number of available devices
  3. now starting open driver instances. each against needed appium server with needed port. Java and TestNG:
    @BeforeMethod(alwaysRun = true)
    public void beforeMethod(
            @Optional("") String device) {
             driver.setDriver(new AppiumDriverFactory().getDriver(getDevice());

where getDevice() is synchronized function which takes one device from list of available devices. only ONE thread can take device from it at the same time and return when test completes in “afterMethod”.

Could you please show work with threads ? Cause it’s not clear to me. How do you assign thread to test class ? How thread takes and give back device from list ?

Thread is test code. Just add number of threads into testNG xml generates needed amount of them.

Simple nice example from google search