Chrome not reachable error upon closing/opening an app

I am trying to achieve the following test scenario in a Hybrid app.

  1. Launch app initially and edit some settings
  2. Close the app
  3. Re-open app the make sure the settings have been saved and enforced on the startup

I am using the following desired capabilities

browserName=‘’,
app=local_android_app_path,
autoAcceptAlerts=True,
noReset=True,
recreateChromeDriverSessions=True

The portion of the script handling the restarting portion goes like so.

# After some code editing the settings and saving it
self.driver.close_app()
time.sleep(2)
self.driver.launch_app()
# On launch of the app there are 2 contexts, NATIVE_APP and WEBVIEW.com.android.myappname
self.driver.switch_to_context(self.driver.contexts[-1]) # This should be the Webview context
assert self.driver.page_source() # this statement will fail with the exception
E       selenium.common.exceptions.WebDriverException: Message: chrome not reachable
E         (Session info: webview=39.0.0.0)
E         (Driver info: chromedriver=2.24.417424 (c5c5ea873213ee72e3d0929b47482681555340c3),platform=Linux 4.4.0-75-generic x86_64)

This is using:
Appium 1.6.4 (and 1.6.3) with chromedriver-executable set to 2.20, 2.29, 2.24
Android 5.1 & 6.0