builder: mozilla-inbound_win8_64_test-svgr-pgo slave: t-w864-ix-011 starttime: 1461836968.31 results: retry (5) buildid: 20160428000520 builduid: 6014381e905243e3b205416e3ebcefe4 revision: 29f94bde2afa ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2016-04-28 02:49:28.308004) ========= master: http://buildbot-master112.bb.releng.scl3.mozilla.com:8201/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2016-04-28 02:49:28.308376) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 22 secs) (at 2016-04-28 02:49:28.308668) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 22 secs) (at 2016-04-28 02:49:51.166111) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 9 secs) (at 2016-04-28 02:49:51.166444) ========= 'bash' '-c' 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py' in dir C:\slave\test\. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py'] environment: ALLUSERSPROFILE=C:\ProgramData APPDATA=C:\Users\cltbld.T-W864-IX-011\AppData\Roaming COMMONPROGRAMFILES=C:\Program Files (x86)\Common Files COMMONPROGRAMFILES(X86)=C:\Program Files (x86)\Common Files COMMONPROGRAMW6432=C:\Program Files\Common Files COMPUTERNAME=T-W864-IX-011 COMSPEC=C:\windows\system32\cmd.exe DCLOCATION=SCL3 DNSSUFFIX=wintest.releng.scl3.mozilla.com FP_NO_HOST_CHECK=NO HOMEDRIVE=C: HOMEPATH=\Users\cltbld.T-W864-IX-011 KTS_HOME=C:\Program Files\KTS KTS_VERSION=1.19c LOCALAPPDATA=C:\Users\cltbld.T-W864-IX-011\AppData\Local LOGONSERVER=\\T-W864-IX-011 MONDIR=C:\Monitor_config\ MOZBUILDDIR=C:\mozilla-build\ MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_NO_REMOTE=1 NO_EM_RESTART=1 NUMBER_OF_PROCESSORS=8 OS=Windows_NT OURDRIVE=C: PATH=C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\mozilla-build\python27;C:\mozilla-build\python27\Scripts;C:\mozilla-build\msys\bin;C:\mozilla-build\vim\vim72;C:\mozilla-build\wget;C:\mozilla-build\info-zip;C:\CoreUtils\bin;C:\mozilla-build\buildbotve\scripts;C:\mozilla-build\hg PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PROCESSOR_ARCHITECTURE=x86 PROCESSOR_ARCHITEW6432=AMD64 PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel PROCESSOR_LEVEL=6 PROCESSOR_REVISION=1e05 PROGRAMDATA=C:\ProgramData PROGRAMFILES=C:\Program Files (x86) PROGRAMFILES(X86)=C:\Program Files (x86) PROGRAMW6432=C:\Program Files PROMPT=$P$G PSMODULEPATH=C:\windows\system32\WindowsPowerShell\v1.0\Modules\ PUBLIC=C:\Users\Public PWD=C:\slave\test RUNLOGFILE=C:\slave\\runslave.log SLAVEDIR=C:\slave\ SYSTEMDRIVE=C: SYSTEMROOT=C:\windows TEMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp TEST1=testie TMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp USERDOMAIN=T-W864-IX-011 USERDOMAIN_ROAMINGPROFILE=T-W864-IX-011 USERNAME=cltbld USERPROFILE=C:\Users\cltbld.T-W864-IX-011 WINDIR=C:\windows XPCOM_DEBUG_BREAK=warn using PTY: False --02:49:51-- https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py => `archiver_client.py' Resolving hg.mozilla.org... 63.245.215.102, 63.245.215.25 Connecting to hg.mozilla.org|63.245.215.102|:443... connected. HTTP request sent, awaiting response... 200 Script output follows Length: 12,141 (12K) [text/x-python] 0K .......... . 100% 7.92 MB/s 02:49:51 (7.92 MB/s) - `archiver_client.py' saved [12141/12141] program finished with exit code 0 elapsedTime=1.240000 ========= master_lag: 8.00 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 9 secs) (at 2016-04-28 02:50:00.403922) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 4 secs) (at 2016-04-28 02:50:00.404203) ========= 'rm' '-rf' 'scripts' 'properties' in dir C:\slave\test\. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: ALLUSERSPROFILE=C:\ProgramData APPDATA=C:\Users\cltbld.T-W864-IX-011\AppData\Roaming COMMONPROGRAMFILES=C:\Program Files (x86)\Common Files COMMONPROGRAMFILES(X86)=C:\Program Files (x86)\Common Files COMMONPROGRAMW6432=C:\Program Files\Common Files COMPUTERNAME=T-W864-IX-011 COMSPEC=C:\windows\system32\cmd.exe DCLOCATION=SCL3 DNSSUFFIX=wintest.releng.scl3.mozilla.com FP_NO_HOST_CHECK=NO HOMEDRIVE=C: HOMEPATH=\Users\cltbld.T-W864-IX-011 KTS_HOME=C:\Program Files\KTS KTS_VERSION=1.19c LOCALAPPDATA=C:\Users\cltbld.T-W864-IX-011\AppData\Local LOGONSERVER=\\T-W864-IX-011 MONDIR=C:\Monitor_config\ MOZBUILDDIR=C:\mozilla-build\ MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_NO_REMOTE=1 NO_EM_RESTART=1 NUMBER_OF_PROCESSORS=8 OS=Windows_NT OURDRIVE=C: PATH=C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\mozilla-build\python27;C:\mozilla-build\python27\Scripts;C:\mozilla-build\msys\bin;C:\mozilla-build\vim\vim72;C:\mozilla-build\wget;C:\mozilla-build\info-zip;C:\CoreUtils\bin;C:\mozilla-build\buildbotve\scripts;C:\mozilla-build\hg PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PROCESSOR_ARCHITECTURE=x86 PROCESSOR_ARCHITEW6432=AMD64 PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel PROCESSOR_LEVEL=6 PROCESSOR_REVISION=1e05 PROGRAMDATA=C:\ProgramData PROGRAMFILES=C:\Program Files (x86) PROGRAMFILES(X86)=C:\Program Files (x86) PROGRAMW6432=C:\Program Files PROMPT=$P$G PSMODULEPATH=C:\windows\system32\WindowsPowerShell\v1.0\Modules\ PUBLIC=C:\Users\Public PWD=C:\slave\test RUNLOGFILE=C:\slave\\runslave.log SLAVEDIR=C:\slave\ SYSTEMDRIVE=C: SYSTEMROOT=C:\windows TEMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp TEST1=testie TMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp USERDOMAIN=T-W864-IX-011 USERDOMAIN_ROAMINGPROFILE=T-W864-IX-011 USERNAME=cltbld USERPROFILE=C:\Users\cltbld.T-W864-IX-011 WINDIR=C:\windows XPCOM_DEBUG_BREAK=warn using PTY: False program finished with exit code 0 elapsedTime=0.202000 ========= master_lag: 3.91 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 4 secs) (at 2016-04-28 02:50:04.514129) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 6 secs) (at 2016-04-28 02:50:04.514433) ========= 'bash' '-c' u'python archiver_client.py mozharness --repo integration/mozilla-inbound --rev 29f94bde2afa --destination scripts --debug' in dir C:\slave\test\. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', u'python archiver_client.py mozharness --repo integration/mozilla-inbound --rev 29f94bde2afa --destination scripts --debug'] environment: ALLUSERSPROFILE=C:\ProgramData APPDATA=C:\Users\cltbld.T-W864-IX-011\AppData\Roaming COMMONPROGRAMFILES=C:\Program Files (x86)\Common Files COMMONPROGRAMFILES(X86)=C:\Program Files (x86)\Common Files COMMONPROGRAMW6432=C:\Program Files\Common Files COMPUTERNAME=T-W864-IX-011 COMSPEC=C:\windows\system32\cmd.exe DCLOCATION=SCL3 DNSSUFFIX=wintest.releng.scl3.mozilla.com FP_NO_HOST_CHECK=NO HOMEDRIVE=C: HOMEPATH=\Users\cltbld.T-W864-IX-011 KTS_HOME=C:\Program Files\KTS KTS_VERSION=1.19c LOCALAPPDATA=C:\Users\cltbld.T-W864-IX-011\AppData\Local LOGONSERVER=\\T-W864-IX-011 MONDIR=C:\Monitor_config\ MOZBUILDDIR=C:\mozilla-build\ MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_NO_REMOTE=1 NO_EM_RESTART=1 NUMBER_OF_PROCESSORS=8 OS=Windows_NT OURDRIVE=C: PATH=C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\mozilla-build\python27;C:\mozilla-build\python27\Scripts;C:\mozilla-build\msys\bin;C:\mozilla-build\vim\vim72;C:\mozilla-build\wget;C:\mozilla-build\info-zip;C:\CoreUtils\bin;C:\mozilla-build\buildbotve\scripts;C:\mozilla-build\hg PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PROCESSOR_ARCHITECTURE=x86 PROCESSOR_ARCHITEW6432=AMD64 PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel PROCESSOR_LEVEL=6 PROCESSOR_REVISION=1e05 PROGRAMDATA=C:\ProgramData PROGRAMFILES=C:\Program Files (x86) PROGRAMFILES(X86)=C:\Program Files (x86) PROGRAMW6432=C:\Program Files PROMPT=$P$G PSMODULEPATH=C:\windows\system32\WindowsPowerShell\v1.0\Modules\ PUBLIC=C:\Users\Public PWD=C:\slave\test RUNLOGFILE=C:\slave\\runslave.log SLAVEDIR=C:\slave\ SYSTEMDRIVE=C: SYSTEMROOT=C:\windows TEMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp TEST1=testie TMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp USERDOMAIN=T-W864-IX-011 USERDOMAIN_ROAMINGPROFILE=T-W864-IX-011 USERNAME=cltbld USERPROFILE=C:\Users\cltbld.T-W864-IX-011 WINDIR=C:\windows XPCOM_DEBUG_BREAK=warn using PTY: False 2016-04-28 02:50:05,069 Setting DEBUG logging. 2016-04-28 02:50:05,069 attempt 1/10 2016-04-28 02:50:05,069 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/integration/mozilla-inbound/29f94bde2afa?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2016-04-28 02:50:06,315 unpacking tar archive at: mozilla-inbound-29f94bde2afa/testing/mozharness/ program finished with exit code 0 elapsedTime=1.909000 ========= master_lag: 4.27 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 6 secs) (at 2016-04-28 02:50:10.696029) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-04-28 02:50:10.696372) ========= script_repo_revision: 29f94bde2afa ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-04-28 02:50:10.696797) ========= ========= Started downloading to oauth.txt (results: 0, elapsed: 9 secs) (at 2016-04-28 02:50:10.697072) ========= ========= Finished downloading to oauth.txt (results: 0, elapsed: 9 secs) (at 2016-04-28 02:50:20.449127) ========= ========= Started 'c:/mozilla-build/python27/python -u ...' interrupted (results: 5, elapsed: 53 secs) (at 2016-04-28 02:50:20.449423) ========= 'c:/mozilla-build/python27/python' '-u' 'scripts/scripts/talos_script.py' '--suite' 'svgr' '--add-option' '--webServer,localhost' '--branch-name' 'Mozilla-Inbound' '--cfg' 'talos/windows_config.py' '--download-symbols' 'ondemand' '--use-talos-json' '--blob-upload-branch' 'Mozilla-Inbound' in dir C:\slave\test\. (timeout 3600 secs) (maxTime 7200 secs) watching logfiles {} argv: ['c:/mozilla-build/python27/python', '-u', 'scripts/scripts/talos_script.py', '--suite', 'svgr', '--add-option', '--webServer,localhost', '--branch-name', 'Mozilla-Inbound', '--cfg', 'talos/windows_config.py', '--download-symbols', 'ondemand', '--use-talos-json', '--blob-upload-branch', 'Mozilla-Inbound'] environment: ALLUSERSPROFILE=C:\ProgramData APPDATA=C:\Users\cltbld.T-W864-IX-011\AppData\Roaming COMMONPROGRAMFILES=C:\Program Files (x86)\Common Files COMMONPROGRAMFILES(X86)=C:\Program Files (x86)\Common Files COMMONPROGRAMW6432=C:\Program Files\Common Files COMPUTERNAME=T-W864-IX-011 COMSPEC=C:\windows\system32\cmd.exe DCLOCATION=SCL3 DNSSUFFIX=wintest.releng.scl3.mozilla.com FP_NO_HOST_CHECK=NO HOMEDRIVE=C: HOMEPATH=\Users\cltbld.T-W864-IX-011 KTS_HOME=C:\Program Files\KTS KTS_VERSION=1.19c LOCALAPPDATA=C:\Users\cltbld.T-W864-IX-011\AppData\Local LOGONSERVER=\\T-W864-IX-011 MONDIR=C:\Monitor_config\ MOZBUILDDIR=C:\mozilla-build\ MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_NO_REMOTE=1 NO_EM_RESTART=1 NUMBER_OF_PROCESSORS=8 OS=Windows_NT OURDRIVE=C: PATH=C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\mozilla-build\python27;C:\mozilla-build\python27\Scripts;C:\mozilla-build\msys\bin;C:\mozilla-build\vim\vim72;C:\mozilla-build\wget;C:\mozilla-build\info-zip;C:\CoreUtils\bin;C:\mozilla-build\buildbotve\scripts;C:\mozilla-build\hg PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PROCESSOR_ARCHITECTURE=x86 PROCESSOR_ARCHITEW6432=AMD64 PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel PROCESSOR_LEVEL=6 PROCESSOR_REVISION=1e05 PROGRAMDATA=C:\ProgramData PROGRAMFILES=C:\Program Files (x86) PROGRAMFILES(X86)=C:\Program Files (x86) PROGRAMW6432=C:\Program Files PROMPT=$P$G PROPERTIES_FILE=C:\slave\test/buildprops.json PSMODULEPATH=C:\windows\system32\WindowsPowerShell\v1.0\Modules\ PUBLIC=C:\Users\Public PWD=C:\slave\test RUNLOGFILE=C:\slave\\runslave.log SLAVEDIR=C:\slave\ SYSTEMDRIVE=C: SYSTEMROOT=C:\windows TEMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp TEST1=testie TMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp USERDOMAIN=T-W864-IX-011 USERDOMAIN_ROAMINGPROFILE=T-W864-IX-011 USERNAME=cltbld USERPROFILE=C:\Users\cltbld.T-W864-IX-011 WINDIR=C:\windows XPCOM_DEBUG_BREAK=warn using PTY: False 02:50:20 INFO - MultiFileLogger online at 20160428 02:50:20 in C:\slave\test 02:50:20 INFO - Run as scripts/scripts/talos_script.py --suite svgr --add-option --webServer,localhost --branch-name Mozilla-Inbound --cfg talos/windows_config.py --download-symbols ondemand --use-talos-json --blob-upload-branch Mozilla-Inbound 02:50:20 INFO - Dumping config to C:\slave\test\logs\localconfig.json. 02:50:20 INFO - {'append_to_log': False, 02:50:20 INFO - 'base_work_dir': 'C:\\slave\\test', 02:50:20 INFO - 'blob_upload_branch': 'Mozilla-Inbound', 02:50:20 INFO - 'blob_uploader_auth_file': 'C:\\slave\\test\\oauth.txt', 02:50:20 INFO - 'branch': 'Mozilla-Inbound', 02:50:20 INFO - 'buildbot_json_path': 'buildprops.json', 02:50:20 INFO - 'config_files': ('talos/windows_config.py',), 02:50:20 INFO - 'default_actions': ('clobber', 02:50:20 INFO - 'read-buildbot-config', 02:50:20 INFO - 'download-and-extract', 02:50:20 INFO - 'populate-webroot', 02:50:20 INFO - 'create-virtualenv', 02:50:20 INFO - 'install', 02:50:20 INFO - 'run-tests'), 02:50:20 INFO - 'default_blob_upload_servers': ('https://blobupload.elasticbeanstalk.com',), 02:50:20 INFO - 'download_minidump_stackwalk': True, 02:50:20 INFO - 'download_symbols': 'ondemand', 02:50:20 INFO - 'exes': {'easy_install': ('C:\\slave\\test\\build/venv/scripts/python', 02:50:20 INFO - 'C:\\slave\\test\\build/venv/scripts/easy_install-2.7-script.py'), 02:50:20 INFO - 'hg': 'c:/mozilla-build/hg/hg', 02:50:20 INFO - 'mozinstall': ('C:\\slave\\test\\build/venv/scripts/python', 02:50:20 INFO - 'C:\\slave\\test\\build/venv/scripts/mozinstall-script.py'), 02:50:20 INFO - 'python': 'c:/mozilla-build/python27/python.exe', 02:50:20 INFO - 'tooltool.py': ('c:/mozilla-build/python27/python.exe', 02:50:20 INFO - 'C:/mozilla-build/tooltool.py'), 02:50:20 INFO - 'virtualenv': ('c:/mozilla-build/python27/python.exe', 02:50:20 INFO - 'c:/mozilla-build/buildbotve/virtualenv.py')}, 02:50:20 INFO - 'find_links': ('http://pypi.pvt.build.mozilla.org/pub', 02:50:20 INFO - 'http://pypi.pub.build.mozilla.org/pub'), 02:50:20 INFO - 'installer_path': 'installer.exe', 02:50:20 INFO - 'log_level': 'info', 02:50:20 INFO - 'log_name': 'talos', 02:50:20 INFO - 'log_to_console': True, 02:50:20 INFO - 'metro_harness_path_frmt': '%(metro_base_path)s/metro/metrotestharness.exe', 02:50:20 INFO - 'minidump_stackwalk_path': 'win32-minidump_stackwalk.exe', 02:50:20 INFO - 'minidump_tooltool_manifest_path': 'config/tooltool-manifests/win32/releng.manifest', 02:50:20 INFO - 'opt_config_files': (), 02:50:20 INFO - 'pip_index': False, 02:50:20 INFO - 'sps_profile': False, 02:50:20 INFO - 'sps_profile_interval': 0, 02:50:20 INFO - 'suite': 'svgr', 02:50:20 INFO - 'system_bits': '32', 02:50:20 INFO - 'talos_extra_options': ('--webServer', 'localhost'), 02:50:20 INFO - 'title': 'T-W864-IX-011', 02:50:20 INFO - 'use_talos_json': True, 02:50:20 INFO - 'virtualenv_modules': ('pywin32', 'talos', 'mozinstall'), 02:50:20 INFO - 'virtualenv_path': 'C:\\slave\\test\\build/venv', 02:50:20 INFO - 'virtualenv_python_dll': 'c:/mozilla-build/python27/python27.dll', 02:50:20 INFO - 'volatile_config': {'actions': None, 'add_actions': None, 'no_actions': None}, 02:50:20 INFO - 'work_dir': 'build'} 02:50:20 INFO - ##### 02:50:20 INFO - ##### Running clobber step. 02:50:20 INFO - ##### 02:50:20 INFO - Running pre-action listener: _resource_record_pre_action 02:50:20 INFO - Running main action method: clobber 02:50:20 INFO - rmtree: C:\slave\test\build 02:50:20 INFO - Using _rmtree_windows ... 02:50:20 INFO - retry: Calling _rmtree_windows with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #1 02:50:20 INFO - Running post-action listener: _resource_record_post_action 02:50:20 INFO - ##### 02:50:20 INFO - ##### Running read-buildbot-config step. 02:50:20 INFO - ##### 02:50:20 INFO - Running pre-action listener: _resource_record_pre_action 02:50:20 INFO - Running main action method: read_buildbot_config 02:50:20 INFO - Using buildbot properties: 02:50:20 INFO - { 02:50:20 INFO - "project": "", 02:50:20 INFO - "product": "firefox", 02:50:20 INFO - "script_repo_revision": "production", 02:50:20 INFO - "builddir": "mozilla-inbound_win8_64_test-svgr", 02:50:20 INFO - "repository": "", 02:50:20 INFO - "buildername": "Windows 8 64-bit mozilla-inbound pgo talos svgr", 02:50:20 INFO - "buildid": "20160428000520", 02:50:20 INFO - "pgo_build": "True", 02:50:20 INFO - "basedir": "C:\\slave\\test", 02:50:20 INFO - "buildnumber": 837, 02:50:20 INFO - "slavename": "t-w864-ix-011", 02:50:20 INFO - "master": "http://buildbot-master112.bb.releng.scl3.mozilla.com:8201/", 02:50:20 INFO - "platform": "win8_64", 02:50:20 INFO - "scheduler": "tests-mozilla-inbound-win64-pgo-talos", 02:50:20 INFO - "branch": "mozilla-inbound", 02:50:20 INFO - "repo_path": "integration/mozilla-inbound", 02:50:20 INFO - "revision": "29f94bde2afa", 02:50:20 INFO - "stage_platform": "win64-pgo", 02:50:20 INFO - "builduid": "6014381e905243e3b205416e3ebcefe4", 02:50:20 INFO - "slavebuilddir": "test" 02:50:20 INFO - } 02:50:20 INFO - Found installer url https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.zip. 02:50:20 INFO - Running post-action listener: _resource_record_post_action 02:50:20 INFO - ##### 02:50:20 INFO - ##### Running download-and-extract step. 02:50:20 INFO - ##### 02:50:20 INFO - Running pre-action listener: _resource_record_pre_action 02:50:20 INFO - Running main action method: download_and_extract 02:50:20 INFO - mkdir: C:\slave\test\build\tests 02:50:20 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pvtbuilds.pvt.build.mozilla.org', 'pvtbuilds.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org'), ('https://queue.taskcluster.net', 'queue.taskcluster.net')]} 02:50:20 INFO - https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.test_packages.json matches https://queue.taskcluster.net 02:50:20 INFO - trying https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.test_packages.json 02:50:20 INFO - Downloading https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.test_packages.json to C:\slave\test\build\firefox-49.0a1.en-US.win64.test_packages.json 02:50:20 INFO - retry: Calling _download_file with args: (), kwargs: {'url': 'https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.test_packages.json', 'file_name': 'C:\\slave\\test\\build\\firefox-49.0a1.en-US.win64.test_packages.json'}, attempt #1 02:50:21 INFO - Downloaded 1218 bytes. 02:50:21 INFO - Reading from file C:\slave\test\build\firefox-49.0a1.en-US.win64.test_packages.json 02:50:21 INFO - Using the following test package requirements: 02:50:21 INFO - {u'common': [u'firefox-49.0a1.en-US.win64.common.tests.zip'], 02:50:21 INFO - u'cppunittest': [u'firefox-49.0a1.en-US.win64.common.tests.zip', 02:50:21 INFO - u'firefox-49.0a1.en-US.win64.cppunittest.tests.zip'], 02:50:21 INFO - u'gtest': [u'firefox-49.0a1.en-US.win64.common.tests.zip'], 02:50:21 INFO - u'jittest': [u'firefox-49.0a1.en-US.win64.common.tests.zip', 02:50:21 INFO - u'jsshell-win64.zip'], 02:50:21 INFO - u'mochitest': [u'firefox-49.0a1.en-US.win64.common.tests.zip', 02:50:21 INFO - u'firefox-49.0a1.en-US.win64.mochitest.tests.zip'], 02:50:21 INFO - u'mozbase': [u'firefox-49.0a1.en-US.win64.common.tests.zip'], 02:50:21 INFO - u'reftest': [u'firefox-49.0a1.en-US.win64.common.tests.zip', 02:50:21 INFO - u'firefox-49.0a1.en-US.win64.reftest.tests.zip'], 02:50:21 INFO - u'talos': [u'firefox-49.0a1.en-US.win64.common.tests.zip', 02:50:21 INFO - u'firefox-49.0a1.en-US.win64.talos.tests.zip'], 02:50:21 INFO - u'web-platform': [u'firefox-49.0a1.en-US.win64.common.tests.zip', 02:50:21 INFO - u'firefox-49.0a1.en-US.win64.web-platform.tests.zip'], 02:50:21 INFO - u'xpcshell': [u'firefox-49.0a1.en-US.win64.common.tests.zip', 02:50:21 INFO - u'firefox-49.0a1.en-US.win64.xpcshell.tests.zip']} 02:50:21 INFO - Downloading packages: [u'firefox-49.0a1.en-US.win64.common.tests.zip'] for test suite category: common 02:50:21 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pvtbuilds.pvt.build.mozilla.org', 'pvtbuilds.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org'), ('https://queue.taskcluster.net', 'queue.taskcluster.net')]} 02:50:21 INFO - https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.common.tests.zip matches https://queue.taskcluster.net 02:50:21 INFO - trying https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.common.tests.zip 02:50:21 INFO - Downloading https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.common.tests.zip to C:\slave\test\build\firefox-49.0a1.en-US.win64.common.tests.zip 02:50:21 INFO - retry: Calling _download_file with args: (), kwargs: {'url': u'https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.common.tests.zip', 'file_name': u'C:\\slave\\test\\build\\firefox-49.0a1.en-US.win64.common.tests.zip'}, attempt #1 02:50:22 INFO - Downloaded 19270110 bytes. 02:50:22 INFO - Running command: ['unzip', '-q', '-o', u'C:\\slave\\test\\build\\firefox-49.0a1.en-US.win64.common.tests.zip', '-d', 'C:\\slave\\test\\build\\tests'] 02:50:22 INFO - Copy/paste: unzip -q -o C:\slave\test\build\firefox-49.0a1.en-US.win64.common.tests.zip -d C:\slave\test\build\tests 02:50:40 INFO - Return code: 0 02:50:40 INFO - Downloading packages: [u'firefox-49.0a1.en-US.win64.common.tests.zip', u'firefox-49.0a1.en-US.win64.talos.tests.zip'] for test suite category: talos 02:50:40 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pvtbuilds.pvt.build.mozilla.org', 'pvtbuilds.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org'), ('https://queue.taskcluster.net', 'queue.taskcluster.net')]} 02:50:40 INFO - https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.common.tests.zip matches https://queue.taskcluster.net 02:50:40 INFO - trying https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.common.tests.zip 02:50:40 INFO - Downloading https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.common.tests.zip to C:\slave\test\build\firefox-49.0a1.en-US.win64.common.tests.zip 02:50:40 INFO - retry: Calling _download_file with args: (), kwargs: {'url': u'https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.common.tests.zip', 'file_name': u'C:\\slave\\test\\build\\firefox-49.0a1.en-US.win64.common.tests.zip'}, attempt #1 02:50:42 INFO - Downloaded 19270110 bytes. 02:50:42 INFO - Running command: ['unzip', '-q', '-o', u'C:\\slave\\test\\build\\firefox-49.0a1.en-US.win64.common.tests.zip', '-d', 'C:\\slave\\test\\build\\tests'] 02:50:42 INFO - Copy/paste: unzip -q -o C:\slave\test\build\firefox-49.0a1.en-US.win64.common.tests.zip -d C:\slave\test\build\tests 02:50:58 INFO - Return code: 0 02:50:58 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pvtbuilds.pvt.build.mozilla.org', 'pvtbuilds.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org'), ('https://queue.taskcluster.net', 'queue.taskcluster.net')]} 02:50:58 INFO - https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.talos.tests.zip matches https://queue.taskcluster.net 02:50:58 INFO - trying https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.talos.tests.zip 02:50:58 INFO - Downloading https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.talos.tests.zip to C:\slave\test\build\firefox-49.0a1.en-US.win64.talos.tests.zip 02:50:58 INFO - retry: Calling _download_file with args: (), kwargs: {'url': u'https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.talos.tests.zip', 'file_name': u'C:\\slave\\test\\build\\firefox-49.0a1.en-US.win64.talos.tests.zip'}, attempt #1 02:50:59 INFO - Downloaded 10840145 bytes. 02:50:59 INFO - Running command: ['unzip', '-q', '-o', u'C:\\slave\\test\\build\\firefox-49.0a1.en-US.win64.talos.tests.zip', '-d', 'C:\\slave\\test\\build\\tests'] 02:50:59 INFO - Copy/paste: unzip -q -o C:\slave\test\build\firefox-49.0a1.en-US.win64.talos.tests.zip -d C:\slave\test\build\tests 02:50:59 INFO - Return code: 0 02:50:59 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pvtbuilds.pvt.build.mozilla.org', 'pvtbuilds.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org'), ('https://queue.taskcluster.net', 'queue.taskcluster.net')]} 02:50:59 INFO - https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.zip matches https://queue.taskcluster.net 02:50:59 INFO - trying https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.zip 02:50:59 INFO - Downloading https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.zip to C:\slave\test\build\firefox-49.0a1.en-US.win64.zip 02:50:59 INFO - retry: Calling _download_file with args: (), kwargs: {'url': 'https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.zip', 'file_name': 'C:\\slave\\test\\build\\firefox-49.0a1.en-US.win64.zip'}, attempt #1 02:51:00 INFO - Downloaded 57173916 bytes. 02:51:00 INFO - Setting buildbot property build_url to https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.zip 02:51:00 INFO - mkdir: C:\slave\test\properties 02:51:00 INFO - Writing buildbot properties ['build_url'] to C:\slave\test\properties\build_url 02:51:00 INFO - Writing to file C:\slave\test\properties\build_url 02:51:00 INFO - Contents: 02:51:00 INFO - build_url:https://queue.taskcluster.net/v1/task/GTRwdkPpT0y_uI_CFZT4Aw/artifacts/public/build/firefox-49.0a1.en-US.win64.zip 02:51:01 INFO - Running post-action listener: _resource_record_post_action 02:51:01 INFO - Running post-action listener: set_extra_try_arguments 02:51:01 INFO - ##### 02:51:01 INFO - ##### Running populate-webroot step. 02:51:01 INFO - ##### 02:51:01 INFO - Running pre-action listener: _resource_record_pre_action 02:51:01 INFO - Running main action method: populate_webroot 02:51:01 INFO - {u'extra_options': {u'android': [u'--apkPath=%(apk_path)s']}, 02:51:01 INFO - u'mobile-suites': {u'remote-tp4m_nochrome': {u'tests': [u'tp4m']}, 02:51:01 INFO - u'remote-tsvgx': {u'talos_options': [u'--noChrome', 02:51:01 INFO - u'--tppagecycles', 02:51:01 INFO - u'7'], 02:51:01 INFO - u'tests': [u'tsvgm']}}, 02:51:01 INFO - u'suites': {u'chromez': {u'talos_options': [u'--disable-e10s'], 02:51:01 INFO - u'tests': [u'tresize', u'tcanvasmark']}, 02:51:01 INFO - u'chromez-e10s': {u'tests': [u'tresize', u'tcanvasmark']}, 02:51:01 INFO - u'dromaeojs': {u'talos_options': [u'--disable-e10s'], 02:51:01 INFO - u'tests': [u'dromaeo_css', u'kraken']}, 02:51:01 INFO - u'dromaeojs-e10s': {u'tests': [u'dromaeo_css', u'kraken']}, 02:51:01 INFO - u'g1': {u'pagesets_url': u'http://talos-bundles.pvt.build.mozilla.org/zips/tp5n.zip', 02:51:01 INFO - u'talos_options': [u'--disable-e10s'], 02:51:01 INFO - u'tests': [u'tp5o_scroll', u'glterrain']}, 02:51:01 INFO - u'g1-e10s': {u'pagesets_url': u'http://talos-bundles.pvt.build.mozilla.org/zips/tp5n.zip', 02:51:01 INFO - u'tests': [u'tp5o_scroll', u'glterrain']}, 02:51:01 INFO - u'g2': {u'pagesets_url': u'http://talos-bundles.pvt.build.mozilla.org/zips/tp5n.zip', 02:51:01 INFO - u'talos_options': [u'--disable-e10s'], 02:51:01 INFO - u'tests': [u'damp', u'tps']}, 02:51:01 INFO - u'g2-e10s': {u'pagesets_url': u'http://talos-bundles.pvt.build.mozilla.org/zips/tp5n.zip', 02:51:01 INFO - u'tests': [u'damp', u'tps']}, 02:51:01 INFO - u'g3': {u'talos_options': [u'--disable-e10s'], 02:51:01 INFO - u'tests': [u'dromaeo_dom']}, 02:51:01 INFO - u'g3-e10s': {u'tests': [u'dromaeo_dom']}, 02:51:01 INFO - u'other': {u'talos_options': [u'--disable-e10s'], 02:51:01 INFO - u'tests': [u'a11yr', 02:51:01 INFO - u'ts_paint', 02:51:01 INFO - u'tpaint', 02:51:01 INFO - u'sessionrestore', 02:51:01 INFO - u'sessionrestore_no_auto_restore', 02:51:01 INFO - u'tabpaint']}, 02:51:01 INFO - u'other-e10s': {u'tests': [u'a11yr', 02:51:01 INFO - u'ts_paint', 02:51:01 INFO - u'tpaint', 02:51:01 INFO - u'sessionrestore', 02:51:01 INFO - u'sessionrestore_no_auto_restore', 02:51:01 INFO - u'tabpaint']}, 02:51:01 INFO - u'other-e10s_l64': {u'tests': [u'a11yr', 02:51:01 INFO - u'ts_paint', 02:51:01 INFO - u'tpaint', 02:51:01 INFO - u'sessionrestore', 02:51:01 INFO - u'sessionrestore_no_auto_restore', 02:51:01 INFO - u'tabpaint']}, 02:51:01 INFO - u'other-e10s_nol64': {u'tests': [u'a11yr', 02:51:01 INFO - u'ts_paint', 02:51:01 INFO - u'tpaint', 02:51:01 INFO - u'sessionrestore', 02:51:01 INFO - u'sessionrestore_no_auto_restore', 02:51:01 INFO - u'tabpaint']}, 02:51:01 INFO - u'other_l64': {u'talos_options': [u'--disable-e10s'], 02:51:01 INFO - u'tests': [u'a11yr', 02:51:01 INFO - u'ts_paint', 02:51:01 INFO - u'tpaint', 02:51:01 INFO - u'sessionrestore', 02:51:01 INFO - u'sessionrestore_no_auto_restore', 02:51:01 INFO - u'tabpaint']}, 02:51:01 INFO - u'other_nol64': {u'talos_options': [u'--disable-e10s'], 02:51:01 INFO - u'tests': [u'a11yr', 02:51:01 INFO - u'ts_paint', 02:51:01 INFO - u'tpaint', 02:51:01 INFO - u'sessionrestore', 02:51:01 INFO - u'sessionrestore_no_auto_restore', 02:51:01 INFO - u'tabpaint']}, 02:51:01 INFO - u'svgr': {u'talos_options': [u'--disable-e10s'], 02:51:01 INFO - u'tests': [u'tsvgx', 02:51:01 INFO - u'tsvgr_opacity', 02:51:01 INFO - u'tart', 02:51:01 INFO - u'tscrollx', 02:51:01 INFO - u'cart']}, 02:51:01 INFO - u'svgr-e10s': {u'tests': [u'tsvgx', 02:51:01 INFO - u'tsvgr_opacity', 02:51:01 INFO - u'tart', 02:51:01 INFO - u'tscrollx', 02:51:01 INFO - u'cart']}, 02:51:01 INFO - u'tp5o': {u'pagesets_url': u'http://talos-bundles.pvt.build.mozilla.org/zips/tp5n.zip', 02:51:01 INFO - u'talos_options': [u'--disable-e10s'], 02:51:01 INFO - u'tests': [u'tp5o']}, 02:51:01 INFO - u'tp5o-e10s': {u'pagesets_url': u'http://talos-bundles.pvt.build.mozilla.org/zips/tp5n.zip', 02:51:01 INFO - u'tests': [u'tp5o']}, 02:51:01 INFO - u'xperf': {u'pagesets_url': u'http://talos-bundles.pvt.build.mozilla.org/zips/tp5n.zip', 02:51:01 INFO - u'talos_options': [u'--disable-e10s', 02:51:01 INFO - u'--xperf_path', 02:51:01 INFO - u'"c:/Program Files/Microsoft Windows Performance Toolkit/xperf.exe"'], 02:51:01 INFO - u'tests': [u'tp5n']}, 02:51:01 INFO - u'xperf-e10s': {u'pagesets_url': u'http://talos-bundles.pvt.build.mozilla.org/zips/tp5n.zip', 02:51:01 INFO - u'talos_options': [u'--xperf_path', 02:51:01 INFO - u'"c:/Program Files/Microsoft Windows Performance Toolkit/xperf.exe"'], 02:51:01 INFO - u'tests': [u'tp5n']}}, 02:51:01 INFO - u'talos.zip': {u'path': u'', 02:51:01 INFO - u'url': u'http://talos-bundles.pvt.build.mozilla.org/zips/talos.a6052c33d420.zip'}} 02:51:01 INFO - Running post-action listener: _resource_record_post_action 02:51:01 INFO - ##### 02:51:01 INFO - ##### Running create-virtualenv step. 02:51:01 INFO - ##### 02:51:01 INFO - Running pre-action listener: _resource_record_pre_action 02:51:01 INFO - Running main action method: create_virtualenv 02:51:01 INFO - Creating virtualenv C:\slave\test\build/venv 02:51:01 INFO - mkdir: C:\slave\test\build\venv\Scripts 02:51:01 INFO - Copying c:/mozilla-build/python27/python27.dll to C:\slave\test\build\venv\Scripts\python27.dll 02:51:01 WARNING - Can't copy c:/mozilla-build/python27/python27.dll to C:\slave\test\build\venv\Scripts\python27.dll: [Errno 2] No such file or directory: 'c:/mozilla-build/python27/python27.dll'! 02:51:01 INFO - Running command: ['c:/mozilla-build/python27/python.exe', 'c:/mozilla-build/buildbotve/virtualenv.py', '--no-site-packages', '--distribute', 'C:\\slave\\test\\build/venv'] in C:\slave\test\build 02:51:01 INFO - Copy/paste: c:/mozilla-build/python27/python.exe c:/mozilla-build/buildbotve/virtualenv.py --no-site-packages --distribute C:\slave\test\build/venv 02:51:05 INFO - New python executable in C:\slave\test\build/venv\Scripts\python.exe 02:51:09 INFO - Installing distribute......................................................................................................................................................................................done. remoteFailed: [Failure instance: Traceback (failure with no frames): : Connection to the other side was lost in a non-clean fashion. ] [Failure instance: Traceback (failure with no frames): : Connection to the other side was lost in a non-clean fashion. ] ========= Finished 'c:/mozilla-build/python27/python -u ...' interrupted (results: 5, elapsed: 53 secs) (at 2016-04-28 02:51:14.022409) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Total master_lag: 16.18 =========