builder: mozilla-beta_ubuntu32_vm_test_pgo-mochitest-clipboard-e10s slave: tst-linux32-spot-449 starttime: 1479685839.16 results: retry (5) buildid: 20161120124621 builduid: 80a8c967c2304a7a921f0ec868a5e8f8 revision: 8c348d0e715122df9906583cfba66afcce83394f ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2016-11-20 15:50:39.162853) ========= master: http://buildbot-master142.bb.releng.usw2.mozilla.com:8201/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2016-11-20 15:50:39.163266) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-11-20 15:50:39.163545) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-11-20 15:50:39.199298) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2016-11-20 15:50:39.199559) ========= bash -c 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py' in dir /builds/slave/test/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py'] environment: HOME=/home/cltbld LANG=en_US.UTF-8 LOGNAME=cltbld MAIL=/var/mail/cltbld NODE_PATH=/usr/lib/nodejs:/usr/lib/node_modules:/usr/share/javascript PATH=/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games PWD=/builds/slave/test SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld XDG_SESSION_COOKIE=5a152710dd62cc268aad214e000002d8-1479685391.131009-1205078908 _=/tools/buildbot/bin/python using PTY: False --2016-11-20 15:50:39-- https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py Resolving hg.mozilla.org (hg.mozilla.org)... 63.245.215.25, 63.245.215.102 Connecting to hg.mozilla.org (hg.mozilla.org)|63.245.215.25|:443... connected. HTTP request sent, awaiting response... 200 Script output follows Length: 12179 (12K) [text/x-python] Saving to: `archiver_client.py' 0K .......... . 100% 9.27M=0.001s 2016-11-20 15:50:39 (9.27 MB/s) - `archiver_client.py' saved [12179/12179] program finished with exit code 0 elapsedTime=0.288495 ========= master_lag: 0.03 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2016-11-20 15:50:39.517627) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-11-20 15:50:39.517910) ========= rm -rf scripts properties in dir /builds/slave/test/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: HOME=/home/cltbld LANG=en_US.UTF-8 LOGNAME=cltbld MAIL=/var/mail/cltbld NODE_PATH=/usr/lib/nodejs:/usr/lib/node_modules:/usr/share/javascript PATH=/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games PWD=/builds/slave/test SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld XDG_SESSION_COOKIE=5a152710dd62cc268aad214e000002d8-1479685391.131009-1205078908 _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.058272 ========= master_lag: 0.03 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-11-20 15:50:39.602153) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 1 secs) (at 2016-11-20 15:50:39.602488) ========= bash -c 'python archiver_client.py mozharness --repo releases/mozilla-beta --rev 8c348d0e715122df9906583cfba66afcce83394f --destination scripts --debug' in dir /builds/slave/test/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', u'python archiver_client.py mozharness --repo releases/mozilla-beta --rev 8c348d0e715122df9906583cfba66afcce83394f --destination scripts --debug'] environment: HOME=/home/cltbld LANG=en_US.UTF-8 LOGNAME=cltbld MAIL=/var/mail/cltbld NODE_PATH=/usr/lib/nodejs:/usr/lib/node_modules:/usr/share/javascript PATH=/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games PWD=/builds/slave/test SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld XDG_SESSION_COOKIE=5a152710dd62cc268aad214e000002d8-1479685391.131009-1205078908 _=/tools/buildbot/bin/python using PTY: False 2016-11-20 15:50:39,684 truncating revision to first 12 chars 2016-11-20 15:50:39,685 Setting DEBUG logging. 2016-11-20 15:50:39,685 attempt 1/10 2016-11-20 15:50:39,685 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/releases/mozilla-beta/8c348d0e7151?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2016-11-20 15:50:40,817 unpacking tar archive at: mozilla-beta-8c348d0e7151/testing/mozharness/ program finished with exit code 0 elapsedTime=1.546658 ========= master_lag: 0.03 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 1 secs) (at 2016-11-20 15:50:41.175925) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-11-20 15:50:41.176256) ========= script_repo_revision: 8c348d0e715122df9906583cfba66afcce83394f ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-11-20 15:50:41.176646) ========= ========= Started downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2016-11-20 15:50:41.176916) ========= ========= Finished downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2016-11-20 15:50:41.308231) ========= ========= Started '/tools/buildbot/bin/python -u ...' interrupted (results: 5, elapsed: 3 mins, 47 secs) (at 2016-11-20 15:50:41.308586) ========= /tools/buildbot/bin/python -u scripts/scripts/desktop_unittest.py --cfg unittests/linux_unittest.py --mochitest-suite plain-clipboard,chrome-clipboard,browser-chrome-clipboard,jetpack-package-clipboard --e10s --blob-upload-branch mozilla-beta --download-symbols ondemand in dir /builds/slave/test/. (timeout 1800 secs) (maxTime 7200 secs) watching logfiles {} argv: ['/tools/buildbot/bin/python', '-u', 'scripts/scripts/desktop_unittest.py', '--cfg', 'unittests/linux_unittest.py', '--mochitest-suite', 'plain-clipboard,chrome-clipboard,browser-chrome-clipboard,jetpack-package-clipboard', '--e10s', '--blob-upload-branch', 'mozilla-beta', '--download-symbols', 'ondemand'] environment: CCACHE_DIR=/builds/ccache CCACHE_UMASK=002 DISPLAY=:0 HOME=/home/cltbld LANG=en_US.UTF-8 LOGNAME=cltbld MAIL=/var/mail/cltbld MOZ_HIDE_RESULTS_TABLE=1 MOZ_NODE_PATH=/usr/bin/node MOZ_NO_REMOTE=1 NODE_PATH=/usr/lib/nodejs:/usr/lib/node_modules:/usr/share/javascript NO_FAIL_ON_TEST_ERRORS=1 PATH=/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games PROPERTIES_FILE=/builds/slave/test/buildprops.json PWD=/builds/slave/test SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld XDG_SESSION_COOKIE=5a152710dd62cc268aad214e000002d8-1479685391.131009-1205078908 _=/tools/buildbot/bin/python using PTY: False 15:50:41 INFO - MultiFileLogger online at 20161120 15:50:41 in /builds/slave/test 15:50:41 INFO - Run as scripts/scripts/desktop_unittest.py --cfg unittests/linux_unittest.py --mochitest-suite plain-clipboard,chrome-clipboard,browser-chrome-clipboard,jetpack-package-clipboard --e10s --blob-upload-branch mozilla-beta --download-symbols ondemand 15:50:41 INFO - Dumping config to /builds/slave/test/logs/localconfig.json. 15:50:41 INFO - {'all_cppunittest_suites': {'cppunittest': {'tests': ('tests/cppunittest',)}}, 15:50:41 INFO - 'all_gtest_suites': {'gtest': ()}, 15:50:41 INFO - 'all_jittest_suites': {'jittest': (), 15:50:41 INFO - 'jittest-chunked': (), 15:50:41 INFO - 'jittest1': ('--total-chunks=2', '--this-chunk=1'), 15:50:41 INFO - 'jittest2': ('--total-chunks=2', '--this-chunk=2')}, 15:50:41 INFO - 'all_mochitest_suites': {'a11y': ('--flavor=a11y',), 15:50:41 INFO - 'browser-chrome': ('--flavor=browser',), 15:50:41 INFO - 'browser-chrome-addons': ('--flavor=browser', 15:50:41 INFO - '--chunk-by-runtime', 15:50:41 INFO - '--tag=addons'), 15:50:41 INFO - 'browser-chrome-chunked': ('--flavor=browser', 15:50:41 INFO - '--chunk-by-runtime'), 15:50:41 INFO - 'browser-chrome-clipboard': ('--flavor=browser', 15:50:41 INFO - '--subsuite=clipboard'), 15:50:41 INFO - 'browser-chrome-coverage': ('--flavor=browser', 15:50:41 INFO - '--chunk-by-runtime', 15:50:41 INFO - '--timeout=1200'), 15:50:41 INFO - 'browser-chrome-gpu': ('--flavor=browser', 15:50:41 INFO - '--subsuite=gpu'), 15:50:41 INFO - 'browser-chrome-screenshots': ('--flavor=browser', 15:50:41 INFO - '--subsuite=screenshots'), 15:50:41 INFO - 'chrome': ('--flavor=chrome',), 15:50:41 INFO - 'chrome-chunked': ('--flavor=chrome', 15:50:41 INFO - '--chunk-by-dir=4'), 15:50:41 INFO - 'chrome-clipboard': ('--flavor=chrome', 15:50:41 INFO - '--subsuite=clipboard'), 15:50:41 INFO - 'chrome-gpu': ('--flavor=chrome', '--subsuite=gpu'), 15:50:41 INFO - 'jetpack-addon': ('--flavor=jetpack-addon',), 15:50:41 INFO - 'jetpack-package': ('--flavor=jetpack-package',), 15:50:41 INFO - 'jetpack-package-clipboard': ('--flavor=jetpack-package', 15:50:41 INFO - '--subsuite=clipboard'), 15:50:41 INFO - 'mochitest-devtools-chrome': ('--flavor=browser', 15:50:41 INFO - '--subsuite=devtools'), 15:50:41 INFO - 'mochitest-devtools-chrome-chunked': ('--flavor=browser', 15:50:41 INFO - '--subsuite=devtools', 15:50:41 INFO - '--chunk-by-runtime'), 15:50:41 INFO - 'mochitest-gl': ('--subsuite=webgl',), 15:50:41 INFO - 'mochitest-media': ('--subsuite=media',), 15:50:41 INFO - 'plain': (), 15:50:41 INFO - 'plain-chunked': ('--chunk-by-dir=4',), 15:50:41 INFO - 'plain-clipboard': ('--subsuite=clipboard',), 15:50:41 INFO - 'plain-gpu': ('--subsuite=gpu',), 15:50:41 INFO - 'valgrind-plain': ('--valgrind=/usr/bin/valgrind', 15:50:41 INFO - '--valgrind-supp-files=/builds/slave/test/build/tests/mochitest/i386-redhat-linux-gnu.sup,/builds/slave/test/build/tests/mochitest/cross-architecture.sup', 15:50:41 INFO - '--timeout=900', 15:50:41 INFO - '--max-timeouts=50')}, 15:50:41 INFO - 'all_mozbase_suites': {'mozbase': ()}, 15:50:41 INFO - 'all_reftest_suites': {'crashtest': {'options': ('--suite=crashtest',), 15:50:41 INFO - 'tests': ('tests/reftest/tests/testing/crashtest/crashtests.list',)}, 15:50:41 INFO - 'crashtest-ipc': {'env': {'MOZ_DISABLE_CONTEXT_SHARING_GLX': '1', 15:50:41 INFO - 'MOZ_OMTC_ENABLED': '1'}, 15:50:41 INFO - 'options': ('--suite=crashtest', 15:50:41 INFO - '--setpref=browser.tabs.remote=true', 15:50:41 INFO - '--setpref=browser.tabs.remote.autostart=true', 15:50:41 INFO - '--setpref=extensions.e10sBlocksEnabling=false', 15:50:41 INFO - '--setpref=layers.async-pan-zoom.enabled=true'), 15:50:41 INFO - 'tests': ('tests/reftest/tests/testing/crashtest/crashtests.list',)}, 15:50:41 INFO - 'jsreftest': {'options': ('--extra-profile-file=tests/jsreftest/tests/user.js', 15:50:41 INFO - '--suite=jstestbrowser'), 15:50:41 INFO - 'tests': ('tests/jsreftest/tests/jstests.list',)}, 15:50:41 INFO - 'reftest': {'options': ('--suite=reftest',), 15:50:41 INFO - 'tests': ('tests/reftest/tests/layout/reftests/reftest.list',)}, 15:50:41 INFO - 'reftest-ipc': {'env': {'MOZ_DISABLE_CONTEXT_SHARING_GLX': '1', 15:50:41 INFO - 'MOZ_OMTC_ENABLED': '1'}, 15:50:41 INFO - 'options': ('--suite=reftest', 15:50:41 INFO - '--setpref=browser.tabs.remote=true', 15:50:41 INFO - '--setpref=browser.tabs.remote.autostart=true', 15:50:41 INFO - '--setpref=extensions.e10sBlocksEnabling=false', 15:50:41 INFO - '--setpref=layers.async-pan-zoom.enabled=true'), 15:50:41 INFO - 'tests': ('tests/reftest/tests/layout/reftests/reftest-sanity/reftest.list',)}, 15:50:41 INFO - 'reftest-no-accel': {'options': ('--suite=reftest', 15:50:41 INFO - '--setpref=layers.acceleration.force-enabled=disabled'), 15:50:41 INFO - 'tests': ('tests/reftest/tests/layout/reftests/reftest.list',)}}, 15:50:41 INFO - 'all_xpcshell_suites': {'xpcshell': {'options': ('--xpcshell=%(abs_app_dir)s/xpcshell', 15:50:41 INFO - '--manifest=tests/xpcshell/tests/xpcshell.ini'), 15:50:41 INFO - 'tests': ()}, 15:50:41 INFO - 'xpcshell-addons': {'options': ('--xpcshell=%(abs_app_dir)s/xpcshell', 15:50:41 INFO - '--tag=addons', 15:50:41 INFO - '--manifest=tests/xpcshell/tests/xpcshell.ini'), 15:50:41 INFO - 'tests': ()}, 15:50:41 INFO - 'xpcshell-coverage': {'options': ('--xpcshell=%(abs_app_dir)s/xpcshell', 15:50:41 INFO - '--manifest=tests/xpcshell/tests/xpcshell.ini'), 15:50:41 INFO - 'tests': ()}}, 15:50:41 INFO - 'allow_software_gl_layers': False, 15:50:41 INFO - 'append_to_log': False, 15:50:41 INFO - 'base_work_dir': '/builds/slave/test', 15:50:41 INFO - 'binary_path': '/builds/slave/test/build/firefox/firefox-bin', 15:50:41 INFO - 'blob_upload_branch': 'mozilla-beta', 15:50:41 INFO - 'blob_uploader_auth_file': '/builds/slave/test/oauth.txt', 15:50:41 INFO - 'buildbot_json_path': 'buildprops.json', 15:50:41 INFO - 'buildbot_max_log_size': 52428800, 15:50:41 INFO - 'code_coverage': False, 15:50:41 INFO - 'config_files': ('unittests/linux_unittest.py',), 15:50:41 INFO - 'default_blob_upload_servers': ('https://blobupload.elasticbeanstalk.com',), 15:50:41 INFO - 'download_minidump_stackwalk': True, 15:50:41 INFO - 'download_symbols': 'ondemand', 15:50:41 INFO - 'e10s': True, 15:50:41 INFO - 'exe_suffix': '', 15:50:41 INFO - 'exes': {'python': '/tools/buildbot/bin/python', 15:50:41 INFO - 'tooltool.py': '/tools/tooltool.py', 15:50:41 INFO - 'virtualenv': ('/tools/buildbot/bin/python', 15:50:41 INFO - '/tools/misc-python/virtualenv.py')}, 15:50:41 INFO - 'find_links': ('http://pypi.pvt.build.mozilla.org/pub', 15:50:41 INFO - 'http://pypi.pub.build.mozilla.org/pub'), 15:50:41 INFO - 'installer_path': '/builds/slave/test/build/installer.tar.bz2', 15:50:41 INFO - 'log_level': 'info', 15:50:41 INFO - 'log_to_console': True, 15:50:41 INFO - 'minidump_save_path': '%(abs_work_dir)s/../minidumps', 15:50:41 INFO - 'minidump_stackwalk_path': 'linux32-minidump_stackwalk', 15:50:41 INFO - 'minidump_tooltool_manifest_path': 'config/tooltool-manifests/linux32/releng.manifest', 15:50:41 INFO - 'minimum_tests_zip_dirs': ('bin/*', 15:50:41 INFO - 'certs/*', 15:50:41 INFO - 'config/*', 15:50:41 INFO - 'mach', 15:50:41 INFO - 'marionette/*', 15:50:41 INFO - 'modules/*', 15:50:41 INFO - 'mozbase/*', 15:50:41 INFO - 'tools/*'), 15:50:41 INFO - 'no_random': False, 15:50:41 INFO - 'opt_config_files': (), 15:50:41 INFO - 'pip_index': False, 15:50:41 INFO - 'preflight_run_cmd_suites': ({'architectures': ('32bit', '64bit'), 15:50:41 INFO - 'cmd': ('xset', 's', 'off', 's', 'reset'), 15:50:41 INFO - 'enabled': True, 15:50:41 INFO - 'halt_on_failure': False, 15:50:41 INFO - 'name': 'disable_screen_saver'}, 15:50:41 INFO - {'architectures': ('32bit',), 15:50:41 INFO - 'cmd': ('python', 15:50:41 INFO - '../scripts/external_tools/mouse_and_screen_resolution.py', 15:50:41 INFO - '--configuration-file', 15:50:41 INFO - '../scripts/external_tools/machine-configuration.json'), 15:50:41 INFO - 'enabled': False, 15:50:41 INFO - 'halt_on_failure': True, 15:50:41 INFO - 'name': 'run mouse & screen adjustment script'}), 15:50:41 INFO - 'require_test_zip': True, 15:50:41 INFO - 'run_all_suites': False, 15:50:41 INFO - 'run_cmd_checks_enabled': True, 15:50:41 INFO - 'run_file_names': {'cppunittest': 'runcppunittests.py', 15:50:41 INFO - 'gtest': 'rungtests.py', 15:50:41 INFO - 'jittest': 'jit_test.py', 15:50:41 INFO - 'mochitest': 'runtests.py', 15:50:41 INFO - 'mozbase': 'test.py', 15:50:41 INFO - 'mozmill': 'runtestlist.py', 15:50:41 INFO - 'reftest': 'runreftest.py', 15:50:41 INFO - 'xpcshell': 'runxpcshelltests.py'}, 15:50:41 INFO - 'specific_tests_zip_dirs': {'cppunittest': ('cppunittest/*',), 15:50:41 INFO - 'gtest': ('gtest/*',), 15:50:41 INFO - 'jittest': ('jit-test/*',), 15:50:41 INFO - 'mochitest': ('mochitest/*',), 15:50:41 INFO - 'mozbase': ('mozbase/*',), 15:50:41 INFO - 'mozmill': ('mozmill/*',), 15:50:41 INFO - 'reftest': ('reftest/*', 'jsreftest/*'), 15:50:41 INFO - 'xpcshell': ('xpcshell/*',)}, 15:50:41 INFO - 'specified_mochitest_suites': ('plain-clipboard', 15:50:41 INFO - 'chrome-clipboard', 15:50:41 INFO - 'browser-chrome-clipboard', 15:50:41 INFO - 'jetpack-package-clipboard'), 15:50:41 INFO - 'strict_content_sandbox': False, 15:50:41 INFO - 'structured_suites': ('reftest',), 15:50:41 INFO - 'suite_definitions': {'cppunittest': {'options': ('--symbols-path=%(symbols_path)s', 15:50:41 INFO - '--xre-path=%(abs_app_dir)s'), 15:50:41 INFO - 'run_filename': 'runcppunittests.py', 15:50:41 INFO - 'testsdir': 'cppunittest'}, 15:50:41 INFO - 'gtest': {'options': ('--xre-path=%(abs_res_dir)s', 15:50:41 INFO - '--cwd=%(gtest_dir)s', 15:50:41 INFO - '--symbols-path=%(symbols_path)s', 15:50:41 INFO - '--utility-path=tests/bin', 15:50:41 INFO - '%(binary_path)s'), 15:50:41 INFO - 'run_filename': 'rungtests.py'}, 15:50:41 INFO - 'jittest': {'options': ('tests/bin/js', 15:50:41 INFO - '--no-slow', 15:50:41 INFO - '--no-progress', 15:50:41 INFO - '--format=automation', 15:50:41 INFO - '--jitflags=all', 15:50:41 INFO - '--timeout=970'), 15:50:41 INFO - 'run_filename': 'jit_test.py', 15:50:41 INFO - 'run_timeout': 1000, 15:50:41 INFO - 'testsdir': 'jit-test/jit-test'}, 15:50:41 INFO - 'luciddream-b2gdt': {'options': ('--startup-timeout=300', 15:50:41 INFO - '--log-raw=%(raw_log_file)s', 15:50:41 INFO - '--log-errorsummary=%(error_summary_file)s', 15:50:41 INFO - '--browser-path=%(browser_path)s', 15:50:41 INFO - '--b2g-desktop-path=%(fxos_desktop_path)s', 15:50:41 INFO - '--gaia-profile=%(gaia_profile)s', 15:50:41 INFO - '%(test_manifest)s')}, 15:50:41 INFO - 'luciddream-emulator': {'options': ('--startup-timeout=300', 15:50:41 INFO - '--log-raw=%(raw_log_file)s', 15:50:41 INFO - '--log-errorsummary=%(error_summary_file)s', 15:50:41 INFO - '--browser-path=%(browser_path)s', 15:50:41 INFO - '--b2gpath=%(emulator_path)s', 15:50:41 INFO - '%(test_manifest)s')}, 15:50:41 INFO - 'mochitest': {'options': ('--appname=%(binary_path)s', 15:50:41 INFO - '--utility-path=tests/bin', 15:50:41 INFO - '--extra-profile-file=tests/bin/plugins', 15:50:41 INFO - '--symbols-path=%(symbols_path)s', 15:50:41 INFO - '--certificate-path=tests/certs', 15:50:41 INFO - '--setpref=webgl.force-enabled=true', 15:50:41 INFO - '--quiet', 15:50:41 INFO - '--log-raw=%(raw_log_file)s', 15:50:41 INFO - '--log-errorsummary=%(error_summary_file)s', 15:50:41 INFO - '--use-test-media-devices', 15:50:41 INFO - '--screenshot-on-fail', 15:50:41 INFO - '--cleanup-crashes'), 15:50:41 INFO - 'run_filename': 'runtests.py', 15:50:41 INFO - 'testsdir': 'mochitest'}, 15:50:41 INFO - 'mozbase': {'options': ('-b', '%(binary_path)s'), 15:50:41 INFO - 'run_filename': 'test.py', 15:50:41 INFO - 'testsdir': 'mozbase'}, 15:50:41 INFO - 'mozmill': {'options': ('--binary=%(binary_path)s', 15:50:41 INFO - '--testing-modules-dir=test/modules', 15:50:41 INFO - '--plugins-path=%(test_plugin_path)s', 15:50:41 INFO - '--symbols-path=%(symbols_path)s'), 15:50:41 INFO - 'run_filename': 'runtestlist.py', 15:50:41 INFO - 'testsdir': 'mozmill'}, 15:50:41 INFO - 'reftest': {'options': ('--appname=%(binary_path)s', 15:50:41 INFO - '--utility-path=tests/bin', 15:50:41 INFO - '--extra-profile-file=tests/bin/plugins', 15:50:41 INFO - '--symbols-path=%(symbols_path)s', 15:50:41 INFO - '--log-raw=%(raw_log_file)s', 15:50:41 INFO - '--log-errorsummary=%(error_summary_file)s', 15:50:41 INFO - '--cleanup-crashes'), 15:50:41 INFO - 'run_filename': 'runreftest.py', 15:50:41 INFO - 'testsdir': 'reftest'}, 15:50:41 INFO - 'xpcshell': {'options': ('--symbols-path=%(symbols_path)s', 15:50:41 INFO - '--test-plugin-path=%(test_plugin_path)s', 15:50:41 INFO - '--log-raw=%(raw_log_file)s', 15:50:41 INFO - '--log-errorsummary=%(error_summary_file)s', 15:50:41 INFO - '--utility-path=tests/bin'), 15:50:41 INFO - 'run_filename': 'runxpcshelltests.py', 15:50:41 INFO - 'testsdir': 'xpcshell'}}, 15:50:41 INFO - 'tooltool_cache': '/builds/tooltool_cache', 15:50:41 INFO - 'vcs_output_timeout': 1000, 15:50:41 INFO - 'virtualenv_path': 'venv', 15:50:41 INFO - 'volatile_config': {'actions': None, 'add_actions': None, 'no_actions': None}, 15:50:41 INFO - 'work_dir': 'build', 15:50:41 INFO - 'xpcshell_name': 'xpcshell'} 15:50:41 INFO - [mozharness: 2016-11-20 23:50:41.633477Z] Running clobber step. 15:50:41 INFO - Running pre-action listener: _resource_record_pre_action 15:50:41 INFO - Running main action method: clobber 15:50:41 INFO - rmtree: /builds/slave/test/build 15:50:41 INFO - retry: Calling rmtree with args: ('/builds/slave/test/build',), kwargs: {}, attempt #1 15:50:44 INFO - Running post-action listener: _resource_record_post_action 15:50:44 INFO - [mozharness: 2016-11-20 23:50:44.729951Z] Finished clobber step (success) 15:50:44 INFO - [mozharness: 2016-11-20 23:50:44.730280Z] Running read-buildbot-config step. 15:50:44 INFO - Running pre-action listener: _resource_record_pre_action 15:50:44 INFO - Running main action method: read_buildbot_config 15:50:44 INFO - Using buildbot properties: 15:50:44 INFO - { 15:50:44 INFO - "project": "", 15:50:44 INFO - "product": "firefox", 15:50:44 INFO - "script_repo_revision": "production", 15:50:44 INFO - "scheduler": "tests-mozilla-beta-ubuntu32_vm-pgo-unittest", 15:50:44 INFO - "repository": "", 15:50:44 INFO - "buildername": "Ubuntu VM 12.04 mozilla-beta pgo test mochitest-clipboard-e10s", 15:50:44 INFO - "buildid": "20161120124621", 15:50:44 INFO - "pgo_build": "True", 15:50:44 INFO - "basedir": "/builds/slave/test", 15:50:44 INFO - "buildnumber": 6, 15:50:44 INFO - "slavename": "tst-linux32-spot-449", 15:50:44 INFO - "revision": "8c348d0e715122df9906583cfba66afcce83394f", 15:50:44 INFO - "master": "http://buildbot-master142.bb.releng.usw2.mozilla.com:8201/", 15:50:44 INFO - "platform": "linux", 15:50:44 INFO - "branch": "mozilla-beta", 15:50:44 INFO - "repo_path": "releases/mozilla-beta", 15:50:44 INFO - "moz_repo_path": "", 15:50:44 INFO - "stage_platform": "linux-pgo", 15:50:44 INFO - "builduid": "80a8c967c2304a7a921f0ec868a5e8f8", 15:50:44 INFO - "slavebuilddir": "test" 15:50:44 INFO - } 15:50:44 INFO - Found installer url https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.tar.bz2. 15:50:44 INFO - Found a test packages url https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.test_packages.json. 15:50:44 INFO - Running post-action listener: _resource_record_post_action 15:50:44 INFO - [mozharness: 2016-11-20 23:50:44.738743Z] Finished read-buildbot-config step (success) 15:50:44 INFO - [mozharness: 2016-11-20 23:50:44.739028Z] Running download-and-extract step. 15:50:44 INFO - Running pre-action listener: _resource_record_pre_action 15:50:44 INFO - Running main action method: download_and_extract 15:50:44 INFO - mkdir: /builds/slave/test/build/tests 15:50:44 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org')]} 15:50:44 INFO - trying https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.test_packages.json 15:50:44 INFO - Downloading https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.test_packages.json to /builds/slave/test/build/firefox-51.0.en-US.linux-i686.test_packages.json 15:50:44 INFO - retry: Calling _download_file with args: (), kwargs: {'url': 'https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.test_packages.json', 'file_name': '/builds/slave/test/build/firefox-51.0.en-US.linux-i686.test_packages.json'}, attempt #1 15:50:45 INFO - Downloaded 1291 bytes. 15:50:45 INFO - Reading from file /builds/slave/test/build/firefox-51.0.en-US.linux-i686.test_packages.json 15:50:45 INFO - Using the following test package requirements: 15:50:45 INFO - {u'common': [u'firefox-51.0.en-US.linux-i686.common.tests.zip'], 15:50:45 INFO - u'cppunittest': [u'firefox-51.0.en-US.linux-i686.common.tests.zip', 15:50:45 INFO - u'firefox-51.0.en-US.linux-i686.cppunittest.tests.zip'], 15:50:45 INFO - u'gtest': [u'firefox-51.0.en-US.linux-i686.common.tests.zip', 15:50:45 INFO - u'firefox-51.0.en-US.linux-i686.gtest.tests.zip'], 15:50:45 INFO - u'jittest': [u'firefox-51.0.en-US.linux-i686.common.tests.zip', 15:50:45 INFO - u'jsshell-linux-i686.zip'], 15:50:45 INFO - u'mochitest': [u'firefox-51.0.en-US.linux-i686.common.tests.zip', 15:50:45 INFO - u'firefox-51.0.en-US.linux-i686.mochitest.tests.zip'], 15:50:45 INFO - u'mozbase': [u'firefox-51.0.en-US.linux-i686.common.tests.zip'], 15:50:45 INFO - u'reftest': [u'firefox-51.0.en-US.linux-i686.common.tests.zip', 15:50:45 INFO - u'firefox-51.0.en-US.linux-i686.reftest.tests.zip'], 15:50:45 INFO - u'talos': [u'firefox-51.0.en-US.linux-i686.common.tests.zip', 15:50:45 INFO - u'firefox-51.0.en-US.linux-i686.talos.tests.zip'], 15:50:45 INFO - u'web-platform': [u'firefox-51.0.en-US.linux-i686.common.tests.zip', 15:50:45 INFO - u'firefox-51.0.en-US.linux-i686.web-platform.tests.zip'], 15:50:45 INFO - u'xpcshell': [u'firefox-51.0.en-US.linux-i686.common.tests.zip', 15:50:45 INFO - u'firefox-51.0.en-US.linux-i686.xpcshell.tests.zip']} 15:50:45 INFO - Downloading packages: [u'firefox-51.0.en-US.linux-i686.common.tests.zip', u'firefox-51.0.en-US.linux-i686.mochitest.tests.zip'] for test suite category: mochitest 15:50:45 INFO - Downloading and extracting to /builds/slave/test/build/tests these dirs bin/*, certs/*, config/*, mach, marionette/*, modules/*, mozbase/*, tools/*, mochitest/* from https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.common.tests.zip 15:50:45 INFO - retry: Calling fetch_url_into_memory with args: (), kwargs: {'url': u'https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.common.tests.zip'}, attempt #1 15:50:45 INFO - Fetch https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.common.tests.zip into memory 15:50:46 INFO - Expected file size: 21852125 15:50:52 INFO - Downloading and extracting to /builds/slave/test/build/tests these dirs bin/*, certs/*, config/*, mach, marionette/*, modules/*, mozbase/*, tools/*, mochitest/* from https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.mochitest.tests.zip 15:50:52 INFO - retry: Calling fetch_url_into_memory with args: (), kwargs: {'url': u'https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.mochitest.tests.zip'}, attempt #1 15:50:52 INFO - Fetch https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.mochitest.tests.zip into memory 15:50:52 INFO - Expected file size: 73393197 15:51:06 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org')]} 15:51:06 INFO - trying https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.tar.bz2 15:51:06 INFO - Downloading https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.tar.bz2 to /builds/slave/test/build/installer.tar.bz2 15:51:06 INFO - retry: Calling _download_file with args: (), kwargs: {'url': 'https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.tar.bz2', 'file_name': '/builds/slave/test/build/installer.tar.bz2'}, attempt #1 15:51:17 INFO - Downloaded 57828281 bytes. 15:51:17 INFO - Setting buildbot property build_url to https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.tar.bz2 15:51:17 INFO - mkdir: /builds/slave/test/properties 15:51:17 INFO - Writing buildbot properties ['build_url'] to /builds/slave/test/properties/build_url 15:51:17 INFO - Writing to file /builds/slave/test/properties/build_url 15:51:17 INFO - Contents: 15:51:17 INFO - build_url:https://queue.taskcluster.net/v1/task/WQ9vvIUdQTOcYr46VyaYJQ/artifacts/public/build/firefox-51.0.en-US.linux-i686.tar.bz2 15:51:18 INFO - Running post-action listener: _resource_record_post_action 15:51:18 INFO - Running post-action listener: set_extra_try_arguments 15:51:18 INFO - [mozharness: 2016-11-20 23:51:18.809986Z] Finished download-and-extract step (success) 15:51:18 INFO - [mozharness: 2016-11-20 23:51:18.810302Z] Running create-virtualenv step. 15:51:18 INFO - Running pre-action listener: _install_mozbase 15:51:18 INFO - Running pre-action listener: _pre_create_virtualenv 15:51:18 INFO - Running pre-action listener: _resource_record_pre_action 15:51:18 INFO - Running main action method: create_virtualenv 15:51:18 INFO - Creating virtualenv /builds/slave/test/build/venv 15:51:18 INFO - Running command: ['/tools/buildbot/bin/python', '/tools/misc-python/virtualenv.py', '--no-site-packages', '--distribute', '/builds/slave/test/build/venv'] in /builds/slave/test/build 15:51:18 INFO - Copy/paste: /tools/buildbot/bin/python /tools/misc-python/virtualenv.py --no-site-packages --distribute /builds/slave/test/build/venv 15:51:18 INFO - The --no-site-packages flag is deprecated; it is now the default behavior. 15:51:18 INFO - Using real prefix '/usr' 15:51:18 INFO - New python executable in /builds/slave/test/build/venv/bin/python 15:51:19 INFO - Installing distribute.............................................................................................................................................................................................done. 15:51:23 INFO - Installing pip.................done. 15:51:23 INFO - Return code: 0 15:51:23 INFO - Installing psutil>=3.1.1 into virtualenv /builds/slave/test/build/venv 15:51:23 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org')]} 15:51:23 INFO - http://pypi.pvt.build.mozilla.org/pub matches http://pypi.pvt.build.mozilla.org 15:51:23 INFO - URL Candidate: http://pypi.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/pub 15:51:23 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org')]} 15:51:23 INFO - http://pypi.pub.build.mozilla.org/pub matches http://pypi.pub.build.mozilla.org 15:51:23 INFO - URL Candidate: http://pypi.pub.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/pub 15:51:23 INFO - retry: Calling run_command with args: [['/builds/slave/test/build/venv/bin/pip', 'install', '--timeout', '120', '--no-index', '--find-links', 'http://pypi.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/pub', '--find-links', 'http://pypi.pub.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/pub', '--find-links', 'http://pypi.pvt.build.mozilla.org/pub', '--find-links', 'http://pypi.pub.build.mozilla.org/pub', 'psutil>=3.1.1']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0xb72ed5e0>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0xb72c8ef8>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x8a2bfa0>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x8a20c28>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x8a205b8>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x8a24f78>, 'level': 'critical'}], 'cwd': '/builds/slave/test/build', 'env': {'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'HOME': '/home/cltbld', 'PATH': '/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games', 'DISPLAY': ':0', 'CCACHE_UMASK': '002', 'LANG': 'en_US.UTF-8', 'TERM': 'linux', 'SHELL': '/bin/bash', 'MOZ_NODE_PATH': '/usr/bin/node', 'XDG_SESSION_COOKIE': '5a152710dd62cc268aad214e000002d8-1479685391.131009-1205078908', 'SHLVL': '1', 'NO_FAIL_ON_TEST_ERRORS': '1', 'MOZ_NO_REMOTE': '1', 'MOZ_HIDE_RESULTS_TABLE': '1', 'MAIL': '/var/mail/cltbld', '_': '/tools/buildbot/bin/python', 'NODE_PATH': '/usr/lib/nodejs:/usr/lib/node_modules:/usr/share/javascript', 'PWD': '/builds/slave/test', 'PROPERTIES_FILE': '/builds/slave/test/buildprops.json', 'CCACHE_DIR': '/builds/ccache'}}, attempt #1 15:51:23 INFO - Running command: ['/builds/slave/test/build/venv/bin/pip', 'install', '--timeout', '120', '--no-index', '--find-links', 'http://pypi.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/pub', '--find-links', 'http://pypi.pub.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/pub', '--find-links', 'http://pypi.pvt.build.mozilla.org/pub', '--find-links', 'http://pypi.pub.build.mozilla.org/pub', 'psutil>=3.1.1'] in /builds/slave/test/build 15:51:23 INFO - Copy/paste: /builds/slave/test/build/venv/bin/pip install --timeout 120 --no-index --find-links http://pypi.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/pub --find-links http://pypi.pub.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/pub --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub psutil>=3.1.1 15:51:23 INFO - Using env: {'CCACHE_DIR': '/builds/ccache', 15:51:23 INFO - 'CCACHE_UMASK': '002', 15:51:23 INFO - 'DISPLAY': ':0', 15:51:23 INFO - 'HOME': '/home/cltbld', 15:51:23 INFO - 'LANG': 'en_US.UTF-8', 15:51:23 INFO - 'LOGNAME': 'cltbld', 15:51:23 INFO - 'MAIL': '/var/mail/cltbld', 15:51:23 INFO - 'MOZ_HIDE_RESULTS_TABLE': '1', 15:51:23 INFO - 'MOZ_NODE_PATH': '/usr/bin/node', 15:51:23 INFO - 'MOZ_NO_REMOTE': '1', 15:51:23 INFO - 'NODE_PATH': '/usr/lib/nodejs:/usr/lib/node_modules:/usr/share/javascript', 15:51:23 INFO - 'NO_FAIL_ON_TEST_ERRORS': '1', 15:51:23 INFO - 'PATH': '/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games', 15:51:23 INFO - 'PROPERTIES_FILE': '/builds/slave/test/buildprops.json', 15:51:23 INFO - 'PWD': '/builds/slave/test', 15:51:23 INFO - 'SHELL': '/bin/bash', 15:51:23 INFO - 'SHLVL': '1', 15:51:23 INFO - 'TERM': 'linux', 15:51:23 INFO - 'TMOUT': '86400', 15:51:23 INFO - 'USER': 'cltbld', 15:51:23 INFO - 'XDG_SESSION_COOKIE': '5a152710dd62cc268aad214e000002d8-1479685391.131009-1205078908', 15:51:23 INFO - '_': '/tools/buildbot/bin/python'} 15:51:23 INFO - Ignoring indexes: https://pypi.python.org/simple/ 15:51:23 INFO - Downloading/unpacking psutil>=3.1.1 15:51:23 INFO - http://pypi.pvt.build.mozilla.org/pub uses an insecure transport scheme (http). Consider using https if pypi.pvt.build.mozilla.org has it available 15:51:23 INFO - http://pypi.pub.build.mozilla.org/pub uses an insecure transport scheme (http). Consider using https if pypi.pub.build.mozilla.org has it available 15:51:23 INFO - http://pypi.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/pub uses an insecure transport scheme (http). Consider using https if pypi.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com has it available 15:51:23 INFO - http://pypi.pub.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/pub uses an insecure transport scheme (http). Consider using https if pypi.pub.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com has it available 15:51:23 INFO - http://pypi.pvt.build.mozilla.org/pub uses an insecure transport scheme (http). Consider using https if pypi.pvt.build.mozilla.org has it available 15:51:23 INFO - http://pypi.pub.build.mozilla.org/pub uses an insecure transport scheme (http). Consider using https if pypi.pub.build.mozilla.org has it available remoteFailed: [Failure instance: Traceback (failure with no frames): : Connection to the other side was lost in a non-clean fashion. ] [Failure instance: Traceback (failure with no frames): : Connection to the other side was lost in a non-clean fashion. ] ========= Finished '/tools/buildbot/bin/python -u ...' interrupted (results: 5, elapsed: 3 mins, 47 secs) (at 2016-11-20 15:54:29.273524) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Total master_lag: 0.08 =========