builder: release-mozilla-beta-fennec_checksums slave: bld-linux64-spot-264 starttime: 1479314828.64 results: failure (2) ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:08.639270) ========= master: http://buildbot-master71.bb.releng.use1.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:08.639705) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:08.639986) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:08.650163) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 2 secs) (at 2016-11-16 08:47:08.650455) ========= bash -c 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py' in dir /builds/slave/rel-m-beta-fennec_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-264.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fennec_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False --2016-11-16 08:47:08-- https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py Resolving hg.mozilla.org... 63.245.215.25, 63.245.215.102 Connecting to hg.mozilla.org|63.245.215.25|:443... connected. HTTP request sent, awaiting response... 200 Script output follows Length: 12179 (12K) [text/x-python] Saving to: ‘archiver_client.py’ 0K .......... . 100% 163K=0.07s 2016-11-16 08:47:09 (163 KB/s) - ‘archiver_client.py’ saved [12179/12179] program finished with exit code 0 elapsedTime=0.561428 ========= master_lag: 2.04 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 2 secs) (at 2016-11-16 08:47:11.253134) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:11.253490) ========= rm -rf scripts properties in dir /builds/slave/rel-m-beta-fennec_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-264.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fennec_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002819 ========= master_lag: 0.02 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:11.272118) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 3 secs) (at 2016-11-16 08:47:11.272422) ========= bash -c 'python archiver_client.py mozharness --repo releases/mozilla-beta --tag FENNEC_51_0b1_RELEASE --destination scripts --debug' in dir /builds/slave/rel-m-beta-fennec_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'python archiver_client.py mozharness --repo releases/mozilla-beta --tag FENNEC_51_0b1_RELEASE --destination scripts --debug'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-264.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fennec_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 2016-11-16 08:47:11,317 Setting DEBUG logging. 2016-11-16 08:47:11,317 "FENNEC_51_0b1_RELEASE" was passed as the tag. Querying remote repository for corresponding rev hash. warning: connecting to hg.mozilla.org using legacy security technology (TLS 1.0); see https://mercurial-scm.org/wiki/SecureConnections for more info 2016-11-16 08:47:12,602 revision being used: 372c17198af2 2016-11-16 08:47:12,602 attempt 1/10 2016-11-16 08:47:12,602 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/releases/mozilla-beta/372c17198af2?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2016-11-16 08:47:14,711 unpacking tar archive at: mozilla-beta-372c17198af2/testing/mozharness/ program finished with exit code 0 elapsedTime=3.858377 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 3 secs) (at 2016-11-16 08:47:15.139757) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:15.140100) ========= script_repo_revision: FENNEC_51_0b1_RELEASE ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:15.140468) ========= ========= Started remove old nonce (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:15.140736) ========= rm -f nonce in dir /builds/slave/rel-m-beta-fennec_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'nonce'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-264.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fennec_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002596 ========= master_lag: 0.04 ========= ========= Finished remove old nonce (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:15.187565) ========= ========= Started downloading to token (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:15.187856) ========= Slave: bld-linux64-spot-264 IP: 10.134.52.105 Duration: 25200 URI: https://mac-v2-signing2.srv.releng.scl3.mozilla.com:9120/token ========= Finished downloading to token (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:15.680694) ========= ========= Started set props: toolsdir (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:15.681126) ========= bash -c pwd in dir /builds/slave/rel-m-beta-fennec_sums-0000000/scripts (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'pwd'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-264.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fennec_sums-0000000/scripts SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False /builds/slave/rel-m-beta-fennec_sums-0000000/scripts program finished with exit code 0 elapsedTime=0.003359 toolsdir: '/builds/slave/rel-m-beta-fennec_sums-0000000/scripts' ========= master_lag: 0.05 ========= ========= Finished set props: toolsdir (results: 0, elapsed: 0 secs) (at 2016-11-16 08:47:15.730130) ========= ========= Started 'python2.7 scripts/scripts/release/generate-checksums.py ...' failed (results: 2, elapsed: 12 mins, 9 secs) (at 2016-11-16 08:47:15.730458) ========= python2.7 scripts/scripts/release/generate-checksums.py --stage-product mobile --version 51.0b1 --build-number 3 --bucket-name-prefix net-mozaws-prod-delivery --credentials /builds/release-s3.credentials --tools-repo /tools/checkouts/build-tools --add-action=copy-info-files in dir /builds/slave/rel-m-beta-fennec_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['python2.7', 'scripts/scripts/release/generate-checksums.py', '--stage-product', 'mobile', '--version', '51.0b1', '--build-number', '3', '--bucket-name-prefix', 'net-mozaws-prod-delivery', '--credentials', '/builds/release-s3.credentials', '--tools-repo', '/tools/checkouts/build-tools', '--add-action=copy-info-files'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-264.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZ_SIGNING_SERVERS=gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120 MOZ_SIGN_CMD=python /builds/slave/rel-m-beta-fennec_sums-0000000/scripts/release/signing/signtool.py --cachedir /builds/slave/rel-m-beta-fennec_sums-0000000/signing_cache -t /builds/slave/rel-m-beta-fennec_sums-0000000/token -n /builds/slave/rel-m-beta-fennec_sums-0000000/nonce -c /builds/slave/rel-m-beta-fennec_sums-0000000/scripts/release/signing/host.cert -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120 PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PROPERTIES_FILE=/builds/slave/rel-m-beta-fennec_sums-0000000/buildprops.json PWD=/builds/slave/rel-m-beta-fennec_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 08:47:15 INFO - MultiFileLogger online at 20161116 08:47:15 in /builds/slave/rel-m-beta-fennec_sums-0000000 08:47:15 INFO - Using buildbot properties: 08:47:15 INFO - { 08:47:15 INFO - "project": "", 08:47:15 INFO - "product": "Fennec", 08:47:15 INFO - "build_number": 3, 08:47:15 INFO - "scheduler": "release-mozilla-beta-fennec_deliverables_ready", 08:47:15 INFO - "repository": "", 08:47:15 INFO - "buildername": "release-mozilla-beta-fennec_checksums", 08:47:15 INFO - "basedir": "/builds/slave/rel-m-beta-fennec_sums-0000000", 08:47:15 INFO - "release_config": "mozilla/release-fennec-mozilla-beta.py", 08:47:15 INFO - "buildnumber": 3, 08:47:15 INFO - "platform": null, 08:47:15 INFO - "version": "51.0b1", 08:47:15 INFO - "master": "http://buildbot-master71.bb.releng.use1.mozilla.com:8001/", 08:47:15 INFO - "slavebuilddir": "rel-m-beta-fennec_sums-0000000", 08:47:15 INFO - "branch": "release-mozilla-beta", 08:47:15 INFO - "script_repo_revision": "FENNEC_51_0b1_RELEASE", 08:47:15 INFO - "slavename": "bld-linux64-spot-264", 08:47:15 INFO - "revision": null 08:47:15 INFO - } 08:47:15 INFO - Overriding version with 51.0b1 08:47:15 INFO - Overriding build_number with 3 08:47:15 INFO - Run as scripts/scripts/release/generate-checksums.py --stage-product mobile --version 51.0b1 --build-number 3 --bucket-name-prefix net-mozaws-prod-delivery --credentials /builds/release-s3.credentials --tools-repo /tools/checkouts/build-tools --add-action=copy-info-files 08:47:15 INFO - Dumping config to /builds/slave/rel-m-beta-fennec_sums-0000000/logs/localconfig.json. 08:47:15 INFO - {'append_to_log': False, 08:47:15 INFO - 'base_work_dir': '/builds/slave/rel-m-beta-fennec_sums-0000000', 08:47:15 INFO - 'bucket_name_prefix': 'net-mozaws-prod-delivery', 08:47:15 INFO - 'build_number': 3, 08:47:15 INFO - 'buildbot_json_path': 'buildprops.json', 08:47:15 INFO - 'credentials': '/builds/release-s3.credentials', 08:47:15 INFO - 'formats': ('sha512',), 08:47:15 INFO - 'includes': ('^.*\\.tar\\.bz2$', 08:47:15 INFO - '^.*\\.tar\\.xz$', 08:47:15 INFO - '^.*\\.dmg$', 08:47:15 INFO - '^.*\\.bundle$', 08:47:15 INFO - '^.*\\.mar$', 08:47:15 INFO - '^.*Setup.*\\.exe$', 08:47:15 INFO - '^.*\\.xpi$'), 08:47:15 INFO - 'log_level': 'info', 08:47:15 INFO - 'log_to_console': True, 08:47:15 INFO - 'opt_config_files': (), 08:47:15 INFO - 'parallelization': 20, 08:47:15 INFO - 'pip_index': True, 08:47:15 INFO - 'stage_product': 'mobile', 08:47:15 INFO - 'tools_repo': '/tools/checkouts/build-tools', 08:47:15 INFO - 'version': u'51.0b1', 08:47:15 INFO - 'virtualenv_modules': ('boto',), 08:47:15 INFO - 'virtualenv_path': 'venv', 08:47:15 INFO - 'volatile_config': {'actions': None, 08:47:15 INFO - 'add_actions': ('copy-info-files',), 08:47:15 INFO - 'no_actions': None}, 08:47:15 INFO - 'work_dir': 'build'} 08:47:15 INFO - [mozharness: 2016-11-16 16:47:15.877822Z] Running create-virtualenv step. 08:47:15 INFO - Running main action method: create_virtualenv 08:47:15 INFO - Creating virtualenv /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv 08:47:15 INFO - mkdir: /builds/slave/rel-m-beta-fennec_sums-0000000/build 08:47:15 INFO - Running command: ['virtualenv', '--no-site-packages', '--distribute', '/builds/slave/rel-m-beta-fennec_sums-0000000/build/venv'] in /builds/slave/rel-m-beta-fennec_sums-0000000/build 08:47:15 INFO - Copy/paste: virtualenv --no-site-packages --distribute /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv 08:47:15 INFO - The --no-site-packages flag is deprecated; it is now the default behavior. 08:47:15 INFO - New python executable in /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/python2.7 08:47:15 INFO - Also creating executable in /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/python 08:47:16 INFO - Installing distribute.............................................................................................................................................................................................done. 08:47:16 INFO - Installing pip...............done. 08:47:16 INFO - Return code: 0 08:47:16 INFO - Installing boto into virtualenv /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv 08:47:16 INFO - retry: Calling run_command with args: [['/builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/pip', 'install', '--timeout', '120', 'boto']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0xb86df0>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0xa1f6c0>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0xbf7360>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0xd55440>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0xd4f030>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x9ebd78>, 'level': 'critical'}], 'cwd': '/builds/slave/rel-m-beta-fennec_sums-0000000/build', 'env': {'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'PATH': '/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin', 'BOTO_CONFIG': '/builds/release-s3.credentials', 'HOME': '/home/cltbld', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'MOZ_SIGNING_SERVERS': 'gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'PROPERTIES_FILE': '/builds/slave/rel-m-beta-fennec_sums-0000000/buildprops.json', 'BUILDBOTCUSTOM': 'https://hg.mozilla.org/build/buildbotcustom', 'MOZ_SIGN_CMD': 'python /builds/slave/rel-m-beta-fennec_sums-0000000/scripts/release/signing/signtool.py --cachedir /builds/slave/rel-m-beta-fennec_sums-0000000/signing_cache -t /builds/slave/rel-m-beta-fennec_sums-0000000/token -n /builds/slave/rel-m-beta-fennec_sums-0000000/nonce -c /builds/slave/rel-m-beta-fennec_sums-0000000/scripts/release/signing/host.cert -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', '_': '/tools/buildbot/bin/python', 'BUILDBOT_CONFIGS': 'https://hg.mozilla.org/build/buildbot-configs', 'HOSTNAME': 'bld-linux64-spot-264.build.releng.use1.mozilla.com', 'HISTCONTROL': 'ignoredups', 'PWD': '/builds/slave/rel-m-beta-fennec_sums-0000000', 'CLOBBERER_URL': 'https://api.pub.build.mozilla.org/clobberer/forceclobber', 'MAIL': '/var/spool/mail/cltbld'}}, attempt #1 08:47:16 INFO - Running command: ['/builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/pip', 'install', '--timeout', '120', 'boto'] in /builds/slave/rel-m-beta-fennec_sums-0000000/build 08:47:16 INFO - Copy/paste: /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/pip install --timeout 120 boto 08:47:16 INFO - Using env: {'BOTO_CONFIG': '/builds/release-s3.credentials', 08:47:16 INFO - 'BUILDBOTCUSTOM': 'https://hg.mozilla.org/build/buildbotcustom', 08:47:16 INFO - 'BUILDBOT_CONFIGS': 'https://hg.mozilla.org/build/buildbot-configs', 08:47:16 INFO - 'CCACHE_HASHDIR': '', 08:47:16 INFO - 'CLOBBERER_URL': 'https://api.pub.build.mozilla.org/clobberer/forceclobber', 08:47:16 INFO - 'G_BROKEN_FILENAMES': '1', 08:47:16 INFO - 'HISTCONTROL': 'ignoredups', 08:47:16 INFO - 'HISTSIZE': '1000', 08:47:16 INFO - 'HOME': '/home/cltbld', 08:47:16 INFO - 'HOSTNAME': 'bld-linux64-spot-264.build.releng.use1.mozilla.com', 08:47:16 INFO - 'LANG': 'en_US.UTF-8', 08:47:16 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 08:47:16 INFO - 'LOGNAME': 'cltbld', 08:47:16 INFO - 'MAIL': '/var/spool/mail/cltbld', 08:47:16 INFO - 'MOZ_SIGNING_SERVERS': 'gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 08:47:16 INFO - 'MOZ_SIGN_CMD': 'python /builds/slave/rel-m-beta-fennec_sums-0000000/scripts/release/signing/signtool.py --cachedir /builds/slave/rel-m-beta-fennec_sums-0000000/signing_cache -t /builds/slave/rel-m-beta-fennec_sums-0000000/token -n /builds/slave/rel-m-beta-fennec_sums-0000000/nonce -c /builds/slave/rel-m-beta-fennec_sums-0000000/scripts/release/signing/host.cert -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 08:47:16 INFO - 'PATH': '/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin', 08:47:16 INFO - 'PROPERTIES_FILE': '/builds/slave/rel-m-beta-fennec_sums-0000000/buildprops.json', 08:47:16 INFO - 'PWD': '/builds/slave/rel-m-beta-fennec_sums-0000000', 08:47:16 INFO - 'SHELL': '/bin/bash', 08:47:16 INFO - 'SHLVL': '1', 08:47:16 INFO - 'TERM': 'linux', 08:47:16 INFO - 'TMOUT': '86400', 08:47:16 INFO - 'USER': 'cltbld', 08:47:16 INFO - '_': '/tools/buildbot/bin/python'} 08:47:20 INFO - Ignoring indexes: http://pypi.python.org/simple/ 08:47:20 INFO - Downloading/unpacking boto 08:47:20 INFO - Running setup.py egg_info for package boto 08:47:20 INFO - warning: no files found matching 'boto/mturk/test/*.doctest' 08:47:20 INFO - warning: no files found matching 'boto/mturk/test/.gitignore' 08:47:20 INFO - Installing collected packages: boto 08:47:20 INFO - Running setup.py install for boto 08:47:20 INFO - warning: no files found matching 'boto/mturk/test/*.doctest' 08:47:20 INFO - warning: no files found matching 'boto/mturk/test/.gitignore' 08:47:20 INFO - changing mode of build/scripts-2.7/sdbadmin from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/elbadmin from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/cfadmin from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/s3put from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/fetch_file from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/launch_instance from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/list_instances from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/taskadmin from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/kill_instance from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/bundle_image from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/pyami_sendmail from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/lss3 from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/cq from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/route53 from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/cwutil from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/instance_events from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/asadmin from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/glacier from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/mturk from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/dynamodb_dump from 664 to 775 08:47:20 INFO - changing mode of build/scripts-2.7/dynamodb_load from 664 to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/cfadmin to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/sdbadmin to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/launch_instance to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/route53 to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/list_instances to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/dynamodb_load to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/cq to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/cwutil to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/s3put to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/dynamodb_dump to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/kill_instance to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/bundle_image to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/fetch_file to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/mturk to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/asadmin to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/pyami_sendmail to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/lss3 to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/glacier to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/taskadmin to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/elbadmin to 775 08:47:20 INFO - changing mode of /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/instance_events to 775 08:47:20 INFO - Successfully installed boto 08:47:20 INFO - Cleaning up... 08:47:20 INFO - Return code: 0 08:47:20 INFO - Done creating virtualenv /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv. 08:47:20 INFO - Getting output from command: ['/builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/pip', 'freeze'] 08:47:20 INFO - Copy/paste: /builds/slave/rel-m-beta-fennec_sums-0000000/build/venv/bin/pip freeze 08:47:20 INFO - Reading from file tmpfile_stdout 08:47:20 INFO - Current package versions: 08:47:20 INFO - boto == 2.38.0 08:47:20 INFO - distribute == 0.6.24 08:47:20 INFO - wsgiref == 0.1.2 08:47:20 INFO - [mozharness: 2016-11-16 16:47:20.347557Z] Finished create-virtualenv step (success) 08:47:20 INFO - [mozharness: 2016-11-16 16:47:20.347728Z] Running collect-individual-checksums step. 08:47:20 INFO - Running main action method: collect_individual_checksums 08:47:20 INFO - Connecting to S3 08:47:20 INFO - Connecting to bucket net-mozaws-prod-delivery-archive 08:47:21 INFO - File prefix is: pub/mobile/candidates/51.0b1-candidates/build3/ 08:47:21 INFO - Getting key names from bucket 08:47:22 INFO - Using checksums format 08:47:25 INFO - [mozharness: 2016-11-16 16:47:25.007565Z] Finished collect-individual-checksums step (success) 08:47:25 INFO - [mozharness: 2016-11-16 16:47:25.007797Z] Running create-big-checksums step. 08:47:25 INFO - Running main action method: create_big_checksums 08:47:25 INFO - Creating big checksums file: SHA512SUMS 08:47:25 INFO - [mozharness: 2016-11-16 16:47:25.008464Z] Finished create-big-checksums step (success) 08:47:25 INFO - [mozharness: 2016-11-16 16:47:25.008630Z] Running sign step. 08:47:25 INFO - Running main action method: sign 08:47:25 INFO - retry: Calling _get_revision with args: (, '/builds/slave/rel-m-beta-fennec_sums-0000000/build/tools'), kwargs: {}, attempt #1 08:47:25 INFO - rmtree: /builds/slave/rel-m-beta-fennec_sums-0000000/build/tools 08:47:25 INFO - retry: attempt #1 caught exception: vcs share base not defined; refusing to operate sub-optimally 08:47:25 INFO - retry: Failed, sleeping 60 seconds before retrying 08:48:25 INFO - retry: Calling _get_revision with args: (, '/builds/slave/rel-m-beta-fennec_sums-0000000/build/tools'), kwargs: {}, attempt #2 08:48:25 INFO - rmtree: /builds/slave/rel-m-beta-fennec_sums-0000000/build/tools 08:48:25 INFO - retry: attempt #2 caught exception: vcs share base not defined; refusing to operate sub-optimally 08:48:25 INFO - retry: Failed, sleeping 120 seconds before retrying 08:50:25 INFO - retry: Calling _get_revision with args: (, '/builds/slave/rel-m-beta-fennec_sums-0000000/build/tools'), kwargs: {}, attempt #3 08:50:25 INFO - rmtree: /builds/slave/rel-m-beta-fennec_sums-0000000/build/tools 08:50:25 INFO - retry: attempt #3 caught exception: vcs share base not defined; refusing to operate sub-optimally 08:50:25 INFO - retry: Failed, sleeping 240 seconds before retrying 08:54:25 INFO - retry: Calling _get_revision with args: (, '/builds/slave/rel-m-beta-fennec_sums-0000000/build/tools'), kwargs: {}, attempt #4 08:54:25 INFO - rmtree: /builds/slave/rel-m-beta-fennec_sums-0000000/build/tools 08:54:25 INFO - retry: attempt #4 caught exception: vcs share base not defined; refusing to operate sub-optimally 08:54:25 INFO - retry: Failed, sleeping 300 seconds before retrying 08:59:25 INFO - retry: Calling _get_revision with args: (, '/builds/slave/rel-m-beta-fennec_sums-0000000/build/tools'), kwargs: {}, attempt #5 08:59:25 INFO - rmtree: /builds/slave/rel-m-beta-fennec_sums-0000000/build/tools 08:59:25 INFO - retry: attempt #5 caught exception: vcs share base not defined; refusing to operate sub-optimally 08:59:25 FATAL - Automation Error: Can't checkout /tools/checkouts/build-tools! 08:59:25 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 08:59:25 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 08:59:25 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 08:59:25 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 08:59:25 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 08:59:25 FATAL - Running post_fatal callback... 08:59:25 FATAL - Exiting -1 08:59:25 INFO - [mozharness: 2016-11-16 16:59:25.375865Z] Finished sign step (failed) 08:59:25 INFO - Running post-run listener: copy_logs_to_upload_dir 08:59:25 INFO - Copying logs to upload dir... 08:59:25 INFO - mkdir: /builds/slave/rel-m-beta-fennec_sums-0000000/build/upload/logs program finished with exit code 255 elapsedTime=729.668245 ========= master_lag: 0.01 ========= ========= Finished 'python2.7 scripts/scripts/release/generate-checksums.py ...' failed (results: 2, elapsed: 12 mins, 9 secs) (at 2016-11-16 08:59:25.409636) ========= ========= Started no change (results: 0, elapsed: 0 secs) (at 2016-11-16 08:59:25.410965) ========= bash -c 'for file in `ls -1`; do cat $file; done' in dir /builds/slave/rel-m-beta-fennec_sums-0000000/properties (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'for file in `ls -1`; do cat $file; done'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-264.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fennec_sums-0000000/properties SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.004276 ========= master_lag: 0.05 ========= ========= Finished no change (results: 0, elapsed: 0 secs) (at 2016-11-16 08:59:25.465283) ========= ========= Total master_lag: 2.22 =========