builder: mozilla-inbound_ubuntu64-asan_vm_test-reftest-1 slave: tst-linux64-spot-430 starttime: 1452234394.4 results: exception (4) buildid: 20160107213153 builduid: 7aff67b0bba148bcaca4617f9167c846 revision: 512d9c5b57888d40416f091b4ceda78496005499 ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2016-01-07 22:26:34.395421) ========= master: http://buildbot-master115.bb.releng.usw2.mozilla.com:8201/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2016-01-07 22:26:34.395857) ========= ========= Started set props: basedir (results: 0, elapsed: 1 secs) (at 2016-01-07 22:26:34.396150) ========= bash -c pwd in dir /builds/slave/test/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'pwd'] environment: HOME=/home/cltbld LANG=en_US.UTF-8 LOGNAME=cltbld MAIL=/var/mail/cltbld NODE_PATH=/usr/lib/nodejs:/usr/lib/node_modules:/usr/share/javascript PATH=/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games PWD=/builds/slave/test SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld XDG_SESSION_COOKIE=9ca12473fbb1d023794ffd180000023c-1452230680.970055-453372456 _=/tools/buildbot/bin/python using PTY: False /builds/slave/test program finished with exit code 0 elapsedTime=0.024526 basedir: '/builds/slave/test' ========= master_lag: 1.29 ========= ========= Finished set props: basedir (results: 0, elapsed: 1 secs) (at 2016-01-07 22:26:35.707514) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 15 secs) (at 2016-01-07 22:26:35.707843) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 15 secs) (at 2016-01-07 22:26:51.162257) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-01-07 22:26:51.162530) ========= rm -rf properties in dir /builds/slave/test/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'properties'] environment: HOME=/home/cltbld LANG=en_US.UTF-8 LOGNAME=cltbld MAIL=/var/mail/cltbld NODE_PATH=/usr/lib/nodejs:/usr/lib/node_modules:/usr/share/javascript PATH=/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games PWD=/builds/slave/test SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld XDG_SESSION_COOKIE=9ca12473fbb1d023794ffd180000023c-1452230680.970055-453372456 _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.021700 ========= master_lag: 0.95 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-01-07 22:26:52.137668) ========= ========= Started set props: script_repo_url (results: 0, elapsed: 0 secs) (at 2016-01-07 22:26:52.137935) ========= script_repo_url: https://hg.mozilla.org/build/mozharness ========= Finished set props: script_repo_url (results: 0, elapsed: 0 secs) (at 2016-01-07 22:26:52.138265) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 1 secs) (at 2016-01-07 22:26:52.138564) ========= bash -c 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py' in dir /builds/slave/test/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py'] environment: HOME=/home/cltbld LANG=en_US.UTF-8 LOGNAME=cltbld MAIL=/var/mail/cltbld NODE_PATH=/usr/lib/nodejs:/usr/lib/node_modules:/usr/share/javascript PATH=/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games PWD=/builds/slave/test SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld XDG_SESSION_COOKIE=9ca12473fbb1d023794ffd180000023c-1452230680.970055-453372456 _=/tools/buildbot/bin/python using PTY: False --2016-01-07 22:26:52-- https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py Resolving hg.mozilla.org (hg.mozilla.org)... 63.245.215.102, 63.245.215.25 Connecting to hg.mozilla.org (hg.mozilla.org)|63.245.215.102|:443... connected. HTTP request sent, awaiting response... 200 Script output follows Length: 12141 (12K) [text/x-python] Saving to: `archiver_client.py' 0K .......... . 100% 12.1M=0.001s 2016-01-07 22:26:52 (12.1 MB/s) - `archiver_client.py' saved [12141/12141] program finished with exit code 0 elapsedTime=0.331440 ========= master_lag: 0.96 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 1 secs) (at 2016-01-07 22:26:53.431031) ========= ========= Started clobber_scripts exception (results: 4, elapsed: 16 mins, 32 secs) (at 2016-01-07 22:26:53.431308) ========= remoteFailed: [Failure instance: Traceback (failure with no frames): : [Failure instance: Traceback (failure with no frames): : Connection to the other side was lost in a non-clean fashion. ] ]

<class 'twisted.spread.pb.PBConnectionLost'>: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion. ]

<class 'twisted.spread.pb.PBConnectionLost'>: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion. ]

Traceback (most recent call last): Failure: twisted.spread.pb.PBConnectionLost: [Failure instance: Traceback (failure with no frames): : Connection to the other side was lost in a non-clean fashion. ] ========= Finished clobber_scripts exception (results: 4, elapsed: 16 mins, 32 secs) (at 2016-01-07 22:43:26.167552) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Started set_script_properties exception (results: 4, elapsed: 0 secs) (at 2016-01-07 22:43:26.167953) ========= remoteFailed: [Failure instance: Traceback: : Calling Stale Broker /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/steps/shell.py:225:start /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:1071:startCommand /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:1002:runCommand /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:77:run --- --- /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/internet/defer.py:125:maybeDeferred /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:529:start /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:311:start /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:112:start /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py:328:callRemote /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py:807:_sendMessage ]

<class 'twisted.spread.pb.DeadReferenceError'>: Calling Stale Broker

/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/internet/defer.py, line 125 in maybeDeferred
123  """
124  try:
125    result = f(*args, **kw)
126  except:
Locals
args'()'
kw'{}'
f"<bound method RemoteShellCommand.start of <RemoteShellCommand '['bash', '-c', 'for file in `ls -1`; do cat $file; done']'>>"
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 529 in start
527                       self.args['workdir'])
528    log.msg(what)
529    return LoggedRemoteCommand.start(self)
530
Locals
what'"command \'[\'bash\', \'-c\', \'for file in `ls -1`; do cat $file; done\']\' in dir \'properties\'"'
self"<RemoteShellCommand '['bash', '-c', 'for file in `ls -1`; do cat $file; done']'>"
Globals
LoggedRemoteCommand'<class buildbot.process.buildstep.LoggedRemoteCommand at 0x2de4940>'
log"<module 'twisted.python.log' from '/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/python/log.pyc'>"
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 311 in start
309          % self)
310    self.updates = {}
311    return RemoteCommand.start(self)
312
Locals
self"<RemoteShellCommand '['bash', '-c', 'for file in `ls -1`; do cat $file; done']'>"
Globals
RemoteCommand'<class buildbot.process.buildstep.RemoteCommand at 0x2de43f8>'
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 112 in start
110    # We should fire self.deferred when the command is done.
111    d = self.remote.callRemote("startCommand", self, self.commandID,
112                  self.remote_command, cmd_args)
113    return d
Locals
self"<RemoteShellCommand '['bash', '-c', 'for file in `ls -1`; do cat $file; done']'>"
cmd_args"{'workdir': 'properties', 'command': ['bash', '-c', 'for file in `ls -1`; do cat $file; done'], 'timeout': 1200, 'env': None, 'want_stdout': 1, 'usePTY': 'slave-config', 'maxTime': None, 'logEnviron': True, 'want_stderr': 1, 'logfiles': {}}"
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py, line 328 in callRemote
326
327    return self.broker._sendMessage('',self.perspective, self.luid,
328                    _name, args, kw)
329
Locals
self'<twisted.spread.pb.RemoteReference instance at 0x580d85a8>'
args"(<RemoteShellCommand '['bash', '-c', 'for file in `ls -1`; do cat $file; done']'>, '264150', 'shell', {'workdir': 'properties', 'command': ['bash', '-c', 'for file in `ls -1`; do cat $file; done'], 'timeout': 1200, 'env': None, 'want_stdout': 1, 'usePTY': 'slave-config', 'maxTime': None, 'logEnviron': True, 'want_stderr': 1, 'logfiles': {}})"
kw'{}'
_name"'startCommand'"
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py, line 807 in _sendMessage
805      del kw['pbanswer']
806    if self.disconnected:
807      raise DeadReferenceError("Calling Stale Broker")
808    try:
Locals
self'<twisted.spread.pb.Broker instance at 0x48023440>'
kw'{}'
Globals
Broker'<class twisted.spread.pb.Broker at 0x25a4120>'
DeadReferenceError"<class 'twisted.spread.pb.DeadReferenceError'>"

<class 'twisted.spread.pb.DeadReferenceError'>: Calling Stale Broker

Traceback (most recent call last): File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/steps/shell.py", line 225, in start self.startCommand(cmd, warnings) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 1071, in startCommand d = self.runCommand(cmd) # might raise ConnectionLost File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 1002, in runCommand d = c.run(self, self.remote) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 77, in run d = defer.maybeDeferred(self.start) --- --- File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/internet/defer.py", line 125, in maybeDeferred result = f(*args, **kw) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 529, in start return LoggedRemoteCommand.start(self) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 311, in start return RemoteCommand.start(self) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 112, in start self.remote_command, cmd_args) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py", line 328, in callRemote _name, args, kw) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py", line 807, in _sendMessage raise DeadReferenceError("Calling Stale Broker") twisted.spread.pb.DeadReferenceError: Calling Stale Broker ========= Finished set_script_properties exception (results: 4, elapsed: 0 secs) (at 2016-01-07 22:43:26.213940) ========= ========= Started rm_oauth_txt exception (results: 4, elapsed: 0 secs) (at 2016-01-07 22:43:26.215283) ========= remoteFailed: [Failure instance: Traceback: : Calling Stale Broker /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/steps/shell.py:225:start /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:1071:startCommand /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:1002:runCommand /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:77:run --- --- /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/internet/defer.py:125:maybeDeferred /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:529:start /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:311:start /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:112:start /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py:328:callRemote /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py:807:_sendMessage ]

<class 'twisted.spread.pb.DeadReferenceError'>: Calling Stale Broker

/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/internet/defer.py, line 125 in maybeDeferred
123  """
124  try:
125    result = f(*args, **kw)
126  except:
Locals
args'()'
kw'{}'
f"<bound method RemoteShellCommand.start of <RemoteShellCommand '['rm', '-f', 'oauth.txt']'>>"
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 529 in start
527                       self.args['workdir'])
528    log.msg(what)
529    return LoggedRemoteCommand.start(self)
530
Locals
what'"command \'[\'rm\', \'-f\', \'oauth.txt\']\' in dir \'.\'"'
self"<RemoteShellCommand '['rm', '-f', 'oauth.txt']'>"
Globals
LoggedRemoteCommand'<class buildbot.process.buildstep.LoggedRemoteCommand at 0x2de4940>'
log"<module 'twisted.python.log' from '/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/python/log.pyc'>"
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 311 in start
309          % self)
310    self.updates = {}
311    return RemoteCommand.start(self)
312
Locals
self"<RemoteShellCommand '['rm', '-f', 'oauth.txt']'>"
Globals
RemoteCommand'<class buildbot.process.buildstep.RemoteCommand at 0x2de43f8>'
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 112 in start
110    # We should fire self.deferred when the command is done.
111    d = self.remote.callRemote("startCommand", self, self.commandID,
112                  self.remote_command, cmd_args)
113    return d
Locals
self"<RemoteShellCommand '['rm', '-f', 'oauth.txt']'>"
cmd_args"{'workdir': '.', 'command': ['rm', '-f', 'oauth.txt'], 'timeout': 1200, 'env': None, 'want_stdout': 1, 'usePTY': 'slave-config', 'maxTime': None, 'logEnviron': True, 'want_stderr': 1, 'logfiles': {}}"
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py, line 328 in callRemote
326
327    return self.broker._sendMessage('',self.perspective, self.luid,
328                    _name, args, kw)
329
Locals
self'<twisted.spread.pb.RemoteReference instance at 0x580d85a8>'
args"(<RemoteShellCommand '['rm', '-f', 'oauth.txt']'>, '264151', 'shell', {'workdir': '.', 'command': ['rm', '-f', 'oauth.txt'], 'timeout': 1200, 'env': None, 'want_stdout': 1, 'usePTY': 'slave-config', 'maxTime': None, 'logEnviron': True, 'want_stderr': 1, 'logfiles': {}})"
kw'{}'
_name"'startCommand'"
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py, line 807 in _sendMessage
805      del kw['pbanswer']
806    if self.disconnected:
807      raise DeadReferenceError("Calling Stale Broker")
808    try:
Locals
self'<twisted.spread.pb.Broker instance at 0x48023440>'
kw'{}'
Globals
Broker'<class twisted.spread.pb.Broker at 0x25a4120>'
DeadReferenceError"<class 'twisted.spread.pb.DeadReferenceError'>"

<class 'twisted.spread.pb.DeadReferenceError'>: Calling Stale Broker

Traceback (most recent call last): File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/steps/shell.py", line 225, in start self.startCommand(cmd, warnings) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 1071, in startCommand d = self.runCommand(cmd) # might raise ConnectionLost File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 1002, in runCommand d = c.run(self, self.remote) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 77, in run d = defer.maybeDeferred(self.start) --- --- File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/internet/defer.py", line 125, in maybeDeferred result = f(*args, **kw) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 529, in start return LoggedRemoteCommand.start(self) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 311, in start return RemoteCommand.start(self) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 112, in start self.remote_command, cmd_args) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py", line 328, in callRemote _name, args, kw) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py", line 807, in _sendMessage raise DeadReferenceError("Calling Stale Broker") twisted.spread.pb.DeadReferenceError: Calling Stale Broker ========= Finished rm_oauth_txt exception (results: 4, elapsed: 0 secs) (at 2016-01-07 22:43:26.242672) ========= ========= Started reboot exception (results: 4, elapsed: 0 secs) (at 2016-01-07 22:43:26.243291) ========= remoteFailed: [Failure instance: Traceback: : Calling Stale Broker /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/steps/shell.py:225:start /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:1071:startCommand /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:1002:runCommand /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:77:run --- --- /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/internet/defer.py:125:maybeDeferred /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:529:start /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:311:start /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:112:start /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py:328:callRemote /builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py:807:_sendMessage ]

<class 'twisted.spread.pb.DeadReferenceError'>: Calling Stale Broker

/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/internet/defer.py, line 125 in maybeDeferred
123  """
124  try:
125    result = f(*args, **kw)
126  except:
Locals
args'()'
kw'{}'
f"<bound method RemoteShellCommand.start of <RemoteShellCommand '['/tools/buildbot/bin/python', 'scripts/external_tools/count_and_reboot.py', '-f', '../reboot_count.txt', '-n', '1', '-z']'>>"
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 529 in start
527                       self.args['workdir'])
528    log.msg(what)
529    return LoggedRemoteCommand.start(self)
530
Locals
what'"command \'[\'/tools/buildbot/bin/python\', \'scripts/external_tools/count_and_reboot.py\', \'-f\', \'../reboot_count.txt\', \'-n\', \'1\', \'-z\']\' in dir \'.\'"'
self"<RemoteShellCommand '['/tools/buildbot/bin/python', 'scripts/external_tools/count_and_reboot.py', '-f', '../reboot_count.txt', '-n', '1', '-z']'>"
Globals
LoggedRemoteCommand'<class buildbot.process.buildstep.LoggedRemoteCommand at 0x2de4940>'
log"<module 'twisted.python.log' from '/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/python/log.pyc'>"
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 311 in start
309          % self)
310    self.updates = {}
311    return RemoteCommand.start(self)
312
Locals
self"<RemoteShellCommand '['/tools/buildbot/bin/python', 'scripts/external_tools/count_and_reboot.py', '-f', '../reboot_count.txt', '-n', '1', '-z']'>"
Globals
RemoteCommand'<class buildbot.process.buildstep.RemoteCommand at 0x2de43f8>'
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 112 in start
110    # We should fire self.deferred when the command is done.
111    d = self.remote.callRemote("startCommand", self, self.commandID,
112                  self.remote_command, cmd_args)
113    return d
Locals
self"<RemoteShellCommand '['/tools/buildbot/bin/python', 'scripts/external_tools/count_and_reboot.py', '-f', '../reboot_count.txt', '-n', '1', '-z']'>"
cmd_args"{'workdir': '.', 'command': ['/tools/buildbot/bin/python', 'scripts/external_tools/count_and_reboot.py', '-f', '../reboot_count.txt', '-n', '1', '-z'], 'timeout': 1200, 'env': {'DISPLAY': ':0', 'PROPERTIES_FILE': '/builds/slave/test/buildprops.json'}, 'want_stdout': 1, 'usePTY': 'slave-config', 'maxTime': None, 'logEnviron': True, 'want_stderr': 1, 'logfiles': {}}"
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py, line 328 in callRemote
326
327    return self.broker._sendMessage('',self.perspective, self.luid,
328                    _name, args, kw)
329
Locals
self'<twisted.spread.pb.RemoteReference instance at 0x580d85a8>'
args"(<RemoteShellCommand '['/tools/buildbot/bin/python', 'scripts/external_tools/count_and_reboot.py', '-f', '../reboot_count.txt', '-n', '1', '-z']'>, '264152', 'shell', {'workdir': '.', 'command': ['/tools/buildbot/bin/python', 'scripts/external_tools/count_and_reboot.py', '-f', '../reboot_count.txt', '-n', '1', '-z'], 'timeout': 1200, 'env': {'DISPLAY': ':0', 'PROPERTIES_FILE': '/builds/slave/test/buildprops.json'}, 'want_stdout': 1, 'usePTY': 'slave-config', 'maxTime': None, 'logEnviron': True, 'want_stderr': 1, 'logfiles': {}})"
kw'{}'
_name"'startCommand'"
/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py, line 807 in _sendMessage
805      del kw['pbanswer']
806    if self.disconnected:
807      raise DeadReferenceError("Calling Stale Broker")
808    try:
Locals
self'<twisted.spread.pb.Broker instance at 0x48023440>'
kw'{}'
Globals
Broker'<class twisted.spread.pb.Broker at 0x25a4120>'
DeadReferenceError"<class 'twisted.spread.pb.DeadReferenceError'>"

<class 'twisted.spread.pb.DeadReferenceError'>: Calling Stale Broker

Traceback (most recent call last): File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/steps/shell.py", line 225, in start self.startCommand(cmd, warnings) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 1071, in startCommand d = self.runCommand(cmd) # might raise ConnectionLost File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 1002, in runCommand d = c.run(self, self.remote) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 77, in run d = defer.maybeDeferred(self.start) --- --- File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/internet/defer.py", line 125, in maybeDeferred result = f(*args, **kw) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 529, in start return LoggedRemoteCommand.start(self) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 311, in start return RemoteCommand.start(self) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 112, in start self.remote_command, cmd_args) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py", line 328, in callRemote _name, args, kw) File "/builds/buildbot/tests1-linux64/lib/python2.7/site-packages/twisted/spread/pb.py", line 807, in _sendMessage raise DeadReferenceError("Calling Stale Broker") twisted.spread.pb.DeadReferenceError: Calling Stale Broker ========= Finished reboot exception (results: 4, elapsed: 0 secs) (at 2016-01-07 22:43:26.272146) ========= ========= Total master_lag: 3.20 =========