zuul doesn't connect to gearman server

Bug #1270029 reported by jishaomei
272
This bug affects 5 people
Affects Status Importance Assigned to Milestone
Zuul
New
Undecided
Unassigned

Bug Description

Zuul server could work with gearman server well, but zuul server may restart automatically due to environment unstable. then gearman server can't work well. we build our gearman in zuul server. Debug entry

2014-01-16 23:39:02,651 DEBUG gear.Client: Processing input on <gear.Connection 0x18ade90 host: 172.16.2.118 port: 4730>
2014-01-16 23:39:02,652 DEBUG gear.Client: Received packet <gear.Packet 0x7f24c08cacd0 type: WORK_COMPLETE>
2014-01-16 23:39:02,652 DEBUG gear.Client: Job complete; handle: H:172.16.2.118:1200 data: ['Description for Jenkins build 3732 was updated to <p>\n Triggered by change:\n <a href="https://review.openstack.org/67092">67092,1</a><br/>\n Branch: <b>master</b><br/>\n Pipeline: <b>check</b>\n</p><p>\n All builds for this change set:\n <ul><li>\n <a href="https://172.16.2.115/job/gate-ci-devstack-test/3732/">\n gate-ci-devstack-test #3732</a>: FAILURE\n</li>\n</ul>\n</p>\n<p>\n Reported result: <b>SUCCESS</b>\n</p>\n']
2014-01-16 23:39:02,652 DEBUG gear.Client: Polling 1 connections
2014-01-16 23:42:51,494 DEBUG zuul.Gearman: Looking for lost builds
2014-01-16 23:47:51,494 DEBUG zuul.Gearman: Looking for lost builds
2014-01-16 23:52:51,495 DEBUG zuul.Gearman: Looking for lost builds
2014-01-16 23:57:51,495 DEBUG zuul.Gearman: Looking for lost builds
2014-01-17 00:02:51,496 DEBUG zuul.Gearman: Looking for lost builds
2014-01-17 00:07:51,503 DEBUG zuul.Gearman: Looking for lost builds
2014-01-17 00:12:51,504 DEBUG zuul.Gearman: Looking for lost builds
2014-01-17 00:17:51,504 DEBUG zuul.Gearman: Looking for lost builds
2014-01-17 00:22:51,505 DEBUG zuul.Gearman: Looking for lost builds
2014-01-17 00:27:51,505 DEBUG zuul.Gearman: Looking for lost builds
2014-01-17 00:32:51,506 DEBUG zuul.Gearman: Looking for lost builds
2014-01-17 00:37:51,506 DEBUG zuul.Gearman: Looking for lost builds
..........................................

I checked the codes class GearmanCleanup(threading.Thread) in zuul/launcher/gearman.py
   lines 44, while True, it always lookForLostBuilds() may cause this bug.
 def run(self):
        while True:
            self.wake_event.wait(300)
            if self._stopped:
                return
            try:
                self.gearman.lookForLostBuilds()
            except:
                self.log.exception("Exception checking builds:")

information type: Private Security → Public Security
Revision history for this message
watanabe.isao (watanabe.isao) wrote :

Hit the same problem after 1 year and 10 months.
Is there any solution or hint about this issue, please?

Revision history for this message
ITRI DISCO CI (itri-cinder) wrote :

Edit the /etc/zuul/zuul.conf
In the [gearman] section, set "check_job_registration = false"

look like following:

[gearman]
server=localhost
check_job_registration=false

To post a comment you must log in.
This report contains Public Security information  
Everyone can see this security related information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.