| *** rlandy has quit IRC | 00:04 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Add test for referencing cloud image by ID https://review.openstack.org/579702 | 00:11 |
|---|---|---|
| openstackgerrit | Merged openstack-infra/nodepool master: Fix for referencing cloud image by ID https://review.openstack.org/579664 | 00:11 |
| *** harlowja has joined #zuul | 00:26 | |
| *** harlowja has quit IRC | 00:27 | |
| *** yolanda_ has joined #zuul | 00:29 | |
| *** yolanda__ has quit IRC | 00:31 | |
| clarkb | we seem to sometimes lose github recheck comments | 00:40 |
| clarkb | reading logs we seem to just not process it implying something like pr_body = self.connection.getPull(project_name, number) may have failed? | 00:43 |
| clarkb | we should probably log that case? | 00:43 |
| gundalow | clarkb: GitHub webhook not firing? | 00:44 |
| clarkb | gundalow: no it fired, and we processed the event with a 200 | 00:44 |
| gundalow | ah, only ask as occasionally we see signs that indicate webooks didn't fire (in shippable) | 00:45 |
| clarkb | I think zuul is semi quietly failing after that | 00:46 |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Delete redundant code. https://review.openstack.org/580008 | 00:51 |
| clarkb | noticed ^ when debugging | 00:51 |
| *** yolanda__ has joined #zuul | 00:55 | |
| clarkb | tobiash: corvus ^ after 2018-07-04 00:47:22,793 DEBUG zuul.GithubGearmanWorker: Github Webhook Received: cff82850-7f23-11e8-9844-2123c3e92a75 and 2018-07-04 00:47:22,793 DEBUG zuul.GithubGearmanWorker: X-Github-Event: issue_comment I don't see any logging related to that event | 00:57 |
| clarkb | I wonder if the double accounting above that I'm cleaning up is possibly related? | 00:57 |
| *** yolanda_ has quit IRC | 00:58 | |
| clarkb | I'm not really sure how to debug further | 00:58 |
| clarkb | hrm pushing an update to the pullrequest seems to have similar behavior | 01:02 |
| *** yolanda_ has joined #zuul | 01:06 | |
| *** yolanda__ has quit IRC | 01:08 | |
| clarkb | corvus: seems like the last thing logged for kata-containers/proxy was prior to restarting stuff 2018-07-03 20:13:19,073 DEBUG zuul.GithubConnection: Got project branches for kata-containers/proxy: ['master', 'sboeuf/enable_kata_containers', 'version-0.2.0-update'] I'm guessing we have a regression in github connection handling? | 01:10 |
| clarkb | we are processing events for kata-containers/runtime and kata-containers/tests though | 01:12 |
| *** yolanda__ has joined #zuul | 01:23 | |
| *** yolanda_ has quit IRC | 01:26 | |
| clarkb | ok I'm stumped and it is dinner time. I think at the very least we need more logging around githubconnection handleEvent. The event seems to just disappear | 02:01 |
| clarkb | hrm looks like it eventually ran jobs a few minutes ago | 03:03 |
| openstackgerrit | Merged openstack-infra/zuul master: Delete redundant code. https://review.openstack.org/580008 | 03:58 |
| openstackgerrit | Vu Cong Tuan proposed openstack-infra/zuul-jobs master: Switch to stestr https://review.openstack.org/580028 | 04:23 |
| *** yolanda_ has joined #zuul | 04:55 | |
| *** yolanda__ has quit IRC | 04:58 | |
| *** yolanda__ has joined #zuul | 05:05 | |
| *** yolanda_ has quit IRC | 05:09 | |
| *** yolanda__ has quit IRC | 05:09 | |
| openstackgerrit | Logan V proposed openstack-infra/zuul master: Fix incorrect API URL for project key https://review.openstack.org/580034 | 05:13 |
| openstackgerrit | Logan V proposed openstack-infra/zuul master: Fix secret example yaml https://review.openstack.org/580039 | 05:32 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: scheduler: fix enqueue event to use canonical project name https://review.openstack.org/580040 | 05:35 |
| *** Rohaan has joined #zuul | 05:47 | |
| *** nchakrab has joined #zuul | 06:13 | |
| *** yolanda__ has joined #zuul | 06:28 | |
| tobiash | uhm, my executor log indicates that when a job starts it updates the local cache and after that it does a clean clone from the upstream url | 06:37 |
| tobiash | need to check that | 06:37 |
| *** AJaeger has left #zuul | 06:50 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix logging of clone origin https://review.openstack.org/580053 | 06:58 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix logging of clone url https://review.openstack.org/580053 | 06:59 |
| tobiash | phew, was just a logging issue | 06:59 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix logging of clone url https://review.openstack.org/580053 | 07:09 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Improve test_static_basic https://review.openstack.org/580063 | 07:19 |
| *** ianychoi has quit IRC | 07:20 | |
| *** yolanda__ is now known as yolanda | 07:21 | |
| *** hasharAway is now known as hashar | 07:25 | |
| *** Rohaan has quit IRC | 07:28 | |
| jiapei | Hello Zuulers, I'm a fresh guy on zuul. Yesterday I installed Zuul v3, and configured it following the official docs, but it complains error on "fatal: Could not read from remote repository." But I can use "git clone " manually without error. Anyone can help me on this issue? http://paste.openstack.org/show/724846/ | 07:54 |
| jiapei | This issue has block me for 2 days, somebody says that it may be related to key permissions, but I can confirm that zuul is the user for "zuul-executor". | 07:57 |
| *** jpena|off is now known as jpena | 08:04 | |
| openstackgerrit | Merged openstack-infra/zuul master: Split test_dynamic_conf_on_broken_config https://review.openstack.org/579996 | 08:29 |
| *** Rohaan has joined #zuul | 08:39 | |
| tobiash | jiapei: what are the permissions of the keyfile and the directory containing the key? | 08:39 |
| tobiash | jiapei: and you are sure that you want to use the same key for accessing nodepool and gerrit? | 08:40 |
| *** electrofelix has joined #zuul | 08:40 | |
| jiapei | tobiash: the directory is ~zuul/.ssh/id_rsa, with permissions "-rw-------. 1 zuul zuul 1675 Jul 4 03:45 id_rsa" | 08:41 |
| jiapei | I use ssh-keygen to create a new key for zuul | 08:42 |
| tobiash | jiapei: your config wants to use /var/lib/zuul/.ssh/nodepool_rsa | 08:42 |
| tobiash | for gerrit | 08:42 |
| tobiash | jiapei: that doesn't match ~zuul/.ssh/id_rsa | 08:42 |
| jiapei | tobiash: I generated a new key id_rsa just now since the "nodepool_rsa" still don't work... | 08:45 |
| jiapei | tobiash: can I use just zuul without nodepool installed/configured? | 08:47 |
| tobiash | jiapei: your problem is not yet nodepool but accessing gerrit and in your pasted zuul.conf you list nodepool_rsa as private key to use to access gerrit and that doesn't match ~zuul/.ssh/id_rsa | 08:51 |
| jiapei | tobiash: I copied id_rsa to nodepool_rsa, but it still can't connect to gerrit. http://paste.openstack.org/show/724961/ | 09:04 |
| *** Rohaan has quit IRC | 09:18 | |
| *** pawelzny has joined #zuul | 09:19 | |
| *** hashar is now known as hasharAway | 09:41 | |
| *** pawelzny has quit IRC | 10:07 | |
| *** pawelzny has joined #zuul | 10:08 | |
| *** gtema has joined #zuul | 10:37 | |
| *** jpena is now known as jpena|lunch | 10:59 | |
| *** Rohaan has joined #zuul | 11:12 | |
| *** jpena|lunch is now known as jpena | 12:16 | |
| goern | hey all, is there somewhere a job that sends out notifications to irc? | 12:46 |
| *** gtema has quit IRC | 12:46 | |
| *** gtema has joined #zuul | 12:48 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Update bindep file with build profiles https://review.openstack.org/580159 | 12:57 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Add job to build container images using pbrx https://review.openstack.org/580160 | 12:57 |
| *** nchakrab_ has joined #zuul | 12:57 | |
| *** nchakrab has quit IRC | 13:00 | |
| tristanC | goern: there is a mqtt publisher, so you could use something like https://github.com/jpmens/mqttwarn to forward message to irc | 13:10 |
| tristanC | goern: on software-factory, just enable the firehose component to setup the service and the pipeline reporters | 13:10 |
| *** hasharAway has quit IRC | 13:11 | |
| rcarrillocruz | mordred: out of curiosity, did you check buildah? My understanding is that is python based, and does not require docker to build images | 13:12 |
| * rcarrillocruz goes check on phone, afk now | 13:12 | |
| goern | tristanC, thats many moving parts.. irccat, warn, mosquito... | 13:13 |
| rcarrillocruz | https://www.projectatomic.io/blog/2017/06/introducing-buildah/ | 13:13 |
| goern | tristanC, cant I use the ansible irc module? :) | 13:13 |
| tristanC | goern: that should work too, though the advantage of pipeline reporter is to get a single event for the whole buildset | 13:14 |
| goern | rcarrillocruz, and it seems to be the better choice for new projects. beside what you said it is way more scriptable than a Dockerfile | 13:14 |
| goern | tristanC, hmm ja agree | 13:14 |
| goern | tristanC, nice thing about warn is that it can push to mattermost too | 13:15 |
| tristanC | goern: adding a native irc driver in zuul shouldn't be too hard, but re-using the mqtt bus sounds better | 13:15 |
| goern | ja | 13:15 |
| tristanC | we should look into integrating mqttwarn in software-factory :-) | 13:16 |
| goern | tristanC, first I need to do the openshift integration ;) | 13:17 |
| goern | tristanC, so I updated to the latest release, but still see only runc nodes | 13:17 |
| goern | nodepool seems to be ok, but no notion of any openshift, even though the provider is configured | 13:18 |
| tristanC | goern: you need to configure the openshift context, e.g. adds this to /etc/nodepool/nodepool.yaml https://github.com/thoth-station/zuul-test-config/blob/master/nodepool/openshift.yaml | 13:19 |
| tristanC | goern: edit the file directly and save, no need to reload nodepool-launcher. But please tail /var/log/nodepool/launcher.log, it may loop if something is wrong | 13:20 |
| goern | tristanC, uh, that is not added by some software-factory? | 13:20 |
| tristanC | goern: e.g. i don't think the driver will stop if it can't create a project, so it will keep on hamering the api | 13:20 |
| tristanC | goern: no, only the managed "oc cluster up" is auto-configured, external openshift cluster needs to be manually configured | 13:21 |
| tristanC | goern: that's because i couldn't figure out how to discover the context to use after oc loginc succeed | 13:21 |
| goern | tristanC, oc whoami --show-context | 13:21 |
| tristanC | oh... then that could have been automated | 13:22 |
| tristanC | but then again, the driver is a bit experimental, so it's better if the nodepool provider creation is manual, so that you can monitor it closely | 13:23 |
| tristanC | it has only been validated with a local oc cluster up endpoint | 13:23 |
| *** swest has quit IRC | 14:10 | |
| *** sshnaidm|rover is now known as sshnaidm|afk | 14:11 | |
| *** elyezer has joined #zuul | 14:14 | |
| *** nchakrab_ has quit IRC | 14:17 | |
| *** elyezer has quit IRC | 14:17 | |
| gundalow | goern: tristanC FYI Ansible has a number of modules for "most" messaging platforms https://docs.ansible.com/ansible/latest/modules/list_of_notification_modules.html | 14:20 |
| *** nchakrab has joined #zuul | 14:21 | |
| *** elyezer has joined #zuul | 14:25 | |
| *** nchakrab has quit IRC | 14:40 | |
| corvus | clarkb: it hashes the line number (mark.line is the line number). but i think the case you describe is why we still report errors if the error is in the same project/branch of the change. | 14:54 |
| corvus | jiapei: did you try running this as the zuul user? what was the output? GIT_SSH_COMMAND="ssh -i /var/lib/zuul/.ssh/id_rsa" git clone ssh://lenovo_lxca_ci@review.openstack.org:29418/openstack/ironic /var/lib/zuul/executor-git/review.openstack.org/openstack/ironic | 15:00 |
| corvus | tobiash: one quick thought about the large repo (i'm not really here, it's a holiday) -- you can manually clone it into place on the mergers/executors. if it's already there, and cached on the image, then you won't have to suffer the long clone time. that might get things moving while we think about alternatives. | 15:01 |
| corvus | jiapei: also, check the permissions of the /var/lib/zuul.ssh directory itself. sometimes ssh requires that it not be world readable. | 15:02 |
| corvus | jiapei: the id_rsa that you tell zuul to use needs to match the id_rsa.pub you uploaded to gerrit for the lenovo_lxca_ci account | 15:03 |
| corvus | goern: notwithstanding the other options tristanC mentioned, an irc driver would be welcome | 15:05 |
| corvus | tobiash: the author attached a license to https://gist.github.com/tim-patterson/4471877 so i should be able to update the patch to match, and clean it up a bit, and we can merge it. | 15:07 |
| corvus | (the repl) | 15:07 |
| tobiash | corvus: cool | 15:07 |
| *** electrofelix has quit IRC | 15:07 | |
| tobiash | corvus: yeah but that doesn't really fit into our operations so I'll refuse to add that repo until we have a solution | 15:08 |
| *** electrofelix has joined #zuul | 15:18 | |
| *** Rohaan has quit IRC | 15:33 | |
| *** sshnaidm|afk is now known as sshnaidm|rover | 15:38 | |
| *** hashar has joined #zuul | 15:52 | |
| *** yolanda has quit IRC | 15:54 | |
| *** gtema has quit IRC | 16:26 | |
| *** gtema has joined #zuul | 16:27 | |
| *** electrofelix has quit IRC | 16:45 | |
| *** Rohaan has joined #zuul | 16:54 | |
| *** Rohaan has quit IRC | 16:59 | |
| *** jpena is now known as jpena|off | 17:03 | |
| *** fbo is now known as fbo|off | 17:14 | |
| *** gtema has quit IRC | 17:39 | |
| *** gtema has joined #zuul | 17:39 | |
| *** gtema has quit IRC | 17:41 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Reduce requests to github when listing project branches https://review.openstack.org/580218 | 17:48 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Fix relaunch attempts when hitting quota errors https://review.openstack.org/536930 | 18:20 |
| *** elyezer has quit IRC | 18:26 | |
| *** elyezer has joined #zuul | 18:38 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Fix relaunch attempts when hitting quota errors https://review.openstack.org/536930 | 19:00 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Fix relaunch attempts when hitting quota errors https://review.openstack.org/536930 | 19:08 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Fix relaunch attempts when hitting quota errors https://review.openstack.org/536930 | 19:20 |
| *** elyezer has quit IRC | 20:29 | |
| *** elyezer has joined #zuul | 20:31 | |
| *** threestrands has joined #zuul | 22:05 | |
| *** threestrands has quit IRC | 22:05 | |
| *** threestrands has joined #zuul | 22:05 | |
| *** threestrands has quit IRC | 22:06 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!