| *** sshnaidm_ has joined #zuul | 00:00 | |
| *** sshnaidm|afk has quit IRC | 00:01 | |
| *** sshnaidm_ has quit IRC | 00:07 | |
| *** sshnaidm_ has joined #zuul | 00:08 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Add artifacts to MQTT reporter https://review.opendev.org/c/zuul/zuul/+/788101 | 00:11 |
|---|---|---|
| *** smyers_ has joined #zuul | 00:22 | |
| *** smyers has quit IRC | 00:25 | |
| *** smyers_ is now known as smyers | 00:25 | |
| *** hamalq has quit IRC | 01:37 | |
| *** ricolin has quit IRC | 01:37 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Switch to ZooKeeper backed build result events https://review.opendev.org/c/zuul/zuul/+/782939 | 01:40 |
| *** sam_wan has joined #zuul | 01:48 | |
| *** evrardjp has quit IRC | 02:33 | |
| *** evrardjp has joined #zuul | 02:33 | |
| *** BaJ has left #zuul | 02:59 | |
| *** jfoufas1 has joined #zuul | 04:25 | |
| *** ykarel has joined #zuul | 04:35 | |
| *** vishalmanchanda has joined #zuul | 04:50 | |
| *** saneax has joined #zuul | 04:54 | |
| *** sam_wan has quit IRC | 05:31 | |
| *** bhavikdbavishi has joined #zuul | 06:20 | |
| *** sam_wan has joined #zuul | 06:26 | |
| openstackgerrit | Felix Edel proposed zuul/zuul master: Calculate statsd metrics via ComponentRegistry https://review.opendev.org/c/zuul/zuul/+/787685 | 06:37 |
| *** jcapitao has joined #zuul | 06:48 | |
| *** sam_wan has quit IRC | 07:01 | |
| *** nils has joined #zuul | 07:22 | |
| *** hashar has joined #zuul | 07:26 | |
| *** bhavikdbavishi has quit IRC | 07:30 | |
| *** sam_wan has joined #zuul | 07:35 | |
| *** tosky has joined #zuul | 07:41 | |
| *** ricolin has joined #zuul | 07:43 | |
| *** rpittau|afk is now known as rpittau | 07:45 | |
| *** jpena|off has joined #zuul | 07:54 | |
| *** jpena|off is now known as jpena | 07:54 | |
| zbr | avass: i wonder if I should ping people about something like https://review.opendev.org/c/zuul/zuul-jobs/+/731471 or just forget it. | 07:56 |
| *** bhavikdbavishi has joined #zuul | 08:00 | |
| *** bhavikdbavishi1 has joined #zuul | 08:03 | |
| *** bhavikdbavishi has quit IRC | 08:05 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 08:05 | |
| avass | zbr: sorry, I'm getting more and more busy internally | 08:15 |
| avass | zbr: but I got some downtime I'll take a loo | 08:16 |
| avass | zbr: lgtm | 08:17 |
| avass | corvus: very small review on that ^ one. I feel like ansible-lint has improved a lot when it comes to execution time and it now has built in support all(?) our custom rules and mocking of modules | 08:20 |
| openstackgerrit | Sorin Sbârnea proposed zuul/zuul-jobs master: Remove ansible-lint path exclusions https://review.opendev.org/c/zuul/zuul-jobs/+/731471 | 08:22 |
| zbr | thanks. i rebased it, just to see if it is still green, 5mo is a very long time. | 08:23 |
| openstackgerrit | Felix Edel proposed zuul/zuul master: Calculate statsd metrics via ComponentRegistry https://review.opendev.org/c/zuul/zuul/+/787685 | 08:37 |
| *** hashar has quit IRC | 08:43 | |
| *** ykarel is now known as ykarel|lunch | 09:13 | |
| *** yoctozepto4 has joined #zuul | 09:26 | |
| *** yoctozepto has quit IRC | 09:26 | |
| *** yoctozepto4 is now known as yoctozepto | 09:26 | |
| *** sshnaidm_ is now known as sshnaidm | 10:00 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: test zuul-client build-info https://review.opendev.org/c/zuul/zuul/+/758783 | 10:01 |
| *** ykarel|lunch is now known as ykarel | 10:13 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul-client master: Add build-info subcommand https://review.opendev.org/c/zuul/zuul-client/+/751070 | 10:15 |
| openstackgerrit | Felix Edel proposed zuul/zuul master: Calculate statsd metrics via ComponentRegistry https://review.opendev.org/c/zuul/zuul/+/787685 | 10:22 |
| sean-k-mooney | o/ | 10:30 |
| sean-k-mooney | am if i enable the gerrit driver with http but do not set up the trigger configurtion | 10:30 |
| sean-k-mooney | can i use it to clone the repos | 10:31 |
| *** jcapitao is now known as jcapitao_lunch | 10:32 | |
| tristanC | corvus: tobiash: could you please have a look at https://review.opendev.org/c/zuul/zuul/+/781092 , this is the resources usage metric fix for held node | 11:25 |
| *** jpena is now known as jpena|lunch | 11:34 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul-client master: Add build-info subcommand https://review.opendev.org/c/zuul/zuul-client/+/751070 | 11:40 |
| mhu | hello zuul-maint, since the builds subcommand has been merged in zuul-client, can we get the tests in zuul merged too? https://review.opendev.org/c/zuul/zuul/+/758141 | 11:43 |
| pabelanger | Is there a way we can render on zuul UI, the size of the zuul.GithubEventProcessor left to process? In our case, sometime the bot on ansible/ansible generates a lot of events in github, and because we have to process them serially it looks like our zuul isn't doing anything (reacting to new PRs, etc). However, when you look at the logs, you can see it chugging though the github events. However, | 11:49 |
| pabelanger | because of rate-limits and size of pages returned it takes a bit of time | 11:49 |
| *** rlandy has joined #zuul | 11:49 | |
| *** rlandy is now known as rlandy|rover | 11:49 | |
| tristanC | pabelanger: here is the code that render the status header: https://opendev.org/zuul/zuul/src/branch/master/web/src/pages/Status.jsx#L166-L180 | 11:51 |
| tristanC | pabelanger: is the size of the zuul.GithubEventProcessor already part of the status json object? | 11:51 |
| pabelanger | I haven't looked honestly | 11:52 |
| pabelanger | I just know the existing queue lengths fields in the UI doesn't reflected the size of it | 11:53 |
| *** hashar has joined #zuul | 11:54 | |
| *** jcapitao_lunch is now known as jcapitao | 12:02 | |
| tobiash | pabelanger: that's not yet exposed | 12:05 |
| openstackgerrit | Merged zuul/zuul-jobs master: Remove ansible-lint path exclusions https://review.opendev.org/c/zuul/zuul-jobs/+/731471 | 12:06 |
| *** rlandy|rover is now known as rlandy|rover|mtg | 12:07 | |
| openstackgerrit | Simon Westphahl proposed zuul/zuul master: Stream API for sharded Zookeeper data https://review.opendev.org/c/zuul/zuul/+/771454 | 12:13 |
| openstackgerrit | Simon Westphahl proposed zuul/zuul master: Cache unparsed config files in Zookeeper https://review.opendev.org/c/zuul/zuul/+/771455 | 12:13 |
| openstackgerrit | Simon Westphahl proposed zuul/zuul master: Cache unparsed config files in Zookeeper https://review.opendev.org/c/zuul/zuul/+/771455 | 12:18 |
| *** Shrews has joined #zuul | 12:21 | |
| *** jpena|lunch is now known as jpena | 12:33 | |
| openstackgerrit | Simon Westphahl proposed zuul/zuul master: Store tenants in unparsed abide as dict https://review.opendev.org/c/zuul/zuul/+/771456 | 12:43 |
| pabelanger | tobiash: thanks, do you feel it would be a lot of work to add it? | 12:45 |
| openstackgerrit | Felix Edel proposed zuul/zuul master: Calculate statsd metrics via ComponentRegistry https://review.opendev.org/c/zuul/zuul/+/787685 | 13:16 |
| tobiash | pabelanger: I think it wouldn't be too much work. However I think that should be aligned with the zk work since I think this could be done generically for all event queues in zk | 13:19 |
| *** rlandy|rover|mtg is now known as rlandy|rover | 13:25 | |
| *** bhavikdbavishi has quit IRC | 13:37 | |
| fungi | a colleague who follows twitter pointed this out: https://twitter.com/hugoprudente/status/1385692060968275968 | 14:12 |
| fungi | always nice to see people noticing zuul exists ;) | 14:13 |
| *** sam_wan has quit IRC | 14:21 | |
| corvus | ++ | 14:23 |
| *** sshnaidm has quit IRC | 14:38 | |
| *** sshnaidm has joined #zuul | 14:40 | |
| *** ykarel has quit IRC | 14:57 | |
| *** snktparik30 has joined #zuul | 15:02 | |
| snktparik30 | Hi everyone, I'm trying to use upload-log-s3 role in my zuul system, but not sure where and how i have to install boto3 dependency. | 15:05 |
| SpamapS | snktparik30: It must be in the PYTHONPATH for Ansible, which runs on the executor, so it has to be there. | 15:06 |
| mordred | corvus: are we waiting on other reviewers for the workspace schema path? or ok to +3? | 15:06 |
| SpamapS | My info may be out of date, but I wrote that role, and back then, I just made sure the executors had boto3. | 15:07 |
| corvus | snktparik30, SpamapS: i think i just saw a change to add boto to our container images for that purpose (this is relevant if you're running zuul from containers) | 15:09 |
| snktparik30 | SpamapS i try with install boto3 on executors but no sucess. | 15:09 |
| corvus | snktparik30: if you're not using containers, let me get you a doc link for how to install it | 15:09 |
| SpamapS | It's possible that Ansible's PYTHONPATH != Zuul's PYTHONPATH .. I don't remember. | 15:10 |
| snktparik30 | yes we are using containers its a eks deployment. | 15:10 |
| clarkb | SpamapS: snktparik30: yes each of the ansible versions is installed in a separate venv now | 15:10 |
| clarkb | you'll need to install boto in each of them | 15:10 |
| clarkb | I thought there was a way to supply extra libs to the manage-ansible tool but I'm not seeing it anymore | 15:11 |
| corvus | https://zuul-ci.org/docs/zuul/howtos/installation.html#ansible-installation-options is the command to use, set ANSIBLE_EXTRA_PACKAGES | 15:11 |
| SpamapS | Sounds familiar. :) | 15:11 |
| snktparik30 | corvus thanks | 15:14 |
| corvus | SpamapS, snktparik30: https://review.opendev.org/787751 is the change to add boto to the container images (so this shouldn't be a problem for future users) | 15:15 |
| corvus | and actually all users (even non-container users) | 15:15 |
| SpamapS | #installAllTheThings | 15:16 |
| corvus | yeah, batteries included :) | 15:16 |
| corvus | mordred: i *think* it's good, but maybe let's just ping zuul-maint and let them know that the workspace scheme change is ready to merge so if anyone else wants to review https://review.opendev.org/787451 speak up :) | 15:18 |
| zbr | corvus: boto3 a pypi package that never caused headaches ;) | 15:20 |
| SpamapS | Yeah, like shade. | 15:20 |
| SpamapS | and PBR | 15:20 |
| SpamapS | ;) | 15:20 |
| * SpamapS will go back to the troll den | 15:20 | |
| * zbr thinks that compared with awscli one, the others are just small flesh wounds. | 15:21 | |
| mordred | corvus: I think you just did ping zuul-maint :) | 15:21 |
| corvus | mordred: oh did we ping zuul-maint? | 15:22 |
| tobiash | I'd like to review that | 15:22 |
| corvus | mordred: i guess we did ping zuul-maint | 15:22 |
| mordred | corvus: :) | 15:22 |
| corvus | tobiash: cool, we'll hold +w for you then | 15:22 |
| mordred | k. I +2'd - holding +W | 15:22 |
| mordred | corvus: it's a shockingly small patch | 15:23 |
| corvus | yeah, and i think we've got good options if we need to expand on it in the future (like an explicit mapping, or exposing the unique scheme to users). | 15:24 |
| tobiash | corvus: lgtm | 15:28 |
| tobiash | although this will give me a headache when upgrading | 15:28 |
| corvus | tobiash: how so? | 15:28 |
| corvus | oh | 15:28 |
| corvus | deleting the repos | 15:28 |
| corvus | (and waiting for them to clone) | 15:28 |
| corvus | tobiash: if you wanted, you could move them into their new names | 15:29 |
| tobiash | yes, we use hostpath for performance reasons and no pvc so we'll have to ssh into every openshift node and clean that up prior to the upgrade | 15:29 |
| corvus | i mean, that's still a headache, but it may be a smaller headache? | 15:29 |
| tobiash | it's doable, but just requires some preparation upfront | 15:29 |
| clarkb | corvus: tobiash: ya thinking about starting our zk upgrades momentarily and part of that process is restarting zuul executors and mergers (I think) and landing this change first may make that quite a bit more involved? | 15:30 |
| tobiash | I'm wondering if we should automate the cleanup or renamings | 15:30 |
| corvus | clarkb: we don't have to merge it right now, but i wouldn't worry about it | 15:30 |
| clarkb | corvus: ok | 15:30 |
| tobiash | this would make most peoples life easier probablt | 15:30 |
| corvus | clarkb: for opendev, i was just planning on rm-ing after the restart | 15:30 |
| clarkb | corvus: and just let it repull? | 15:31 |
| corvus | clarkb: yep. | 15:31 |
| corvus | that is an expected mode of operation | 15:31 |
| corvus | tobiash: that's an option. think it's worth doing? | 15:33 |
| tobiash | at least we will need time for preparing the upgrade (and if that means deleting the cache the upgrade itself will take longer due to a prolonged startup) | 15:34 |
| corvus | tobiash: to be clear, zuul doesn't care if you delete the cache, but if you don't have space to 2x the repo storage then you'll need to | 15:35 |
| tobiash | so I guess it depends on the effort of such a migration | 15:35 |
| tobiash | yes, fully understood that point | 15:36 |
| corvus | ok; so i'm assuming 2x isn't an option which is why you need the extra prep (either locally or in zuul) | 15:36 |
| tobiash | a simple method might be versioning the cache layout (similar to the keystore) and if the version mismatches auto-delete the cache on startup | 15:36 |
| corvus | yep; we can probably assume users won't have a connection named ".zuul_cache_version" :) | 15:37 |
| tobiash | :D | 15:38 |
| tobiash | the auto-delete also would make it possible to do the cache upgrade during a rolling restart of the executors which is much easier to handle compared to 150 executors fetching all repos in the first hours | 15:39 |
| corvus | tobiash: okay; feel free to -1 with that and i'll add a migration to it | 15:40 |
| tobiash | k | 15:41 |
| tobiash | thanks | 15:41 |
| corvus | thank you :) | 15:41 |
| *** holser has quit IRC | 15:44 | |
| *** holser has joined #zuul | 15:45 | |
| *** hashar is now known as hasharAway | 15:46 | |
| avass | tobiash, corvus: maybe I should rename the zuul-cache to zuul-artifact-cache just in case... :) | 15:48 |
| corvus | avass: on general principal, the more descriptive name does seem better :) however, i'm not afraid of confusion in this specific instance (the internal merger repo cache isn't really a user-visible thing). | 15:50 |
| corvus | avass: but if you want to do that to avoid potential confusion with other user-visible things in the future, that might be a good idea | 15:50 |
| *** ykarel has joined #zuul | 15:51 | |
| avass | yep exactly. | 15:51 |
| mhu | tobiash, fungi clarkb can this get the final +3 ? https://review.opendev.org/c/zuul/zuul/+/758141 - the depends-on has already been merged | 15:51 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul-client master: Add build-info subcommand https://review.opendev.org/c/zuul/zuul-client/+/751070 | 15:56 |
| *** ykarel has quit IRC | 16:00 | |
| *** snktparik30 has quit IRC | 16:09 | |
| *** jcapitao has quit IRC | 16:21 | |
| *** rpittau is now known as rpittau|afk | 16:33 | |
| *** bhavikdbavishi has joined #zuul | 16:45 | |
| *** bhavikdbavishi1 has joined #zuul | 16:52 | |
| *** bhavikdbavishi has quit IRC | 16:53 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 16:53 | |
| *** jpena is now known as jpena|off | 17:01 | |
| openstackgerrit | Merged zuul/zuul master: Test zuul-client builds subcommand https://review.opendev.org/c/zuul/zuul/+/758141 | 17:03 |
| *** saneax has quit IRC | 17:14 | |
| *** jfoufas1 has quit IRC | 17:39 | |
| *** hamalq has joined #zuul | 17:53 | |
| *** hamalq has quit IRC | 17:54 | |
| *** hamalq has joined #zuul | 17:54 | |
| *** vishalmanchanda has quit IRC | 18:14 | |
| *** openstackstatus has quit IRC | 18:31 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul-client master: Improve logging and CLI output https://review.opendev.org/c/zuul/zuul-client/+/788340 | 18:33 |
| *** openstackstatus has joined #zuul | 18:33 | |
| *** ChanServ sets mode: +v openstackstatus | 18:33 | |
| *** hasharAway is now known as hashar | 19:05 | |
| *** bhavikdbavishi has quit IRC | 19:27 | |
| ianw | zuul-maint: it would be helpful to get some eyes on https://review.opendev.org/c/zuul/nodepool/+/788028 to collect devstack logs from nodepool jobs. we are seeing random 500 errors from nova/keystone/something in the job in the dib gate, and don't really have much to go on | 19:28 |
| ianw | i know in the past we've said "this isn't a devstack test" ... which yes it isn't, but practically there's not much else to help with random errors popping up | 19:29 |
| fungi | we could also stage a revert of that once we manage to debug the current issue | 19:30 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul-client master: Add build-info subcommand https://review.opendev.org/c/zuul/zuul-client/+/751070 | 19:38 |
| corvus | ianw: that's a post-run task; can you do that in the dib repo? | 19:38 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: zuul-client: Test buildsets, buildset-info subcommands https://review.opendev.org/c/zuul/zuul/+/758985 | 19:39 |
| fungi | oh, good point, we could probably make a child job which adds it | 19:41 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul-client master: Add buildsets, buildset-info to subcommands https://review.opendev.org/c/zuul/zuul-client/+/752909 | 19:42 |
| clarkb | corvus: fungi yes I think that is possible since nothing will have stopped devstack | 19:44 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul-client master: Improve logging and CLI output https://review.opendev.org/c/zuul/zuul-client/+/788340 | 20:14 |
| *** nils has quit IRC | 20:30 | |
| *** ikhan has joined #zuul | 20:53 | |
| *** cloudnull has quit IRC | 21:24 | |
| *** cloudnull has joined #zuul | 21:25 | |
| *** Shrews has quit IRC | 21:28 | |
| *** hashar has quit IRC | 21:40 | |
| *** rlandy|rover is now known as rlandy|rover|bia | 21:41 | |
| *** tosky has quit IRC | 23:08 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Support overlapping repos and a flat workspace scheme https://review.opendev.org/c/zuul/zuul/+/787451 | 23:13 |
| corvus | tobiash: ^ how's that look? | 23:14 |
| *** rlandy|rover|bia is now known as rlandy|rover | 23:19 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Add waiting status to status page https://review.opendev.org/c/zuul/zuul/+/788376 | 23:23 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Log semaphore acquire/release at INFO https://review.opendev.org/c/zuul/zuul/+/788377 | 23:28 |
| *** rlandy|rover has quit IRC | 23:45 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Emit stats for semaphore holders https://review.opendev.org/c/zuul/zuul/+/788378 | 23:52 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!