Monday, 2021-04-26

*** sam_wan has joined #zuul02:09
*** evrardjp has quit IRC02:33
*** evrardjp has joined #zuul02:33
*** saneax has joined #zuul04:19
*** vishalmanchanda has joined #zuul04:52
*** sam_wan has quit IRC04:59
*** ykarel has joined #zuul05:29
openstackgerritSimon Westphahl proposed zuul/zuul master: Log raw connection events on submit  https://review.opendev.org/c/zuul/zuul/+/78791305:43
*** ykarel_ has joined #zuul05:52
*** ykarel has quit IRC05:54
*** jcapitao has joined #zuul05:56
*** jfoufas1 has joined #zuul05:56
*** sam_wan has joined #zuul06:13
openstackgerritFelix Edel proposed zuul/zuul master: Switch to ZooKeeper backed build result events  https://review.opendev.org/c/zuul/zuul/+/78791506:28
*** ykarel_ is now known as ykarel06:50
*** iurygregory has joined #zuul06:58
*** rpittau|afk is now known as rpittau07:12
*** tosky has joined #zuul07:42
*** nils has joined #zuul07:43
*** openstack has joined #zuul07:53
*** ChanServ sets mode: +o openstack07:53
*** jpena|off is now known as jpena07:54
openstackgerritFelix Edel proposed zuul/zuul master: Improve component registry  https://review.opendev.org/c/zuul/zuul/+/78768408:02
openstackgerritFelix Edel proposed zuul/zuul master: Calculate statsd metrics via ComponentRegistry  https://review.opendev.org/c/zuul/zuul/+/78768508:02
*** openstackgerrit has quit IRC08:11
*** webknjaz has quit IRC08:24
*** dcastellani has quit IRC08:24
*** PrinzElvis has quit IRC08:25
*** webknjaz has joined #zuul08:30
*** dcastellani has joined #zuul08:30
*** PrinzElvis has joined #zuul08:30
*** hamalq has joined #zuul08:33
*** hamalq has quit IRC08:38
*** openstackgerrit has joined #zuul08:53
openstackgerritAshley Bullock proposed zuul/zuul master: Add initial bitbucket cloud driver using webhooks  https://review.opendev.org/c/zuul/zuul/+/75900308:53
*** parallax has joined #zuul08:57
*** ykarel is now known as ykarel|lunch09:16
openstackgerritFelix Edel proposed zuul/zuul master: Improve component registry  https://review.opendev.org/c/zuul/zuul/+/78768409:56
openstackgerritFelix Edel proposed zuul/zuul master: Calculate statsd metrics via ComponentRegistry  https://review.opendev.org/c/zuul/zuul/+/78768509:56
openstackgerritFelix Edel proposed zuul/zuul master: Switch to ZooKeeper backed merge result events  https://review.opendev.org/c/zuul/zuul/+/78419510:06
*** ykarel|lunch is now known as ykarel10:29
*** hamalq has joined #zuul10:34
*** hamalq has quit IRC10:39
*** sam_wan has quit IRC10:45
*** jcapitao is now known as jcapitao_lunch10:58
lyrHi there. Is there a prometheus exporter for zuul & nodepool & co ? Or it's only zuul & co into statd into prometheus ?11:04
tristanClyr: the prometheus exporter is still under review, you have to setup a statsd_exporter to use zuul with prometheus11:07
lyrah, there's one coming out somewhen then ?11:08
tristanClyr: the review is https://review.opendev.org/c/zuul/zuul/+/59920911:09
lyrthanks11:15
*** jpena is now known as jpena|lunch11:26
tristanCperhaps another solution would be the one described at https://github.com/nolar/kopf/issues/28911:27
*** rlandy has joined #zuul11:41
*** rlandy is now known as rlandy|rover11:42
*** jcapitao_lunch is now known as jcapitao12:02
*** jpena|lunch is now known as jpena12:28
*** hamalq has joined #zuul12:35
*** sduthil has joined #zuul12:36
*** hamalq has quit IRC12:39
openstackgerritTristan Cacqueray proposed zuul/zuul master: prometheus: add options to start the server and process collector  https://review.opendev.org/c/zuul/zuul/+/59920912:53
*** sshnaidm|afk is now known as sshnaidm13:10
*** vishalmanchanda has quit IRC13:41
*** vishalmanchanda has joined #zuul14:22
*** openstackgerrit has quit IRC14:23
*** josefwells has joined #zuul14:32
*** openstackgerrit has joined #zuul14:34
openstackgerritTristan Cacqueray proposed zuul/zuul master: prometheus: add options to start the server and process collector  https://review.opendev.org/c/zuul/zuul/+/59920914:34
*** hamalq has joined #zuul14:36
corvustristanC: https://github.com/prometheus/client_python/issues/132  is your understanding that once 3.8.0 is our minimum, that should work?14:37
*** hamalq has quit IRC14:40
tristanCcorvus: python-3.8 seems to be the requirements for http server on v6 yes14:41
corvustristanC: ok.  seems like that's probably something we can live with; maybe add a comment to the code so we don't forget why that's set that way?14:44
corvusotherwise lgtm14:45
openstackgerritTristan Cacqueray proposed zuul/zuul master: prometheus: add options to start the server and process collector  https://review.opendev.org/c/zuul/zuul/+/59920914:47
tristanCcorvus: nice, thanks!14:47
*** nils has quit IRC14:49
openstackgerritTristan Cacqueray proposed zuul/zuul master: statsd: decrement resources gauge for held node  https://review.opendev.org/c/zuul/zuul/+/78109214:56
*** nils has joined #zuul15:00
openstackgerritMerged zuul/zuul master: Log raw connection events on submit  https://review.opendev.org/c/zuul/zuul/+/78791315:03
*** nils has quit IRC15:09
*** nils has joined #zuul15:11
openstackgerritClark Boylan proposed zuul/nodepool master: Capture the openstack logs in the functional job  https://review.opendev.org/c/zuul/nodepool/+/78802815:18
clarkbI don't know that we want to merge ^ but trying to debug some failures with the functional openstack jobs15:18
*** ykarel has quit IRC15:21
openstackgerritMatthieu Huin proposed zuul/zuul-client master: Add build-info subcommand  https://review.opendev.org/c/zuul/zuul-client/+/75107015:36
*** mnaser has joined #zuul15:54
*** rpittau is now known as rpittau|afk15:55
*** ykarel has joined #zuul15:58
*** hamalq has joined #zuul15:58
*** hamalq has quit IRC16:03
*** ykarel has quit IRC16:03
*** hamalq has joined #zuul16:04
*** jcapitao has quit IRC16:28
*** saneax has quit IRC16:33
openstackgerritClark Boylan proposed zuul/nodepool master: Capture the openstack logs in the functional job  https://review.opendev.org/c/zuul/nodepool/+/78802816:43
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Roles to create, cleanup and promote snapshots in ec2  https://review.opendev.org/c/zuul/zuul-jobs/+/78767716:47
*** jpena is now known as jpena|off17:10
*** sshnaidm is now known as sshnaidm|afk17:12
*** josefwells has quit IRC17:16
*** jfoufas1 has quit IRC17:30
sean-k-mooneyhi has any discussion of zuul and ansible execution enviornments taken place17:56
sean-k-mooneyhttps://www.ansible.com/blog/introduction-to-ansible-builder17:56
sean-k-mooneyor integrating with https://ansible-runner.readthedocs.io/en/latest/install.html18:00
sean-k-mooneyansible-runner18:00
sean-k-mooneysorry i should have linked https://ansible-runner.readthedocs.io/en/latest/intro.html18:02
SpamapScorvus: I just read that hackernews comment. Pretty cool. Did you see this mentioned there? https://blog.mergify.io/announcing-speculative-merge-queues18:03
SpamapSThe diagram there looks AWFULLY familiar. ;)18:04
SpamapS"Faster & Safer code merge"18:05
SpamapSOh I see.. those are our people. :-D18:05
sean-k-mooneyit does not mention zuul but ya it look familar alright18:07
sean-k-mooneyi dont know if they are using zuul underneath or not18:09
pabelangersean-k-mooney: we'd have to decided to use podman or docker on the zuul-executors over bwrap18:11
sean-k-mooneyya but alsom maybe on the target nodes18:12
pabelangeras you said, the interface is ansible-runner18:12
sean-k-mooneyits not clear if you can or should have the execution env on the nodes being managed or not18:13
corvusif a-r existed when we wrote zuulv3, we probably would have used it.  as it stands now though, we're pretty good at running ansible, so i don't think it's worth refactoring18:13
pabelangerno, it is just needed on the controller side18:13
pabelanger(also I am building EEs for downstream Redhat as my day job) :)18:13
sean-k-mooneycorvus: well the concern is that installing ansible from non source might get more challaning going forward18:13
sean-k-mooneypabelanger: we should talk so18:14
pabelangerso far, ansible community is still rolling an ansible package on pypi. But for productization, it is EEs moving forward18:14
pabelangerwhich is why ansible blog is talking about them now18:14
pabelangerIt would be worth seeing, moving to ansible-core and selecting which collections to install into zuul-executor. while still using bwrap18:20
corvus++ we've always wanted to support (first galaxy, now collections) in zuul18:20
*** vishalmanchanda has quit IRC18:21
sean-k-mooneycool i was not sure if that was public so didnt want to say that here18:35
sean-k-mooneybut also wanted to use zuul more downstream and wanted to make sure we still could in the future18:36
*** gouthamr has joined #zuul19:01
*** BaJ has joined #zuul20:04
openstackgerritMatthieu Huin proposed zuul/zuul-client master: Add buildsets, buildset-info to subcommands  https://review.opendev.org/c/zuul/zuul-client/+/75290920:23
*** jpena|off has quit IRC20:32
*** fbo has quit IRC20:33
fungiSpamapS: yeah, for some reason i thought jd had added speculative states to mergify years ago (like around when you were working on bonnyci), but maybe i misremembered, or maybe he's improved it or is just reannouncing it20:56
*** nils has quit IRC21:34
openstackgerritJames E. Blair proposed zuul/zuul master: Switch to ZooKeeper backed build result events  https://review.opendev.org/c/zuul/zuul/+/78293921:36
clarkbcorvus: in the unique repo checkouts change the reason the playbook checkouts aren't a problem is they are prefixed with project_X right?21:37
corvusclarkb: exactly, they're basically one repo per dir21:38
corvusthe repo dirs are called project_X and then it doesn't matter what's underneath that21:38
clarkbyup, just double checking my understanding of that21:39
clarkbcorvus: left a question on https://review.opendev.org/c/zuul/zuul/+/787451 but overall it lgtm21:53
corvusclarkb: replied21:58
clarkbcorvus: I see and we only need to supply the scheme in that one case because we are overriding the default scheme22:06
corvusclarkb: yep22:08
clarkbcorvus: I wrote that question down more formally in the code review if you want to double check I've got it right still22:09
clarkbwe override the default scheme in a couple of other locations and wonder if they should be explicit about the cache scheme too22:09
corvusclarkb: replied; the merger cache always uses the unique scheme, and i figured that's typical enough to just leave it as a default...22:24
corvusit wouldn't hurt to be explicit; i guess in my mind i just figured that was the usual case, and we only need to be explicit when we're moving out into the jobdirs22:26
clarkbgot it, it is root dependent. That makes sense22:33
openstackgerritMatthieu Huin proposed zuul/zuul-client master: Add console-stream subcommand  https://review.opendev.org/c/zuul/zuul-client/+/75123822:35
openstackgerritMatthieu Huin proposed zuul/zuul master: Test zuul-client builds subcommand  https://review.opendev.org/c/zuul/zuul/+/75814122:39
openstackgerritMatthieu Huin proposed zuul/zuul master: test zuul-client build-info  https://review.opendev.org/c/zuul/zuul/+/75878322:39
openstackgerritMatthieu Huin proposed zuul/zuul master: zuul-client: Test buildsets, buildset-info subcommands  https://review.opendev.org/c/zuul/zuul/+/75898522:39
mhubefore I rebase or abandon https://review.opendev.org/c/zuul/zuul-client/+/755292 , are object models and annotations a hard no? I remember tristanc being interested in that for zuul-client22:44
mhuas a consumer of the API it would bring security in handling data22:45
mhu(if we don't go the object model route I'll modify the change to just cover output formatters)22:46
fungimhu: i don't thing the ml thread has reached a conclusion, but it was pointed out that there's no "halfway" in annotating the codebase in a reasonable manner, and trying to shoehorn type hints into the entire codebase is unlikely to be a great use of someone's time22:47
fungiplus type hinting in python is still in an immature enough state to be painful to deal with22:48
mhufungi: this change is for zuul-client specifically, so it's isolated22:49
corvusi think we're pretty close to no on annotations;22:49
mhuok, just wanted to make sure to avoid working on something that'd get the boot22:51
mhuthanks!22:51
corvusmhu: thanks :)22:52
fungimost recent post on that thread was more than a month ago: ansible localhost -i localhost, -m setup22:52
fungier, http://lists.zuul-ci.org/pipermail/zuul-discuss/2021-March/001538.html22:52
fungiif anyone has any more suggestions on how to make it not a pain, that's probably the best place to resume the discussion22:53
corvusyeah, should probably add something to dev docs about it22:53
mhuby the way, anything I should check on the ML for April? I just recently emerged from diaper duty and I must say I didn't think of checking the ML22:54
mhu(baby poop has this effect on you)22:54
fungithere were 5 threads: http://lists.zuul-ci.org/pipermail/zuul-discuss/2021-April/thread.html22:54
fungiideally you can tell from their subjects if they're anything you care about22:55
fungi(otherwise they're not well-composed subject lines)22:55
clarkbcorvus: felixedel I left some comments/questions on https://review.opendev.org/c/zuul/zuul/+/78293922:55
clarkbLooks like it needs an update for some linting problems (that seem valid), and then I've got a few questions too22:55
corvusmhu: the change ref'd by 'proposed behavior change' has merged; seems like no one figured that was a showstopper; the other one is in review; we made a couple releases, mostly checkpointing the scale-out-scheduler stuff22:56
corvusclarkb: oof, i just copied felix's suggestion; i'll fix that.22:57
mhucorvus, thanks for the summary22:57
mhudo you think there's some bandwidth to move forward on the GUI authentication and admin actions?22:58
corvusmhu: i'm hoping to look at it within the next week or two22:59
mhucool! I think the underlying mechanic is sound, it should be mainly cosmetic stuff to tinker with23:01
mhuhopefully23:01
*** tosky has quit IRC23:01
corvusclarkb: i replied to some of your comments; will leave felixedel to reply to others23:09
clarkbthanks!23:10
openstackgerritJames E. Blair proposed zuul/zuul master: Switch to ZooKeeper backed build result events  https://review.opendev.org/c/zuul/zuul/+/78293923:12
corvusthat should take care of the copypasta23:13
*** smyers_ has joined #zuul23:22
*** smyers has quit IRC23:22
*** smyers_ is now known as smyers23:22
*** rlandy|rover has quit IRC23:47

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!