Thursday, 2019-12-05

ianwi've just realised that doesn't really work anyway, because both the jobs would try to upload the same tagged images into the registry.  it would be luck which one gets there first.  the containers with siblings will have to have different names, i guess00:00
corvusi would think that the system-config repo would have exercised the case of multiple provides jobs00:01
corvusbut yeah, that'll be a problem; the data structure for the build image role should allow you to specify a different tag00:01
corvusso you could do zuul/nodepool:latest-siblings00:02
ianwright, so we're happy with the one build job doing double-duty here?00:02
ianwi guess that also means the siblings are uploaded to dockerhub?00:03
ianwhrmm ... maybe i can cut them out of the gate job00:03
ianwsorry, thinking out loud :)  there's a lot of corners when you start implementing this :)00:04
corvuser i don't know -- this ipv6 container stuff is so complex i haven't been able to give this work the attention it deserves.  i'm trying to provide information to unblock you, but i don't have a thorough grasp of the changes.00:04
corvus^ was about 'double duty"00:04
*** jamesmcarthur has joined #zuul00:04
corvusre dockerhub: yes, the gate will upload to dockerhub.  we can either choose to omit that from the gate job, or consider uploading a siblings image.  i would probably lean toward the former, but don't feel strongly at the moment.00:05
corvusor00:05
corvusthe gate will upload to dockerhub with a crazy unusable tag -- we could allow that to happen, but never promote the siblings tags to something usable.00:05
corvus(so include in check+gate but omit siblings in promote)00:05
corvusoptions abound00:06
ianwyes, that is for sure :)00:06
corvusi have to eod now; hopefully i'll be able to clear some of this v6 stuff tomorrow and dig in more with you00:06
ianwok, no worries.  it's two steps forward, one back atm, but i think we're getting there00:07
*** rfolco has joined #zuul00:07
ianwthat test stack didn't hang, in the same way my other one did.  so, still a bit in the dark on that one00:07
*** jamesmcarthur has quit IRC00:08
*** tosky has quit IRC00:10
openstackgerritIan Wienand proposed zuul/nodepool master: [wip] move openstack testing to use containerised daemon  https://review.opendev.org/69346400:13
openstackgerritIan Wienand proposed zuul/nodepool master: [wip] move openstack testing to use containerised daemon  https://review.opendev.org/69346400:16
ianwi just thought of another thing; because the siblings build runs & installs everything from bindep, the sibling containers won't require extra installation of binary packages for dib.  but the production images will00:17
openstackgerritIan Wienand proposed zuul/nodepool master: Also build sibling container images  https://review.opendev.org/69739300:40
*** rfolco has quit IRC00:50
openstackgerritIan Wienand proposed zuul/nodepool master: Also build sibling container images  https://review.opendev.org/69739301:15
*** rfolco has joined #zuul01:29
ianwcorvus: 693464 still gets itself stuck with those job failures.  I have filed https://storyboard.openstack.org/#!/story/2006988 with the details.  i have left it as is in the gate for now in case some state helps.02:02
*** rfolco has quit IRC02:12
*** jamesmcarthur has joined #zuul02:45
*** igordc has quit IRC02:54
*** jamesmcarthur has quit IRC03:04
*** jamesmcarthur has joined #zuul03:19
*** rlandy|bbl is now known as rlandy03:19
*** rlandy has quit IRC03:23
*** jamesmcarthur has quit IRC03:35
*** bhavikdbavishi1 has joined #zuul03:38
*** bhavikdbavishi has quit IRC03:39
*** bhavikdbavishi1 is now known as bhavikdbavishi03:39
*** jamesmcarthur has joined #zuul03:51
*** jamesmcarthur has quit IRC03:54
*** bhavikdbavishi has quit IRC03:54
*** jamesmcarthur has joined #zuul03:55
*** jamesmcarthur has quit IRC04:00
*** jamesmcarthur has joined #zuul04:25
*** jamesmcarthur has quit IRC04:32
*** bhavikdbavishi has joined #zuul04:48
*** bhavikdbavishi1 has joined #zuul04:51
*** bhavikdbavishi has quit IRC04:53
*** bhavikdbavishi1 is now known as bhavikdbavishi04:53
*** threestrands has joined #zuul05:24
*** reiterative has quit IRC05:35
*** pcaruana has joined #zuul05:38
*** pcaruana has quit IRC05:42
*** raukadah is now known as chkumar|ruck05:45
*** swest has joined #zuul05:49
*** lennyb has joined #zuul07:09
*** pcaruana has joined #zuul07:17
*** jamesmcarthur has joined #zuul07:34
*** jamesmcarthur has quit IRC07:38
*** jcapitao has joined #zuul07:42
*** gtema has joined #zuul07:47
*** saneax has joined #zuul07:50
openstackgerritSimon Westphahl proposed zuul/zuul master: Don't process builds not longer in job graph  https://review.opendev.org/69742008:06
openstackgerritSimon Westphahl proposed zuul/zuul master: Don't process builds not longer in job graph  https://review.opendev.org/69742008:09
*** gtema has quit IRC08:10
*** pabelanger has quit IRC08:34
*** maxamillion has quit IRC08:34
*** tosky has joined #zuul08:36
*** pabelanger has joined #zuul08:38
*** maxamillion has joined #zuul08:38
*** bhavikdbavishi1 has joined #zuul08:45
*** bhavikdbavishi has quit IRC08:47
*** bhavikdbavishi1 is now known as bhavikdbavishi08:47
*** jpena|off is now known as jpena08:50
*** threestrands has quit IRC09:07
*** jangutter has joined #zuul09:09
*** mhu has joined #zuul09:22
mhuhi tobiash, thanks for the reviews! Regarding https://review.opendev.org/#/c/695446/ should I change the help message for the trigger arg?09:31
*** pabelanger has quit IRC09:54
*** maxamillion has quit IRC09:54
*** saneax has quit IRC09:54
*** dmellado has quit IRC09:54
*** jangutter has quit IRC09:54
*** mugsie has quit IRC09:54
*** donnyd has quit IRC09:54
*** shanemcd has quit IRC09:54
*** adam_g has quit IRC09:54
*** jkt has quit IRC09:54
*** mnasiadka has quit IRC09:54
*** webknjaz has quit IRC09:54
*** EmilienM has quit IRC09:54
*** frickler has quit IRC09:54
*** Diabelko has quit IRC09:54
*** bhavikdbavishi has quit IRC09:54
*** mhu has quit IRC09:54
*** fdegir has quit IRC09:54
*** sgw has quit IRC09:54
*** AJaeger has quit IRC09:54
*** dmsimard has quit IRC09:54
*** openstackgerrit has quit IRC09:54
*** SotK has quit IRC09:54
*** jpena has quit IRC09:54
*** evrardjp has quit IRC09:54
*** mgoddard has quit IRC09:54
*** sugaar has quit IRC09:54
*** logan- has quit IRC09:54
*** ChrisShort has quit IRC09:54
*** dcastellani has quit IRC09:54
*** zxiiro has quit IRC09:54
*** jlk has quit IRC09:54
*** amotoki has quit IRC09:54
*** fbo has quit IRC09:54
*** clayg has quit IRC09:54
*** ttx has quit IRC09:54
*** tosky has quit IRC09:54
*** pcaruana has quit IRC09:54
*** lennyb has quit IRC09:54
*** yolanda has quit IRC09:54
*** johanssone has quit IRC09:54
*** irclogbot_1 has quit IRC09:55
*** klindgren_ has quit IRC09:55
*** corvus has quit IRC09:55
*** ianw has quit IRC09:55
*** aspiers has quit IRC09:55
*** notnone has quit IRC09:55
*** gothicmindfood has quit IRC09:55
*** Goneri has quit IRC09:55
*** smyers has quit IRC09:55
*** persia has quit IRC09:55
*** mauved has quit IRC09:55
*** coldtom has quit IRC09:55
*** gouthamr has quit IRC09:55
*** sshnaidm has quit IRC09:55
*** pots has quit IRC09:55
*** daniel2 has quit IRC09:55
*** gundalow has quit IRC09:55
*** wxy-xiyuan has quit IRC09:55
*** fungi has quit IRC09:55
*** stevthedev has quit IRC09:55
*** mmedvede has quit IRC09:55
*** gmann has quit IRC09:55
*** dustinc has quit IRC09:55
*** samccann has quit IRC09:55
*** yoctozepto has quit IRC09:55
*** paladox has quit IRC09:55
*** decimuscorvinus has quit IRC09:55
*** bstinson has quit IRC09:55
*** panda has quit IRC09:55
*** nhicher has quit IRC09:55
*** tobiash has quit IRC09:55
*** aluria has quit IRC09:55
*** chkumar|ruck has quit IRC09:55
*** tobberydberg has quit IRC09:55
*** Miouge has quit IRC09:55
*** flaper87 has quit IRC09:55
*** timburke has quit IRC09:55
*** tristanC has quit IRC09:55
*** arxcruz has quit IRC09:55
*** jhesketh has quit IRC09:55
*** Tahvok has quit IRC09:55
*** andreaf has quit IRC09:55
*** johnsom has quit IRC09:55
*** portdirect has quit IRC09:55
*** jcapitao has quit IRC09:55
*** swest has quit IRC09:55
*** zbr_ has quit IRC09:55
*** clarkb has quit IRC09:55
*** ssbarnea has quit IRC09:55
*** tflink has quit IRC09:55
*** tdasilva has quit IRC09:55
*** mgagne has quit IRC09:55
*** dtroyer has quit IRC09:55
*** tributarian has quit IRC09:55
*** guilhermesp has quit IRC09:55
*** iamweswilson has quit IRC09:55
*** kmalloc has quit IRC09:55
*** mordred has quit IRC09:55
*** evgenyl has quit IRC09:55
*** mnaser has quit IRC09:55
*** jtanner has quit IRC09:55
*** Shrews has quit IRC09:55
*** ChanServ has quit IRC09:55
*** maxamillion has joined #zuul10:04
*** pabelanger has joined #zuul10:04
*** electrofelix has joined #zuul10:04
*** dmellado has joined #zuul10:04
*** saneax has joined #zuul10:04
*** Diabelko has joined #zuul10:04
*** frickler has joined #zuul10:04
*** EmilienM has joined #zuul10:04
*** webknjaz has joined #zuul10:04
*** mnasiadka has joined #zuul10:04
*** jkt has joined #zuul10:04
*** adam_g has joined #zuul10:04
*** shanemcd has joined #zuul10:04
*** donnyd has joined #zuul10:04
*** mugsie has joined #zuul10:04
*** jangutter has joined #zuul10:04
*** evrardjp has joined #zuul10:04
*** jpena has joined #zuul10:04
*** SotK has joined #zuul10:04
*** openstackgerrit has joined #zuul10:04
*** dmsimard has joined #zuul10:04
*** AJaeger has joined #zuul10:04
*** sgw has joined #zuul10:04
*** fdegir has joined #zuul10:04
*** bhavikdbavishi has joined #zuul10:04
*** mhu has joined #zuul10:04
*** avass has joined #zuul10:04
*** tosky has joined #zuul10:04
*** jcapitao has joined #zuul10:04
*** pcaruana has joined #zuul10:04
*** lennyb has joined #zuul10:04
*** swest has joined #zuul10:04
*** Goneri has joined #zuul10:04
*** zbr_ has joined #zuul10:04
*** yolanda has joined #zuul10:04
*** yoctozepto has joined #zuul10:04
*** paladox has joined #zuul10:04
*** smyers has joined #zuul10:04
*** jhesketh has joined #zuul10:04
*** johanssone has joined #zuul10:04
*** clarkb has joined #zuul10:04
*** persia has joined #zuul10:04
*** decimuscorvinus has joined #zuul10:04
*** bstinson has joined #zuul10:04
*** mauved has joined #zuul10:04
*** panda has joined #zuul10:04
*** ssbarnea has joined #zuul10:04
*** coldtom has joined #zuul10:04
*** gouthamr has joined #zuul10:04
*** tflink has joined #zuul10:04
*** Tahvok has joined #zuul10:04
*** nhicher has joined #zuul10:04
*** sshnaidm has joined #zuul10:04
*** irclogbot_1 has joined #zuul10:04
*** tobiash has joined #zuul10:04
*** klindgren_ has joined #zuul10:04
*** pots has joined #zuul10:04
*** corvus has joined #zuul10:04
*** daniel2 has joined #zuul10:04
*** tdasilva has joined #zuul10:04
*** mgagne has joined #zuul10:04
*** dtroyer has joined #zuul10:04
*** ianw has joined #zuul10:04
*** gmann has joined #zuul10:04
*** gundalow has joined #zuul10:04
*** guilhermesp has joined #zuul10:04
*** kmalloc has joined #zuul10:04
*** tributarian has joined #zuul10:04
*** iamweswilson has joined #zuul10:04
*** wxy-xiyuan has joined #zuul10:04
*** aluria has joined #zuul10:04
*** chkumar|ruck has joined #zuul10:04
*** fungi has joined #zuul10:04
*** mordred has joined #zuul10:04
*** aspiers has joined #zuul10:04
*** stevthedev has joined #zuul10:04
*** notnone has joined #zuul10:04
*** andreaf has joined #zuul10:04
*** tobberydberg has joined #zuul10:04
*** Miouge has joined #zuul10:04
*** gothicmindfood has joined #zuul10:04
*** mmedvede has joined #zuul10:04
*** flaper87 has joined #zuul10:04
*** timburke has joined #zuul10:04
*** tristanC has joined #zuul10:04
*** arxcruz has joined #zuul10:04
*** dustinc has joined #zuul10:04
*** samccann has joined #zuul10:04
*** johnsom has joined #zuul10:04
*** portdirect has joined #zuul10:04
*** Shrews has joined #zuul10:04
*** jtanner has joined #zuul10:04
*** mnaser has joined #zuul10:04
*** evgenyl has joined #zuul10:04
*** ChanServ has joined #zuul10:04
*** orwell.freenode.net sets mode: +o ChanServ10:04
*** ttx has joined #zuul10:04
*** mgoddard has joined #zuul10:04
*** sugaar has joined #zuul10:04
*** logan- has joined #zuul10:04
*** ChrisShort has joined #zuul10:04
*** zxiiro has joined #zuul10:04
*** dcastellani has joined #zuul10:04
*** jlk has joined #zuul10:04
*** amotoki has joined #zuul10:04
*** fbo has joined #zuul10:04
*** clayg has joined #zuul10:04
*** logan- has quit IRC10:05
*** logan- has joined #zuul10:06
*** hashar has joined #zuul10:14
*** bhavikdbavishi has quit IRC10:22
*** pcaruana has quit IRC10:42
*** jcapitao is now known as jcapitao|afk10:46
sugaarhey, is there a way to increase the number of logs obtained from zuul execution? for debugging10:51
*** hashar has quit IRC10:54
*** jcapitao|afk is now known as jcapitao10:57
*** vivobg has joined #zuul10:59
*** rfolco has joined #zuul11:17
*** rfolco has quit IRC11:17
*** rfolco has joined #zuul11:18
*** saneax has quit IRC11:22
*** saneax has joined #zuul11:23
tobiashsugaar: see here: https://zuul-ci.org/docs/zuul/admin/components.html#id1111:38
tobiashYou can switch a running executor into verbose mode such that it runa ansible in verbose mode11:38
*** vivobg has quit IRC11:52
sugaartobiash nice, thanks!11:56
*** bhavikdbavishi has joined #zuul11:58
*** bhavikdbavishi1 has joined #zuul12:01
*** bhavikdbavishi has quit IRC12:02
*** bhavikdbavishi1 is now known as bhavikdbavishi12:02
*** jcapitao is now known as jcapitao|lunch12:07
*** zbr_ is now known as zbr|out12:13
*** jpena is now known as jpena|lunch12:22
*** themroc has joined #zuul12:42
*** jamesmcarthur has joined #zuul12:53
*** pcaruana has joined #zuul12:54
*** mhu has quit IRC12:57
sugaarI am getting "Declining node request 200-0000000010 because node type(s) [ubuntu-bionic] not available", So I created a minikube cluster called "ubuntu-bionic" but it still struggles to find it. Then I discovered that when i execute "kubectl get nodes" the output is minikube so I guess that is is the reason of failure. But I would like to confirm12:59
sugaarthat the node name in https://opendev.org/zuul/zuul/src/branch/master/doc/source/admin/examples/zuul-config/zuul.d/jobs.yaml#L6 refers to the actual node name and not something else, such as a label, namespace etc.12:59
*** rlandy has joined #zuul13:01
*** jamesmcarthur has quit IRC13:07
*** bhavikdbavishi has quit IRC13:09
*** jamesmcarthur has joined #zuul13:12
*** jpena|lunch is now known as jpena13:14
*** jcapitao|lunch is now known as jcapitao13:22
*** Goneri has quit IRC13:24
*** jamesmcarthur has quit IRC13:25
*** jamesmcarthur has joined #zuul13:26
*** themroc has quit IRC13:29
*** jamesmcarthur has quit IRC13:31
*** jamesmcarthur has joined #zuul13:57
*** jamesmcarthur has quit IRC14:04
*** Goneri has joined #zuul14:18
*** rlandy is now known as rlandy|mtg14:28
*** zbr|out has quit IRC14:33
*** zbr has joined #zuul14:34
*** jamesmcarthur has joined #zuul14:36
*** pcaruana has quit IRC14:38
*** jamesmcarthur has quit IRC14:40
*** zbr_ has joined #zuul14:41
*** zbr has quit IRC14:44
openstackgerritSimon Westphahl proposed zuul/zuul master: Store event id for buildsets in database  https://review.opendev.org/69748814:47
*** zbr_ has quit IRC14:49
*** zbr has joined #zuul14:55
openstackgerritSimon Westphahl proposed zuul/zuul master: Store event id for buildsets in database  https://review.opendev.org/69748814:55
*** bhavikdbavishi has joined #zuul14:58
*** rlandy|mtg is now known as rlandy15:09
*** swest has quit IRC15:10
avassIt's become a social network of sorts for geeks, despite the age of the protocol I still find it the least "invasive" and most friendly experience, but that's probably because I spent the time configuring a client that's nice for me. (preview: http://imgs.fyi/img/9ve2.png )15:12
avassyeah that's an accidental copy paste, sorry15:12
*** mhu has joined #zuul15:14
mhuhey mnaser, just to let you know I've resumed work on https://review.opendev.org/#/c/643536/ and I might have something ugly but somewhat usable soon ... fingers crossed15:17
mhu( ^ is JWT support in zuul-web GUI)15:17
mnasermhu: oh thats awesome, sorry its been on my list but ive just barely been keeping up15:23
mhumnaser, no worries15:23
mhuI just wanted to make sure you hadn't anything in the works15:24
mnaseri wish :p15:24
mhuwell there'll be plenty left for you to polish up if you'd like :)15:25
mordredavass: in the world of accidental copy-paste - that could have been much worse15:25
mordredavass: one time I accidentally copy/pasted a couple of lines from a private conversation that were ... quite inappropriate15:26
avassmordred: wow, that sounds horrible15:27
avassmordred: didn't know I had paste on middle mouse button. disabled that now :)15:27
*** bhavikdbavishi1 has joined #zuul15:29
*** jcapitao is now known as jcapitao|afk15:30
*** bhavikdbavishi has quit IRC15:30
*** bhavikdbavishi1 is now known as bhavikdbavishi15:30
mordredmiddle mouse button paste was the thing that got me - that and a habit of highlighting text as I read it :)15:32
corvusinteresting... my "mouse" only has 2 buttons, so i emulate a middle button by pressng both.  that tends to make it hard to accidentally hit.15:37
*** jamesmcarthur has joined #zuul15:37
clarkbmy laptop touchpad is the worst thing ever so sometimes I use shift + insert15:38
*** jcapitao|afk is now known as jcapitao15:40
corvussugaar: the node name is what zuul gives to ansible (ie, it's the name that goes into the inventory).  the label is what zuul requests from nodepool (the nodepool label).15:41
*** jamesmcarthur has quit IRC15:42
corvussugaar: so the label in zuul and the label in nodepool need to match (the error you got looks like it doesn't)15:42
*** avass has quit IRC15:44
*** chkumar|ruck is now known as raukadah15:57
*** mattw4 has joined #zuul16:21
*** jangutter has quit IRC16:25
sugaarcorvus in which zuul file is specified that??16:27
*** igordc has joined #zuul16:27
corvussugaar: that was in reference to the file you cited here: https://opendev.org/zuul/zuul/src/branch/master/doc/source/admin/examples/zuul-config/zuul.d/jobs.yaml#L616:29
sugaaraaa all right, then I have the same label for both, something else could be failing?16:30
corvussugaar: check the nodepool launcher logs, they may indicate why it's unable to fulfill the request16:31
openstackgerritMatthieu Huin proposed zuul/zuul master: [DNM][WIP] admin REST API: zuul-web integration  https://review.opendev.org/64353616:32
*** jamesmcarthur has joined #zuul16:38
*** jamesmcarthur has quit IRC16:42
*** openstackgerrit has quit IRC16:42
*** openstackgerrit has joined #zuul16:43
openstackgerritMatthieu Huin proposed zuul/zuul master: enqueue: make trigger deprecated  https://review.opendev.org/69544616:43
*** jpena is now known as jpena|brb16:45
sugaarcorvus will do thanks16:47
*** mattw4 has quit IRC16:49
*** electrofelix has quit IRC16:49
zbrwho wrote the zuul-github integration? i am curious if there is any progress on improving it to enable the "details" option, and avoid posting comments.16:57
*** mattw4 has joined #zuul16:58
*** jamesmcarthur has joined #zuul17:00
pabelangerzbr: detail link works today17:00
pabelangerzbr: see https://github.com/ansible/ansible-zuul-jobs/pull/262 for example17:01
zbrpabelanger: super. i was looking at https://github.com/containers/libpod/pull/4601 which uses rdo zuul, maybe it needs an update, or config change?17:01
pabelangerzbr: yes17:02
zbrpabelanger++ i love how the link looks, points user to a page that is really easy to read. i want the same!17:02
corvusis this the thing you can't see unless you're logged in?17:03
corvusoh, you can click on the tiny check mark and get details17:04
corvuszbr, pabelanger: is this what you're talking about? https://imgur.com/a/CND48u517:05
zbrcorvus: i think so, it was looking bit different for me but since then that change merged. it was inside a "checks" table that contained all of them.17:07
zbrthe check row was looking the in your screenshot.17:08
corvuszbr: you might be seeing the logged in view.  for some reason, github doesn't show that to logged-out users.17:09
corvusi was able to see that by clicking the tiny little check mark (or yellow dot) next to the commit sha17:09
zbrprobably due to API trottling, maybe they also have security concerns, i don't care much because I am almost always logged in on github.17:10
corvusanyway, when making changes, i recommend looking at it both logged in and logged out to make sure you know what folks are seeing, since github renders it differently.17:10
corvuszbr: well, i'm suggesting you think about more than just you :)17:10
corvuszbr: other folks interested in the project may be using github unauthenticated17:10
zbrsure. i will check both17:10
zbrnow I only need to discover what magic changes i need for rdo in order to get the same feature working.17:11
corvuszbr: i think https://github.com/ansible/project-config/blob/master/zuul.d/pipelines.yaml#L71  maybe pabelanger can veriy17:12
corvusverify even17:12
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: WIP: use-buildset-registry: Add podman support  https://review.opendev.org/69505117:14
raukadahzbr: corvus tripleo is working on using podman from master to find breakage early may be in future, if things are awesome, we can use it in opendev17:15
corvusdoes anyone know how the "> Details" stuff in pr comments works?17:15
corvusraukadah: ++ we're using it more and more -- we're hoping to switch our image builds to buildah soon, and mordred's preparing to use it to run gerrit.  i'm working on adding support for it to the speculative containers system.17:17
corvusmaybe we can have an option for zuul to put job results under "> Details".17:18
raukadahcorvus: for buildah one, we have not started, we first want to gain the trust then move forward17:18
*** lennyb has quit IRC17:20
*** jpena|brb is now known as jpena17:25
*** lennyb has joined #zuul17:26
clarkbpabelanger: did you see tobiash's comment on your github fix change?17:26
clarkbpabelanger: tobiash decided that one of my comments was -1 worthy (the need for canonical name lookups)17:27
mordredraukadah: the ability to bind-mount volumes instead of copying when doing podman build instead of docker build is super exciting17:29
mordredraukadah: and https://review-dev.openstack.org is currently running in podman17:29
mordredoh neat - I just read the scrollback from zbr about rdo zuul doing testing on containers/libpod :)17:30
*** lennyb has quit IRC17:32
raukadahmordred: awesome, we will try to keep the status updated, My main goal is to use zuul from rdo side, find values and make them comfortable so that they can adopt our tooling :-)17:35
raukadahbut baby step17:35
raukadahwe have a long road to travel17:36
*** jamesmcarthur has quit IRC17:36
*** lennyb has joined #zuul17:36
raukadahmordred: we also gatted ceph-ansible via tripleo job fyi!17:37
*** lennyb has quit IRC17:41
mordred\o/17:42
*** jamesmcarthur has joined #zuul17:46
*** jcapitao has quit IRC17:46
*** rfolco is now known as rfolco|brb17:48
*** jamesmcarthur has quit IRC17:50
clarkbprobably too early to even think about it, but maybe that gives us an avenue to push on ipv6 support17:53
clarkbcreate a non voting job with a bunch of the scenarios we've found that fail and have then run17:53
clarkbthen maybe people will want to make those scenarios not fail17:53
clarkbmhu: latest ps looks good to me on the trigger change17:54
pabelangerclarkb: tobiash: sadly no, I've had to step away from that fix right now. If either would like to take over, I'd not object17:57
*** jamesmcarthur has joined #zuul17:58
*** jamesmcarthur has quit IRC17:59
*** mattw4 has quit IRC18:03
mordredclarkb: ++18:07
mordredclarkb: maybe raukadah and zbr can convince our podman friends to fix the ipv6 issues :)18:08
zbrmordred: we can try. we started with few jobs, later we can add more.18:09
raukadahclarkb: we need issue and live examples, may be we need to propose patches also to show the fix then they can agree18:09
*** jamesmcarthur has joined #zuul18:10
clarkbraukadah: well they closed the issue "wont fix"18:11
clarkbso that doesn't really help us18:11
raukadahsorry to say, collaboration is a good word, hard to convince them how it happens18:11
*** jamesmcarthur has quit IRC18:11
mordredraukadah: https://github.com/containers/libpod/issues/4311 is the most recent open non-wont-fix issue18:12
zbrclarkb: do you have link? i am curious. TBH, I was impressed by how easy it was to introduce my rpm-building changes. but those were not really changing the product.18:12
raukadahmordred: adding to my list18:12
clarkbzbr: https://github.com/containers/skopeo/issues/63118:13
*** mattw4 has joined #zuul18:15
corvusyeah, i think the podman folks want 4311 solved, so hopefully it will be eventually.  but skopeo 631 is disappointing.18:15
corvusboth of those are ipv6 issues, and working around each of them requires running socat18:16
zbri don't see it closed, and its seems like an easy fix. i do not fully understand the comment....18:16
zbrconsidering that the URL is valid IPv6 there is no excuse for not supporting it.18:16
corvusso that our systems will end up doing: podman <-> socat (for skopeo631) <-> socat (for libpod 4311) <-> registry.  it's not the best network design.  :)18:16
zbri doubt a PR to fix such a problem would be refused.18:16
zbrnow i have no idea if ipv6 support works or not (using DNS entries)18:17
mordredzbr: other than that issue, ipv6 works great18:18
raukadahsorry but stupid question, does skopeo and buildah functionality are a part of podman? It is coming from a feature which is in builadh but there is an issue to levarage in podman aka manifest support18:18
*** jpena is now known as jpena|off18:18
zbrin fact that could be a bit problematic due to the way docker refers to containers from various registries, prefixing them. due to this would i do my best to avoid using IP addreses when working with images.18:19
*** michael-beaver has joined #zuul18:19
zbri would use myregistry.local or whatever i can.18:19
corvuszbr: yes, we do that in some cases.  however, we want to run skopeo in a containerized environment where we can't modify /etc/hosts.18:20
zbrprobably it has something to do with this. also we do all know that ipv6 addresses can be written in many ways, which one is the "normalized" one.18:20
corvusso we have to use socat18:20
zbrouch, the old /etc/hosts issue, gave me nightmares18:20
mordredzbr: this would be mitigated if the underlying code used url parsing libraries rather than regexes18:22
zbrparsing url with regex, that is one of the top voted stackoverflow questions18:24
clarkbzbr: it works with dns entries18:24
clarkbits purely a parsing error18:24
clarkbThe likely fix here is to have skopeo check if the input location is a docker "url" or an actual "url" then use the appropriate parser depending on the input18:25
clarkbthen we could do https://[2345::1]:5000/stuff/here and it would work18:25
clarkbeveryone else can do localhost:5000/stuff/here and get docker's broken parser18:25
mordred++18:26
*** jamesmcarthur has joined #zuul18:26
clarkbbut the response from upstream seems to be they don't even car18:26
clarkbso my ability to care is pretty low18:26
zbri need to go now, but if anyone needs help raising awareness, ping me.18:28
clarkbI think the ideal would be to start adding some ipv6 testing where things do work and can be made to work. This way people start thinking about ipv6 as a requirement18:30
clarkbthen that will hopefully change the perception on some of these other issues over time18:30
*** jamesmcarthur has quit IRC18:32
*** Goneri has quit IRC18:35
*** rfolco|brb is now known as rfolco18:35
fungi"look how close your stuff is to fully supporting ipv6 use cases"18:36
openstackgerritClark Boylan proposed zuul/zuul master: Record job build attempts in inventory  https://review.opendev.org/69754818:43
clarkbthis ^ is an idea I've been playing around with to expose reliability of jobs a bit more18:43
clarkbwe don't just have pass/fail anymore but have pass/fail1/fail2/fail318:43
*** Goneri has joined #zuul18:44
corvusclarkb: ++18:52
*** bhavikdbavishi has quit IRC18:57
corvusclarkb: incidentally, i just hit your bug again -- registries.conf can't handle an ipv6 addr as a "location".  i think it's just a straight string rewrite that goes right into the reference parser.18:58
mordredcorvus: that's so sad18:58
fungiout of curiosity, can it handle an ipv4 address?19:00
corvuspretty sure yes19:00
corvus(since the job worked when run on ipv4 hosts)19:01
fungiyeah, definitely doesn't make sense that they don't consider that a bug then19:01
fungiif something which works with a literal ipv4 address can't support a literal ipv6 address...19:01
corvusi don't want to speak for them too much, but i do get the feeling they at least think it's unfortunate behavior imposed on them by docker19:02
mordredyeah. and extra unfortunately docker is basically a dead upstream now, so fixing it upstream is super unlikley19:03
clarkbmordred: right that is why I suggested accepting two input formats19:03
corvuslike, i don't think the libpod folks think the state is *good*, just that maybe they are not certain it warrants breaking bug compat.  perhaps as zbr suggests, they may be open to further persuasion.19:03
clarkb the docker format for legacy compat and proper urls for the future19:04
mordred++19:04
corvusyeah, maybe it's worth proposing that as a solution, esp if we can reliably detect whether it's urls vs legacy pile of regex19:04
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: WIP: use-buildset-registry: Add podman support  https://review.opendev.org/69505119:07
clarkbI've left an updated comment19:09
openstackgerritClark Boylan proposed zuul/zuul master: Record job build attempts in inventory  https://review.opendev.org/69754819:11
clarkbI wonder if something about my git setup causes me to hit ^ every time I make a zuul commit19:11
mnaserjust a heads up given you're doing a lot of docker and podman19:21
mnaserthis took up a long time of mine: https://github.com/docker/hub-feedback/issues/187119:21
clarkbmnaser: I feel you bro19:22
mnaserlots of wat.png19:22
pabelangerclarkb: okay, I lol'd at that19:24
pabelangerthen read PR19:24
pabelanger:(19:24
mordredsame19:24
mnaserharbor is an interesting registry to look at19:25
mnaseri havent touched it yet though19:25
mnaserit supports storing things like helm charts too (which are now a thing that can be stored in registries)19:25
clarkbfwiw given my experiences with ipv6 things I do commiserate and thought the "feel you bro" comment from that issue was was appropriate :)19:25
clarkbseems I looked at harbor quickly when looking at options for zuul registry19:26
clarkband discovered it needs a bunch of database stuff19:26
mnaseryeah, its pretty stateful overall19:28
corvusall the feels19:41
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: use-buildset-registry: Add podman support  https://review.opendev.org/69505119:44
corvusokay, that's ^ out of WIP.  it's been tested on ipv6 and passes19:44
mordredcorvus: \o/19:52
*** hashar has joined #zuul19:53
*** igordc has quit IRC20:05
ianwcorvus: i see you've been flat out with the podman stuff.  not sure if you have any thoughts on https://storyboard.openstack.org/#!/story/2006988 ... just checking in on it, it did eventually skip the job, not sure what it was thinking in the mean time20:10
Shrewscorvus: i surprisingly grasp most of that. although, is this ignored error a concern? https://zuul.opendev.org/t/zuul/build/fa75b36a8d30438a8e57d85c1510cfdc/log/job-output.txt#64120:16
clarkbrereviewing the container updates chagnes is at the top of my todo list for post lunch activity20:18
clarkbShrews: I expect we want that results.json file to exist?20:18
Shrewslooks like that might exist for a different role usage scenario, so i'm guessing that's ok20:27
*** saneax has quit IRC20:53
corvusShrews: yep, that's for if the buildset registry comes from a previous job, but in this test it's the same job.21:11
corvusianw: back from lunch and i think i can context switch now21:11
ianwcorvus: thanks :)21:13
clarkbcorvus: comment on https://review.opendev.org/#/c/695051 but i think it is probably fine as a start21:22
corvusclarkb: ack replied21:24
*** rfolco has quit IRC21:25
clarkbcorvus: I think you can approve the stack when ready then21:29
corvusianw: zuul did leave a comment indicating the cause of the failure of those 2 jobs on https://review.opendev.org/#/c/693464/3421:37
corvusit's not a good comment, but it's something21:38
corvusthat more or less translates to "the image build job of the change ahead did not run"21:38
*** Goneri has quit IRC21:38
corvusthe change ahead has a similar comment: https://review.opendev.org/#/c/69484521:38
corvuswhich translates to "the image build job of the change ahead did run but did not succeed"21:39
corvusand that's just a legit failure: https://zuul.opendev.org/t/zuul/build/92ae266b49d645ada06accd0663dcd6b21:39
corvushopefully that should clear up the mystery of why the jobs immediately failed (clearly we should finde better ways of communicating that)21:40
corvusthat still should not have caused the item to get stuck21:40
ianwcorvus: oh, interesting ... you know i didn't even expand that comment21:41
*** persia has quit IRC21:43
ianwi think my underlying confusion comes from what you explained yesterday with the requires/provides docker-image bits; i had expected it would just build each change separately21:44
*** persia has joined #zuul21:45
openstackgerritJames E. Blair proposed zuul/zuul master: Log item warning messages at info level  https://review.opendev.org/69757121:45
openstackgerritIan Wienand proposed zuul/nodepool master: Dockerfile : install sudo for nodepool-builder  https://review.opendev.org/69470921:48
openstackgerritIan Wienand proposed zuul/nodepool master: Dockerfile: add DEBUG environment flag  https://review.opendev.org/69484521:48
openstackgerritIan Wienand proposed zuul/nodepool master: Also build sibling container images  https://review.opendev.org/69739321:48
openstackgerritIan Wienand proposed zuul/nodepool master: [wip] move openstack testing to use containerised daemon  https://review.opendev.org/69346421:48
corvusianw: i have a theory about why it got stuck; it'll take a bit to produce a test case21:58
openstackgerritIan Wienand proposed zuul/nodepool master: Dockerfile: install sudo for nodepool-builder  https://review.opendev.org/69470922:03
openstackgerritIan Wienand proposed zuul/nodepool master: Dockerfile: add DEBUG environment flag  https://review.opendev.org/69484522:03
openstackgerritIan Wienand proposed zuul/nodepool master: Also build sibling container images  https://review.opendev.org/69739322:03
openstackgerritIan Wienand proposed zuul/nodepool master: [wip] move openstack testing to use containerised daemon  https://review.opendev.org/69346422:03
ianwcorvus: not to distract, something else that i realised when building up the images is that the sibling images run bindep to install all the dependencies for the siblings, as it loops through installing them with python-builder22:12
ianwthat won't happen when building from releases (i.e. just running python-builder for nodepool, no siblings) for a (theoretical) production image22:13
ianwit had me thinking maybe if zuul had a "latest tag" checkout option, we could install via the siblings method for the production images too, but ensure the siblings are only coming in from, well, their latest tag22:14
ianwi'm not *actually* sure if that is at all practical :)22:14
ianwotherwise we basically have to re-implement installing the bindep.txt packages in the Dockerfile -- which would fall out as a no-op in the siblings case I guess, since the packages are already installed22:15
*** mhu has quit IRC22:16
openstackgerritJames E. Blair proposed zuul/zuul master: Fix potential wedge with provides/requires/dependencies  https://review.opendev.org/69757922:19
corvusianw: ^ there we go.  it was a one-liner.22:19
corvusthe latter is probably the best solution.  i think it uses the tooling as designed.  but maybe there's some way we can put bindep info into package metadata that makes it into release tarballs and wheels?22:22
ianwi think that's been a constant tricky point with bindep, that it's not distributed22:23
ianw“But you did that in thirty seconds,” the astonished woman replied.22:24
ianw“No,” Picasso said. “It has taken me forty years to do that.”22:24
ianwwe'll just call corvus Picasso :)22:25
corvusi've been called a subset of Picasso before22:25
corvusprobably due to my inability to take a compliment.  thanks.  :)  and thanks for finding the bug and narrowing it down.  i didn't have to look far.22:26
*** mattw4 has quit IRC22:27
*** jamesmcarthur has joined #zuul22:31
*** jamesmcarthur has quit IRC22:45
*** jamesmcarthur has joined #zuul22:45
*** hashar has quit IRC23:00
*** mattw4 has joined #zuul23:15
*** mattw4 has quit IRC23:20
*** sshnaidm is now known as sshnaidm|afk23:24
*** jamesmcarthur has quit IRC23:28
*** tosky has quit IRC23:38
*** jamesmcarthur has joined #zuul23:38
*** rlandy is now known as rlandy|afk23:45
*** jamesmcarthur has quit IRC23:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!