Wednesday, 2020-06-24

mnasermordred: beyond me too..00:06
*** rlandy|ruck|bbl is now known as rlandy|ruck00:07
*** jamesmcarthur has joined #zuul00:30
*** hamalq_ has quit IRC00:44
*** jamesmcarthur has quit IRC00:50
*** jamesmcarthur has joined #zuul00:51
*** jamesmcarthur has quit IRC00:58
*** jamesmcarthur has joined #zuul01:14
*** jamesmcarthur has quit IRC01:23
*** dennis_effa has joined #zuul01:40
*** jamesmcarthur has joined #zuul01:42
*** jamesmcarthur has quit IRC01:50
*** swest has quit IRC01:52
*** swest has joined #zuul02:07
*** jamesmcarthur has joined #zuul02:11
*** jamesmcarthur has quit IRC02:11
*** jamesmcarthur has joined #zuul02:11
*** rlandy|ruck has quit IRC02:18
*** sgw1 has quit IRC02:50
*** Goneri has joined #zuul02:53
*** jamesmcarthur has quit IRC02:57
*** jamesmcarthur has joined #zuul03:02
*** sgw1 has joined #zuul03:06
*** rfolco has quit IRC03:09
*** sgw1 has quit IRC03:12
*** sgw1 has joined #zuul03:15
*** Goneri has quit IRC03:31
*** dennis_effa has quit IRC03:50
*** bhavikdbavishi has joined #zuul03:51
*** sgw1 has quit IRC03:58
*** sgw1 has joined #zuul04:00
*** bhavikdbavishi1 has joined #zuul04:14
*** bhavikdbavishi has quit IRC04:17
*** bhavikdbavishi1 is now known as bhavikdbavishi04:17
*** ysandeep|away is now known as ysandeep04:28
*** jamesmcarthur has quit IRC04:31
*** evrardjp has quit IRC04:33
*** evrardjp has joined #zuul04:33
*** jamesmcarthur has joined #zuul04:37
*** sgw has quit IRC04:51
*** jamesmcarthur has quit IRC04:58
*** jamesmcarthur has joined #zuul04:58
*** jamesmcarthur has quit IRC05:04
*** jamesmcarthur has joined #zuul05:33
*** sshnaidm|afk is now known as sshnaidm|off05:34
*** jamesmcarthur has quit IRC05:42
*** jamesmcarthur has joined #zuul06:13
*** jamesmcarthur has quit IRC06:22
*** ysandeep is now known as ysandeep|afk06:30
*** bhavikdbavishi has quit IRC06:30
*** harrymichal has joined #zuul06:52
*** rpittau|afk is now known as rpittau06:57
*** jcapitao has joined #zuul07:03
*** harrymichal has quit IRC07:16
*** harrymichal has joined #zuul07:17
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Test multiarch release builds  https://review.opendev.org/73731507:17
openstackgerritFelix Edel proposed zuul/zuul master: Fix mqtt log url reporting when report-build-page is active  https://review.opendev.org/70398307:22
*** hashar has joined #zuul07:30
*** vishalmanchanda has joined #zuul07:34
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Test multiarch release builds  https://review.opendev.org/73731507:34
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Fix zuul_run_command ret when command is not found  https://review.opendev.org/73547507:38
openstackgerritGuillaume Chauvel proposed zuul/zuul master: zuul_stream: close streamer when task is skipped  https://review.opendev.org/73547607:38
*** bhavikdbavishi has joined #zuul07:42
*** ysandeep|afk is now known as ysandeep07:42
*** dmellado has joined #zuul07:43
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Test multiarch release builds  https://review.opendev.org/73731507:47
*** tosky has joined #zuul07:49
*** marios has joined #zuul07:51
*** jpena|off is now known as jpena07:56
*** bhagyashris is now known as bhagyashris|lunc07:57
*** nils has joined #zuul08:11
*** harrymichal has quit IRC08:11
*** harrymichal has joined #zuul08:12
*** jamesmcarthur has joined #zuul08:18
*** jamesmcarthur has quit IRC08:23
*** harrymichal has quit IRC08:26
*** harrymichal has joined #zuul08:27
*** holser_ has quit IRC08:46
*** holser has joined #zuul08:49
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Test multiarch release builds  https://review.opendev.org/73731508:50
*** harrymichal has quit IRC08:51
*** harrymichal has joined #zuul08:52
openstackgerritGuillaume Chauvel proposed zuul/nodepool master: Initial change to rename zuul-quick-start to zuul-tutorial-quick-start  https://review.opendev.org/72826209:02
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Test multiarch release builds  https://review.opendev.org/73731509:04
*** bhagyashris|lunc is now known as bhagyashris09:08
*** harrymichal has quit IRC09:26
*** harrymichal has joined #zuul09:27
*** hashar has quit IRC09:48
*** harrymichal has quit IRC09:53
*** harrymichal has joined #zuul09:54
*** rpittau is now known as rpittau|bbl10:11
*** jamesmcarthur has joined #zuul10:20
*** bhavikdbavishi has quit IRC10:22
*** harrymichal has quit IRC10:23
*** bhavikdbavishi has joined #zuul10:23
*** harrymichal has joined #zuul10:23
*** jamesmcarthur has quit IRC10:32
*** bhavikdbavishi has quit IRC10:36
*** bhavikdbavishi has joined #zuul10:40
*** hashar has joined #zuul10:41
*** harrymichal has quit IRC10:48
*** harrymichal has joined #zuul10:48
*** bhavikdbavishi has quit IRC10:57
openstackgerritJan Kubovy proposed zuul/zuul master: Scheduler's pause/resume functionality  https://review.opendev.org/70973511:03
openstackgerritJan Kubovy proposed zuul/zuul master: Separate connection registries in tests  https://review.opendev.org/71295811:03
*** harrymichal has quit IRC11:03
*** harrymichal has joined #zuul11:03
openstackgerritJan Kubovy proposed zuul/zuul master: Prepare Zookeeper for scale-out scheduler  https://review.opendev.org/71726911:12
openstackgerritJan Kubovy proposed zuul/zuul master: Mandatory Zookeeper connection for ZuulWeb in tests  https://review.opendev.org/72125411:21
*** jcapitao has quit IRC11:27
*** jcapitao has joined #zuul11:28
*** jcapitao is now known as jcapitao_lunch11:28
*** jcapitao_lunch is now known as jcapitao11:28
*** jcapitao is now known as jcapitao_lunch11:28
avassmordred: did you do any magic to get buildx to trust the buildset registry certificate other than install it with update-ca-certificates?11:29
avassI did the same with the fake publication registry but buildx won't trust the certificate even though it works with curl from the container11:30
*** wxy has quit IRC11:40
*** jpena is now known as jpena|lunch11:43
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "Use zuul jobs"  https://review.opendev.org/73206811:44
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "gate pipeline"  https://review.opendev.org/73206911:44
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "job secrets"  https://review.opendev.org/73207011:44
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "job dependencies"  https://review.opendev.org/73207111:44
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Rename quick-start to zuul-tutorial-quick-start  https://review.opendev.org/73765611:44
*** rlandy has joined #zuul11:45
*** rlandy is now known as rlandy|ruck11:46
*** harrymichal has quit IRC11:49
*** harrymichal has joined #zuul11:49
*** ysandeep is now known as ysandeep|brb11:58
*** harrymichal has quit IRC11:59
*** harrymichal has joined #zuul11:59
*** tumble has joined #zuul12:02
*** jcapitao_lunch is now known as jcapitao12:07
*** rfolco has joined #zuul12:11
*** rpittau|bbl is now known as rpittau12:13
*** ysandeep|brb is now known as ysandeep12:14
openstackgerritJan Kubovy proposed zuul/zuul master: Driver event ingestion  https://review.opendev.org/71729912:23
*** jamesmcarthur has joined #zuul12:29
*** jamesmcarthur has quit IRC12:34
*** harrymichal has quit IRC12:34
*** harrymichal has joined #zuul12:35
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Test multiarch release builds  https://review.opendev.org/73731512:43
*** jcapitao has quit IRC12:45
*** jcapitao has joined #zuul12:46
openstackgerritThierry Carrez proposed zuul/zuul-jobs master: upload-git-mirror: check after mirror operation  https://review.opendev.org/73753312:49
*** harrymichal has quit IRC12:49
openstackgerritThierry Carrez proposed zuul/zuul-jobs master: upload-git-mirror: check after mirror operation  https://review.opendev.org/73753312:50
*** harrymichal has joined #zuul12:50
openstackgerritThierry Carrez proposed zuul/zuul-jobs master: upload-git-mirror: check after mirror operation  https://review.opendev.org/73753312:51
*** jpena|lunch is now known as jpena12:51
*** sgw has joined #zuul12:57
*** jcapitao has quit IRC12:57
*** jcapitao has joined #zuul12:58
*** harrymichal has quit IRC13:19
*** harrymichal has joined #zuul13:20
*** jcapitao has quit IRC13:28
*** jcapitao has joined #zuul13:31
*** rlandy|ruck is now known as rlandy|ruck|mtg13:31
mordredavass: I wanna say yes, and also that I don't 100% remember13:34
*** jcapitao has quit IRC13:43
*** jcapitao has joined #zuul13:49
*** harrymichal has quit IRC14:04
*** harrymichal has joined #zuul14:05
*** jamesmcarthur has joined #zuul14:15
*** ysandeep is now known as ysandeep|afk14:29
*** harrymichal has quit IRC14:34
*** harrymichal has joined #zuul14:35
*** hashar has quit IRC14:52
*** jamesmcarthur has quit IRC14:54
*** jamesmcarthur has joined #zuul14:54
*** ysandeep|afk is now known as ysandeep14:56
corvusmordred, paladox: fyi i restarted upstream gerrit's nodepool launcher to pick up the quota fix, and it couldn't resolve hostnames so it couldn't connect to zk.  i eventually found that kube-dns was broken, and apparently the way you fix that is to restart docker[1].  so i just restarted the entire k8s cluster.  so it's now running latest everything.15:08
corvus[1] https://github.com/kubernetes/kubeadm/issues/19315:08
paladoxgreat! :)15:08
*** ysandeep is now known as ysandeep|away15:09
*** jamesmcarthur has quit IRC15:12
*** jamesmcarthur has joined #zuul15:13
mordredcorvus: neat15:17
*** Goneri has joined #zuul15:19
*** harrymichal has quit IRC15:19
*** harrymichal has joined #zuul15:20
*** rlandy|ruck|mtg is now known as rlandy|ruck15:22
*** jamesmcarthur has quit IRC15:23
*** harrymichal has quit IRC15:26
*** harrymichal has joined #zuul15:32
*** bhavikdbavishi has joined #zuul15:32
*** bhavikdbavishi1 has joined #zuul15:36
*** bhavikdbavishi has quit IRC15:38
*** bhavikdbavishi1 is now known as bhavikdbavishi15:38
*** harrymichal has quit IRC15:39
*** harrymichal has joined #zuul15:39
fungithat's a fun issue15:57
openstackgerritThierry Carrez proposed zuul/zuul-jobs master: upload-git-mirror: check after mirror operation  https://review.opendev.org/73753316:02
*** bhavikdbavishi has quit IRC16:04
*** bhavikdbavishi has joined #zuul16:05
*** marios has quit IRC16:07
ttxalright that one should do it16:08
*** bhavikdbavishi1 has joined #zuul16:12
*** bhavikdbavishi has quit IRC16:14
*** bhavikdbavishi1 is now known as bhavikdbavishi16:14
*** ysandeep|away is now known as ysandeep16:16
*** jcapitao has quit IRC16:24
*** ysandeep is now known as ysandeep|away16:26
*** harrymichal has quit IRC16:34
*** harrymichal has joined #zuul16:34
openstackgerritMatthieu Huin proposed zuul/zuul master: [WIP] Web UI: add i18n support, french translations  https://review.opendev.org/73729016:35
*** rpittau is now known as rpittau|afk16:41
openstackgerritJan Kubovy proposed zuul/zuul master: WIP: Store unparsed branch config in Zookeeper  https://review.opendev.org/70571616:59
*** harrymichal has quit IRC17:00
*** harrymichal_ has joined #zuul17:01
*** harrymichal_ is now known as harrymichal17:01
*** jpena is now known as jpena|off17:03
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "gate your first patch"  https://review.opendev.org/73206717:05
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "Use zuul jobs"  https://review.opendev.org/73206817:05
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "gate pipeline"  https://review.opendev.org/73206917:05
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "job secrets"  https://review.opendev.org/73207017:05
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "job dependencies"  https://review.opendev.org/73207117:05
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Rename quick-start to zuul-tutorial-quick-start  https://review.opendev.org/73765617:05
openstackgerritGuillaume Chauvel proposed zuul/zuul master: [DNM] TEST run zuul tutorials to test stream+callback (+ zuul-jobs change)  https://review.opendev.org/73547717:05
openstackgerritGuillaume Chauvel proposed zuul/zuul master: [DNM] TEST run zuul tutorials to test stream+callback and multiple nodes  https://review.opendev.org/73548317:05
*** harrymichal has quit IRC17:31
*** harrymichal has joined #zuul17:31
corvusmordred: why does buildx require a buildset registry?17:47
mordredcorvus: well - it has to push an image _somewhere_17:48
mordredcorvus: there is no other way to get its results into a local image cache17:49
mordredso if you use buildx to build an image and then want to docker run it - you have to push/pull17:49
avasscorvus: the image isn't available if for docker if you just build it with buildx for some reason17:50
corvusmordred: i think there's a confusing thing here were we previously said that a buildset registry was optional, but we've made it required for multi-arch builds17:50
mordredyes - I agree17:51
*** harrymichal has quit IRC17:51
corvusmordred: so jobs that just ran 'build-docker-image' suddenly fail when we ask them to build a multiarch image17:51
*** harrymichal has joined #zuul17:51
mordredcorvus: perhaps we should update teh buildx code to run a zuul-registry if no buildset-registry is given, and use that as the push/pull source, but then stop/rm that registry at teh end of the build tasks17:52
corvusyeah maybe17:52
corvuswhat happens if you run docker buildx without push?  does it just sit inside the build container?17:52
mordredyeah17:52
mordredit's in the image cache inside the build container, but not in the image cache in the top-level docker17:52
corvusi wonder if there's any other way we could move it between the caches17:53
mordredthere is intended to be support for that17:53
mordredbut it is not yet implemented17:53
mordredlike - you wanna hear something funny?17:53
mordredif you use buildx to build a non-multi-arch image you can do it17:53
mordredbut it's not implemented for manifest images yet17:53
avass'yay'17:53
avassthe last thing I did on the held buildset node was to install the certificate inside the buildx container and the host, and that worked. So i wonder if it has to be installed on both for some reason17:55
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Test multiarch release builds  https://review.opendev.org/73731517:57
corvusavass: yeah, build-docker-image copies the buildset registry cert into the builder17:58
corvusavass: you can probably copy the tasks from tasks/setup-buildx17:58
avasscorvus: just did, well sort of :)17:59
corvusmordred, avass: i think we could do mordred's suggestion of running a temp registry to move the images if there isn't already a buildset registry; but i feel like the complexity (especially around testing) is getting out of hand18:01
avassyup18:01
corvusthat would be the *fourth* registry involved in this process18:01
corvusintermediate, buildset, publication, temporary (and if you count the tests, don't forget the *fake* intermediate registry which stands in for the *real* intermediate registry.  that's a fifth)18:02
fungithe docker-docker-registry-registry-docker-registry-docker-registry18:02
corvusif there's no alternative, maybe we could move buildx into its own role18:04
*** bhavikdbavishi has quit IRC18:04
corvusthat might help with understanding and testing thes...18:04
*** harrymichal has quit IRC18:06
*** harrymichal has joined #zuul18:06
corvusmordred: what do you think of that?  and did you come up with any other ideas we could explore?18:08
corvusmaybe we should not use the buildset registry in the buildx path18:11
corvusmaybe we should just *always* run a temp registry in order to move to/from the builder18:11
corvusthen hand back to the normal code path for getting to the buildset registry18:12
corvusit means that we'll be moving more bytes around, but maybe the role will be simpler18:12
mordredcorvus: I think I like that better actually18:14
mordredtreat the temp registry just as an impl detail of buildx18:14
corvusya18:14
corvusavass: ^?18:14
avassyeah, it sounds like a good idea18:15
avassjust need to under stand how this is supposed to work :)18:15
corvusokay, i'm going to work on that a bit18:15
avassjust got the same error even though the certificate is installed both on the host and inside the container18:15
avassI got it got work after installing is inside the buildx container and on the host and then restarting the docker daemon. but I must have done something else that I can't remember because that doesn't work in the test18:16
*** vishalmanchanda has quit IRC18:17
corvusavass: i think we need a "run-a-registry" role to use internally in zuul-jobs.  for the tests, for your publication registry, for this temp registry...18:21
corvusi think i'll start by making that18:21
avasssounds good18:21
corvusit'll be our first "for internal use only" role -- maybe it should just be a task import or something rather than a real role18:22
avasscan you hold another node so I can mess around with the latest patchset?18:22
corvusavass: yep 1 sec18:22
corvusavass: done with the first?18:22
avassyup18:22
corvusavass: old deleted / new set18:23
*** harrymichal has quit IRC18:29
*** harrymichal has joined #zuul18:29
*** irclogbot_3 has quit IRC18:34
*** irclogbot_1 has joined #zuul18:39
avassoh, huh, looks like I got chosen for a random covid19 test. So guess I should do that before I get too invested18:48
avasscorvus: the node should be held, but I don't have access to it :)19:17
corvusavass: ssh root@158.69.68.1219:22
corvusshould be good now19:22
avassoh!19:25
avasswe might not need a registry19:25
corvusavass: for publishing or just building?19:26
avassfor building but nvm, got an irrelevant warning telling me to use '--load' but like mordred said it's not actually supported for manifest lists19:26
*** Goneri has quit IRC19:30
avasscorvus: would it be easier to output an oci image tarball instead of using a temporary build registry?19:33
corvusavass: if that were an option, probably so? but i thought that wasn't implemented either?19:36
avasscorvus: looks like you can do '--output type=oci,dest=<file>'19:38
avassinstead of pushing the image19:39
*** sanjayu_ has quit IRC19:39
corvusavass: oh, i wonder if that will work with the multi-arch manifest stuff19:42
corvusi wonder if mordred tried that19:43
*** hamalq has joined #zuul19:43
avasscorvus, mordred: looking at: https://github.com/docker/buildx/issues/166#issuecomment-544827163 I would guess it should work19:45
avassbut how do we upload the image to the registry in that case? import it to docker and then push it?19:45
avasslooks like you can enable experimental docker daemon features to import a specific platform19:46
*** nils has quit IRC19:46
*** harrymichal has quit IRC19:53
*** harrymichal has joined #zuul19:54
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Test multiarch release builds  https://review.opendev.org/73731519:54
corvusavass: if it works, then we'd import it into the local docker cache, then let the standard push to buildset registry and push to dockerhub tasks handle it from there.20:03
clarkbis this work in the service of fixing the mixups with the image manifests and multi arch or does that problem still exist?20:12
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Test multiarch release builds  https://review.opendev.org/73731520:19
avasscorvus: anyway the multiarch test is green, the fix was to restart the buildx container :)20:19
avassthough I'm not sure if we want to explicitly pull from the buildset registry in build-docker-image, I added it since it didn't work for some reason20:20
avassclarkb: what's the mixup?20:25
clarkbavass: at one point we were seeing images not work because running the x86 image got us the arm64 image20:25
clarkb(or maybe it was the other way around but docker would get the wrong arch image)20:25
avassoh, no this is adding tests for multiarch container releases20:27
avassand fixing the releases so nodepool can push a 3.?.0 container20:28
mordredclarkb: no - this isn't even working on that yet20:34
*** rfolco has quit IRC20:47
*** harrymichal has quit IRC20:58
*** harrymichal has joined #zuul20:59
*** harrymichal has quit IRC21:13
*** harrymichal has joined #zuul21:14
*** harrymichal has quit IRC21:33
*** harrymichal has joined #zuul21:34
*** harrymichal has quit IRC21:58
*** harrymichal has joined #zuul21:59
*** rfolco has joined #zuul22:04
*** swest has quit IRC22:13
*** rlandy|ruck is now known as rlandy|ruck|bbl22:22
*** rfolco has quit IRC22:27
*** swest has joined #zuul22:28
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "Use zuul jobs"  https://review.opendev.org/73206822:38
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "gate pipeline"  https://review.opendev.org/73206922:38
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "job secrets"  https://review.opendev.org/73207022:38
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "job dependencies"  https://review.opendev.org/73207122:38
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Rename quick-start to zuul-tutorial-quick-start  https://review.opendev.org/73765622:38
openstackgerritGuillaume Chauvel proposed zuul/zuul master: [DNM] TEST run zuul tutorials to test stream+callback (+ zuul-jobs change)  https://review.opendev.org/73547722:38
openstackgerritGuillaume Chauvel proposed zuul/zuul master: [DNM] TEST run zuul tutorials to test stream+callback and multiple nodes  https://review.opendev.org/73548322:38
*** tumble has quit IRC22:41
*** cloudnull has quit IRC22:56
*** tosky has quit IRC23:03
*** harrymichal has quit IRC23:08
*** rfolco has joined #zuul23:23

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!