*** Chaserjim has quit IRC | 00:05 | |
*** Chaserjim has joined #openstack-kolla | 00:06 | |
*** dcapone2004 has quit IRC | 00:20 | |
*** maharg101 has joined #openstack-kolla | 00:20 | |
*** adrian-a has quit IRC | 00:25 | |
*** maharg101 has quit IRC | 00:26 | |
*** calbers has quit IRC | 00:27 | |
*** calbers has joined #openstack-kolla | 00:28 | |
*** kevko has quit IRC | 00:30 | |
*** brinzhang has joined #openstack-kolla | 00:38 | |
*** Chaserjim has quit IRC | 00:45 | |
*** Chaserjim has joined #openstack-kolla | 00:45 | |
*** benj_- has joined #openstack-kolla | 00:53 | |
*** benj_ has quit IRC | 00:54 | |
*** benj_- is now known as benj_ | 00:54 | |
*** wuchunyang has joined #openstack-kolla | 00:57 | |
*** Chaserjim has quit IRC | 01:00 | |
*** Chaserjim has joined #openstack-kolla | 01:00 | |
*** LinPeiWen has joined #openstack-kolla | 01:09 | |
*** sorin-mihai has quit IRC | 01:18 | |
*** Chaserjim has quit IRC | 01:23 | |
*** Chaserjim has joined #openstack-kolla | 01:23 | |
*** Chaserjim has quit IRC | 01:34 | |
*** Chaserjim has joined #openstack-kolla | 01:34 | |
*** ricolin has quit IRC | 01:35 | |
*** Chaserjim has quit IRC | 01:47 | |
*** Chaserjim has joined #openstack-kolla | 01:47 | |
*** dking has joined #openstack-kolla | 01:55 | |
*** maharg101 has joined #openstack-kolla | 02:21 | |
*** maharg101 has quit IRC | 02:26 | |
*** k_mouza has joined #openstack-kolla | 02:28 | |
*** k_mouza has quit IRC | 02:33 | |
*** Wasaac has quit IRC | 02:33 | |
*** Chaserjim has quit IRC | 02:35 | |
*** Chaserjim has joined #openstack-kolla | 02:36 | |
*** Chaserjim has quit IRC | 02:57 | |
*** Chaserjim has joined #openstack-kolla | 02:57 | |
*** priteau has quit IRC | 03:03 | |
*** Chaserjim has quit IRC | 03:22 | |
*** openstackgerrit has quit IRC | 03:22 | |
*** Chaserjim has joined #openstack-kolla | 03:23 | |
*** zijlboot has quit IRC | 03:27 | |
*** Wasaac has joined #openstack-kolla | 03:53 | |
*** dave-mccowan has quit IRC | 03:54 | |
*** Chaserjim has quit IRC | 04:00 | |
*** Chaserjim has joined #openstack-kolla | 04:00 | |
*** wuchunyang has quit IRC | 04:01 | |
*** bsanjeewa has joined #openstack-kolla | 04:10 | |
*** maharg101 has joined #openstack-kolla | 04:22 | |
*** bsanjeewa has quit IRC | 04:23 | |
*** maharg101 has quit IRC | 04:27 | |
*** Chaserjim has quit IRC | 04:54 | |
*** Chaserjim has joined #openstack-kolla | 04:54 | |
*** Chaserjim has quit IRC | 05:00 | |
*** Chaserjim has joined #openstack-kolla | 05:01 | |
*** skramaja has joined #openstack-kolla | 05:06 | |
*** zzzeek has quit IRC | 05:06 | |
*** zzzeek has joined #openstack-kolla | 05:08 | |
*** Chaserjim has quit IRC | 05:08 | |
*** Chaserjim has joined #openstack-kolla | 05:09 | |
*** skramaja has quit IRC | 05:11 | |
*** dasp has quit IRC | 05:18 | |
*** Chaserjim has quit IRC | 05:26 | |
*** Chaserjim has joined #openstack-kolla | 05:27 | |
*** skramaja has joined #openstack-kolla | 05:29 | |
*** evrardjp has quit IRC | 05:33 | |
*** evrardjp has joined #openstack-kolla | 05:33 | |
*** JamesBenson has quit IRC | 05:33 | |
*** dasp has joined #openstack-kolla | 05:34 | |
*** JamesBenson has joined #openstack-kolla | 05:35 | |
*** JamesBenson has quit IRC | 05:41 | |
*** bsanjeewa has joined #openstack-kolla | 05:43 | |
*** bsanjeewa has quit IRC | 05:52 | |
*** bsanjeewa has joined #openstack-kolla | 05:55 | |
*** Chaserjim has quit IRC | 05:59 | |
*** Chaserjim has joined #openstack-kolla | 05:59 | |
*** bsanjeewa has quit IRC | 06:00 | |
*** bsanjeewa has joined #openstack-kolla | 06:02 | |
*** bsanjeewa has quit IRC | 06:02 | |
*** rpittau|afk has quit IRC | 06:11 | |
*** rpittau|afk has joined #openstack-kolla | 06:12 | |
*** zzzeek has quit IRC | 06:17 | |
*** JamesBenson has joined #openstack-kolla | 06:17 | |
*** zzzeek has joined #openstack-kolla | 06:18 | |
*** bsanjeewa has joined #openstack-kolla | 06:20 | |
*** JamesBenson has quit IRC | 06:22 | |
*** bsanjeewa has quit IRC | 06:25 | |
*** Chaserjim has quit IRC | 06:25 | |
*** Chaserjim has joined #openstack-kolla | 06:26 | |
*** jaicaa has quit IRC | 06:31 | |
*** Chaserjim has quit IRC | 06:33 | |
*** Chaserjim has joined #openstack-kolla | 06:34 | |
*** jaicaa has joined #openstack-kolla | 06:34 | |
*** cah_link has joined #openstack-kolla | 06:45 | |
*** Chaserjim has quit IRC | 06:49 | |
*** evrardjp has quit IRC | 06:49 | |
*** evrardjp_ has joined #openstack-kolla | 06:49 | |
*** Chaserjim has joined #openstack-kolla | 06:49 | |
*** openstackgerrit has joined #openstack-kolla | 06:52 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla stable/victoria: Support CentOS 8.3 https://review.opendev.org/c/openstack/kolla/+/766421 | 06:52 |
---|---|---|
*** bsanjeewa has joined #openstack-kolla | 06:56 | |
*** bsanjeewa_ has joined #openstack-kolla | 06:58 | |
*** bsanjeewa has quit IRC | 07:00 | |
*** bsanjeewa_ has quit IRC | 07:01 | |
*** bsanjeewa_ has joined #openstack-kolla | 07:01 | |
*** sorin-mihai has joined #openstack-kolla | 07:03 | |
*** zijlboot has joined #openstack-kolla | 07:09 | |
*** sorin-mihai has quit IRC | 07:28 | |
*** sorin-mihai_ has joined #openstack-kolla | 07:28 | |
*** sorin-mihai_ has quit IRC | 07:34 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla stable/ussuri: Support CentOS 8.3 https://review.opendev.org/c/openstack/kolla/+/766409 | 07:40 |
*** Chaserjim has quit IRC | 07:42 | |
*** Chaserjim has joined #openstack-kolla | 07:42 | |
*** maharg101 has joined #openstack-kolla | 07:44 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla stable/train: Support CentOS 8.3 https://review.opendev.org/c/openstack/kolla/+/766410 | 07:45 |
*** nikparasyr has joined #openstack-kolla | 07:45 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla stable/train: Support CentOS 8.3 https://review.opendev.org/c/openstack/kolla/+/766410 | 07:47 |
*** jbadiapa has joined #openstack-kolla | 07:48 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla stable/victoria: Support CentOS 8.3 https://review.opendev.org/c/openstack/kolla/+/766421 | 07:53 |
*** Chaserjim has quit IRC | 07:54 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla stable/ussuri: Support CentOS 8.3 https://review.opendev.org/c/openstack/kolla/+/766409 | 07:54 |
*** Chaserjim has joined #openstack-kolla | 07:54 | |
*** rgogunskiy has joined #openstack-kolla | 07:58 | |
*** Chaserjim has quit IRC | 08:00 | |
*** Chaserjim has joined #openstack-kolla | 08:01 | |
*** gfidente has joined #openstack-kolla | 08:04 | |
yoctozepto | mnasiadka: why did not you wait for the merge to happen? | 08:07 |
mnasiadka | yoctozepto: which merge? | 08:08 |
*** bengates has joined #openstack-kolla | 08:08 | |
yoctozepto | mnasiadka: centos 8.3... | 08:09 |
yoctozepto | you proposed unmerged backport | 08:09 |
yoctozepto | (no cherrypick stamp) | 08:09 |
mnasiadka | will update later | 08:10 |
mnasiadka | now I'm trying to follow the whole stack | 08:10 |
mnasiadka | which is some nightmare | 08:10 |
mnasiadka | https://review.opendev.org/c/openstack/kolla-ansible/+/766181 | 08:11 |
mnasiadka | and this won't merge without adding centos 8.3 inside | 08:11 |
mnasiadka | well, not inside, but in kolla :) | 08:11 |
*** andrewbonney has joined #openstack-kolla | 08:11 | |
mnasiadka | but kolla-ansible jobs will fail, so seems we have a cyclic dependency | 08:11 |
yoctozepto | mnasiadka: why not | 08:11 |
yoctozepto | it was passing yesterday | 08:12 |
yoctozepto | just had some minor gate failure | 08:12 |
yoctozepto | well, minor | 08:12 |
yoctozepto | docker limits | 08:12 |
mnasiadka | kolla-ansible-centos8-source is building images | 08:12 |
mnasiadka | and it's failing | 08:12 |
mnasiadka | why the heck is it building images? | 08:13 |
mnasiadka | in gate but not in check? :D | 08:13 |
yoctozepto | mnasiadka: hmm, queue quirks unfortunately | 08:14 |
*** Chaserjim has quit IRC | 08:14 | |
yoctozepto | let's make sure nothing gates in kolla | 08:14 |
yoctozepto | (for the time being) | 08:14 |
yoctozepto | focus on having k-a train merge now | 08:15 |
*** Chaserjim has joined #openstack-kolla | 08:15 | |
yoctozepto | do not recheck any others | 08:15 |
yoctozepto | then make sure k-a ussuri etc. merge | 08:15 |
mnasiadka | it will get +1 from Zuul in a minute and go to gate | 08:15 |
yoctozepto | then move onto kolla | 08:15 |
mnasiadka | let's see what happens then | 08:15 |
yoctozepto | ++ | 08:15 |
*** rpittau|afk is now known as rpittau | 08:17 | |
*** Chaserjim has quit IRC | 08:18 | |
*** Chaserjim has joined #openstack-kolla | 08:18 | |
*** JamesBenson has joined #openstack-kolla | 08:18 | |
mnasiadka | yoctozepto: seems getting those changes merged will take some time, due to deps | 08:20 |
*** vrdel has quit IRC | 08:20 | |
*** vrdel has joined #openstack-kolla | 08:21 | |
*** JamesBenson has quit IRC | 08:23 | |
*** e0ne has joined #openstack-kolla | 08:23 | |
yoctozepto | mnasiadka: yup | 08:24 |
yoctozepto | mnasiadka: I also did not want to backport c8.3 before backporting the CI slim down | 08:24 |
yoctozepto | and waited with all this for the k-a stack to merge | 08:24 |
mnasiadka | yoctozepto: I did w-1, once we're ready - I'll update the changes. | 08:24 |
yoctozepto | hence why I was a bit disappointed with your action :-) | 08:25 |
yoctozepto | ok, just try to be lightweight on the CI | 08:25 |
yoctozepto | do you remember when was the last time we had only a single CI issue? :D | 08:25 |
*** bsanjeewa__ has joined #openstack-kolla | 08:25 | |
yoctozepto | because nowadays I think 2+ is a norm | 08:25 |
*** bsanjeewa_ has quit IRC | 08:25 | |
mnasiadka | well, the docker version check is our bug, but centos 8.3 was imposed on us ;) | 08:26 |
mnasiadka | so I think it's a tie | 08:26 |
*** sorin-mihai has joined #openstack-kolla | 08:26 | |
yoctozepto | yeah, but how come it is pretty much the same day :-) | 08:28 |
yoctozepto | plus that virtualenv update with new pip that broke l-c | 08:29 |
mnasiadka | well, life can't be easy | 08:29 |
yoctozepto | also our "bug" | 08:29 |
yoctozepto | indeed | 08:29 |
*** kevko has joined #openstack-kolla | 08:30 | |
mnasiadka | after analysing the mail threads on centos-devel yesterday, I'm getting to the point nobody wants to run unstable centos stream in production :) | 08:31 |
yoctozepto | I have just gate-guarded the train patch | 08:32 |
yoctozepto | I will release the w-1 once the gate is clear | 08:32 |
yoctozepto | mnasiadka: it looks like it | 08:32 |
yoctozepto | mnasiadka: I don't mind for our use case | 08:32 |
yoctozepto | but I understand folks can be pissed off ;-) | 08:32 |
mnasiadka | well, without a local mirror with frozen content - it will be hard to run a consistent env | 08:33 |
*** Chaserjim has quit IRC | 08:33 | |
*** Chaserjim has joined #openstack-kolla | 08:33 | |
openstackgerrit | wanghongxu proposed openstack/kolla master: keepalived: Remove checkers.pid file for keepalived https://review.opendev.org/c/openstack/kolla/+/766413 | 08:35 |
yoctozepto | mnasiadka: I have been freezing it this way even with the point releases; they do change too so this point is moot | 08:35 |
yoctozepto | the shorter cadence | 08:35 |
yoctozepto | and vendors relying on point releases | 08:36 |
yoctozepto | these are valid | 08:36 |
*** bsanjeewa__ has quit IRC | 08:36 | |
mnasiadka | yoctozepto: I don't think CentOS updates a lot in the point releases, unless you use -CR | 08:36 |
*** zzzeek has quit IRC | 08:36 | |
*** Chaserjim has quit IRC | 08:37 | |
*** Chaserjim has joined #openstack-kolla | 08:38 | |
*** zzzeek has joined #openstack-kolla | 08:39 | |
openstackgerrit | Merged openstack/kolla stable/stein: [CI] Stop testing lower-constraints and fix py27 job https://review.opendev.org/c/openstack/kolla/+/766243 | 08:42 |
yoctozepto | mnasiadka: a lot not but for real reproducibility you need to freeze anyway | 08:42 |
mgoddard | yoctozepto, mnasiadka: morning | 08:42 |
yoctozepto | but I get the point about this much more dynamic now | 08:42 |
yoctozepto | mgoddard: morning! | 08:43 |
mgoddard | the fun continues | 08:43 |
yoctozepto | indeed | 08:43 |
mgoddard | so is kolla in the gate because it has a depends-on to the k-a patch? Has the W+1 been removed from the kolla patch? | 08:43 |
*** bsanjeewa has joined #openstack-kolla | 08:44 | |
*** dougsz has joined #openstack-kolla | 08:45 | |
yoctozepto | mgoddard: the patch has merged | 08:45 |
yoctozepto | it is all right now | 08:45 |
yoctozepto | we have a common gate | 08:45 |
mgoddard | ok | 08:45 |
mgoddard | we do | 08:45 |
yoctozepto | which triggers the build logic | 08:45 |
yoctozepto | and mnasiadka pointed out the order can cause failures now | 08:45 |
yoctozepto | so we have to be slightly careful | 08:46 |
yoctozepto | checks are safe as they are "queue-less" | 08:46 |
yoctozepto | well, the proper term is "independent pipeline" | 08:46 |
yoctozepto | but you get the point | 08:46 |
yoctozepto | I have updated the summary on the whiteboard | 08:47 |
mgoddard | thanks | 08:47 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: CI: stop checking on aarch64 https://review.opendev.org/c/openstack/kolla/+/766264 | 08:48 |
yoctozepto | what are we doing about ^ ? | 08:49 |
yoctozepto | I guess hrw's word is final here :P | 08:49 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: update packages to python3 for ovs-dpdk contrib template https://review.opendev.org/c/openstack/kolla/+/764614 | 08:49 |
yoctozepto | mgoddard: ^^^^ | 08:56 |
mnasiadka | yoctozepto: does that mean we are not going to publish aarch64 images anymore on Docker Hub? That might mean we should remove the old images to avoid confusion... | 08:56 |
yoctozepto | mnasiadka: yeah, I believe we should also drop some comm about this on the ml | 08:56 |
mnasiadka | yup | 08:57 |
mgoddard | this is just for Train, right? | 08:57 |
mgoddard | it's fine by me | 08:58 |
mgoddard | ML update sounds sensible | 08:58 |
mnasiadka | well, Train is not EM yet, so we should at least make an announcement | 08:58 |
mgoddard | we have said many times we will remove images from dockerhub, but we never build that tool :) | 08:58 |
mnasiadka | Yeah, we need to - because there's like years of history in there, it would be good to clean that up | 08:59 |
mgoddard | agreed | 08:59 |
mnasiadka | we could just run a playbook that removes images by tags that we don't support anymore, that shouldn't be too complicated | 08:59 |
mgoddard | it's not impossible, someone just needs to do it :) | 09:00 |
mgoddard | probably better would be to remove anything over X days old | 09:00 |
mgoddard | that catches a bunch of stuff | 09:01 |
yoctozepto | over 6 months old sounds plausible | 09:03 |
*** muhaha has joined #openstack-kolla | 09:03 | |
mgoddard | +1 | 09:04 |
mgoddard | wouldn't cover the aarch64 case though, for 6 months | 09:04 |
yoctozepto | yeah, but every other cruft :-) | 09:04 |
mnasiadka | opendev.org certificate expired? geez | 09:05 |
mnasiadka | ah, only on some gitea instances | 09:05 |
yoctozepto | there is some quirk regarding gerrit/zuul picking up changes to gate | 09:07 |
yoctozepto | if you ever see nothing happens | 09:07 |
yoctozepto | do the w-1 w+1 dance I am doing | 09:07 |
yoctozepto | (and repeat as necessary) | 09:07 |
yoctozepto | ok, k-a docker 20.10 train-ussuri-victoria gating | 09:07 |
yoctozepto | fingers crossed | 09:08 |
*** Chaserjim has quit IRC | 09:09 | |
*** Chaserjim has joined #openstack-kolla | 09:10 | |
yoctozepto | INFO:kolla.common.utils.base:[91mError: Unable to find a match: centos-release-openstack-victoria | 09:13 |
yoctozepto | lovely | 09:13 |
yoctozepto | mnasiadka: ^ c8.3 in its ducking glory | 09:13 |
yoctozepto | INFO:kolla.common.utils.kuryr-libnetwork:[91mERROR: Could not find a version that satisfies the requirement jsonschema<3.0.0,>=2.6.0 (from kuryr-libnetwork) | 09:14 |
yoctozepto | ^ this one is new pip | 09:14 |
yoctozepto | duck my life | 09:14 |
yoctozepto | 😂 | 09:15 |
yoctozepto | that last one was train | 09:16 |
yoctozepto | ussuri looks green though | 09:16 |
hrw | ops. I removed publish. dropped patch | 09:16 |
*** k_mouza has joined #openstack-kolla | 09:17 | |
openstackgerrit | Mark Goddard proposed openstack/kayobe master: DNM: Test Swift https://review.opendev.org/c/openstack/kayobe/+/764617 | 09:17 |
yoctozepto | hrw: xD | 09:18 |
*** Chaserjim has quit IRC | 09:25 | |
*** Chaserjim has joined #openstack-kolla | 09:25 | |
*** Chaserjim has quit IRC | 09:31 | |
*** Chaserjim has joined #openstack-kolla | 09:32 | |
*** zzzeek has quit IRC | 09:32 | |
*** zzzeek has joined #openstack-kolla | 09:33 | |
*** wuchunyang has joined #openstack-kolla | 09:34 | |
*** devfaz has quit IRC | 09:34 | |
*** dswebb has joined #openstack-kolla | 09:37 | |
*** Chaserjim has quit IRC | 09:37 | |
*** Chaserjim has joined #openstack-kolla | 09:38 | |
hrw | yoctozepto: so now we are waiting for docker2010 going through gates of hell, then centos 8.3, l-c and then can finally start looking at patches | 09:39 |
hrw | ? | 09:39 |
*** Chaserjim has quit IRC | 09:41 | |
*** dswebb has quit IRC | 09:41 | |
*** Chaserjim has joined #openstack-kolla | 09:41 | |
yoctozepto | hrw: pretty much, yes; see https://etherpad.opendev.org/p/KollaWhiteBoard | 09:43 |
yoctozepto | where I am tracking this duckery | 09:43 |
hrw | yoctozepto: marked l-c there as merged | 09:50 |
mnasiadka | yoctozepto: I think mariadb failed in the gates of hell on mixed job - https://review.opendev.org/c/openstack/kolla-ansible/+/766181/ | 09:59 |
*** Chaserjim has quit IRC | 10:01 | |
*** Chaserjim has joined #openstack-kolla | 10:02 | |
yoctozepto | mnasiadka: yup | 10:02 |
yoctozepto | so it's all lost | 10:03 |
*** numans has quit IRC | 10:04 | |
*** Chaserjim has quit IRC | 10:04 | |
*** Chaserjim has joined #openstack-kolla | 10:05 | |
yoctozepto | recheck only that one now | 10:05 |
*** Chaserjim has quit IRC | 10:09 | |
*** Chaserjim has joined #openstack-kolla | 10:09 | |
openstackgerrit | wanghongxu proposed openstack/kolla master: keepalived: Remove pid files for keepalived https://review.opendev.org/c/openstack/kolla/+/766413 | 10:12 |
*** zzzeek has quit IRC | 10:13 | |
*** wuchunyang has quit IRC | 10:13 | |
*** zzzeek has joined #openstack-kolla | 10:14 | |
openstackgerrit | wanghongxu proposed openstack/kolla master: keepalived: Remove pid files for keepalived https://review.opendev.org/c/openstack/kolla/+/766413 | 10:16 |
*** JamesBenson has joined #openstack-kolla | 10:19 | |
yoctozepto | recheck issued | 10:23 |
yoctozepto | please do not do any other rechecks or w+1s | 10:23 |
*** JamesBenson has quit IRC | 10:23 | |
yoctozepto | if it fails twice more (meaning we don't get it merged by the end of the working day), I'll propose to slim down the CIs already | 10:32 |
yoctozepto | that's the plan | 10:32 |
yoctozepto | and now onto other things | 10:32 |
*** zzzeek has quit IRC | 10:39 | |
*** zzzeek has joined #openstack-kolla | 10:41 | |
*** rgogunskiy has quit IRC | 10:45 | |
*** k_mouza has quit IRC | 10:46 | |
*** rgogunskiy has joined #openstack-kolla | 10:47 | |
*** k_mouza has joined #openstack-kolla | 10:48 | |
*** Chaserjim has quit IRC | 10:55 | |
*** Chaserjim has joined #openstack-kolla | 10:55 | |
*** adrian-a has joined #openstack-kolla | 11:08 | |
*** Chaserjim has quit IRC | 11:14 | |
*** Chaserjim has joined #openstack-kolla | 11:15 | |
*** Chaserjim has quit IRC | 11:16 | |
*** Chaserjim has joined #openstack-kolla | 11:16 | |
*** Chaserjim has quit IRC | 11:29 | |
*** Chaserjim has joined #openstack-kolla | 11:30 | |
*** wuchunyang has joined #openstack-kolla | 11:31 | |
*** wuchunyang has quit IRC | 11:35 | |
*** Chaserjim has quit IRC | 11:37 | |
*** Chaserjim has joined #openstack-kolla | 11:38 | |
*** JamesBenson has joined #openstack-kolla | 12:00 | |
*** skramaja has quit IRC | 12:05 | |
*** JamesBenson has quit IRC | 12:06 | |
*** JamesBenson has joined #openstack-kolla | 12:06 | |
*** Chaserjim has quit IRC | 12:10 | |
*** Chaserjim has joined #openstack-kolla | 12:10 | |
*** zzzeek has quit IRC | 12:14 | |
bsanjeewa | Could someone please give me a guide to configure external ceph with kayobe? | 12:14 |
bsanjeewa | ussuri | 12:15 |
*** zzzeek has joined #openstack-kolla | 12:17 | |
mgoddard | bsanjeewa: https://docs.openstack.org/kolla-ansible/ussuri/reference/storage/external-ceph-guide.html | 12:17 |
mgoddard | bsanjeewa: some paths need to be modified for kayobe | 12:17 |
mgoddard | i.e. /etc/kolla -> <kayobe-config>/etc/kayobe/kolla/ | 12:18 |
*** Chaserjim has quit IRC | 12:18 | |
bsanjeewa | mgoddard: Thanks | 12:18 |
*** Chaserjim has joined #openstack-kolla | 12:19 | |
*** Chaserjim has quit IRC | 12:20 | |
*** Chaserjim has joined #openstack-kolla | 12:21 | |
*** Chaserjim has quit IRC | 12:22 | |
*** Chaserjim has joined #openstack-kolla | 12:22 | |
*** vrdel has quit IRC | 12:24 | |
*** lxkong has quit IRC | 12:26 | |
*** vrdel has joined #openstack-kolla | 12:27 | |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Fix mariadb_recovery when mariadb container is missing https://review.opendev.org/c/openstack/kolla-ansible/+/766458 | 12:28 |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: DNM: Testing for bug 1907658 https://review.opendev.org/c/openstack/kolla-ansible/+/766459 | 12:30 |
openstack | bug 1907658 in kolla-ansible wallaby "Mariadb recovery fails if mariadb container does not exist" [Medium,Triaged] https://launchpad.net/bugs/1907658 | 12:30 |
yoctozepto | mgoddard: I would hold with proposing new changes too to avoid hitting dockerhub limits | 12:34 |
yoctozepto | <gerrit nazi> | 12:35 |
mnasiadka | did we finally change to publish weekly? | 12:35 |
*** bsanjeewa has quit IRC | 12:36 | |
yoctozepto | we did not but it will not help in here anyhow | 12:36 |
yoctozepto | without using a caching mirror | 12:36 |
mnasiadka | ok, so that part is missing | 12:37 |
yoctozepto | mhm | 12:38 |
mnasiadka | anyway, let's merge all of that crap that is underway | 12:38 |
yoctozepto | I | 12:38 |
yoctozepto | amd | 12:38 |
yoctozepto | sorry, keyboard | 12:38 |
yoctozepto | I am working on it | 12:38 |
*** Chaserjim has quit IRC | 12:39 | |
*** Chaserjim has joined #openstack-kolla | 12:39 | |
*** zzzeek has quit IRC | 12:40 | |
mgoddard | we do use a caching mirror | 12:40 |
mgoddard | see tests/templates/globals-default.j2 | 12:41 |
*** zzzeek has joined #openstack-kolla | 12:41 | |
yoctozepto | mgoddard: but it seems to still hit limits; if it really "cached", it would not | 12:42 |
yoctozepto | I believe it is because it still calls dockerhub each time | 12:42 |
mgoddard | yoctozepto: images are updated every day | 12:42 |
yoctozepto | and then it's irrelevant whether these are weekly images or not | 12:42 |
yoctozepto | mgoddard: so? we should still be under limit if caching happened | 12:43 |
mgoddard | 3 distros, 2 types, many many images | 12:43 |
mgoddard | easily over the limit | 12:43 |
yoctozepto | hmm, I think I've done the math so that it would be unlikely to hit it | 12:44 |
mgoddard | if caching did not happen we would get only a few jobs passing per hour | 12:44 |
yoctozepto | not really because we have different ip addresses | 12:44 |
yoctozepto | so it's not that 1:1 | 12:44 |
mgoddard | the mirror's network's gateway will be the IP | 12:45 |
yoctozepto | but it still does not look current caching is enough; I suspect it just still hits dockerhub at least from time to time and it triggers limits | 12:45 |
yoctozepto | but maybe the math was wrong | 12:46 |
mgoddard | I think so | 12:46 |
mgoddard | if we have ~30 containers per job | 12:46 |
mgoddard | 3 distros is almost 100 pulls already | 12:47 |
yoctozepto | exactly - almost | 12:47 |
yoctozepto | it is below 100 | 12:47 |
mgoddard | what about branches | 12:47 |
mgoddard | binary/source | 12:47 |
yoctozepto | hahahaha, I forgot about branches obviously; it is the same namespace in dockerhub | 12:47 |
yoctozepto | poor me | 12:47 |
mgoddard | if we ran more jobs we'd be failing everywhere | 12:47 |
yoctozepto | <facepalm> | 12:47 |
mgoddard | plus scenarios | 12:48 |
*** rgogunskiy has quit IRC | 12:48 | |
yoctozepto | scenarios overlap | 12:48 |
mgoddard | to an extent | 12:48 |
mgoddard | we have hundreds of images. I don't know how many we test, but quite a few | 12:48 |
yoctozepto | yes, this makes sense | 12:48 |
yoctozepto | so caching is happening | 12:48 |
mgoddard | yes | 12:48 |
mgoddard | we just get lucky sometimes | 12:49 |
yoctozepto | I hope we get lucky this time | 12:49 |
mgoddard | weekly publish would help a lot | 12:49 |
mgoddard | and jobs would get more reliable throughout the week :D | 12:49 |
yoctozepto | except for weekend jobs | 12:49 |
yoctozepto | but then again there are not many of them | 12:49 |
yoctozepto | indeed | 12:49 |
yoctozepto | so, maybe just switch for now? | 12:49 |
yoctozepto | (and cry later) | 12:50 |
mgoddard | to weekly? yes | 12:50 |
yoctozepto | ack | 12:50 |
mgoddard | especially for older branches | 12:50 |
yoctozepto | we should have stopped stein | 12:51 |
yoctozepto | and we did not | 12:51 |
yoctozepto | I am stopping it | 12:51 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/stein: [CI] EM - Stop periodics https://review.opendev.org/c/openstack/kolla/+/766461 | 12:53 |
yoctozepto | mgoddard, mnasiadka, hrw: ^ | 12:53 |
*** ricolin has joined #openstack-kolla | 12:56 | |
*** adrian-a has quit IRC | 12:57 | |
*** dave-mccowan has joined #openstack-kolla | 12:57 | |
hrw | +2 | 12:58 |
*** wuchunyang has joined #openstack-kolla | 12:59 | |
*** adrian-a has joined #openstack-kolla | 13:00 | |
*** adrian-a has quit IRC | 13:01 | |
*** adrian-a has joined #openstack-kolla | 13:01 | |
hrw | slowly cleans | 13:03 |
*** wuchunyang has quit IRC | 13:03 | |
*** priteau has joined #openstack-kolla | 13:10 | |
*** vrdel has quit IRC | 13:22 | |
*** vrdel has joined #openstack-kolla | 13:24 | |
*** k_mouza_ has joined #openstack-kolla | 13:33 | |
*** k_mouza has quit IRC | 13:33 | |
*** hjensas has quit IRC | 13:35 | |
*** muhaha has quit IRC | 13:38 | |
*** hjensas has joined #openstack-kolla | 13:56 | |
*** wuchunyang has joined #openstack-kolla | 14:04 | |
*** adrian-a has quit IRC | 14:17 | |
*** TrevorV has joined #openstack-kolla | 14:19 | |
*** wuchunyang has quit IRC | 14:20 | |
*** adrian-a has joined #openstack-kolla | 14:21 | |
*** bsanjeewa has joined #openstack-kolla | 14:21 | |
openstackgerrit | Merged openstack/kolla-ansible stable/train: Fix prechecks with Docker 20.10.0 and py27 job https://review.opendev.org/c/openstack/kolla-ansible/+/766181 | 14:27 |
mnasiadka | yay | 14:28 |
mnasiadka | yoctozepto: ^^ | 14:28 |
mnasiadka | did a recheck on next one in the row | 14:29 |
*** wuchunyang has joined #openstack-kolla | 14:30 | |
yoctozepto | mnasiadka: great, thanks | 14:31 |
mnasiadka | so train done, ussuri -> victoria -> master | 14:31 |
mnasiadka | and then we can deal with the kolla side | 14:31 |
yoctozepto | ++ | 14:33 |
*** wuchunyang has quit IRC | 14:36 | |
*** k_mouza_ has quit IRC | 14:38 | |
*** k_mouza has joined #openstack-kolla | 14:39 | |
*** cah_link has quit IRC | 14:44 | |
hrw | and on tuesday we can restart development ;D | 14:48 |
mnasiadka | maybe wed | 14:49 |
mnasiadka | :) | 14:49 |
hrw | https://review.opendev.org/c/openstack/kolla/+/765807 anyone? tier 2 stuff | 14:51 |
hrw | zuul gave -1 only on l-c (now removed) | 14:51 |
hrw | has added 'test' image which fails but as it is tier 2 image whole run is success | 14:52 |
*** cah_link has joined #openstack-kolla | 14:52 | |
*** k_mouza has quit IRC | 14:52 | |
*** k_mouza has joined #openstack-kolla | 14:56 | |
adrian-a | what's the logic on which a commit gets on master, why after stable releases? is that defined somewhere? | 15:00 |
*** wuchunyang has joined #openstack-kolla | 15:00 | |
adrian-a | and "Fix prechecks with Docker 20.10.0" is taking days to reach Victoria because automatic tests take too much and are unreliable? | 15:02 |
*** wuchunyang has quit IRC | 15:04 | |
*** e0ne has quit IRC | 15:07 | |
*** e0ne has joined #openstack-kolla | 15:08 | |
yoctozepto | adrian-a: yes, that's it; we have been hit by a bunch of independent issues | 15:16 |
yoctozepto | plus any random instabilities | 15:16 |
yoctozepto | we have upgrade jobs which forced us to reverse the merge strategy for this particular fix | 15:16 |
adrian-a | ok | 15:20 |
*** devfaz has joined #openstack-kolla | 15:23 | |
*** k_mouza has quit IRC | 15:24 | |
hrw | adrian-a: but note that patches were backported from master to stable ones | 15:24 |
hrw | yoctozepto: do you plan to backport ci slim once we get back to green? | 15:25 |
yoctozepto | hrw: yes (it's on the whiteboard) | 15:26 |
hrw | updated it a bit | 15:28 |
hrw | so tomorrow we should have docker 2010 - each branch is up to 6 (3+3) h on zuul which means today we get ussuri in. victoria during night, master in the morning | 15:30 |
*** wuchunyang has joined #openstack-kolla | 15:34 | |
*** wuchunyang has quit IRC | 15:39 | |
adrian-a | ok, nice | 15:41 |
adrian-a | I'm wating for the CCLA to be processed (I have submitted the signed PDF and I assume it will show in Gerrit). I have a small docs fix. | 15:42 |
adrian-a | this https://prnt.sc/vzvrfr and a sudo mkdir /etc/ansible after pip install 'ansible<2.10' | 15:44 |
adrian-a | This virtualenv install piece was removed a while ago https://review.opendev.org/c/openstack/kolla-ansible/+/735894/7/doc/source/user/quickstart.rst#40 but python3 -m venv env does no work without the python3-virtualenv package | 15:45 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: elasticsearch-curator: drop botocore workaround https://review.opendev.org/c/openstack/kolla/+/766500 | 15:48 |
*** k_mouza has joined #openstack-kolla | 15:49 | |
*** nikparasyr has left #openstack-kolla | 15:53 | |
*** adrian-a has quit IRC | 15:57 | |
*** frickler has joined #openstack-kolla | 16:00 | |
yoctozepto | hrw: if it goes smoothly ;-) | 16:01 |
yoctozepto | thanks for the update | 16:01 |
hrw | if ;D | 16:02 |
frickler | noob question: does anyone have a comprehensive comparison of kolla with e.g. osa or others, helping to decide which one to use? | 16:03 |
*** Chaserjim has quit IRC | 16:04 | |
yoctozepto | frickler: I know mgoddard has some old comparison | 16:04 |
yoctozepto | it is probably inaccurate now | 16:05 |
yoctozepto | we are happy to help construct it, along with the osa team | 16:05 |
*** muhaha has joined #openstack-kolla | 16:14 | |
*** kevko has quit IRC | 16:15 | |
openstackgerrit | Pierre Riteau proposed openstack/kolla-ansible master: Fix failure during Monasca Grafana upgrade https://review.opendev.org/c/openstack/kolla-ansible/+/766503 | 16:17 |
*** dougsz has quit IRC | 16:17 | |
openstackgerrit | Pierre Riteau proposed openstack/kolla-ansible master: Fix failure during Monasca Grafana upgrade https://review.opendev.org/c/openstack/kolla-ansible/+/766503 | 16:18 |
*** e0ne has quit IRC | 16:28 | |
*** dougsz has joined #openstack-kolla | 16:31 | |
*** cah_link has quit IRC | 16:32 | |
*** k_mouza has quit IRC | 16:33 | |
*** bsanjeewa has quit IRC | 16:34 | |
*** k_mouza has joined #openstack-kolla | 16:35 | |
*** bengates has quit IRC | 16:55 | |
*** Trevor_V has joined #openstack-kolla | 17:05 | |
*** TrevorV has quit IRC | 17:06 | |
*** adrian-a has joined #openstack-kolla | 17:19 | |
*** dougsz has quit IRC | 17:31 | |
*** Chaserjim has joined #openstack-kolla | 17:31 | |
*** dave-mccowan has quit IRC | 17:33 | |
*** dave-mccowan has joined #openstack-kolla | 17:34 | |
*** dave-mccowan has quit IRC | 17:39 | |
JamesBenson | yoctozepto: The patch for the docker update, is that getting ported to the ussuri branch? | 17:42 |
hrw | JamesBenson: it goes to all branches | 17:43 |
yoctozepto | JamesBenson: yes, it already is | 17:43 |
yoctozepto | JamesBenson: we are suffering multiple issues concurrently | 17:43 |
yoctozepto | like | 17:43 |
hrw | ussuri one is now at gates | 17:43 |
yoctozepto | gerrit is down at the very moment | 17:43 |
JamesBenson | ah okay, I'm still getting failures from the docker in pre-checks that why I was wondering. | 17:44 |
yoctozepto | I would tell you to apply a fix from a link but it is not going to load | 17:45 |
yoctozepto | https://review.opendev.org/c/openstack/kolla-ansible/+/766182 | 17:45 |
JamesBenson | okay | 17:45 |
yoctozepto | we are drowning in a general misery | 17:45 |
hrw | grab fix from stable/train ;D | 17:52 |
yoctozepto | ^ yeas, opendev.org itself should work for that | 17:54 |
yoctozepto | https://opendev.org/openstack/kolla-ansible/commit/c34bf4529d4c4bbe57944e871e408a4b26486ed7 | 17:54 |
yoctozepto | JamesBenson: ^ | 17:54 |
yoctozepto | you only need that one regexp fixed | 17:55 |
JamesBenson | ah, okay. Cool, thanks :-) | 17:55 |
*** jbadiapa has quit IRC | 17:57 | |
hrw | and we wait for zuul... | 17:57 |
yoctozepto | hrw: we will lose the results most likely | 17:58 |
yoctozepto | as gerrit will not get them | 17:58 |
yoctozepto | being down... | 17:58 |
hrw | its up again | 18:04 |
*** rpittau is now known as rpittau|afk | 18:04 | |
yoctozepto | yeas | 18:08 |
hrw | it is gating ;d | 18:10 |
yoctozepto | <3 | 18:21 |
*** k_mouza has quit IRC | 18:48 | |
*** bsanjeewa has joined #openstack-kolla | 18:51 | |
*** gfidente is now known as gfidente|afk | 18:53 | |
openstackgerrit | Merged openstack/kolla-ansible stable/ussuri: Fix prechecks with Docker 20.10.0 https://review.opendev.org/c/openstack/kolla-ansible/+/766182 | 19:03 |
hrw | time for victioria recheck? | 19:05 |
hrw | done | 19:06 |
*** cah_link has joined #openstack-kolla | 19:07 | |
yoctozepto | ack, updated the wb | 19:13 |
*** adrian-a has quit IRC | 19:20 | |
*** adrian-a has joined #openstack-kolla | 19:24 | |
openstackgerrit | Merged openstack/kolla stable/stein: [CI] EM - Stop periodics https://review.opendev.org/c/openstack/kolla/+/766461 | 19:27 |
*** maharg101 has quit IRC | 19:33 | |
*** dciabrin_ has joined #openstack-kolla | 19:40 | |
*** dciabrin has quit IRC | 19:43 | |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/stein: [CI] EM - Stop periodics https://review.opendev.org/c/openstack/kolla-ansible/+/766539 | 19:48 |
*** cah_link has quit IRC | 19:51 | |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/stein: [CI] EM - Stop periodics https://review.opendev.org/c/openstack/kolla-ansible/+/766539 | 19:53 |
*** muhaha has quit IRC | 19:53 | |
yoctozepto | mgoddard, mnasiadka, hrw: just noticed this is very important in lessening the morning CI stress on dockerhub -> https://review.opendev.org/c/openstack/kolla-ansible/+/766539 | 19:53 |
yoctozepto | (and CI itself of course) | 19:54 |
yoctozepto | I will approve it myself if I can't see you come to it | 19:54 |
*** muhaha has joined #openstack-kolla | 19:58 | |
hrw | +2 | 19:58 |
*** andrewbonney has quit IRC | 20:05 | |
*** cah_link has joined #openstack-kolla | 20:05 | |
yoctozepto | hrw thx | 20:06 |
adrian-a | I'm curious, are there some IF-s in testing code to not test everything on every commit? E.g. on docs change, there's no point to run any code tests. | 20:10 |
yoctozepto | adrian-a: there are | 20:11 |
yoctozepto | just we are not changing docs here :-) | 20:11 |
adrian-a | :D | 20:11 |
yoctozepto | our CI is quite comprehensive nowadays | 20:12 |
yoctozepto | and not so fast | 20:12 |
mgoddard | yoctozepto: we should just kill those periodics | 20:12 |
yoctozepto | so it takes time | 20:12 |
adrian-a | yeah, the logic applies for multiple "code partitioning" | 20:12 |
yoctozepto | mgoddard: kill all? | 20:12 |
mgoddard | yoctozepto: yes | 20:12 |
mgoddard | they eat our precious pulls, and we rarely check them | 20:12 |
mgoddard | not to mention infra resources | 20:13 |
yoctozepto | mgoddard: speak for yourself, I do check them | 20:14 |
mgoddard | keep them if you like | 20:14 |
yoctozepto | but I agree we went a bit overboard with them | 20:14 |
yoctozepto | as a side note, tripleo has more ;p | 20:14 |
yoctozepto | I think drastically reducing the amount of them makes sense | 20:15 |
mgoddard | no doubt | 20:15 |
yoctozepto | well, otoh we still do lots of backports usually | 20:15 |
mgoddard | until we resolve the pull issue, those pulls are better spent on real reviews | 20:15 |
yoctozepto | so we still get to see most of these results | 20:15 |
yoctozepto | mgoddard: and that! | 20:16 |
yoctozepto | ok, I am removing them all | 20:16 |
yoctozepto | I will only leave publishes for now | 20:16 |
mgoddard | how many dockerhub user accounts would we need to guarantee pulls succeed? | 20:16 |
yoctozepto | xD | 20:16 |
yoctozepto | well, account gives us 200 pulls | 20:17 |
yoctozepto | one per branch should be fine | 20:17 |
mgoddard | username=<job>-<branch>-<cloud> | 20:17 |
mgoddard | that should do it | 20:17 |
yoctozepto | I think one per branch is enough; my calculations forgot branches | 20:18 |
yoctozepto | but now with 200 per branch | 20:18 |
yoctozepto | it should be plenty | 20:18 |
yoctozepto | well, except for these clouds | 20:18 |
yoctozepto | how many cloud endpoints do we have? ;D | 20:18 |
yoctozepto | let's leave that as a future idea; an exercise for a reader | 20:18 |
mgoddard | yeah. hoping that periodic-weekly helps | 20:19 |
yoctozepto | as well | 20:19 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: [CI] Drop periodics https://review.opendev.org/c/openstack/kolla-ansible/+/766543 | 20:22 |
yoctozepto | mgoddard: ^ | 20:22 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/victoria: [CI] Drop periodics https://review.opendev.org/c/openstack/kolla-ansible/+/766428 | 20:23 |
yoctozepto | does not make sense to wait for merge, this is not user-facing | 20:24 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/ussuri: [CI] Drop periodics https://review.opendev.org/c/openstack/kolla-ansible/+/766429 | 20:24 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: [CI] Drop periodics https://review.opendev.org/c/openstack/kolla-ansible/+/766430 | 20:25 |
openstackgerrit | Merged openstack/kolla-ansible stable/stein: [CI] EM - Stop periodics https://review.opendev.org/c/openstack/kolla-ansible/+/766539 | 20:26 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: [CI] Drop periodics and multinode gating https://review.opendev.org/c/openstack/kolla-ansible/+/766430 | 20:29 |
yoctozepto | mgoddard: Train with a twist ^ | 20:29 |
yoctozepto | this should never have made it into gate | 20:30 |
yoctozepto | we already have two centoses in train | 20:30 |
yoctozepto | a multinode job in gate is asking for trouble | 20:30 |
yoctozepto | all right; this all looks much brighter now | 20:30 |
openstackgerrit | Mark Goddard proposed openstack/kayobe master: Fixes for CentOS 8.3 https://review.opendev.org/c/openstack/kayobe/+/766203 | 20:31 |
yoctozepto | mgoddard: workaholism too? | 20:31 |
mgoddard | yoctozepto: went for a haircut earlier. Try not to work late normally | 20:32 |
mgoddard | and out \o | 20:34 |
yoctozepto | bye | 20:35 |
*** cah_link has quit IRC | 21:01 | |
*** lxkong has joined #openstack-kolla | 21:02 | |
openstackgerrit | Merged openstack/kolla-ansible master: [CI] Drop periodics https://review.opendev.org/c/openstack/kolla-ansible/+/766543 | 21:02 |
openstackgerrit | Merged openstack/kolla-ansible stable/ussuri: [CI] Drop periodics https://review.opendev.org/c/openstack/kolla-ansible/+/766429 | 21:04 |
openstackgerrit | Merged openstack/kolla-ansible stable/victoria: [CI] Drop periodics https://review.opendev.org/c/openstack/kolla-ansible/+/766428 | 21:09 |
openstackgerrit | Adrian Andreias proposed openstack/kolla-ansible master: [docs] Add python3-venv package to quickstart.rst https://review.opendev.org/c/openstack/kolla-ansible/+/766558 | 21:15 |
*** Trevor_V has quit IRC | 21:16 | |
*** muhaha has quit IRC | 21:30 | |
openstackgerrit | Merged openstack/kolla-ansible stable/train: [CI] Drop periodics and multinode gating https://review.opendev.org/c/openstack/kolla-ansible/+/766430 | 22:03 |
*** vrdel has quit IRC | 22:11 | |
*** vrdel has joined #openstack-kolla | 22:13 | |
*** gfidente|afk has quit IRC | 22:33 | |
*** adrian-a has quit IRC | 22:38 | |
*** vrdel has quit IRC | 22:45 | |
*** sorin-mihai has quit IRC | 22:57 | |
*** bsanjeewa has quit IRC | 23:09 | |
openstackgerrit | Merged openstack/kolla-ansible stable/victoria: Fix prechecks with Docker 20.10.0 https://review.opendev.org/c/openstack/kolla-ansible/+/766183 | 23:19 |
*** maharg101 has joined #openstack-kolla | 23:30 | |
*** maharg101 has quit IRC | 23:35 | |
*** adeberg has quit IRC | 23:53 | |
*** adeberg has joined #openstack-kolla | 23:53 | |
*** sorin-mihai has joined #openstack-kolla | 23:57 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!