Wednesday, 2020-12-09

*** imtiazc has joined #openstack-kolla00:27
*** luksky has quit IRC00:29
*** Martouf has quit IRC00:51
*** Reepicheep has quit IRC00:52
*** Reepicheep has joined #openstack-kolla00:53
*** ftarasenko has quit IRC00:53
*** benj_ has quit IRC00:54
*** benj_ has joined #openstack-kolla00:54
-openstackstatus- NOTICE: The Gerrit service on review.opendev.org is being restarted quickly to make heap memory and jgit config adjustments, downtime should be less than 5 minutes01:09
openstackgerritlikui proposed openstack/kolla master: update packages to python3  https://review.opendev.org/c/openstack/kolla/+/76461401:10
openstackgerritlikui proposed openstack/kolla master: update python-subunit to 1.3.0 fix openstack-tox-lower-constraints  https://review.opendev.org/c/openstack/kolla/+/76611601:36
*** Martouf has joined #openstack-kolla01:48
*** zzzeek has quit IRC01:52
*** zzzeek has joined #openstack-kolla01:53
openstackgerritlikui proposed openstack/kolla master: update python-subunit to 1.3.0 fix openstack-tox-lower-constraints  https://review.opendev.org/c/openstack/kolla/+/76611601:54
*** zzzeek has quit IRC02:05
*** zzzeek has joined #openstack-kolla02:06
*** dciabrin has joined #openstack-kolla02:51
*** dciabrin_ has quit IRC02:53
*** k_mouza has joined #openstack-kolla03:37
*** k_mouza has quit IRC03:42
*** dannins has joined #openstack-kolla04:05
*** k_mouza has joined #openstack-kolla04:13
*** k_mouza has quit IRC04:17
*** zzzeek has quit IRC04:19
*** ricolin has quit IRC04:21
*** zzzeek has joined #openstack-kolla04:21
*** zzzeek has quit IRC04:26
*** zzzeek has joined #openstack-kolla04:27
*** vishalmanchanda has joined #openstack-kolla04:55
*** hrw has quit IRC04:56
*** hrw has joined #openstack-kolla04:57
*** zzzeek has quit IRC05:26
*** jopdorp has quit IRC05:27
*** r3ap3r has quit IRC05:27
*** stackedsax has quit IRC05:27
*** stackedsax has joined #openstack-kolla05:28
*** r3ap3r has joined #openstack-kolla05:28
*** jopdorp has joined #openstack-kolla05:28
*** zzzeek has joined #openstack-kolla05:29
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-kolla05:33
*** LinPeiWen has quit IRC05:45
*** zzzeek has quit IRC06:15
*** zzzeek has joined #openstack-kolla06:17
*** LinPeiWen has joined #openstack-kolla06:31
*** cah_link has joined #openstack-kolla06:43
*** zzzeek has quit IRC06:49
*** zzzeek has joined #openstack-kolla06:51
*** jbadiapa has joined #openstack-kolla07:09
*** zzzeek has quit IRC07:21
*** zzzeek has joined #openstack-kolla07:23
*** bengates has joined #openstack-kolla07:40
*** skramaja has joined #openstack-kolla07:51
yoctozeptomorning07:58
yoctozeptohrw: there seems to be a problem folks are experiencing with the new cirros's kernel getting panic attacks now and then (ping sean-k-mooney as well): http://lists.openstack.org/pipermail/openstack-discuss/2020-December/019250.html07:59
yoctozeptoare you still up to the challenge of cirros?08:00
*** nikparasyr has joined #openstack-kolla08:03
osmanlicilegimorning08:07
parallaxhi08:10
*** andrewbonney has joined #openstack-kolla08:13
*** rpittau|afk is now known as rpittau08:14
*** bengates has quit IRC08:20
*** bengates has joined #openstack-kolla08:21
*** cah_link has quit IRC08:31
*** cah_link has joined #openstack-kolla08:32
mgoddardmorning08:41
yoctozeptoif I tell you Docker 20.10 was released yesterday and it broke our CI08:42
yoctozeptowhat will be your reaction08:42
yoctozeptomine is: 😂08:43
*** bengates has quit IRC08:48
osmanlicilegiyoctozepto: do not bet today ]08:49
osmanlicilegi:]08:49
*** dougsz has joined #openstack-kolla08:50
*** zzzeek has quit IRC08:50
*** zzzeek has joined #openstack-kolla08:50
mnasiadkamorning08:51
mnasiadkayoctozepto: should we pin versions that we test? :)08:51
hrwmorning09:02
hrwyoctozepto: I saw patch in review but not looked at details09:02
yoctozeptomnasiadka: I think we should fix the regex09:03
yoctozeptobecause it seems to have change the format09:03
yoctozeptoDocker version 20.10.0, build 7287ab309:04
yoctozeptohmm, looks similar09:04
yoctozeptoI wonder why it fails these prechecks09:04
yoctozepto  failed_when: result is failed09:04
yoctozepto               or result.stdout | regex_replace('.*(\\d+\\.\\d+\\.\\d+).*', '\\1')  is version(docker_version_min, '<')09:04
yoctozeptodocker_version_min: '1.10.0'09:04
yoctozeptooh are not we generous with that min anyhow09:04
mnasiadkawell, we should bump that every release09:05
yoctozeptotell me how it cannot match it09:05
yoctozeptolooks correct09:05
yoctozeptowth09:05
yoctozeptoneed to set it locally09:07
*** luksky has joined #openstack-kolla09:10
mnasiadkaisn't docker --version for client? :)09:10
mgoddardmnasiadka: yes, but unless your daemon is remote it should be the same09:14
mnasiadkamgoddard: true, if it's not - do we want to check server version or client version?09:15
*** zzzeek has quit IRC09:16
*** zzzeek has joined #openstack-kolla09:17
yoctozeptomnasiadka: likely both in fact09:17
yoctozeptowell, otoh, we mostly use our client09:17
mgoddardmnasiadka: probably server, but the ansible model is local09:17
yoctozeptoso server is more important here09:17
yoctozeptomgoddard ++09:18
yoctozeptolet's first fix the failure09:18
yoctozeptoit should be passing....09:18
openstackgerritMerged openstack/kolla master: [CI] Stop testing lower-constraints  https://review.opendev.org/c/openstack/kolla/+/76599509:18
hrwyoctozepto: hm. docker 20... I hope they understand cgroups v2 finally09:19
mnasiadkawell, for healthchecks we need api 1.24, so we would need 1.12 at minimum btw09:19
mnasiadkahttps://docs.docker.com/engine/api/#api-version-matrix09:19
yoctozeptohrw: they do https://docs.docker.com/engine/release-notes/#runtime09:21
yoctozeptoSupport cgroup2 moby/moby#40174 moby/moby#40657 moby/moby#4066209:21
openstackgerritMerged openstack/kolla master: [CI] Slim down  https://review.opendev.org/c/openstack/kolla/+/76608309:22
hrwyoctozepto: cool. can finally drop one of kernel arguments09:24
yoctozeptoyay, kolla's CI on its way to uncork09:25
yoctozeptofingers crossed for gate09:25
hrwand then rebase, rebase, rebase ;D09:27
hrwbtw - where patchbot went?09:28
*** gfidente has joined #openstack-kolla09:30
yoctozeptono care09:31
mnasiadkagot scared of CentOS direction and left09:33
yoctozepto😂09:33
yoctozeptopity opensuse no longer really supports openstack09:34
yoctozeptoI'd just jump there otherwise09:34
yoctozeptosomeone tell centos it's as good decision as mcdonalds withdrawing bigmac09:36
*** zzzeek has quit IRC09:40
*** k_mouza has joined #openstack-kolla09:40
*** zzzeek has joined #openstack-kolla09:41
*** zzzeek has quit IRC09:46
*** zzzeek has joined #openstack-kolla09:49
hrwI would say: wait and see how Stream goes09:51
hrwas now it was: RHEL released, month+ waiting for CentOS to rebuild09:52
hrwbbl09:52
yoctozeptohrw: yeas, that was a pain and I don't really understand that "stability" argument of others09:59
yoctozeptobut the fact that lifespan gets halved is bad09:59
*** zzzeek has quit IRC10:01
*** zzzeek has joined #openstack-kolla10:03
yoctozeptook, kolla fix fried because of the docker failing k-a jobs10:08
openstackgerritMerged openstack/kolla master: docs: add code reviews to contributor guide  https://review.opendev.org/c/openstack/kolla/+/76281710:11
*** dannins has quit IRC10:11
hrwlooks like I need to write longer description to my infra k-a patch so people get why it goes that way10:11
yoctozeptoupdated whiteboard and added bugreport10:12
*** bengates has joined #openstack-kolla10:14
*** bengates has quit IRC10:20
*** dswebb has joined #openstack-kolla10:23
hrwthe good part of centos 8 stream stuff when it comes to kolla?10:31
hrwwe can ignore it for now and just use centos:810:31
hrwand then in X/Yeti cycle check do we need to move to centos:8-stream10:32
*** brinzhang_ has quit IRC10:34
sean-k-mooneyhrw: you could but why not use it10:40
hrwsean-k-mooney: 8.3 just got released. so for W cycle it is perfect10:40
sean-k-mooneyi have kolla ansibel deployed on centos 8 stream currently granted i do not use the docker from centos and i replace the centos kernel but technically i installed centos 8 stream at some point10:40
sean-k-mooneyits not a long life release i woudl stick with 8.2 or go to the stream release personally10:41
hrwsean-k-mooney: I have a feeling that we have already our plates too full to add 'let us move to c8s'10:41
sean-k-mooneyit should just work10:42
*** brinzhang has joined #openstack-kolla10:42
sean-k-mooneyits litrally just chanign the base tag10:42
hrwsean-k-mooney: I think that during W we will see which way RDO go. and then have to adapt to be sure that binary packages work10:42
hrwuntil then let us make review queue shorter10:43
hrwI have 14 patches for kolla(-ansible) in my queue and would like to finish W cycle without any of them10:44
*** bsanjeewa has joined #openstack-kolla10:45
sean-k-mooneyya we were kind of blinsided by this news at least in the compute dfg i dont think it will impact me too much but still it would be nice ot have centos 8 stream in at least some of the gates10:45
sean-k-mooneywe were going to explore the idea of using centos 8 it in teh nova check/gate pipelines to workaorund an issue we were seeing in 20.0410:46
sean-k-mooneybut not sure how 8 vs 8-stream will play into that10:46
sean-k-mooneyfrom a ooo/rdo point of view im expecting there to be a push to supprot centos 9 stream this cycle10:48
*** LinPeiWen has quit IRC10:51
*** bengates has joined #openstack-kolla10:55
openstackgerritMark Goddard proposed openstack/kayobe master: DNM: Test Swift  https://review.opendev.org/c/openstack/kayobe/+/76461710:57
*** bengates has quit IRC11:00
mgoddardyoctozepto, mnasiadka, hrw: is anyone looking at the docker 20.10 issue?11:00
mnasiadkaI think yoctozepto is - if not, let's just pin for now11:01
yoctozeptomgoddard: I was but had to focus on something else11:12
mgoddardyoctozepto: how far did you get?11:12
yoctozeptomgoddard: to getting failure locally11:13
mgoddardyoctozepto: do you think you'll go back to it today?11:13
*** zzzeek has quit IRC11:17
*** zzzeek has joined #openstack-kolla11:18
openstackgerritMark Goddard proposed openstack/kayobe master: Fixes for CentOS 8.3  https://review.opendev.org/c/openstack/kayobe/+/76620311:33
openstackgerritMark Goddard proposed openstack/kayobe master: DNM: Test Swift  https://review.opendev.org/c/openstack/kayobe/+/76461711:37
*** e0ne has joined #openstack-kolla11:37
yoctozeptomgoddard: today yes; for example during the meeting ;-) probably earlier11:48
openstackgerritMark Goddard proposed openstack/kayobe master: Fixes for CentOS 8.3  https://review.opendev.org/c/openstack/kayobe/+/76620311:48
openstackgerritMark Goddard proposed openstack/kayobe master: Fixes for CentOS 8.3  https://review.opendev.org/c/openstack/kayobe/+/76620311:49
yoctozeptohttps://centos.rip/ lol11:50
mnasiadkayoctozepto: good one :)11:54
mgoddardyeah, nice find11:55
openstackgerritMark Goddard proposed openstack/kayobe master: Fixes for CentOS 8.3  https://review.opendev.org/c/openstack/kayobe/+/76620311:57
*** imtiazc has quit IRC12:09
openstackgerritMark Goddard proposed openstack/kayobe master: DNM: Test Swift  https://review.opendev.org/c/openstack/kayobe/+/76461712:09
*** waverider has joined #openstack-kolla12:13
*** kukacz has quit IRC12:15
*** JamesBenson has joined #openstack-kolla12:16
mgoddardyoctozepto: I have a docker fix12:20
*** sorin-mihai has joined #openstack-kolla12:25
*** sorin-mihai has quit IRC12:26
*** sorin-mihai has joined #openstack-kolla12:27
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Fix prechecks with Docker 20.10.0  https://review.opendev.org/c/openstack/kolla-ansible/+/76621112:27
openstackgerritMark Goddard proposed openstack/kayobe master: DNM: Test Swift  https://review.opendev.org/c/openstack/kayobe/+/76461712:30
openstackgerritMark Goddard proposed openstack/kayobe master: Fixes for CentOS 8.3  https://review.opendev.org/c/openstack/kayobe/+/76620312:30
*** skramaja has quit IRC12:30
*** bengates has joined #openstack-kolla12:34
yoctozeptomgoddard: all the better! :D12:37
*** shyamb has joined #openstack-kolla12:38
yoctozeptomgoddard: ah, greediness12:38
yoctozeptomgoddard: try dropping .*12:39
yoctozeptoit should work too12:39
sorin-mihaigrretings :) i'm trying to deploy a small multi-node. i know this was (maybe) discussed in many other places, but is hard to find exact details of small production deployments. i'm thinking of at least 3 control nodes (each 2x8 cores, 128GB ram, 4x1TB SSD) and 3 compute nodes (each 2x16 cores, 256GB ram 4x256 GB SSD). but then, how many network nodes and how many storage nodes should i add? do i really have to go ceph for shared12:40
sorin-mihaistorage, or is there some other simpler way? currently in the all-in-one i use cinder with lvm backend for the volumes, the purpose of building this multi-node is to be able to do software/hardware upgrades without having any downtime for the VMs. you have any recommendations?12:40
*** shyamb has quit IRC13:06
JamesBensonFor our setups, only slightly larger, we have network and control on the same nodes13:07
JamesBensonand you can definitely go converged or hyper-converged where you have control, network, storage, and compute all together.13:08
JamesBensonsorin-mihai: ^^ & We have storage across all of our nodes.13:09
sorin-mihaii assume 10G network would be a must in that case?13:09
JamesBenson10G is definitely preferred, but we do have one cluster with a 1G internal and 1G public, ceph is not running there though.13:09
JamesBenson10g is running for ceph primarily on our other clusters, and 1G for everything else.13:10
ozzzoIs anyone else having trouble running Ussuri Horizon containers on Centos 8.3? I'm getting this error:13:13
ozzzo{"log":"CommandError: An error occurred during rendering /var/lib/kolla/venv/lib/python3.6/site-packages/openstack_dashboard/templates/horizon/_scripts.html: Couldn't find any precompiler in COMPRESS_PRECOMPILERS setting for mimetype '\\'text/javascript\\''.\n"13:13
ozzzoI didn't see this on 8.213:13
sorin-mihaiJamesBenson, so then i could get by with 3 control+network nodes, each 2x8 cores, 128GB ram, 4x1TB SSD (i think this is where the db and images would be stored?) and 3 compute nodes, each 2x16 cores, 256GB ram 4x1TB GB SSD (i think i could stick with cinder/lvm on each node and manually migrate VMs whenever needed)?13:15
*** bsanjeewa has quit IRC13:16
JamesBensonyeah, for live migrations, your compute nodes need to match, particularly the CPU's.13:17
sorin-mihaibut shared storage wouldn't be required, right?13:17
*** waverider has quit IRC13:18
JamesBensonYeah, I believe so.  On our cluster without ceph, I believe we can live migrate, I'll test if you want ;-)13:18
*** maharg101 has joined #openstack-kolla13:19
sorin-mihaiyeah, would be great if you could confirm. obviously i'll have my run of tests once the hardware arrives, but still. :D13:20
JamesBensonSo on that cluster there is no ceph and no cinder and no live-migration.13:22
*** shyamb has joined #openstack-kolla13:22
JamesBensonOn our other setup, we have ceph & cinder and we can definitely live migrate.13:26
*** bsanjeewa has joined #openstack-kolla13:26
sorin-mihaiis that setup with cinder and ceph in the same nodes, or ceph is in separate nodes?13:27
JamesBensoncinder uses ceph as a backend.13:28
*** k_mouza has quit IRC13:28
*** kukacz has joined #openstack-kolla13:28
*** k_mouza has joined #openstack-kolla13:28
JamesBensonwe have storage across everything typically13:29
sorin-mihairight, i mean, is ceph on the same nodes as compute?13:29
*** shyamb has quit IRC13:29
JamesBensonyep, everything.13:29
*** bengates has quit IRC13:30
*** bengates has joined #openstack-kolla13:30
sorin-mihaiso hyper-converged. seems right if one want's to migrate anywhere anytime, but how does that reflect on the drive partitions? i guess at least 2-4tb SSDs?13:31
JamesBensonthe drives don't really matter if it is a light workload, we have spinners and it works (IOPS are horrible though, but enough for our setup)13:33
JamesBensonwe also reserved 10-15GB of RAM to the host13:33
JamesBensonnova.conf reserved_host_memory_mb = 1024013:34
openstackgerritMark Goddard proposed openstack/kayobe master: DNM: Test Swift  https://review.opendev.org/c/openstack/kayobe/+/76461713:41
* osmanlicilegi bbl13:41
mgoddardyoctozepto: looks like docker issue breaks upgrades, so need to to the reverse backport trick13:50
mnasiadkaso, talking about upgrades - docker-ce update is not possible without module_hotfixes=113:52
mnasiadkaso we need to add that back13:52
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Fix prechecks with Docker 20.10.0  https://review.opendev.org/c/openstack/kolla-ansible/+/76618013:54
mgoddardmnasiadka: great13:57
mgoddardmnasiadka: due to containerd?13:57
mnasiadkamgoddard: yes13:57
mnasiadkahttps://www.irccloud.com/pastebin/sZB7cfXR/13:57
*** ricolin has joined #openstack-kolla13:58
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Fix prechecks with Docker 20.10.0  https://review.opendev.org/c/openstack/kolla-ansible/+/76618013:58
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Fix prechecks with Docker 20.10.0  https://review.opendev.org/c/openstack/kolla-ansible/+/76618114:00
mnasiadkahmm, it is there, I just haven't rerun the baremetal role again :)14:00
*** devfaz has quit IRC14:02
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Fix prechecks with Docker 20.10.0  https://review.opendev.org/c/openstack/kolla-ansible/+/76618214:03
*** waverider has joined #openstack-kolla14:04
*** bengates has quit IRC14:04
*** bengates has joined #openstack-kolla14:05
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Fix prechecks with Docker 20.10.0  https://review.opendev.org/c/openstack/kolla-ansible/+/76618214:06
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/victoria: Fix prechecks with Docker 20.10.0  https://review.opendev.org/c/openstack/kolla-ansible/+/76618314:06
*** bengates has quit IRC14:08
*** bengates has joined #openstack-kolla14:09
openstackgerritMark Goddard proposed openstack/kayobe master: DNM: Test Swift  https://review.opendev.org/c/openstack/kayobe/+/76461714:11
openstackgerritMark Goddard proposed openstack/kayobe master: DNM: Test Swift  https://review.opendev.org/c/openstack/kayobe/+/76461714:11
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Fix prechecks with Docker 20.10.0  https://review.opendev.org/c/openstack/kolla-ansible/+/76621114:12
*** TrevorV has joined #openstack-kolla14:17
*** jbalciunas has joined #openstack-kolla14:31
*** dcapone2004 has joined #openstack-kolla14:37
dcapone2004I am sure it is a fun morning / afternoon for everyone after the CentOS announcement...and I am sure that it is probably too early for any definitive responses, but has any thoughts gone into kolla and supporting a migration from CentOS to Oracle linux?14:39
*** bengates has quit IRC14:49
mgoddardmgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi bbezak14:50
mgoddard^ meeting in 1014:50
*** bengates has joined #openstack-kolla14:50
mgoddarddcapone2004: lol. we dropped oracle a few releases back14:50
dcapone2004I know, I was wondering what the plan was with the latest news....is it going to be ubuntu only or is there going to be some type of migration path?14:55
*** bsanjeewa_ has joined #openstack-kolla14:55
mgoddarddcapone2004: CentOS stream lives on14:56
dcapone2004I was in the planning stages of deploying 2 new clusters, and we have been standardized on CentOS  for years, so we are scrambling to understand how we need to reshuffle our plans moving forward14:56
dcapone2004for general purpose VMs, Oracle Linux seems to be at least the solution for now, but for Openstack host OS, it is a little more complex14:56
dcapone2004so the kolla / openstack plan is to adopt centos stream?  Early rumblings are about lack of security as initial reports are security fixes are going to be intentionally delayed to centOS stream14:57
*** wuchunyang has joined #openstack-kolla14:57
*** bsanjeewa has quit IRC14:58
yoctozeptodcapone2004: the way our release cadence happens14:59
*** cah_link has quit IRC14:59
yoctozeptoit is best to move to stream anyway14:59
*** bengates has quit IRC15:00
*** bengates has joined #openstack-kolla15:01
dcapone2004I'll reserve future comments on this till after your meeting15:01
*** waverider has quit IRC15:01
*** rafaelweingartne has joined #openstack-kolla15:01
mgoddard#startmeeting kolla15:02
openstackMeeting started Wed Dec  9 15:02:16 2020 UTC and is due to finish in 60 minutes.  The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot.15:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:02
*** openstack changes topic to " (Meeting topic: kolla)"15:02
openstackThe meeting name has been set to 'kolla'15:02
mgoddard#topic rollcall15:02
*** openstack changes topic to "rollcall (Meeting topic: kolla)"15:02
mgoddard\o15:03
mnasiadkao/15:03
yoctozeptoo/15:03
osmanlicilegio/15:03
rafaelweingartne\o15:03
*** waverider has joined #openstack-kolla15:03
wuchunyango/15:05
mgoddard#topic agenda15:05
*** openstack changes topic to "agenda (Meeting topic: kolla)"15:05
mgoddard* Roll-call15:05
mgoddard* Announcements15:05
mgoddard* Review action items from the last meeting15:05
mgoddard* CI status15:05
mgoddard* Victoria release planning15:05
mgoddard* CentOS 8.3 & stream https://lists.centos.org/pipermail/centos-devel/2020-December/075451.html15:05
mgoddard* Dockerhub pull rate limits https://etherpad.opendev.org/p/docker-pull-limits15:05
mgoddard* Cinder active/active https://bugs.launchpad.net/kolla-ansible/+bug/190406215:05
openstackLaunchpad bug 1904062 in kolla-ansible wallaby "external ceph cinder volume config breaks volumes on ussuri upgrade" [High,In progress] - Assigned to Michal Nasiadka (mnasiadka)15:05
mgoddard* Wallaby PTG actions15:05
mgoddard#topic announcements15:05
*** openstack changes topic to "announcements (Meeting topic: kolla)"15:05
mgoddard#info CentOS 8.3 released, triggering various breakages15:06
mgoddard#info CentOS Linux deprecated in favour of CentOS stream15:06
yoctozeptolovely week, my dears15:07
mgoddard#topic Review action items from the last meeting15:08
*** openstack changes topic to "Review action items from the last meeting (Meeting topic: kolla)"15:08
mgoddardThere were none15:08
mgoddard#topic CI status15:08
*** openstack changes topic to "CI status (Meeting topic: kolla)"15:08
mgoddardbroken15:08
yoctozeptovery b0rken15:08
rafaelweingartneMark, about the review action, we have a bit of a problem in the patch we are working. People are requesting to add SAML or to split the patch in some other parts, but we are not understanding what is being requested. The patch is already complex, and long, but it is working and self-contained.15:09
rafaelweingartneI would like to move on with it, and address extra extensions and changes in new further patches15:10
yoctozeptorafaelweingartne: later please15:10
rafaelweingartneSorry, I saw the review action15:10
mgoddardstarting with kolla15:11
mgoddard[major] lower-constraints broken15:11
yoctozeptorafaelweingartne: ah; this is for reviewing *actions* from the previous meeting15:11
mgoddardfixed by dropping the lower-constraints job15:12
yoctozeptoyes, need to backport15:12
mgoddard+115:12
mnasiadkarafaelweingartne: you need to wait until the end of the meeting, then will be time for similar queries.15:12
mgoddardbackporting seems a lot slower with new gerrit15:12
yoctozeptoit does15:12
mgoddardeverything is slower :)15:12
yoctozeptoI will backport this drop15:12
mgoddardanyway15:12
yoctozeptomgoddard: +215:12
mgoddardcool15:12
yoctozeptoand also15:13
yoctozeptothe slimming15:13
yoctozeptoif you don't mind15:13
waveriderthe Kolla meeting is in #openstack-meeting-3 ?15:13
mgoddardyeah15:13
yoctozeptoit makes it much snappier to recheck15:13
yoctozeptothanks15:13
yoctozeptowaverider: here15:13
yoctozeptowaverider: now15:13
maharg101what would be the most efficient invocatiom of kolla-ansible to simply upgrade new TLS certificates which have been prepared and placed in ./config/certificates ?15:13
yoctozeptofolks, *this* is the meeting, please stay focused on the topic :-)15:13
maharg101apols15:14
mgoddard[major] [user-facing] [centos8.3] INFO:kolla.common.utils.base:[91mError: No matching repo to modify: PowerTools.15:14
mgoddardfix looks good, "just" needs docker 20.10 patch to land15:14
mgoddardI think that's all for kolla15:14
yoctozeptomgoddard: did you try dropping the .* instead?15:14
yoctozepto(just curious)15:15
mgoddardyoctozepto: no, it worked15:15
mgoddardsaw no need to iterate15:15
yoctozeptook15:15
mgoddardonto kolla-ansible15:15
mgoddard[major] [user-facing] Docker 20.10 fails prechecks15:15
mgoddardwe have a patch, and reverse backport chain to stein15:15
mgoddardhopefully it will pass15:15
yoctozeptofailing already15:16
yoctozeptok-a needs the l-c drop15:16
mnasiadkaso all CI breakages are being handled?15:16
yoctozeptoyeas15:16
yoctozeptook, I will handle the l-c stuff all around15:16
* yoctozepto patting himself on the back for making zuul not trigger our jobs if only zuul files are touched15:16
yoctozeptoso that we can now do something about it15:17
yoctozeptoCollecting bandit>=1.1.015:18
yoctozepto  Downloading https://mirror.gra1.ovh.opendev.org/pypifiles/packages/25/2b/fe57beb362cb19145ab5eb809f65feec16febe056d97280e9a8d4b235824/bandit-1.6.3-py2.py3-none-any.whl (115 kB)15:18
yoctozeptoERROR: Package 'bandit' requires a different Python: 2.7.17 not in '>=3.5'15:18
*** TrevorV has quit IRC15:18
yoctozeptooooh15:18
yoctozeptothis is k-a stein15:18
yoctozeptotrying tox py2715:18
mgoddardah yeah, py27 jobs are failing on stein & train15:19
mgoddardeverywhere from what I can tell15:19
mgoddardquite the mess we have here15:19
yoctozeptoyes15:20
yoctozeptoadd this to whiteboard please15:21
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla stable/victoria: [CI] Stop testing lower-constraints  https://review.opendev.org/c/openstack/kolla/+/76624015:21
mgoddarddone15:22
mgoddardonto kayobe15:23
mgoddardobviously we are hit by the kolla-ansible docker precheck issue15:23
yoctozepto(gerrit really is slow)15:23
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla stable/ussuri: [CI] Stop testing lower-constraints  https://review.opendev.org/c/openstack/kolla/+/76624115:24
mgoddardstill trying to work out how we are hit by CentOS 8.3. I think we have patches to fix CI now15:24
mnasiadkawonder if it's the Gerrit UI, or Gerrit API is also slow15:25
mgoddardI expect there would be issues with a full universe-from-nothing run though, and we had a couple of bugs raised15:25
yoctozeptomnasiadka: API seems slow too15:25
yoctozeptomgoddard: how much is kayobe affected?15:25
yoctozeptodue to dib?15:25
mgoddardstill unsure15:26
mgoddardhttps://review.opendev.org/c/openstack/kayobe/+/76620315:26
mgoddardthat fixes a few issues15:26
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla stable/train: [CI] Stop testing lower-constraints  https://review.opendev.org/c/openstack/kolla/+/76624215:26
mnasiadkawe'll probably be fixing stuff related to 8.3 in the next days at least15:26
yoctozeptomgoddard: gosh, that's a quite a bit15:27
yoctozeptomnasiadka, mgoddard: well, 8.3 is said to be the taste of stream :-)15:27
mnasiadkayoctozepto: I would call that different, but I think it violates some rules to be polite :)15:27
yoctozeptoI wonder if it makes me want to continue consuming it though15:27
yoctozeptomnasiadka: well ;-)15:28
mgoddard#topic Victoria release planning15:29
*** openstack changes topic to "Victoria release planning (Meeting topic: kolla)"15:29
mgoddardI was hoping we might push forward with V, but it seems firefighting will be the activity for a while15:30
yoctozepto++15:30
yoctozeptovery saddening15:30
mgoddardrelease blockers are on L166 of the whiteboard15:31
mgoddardnot really any changes15:31
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla stable/stein: [CI] Stop testing lower-constraints  https://review.opendev.org/c/openstack/kolla/+/76624315:31
yoctozeptook, dears, please approve all those l-c drops ^15:32
yoctozeptonow the same on k-a15:32
mgoddardyoctozepto: did you look at py27?15:32
yoctozeptomgoddard: not yet, I wonder if it breaks on kolla too15:33
yoctozeptowill do that as the next step, yes15:33
mnasiadkaOk, seems I can put some cycles to cinder in the next two days, so we might have some progress on that one.15:33
yoctozeptoleave the basic CI to me :-)15:33
yoctozeptomnasiadka: that would be wonderful15:33
mgoddardyoctozepto: it does15:33
yoctozeptostart with that volume-preserving upgrade15:33
yoctozeptomgoddard: that was fast :-)15:34
mgoddardyoctozepto: checked emails..15:34
yoctozeptoI see15:34
mnasiadkawell, the volume will be preserved either way, just you can't do anything with it since the agent that owns it is dead :)15:34
yoctozeptomnasiadka: yeah, I mean we are now cleaning them15:34
yoctozeptoso hard to check15:34
mgoddard#topic Cinder active/active https://bugs.launchpad.net/kolla-ansible/+bug/190406215:34
*** openstack changes topic to "Cinder active/active https://bugs.launchpad.net/kolla-ansible/+bug/1904062 (Meeting topic: kolla)"15:34
openstackLaunchpad bug 1904062 in kolla-ansible wallaby "external ceph cinder volume config breaks volumes on ussuri upgrade" [High,In progress] - Assigned to Michal Nasiadka (mnasiadka)15:34
mgoddardsince we are on it already15:35
mnasiadkamgoddard: sorry to get in front of the agenda ;)15:35
mgoddardI saw in last week's meeting a plan that did not align with the one in my head15:35
mgoddardfirst, there was some suggestion that cluster is not supported until victoria15:35
mgoddardthat is incorrect, it is about a cluster_name field returned by the API15:35
mgoddardcluster goes back to rocky IIRC15:36
mnasiadkayeah, OSA changed way back to use cluster15:36
mgoddardsecond, there was talk of using backend_host until victoria. I think we should use cluster and drop backend_host, all the way back to stein15:36
mgoddards/stein/train/15:36
*** wuchunyang has quit IRC15:37
mnasiadkawell, we never had backend_host in external ceph code I think15:37
mnasiadkaOnly in docs15:37
mgoddardcorrect, but we have to assume our users followed the docs :)15:38
mnasiadkaOk, so after merging a fix and upgrade path - we should fix the docs as well.15:38
yoctozeptomgoddard: I agree15:38
*** wuchunyang has joined #openstack-kolla15:39
yoctozeptohmm, bandit 1.6.3 was released Dec 6th15:39
*** lxkong has quit IRC15:39
mgoddardmnasiadka: fix docs in stable?15:39
yoctozeptoit likely broke all CIs15:39
mgoddardyoctozepto: requirements may have a patch in progress in that case15:39
mnasiadkamgoddard: yeah, shouldn't we?15:40
mgoddardmnasiadka: I agree, we should15:40
mnasiadkaok, added to my list15:40
mgoddardI suppose we need to consider what happens if a user keeps backend_host15:40
yoctozeptohttps://github.com/PyCQA/bandit/issues/66315:40
mgoddardshould we fail?15:40
yoctozeptomgoddard: it's not controlled by reqs15:41
mnasiadkamgoddard: we could write a precheck for that, would make sense15:41
mgoddard+115:41
mnasiadkaand backport it all the way?15:41
mgoddardyes15:41
mnasiadkamakes sense15:42
mgoddardready to move on?15:43
mnasiadkayup15:43
* yoctozepto fixing kolla py27 by blacklisting "universal" bandit15:43
mgoddard#topic CentOS 8.3 & stream https://lists.centos.org/pipermail/centos-devel/2020-December/075451.html15:43
*** openstack changes topic to "CentOS 8.3 & stream https://lists.centos.org/pipermail/centos-devel/2020-December/075451.html (Meeting topic: kolla)"15:44
mgoddardavoiding CentOS bashing for the moment15:44
dcapone2004:-(15:44
mgoddardwhat do we need to do?15:44
mgoddardmedium term, it seems the path forward it stream15:45
mgoddard*is15:45
mgoddardthe question for us is when15:45
mnasiadkaI guess first we would need to understand if there will be container image tagged centos:8-stream15:45
yoctozepto++15:46
mnasiadkaI can ask on centos-devel15:46
yoctozeptoI would say go stream all the way15:46
yoctozeptoit's fine for our cadence15:46
yoctozeptojust let there be a proper container image of it15:46
mnasiadkaSecond thing is - if Infra is planning to build a stream image we could use in CI15:46
yoctozeptomnasiadka: we have it already15:46
yoctozeptopasses devstack CI ;-)15:47
mnasiadkaSo then we could start running our simple CI jobs on it15:47
yoctozeptoyou are in good hands with me :D15:47
yoctozeptoyes, we can switch this easily15:47
mnasiadkado we want to switch, or have both?15:47
mnasiadkaIt's rather a question do we deprecate normal CentOS 8 support in W, and support only Stream?15:48
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla stable/train: [CI] Stop testing lower-constraints and fix py27 job  https://review.opendev.org/c/openstack/kolla/+/76624215:48
yoctozeptomnasiadka: I wonder what docker will do15:48
yoctozeptoare its repos stream-friendly now?15:48
mgoddardwere they not?15:48
mnasiadkaI think they should be.15:49
yoctozeptoI think so too, just asking for clarity15:49
mnasiadkaI can waste some minutes and spawn a Stream image and try to build/deploy Kolla15:49
yoctozeptothat would not be a waste!15:49
mnasiadkaRather thinking do we just support Stream from Wallaby, or support both 8.3 and Stream?15:49
mnasiadkaAnybody has any thoughts on that?15:50
mgoddardI've added these questions to the whiteboard15:50
*** devfaz has joined #openstack-kolla15:50
mgoddardin order to drop support for releases we need a working migration path to stream15:51
mnasiadkawell, migration path shouldn't be complex - just dnf install centos-release-stream and dnf distro-sync15:51
yoctozeptoyes, that is simple15:52
mgoddardmnasiadka: you are right - it shouldn't :)15:52
yoctozeptomgoddard: it really is simple15:52
mnasiadkabut what breaks then, don't ask me yet15:52
yoctozeptoyeas, kolla-wise unknown :-)15:52
mnasiadkawell, then medium term we could test that migration path in upgrade jobs15:52
yoctozeptotoo costly15:53
yoctozeptowe never tested 7.x -> 7.(x+1) anyhow15:53
mgoddardwe should probably switch the containers over15:53
ozzzowe (and probably lots of other operators) are not planning to run OpenStack on stream. I'd like to see Centos 8.3 supported as long as possible while we work on switching to another distro15:53
mgoddardozzzo: good datapoint15:54
yoctozeptohmm15:54
mgoddardozzzo: can you provide your reasoning?15:54
yoctozepto^15:54
ozzzostream isn't suitable for production. It is basically a beta, while still trailing RHEL for security fixes15:55
yoctozeptothey are changing this, it's an unfair claim15:55
yoctozeptoI would say wait till the end of Q115:55
mnasiadkawell, anyway that's main concern of a lot of people15:56
mgoddardI would at least say that you are going to want a stable local mirror of it15:56
mgoddardthat you can move forward at your own pace15:56
yoctozeptowell, with the current model you could have 1-2 months of no security fixes anyhow15:56
mnasiadkamgoddard, yoctozepto: centos-devel folks are thinking of building centos-stream container images, but nothing concrete yet15:57
ozzzowe can live with trailing security fixes; the concern is stability15:57
yoctozeptomnasiadka: thanks15:57
mgoddardozzzo: see my last point15:57
waveriderIs there another rpm-based open source distro suitable for production? Operators prefer rpm-based instead of deb-distros, why? Or makes sense to consider Debian support (as alternative to Ubuntu, which is probably leaned towards commercial).15:57
yoctozeptowaverider: deb is just as fine ;-)15:57
mgoddardwaverider: we support debian15:57
mgoddardand ubuntu15:57
dcapone2004ozzzo:  I'm with you, I commented before meeting on that, but said I was waiting till after meeting to discuss that further15:57
yoctozeptowaverider: for openstack with rpms your best bet is centos still15:58
yoctozeptootherwise we welcome you in ubuntu and debian flavours15:58
dcapone2004fyi, original Centos founder15:58
yoctozeptoas for the current situation w/ centos15:58
yoctozeptorocky linux is happening15:58
dcapone2004just announced Rocky Linux....he is supposedly recreating another fork of RHEL15:58
waveridernice, I didn't notice Debian, I'm used with Ubuntu and we used everywhere we are not forced to rpm-based (like cPanel servers)15:58
yoctozeptohttps://forums.rockylinux.org/15:58
yoctozeptoand #rockylinux* on Freenode15:59
waveriderthat was on my mind, who's gonna take over centos open source :)15:59
yoctozeptoanyway, another announcement is15:59
yoctozeptowe will be discussing centos with tc tomorrow15:59
yoctozeptothe infra is ready for stream16:00
yoctozeptojust need for decisions16:00
mnasiadkamgoddard, yoctozepto: so for now I'll just add conversion to centos stream during base build to understand if something will fail very badly on stream builds.16:00
mnasiadkaand we can get better prepared16:00
yoctozeptomnasiadka: ++16:00
mgoddardI expect we need to hold tight and see which way this goes before doing anything drastic16:00
yoctozeptolovely idea16:00
yoctozeptomgoddard: ++ as well16:00
*** wuchunyang has quit IRC16:00
mnasiadkayeah, no dynamic moves before Stream gets established properly.16:01
mgoddardthanks all16:01
mgoddard#endmeeting16:01
*** openstack changes topic to "IRC meetings on Wednesdays @ 15:00 UTC - agenda @ https://goo.gl/OXB0DL | Whiteboard: https://bit.ly/2MM7mWF | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b"16:01
openstackMeeting ended Wed Dec  9 16:01:50 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:01
openstackMinutes:        http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-12-09-15.02.html16:01
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-12-09-15.02.txt16:01
openstackLog:            http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-12-09-15.02.log.html16:01
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla stable/stein: [CI] Stop testing lower-constraints  https://review.opendev.org/c/openstack/kolla/+/76624316:02
waveriderBefore my first contribution, anything I should know, besides documented gerrit & all workflow? Should I just push the first one or should I talk to someone first?16:03
yoctozeptothanks mgoddard16:03
mgoddardhttps://news.itsfoss.com/rocky-linux-announcement/16:04
yoctozeptowaverider: just push, don't be shy16:04
waveriderok16:04
mnasiadkawaverider: and don't be frustrated when somebody does -1 :)16:04
waveridersure, I'd expect that, we're using Gitlab internally and I'd be using Gerrit for the first time16:05
waverider(would be nice to use Gitlab in OpenStack projects as well. but that would be a big infra change)16:05
jopdorp-1, at least they care enough to look o_o16:08
waverider:D16:09
yoctozeptojopdorp: haha16:09
*** waverider has quit IRC16:09
yoctozeptojopdorp: you want some -1s on masakari? :D I guess you understand the reasoning behind my delays there now; as it's basically every week fire fighting :D16:10
*** mloza is now known as atmark16:10
yoctozeptoarar, k-a stein seems to not have jobs filtered on zuul changes16:11
bsanjeewa_ Anyone can direct me how to define a vlan on a bond with kayobe in group_vars/../network_interfaces, if supported?16:12
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla stable/stein: [CI] Stop testing lower-constraints and fix py27 job  https://review.opendev.org/c/openstack/kolla/+/76624316:13
yoctozeptomgoddard, mnasiadka: https://review.opendev.org/c/openstack/kolla-ansible/+/759121 <- testing stream since Oct16:15
openstackgerritPiotr Parczewski proposed openstack/kolla master: Add secondary Prometheus image  https://review.opendev.org/c/openstack/kolla/+/76591616:21
hrwelo16:24
*** brinzhang has quit IRC16:27
openstackgerritMark Goddard proposed openstack/kolla master: Support CentOS 8.3  https://review.opendev.org/c/openstack/kolla/+/76585416:27
mgoddardyoctozepto: ^ added depends-on16:27
yoctozeptomgoddard: thanks16:28
mgoddardbsanjeewa_: <network>_interface: bond0.12316:28
mgoddardbsanjeewa_: <network>_vlan: 12316:29
yoctozeptoeh, wrong place16:29
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla master: Support CentOS 8.3  https://review.opendev.org/c/openstack/kolla/+/76585416:29
yoctozeptoit does not pick it up if it is not in one labels block16:30
yoctozeptoI *think* it might tolerate whitespace16:30
yoctozeptobut not other non-label stuff16:30
bsanjeewa_mgoddard: thanks, will try. <network>_vlan: is already defined in networks.yml, so I think <network>_interface: bond0.123 is enough?16:31
yoctozeptohmm, thankfully l-c are not broken in k-a16:32
yoctozeptoso only a matter of fixing the py2716:32
openstackgerritMark Goddard proposed openstack/kayobe master: DNM: Test Swift  https://review.opendev.org/c/openstack/kayobe/+/76461716:34
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla-ansible stable/train: Fix prechecks with Docker 20.10.0 and py27 job  https://review.opendev.org/c/openstack/kolla-ansible/+/76618116:35
openstackgerritMark Goddard proposed openstack/kayobe master: DNM: Test Swift  https://review.opendev.org/c/openstack/kayobe/+/76461716:36
yoctozeptooh well, it actually fails on train--16:40
yoctozeptopff16:40
yoctozeptoremoving there16:40
openstackgerritOliver Horecny proposed openstack/kolla-ansible master: Removing of unused nova services after upgrade  https://review.opendev.org/c/openstack/kolla-ansible/+/76534716:44
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla-ansible stable/stein: Fix prechecks with Docker 20.10.0 and py27 job  https://review.opendev.org/c/openstack/kolla-ansible/+/76618016:45
mgoddardyoctozepto: did you see bandit on openstack-discuss?16:48
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla-ansible stable/train: Fix prechecks with Docker 20.10.0 and py27 job  https://review.opendev.org/c/openstack/kolla-ansible/+/76618116:48
yoctozeptomgoddard: yes; any specific part you want to discuss?16:49
yoctozeptoI have independently found the github issue already reported16:49
yoctozeptoso just added my 2 cents in there and hope they will stop releasing universal wheels past 1.6.316:49
yoctozeptoall this universal wheel bs is cringy16:50
mgoddardyoctozepto: nothing in particular, just checking you'd seen it16:54
yoctozeptoack16:54
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla stable/stein: [CI] Stop testing lower-constraints and fix py27 job  https://review.opendev.org/c/openstack/kolla/+/76624316:58
yoctozeptohuff-puff, that should be it16:58
yoctozeptofingers crossed16:58
yoctozeptoit should boil down to rechecks on random issues16:59
mgoddardfamous last word17:04
*** Chaserjim has joined #openstack-kolla17:10
*** rpittau is now known as rpittau|afk17:12
*** e0ne has quit IRC17:12
yoctozeptomgoddard: I guess we should release Train and Ussuri for all projects after fixes merge17:12
yoctozeptoto have users happy with new docker and centos17:13
mgoddardyes. I was thinking of waiting for cinder, but maybe not17:13
yoctozeptomaybe not17:13
*** kukacz has quit IRC17:14
hrwhttps://review.opendev.org/c/openstack/kolla/+/766242 anyone?17:14
hrwomg. stein too?17:15
hrwhm. I am thinking of disabling aarch64 ci for <ussuri. opinions?17:16
yoctozeptohrw: agreed, it boils down to your support17:16
*** Chaserjim has quit IRC17:17
*** Chaserjim has joined #openstack-kolla17:18
*** TrevorV has joined #openstack-kolla17:19
hrwit's just train17:20
*** bengates has quit IRC17:20
openstackgerritMarcin Juszkiewicz proposed openstack/kolla stable/train: CI: stop checking on aarch64  https://review.opendev.org/c/openstack/kolla/+/76626417:20
*** nikparasyr has left #openstack-kolla17:21
*** bengates has joined #openstack-kolla17:21
yoctozeptomgoddard: added a summary of next actions to the whiteboard17:22
hrwall l-c jobs have my +217:24
hrwso some other core can go with +2+W to get that sorted out17:25
*** dougsz has quit IRC17:32
*** e0ne has joined #openstack-kolla17:34
*** gfidente is now known as gfidente|afk17:35
*** luksky has quit IRC17:35
*** bsanjeewa_ has quit IRC17:43
*** k_mouza has quit IRC17:46
*** bsanjeewa has joined #openstack-kolla17:47
*** kukacz has joined #openstack-kolla17:47
*** rafaelweingartne has quit IRC17:55
yoctozeptoand now gerrit failed so we will lose some job results :D mgoddard - bad luck never disappoints, no?18:07
*** Chaserjim has quit IRC18:10
*** Chaserjim has joined #openstack-kolla18:11
*** k_mouza has joined #openstack-kolla18:11
*** k_mouza has quit IRC18:15
-openstackstatus- NOTICE: The Gerrit service on review.opendev.org is currently responding slowly or timing out due to resource starvation, investigation is underway18:15
*** Chaserjim has quit IRC18:17
*** Chaserjim has joined #openstack-kolla18:17
*** k_mouza has joined #openstack-kolla18:17
*** kukacz has quit IRC18:18
*** bengates has quit IRC18:18
*** Chaserjim has quit IRC18:23
*** Chaserjim has joined #openstack-kolla18:23
*** bengates has joined #openstack-kolla18:23
*** k_mouza has quit IRC18:25
*** dking has quit IRC18:28
*** Chaserjim has quit IRC18:32
*** Chaserjim has joined #openstack-kolla18:32
*** kukacz has joined #openstack-kolla18:43
yoctozeptoyeas, centos8.3 green 100% https://review.opendev.org/c/openstack/kolla/+/765854 hrw mgoddard mnasiadka to approve18:49
yoctozepto(needs the whole k-a stack though)18:49
mnasiadkaGerrit so sloooow18:50
*** e0ne has quit IRC18:51
yoctozeptohrw mnasiadka mgoddard k-a reached pull limits18:52
yoctozeptowe will need to proceed slowly18:52
yoctozeptostarting with stein18:52
*** andrewbonney has quit IRC19:03
openstackgerritMark Goddard proposed openstack/kayobe master: Fixes for CentOS 8.3  https://review.opendev.org/c/openstack/kayobe/+/76620319:07
mgoddardyoctozepto: stein failure was in build-openstack-deploy-guide19:12
mgoddarddoc/source/user/quickstart.rst:368:Unknown interpreted text role "kolla-doc".19:12
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Fix prechecks with Docker 20.10.0 and py27 job  https://review.opendev.org/c/openstack/kolla-ansible/+/76618019:18
*** bsanjeewa has quit IRC19:24
*** bengates_ has joined #openstack-kolla19:26
*** bengates has quit IRC19:29
*** bengates_ has quit IRC19:30
yoctozeptomgoddard: true, but others not19:33
*** dougsz has joined #openstack-kolla19:33
yoctozeptothanks for fixing it19:33
*** Chaserjim has quit IRC19:35
*** Chaserjim has joined #openstack-kolla19:35
*** lxkong has joined #openstack-kolla19:40
*** dougsz has quit IRC19:47
*** waverider has joined #openstack-kolla19:47
*** waverider has joined #openstack-kolla19:47
*** waverider has quit IRC19:48
*** waverider has joined #openstack-kolla19:48
*** waverider is now known as adrian-a19:49
*** adrian-a has quit IRC19:51
*** adrian-a_ has joined #openstack-kolla19:54
*** adrian-a_ has quit IRC19:54
*** adrian-a has joined #openstack-kolla19:55
*** bengates has joined #openstack-kolla19:58
*** k_mouza has joined #openstack-kolla19:58
*** k_mouza has quit IRC20:03
*** bengates has quit IRC20:03
*** maharg101 has quit IRC20:23
*** adrian-a has quit IRC20:24
*** adrian-a has joined #openstack-kolla20:25
*** dave-mccowan has joined #openstack-kolla20:32
*** vishalmanchanda has quit IRC20:54
*** Chaserjim has quit IRC21:04
*** Chaserjim has joined #openstack-kolla21:05
*** kukacz has quit IRC21:11
*** Chaserjim has quit IRC21:13
*** Chaserjim has joined #openstack-kolla21:13
*** Chaserjim has quit IRC21:16
*** Chaserjim has joined #openstack-kolla21:16
*** sorin-mihai has quit IRC21:26
*** gfidente|afk has quit IRC21:28
*** Chaserjim has quit IRC21:29
*** Chaserjim has joined #openstack-kolla21:30
*** iniazi has quit IRC21:31
*** e0ne has joined #openstack-kolla21:38
*** sorin-mihai has joined #openstack-kolla21:54
*** imtiazc has joined #openstack-kolla22:06
*** e0ne has quit IRC22:14
openstackgerritMerged openstack/kolla-ansible stable/stein: Fix prechecks with Docker 20.10.0 and py27 job  https://review.opendev.org/c/openstack/kolla-ansible/+/76618022:18
openstackgerritMerged openstack/kolla stable/train: [CI] Stop testing lower-constraints and fix py27 job  https://review.opendev.org/c/openstack/kolla/+/76624222:19
openstackgerritMerged openstack/kolla stable/ussuri: [CI] Stop testing lower-constraints  https://review.opendev.org/c/openstack/kolla/+/76624122:20
openstackgerritMerged openstack/kolla stable/victoria: [CI] Stop testing lower-constraints  https://review.opendev.org/c/openstack/kolla/+/76624022:20
*** jbalciunas has quit IRC22:23
*** jbalciunas has joined #openstack-kolla22:23
*** kukacz has joined #openstack-kolla22:53
*** jbadiapa has quit IRC22:54
*** dswebb has quit IRC23:10
*** bodgix has joined #openstack-kolla23:18
*** bodgix has quit IRC23:22
*** imtiazc has quit IRC23:22
*** TrevorV has quit IRC23:22
*** bodgix has joined #openstack-kolla23:23
*** imtiazc has joined #openstack-kolla23:25
*** Chaserjim has quit IRC23:40
*** Chaserjim has joined #openstack-kolla23:40
*** Chaserjim has quit IRC23:41
*** k_mouza has joined #openstack-kolla23:41
*** Chaserjim has joined #openstack-kolla23:41
*** k_mouza has quit IRC23:45

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!