Tuesday, 2020-03-31

*** kevinz has joined #openstack-kolla00:03
*** factor has quit IRC00:19
*** factor has joined #openstack-kolla00:20
*** k_mouza has joined #openstack-kolla00:47
*** k_mouza has quit IRC00:52
*** Fl1nt has quit IRC00:54
*** sorin-mihai has quit IRC01:12
*** noxoid has quit IRC01:14
*** zhanglong has joined #openstack-kolla01:28
*** watersj has joined #openstack-kolla01:47
*** rlandy has quit IRC01:48
*** Tony31 has joined #openstack-kolla02:05
*** zhenguo_ has joined #openstack-kolla02:33
*** k_mouza has joined #openstack-kolla02:51
*** k_mouza has quit IRC02:56
*** hongbin has joined #openstack-kolla03:00
*** hongbin has quit IRC03:05
*** threestrands has joined #openstack-kolla03:39
*** noxoid has joined #openstack-kolla04:29
*** evrardjp has quit IRC04:36
*** evrardjp has joined #openstack-kolla04:36
*** zhenguo_ has quit IRC04:42
*** ykarel|away is now known as ykarel04:45
noxoidyoctozepto, would appreciate if you could take a peek at https://bugs.launchpad.net/kolla-ansible/+bug/1869832 when you get a chance to make sure im not crazy04:54
openstackLaunchpad bug 1869832 in kolla-ansible "openvswitch firewall still broken after unclean backport" [Undecided,New]04:54
*** k_mouza has joined #openstack-kolla04:56
*** k_mouza has quit IRC05:01
*** dave-mccowan has quit IRC05:03
*** dave-mccowan has joined #openstack-kolla05:15
*** cah_link has joined #openstack-kolla05:21
*** pbing19 has joined #openstack-kolla05:32
yoctozeptonoxoid: done, there is no proof of you being crazy or not, that I can say06:31
*** vishalmanchanda has joined #openstack-kolla06:38
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/train: DNM: image_upload_use_cinder_backend - no rbd  https://review.opendev.org/71616806:52
*** hjensas has quit IRC06:54
openstackgerritPiotr Rabiega proposed openstack/kolla master: add dpdk_telemetry and logparser, use centos-release-opstools for C8  https://review.opendev.org/71592306:55
*** k_mouza has joined #openstack-kolla06:57
mnasiadkamorning06:59
*** k_mouza has quit IRC07:02
mnasiadkanoxoid: openvswitch_agent_xenapi? really you are using that?07:03
mnasiadkanoxoid: ah ok, I misread the bug07:04
Tony31morning07:08
*** bengates has joined #openstack-kolla07:15
*** bengates has quit IRC07:15
*** bengates has joined #openstack-kolla07:16
*** rpittau|afk is now known as rpittau07:17
yoctozeptomnasiadka: yeah, it's badder07:19
*** Fl1nt has joined #openstack-kolla07:19
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Fix ovs fw driver for the other ovs agent  https://review.opendev.org/71617407:20
yoctozeptomnasiadka: ^07:20
yoctozeptomnasiadka: I will do immediate backport to all branches (adapting properly this time)07:20
yoctozeptomgoddard: can we rerelease final rocky version due to a relatively critical bug?07:20
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/train: Fix ovs fw driver for the other ovs agent  https://review.opendev.org/71617507:21
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/train: Fix ovs fw driver for the other ovs agent  https://review.opendev.org/71617507:23
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/stein: Fix ovs fw driver for the other ovs agent  https://review.opendev.org/71617807:23
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/rocky: Fix ovs fw driver for the other ovs agent  https://review.opendev.org/71617907:23
*** hjensas has joined #openstack-kolla07:43
*** Fl1nt has quit IRC07:44
*** e0ne has joined #openstack-kolla07:44
*** jbadiapa has joined #openstack-kolla07:50
yoctozeptomgoddard, mnasiadka: I just noticed Stein and Train did not see a release so they should not need either reno there, same for Ussuri; ah those renos are pain :/07:57
yoctozeptomgoddard, mnasiadka: I'll amend patches when CI-tested07:59
*** ktibi has joined #openstack-kolla08:11
*** iniazi has quit IRC08:15
*** iniazi has joined #openstack-kolla08:15
mnasiadkayoctozepto: have fun :)08:21
*** threestrands has quit IRC08:26
openstackgerritMagnus Lööf proposed openstack/kolla-ansible master: Configure sysctl settings for RabbitMQ to fix startup errors  https://review.opendev.org/71620708:26
Tony31hope you guys are doing well and staying safe08:27
hrwmorgen08:29
hrwTony31: bored08:29
Tony31morning hrw08:30
*** zhanglong has quit IRC08:33
mgoddardyoctozepto: rocky final was already done08:33
openstackgerritPiotr Rabiega proposed openstack/kolla master: add dpdk_telemetry and logparser, use centos-release-opstools for C8  https://review.opendev.org/71592308:34
yoctozeptomgoddard: yeah, looking for exception ;d08:34
mgoddardwe tagged EM08:34
cosmicsoundgreetings08:34
mgoddardmnasiadka, hrw, mnasiadka: Anyone available to run the meeting tomorrow?08:35
*** oyrogerg has quit IRC08:39
*** oyrogerg has joined #openstack-kolla08:41
*** Luzi has joined #openstack-kolla08:44
*** zhanglong has joined #openstack-kolla08:48
*** cah_link1 has joined #openstack-kolla08:49
*** cah_link has quit IRC08:50
*** cah_link1 is now known as cah_link08:50
*** priteau has joined #openstack-kolla08:59
kevinzyoctozepto, morning!09:02
kevinzWe are upgrading our env from R to S today, and meet a very interesting issue: https://bugs.launchpad.net/kolla-ansible/+bug/186985509:03
openstackLaunchpad bug 1869855 in kolla-ansible "From Rocky to Stein, router in one network node creation issue" [Undecided,New]09:03
kevinzLooks one network node has issue with l3 agent,.. or OVS,.. but other 2 nodes works find09:03
kevinzworks fine09:03
*** gfidente has joined #openstack-kolla09:09
*** xinliang has joined #openstack-kolla09:13
mnasiadkakevinz: tried restarting neutron-l3-agent on the problem node?09:16
kevinzmnsiadka: yes, restart neutron-l3-agent and also restart the node, no effect09:17
kevinzmnsiakdka: actually I restart another network node, it works...But this one ^ do not work09:18
*** zhanglong has quit IRC09:21
*** zhanglong has joined #openstack-kolla09:22
priteaukevinz: Have you looked at neutron-l3-agent logs?09:23
kevinzERROR neutron.agent.linux.external_process [-] keepalived for router with uuid 44cc73d8-fb3c-408b-be22-682931cb1fc1 not found. The process should not have died09:23
kevinzyes, some router issue in L3 here ^09:23
kevinzSome routers works, without the error above09:23
mnasiadkawell then keepalived seems to have died, question why09:30
mnasiadkawithout enabling debug in l3-agent might be hard to understand09:30
*** k_mouza has joined #openstack-kolla09:32
*** priteau has quit IRC09:41
*** diga has joined #openstack-kolla09:45
*** zhanglong has quit IRC09:45
*** xinliang has quit IRC09:48
*** cah_link has quit IRC10:07
*** skramaja has joined #openstack-kolla10:07
*** ykarel is now known as ykarel|lunch10:11
*** cah_link has joined #openstack-kolla10:15
*** jrist has quit IRC10:24
*** jrist has joined #openstack-kolla10:25
*** cah_link has quit IRC10:27
cosmicsoundwhat could cause this in designate: http://paste.openstack.org/show/791389/10:32
*** weshay|ruck has quit IRC10:35
*** weshay_ has joined #openstack-kolla10:35
*** zzzeek has quit IRC10:44
*** zzzeek has joined #openstack-kolla10:45
*** ykarel|lunch is now known as ykarel10:52
*** rpittau is now known as rpittau|bbl11:05
*** pbing19 has quit IRC11:06
openstackgerritPiotr Rabiega proposed openstack/kolla master: add dpdk_telemetry and logparser, use centos-release-opstools for C8  https://review.opendev.org/71592311:06
*** cah_link has joined #openstack-kolla11:06
*** watersj has quit IRC11:11
*** watersj has joined #openstack-kolla11:14
cosmicsoundisnt kolla supposed to change itself docker.service when enabling etcd ?11:16
cosmicsound./etc/systemd/system/docker.service.d/kolla.conf this is still valid way to add extra docker.service configs?11:37
kevinzmnasiadka: yes right, I will enable debug and see what happen then11:53
mnasiadkakevinz: in theory l3-agent should run a full-sync, and spawn keepalived processes, create netns, etc - unless there's some problem with something :)11:54
kevinzmnasiadka: yes it should be this behavior11:55
*** jrist has quit IRC11:57
*** weshay_ has quit IRC11:59
*** hjensas has quit IRC12:01
*** dciabrin_ is now known as dciabrin12:02
*** dougsz has joined #openstack-kolla12:02
*** zzzeek has quit IRC12:05
*** zzzeek has joined #openstack-kolla12:06
*** weshay_ has joined #openstack-kolla12:10
*** weshay_ is now known as weshay|ruck12:12
*** Fl1nt has joined #openstack-kolla12:12
Fl1ntHello folks!12:12
Fl1ntDid someone already tried to deploy kolla using a RH8/CentOS8 podman engine ?12:13
*** rpittau|bbl is now known as rpittau12:15
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Custom haproxy script for monitoring galera  https://review.opendev.org/71021312:27
*** hjensas has joined #openstack-kolla12:41
*** hjensas is now known as hjensas|afk12:41
hrwFl1nt: k-a does not support podman.12:41
*** zzzeek has quit IRC12:44
*** zzzeek has joined #openstack-kolla12:45
*** jimcrowleyibm has joined #openstack-kolla12:51
*** jimcrowleyibm is now known as jimcrowleyibm[aw12:54
mgoddardFl1nt: it's been discussed before, but not implemented. There are a few things lacking in podman that we rely on - container restarts etc.13:05
mgoddardwould need to use systemd for a full replacement13:05
*** ykarel is now known as ykarel|mtg13:22
*** pbing19 has joined #openstack-kolla13:23
*** weshay has joined #openstack-kolla13:23
*** weshay|ruck has quit IRC13:25
*** bline has quit IRC13:25
noxoidyoctozepto, thanks for looking into that ovs firewall issue13:30
Fl1nt@mgoddard, ok, sweet, I'll have to use it sooner or later for a fully FCOS deployment, so glad to know that.13:34
mgoddardFl1nt: just to set expectations, it's been around for a while, and no one is actively working on it, or planning to AFAIK13:34
*** ykarel|mtg is now known as ykarel13:35
Fl1ntoh ok, that may be a god13:36
Fl1ntgood opportunity13:36
Fl1ntthen ^^13:36
*** zzzeek has quit IRC13:38
*** zzzeek has joined #openstack-kolla13:39
Fl1nt@mgoddard, If I'm not making any mistake, this restart thing is within the docker plugin isn't ?13:43
Fl1ntI mean the ansible plugin13:43
mgoddardFl1nt: it's something the docker daemon does, we just set the restart policy13:43
mgoddardwith podman there is no daemon to do the restarting. Hence why systemd is required13:44
Fl1ntyes, but I mean, as kolla use the docker add on to manage related container lifecycle, I could add the special podman related restart scenario in it.13:47
Fl1ntlike, if the addon detect it's not docker but podman then it target systemd13:48
Fl1ntinstead of the docker sdk13:48
*** Luzi has quit IRC13:54
mnasiadkamgoddard: is there something really urgent that we need the meeting tomorrow? I'm a bit busy at that time - so it would leave hrw and yoctozepto on the meeting mainly :)13:58
mgoddardmnasiadka: there's nothing unusual on the agenda, we can skip if yoctozepto and hrw want to14:02
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Custom haproxy script for monitoring galera  https://review.opendev.org/71021314:02
Fl1nt@mgoddard, Just to list a bit all the works required by having kolla to support podman, it would require a container_engine_binary var that default to docker, then if it's podman, don't call the docker plugin but rather the systemd plugin on each and every role right?14:15
*** pbing19 has quit IRC14:16
mgoddardFl1nt: I think there are a few things to cover. I'm a bit busy today, but we could go through it on Thursday if you like14:19
mgoddardFl1nt: see L559 on https://etherpad.openstack.org/p/kolla-ussuri-ptg for some ideas14:20
Fl1ntoki doo, sure no problem on thursday14:21
yoctozeptomgoddard, mnasiadka: yeah, we can skip; please inform the ml though14:21
mgoddardwill do14:22
yoctozeptonoxoid: sure, no problem, I feel a bit responsible still... similarity index was high enough to trust this14:22
*** dave-mccowan has quit IRC14:23
yoctozeptomnasiadka: https://review.opendev.org/714391 quickie14:23
patchbotpatch 714391 - kolla - Add nfs dependencies to glance container - 3 patch sets14:23
mnasiadkayoctozepto: can I be picky, and complain about 1) two packages in one line, 2) not alphabetically sorted? :D14:24
*** pbing19 has joined #openstack-kolla14:28
yoctozeptomnasiadka: be my guest, easy to fix14:28
yoctozeptomnasiadka: best just edit it14:28
yoctozeptomnasiadka: I will revote my +2 and approve14:28
*** zzzeek has quit IRC14:28
*** dave-mccowan has joined #openstack-kolla14:29
*** zzzeek has joined #openstack-kolla14:32
*** xinliang has joined #openstack-kolla14:35
openstackgerritMark Goddard proposed openstack/kayobe master: Don't use become for Kolla Ansible  https://review.opendev.org/71631414:37
openstackgerritMark Goddard proposed openstack/kayobe master: Avoid unconditional fact gathering  https://review.opendev.org/71631514:37
*** ykarel is now known as ykarel|away14:41
*** xinliang has quit IRC14:43
*** hjensas|afk is now known as hjensas14:59
*** dave-mccowan has quit IRC15:04
*** dave-mccowan has joined #openstack-kolla15:06
*** vishalmanchanda has quit IRC15:18
openstackgerritBharat Kunwar proposed openstack/kolla stable/train: Bump up mistral-dashboard, magnum and manila versions  https://review.opendev.org/71633915:21
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Avoid unconditional fact gathering  https://review.opendev.org/71634015:22
openstackgerritBharat Kunwar proposed openstack/kolla stable/train: Bump up magnum and manila versions  https://review.opendev.org/71633915:25
hrwmnasiadka: https://review.opendev.org/#/c/715166/ can you?15:26
patchbotpatch 715166 - kolla - Revert "openstack-base: pin setuptools < 46 to get... - 2 patch sets15:26
hrwyoctozepto: and you https://review.opendev.org/715202 one?15:27
patchbotpatch 715202 - kolla - CI: Ansiblify setup of builders - 8 patch sets15:27
*** vishalmanchanda has joined #openstack-kolla15:41
*** bengates has quit IRC15:54
*** dougsz has quit IRC15:56
*** skramaja has quit IRC15:59
*** dougsz has joined #openstack-kolla16:00
*** rpittau is now known as rpittau|afk16:07
yoctozeptohrw: this is our coauthorship, your vote is as good as mine :-) prefer mine?16:19
*** evrardjp has quit IRC16:36
*** evrardjp has joined #openstack-kolla16:36
watersjhi all, can someone point me at a good guide to masakari config. I was able upgrade to train and it up and running. Just need to define my segments and guess which of my "pets" it needs to power on16:47
yoctozeptowatersj: hi, I guess masakari channel or openstack-discuss mailing list would be better places to ask this question; we only really deploy it :-)16:51
watersjyoctozepto, ty, got try someplace 1st. masakari channel is very16:53
watersjlooks little light16:53
*** TrevorV has joined #openstack-kolla16:55
*** cah_link has quit IRC16:56
*** cah_link has joined #openstack-kolla16:56
*** sorin-mihai has joined #openstack-kolla16:56
yoctozeptowatersj: no problem; I would direct you at the folk who wrote the integration (and knows masakari) but he's not around atm...17:01
*** k_mouza has quit IRC17:01
*** k_mouza has joined #openstack-kolla17:03
watersjis anyone using it? documentation on interwebs and books seem light. I most likely going about it wrong way17:04
*** dougsz has quit IRC17:06
*** Mauriciorm has joined #openstack-kolla17:09
yoctozeptowatersj: it was recently added to kolla(-ansible), in Train cycle17:15
yoctozeptowatersj: could explain low usage17:15
yoctozeptowatersj: per what the folk said it is usable17:15
yoctozeptowatersj: it has some light testing in our CI: see tests/test-masakari.sh in kolla-ansible repo17:17
*** cah_link1 has joined #openstack-kolla17:18
MauriciormHello guys, good afternoon. I'm kind of new to the openstack world, I downloaded it, I managed to install all-in-one, now I'm looking to connect it to vcenter, I already have a functional environment with VMware. Where can I get better documentation on how to do this integration? Anyone with any complete documentation for this? Something for dummies17:19
*** cah_link has quit IRC17:19
*** cah_link1 is now known as cah_link17:19
hrwyoctozepto: :)17:23
watersjMauriciorm, might get shunned but why use openstack if you have vcenter, and rest vstuff? Is there something specific you are wanting out of OS?17:24
yoctozeptohrw: smiling for that +2?17:24
hrwo yes17:25
yoctozeptoMauriciorm: hello, this is an unusual question; more often we are asked how to migrate from vmware to openstack+kvm17:25
yoctozeptoMauriciorm: I wonder how you imagine this integration?17:26
* hrw off17:26
Mauriciormwatersj, I work in a state prod and offer services to the state departments and agencies. Today everything we do is manual, we have nothing automated and there is a lengthy process from the customer's request to the delivery of the result.17:26
hrwyoctozepto: and that ansiblify was mostly my work in your patch which I extracted as it was too huge to affect original one17:27
*** k_mouza has quit IRC17:27
hrwyoctozepto: anyway, once patch hit gerrit it is project's patch ;d17:27
MauriciormCustomers have almost no autonomy for anything.17:27
hrwMauriciorm: no way to give an account with resources quota?17:29
yoctozeptohrw: ++17:30
Mauriciormyoctozepto: My current environment has 1600 virtual servers, and migrating from vmware to kvm is a slow process, and vmware has an optimization of resources that kvm still has some time to go to reach it. I wanted to use kvm, but because of my "limitations" I still have to use vmware. If I had started from 0 everything is fine, but unfortunately it is not my case.17:30
yoctozeptoMauriciorm: I guess what you want is using openstack to manage vsphere hypervisors; I am not sure where vcenter fits in that; maybe best ask in #openstack ?17:31
watersjMauriciorm, might want to look at vRealize if budget allows17:32
Mauriciormhrw: Kind of complicated, because my environment has evolved over time and I end up having a basket of cats to manage.17:32
hrwMauriciorm: https://docs.openstack.org/nova/latest/admin/configuration/hypervisor-vmware.html maybe?17:32
*** ktibi has quit IRC17:32
Mauriciormwatersj: Vrealize is prohibitive because of the cost.17:34
watersjMauriciorm, agreed, why I'm looking at openstack+kvm, and ansible for provisioning17:36
Mauriciormhrw: This is more or less what I want to do, however I found that I need to put some OVS to control the network part and a proxy.17:36
Mauriciormwatersj: If it were openstack + kvm it would be ready. I have a friend who installed using the kolla and who was super easy and with 2 days was already in the air for his environment. That's because he had free equipment and was starting.17:38
* hrw out17:40
watersjMauriciorm, might be able to migrate to that overtime. hrw link is good starting spot.17:40
*** jbadiapa has quit IRC17:52
openstackgerritMark Goddard proposed openstack/kayobe master: Support custom Ansible configuration  https://review.opendev.org/71637818:04
*** gfidente is now known as gfidente|afk18:13
*** osmanlicilegi has quit IRC18:19
*** osmanlicilegi has joined #openstack-kolla18:21
*** Tony31 has quit IRC18:21
*** e0ne has quit IRC18:54
*** e0ne has joined #openstack-kolla18:55
*** cloudnull has quit IRC18:57
*** ktibi has joined #openstack-kolla19:01
*** dougsz has joined #openstack-kolla19:04
sean-k-mooneyquick question has anyone started lookign at running kolla ansible with ubuntu 20,0419:19
sean-k-mooneyim assuming that is planned for victoria rather then ussuri?19:19
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: [DNM] test rmq failure  https://review.opendev.org/71640419:23
*** ktibi has quit IRC19:24
yoctozeptosean-k-mooney: yeah, victoria, ussuri was already hard for c8 :-)19:25
*** vishalmanchanda has quit IRC19:28
sean-k-mooneyhaha no worries ya that is enough work for one release19:34
*** pbing19 has quit IRC19:35
*** pbing19 has joined #openstack-kolla19:35
yoctozeptosean-k-mooney: we expect focal to be easier due to no python switch and generally less earthquakes between ubuntu ltses19:37
yoctozeptosean-k-mooney: but really only time will tell ;-)19:37
sean-k-mooneyi was going to try and deploy on the nightly build and just see if it works19:43
*** TrevorV has quit IRC19:43
sean-k-mooneymy home server has some faulty ram which i removed but while i wait to get some replacment ram i was going to take the opertunity to try out 20.04 while i decied how im going to redeploy it19:44
yoctozeptosean-k-mooney: oh, would be great; any help welcome!19:44
sean-k-mooneyi was basicaly debating if i should install 18.04 20.04 or centos 8 but i want to eventually redeploy kolla ansible on it19:45
sean-k-mooneyi assumed 18.04 or centos 8 would make the most sense. but i dont need to make that choice for a few weeks19:46
yoctozeptosean-k-mooney: yeah, both are aggressively tested now :D19:47
sean-k-mooneyya before the hardwware iisue it was running 18.04 and train happily19:48
yoctozeptosame for ussuri19:49
*** sorin-mihai_ has joined #openstack-kolla20:03
*** sorin-mihai has quit IRC20:06
*** sorin-mihai__ has joined #openstack-kolla20:12
*** e0ne has quit IRC20:14
*** sorin-mihai_ has quit IRC20:15
*** cah_link has quit IRC20:29
*** dougsz has quit IRC20:34
hrwsean-k-mooney: first 20.04 needs to be released. then 20.04.1 be released to have something closer to stable. at which time I expect to have UCA so we can use 20.04 in kolla.21:03
*** diga has quit IRC21:04
hrwsean-k-mooney: for k-a we need docker-ce repo so again - 20.04 needs to be released.21:04
* hrw out21:04
sean-k-mooneyhrw: yep its slated for april 23rd i think21:04
sean-k-mooneyi installed the nightly build this morning but im currently runing memtest on the remain ram in my server to ensure it was only the 3 dims that i removed that were failing21:06
*** Mauriciorm has quit IRC21:08
*** Fl1nt has quit IRC21:17
*** noxoid has quit IRC21:26
*** e0ne has joined #openstack-kolla21:46
*** e0ne has quit IRC21:47
*** hrw has quit IRC21:54
*** hrw has joined #openstack-kolla21:58
*** ktibi has joined #openstack-kolla22:02
*** hrw has quit IRC22:10
*** watersj has quit IRC22:18
*** pbing19 has quit IRC23:48

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!