Monday, 2021-08-30

parallaxMorning07:03
*** amoralej|off is now known as amoralej07:11
Fl1nthowdy everyone!09:07
kevkomorning 09:20
opendevreviewRadosÅ‚aw Piliszek proposed openstack/kolla-ansible master: Restore libvirtd cgroupfs mount  https://review.opendev.org/c/openstack/kolla-ansible/+/80655509:36
priteauGood morning09:42
opendevreviewPierre Riteau proposed openstack/kayobe stable/wallaby: Fix documentation links for routed control plane networks  https://review.opendev.org/c/openstack/kayobe/+/80651809:50
opendevreviewRadosÅ‚aw Piliszek proposed openstack/kolla-ansible master: [CI] Test instance health after upgrade  https://review.opendev.org/c/openstack/kolla-ansible/+/80633109:53
priteauyoctozepto: Are you aware of breakage on ubuntu/xena? We are seeing this in Kayobe CI when building container images10:21
priteauGPG error: http://ubuntu-cloud.archive.canonical.com/ubuntu focal-updates/xena InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 5EDB1B62EC4926EA10:21
yoctozeptopriteau: not aware; is it running kolla there? or..?10:22
priteauIt runs "kayobe seed container image build ^base", which calls kolla-build10:23
priteauIt could be related to https://review.opendev.org/c/openstack/kolla/+/78492310:27
yoctozeptohmm, so does kayobe try to customise repos?10:32
priteauNope10:35
priteauThe patch linked above used to include this key10:35
priteau{# 391A9AA2147192839E9DB0315EDB1B62EC4926EA -- Canonical Cloud Archive Signing Key <ftpmaster@canonical.com> #}10:35
priteauIt can be installed with the ubuntu-cloud-keyring package10:35
priteauI don't know why we would see this only in kayobe and not in kolla CI. Does kolla check certificates?10:36
priteaus/kolla/kolla CI/10:36
opendevreviewPierre Riteau proposed openstack/kolla master: Install UCA GPG key  https://review.opendev.org/c/openstack/kolla/+/80656010:43
priteauTrying this as a fix ^^10:43
ignaziocassanoHello All, I have just update kolla wallaby with images released 37 hours ago but hacluster stopped working with them: 10:57
priteaubase_ubuntu_package_pre applies to debian too :/10:57
ignaziocassanoHello All, I have just update kolla wallaby with images released 37 hours ago but hacluster stopped working with them: TASK [hacluster : Ensure stonith is disabled] fails 10:58
opendevreviewPierre Riteau proposed openstack/kolla master: Install UCA GPG key  https://review.opendev.org/c/openstack/kolla/+/80656010:58
ignaziocassanosorry 27 hours ago10:58
ignaziocassanoThe firs controller reports the following in pacemaker.log :https://paste.openstack.org/show/808400/11:02
opendevreviewPierre Riteau proposed openstack/kolla master: Install UCA GPG key  https://review.opendev.org/c/openstack/kolla/+/80656011:16
*** Flint is now known as Fl1nt11:31
Fl1nttest11:33
yoctozeptoignaziocassano: is corosync running?11:54
ignaziocassanoyoctozepto: yes, it is. Now I am trying to  deployng again but bevore I stoppeed and removed hacluster containers and volumes11:59
ignaziocassanoyoctozepto: nou hacluster  container is running again but only on first controller. Is it right ?12:02
yoctozeptoignaziocassano: should be on all the controllers12:03
ignaziocassanoyoctozepto: Yes, I presume it should 12:04
yoctozeptopriteau: I think we avoided ignoring keys but let me check how we have done that now12:04
ignaziocassanoyoctozepto: Yes, I presume it should 12:05
ignaziocassanoyoctozepto: I runed again deploy but with  tags hacluster and now is running on all controllers12:06
ignaziocassanoyoctozepto: it is strange but now it is working fine12:08
ignaziocassanoyoctozepto: so I stopped and removed hacluster containers and columes. I runned deploy and then I runned deply again with -t hacluster :-)12:10
ignaziocassanoyoctozepto: now crm cluster status reports well12:11
yoctozeptoit should be enough to deploy it once; we test this in CI; the play always runs against all the controllers12:16
ignaziocassanoyoctozepto: probably I am impatient and I must wait hacluster containers appaer on the other controllers. Anycase the update left hacluster in error and I had to remove its container and volume and deploy again12:28
yoctozeptoignaziocassano: they appear after the role gets applied, no need to wait :D12:28
yoctozeptoignaziocassano: perhaps there is some race condition? I can't tell; it always succeeded for me so far12:29
kevkopriteau: hmm, I gave you +1 to UCA GPG key ..but instead of installing deb package, shouldn't be key just added to base_apt_keys dict ? 12:32
*** amoralej is now known as amoralej|lunch12:34
yoctozeptokevko: I am glad you are doing thorough reviews :-)12:40
kevko:D 12:40
kevkomaybe you can check proxysql patches :D :D :D 12:43
kevkoyoctozepto: but yeah, trying to do the best12:43
priteauyoctozepto: It's another option. I thought since we have a package, it will stay up to date even if the key changes.12:45
yoctozeptocores: there is a permanent failure in our multinode upgrade jobs in xena (master) due to cinder failing on OSM12:49
kevkopriteau: well, it was reworked because to be one key -> one repo .. if i am correct ..installing that package causes that key will be trusted globally 12:50
yoctozeptopriteau: yeah, in kolla we go with trusted=yes for base repos so we prevented this issue for non-base repos but still can hit for base ones; pity12:51
yoctozeptokevko, priteau: we need to fix the key anyhow; glad kayobe tests this and we catch this early12:51
priteauhappy to include the key directly if this is preferred?12:52
kevkopriteau: i think you can add similar block as debian has already for ubuntu also (debian using extrepo ..but it's only used to configure and then purged package), so similar block can be for ubuntu12:52
kevkopriteau: it's on line 277 master 12:52
yoctozeptopriteau: I think your patch makes sense12:53
yoctozeptojust can be done better12:54
yoctozeptocommenting inline now12:54
yoctozeptocommented12:55
kevkolet me try something 12:55
*** amoralej|lunch is now known as amoralej12:58
opendevreviewPierre Riteau proposed openstack/kolla master: Install UCA GPG key  https://review.opendev.org/c/openstack/kolla/+/80656013:10
parallaxI'm just browsing through package repositories configured in Kolla, curious on crmsh.repo 13:32
parallaxAny chance this is still used, eg. by Masakari ?13:32
yoctozeptoparallax: no, crmsh is not; it was added at some point by the previous folk who was about to add pacemaker and family14:06
yoctozeptobut we do not use it in KA14:06
parallaxyoctozepto: drop it ?14:07
yoctozeptoparallax: I would accept such a patch :-)14:07
parallaxgood14:08
kevkowho is developing elasticsearch-py ? elasticsearch ? 14:24
Fl1nt kevko seems so: https://elasticsearch-py.readthedocs.io/en/7.x/14:26
yoctozeptokevko: evil folks14:26
kevkohmm, reviewing this https://review.opendev.org/c/openstack/kolla/+/80599014:26
kevkoit looks like they stopped supporting oss version ? 14:27
yoctozeptokevko: yeah14:27
yoctozeptothat's why I called them evil14:27
yoctozepto;p14:27
yoctozeptoI forgot to +2 that, I had only a nit comment there14:27
* parallax can follow up on that to not waste yoctozepto's precious +214:29
parallaxbut I guess we're lacking cores on duty today :)14:30
kevkohmm, but what does it mean ? will they fix it for OSS or it is  their intention to disable it?14:33
kevkoi mean disable oss functionality ..14:34
yoctozeptoparallax: yeah, we truly are14:34
yoctozeptokevko: no idea, amazon forked their own version, we might want to switch to that at some point14:35
parallaxit's similar to this: https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/1005 - notice the thumbs down on this one from the community14:38
kevkosadly :(14:41
kevkothey (oss responsible guys) should fork elasticsearch-py library and removing this sh*** from code :D 14:43
kevkobtw, someone for review this one line ? :P https://review.opendev.org/c/openstack/kolla-ansible/+/775627 ? 14:53
opendevreviewPierre Riteau proposed openstack/kayobe master: [WIP] Build overcloud host image directly with DIB  https://review.opendev.org/c/openstack/kayobe/+/77260915:14
*** amoralej is now known as amoralej|off15:40
priteauyoctozepto: I proposed a kayobe patch (just above) with Depends-On on my kolla UCA patch and it passes kayobe-seed-ubuntu-focal which was failing before15:48
opendevreviewMerged openstack/kolla master: haproxy: Use haproxy 2.2.x  https://review.opendev.org/c/openstack/kolla/+/80451317:52
dmsimardFYI, ansiblefest agenda is out: https://www.ansible.com/ansiblefest -> https://events.ansiblefest.redhat.com/widget/redhat/ansible21/sessioncatalog, contributor summit registrations are also open: https://ansiblecs202109.eventbrite.com/18:00
yoctozeptopriteau: ++18:10
opendevreviewMerged openstack/kolla master: Install UCA GPG key  https://review.opendev.org/c/openstack/kolla/+/80656018:24
opendevreviewMerged openstack/kolla stable/ussuri: Unify curl options  https://review.opendev.org/c/openstack/kolla/+/80564418:24
opendevreviewMerged openstack/kolla stable/victoria: Unify curl options  https://review.opendev.org/c/openstack/kolla/+/80564318:25
opendevreviewMerged openstack/kolla master: docs: add feature freeze to release management  https://review.opendev.org/c/openstack/kolla/+/80601318:25
opendevreviewJames Kirsch proposed openstack/kolla-ansible master: Support for keystone scoped authorization  https://review.opendev.org/c/openstack/kolla-ansible/+/69217919:19
opendevreviewMaksim Malchuk proposed openstack/kolla master: Unify curl use (customisation options)  https://review.opendev.org/c/openstack/kolla/+/80564020:15
opendevreviewMaksim Malchuk proposed openstack/kolla master: Unify curl use (customisation options)  https://review.opendev.org/c/openstack/kolla/+/80564020:25
opendevreviewJames Kirsch proposed openstack/kolla-ansible master: Support for keystone scoped authorization  https://review.opendev.org/c/openstack/kolla-ansible/+/69217922:11
opendevreviewJames Kirsch proposed openstack/kolla-ansible master: Support for keystone scoped authorization  https://review.opendev.org/c/openstack/kolla-ansible/+/69217923:39

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!