Wednesday, 2020-12-02

*** LinPeiWen has quit IRC00:30
*** LinPeiWen has joined #openstack-kolla00:35
*** k_mouza has joined #openstack-kolla00:46
*** rouk has quit IRC00:48
*** LinPeiWen has quit IRC00:53
*** k_mouza has quit IRC00:54
*** xinliang has joined #openstack-kolla01:03
*** vesper11 has joined #openstack-kolla01:09
*** LinPeiWen has joined #openstack-kolla01:36
*** zenkuro has quit IRC02:14
*** k_mouza has joined #openstack-kolla02:23
*** k_mouza has quit IRC02:27
*** Arador has quit IRC03:17
*** k_mouza has joined #openstack-kolla03:33
*** k_mouza has quit IRC03:37
*** skramaja has joined #openstack-kolla03:41
*** vishalmanchanda has joined #openstack-kolla04:38
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-kolla05:33
*** xinliang has quit IRC05:49
openstackgerritLin PeiWen proposed openstack/kolla-ansible master: Add default support for octavia physical network  https://review.opendev.org/c/openstack/kolla-ansible/+/76505705:54
*** ladrua has joined #openstack-kolla06:08
*** dasTor has quit IRC06:31
*** dasTor has joined #openstack-kolla06:32
*** brinzhang0 has joined #openstack-kolla06:46
*** brinzhang_ has quit IRC06:49
*** dasTor has quit IRC06:58
*** dasTor has joined #openstack-kolla07:00
*** cah_link has joined #openstack-kolla07:10
*** zzzeek has quit IRC07:13
*** zzzeek has joined #openstack-kolla07:14
*** brinzhang_ has joined #openstack-kolla07:32
*** k_mouza has joined #openstack-kolla07:33
*** brinzhang0 has quit IRC07:35
*** k_mouza has quit IRC07:38
*** xinliang has joined #openstack-kolla07:38
*** wuchunyang has joined #openstack-kolla07:46
*** nikparasyr has joined #openstack-kolla07:48
*** bengates has joined #openstack-kolla08:09
*** k_mouza has joined #openstack-kolla08:16
*** k_mouza has quit IRC08:20
*** rpittau|afk is now known as rpittau08:28
*** skramaja has quit IRC08:34
*** andrewbonney has joined #openstack-kolla08:34
osmanlicilegimorning08:37
openstackgerritChristian Berendt proposed openstack/kolla master: Add prometheus-ovs-exporter image  https://review.opendev.org/c/openstack/kolla/+/76499508:51
*** obre has joined #openstack-kolla08:59
*** k_mouza has joined #openstack-kolla09:14
*** ladrua has quit IRC09:15
*** luksky has joined #openstack-kolla09:15
*** ladrua has joined #openstack-kolla09:16
*** ladrua has quit IRC09:20
*** ladrua has joined #openstack-kolla09:21
*** ladrua has quit IRC09:27
*** ladrua has joined #openstack-kolla09:28
*** abdysn has joined #openstack-kolla09:51
*** k_mouza has quit IRC10:02
*** k_mouza has joined #openstack-kolla10:05
*** happyhemant has joined #openstack-kolla10:05
*** wuchunyang has quit IRC10:07
*** gfidente has joined #openstack-kolla10:21
*** xinliang has quit IRC10:42
*** e0ne has joined #openstack-kolla10:57
LinPeiWenWhy is the path of the openstack_dev_mode volume11:04
LinPeiWen '/var/lib/kolla/venv/lib/python3/site-packages/nova'11:05
LinPeiWenInstead of direct11:05
LinPeiWen'/usr/lib/python3.6/site-packages/nova/' :')11:06
hrwLinPeiWen: because in source images we install into virtualenv?11:11
*** skramaja has joined #openstack-kolla11:14
openstackgerritlikui proposed openstack/kolla-ansible master: update lower-constraints.txt  https://review.opendev.org/c/openstack/kolla-ansible/+/76511611:17
LinPeiWenIs there a document on how to use openstack_dev_mode?11:18
*** k_mouza has quit IRC11:43
*** zenkuro has joined #openstack-kolla11:44
*** shyamb has joined #openstack-kolla11:51
*** brinzhang_ has quit IRC11:52
*** brinzhang_ has joined #openstack-kolla11:52
*** k_mouza has joined #openstack-kolla12:01
*** abdysn has quit IRC12:16
*** abdysn has joined #openstack-kolla12:16
*** zenkuro has quit IRC12:21
*** zenkuro has joined #openstack-kolla12:22
*** e0ne has quit IRC12:40
*** Fl1nt has joined #openstack-kolla12:52
Fl1ntHi everyone!12:52
*** vesper11 has quit IRC12:53
*** jbadiapa has joined #openstack-kolla12:55
*** Luzi has joined #openstack-kolla13:03
*** TrevorV has joined #openstack-kolla13:16
*** Abdallahyas has joined #openstack-kolla13:20
*** abdysn has quit IRC13:24
*** e0ne has joined #openstack-kolla13:34
*** Luzi has quit IRC13:51
*** wuchunyang has joined #openstack-kolla13:51
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: Use Docker healthchecks for barbican services  https://review.opendev.org/c/openstack/kolla-ansible/+/76514014:06
*** shyamb has quit IRC14:17
openstackgerritdou proposed openstack/kolla master: ironic-inspector install iptables  https://review.opendev.org/c/openstack/kolla/+/76514614:22
*** dougsz has joined #openstack-kolla14:28
*** kodim has joined #openstack-kolla14:38
*** kodim has quit IRC14:39
*** kodim has joined #openstack-kolla14:39
*** kodim has quit IRC14:40
*** dougsz has quit IRC14:41
*** kodim has joined #openstack-kolla14:43
*** rafaelweingartne has joined #openstack-kolla14:51
wuchunyangmeeting ?14:55
rafaelweingartnein 4 min., I guess14:56
wuchunyang3 min now,14:57
*** kodim21 has joined #openstack-kolla14:57
*** rafaelweingartne has quit IRC15:03
*** rafaelweingartne has joined #openstack-kolla15:03
*** kodim21 has left #openstack-kolla15:03
*** msalo has joined #openstack-kolla15:03
yoctozepto#startmeeting kolla15:10
openstackMeeting started Wed Dec  2 15:10:48 2020 UTC and is due to finish in 60 minutes.  The chair is yoctozepto. Information about MeetBot at http://wiki.debian.org/MeetBot.15:10
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:10
*** openstack changes topic to " (Meeting topic: kolla)"15:10
openstackThe meeting name has been set to 'kolla'15:10
yoctozepto#topic Roll-call15:11
yoctozeptoo/15:11
*** openstack changes topic to "Roll-call (Meeting topic: kolla)"15:11
yoctozepto\o/15:11
osmanlicilegio/15:11
yoctozeptomgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi bbezak15:11
yoctozeptomgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi bbezak - meeting time15:11
* yoctozepto doing another meeting concurrently15:11
* mnasiadka lies down under a builder called work issues15:12
* yoctozepto knows how mnasiadka is feeling15:12
yoctozeptowuchunyang: meeting15:14
Fl1nt\o15:14
wuchunyango/15:14
yoctozepto#topic Agenda15:14
*** openstack changes topic to "Agenda (Meeting topic: kolla)"15:14
yoctozepto* Roll-call15:14
yoctozepto* Announcements15:14
yoctozepto* Review action items from the last meeting15:14
yoctozepto* CI status15:15
yoctozepto* Victoria release planning15:15
yoctozepto* Dockerhub pull rate limits https://etherpad.opendev.org/p/docker-pull-limits15:15
yoctozepto* Cinder active/active https://bugs.launchpad.net/kolla-ansible/+bug/190406215:15
openstackLaunchpad bug 1904062 in kolla-ansible wallaby "external ceph cinder volume config breaks volumes on ussuri upgrade" [High,In progress] - Assigned to Michal Nasiadka (mnasiadka)15:15
yoctozepto* Wallaby PTG actions15:15
yoctozepto(but I believe we will skip the issues since too many cores are missing)15:15
yoctozepto#topic Announcements15:15
*** openstack changes topic to "Announcements (Meeting topic: kolla)"15:15
yoctozeptoanyone has any announcements?15:16
Fl1ntnot so far ^^ still working on few patches such as cloudkitty and SSO15:16
yoctozeptono announcements today then15:18
yoctozepto#topic Review action items from the last meeting15:18
*** openstack changes topic to "Review action items from the last meeting (Meeting topic: kolla)"15:18
yoctozepto#info mgoddard to try reverting to https://review.opendev.org/c/openstack/requirements/+/761194/215:18
yoctozeptoit happened15:18
yoctozepto#info yoctozepto fix NFV15:18
yoctozeptoit happened as well15:18
yoctozeptonot sure if merged15:18
yoctozepto#link https://review.opendev.org/c/openstack/kolla-ansible/+/76481615:19
yoctozeptoit seems Tacker folks started observing the change15:19
yoctozeptoplease review anyhow15:19
yoctozeptolet it be green15:19
Fl1ntWe'll have a look.15:20
yoctozepto#info yoctozepto deprecate the retired Wallabies15:20
Fl1ntOo meh??15:20
yoctozeptohe did not because gmann told me they are to be dropped entirely15:20
Fl1ntah ah ah ^^15:20
yoctozepto(well, using 3rd and 1st person to mean  myself went ugly)15:20
Fl1ntlet be kind with the wallabies :p15:21
yoctozeptoFl1nt: no, we are actually not15:21
yoctozeptowe are kicking them out of the nest15:21
Fl1ntpoor poor animals :D15:21
yoctozeptoit is about the retired projects in the wallaby cycle15:21
yoctozeptono animals were hurt during this15:21
yoctozeptofor the record :-)15:22
Fl1ntOuf ^^15:22
Fl1ntLets clean everything! with vaccum \o/15:22
yoctozeptoindeed15:23
yoctozepto#topic CI status15:23
*** openstack changes topic to "CI status (Meeting topic: kolla)"15:23
yoctozeptokolla looks pretty green15:24
yoctozeptok-a as well15:25
yoctozeptocurrent kayobe branches GREEN as well15:25
Fl1nthouray!15:25
yoctozeptoI wonder why we are keeping the status for stein, rocky and queens15:25
yoctozeptoI'd say drop15:26
Fl1ntI Don't know ^^15:26
yoctozeptobut not doing without blessing from the others and there seems to be only me here being core :-)15:26
yoctozeptoanyhow15:26
Fl1ntmaybe there are few people still relying on rocky/stein and waiting for their maintenance windows to update?15:26
yoctozeptofeeling good for having green CI15:26
Fl1ntyeah, that's a cool step15:27
yoctozeptoFl1nt: undoubtedly15:27
yoctozeptobut it's not the upstream focus15:27
yoctozepto#topic Victoria release planning15:27
*** openstack changes topic to "Victoria release planning (Meeting topic: kolla)"15:27
yoctozeptoseriously hard to discuss it with myself :-)15:27
Fl1ntsure15:27
Fl1nthave to wait for some additional core members.15:28
mnasiadkayoctozepto: we need to fix cinder, but I lack time and a testing env - we need to wait for Mark to be back next week ;)15:29
Fl1ntSo, officially, cinder only support cluster_name since microversion 3.61 from Victoria: https://youtu.be/54f6SmUifdA?t=68815:29
yoctozeptoFl1nt: yeah, more so when I had health issues and not in 100% shape still15:30
yoctozeptomnasiadka: I planned on doing lightweight cinder testing as it's in my "care scope"15:30
yoctozeptobut, well, health is a traitor15:30
Fl1ntmine too, but I'm stuck to train for now and at least 3 more months.15:30
yoctozeptoand more so new gerrit really made it harder for me to concentrate on what matters :P15:31
Fl1ntI'm pushing for an upgrade really hard, but we have roadmap release date that come closer so it will be for our next sprint.15:31
mnasiadkayoctozepto: we just need to handle upgrade cases15:32
Fl1ntyeah new gerrit interface is quite disturbing and refreshing in the same time, really awkward feeling.15:32
Fl1ntmnasiadka, only from Ussuri to Victoria right?15:33
*** Abdallahyas has quit IRC15:33
mnasiadkaNope15:33
mnasiadkaWe need to handle both backend_host and no backend_host configs15:34
Fl1ntwell, it wasn't officially introduced before victoria so I doubt it would be clever to enforce it on Ussuri15:34
Fl1ntaaaah15:34
Fl1ntok15:34
Fl1ntthought you were talking about cluster_name15:34
mnasiadkaBecause backend_host was in docs and some people use it15:34
Fl1ntyep15:34
Fl1ntand it was indeed "natively" used by k-a at some point.15:34
mnasiadkawell, we need to use cluster_name, but we need to move from broken to proper a/a somehow15:35
mnasiadkaWithout telling users to remove all volumes :)15:35
Fl1ntso T/U needs backend_host and then from U/V we need to upgrade the conf with cluster_name and cluster_name need to retrieve its value from the older backend_host.15:35
yoctozepto^ this15:35
yoctozeptowe need to properly fix all expected envs15:36
yoctozeptoit is a bit convoluted15:36
yoctozeptoas we made an error in an error15:36
yoctozepto:-)15:36
Fl1nt^ that one will be challenging as you can reliably know and predict users cluster confs.15:36
Fl1nts/can/can't/15:36
yoctozeptoyeah, we can't, we will have to document and communicate it well as well15:37
Fl1ntyep15:37
Fl1ntfirst ERRATUM for K-A \o/15:37
yoctozeptofar from first15:37
*** devfaz has quit IRC15:38
*** devfaz has joined #openstack-kolla15:40
yoctozeptoall right, we are pretty short in people today so I am doing a trick now15:40
yoctozepto#topic Open discussion15:41
*** openstack changes topic to "Open discussion (Meeting topic: kolla)"15:41
yoctozeptoplease raise anything you want15:41
rafaelweingartneI would like to ask about our patch https://review.opendev.org/c/openstack/kolla-ansible/+/69543215:41
rafaelweingartnewhich is introducing support to Open ID Connect15:42
rafaelweingartnewe updated it with a detailed document on how to create a DEV env. to test it15:42
rafaelweingartneas we discussed in the PTL meeting, people were not comfortable to approve it, because they did not know how to test it.15:42
yoctozeptooh, great; that will help15:42
rafaelweingartnewe hope that this will facilitate things now15:42
yoctozeptoyeah, you mean the PTG15:43
rafaelweingartneexactly15:43
rafaelweingartneI am bad with acronyms15:43
rafaelweingartne:)15:43
yoctozeptono problem15:43
*** skramaja has quit IRC15:44
headphoneJamesI would like to have a couple eyes on the lets encrypt spec:  https://etherpad.opendev.org/p/kolla-ansible-letsencrypt-https15:45
Fl1ntrafaelweingartne, I'm doing the SAML2 part of your patch, we should coordinate to have federation as a whole supported.15:46
rafaelweingartnethat would be awesome15:46
rafaelweingartneI would like to finish and merge this patch first though. It is too big already15:46
rafaelweingartneIf you need any help to add the SAML support to it, just ping me15:47
*** nikparasyr has left #openstack-kolla15:49
Fl1ntI've finished it, I just need time to push my patch but overhaul I need to discuss with you about implementation details.15:49
rafaelweingartneThat is cool, just let me know when you are ready then15:50
*** wuchunyang has quit IRC15:53
yoctozeptoheadphoneJames: you got mine15:55
yoctozeptoheadphoneJames: I left several comments15:55
headphoneJamesyoctozepto: sweet, and thanks15:55
yoctozeptoheadphoneJames: overally great and I see how it will work15:55
yoctozepto:-)15:55
headphoneJamesI've done a first pass at implementation that is working15:56
yoctozeptoheadphoneJames: yay15:57
yoctozeptoall right15:58
yoctozeptothank you all very much for attending15:58
yoctozeptohave a good rest of the day (or night)15:59
yoctozepto#endmeeting15:59
*** openstack changes topic to "IRC meetings on Wednesdays @ 15:00 UTC - agenda @ https://goo.gl/OXB0DL | Whiteboard: https://bit.ly/2MM7mWF | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b"15:59
openstackMeeting ended Wed Dec  2 15:59:06 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:59
openstackMinutes:        http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-12-02-15.10.html15:59
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-12-02-15.10.txt15:59
openstackLog:            http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-12-02-15.10.log.html15:59
headphoneJamesthanks yoctozepto15:59
*** cah_link has quit IRC16:04
*** luksky has quit IRC16:08
Fl1ntrafaelweingartne, overall, I'd like to get this variable to drive the different jinja template: keystone_federation_type: with value being either undefined/saml2/oidc that would allow for a simple on/off of the federation integration, but also let us prepare for any additional providers that could arise.16:09
Fl1ntheadphoneJames, quick question regarding your let's encrypt implementation? How do you manage air-gapped platforms? Is there any scenario available or a way to disable it?16:11
*** brinzhang0 has joined #openstack-kolla16:14
*** brinzhang_ has quit IRC16:16
headphoneJamesFl1nt: it wouldn't work in air-gapped platforms. It should not be enabled in that type of deployment16:18
headphoneJamesFl1nt: It needs to be explicitly enabled and configured16:19
Fl1ntyes, my point, we just need a way to fallback to more "manual" way to do it ^^16:19
Fl1ntoh ok perfect16:19
headphoneJamesSelf-signed certs are not being removed16:20
Fl1ntnice, just to be noted regarding: 6.0 a container shouldn't have more than exactly one process running, so having haproxy running a script that trigger a cronjob is kinda limit ^^16:21
Fl1ntit's ok because it's part of HAProxy feature (such as with MYSQL for exemple)16:21
Fl1ntbut we need to be carefull16:22
*** devfaz has quit IRC16:23
Fl1ntheadphoneJames, overall, I like what I see on this blueprint :D GG16:23
headphoneJamesthanks16:24
headphoneJamesregarding more than one process per container - LetsEncrypt requires that certbot be run in the same container that is running the ACME server since it needs to restart the process. I tried splitting ACME and certbot into two containers and could not get it to work16:25
Fl1ntYeah, that's why I said that it's OK, this is a specific case where until better solution we can't do it differently.16:29
yoctozeptoheadphoneJames: odd; I believe it can do it without seeing the server16:30
yoctozeptoI've been doing that basically16:30
yoctozeptoyou tell it only the path to the exposed directory16:30
Fl1ntyeah, using certonly would probably work TBH16:31
Fl1ntas describe in here: https://certbot.eff.org/docs/install.html#running-with-docker16:31
Fl1ntthen your cronjob is doing the signaling to reload HAPROXY16:32
*** rafaelweingartne has quit IRC16:42
*** devfaz has joined #openstack-kolla16:47
*** bengates has quit IRC16:48
*** bengates has joined #openstack-kolla16:49
*** e0ne has quit IRC16:51
*** bengates has quit IRC16:53
*** rpittau is now known as rpittau|afk17:04
yoctozeptomnasiadka: could you approve https://review.opendev.org/c/openstack/kolla-ansible/+/764956 and all its cherrypicks? this fix will improve upgrades stability17:09
mnasiadkayoctozepto: aren't vars in restart_services.yml a bit redundant? we're supplying them in the loop?17:11
mnasiadkaarh, maybe not - it's too late to think ;)17:14
*** jonaspaulo has joined #openstack-kolla17:17
*** Fl1nt has quit IRC17:18
*** luksky has joined #openstack-kolla17:18
*** cah_link has joined #openstack-kolla17:20
yoctozeptomnasiadka: could be, I guess the include inherits the env?17:24
yoctozeptowell, anyhow, this is already a backport17:24
yoctozeptoand it is clean enough and works :-)17:24
mnasiadkayeah, that's why I said it's too late ;)17:24
yoctozeptomnasiadka: you said 'to think'17:25
yoctozeptomnasiadka: but it's too late to think too17:25
yoctozeptomnasiadka: time to rest :-)17:25
mnasiadkayoctozepto: well, it's a backport, no need for a lot of thinking ;)17:25
*** e0ne has joined #openstack-kolla17:41
*** k_mouza has quit IRC17:47
openstackgerritMichal Nasiadka proposed openstack/kolla master: Unify curl options  https://review.opendev.org/c/openstack/kolla/+/76518517:48
*** cah_link has quit IRC17:50
*** kodim has quit IRC17:50
*** k_mouza has joined #openstack-kolla17:57
*** k_mouza has quit IRC18:01
*** andrewbonney has quit IRC18:19
*** gfidente is now known as gfidente|afk18:40
*** vishalmanchanda has quit IRC18:58
*** jonaspaulo has quit IRC18:58
*** e0ne has quit IRC19:16
openstackgerritMerged openstack/kolla-ansible stable/victoria: RabbitMQ handler refactored to restart services in serial  https://review.opendev.org/c/openstack/kolla-ansible/+/76495619:24
openstackgerritMerged openstack/kolla-ansible stable/ussuri: RabbitMQ handler refactored to restart services in serial  https://review.opendev.org/c/openstack/kolla-ansible/+/76495719:41
openstackgerritMerged openstack/kolla-ansible stable/train: RabbitMQ handler refactored to restart services in serial  https://review.opendev.org/c/openstack/kolla-ansible/+/76495919:41
*** e0ne has joined #openstack-kolla19:50
*** mchlumsky has quit IRC20:01
*** mchlumsky has joined #openstack-kolla20:03
*** mchlumsky has quit IRC20:05
*** mchlumsky has joined #openstack-kolla20:06
*** e0ne has quit IRC20:11
*** vesper11 has joined #openstack-kolla20:15
*** JamesBenson has joined #openstack-kolla20:19
*** vesper has joined #openstack-kolla20:19
*** vesper11 has quit IRC20:19
*** brinzhang_ has joined #openstack-kolla20:58
*** brinzhang0 has quit IRC21:01
*** rouk has joined #openstack-kolla21:04
roukhmm, anyone on ussuri notice that for some unexplained reason, designate-worker logs arent being collected? i see nothing wrong with the config...21:04
*** waverider has joined #openstack-kolla21:05
roukdesignate-api is fine, and in the same dir, and matches the same pattern.21:05
*** vesper has quit IRC21:06
waveriderhi. I'm running kolla-ansible prechecks (after successful bootstrap-servers) from git repo vicoria branch on Ubuntu 20.04 localhost (ansible master, as well as localhost target system). And I get error aboyut missing "docker" python lib. Should the script install this? https://pastebin.pl/view/b4f7284221:28
*** vesper11 has joined #openstack-kolla21:30
waverideri think that .pl pastebin just crashed :) so here's a copy: https://pastebin.ubuntu.com/p/BJksr8MpJm/21:31
*** TrevorV has quit IRC21:33
*** waverider has quit IRC21:36
*** waverider has joined #openstack-kolla21:37
waveriderSame error with current kolla-ansible master. And if I create a separate venv and set a ansible_python_interpreter, I get another error on ansible_python_interpreter: ansible_python_interpreter: fatal: [localhost]: FAILED! => {"changed": false, "msg": "Could not import python modules: apt, apt_pkg. Please install python3-apt package."}. System package is there (dpkg -l|grep python3-apt).21:49
waverider*on bootstrap-servers (this time, with venv)21:49
waveriderfixed the 2nd problem (apt missing) after recreating the venv with `--system-site-packages` (so I guess this should be added to docs). Fixed the second problem (cannot import docker), after manually pip install docker in target env. The second one looks like a bug (?). Who should install docker py lib?21:57
waveridercreated https://bugs.launchpad.net/kolla-ansible/+bug/190656622:16
openstackLaunchpad bug 1906566 in kolla-ansible "bootstrap-servers with ven: Could not import python modules: apt, apt_pkg" [Undecided,New]22:16
*** msalo has quit IRC22:17
*** cah_link has joined #openstack-kolla22:26
*** jbadiapa has quit IRC22:39
*** k_mouza has joined #openstack-kolla23:16
*** k_mouza has quit IRC23:21
*** happyhemant has quit IRC23:54
*** luksky has quit IRC23:57

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!