Wednesday, 2020-11-04

*** LinPeiWen has joined #openstack-kolla00:32
*** strobert has quit IRC01:54
yan0sI have found a workaround on the issue that monasca-agent container could not access the libvirt socket01:55
yan0sby changing the "libvirt_uri" variable from "qemu:///system" to "qemu+tcp://node-hostname/system"01:59
yan0sbut I hardcoded the change in "/var/lib/kolla/venv/lib/python3.6/site-packages/monasca_agent/collector/virt/libvirt/inspector.py" file01:59
yan0sit seems that the code can read this value by a configuration file02:00
yan0scfg.StrOpt('libvirt_uri' ....02:01
yan0sdoes anyone which file it is?02:01
*** strobert has joined #openstack-kolla02:05
*** strobert has quit IRC02:14
*** strobert has joined #openstack-kolla02:14
*** kwazar has quit IRC02:15
*** skramaja has joined #openstack-kolla03:04
*** zzzeek has quit IRC03:24
*** zzzeek has joined #openstack-kolla03:25
*** JamesBenson has quit IRC05:21
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-kolla05:33
*** wuchunyang has joined #openstack-kolla05:46
*** k_mouza has joined #openstack-kolla06:08
*** k_mouza has quit IRC06:12
*** vishalmanchanda has joined #openstack-kolla06:26
*** cah_link has joined #openstack-kolla07:02
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Temporarily disable rabbitmq internal tls  https://review.opendev.org/76128207:03
*** abdysn has joined #openstack-kolla07:04
mnasiadkamgoddard, yoctozepto: ^^ need to disable until this is fixed in oslo.messaging/requirements, it will unblock CI/gate.07:05
*** xinliang has joined #openstack-kolla07:09
*** jbadiapa has quit IRC07:33
*** jbadiapa has joined #openstack-kolla08:09
*** shyamb has joined #openstack-kolla08:18
*** shyam89 has joined #openstack-kolla08:18
*** shyamb has quit IRC08:19
*** shyam89 has quit IRC08:19
*** shyam89 has joined #openstack-kolla08:20
*** shyamb has joined #openstack-kolla08:20
*** shyamb has quit IRC08:20
*** shyam89 has quit IRC08:20
*** shyamb has joined #openstack-kolla08:21
*** kwazar has joined #openstack-kolla08:23
*** xinliang has quit IRC08:37
*** shyam89 has joined #openstack-kolla08:37
*** shyamb has quit IRC08:39
*** dougsz has joined #openstack-kolla08:42
*** gfidente has joined #openstack-kolla08:49
*** e0ne has joined #openstack-kolla08:51
*** bengates has joined #openstack-kolla08:58
*** bengates has quit IRC08:59
*** bengates has joined #openstack-kolla09:00
*** dougsz has quit IRC09:00
*** rpittau|afk is now known as rpittau09:05
shyam89Hi09:06
shyam89compare_containers taskr un by check-containers.yaml in kolla-ansible is always resulting in 'changed' mode09:06
shyam89and hence our containers are getting restarted on every deployment even if there is no change happened09:07
shyam89https://github.com/trilioData/triliovault-cfg-scripts/blob/master/kolla-ansible/ansible/roles/triliovault/tasks/check-containers.yml09:07
shyam89This task does not provide reason of the "changed" status09:08
shyam89How can we debug this?09:08
wuchunyangyour can try docker inspect your container, and compare with the valued defined in tasks ?09:11
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN: Make OVS db entries idempotent  https://review.opendev.org/75063109:15
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN: Make OVS db entries idempotent  https://review.opendev.org/75063109:15
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN: Make OVS db entries idempotent  https://review.opendev.org/75063109:15
*** xinliang has joined #openstack-kolla09:24
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN: Make OVS db entries idempotent  https://review.opendev.org/75063109:27
openstackgerritMark Goddard proposed openstack/kayobe stable/ussuri: docs: Add link back to Train CentOS 8 migration page  https://review.opendev.org/76132809:33
openstackgerritMark Goddard proposed openstack/kayobe stable/ussuri: Fix filtering of network names set to an empty string  https://review.opendev.org/76133009:35
openstackgerritMark Goddard proposed openstack/kayobe stable/train: Fix filtering of network names set to an empty string  https://review.opendev.org/76133109:35
openstackgerritMark Goddard proposed openstack/kayobe stable/stein: Fix filtering of network names set to an empty string  https://review.opendev.org/76133209:35
shyam89yoctozepto: Hi09:44
shyam89let me know when you get online09:44
*** shyamb has joined #openstack-kolla09:48
*** shyam89 has quit IRC09:49
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN: Make OVS db entries idempotent  https://review.opendev.org/75063109:50
openstackgerritMichal Nasiadka proposed openstack/kolla master: neutron: Fix update-alternatives on CentOS  https://review.opendev.org/76118209:51
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: horizon: Support custom themes  https://review.opendev.org/76136409:54
*** wuchunyang has quit IRC10:18
yoctozeptoshyamb: is it you who waited for me?10:22
mnasiadkawe have all been waiting for you :D10:26
*** xinliang has quit IRC10:37
shyambyoctozepto: Hi, Yes.10:37
shyambI am having issue with kolla_docker ansible module for 'compare_container' action10:38
shyambIt's always resulting in 'changed' mode10:38
shyambyoctozepto: Here is my check-containers yaml: https://github.com/trilioData/triliovault-cfg-scripts/blob/4.1OSI/kolla-ansible/ansible/roles/triliovault/tasks/check-containers.yml10:39
shyambfor other openstack services it does not result in changed mode. For triliovault services only we are having this issue10:40
shyambHow can we debug it?10:40
*** k_mouza has joined #openstack-kolla10:41
shyambIssue seems with compare_labels: https://github.com/openstack/kolla-ansible/blob/stable/ussuri/ansible/library/kolla_docker.py#L33610:42
shyambIf I remove this function call, things are working fine10:43
mnasiadkaso inspect the image and running container10:46
mnasiadkaif they have the same labels10:46
shyambmnasiadka: Okay10:53
mnasiadkait might be that they are presented in a different manner and the compare function has some flaw - but it works on all Kolla built containers properly...10:56
shyambmnasiadka: Hi11:13
shyambWe keep our docker images in private docker registry11:13
shyambwhile debugging I saw check_image at https://github.com/openstack/kolla-ansible/blob/stable/ussuri/ansible/library/kolla_docker.py#L41811:14
shyambwas of 'NoneType' throwing error11:15
*** e0ne has quit IRC11:26
*** abdysn has quit IRC11:43
*** shyamb has quit IRC11:44
*** abdysn has joined #openstack-kolla11:45
*** e0ne has joined #openstack-kolla11:58
*** JamesBenson has joined #openstack-kolla12:04
*** JamesBenson has quit IRC12:06
*** JamesBenson has joined #openstack-kolla12:06
*** e0ne has quit IRC12:14
*** nikparasyr has joined #openstack-kolla12:24
*** Abdallahyas has joined #openstack-kolla12:38
*** abdysn has quit IRC12:41
openstackgerritMichal Nasiadka proposed openstack/kolla master: toolbox: Add sudoers for kolla_toolbox become  https://review.opendev.org/76140312:48
mnasiadkadoh, curator build broken again? huh12:54
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: toolbox: Add support for become  https://review.opendev.org/76120812:55
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN: Make OVS db entries idempotent  https://review.opendev.org/75063112:56
*** skramaja has quit IRC13:14
*** e0ne has joined #openstack-kolla13:17
*** Luzi has joined #openstack-kolla13:19
*** kevko has quit IRC13:27
*** luksky has joined #openstack-kolla13:41
*** Abdallahyas has quit IRC14:07
*** TrevorV has joined #openstack-kolla14:37
*** born2bake has joined #openstack-kolla14:51
*** abdysn has joined #openstack-kolla14:56
mgoddard#startmeeting kolla15:01
openstackMeeting started Wed Nov  4 15:01:41 2020 UTC and is due to finish in 60 minutes.  The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
*** openstack changes topic to " (Meeting topic: kolla)"15:01
openstackThe meeting name has been set to 'kolla'15:01
mgoddard#topic rollcall15:02
*** openstack changes topic to "rollcall (Meeting topic: kolla)"15:02
mgoddard\o15:02
mgoddardmgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi bbezak15:02
hrw]o]15:02
yoctozeptoo/15:06
yoctozeptotaking a break after a day-long meeting15:06
* yoctozepto might be sluggish to respond15:06
yoctozeptoping me15:06
JamesBenson\o15:07
*** dcapone2004 has joined #openstack-kolla15:09
mgoddard#topic agenda15:09
*** openstack changes topic to "agenda (Meeting topic: kolla)"15:09
mgoddard* Roll-call15:09
mgoddard* Announcements15:09
mgoddard  ** Vote for Kolla Wallaby priorities https://etherpad.opendev.org/p/kolla-wallaby-priorities15:09
mgoddard* Review action items from the last meeting15:09
mgoddard* CI status15:09
mgoddard* Victoria release planning15:10
mgoddard* Wallaby PTG actions15:10
mgoddard#topic announcements15:10
*** openstack changes topic to "announcements (Meeting topic: kolla)"15:10
mgoddard#info Vote for Kolla Wallaby priorities15:10
mgoddard#link https://etherpad.opendev.org/p/kolla-wallaby-priorities15:10
mgoddardNot too many votes on there yet, please add your name on up to 12 items15:10
mgoddard#topic Review action items from the last meeting15:11
*** openstack changes topic to "Review action items from the last meeting (Meeting topic: kolla)"15:11
mgoddardundeprecate VMware15:11
mgoddarddid it happen?15:11
mgoddardhttps://review.opendev.org/#/c/747512/15:12
patchbotpatch 747512 - kolla-ansible - Revert VMware deprecation (MERGED) - 2 patch sets15:12
mgoddardI guess so15:12
mgoddard#topic CI status15:12
*** openstack changes topic to "CI status (Meeting topic: kolla)"15:12
mgoddardmnasiadka:15:13
mnasiadkaOh boy15:13
mgoddardSeems like we have some issues15:13
mnasiadkaKolla - I think curator strikes again, but need to verify15:13
mgoddardis the whiteboard up to date?15:13
mnasiadkaYes, up to date15:13
mgoddardgreat15:13
mnasiadkaEspecially with the Nova rmq tls15:14
yoctozeptolooking now15:14
mnasiadkaThere is a change to disable rmq tls testing in CI15:14
mnasiadkaAnd a change to requirements to pin kombu and amqp to old versions15:14
mnasiadkaBecause new kombu and amqp tandem causes incompat with oslo.messaging15:15
yoctozeptoNFV is minor - nobody seems to care15:15
yoctozeptoescurator was fixed in master I guess, no?15:15
yoctozepto"workarounded"15:15
mgoddardnew issue15:15
mnasiadkaI saw a failed build today in master...15:16
yoctozeptogeez15:16
yoctozeptoso older branches are affected double xD15:16
yoctozeptocould you add links?15:16
yoctozeptoI don't see the kombu issue either15:16
yoctozeptoor is it ovn?15:16
mnasiadkaNo, nova15:17
mnasiadkaI’ll check and update in 5 mins15:17
yoctozeptomnasiadka -> https://etherpad.opendev.org/p/KollaWhiteBoard15:17
yoctozeptomake sure it always gets there finally :-)15:17
mgoddardis anyone working on escurator?15:18
mgoddardI have no time this week15:19
mgoddardshall we mark it as unbuildable until someone has time to work on it/15:20
yoctozeptok-a looks green to me15:20
yoctozeptomgoddard: paste a link to failed build in the whiteboard15:20
mgoddardthere is one15:20
yoctozeptothat one was fixed15:20
yoctozeptoyou mean it fails exactly the same again?15:21
yoctozeptowhat the escurator15:21
yoctozepto:D15:21
mgoddardit's slightly different15:21
mgoddardlast time it was boto15:23
hrwkill it with napalm15:23
mgoddardcurate it15:23
yoctozeptowe seriously need that tiering approach15:23
mgoddard#action mgoddard check if escurator broken and mark unbuildable if so15:24
*** Luzi has quit IRC15:24
yoctozeptoI mean, one practically would not care to have outdated escurator image15:24
yoctozepto(for not too long)15:24
mnasiadkaso, we could switch to binary from packages.elastic.co15:25
mnasiadkabut there are no aarch64 packages15:25
*** dcapone2004 has quit IRC15:26
mnasiadkayoctozepto: the Nova issue is in k-a section in whiteboard, but in reality it's Kolla issue, or rather requirements/Nova/oslo.messaging issue :)15:27
mgoddardlet's move on15:28
mgoddardif anyone has time for curator, go for it15:28
mgoddard#topci Victoria release planning15:28
mgoddard#topic Victoria release planning15:28
*** openstack changes topic to "Victoria release planning (Meeting topic: kolla)"15:28
mgoddardmnasiadka proposed kolla RC115:29
mgoddardwhat about kolla-ansible and kayobe?15:29
mgoddardhttps://review.opendev.org/#/c/761159/15:29
patchbotpatch 761159 - releases - Release kolla 11.0.0.0rc1 - 3 patch sets15:29
mgoddardkayobe is probably not ready yet15:29
mnasiadkakolla-ansible - I would prefer to branch it when simple CI jobs work15:30
mnasiadkanow it's not the case :)15:30
*** brinzhang0 has joined #openstack-kolla15:30
mgoddard#link https://docs.openstack.org/kolla/latest/contributor/release-management.html15:30
mgoddardmnasiadka: well, as you said that's a kolla issue :p15:30
mnasiadkahaha15:30
mnasiadkahttps://launchpad.net/kolla-ansible/+milestone/11.0.015:30
mnasiadkaare those bugs stoppers for branching rc?15:31
mgoddardonly the OVN one is high15:31
mgoddardand that's in released code15:31
*** abdysn has quit IRC15:31
mnasiadkaYeah, but it needs rework - it's on my list, but it doesn't mean it doesn't work at all now :)15:32
*** brinzhang_ has quit IRC15:32
mgoddardI don't think they are RC blockers15:32
mnasiadkaok, I'll raise the k-a change to releases today then15:32
mnasiadkawhat about kayobe?15:33
mgoddardhttps://docs.openstack.org/kayobe/latest/contributor/releases.html15:33
yoctozeptomnasiadka: but I don't see k-a periodic jobs failing on nova...15:34
mnasiadkayoctozepto: interestingly, do we run {centos8/ubuntu}-source in periodics15:35
mnasiadka?15:35
mnasiadkano, just the upgrade ones.15:35
mnasiadkaand the task that is failing, is waiting for nova-compute to get registered15:36
mnasiadkaI guess in upgrade it's already registed, so we survive15:36
mnasiadkamaybe after all we should run those standard tasks in periodic, so we know that they are all right?15:39
mgoddardthey should be run often enough15:39
mgoddardkayobe RC1 depends on kolla RC115:40
mgoddardbut if anyone wants to sync the config, that would be good15:40
mgoddardand renos15:40
mnasiadkaI'll look into that tomorrow15:41
mgoddardhopefully I'll have more time to push the release tasks forward next week15:43
mgoddard#topic Wallaby PTG actions15:43
*** openstack changes topic to "Wallaby PTG actions (Meeting topic: kolla)"15:43
mgoddard#link https://etherpad.opendev.org/p/kolla-wallaby-ptg15:43
*** k_mouza has quit IRC15:43
mgoddardTODO(): High level documentation, eg. examples of networking config, diagrams, justification of use of containers, not k8s etc.15:43
mgoddardTODO(): document justification for kolla/kolla-ansible15:43
mgoddardTODO(yoctozepto): wait for zuul-runner, try it out, fix issues, document how to use it15:43
mgoddardTODO(mgoddard): Poll community for a new kolla klub timeslot15:43
mgoddardTODO(Fl1nt): Call for contributor campaign, offer some (limited) mentorship15:43
mgoddardTODO(mgoddard): Reach out to existing community members in non EU/US15:43
mgoddardTODO() find 'interested parties' for infra image CI work15:43
mgoddardTODO(Fl1nt): add a note to documentation (FAQ/troubleshooting?) about new Docker hub limits15:43
mgoddardTODO(): ask opendev infra about open source project application process15:43
mgoddardTODO(): add tags for register & bootstrap?15:43
mgoddardTODO(yoctozepto): make genconfig + deploy-containers work15:43
mgoddardTODO(yoctozepto): Deprecate reconfigure command15:43
mgoddardTODO(): Modernise the old skool Swift role15:43
mgoddardTODO(Fl1nt, or others): PoC and/or spec for podman15:43
mgoddardTODO(yoctozepto): work on masakari hostmonitor integration15:44
mgoddardTODO(headphoneJames): write up high level description of how Letsencrypt fits together15:44
mgoddardTODO(): write a high level design document/spec for kayobe multiple environments15:44
mgoddardTODO(): 'Deprecate' devicemapper on stable branches, require some action (set a flag) to override15:44
mgoddardTODO(jovial): make a kayobe story for switching to networkmanager15:44
mgoddardTODO(dougszu): Strip out Grafana post configure functionality and move it to Kolla-Ansible15:44
mgoddardTODO(dougszu): Investigate ansible collections, reference custom playbook repo (e.g. kayobe-ops)15:44
mgoddardwe have some people assigned15:44
mgoddardif there is something you can help with, please add your name on the etherpad15:44
mgoddardand if you are assigned to something, please don't forget :)15:44
*** kevko has joined #openstack-kolla15:44
mgoddardany ideas for how we get better at actually doing these?15:44
mnasiadkahttps://review.opendev.org/761433 - kolla-ansible victoria rc115:44
patchbotpatch 761433 - releases - Release kolla-ansible 11.0.0.0rc1 - 1 patch set15:44
mnasiadkamgoddard: a better tool than etherpad for tracking status? :)15:45
mgoddardwhat could be better?15:45
yoctozeptomnasiadka: but we run zun15:46
yoctozeptoand it's even more demanding15:47
yoctozeptohttps://zuul.openstack.org/build/b0016619a2d846c0bdedb3494ea2bb1515:47
mgoddard#topic Open discussion15:48
*** openstack changes topic to "Open discussion (Meeting topic: kolla)"15:48
mnasiadkamgoddard: I don't know, I have a perspective that people often vanish for the whole cycle and don't pick up anything they signed up for :)15:48
mgoddardthat can happen15:49
mgoddardalso sometimes people appear that weren't at the PTG15:49
mnasiadkayoctozepto: do we enable backend tls?15:49
mgoddardtrue, that be the difference15:49
mnasiadkamgoddard: I'm just more a graphical board type of a guy, than someone skimming a kilometer long etherpad in search of something I could do :)15:49
mnasiadkayes, the bug is related to Nova RMQ backend TLS - nothing else.15:50
mnasiadkathat's why I proposed a change to disable it in the CI for the time being, and revert when it comes back to shape.15:50
mgoddardmnasiadka: when was the last time someone skimmed LP blueprints for something to do (and did it?)15:50
mnasiadkayeah, that's another thing, we did some cleanup, but nobody is looking at that either :)15:51
mnasiadkaAnyway, people signed up for some stuff, let's hope they update etherpad as they go, and we have a blueprint attached to each of those items for easier tracking :)15:51
mnasiadkapolish complaining mode off15:52
mgoddardanything for open discussion?15:52
yoctozeptomnasiadka; why Polish?15:52
yoctozeptomgoddard, mnasiadka: tls, ack15:52
mnasiadkayoctozepto: we are known for complaining all the time15:52
yoctozeptoneed to run periodics with those15:52
yoctozeptomnasiadka: pff, I've seen worse ;p15:53
hrwI am The Main Complainer at Linaro15:53
mnasiadkathat's the spirit :)15:53
hrwunofficial title for years15:53
headphoneJamesfor lets encrypt integration - are we are initially targeting external vip certs?15:53
mgoddardheadphoneJames: the API needs to be publicly accessible for ACME to work15:54
mnasiadkaopen discussion - I started moving openvswitch tasks to modules instead of command: - but it needs changes in ansible_sudoers file in kolla_toolbox - https://review.opendev.org/#/c/761403/ - any votes against doing this change?15:54
patchbotpatch 761403 - kolla - toolbox: Add sudoers for kolla_toolbox become - 1 patch set15:54
mnasiadka(not counting that we still have ceph related stuff in ansible_sudoers :-) )15:55
mnasiadkayoctozepto: so if ack - then +2 here please https://review.opendev.org/#/c/761282/15:56
patchbotpatch 761282 - kolla-ansible - CI: Temporarily disable rabbitmq internal tls - 1 patch set15:56
mgoddardmnasiadka: find_disks also for swift15:56
mnasiadkaah15:56
mnasiadkaso I'll add that back15:56
mgoddardmnasiadka: can we not use a more specific pattern?15:57
mnasiadkawell, if we add -b flag to ansible run in kolla_toolbox, then most probably we can't, right?15:58
mnasiadkaunless we run sudo to ansible command, instead of using -b flag?15:58
mnasiadka*run ansible command with sudo (sudo ansible bla bla), not the -b (become) function of Ansible15:58
*** LinPeiWen has quit IRC16:00
mnasiadkamgoddard: unless I'm mistaken in my thinking :)16:00
mgoddardyou could run ansible with -vvv and see what commands it executes via sudo16:01
mgoddardbut I guess probably just python <some gross ansible module blob>16:01
mnasiadkawell, I guess it's python16:01
mnasiadkaand we only need to run openvswitch_* modules as root, because the permissions on ovs db.sock is root:root16:01
mnasiadkaunless we add ansible to root group in kolla_toolbox container... hmm16:02
mgoddardsudo -H -S -n  -u root /bin/sh -c '"'"'echo BECOME-SUCCESS-bjpknhkgjmkrldiquxksmyoydwrudipv ; /usr/bin/python /home/mark/.ansible/tmp/ansible-tmp-1604505753.73-227606553818806/AnsiballZ_openvswitch_db.py16:02
mnasiadkathat would be one nasty regex with openvswitch_db.py in the end16:03
mgoddardwhat about docker execing as root?16:03
*** k_mouza has joined #openstack-kolla16:03
mnasiadkawell, that's another idea, we could rework kolla_toolbox to exec as root16:04
mnasiadkain theory the user: option is for that16:04
mnasiadkabut I think it didn't work as I expected, will experiment16:04
mgoddardas you pointed out, we use the rabbitmq user for rabbitmq16:05
mgoddardanyways, meeting time up16:05
mgoddardthanks all16:05
mgoddard#endmeeting16:05
*** openstack changes topic to "IRC meetings on Wednesdays @ 15:00 UTC - agenda @ https://goo.gl/OXB0DL | Whiteboard: https://bit.ly/2MM7mWF | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b | PTG: https://bit.ly/3ou3mMg"16:05
openstackMeeting ended Wed Nov  4 16:05:23 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:05
openstackMinutes:        http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-11-04-15.01.html16:05
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-11-04-15.01.txt16:05
openstackLog:            http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-11-04-15.01.log.html16:05
*** e0ne has quit IRC16:07
*** dcapone2004 has joined #openstack-kolla16:13
*** k_mouza has quit IRC16:14
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: OVN: Make OVS db entries idempotent  https://review.opendev.org/75063116:18
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: OVN: Make OVS db entries idempotent  https://review.opendev.org/75063116:19
*** k_mouza has joined #openstack-kolla16:19
mnasiadkamgoddard: seems it works, I overcomplicated :)16:19
openstackgerritMichal Nasiadka proposed openstack/kolla master: curator: Add wheel to elasticsearch-curator  https://review.opendev.org/76144216:25
mnasiadkahrw, yoctozepto, mgoddard: ^^ curator fix...16:26
mnasiadkaseems python3-wheel was missing in centos16:27
hrw+216:27
openstackgerritMichal Nasiadka proposed openstack/kolla master: neutron: Fix update-alternatives on CentOS  https://review.opendev.org/76118216:30
*** cah_link has quit IRC16:37
*** nikparasyr has left #openstack-kolla16:46
yoctozeptomnasiadka, hrw: so... is the previous fix unnecessary?17:08
yoctozeptoI mean previous workaround*17:08
mnasiadkayoctozepto: tested, it is necessary17:09
mnasiadkaAs long as curator folks will not fix their reqs with urllib17:09
*** bengates_ has joined #openstack-kolla17:11
*** bengates has quit IRC17:14
*** bengates_ has quit IRC17:15
*** jonaspaulo has joined #openstack-kolla17:21
*** gfidente is now known as gfidente|afk17:25
*** jonaspaulo has quit IRC17:27
*** rpittau is now known as rpittau|afk17:35
*** vishalmanchanda has quit IRC17:38
*** jonaspaulo has joined #openstack-kolla17:38
*** k_mouza has quit IRC17:38
*** e0ne has joined #openstack-kolla17:59
*** jonaspaulo has quit IRC17:59
dcapone2004is there a procedure for backing up kolla?  I am talking about the deployment station and I am envisioning a scenario where there is a catastrophic failure of the deployment server....What needs to be backed up and how should it be restored so that the replacement system can continue day 2 management of the openstack cluster?18:05
dcapone2004and does the hostname on any replacement node need to the same or can the hostname be a different name as long as it can still reach all managed nodes via the hostnames18:06
*** dcapone2004 has quit IRC18:19
openstackgerritMerged openstack/kolla-ansible master: CI: Temporarily disable rabbitmq internal tls  https://review.opendev.org/76128218:44
r3ap3rQuck question, I see in my kolla containers' logs an error that is `File "/var/lib/kolla/venv/lib/python3.6/site-packages/glance_store/_drivers/filesystem.py",` however my venv environment was created with Python 3.8. Should I be using Python 3.6 as my Python virtual environment or does that not really matter?19:08
*** luksky has quit IRC19:12
*** luksky has joined #openstack-kolla19:24
*** k_mouza has joined #openstack-kolla19:39
*** dcapone2004 has joined #openstack-kolla19:41
*** k_mouza has quit IRC19:43
yoctozeptor3ap3r: should not matter19:53
r3ap3ryoctozepto: ok, cool. Thanks. :)19:54
yoctozeptodcapone2004: you want to backup the mariadb databases19:54
yoctozeptodcapone2004: and kolla-ansible has an action for that19:54
yoctozeptodcapone2004: you should likely also backup all your deployment blueprints (inventory, globals, config overrides, kolla-ansible version used etc.)19:55
dcapone2004I know about the mariadb_databases.....that moreso also backs up openstack itself correct?19:55
yoctozeptodcapone2004: you might want to backup cinder volumes and alike as well but it's out of scope for kolla itself19:55
yoctozeptodcapone2004: all information is stored in mariadb19:56
yoctozeptodcapone2004: all control plane details are there19:56
yoctozeptodcapone2004: you only don't get instances data there for obvious reasons :-)19:56
dcapone2004but do I need to backup /etc/kolla so a new install of kolla knows the current status of the cluster or is all of that in mariadb?19:56
dcapone2004so on a new node with a fresh install of kolla, i can do mariadb_recovery and it will know the status of the cluster and what containers are already where if I have the same passwords.yml, globals.yml and multinode file?19:57
*** luksky has quit IRC20:01
yoctozeptodcapone2004: yeah; if you only lose the controllers, then you can pretty easily restore them with this20:13
*** luksky has joined #openstack-kolla20:13
*** e0ne has quit IRC20:31
*** JamesBenson has quit IRC21:24
*** dcapone2004 has quit IRC22:19
*** TrevorV has quit IRC22:29
*** gfidente|afk has quit IRC22:32
*** born2bake has quit IRC22:47
*** luksky has quit IRC22:48
openstackgerritMerged openstack/kolla master: curator: Add wheel to elasticsearch-curator  https://review.opendev.org/76144223:39

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!