Thursday, 2020-06-04

*** Torel has quit IRC00:10
*** Torel has joined #openstack-kolla00:12
*** dcapone2004 has joined #openstack-kolla01:18
*** cah_link has joined #openstack-kolla01:21
*** cah_link has quit IRC01:27
*** cah_link has joined #openstack-kolla01:27
*** cah_link1 has joined #openstack-kolla01:39
*** cah_link has quit IRC01:41
*** cah_link1 is now known as cah_link01:41
*** diurnalist has quit IRC01:42
dcapone2004is there a procedure anywhere for how to gracefully shutdown a kolla based openstack cluster?01:43
dcapone2004everything I have found is old and mentions little things like recovery works better now or similar one liner mentions, but no real step by step procedures01:43
*** also_stingrayza has joined #openstack-kolla01:49
*** stingrayza has quit IRC01:52
*** cah_link has quit IRC02:07
*** k_mouza has joined #openstack-kolla02:07
*** k_mouza has quit IRC02:13
*** diurnalist has joined #openstack-kolla02:32
*** k_mouza has joined #openstack-kolla02:55
*** k_mouza has quit IRC03:00
kplantisn't there a `kolla-ansible stop` ?03:32
*** cah_link has joined #openstack-kolla04:09
*** skramaja has joined #openstack-kolla04:10
*** Torel has quit IRC04:21
*** cah_link has quit IRC04:25
*** ykarel|away is now known as ykarel04:31
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-kolla04:33
sorin-mihaimaybe i caused this with some changes that i forgot about. i noticed that a deploy would keep waiting for mariadb to be available via haproxy and then fail if database_address is set to "{{ kolla_internal_fqdn }}", which seems to be the default in master. changed to "{{ api_interface_address }}" and testing. was this introduced recently or i borked my git branch?04:34
*** wuchunyang has joined #openstack-kolla04:39
*** diurnalist has quit IRC04:56
*** wuchunyang has quit IRC05:07
*** nikparasyr has joined #openstack-kolla05:23
*** oklhost has quit IRC05:35
*** ricolin has joined #openstack-kolla05:36
*** oklhost has joined #openstack-kolla05:39
*** seco has joined #openstack-kolla05:42
*** cah_link has joined #openstack-kolla05:44
*** jaicaa has quit IRC05:51
*** vishalmanchanda has joined #openstack-kolla05:51
*** jaicaa has joined #openstack-kolla05:54
*** abdysn has joined #openstack-kolla06:08
*** sorin-mihai has quit IRC06:11
*** sorin-mihai has joined #openstack-kolla06:29
*** wuchunyang has joined #openstack-kolla06:37
*** Tony31 has joined #openstack-kolla06:39
Tony31Hi, what is the current release that can be deployed with Kayobe? Is it Train or Ussuri? I ask because I don't see Ussuri listed in the releases here: https://opendev.org/openstack/kayobe-config06:40
*** k_mouza has joined #openstack-kolla06:58
*** k_mouza has quit IRC07:03
mnasiadkaTony31: then it's Train07:07
Tony31👍 thank you Michael07:07
Tony31The documentation pages say this at the top "This release is under development. The current supported release is Ussuri." FYI07:08
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Add framework to deploy user-defined containers on seed  https://review.opendev.org/70968907:20
mnasiadkaTony31: but this is master branch documentation - you don't want to use that in production07:21
mnasiadkaTony31: you should read the stable branch documentation, e.g. train07:21
mnasiadkaTony31: since there is no ussuri branch/docs for Kayobe currently - (it returns 404)07:23
mnasiadkathe message on the top of the page with link to Ussuri - is global to OpenStack, it does not distinct if a project has released Ussuri yet or not :)07:23
*** nathharp_ has quit IRC07:24
*** nathharp has joined #openstack-kolla07:24
Tony31Ah thank you for explaining!07:25
*** k_mouza has joined #openstack-kolla07:30
*** amoralej|off is now known as amoralej07:36
*** bengates has joined #openstack-kolla07:44
*** bengates has quit IRC07:47
*** bengates has joined #openstack-kolla07:47
*** rpittau|afk is now known as rpittau07:50
hrwmorning07:59
hrwyoctozepto: can you +w on https://review.opendev.org/#/c/723286/ patch?07:59
patchbotpatch 723286 - devstack - Fix devstack default settings in aarch64 - 3 patch sets07:59
mgoddardmorning08:09
Tony31Morning :)08:24
*** born2bake has joined #openstack-kolla08:28
*** also_stingrayza is now known as stingrayza08:32
*** gfidente has joined #openstack-kolla08:36
*** wuchunyang has quit IRC08:39
openstackgerritMark Goddard proposed openstack/kolla stable/ussuri: Switch to RDO Ussuri release on CentOS  https://review.opendev.org/73179808:45
yoctozeptohrw: done08:46
yoctozeptomorning channel08:46
openstackgerritWill Szumski proposed openstack/kayobe master: Add note about hardware package dropping python 2 support  https://review.opendev.org/73308908:50
*** kevko has joined #openstack-kolla08:54
*** bsanjeewa has joined #openstack-kolla08:57
*** priteau has joined #openstack-kolla08:58
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Fix glance backend TLS configuration task  https://review.opendev.org/73349108:59
*** bsanjeewa_ has joined #openstack-kolla08:59
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Switch to Monasca API for logs  https://review.opendev.org/73349208:59
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Custom haproxy script for monitoring galera  https://review.opendev.org/73349309:00
*** bsanjeewa has quit IRC09:02
openstackgerritMark Goddard proposed openstack/kolla master: Remove centos-nfs-ganesha28 from repos.yaml  https://review.opendev.org/73349809:08
hrwyoctozepto: thx09:08
openstackgerritMerged openstack/kolla-ansible master: Add EL8 packages.  https://review.opendev.org/73163109:11
*** oyrogerg has joined #openstack-kolla09:28
*** k_mouza has quit IRC09:37
*** ricolin has quit IRC09:39
*** bsanjeewa has joined #openstack-kolla09:46
*** bsanjeewa_ has quit IRC09:50
*** YvesG has joined #openstack-kolla09:50
*** mchlumsky4 has joined #openstack-kolla09:55
*** sorin-mihai_ has joined #openstack-kolla09:55
*** skramaja_ has joined #openstack-kolla09:56
*** born2bake has quit IRC09:57
*** skramaja has quit IRC09:57
*** mchlumsky has quit IRC09:57
*** kevinz has quit IRC09:57
*** mchlumsky4 is now known as mchlumsky09:57
*** sorin-mihai has quit IRC09:57
*** e0ne has joined #openstack-kolla09:58
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Add EL8 packages.  https://review.opendev.org/73351809:58
*** rpittau is now known as rpittau|bbl10:02
hrwmgoddard: can you next time use better patch titles?10:05
hrwmgoddard: whole ussuri cycle was 'add el8 packages'10:05
mgoddardhrw: I always use good patch titles. It's a backport10:05
hrwmgoddard: I am aware that it is backport.10:06
mgoddardhrw: I'm not going to change the title of a backport10:06
hrwit is a backport so we do not change it as it would stop being backport10:07
mgoddardhrw: so what did I do wrong?10:07
hrwmgoddard: 'component: Add EL8 packages' or sth like that?10:08
mgoddardhrw: it's not my patch!10:08
hrwmgoddard: ok10:08
mgoddardI don't disagree it's a bad title10:08
hrwsorry then ;D10:09
mgoddardmaybe look at the review next time? :p10:09
hrwtitle distracts ;d10:09
hrwwill leave comment on master patch10:10
*** Torel has joined #openstack-kolla10:16
*** k_mouza has joined #openstack-kolla10:17
*** k_mouza has quit IRC10:22
priteauCan I remove the pull-retag-push item from Kayobe priority candidates? It's been copied to Kolla already.10:32
mgoddardpriteau: go for it10:35
hrwhttps://review.opendev.org/730331 guys?10:40
patchbotpatch 730331 - kolla - CI: use wheels from infra mirror - 4 patch sets10:40
*** stingrayza has quit IRC10:51
*** wuchunyang has joined #openstack-kolla10:53
openstackgerritMerged openstack/kolla master: Use CentOS official mirrors for Ceph packages  https://review.opendev.org/73250510:56
openstackgerritMerged openstack/kolla stable/ussuri: Add ceph releases per-distro to support matrix  https://review.opendev.org/73306910:56
openstackgerritMerged openstack/kolla stable/train: Add ceph releases per-distro to support matrix  https://review.opendev.org/73311910:56
openstackgerritMark Goddard proposed openstack/kolla stable/train: Fix monasca-grafana by pinning more Ruby gems  https://review.opendev.org/73355711:08
*** wuchunyang has quit IRC11:11
openstackgerritMark Goddard proposed openstack/kolla stable/ussuri: Switch to RDO Ussuri release on CentOS  https://review.opendev.org/73179811:12
hrwhttps://review.opendev.org/731480 https://review.opendev.org/730331 makes our images use binary wheels from infra. would love to get some extra eyes on them11:13
patchbotpatch 731480 - kolla-ansible - CI: use wheels from infra mirror - 1 patch set11:13
patchbotpatch 730331 - kolla - CI: use wheels from infra mirror - 4 patch sets11:13
hrwprobably should drop 'when: not publisher' part11:13
*** Torel has quit IRC11:15
*** Torel has joined #openstack-kolla11:19
openstackgerritMark Goddard proposed openstack/kolla-ansible master: barbican: Use python3 plugin in uwsgi config  https://review.opendev.org/73356211:20
*** e0ne has quit IRC11:33
*** e0ne has joined #openstack-kolla11:33
*** e0ne has quit IRC11:34
*** e0ne has joined #openstack-kolla11:34
openstackgerritMerged openstack/kolla-ansible stable/stein: Avoid unconditional fact gathering  https://review.opendev.org/73268811:34
*** rpittau|bbl is now known as rpittau11:35
*** ricolin has joined #openstack-kolla11:36
*** Torel has quit IRC11:44
*** Torel has joined #openstack-kolla11:46
*** stingrayza has joined #openstack-kolla11:48
sorin-mihai_i'm trying to run 'reconfigure' but TASK [nova : Running Nova API bootstrap container] keeps getting stuck for some reason. 'docker logs nova_api_bootstrap' says the last thing run is 'nova-manage db sync' and that was 10 minutes ago.11:51
*** hjensas|afk is now known as hjensas11:57
*** Torel has quit IRC12:05
*** Torel has joined #openstack-kolla12:07
*** cah_link has quit IRC12:08
openstackgerritMerged openstack/kolla-ansible master: Stop to use the __future__ module.  https://review.opendev.org/73285412:11
openstackgerritMerged openstack/kolla-ansible master: Use api_interface as migration_interface default value  https://review.opendev.org/72948212:11
openstackgerritMerged openstack/kolla master: Stop to use the __future__ module.  https://review.opendev.org/73285312:11
openstackgerritMerged openstack/kolla-ansible stable/ussuri: Add EL8 packages.  https://review.opendev.org/73351812:11
*** dougsz has joined #openstack-kolla12:12
sorin-mihai_half an hour since started and the task is still stuck. how can i debug this?12:14
*** amoralej is now known as amoralej|lunch12:14
yoctozeptomnasiadka: https://review.opendev.org/732603 + ussuri one, see https://ethercalc.openstack.org/kolla-infra-service-matrix as well - sure about ubuntu nautilus?12:22
patchbotpatch 732603 - kolla - Add ceph releases per-distro to support matrix (MERGED) - 1 patch set12:22
mnasiadkayoctozepto: I'll double check, I'm pretty sure it was Nautilus last time I checked...12:23
*** arxcruz has quit IRC12:28
*** cah_link has joined #openstack-kolla12:28
*** arxcruz has joined #openstack-kolla12:29
*** Torel has quit IRC12:29
*** zijlboot has joined #openstack-kolla12:30
*** Torel has joined #openstack-kolla12:32
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Use api_interface as migration_interface default value  https://review.opendev.org/73358612:33
*** calbers_ has joined #openstack-kolla12:33
*** zijlboot_ has quit IRC12:33
*** dmellado_ has joined #openstack-kolla12:35
*** hrww has joined #openstack-kolla12:35
*** benj_- has joined #openstack-kolla12:36
hrwwhttps://review.opendev.org/#/c/731487/ needs second brave core and we can get rid of pre-ussuri junk12:36
patchbotpatch 731487 - kolla-ansible - CI: drop pre-ussuri upgrade support - 3 patch sets12:36
*** Tengu_ has joined #openstack-kolla12:36
*** zzzeek has quit IRC12:36
*** calbers has quit IRC12:36
*** dmellado has quit IRC12:36
*** arxcruz has quit IRC12:36
*** kukacz_ has quit IRC12:36
*** benj_ has quit IRC12:36
*** _Cyclone_ has quit IRC12:36
*** tonyb has quit IRC12:36
*** Tengu has quit IRC12:36
*** numans has quit IRC12:36
*** mjturek has quit IRC12:36
*** dswebb has quit IRC12:36
*** hrw has quit IRC12:36
*** bjolo_ has quit IRC12:36
*** benj_- is now known as benj_12:36
*** hrww is now known as hrw12:36
*** dmellado_ is now known as dmellado12:37
*** calbers_ is now known as calbers12:37
*** arxcruz has joined #openstack-kolla12:37
*** zzzeek has joined #openstack-kolla12:38
zijlbootI want to physically move my controllers to new bare-metal nodes... deploying all the services is easy but how about RabbitMQ and MariaDB, what's the best approach using Kolla?12:38
zijlbootCan I simply run the mariadb task while adding one new node and have it sync, and then run again and remove an old and sofort?12:39
openstackgerritRadosław Piliszek proposed openstack/kolla stable/ussuri: Switch to RDO Ussuri release on CentOS  https://review.opendev.org/73179812:39
zijlbootSame for RabbitMQ, can I just add the new nodes and then remove the old ones in another run?12:39
*** Torel has quit IRC12:45
*** wuchunyang has joined #openstack-kolla12:46
*** Torel has joined #openstack-kolla12:46
yoctozeptomnasiadka: do check again then!12:48
mnasiadkayoctozepto: looking at my current workload - somewhere in two weeks time :)12:49
*** dosaboy has quit IRC12:50
*** dosaboy has joined #openstack-kolla12:51
yoctozeptomnasiadka: doh12:52
*** k_mouza has joined #openstack-kolla12:56
*** ricolin has quit IRC12:59
*** ricolin_ has joined #openstack-kolla12:59
*** amoralej|lunch is now known as amoralej13:00
*** ricolin_ is now known as ricolin13:01
*** cah_link has quit IRC13:02
*** cah_link has joined #openstack-kolla13:05
openstackgerritMerged openstack/kayobe stable/train: Bump version of os-images role  https://review.opendev.org/73256613:05
*** diurnalist has joined #openstack-kolla13:05
*** wuchunya_ has joined #openstack-kolla13:08
sorin-mihai_so, it looks like nova_api_bootstrap started one hour ago is still stuck at 'nova-manage db sync'. any ideas?13:08
*** k_mouza has quit IRC13:11
*** k_mouza has joined #openstack-kolla13:11
*** e0ne has quit IRC13:12
*** e0ne has joined #openstack-kolla13:12
*** e0ne has quit IRC13:14
openstackgerritMichal Arbet proposed openstack/kolla master: Fix horizon debian binary docker image  https://review.opendev.org/73360713:14
*** e0ne has joined #openstack-kolla13:14
sorin-mihai_anyone?13:15
mgoddardsorin-mihai_: check the logs13:15
sorin-mihai_what should i look for?13:16
mgoddardsorin-mihai_: and ps to see if it has spawned any children13:16
openstackgerritMerged openstack/kayobe master: Fix docker-devicemapper playbook  https://review.opendev.org/73319713:16
mgoddardsorin-mihai_: something in /var/log/kolla/nova/13:16
sorin-mihai_2020-06-04 18:47:15.328 20 WARNING oslo_db.sqlalchemy.engines [req-2fcf626e-0176-4d53-b0eb-9f53e58d7139 - - - - -] SQL connection failed. -583 attempts left.: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')13:18
openstackgerritMark Goddard proposed openstack/kayobe stable/train: Fix docker-devicemapper playbook  https://review.opendev.org/73360813:18
mgoddardsorin-mihai_: DB down?13:19
sorin-mihai_i guess this is related to me changing database_address from kolla_internal_fqdn to api_interface_address? but without that change deploying mariadb will fail13:19
sorin-mihai_i had a feeling this morning it would bite back. lol13:20
*** e0ne has quit IRC13:20
*** e0ne_ has joined #openstack-kolla13:20
yoctozeptomnasiadka: it is octopus :P13:22
mnasiadkayoctozepto: so launch your octopus and update it, I'm firefighting ;)13:23
*** rpittau is now known as rpittau|brb13:24
openstackgerritRadosław Piliszek proposed openstack/kolla master: [docs] Ussuri - Ubuntu has Ceph Octopus  https://review.opendev.org/73361013:24
yoctozeptomnasiadka: done ^13:24
mnasiadkagracias senor13:25
hrwmnasiadka: I can borrow you 60m of garden hose13:25
openstackgerritMerged openstack/kolla-ansible stable/ussuri: Custom haproxy script for monitoring galera  https://review.opendev.org/73349313:25
openstackgerritMichal Arbet proposed openstack/kolla-ansible master: Fix STATIC_ROOT for Debian, Ubuntu  https://review.opendev.org/73361213:27
*** bsanjeewa_ has joined #openstack-kolla13:29
*** Tengu_ has quit IRC13:30
*** cah_link has quit IRC13:31
openstackgerritMerged openstack/kolla-ansible stable/ussuri: Fix glance backend TLS configuration task  https://review.opendev.org/73349113:31
*** Tengu has joined #openstack-kolla13:31
*** bsanjeewa has quit IRC13:32
openstackgerritMerged openstack/kolla-ansible stable/ussuri: Switch to Monasca API for logs  https://review.opendev.org/73349213:33
*** dcapone2004 has quit IRC13:37
mnasiadkahrw: maybe next time :)13:41
*** munimeha1 has joined #openstack-kolla13:43
*** KeithMnemonic has joined #openstack-kolla13:46
*** nikparasyr has quit IRC13:48
maharg101cloudkitty-processor not starting in train - https://review.opendev.org/#/c/707379/ - I think it may be possible to work around this with a config override, has anyone got it working ?13:51
patchbotpatch 707379 - kolla-ansible - Cloudkitty cant not conncet to Auth - 2 patch sets13:51
*** YvesG has quit IRC13:52
openstackgerritMark Goddard proposed openstack/kayobe stable/train: CentOS 8: add docs and release note  https://review.opendev.org/73182913:52
*** cah_link has joined #openstack-kolla13:53
mgoddardmaharg101: have you tried the patch you commented on recently?13:55
*** Torel has quit IRC13:55
*** Torel has joined #openstack-kolla13:57
maharg101just trying to add it now, because we install kolla via pip it is not as easy as it should be :) but not too hard !13:58
*** rpittau|brb is now known as rpittau14:01
maharg101trying to achieve with config override and add cloudkitty_fetcher to globals..14:02
*** TrevorV has joined #openstack-kolla14:02
*** k_mouza has quit IRC14:09
*** abdysn has quit IRC14:10
*** Torel_ has joined #openstack-kolla14:12
openstackgerritRadosław Piliszek proposed openstack/kolla stable/ussuri: Switch to RDO Ussuri release on CentOS  https://review.opendev.org/73179814:12
*** Torel has quit IRC14:14
*** e0ne_ has quit IRC14:16
*** e0ne has joined #openstack-kolla14:17
openstackgerritRadosław Piliszek proposed openstack/kolla stable/ussuri: Fix pre-commit-hook  https://review.opendev.org/73361914:20
openstackgerritMerged openstack/kolla master: Remove centos-nfs-ganesha28 from repos.yaml  https://review.opendev.org/73349814:26
openstackgerritRadosław Piliszek proposed openstack/kolla stable/ussuri: Remove centos-nfs-ganesha28 from repos.yaml  https://review.opendev.org/73362614:27
openstackgerritRadosław Piliszek proposed openstack/kolla stable/ussuri: Remove centos-nfs-ganesha28 from repos.yaml  https://review.opendev.org/73362614:27
*** ricolin_ has joined #openstack-kolla14:28
*** ricolin has quit IRC14:28
*** ricolin_ has quit IRC14:28
*** munimeha1 has quit IRC14:28
*** ricolin has joined #openstack-kolla14:28
*** _Cyclone_ has joined #openstack-kolla14:34
*** k_mouza has joined #openstack-kolla14:40
*** skramaja_ has quit IRC14:52
*** Torel_ has quit IRC15:02
*** Torel has joined #openstack-kolla15:03
*** bsanjeewa_ has quit IRC15:03
*** Luzi has joined #openstack-kolla15:05
*** Luzi has quit IRC15:05
*** Torel has quit IRC15:07
openstackgerritMark Goddard proposed openstack/kayobe master: Copy custom certificates  https://review.opendev.org/72845315:08
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: CI: use wheels from infra mirror  https://review.opendev.org/73033115:15
hrwyoctozepto: thanks for review - improved version15:15
*** born2bake has joined #openstack-kolla15:17
hrwfocal UCA may start in about 2 weeks15:17
openstackgerritMerged openstack/kolla-ansible stable/train: Avoid unconditional fact gathering  https://review.opendev.org/73268715:20
yoctozeptohrw: thanks15:21
hrwyoctozepto: and it is completely ignored in k-a15:22
hrwso in k-a copying of infra pip.conf stays for now in patch15:22
openstackgerritRadosław Piliszek proposed openstack/kolla master: CI: use wheels from infra mirror  https://review.opendev.org/73033115:22
openstackgerritMerged openstack/kayobe master: Add note about hardware package dropping python 2 support  https://review.opendev.org/73308915:22
*** noxoid has quit IRC15:23
*** noxoid has joined #openstack-kolla15:24
hrwyoctozepto: in k-a we do not have template overrides but use kolla ones so abandoned patch15:28
yoctozeptohrw: cool15:28
*** lvdombrkr has joined #openstack-kolla15:29
hrwnow waiting for infra to finish wheel cache stuff15:29
lvdombrkrHello guys, anybody have idea why nodes hostnames in different api requests are different? (see compute-2) http://paste.openstack.org/raw/794375/15:31
*** seco has quit IRC15:36
*** ykarel is now known as ykarel|away15:37
openstackgerritMark Goddard proposed openstack/kayobe stable/train: Add note about hardware package dropping python 2 support  https://review.opendev.org/73364615:39
*** wuchunya_ has quit IRC15:43
openstackgerritPierre Riteau proposed openstack/kayobe master: Update openrc files after overcloud service upgrade  https://review.opendev.org/73364915:46
*** wuchunya_ has joined #openstack-kolla15:46
maharg101lvdombrkr: order of fdqn / bare host name in hosts file ?15:47
lvdombrkrmaharg101: for me seems all records are correct: http://paste.openstack.org/raw/794377/15:51
*** wuchunya_ has quit IRC15:51
*** wuchunya_ has joined #openstack-kolla15:51
*** wuchunya_ has quit IRC15:53
maharg101lvdombrkr: are `hostname` and `hostname -f` equivalent in their fqdn-ness ?15:53
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Run kolla-toolbox container unpriviliged  https://review.opendev.org/73270015:56
lvdombrkrmaharg101: how can i check this? output of both commands hostname and hostname -f is the same15:59
*** factor has quit IRC15:59
*** seco has joined #openstack-kolla16:05
*** seco has quit IRC16:10
openstackgerritMichal Arbet proposed openstack/kolla master: Fix horizon debian binary docker image  https://review.opendev.org/73360716:12
*** gfidente is now known as gfidente|afk16:15
maharg101lvdombrkr: I've seen this before where the hostnames were different because of hosts file ordering issues. `hostname -f` should be fully qualified, and `hostname` should not be.16:15
lvdombrkrmaharg101: for me both are the same compute-2.internal23.com16:16
lvdombrkrmaharg101: i deleted compute service, discover it again and result the same16:17
*** jonaspaulo has joined #openstack-kolla16:17
lvdombrkrso it takes data for somewere e,se16:18
maharg101lvdombrkr: and are the hosts file entries on the infrastructure / controller hosts all ordered correctly ?16:22
maharg101the entries for compute-2 I mean...16:22
*** muhaha has joined #openstack-kolla16:27
lvdombrkrmaharg101: for me looks good on all hosts16:27
lvdombrkrhttp://paste.openstack.org/raw/794379/16:27
*** numans has joined #openstack-kolla16:28
maharg101lvdombrkr: I'm out of ideas. I had the exact same problem some months ago, and fixing the hosts file fixed the issue.16:30
*** amoralej is now known as amoralej|off16:31
*** rpittau is now known as rpittau|afk16:31
lvdombrkrmaharg101: maybe in all hosts files leave just 100.81.39.19 compute-2.internal23.com without compute-2?16:32
*** e0ne has quit IRC16:33
maharg101lvdombrkr: might be worth a go. Has compute-2 been booted since the hosts file was last changed ?16:36
lvdombrkrmaharg101: yes i double-checked all hosts records and rebooted it yesterday. after i removed this compute host and added again and result the same16:38
maharg101mgoddard: I don't think that patch works, I've tried an over-ride, and directly editing the config on one node to take out entries left in by merge_configs plugin, by no joy :(16:39
mgoddardmaharg101: :( if you do find a fix please update the patch, or at least comment on it what you did16:39
lvdombrkrmaharg101: is this error when running ansible can be because of this misconfiguration : http://paste.openstack.org/raw/794381/16:40
maharg101sure, will do mgoddard - thanks16:40
maharg101lvdombrkr: looks like you are on the right track - good luck with it !16:43
*** nathharp has quit IRC16:45
*** nathharp has joined #openstack-kolla16:45
lvdombrkrmaharg101: thanks in assist16:48
*** seco has joined #openstack-kolla16:49
*** priteau has quit IRC16:49
*** nathharp has quit IRC16:50
*** seco has quit IRC16:54
openstackgerritMerged openstack/kolla-ansible stable/ussuri: Use api_interface as migration_interface default value  https://review.opendev.org/73358616:57
maharg101lvdombrkr: np :)16:59
maharg101mgoddard: my bad, it DOES work, cloudkitty starts at least :)17:06
mgoddardmaharg101: ok, improvement17:06
mgoddardmaharg101: either way, please comment on the bug with your final result17:09
mgoddardmaharg101: s/bug/review/17:09
openstackgerritMerged openstack/kayobe stable/train: Fix docker-devicemapper playbook  https://review.opendev.org/73360817:18
openstackgerritMerged openstack/kayobe master: docs: fix route configuration example syntax  https://review.opendev.org/73176817:19
openstackgerritMerged openstack/kayobe master: Stop to use the __future__ module.  https://review.opendev.org/73285117:20
maharg101mgoddard: done17:24
*** kevko_ has joined #openstack-kolla17:25
*** kevko has quit IRC17:28
*** cah_link has quit IRC17:31
openstackgerritMerged openstack/kolla stable/ussuri: Fix pre-commit-hook  https://review.opendev.org/73361917:34
*** jonaspaulo has quit IRC17:36
*** seco has joined #openstack-kolla17:43
*** seco has quit IRC17:48
*** bengates_ has joined #openstack-kolla17:48
*** bengates has quit IRC17:51
*** Torel has joined #openstack-kolla17:58
*** Torel has quit IRC18:04
*** ricolin has quit IRC18:06
*** Torel has joined #openstack-kolla18:06
*** Torel has quit IRC18:19
*** dcapone2004 has joined #openstack-kolla18:20
*** Torel has joined #openstack-kolla18:20
dcapone2004hi, I inquired last night about the proper shutdown procedure for a kolla cluster... I do not think I received much feedback18:21
dcapone2004I know about the kolla-ansible stop18:21
dcapone2004however, my question and concern is around proper shutdown order and restart procedure to ensure MariaDB / Galera is not corrupted and there is no issue with HAProxy cluster18:21
dcapone2004is "stop" aware of shutting down in proper order, etc?  Searches I have done all link to old articles but seemed to insinuate that stop merely stopped the kolla containers without regard to state, etc...It also would not help in determining what order the servers should be powered back up in18:23
*** bengates_ has quit IRC18:25
*** bengates has joined #openstack-kolla18:25
*** bengates_ has joined #openstack-kolla18:28
*** e0ne has joined #openstack-kolla18:28
*** bengates has quit IRC18:28
mgoddarddcapone2004: the stop command may be used with --limit if you want to control the order of shutdown. Start up in reverse order18:31
*** e0ne has quit IRC18:32
dcapone2004so if you have 3 nodes, you run stop 3 times, once for each host....if you have 14 nodes, you run it 14 times, once for each host and then power back up in the reverse order of the stop18:33
dcapone2004is that correct?18:52
dcapone2004or am I misunderstanding what you mean by using limit18:52
openstackgerritMerged openstack/kolla master: Add py38 package metadata  https://review.opendev.org/73027319:06
*** vishalmanchanda has quit IRC19:11
*** dougsz has quit IRC19:13
*** bengates_ has quit IRC19:24
*** dougsz has joined #openstack-kolla19:27
*** seco has joined #openstack-kolla19:33
*** seco has quit IRC19:39
*** sorin-mihai_ has quit IRC19:40
*** muhaha has quit IRC19:40
*** bsanjeewa has joined #openstack-kolla19:44
openstackgerritMerged openstack/kolla stable/ussuri: Switch to RDO Ussuri release on CentOS  https://review.opendev.org/73179819:57
*** bsanjeewa_ has joined #openstack-kolla19:57
*** bsanjeewa has quit IRC20:00
*** Torel has quit IRC20:20
*** Torel has joined #openstack-kolla20:22
*** e0ne has joined #openstack-kolla20:25
*** e0ne has quit IRC20:28
*** e0ne has joined #openstack-kolla20:28
*** Torel has quit IRC20:30
openstackgerritMerged openstack/kolla-ansible master: Do not ask for a SSH key password  https://review.opendev.org/73163520:31
*** Torel has joined #openstack-kolla20:33
*** lvdombrkr has quit IRC20:34
*** e0ne_ has joined #openstack-kolla20:37
*** e0ne has quit IRC20:37
*** k_mouza has quit IRC20:38
*** k_mouza has joined #openstack-kolla20:40
*** e0ne_ has quit IRC20:41
*** e0ne has joined #openstack-kolla20:43
*** e0ne has quit IRC20:46
*** bsanjeewa_ has quit IRC20:50
*** k_mouza has quit IRC20:51
*** k_mouza has joined #openstack-kolla21:05
*** k_mouza has quit IRC21:06
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Generate Root CA for Self-Signed Certificates  https://review.opendev.org/73134421:08
*** dougsz has quit IRC21:17
*** e0ne has joined #openstack-kolla21:34
*** e0ne has quit IRC21:49
*** Torel has quit IRC21:57
*** Torel has joined #openstack-kolla21:59
*** born2bake has quit IRC22:16
*** crindi has quit IRC22:35
*** kklimonda has quit IRC22:36
*** vkmc has quit IRC22:36
*** alanmeadows has quit IRC22:36
*** rpittau|afk has quit IRC22:36
*** niedbalski has quit IRC22:36
*** stackedsax has quit IRC22:36
*** emccormick has quit IRC22:36
*** egonzalez has quit IRC22:36
*** r3ap3r has quit IRC22:36
*** mnasiadka has quit IRC22:37
*** cz3 has quit IRC22:37
*** jonmasters has quit IRC22:37
*** cz3 has joined #openstack-kolla22:37
*** portdirect has quit IRC22:37
*** TheJulia has quit IRC22:37
*** mwhahaha has quit IRC22:37
*** lxkong has quit IRC22:37
*** andrein has quit IRC22:37
*** stackedsax has joined #openstack-kolla22:37
*** emccormick has joined #openstack-kolla22:37
*** johnsom has quit IRC22:37
*** headphoneJames has quit IRC22:37
*** gmann has quit IRC22:37
*** sri_ has quit IRC22:37
*** v1k0d3n has quit IRC22:37
*** rm_work has quit IRC22:38
*** alanmeadows has joined #openstack-kolla22:38
*** egonzalez has joined #openstack-kolla22:38
*** v1k0d3n has joined #openstack-kolla22:38
*** vkmc has joined #openstack-kolla22:38
*** jonmasters has joined #openstack-kolla22:38
*** gmann has joined #openstack-kolla22:38
*** niedbalski has joined #openstack-kolla22:38
*** lxkong has joined #openstack-kolla22:39
*** sri_ has joined #openstack-kolla22:39
*** mnasiadka has joined #openstack-kolla22:39
*** andrein has joined #openstack-kolla22:40
*** crindi has joined #openstack-kolla22:41
*** r3ap3r has joined #openstack-kolla22:41
*** mwhahaha has joined #openstack-kolla22:41
*** TheJulia has joined #openstack-kolla22:41
*** portdirect has joined #openstack-kolla22:42
*** johnsom has joined #openstack-kolla22:43
*** Torel has quit IRC22:49
*** rm_work has joined #openstack-kolla22:51
*** Torel has joined #openstack-kolla22:52
*** TrevorV has quit IRC22:57
*** rpittau|afk has joined #openstack-kolla23:04
*** kklimonda has joined #openstack-kolla23:04

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!