Wednesday, 2020-06-03

*** cah_link1 has joined #openstack-kolla00:01
*** cah_link has quit IRC00:03
*** cah_link1 is now known as cah_link00:03
*** dking has quit IRC00:19
*** nathharp_ has joined #openstack-kolla00:49
*** nathharp has quit IRC00:52
*** cah_link has quit IRC01:16
*** wuchunyang has joined #openstack-kolla01:18
*** wuchunyang has quit IRC01:45
*** Torel has quit IRC01:47
*** wuchunyang has joined #openstack-kolla02:16
*** wuchunyang has quit IRC03:20
*** wuchunyang has joined #openstack-kolla03:36
*** wuchunyang has quit IRC04:02
*** ricolin has joined #openstack-kolla04:07
*** cah_link has joined #openstack-kolla04:08
*** dmellado has quit IRC04:16
*** munimeha1 has quit IRC04:17
*** cah_link has quit IRC04:21
*** ysirndjuro has joined #openstack-kolla04:25
*** vishalmanchanda has joined #openstack-kolla04:26
*** ysirndjuro has quit IRC04:28
*** ykarel|away is now known as ykarel04:31
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-kolla04:33
*** wuchunyang has joined #openstack-kolla04:39
*** wuchunyang has quit IRC04:53
*** abdysn has joined #openstack-kolla04:57
*** skramaja has joined #openstack-kolla05:12
*** diurnalist has quit IRC05:17
*** dmellado has joined #openstack-kolla05:31
*** cah_link has joined #openstack-kolla05:36
*** sean-k-mooney has quit IRC05:50
*** k_mouza has joined #openstack-kolla05:53
*** k_mouza has quit IRC05:57
*** nikparasyr has joined #openstack-kolla06:11
*** bsanjeewa has joined #openstack-kolla06:15
*** bsanjeewa_ has joined #openstack-kolla06:17
*** sorin-mihai_ has quit IRC06:18
oklhostGood morning everyone, upgrade from train->ussuri throws some errors while upgrading kibana: http://paste.openstack.org/show/794287/06:20
*** bsanjeewa has quit IRC06:20
*** bsanjeewa_ has quit IRC06:23
*** muhaha has joined #openstack-kolla06:33
osmanlicilegimorning06:49
*** slunav has quit IRC07:06
*** slunav has joined #openstack-kolla07:06
*** also_stingrayza has joined #openstack-kolla07:08
*** stingrayza has quit IRC07:12
*** nathharp_ has quit IRC07:13
*** nathharp has joined #openstack-kolla07:13
yoctozeptorouk: but this is by design, it should just work (TM), please be more specific about what does not07:14
yoctozeptooklhost: oh, that's a new one, have not seen this one before07:15
yoctozeptooklhost: the bug reporting floor is yours07:15
yoctozeptooklhost: it looks like it failed to parse [200 as it should actually be parsing 20007:16
yoctozeptomorning channel07:16
osmanlicilegimorning yoctozepto07:16
oklhostyoctozepto: hrhr... okay, will report it right after my standup. thx!07:16
oklhostyoctozepto: can we just disable central logging as a workaround?07:17
yoctozeptooklhost: yeah, I think so, though it has failed at kibana which suggests it has already upgraded elasticsearch so kibana is likely in a broken state07:18
yoctozeptooklhost: if that is not a problem for you (or kibana actually works, please let us know), then yes, you can do this07:19
yoctozeptooklhost: you can then later limit to kibana tag to upgrade just kibana when we figure out what is wrong there07:19
yoctozeptomorning osmanlicilegi07:19
oklhostyoctozepto: great, we'll try that and record all results within our bug report later.07:21
*** slunav has quit IRC07:25
*** slunav has joined #openstack-kolla07:25
*** muhaha has quit IRC07:27
oklhostyoctozepto: kibana seems working anyway. Version: 5.6.16, no idea if this is right for ussuri.07:29
yoctozeptooklhost: nah, it should be 6.x afair07:29
yoctozeptobut glad it works ;d07:29
*** bengates has joined #openstack-kolla07:30
oklhosthaha, okay :D well, we'll disable central logging and try again.07:30
*** amoralej|off is now known as amoralej07:33
*** slunav has quit IRC07:33
*** slunav has joined #openstack-kolla07:33
yoctozeptooklhost: it would be safer to just skip kibana then07:33
yoctozeptooklhost: if elastic works, no need to deconfigure07:34
yoctozeptooklhost: --skip-tags kibana07:34
*** bengates has quit IRC07:34
oklhostyoctozepto: ahh great!07:34
*** bengates has joined #openstack-kolla07:35
*** bsanjeewa has joined #openstack-kolla07:36
*** slunav has quit IRC07:48
*** slunav has joined #openstack-kolla07:48
*** seco has joined #openstack-kolla07:49
oklhosthere we go https://bugs.launchpad.net/kolla-ansible/+bug/188186207:50
openstackLaunchpad bug 1881862 in kolla-ansible "Train->Ussuri upgrade kibana fail" [Undecided,New]07:50
mgoddardrouk: what you've described is correct. cell0 is a special cell, the control services need access to it. the nova cell is the default real cell08:03
*** born2bake has joined #openstack-kolla08:03
mnasiadkamorning08:22
*** sean-k-mooney has joined #openstack-kolla08:22
*** also_stingrayza is now known as stingrayza08:25
hrwmorng08:26
openstackgerritMerged openstack/kolla master: Add ceph releases per-distro to support matrix  https://review.opendev.org/73260308:29
openstackgerritMichal Nasiadka proposed openstack/kolla stable/ussuri: Add ceph releases per-distro to support matrix  https://review.opendev.org/73306908:36
*** dciabrin has joined #openstack-kolla08:45
*** e0ne has joined #openstack-kolla08:49
*** kevko has joined #openstack-kolla08:53
*** seco has quit IRC09:06
*** gfidente|afk is now known as gfidente09:07
*** seco has joined #openstack-kolla09:08
*** jovial[m] has joined #openstack-kolla09:39
jovial[m]Out of interest, why did you guys pick the proprietary xoom over jitsi for the PTG sessions?09:47
mgoddardjovial[m]: default :)09:54
*** Torel has joined #openstack-kolla10:00
*** e0ne has quit IRC10:14
*** e0ne has joined #openstack-kolla10:14
openstackgerritWill Szumski proposed openstack/kayobe master: Add note about hardware package dropping python 2 support  https://review.opendev.org/73308910:23
*** hamzaachi has joined #openstack-kolla10:24
*** seco has quit IRC10:34
*** e0ne_ has joined #openstack-kolla10:34
*** e0ne has quit IRC10:34
*** k_mouza has joined #openstack-kolla10:37
*** seco has joined #openstack-kolla10:39
openstackgerritMichal Nasiadka proposed openstack/kolla stable/ussuri: Add ceph releases per-distro to support matrix  https://review.opendev.org/73306910:39
openstackgerritWill Szumski proposed openstack/kayobe master: Add note about hardware package dropping python 2 support  https://review.opendev.org/73308910:39
*** adrian0x0 has joined #openstack-kolla10:52
*** k_mouza has quit IRC10:54
*** k_mouza has joined #openstack-kolla10:55
yoctozeptojovial[m]: we be lazy :-)10:55
*** muhaha has joined #openstack-kolla10:58
*** priteau has joined #openstack-kolla10:59
*** bsanjeewa has joined #openstack-kolla11:04
*** e0ne_ has quit IRC11:06
*** e0ne has joined #openstack-kolla11:06
*** bsanjeewa_ has joined #openstack-kolla11:06
*** dcapone2004 has quit IRC11:08
*** bsanjeewa has quit IRC11:10
*** nikparasyr has quit IRC11:21
*** e0ne has quit IRC11:21
*** e0ne has joined #openstack-kolla11:22
*** zijlboot_ has joined #openstack-kolla11:29
*** e0ne has quit IRC11:30
*** e0ne has joined #openstack-kolla11:32
*** zijlboot has quit IRC11:32
*** bsanjeewa_ has quit IRC11:34
*** e0ne_ has joined #openstack-kolla11:35
*** e0ne has quit IRC11:35
*** e0ne has joined #openstack-kolla11:36
*** e0ne_ has quit IRC11:39
*** e0ne has quit IRC11:42
*** k_mouza has quit IRC11:42
*** e0ne has joined #openstack-kolla11:47
*** e0ne_ has joined #openstack-kolla11:50
*** e0ne has quit IRC11:52
openstackgerritMichal Nasiadka proposed openstack/kolla stable/ussuri: Add ceph releases per-distro to support matrix  https://review.opendev.org/73306911:55
openstackgerritMichal Nasiadka proposed openstack/kolla stable/train: Add ceph releases per-distro to support matrix  https://review.opendev.org/73311911:55
*** rpittau|afk is now known as rpittau11:57
*** amoralej is now known as amoralej|lunch11:58
*** e0ne has joined #openstack-kolla11:59
*** k_mouza has joined #openstack-kolla11:59
*** e0ne_ has quit IRC12:00
*** cah_link has quit IRC12:01
*** e0ne has quit IRC12:02
*** e0ne has joined #openstack-kolla12:09
*** e0ne has quit IRC12:19
*** e0ne_ has joined #openstack-kolla12:19
*** kevko_ has joined #openstack-kolla12:21
*** lvdombrkr has joined #openstack-kolla12:23
*** kevko has quit IRC12:24
lvdombrkrhello guys. some days ago added second compute node. ansible-script was done without any errors. today trying to run ansible deploy command again and its failing on :Waiting for nova-compute services to register themselves12:31
lvdombrkrthere is how i added new node12:32
lvdombrkrand error12:32
lvdombrkrhttp://paste.openstack.org/raw/794311/12:32
lvdombrkrguys anyone here?12:36
*** cah_link has joined #openstack-kolla12:47
*** e0ne_ has quit IRC12:47
*** xinliang has joined #openstack-kolla12:47
*** skramaja has quit IRC12:48
*** dougsz has joined #openstack-kolla12:53
*** e0ne has joined #openstack-kolla12:53
*** amoralej|lunch is now known as amoralej12:54
*** e0ne has quit IRC13:06
*** e0ne has joined #openstack-kolla13:07
*** spiette has quit IRC13:07
yoctozeptolvdombrkr: ptg ongoing, what is the final result of that command? i.e. which computes does it see?13:07
*** spiette has joined #openstack-kolla13:07
*** e0ne has quit IRC13:11
lvdombrkryoctozepto: ok i see, sorry.. ( here is outputs http://paste.openstack.org/raw/794314/13:11
*** dking has joined #openstack-kolla13:12
*** e0ne has joined #openstack-kolla13:16
*** bsanjeewa has joined #openstack-kolla13:17
yoctozeptolvdombrkr: aye, so the failure reason is that one host registered without domain part13:19
adrian0x0hi guys, tried to deploy a-universe-from-nothing and it got an error that it cannot connect to hosts (centos 7/train) http://paste.openstack.org/show/794316/ any ideas what to do?13:20
*** e0ne has quit IRC13:21
lvdombrkryoctozepto: yes i see. any guess why its registred without domain? all hostnames in host looks properly set http://paste.openstack.org/raw/794319/13:23
*** e0ne has joined #openstack-kolla13:24
*** wuchunyang has joined #openstack-kolla13:29
*** e0ne has quit IRC13:30
*** Torel has quit IRC13:31
*** TrevorV has joined #openstack-kolla13:31
mnasiadkayoctozepto: did we agree yesterday to deprecate sanity checks? :)13:33
*** e0ne has joined #openstack-kolla13:33
mnasiadka(in their current form)13:33
*** Torel has joined #openstack-kolla13:33
yoctozeptomnasiadka: not really, more like replace them13:33
yoctozeptomnasiadka: aye, that could apply13:33
mnasiadkayoctozepto: yeah, I would be happy to remove swift sanity checks, because they use kolla_sanity.py - which uses shade ;)13:34
yoctozeptomnasiadka: geez, immediately!13:34
mnasiadkaand they only authenticate to keystone, which is a bit funny for a smoke test of swift13:35
yoctozeptomnasiadka: lolz13:35
hrwdo we discuss today something else than kayobe?13:36
mnasiadkahrw: I don't think so13:36
yoctozeptonope, only kayobe today13:36
hrwok, so not joinging13:36
yoctozeptothe reason I'm not that talkative today13:36
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Remove swift sanity check  https://review.opendev.org/73314313:38
openstackgerritMichal Nasiadka proposed openstack/kolla master: Remove shade and kolla_sanity.py from kolla-toolbox  https://review.opendev.org/73314413:41
*** wuchunyang has quit IRC13:41
openstackgerritMichal Nasiadka proposed openstack/kolla master: Remove shade and kolla_sanity.py from kolla-toolbox  https://review.opendev.org/73314413:45
*** Torel has quit IRC13:46
*** Torel has joined #openstack-kolla13:49
*** wuchunyang has joined #openstack-kolla14:01
lvdombrkryoctozepto: do you have any clues?14:02
*** bsanjeewa_ has joined #openstack-kolla14:03
yoctozeptolvdombrkr: no, sorry, nothing off the top of my head :< I wonder whether it has changed in some nova parts - did much time pass between the two invocations?14:03
*** diurnalist has joined #openstack-kolla14:05
*** bsanjeewa has quit IRC14:06
*** bsanjeewa has joined #openstack-kolla14:07
*** bsanjeewa_ has quit IRC14:07
yoctozeptolvdombrkr: no, sorry, nothing off the top of my head :< I wonder whether it has changed in some nova parts - did much time pass between the two invocations?14:07
yoctozeptosorry, irc client hiccup14:08
lvdombrkryoctozepto: when i identified this issue (today morning) i double-checked all hostnames in compute-2 node and remove compute service with ( openstack compute service delete)14:08
lvdombrkrafter restart nova-compute and run discovery14:09
lvdombrkrand service was back again with compute-2 hostname instead as expected with domain14:10
*** spiette has quit IRC14:13
*** wuchunya_ has joined #openstack-kolla14:15
roukmgoddard: block_device_mapping table the API uses for metadata responses was coming from the cell0 db, which broke a bunch of my tenant scripts that depended on it (so far train is just in dev, so no prod break) after pointing to the nova db, metadata works as expected, but maybe that breaks something else...?14:16
*** wuchunyang has quit IRC14:17
*** abdysn has quit IRC14:17
*** xinliang has quit IRC14:22
*** spiette has joined #openstack-kolla14:23
roukUnless that's a bug in nova that needs to be fixed, I'm not sure where db selection happens for the session in nova.14:24
*** sorin-mihai has joined #openstack-kolla14:26
openstackgerritMichal Nasiadka proposed openstack/kolla master: Remove shade and kolla_sanity.py from kolla-toolbox  https://review.opendev.org/73314414:45
*** bsanjeewa_ has joined #openstack-kolla14:45
*** bsanjeewa has quit IRC14:49
*** Torel has quit IRC15:06
*** Torel has joined #openstack-kolla15:07
*** dmellado has quit IRC15:18
*** dougsz has quit IRC15:18
*** dmellado has joined #openstack-kolla15:20
*** lvdombrkr has quit IRC15:20
*** seco has quit IRC15:20
*** dswebb has joined #openstack-kolla15:23
dswebbhey, managed to put this in the unregistered chat yesterday by mistake.  found out why the centos 8 barbican images were broken:  https://bugs.launchpad.net/kolla-ansible/+bug/188178415:27
openstackLaunchpad bug 1881784 in kolla-ansible "barbican-api.ini for centos8 referencing wrong python plugin" [Undecided,New]15:27
*** muhaha has quit IRC15:32
*** wuchunya_ has quit IRC15:32
roukmgoddard: yeah, after talking with nova guys, it does seem like kolla is doing nothing wrong and that this is a bug in nova train and higher.15:44
hrwkolla-ansible-debian-source-upgrade-aarch64 for ussuri->victoria works!15:46
*** wuchunyang has joined #openstack-kolla15:49
*** jaicaa has quit IRC15:50
*** wuchunyang has quit IRC15:50
*** jaicaa has joined #openstack-kolla15:50
*** bsanjeewa has joined #openstack-kolla15:51
roukis there support for per-cell metadata services? nova-api-metadata is the current workaround to the metadata bug.15:52
*** bsanjeewa_ has quit IRC15:54
*** bsanjeewa_ has joined #openstack-kolla15:55
*** Torel has quit IRC15:56
*** bsanjeewa has quit IRC15:57
*** Torel has joined #openstack-kolla15:58
openstackgerritPierre Riteau proposed openstack/kayobe master: Fix docker-devicemapper playbook  https://review.opendev.org/73319716:06
*** ykarel is now known as ykarel|away16:07
*** bsanjeewa_ has quit IRC16:12
*** Torel has quit IRC16:15
*** bengates has quit IRC16:18
kevko_hrw: still here ? :)16:19
*** rpittau is now known as rpittau|afk16:24
priteaumgoddard: I am looking at adding a Trivial-Fix flag. There is some validation in project-config tools/normalize_acl.py to validate labels, so we would have to propose it. In the process I noticed another one that could be useful for Kolla: label-Backport-Candidate16:30
priteauIt's used in Octavia16:30
mgoddardyes, that could be useful16:31
priteauhttps://opendev.org/openstack/project-config/src/branch/master/gerrit/acls/openstack/octavia.config#L27-L3616:31
mgoddardhopefully we won't get lost in a sea of labels16:31
mgoddardPriorities ready for voting!16:41
mgoddardhttps://etherpad.opendev.org/p/kolla-victoria-priorities16:41
*** slunav has quit IRC16:53
*** slunav has joined #openstack-kolla16:54
*** hamzaachi has quit IRC17:02
*** amoralej is now known as amoralej|off17:06
*** jonaspaulo has joined #openstack-kolla17:11
*** nathharp_ has joined #openstack-kolla17:14
*** lvdombrkr has joined #openstack-kolla17:16
*** nathharp has quit IRC17:17
*** k_mouza has quit IRC17:17
*** k_mouza has joined #openstack-kolla17:18
*** hjensas is now known as hjensas|afk17:21
*** k_mouza has quit IRC17:22
*** e0ne_ has joined #openstack-kolla17:29
*** e0ne has quit IRC17:29
*** gfidente is now known as gfidente|afk17:31
*** Limech_ has joined #openstack-kolla17:36
*** Limech has quit IRC17:41
*** slunav has quit IRC17:43
*** e0ne_ has quit IRC17:44
*** k_mouza has joined #openstack-kolla17:54
*** sorin-mihai has quit IRC17:55
*** sorin-mihai has joined #openstack-kolla17:55
*** k_mouza has quit IRC17:57
*** k_mouza has joined #openstack-kolla17:57
*** k_mouza has quit IRC18:02
*** k_mouza has joined #openstack-kolla18:42
*** riuzen has joined #openstack-kolla18:46
*** k_mouza has quit IRC18:47
*** riuzen has quit IRC18:50
*** vishalmanchanda has quit IRC19:13
*** ricolin has quit IRC19:18
*** jonaspaulo has quit IRC19:20
*** adrian0x0 has quit IRC19:28
*** lvdombrkr has quit IRC19:41
*** kevko_ has quit IRC19:48
*** hamzaachi has joined #openstack-kolla20:01
*** k_mouza has joined #openstack-kolla20:10
*** priteau has quit IRC20:12
*** cah_link has quit IRC20:20
*** k_mouza has quit IRC20:21
*** e0ne has joined #openstack-kolla20:27
*** JamesBenson has quit IRC20:29
openstackgerritJason Anderson proposed openstack/kolla-ansible master: Support overriding Horizon default openrc template  https://review.opendev.org/73339720:31
*** kevko_ has joined #openstack-kolla20:34
*** Torel has joined #openstack-kolla20:47
*** kevko_ has quit IRC20:59
*** e0ne has quit IRC21:18
*** hamzaachi has quit IRC21:24
*** k_mouza has joined #openstack-kolla21:46
*** k_mouza has quit IRC21:46
*** Torel has quit IRC21:58
*** Torel has joined #openstack-kolla22:00
*** Torel has quit IRC22:12
*** Torel has joined #openstack-kolla22:13
*** Torel has quit IRC22:54
*** Torel has joined #openstack-kolla22:56
*** factor has joined #openstack-kolla23:09
*** kevko_ has joined #openstack-kolla23:09
*** gfidente|afk has quit IRC23:16
*** born2bake has quit IRC23:21
*** diurnalist has quit IRC23:26
*** kevko_ has quit IRC23:32
*** Torel has quit IRC23:36
*** Torel has joined #openstack-kolla23:37
*** TrevorV has quit IRC23:49
*** factor has quit IRC23:52
*** factor has joined #openstack-kolla23:52
*** diurnalist has joined #openstack-kolla23:53

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!