Thursday, 2020-10-22

openstackgerritMerged openstack/kayobe master: Fix "Wait for the ironic node to be inspected" task  https://review.opendev.org/75820200:13
*** wuchunyang has joined #openstack-kolla01:00
*** mrunge has quit IRC01:05
*** wuchunyang has quit IRC01:10
*** plootonyum has quit IRC01:13
*** devfaz has quit IRC01:44
*** wuchunyang has joined #openstack-kolla01:55
*** wuchunyang has quit IRC02:05
*** mrunge has joined #openstack-kolla02:17
*** brinzhang has quit IRC02:31
*** skramaja has joined #openstack-kolla03:03
*** bsanjeewa has joined #openstack-kolla03:45
*** LinPeiWen has quit IRC03:51
*** LinPeiWen has joined #openstack-kolla03:57
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-kolla04:33
*** gfidente has joined #openstack-kolla04:57
*** williampiv has quit IRC05:04
*** vishalmanchanda has joined #openstack-kolla05:39
*** bsanjeewa has quit IRC05:44
*** jbadiapa has joined #openstack-kolla05:46
*** bsanjeewa has joined #openstack-kolla05:59
*** cah_link has joined #openstack-kolla06:08
yoctozeptomorning06:30
*** wuchunyang has joined #openstack-kolla06:30
openstackgerritwu.chunyang proposed openstack/kolla master: Remove the unused coding style modules  https://review.opendev.org/75918906:30
*** devfaz has joined #openstack-kolla06:37
*** bsanjeewa has quit IRC06:37
*** rpittau|afk is now known as rpittau06:54
mnasiadkayoctozepto: say w00t?06:57
mnasiadkayoctozepto: master?06:57
yoctozeptomnasiadka: yeah06:57
mnasiadkadid neutron change something?06:57
yoctozeptomnasiadka: I have no idea06:59
yoctozeptomnasiadka: left it all to you :-)06:59
mnasiadkaI'll check that, but most probably tomorrow, today I have another crazy day06:59
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/ussuri: docs: Add link back to Train CentOS 8 migration page  https://review.opendev.org/75919307:05
*** bengates has joined #openstack-kolla07:06
yoctozeptomnasiadka: sure thing07:06
*** bsanjeewa has joined #openstack-kolla07:07
*** bsanjeewa has quit IRC07:11
*** e0ne has joined #openstack-kolla07:12
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: WIP: CI: Test MariaDB backup  https://review.opendev.org/69333207:16
*** devfaz has quit IRC07:17
*** bsanjeewa has joined #openstack-kolla07:19
*** muhaha has joined #openstack-kolla07:22
*** gfidente is now known as gfidente|pto07:23
muhahado i need to provision ceph if i wanna install allinone ?07:27
mgoddardmorning07:40
mgoddardmuhaha: no07:40
mnasiadkamorning07:43
*** grandfso has joined #openstack-kolla07:47
wuchunyangmorning07:47
*** bengates has quit IRC07:48
*** bengates has joined #openstack-kolla07:48
muhahaAre you recommending https://github.com/ceph/ceph-ansible as aditional deployment to multi node kolla ?07:50
*** gfidente|pto has quit IRC07:52
wuchunyangmgoddard should we take a little time to  review octavia docs since patchsets were merged ?07:52
mnasiadkaIf you're planning to deploy Ceph Nautilus - yes, if Ceph Octopus - rather use cephadm.07:53
mgoddardwuchunyang: yes, just need some time :)07:53
wuchunyangmgoddard  thanks.  and could you help review a comment ? just a comment.  https://review.opendev.org/#/c/755589/14/ansible/roles/octavia/defaults/main.yml07:57
patchbotpatch 755589 - kolla-ansible - octavia: support tenant management network - 14 patch sets07:57
*** bsanjeewa has quit IRC08:00
hrwmornig08:08
mgoddardmnasiadka: do we have a bug for the keystone-startup issue?08:10
mgoddardhttps://bugs.launchpad.net/kolla-ansible/+bug/189572308:11
openstackLaunchpad bug 1895723 in kolla-ansible ussuri "Keystone is restarting due to stale primary key" [High,Fix committed] - Assigned to Radosław Piliszek (yoctozepto)08:11
*** nikparasyr has joined #openstack-kolla08:12
openstackgerritMerged openstack/kolla-ansible master: Fix fernet cron path on Ubuntu/Debian  https://review.opendev.org/75707608:13
openstackgerritMerged openstack/kolla-ansible stable/ussuri: docs: Add link back to Train CentOS 8 migration page  https://review.opendev.org/75919308:13
*** gfidente has joined #openstack-kolla08:16
*** gfidente is now known as gfidente|pto08:17
*** dardelean has joined #openstack-kolla08:20
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Fix keystone-startup.sh - remove Fernet key age check  https://review.opendev.org/75921008:26
*** bsanjeewa has joined #openstack-kolla08:27
mgoddardmnasiadka, priteau, yoctozepto: ^08:27
mnasiadkamgoddard: nope, only some on rotation related things.08:27
mgoddardmnasiadka: I found it. See https://review.opendev.org/75921008:29
patchbotpatch 759210 - kolla-ansible - Fix keystone-startup.sh - remove Fernet key age check - 1 patch set08:30
mnasiadkayeah, already +2 ;)08:30
mgoddardnice08:31
*** bsanjeewa has quit IRC08:35
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Fix permission denied during Fernet key rotation  https://review.opendev.org/75921508:35
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Fix fernet cron path on Ubuntu/Debian  https://review.opendev.org/75921708:36
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Fix fernet cron path on Ubuntu/Debian  https://review.opendev.org/75921808:37
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Fix fernet cron path on Ubuntu/Debian  https://review.opendev.org/75921908:37
mnasiadkathe perm denied - I have never seen that, but it might happen08:37
mgoddardmnasiadka: I saw it in https://review.opendev.org/#/c/74615308:47
patchbotpatch 746153 - kolla-ansible - WIP: keystone fernet follow up follow up - 7 patch sets08:47
hrwso what do we do with elasticsearch-curator?08:50
*** skramaja_ has joined #openstack-kolla08:55
*** skramaja has quit IRC08:56
openstackgerritMark Goddard proposed openstack/kolla-ansible master: WIP: Fix keystone cron generator  https://review.opendev.org/75879708:58
hrwINFO:kolla.common.utils.elasticsearch-curator:  Downloading https://files.pythonhosted.org/packages/34/78/787a52834656f7f5dab6d709e38876c4d2604f0e1a16d17937d00330b0c5/elasticsearch-curator-5.8.1.tar.gz (225kB)09:00
hrwthat file is served on wet wire...09:01
mgoddardhrw: if I install boto3 separately, it works09:13
mgoddardhmm, actually it seems to always work now09:14
hrwmgoddard: where?09:15
mgoddardlocally09:15
hrwah09:15
hrwERROR:kolla.common.utils.elasticsearch-curator:Error'd with the following message09:15
*** jaicaa has quit IRC09:22
*** jaicaa has joined #openstack-kolla09:23
*** jonaspaulo has joined #openstack-kolla09:34
mnasiadkamgoddard: what is interesting for me - Ubuntu seems to have never rotated fernet, and nobody came back before introducing ''check stale key feature'' that keystone is not working at all?09:38
mgoddardmnasiadka: as priteau said yesterday, keystone will continue to work with old keys. Tokens expire, keys do not09:39
mnasiadkaso why do we rotate at all?09:39
mgoddardmnasiadka: so they would have to look at the keys to check they are old09:39
priteaumnasiadka: it's a security thing?09:39
mgoddardso that if a key is compromised it is only temporary09:39
hrwINFO:kolla.common.utils.elasticsearch-curator:Successfully tagged kolla/centos-source-elasticsearch-curator:10.1.009:40
mnasiadkapriteau: how long does it take for a normal person without thousands of servers to break a key?09:40
mnasiadkaAES256 if I remember correctly?09:40
mgoddardmore likely they will find a key09:40
priteauIt may be more about people getting access to system than brute force cracking09:40
mnasiadkaso then we should rotate every hour :)09:41
mnasiadkaor give a command to rotate the keys in case of a leak09:41
priteauThe keystone docs use 6 hours hours (although that's just an example)09:41
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: elasticsearch-curator: install boto before curator  https://review.opendev.org/75923309:42
hrwgit commit message could get improvements if someone has any suggestions09:42
*** k_mouza has joined #openstack-kolla09:44
*** wuchunyang has quit IRC10:19
*** bengates has quit IRC10:28
*** bengates has joined #openstack-kolla10:30
*** devfaz has joined #openstack-kolla10:38
mnasiadkahrw: well, probably a bug and a reno, if we would be strictly following the rules ;)11:07
*** kevko has joined #openstack-kolla11:12
*** jonaspaulo has quit IRC11:13
openstackgerritMichal Arbet proposed openstack/kolla-ansible master: Use native fluent-logger instead of tail - Fluent central_logging  https://review.opendev.org/75577511:23
kevkomgoddard: is it ok now with native_fluentd_logger added ? ^^^11:24
mgoddardkevko: sorry, I don't have time for Wallaby patches currently11:25
mgoddardkevko: would you like to discuss it at the PTG?11:26
mgoddardI've added it to the agenda11:28
mgoddardhttps://etherpad.opendev.org/p/kolla-wallaby-ptg11:28
kevkoyeah, sure , but how it works ? :) ..discuss on irc ? Or ?11:30
mgoddardkevko: it's a video call over 2 days next week. Details in the etherpad11:32
mgoddardAdd your name if you're interested in attending11:32
mgoddardeven if you don't want to join the whole session, make a note that you want to be pinged for specific topics11:32
kevkomgoddard: ok, i'm not sure if my english is good enough when I am speaking live :( .. but I can try it :/11:34
mgoddardkevko: it's fine, most will be non-native speakers11:34
kevkook, can I describe what is going on in my patch widely to that etherpad doc ?11:35
mgoddardyes11:35
mgoddardosmanlicilegi: do you want to discuss kolla-ceph at the PTG?11:36
kevkook, i will leave notes then  .. thank you11:36
kevkokolla-ceph ? is this some new project ?11:36
mnasiadkawe removed it some time ago.11:38
mgoddardkevko: kolla used to deploy ceph. It's about where to go if you are using that functionality11:38
*** k_mouza_ has joined #openstack-kolla11:43
*** k_mouza has quit IRC11:43
*** k_mouza has joined #openstack-kolla11:44
*** k_mouza_ has quit IRC11:47
kevkomgoddard: well I know that kolla-ansible used to deploy ceph until train (removed) .. but i think it was good step to remove it from kolla-ansible as there is ceph-ansible11:49
yoctozeptomnasiadka: https://review.opendev.org/759217 slapped w+1 too early; please add CR+2 :-)11:49
patchbotpatch 759217 - kolla-ansible (stable/ussuri) - Fix fernet cron path on Ubuntu/Debian - 1 patch set11:49
yoctozeptokevko: and now cephadm11:49
kevkoyoctozepto: is it better to use cephadm ? anf if .. why ?11:49
yoctozeptowell, the kolla-ceph topic was brought many times since11:49
yoctozeptokevko: it's the so-called future :-)11:50
mgoddardyoctozepto, hrw, mnasiadka, osmanlicilegi, Fl1nt, headphoneJames, bbezak: updated PTG schedule11:50
mgoddardhttps://etherpad.opendev.org/p/kolla-wallaby-ptg11:50
mgoddardbegin the last minute addition of topics :)11:50
kevkoyoctozepto: I'm OK with ceph-ansible ..as it is ansible :)11:52
yoctozeptokevko: well, they might drop its support anytime11:53
yoctozeptokevko: anyhow, cephadm should be pretty easy to use once you have your cluster properly deployed with ceph-ansible anyway11:53
yoctozeptoso, uhm, nothing to worry about :-)11:53
kevkoyoctozepto: btw, i was trying to upgrade from stein to ussuri with kolla-ansible ...i had few small issues ...but what i am curious about what you said about keystone-fernet ...11:55
yoctozeptokevko: have you skipped train? ;O11:55
kevkoyoctozepto: yes11:55
kevkowell, i was trying if it is ok to upgrade ..because we are going to upgrade on client's site ..11:55
kevkobut I probably hit a bug ..because i had stale fernet token ..is your patch fixing it ?11:56
yoctozeptokevko: we have lots of fernet fixes, yes11:56
yoctozeptokevko: turned out to have many funky issues11:56
yoctozeptowe believe we have very few actual ubuntu users and our users seem to not use their clusters on Sundays :D11:57
kevkoyoctozepto: i've seen this in docker logs -> http://paste.openstack.org/show/799274/11:58
kevkoyoctozepto: and both keystones were restarting11:58
yoctozeptokevko: yeah, because we added detection of this bad state...11:58
yoctozeptowell, ubuntu AND debian11:58
yoctozeptolet's say most times I say ubuntu I mean debian as well11:59
yoctozeptobecause they share most of the distro-based issues11:59
kevkoyeah, i know11:59
yoctozeptobeing the other distro family we support11:59
kevkobut I can see big progress in debian/ubuntu support in kolla{-ansible}12:00
kevkofrom stein ,maybe rocky12:00
yoctozeptoyeah, there was indeed12:00
yoctozeptowhile I don't use ubuntu for openstack and sometimes make jokes about deprecating its support, I advocate our support for both major distro families12:01
yoctozeptoand hrw has done a lot of work on debuntu and aarch64 side12:01
*** k_mouza_ has joined #openstack-kolla12:07
*** k_mouza has quit IRC12:10
yoctozeptomgoddard: https://review.opendev.org/693332 weird; it looks as if it hanged12:13
patchbotpatch 693332 - kolla-ansible - WIP: CI: Test MariaDB backup - 3 patch sets12:13
*** k_mouza has joined #openstack-kolla12:13
*** gfidente|pto is now known as gfidente12:15
*** k_mouza_ has quit IRC12:17
ebbexHow can I limit my controller, hypervisor and seed to only have an interface on provision_oc_net? (i have a route to the "oob_oc_net" from provisioning net, and the default seems to want interfaces on both.)12:19
*** muhaha has quit IRC12:24
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: [tox] Optimise docs actions  https://review.opendev.org/75925312:28
*** k_mouza has quit IRC12:29
*** k_mouza has joined #openstack-kolla12:29
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: [docs] Add templates and examples of renos  https://review.opendev.org/75925412:29
yoctozeptomgoddard, mnasiadka: ^ if you like the above, I will propose for kolla too (and please appropriate for kayobe :-) )12:30
openstackgerritMerged openstack/kolla-ansible stable/stein: Fix fernet cron path on Ubuntu/Debian  https://review.opendev.org/75921912:49
*** wuchunyang has joined #openstack-kolla12:54
kevkoguys, i would like to ask what is your opinion to write some common role to copy files ...12:58
kevkoi mean, there are several copying tasks in every role which is copying for example policy files ..12:59
hrwkevko: common as 'macro in macros.j2'?12:59
hrwkevko: if it has sense and covers distros13:00
kevkobut user (as us) want to sometimes change paste-ini file ..or copy some another files ..13:00
yoctozeptokevko: that's kinda the goal to create a k-a framework13:00
kevkoand every time we are changing locally kolla-ansible to do everytime the same13:01
kevkocheck if exist some file in /etc/kolla/config/service/file ... if yes copy to node ..and if defined ..render config.json13:01
* hrw -> food13:01
kevkoso, now we are copying policy files, some kafka certs, paste ini files, and something more ..13:02
kevkoevery time we are merging these changes to kolla-ansible locally13:02
kevkoso i was wondering what is your opinion to have one role (or whatewer iplementation it will be) ... just import in tasks/config.yml and role will find every custom config ..whatewer it is ..render config.json ..copy to node ..13:04
kevkonow it is several "entries" in config json (paste,policy, whatewer) ...in tasks/config ..and when merging (especially config.json) ..sometimes it is confusing for me :) ..so this approach will be very nice for me ..but i thing it is not bad idea globally13:06
mgoddardkevko: it's a nice idea. It would be quite a lot of work to do it for every service for all config. But if we create a general role we can increase usage of it as we go13:22
mgoddardkevko: if done well it could improve performance, by reducing the number of tasks13:22
mgoddardprobably at the expense of complexity13:22
kevkook, i will implement something to future :) when I will have some time :)13:23
mgoddardkevko: well, let's discuss it before jumping in13:26
mgoddard(at the PTG)13:27
kevkomgoddard: ok13:27
mgoddardplease add the topic13:27
mgoddardyoctozepto: mariabackup hang in CI, sounds familiar13:27
yoctozeptomgoddard: ok13:39
*** cah_link has quit IRC13:39
*** TrevorV has joined #openstack-kolla13:40
openstackgerritMerged openstack/kolla-ansible stable/train: Fix fernet cron path on Ubuntu/Debian  https://review.opendev.org/75921813:49
*** k_mouza has quit IRC14:01
*** k_mouza has joined #openstack-kolla14:07
openstackgerritMerged openstack/kolla-ansible stable/ussuri: Fix fernet cron path on Ubuntu/Debian  https://review.opendev.org/75921714:22
*** kevko has quit IRC14:23
*** grandfso has quit IRC14:24
mnasiadkayoctozepto: what about supplying a predefined template for bug at least? I mean a template you can use with "reno new bla-bla --from-template bug-template.yaml"?14:44
yoctozeptomnasiadka: hmm, does reno do that? did not know14:45
mnasiadkayoctozepto: it seems it does, just checked in the docs14:46
yoctozeptomnasiadka: oh, great; that would make it even better14:47
yoctozeptomnasiadka: it could be made a part of tox14:47
*** skramaja_ has quit IRC14:50
*** nikparasyr has left #openstack-kolla15:07
mgoddardCI unblocker: https://review.opendev.org/#/c/759233/15:08
patchbotpatch 759233 - kolla - elasticsearch-curator: install boto before curator - 1 patch set15:08
*** also_stingrayza has joined #openstack-kolla15:12
*** e0ne has quit IRC15:14
*** stingrayza has quit IRC15:15
*** muhaha has joined #openstack-kolla15:23
*** williampiv has joined #openstack-kolla15:34
*** bengates has quit IRC15:43
*** bengates has joined #openstack-kolla15:44
*** wuchunyang has quit IRC15:47
*** bengates has quit IRC15:48
*** rpittau is now known as rpittau|afk15:57
*** iniazi has quit IRC15:58
*** k_mouza has quit IRC16:06
*** k_mouza_ has joined #openstack-kolla16:06
*** k_mouza_ has quit IRC16:10
*** muhaha has quit IRC17:06
*** bsanjeewa has joined #openstack-kolla17:07
*** born2bake has joined #openstack-kolla17:18
*** kevko has joined #openstack-kolla17:19
*** bsanjeewa has quit IRC17:24
*** gfidente is now known as gfidente|afk17:28
*** vishalmanchanda has quit IRC17:39
*** jonaspaulo has joined #openstack-kolla17:42
*** jonaspaulo has quit IRC17:48
*** jonaspaulo has joined #openstack-kolla17:50
*** ricolin has quit IRC17:54
*** jonaspaulo has quit IRC18:10
*** KurtB has quit IRC18:35
*** e0ne has joined #openstack-kolla18:59
*** kevko has quit IRC19:06
*** kevko has joined #openstack-kolla19:11
*** dardelean has quit IRC19:28
*** e0ne has quit IRC19:53
*** TrevorV has quit IRC20:38
*** primeministerp has quit IRC20:50
*** kwazar has joined #openstack-kolla21:15
*** born2bake has quit IRC21:54
*** bsanjeewa has joined #openstack-kolla22:18
*** bsanjeewa has quit IRC22:23
*** iniazi has joined #openstack-kolla23:02
*** benj_ has quit IRC23:21
*** benj_ has joined #openstack-kolla23:26
*** williampiv has quit IRC23:38

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!