Thursday, 2020-04-23

*** k_mouza has joined #openstack-kolla00:34
*** k_mouza has quit IRC00:39
*** cdearborn has quit IRC00:47
*** kplant has quit IRC01:13
*** kplant has joined #openstack-kolla01:14
*** wuchunyang has joined #openstack-kolla01:19
*** wuchunyang has quit IRC01:24
*** zhanglong has joined #openstack-kolla01:29
*** JangwonLee_ has joined #openstack-kolla02:03
*** JangwonLee__ has quit IRC02:06
*** threestrands has joined #openstack-kolla02:33
*** ricolin_ has joined #openstack-kolla02:44
*** dking has quit IRC02:54
openstackgerritya.wang proposed openstack/kolla-ansible stable/train: Fix that cyborg agent failed to start privsep daemon.  https://review.opendev.org/72219503:12
*** negronjl has quit IRC04:10
*** negronjl has joined #openstack-kolla04:14
*** evrardjp has quit IRC04:35
*** evrardjp has joined #openstack-kolla04:35
*** JangwonLee__ has joined #openstack-kolla04:38
*** JangwonLee_ has quit IRC04:41
*** negronjl has quit IRC04:42
*** negronjl has joined #openstack-kolla04:45
*** cah_link1 has joined #openstack-kolla04:58
*** wuchunyang has joined #openstack-kolla04:58
*** cah_link has quit IRC05:00
*** cah_link1 is now known as cah_link05:00
*** wuchunyang has quit IRC05:01
*** ykarel|away is now known as ykarel05:02
*** skramaja has joined #openstack-kolla05:20
*** sorin-mihai_ has quit IRC05:26
*** vishalmanchanda has joined #openstack-kolla05:27
*** oklhost has joined #openstack-kolla05:32
*** cah_link has quit IRC05:51
openstackgerritJames Kirsch proposed openstack/kolla master: Modify Heat container to execute httpd setup  https://review.opendev.org/72202806:16
*** cah_link has joined #openstack-kolla06:20
*** zhanglong has quit IRC06:21
*** zhanglong has joined #openstack-kolla06:23
*** jaicaa has quit IRC06:29
*** jaicaa has joined #openstack-kolla06:32
*** nikparasyr has joined #openstack-kolla06:46
yoctozeptomorning06:52
*** zhanglong has quit IRC07:02
*** suff has joined #openstack-kolla07:05
mnasiadkamorning07:09
*** JangwonLee_ has joined #openstack-kolla07:10
*** KeithMnemonic has quit IRC07:12
*** JangwonLee__ has quit IRC07:14
*** bengates has joined #openstack-kolla07:24
*** bengates has quit IRC07:25
*** e0ne has joined #openstack-kolla07:25
*** bengates has joined #openstack-kolla07:25
*** e0ne has quit IRC07:25
*** zhanglong has joined #openstack-kolla07:27
*** rpittau|afk is now known as rpittau07:39
hrwwyjebongo++07:39
hrwelo07:39
*** abdysn has joined #openstack-kolla07:42
yoctozeptolol07:55
*** ykarel is now known as ykarel|lunch08:03
*** e0ne has joined #openstack-kolla08:06
*** e0ne has quit IRC08:09
hrwyoctozepto: have a problem?08:11
*** igordc has quit IRC08:13
*** threestrands has quit IRC08:33
*** happyhemant has joined #openstack-kolla08:46
*** gfidente|afk is now known as gfidente08:47
*** ykarel|lunch is now known as ykarel08:56
*** k_mouza has joined #openstack-kolla08:58
mgoddardmorning08:58
mgoddarddcapone2004: CentOS 8 should work in the stable/train branch. We haven't tagged a release with support yet though09:05
mgoddardyoctozepto: I put my name down for the EU/US timezone09:05
mgoddardyoctozepto: also signed up for PTG slots09:06
mgoddardyoctozepto: on your question about sanity checks, I have never enabled those flags09:07
mgoddardI have sometimes run the check command09:08
mgoddardone of my oldest open reviews is to check containers in the check command: https://review.opendev.org/59973509:09
patchbotpatch 599735 - kolla-ansible - Check containers during kolla-ansible check - 17 patch sets09:09
mgoddardunsure why it never gained traction09:09
openstackgerritMark Goddard proposed openstack/kayobe stable/train: Fix passwords.yml generation with vault encryption on Python 3  https://review.opendev.org/72223609:15
*** chardegen has joined #openstack-kolla09:18
*** Abdallahyas has joined #openstack-kolla09:25
*** suff1 has joined #openstack-kolla09:25
*** suff has quit IRC09:27
*** Abdallahyas has quit IRC09:27
yoctozeptomgoddard: cool; as for checks neither did I, I guess the best solution is to just remove all traces of them ;p09:27
*** abdysn has quit IRC09:28
*** k_mouza has quit IRC09:30
*** abdysn has joined #openstack-kolla09:31
*** k_mouza has joined #openstack-kolla09:34
*** k_mouza has quit IRC09:35
*** k_mouza has joined #openstack-kolla09:35
openstackgerritMarcin Juszkiewicz proposed openstack/kolla stable/train: [WIP] switch to official CentOS 8 repositories  https://review.opendev.org/72132909:36
hrwaarch64 related improvements added09:36
hrwenough of work for today09:39
*** numans has quit IRC09:42
*** born2bake has joined #openstack-kolla09:47
*** ykarel is now known as ykarel|afk09:47
openstackgerritMark Goddard proposed openstack/kayobe stable/train: Fix passwords.yml generation with vault encryption on Python 3  https://review.opendev.org/72223609:47
*** e0ne has joined #openstack-kolla09:47
*** k_mouza has quit IRC09:58
*** cosmicsound has quit IRC10:01
*** cosmicsound8 has joined #openstack-kolla10:01
*** k_mouza has joined #openstack-kolla10:07
hrwI suppose that no one will take a look at https://review.opendev.org/721329 until I remove [WIP] from it?10:10
patchbotpatch 721329 - kolla (stable/train) - [WIP] switch to official CentOS 8 repositories - 4 patch sets10:10
*** zhanglong has quit IRC10:11
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Add support for encrypting glance api  https://review.opendev.org/70713110:15
*** ykarel|afk is now known as ykarel10:21
*** rpittau is now known as rpittau|bbl10:21
*** riuzen has joined #openstack-kolla10:21
*** riuzen has quit IRC10:22
openstackgerritMerged openstack/kolla-ansible stable/train: Fix that cyborg agent failed to start privsep daemon.  https://review.opendev.org/72219510:41
*** wuchunyang has joined #openstack-kolla11:06
*** wuchunyang has quit IRC11:16
openstackgerritMerged openstack/kayobe stable/train: Fix seed VM provisioning on a remote seed hypervisor  https://review.opendev.org/72198311:35
openstackgerritMerged openstack/kolla master: Add stunnel container for Glance service  https://review.opendev.org/72085011:48
*** jimcrowleyibm has joined #openstack-kolla11:49
*** wuchunyang has joined #openstack-kolla11:55
openstackgerritRaimund Hook (stingrayza) proposed openstack/kolla-ansible master: Removing a extra word in Central Loggin docs  https://review.opendev.org/72228211:57
openstackgerritRaimund Hook (stingrayza) proposed openstack/kolla-ansible master: Removing a extra word in Central Logging docs  https://review.opendev.org/72228211:57
*** rpittau|bbl is now known as rpittau12:02
*** dougsz has joined #openstack-kolla12:15
*** dcapone2004 has quit IRC12:17
*** ykarel is now known as ykarel|afk12:22
*** seco has joined #openstack-kolla12:22
*** cah_link1 has joined #openstack-kolla12:45
*** cah_link has quit IRC12:47
*** cah_link1 is now known as cah_link12:47
oklhostI already asked in12:51
oklhostwoops12:51
openstackgerritMark Goddard proposed openstack/kayobe master: Improve SSH known host error messages  https://review.opendev.org/72068712:51
oklhostI already asked in #openstack-dns, they told me I should ask here. Question: I'd like to enable designate in my OpenStack deployment (kolla-ansible) using this guide: https://docs.openstack.org/kolla-ansible/latest/reference/networking/designate-guide.html deployment went well, but I can't add any zones like mentioned in the guide. I get the error "Could not find Pool", in designate-central logs these error pop up: http://paste.openstack.org12:52
oklhost/show/792598/12:52
*** wuchunyang has quit IRC12:52
*** wuchunyang has joined #openstack-kolla12:53
stingrayzaoklhost: can you please post your globals.yml? (or at least the designate bits) as well as your /etc/kolla/config/designate/designate-sink.conf ?12:55
oklhoststingrayza: Sure. Just a moment. But maybe I already got my issue. I didn't create designate-sink.conf, I enabled designate, designate_ns_record & redis in globals.yaml and ran deployment, then I tried to create a zone. Maybe thats the problem?13:00
yoctozeptosink is only for integration with nova afair13:00
stingrayzayeah - the sink bit is only if you want the auto-dns entry for every instance you create13:01
stingrayzaonce you have designate running, even without the sink bits, you should be able to create zones13:02
openstackgerritMerged openstack/kolla-ansible master: Removing a extra word in Central Logging docs  https://review.opendev.org/72228213:04
*** wuchunyang has quit IRC13:05
oklhostglobals: http://paste.openstack.org/show/792600/13:05
*** igordc has joined #openstack-kolla13:07
oklhoststingrayza: that's what I expected. Maybe we're doing something wrong in our superdooper enterprise nightmare environment. so many openstack components just fail and I never find anything that helps in google.13:07
openstackgerritMark Goddard proposed openstack/kayobe master: WIP: Switch default docker storage driver to overlay2  https://review.opendev.org/65881513:21
openstackgerritMark Goddard proposed openstack/kayobe master: Enable 'data' LVM group only for Docker devicemapper  https://review.opendev.org/72231613:21
mgoddardoklhost: is this bug related: https://bugs.launchpad.net/kolla-ansible/+bug/185587713:22
openstackLaunchpad bug 1855877 in kolla-ansible "Kolla-ansible can't create default server pool for Designate " [Medium,Triaged]13:22
*** ykarel|afk is now known as ykarel13:24
oklhostmgoddard: hell yeah! That describes my issue exactly. Thank you so much. Will try tomorrow like described by Wojtek.13:27
mgoddardoklhost: seems we're missing a bit of automation for designate. If it's something you are able to work on, that would be awesome13:27
oklhostmgoddard: I'll have a look tomorrow and will try. I would be very happy to give something back to the community, but I'm a bloody OpenStack as well as ansible noob, did work in a ruby-company before, so I'm more familiar with ruby and chef.13:30
mgoddardoklhost: no problem, I'm sure people will be able to help. Having someone with an environment to verify the patch will give us confidence13:31
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: CentOS 8: CI: Test CentOS 7 to 8 migration  https://review.opendev.org/71160113:32
oklhostmgoddard: Great. I'll keep you guys updated. :) We plan to use kolla-ansible for our next-gen private cloud, so there should be more we could try in our environment.13:33
mgoddardoklhost: great choice :D13:35
oklhostmgoddard: I hope so! ;) Fun on the side, your work on kolla-ansible is awesome. Great project <313:36
mgoddardoklhost: indeed, spread the word :)13:37
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: Remove empty default LVM configuration  https://review.opendev.org/72232113:38
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: CI: switch to Docker overlay2 storage driver by default  https://review.opendev.org/72232213:38
*** seco has quit IRC13:38
oklhostmgoddard: For sure I will! ;) Okay folks... I've to leave, my wife wants me to go our for a walk in the sun. Thanks again for your response, we'll be in touch soon. cheers!13:39
openstackgerritMerged openstack/kayobe stable/rocky: Fix seed VM provisioning on a remote seed hypervisor  https://review.opendev.org/72198513:43
*** priteau has joined #openstack-kolla13:44
*** nikparasyr has quit IRC13:54
*** scottsol has joined #openstack-kolla14:00
*** TrevorV has joined #openstack-kolla14:06
*** vishalmanchanda has quit IRC14:07
*** wuchunya_ has joined #openstack-kolla14:09
*** oyrogerg has quit IRC14:11
*** dcapone2004 has joined #openstack-kolla14:11
dcapone2004moggard:  When you say the stable/Train you mean via git only14:12
dcapone2004mgoddard: still not pushed into the pip package?14:13
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: Remove empty default LVM configuration  https://review.opendev.org/72232114:14
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: CI: switch to Docker overlay2 storage driver by default  https://review.opendev.org/72232214:14
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: CentOS 8: switch to new deploy jobs  https://review.opendev.org/72232614:14
mgoddarddcapone2004: correct - git branch stable/train14:14
*** seco has joined #openstack-kolla14:15
*** e0ne has quit IRC14:17
*** e0ne has joined #openstack-kolla14:17
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Add docs and release note for CentOS 8  https://review.opendev.org/72232814:20
*** seco has quit IRC14:22
*** oyrogerg has joined #openstack-kolla14:23
*** wuchunyang has joined #openstack-kolla14:35
*** cdearborn has joined #openstack-kolla14:49
*** k_mouza has quit IRC14:53
*** cdearborn has quit IRC14:53
*** k_mouza has joined #openstack-kolla14:53
*** cdearborn has joined #openstack-kolla14:53
*** seco has joined #openstack-kolla14:53
stingrayzasorry klubbers... not going to to make today's call :( If there's a recording again, it would be great14:55
*** wuchunyang has quit IRC14:56
*** wuchunyang has joined #openstack-kolla14:56
*** chardegen has quit IRC14:56
*** dking has joined #openstack-kolla15:01
mgoddardKolla klub meeting: https://meet.google.com/hph-pynx-vsy15:01
*** ykarel is now known as ykarel|away15:02
*** ricolin_ has quit IRC15:06
*** abdysn has quit IRC15:06
*** skramaja has quit IRC15:13
*** zhanglong has joined #openstack-kolla15:19
*** zhanglong has quit IRC15:23
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Add support for encrypting heat api  https://review.opendev.org/72235515:24
*** zhanglong has joined #openstack-kolla15:24
*** born2bake has quit IRC15:28
*** pescobar has joined #openstack-kolla15:37
pescobarthansk @mgoddard for the interesing talk :)15:57
mgoddardyou're welcome pescobar :)15:57
*** wuchunya_ has quit IRC15:57
dkingThank you very much for the meeting! The information is very valuable.15:59
noxoid^16:00
noxoidmgoddard: dking and i may be able to present something in the future, we need to talk to the president of our company first though16:00
yoctozeptoif there is serious interest in kolla-deployed ceph, then I guess we could restore the removed code in a separate project, it best live outside of openstack lifecycle anyway as the two projects have very different ones16:00
*** zhanglong has quit IRC16:01
yoctozeptobut it would still be external ceph as far as kolla-ansible is considered16:01
mgoddardyoctozepto: that was proposed via ML, but no one came forward to help maintain16:06
yoctozeptomgoddard: yeah, /me aware, just reminding :-)16:06
mgoddardthe suggestion hasn't expired - anyone could extract the code from ceph16:06
mgoddardnoxoid: that would be great. Let us know16:07
*** seco has quit IRC16:08
*** bengates has quit IRC16:10
*** bline has quit IRC16:10
dkingI know that it's getting late on that side of the world, but I'm having some trouble this morning with kayobe overcloud hardware inspect. I see that the server is able to boot, get the DHCP response, and it looks like it's downloading the images but it seems to stall after that.16:11
dkingI was just using the default settings for images, but I also tried updating ipa_kernel_upstream_url and the ramdisk with https://tarballs.openstack.org/ironic-python-agent-builder/dib/files/ipa-centos8-master.kernel, but the same outcome. Is that the right location for that change?16:15
*** wuchunyang has quit IRC16:18
dkingmgoddard: Would you have any thoughts on that?16:21
*** bline has joined #openstack-kolla16:22
mgoddarddking: are you using Train?16:24
dkingYes, I'm using Train16:24
dkingThe hard part here is knowing where things are failing, because it seems to be failing after downloading the IPA images. When I was using plain Kolla-ansible, I was using PXE, rather than iPXE, though I don't know if that makes a difference, since it seems to get far enough to download the images.16:27
mgoddarddking: I need to head off now really. I'd suggest using tcpdump to check the traffic, and also look at the kernel console args16:32
dkingmgoddard: Thanks. I'll probably work on something else for a bit, and maybe try adjusting the kernel args. Thanks again for the meeting, and have a great night.16:33
mgoddardnp, and you16:33
*** evrardjp has quit IRC16:35
*** evrardjp has joined #openstack-kolla16:35
*** scottsol has quit IRC16:36
*** rpittau is now known as rpittau|afk16:49
*** bline has quit IRC16:57
*** k_mouza has quit IRC16:57
*** bline has joined #openstack-kolla16:59
*** cdearborn has quit IRC17:02
*** spsurya_ has quit IRC17:03
openstackgerritMarcin Juszkiewicz proposed openstack/kolla stable/train: [WIP] switch to official CentOS 8 repositories  https://review.opendev.org/72132917:06
hrwmgoddard: bifrost pass now17:06
*** dougsz has quit IRC17:10
openstackgerritCyril Roelandt proposed openstack/kolla stable/train: Add nfs dependencies to glance container  https://review.opendev.org/72240617:11
*** priteau has quit IRC17:16
*** seco has joined #openstack-kolla17:22
*** gfidente is now known as gfidente|afk17:22
*** bline has quit IRC17:31
*** e0ne has quit IRC17:47
*** e0ne has joined #openstack-kolla17:48
*** seco has quit IRC17:54
*** jbadiapa has quit IRC18:04
openstackgerritRadosław Piliszek proposed openstack/kolla stable/stein: Add nfs dependencies to glance container  https://review.opendev.org/72241718:23
openstackgerritRadosław Piliszek proposed openstack/kolla master: CI: Add swift jobs  https://review.opendev.org/72212718:41
*** KeithMnemonic has joined #openstack-kolla18:46
*** seco has joined #openstack-kolla18:53
dcapone2004if using a custom SSL certificate with kolla-ansible, is the file specified in kolla_external_fqdn_cert supposed to contain both the cert and the private key?  Or the key specified via a different variable18:57
*** k_mouza has joined #openstack-kolla18:58
*** dougsz has joined #openstack-kolla19:01
*** k_mouza has quit IRC19:02
*** jimcrowleyibm has quit IRC19:06
yoctozeptodcapone2004: both, it's documented to be both, it is what haproxy wants19:08
dcapone2004no prob...figured that, but figured since I had the window open I might as well ask while setting u my variables19:16
dcapone2004bigger question/issue... I am failing the prechecks on Checking if kolla_internal_vip_address and kolla_external_vip_address are not pingable from any node]19:16
dcapone2004but the internal and external VIP ARE pingable … is icmp supposed to be blocked by firewalld?19:17
dcapone2004or iptables … looks like bootstrap process switched to IPtables19:18
*** jimcrowleyibm has joined #openstack-kolla19:19
yoctozeptodcapone2004: they are supposed to be not used at this point19:22
yoctozeptobecause the are "virtual"19:22
yoctozeptoshould not exist before deployment revives them19:22
dcapone2004oh ok, so those shouldn't be the interface IPs of the interface they are supposed to bind to19:23
dcapone2004they should be another IP in the same subnet of the corresponding interfaces?19:23
*** jimcrowleyibm has quit IRC19:24
*** jimcrowleyibm has joined #openstack-kolla19:25
*** vesper has joined #openstack-kolla19:37
*** vesper11 has quit IRC19:38
*** jonaspaulo has joined #openstack-kolla19:38
*** igordc has quit IRC19:39
yoctozeptodcapone2004: exactly19:40
dcapone2004yep already running through, had it backwards in my docs...thought I gave kolla the interface IP and it came back with the VIP19:41
*** suff1 has quit IRC19:49
*** numans has joined #openstack-kolla19:51
dcapone2004general openstack / performance question .. is it possible to run openstack services on the same 3 nodes as a ceph cluster?  We were supposed to fly out and deploy 3 new servers at a remote datacenter, but that is on hold19:54
dcapone2004due to covid-19, and I am wondering how bad the performance might be if I deployed to the same hardware nodes at the ceph cluster and later expanded the openstack nodes and migrated those containers off19:55
openstackgerritMark Goddard proposed openstack/kayobe master: Improve SSH known host error messages  https://review.opendev.org/72068719:56
*** priteau has joined #openstack-kolla19:56
*** TrevorV has quit IRC20:00
mgoddarddcapone2004: hyperconverged setups run the storage and compute on the same hosts, so it has precedent20:01
dcapone2004mgoddard: guessing using LVM vs ceph?20:15
*** e0ne has quit IRC20:22
*** mloza has joined #openstack-kolla20:31
*** seco has quit IRC20:31
*** igordc has joined #openstack-kolla20:32
*** cah_link has quit IRC20:46
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Add support for encrypting heat api  https://review.opendev.org/72235520:46
*** seco has joined #openstack-kolla20:47
*** dougsz has quit IRC20:50
openstackgerritMerged openstack/kolla stable/stein: Add nfs dependencies to glance container  https://review.opendev.org/72241721:00
openstackgerritMerged openstack/kolla master: CI: Add swift jobs  https://review.opendev.org/72212721:00
*** born2bake has joined #openstack-kolla21:27
*** priteau has quit IRC21:33
*** igordc has quit IRC21:51
*** jonaspaulo has quit IRC22:24
*** igordc has joined #openstack-kolla22:26
*** seco has quit IRC22:40
*** jimcrowleyibm has quit IRC22:43
*** born2bake has quit IRC22:55
dcapone2004so, I think there is an issue in kolla-ansible when deploying using a SSL certificate that uses SANs for the fqdn and it fails to authenticate22:57
dcapone2004I have been working the issue for an hour now, and the reconfigure fails at the creating keystone services phase, but the error is related to a bad SSL handshake22:57
dcapone2004however, if I go to the URL (including port) of all of the URLs emitted in the error message generated by kolla-ansible, Google Chrome shows the certificate is fine22:58
*** igordc has quit IRC23:05
openstackgerritMerged openstack/kayobe stable/stein: Fix seed VM provisioning on a remote seed hypervisor  https://review.opendev.org/72198423:28
openstackgerritMerged openstack/kayobe master: Add kolla_enable_openstack_core variable  https://review.opendev.org/71778523:44
*** k_mouza has joined #openstack-kolla23:44
*** k_mouza has quit IRC23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!