Tuesday, 2020-06-09

openstackgerritMerged openstack/kayobe stable/stein: Fix concurrency issues while adding SSH keys to known_hosts  https://review.opendev.org/73384100:21
*** jcmdln has quit IRC01:12
*** jcmdln has joined #openstack-kolla01:19
*** wuchunyang has joined #openstack-kolla01:23
*** wuchunyang has quit IRC01:26
*** wuchunyang has joined #openstack-kolla01:27
*** hongbin_ has joined #openstack-kolla01:34
*** hongbin_ has quit IRC01:34
*** hongbin_ has joined #openstack-kolla01:35
*** hongbin_ has quit IRC01:37
*** hongbin_ has joined #openstack-kolla01:37
*** also_stingrayza has joined #openstack-kolla01:49
*** stingrayza has quit IRC01:51
*** hongbin_ has quit IRC01:59
*** hongbin_ has joined #openstack-kolla01:59
*** hongbin_ has quit IRC01:59
*** ricolin has joined #openstack-kolla02:34
*** jcmdln has quit IRC02:58
*** Torel has quit IRC03:00
*** Torel has joined #openstack-kolla03:01
*** Torel has quit IRC03:09
*** jcmdln has joined #openstack-kolla03:13
*** wuchunyang has quit IRC03:20
*** hongbin has joined #openstack-kolla03:28
*** k_mouza has joined #openstack-kolla03:52
*** diurnalist has quit IRC03:54
*** skramaja has joined #openstack-kolla03:56
*** k_mouza has quit IRC03:57
*** wuchunyang has joined #openstack-kolla04:14
*** hongbin has quit IRC04:14
*** wuchunyang has quit IRC04:18
*** dmellado has quit IRC04:25
*** evrardjp has joined #openstack-kolla04:33
*** factor has joined #openstack-kolla04:35
*** ykarel|away is now known as ykarel04:42
*** abdysn has joined #openstack-kolla05:01
*** wuchunyang has joined #openstack-kolla05:03
*** cah_link has joined #openstack-kolla05:26
*** wuchunyang has quit IRC05:37
*** seco has joined #openstack-kolla05:47
*** diurnalist has joined #openstack-kolla05:52
*** diurnalist has quit IRC05:56
yoctozeptomorning channel05:59
yoctozeptokplant: I think we have a bug on it05:59
*** bsanjeewa has joined #openstack-kolla06:42
*** vishalmanchanda has joined #openstack-kolla06:47
*** xinliang has joined #openstack-kolla06:49
*** wuchunyang has joined #openstack-kolla06:52
openstackgerritChristian Berendt proposed openstack/kolla stable/train: Bump versions for Train  https://review.opendev.org/73179906:53
*** jbadiapa has joined #openstack-kolla06:55
*** amoralej|off is now known as amoralej07:23
*** bengates has joined #openstack-kolla07:24
*** dougsz has joined #openstack-kolla07:25
*** bengates has quit IRC07:26
*** bengates has joined #openstack-kolla07:27
*** nathharp has quit IRC07:28
*** nathharp has joined #openstack-kolla07:29
mgoddardbsanjeewa: hi. There is no longer support for configuring NTP daemon on the seed and seed hypervisor hosts. For the overcloud yuo can use the chrony daemon.07:38
mgoddardbsanjeewa: https://docs.openstack.org/kayobe/latest/configuration/hosts.html#ntp07:38
bsanjeewamsgoddard: Yes I ma aware, so I wanted to configure the time seeding server in the time.yml. Because our firewalls block the time requests to outside, we use out AD as the time source07:42
mgoddardbsanjeewa: for chrony?07:42
mgoddard(container)07:42
openstackgerritMark Goddard proposed openstack/kolla stable/stein: Fix multiple issues  https://review.opendev.org/73413107:44
bsanjeewamgoddard: all servers in DMZ, so I thought that setting should go to overcloud as well07:45
mgoddardbsanjeewa: for chrony you can set external_ntp_servers in etc/kayobe/kolla/globals.yml07:46
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Fix handler notification for mariadb-clustercheck  https://review.opendev.org/73443207:47
bsanjeewamgoddard: So I prepd ntp.yml with  ntp_config_server: ad server ip for the previous version. But couldn't finish deploy07:47
mgoddardbsanjeewa: that option no longer exists in master/ussuri07:48
mgoddardbsanjeewa: which release are you using?07:48
*** rpittau|afk is now known as rpittau07:54
bsanjeewamgoddard: trying to do the first poc with kayobe. Earlier I went with pip install kayobe, now I try to use git clone https://opendev.org/openstack/kayobe.git07:56
mgoddardbsanjeewa: I would suggest using the stable/train branch if you are using source. This is the most recent stable branch07:57
mgoddardmaster is close to release, but still in development07:57
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Run kolla-toolbox container unpriviliged  https://review.opendev.org/73270008:02
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: fix create loadbalancer failed  https://review.opendev.org/73443508:05
*** xinliang has quit IRC08:06
*** maharg101 has quit IRC08:10
bsanjeewamgoddard: will try that, thanks08:11
mgoddardbsanjeewa: also, how are you running it? following the development guide, or using a-universe-from-nothing?08:12
bsanjeewamgoddard: will stable/ussuri come soon. I'm following the deployment guide latest08:13
mgoddardbsanjeewa: I'm about to propose patches to create it. But that will just be a release candidate, not final release08:13
bsanjeewamgoddard: to use stable/train do I have to go back to CentOS 708:19
*** kevko_ has joined #openstack-kolla08:25
*** wuchunyang has quit IRC08:25
openstackgerritMark Goddard proposed openstack/kayobe master: Add seed VM provisioning CI job  https://review.opendev.org/55970608:26
*** kevko has quit IRC08:27
mgoddardbsanjeewa: stable/train has support for CentOS 8, but it is newer so may have one or two issues08:29
mgoddardbsanjeewa: some docs you might find useful for using CentOS 8 on train: https://review.opendev.org/73182908:29
patchbotpatch 731829 - kayobe (stable/train) - CentOS 8: add docs and release note - 2 patch sets08:29
*** ykarel is now known as ykarel|lunch08:31
openstackgerritRadosław Piliszek proposed openstack/kolla stable/stein: Fix multiple issues  https://review.opendev.org/73413108:34
*** xinliang has joined #openstack-kolla08:34
mgoddardbsanjeewa: could you provide the name of the task that failed on https://storyboard.openstack.org/#!/story/2007779 ?08:34
mgoddardbsanjeewa: are you using ansible_connection=local?08:34
openstackgerritRadosław Piliszek proposed openstack/kolla stable/stein: Bump versions for Stein  https://review.opendev.org/73180108:35
*** wuchunyang has joined #openstack-kolla08:38
*** born2bake has joined #openstack-kolla08:39
openstackgerritRadosław Piliszek proposed openstack/kolla stable/ussuri: Victoria: Add releasenote for remove congress images  https://review.opendev.org/73186208:41
openstackgerritRadosław Piliszek proposed openstack/kolla stable/ussuri: Add releasenote for congress deprecation  https://review.opendev.org/73186208:42
openstackgerritRadosław Piliszek proposed openstack/kolla stable/ussuri: Add releasenote for congress deprecation  https://review.opendev.org/73186208:42
*** e0ne has joined #openstack-kolla08:46
hrw+208:48
*** eliaswimmer_ has joined #openstack-kolla08:50
bsanjeewamgoddard: in inventory/hosts for localhost only, I went with --system-site-packages, let me revert back and upload the logs08:53
mgoddardbsanjeewa: you should give the host a different hostname than localhost08:55
wuchunyanghrw  hello, recently  i have tested octavia,  but i got an error  about ovs-vsctl when i bonded an interface to br-int  . it seems missing libibverbs.08:58
openstackgerritMark Goddard proposed openstack/kayobe-config master: Synchronise with kayobe for Ussuri  https://review.opendev.org/73446608:58
wuchunyangcentos kolla_base_ditro08:58
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Fix chrony permissions inside docker container  https://review.opendev.org/73404208:59
hrwwuchunyang: do you have mellanox cards?08:59
wuchunyangUbuntu is work08:59
bsanjeewamgoddard: ansible_connection=local is used only here08:59
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Fix chrony permissions inside docker container  https://review.opendev.org/73404208:59
bsanjeewa# This host acts as the configuration management Ansible control host. This must be08:59
bsanjeewa# localhost.09:00
bsanjeewalocalhost ansible_connection=local09:00
bsanjeewaonly localhost is used here09:00
*** priteau has joined #openstack-kolla09:01
hrwwuchunyang: sorry, I do not remember how was the story of it. deep in other project today09:01
wuchunyanghrw  what is meaning of mellanox cards?09:01
wuchunyanghrw     i want add this packages into image , i don't know wheather this is needed or not09:02
hrwwuchunyang: https://bugzilla.redhat.com/show_bug.cgi?id=165813809:02
openstackbugzilla.redhat.com bug 1658138 in openstack-tripleo-puppet-elements "missing libibverbs from overcloud image to enable ovs-dpdk with mlnx nic" [Medium,New] - Assigned to rhos-maint09:02
hrwiirc this was one about it09:02
wuchunyangovs need too09:03
wuchunyangshould we add this package into images09:03
wuchunyang'?09:03
hrwwuchunyang: can you add, build images and check does it help?09:03
hrwwuchunyang: I am trying to build something completely unrelated to kolla today09:04
wuchunyangyes,ok , i will add to package, can you help review ?09:04
hrwsure09:04
wuchunyangi know ,neutron_openvswitch_agent, ovs_db, ovs_vswitchd need this package.09:05
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: Synchronise with kayobe-config for Ussuri  https://review.opendev.org/73447309:05
wuchunyangwhich ironic images need too ?09:06
mgoddardbsanjeewa: ok, that should be fine09:06
wuchunyangmgoddard  hi could  you help review https://review.opendev.org/#/c/733986/ again ? i consider use "become true" is better than create folder first and set own.09:12
patchbotpatch 733986 - kolla-ansible - permission denied when enable_kolla_dev_mod - 1 patch set09:12
*** ykarel|lunch is now known as ykarel09:15
*** lvdombrkr has joined #openstack-kolla09:16
lvdombrkrHello guys,  i have changed hostname for my compute node host, but in contaiers there is sill old one under /etc/hostname09:16
lvdombrkrany clues how to change it?09:16
wuchunyangall contaiers are old ?09:19
lvdombrkrwuchunyang: what you mean by old? all containers was deployed when there was still old hostname09:20
lvdombrkrnow i changed hostname09:20
lvdombrkrfor host but inside containers still old one09:21
mgoddardlvdombrkr: restart containers?09:23
lvdombrkrmgoddard wuchunyang : http://paste.openstack.org/raw/794505/09:24
lvdombrkrmgoddard: tried to restart nothin changes09:25
*** kevko_ has quit IRC09:26
*** kevko has joined #openstack-kolla09:27
mgoddardlvdombrkr: remove containers and redeploy?09:28
*** dciabrin is now known as dciabrin|afk09:28
*** eliaswimmer_ has quit IRC09:29
kevkomgoddard: Hi, you was right ..bug in chrony is caused by apparmor ..but on docker host ..not inside docker container ..09:29
kevkomgoddard: https://review.opendev.org/#/c/734042/409:30
patchbotpatch 734042 - kolla-ansible - Fix chrony permissions inside docker container - 4 patch sets09:30
kevkoyoctozepto: Radoslav ^^09:30
mgoddardkevko: cool. If root can't gets perm denied, usually means apparmor or selinux09:31
kevkobut, how it can be fixed if it is not in container ..09:31
lvdombrkrmgoddard: you mean remove containers with kolla-ansible destroy --limit and then deploy back?09:32
mgoddardlvdombrkr: kolla-ansible destroy --limit doesn't work09:33
mgoddardlvdombrkr: docker rm $(docker ps -q)09:33
lvdombrkrmgoddard: and then deploy?09:34
mgoddardlvdombrkr: yes09:34
lvdombrkrmgoddard: good. thnaks09:34
*** bsanjeewa has quit IRC09:42
*** jschlueter has quit IRC09:43
*** ricolin has quit IRC09:59
*** ykarel is now known as ykarel|afk10:00
*** hjensas has quit IRC10:02
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: Remove empty default LVM configuration  https://review.opendev.org/72232110:02
*** xinliang has quit IRC10:05
openstackgerritMerged openstack/kolla-ansible master: Add 'ovn' to list of valid values of neutron_plugin_agent  https://review.opendev.org/73417410:05
openstackgerritMerged openstack/kolla stable/ussuri: Add releasenote for congress deprecation  https://review.opendev.org/73186210:05
*** Tony31 has quit IRC10:05
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Add 'ovn' to list of valid values of neutron_plugin_agent  https://review.opendev.org/73453610:07
*** rpittau is now known as rpittau|bbl10:11
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: Remove empty default LVM configuration  https://review.opendev.org/72232110:11
openstackgerritMichal Arbet proposed openstack/kolla-ansible master: Disable apparmor's chronyd profile on Ubuntu  https://review.opendev.org/73404210:12
kevkomgoddard: yoctozepto: I think this is best way for fix , what do you think :) ? https://review.opendev.org/#/c/734042/10:13
patchbotpatch 734042 - kolla-ansible - Disable apparmor's chronyd profile on Ubuntu - 5 patch sets10:13
mgoddardkevko: could it be because you are running on an ubuntu host? tried debian?10:14
yoctozeptowe generally dont support selinux nor apparmor so we would be best disabling apparmor too10:15
yoctozeptowhich pains me greatly10:15
*** wuchunyang has quit IRC10:16
openstackgerritMichal Arbet proposed openstack/kolla-ansible master: Disable apparmor's chronyd profile on Ubuntu  https://review.opendev.org/73404210:16
mgoddardyoctozepto: apparmor seems to get in the way less10:16
*** hjensas has joined #openstack-kolla10:16
mgoddardyoctozepto: would be a shame to disable it just for this10:16
kevkoagree10:16
kevkoguys, going for lunch , and after lunch i will try to install on debian docker host10:17
mgoddardkevko: have you seen this with ubuntu containers on ubuntu?10:17
mgoddardAll: a reminder that priorities are open for voting: https://etherpad.opendev.org/p/kolla-victoria-priorities10:18
mgoddard^^^^^^^^^^^^^^^^^^ !!!! ^^^^^^^^^^^^^^^^^^^10:18
kevkomgoddard: haven't try yet, but i think it will be same10:18
mgoddardkevko: maybe, but maybe apparmor config is not in sync between them10:19
openstackgerritMerged openstack/kayobe-config-dev master: CentOS 8: switch to new deploy jobs  https://review.opendev.org/72232610:20
kevkomgoddard: ubuntu and debian package has same vcs -> https://salsa.debian.org/debian/chrony.git10:21
kevkomgoddard: if you check 18.04 package downloaded from ubuntu packages site ..you will see apparmor profile is inside debian archive ... for 16.04 it is not10:21
*** ricolin has joined #openstack-kolla10:26
yoctozeptomgoddard: true that, though otoh it actually does not provide any protection by default, unlike selinux exactly10:27
yoctozeptothat is, it works more like blacklisting10:27
*** dmellado has joined #openstack-kolla10:28
yoctozeptokevko: uhm, then chrony was also installed on the host itself?10:28
*** priteau has quit IRC10:29
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: WIP: Add seed and seed-hypervisor hosts  https://review.opendev.org/61716110:31
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: Add seed and seed-hypervisor hosts  https://review.opendev.org/61716110:31
openstackgerritMark Goddard proposed openstack/kayobe master: Add seed VM provisioning CI job  https://review.opendev.org/55970610:35
*** ykarel|afk is now known as ykarel10:35
*** ykarel is now known as ykarel|mtg10:43
*** wuchunyang has joined #openstack-kolla10:46
*** priteau has joined #openstack-kolla10:49
kevkoyoctozepto: yes, chrony is installed by default10:49
mgoddardkevko: well we probably don't want to run it on the host and in a container10:50
mgoddardI think we have the same thing on CentOS 8 FWIW, spotted yesterday10:51
mgoddardkevko: can you test again after uninstalling on the host?10:51
openstackgerritMerged openstack/kolla stable/train: Bump versions for Train  https://review.opendev.org/73179910:51
*** wuchunyang has quit IRC10:52
kevkomgoddard: give me few minutes ..going to test it10:52
*** bsanjeewa has joined #openstack-kolla10:53
*** dciabrin|afk is now known as dciabrin10:54
kevkomgoddard: why it is not wanted to have chrony on docker host ? why not ?10:55
mgoddardkevko: well you shouldn't run it in a container and on the host. Pick one10:56
mgoddardTBH I think kolla should not have containerised it, but that's just me10:56
*** nathharp has quit IRC10:56
*** nathharp has joined #openstack-kolla10:57
kevkoagree10:57
mgoddardkevko: you can always set kolla_enably_chrony = false, but I assume you are trying to make it work?10:58
*** bengates_ has joined #openstack-kolla10:59
kevkomgoddard: well, always if something is not working, i'm trying to fix it, it's just my work :)11:00
mgoddardkevko: tough job, someone has to do it11:00
kevkomgoddard: confirmed that uninstalling chrony helps, but i has to reboot host to take effect ...  apparmor_parser -r /etc/apparmor.d/ didn't reload ..or do you know how to effectively reload apparmor ?11:01
kevkowithout restart i mean11:01
mgoddardkevko: debian isn't my strong suit11:02
yoctozepto12:56:57 <mgoddard> TBH I think kolla should not have containerised it, but that's just me11:02
yoctozepto+211:02
*** bengates has quit IRC11:03
mgoddardI wish I had pushed back on enabling the chrony container by default.11:03
yoctozeptoit's relevant for most basic crypto nowadays, so everyone runs it anyway, I disable it by default11:03
yoctozeptoI mean, I disable the containerised11:03
mgoddardapart from anything, we configure ntpd in kayobe and it has been a nightmare transitioning11:03
*** k_mouza has joined #openstack-kolla11:03
yoctozeptothat true as well11:04
kevkohmm, so, what about my review ? should i abandon it or what ? :D11:05
kevko:D11:05
yoctozeptokevko: we can uninstall host packages from k-a11:05
yoctozeptoI mean, we do already11:05
yoctozeptoso chrony on debubu is a valid candidate11:05
mgoddardthat's true11:06
mgoddard+"11:06
*** ykarel|mtg is now known as ykarel11:06
mgoddard+211:06
yoctozeptoa separate issue is that chrony does not really need to write its config but this is so irrelevant in kolla context...11:06
*** jschlueter has joined #openstack-kolla11:07
kevkois it better to uninstall ? i think disable apparmor profile is better ..11:08
kevkoif i want containerized chrony .. ok, i will have it, and i will be sure it is working ..because apparmor disabled ..11:09
kevkoand if  i will not want to have containerized chrony, ok, i have it installed already ..11:09
*** priteau has quit IRC11:16
*** Torel has joined #openstack-kolla11:17
mgoddardkevko: is chrony running on the host as well though, or just installed? we don't want it running twice11:18
*** shyamb has joined #openstack-kolla11:18
yoctozeptothe default debubu policy is to run installed services11:18
mgoddardto be sure we would at least want to stop and disable the service. At which point we might as well uninstall11:18
yoctozeptoso we have to fix that anyway to avoid weirdness11:18
yoctozeptoand seriously, maybe switch the default to not run chrony containerized11:19
kevkochecked, it also runs in host11:23
*** hjensas has quit IRC11:23
*** Torel_ has joined #openstack-kolla11:26
*** threestrands has quit IRC11:27
*** ricolin has quit IRC11:28
*** Torel has quit IRC11:29
openstackgerritMerged openstack/kolla-ansible stable/ussuri: Fix handler notification for mariadb-clustercheck  https://review.opendev.org/73443211:30
openstackgerritMerged openstack/kolla stable/stein: Fix multiple issues  https://review.opendev.org/73413111:30
openstackgerritMerged openstack/kolla stable/stein: Bump versions for Stein  https://review.opendev.org/73180111:34
kevkoyoctozepto: mgoddard: ok, so, what way do you want to go ? containerized way or OS ? i can rework my review to meet it..11:36
*** hjensas has joined #openstack-kolla11:38
openstackgerritMerged openstack/kayobe stable/train: Fix concurrency issues while adding SSH keys to known_hosts  https://review.opendev.org/73384011:40
shyambHi11:50
shyambDoes kolla release for Ussuri already released?11:52
shyambDocuments shows, 'RC' is out but does not mention about GA11:52
shyambhttps://releases.openstack.org/teams/kolla.html#ussuri11:52
shyambAny additional information will be helpful for us, thanks11:53
*** amoralej is now known as amoralej|lunch11:54
openstackgerritMerged openstack/kayobe-config master: Synchronise with kayobe for Ussuri  https://review.opendev.org/73446611:54
openstackgerritChristian Berendt proposed openstack/kolla-ansible master: Remove XenAPI integration  https://review.opendev.org/73418011:56
*** e0ne has quit IRC11:58
*** bengates_ has quit IRC12:08
*** rpittau|bbl is now known as rpittau12:11
*** bengates has joined #openstack-kolla12:11
*** bengates has quit IRC12:19
*** bengates has joined #openstack-kolla12:20
yoctozeptokevko: you can workaround then by disabling the containerized one, no need to use it12:21
yoctozeptowith mgoddard we meant we would prefer to not suggests to users to use the containerized chrony by default12:22
yoctozeptothis is generally in line with most default installs which synchronize time one way or another12:22
yoctozeptoas this is a crucial base tasks rather than openstack component12:22
yoctozepto(but indeed very crucial for openstack too)12:22
kevkoyoctozepto: ok, so can we just change enable_chrony: yes to no ?12:23
kevkoyoctozepto: I mean, default globals.yml in git repo12:23
mgoddardshyamb: Kolla has not released Ussuri GA yet12:24
mgoddardkevko, yoctozepto: I think changing default (again) is another topic. I don't like changing defaults generally, it's a PITA for operators. We should first uninstall the package when enable_chrony is true. That is done in the baremetal role12:25
kevkomgoddard: well, that's what i wanted to do ..12:25
mgoddardkevko: thenwe are agreed :)12:26
bsanjeewamgoddard: I updated https://storyboard.openstack.org/#!/story/2007779 . Sorry the error was not with bootstrapping. It was when running kayobe seed hypervisor host configure12:31
mgoddardok, thanks bsanjeewa12:32
k_mouzahello all! I was thinking of adding a small feature to the kolla-ansible script, which would let it read multiple globals files. This would give operators the ability to have separate globals files for some services, giving them a bit more granular control. These files would be named "globals-<name>.yml". What do you think? I can create a new spec for it12:33
mgoddardk_mouza: makes sense. Although you can pass in extra configs via -e @/path/to/file12:34
*** e0ne has joined #openstack-kolla12:36
mgoddardbsanjeewa: added a comment12:36
k_mouzamgoddard: true, although that can lead to a long command, if you have 4-5 separate globals files. Why bother typing? :)12:38
mgoddardk_mouza: how about globals.d/*.yml?12:39
k_mouzamgoddard: yup! Even better! And we're thinking the main globals.yml file residing in that dir as well, or keep that under /etc/kolla ?12:41
mgoddardk_mouza: I was thinking /etc/kolla/globals.yml and /etc/kolla/globals.d/*.yml12:46
mgoddardwhere /etc/kolla/ can be changed via --config-dir12:46
sorin-mihai(please ignore my rant if not relevant) i'm thinking that regardless if chrony is enabled or not in globals.yml, there should be at least a check in the host if there is any sort of ntp sync (not sure if there is such check now), and if there such ntp sync, then chrony should not be deployed, unless there is a very good reason. i don't think any of the supported distros come by default without _any_ sort of ntp client, and this12:46
sorin-mihaicould also be part of the initial things done in the host along cloning the git repo or installing the pip package(s)12:46
k_mouzamgoddard: agreed! I'll start working/testing on this with the master branch. I'm guessing I need to create a blueprint for  this ?12:50
mgoddardk_mouza: yes, please do12:50
bsanjeewamgoddard: https://docs.openstack.org/kayobe/latest/installation.html makes me confused with the comment12:51
mgoddardbsanjeewa: which one?12:51
*** hongbin has joined #openstack-kolla12:52
*** amoralej|lunch is now known as amoralej12:57
bsanjeewa mgoddard: https://storyboard.openstack.org/#!/story/200777912:57
*** skramaja has quit IRC13:01
openstackgerritMerged openstack/kayobe-config-dev master: Synchronise with kayobe-config for Ussuri  https://review.opendev.org/73447313:01
openstackgerritMerged openstack/kayobe-config-dev master: Remove empty default LVM configuration  https://review.opendev.org/72232113:01
*** shyamb has quit IRC13:03
r3ap3rmgoddard: yoctozepto: I replied to https://bugs.launchpad.net/kolla-ansible/+bug/1878412?comments=all and just wanted to let you know what my results were. If you have anything else for me to try, just post in the bug report and I will try it out. I have a server set aside for testing at the moment while I get all of my vlan's setup in my firewall and then I have to setup Ceph so that server will be up for a13:04
openstackLaunchpad bug 1878412 in kolla-ansible train "CentOS 8 Failure of Restart elasticsearch container" [High,In progress] - Assigned to Mark Goddard (mgoddard)13:04
r3ap3rwhile for me to try things out on. Thanks.13:04
*** shyamb has joined #openstack-kolla13:04
*** shyamb has quit IRC13:07
*** priteau has joined #openstack-kolla13:12
openstackgerritMark Goddard proposed openstack/kayobe-config-dev master: Add seed-hypervisor host  https://review.opendev.org/61716113:19
*** diurnalist has joined #openstack-kolla13:27
*** TrevorV has joined #openstack-kolla13:31
*** wuchunyang has joined #openstack-kolla13:33
*** bsanjeewa|phone has joined #openstack-kolla13:36
*** bengates has quit IRC13:48
*** bengates_ has joined #openstack-kolla13:48
*** bengates_ has quit IRC13:49
*** bengates has joined #openstack-kolla13:49
*** gmann is now known as gmann_afk13:52
kevkomgoddard: still here ?13:55
*** abdysn has quit IRC13:56
kevkomgoddard: when uninstalling chrony from host via ubuntu_package_removal ..it is processed by ansible package module which doesn't support purge ..so it is removed ...but config files still present in system ..so apparmor still turned on :(13:56
*** ricolin has joined #openstack-kolla13:59
*** bengates_ has joined #openstack-kolla14:00
*** bengates has quit IRC14:00
kevkotrap next to the trap14:00
*** bengates_ has quit IRC14:01
*** bengates has joined #openstack-kolla14:01
*** hongbin has quit IRC14:03
dkingWith Kayobe, during "kayobe seed host configure", I'm running across an issue at "MichaelRigart.interfaces : Check active bond interface state" where "Interface eno2 is not active". I saw that once before for some cloud hosts, and I re-provisioned them for it to go away.14:04
dkingI'm using VLANs over a bond.  I notice that during this time, accessing the terminal through the BMC< I can see the error "bond0: option slaves: invalid value (-eno1)"14:04
*** ysirndjuro has joined #openstack-kolla14:05
dkingAlso, what is the best way to re-deploy a Kayobe seed host? Would I need to just start over with a new Kayobe directory?14:09
*** hongbin has joined #openstack-kolla14:13
mgoddarddking: for the interface config, I would suggest poking around on the box to see why the links are down. There are some bonding options you can provide such as updelay/downdelay that might be useful if the timing isn't right14:15
mgoddardsecond error sounds like your bond slave name is configured incorrectly...14:15
mgoddardthird, I'm not sure what you mean by a kayobe directory14:16
dkingI meant the whole base_path. But really, I'm just interested in what directories or files I could remove to start over with the seed host to be sure that old configurations are removed.14:21
*** seco has quit IRC14:27
*** Torel_ has quit IRC14:36
*** gmann_afk is now known as gmann14:36
*** Torel has joined #openstack-kolla14:44
*** diurnalist has quit IRC14:49
priteaudking: I think rm -rf /opt/kayobe, /etc/kolla and deleting docker containers and volumes should get you into a mostly clean state, aside from the OS-specific things (network, LVM, etc.). But old configuration isn't necessarily going to cause issues anyway, it will generally be rewritten or ignored.14:53
priteauOne thing to watch out is old network config files: /etc/syconfig/network-scripts/ifcfg-*14:54
dkingYeah, you may be right. I just want to be sure, since I've been getting issues, even when I try a freshly OSed seed host with configs that had worked before. You may be right about the network scripts.14:55
dkingI'm going to try clearing out /opt/kayobe again. Is there any single place for updated files related specifically to the seed host?14:56
priteauI don't think so, the seed doesn't do much except run containers and kolla builds14:57
priteauJust to be sure, you are talking about a *seed* host, not a *seed hypervisor* host?14:58
dkingalso, what's interesting about the network issue I'm getting is that things work after I run a "systemctl restart network", but then the issues occur (eno2 DOWN and I can't access from my external network) after I run the "kayobe seed host configure".14:58
dkingCorrect. It's a physical server with CentOS 8.14:59
priteauCould you share your network config?15:02
dkingSure. One moment.15:03
*** zijlboot_ has joined #openstack-kolla15:04
*** dougsz has quit IRC15:05
dkingHere's what I'm currently working with: http://paste.openstack.org/show/794530/15:06
*** zijlboot has quit IRC15:07
dkingBut I've been adjusting things. I tried reverting to things that worked on my other instance. I was even trying some settings which had worked previously on this current instance, making me suspect some stale configuration somewhere.15:09
priteauCheck the generated network config files: /etc/sysconfig/network-scripts/ifcfg-{bond0,eno1,eno2}15:09
priteauAlso check for other files in /etc/sysconfig/network-scripts/ifcfg-* which might get picked up15:10
*** diurnalist has joined #openstack-kolla15:17
dkingI'm removing some old files I had and I'm adding the external network, since I'll want that, too. That way they should match.15:19
*** dougsz has joined #openstack-kolla15:19
*** Torel has quit IRC15:24
*** Torel has joined #openstack-kolla15:26
dkingOkay, now the scripts match what's in the configuration. The issues persist. If I restart the network, I can ping the external IP again, until I run the seed host configure. However, I see that eno2 is listed as down regardless. I'm going to try rebooting the seed.15:28
*** nathharp has quit IRC15:32
*** nathharp has joined #openstack-kolla15:33
*** nathharp has quit IRC15:37
openstackgerritChristian Berendt proposed openstack/kolla master: Remove opendaylight image  https://review.opendev.org/73463015:39
*** bsanjeewa_ has joined #openstack-kolla15:40
openstackgerritChristian Berendt proposed openstack/kolla master: Remove opendaylight image  https://review.opendev.org/73463015:41
*** bsanjeewa has quit IRC15:43
dkingWell, eno2 is still down. I suppose that's the problem. It seems to be working, but if it says that it's down, I imagine that task will fail, and not finish setting things up. It's odd that ifup doesn't show any errors. It just says "DOWN" with "ip a". But I suppose it's not a Kayobe problem at the moment.15:45
openstackgerritChristian Berendt proposed openstack/kolla master: Remove sensu images  https://review.opendev.org/73463215:46
*** ykarel is now known as ykarel|away15:46
*** nathharp has joined #openstack-kolla15:47
openstackgerritChristian Berendt proposed openstack/kolla master: Remove Neutron OVN images  https://review.opendev.org/73463315:50
*** jonaspaulo has joined #openstack-kolla15:52
*** bsanjeewa|phone has quit IRC15:53
*** e0ne has quit IRC15:57
*** rpittau is now known as rpittau|afk16:09
*** wuchunyang has quit IRC16:11
*** wuchunya_ has joined #openstack-kolla16:11
*** bsanjeewa|phone has joined #openstack-kolla16:11
*** wuchunyang has joined #openstack-kolla16:11
*** wuchunya_ has quit IRC16:12
openstackgerritgugug proposed openstack/kolla-ansible master: Remove the unnecessary task for octavia  https://review.opendev.org/73464116:14
openstackgerritWill Szumski proposed openstack/kayobe master: Update feature flags  https://review.opendev.org/73406416:14
openstackgerritErol Guzoglu proposed openstack/kolla-ansible master: Support customizing skydive.conf file  https://review.opendev.org/73262016:19
openstackgerritErol Guzoglu proposed openstack/kolla-ansible master: Support customizing skydive.conf file  https://review.opendev.org/73262016:21
*** bengates has quit IRC16:27
*** nathharp has quit IRC16:29
*** nathharp has joined #openstack-kolla16:30
*** ricolin has quit IRC16:30
*** nathharp has quit IRC16:34
*** amoralej is now known as amoralej|off16:35
*** wuchunyang has quit IRC16:45
*** bsanjeewa_ has quit IRC16:53
*** bsanjeewa has joined #openstack-kolla16:58
openstackgerritKonstantinos Mouzakitis proposed openstack/kolla-ansible master: Adds the blueprint file for multiple globals files support  https://review.opendev.org/73465317:02
*** Torel has quit IRC17:04
*** Torel has joined #openstack-kolla17:05
*** lvdombrkr has quit IRC17:06
*** maharg101 has joined #openstack-kolla17:13
*** maharg101 has quit IRC17:14
*** maharg101 has joined #openstack-kolla17:14
*** diurnalist has quit IRC17:15
*** dougsz has quit IRC17:18
*** priteau has quit IRC17:21
*** k_mouza has quit IRC17:35
openstackgerritMerged openstack/kolla-ansible stable/ussuri: Add 'ovn' to list of valid values of neutron_plugin_agent  https://review.opendev.org/73453617:36
openstackgerritMerged openstack/kolla-ansible master: Set previous release to Ussuri  https://review.opendev.org/73180517:38
*** cah_link has quit IRC17:40
*** diurnalist has joined #openstack-kolla17:42
*** vishalmanchanda has quit IRC17:45
*** bsanjeewa|phone has quit IRC17:50
openstackgerritMerged openstack/kolla-ansible master: CI: drop pre-ussuri upgrade support  https://review.opendev.org/73148717:53
*** k_mouza has joined #openstack-kolla17:57
openstackgerritMarcin Juszkiewicz proposed openstack/kolla-ansible master: CI: move playbook files to tests/playbooks/ dir  https://review.opendev.org/71587218:02
*** bsanjeewa has quit IRC18:03
*** bsanjeewa_ has joined #openstack-kolla18:05
*** k_mouza has quit IRC18:08
*** bsanjeewa has joined #openstack-kolla18:09
*** Torel has quit IRC18:29
*** k_mouza has joined #openstack-kolla18:30
*** hongbin has quit IRC18:30
*** muhaha has joined #openstack-kolla18:31
*** Torel has joined #openstack-kolla18:31
*** hongbin has joined #openstack-kolla18:49
*** k_mouza has quit IRC18:50
*** dougsz has joined #openstack-kolla19:05
*** diurnalist has quit IRC19:09
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/stein: Do not require kolla-ansible to be installed  https://review.opendev.org/73468119:17
*** hongbin has quit IRC19:34
openstackgerritRadosław Piliszek proposed openstack/kolla master: [docs] Release management - small changes  https://review.opendev.org/73468419:36
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/train: [DNM] test  https://review.opendev.org/73468519:46
*** hongbin has joined #openstack-kolla19:52
*** nathharp has joined #openstack-kolla19:57
*** nathharp has quit IRC19:58
openstackgerritMerged openstack/kolla-ansible master: Remove XenAPI integration  https://review.opendev.org/73418019:58
*** nathharp has joined #openstack-kolla19:58
*** stingrayza has joined #openstack-kolla20:02
*** dougsz has quit IRC20:05
*** also_stingrayza has quit IRC20:05
admin0hi guys . does kolla support ubuntu 20 already ?20:09
*** dougsz has joined #openstack-kolla20:20
*** diurnalist has joined #openstack-kolla20:20
openstackgerritMerged openstack/kolla-ansible master: Remove the unnecessary task for octavia  https://review.opendev.org/73464120:27
*** keper7 has joined #openstack-kolla20:35
*** e0ne has joined #openstack-kolla20:42
*** jbadiapa has quit IRC20:48
*** e0ne has quit IRC20:50
r3ap3radmin0: If you look here, they don't say they do. Maybe they will add support for Focal in Ussuri but will most likely be a Victoria thing, I'm not really sure? https://docs.openstack.org/kolla-ansible/latest/user/support-matrix.html21:03
*** diurnali1t has joined #openstack-kolla21:11
born2bakei deployed k-a on focal hosts21:20
born2bakeno issues :)21:20
*** keper7 has quit IRC21:20
*** muhaha has quit IRC21:21
*** Torel has quit IRC21:23
*** TrevorV has quit IRC21:26
*** Torel has joined #openstack-kolla21:26
*** dougsz has quit IRC21:27
admin0ok21:59
*** bsanjeewa_ has quit IRC22:26
*** bsanjeewa_ has joined #openstack-kolla22:26
*** ysirndjuro has quit IRC22:32
r3ap3rborn2bake: valid point, I guess to a certain degree, as long as you run Python 3 and a supported version of Ansible, the host doesn't really matter. The containers would be based off of whatever you set in globals and that would be the only difference.22:35
born2bakejust needed to change 1-2 lines in k-a22:36
born2baker3ap3r as far as I remember, you have swift connected to ceph rgw right?22:36
born2bakeI am wondering, how storage policy can be added to swift, when its deployed with rgw22:37
born2bakecause I m getting storage policy errors every time I open object storage in horizon :/22:37
born2bakecant create containers either22:37
r3ap3rI personally have not. I'm building a single Ceph node at the house to test against Ussuri Cent8 deployment.22:37
r3ap3rI know there are "things" needed to run a single node but I'm working through that as I can dedicate time to it.22:38
r3ap3rborn2bake: I apologize but I'm still relatively new to Ceph, coming from a Cinder only background, but I'll let you know if I come across anything related to that.22:40
*** diurnalist has quit IRC22:42
*** bsanjeewa_ has quit IRC22:53
*** bsanjeewa_ has joined #openstack-kolla22:53
*** born2bake has quit IRC23:07
*** diurnalist has joined #openstack-kolla23:12
*** bsanjeewa has quit IRC23:14
*** bsanjeewa has joined #openstack-kolla23:17
*** keper7 has joined #openstack-kolla23:41
*** keper7 has quit IRC23:41
*** jonaspaulo has quit IRC23:44
*** bsanjeewa_ has quit IRC23:56
*** bsanjeewa has quit IRC23:56

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!