| openstackgerrit | Merged openstack/kayobe stable/stein: Fix concurrency issues while adding SSH keys to known_hosts https://review.opendev.org/733841 | 00:21 |
|---|---|---|
| *** jcmdln has quit IRC | 01:12 | |
| *** jcmdln has joined #openstack-kolla | 01:19 | |
| *** wuchunyang has joined #openstack-kolla | 01:23 | |
| *** wuchunyang has quit IRC | 01:26 | |
| *** wuchunyang has joined #openstack-kolla | 01:27 | |
| *** hongbin_ has joined #openstack-kolla | 01:34 | |
| *** hongbin_ has quit IRC | 01:34 | |
| *** hongbin_ has joined #openstack-kolla | 01:35 | |
| *** hongbin_ has quit IRC | 01:37 | |
| *** hongbin_ has joined #openstack-kolla | 01:37 | |
| *** also_stingrayza has joined #openstack-kolla | 01:49 | |
| *** stingrayza has quit IRC | 01:51 | |
| *** hongbin_ has quit IRC | 01:59 | |
| *** hongbin_ has joined #openstack-kolla | 01:59 | |
| *** hongbin_ has quit IRC | 01:59 | |
| *** ricolin has joined #openstack-kolla | 02:34 | |
| *** jcmdln has quit IRC | 02:58 | |
| *** Torel has quit IRC | 03:00 | |
| *** Torel has joined #openstack-kolla | 03:01 | |
| *** Torel has quit IRC | 03:09 | |
| *** jcmdln has joined #openstack-kolla | 03:13 | |
| *** wuchunyang has quit IRC | 03:20 | |
| *** hongbin has joined #openstack-kolla | 03:28 | |
| *** k_mouza has joined #openstack-kolla | 03:52 | |
| *** diurnalist has quit IRC | 03:54 | |
| *** skramaja has joined #openstack-kolla | 03:56 | |
| *** k_mouza has quit IRC | 03:57 | |
| *** wuchunyang has joined #openstack-kolla | 04:14 | |
| *** hongbin has quit IRC | 04:14 | |
| *** wuchunyang has quit IRC | 04:18 | |
| *** dmellado has quit IRC | 04:25 | |
| *** evrardjp has joined #openstack-kolla | 04:33 | |
| *** factor has joined #openstack-kolla | 04:35 | |
| *** ykarel|away is now known as ykarel | 04:42 | |
| *** abdysn has joined #openstack-kolla | 05:01 | |
| *** wuchunyang has joined #openstack-kolla | 05:03 | |
| *** cah_link has joined #openstack-kolla | 05:26 | |
| *** wuchunyang has quit IRC | 05:37 | |
| *** seco has joined #openstack-kolla | 05:47 | |
| *** diurnalist has joined #openstack-kolla | 05:52 | |
| *** diurnalist has quit IRC | 05:56 | |
| yoctozepto | morning channel | 05:59 |
| yoctozepto | kplant: I think we have a bug on it | 05:59 |
| *** bsanjeewa has joined #openstack-kolla | 06:42 | |
| *** vishalmanchanda has joined #openstack-kolla | 06:47 | |
| *** xinliang has joined #openstack-kolla | 06:49 | |
| *** wuchunyang has joined #openstack-kolla | 06:52 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla stable/train: Bump versions for Train https://review.opendev.org/731799 | 06:53 |
| *** jbadiapa has joined #openstack-kolla | 06:55 | |
| *** amoralej|off is now known as amoralej | 07:23 | |
| *** bengates has joined #openstack-kolla | 07:24 | |
| *** dougsz has joined #openstack-kolla | 07:25 | |
| *** bengates has quit IRC | 07:26 | |
| *** bengates has joined #openstack-kolla | 07:27 | |
| *** nathharp has quit IRC | 07:28 | |
| *** nathharp has joined #openstack-kolla | 07:29 | |
| mgoddard | bsanjeewa: hi. There is no longer support for configuring NTP daemon on the seed and seed hypervisor hosts. For the overcloud yuo can use the chrony daemon. | 07:38 |
| mgoddard | bsanjeewa: https://docs.openstack.org/kayobe/latest/configuration/hosts.html#ntp | 07:38 |
| bsanjeewa | msgoddard: Yes I ma aware, so I wanted to configure the time seeding server in the time.yml. Because our firewalls block the time requests to outside, we use out AD as the time source | 07:42 |
| mgoddard | bsanjeewa: for chrony? | 07:42 |
| mgoddard | (container) | 07:42 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/stein: Fix multiple issues https://review.opendev.org/734131 | 07:44 |
| bsanjeewa | mgoddard: all servers in DMZ, so I thought that setting should go to overcloud as well | 07:45 |
| mgoddard | bsanjeewa: for chrony you can set external_ntp_servers in etc/kayobe/kolla/globals.yml | 07:46 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/ussuri: Fix handler notification for mariadb-clustercheck https://review.opendev.org/734432 | 07:47 |
| bsanjeewa | mgoddard: So I prepd ntp.yml with ntp_config_server: ad server ip for the previous version. But couldn't finish deploy | 07:47 |
| mgoddard | bsanjeewa: that option no longer exists in master/ussuri | 07:48 |
| mgoddard | bsanjeewa: which release are you using? | 07:48 |
| *** rpittau|afk is now known as rpittau | 07:54 | |
| bsanjeewa | mgoddard: trying to do the first poc with kayobe. Earlier I went with pip install kayobe, now I try to use git clone https://opendev.org/openstack/kayobe.git | 07:56 |
| mgoddard | bsanjeewa: I would suggest using the stable/train branch if you are using source. This is the most recent stable branch | 07:57 |
| mgoddard | master is close to release, but still in development | 07:57 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Run kolla-toolbox container unpriviliged https://review.opendev.org/732700 | 08:02 |
| openstackgerrit | wu.chunyang proposed openstack/kolla-ansible master: fix create loadbalancer failed https://review.opendev.org/734435 | 08:05 |
| *** xinliang has quit IRC | 08:06 | |
| *** maharg101 has quit IRC | 08:10 | |
| bsanjeewa | mgoddard: will try that, thanks | 08:11 |
| mgoddard | bsanjeewa: also, how are you running it? following the development guide, or using a-universe-from-nothing? | 08:12 |
| bsanjeewa | mgoddard: will stable/ussuri come soon. I'm following the deployment guide latest | 08:13 |
| mgoddard | bsanjeewa: I'm about to propose patches to create it. But that will just be a release candidate, not final release | 08:13 |
| bsanjeewa | mgoddard: to use stable/train do I have to go back to CentOS 7 | 08:19 |
| *** kevko_ has joined #openstack-kolla | 08:25 | |
| *** wuchunyang has quit IRC | 08:25 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: Add seed VM provisioning CI job https://review.opendev.org/559706 | 08:26 |
| *** kevko has quit IRC | 08:27 | |
| mgoddard | bsanjeewa: stable/train has support for CentOS 8, but it is newer so may have one or two issues | 08:29 |
| mgoddard | bsanjeewa: some docs you might find useful for using CentOS 8 on train: https://review.opendev.org/731829 | 08:29 |
| patchbot | patch 731829 - kayobe (stable/train) - CentOS 8: add docs and release note - 2 patch sets | 08:29 |
| *** ykarel is now known as ykarel|lunch | 08:31 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/stein: Fix multiple issues https://review.opendev.org/734131 | 08:34 |
| *** xinliang has joined #openstack-kolla | 08:34 | |
| mgoddard | bsanjeewa: could you provide the name of the task that failed on https://storyboard.openstack.org/#!/story/2007779 ? | 08:34 |
| mgoddard | bsanjeewa: are you using ansible_connection=local? | 08:34 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/stein: Bump versions for Stein https://review.opendev.org/731801 | 08:35 |
| *** wuchunyang has joined #openstack-kolla | 08:38 | |
| *** born2bake has joined #openstack-kolla | 08:39 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/ussuri: Victoria: Add releasenote for remove congress images https://review.opendev.org/731862 | 08:41 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/ussuri: Add releasenote for congress deprecation https://review.opendev.org/731862 | 08:42 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/ussuri: Add releasenote for congress deprecation https://review.opendev.org/731862 | 08:42 |
| *** e0ne has joined #openstack-kolla | 08:46 | |
| hrw | +2 | 08:48 |
| *** eliaswimmer_ has joined #openstack-kolla | 08:50 | |
| bsanjeewa | mgoddard: in inventory/hosts for localhost only, I went with --system-site-packages, let me revert back and upload the logs | 08:53 |
| mgoddard | bsanjeewa: you should give the host a different hostname than localhost | 08:55 |
| wuchunyang | hrw hello， recently i have tested octavia, but i got an error about ovs-vsctl when i bonded an interface to br-int . it seems missing libibverbs. | 08:58 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe-config master: Synchronise with kayobe for Ussuri https://review.opendev.org/734466 | 08:58 |
| wuchunyang | centos kolla_base_ditro | 08:58 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Fix chrony permissions inside docker container https://review.opendev.org/734042 | 08:59 |
| hrw | wuchunyang: do you have mellanox cards? | 08:59 |
| wuchunyang | Ubuntu is work | 08:59 |
| bsanjeewa | mgoddard: ansible_connection=local is used only here | 08:59 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Fix chrony permissions inside docker container https://review.opendev.org/734042 | 08:59 |
| bsanjeewa | # This host acts as the configuration management Ansible control host. This must be | 08:59 |
| bsanjeewa | # localhost. | 09:00 |
| bsanjeewa | localhost ansible_connection=local | 09:00 |
| bsanjeewa | only localhost is used here | 09:00 |
| *** priteau has joined #openstack-kolla | 09:01 | |
| hrw | wuchunyang: sorry, I do not remember how was the story of it. deep in other project today | 09:01 |
| wuchunyang | hrw what is meaning of mellanox cards? | 09:01 |
| wuchunyang | hrw i want add this packages into image , i don't know wheather this is needed or not | 09:02 |
| hrw | wuchunyang: https://bugzilla.redhat.com/show_bug.cgi?id=1658138 | 09:02 |
| openstack | bugzilla.redhat.com bug 1658138 in openstack-tripleo-puppet-elements "missing libibverbs from overcloud image to enable ovs-dpdk with mlnx nic" [Medium,New] - Assigned to rhos-maint | 09:02 |
| hrw | iirc this was one about it | 09:02 |
| wuchunyang | ovs need too | 09:03 |
| wuchunyang | should we add this package into images | 09:03 |
| wuchunyang | '? | 09:03 |
| hrw | wuchunyang: can you add, build images and check does it help? | 09:03 |
| hrw | wuchunyang: I am trying to build something completely unrelated to kolla today | 09:04 |
| wuchunyang | yes,ok , i will add to package, can you help review ? | 09:04 |
| hrw | sure | 09:04 |
| wuchunyang | i know ,neutron_openvswitch_agent, ovs_db, ovs_vswitchd need this package. | 09:05 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe-config-dev master: Synchronise with kayobe-config for Ussuri https://review.opendev.org/734473 | 09:05 |
| wuchunyang | which ironic images need too ? | 09:06 |
| mgoddard | bsanjeewa: ok, that should be fine | 09:06 |
| wuchunyang | mgoddard hi could you help review https://review.opendev.org/#/c/733986/ again ? i consider use "become true" is better than create folder first and set own. | 09:12 |
| patchbot | patch 733986 - kolla-ansible - permission denied when enable_kolla_dev_mod - 1 patch set | 09:12 |
| *** ykarel|lunch is now known as ykarel | 09:15 | |
| *** lvdombrkr has joined #openstack-kolla | 09:16 | |
| lvdombrkr | Hello guys, i have changed hostname for my compute node host, but in contaiers there is sill old one under /etc/hostname | 09:16 |
| lvdombrkr | any clues how to change it? | 09:16 |
| wuchunyang | all contaiers are old ? | 09:19 |
| lvdombrkr | wuchunyang: what you mean by old? all containers was deployed when there was still old hostname | 09:20 |
| lvdombrkr | now i changed hostname | 09:20 |
| lvdombrkr | for host but inside containers still old one | 09:21 |
| mgoddard | lvdombrkr: restart containers? | 09:23 |
| lvdombrkr | mgoddard wuchunyang : http://paste.openstack.org/raw/794505/ | 09:24 |
| lvdombrkr | mgoddard: tried to restart nothin changes | 09:25 |
| *** kevko_ has quit IRC | 09:26 | |
| *** kevko has joined #openstack-kolla | 09:27 | |
| mgoddard | lvdombrkr: remove containers and redeploy? | 09:28 |
| *** dciabrin is now known as dciabrin|afk | 09:28 | |
| *** eliaswimmer_ has quit IRC | 09:29 | |
| kevko | mgoddard: Hi, you was right ..bug in chrony is caused by apparmor ..but on docker host ..not inside docker container .. | 09:29 |
| kevko | mgoddard: https://review.opendev.org/#/c/734042/4 | 09:30 |
| patchbot | patch 734042 - kolla-ansible - Fix chrony permissions inside docker container - 4 patch sets | 09:30 |
| kevko | yoctozepto: Radoslav ^^ | 09:30 |
| mgoddard | kevko: cool. If root can't gets perm denied, usually means apparmor or selinux | 09:31 |
| kevko | but, how it can be fixed if it is not in container .. | 09:31 |
| lvdombrkr | mgoddard: you mean remove containers with kolla-ansible destroy --limit and then deploy back? | 09:32 |
| mgoddard | lvdombrkr: kolla-ansible destroy --limit doesn't work | 09:33 |
| mgoddard | lvdombrkr: docker rm $(docker ps -q) | 09:33 |
| lvdombrkr | mgoddard: and then deploy? | 09:34 |
| mgoddard | lvdombrkr: yes | 09:34 |
| lvdombrkr | mgoddard: good. thnaks | 09:34 |
| *** bsanjeewa has quit IRC | 09:42 | |
| *** jschlueter has quit IRC | 09:43 | |
| *** ricolin has quit IRC | 09:59 | |
| *** ykarel is now known as ykarel|afk | 10:00 | |
| *** hjensas has quit IRC | 10:02 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe-config-dev master: Remove empty default LVM configuration https://review.opendev.org/722321 | 10:02 |
| *** xinliang has quit IRC | 10:05 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Add 'ovn' to list of valid values of neutron_plugin_agent https://review.opendev.org/734174 | 10:05 |
| openstackgerrit | Merged openstack/kolla stable/ussuri: Add releasenote for congress deprecation https://review.opendev.org/731862 | 10:05 |
| *** Tony31 has quit IRC | 10:05 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/ussuri: Add 'ovn' to list of valid values of neutron_plugin_agent https://review.opendev.org/734536 | 10:07 |
| *** rpittau is now known as rpittau|bbl | 10:11 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe-config-dev master: Remove empty default LVM configuration https://review.opendev.org/722321 | 10:11 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Disable apparmor's chronyd profile on Ubuntu https://review.opendev.org/734042 | 10:12 |
| kevko | mgoddard: yoctozepto: I think this is best way for fix , what do you think :) ? https://review.opendev.org/#/c/734042/ | 10:13 |
| patchbot | patch 734042 - kolla-ansible - Disable apparmor's chronyd profile on Ubuntu - 5 patch sets | 10:13 |
| mgoddard | kevko: could it be because you are running on an ubuntu host? tried debian? | 10:14 |
| yoctozepto | we generally dont support selinux nor apparmor so we would be best disabling apparmor too | 10:15 |
| yoctozepto | which pains me greatly | 10:15 |
| *** wuchunyang has quit IRC | 10:16 | |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Disable apparmor's chronyd profile on Ubuntu https://review.opendev.org/734042 | 10:16 |
| mgoddard | yoctozepto: apparmor seems to get in the way less | 10:16 |
| *** hjensas has joined #openstack-kolla | 10:16 | |
| mgoddard | yoctozepto: would be a shame to disable it just for this | 10:16 |
| kevko | agree | 10:16 |
| kevko | guys, going for lunch , and after lunch i will try to install on debian docker host | 10:17 |
| mgoddard | kevko: have you seen this with ubuntu containers on ubuntu? | 10:17 |
| mgoddard | All: a reminder that priorities are open for voting: https://etherpad.opendev.org/p/kolla-victoria-priorities | 10:18 |
| mgoddard | ^^^^^^^^^^^^^^^^^^ !!!! ^^^^^^^^^^^^^^^^^^^ | 10:18 |
| kevko | mgoddard: haven't try yet, but i think it will be same | 10:18 |
| mgoddard | kevko: maybe, but maybe apparmor config is not in sync between them | 10:19 |
| openstackgerrit | Merged openstack/kayobe-config-dev master: CentOS 8: switch to new deploy jobs https://review.opendev.org/722326 | 10:20 |
| kevko | mgoddard: ubuntu and debian package has same vcs -> https://salsa.debian.org/debian/chrony.git | 10:21 |
| kevko | mgoddard: if you check 18.04 package downloaded from ubuntu packages site ..you will see apparmor profile is inside debian archive ... for 16.04 it is not | 10:21 |
| *** ricolin has joined #openstack-kolla | 10:26 | |
| yoctozepto | mgoddard: true that, though otoh it actually does not provide any protection by default, unlike selinux exactly | 10:27 |
| yoctozepto | that is, it works more like blacklisting | 10:27 |
| *** dmellado has joined #openstack-kolla | 10:28 | |
| yoctozepto | kevko: uhm, then chrony was also installed on the host itself? | 10:28 |
| *** priteau has quit IRC | 10:29 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe-config-dev master: WIP: Add seed and seed-hypervisor hosts https://review.opendev.org/617161 | 10:31 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe-config-dev master: Add seed and seed-hypervisor hosts https://review.opendev.org/617161 | 10:31 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: Add seed VM provisioning CI job https://review.opendev.org/559706 | 10:35 |
| *** ykarel|afk is now known as ykarel | 10:35 | |
| *** ykarel is now known as ykarel|mtg | 10:43 | |
| *** wuchunyang has joined #openstack-kolla | 10:46 | |
| *** priteau has joined #openstack-kolla | 10:49 | |
| kevko | yoctozepto: yes, chrony is installed by default | 10:49 |
| mgoddard | kevko: well we probably don't want to run it on the host and in a container | 10:50 |
| mgoddard | I think we have the same thing on CentOS 8 FWIW, spotted yesterday | 10:51 |
| mgoddard | kevko: can you test again after uninstalling on the host? | 10:51 |
| openstackgerrit | Merged openstack/kolla stable/train: Bump versions for Train https://review.opendev.org/731799 | 10:51 |
| *** wuchunyang has quit IRC | 10:52 | |
| kevko | mgoddard: give me few minutes ..going to test it | 10:52 |
| *** bsanjeewa has joined #openstack-kolla | 10:53 | |
| *** dciabrin|afk is now known as dciabrin | 10:54 | |
| kevko | mgoddard: why it is not wanted to have chrony on docker host ? why not ? | 10:55 |
| mgoddard | kevko: well you shouldn't run it in a container and on the host. Pick one | 10:56 |
| mgoddard | TBH I think kolla should not have containerised it, but that's just me | 10:56 |
| *** nathharp has quit IRC | 10:56 | |
| *** nathharp has joined #openstack-kolla | 10:57 | |
| kevko | agree | 10:57 |
| mgoddard | kevko: you can always set kolla_enably_chrony = false, but I assume you are trying to make it work? | 10:58 |
| *** bengates_ has joined #openstack-kolla | 10:59 | |
| kevko | mgoddard: well, always if something is not working, i'm trying to fix it, it's just my work :) | 11:00 |
| mgoddard | kevko: tough job, someone has to do it | 11:00 |
| kevko | mgoddard: confirmed that uninstalling chrony helps, but i has to reboot host to take effect ... apparmor_parser -r /etc/apparmor.d/ didn't reload ..or do you know how to effectively reload apparmor ? | 11:01 |
| kevko | without restart i mean | 11:01 |
| mgoddard | kevko: debian isn't my strong suit | 11:02 |
| yoctozepto | 12:56:57 <mgoddard> TBH I think kolla should not have containerised it, but that's just me | 11:02 |
| yoctozepto | +2 | 11:02 |
| *** bengates has quit IRC | 11:03 | |
| mgoddard | I wish I had pushed back on enabling the chrony container by default. | 11:03 |
| yoctozepto | it's relevant for most basic crypto nowadays, so everyone runs it anyway, I disable it by default | 11:03 |
| yoctozepto | I mean, I disable the containerised | 11:03 |
| mgoddard | apart from anything, we configure ntpd in kayobe and it has been a nightmare transitioning | 11:03 |
| *** k_mouza has joined #openstack-kolla | 11:03 | |
| yoctozepto | that true as well | 11:04 |
| kevko | hmm, so, what about my review ? should i abandon it or what ? :D | 11:05 |
| kevko | :D | 11:05 |
| yoctozepto | kevko: we can uninstall host packages from k-a | 11:05 |
| yoctozepto | I mean, we do already | 11:05 |
| yoctozepto | so chrony on debubu is a valid candidate | 11:05 |
| mgoddard | that's true | 11:06 |
| mgoddard | +" | 11:06 |
| *** ykarel|mtg is now known as ykarel | 11:06 | |
| mgoddard | +2 | 11:06 |
| yoctozepto | a separate issue is that chrony does not really need to write its config but this is so irrelevant in kolla context... | 11:06 |
| *** jschlueter has joined #openstack-kolla | 11:07 | |
| kevko | is it better to uninstall ? i think disable apparmor profile is better .. | 11:08 |
| kevko | if i want containerized chrony .. ok, i will have it, and i will be sure it is working ..because apparmor disabled .. | 11:09 |
| kevko | and if i will not want to have containerized chrony, ok, i have it installed already .. | 11:09 |
| *** priteau has quit IRC | 11:16 | |
| *** Torel has joined #openstack-kolla | 11:17 | |
| mgoddard | kevko: is chrony running on the host as well though, or just installed? we don't want it running twice | 11:18 |
| *** shyamb has joined #openstack-kolla | 11:18 | |
| yoctozepto | the default debubu policy is to run installed services | 11:18 |
| mgoddard | to be sure we would at least want to stop and disable the service. At which point we might as well uninstall | 11:18 |
| yoctozepto | so we have to fix that anyway to avoid weirdness | 11:18 |
| yoctozepto | and seriously, maybe switch the default to not run chrony containerized | 11:19 |
| kevko | checked, it also runs in host | 11:23 |
| *** hjensas has quit IRC | 11:23 | |
| *** Torel_ has joined #openstack-kolla | 11:26 | |
| *** threestrands has quit IRC | 11:27 | |
| *** ricolin has quit IRC | 11:28 | |
| *** Torel has quit IRC | 11:29 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/ussuri: Fix handler notification for mariadb-clustercheck https://review.opendev.org/734432 | 11:30 |
| openstackgerrit | Merged openstack/kolla stable/stein: Fix multiple issues https://review.opendev.org/734131 | 11:30 |
| openstackgerrit | Merged openstack/kolla stable/stein: Bump versions for Stein https://review.opendev.org/731801 | 11:34 |
| kevko | yoctozepto: mgoddard: ok, so, what way do you want to go ? containerized way or OS ? i can rework my review to meet it.. | 11:36 |
| *** hjensas has joined #openstack-kolla | 11:38 | |
| openstackgerrit | Merged openstack/kayobe stable/train: Fix concurrency issues while adding SSH keys to known_hosts https://review.opendev.org/733840 | 11:40 |
| shyamb | Hi | 11:50 |
| shyamb | Does kolla release for Ussuri already released? | 11:52 |
| shyamb | Documents shows, 'RC' is out but does not mention about GA | 11:52 |
| shyamb | https://releases.openstack.org/teams/kolla.html#ussuri | 11:52 |
| shyamb | Any additional information will be helpful for us, thanks | 11:53 |
| *** amoralej is now known as amoralej|lunch | 11:54 | |
| openstackgerrit | Merged openstack/kayobe-config master: Synchronise with kayobe for Ussuri https://review.opendev.org/734466 | 11:54 |
| openstackgerrit | Christian Berendt proposed openstack/kolla-ansible master: Remove XenAPI integration https://review.opendev.org/734180 | 11:56 |
| *** e0ne has quit IRC | 11:58 | |
| *** bengates_ has quit IRC | 12:08 | |
| *** rpittau|bbl is now known as rpittau | 12:11 | |
| *** bengates has joined #openstack-kolla | 12:11 | |
| *** bengates has quit IRC | 12:19 | |
| *** bengates has joined #openstack-kolla | 12:20 | |
| yoctozepto | kevko: you can workaround then by disabling the containerized one, no need to use it | 12:21 |
| yoctozepto | with mgoddard we meant we would prefer to not suggests to users to use the containerized chrony by default | 12:22 |
| yoctozepto | this is generally in line with most default installs which synchronize time one way or another | 12:22 |
| yoctozepto | as this is a crucial base tasks rather than openstack component | 12:22 |
| yoctozepto | (but indeed very crucial for openstack too) | 12:22 |
| kevko | yoctozepto: ok, so can we just change enable_chrony: yes to no ? | 12:23 |
| kevko | yoctozepto: I mean, default globals.yml in git repo | 12:23 |
| mgoddard | shyamb: Kolla has not released Ussuri GA yet | 12:24 |
| mgoddard | kevko, yoctozepto: I think changing default (again) is another topic. I don't like changing defaults generally, it's a PITA for operators. We should first uninstall the package when enable_chrony is true. That is done in the baremetal role | 12:25 |
| kevko | mgoddard: well, that's what i wanted to do .. | 12:25 |
| mgoddard | kevko: thenwe are agreed :) | 12:26 |
| bsanjeewa | mgoddard: I updated https://storyboard.openstack.org/#!/story/2007779 . Sorry the error was not with bootstrapping. It was when running kayobe seed hypervisor host configure | 12:31 |
| mgoddard | ok, thanks bsanjeewa | 12:32 |
| k_mouza | hello all! I was thinking of adding a small feature to the kolla-ansible script, which would let it read multiple globals files. This would give operators the ability to have separate globals files for some services, giving them a bit more granular control. These files would be named "globals-<name>.yml". What do you think? I can create a new spec for it | 12:33 |
| mgoddard | k_mouza: makes sense. Although you can pass in extra configs via -e @/path/to/file | 12:34 |
| *** e0ne has joined #openstack-kolla | 12:36 | |
| mgoddard | bsanjeewa: added a comment | 12:36 |
| k_mouza | mgoddard: true, although that can lead to a long command, if you have 4-5 separate globals files. Why bother typing? :) | 12:38 |
| mgoddard | k_mouza: how about globals.d/*.yml? | 12:39 |
| k_mouza | mgoddard: yup! Even better! And we're thinking the main globals.yml file residing in that dir as well, or keep that under /etc/kolla ? | 12:41 |
| mgoddard | k_mouza: I was thinking /etc/kolla/globals.yml and /etc/kolla/globals.d/*.yml | 12:46 |
| mgoddard | where /etc/kolla/ can be changed via --config-dir | 12:46 |
| sorin-mihai | (please ignore my rant if not relevant) i'm thinking that regardless if chrony is enabled or not in globals.yml, there should be at least a check in the host if there is any sort of ntp sync (not sure if there is such check now), and if there such ntp sync, then chrony should not be deployed, unless there is a very good reason. i don't think any of the supported distros come by default without _any_ sort of ntp client, and this | 12:46 |
| sorin-mihai | could also be part of the initial things done in the host along cloning the git repo or installing the pip package(s) | 12:46 |
| k_mouza | mgoddard: agreed! I'll start working/testing on this with the master branch. I'm guessing I need to create a blueprint for this ? | 12:50 |
| mgoddard | k_mouza: yes, please do | 12:50 |
| bsanjeewa | mgoddard: https://docs.openstack.org/kayobe/latest/installation.html makes me confused with the comment | 12:51 |
| mgoddard | bsanjeewa: which one? | 12:51 |
| *** hongbin has joined #openstack-kolla | 12:52 | |
| *** amoralej|lunch is now known as amoralej | 12:57 | |
| bsanjeewa | mgoddard: https://storyboard.openstack.org/#!/story/2007779 | 12:57 |
| *** skramaja has quit IRC | 13:01 | |
| openstackgerrit | Merged openstack/kayobe-config-dev master: Synchronise with kayobe-config for Ussuri https://review.opendev.org/734473 | 13:01 |
| openstackgerrit | Merged openstack/kayobe-config-dev master: Remove empty default LVM configuration https://review.opendev.org/722321 | 13:01 |
| *** shyamb has quit IRC | 13:03 | |
| r3ap3r | mgoddard: yoctozepto: I replied to https://bugs.launchpad.net/kolla-ansible/+bug/1878412?comments=all and just wanted to let you know what my results were. If you have anything else for me to try, just post in the bug report and I will try it out. I have a server set aside for testing at the moment while I get all of my vlan's setup in my firewall and then I have to setup Ceph so that server will be up for a | 13:04 |
| openstack | Launchpad bug 1878412 in kolla-ansible train "CentOS 8 Failure of Restart elasticsearch container" [High,In progress] - Assigned to Mark Goddard (mgoddard) | 13:04 |
| r3ap3r | while for me to try things out on. Thanks. | 13:04 |
| *** shyamb has joined #openstack-kolla | 13:04 | |
| *** shyamb has quit IRC | 13:07 | |
| *** priteau has joined #openstack-kolla | 13:12 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe-config-dev master: Add seed-hypervisor host https://review.opendev.org/617161 | 13:19 |
| *** diurnalist has joined #openstack-kolla | 13:27 | |
| *** TrevorV has joined #openstack-kolla | 13:31 | |
| *** wuchunyang has joined #openstack-kolla | 13:33 | |
| *** bsanjeewa|phone has joined #openstack-kolla | 13:36 | |
| *** bengates has quit IRC | 13:48 | |
| *** bengates_ has joined #openstack-kolla | 13:48 | |
| *** bengates_ has quit IRC | 13:49 | |
| *** bengates has joined #openstack-kolla | 13:49 | |
| *** gmann is now known as gmann_afk | 13:52 | |
| kevko | mgoddard: still here ? | 13:55 |
| *** abdysn has quit IRC | 13:56 | |
| kevko | mgoddard: when uninstalling chrony from host via ubuntu_package_removal ..it is processed by ansible package module which doesn't support purge ..so it is removed ...but config files still present in system ..so apparmor still turned on :( | 13:56 |
| *** ricolin has joined #openstack-kolla | 13:59 | |
| *** bengates_ has joined #openstack-kolla | 14:00 | |
| *** bengates has quit IRC | 14:00 | |
| kevko | trap next to the trap | 14:00 |
| *** bengates_ has quit IRC | 14:01 | |
| *** bengates has joined #openstack-kolla | 14:01 | |
| *** hongbin has quit IRC | 14:03 | |
| dking | With Kayobe, during "kayobe seed host configure", I'm running across an issue at "MichaelRigart.interfaces : Check active bond interface state" where "Interface eno2 is not active". I saw that once before for some cloud hosts, and I re-provisioned them for it to go away. | 14:04 |
| dking | I'm using VLANs over a bond. I notice that during this time, accessing the terminal through the BMC< I can see the error "bond0: option slaves: invalid value (-eno1)" | 14:04 |
| *** ysirndjuro has joined #openstack-kolla | 14:05 | |
| dking | Also, what is the best way to re-deploy a Kayobe seed host? Would I need to just start over with a new Kayobe directory? | 14:09 |
| *** hongbin has joined #openstack-kolla | 14:13 | |
| mgoddard | dking: for the interface config, I would suggest poking around on the box to see why the links are down. There are some bonding options you can provide such as updelay/downdelay that might be useful if the timing isn't right | 14:15 |
| mgoddard | second error sounds like your bond slave name is configured incorrectly... | 14:15 |
| mgoddard | third, I'm not sure what you mean by a kayobe directory | 14:16 |
| dking | I meant the whole base_path. But really, I'm just interested in what directories or files I could remove to start over with the seed host to be sure that old configurations are removed. | 14:21 |
| *** seco has quit IRC | 14:27 | |
| *** Torel_ has quit IRC | 14:36 | |
| *** gmann_afk is now known as gmann | 14:36 | |
| *** Torel has joined #openstack-kolla | 14:44 | |
| *** diurnalist has quit IRC | 14:49 | |
| priteau | dking: I think rm -rf /opt/kayobe, /etc/kolla and deleting docker containers and volumes should get you into a mostly clean state, aside from the OS-specific things (network, LVM, etc.). But old configuration isn't necessarily going to cause issues anyway, it will generally be rewritten or ignored. | 14:53 |
| priteau | One thing to watch out is old network config files: /etc/syconfig/network-scripts/ifcfg-* | 14:54 |
| dking | Yeah, you may be right. I just want to be sure, since I've been getting issues, even when I try a freshly OSed seed host with configs that had worked before. You may be right about the network scripts. | 14:55 |
| dking | I'm going to try clearing out /opt/kayobe again. Is there any single place for updated files related specifically to the seed host? | 14:56 |
| priteau | I don't think so, the seed doesn't do much except run containers and kolla builds | 14:57 |
| priteau | Just to be sure, you are talking about a *seed* host, not a *seed hypervisor* host? | 14:58 |
| dking | also, what's interesting about the network issue I'm getting is that things work after I run a "systemctl restart network", but then the issues occur (eno2 DOWN and I can't access from my external network) after I run the "kayobe seed host configure". | 14:58 |
| dking | Correct. It's a physical server with CentOS 8. | 14:59 |
| priteau | Could you share your network config? | 15:02 |
| dking | Sure. One moment. | 15:03 |
| *** zijlboot_ has joined #openstack-kolla | 15:04 | |
| *** dougsz has quit IRC | 15:05 | |
| dking | Here's what I'm currently working with: http://paste.openstack.org/show/794530/ | 15:06 |
| *** zijlboot has quit IRC | 15:07 | |
| dking | But I've been adjusting things. I tried reverting to things that worked on my other instance. I was even trying some settings which had worked previously on this current instance, making me suspect some stale configuration somewhere. | 15:09 |
| priteau | Check the generated network config files: /etc/sysconfig/network-scripts/ifcfg-{bond0,eno1,eno2} | 15:09 |
| priteau | Also check for other files in /etc/sysconfig/network-scripts/ifcfg-* which might get picked up | 15:10 |
| *** diurnalist has joined #openstack-kolla | 15:17 | |
| dking | I'm removing some old files I had and I'm adding the external network, since I'll want that, too. That way they should match. | 15:19 |
| *** dougsz has joined #openstack-kolla | 15:19 | |
| *** Torel has quit IRC | 15:24 | |
| *** Torel has joined #openstack-kolla | 15:26 | |
| dking | Okay, now the scripts match what's in the configuration. The issues persist. If I restart the network, I can ping the external IP again, until I run the seed host configure. However, I see that eno2 is listed as down regardless. I'm going to try rebooting the seed. | 15:28 |
| *** nathharp has quit IRC | 15:32 | |
| *** nathharp has joined #openstack-kolla | 15:33 | |
| *** nathharp has quit IRC | 15:37 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla master: Remove opendaylight image https://review.opendev.org/734630 | 15:39 |
| *** bsanjeewa_ has joined #openstack-kolla | 15:40 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla master: Remove opendaylight image https://review.opendev.org/734630 | 15:41 |
| *** bsanjeewa has quit IRC | 15:43 | |
| dking | Well, eno2 is still down. I suppose that's the problem. It seems to be working, but if it says that it's down, I imagine that task will fail, and not finish setting things up. It's odd that ifup doesn't show any errors. It just says "DOWN" with "ip a". But I suppose it's not a Kayobe problem at the moment. | 15:45 |
| openstackgerrit | Christian Berendt proposed openstack/kolla master: Remove sensu images https://review.opendev.org/734632 | 15:46 |
| *** ykarel is now known as ykarel|away | 15:46 | |
| *** nathharp has joined #openstack-kolla | 15:47 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla master: Remove Neutron OVN images https://review.opendev.org/734633 | 15:50 |
| *** jonaspaulo has joined #openstack-kolla | 15:52 | |
| *** bsanjeewa|phone has quit IRC | 15:53 | |
| *** e0ne has quit IRC | 15:57 | |
| *** rpittau is now known as rpittau|afk | 16:09 | |
| *** wuchunyang has quit IRC | 16:11 | |
| *** wuchunya_ has joined #openstack-kolla | 16:11 | |
| *** bsanjeewa|phone has joined #openstack-kolla | 16:11 | |
| *** wuchunyang has joined #openstack-kolla | 16:11 | |
| *** wuchunya_ has quit IRC | 16:12 | |
| openstackgerrit | gugug proposed openstack/kolla-ansible master: Remove the unnecessary task for octavia https://review.opendev.org/734641 | 16:14 |
| openstackgerrit | Will Szumski proposed openstack/kayobe master: Update feature flags https://review.opendev.org/734064 | 16:14 |
| openstackgerrit | Erol Guzoglu proposed openstack/kolla-ansible master: Support customizing skydive.conf file https://review.opendev.org/732620 | 16:19 |
| openstackgerrit | Erol Guzoglu proposed openstack/kolla-ansible master: Support customizing skydive.conf file https://review.opendev.org/732620 | 16:21 |
| *** bengates has quit IRC | 16:27 | |
| *** nathharp has quit IRC | 16:29 | |
| *** nathharp has joined #openstack-kolla | 16:30 | |
| *** ricolin has quit IRC | 16:30 | |
| *** nathharp has quit IRC | 16:34 | |
| *** amoralej is now known as amoralej|off | 16:35 | |
| *** wuchunyang has quit IRC | 16:45 | |
| *** bsanjeewa_ has quit IRC | 16:53 | |
| *** bsanjeewa has joined #openstack-kolla | 16:58 | |
| openstackgerrit | Konstantinos Mouzakitis proposed openstack/kolla-ansible master: Adds the blueprint file for multiple globals files support https://review.opendev.org/734653 | 17:02 |
| *** Torel has quit IRC | 17:04 | |
| *** Torel has joined #openstack-kolla | 17:05 | |
| *** lvdombrkr has quit IRC | 17:06 | |
| *** maharg101 has joined #openstack-kolla | 17:13 | |
| *** maharg101 has quit IRC | 17:14 | |
| *** maharg101 has joined #openstack-kolla | 17:14 | |
| *** diurnalist has quit IRC | 17:15 | |
| *** dougsz has quit IRC | 17:18 | |
| *** priteau has quit IRC | 17:21 | |
| *** k_mouza has quit IRC | 17:35 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/ussuri: Add 'ovn' to list of valid values of neutron_plugin_agent https://review.opendev.org/734536 | 17:36 |
| openstackgerrit | Merged openstack/kolla-ansible master: Set previous release to Ussuri https://review.opendev.org/731805 | 17:38 |
| *** cah_link has quit IRC | 17:40 | |
| *** diurnalist has joined #openstack-kolla | 17:42 | |
| *** vishalmanchanda has quit IRC | 17:45 | |
| *** bsanjeewa|phone has quit IRC | 17:50 | |
| openstackgerrit | Merged openstack/kolla-ansible master: CI: drop pre-ussuri upgrade support https://review.opendev.org/731487 | 17:53 |
| *** k_mouza has joined #openstack-kolla | 17:57 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: CI: move playbook files to tests/playbooks/ dir https://review.opendev.org/715872 | 18:02 |
| *** bsanjeewa has quit IRC | 18:03 | |
| *** bsanjeewa_ has joined #openstack-kolla | 18:05 | |
| *** k_mouza has quit IRC | 18:08 | |
| *** bsanjeewa has joined #openstack-kolla | 18:09 | |
| *** Torel has quit IRC | 18:29 | |
| *** k_mouza has joined #openstack-kolla | 18:30 | |
| *** hongbin has quit IRC | 18:30 | |
| *** muhaha has joined #openstack-kolla | 18:31 | |
| *** Torel has joined #openstack-kolla | 18:31 | |
| *** hongbin has joined #openstack-kolla | 18:49 | |
| *** k_mouza has quit IRC | 18:50 | |
| *** dougsz has joined #openstack-kolla | 19:05 | |
| *** diurnalist has quit IRC | 19:09 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/stein: Do not require kolla-ansible to be installed https://review.opendev.org/734681 | 19:17 |
| *** hongbin has quit IRC | 19:34 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: [docs] Release management - small changes https://review.opendev.org/734684 | 19:36 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: [DNM] test https://review.opendev.org/734685 | 19:46 |
| *** hongbin has joined #openstack-kolla | 19:52 | |
| *** nathharp has joined #openstack-kolla | 19:57 | |
| *** nathharp has quit IRC | 19:58 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Remove XenAPI integration https://review.opendev.org/734180 | 19:58 |
| *** nathharp has joined #openstack-kolla | 19:58 | |
| *** stingrayza has joined #openstack-kolla | 20:02 | |
| *** dougsz has quit IRC | 20:05 | |
| *** also_stingrayza has quit IRC | 20:05 | |
| admin0 | hi guys . does kolla support ubuntu 20 already ? | 20:09 |
| *** dougsz has joined #openstack-kolla | 20:20 | |
| *** diurnalist has joined #openstack-kolla | 20:20 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Remove the unnecessary task for octavia https://review.opendev.org/734641 | 20:27 |
| *** keper7 has joined #openstack-kolla | 20:35 | |
| *** e0ne has joined #openstack-kolla | 20:42 | |
| *** jbadiapa has quit IRC | 20:48 | |
| *** e0ne has quit IRC | 20:50 | |
| r3ap3r | admin0: If you look here, they don't say they do. Maybe they will add support for Focal in Ussuri but will most likely be a Victoria thing, I'm not really sure? https://docs.openstack.org/kolla-ansible/latest/user/support-matrix.html | 21:03 |
| *** diurnali1t has joined #openstack-kolla | 21:11 | |
| born2bake | i deployed k-a on focal hosts | 21:20 |
| born2bake | no issues :) | 21:20 |
| *** keper7 has quit IRC | 21:20 | |
| *** muhaha has quit IRC | 21:21 | |
| *** Torel has quit IRC | 21:23 | |
| *** TrevorV has quit IRC | 21:26 | |
| *** Torel has joined #openstack-kolla | 21:26 | |
| *** dougsz has quit IRC | 21:27 | |
| admin0 | ok | 21:59 |
| *** bsanjeewa_ has quit IRC | 22:26 | |
| *** bsanjeewa_ has joined #openstack-kolla | 22:26 | |
| *** ysirndjuro has quit IRC | 22:32 | |
| r3ap3r | born2bake: valid point, I guess to a certain degree, as long as you run Python 3 and a supported version of Ansible, the host doesn't really matter. The containers would be based off of whatever you set in globals and that would be the only difference. | 22:35 |
| born2bake | just needed to change 1-2 lines in k-a | 22:36 |
| born2bake | r3ap3r as far as I remember, you have swift connected to ceph rgw right? | 22:36 |
| born2bake | I am wondering, how storage policy can be added to swift, when its deployed with rgw | 22:37 |
| born2bake | cause I m getting storage policy errors every time I open object storage in horizon :/ | 22:37 |
| born2bake | cant create containers either | 22:37 |
| r3ap3r | I personally have not. I'm building a single Ceph node at the house to test against Ussuri Cent8 deployment. | 22:37 |
| r3ap3r | I know there are "things" needed to run a single node but I'm working through that as I can dedicate time to it. | 22:38 |
| r3ap3r | born2bake: I apologize but I'm still relatively new to Ceph, coming from a Cinder only background, but I'll let you know if I come across anything related to that. | 22:40 |
| *** diurnalist has quit IRC | 22:42 | |
| *** bsanjeewa_ has quit IRC | 22:53 | |
| *** bsanjeewa_ has joined #openstack-kolla | 22:53 | |
| *** born2bake has quit IRC | 23:07 | |
| *** diurnalist has joined #openstack-kolla | 23:12 | |
| *** bsanjeewa has quit IRC | 23:14 | |
| *** bsanjeewa has joined #openstack-kolla | 23:17 | |
| *** keper7 has joined #openstack-kolla | 23:41 | |
| *** keper7 has quit IRC | 23:41 | |
| *** jonaspaulo has quit IRC | 23:44 | |
| *** bsanjeewa_ has quit IRC | 23:56 | |
| *** bsanjeewa has quit IRC | 23:56 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!