| *** tosky has quit IRC | 00:14 | |
| *** macz_ has quit IRC | 00:17 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Disable manila 2 vms tempest scenario https://review.opendev.org/760771 | 00:40 |
|---|---|---|
| *** cshen has quit IRC | 01:15 | |
| *** macz_ has joined #openstack-ansible | 01:27 | |
| *** macz_ has quit IRC | 01:32 | |
| *** spatel has joined #openstack-ansible | 02:10 | |
| *** cshen has joined #openstack-ansible | 02:11 | |
| *** spatel has quit IRC | 02:11 | |
| *** spatel has joined #openstack-ansible | 02:12 | |
| *** spatel has quit IRC | 02:14 | |
| *** cshen has quit IRC | 02:16 | |
| *** rh-jelabarre has quit IRC | 03:19 | |
| *** nurdie has quit IRC | 04:11 | |
| *** nurdie has joined #openstack-ansible | 04:11 | |
| *** cshen has joined #openstack-ansible | 04:11 | |
| *** cshen has quit IRC | 04:16 | |
| *** nurdie has quit IRC | 04:16 | |
| *** nurdie has joined #openstack-ansible | 05:20 | |
| *** nurdie has quit IRC | 05:27 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-ansible | 05:33 | |
| *** nurdie has joined #openstack-ansible | 06:00 | |
| *** nurdie has quit IRC | 06:05 | |
| *** cshen has joined #openstack-ansible | 06:12 | |
| *** cshen has quit IRC | 06:16 | |
| *** jbadiapa has quit IRC | 06:49 | |
| *** miloa has joined #openstack-ansible | 06:59 | |
| *** cshen has joined #openstack-ansible | 07:00 | |
| kleini | ThiagoCMC: as our productive Ceph is outdated as hell on Jewel, we don't use EC | 07:02 |
| *** cshen has quit IRC | 07:04 | |
| *** cshen has joined #openstack-ansible | 07:12 | |
| *** nurdie has joined #openstack-ansible | 07:16 | |
| *** cshen has quit IRC | 07:17 | |
| *** melwitt has quit IRC | 07:20 | |
| *** melwitt has joined #openstack-ansible | 07:21 | |
| *** nurdie has quit IRC | 07:21 | |
| *** cshen has joined #openstack-ansible | 07:22 | |
| *** jmccrory has quit IRC | 07:22 | |
| *** jmccrory has joined #openstack-ansible | 07:22 | |
| *** pto has quit IRC | 07:42 | |
| *** pto has joined #openstack-ansible | 07:43 | |
| *** nurdie has joined #openstack-ansible | 07:49 | |
| *** pcaruana has quit IRC | 07:52 | |
| *** nurdie has quit IRC | 07:54 | |
| *** pcaruana has joined #openstack-ansible | 08:04 | |
| *** luksky has joined #openstack-ansible | 08:09 | |
| noonedeadpunk | mornings | 08:11 |
| *** tosky has joined #openstack-ansible | 08:13 | |
| *** andrewbonney has joined #openstack-ansible | 08:14 | |
| *** nurdie has joined #openstack-ansible | 08:26 | |
| *** nurdie has quit IRC | 08:31 | |
| *** sshnaidm|rover has quit IRC | 08:36 | |
| *** macz_ has joined #openstack-ansible | 08:37 | |
| *** sshnaidm|rover has joined #openstack-ansible | 08:38 | |
| *** rpittau|afk is now known as rpittau | 08:39 | |
| *** mensis has joined #openstack-ansible | 08:41 | |
| *** macz_ has quit IRC | 08:42 | |
| *** sshnaidm|rover has quit IRC | 08:43 | |
| *** sshnaidm|rover has joined #openstack-ansible | 08:45 | |
| kleini | morning | 08:52 |
| *** sshnaidm|rover has quit IRC | 08:52 | |
| *** sshnaidm|rover has joined #openstack-ansible | 08:56 | |
| *** sshnaidm|rover has quit IRC | 09:00 | |
| *** jbadiapa has joined #openstack-ansible | 09:02 | |
| *** yann-kaelig has joined #openstack-ansible | 09:30 | |
| *** mensis has quit IRC | 09:33 | |
| *** suryasingh has joined #openstack-ansible | 09:40 | |
| *** macz_ has joined #openstack-ansible | 09:43 | |
| *** macz_ has quit IRC | 09:48 | |
| *** sshnaidm has joined #openstack-ansible | 09:49 | |
| *** pto has quit IRC | 09:56 | |
| *** pto has joined #openstack-ansible | 09:57 | |
| *** cshen has quit IRC | 10:03 | |
| *** arxcruz has quit IRC | 10:04 | |
| *** arxcruz has joined #openstack-ansible | 10:09 | |
| *** cshen has joined #openstack-ansible | 10:14 | |
| *** cshen has quit IRC | 10:18 | |
| *** CeeMac has joined #openstack-ansible | 10:22 | |
| *** nurdie has joined #openstack-ansible | 10:28 | |
| *** cshen has joined #openstack-ansible | 10:30 | |
| *** noonedeadpunk has quit IRC | 10:32 | |
| *** noonedeadpunk has joined #openstack-ansible | 10:32 | |
| *** nurdie has quit IRC | 10:33 | |
| *** yann-kaelig has quit IRC | 10:33 | |
| admin0 | can upgrade from 20.1.x to 21.1.x or should upgrade to 21.0 first and then to 21.1 ? | 10:47 |
| kleini | I just upgraded production from 20.1.4 to 21.1.0 and all went very well | 10:49 |
| kleini | except that ubuntu base image problem, which I expect to be fixed in 21.1.1 | 10:50 |
| noonedeadpunk | admin0: yu can jump straight to the latest major tag (ie 20.*.* -> 21.*.*) | 11:02 |
| admin0 | noonedeadpunk, i did tried it 3 times from 20.1.4 to 21.1. and it failed, so now first moved from 20.1.4 to 20.1.7 | 11:04 |
| noonedeadpunk | isn't it image download issue?:) | 11:04 |
| admin0 | that was one.. which you gave me a pointer and i had to manually put in the url .. the 2nd was it failed on setting up keystone saying cannot setup database | 11:13 |
| admin0 | i will try 20.1.7 -> 21.1.0 and check what issues i will get | 11:15 |
| *** noonedeadpunk has quit IRC | 11:21 | |
| *** noonedeadpunk has joined #openstack-ansible | 11:25 | |
| *** cshen has quit IRC | 11:49 | |
| *** rfolco has joined #openstack-ansible | 12:02 | |
| *** fanfi has joined #openstack-ansible | 12:06 | |
| fanfi | folks, when I tried to add ceph to my OSA instances i got following error. Probably ceph repo missing. Where I can set which repo I want to use for containers? TASK [ceph_client : Install ceph packages] | 12:10 |
| fanfi | FAILED - RETRYING: Install ceph packages (1 retries left).fatal: [v-node01_glance_container-4695b489]: FAILED! => {"attempts": 5, "changed": false, "failures": [], "msg": "Depsolve Error occured: \n Problem 1: package python3-cephfs-2:15.2.5-0.el8.x86_64 requires libcephfs2 = 2:15.2.5-0.el8, but none of the providers can be installed\n - package | 12:10 |
| fanfi | libcephfs2-2:15.2.5-0.el8.x86_64 requires libfmt.so.6()(64bit), but none of the providers can be installed\n - conflicting requests\n - package fmt-6.2.1-1.el8.x86_64 is filtered out by exclude filtering\n Problem 2: package python3-rados-2:15.2.5-0.el8.x86_64 requires librados.so.2(LIBRADOS_14.2.0)(64bit), but none of the providers can be | 12:10 |
| fanfi | installed\n - package python3-rados-2:15.2.5-0.el8.x86_64 requires librados2 = 2:15.2.5-0.el8, but none of the providers can be installed\n - package librados2-2:15.2.5-0.el8.x86_64 requires libfmt.so.6()(64bit), but none of the providers can be installed\n - conflicting requests\n - package fmt-6.2.1-1.el8.x86_64 is filtered out by exclude | 12:10 |
| fanfi | filtering\n Problem 3: package python3-rbd-2:15.2.5-0.el8.x86_64 requires librbd1 = 2:15.2.5-0.el8, but none of the providers can be installed\n - package librbd1-2:15.2.5-0.el8.x86_64 requires libfmt.so.6()(64bit), but none of the providers can be installed\n - conflicting requests\n - package fmt-6.2.1-1.el8.x86_64 is filtered out by exclude | 12:10 |
| fanfi | filtering", "rc": 1, "results": []} | 12:10 |
| *** nurdie has joined #openstack-ansible | 12:29 | |
| *** djhankb has quit IRC | 12:39 | |
| *** djhankb has joined #openstack-ansible | 12:40 | |
| *** cshen has joined #openstack-ansible | 12:41 | |
| *** nurdie has quit IRC | 12:45 | |
| admin0 | fanfi, please pastebin such errors | 12:47 |
| admin0 | its hard to read here as well | 12:47 |
| jamesdenton | mgariepy until recently, the openvswitch firewall had a somewhat nasty flooding behavior. not sure it's been fixed completely. https://bugs.launchpad.net/neutron/+bug/1732067 | 12:53 |
| openstack | Launchpad bug 1732067 in neutron "openvswitch firewall flows cause flooding on integration bridge" [High,In progress] - Assigned to LIU Yulong (dragon889) | 12:53 |
| *** fanfi has quit IRC | 12:58 | |
| *** rfolco has quit IRC | 13:01 | |
| *** rfolco has joined #openstack-ansible | 13:01 | |
| *** fanfi has joined #openstack-ansible | 13:04 | |
| fanfi | admin0 there is my past from the error. | 13:04 |
| fanfi | @admin0 | 13:04 |
| fanfi | https://pastebin.com/qR084Lvw | 13:05 |
| ThiagoCMC | fanfi, I would guess that your CentOS (8?) repositories are bad | 13:06 |
| fanfi | yes | 13:06 |
| *** rh-jelabarre has joined #openstack-ansible | 13:07 | |
| *** nurdie has joined #openstack-ansible | 13:18 | |
| *** nurdie has quit IRC | 13:23 | |
| *** suryasingh has quit IRC | 13:33 | |
| *** nurdie has joined #openstack-ansible | 13:55 | |
| *** spatel has joined #openstack-ansible | 13:59 | |
| *** nurdie has quit IRC | 13:59 | |
| spatel | jamesdenton: I got reply from centos8 community and they are saying use this repo to get openstackvswitch-2.13 which has support of dpdk "install -y centos-release-nfv-openvswitch" | 14:04 |
| spatel | they have created separate repo for NFV | 14:05 |
| spatel | It would be good if we add this in OSA for Victoria launch | 14:05 |
| mgariepy | jamesdenton, ho. | 14:06 |
| openstackgerrit | Merged openstack/openstack-ansible-os_manila master: Reduce number of processes on small systems https://review.opendev.org/760637 | 14:11 |
| mgariepy | jamesdenton, isn't ovn using the ovs fw ? | 14:14 |
| mgariepy | or it's another beast hidden in ovn ? | 14:15 |
| fanfi | ThiagoCMC yes i think the ceph repo is missing. But how I can add the ceph repo to the containers. | 14:17 |
| noonedeadpunk | mgariepy: can you kindly vote on https://review.opendev.org/#/c/760188/3 ?:) | 14:28 |
| mgariepy | done noonedeadpunk | 14:28 |
| noonedeadpunk | thanks! | 14:29 |
| *** nurdie has joined #openstack-ansible | 14:31 | |
| *** nurdie has quit IRC | 14:44 | |
| *** nurdie has joined #openstack-ansible | 14:44 | |
| pto | When keystone_sso_callback_file_path is not defined in https://github.com/openstack/openstack-ansible-os_keystone/blob/2b125eca319271b9ad8fc700f5b5aba00dc09037/defaults/main.yml#L501, is the default to copy a template or nothing? | 14:51 |
| pto | Its run from keystone post install https://github.com/openstack/openstack-ansible-os_keystone/blob/dcc16da7e20f50e1f9e9cd56170427ec9491d15c/tasks/keystone_post_install.yml#L100 | 14:52 |
| noonedeadpunk | also would be nice to merge this bump https://review.opendev.org/#/c/760730/ | 14:56 |
| pto | l,,læØ'¨ | 15:07 |
| *** macz_ has joined #openstack-ansible | 15:07 | |
| *** macz_ has quit IRC | 15:12 | |
| *** pto has quit IRC | 15:17 | |
| *** pto has joined #openstack-ansible | 15:19 | |
| *** fanfi has quit IRC | 15:22 | |
| spatel | noonedeadpunk: 21.0.0.0rc3 is Victoria tag? | 15:23 |
| spatel | got it 21.x.x.x belongs to ussuri | 15:25 |
| noonedeadpunk | no( | 15:30 |
| noonedeadpunk | I still didn't make it:( | 15:30 |
| noonedeadpunk | want to merge some things to fix roles first to make some beta | 15:30 |
| noonedeadpunk | however master if fixed on victoria in terms of services | 15:31 |
| noonedeadpunk | s/if/is/ | 15:31 |
| *** pto has quit IRC | 15:32 | |
| spatel | I am planning to deploy on production so thinking to use master or stable/ussuri | 16:01 |
| spatel | i am thinking to use master and as we get more stable code i will keep upgrading (anyway my production not going to go live for next 1 month so not worried) | 16:02 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Fix OVN functional test https://review.opendev.org/760188 | 16:12 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Enable notifications when Designate is enabled https://review.opendev.org/757937 | 16:12 |
| *** macz_ has joined #openstack-ansible | 16:26 | |
| *** macz_ has joined #openstack-ansible | 16:27 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_cinder master: Define credentials for nova interaction https://review.opendev.org/761637 | 16:42 |
| admin0 | which file in osa tells what release/tag/git-checksum of every project is ? for example if i want to know what version/release of nova is in 21.1.0 , where do i look ? | 16:57 |
| admin0 | is there an easy way to tell/see what versions/tags of each project is corresponding to a osa release ? | 16:58 |
| jrosser | admin0: here are the ansible role versions https://github.com/openstack/openstack-ansible/blob/21.1.0/ansible-role-requirements.yml | 17:02 |
| jrosser | and here are the versions of nova/keystone/..../etc https://github.com/openstack/openstack-ansible/blob/21.1.0/playbooks/defaults/repo_packages/openstack_services.yml | 17:03 |
| jrosser | that is an example for tag 21.1.0 | 17:03 |
| *** jamesden_ has joined #openstack-ansible | 17:08 | |
| *** rpittau is now known as rpittau|afk | 17:21 | |
| mgariepy | anyone here created a rbd usable ceph EC pool via ceph-ansible ? | 17:21 |
| *** gyee has joined #openstack-ansible | 17:35 | |
| nsmeds | Hello OSA team - just wanted to pop in and say thank you! We just upgraded our staging environment from Train to Ussuri, and openstack-ansible made the upgrade smooth and simple. We really appreciate it! | 17:55 |
| nsmeds | We have one caching issue that we're investigating, and I was hoping to get some clarification on conflicting docs. | 17:58 |
| nsmeds | https://docs.openstack.org/openstack-ansible-memcached_server/ussuri/configure-ha.html provides an example for registering memcached with HAProxy and telling services to go via HAProxy. | 17:59 |
| jrosser | nsmeds: that is great to hear your upgrade was smooth, do make a bug on launchpad for anything that looks suspect | 17:59 |
| nsmeds | https://github.com/openstack/openstack-ansible-os_keystone/blob/stable/ussuri/templates/keystone.conf.j2#L27 describes a bug related to this config, and suggests the memcached containers should be a comma separated list (skipping haproxy) | 18:00 |
| nsmeds | (at least that's my understanding) | 18:00 |
| nsmeds | Just doing some testing on our side to verify that comma separated list resolves the issue (right now we talk to memcached via HAProxy and receive frequent token errors and are logged out of Horizon). | 18:03 |
| nsmeds | @jrosser would you like a bug that just mentions the conflicting docs? | 18:04 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/ussuri: Enable notifications when Designate is enabled https://review.opendev.org/761240 | 18:06 |
| jrosser | nsmeds: where do you see it connecting via haproxy? thats interesting | 18:07 |
| nsmeds | So, that first link has examples which a) register memcached wit HAProxy and b) update `memcached_servers` to point to HAProxy frontend, which we've done. | 18:08 |
| nsmeds | When you update `memcached_servers`, it results in a number of OpenStack configs being updated with the same value, including in `keystone.conf`. | 18:08 |
| nsmeds | Specifically, in the Keystone container's `/etc/keystone/keystone.conf` we have the setting `memcache_servers = <internal_vip>:11211` | 18:09 |
| *** fanfi has joined #openstack-ansible | 18:09 | |
| jrosser | yeah so i wonder if that documentation really is correct | 18:10 |
| jrosser | without those overrides it should be a list by default https://github.com/openstack/openstack-ansible/blob/master/inventory/group_vars/all/infra.yml#L40-L46 | 18:10 |
| nsmeds | however the second link describes a problem with doing so, and recommends a comma-separated list (which is the default, as you just posted) | 18:10 |
| nsmeds | So the fix is easy from our side - just going to remove the `memcached_servers` override and allow default to be applied. Just wanted to mention the conflicting docs mostly (since it appears the correct config is hidden as a code comment). | 18:11 |
| openstackgerrit | Merged openstack/openstack-ansible stable/stein: Bump SHAs for stable/stein https://review.opendev.org/760730 | 18:11 |
| jrosser | yes certainly make a bug for the docs ambiguity becasue following the bug link suggests that this should be fixed in oslo | 18:12 |
| nsmeds | Just doing some testing myself right now to see how services behave with the comma-separated list (e.g. what happens if I down the first memcached LXC container) | 18:12 |
| nsmeds | ok I'll make a bug today | 18:12 |
| nsmeds | thanks again to you and the OSA team - we've been dreading the OpenStack upgrade but the upgrade process you've provided took care of everything with near 0 downtime | 18:15 |
| *** redkrieg has quit IRC | 18:26 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/train: Enable notifications when Designate is enabled https://review.opendev.org/761241 | 18:29 |
| *** andrewbonney has quit IRC | 18:29 | |
| *** sshnaidm is now known as sshnaidm|afk | 18:44 | |
| spatel | https://ibb.co/SdKd1DV | 19:07 |
| mgariepy | spatel, lol | 19:10 |
| *** pto has joined #openstack-ansible | 19:10 | |
| *** cshen has quit IRC | 19:14 | |
| *** pto has quit IRC | 19:16 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/train: Bump SHAs for stable/train https://review.opendev.org/760728 | 19:34 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/train: Bump SHAs for stable/train https://review.opendev.org/760728 | 19:34 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/ussuri: Bump SHAs for stable/ussuri https://review.opendev.org/760731 | 19:35 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/ussuri: Bump SHAs for stable/ussuri https://review.opendev.org/760731 | 19:35 |
| noonedeadpunk | would be awesome to merge these bumps | 19:36 |
| noonedeadpunk | but renos worth checking | 19:36 |
| mgariepy | lgtm. | 20:04 |
| *** dwilde has quit IRC | 20:46 | |
| *** d34dh0r53 has joined #openstack-ansible | 20:46 | |
| spatel | jrosser: i am trying to speed up ansible using openstack-ansible -f 16 option but not seeing big difference. | 20:49 |
| *** fanfi has quit IRC | 21:03 | |
| *** cshen has joined #openstack-ansible | 21:10 | |
| *** cshen has quit IRC | 21:15 | |
| *** miloa has quit IRC | 21:43 | |
| *** pto has joined #openstack-ansible | 21:47 | |
| *** pto has quit IRC | 21:52 | |
| *** fanfi has joined #openstack-ansible | 22:05 | |
| *** cshen has joined #openstack-ansible | 22:08 | |
| *** rh-jelabarre has quit IRC | 22:22 | |
| *** rh-jelabarre has joined #openstack-ansible | 22:22 | |
| *** jamesden_ has quit IRC | 22:33 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [doc] Mention uwsgi overrides in doc https://review.opendev.org/761206 | 22:45 |
| jamesdenton | mgariepy yes, OVN uses an OVS-based firewall, but the mechanics are built into OVN rather than Neutron itself | 22:47 |
| ThiagoCMC | jrosser, we were talking about the Hybrid messaging deployment the other day... This one: https://docs.openstack.org/openstack-ansible/ussuri/user/messaging/messaging.html - Well, it doesn't work. | 22:57 |
| ThiagoCMC | Here is both nova.conf and syslog with errors: http://paste.openstack.org/show/799760/ | 22:57 |
| ThiagoCMC | It tries to use both (which was something that I was expecting) rabbit (for oslo_messaging_notifications) and ampq for Rpc calls but, it seems to be in an unconfigured state. | 22:59 |
| ThiagoCMC | Keystone seems to be working! The "openstack endpoint list" worked. | 23:02 |
| *** cshen has quit IRC | 23:02 | |
| *** rh-jelabarre has quit IRC | 23:03 | |
| *** spatel has quit IRC | 23:18 | |
| *** spatel has joined #openstack-ansible | 23:20 | |
| *** spatel has quit IRC | 23:25 | |
| ThiagoCMC | Can someone help me with Horizon in OSA Ussuri deployment? It's failing: http://paste.openstack.org/show/799762/ - TASK: os_horizon : Ensure static files are collected and compressed - Some python error related to _50_murano.py - I don't have Murano enabled at Horizon but failed anyway, tried to enable it, same error. | 23:29 |
| nsmeds | @ThiagoCMC this might not be super helpful - but I've just updated one of our deployments to Ussuri and I don't see the `_50_murano.py` in that directory. | 23:34 |
| nsmeds | Some differences though, my directory naming is `/openstack/venvs/horizon-21.1.0/lib/python3.6/` | 23:35 |
| *** pfsmorigo has quit IRC | 23:40 | |
| ThiagoCMC | Oh! Any fixes?! | 23:44 |
| *** luksky has quit IRC | 23:46 | |
| *** pto has joined #openstack-ansible | 23:49 | |
| nsmeds | Sorry, I am not familiar with how this content is generated - just thought I'd share to hopefully help you troubleshoot. | 23:50 |
| ThiagoCMC | Ok, no worries | 23:52 |
| ThiagoCMC | Have you deployed it with Ussuri? | 23:52 |
| nsmeds | Deployed Train, upgraded to Ussuri yesterday. Running Ubuntu 18.04 servers. | 23:54 |
| ThiagoCMC | cool | 23:54 |
| ThiagoCMC | I'm trying a fresh new OSA Ussuri with Ubuntu 20.04, so far, not good. lol | 23:54 |
| *** tosky has quit IRC | 23:55 | |
| nsmeds | Question for you - what branch are you deploying? I notice `/openstack/venvs/horizon-21.1.1.dev3/` in your paste, which suggests you're deploying a dev branch? | 23:55 |
| *** rfolco has quit IRC | 23:55 | |
| ThiagoCMC | Branch stable/ussuri | 23:55 |
| *** pto has quit IRC | 23:55 | |
| nsmeds | I believe you'll want to set `21.1.0` for the branch, let me just find docs which confirm that | 23:56 |
| ThiagoCMC | Hmmm | 23:56 |
| nsmeds | Yep, look at https://docs.openstack.org/project-deploy-guide/openstack-ansible/ussuri/deploymenthost.html | 23:57 |
| nsmeds | Might help? | 23:58 |
| ThiagoCMC | Sure, I'll give it a try, thank you! | 23:58 |
| nsmeds | actually that suggests `21.0.1` (but still - specifying the actual version tag instead of stable/ussuri) | 23:58 |
| ThiagoCMC | Yep, got it | 23:59 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!