Tuesday, 2020-10-13

*** MickyMan77 has quit IRC00:12
openstackgerritMerged openstack/openstack-ansible master: Add infra testing scenario  https://review.opendev.org/75549700:26
*** spatel has joined #openstack-ansible00:50
*** gyee has quit IRC00:54
*** spatel has quit IRC00:54
*** spatel has joined #openstack-ansible00:59
*** cshen has joined #openstack-ansible01:26
*** MickyMan77 has joined #openstack-ansible01:28
*** cshen has quit IRC01:30
*** MickyMan77 has quit IRC01:37
*** MickyMan77 has joined #openstack-ansible02:06
*** MickyMan77 has quit IRC02:14
*** MickyMan77 has joined #openstack-ansible02:42
*** MickyMan77 has quit IRC02:51
*** cshen has joined #openstack-ansible03:10
*** cshen has quit IRC03:14
*** MickyMan77 has joined #openstack-ansible03:20
*** MickyMan77 has quit IRC03:28
*** MickyMan77 has joined #openstack-ansible04:01
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-ansible04:33
*** miloa has joined #openstack-ansible04:36
*** MickyMan77 has quit IRC05:04
*** spatel has quit IRC05:07
*** cshen has joined #openstack-ansible05:10
*** cshen has quit IRC05:14
*** cshen has joined #openstack-ansible05:25
*** cshen has quit IRC05:30
*** djhankb has quit IRC05:55
*** djhankb has joined #openstack-ansible05:55
*** cshen has joined #openstack-ansible06:00
*** cshen has quit IRC06:04
*** cshen has joined #openstack-ansible06:24
jrossermorning06:39
*** cshen has quit IRC06:39
*** cshen has joined #openstack-ansible06:41
*** cshen has quit IRC06:46
jrossernoonedeadpunk: can you take a look at this https://review.opendev.org/#/c/756279/06:59
jrosserreally hoping that doesnt break things :/06:59
jrosserbut it's blocking python_venv_build for sure06:59
openstackgerritwu.shiming proposed openstack/openstack-ansible master: Use unittest.mock instead of mock  https://review.opendev.org/75749006:59
*** andrewbonney has joined #openstack-ansible07:08
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_placement stable/ussuri: Trigger service restart  https://review.opendev.org/75771007:18
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_cinder stable/ussuri: Trigger uwsgi restart  https://review.opendev.org/75771207:19
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_cinder stable/train: Trigger uwsgi restart  https://review.opendev.org/75771307:20
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_nova stable/train: Trigger uwsgi restart  https://review.opendev.org/75771407:21
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_nova stable/ussuri: Trigger uwsgi restart  https://review.opendev.org/75771507:21
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_aodh stable/train: Trigger uwsgi restart  https://review.opendev.org/75771607:21
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_aodh stable/ussuri: Trigger uwsgi restart  https://review.opendev.org/75771707:21
*** cshen has joined #openstack-ansible07:22
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_aodh stable/train: Trigger uwsgi restart  https://review.opendev.org/75771607:23
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Add rsync to container base image  https://review.opendev.org/75761207:23
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_heat stable/train: Trigger uwsgi restart  https://review.opendev.org/75772107:24
jrosseri just run a focal AIO and somehow the stackviz install in os_tempest doesnt use the repo container to build the wheels, thats happened on the utility container07:24
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_heat stable/ussuri: Trigger uwsgi restart  https://review.opendev.org/75772207:24
*** tosky has joined #openstack-ansible07:26
*** rpittau|afk is now known as rpittau07:27
noonedeadpunkI'm also wondering how `venv_build_host` is being defined here https://opendev.org/openstack/openstack-ansible-os_tempest/src/branch/master/tasks/tempest_install_source.yml#L3707:29
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty master: Define condition for the first play host one time  https://review.opendev.org/75126107:47
openstackgerritMerged openstack/openstack-ansible-tests master: Use pip and virtualenv from host packages rather than get-pip.py  https://review.opendev.org/75627907:56
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests  https://review.opendev.org/74933708:02
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_senlin master: Updated from OpenStack Ansible Tests  https://review.opendev.org/75289208:03
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_placement stable/train: Trigger service restart  https://review.opendev.org/75774508:19
*** pmannidi has quit IRC08:24
*** pmannidi has joined #openstack-ansible08:24
noonedeadpunkwould be also awesome to get https://review.opendev.org/#/c/753376/ merged08:28
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: Add centos-8 support  https://review.opendev.org/73964608:29
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [DNM] Decrease murano tempest concurrency  https://review.opendev.org/74379808:30
recycleheromorning guys08:38
recycleherojrosser: I didnt see how it was a bug what u have sent last night?08:40
recycleherohttps://opendev.org/openstack/openstack-ansible-os_neutron/src/branch/master/vars/main.yml#L325-L34008:40
jrosserthe filtered list of services will not include the metadata service when you remove it from the neutron_plugin_base08:40
jrosserso i think thats why you saw the service keep running even though it was removed from the list08:41
jrosseri don't really know what the user expectation should be here08:43
recycleheroopendev is not opening for some reason , I will checkout in a min. will u fix the bug so I can cherry pick or on my own?08:44
recycleherojrosser: filtered_services are the services that should be deployed or the other way around? I think filtered_neutron_services incldue metering_agent based on the service_plugin. I am tring to setup ansible debug for me.08:52
jrosseryes i think that filtered services are the ones that should be deployed08:53
jrosserbut i think theres nothing that can account for taking something out of the list08:53
recycleherojrosser: something like this for debugging, am I on the correct path?09:02
recycleherohttp://paste.openstack.org/show/798977/09:02
recycleheroI run it with ansible-playbook -i /opt/openstack-ansible/inventory/dynamic_inventory.py AlistarAnsible09:03
jrossernot quite09:03
recycleherooh09:03
jrosserare you trying to see the value of this? https://github.com/openstack/openstack-ansible-os_neutron/blob/c4d5649b11912637c8ca4753358747fc1b695d3e/vars/main.yml#L14409:06
recycleheroyes09:08
jrossersorry meetings time now09:17
openstackgerritMerged openstack/openstack-ansible-os_manila master: Fix linter errors  https://review.opendev.org/75557009:24
noonedeadpunkwhaaat09:24
noonedeadpunkah, ok, it was just linters09:25
openstackgerritMerged openstack/openstack-ansible-os_nova master: Simplify scheduler filter additions  https://review.opendev.org/65014409:35
*** yann-kaelig has joined #openstack-ansible10:18
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_nova master: Define condition for the first play host one time  https://review.opendev.org/75633210:26
*** shyamb has joined #openstack-ansible11:26
openstackgerritMerged openstack/openstack-ansible master: Fix focal ceph jobs  https://review.opendev.org/75337611:32
ebbexnoonedeadpunk, jrosser https://github.com/openstack/openstack-ansible-os_nova/blob/master/vars/main.yml#L104 is it supposed to be default_filters or just `filters`?11:35
jrosserurgh11:36
ebbexI take that as a no, I'll submit a fix :)11:36
noonedeadpunkyeah....11:38
*** shyamb has quit IRC11:39
ebbexshould it perhaps be worded differently, so we set filters = nova_scheduler_default_filters and then set default_filters = filters.split(',') so the last line makes sense like it does now?11:41
ebbexnah, I'm leaving it as is. this will be deprecated/simplified in a release or two right?11:45
noonedeadpunkebbex: that's the plan11:46
noonedeadpunkidea was just to leave {{ nova_scheduler_default_filters + nova_scheduler_extra_filters }} at the end of the day11:46
openstackgerritErik Berg proposed openstack/openstack-ansible-os_nova master: use correct filters variable  https://review.opendev.org/75784411:48
noonedeadpunkgerrit doesn't load for me :(11:50
ebbexme neither.11:50
*** shyamb has joined #openstack-ansible11:58
*** jbadiapa has joined #openstack-ansible12:06
*** rfolco has joined #openstack-ansible12:10
*** MickyMan77 has joined #openstack-ansible12:20
MickyMan77I'm not able to deploy openstack-ansible with ceph-client. I failes during TASK ceph_client : Add OpenStack service to cephkeys_access_group group "The error was: TypeError: getpwnam() argument must be str, not None fatal"12:22
MickyMan77or if i the disable ceph_keyrings_dir: function in user_variables.yml and try to use ssh.12:23
MickyMan77if failes when it try to ssh mon nodes. (not able to lookup host).12:24
ebbexcan we set this to something? https://github.com/openstack/openstack-ansible/blob/stable/ussuri/ansible-role-requirements.yml#L27512:25
MickyMan77does someone have any updated guides to get ceph-client to work with openstack-ansible deployments ?12:26
ebbexand aslo, which repo contains the release-notes for osa?12:27
jrosserrelease notes are aggregated from all roles into the integrated repo iirc12:27
jrosserand as far as the ceph-ansible trackbranch goes, i think thats because they start to put breaking changes on the stable-<N> branches for ceph-ansible so we have to pin to a SHA now12:28
jrosserbeyond that SHA it's all broken12:28
ebbexuffda.12:28
jrosserbroken in the sense that the data we have in group_vars will suddlenly no longer be OK for a later version of the same ceph-ansible stable branch12:29
jrosserwhich is really quite uncool12:29
ebbexi can agree with that.12:29
jrosserMickyMan77: it would help if you could share some more details, maybe at paste.openstack.org of what you're trying to do12:30
jrosserMickyMan77: we run a CI job on every commit that uses OSA + ceph-ansible together, so one of those code paths is checked regularly12:31
jrosserit looks like you are trying to integrate with an external ceph cluster though?12:31
jrosserit's really helpful to know which branch you are using, paste the output from the failing tasks (and a few before) and if possible share the relevant config12:32
MickyMan77jrosser: here you go...   http://paste.openstack.org/show/798986/12:45
recycleherojrosser:  little help here12:51
recycleherohttp://paste.openstack.org/show/798987/12:51
jrosserMickyMan77: the first error you got in the glance container is probably becasue of this setting openstack_service_system_user: null12:51
jrosserrecyclehero: ok, so you can't really write an independant playbook like tht12:52
jrosserthe variables you are trying to print only exist in the scope of executing the os_neutron role12:53
*** shyamb has quit IRC12:53
recycleheroso how can I see if neutron_metering is on/off and also what I should do about the bug12:53
jrosseryou should add a debug: task to somewhere in the os_neutron role, maybe really early on in main.yml12:53
jrosseryou can even follow it directly with a fail: task to make things just stop12:54
jrosserso really it's bug vs. expectations12:54
recycleherook. but your take on it was neutron_metering cant be turned off just by removeing it from neutron_base_plugins ?12:55
jrosseras far as i can see (having looked very briefly yesterday), it should remove it from the list of things to deploy12:56
jrosserbut if it's already deployed from a previous run then it's likley not to be touched12:56
recycleherogot it, thanks.12:57
jrosserif you take metering out of neutron_plugins_base then hopefully it will not be redeployed12:57
jrosserand you could stop/disable the service with systemctl and it shouldnt be restarted if you re-run the os_neutron playbook12:57
jrosserall subject to testing though :)12:58
*** shyamb has joined #openstack-ansible12:58
*** shyamb has quit IRC12:58
recycleherothat sounded like  a legal disclaimer :D12:58
jrosserwell it kind of is12:59
jrossereverything is volunteer effort12:59
recycleherothats the context here. thank for ur efforts. its helps us move forward.13:00
recycleheroI ahve some volume moved from a failed openstack setup to this new one by converting them to qcow2 by qemu-img and uploading to the newly deployed glance.13:02
recycleheronow when I lunch them in the log they try for 120s to get to metadata agents but cant13:03
recycleherothats not a problem with cirros image13:03
recycleheroany idea what could be the cause of that?13:03
recycleheroI can connect to them after the 120s period13:05
jrosserit feels like the metadata service is timing out13:06
recycleherohttp://paste.openstack.org/show/798988/13:16
*** openstackgerrit has quit IRC13:17
recyclehero[HTTPConnectionPool(host='200.200.200.220', port=80): Max retries exceeded with url: /latest/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7fc447fd2cc0>: Failed to establish a new connection: [Errno 111] Connection refused',))]13:18
recycleherothis is the error seen in the log of the instance13:18
recycleherowhy is it calling the ip of the dhcp itself and not 169.254.169.254 which it has a route for?13:19
jamesdentonthere is a fallback mechanism built into cloud-init to fall back to the DHCP server IIRC13:20
jamesdentonwhat happens in your cirros instance if you curl http://169.254.169.254/latest/meta-data ?13:20
recycleherojamesdenton: I will recreate the instance and report back13:22
jamesdentonthx13:22
*** klamath_atx has quit IRC13:23
*** klamath_atx has joined #openstack-ansible13:24
recycleherojamesdenton: a list I guess instance-id, ami-id ....13:28
noonedeadpunkjrosser: what do you think about http://bit.ly/osa-review-board ? (I've just stolen that from barbican folks)13:29
jrossercould be total lifesaver :)13:29
recycleherojamesdenton: I think I shoud do that with the  instance that I have imported from the other enviroment13:29
jrossernoonedeadpunk: the specific question today is "what do we need to merge for the V release"13:30
jrosserthe etherpad has become a bit out of date for that becasue it was the things we needed to fix/merge when the pad was filled out13:31
jrossertheres now a huge pile of stuff from the last two weeks or so13:31
noonedeadpunkI will go through it now13:31
jrosserthats a really useful view13:34
jrossermakes the patch backlog look manageable now rather than just seeming to be gigantic13:34
jrossernoonedeadpunk: gshippey did some more work on the galera backup patch, it might be useful to try it out if you have a similar requirement13:35
jrossersame sort of thing as with the letsencrypt stuff, i think it maybe is requiring actual road-test13:35
recycleherojamesdenton: this time I gave it a key upon lunch and it worked right away. I didnt add a key cause I injected a key upon transferring them and didnt needed one. I  think no key triggered the fail saif machanism in it13:37
jamesdentonwell, the key is only available upon successful connectivity to the metadata service. if the 169 IP isn't available after so many tries, cloud init will try other IPs it knows. This used to work but is now broken (by design)13:39
jamesdentonhttps://bugs.launchpad.net/neutron/+bug/187022813:40
openstackLaunchpad bug 1870228 in neutron "cloud-init metadata fallback broken" [Medium,New]13:40
recycleherojamesdenton: thank u13:42
noonedeadpunk#topic Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/osa-review-board-v113:44
noonedeadpunkTOPIC openstack-ansible Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/osa-review-board-v113:46
recycleherojamesdenton: can u explain what is the purpose of this metadata, I read it but cant fully understand whts it does exactly13:46
noonedeadpunkuh13:46
*** noonedeadpunk[h] has joined #openstack-ansible13:47
*** spatel has joined #openstack-ansible13:47
*** noonedeadpunk[h] has quit IRC13:47
*** openstackgerrit has joined #openstack-ansible13:48
openstackgerritMerged openstack/openstack-ansible-ops master: Update graylog-forwarder to use py3  https://review.opendev.org/75546113:48
jamesdentonmetadata is information about your instance that the instance can then use, including a RSA key that is then used for logging in. The cloud-init service on vm image knows how to reach metadata service and what to pull down. But you can also execute scripts and other cloud-init specific actions13:49
*** cshen has quit IRC13:51
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-plugins master: Move provider_networks module into os_neutron  https://review.opendev.org/65813014:00
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_magnum master: Support docker registry config options  https://review.opendev.org/65264814:01
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: IP addresses in examples were changed  https://review.opendev.org/57293514:07
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Add vars file for ubuntu focal  https://review.opendev.org/75634114:14
*** alvinstarr has joined #openstack-ansible14:15
*** nurdie has joined #openstack-ansible14:15
*** klamath_atx has quit IRC14:20
*** redrobot has quit IRC14:22
*** klamath_atx has joined #openstack-ansible14:23
ebbexjrosser: Could you have a quick peek at this http://paste.openstack.org/show/798993/ , is there any obvious action i might be missing for pci-passthrough?14:23
*** klamath_atx has quit IRC14:25
*** jamesdenton has quit IRC14:31
openstackgerritMerged openstack/openstack-ansible-tests master: Remove support for lxc2 config keys  https://review.opendev.org/75625514:35
*** cshen has joined #openstack-ansible14:36
openstackgerritMerged openstack/openstack-ansible-os_cinder stable/train: Trigger uwsgi restart  https://review.opendev.org/75771314:40
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_nova master: Define condition for the first play host one time  https://review.opendev.org/75633214:40
*** jamesdenton has joined #openstack-ansible14:42
jrosserebbex: you mean it's not working, or just check what you have?14:45
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic master: Define condition for the first play host one time  https://review.opendev.org/75634014:45
jrosserebbex: maybe missing pci stub stuff on the boot parameters, i have  GRUB_CMDLINE_LINUX_DEFAULT="intel_iommu=on modprobe.blacklist=nouveau pci-stub.ids=10de:1eb8,10de:12a2"14:48
jrosseractually jamesdenton already wrote about all this https://www.jimmdenton.com/gpu-offloading-openstack/14:49
noonedeadpunkjrosser: answering question about what to merge for release... I think we're good enough for what we have already pushed, but I think we need to make our roles passing. I'm going to spend some time for fixing manila/murano, which were broken for U...14:50
jrosseryeah, i put a list of whats broken on the etherpad14:50
noonedeadpunkAnd we need to ensure that after merging things, ironic, octavia at least will be also passing14:50
noonedeadpunkas things are unhappy without public vip in tempest14:51
noonedeadpunkmagnum is bad as well...14:51
jrosseryes - i wonder if the haproxy/metal patch is going to help with thtat14:51
jrosserwe maybe discover more tempest plugins with no config for endpoint though14:51
noonedeadpunkfrom what I saw in tempest logs for some of the patches - it was claiming on publicurl, which should help14:52
noonedeadpunkironic broken with tempestconf, which requires public endpoint iirc14:52
noonedeadpunkoctavia is almost happy with https://review.opendev.org/#/c/755737/ except upgrade jobs...14:52
noonedeadpunkyeah, I agree with the list, except I moved senlin to W14:58
noonedeadpunksince we obvoiously won't have needed options for V14:58
jrosserdid we ever merge the patches to make upgrade jobs work properly15:00
jrosseri was wondering if thats why the octavia patch breaks for upgrades15:00
noonedeadpunkI think we did, and they were behaving nicely lately15:00
noonedeadpunkbut they break during tempest...15:00
noonedeadpunkbut upgrade does not do bootstrap-host anyway 2nd time15:01
noonedeadpunkand that's what we need to get updated tempest conf15:01
*** macz_ has joined #openstack-ansible15:04
*** rh-jelabarre has quit IRC15:06
Adri2000hello15:07
Adri2000I wonder if in that patch https://review.opendev.org/#/c/673878/, there was an oversight on designate? i.e. notifications should be enabled if we have ceilometer enabled *or* designate enabled. I've just upgraded to stein and hit this problem (I use designate but don't use ceilometer). mnaser?15:09
openstackgerritMerged openstack/openstack-ansible-os_cinder stable/train: Explicitly enable/disable active/active  https://review.opendev.org/75270415:15
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Add rsync to required packages for redhat based OS  https://review.opendev.org/75665115:15
openstackgerritMerged openstack/openstack-ansible master: IP addresses in examples were changed  https://review.opendev.org/57293515:24
openstackgerritMerged openstack/openstack-ansible master: Add link to configuration example for Ceph configuration from files.  https://review.opendev.org/75579715:24
ebbexjrosser: thanks, there's something not quite working on my part yet, the denton stuff seems like a good read :)15:24
noonedeadpunkjrosser: huh, manila self-repaired....15:26
jrosserthat is the best kind of bugfix15:26
noonedeadpunkjust needed this https://review.opendev.org/#/c/757854/1/tests/roles/bootstrap-host/templates/user_variables_manila.yml.j215:26
jrosserthats good15:27
jrosserwe should probably merge this https://review.opendev.org/#/c/733408/15:27
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/ussuri: Fix focal ceph jobs  https://review.opendev.org/75789615:28
jrossertheres a risk of changing things in all the role metal jobs with that15:28
noonedeadpunkI hope it will just fix everything for us lol15:29
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_adjutant master: Make role fit to the OSA standards  https://review.opendev.org/75631315:40
*** nurdie has quit IRC15:49
*** nurdie has joined #openstack-ansible15:50
*** cshen has quit IRC15:50
openstackgerritMerged openstack/openstack-ansible-os_nova stable/train: Trigger uwsgi restart  https://review.opendev.org/75771415:52
*** gyee has joined #openstack-ansible15:54
openstackgerritAdrien Cunin proposed openstack/openstack-ansible-os_nova master: Enable notifications when Designate is enabled  https://review.opendev.org/75790415:56
Adri2000follow up to my earlier message ^ (cc mnaser)15:57
*** rh-jelabarre has joined #openstack-ansible16:03
noonedeadpunkAdri2000: I'm trying to understand how designate will be reading nova vhost and can't really find way to configure that...16:05
noonedeadpunkhttps://docs.openstack.org/designate/latest/admin/config.html#handler-nova-fixed doesn't contain neither creds for connection nor really vhost or anything actually...16:06
noonedeadpunkAdri2000: and btw the same thing is here https://opendev.org/openstack/openstack-ansible-os_neutron/src/branch/master/templates/neutron.conf.j2#L23316:07
noonedeadpunkAdri2000: to tbh, I'd set another topic for designate as I think then designate will fight with ceilometer for notifications16:08
noonedeadpunkah well, sorry, it;s already there....16:09
noonedeadpunkbut then we need to use notifications topic only when ceilometer is enabled....16:10
noonedeadpunkwell, I'm not rerally sure16:10
noonedeadpunk#startmeeting openstack_ansible_meeting16:11
openstackMeeting started Tue Oct 13 16:11:10 2020 UTC and is due to finish in 60 minutes.  The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot.16:11
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:11
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:11
noonedeadpunk#topic office hours16:11
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:11
*** openstack changes topic to "office hours (Meeting topic: openstack_ansible_meeting)"16:11
MickyMan77jrosser: do you know what user i should use for the setting openstack_service_system_user: XXXX ??16:12
jrosserMickyMan77: i don't think you should set that at all16:12
jrosserthat variable will be set to the appropriate value in the cinder/glance/etc roles as here http://codesearch.openstack.org/?q=openstack_service_system_user16:13
noonedeadpunkso, I don't have really much to discuss I guess this time, as we're moving forward and things continue merging (pretty slowly though)16:14
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Add infra scenario CI jobs  https://review.opendev.org/75644016:15
noonedeadpunkexcept I wanted to share this fancy link to the review board16:16
noonedeadpunk#link http://bit.ly/osa-review-board16:16
jrosseri am liking that a lot16:16
noonedeadpunkit is including non-osa projects at the moment, but I hope I will clean it out16:17
noonedeadpunkYeah, it has at least some structure. not sure how good it works in terms of `2 week without feedback`16:18
noonedeadpunkbut yeah16:18
* jrosser just looks at the galera bump16:19
noonedeadpunkoh, yes, I will test it out for sure as have a use case16:20
ebbexHas anyone looked through https://docs.openstack.org/releasenotes/openstack-ansible/ussuri.html16:20
* noonedeadpunk writes down in todo list16:20
noonedeadpunkebbex: well, I did...16:20
noonedeadpunkwith release team16:20
ebbexit's a bit much, no?16:21
noonedeadpunkand we were unable to figurre out wtf it was...16:21
noonedeadpunkit includes all train and ussuri16:21
ebbexyeah, it seems to have carried stuff all the way from rocky.16:21
noonedeadpunkhttps://storyboard.openstack.org/#!/story/200813916:21
*** rpittau is now known as rpittau|afk16:21
noonedeadpunkthe only workaround I was suggested is to exclude manually every reno that shouldn't be there16:22
noonedeadpunkwhich is....16:22
ebbex21.0.0 requires ceph-ansible 4.0 (but that upgrade would have happened in train right?)16:22
noonedeadpunkand what also we can't do in no way - backport release notes....16:23
noonedeadpunklike we did here https://review.opendev.org/#/c/752704/ :(((16:23
noonedeadpunkit is16:23
noonedeadpunkin 21.0.0 we require 5.016:24
jrosseri am looking at https://review.opendev.org/#/c/75785116:25
jrosserdoesnt that make N^2 tasks for N compute nodes, each one needing the key for all the others?16:26
*** ChosSimbaOne has quit IRC16:27
openstackgerritLogan V proposed openstack/openstack-ansible-os_nova master: Fix for scheduler filters list construction  https://review.opendev.org/75790916:27
noonedeadpunkjrosser: it is:(16:29
*** ChosSimbaOne has joined #openstack-ansible16:29
noonedeadpunkwell, I was trying to find the way how to store authorized keys somewhere, but didn't come up with good solution either...16:30
noonedeadpunkjrosser: what can be done better is to use some var I guess which will collect all keys for all nodes16:31
*** rpittau|afk has quit IRC16:31
jrosseror we do the ssh certs thing16:31
noonedeadpunkI guess it's in terms of https://etherpad.opendev.org/p/osa-certificates-refactor ?16:32
jrosseryeah, if we have a CA there is already an ansible module to create the ssh credential16:34
noonedeadpunkbut ssh certs sounds really good16:34
*** rpittau|afk has joined #openstack-ansible16:34
noonedeadpunkwell ok, let's live with it till W16:36
noonedeadpunkand do certs afterwards16:36
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Add CADF notifications for federated keystone  https://review.opendev.org/74194616:39
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/ansible-config_template master: Missing document start "---"  https://review.opendev.org/73646616:41
*** recyclehero has quit IRC16:53
noonedeadpunk#endmeeting16:54
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://bit.ly/2SAcGAn"16:54
openstackMeeting ended Tue Oct 13 16:54:50 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:54
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2020/openstack_ansible_meeting.2020-10-13-16.11.html16:54
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2020/openstack_ansible_meeting.2020-10-13-16.11.txt16:54
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2020/openstack_ansible_meeting.2020-10-13-16.11.log.html16:54
*** recyclehero has joined #openstack-ansible17:00
recycleherogonna do a backup restore and then nuke the whole thing. if you have any experiment for 21.0.1 hit me.17:04
recycleherogoing to deploy production17:04
* recyclehero excited 17:04
recycleheroguys this is in the docs:17:11
recyclehero# ansible galera_container -m shell -a "mysql -h 127.0.0.1 \17:11
recyclehero-e 'show status like \"%wsrep_cluster_%\";'"17:11
recycleherowhere is the inventory in this command, its for finding a failed node17:12
recycleheroaha galera container should be replaced with the ip of the glarea container. noob17:14
*** miloa has quit IRC17:17
rh-jelabarreanyone watching AnsibleFest breakout sessions and getting a lot of buffering?17:17
*** Guest75569 has joined #openstack-ansible17:21
*** Guest75569 is now known as redrobot17:23
*** vesper11 has joined #openstack-ansible17:25
*** andrewbonney has quit IRC17:28
*** cshen has joined #openstack-ansible17:29
*** cshen has quit IRC17:35
*** cshen has joined #openstack-ansible17:46
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Do not manage /etc/ssl or /etc/pki directories or symlinks  https://review.opendev.org/75409217:48
*** cshen has quit IRC17:51
openstackgerritMerged openstack/openstack-ansible-os_heat stable/ussuri: Trigger uwsgi restart  https://review.opendev.org/75772218:01
openstackgerritMerged openstack/openstack-ansible-os_heat stable/train: Trigger uwsgi restart  https://review.opendev.org/75772118:01
*** sshnaidm is now known as sshnaidm|afk18:24
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_neutron master: Enable notifications when Designate is enabled  https://review.opendev.org/75793719:08
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_neutron master: Enable notifications when Designate is enabled  https://review.opendev.org/75793719:10
MickyMan77jrosser: I have solve the first issue, now I get this error msg... TabError: inconsistent use of tabs and spaces in indentation  --> http://paste.openstack.org/show/799008/19:24
jrosserMickyMan77: which release of OSA is this?19:25
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Added Openstack Adjutant role deployment  https://review.opendev.org/75631019:26
MickyMan77Git tag 21.0.119:26
noonedeadpunko_O19:26
noonedeadpunkoh well19:27
noonedeadpunkMickyMan77: rename/remove /root/rbd.py19:27
jrosserhow does that even exist/19:28
jrosser?19:28
*** gshippey has quit IRC19:28
noonedeadpunkcorner case ¯\(◉◡◔)/¯19:28
MickyMan77# locate rbd.py19:28
MickyMan77# /usr/local/lib/python3.6/site-packages/rbd.py19:28
noonedeadpunkwell, I think MickyMan77has created some script in root which is named rbd.py, and eventually it got imported instead of real rbd library19:28
MickyMan77I dont have anyting in root19:29
noonedeadpunkMickyMan77: on controller?19:29
MickyMan77I check19:29
MickyMan77aha...19:29
MickyMan77it's i file there.19:29
noonedeadpunktoday I was really about to do the same :p19:30
noonedeadpunkmaybe we should chdir to /tmp or dunno19:30
MickyMan77i run the deployments again now... lets see if it will work now.. :)19:31
recycleheroIf I want to test DR scenario wuth a 1 node galera deployment. for the backup I should just do a mariadb full backup?19:35
*** cshen has joined #openstack-ansible19:47
recycleheroas mentioned in https://docs.openstack.org/openstack-ansible/ussuri/admin/backup-restore.html19:50
recyclehero/etc/openstack_deploy contains a live inventory19:50
recycleherosay one of the physical hosts die, and I am going to change it with another physical host with diffrent spec19:51
*** cshen has quit IRC19:51
recycleherowhat should one do with the gatherd ansible_facts19:51
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Added Openstack Adjutant role deployment  https://review.opendev.org/75631019:54
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_adjutant master: Make role fit to the OSA standards  https://review.opendev.org/75631319:56
openstackgerritMerged openstack/openstack-ansible-os_placement stable/ussuri: Trigger service restart  https://review.opendev.org/75771020:01
jrosserrecyclehero: the facts in /etc/openstack-deploy can be deleted should it be needed20:07
jrosserit's just a cache20:08
recycleherogreat. I just read about that. jrosser when I am assigning variables in user_variables for variables with hierarchies like nova_virt_type If I want to only change the bottom one I should change all other variables too?20:10
recycleheroI changed nova_reserverd_host_memory_mb and the playbook was complaing about not defined nova_compute_driver20:10
recycleherohttps://docs.openstack.org/openstack-ansible-os_nova/latest/20:10
jrosseri don't think you need to touch nova_virt_types at all, theres a comment above which explains20:15
jrosserdepending on nova_virt_type, one set of values out of nova_virt_types is set as ansible facts during the run20:16
jrosserthose facts are then used in the template for the config file https://opendev.org/openstack/openstack-ansible-os_nova/src/branch/master/templates/nova.conf.j2#L1520:17
jrosseransible has a variable precedence https://docs.ansible.com/ansible/latest/user_guide/playbooks_variables.html#ansible-variable-precedence20:18
jrosserextra vars (anything you put in user_variables.yml) is the highest precedence, so will override any previously set fact for nova_reserverd_host_memory_mb20:19
jrosserso just setting nova_reserverd_host_memory_mb: <value> in user_variables.yml will hopefully do what you need20:19
*** jbadiapa has quit IRC20:20
recycleherojrosser: I just put nova_virt_type cuz I thought nova_reserved_host_memory_db alone wihtout it parents doesnt make sense20:47
jrosseryeah, understood20:48
jrosserultimately the thing you will be overrding is whatever is used in the template20:48
recycleheronova_cpu_allocation_ratio: 2.0, If I want to use placement api later I should override these. but when I set these to 'none' I will get runtime error that it couldnt convert string to float20:49
jrosserand those precendence rules i linked can be useful when deciding if to put things in group/host vars or user_variables20:49
jrossernot sure i follow - placement is mandatory now i think20:50
recycleherolink with #ID20:51
recycleherohttps://docs.openstack.org/nova/ussuri/admin/configuration/schedulers.html#usage-scenarios20:51
recycleheroI want to be able to set allocation ratios not as hardcoded but with apis. I think they way OSA default variables sets it take that option out of picture20:52
recycleheroI want to scenario #220:53
recycleheromaybe I could omit them from os_nova/defaults20:56
recycleheroor define them in user_variables with no value20:57
recyclehero?20:57
recycleherojrosser: I read the link. for overridng nova_virt_type['kvm']['nova_reserverd_host_memory_mb'] in user_variables I should just write nova_reserved_host_memory_mb?21:12
*** rfolco has quit IRC21:12
jrosseryes but do understand that it's not the inner variable in that dict you are actually overriding21:13
*** rfolco has joined #openstack-ansible21:14
jrosserit's an ansible fact of the same name set to the value of that inner variable, by virtue of the virt_type being kvm21:14
jrosserwhat you are overriding is the variable used in the template21:15
jrosserwhen you tried to override nova_cpu_allocation_ratio, did you use none or 'none'21:16
recyclehero'None' :D21:18
jrosserintersting21:19
recycleheroso which one should I use?21:19
recycleheroor u think I shoud use21:19
recycleherocause for now leaving them empty and doing successful api call to placement actually doesnt change the vcpus in horizon dashboard21:20
jrosserif you get a runtime error then thats really a nova issue i guess, would have to look at the code21:21
jrosserpython None is not the same as a string containing 'None' so i wonder if thats even possible via the config file21:21
recycleherowhat if i delete them from default/main21:22
recycleheroits like they never existed21:22
jrosserno, the template will still try to put them in the file21:22
recyclehero#cpu_allocation_ratio = <None>21:22
recycleherothis is from https://docs.openstack.org/nova/latest/configuration/sample-config.html21:23
jrosserthis is the thing here https://github.com/openstack/nova/blob/a4068802ef2eca5568a58b8f961a521a3a3ddcb5/nova/conf/compute.py#L42221:25
jrosserthe nova code wants you to supply a float21:25
*** yann-kaelig has quit IRC21:26
jrosserand if you don't supply anything the value is None <- that is not a string21:26
recycleheroyou mean like  "nova_cpu_allocation_ration: "21:27
*** spatel has quit IRC21:27
jrosserno, if the option is not present21:28
jrosserif it is present it has to be a float21:28
jrosserit's an ini format file key=value21:28
jrosseranyway, its late here, enough for today21:29
recycleherook have a good night21:30
MickyMan77jrosser: some update for you... "Starting cinder-volume cluster ceph@ceph-ssd (version 16.1.1)"21:30
MickyMan77first node is working... :)21:30
MickyMan77thx for you input..21:31
jrosserno problem - glad it is fixed!21:31
*** cshen has joined #openstack-ansible21:47
*** cshen has quit IRC21:51
*** rfolco has quit IRC22:10
*** rfolco has joined #openstack-ansible22:53
*** macz_ has quit IRC23:06
*** rfolco has quit IRC23:13
*** nurdie has quit IRC23:18
*** jamesdenton has quit IRC23:20
*** jamesdenton has joined #openstack-ansible23:20
*** zigo has quit IRC23:23
*** mgariepy has quit IRC23:24
*** watersj has joined #openstack-ansible23:32
*** pmannidi has quit IRC23:33
*** cshen has joined #openstack-ansible23:33
*** pmannidi has joined #openstack-ansible23:33
*** mgariepy has joined #openstack-ansible23:34
*** cshen has quit IRC23:37
*** MickyMan77 has quit IRC23:38
*** MickyMan77 has joined #openstack-ansible23:38
*** tosky has quit IRC23:40
*** rfolco has joined #openstack-ansible23:41
*** MickyMan77 has quit IRC23:47
*** nurdie has joined #openstack-ansible23:52
*** nurdie has quit IRC23:56

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!