| *** mmercer has joined #openstack-ansible | 00:52 | |
| *** openstackgerrit has joined #openstack-ansible | 01:11 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Add port to transport_url database template https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/791038 | 01:11 |
|---|---|---|
| *** gyee has quit IRC | 01:17 | |
| *** spatel_ has joined #openstack-ansible | 01:18 | |
| *** spatel_ is now known as spatel | 01:18 | |
| openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: Modernise TLS configuration https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/789789 | 01:54 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: Update mariadb version to 10.5.10 https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/790329 | 02:07 |
| *** spatel has quit IRC | 02:18 | |
| *** evrardjp has quit IRC | 02:33 | |
| *** evrardjp has joined #openstack-ansible | 02:33 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Split keepalived liveness checks for internal/external networks https://review.opendev.org/c/openstack/openstack-ansible/+/782374 | 02:58 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_neutron master: Use ansible_facts[] instead of fact variables https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/777650 | 05:36 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_nova master: Add variables for rabbitmq ssl configuration https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/790037 | 05:39 |
| *** snapdeal has joined #openstack-ansible | 06:34 | |
| *** zbr has quit IRC | 06:49 | |
| *** zbr has joined #openstack-ansible | 06:51 | |
| *** andrewbonney has joined #openstack-ansible | 07:25 | |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_adjutant master: Install mysql client libraries https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/777607 | 07:41 |
| *** ChipOManiac has joined #openstack-ansible | 07:45 | |
| *** tosky has joined #openstack-ansible | 07:47 | |
| jrosser | bbcrd | 07:59 |
| noonedeadpunk | mornings ;) | 07:59 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/train: Prepare Train to EM https://review.opendev.org/c/openstack/openstack-ansible/+/790655 | 07:59 |
| jrosser | hello± | 08:01 |
| ChipOManiac | morning | 08:01 |
| jrosser | oh my, not in control of my keyboard this morning :) | 08:01 |
| ChipOManiac | jrosser Was wondering what that +/- was. '=D | 08:02 |
| ChipOManiac | noonedeadpunk So I upgraded the whole of our PoC to Victoria. But Masakari isn't working as expected still. :( | 08:06 |
| noonedeadpunk | if it's in regards to instancemonitor - https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/790558 has not been released yet | 08:09 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: Remove references to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/779740 | 08:09 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: Use ansible_facts[] instead of fact variables https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/780649 | 08:10 |
| ChipOManiac | noonedeadpunk Oy vey. Should a simulation of loss of networking (i.e. ifdown of management and storage) trigger an evac of instances on the node being downed? | 08:13 |
| noonedeadpunk | it should trigger evacuate every time when pacemaker cluster loose member | 08:15 |
| noonedeadpunk | another part is that nova should mark service as "down" as well, otherwise it won't allow evacuate | 08:16 |
| ChipOManiac | Odd, pacemaker/corosync does register a down of the member, but the instance never gets evac'd. | 08:16 |
| noonedeadpunk | and name of the node in the pacemaker cluster should exact;y match the name of service in nova | 08:17 |
| ChipOManiac | I've fixed the name discrepancy problem in the role manually by changing the template, so I guess that's done. | 08:17 |
| ChipOManiac | Should the ifdown cause the nova service to be marked as down? | 08:18 |
| noonedeadpunk | it's marks as down if it doesn't see messages from nova-compute for 60 seconds or smth like that. so yes, network interruption should cause nova to set service down | 08:19 |
| noonedeadpunk | worth checking masakari monitor and masakari engine logs though | 08:19 |
| ChipOManiac | hostmonitor def shows the downed node as offline. | 08:20 |
| noonedeadpunk | then it should create notification in masakari db via api that should be processed by the engine | 08:20 |
| ChipOManiac | We are using LINSTOR as the storage backend, but there's not even an attempt to evac the instance. | 08:20 |
| noonedeadpunk | oh, well, name of node in masakari segment should also equal to the one set in cluster | 08:21 |
| ChipOManiac | They equal. | 08:22 |
| noonedeadpunk | just saying | 08:22 |
| noonedeadpunk | and what;s in engine logs? Does notification even being created? | 08:23 |
| noonedeadpunk | Or monitors fail to create one? | 08:23 |
| ChipOManiac | Matter of fact yes. They send out a notify for instancemonitor, can recall the same for a host down. | 08:23 |
| openstackgerrit | Merged openstack/ansible-role-pki master: Create CA and server certificates https://review.opendev.org/c/openstack/ansible-role-pki/+/788021 | 09:00 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Gather minimal facts in CI https://review.opendev.org/c/openstack/openstack-ansible/+/790042 | 09:03 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron master: Change task ordering to perform smooth upgrades https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/788501 | 09:07 |
| *** macz_ has joined #openstack-ansible | 09:08 | |
| *** macz_ has quit IRC | 09:13 | |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_senlin master: DNM - test patch for senlin tempest testing https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/754045 | 09:32 |
| *** snapdeal has quit IRC | 09:33 | |
| jrosser | noonedeadpunk: andrewbonney correctly points out that [oslo_messaging_notifications] does not have it's own settings for ssl | 09:38 |
| jrosser | they are in [oslo_messaging_rabbit], which makes things kind of tricky as we seperate out the settings in defaults/main.yml for rpc and notifications | 09:39 |
| ChipOManiac | noonedeadpunk Yeah, masakari-hostmonitor does throw a notification that the host is down. | 09:45 |
| noonedeadpunk | jrosser: well, looking at oslo code we don't really have much choice here I think... | 09:49 |
| jrosser | i was wondering if our split of these vars rpc/notify is even valid | 09:50 |
| noonedeadpunk | other then make a requirement for notifications and rpc to be covered with SSL issued by same CA | 09:50 |
| jrosser | or if it should be more like nova_oslomsg_rabbitmq_use_ssl | 09:50 |
| jrosser | well thats the thing, is it ever possible to specify different CA for rpc/notify? given that there is only one set if vars in the config | 09:51 |
| noonedeadpunk | well, I think it is, since for trove I used separate rabbit for rpc and common for notification | 09:51 |
| noonedeadpunk | and before that we used isolated rabbit for all services, but common for notification iirc | 09:52 |
| noonedeadpunk | I don't see how that can be possible. | 09:52 |
| jrosser | when i look at the config i only see the settings for oslo_messaging_rabbit, like here https://zuul.opendev.org/t/openstack/build/e936500f8e5942b0ba7f03567d4b7960/log/logs/host/nova-conductor.service.journal-16-43-20.log.txt#796-800 | 09:52 |
| noonedeadpunk | I really thought about specifying everything in query and leave oslo_messaging_rabbit but I have no idea if that will work | 09:54 |
| noonedeadpunk | oslo_messaging_notifications have pretty limited amount of options https://docs.openstack.org/nova/latest/configuration/config.html#oslo-messaging-notifications | 09:55 |
| noonedeadpunk | I also wonder if we do correct thing nowadays with ha queues in regard to https://opendev.org/openstack/oslo.messaging/src/branch/master/oslo_messaging/_drivers/impl_rabbit.py#L140-L151 | 09:57 |
| noonedeadpunk | I guess yes? | 09:57 |
| jrosser | i wonder if we should ask hberaud for some advice | 09:59 |
| * jrosser meetings | 09:59 | |
| noonedeadpunk | well, url and ssl options are separate for sure , so seems like we can't just add to query https://opendev.org/openstack/oslo.messaging/src/branch/master/oslo_messaging/_drivers/impl_rabbit.py#L590 | 10:00 |
| noonedeadpunk | so from what I see, I think we _must_ have same tls_version and ca for both notifications and rpc servers | 10:01 |
| noonedeadpunk | and that's smth we can't separate | 10:01 |
| noonedeadpunk | the most annoying would be ssl_cert_file and ssl_key_file | 10:02 |
| noonedeadpunk | well, it actually makes sense only when separating rpc with notifications between amqp and rabbit, but not between 2 rabbits | 10:03 |
| noonedeadpunk | feels like oslo not designed that way atm | 10:03 |
| *** ChipOManiac has quit IRC | 10:06 | |
| *** ChipOManiac has joined #openstack-ansible | 10:14 | |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Adjust openstack_distrib_code_name https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/774624 | 10:24 |
| *** djhankb has quit IRC | 10:25 | |
| *** ChipOManiac has quit IRC | 10:40 | |
| jrosser | noonedeadpunk: do you think i should change the vars to be like nova_oslomsq_rabbitmq_<...> ? | 10:49 |
| noonedeadpunk | regarding ssl_version and ssl_cafile? Yeah I think it makes sense | 10:53 |
| jrosser | and then how about the ssl = true | 10:53 |
| jrosser | because there is one place in oslo_messaging_rabbitmq for that | 10:53 |
| noonedeadpunk | well, it's also part of the query | 10:54 |
| jrosser | for nova yes | 10:54 |
| noonedeadpunk | but I'm already not really sure that it's super valid... | 10:54 |
| jrosser | but not in my other patches, but i can change tht | 10:54 |
| jrosser | no, i'm not sure either | 10:54 |
| noonedeadpunk | do you have any working env to check if ssl in query makes any difference? | 10:55 |
| noonedeadpunk | (I've broke all mines trying to downgrade libvirt) | 10:55 |
| jrosser | oh well yes actually i have enough of an AIO here to see if nova is / is not happy | 10:55 |
| jrosser | but it's also like nova is some special case too | 10:56 |
| noonedeadpunk | just if ssl in query works, maybe worth leaving it there? | 10:56 |
| jrosser | yes | 10:58 |
| jrosser | maybe making the smallest change now is best, just get the TLS version correct and worry about the other things laer | 10:58 |
| noonedeadpunk | yeah, was thinking about the same | 10:59 |
| noonedeadpunk | oh, well, have aio with cinder to check that :) | 10:59 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts stable/train: Add custom user-agent for git clones from opendev.org https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/789546 | 11:00 |
| noonedeadpunk | hm, btw spawning 2 aio right now, and both failed on cinder db sync http://paste.openstack.org/show/805348/ | 11:01 |
| openstackgerrit | Merged openstack/openstack-ansible stable/victoria: Increase backend_fall value for haproxy_letsencrypt_service https://review.opendev.org/c/openstack/openstack-ansible/+/790158 | 11:02 |
| *** macz_ has joined #openstack-ansible | 11:09 | |
| jrosser | yes, i've seen a few CI jobs all breaking on setup in cinder | 11:12 |
| *** macz_ has quit IRC | 11:13 | |
| noonedeadpunk | that's kind of super weird. looks like database is filled in with service before db sync is launched | 11:14 |
| noonedeadpunk | as I've dropped database and db sync just worked afterwards | 11:15 |
| noonedeadpunk | (oh, and stopped scheduler) | 11:15 |
| noonedeadpunk | ok, ssl in query works | 11:19 |
| noonedeadpunk | well, worth testing if maybe we can also provide there tls_version and ca cert as well. As that would be perfect, since we won't need to have oslo_messaging_rabbit | 11:20 |
| openstackgerrit | Merged openstack/openstack-ansible stable/victoria: Bump SHAs for stable/victoria https://review.opendev.org/c/openstack/openstack-ansible/+/790360 | 11:20 |
| noonedeadpunk | yep, seems like it works | 11:22 |
| noonedeadpunk | so setting `rabbit://cinder:2ce00c040a8f462c2d90549479@172.29.236.100:5671//cinder?ssl=1&ssl_version=TLSv1_1` gives me TLSV1_ALERT_PROTOCOL_VERSION | 11:26 |
| noonedeadpunk | jrosser: do you thin kwe can go that way& | 11:27 |
| noonedeadpunk | ? | 11:27 |
| noonedeadpunk | and query has prescedence over [oslo_messaging_rabbit] just n case | 11:30 |
| noonedeadpunk | as while having `ssl = False` there, ssl=1 in query makes it use ssl | 11:31 |
| jrosser | i'll take a look | 11:38 |
| jrosser | i wonder if somewhere in cinder it goes "oh no database" and makes it at startup | 11:38 |
| jrosser | so kind of race condition in our stuff with that vs. the db setup task | 11:39 |
| noonedeadpunk | Yeah, I was thinking about the same actually | 11:40 |
| openstackgerrit | Merged openstack/openstack-ansible stable/ussuri: Bump SHAs for stable/ussuri https://review.opendev.org/c/openstack/openstack-ansible/+/790358 | 11:40 |
| noonedeadpunk | I think the issue is that we start services right after creating with systmd role | 11:40 |
| noonedeadpunk | and do db sync later on | 11:41 |
| jrosser | maybe we should drop the services as disabled | 11:41 |
| jrosser | then use a handler to enable / restart as needed | 11:41 |
| jrosser | there is also heaps of bad logging due that as the config is also missing first time | 11:42 |
| *** jhesketh has quit IRC | 11:43 | |
| noonedeadpunk | well I think it should be enabled, but probably not started... | 11:43 |
| noonedeadpunk | probably we can add some bool key for condition of https://opendev.org/openstack/ansible-role-systemd_service/src/branch/master/tasks/main.yml#L162 | 11:44 |
| noonedeadpunk | well, looking at handlers, we can probably just pass state: stopped | 11:46 |
| noonedeadpunk | but that is not good either actually | 11:46 |
| jrosser | though the thing is you don't want to stop the service if you adjust the config file | 11:46 |
| noonedeadpunk | yeah | 11:46 |
| noonedeadpunk | can we just omit state? | 11:47 |
| noonedeadpunk | seems no default https://docs.ansible.com/ansible/latest/collections/ansible/builtin/systemd_module.html | 11:47 |
| noonedeadpunk | se eventually we shouldn't pass state from roles | 11:48 |
| jrosser | `At least one of state and enabled are required.` | 11:48 |
| noonedeadpunk | they could put this against state as well.... | 11:49 |
| noonedeadpunk | well, then we can just add another bool and use it as condition for the task... | 11:49 |
| jrosser | so maybe if we just don't specify, we get enabled but not started | 11:50 |
| noonedeadpunk | I think we don't provide state atm | 11:50 |
| noonedeadpunk | ie we don't have it in cinder_services | 11:51 |
| noonedeadpunk | and don't add it for filtered_cinder_services | 11:52 |
| jrosser | and in nova_services we never use enabled or state | 11:53 |
| jrosser | so maybe that task should be when: item.state is defined or item.enabled is defined | 11:53 |
| jrosser | becasue the only point to calling the systemd module at that point is to either change the state/enabled | 11:54 |
| noonedeadpunk | I think it make sense | 11:54 |
| noonedeadpunk | worth to be careful though, as I can expect some services to have either enabled or state | 11:55 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [DNM] Add Debian Bullseye support https://review.opendev.org/c/openstack/openstack-ansible/+/783606 | 12:13 |
| *** jhesketh has joined #openstack-ansible | 12:21 | |
| *** shyamb has joined #openstack-ansible | 12:25 | |
| noonedeadpunk | I think we should also drop other jobs now not to waste resources | 12:28 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: [DNM] Add Debian Bullseye support https://review.opendev.org/c/openstack/openstack-ansible/+/783606 | 12:32 |
| noonedeadpunk | centos in manila fails due to oom... pretty sure as can't reproduce in aio with 12gb of ram | 12:34 |
| jrosser | we need to cut a branch though first before dropping distro? | 12:38 |
| noonedeadpunk | um, yes | 12:41 |
| noonedeadpunk | do you mean drop bionic,stream? | 12:41 |
| noonedeadpunk | s/,/&/ | 12:41 |
| *** shyamb has quit IRC | 12:45 | |
| jrosser | yes to drop bionic/old centos we need to branch (or at least have the commit that will be the branch?( | 12:46 |
| noonedeadpunk | we need to branch roles I think at least | 12:47 |
| noonedeadpunk | and then yeah, have a commit which will be rc, based on which we branch integrated repo | 12:50 |
| *** spatel_ has joined #openstack-ansible | 13:03 | |
| *** spatel_ is now known as spatel | 13:03 | |
| *** macz_ has joined #openstack-ansible | 13:10 | |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Decrease manila tempest coverage https://review.opendev.org/c/openstack/openstack-ansible/+/791202 | 13:10 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_manila master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_manila/+/782244 | 13:11 |
| *** macz_ has quit IRC | 13:15 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [DNM] Add Debian Bullseye support https://review.opendev.org/c/openstack/openstack-ansible/+/783606 | 13:15 |
| noonedeadpunk | would be greate to get reviews on https://review.opendev.org/c/openstack/openstack-ansible/+/790655 | 13:18 |
| noonedeadpunk | oh this is another huge and scary thing that would be good to land I guess https://review.opendev.org/c/openstack/openstack-ansible/+/769974 maybe worth merging after release though | 13:36 |
| jrosser | i finally proved that ssl_ca_file in the transport URL does work | 13:45 |
| jrosser | if you give it an incorrect CA there then things break with [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed | 13:46 |
| noonedeadpunk | yeah, I checked ssl_version and ssl | 13:48 |
| noonedeadpunk | works as well and have prescedence over oslo_messaging_rabbit | 13:48 |
| jrosser | it's not necessary to urlencode the path to the file | 13:48 |
| noonedeadpunk | (wrote about that previously) | 13:48 |
| jrosser | well it's even worse then urlencode really, but it seems '/' is allowed in the query parameters | 13:49 |
| noonedeadpunk | so I think we jsut drop oslo_messaging_rabbit completely? | 13:49 |
| jrosser | yeah, the transport_url expression is kind of nasty now but maybe thats something to address in the future to make it more manageable | 13:50 |
| noonedeadpunk | I found super nasty chicken/egg we have with gnocchi and swift | 13:50 |
| noonedeadpunk | and the worst part is that I have no idea if the config we set for swift is valid or not... | 13:51 |
| noonedeadpunk | specifically https://opendev.org/openstack/openstack-ansible-os_swift/src/branch/master/templates/proxy-server.conf.j2#L173-L175 | 13:51 |
| noonedeadpunk | it feels that fi;ters should be in api-paste? | 13:52 |
| *** spatel has quit IRC | 13:52 | |
| *** pcaruana has quit IRC | 13:54 | |
| jrosser | thats what i'd expect to find | 13:54 |
| jrosser | btw does this look wrong https://github.com/openstack/openstack-ansible-openstack_hosts/blob/master/vars/debian.yml#L54 | 13:54 |
| jrosser | i.e python3-virtualenv is all we need | 13:54 |
| noonedeadpunk | yeah... | 13:55 |
| jrosser | thats the first failure for bullseye now it's getting through bootstrap-ansible | 13:55 |
| noonedeadpunk | I think it would be a challenge to include vars based on the distro name/ distro id | 13:56 |
| *** spatel has joined #openstack-ansible | 13:56 | |
| jrosser | i think we can have debian-11.yml wherever we need it | 13:57 |
| jrosser | but this looks really like a bug instead | 13:57 |
| noonedeadpunk | I totally don't understand wtf we're doing with gnocchi/swift integration..... | 13:58 |
| noonedeadpunk | why do we need this https://opendev.org/openstack/openstack-ansible-os_gnocchi/src/branch/master/defaults/main.yml#L104 | 13:59 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Only install python3 virtualenv package https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/791242 | 13:59 |
| noonedeadpunk | Logical anwer would be - to avoid metering of gnochhi itself and prevent looping | 13:59 |
| noonedeadpunk | but.... in ceilometer middleware there's https://opendev.org/openstack/ceilometermiddleware/src/branch/master/ceilometermiddleware/swift.py#L158 | 14:00 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [DNM] Add Debian Bullseye support https://review.opendev.org/c/openstack/openstack-ansible/+/783606 | 14:00 |
| *** pcaruana has joined #openstack-ansible | 14:00 | |
| jrosser | not sure this is even helping to explain https://github.com/openstack/openstack-ansible-os_gnocchi/commit/e783edaa4598b50ad34ac737774821cd762181b9 | 14:03 |
| noonedeadpunk | worth going even before that.... | 14:05 |
| jrosser | https://github.com/openstack/openstack-ansible-os_gnocchi/commit/b0e2399d83d222449eaaa47a1bd61360e37fd6b0 | 14:06 |
| jrosser | ^ that patch deleted the helpful explaination | 14:06 |
| noonedeadpunk | even worse lol | 14:06 |
| jrosser | sounds like there is some feedback loop that probably generates infinite traffic unless you block it metering itself | 14:07 |
| noonedeadpunk | The thing is that filter_service_activity is not a thing nowadays in ceilometer | 14:08 |
| noonedeadpunk | and also, ceilometer middleware prevents that for service project by default | 14:08 |
| jrosser | i wonder if the ceilometer middleware stuff actually is newer code that what we see in the gnocchi role | 14:09 |
| jrosser | perhaps we have legacy workarounds for things that are now not an issue | 14:09 |
| noonedeadpunk | so eventually we either taking ignore_projects from swift conf or just ignoring `service` by default https://opendev.org/openstack/ceilometermiddleware/src/branch/master/ceilometermiddleware/swift.py#L209-L212 | 14:11 |
| noonedeadpunk | so I think we can get rid of that complexity nowadays? | 14:11 |
| noonedeadpunk | but I'm super bad in swift.... literally never used it... | 14:11 |
| jrosser | it looks like in the past ignore_project could only be UUID | 14:15 |
| jrosser | and that was probably totally difficult to do in the ansible | 14:15 |
| jrosser | i've never used swift either | 14:16 |
| noonedeadpunk | yeah. now it can be also name, but generally feels like we don't need it at all... | 14:16 |
| noonedeadpunk | a bit afraid of breaking things during upgrade thouhg | 14:17 |
| noonedeadpunk | well, it's been like that for quite a while https://opendev.org/openstack/ceilometermiddleware/commit/e2bf485044d8f3743da9298a9e461c5808be31f3 | 14:27 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_swift master: Do not collect gnocchi project ID https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/791250 | 14:34 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_swift master: Do not collect gnocchi project ID https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/791250 | 14:35 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_glance master: Add variables for rabbitmq ssl configuration https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/790006 | 14:37 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: Add variables for rabbitmq ssl configuration https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/790034 | 14:38 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_cinder master: Add variables for rabbitmq ssl configuration https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/790035 | 14:39 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_swift master: Do not collect gnocchi project ID https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/791250 | 14:40 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [DNM] Add Debian Bullseye support https://review.opendev.org/c/openstack/openstack-ansible/+/783606 | 14:40 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_neutron master: Add variables for rabbitmq ssl configuration https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/790036 | 14:41 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_nova master: Add variables for rabbitmq ssl configuration https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/790037 | 14:47 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_gnocchi master: Switch gnocchi service name to service https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/791254 | 14:48 |
| *** macz_ has joined #openstack-ansible | 14:53 | |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_ceilometer master: Remove deprecated options from config https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/791259 | 14:59 |
| *** sshnaidm is now known as sshnaidm|afk | 15:00 | |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Change order of swift and gnocchi installation https://review.opendev.org/c/openstack/openstack-ansible/+/791261 | 15:02 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Cleanup after service variables merged https://review.opendev.org/c/openstack/openstack-ansible/+/769974 | 15:05 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-haproxy_server master: Use http-request set-header instead of reqadd https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/791264 | 15:18 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [DNM] Add Debian Bullseye support https://review.opendev.org/c/openstack/openstack-ansible/+/783606 | 15:18 |
| *** gyee has joined #openstack-ansible | 15:21 | |
| *** NewJorg has quit IRC | 15:21 | |
| *** NewJorg has joined #openstack-ansible | 15:22 | |
| jrosser | looks like we have a few repos with vars/debian-10.yml | 15:43 |
| jrosser | those will need fixing | 15:43 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Add option to remove group from inventory https://review.opendev.org/c/openstack/openstack-ansible/+/791277 | 15:50 |
| noonedeadpunk | jrosser: just firing question without any research - does this format supported by haproxy 1.*? https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/791264/1/templates/service.j2#79 | 15:51 |
| jrosser | hmm right and no mariadb repo for bullseye | 15:51 |
| jrosser | noonedeadpunk: well, without testing it *at all* i used what was here https://www.haproxy.com/blog/redirect-http-to-https-with-haproxy/ | 15:52 |
| noonedeadpunk | then let's see how bionic will like that :) | 15:53 |
| noonedeadpunk | I htink we have option to use native repo for mariadb? | 15:53 |
| jrosser | 2.1 failed with reqadd | 15:53 |
| noonedeadpunk | as bullseye has 10.5.9 | 15:53 |
| noonedeadpunk | https://packages.debian.org/bullseye/mariadb-server | 15:53 |
| jrosser | so my hope is that the older version supports both | 15:54 |
| noonedeadpunk | which is broken for root user, but we don't have upgrades kind of :) | 15:54 |
| jrosser | yes, we can do native repo, which i think we already do for maybe centos? | 15:54 |
| jrosser | or for something? | 15:54 |
| noonedeadpunk | um, I think we don't atm | 15:54 |
| noonedeadpunk | I think I'm mixing with rabbit actually | 15:55 |
| jrosser | well this rabbitmq stuff has scrambled my head so i'm not sure on anything anymore :) | 15:55 |
| noonedeadpunk | as I don't see bits that allow to avoid repo installation | 15:55 |
| noonedeadpunk | should be trivial to add actually | 15:57 |
| noonedeadpunk | we can move that to block https://opendev.org/openstack/openstack-ansible-galera_server/src/branch/master/tasks/galera_install_apt.yml#L21-L52 | 15:57 |
| noonedeadpunk | ok, plenty o jobs started failing on cinder. I guess this might be related to recently merged bump... | 16:03 |
| noonedeadpunk | oh, wait, we haven't merged it... | 16:04 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-galera_server master: Add support for Debian Bullseye https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/791280 | 16:06 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-haproxy_server master: Use http-request set-header instead of reqadd https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/791264 | 16:09 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [DNM] Add Debian Bullseye support https://review.opendev.org/c/openstack/openstack-ansible/+/783606 | 16:11 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_adjutant master: Install mysql client libraries https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/777607 | 16:37 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-rsyslog_client master: Add support for debian bullseye https://review.opendev.org/c/openstack/openstack-ansible-rsyslog_client/+/791288 | 16:46 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Add option to remove group from inventory https://review.opendev.org/c/openstack/openstack-ansible/+/791277 | 16:49 |
| noonedeadpunk | regarding cinder - it's not race condition... | 16:49 |
| openstackgerrit | Jonathan Rosser proposed openstack/ansible-role-uwsgi master: Add support for debian bullseye https://review.opendev.org/c/openstack/ansible-role-uwsgi/+/791290 | 16:50 |
| jrosser | oh interesting | 16:50 |
| jrosser | did we break something? | 16:50 |
| noonedeadpunk | http://paste.openstack.org/show/805359/ | 16:50 |
| noonedeadpunk | I think it's actually cinder is broken imo... | 16:50 |
| noonedeadpunk | if I re-run sync it ends up even worse http://paste.openstack.org/show/805360/ | 16:51 |
| jrosser | do you ask the cinder people yet? | 16:51 |
| noonedeadpunk | Wonder if this has smth to do with https://review.opendev.org/c/openstack/cinder/+/790796 | 16:51 |
| noonedeadpunk | yes, but it's super quiet there | 16:52 |
| *** dwilde has joined #openstack-ansible | 16:52 | |
| jrosser | we should be pinned back though on "master" to wallaby-ish services? | 16:52 |
| noonedeadpunk | yep, I think we should use W | 16:53 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master https://review.opendev.org/c/openstack/openstack-ansible/+/790357 | 16:56 |
| noonedeadpunk | just decided to try current W HEAD | 16:57 |
| *** dwilde has quit IRC | 16:58 | |
| noonedeadpunk | well, I wonder if it couldn't be maria 10.5.10 | 17:02 |
| noonedeadpunk | as error is interminent | 17:03 |
| noonedeadpunk | hm | 17:07 |
| noonedeadpunk | `[Warning] WSREP: Ignoring error 'Unknown column '`cinder`.`consistencygroups_1`.`deleted`' in 'CHECK'' on query. Default database: 'cinder'. Query: 'ALTER TABLE consistencygroups CONVERT TO CHARACTER SET utf8', Error_code: 1054` | 17:07 |
| noonedeadpunk | looks like just regular notification about error | 17:08 |
| noonedeadpunk | (it's from maria journal) | 17:09 |
| noonedeadpunk | but, we started seeing that right after merging maria bump patch? | 17:10 |
| noonedeadpunk | I can barely recall stable mariadb release.... | 17:18 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump ansible-base to 2.10.9 https://review.opendev.org/c/openstack/openstack-ansible/+/791293 | 17:21 |
| noonedeadpunk | Honestly I kind of about to try reverting mariadb bump and see if things will change with depends-on at least... | 17:22 |
| jrosser | that sounds like a good idea | 17:22 |
| jrosser | could be unicode related | 17:25 |
| *** andrewbonney has quit IRC | 17:28 | |
| *** d34dh0r53 has quit IRC | 18:32 | |
| spatel | folk, by mistake my neutron dhcp namespace tool my gateway HSRP ip address, any good way to change it? | 19:29 |
| spatel | took* | 19:29 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Revert "Update mariadb version to 10.5.10" https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/791107 | 20:05 |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master https://review.opendev.org/c/openstack/openstack-ansible/+/790357 | 20:05 |
| *** fresta has quit IRC | 20:09 | |
| *** jonher has quit IRC | 20:09 | |
| *** rodolof has quit IRC | 20:09 | |
| *** jonher has joined #openstack-ansible | 20:09 | |
| *** rodolof has joined #openstack-ansible | 20:09 | |
| -openstackstatus- NOTICE: Zuul is in the process of migrating to a new VM and will be restarted shortly. | 20:39 | |
| admin0 | spatel, you can kill that namespace , edit and create again . | 20:49 |
| admin0 | i mean the network that created the dhcp | 20:49 |
| admin0 | or edit the dhcp, put the ip range which does not take the gateway, and then kill this specific ip | 20:49 |
| spatel | admin0 totally possible in that way | 20:50 |
| *** spatel has quit IRC | 20:54 | |
| *** jbadiapa has quit IRC | 21:13 | |
| *** corvus has quit IRC | 21:58 | |
| -openstackstatus- NOTICE: We are cautiously optimistic that Zuul is functional now on the new server. We ran into some unexpected problems and want to do another restart in the near future to ensure a revert addresses the source of that problem. | 22:03 | |
| *** tosky has quit IRC | 23:23 | |
| *** macz_ has quit IRC | 23:30 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!