| *** hoonetorg has quit IRC | 00:14 | |
| *** tosky has quit IRC | 00:17 | |
| *** hoonetorg has joined #openstack-oslo | 00:28 | |
| *** brinzhang has joined #openstack-oslo | 00:38 | |
| *** ralonsoh has quit IRC | 00:46 | |
| *** ralonsoh has joined #openstack-oslo | 00:46 | |
| *** hoonetorg has quit IRC | 01:26 | |
| *** zzzeek has quit IRC | 01:26 | |
| *** zzzeek has joined #openstack-oslo | 01:26 | |
| *** zzzeek has quit IRC | 01:31 | |
| *** zzzeek has joined #openstack-oslo | 01:32 | |
| *** hoonetorg has joined #openstack-oslo | 01:38 | |
| *** zzzeek has quit IRC | 01:50 | |
| *** zzzeek has joined #openstack-oslo | 01:51 | |
| *** zzzeek has quit IRC | 02:07 | |
| *** zzzeek has joined #openstack-oslo | 02:11 | |
| *** DinaBelova has quit IRC | 02:12 | |
| *** DinaBelova has joined #openstack-oslo | 02:13 | |
| *** brinzhang has quit IRC | 02:16 | |
| *** zzzeek has quit IRC | 02:16 | |
| *** zzzeek has joined #openstack-oslo | 02:18 | |
| *** iurygregory has quit IRC | 02:25 | |
| *** zzzeek has quit IRC | 02:30 | |
| *** zzzeek has joined #openstack-oslo | 02:31 | |
| *** rcernin has quit IRC | 02:33 | |
| *** rcernin has joined #openstack-oslo | 03:03 | |
| *** rcernin has quit IRC | 03:11 | |
| *** rcernin has joined #openstack-oslo | 03:11 | |
| *** zzzeek has quit IRC | 04:18 | |
| *** zzzeek has joined #openstack-oslo | 04:19 | |
| *** zzzeek has quit IRC | 04:34 | |
| *** zzzeek has joined #openstack-oslo | 04:35 | |
| *** zzzeek has quit IRC | 04:59 | |
| *** zzzeek has joined #openstack-oslo | 05:00 | |
| *** zzzeek has quit IRC | 05:10 | |
| *** zzzeek has joined #openstack-oslo | 05:11 | |
| *** ralonsoh has quit IRC | 06:46 | |
| *** zzzeek has quit IRC | 06:49 | |
| *** zzzeek has joined #openstack-oslo | 06:49 | |
| *** iurygregory has joined #openstack-oslo | 07:02 | |
| *** rpittau|afk is now known as rpittau | 07:39 | |
| *** rcernin has quit IRC | 07:49 | |
| *** rcernin has joined #openstack-oslo | 07:57 | |
| *** sboyron__ has joined #openstack-oslo | 07:58 | |
| *** sboyron__ is now known as sboyron | 08:12 | |
| *** rcernin has quit IRC | 08:15 | |
| *** ralonsoh has joined #openstack-oslo | 08:15 | |
| *** tosky has joined #openstack-oslo | 08:48 | |
| *** zzzeek has quit IRC | 08:50 | |
| *** zzzeek has joined #openstack-oslo | 08:54 | |
| *** dtantsur|afk is now known as dtantsur | 09:01 | |
| *** zzzeek has quit IRC | 09:09 | |
| *** zzzeek has joined #openstack-oslo | 09:09 | |
| *** zzzeek has quit IRC | 09:18 | |
| *** zzzeek has joined #openstack-oslo | 09:19 | |
| *** zzzeek has quit IRC | 09:26 | |
| *** zzzeek has joined #openstack-oslo | 09:28 | |
| *** iurygregory has quit IRC | 09:37 | |
| *** iurygregory has joined #openstack-oslo | 09:43 | |
| *** zzzeek has quit IRC | 10:04 | |
| *** zzzeek has joined #openstack-oslo | 10:06 | |
| *** zzzeek has quit IRC | 10:21 | |
| *** zzzeek has joined #openstack-oslo | 10:22 | |
| *** zzzeek has quit IRC | 10:26 | |
| *** zzzeek has joined #openstack-oslo | 10:28 | |
| *** zzzeek has quit IRC | 10:47 | |
| *** zzzeek has joined #openstack-oslo | 10:47 | |
| *** ralonsoh has quit IRC | 11:20 | |
| *** ralonsoh has joined #openstack-oslo | 11:23 | |
| *** zzzeek has quit IRC | 11:31 | |
| *** zzzeek has joined #openstack-oslo | 11:32 | |
| *** Luzi has joined #openstack-oslo | 12:07 | |
| *** dtantsur is now known as dtantsur|brb | 12:22 | |
| *** dtantsur|brb is now known as dtantsur | 13:41 | |
| *** openstackgerrit has joined #openstack-oslo | 13:49 | |
| openstackgerrit | Hervé Beraud proposed openstack/oslo.messaging master: fix variable name https://review.opendev.org/c/openstack/oslo.messaging/+/763975 | 13:49 |
|---|---|---|
| hberaud | kgiusti: o/ do you think it make sense to also `enable_cancel_on_failover` on `_driver.impl_rabbit.Connection._publish_and_creates_default_queue`? https://github.com/openstack/oslo.messaging/blob/master/oslo_messaging/_drivers/impl_rabbit.py#L1276 | 13:53 |
| * kgiusti looks... | 13:54 | |
| *** Luzi has quit IRC | 13:55 | |
| hberaud | as it was added on consumer https://github.com/openstack/oslo.messaging/blob/master/oslo_messaging/_drivers/impl_rabbit.py#L285 | 13:56 |
| gmann | hberaud: thanks | 14:04 |
| hberaud | kgiusti: I wonder if it can help to solve https://bugzilla.redhat.com/show_bug.cgi?id=1898578 by notifying the server that the binding is deleted. | 14:05 |
| openstack | bugzilla.redhat.com bug 1898578 in openstack-nova "[OSP 16.1] n-cpu raising MessageUndeliverable when replying to RPC call" [High,New] - Assigned to nova-maint | 14:05 |
| gmann | stephenfin: if you are around https://review.opendev.org/c/openstack/oslo.upgradecheck/+/763484 | 14:06 |
| *** zzzeek has quit IRC | 14:07 | |
| kgiusti | hberaud: I really don't know for sure. According to the rabbitmq docs, the x-cancel-on-ha-failover needs to be set by the _consumer_. That publish_and_creates_default_queue is for _publishing_ clients (notify-send). | 14:08 |
| kgiusti | hberaud: https://www.rabbitmq.com/ha.html#cancellation | 14:09 |
| *** zzzeek has joined #openstack-oslo | 14:09 | |
| hberaud | I see thanks | 14:09 |
| kgiusti | hberaud: we (oslo project) really needs an in house RabbitMQ expert. It's a shame we've lost such talented folks. | 14:12 |
| hberaud | kgiusti: also can you take a look to https://bugzilla.redhat.com/show_bug.cgi?id=1898578 , I submitted a reply from our oslo.messaging point of view however I'm not sure if we can do something from our side. | 14:13 |
| openstack | bugzilla.redhat.com bug 1898578 in openstack-nova "[OSP 16.1] n-cpu raising MessageUndeliverable when replying to RPC call" [High,New] - Assigned to nova-maint | 14:13 |
| hberaud | kgiusti: I agree | 14:13 |
| kgiusti | hberaud: that response is fine - you've covered everything I could think of (and more). | 14:33 |
| kgiusti | hberaud: given the CI history of failures we've seen in the rabbitmq failover tests there must be something the rabbitmq driver is doing wrong. | 14:34 |
| kgiusti | hberaud: I've spent time trying to get that failover test to pass consistently and have gotten no where with it. | 14:34 |
| hberaud | thanks | 14:35 |
| *** gouthamr_ has quit IRC | 14:36 | |
| hberaud | concerning the failover tests I suppose that you speak about https://review.opendev.org/c/openstack/oslo.messaging/+/763975 , isn't? | 14:37 |
| hberaud | kgiusti: ^ | 14:37 |
| kgiusti | hberaud: was a variable name issue causing the Rabbitmq failover tests (functional test) to fail frequently? | 14:39 |
| hberaud | kgiusti: ah oups sorry wrong link | 14:39 |
| hberaud | lol | 14:39 |
| kgiusti | hberaud: man *that* would've been excellent! :) | 14:39 |
| *** zzzeek has quit IRC | 14:39 | |
| hberaud | I was thinking about this one https://review.opendev.org/c/openstack/oslo.messaging/+/747892 | 14:40 |
| hberaud | kgiusti: ^ . Yes it would've been so straightforward :) | 14:40 |
| kgiusti | hberaud: yeah {2} oslo_messaging.tests.functional.test_rabbitmq.RabbitMQFailoverTests.test_failover_scenario_enable_cancel_on_failover [0.368216s] ... FAILED | 14:42 |
| kgiusti | hberaud: not sure if that was/is a Pifpaf issue | 14:42 |
| kgiusti | hberaud: but that RabbitMQFailoverTests has been unstable for awhile | 14:43 |
| * hberaud hate the zuul's output on the last gerrit version | 14:44 | |
| *** zzzeek has joined #openstack-oslo | 14:45 | |
| hberaud | tempest 25.0.1.dev81 has requirement jsonschema>=3.2.0, but you'll have jsonschema 3.0.2 which is incompatible. | 14:48 |
| hberaud | ERROR: tempest 25.0.1.dev81 has requirement paramiko>=2.7.0, but you'll have paramiko 2.6.0 which is incompatible. | 14:48 |
| hberaud | kgiusti: normally failover is now a non voting job, however the full rabbit test is still a voting test and it stuck us but all the errors found in its logs doesn't looks like related to oslo.messaging (oslo.messaging-src-dsvm-full-rabbit) (https://zuul.opendev.org/t/openstack/build/ff791791893144ae9dac63c3919268cf/log/job-output.txt?severity=0) | 14:53 |
| hberaud | kgiusti: concerning the failover test it looks like to the pifpaf issue previously discussed in the patch's comments "WARNING [pifpaf.drivers] `psutil.Popen(pid=3322, status='terminated')` is already gone, sending SIGKILL to its process group" | 14:55 |
| hberaud | kgiusti: however this functional test is now non voting | 14:56 |
| kgiusti | hberaud: ah, so the tempest test failure is unrelated to oslo.messaging. Is there a fix for the pifpaf issue that's causing the functional test to fail? Ideally we'd want that to be a voting job. | 14:59 |
| hberaud | kgiusti: yes a fix exist (https://github.com/jd/pifpaf/pull/124), I already tried to introduce the fix for stein with => https://review.opendev.org/c/openstack/requirements/+/753239 I need to check which version of pifpaf is used on train, but pifpaf errors seems similar | 15:07 |
| kgiusti | hberaud: that's great news - we can enable voting for the functional test and simple skip the failover test if the version of pifpaf is broken. | 15:09 |
| hberaud | kgiusti: on train pifpaf's upper-constraints is 2.2.0 and the fix is landed after 2.4.0 so we are in the same situation that with stein | 15:40 |
| hberaud | kgiusti: https://github.com/openstack/requirements/blob/stable/train/upper-constraints.txt#L404 | 15:40 |
| hberaud | kgiusti: https://review.opendev.org/c/openstack/requirements/+/753239 | 15:40 |
| hberaud | kgiusti: however some people aren't inclined to raise the pifpaf version on these stable branches | 15:42 |
| hberaud | and yes we can simply skip the failover test | 15:43 |
| kgiusti | hberaud: skipping that one test will at least allow the functional test to flag other breaking changes for those stable branches. Best we can do if they cannot bump the upper constraint. | 15:44 |
| openstackgerrit | Hervé Beraud proposed openstack/oslo.messaging stable/train: Cancel consumer if queue down https://review.opendev.org/c/openstack/oslo.messaging/+/747892 | 15:52 |
| hberaud | kgiusti: ^ this new PS could be a good consensus | 15:52 |
| openstackgerrit | Merged openstack/oslo.upgradecheck master: Add common checks for json to yaml policy file migration https://review.opendev.org/c/openstack/oslo.upgradecheck/+/763484 | 15:53 |
| kgiusti | hberaud: indeed. Hopefully Zuul will agree :D | 15:57 |
| hberaud | crossing my fingers | 16:01 |
| gmann | hberaud: oslo.upgradechecks and oslo.policy patches are merged now. can we do a release for them ? https://review.opendev.org/c/openstack/oslo.upgradecheck/+/763484 https://review.opendev.org/c/openstack/oslo.policy/+/763261 | 16:40 |
| gmann | so that this new things can be used on project side | 16:40 |
| *** hoonetorg has quit IRC | 16:41 | |
| -openstackstatus- NOTICE: The Gerrit service on review.opendev.org is being restarted quickly to troubleshoot an SMTP queuing backlog, downtime should be less than 5 minutes | 16:42 | |
| gmann | hberaud: let me know if you want me to push the release patch and you can +2 | 16:42 |
| *** rpittau is now known as rpittau|afk | 17:01 | |
| hberaud | gmann: sure feel free to submit the new release | 17:17 |
| hberaud | gmann: however I hope you are not too much in a hurry because we are stuck by some SSH/gerrit issues that block our release tagging jobs http://lists.openstack.org/pipermail/openstack-discuss/2020-November/018976.html | 17:20 |
| hberaud | gmann: hopefully all the pieces of the solution will be merged soon ( https://review.opendev.org/c/openstack/project-config/+/763797/ , https://review.opendev.org/c/openstack/project-config/+/763830/ , https://review.opendev.org/c/zuul/zuul-jobs/+/763834/ ) | 17:22 |
| gmann | hberaud: ohk. let me propose and once release tagging fix those can merge | 17:32 |
| hberaud | gmann: ack thanks | 17:32 |
| *** jlvillal has quit IRC | 17:42 | |
| *** jlvillal has joined #openstack-oslo | 17:43 | |
| *** iurygregory has quit IRC | 17:59 | |
| *** dtantsur is now known as dtantsur|afk | 18:01 | |
| *** iurygregory has joined #openstack-oslo | 18:27 | |
| openstackgerrit | David Vallee Delisle proposed openstack/oslo.config master: Adding --check-defaults to validator https://review.opendev.org/c/openstack/oslo.config/+/759338 | 18:55 |
| openstackgerrit | Ghanshyam proposed openstack/oslo.policy master: Fix oslopolicy-j2y-convertor tool for RuleDefault https://review.opendev.org/c/openstack/oslo.policy/+/764056 | 19:30 |
| *** sboyron has quit IRC | 20:09 | |
| *** hamalq has joined #openstack-oslo | 20:16 | |
| *** sboyron has joined #openstack-oslo | 20:18 | |
| *** hamalq has quit IRC | 20:55 | |
| gmann | hberaud: lbragstad once more fix in oslo.policy which i would like to include on new release - https://review.opendev.org/c/openstack/oslo.policy/+/764056 | 20:58 |
| hberaud | gmann: ack, I'll take a look later | 20:58 |
| gmann | this is found while generating the yaml file for glance which still using RuleDefault instead of DocumentedRuleDefault | 20:59 |
| gmann | hberaud: thanls | 20:59 |
| gmann | thanks | 20:59 |
| hberaud | ack | 20:59 |
| lbragstad | gmann that makes sense - looks good to me but i'll let hberaud kick it through after he takes a look | 21:01 |
| gmann | sure, lbragstad thanks | 21:04 |
| *** hamalq has joined #openstack-oslo | 21:10 | |
| *** hamalq has quit IRC | 21:15 | |
| *** ralonsoh has quit IRC | 21:17 | |
| *** raildo has quit IRC | 21:17 | |
| hberaud | gmann: done | 21:17 |
| gmann | hberaud: thanks | 21:17 |
| *** sboyron has quit IRC | 21:34 | |
| *** sboyron has joined #openstack-oslo | 21:34 | |
| *** zzzeek has quit IRC | 21:38 | |
| *** zzzeek has joined #openstack-oslo | 21:40 | |
| *** sboyron has quit IRC | 21:58 | |
| *** sboyron has joined #openstack-oslo | 21:59 | |
| *** rcernin has joined #openstack-oslo | 22:00 | |
| *** sboyron has quit IRC | 22:11 | |
| *** sboyron has joined #openstack-oslo | 22:11 | |
| *** sboyron has quit IRC | 22:12 | |
| *** sboyron has joined #openstack-oslo | 22:13 | |
| *** sboyron has quit IRC | 22:15 | |
| *** sboyron has joined #openstack-oslo | 22:16 | |
| *** sboyron has quit IRC | 22:20 | |
| *** sboyron has joined #openstack-oslo | 22:20 | |
| openstackgerrit | Merged openstack/oslo.policy master: Fix oslopolicy-j2y-convertor tool for RuleDefault https://review.opendev.org/c/openstack/oslo.policy/+/764056 | 22:25 |
| *** sboyron has quit IRC | 22:25 | |
| *** sboyron has joined #openstack-oslo | 22:26 | |
| *** sboyron has quit IRC | 22:33 | |
| *** sboyron has joined #openstack-oslo | 22:34 | |
| *** sboyron has quit IRC | 22:40 | |
| *** sboyron has joined #openstack-oslo | 22:41 | |
| *** sboyron has quit IRC | 22:48 | |
| *** sboyron has joined #openstack-oslo | 22:48 | |
| *** sboyron has quit IRC | 22:57 | |
| *** hoonetorg has joined #openstack-oslo | 23:03 | |
| *** sboyron has joined #openstack-oslo | 23:07 | |
| *** hamalq has joined #openstack-oslo | 23:37 | |
| *** hamalq has quit IRC | 23:41 | |
| *** hamalq has joined #openstack-oslo | 23:52 | |
| *** tosky has quit IRC | 23:57 | |
| *** hamalq has quit IRC | 23:57 | |
| *** openstackgerrit has quit IRC | 23:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!