| *** sapd1 has joined #openstack-lbaas | 01:39 | |
| *** rcernin has joined #openstack-lbaas | 02:39 | |
| *** xgerman has quit IRC | 04:56 | |
| *** rouk has quit IRC | 05:06 | |
| *** vishalmanchanda has joined #openstack-lbaas | 05:19 | |
| *** gcheresh has joined #openstack-lbaas | 06:17 | |
| *** zzzeek has quit IRC | 07:07 | |
| *** zzzeek has joined #openstack-lbaas | 07:08 | |
| *** ccamposr__ has joined #openstack-lbaas | 07:14 | |
| *** ccamposr has quit IRC | 07:16 | |
| *** rpittau|afk is now known as rpittau | 07:39 | |
| *** yamamoto has quit IRC | 08:26 | |
| *** cgoncalves has quit IRC | 08:31 | |
| *** cgoncalves has joined #openstack-lbaas | 08:33 | |
| *** haleyb has quit IRC | 08:34 | |
| *** haleyb has joined #openstack-lbaas | 08:37 | |
| *** yamamoto has joined #openstack-lbaas | 08:55 | |
| *** yamamoto has quit IRC | 09:02 | |
| *** yamamoto has joined #openstack-lbaas | 09:05 | |
| *** rcernin has quit IRC | 09:07 | |
| *** yamamoto has quit IRC | 09:12 | |
| *** rcernin has joined #openstack-lbaas | 09:17 | |
| *** yamamoto has joined #openstack-lbaas | 09:21 | |
| *** yamamoto has quit IRC | 09:22 | |
| *** rcernin has quit IRC | 09:25 | |
| *** rcernin has joined #openstack-lbaas | 09:43 | |
| *** icey has quit IRC | 09:46 | |
| *** yamamoto has joined #openstack-lbaas | 09:49 | |
| *** icey has joined #openstack-lbaas | 09:50 | |
| *** yamamoto has quit IRC | 09:55 | |
| *** sapd1 has quit IRC | 10:09 | |
| *** yamamoto has joined #openstack-lbaas | 10:09 | |
| *** ramishra has quit IRC | 10:23 | |
| *** ramishra has joined #openstack-lbaas | 10:25 | |
| *** rcernin has quit IRC | 10:48 | |
| *** rcernin has joined #openstack-lbaas | 10:53 | |
| *** rcernin has quit IRC | 10:57 | |
| *** ilush has joined #openstack-lbaas | 11:15 | |
| *** ilush has quit IRC | 11:42 | |
| *** rcernin has joined #openstack-lbaas | 11:49 | |
| *** sshnaidm|afk is now known as sshnaidm | 11:53 | |
| *** ccamposr has joined #openstack-lbaas | 12:10 | |
| *** ccamposr__ has quit IRC | 12:13 | |
| *** yamamoto has quit IRC | 12:38 | |
| *** gryf is now known as _gryf | 12:47 | |
| *** _gryf is now known as gryf | 12:48 | |
| *** gryf is now known as niech_co_krwawy_ | 12:49 | |
| *** niech_co_krwawy_ is now known as gryf | 12:49 | |
| *** sapd1 has joined #openstack-lbaas | 13:06 | |
| *** yamamoto has joined #openstack-lbaas | 13:22 | |
| *** yamamoto has quit IRC | 13:34 | |
| *** rcernin has quit IRC | 13:43 | |
| *** sapd1 has quit IRC | 13:45 | |
| *** openstackgerrit has joined #openstack-lbaas | 13:51 | |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia-tempest-plugin master: Add new scenario test to create LB in specific AZ https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/695349 | 13:51 |
|---|---|---|
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia-tempest-plugin master: WIP DNM Fix IPv6 VIP network connectivity https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/774086 | 14:26 |
| *** ilush has joined #openstack-lbaas | 14:57 | |
| *** yamamoto has joined #openstack-lbaas | 15:33 | |
| *** yamamoto has quit IRC | 15:47 | |
| *** sshnaidm is now known as sshnaidm|afk | 15:48 | |
| openstackgerrit | Arkady Shtempler proposed openstack/octavia-tempest-plugin master: Refactoring - add pool of ports to be used in tests https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/755436 | 16:15 |
| *** xgerman has joined #openstack-lbaas | 16:28 | |
| *** ccamposr__ has joined #openstack-lbaas | 16:38 | |
| *** ccamposr has quit IRC | 16:40 | |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia-tempest-plugin master: Add new scenario test to create LB in specific AZ https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/695349 | 17:18 |
| *** openstack has joined #openstack-lbaas | 17:25 | |
| *** ChanServ sets mode: +o openstack | 17:25 | |
| *** vishalmanchanda has quit IRC | 17:38 | |
| *** zzzeek has quit IRC | 17:42 | |
| *** zzzeek has joined #openstack-lbaas | 17:44 | |
| *** rpittau is now known as rpittau|afk | 18:10 | |
| *** ccamposr has joined #openstack-lbaas | 19:00 | |
| *** lemko7 has quit IRC | 19:00 | |
| *** lemko has joined #openstack-lbaas | 19:00 | |
| *** ccamposr__ has quit IRC | 19:02 | |
| *** ilush has quit IRC | 19:12 | |
| *** rcernin has joined #openstack-lbaas | 19:40 | |
| *** yamamoto has joined #openstack-lbaas | 19:44 | |
| *** rcernin has quit IRC | 19:45 | |
| *** yamamoto has quit IRC | 19:49 | |
| *** stand has quit IRC | 20:12 | |
| *** rcernin has joined #openstack-lbaas | 20:17 | |
| *** rcernin has quit IRC | 20:31 | |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia-tempest-plugin master: WIP DNM Fix IPv6 VIP network connectivity https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/774157 | 20:56 |
| *** rcernin has joined #openstack-lbaas | 21:00 | |
| mchlumsky | I tried to reproduce the "centos 8 amphora host-route on vip subnet breaks amphora creation" bug in devstack to have proper steps to reproduce the bug for a bug report but I can't reproduce it. I can reproduce it intermittently in our environments. Here is /var/log/messages from an amphora when it works correctly: | 21:12 |
| mchlumsky | http://paste.openstack.org/show/802343/ and here's when it fails: http://paste.openstack.org/show/802344/ | 21:12 |
| johnsom | mchlumsky Yeah, it looks like the controller didn't (couldn't) contact the VM in the failed scenario | 21:16 |
| johnsom | If you can, please include the neutron "network show" and "subnet show" for the lb management network those are on and the VIP network you are using | 21:18 |
| mchlumsky | http://paste.openstack.org/show/hMoG0sRqTijFbEMfgFrx/ | 21:25 |
| johnsom | Ok, that should be enough information to reproduce it. | 21:27 |
| johnsom | Yeah, ok, I can see exactly what is going on. It is going to be intermittent. The DHCP on the VIP network is injecting that route as well (which is ok), it's just that the DHCP is firing before the amphora agent gets called, so DHCP is injecting the bad route before the interface is moved into the netns. | 21:28 |
| johnsom | It's network manager on centos that is causing you pain | 21:29 |
| mchlumsky | yes it is :( | 21:31 |
| mchlumsky | it looks like the renaming of ens7 to eth1 causes a DHCP transaction cancellation in the success scenario | 21:32 |
| johnsom | We can't embrace network manager fully as it doesn't understand network namespaces, so we have kept it at arms length. I just not a long enough arm.... | 21:32 |
| johnsom | Yeah, that log message is about when the interface is detached from the "default" namespace and moved into the haproxy-amphora network namespace. | 21:32 |
| johnsom | It's not supposed to come up in the default namespace, it is only supposed to go active inside the network namespace. | 21:33 |
| johnsom | That is the bug on centos | 21:33 |
| johnsom | network manager is bringing it up automatically when we don't want it to | 21:34 |
| johnsom | I bet centos 7 doesn't have this problem. lol | 21:34 |
| johnsom | I am going to open a story now | 21:35 |
| mchlumsky | Indeed it doesn't, we had centos 7 amphoras before and they worked fine in the same environments. Only when we upgraded to centos 8 did this start happening | 21:36 |
| mchlumsky | Can I build centos 7 amphoras for Ussuri? | 21:36 |
| johnsom | Technically, yes. | 21:36 |
| johnsom | It's not the best solution though as the haproxy is older | 21:37 |
| mchlumsky | yeah 1.5 vs 1.88 | 21:37 |
| mchlumsky | *1.8 | 21:37 |
| rm_work | i heard the priority list is updated? I'll start working through some of that today :D | 21:37 |
| johnsom | Yeah, complements of Greg! | 21:37 |
| rm_work | thanks greg! | 21:37 |
| rm_work | hmm yeah lots with merge conflicts T_T maybe I can help with some of those | 21:38 |
| mchlumsky | johnsom ty for the help. Much appreciated! | 21:39 |
| johnsom | Yeah, hopefully we can get a solution to this pretty quick so you can build an image without this defect. | 21:39 |
| *** rcernin has quit IRC | 21:39 | |
| johnsom | mchlumsky https://storyboard.openstack.org/#!/story/2008599 | 21:41 |
| johnsom | I will add more comments now | 21:41 |
| *** gcheresh has quit IRC | 21:43 | |
| *** yamamoto has joined #openstack-lbaas | 21:46 | |
| mchlumsky | +1 | 21:47 |
| johnsom | Thank you for providing us the details, this really helps get a quick solution. | 21:48 |
| *** yamamoto has quit IRC | 21:50 | |
| mchlumsky | You're welcome! :) | 21:53 |
| *** rcernin has joined #openstack-lbaas | 21:56 | |
| *** yamamoto has joined #openstack-lbaas | 22:16 | |
| *** rcernin has quit IRC | 22:26 | |
| *** rcernin has joined #openstack-lbaas | 22:26 | |
| *** yamamoto has quit IRC | 22:35 | |
| *** yamamoto has joined #openstack-lbaas | 22:35 | |
| *** lemko has quit IRC | 22:57 | |
| *** lemko has joined #openstack-lbaas | 22:57 | |
| *** tkajinam has quit IRC | 22:59 | |
| *** tkajinam has joined #openstack-lbaas | 22:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!