| openstackgerrit | Adam Harwell proposed openstack/octavia-tempest-plugin master: WIP: Test Additional VIPs https://review.opendev.org/664462 | 00:00 |
|---|---|---|
| *** henriqueof has quit IRC | 00:00 | |
| johnsom | commented back on that gunicorn setting | 00:01 |
| rm_work | arg switching back and forth between two different tempest patches that are running into similar errors ... the context switching hurts | 00:01 |
| rm_work | johnsom: gates still broken or should I recheck with my +2? | 00:02 |
| rm_work | guess I can find out | 00:03 |
| johnsom | I don't know if they ever fixed that mirror or not | 00:03 |
| lxkong | johnsom: bionic works for us! | 00:03 |
| johnsom | lxkong +100 | 00:03 |
| lxkong | w00t! | 00:03 |
| openstackgerrit | Adam Harwell proposed openstack/octavia-tempest-plugin master: Add octavia-v2-dsvm-scenario-ipv6 to check queue https://review.opendev.org/594078 | 00:11 |
| johnsom | rm_work Easy one: https://review.opendev.org/#/c/626406/ | 00:15 |
| rm_work | +2, but wasn't most of that IN the other patch? | 00:16 |
| rm_work | or is this a different repo | 00:16 |
| johnsom | Yeah, this one just saves the logs in the gate jobs | 00:16 |
| johnsom | The one in the other patch is only for "legacy" jobs | 00:17 |
| *** mithilarun has quit IRC | 00:18 | |
| *** ianychoi has joined #openstack-lbaas | 00:19 | |
| *** mithilarun has joined #openstack-lbaas | 00:19 | |
| *** mithilarun has quit IRC | 00:23 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Amphora logging https://review.opendev.org/624835 | 00:27 |
| johnsom | rm_work Ok, I think that is pretty good for a first pass. | 00:27 |
| *** yamamoto has joined #openstack-lbaas | 00:27 | |
| rm_work | did you address all my nits | 00:28 |
| johnsom | I did, including the filename issue | 00:28 |
| johnsom | Sorry, no syslog-ng though.... | 00:30 |
| rm_work | T_T | 00:32 |
| rm_work | yeah that seems good enough | 00:32 |
| rm_work | +2 here | 00:32 |
| rm_work | what was on your plate next? will you be able to help me with the ACTIVE-ACTIVE stuff? | 00:33 |
| rm_work | and possibly poke at testing multivip stuff soon? it's pretty much good now | 00:33 |
| rm_work | it seems i've taken up the ipv6 goal | 00:33 |
| johnsom | Umm, next is figure out this centos gate issue, figure out how to do a tempest for the log offloading, I want to work on the failover flow, and I need to start on the single process work. | 00:42 |
| johnsom | Among other internal stuffs | 00:42 |
| rm_work | k | 00:42 |
| johnsom | There is also deadlock I saw today I want to look into: http://logs.openstack.org/07/665207/2/check/octavia-v2-dsvm-noop-py2-api/a807c0c/controller/logs/screen-o-cw.txt.gz#_Jun_13_19_03_59_217759 | 00:43 |
| johnsom | I think I know what is up with that and how to fix it. Just surprised I haven't seen it before now. | 00:44 |
| johnsom | Also a bit odd it's on a noop gate | 00:44 |
| rm_work | johnsom: ok i guess i am just gonna wait on your logging patches to land before i really continue debugging these tempest tests because they are not giving me helpful results | 01:10 |
| rm_work | i need to see inside the amp (both system and tenant logs) :D | 01:10 |
| rm_work | so good timing i guess on you wrapping your stuff up | 01:10 |
| lxkong | rm_work, johnsom, the bionic image has problem http://paste.openstack.org/show/752909/ | 01:12 |
| lxkong | rm_work, johnsom, have we already used bionic image in CI? | 01:13 |
| rm_work | we have a test in CI for it | 01:13 |
| rm_work | but it is not incredibly stable | 01:13 |
| rm_work | though i thought it was timing related | 01:14 |
| lxkong | the problem in http://paste.openstack.org/show/752909/ looks like python3 related | 01:15 |
| *** rcernin has quit IRC | 01:27 | |
| *** rcernin has joined #openstack-lbaas | 01:27 | |
| rm_work | johnsom: umm, is an ipv6-vip LB not being able to reach an ipv4 member a known issue? | 01:43 |
| rm_work | without multi-vip | 01:43 |
| rm_work | just like... on master | 01:43 |
| rm_work | not sure if i broke it or not... but it's not bringing up an ipv4 interface at all | 01:44 |
| rm_work | maybe i plugged the members wrong | 01:45 |
| rm_work | nope... | 01:45 |
| rm_work | crap, not sure why the member plugging is not adding an interface on the ipv4 subnet (it should, as it is *new* | 01:52 |
| rm_work | ) | 01:52 |
| *** spatel has joined #openstack-lbaas | 02:03 | |
| rm_work | ugh yep, i'm gonna be fixing the "multiple-subnets, same network" delta calculation issue aren't I | 02:05 |
| rm_work | T_T | 02:05 |
| rm_work | ok then. | 02:07 |
| *** spatel has quit IRC | 02:08 | |
| johnsom | rm_work: Nir is supposed to be working on that. | 02:20 |
| rm_work | well | 02:20 |
| johnsom | Ipv6 to ipv4 works in the scenario | 02:20 |
| johnsom | rm_work: I thought we got rid of flask, lxkong error shows flask code | 02:21 |
| rm_work | it very clearly doesn't work in my devstack... i'll rebuild again on master to make sure i didn't break anything | 02:21 |
| rm_work | i thought we did too? | 02:22 |
| rm_work | maybe still needed to import it for something stupid tho? :/ | 02:22 |
| rm_work | i think there was like one thing i didn't know how to get rid of | 02:22 |
| *** rtjure has quit IRC | 02:46 | |
| *** rtjure has joined #openstack-lbaas | 02:52 | |
| *** ramishra has joined #openstack-lbaas | 02:56 | |
| *** yamamoto has quit IRC | 02:58 | |
| *** dmellado_ has joined #openstack-lbaas | 03:08 | |
| *** dmellado has quit IRC | 03:08 | |
| *** dayou_ has quit IRC | 03:08 | |
| *** dmellado_ is now known as dmellado | 03:08 | |
| *** dayou_ has joined #openstack-lbaas | 03:10 | |
| *** dayou_ has quit IRC | 03:22 | |
| *** mugsie has quit IRC | 03:22 | |
| *** dosaboy has quit IRC | 03:22 | |
| *** kklimonda has quit IRC | 03:22 | |
| *** rouk has quit IRC | 03:22 | |
| *** dasp has quit IRC | 03:22 | |
| *** dulek has quit IRC | 03:24 | |
| *** gcheresh has joined #openstack-lbaas | 03:26 | |
| *** dulek has joined #openstack-lbaas | 03:31 | |
| *** psachin has joined #openstack-lbaas | 03:31 | |
| *** yamamoto has joined #openstack-lbaas | 03:33 | |
| *** gcheresh has quit IRC | 03:35 | |
| *** dayou_ has joined #openstack-lbaas | 03:37 | |
| *** mugsie has joined #openstack-lbaas | 03:37 | |
| *** dosaboy has joined #openstack-lbaas | 03:37 | |
| *** kklimonda has joined #openstack-lbaas | 03:38 | |
| *** rouk has joined #openstack-lbaas | 03:38 | |
| *** dasp has joined #openstack-lbaas | 03:38 | |
| *** irclogbot_1 has quit IRC | 03:41 | |
| *** yamamoto has quit IRC | 03:41 | |
| *** irclogbot_1 has joined #openstack-lbaas | 03:42 | |
| *** yamamoto has joined #openstack-lbaas | 03:47 | |
| *** dasp has quit IRC | 03:58 | |
| *** gcheresh has joined #openstack-lbaas | 04:17 | |
| *** dasp has joined #openstack-lbaas | 04:21 | |
| *** gcheresh has quit IRC | 04:36 | |
| *** gcheresh has joined #openstack-lbaas | 04:55 | |
| *** pcaruana has joined #openstack-lbaas | 05:09 | |
| *** gcheresh has quit IRC | 05:14 | |
| *** luksky has joined #openstack-lbaas | 05:26 | |
| *** ivve has joined #openstack-lbaas | 06:06 | |
| *** sapd1_x has joined #openstack-lbaas | 06:21 | |
| *** takamatsu has joined #openstack-lbaas | 06:34 | |
| *** rpittau|afk is now known as rpittau | 06:35 | |
| *** sapd1_x has quit IRC | 06:49 | |
| *** ccamposr__ has joined #openstack-lbaas | 06:50 | |
| *** ccamposr has quit IRC | 06:52 | |
| *** sapd1_x has joined #openstack-lbaas | 06:54 | |
| openstackgerrit | Yue Qu proposed openstack/neutron-lbaas stable/stein: "lbaas delete l7 rule" Parameter Passing Error https://review.opendev.org/665315 | 06:56 |
| *** tesseract has joined #openstack-lbaas | 07:08 | |
| openstackgerrit | Yue Qu proposed openstack/neutron-lbaas stable/stein: "lbaas delete l7 rule" Parameter Passing Error https://review.opendev.org/665315 | 07:09 |
| *** sapd1_x has quit IRC | 07:09 | |
| *** rcernin has quit IRC | 07:22 | |
| *** sapd1_x has joined #openstack-lbaas | 07:41 | |
| *** ccamposr has joined #openstack-lbaas | 07:50 | |
| *** ccamposr__ has quit IRC | 07:53 | |
| *** sapd1_x has quit IRC | 08:24 | |
| *** sapd1_x has joined #openstack-lbaas | 08:48 | |
| cgoncalves | lxkong, hi! | 08:53 |
| cgoncalves | lxkong, I'm still reading the backlog but one question: nested virtualization disabled? | 08:53 |
| lxkong | cgoncalves: unfortunately yes | 08:54 |
| lxkong | cgoncalves: and hi | 08:54 |
| lxkong | i gave up trying, suggest our ops to do downgrade | 08:54 |
| cgoncalves | ok, I'm reading your https://termbin.com/6g4l | 08:56 |
| cgoncalves | Fedora actually booted rather quick. initramfs went fast and switched to rootfs | 08:56 |
| cgoncalves | IIRC what you're seeing is fedora actually not finishing the boot | 08:57 |
| cgoncalves | what johnsom and I see is centos booting slowly but it finishes | 08:57 |
| lxkong | cgoncalves: in the end it finished, http://dpaste.com/07GF644 | 08:59 |
| cgoncalves | lxkong, ah, ok. | 09:00 |
| *** gcheresh has joined #openstack-lbaas | 09:00 | |
| lxkong | cgoncalves: output of `systemd-analyze` http://dpaste.com/18VQ1N5 | 09:00 |
| cgoncalves | btw, I like having the systemd-analyze data plotted. you can also do it with "systemd-analyze --plot" | 09:01 |
| *** ccamposr__ has joined #openstack-lbaas | 09:04 | |
| *** ccamposr has quit IRC | 09:06 | |
| *** yamamoto has quit IRC | 09:08 | |
| *** yamamoto has joined #openstack-lbaas | 09:08 | |
| *** yamamoto has quit IRC | 09:16 | |
| *** gcheresh has quit IRC | 09:23 | |
| *** gcheresh has joined #openstack-lbaas | 09:27 | |
| *** yamamoto has joined #openstack-lbaas | 09:34 | |
| *** gcheresh has quit IRC | 09:40 | |
| *** yamamoto has quit IRC | 09:43 | |
| *** luksky has quit IRC | 10:26 | |
| *** yamamoto has joined #openstack-lbaas | 10:30 | |
| *** sapd1_x has quit IRC | 10:31 | |
| *** gcheresh has joined #openstack-lbaas | 10:33 | |
| *** psachin has quit IRC | 10:37 | |
| *** psachin has joined #openstack-lbaas | 10:39 | |
| *** ccamposr has joined #openstack-lbaas | 10:43 | |
| *** ccamposr__ has quit IRC | 10:45 | |
| *** gcheresh has quit IRC | 10:50 | |
| *** yamamoto has quit IRC | 10:50 | |
| rm_work | mmm almost done fixing this stupid subnet plugging issue i think | 11:02 |
| rm_work | though i'm sure it won't work the first time <_< | 11:02 |
| *** luksky has joined #openstack-lbaas | 11:04 | |
| *** yamamoto has joined #openstack-lbaas | 11:09 | |
| *** ccamposr__ has joined #openstack-lbaas | 11:15 | |
| *** ccamposr has quit IRC | 11:17 | |
| *** yamamoto has quit IRC | 11:20 | |
| rm_work | ok or maybe it ... works? | 11:24 |
| cgoncalves | even the code is signaling you to go to sleep | 11:24 |
| rm_work | nah i want to prove this works in devstack and then push it up | 11:37 |
| rm_work | THEN sleep | 11:37 |
| *** goldyfruit has quit IRC | 11:40 | |
| *** ccamposr has joined #openstack-lbaas | 11:41 | |
| *** ccamposr__ has quit IRC | 11:44 | |
| *** yamamoto has joined #openstack-lbaas | 11:56 | |
| *** ccamposr__ has joined #openstack-lbaas | 11:56 | |
| *** ccamposr has quit IRC | 11:59 | |
| *** yamamoto has quit IRC | 12:00 | |
| *** gcheresh has joined #openstack-lbaas | 12:13 | |
| *** gcheresh has quit IRC | 12:37 | |
| *** gcheresh has joined #openstack-lbaas | 12:48 | |
| *** gcheresh has quit IRC | 12:55 | |
| *** yamamoto has joined #openstack-lbaas | 13:03 | |
| *** goldyfruit has joined #openstack-lbaas | 13:08 | |
| openstackgerrit | Ann Taraday proposed openstack/octavia master: [WIP] Convert pool flows to use dicts https://review.opendev.org/665381 | 13:08 |
| *** boden has joined #openstack-lbaas | 13:09 | |
| *** goldyfruit has quit IRC | 13:23 | |
| *** goldyfruit has joined #openstack-lbaas | 13:24 | |
| *** sapd1_x has joined #openstack-lbaas | 13:30 | |
| *** spatel has joined #openstack-lbaas | 13:35 | |
| *** spatel has quit IRC | 13:39 | |
| *** goldyfruit has quit IRC | 13:47 | |
| *** goldyfruit has joined #openstack-lbaas | 13:53 | |
| *** spatel has joined #openstack-lbaas | 14:02 | |
| *** sapd1_x has quit IRC | 14:06 | |
| *** sapd1_x has joined #openstack-lbaas | 14:08 | |
| *** gcheresh has joined #openstack-lbaas | 14:09 | |
| openstackgerrit | Adam Harwell proposed openstack/octavia master: WIP: handle plugging member subnets on existing networks https://review.opendev.org/665402 | 14:13 |
| *** Vorrtex has joined #openstack-lbaas | 14:22 | |
| *** gcheresh has quit IRC | 14:25 | |
| openstackgerrit | Carlos Goncalves proposed openstack/octavia stable/rocky: Fix for utils LB DM transformation function https://review.opendev.org/665405 | 14:32 |
| openstackgerrit | Carlos Goncalves proposed openstack/neutron-lbaas stable/rocky: Fix memory leak in the haproxy provider driver https://review.opendev.org/665410 | 14:38 |
| openstackgerrit | Carlos Goncalves proposed openstack/neutron-lbaas stable/queens: Fix memory leak in the haproxy provider driver https://review.opendev.org/665411 | 14:38 |
| *** lemko has joined #openstack-lbaas | 14:50 | |
| *** mithilarun has joined #openstack-lbaas | 15:01 | |
| *** mithilarun has quit IRC | 15:02 | |
| *** mithilarun has joined #openstack-lbaas | 15:03 | |
| *** luksky has quit IRC | 15:08 | |
| *** mithilar_ has joined #openstack-lbaas | 15:19 | |
| *** mithilarun has quit IRC | 15:22 | |
| *** mithilar_ has quit IRC | 15:23 | |
| *** ivve has quit IRC | 15:29 | |
| *** mithilarun has joined #openstack-lbaas | 15:31 | |
| *** mithilarun has quit IRC | 15:33 | |
| *** Vorrtex has quit IRC | 15:53 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Amphora logging https://review.opendev.org/624835 | 16:02 |
| *** takamatsu has quit IRC | 16:07 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia-tempest-plugin master: Save amphora logs in gate https://review.opendev.org/626406 | 16:08 |
| openstackgerrit | Michael Johnson proposed openstack/octavia-tempest-plugin master: Save amphora logs in gate https://review.opendev.org/626406 | 16:10 |
| *** rpittau is now known as rpittau|afk | 16:11 | |
| *** goldyfruit has quit IRC | 16:24 | |
| *** goldyfruit has joined #openstack-lbaas | 16:32 | |
| openstackgerrit | Merged openstack/neutron-lbaas stable/stein: Support URL query params in healthmonitor url_path https://review.opendev.org/660930 | 16:37 |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix allocate_and_associate DB deadlock https://review.opendev.org/665433 | 16:41 |
| *** ramishra has quit IRC | 16:42 | |
| *** gthiemon1e has joined #openstack-lbaas | 16:56 | |
| *** gthiemonge has quit IRC | 16:57 | |
| *** sapd1_x has quit IRC | 17:00 | |
| *** lemko has quit IRC | 17:00 | |
| *** ccamposr has joined #openstack-lbaas | 17:02 | |
| *** mithilarun has joined #openstack-lbaas | 17:03 | |
| *** spatel has quit IRC | 17:04 | |
| *** mithilarun has quit IRC | 17:04 | |
| *** mithilarun has joined #openstack-lbaas | 17:05 | |
| *** ccamposr__ has quit IRC | 17:05 | |
| *** mithilarun has quit IRC | 17:06 | |
| *** mithilarun has joined #openstack-lbaas | 17:06 | |
| *** mithilarun has quit IRC | 17:10 | |
| *** mithilarun has joined #openstack-lbaas | 17:12 | |
| *** rouk has quit IRC | 17:17 | |
| *** spatel has joined #openstack-lbaas | 17:52 | |
| *** rtjure has quit IRC | 18:02 | |
| *** spatel has quit IRC | 18:07 | |
| *** psachin has quit IRC | 18:08 | |
| *** rtjure has joined #openstack-lbaas | 18:10 | |
| openstackgerrit | Michael Johnson proposed openstack/neutron-lbaas stable/queens: Remove DDT tests from tempest plugin https://review.opendev.org/665444 | 18:11 |
| *** spatel has joined #openstack-lbaas | 18:12 | |
| *** graysonh has joined #openstack-lbaas | 18:16 | |
| *** rtjure has quit IRC | 18:16 | |
| *** tesseract has quit IRC | 18:18 | |
| *** rtjure has joined #openstack-lbaas | 18:25 | |
| *** spatel has quit IRC | 18:27 | |
| *** spatel has joined #openstack-lbaas | 18:31 | |
| graysonh | I'm trying to set some loadbalancer quotas for one of my users, but my openstack loadbalancer commands are failing with "public endpoint for load-balancer service in aus region not found". I've deployed rocky via kolla, and sure enough "openstack endpoint list" doesn't have any octavia endpoints listed. All of the other functionality seems to work, I just can't do anything with the client | 18:35 |
| graysonh | Should the endpoint be there in rocky? I'm wondering if maybe my client is trying to do things a newer way than my cluster can do? I'm not extremely familiar with how octavia works, but didn't all of it's api stuff used to live in the neutron endpoint? | 18:37 |
| *** spatel has quit IRC | 18:53 | |
| *** spatel has joined #openstack-lbaas | 18:58 | |
| johnsom | graysonh Hi there. Can you do an "openstack endpoint list" for that region and paste it? | 19:08 |
| johnsom | Rocky had quotas for sure. | 19:08 |
| johnsom | Oh, sorry, catching up getting back from lunch. So, yes, you must have the octavia endpoint configured in keystone, starting from Pike release. | 19:09 |
| *** mithilarun has quit IRC | 19:10 | |
| johnsom | Something like this: | 19:12 |
| johnsom | | c51d476114cb4bcb9ab214df9ef2cdb2 | RegionOne | octavia | load-balancer | True | public | http://10.21.21.77/load-balancer | | 19:12 |
| *** graysonh has quit IRC | 19:16 | |
| *** goldyfruit has quit IRC | 19:17 | |
| *** goldyfruit has joined #openstack-lbaas | 19:17 | |
| *** goldyfruit has quit IRC | 19:22 | |
| johnsom | Blah, found a bug in my logging patch. I will create a followup to fix it. | 19:35 |
| *** pcaruana has quit IRC | 19:39 | |
| *** gcheresh has joined #openstack-lbaas | 19:45 | |
| *** mithilarun has joined #openstack-lbaas | 19:50 | |
| *** mithilarun has quit IRC | 19:54 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: DNM CentOS7 gate test https://review.opendev.org/665464 | 19:56 |
| *** luksky has joined #openstack-lbaas | 19:56 | |
| *** gcheresh has quit IRC | 20:00 | |
| *** spatel has quit IRC | 20:17 | |
| *** mithilarun has joined #openstack-lbaas | 20:23 | |
| *** mithilarun has quit IRC | 20:26 | |
| *** mithilarun has joined #openstack-lbaas | 20:26 | |
| *** goldyfruit has joined #openstack-lbaas | 20:28 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix TCP listener logging bug https://review.opendev.org/665470 | 20:39 |
| *** goldyfruit_ has joined #openstack-lbaas | 20:54 | |
| *** mithilarun has quit IRC | 20:55 | |
| *** goldyfruit has quit IRC | 20:56 | |
| *** goldyfruit_ has quit IRC | 21:00 | |
| *** goldyfruit_ has joined #openstack-lbaas | 21:01 | |
| openstackgerrit | Merged openstack/octavia master: Align logging in the amphora https://review.opendev.org/664123 | 21:07 |
| *** mithilarun has joined #openstack-lbaas | 21:14 | |
| *** mithilarun has quit IRC | 21:14 | |
| *** mithilarun has joined #openstack-lbaas | 21:14 | |
| *** boden has quit IRC | 21:21 | |
| *** mithilarun has quit IRC | 21:43 | |
| *** mithilarun has joined #openstack-lbaas | 21:44 | |
| *** mithilarun has quit IRC | 21:48 | |
| *** goldyfruit___ has joined #openstack-lbaas | 21:57 | |
| *** mithilarun has joined #openstack-lbaas | 21:58 | |
| *** goldyfruit_ has quit IRC | 22:00 | |
| *** luksky has quit IRC | 22:08 | |
| johnsom | lxkong are you around? | 22:11 |
| johnsom | I was looking at your bionic error. It's in an exception handler that is in fact missing code coverage. This is why none of our bionic gates caught it. The scenarios aren't going to get an exception from that call and the unit/functional tests are missing that exception path. | 22:14 |
| *** spatel has joined #openstack-lbaas | 22:14 | |
| johnsom | From where it happens I a guessing you are using a custom haproxy template? It looks like haproxy failed to reload for some reason. My guess is it is a modified haproxy template that has a bug. | 22:16 |
| johnsom | Also, if you happen to have that cloud-init log file from your fedora instance I would still like to review it. | 22:16 |
| *** spatel has quit IRC | 22:19 | |
| johnsom | As we all know, 92% coverage still isn't enough.... | 22:22 |
| *** mithilarun has quit IRC | 23:06 | |
| *** mithilarun has joined #openstack-lbaas | 23:15 | |
| *** goldyfruit___ has quit IRC | 23:19 | |
| openstackgerrit | Merged openstack/neutron-lbaas stable/rocky: Fix memory leak in the haproxy provider driver https://review.opendev.org/665410 | 23:36 |
| *** mithilarun has quit IRC | 23:47 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!