| johnsom | Blah, struggling to reproduce the stable/queens issue. Trying to run the full tempest suite now. | 00:04 |
|---|---|---|
| johnsom | https://www.irccloud.com/pastebin/Wbsl8wTg/ | 00:16 |
| rm_work | <_< | 00:18 |
| rm_work | is the gate issue you're debugging intermittent, or always? | 00:19 |
| rm_work | i haven't been tracking that far back | 00:19 |
| johnsom | It must be a race. The last two that failed were RAX where the check gates that passed were inap | 00:19 |
| *** gthiemonge has quit IRC | 00:29 | |
| *** gthiemonge has joined #openstack-lbaas | 00:29 | |
| openstackgerrit | Merged openstack/octavia master: Adjust for new octavia-lib LB signature https://review.opendev.org/697365 | 01:33 |
| openstackgerrit | Merged openstack/octavia-lib master: Return tips jobs to voting https://review.opendev.org/694895 | 01:33 |
| rm_work | cool | 01:35 |
| rm_work | we're back in business | 01:35 |
| rm_work | sorrison: couple of comments, need to fix that then i guess i need to figure out how to test this with a super limited amount of resources | 02:27 |
| rm_work | (my devstack is ... like, 8G RAM) | 02:27 |
| openstackgerrit | Sam Morrison proposed openstack/octavia master: Support creating an LB in a specified availability-zone https://review.opendev.org/693762 | 02:54 |
| openstackgerrit | Sam Morrison proposed openstack/octavia master: Support creating an LB in a specified availability-zone https://review.opendev.org/693762 | 02:57 |
| openstackgerrit | Sam Morrison proposed openstack/octavia master: Support creating an LB in a specified availability-zone https://review.opendev.org/693762 | 03:33 |
| *** psachin has joined #openstack-lbaas | 03:41 | |
| *** openstackstatus has joined #openstack-lbaas | 03:41 | |
| *** ChanServ sets mode: +v openstackstatus | 03:41 | |
| openstackgerrit | Merged openstack/octavia stable/queens: Fix a potential race condition with certs-ramfs https://review.opendev.org/694826 | 04:11 |
| *** tkajinam has quit IRC | 05:02 | |
| *** tkajinam has joined #openstack-lbaas | 05:04 | |
| *** tkajinam_ has joined #openstack-lbaas | 05:35 | |
| *** tkajinam has quit IRC | 05:38 | |
| *** rcernin has quit IRC | 06:03 | |
| *** ataraday_ has quit IRC | 06:18 | |
| *** vishalmanchanda has joined #openstack-lbaas | 07:18 | |
| *** rcernin has joined #openstack-lbaas | 07:25 | |
| *** yamamoto has joined #openstack-lbaas | 07:50 | |
| *** pcaruana has joined #openstack-lbaas | 08:11 | |
| *** tkajinam_ has quit IRC | 08:16 | |
| *** rpittau|afk is now known as rpittau | 08:21 | |
| *** maciejjozefczyk has joined #openstack-lbaas | 08:24 | |
| *** tesseract has joined #openstack-lbaas | 08:31 | |
| openstackgerrit | yuanrunsen proposed openstack/octavia master: Fix create loadbalancer error. https://review.opendev.org/697224 | 08:50 |
| openstackgerrit | yuanrunsen proposed openstack/octavia master: Fix create loadbalancer error. https://review.opendev.org/697224 | 08:55 |
| openstackgerrit | Carlos Goncalves proposed openstack/octavia master: Add support for CentOS 8 amphora images https://review.opendev.org/697128 | 09:24 |
| *** gcheresh has joined #openstack-lbaas | 09:29 | |
| *** salmankhan has joined #openstack-lbaas | 09:53 | |
| *** yamamoto has quit IRC | 09:56 | |
| *** gcheresh has quit IRC | 09:59 | |
| *** gcheresh has joined #openstack-lbaas | 10:07 | |
| *** abaindur has quit IRC | 10:10 | |
| *** rcernin has quit IRC | 10:12 | |
| *** rcernin has joined #openstack-lbaas | 10:15 | |
| *** gcheresh has quit IRC | 10:24 | |
| *** rcernin has quit IRC | 10:33 | |
| openstackgerrit | Carlos Goncalves proposed openstack/octavia master: Gate on octavia-v2-dsvm-tls-barbican https://review.opendev.org/697644 | 10:36 |
| *** servagem has joined #openstack-lbaas | 10:44 | |
| *** ramishra has quit IRC | 11:15 | |
| *** yamamoto has joined #openstack-lbaas | 11:27 | |
| *** ramishra has joined #openstack-lbaas | 11:31 | |
| *** yamamoto has quit IRC | 11:50 | |
| *** yamamoto has joined #openstack-lbaas | 11:58 | |
| *** yamamoto has quit IRC | 11:58 | |
| *** maciejjozefczyk has quit IRC | 12:24 | |
| *** maciejjozefczyk has joined #openstack-lbaas | 12:24 | |
| *** yamamoto has joined #openstack-lbaas | 12:25 | |
| *** salmankhan1 has joined #openstack-lbaas | 13:05 | |
| *** salmankhan has quit IRC | 13:05 | |
| *** salmankhan1 is now known as salmankhan | 13:05 | |
| *** falencastro has quit IRC | 14:19 | |
| *** falencastro has joined #openstack-lbaas | 14:37 | |
| *** goldyfruit___ has joined #openstack-lbaas | 14:41 | |
| *** goldyfruit___ is now known as goldyfruit | 15:07 | |
| *** TrevorV has joined #openstack-lbaas | 15:15 | |
| *** KeithMnemonic has joined #openstack-lbaas | 15:29 | |
| *** gcheresh has joined #openstack-lbaas | 15:40 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia stable/rocky: Fix catching driver exceptions https://review.opendev.org/681780 | 15:58 |
| *** gcheresh has quit IRC | 16:10 | |
| *** maciejjozefczyk has quit IRC | 16:16 | |
| rm_work | cgoncalves / haleyb: how is cent7 py3 going? | 16:16 |
| rm_work | i just realized internally we deploy cent amps and are switching to py3 and are now behind <_< | 16:17 |
| haleyb | rm_work: it's a non-starter, better to focus on cent8, at least on the controller patches i was working on | 16:17 |
| rm_work | kk | 16:18 |
| rm_work | i thought you said you had a patch going for it | 16:18 |
| rm_work | but, gave up? | 16:18 |
| rm_work | i'm ok with cent8 amp | 16:18 |
| rm_work | if that's working | 16:18 |
| rm_work | so i can help review that | 16:18 |
| haleyb | i gave up, carlos had a patch for cent8, haven't checked it today | 16:19 |
| cgoncalves | centos 8 amp is ready for review | 16:19 |
| johnsom | FYI, stable branch release proposed: https://review.opendev.org/697688 | 16:20 |
| cgoncalves | https://review.opendev.org/#/c/697128/ | 16:20 |
| cgoncalves | https://review.opendev.org/#/c/697336/ | 16:20 |
| johnsom | Note that queens is now in extended maintenance, so we cannot cut releases for it any longer. | 16:20 |
| cgoncalves | depends on https://review.opendev.org/#/c/696454/ | 16:20 |
| cgoncalves | johnsom, thank you | 16:20 |
| johnsom | coreycb https://review.opendev.org/697688 | 16:21 |
| coreycb | johnsom: awesome, thanks so much | 16:21 |
| johnsom | coreycb We also patched queens, but it is in extended maintenance, so we can't cut any more releases. | 16:22 |
| coreycb | johnsom: great, thanks. I can cherry-pick from there then. | 16:24 |
| johnsom | coreycb Here is a list: | 16:24 |
| johnsom | https://www.irccloud.com/pastebin/5rtJa06d/ | 16:24 |
| rm_work | johnsom: https://review.opendev.org/#/c/696454/ | 16:24 |
| rm_work | plz | 16:24 |
| coreycb | johnsom: thanks | 16:25 |
| johnsom | rm_work Why did you leave the py2 centos 7? | 16:27 |
| rm_work | someone's comment i think? | 16:28 |
| cgoncalves | hmm? I removed it in one of my patch sets | 16:28 |
| cgoncalves | https://review.opendev.org/#/c/696454/4/zuul.d/projects.yaml | 16:28 |
| johnsom | ok | 16:28 |
| rm_work | err | 16:29 |
| rm_work | actually i don't see it | 16:29 |
| rm_work | yeah | 16:29 |
| johnsom | It is still defined in the jobs | 16:29 |
| cgoncalves | the job definition needs to stay. stable branches use it | 16:29 |
| johnsom | octavia-v2-dsvm-py2-scenario-centos-7 | 16:29 |
| johnsom | Ah, right, got it | 16:29 |
| rm_work | ahh you meant in jobs, not projects | 16:29 |
| johnsom | We need to decide how we want to add that IPv6 job to the main repo. | 16:30 |
| haleyb | cgoncalves: one comment on https://review.opendev.org/#/c/696454/ - seems there's one more straggler | 16:31 |
| haleyb | but since it just got a +W i can do it in a follow-on | 16:31 |
| cgoncalves | haleyb, codesearch only searches in master branch | 16:31 |
| haleyb | cgoncalves: so that's used in stable somewhere? | 16:32 |
| cgoncalves | haleyb, https://github.com/openstack/octavia/blob/stable/train/zuul.d/projects.yaml#L38 | 16:33 |
| haleyb | cgoncalves: thanks, and since it's branchless we'd break that it seems | 16:35 |
| *** falencastro has quit IRC | 16:36 | |
| rm_work | eugh i really wish we could build amphorae inside a container | 16:36 |
| rm_work | but DIB requires some special privs that are denied by default in docker T_T | 16:36 |
| johnsom | rm_work Ian is working on that right now | 16:38 |
| rm_work | ah, sweet | 16:38 |
| rm_work | like *as we speak* right now? | 16:38 |
| rm_work | or it's on his TODO list | 16:39 |
| *** yamamoto has quit IRC | 16:40 | |
| johnsom | Like right now I think | 16:40 |
| johnsom | https://review.opendev.org/#/c/693971/ | 16:40 |
| *** yamamoto has joined #openstack-lbaas | 16:41 | |
| *** yamamoto has quit IRC | 16:41 | |
| rm_work | uhh, i don't know if that's the same issue | 16:41 |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Stop supporting xenial amphora images https://review.opendev.org/697695 | 16:43 |
| rm_work | hmm the topic seems like it's the right thing | 16:44 |
| rm_work | but i don't see how this patch fixes the issue | 16:44 |
| johnsom | Yeah, I thought the end goal there was to have a docker image that can build images. Admittedly I am not following closely. | 16:45 |
| johnsom | Well, there is a chain of related stuff and it's not merged yet.... | 16:45 |
| rm_work | yeah | 16:46 |
| rm_work | i mean, we have a docker image set up that has all the required stuff... | 16:46 |
| rm_work | but there's some SYS perms that aren't granted normally | 16:46 |
| rm_work | and we don't have control of the env to set them (if that was even a good idea) | 16:47 |
| johnsom | Yeah, I'm sure it's some of that filesystem stuff that the cgroup doesn't like | 16:47 |
| rm_work | it's been too long, forgot the exact error | 16:47 |
| rm_work | i'll try soon maybe | 16:47 |
| johnsom | It works fine in a venv, I do that all the time. | 16:47 |
| rm_work | not a venv | 16:48 |
| rm_work | k8s env | 16:48 |
| johnsom | I know you want docker, I just saying if you want python isolation, venv works fine | 16:48 |
| rm_work | no, our build system is k8s | 16:48 |
| rm_work | so we have to do some BS to spin up a cloud VM from within our k8s build job, build the amp image on it, and copy it back | 16:49 |
| rm_work | it's not that i would like to add isolation, it's that we have to do annoying workarounds to even make it work now | 16:50 |
| rm_work | and it breaks often | 16:50 |
| *** rpittau is now known as rpittau|afk | 16:51 | |
| rm_work | python isolation is not the goal, heh | 16:53 |
| johnsom | Right, I understand. | 16:54 |
| johnsom | problem == k8s | 16:54 |
| *** psachin has quit IRC | 16:55 | |
| johnsom | Ok, triaged some stories and ask.o.o. | 17:18 |
| rm_work | johnsom: our API uses apache-modwsgi to run in our gates right? | 17:19 |
| johnsom | No, I don't think so | 17:19 |
| rm_work | orly ok | 17:19 |
| rm_work | i thought everything moved to that | 17:19 |
| johnsom | We run uwsgi and proxy through apache. Just a sec I will refresh my memory | 17:20 |
| johnsom | Yeah, the apache config is "ProxyPass "/load-balancer" "unix:/var/run/uwsgi/octavia-wsgi.socket|uwsgi://uwsgi-uds-octavia-wsgi/" retry=0 | 17:20 |
| johnsom | " | 17:20 |
| johnsom | It's really uwsgi doing the serving | 17:21 |
| johnsom | There were some problems/limitations/scale issues with modwsgi if I remember right | 17:21 |
| *** KeithMnemonic has quit IRC | 17:22 | |
| *** pcaruana has quit IRC | 17:23 | |
| rm_work | running into issues with modwsgi and py37 on rhel7 T_T | 17:24 |
| johnsom | Well, there you go | 17:24 |
| johnsom | lol | 17:24 |
| rm_work | as in, it just won't run at all | 17:24 |
| *** tesseract has quit IRC | 17:35 | |
| *** yamamoto has joined #openstack-lbaas | 17:41 | |
| *** yamamoto has quit IRC | 17:49 | |
| *** salmankhan has quit IRC | 17:51 | |
| openstackgerrit | Merged openstack/octavia-tempest-plugin master: Disable py2 jobs on master https://review.opendev.org/696454 | 18:37 |
| openstackgerrit | Merged openstack/octavia master: Add support for CentOS 8 amphora images https://review.opendev.org/697128 | 18:37 |
| rm_work | cgoncalves: is the default amphora_os_release still 7? | 18:44 |
| johnsom | For centos yes | 18:45 |
| rm_work | kk | 18:47 |
| *** armax has joined #openstack-lbaas | 19:40 | |
| *** TrevorV has quit IRC | 20:27 | |
| *** servagem has quit IRC | 21:26 | |
| *** irclogbot_0 has quit IRC | 21:45 | |
| *** yamamoto has joined #openstack-lbaas | 21:47 | |
| *** yamamoto has quit IRC | 21:52 | |
| *** goldyfruit has quit IRC | 22:12 | |
| *** ramishra has quit IRC | 23:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!