| openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix grenade to build the test server https://review.opendev.org/762594 | 00:29 |
|---|---|---|
| *** rcernin has quit IRC | 00:42 | |
| *** rcernin has joined #openstack-lbaas | 00:43 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix pep8 failures in gate https://review.opendev.org/762565 | 00:46 |
| rm_work | why do we have to use str(e) now on Exceptions? lame | 01:33 |
| *** spatel has joined #openstack-lbaas | 01:37 | |
| *** spatel has quit IRC | 01:42 | |
| *** rcernin has quit IRC | 01:58 | |
| *** sapd1 has joined #openstack-lbaas | 02:31 | |
| rm_work | johnsom: bleh grenade failed on that ^^ | 02:54 |
| rm_work | https://66f3361aafded0fa7c12-c2be07d11a08a869365c79079919dbfe.ssl.cf5.rackcdn.com/762565/3/check/octavia-grenade/b560faf/testr_results.html | 02:54 |
| *** rcernin has joined #openstack-lbaas | 02:57 | |
| *** rcernin has quit IRC | 03:38 | |
| *** armax has quit IRC | 03:47 | |
| *** rcernin has joined #openstack-lbaas | 04:05 | |
| *** psachin has joined #openstack-lbaas | 04:53 | |
| *** rm_work has quit IRC | 04:58 | |
| *** rm_work has joined #openstack-lbaas | 04:58 | |
| *** zzzeek has quit IRC | 05:34 | |
| *** zzzeek has joined #openstack-lbaas | 05:36 | |
| *** rcernin has quit IRC | 05:39 | |
| *** rcernin has joined #openstack-lbaas | 05:42 | |
| *** rcernin_ has joined #openstack-lbaas | 06:53 | |
| *** rcernin has quit IRC | 06:54 | |
| *** rcernin_ has quit IRC | 06:59 | |
| openstackgerrit | zhangxingjun proposed openstack/python-octaviaclient master: Add batch udpating members settings https://review.opendev.org/762620 | 07:04 |
| openstackgerrit | zhangxingjun proposed openstack/python-octaviaclient master: Add batch udpating members settings https://review.opendev.org/762620 | 07:06 |
| *** xgerman has quit IRC | 07:15 | |
| *** rpittau|afk is now known as rpittau | 07:20 | |
| *** wuchunyang has joined #openstack-lbaas | 07:28 | |
| *** tkajinam has quit IRC | 08:08 | |
| *** tkajinam has joined #openstack-lbaas | 08:12 | |
| *** ccamposr has quit IRC | 08:28 | |
| *** ccamposr has joined #openstack-lbaas | 08:28 | |
| *** servagem has quit IRC | 09:00 | |
| openstackgerrit | Jay Liu proposed openstack/octavia master: Alternative Distributor for L3 Active-Active, N+1 Amphora Setup https://review.opendev.org/723864 | 09:08 |
| *** ccamposr__ has joined #openstack-lbaas | 10:23 | |
| *** ccamposr has quit IRC | 10:26 | |
| *** wuchunyang has quit IRC | 10:26 | |
| *** takamatsu has quit IRC | 11:33 | |
| *** takamatsu has joined #openstack-lbaas | 11:33 | |
| openstackgerrit | Arkady Shtempler proposed openstack/octavia-tempest-plugin master: Adding failover test. Send HTTP traffic while MASTER Amphorae is rebooted. BACKUP Amphorae should serve the traffic. https://review.opendev.org/751617 | 11:47 |
| *** TMM has quit IRC | 11:51 | |
| *** TMM has joined #openstack-lbaas | 11:51 | |
| *** servagem has joined #openstack-lbaas | 11:51 | |
| haleyb | gthiemonge: you had a change regarding test_server.bin recently, right? trying to figure out why grenade job can't find the file | 14:33 |
| gthiemonge | haleyb: https://review.opendev.org/#/c/758778/ | 14:34 |
| haleyb | ok, and that merged | 14:35 |
| gthiemonge | it is built in the test-config step | 14:35 |
| gthiemonge | haleyb: you might have to add "octavia-tempest-plugin" in the "devstack_plugins" list (-> https://review.opendev.org/#/c/758778/5/zuul.d/jobs.yaml) | 14:35 |
| haleyb | gthiemonge: i thought michael did, but maybe we need the tempest_plugins stanza as well? | 14:36 |
| haleyb | https://review.opendev.org/#/c/762565/3/zuul.d/jobs.yaml | 14:37 |
| haleyb | i'm going to try that | 14:37 |
| haleyb | oh, it's already there below | 14:38 |
| haleyb | gthiemonge: since this is grenade, do we need that change in a -1 branch? because it's running the "old" branch first? | 14:42 |
| gthiemonge | haleyb: we have these patches: https://review.opendev.org/#/q/I43b79c4c203ec5c7ecf617c449805fa963dd2db8 | 14:44 |
| * haleyb wonders how far down the rabbit hole it goes | 14:44 | |
| haleyb | gthiemonge: was looking to duplicate those... but they didn't work either it seems | 14:45 |
| haleyb | so that issue is breaking the gate, i'll need some coffee before continuing | 14:47 |
| *** rpittau is now known as rpittau|afk | 14:49 | |
| cgoncalves | the problem is devstack/grenade isn't running test-config | 14:51 |
| openstackgerrit | Gregory Thiemonge proposed openstack/python-octaviaclient master: Add tag support for Octavia resources https://review.opendev.org/762668 | 14:58 |
| haleyb | cgoncalves: is someone working on that? | 15:03 |
| cgoncalves | haleyb, not that I am aware of | 15:03 |
| cgoncalves | I have not confirmed this at 100%, so take it with a grain of salt | 15:04 |
| haleyb | cgoncalves: any idea where i can start? is the other option putting the .bin file back to fix the gate? | 15:05 |
| cgoncalves | haleyb, maybe confirm if the issue is grenade isn't calling test-config first. I like to look forward, not backward (revert valid patches) ;) | 15:06 |
| haleyb | cgoncalves: it's been 10 days is all, and i know nothing about test-config (or at least don't think i do) | 15:07 |
| haleyb | cgoncalves: i see "Building backend test server" in the logs | 15:12 |
| haleyb | cgoncalves: so i see the Building message only in the changes on master, Victoria and older nothing, so perhaps and old vs new issue | 15:26 |
| *** ianychoi has joined #openstack-lbaas | 15:30 | |
| *** TrevorV has joined #openstack-lbaas | 15:31 | |
| *** bcafarel has quit IRC | 15:32 | |
| *** bcafarel has joined #openstack-lbaas | 15:36 | |
| openstackgerrit | Brian Haley proposed openstack/octavia stable/train: Enable octavia-tempest-plugin for grenade job https://review.opendev.org/762677 | 15:53 |
| haleyb | that's not going to work, but makes me feel better to get a hack out of my system | 15:53 |
| *** armax has joined #openstack-lbaas | 15:57 | |
| johnsom | Maybe we need to make grenade non-voting to get the pep8 fix in, then figure out why Carlos’s patches are not working. Some how I missed those when looking for them | 16:07 |
| cgoncalves | Brian's patch may just do the job. I knew we had to patch stable/train (and first before newer branches) but overlooked octavia-tempest-plugin must be in the grenade var env Brian is setting | 16:10 |
| haleyb | yeah, we have to start at train and work forward, but with "old" zuul i'm flying blind as what to do | 16:10 |
| *** takamatsu has quit IRC | 16:15 | |
| *** takamatsu has joined #openstack-lbaas | 16:46 | |
| openstackgerrit | Arkady Shtempler proposed openstack/octavia-tempest-plugin master: Adding failover test. Send HTTP traffic while MASTER Amphorae is rebooted. BACKUP Amphorae should serve the traffic. https://review.opendev.org/751617 | 16:47 |
| *** TrevorV has quit IRC | 16:58 | |
| *** gcheresh has joined #openstack-lbaas | 17:25 | |
| *** psachin has quit IRC | 17:44 | |
| openstackgerrit | Brian Haley proposed openstack/octavia stable/train: Enable octavia-tempest-plugin for grenade job https://review.opendev.org/762677 | 17:48 |
| *** ccamposr has joined #openstack-lbaas | 18:29 | |
| *** ccamposr__ has quit IRC | 18:32 | |
| *** gcheresh has quit IRC | 18:39 | |
| *** ccamposr has quit IRC | 18:51 | |
| *** ccamposr has joined #openstack-lbaas | 18:52 | |
| *** xgerman has joined #openstack-lbaas | 19:18 | |
| haleyb | johnsom: so the patch still didn't work... option b would be to disable grenade in ussuri branch, merge carlos' patch there, which should fix the victoria branch, rinse/repeat | 19:22 |
| johnsom | Oh really? I thought I just saw it mostly through zuul | 19:22 |
| haleyb | well, i also disabled everything except grenade to speed it up | 19:23 |
| haleyb | as a test | 19:23 |
| johnsom | Yeah | 19:23 |
| haleyb | i need to have you review my other patches on Fridays :) | 19:23 |
| johnsom | It ran for an hour so I figured it had made it past the scp | 19:23 |
| johnsom | I'm ok with temporarily disabling grenade to get the other fixes in. | 19:24 |
| haleyb | johnsom: do you agree getting https://review.opendev.org/#/c/761221/ merged should fix later branches? at least that's my thought, so we wouldn't have to disable on master | 19:26 |
| johnsom | Well, that patch failed too. | 19:27 |
| johnsom | The train patch probably bombed because it pulled stein in | 19:29 |
| johnsom | Hmm, but still it should have ran the devstack plugin for octavia-tempest-plugin. | 19:30 |
| johnsom | I will look at this more closely | 19:31 |
| haleyb | i'm not sure it ran through test-config in tempest, at least i don't see the Building message | 19:31 |
| haleyb | that's why i figured we could start with ussuri, which should fix victoria | 19:31 |
| johnsom | Ah, you added the plugin to grenade_pluginrc, I think we need to get it local_conf. It's a devstack plugin, not a grenade plugin. | 19:40 |
| johnsom | So it's not going to get "stack" as $1 | 19:41 |
| *** gcheresh has joined #openstack-lbaas | 19:41 | |
| johnsom | Let me edit this and give that a go | 19:42 |
| openstackgerrit | Michael Johnson proposed openstack/octavia stable/train: Enable octavia-tempest-plugin for grenade job https://review.opendev.org/762677 | 19:43 |
| haleyb | johnsom: that's why they pay you the big bucks, i was trying to update based on what was there | 19:46 |
| johnsom | Wait, is test-config even a valid devstack phase? | 19:47 |
| cgoncalves | https://docs.openstack.org/devstack/latest/configuration.html | 19:47 |
| openstackgerrit | Arkady Shtempler proposed openstack/octavia-tempest-plugin master: Adding failover test. Send HTTP traffic while MASTER Amphorae is rebooted. BACKUP Amphorae should serve the traffic. https://review.opendev.org/751617 | 19:47 |
| johnsom | Cool, ok. Yeah, it must be given the scenarios aren't exploding | 19:47 |
| johnsom | So grenade doesn't run that phase? is that the issue with the "new" zuul grenade? | 19:49 |
| cgoncalves | I did not have time to have a good look at it, but that was my thinking | 19:52 |
| cgoncalves | it may not be the "new" zuul grenade if we can't get https://review.opendev.org/#/c/762677/ to pass either | 19:52 |
| cgoncalves | ^ stable/train which runs "old" zuul grenade | 19:53 |
| johnsom | Yeah, so new grenade is not running the test-config phase for some reason | 19:54 |
| johnsom | With all of the spaghetti of scripts involved, I can understand why I don't remember all of the details of how this stuff works. | 20:45 |
| haleyb | johnsom: seems the spaghetti has won | 21:15 |
| johnsom | Yeah, looking at that now | 21:15 |
| *** ccamposr__ has joined #openstack-lbaas | 21:17 | |
| *** servagem has quit IRC | 21:19 | |
| *** ccamposr has quit IRC | 21:19 | |
| *** rcernin has joined #openstack-lbaas | 21:19 | |
| johnsom | Well, at least that time it built it: https://zuul.opendev.org/t/openstack/build/9bda6335d7494eb58144aa54ce71a3d9/log/logs/old/devstacklog.txt#32716 | 21:25 |
| johnsom | It failed because it built it in the /old directory, but after the upgrade it doesn't exist in /new | 21:28 |
| haleyb | so does it scp a second time? shouldn't it already be there? | 21:31 |
| johnsom | The SCP is in the setup class for the tempest suite. | 21:32 |
| johnsom | They are fresh vms | 21:32 |
| haleyb | "run_plugins stack test-config" only happens in old | 21:35 |
| johnsom | Right, and tempest runs from new | 21:35 |
| *** ccamposr has joined #openstack-lbaas | 21:36 | |
| *** ccamposr__ has quit IRC | 21:38 | |
| johnsom | I think we should put it in a "well known" location instead of guessing a path. | 21:39 |
| haleyb | \/tmp/f-grenade/test_server.bin | 21:40 |
| johnsom | I was thinking /opt/octavia-tempest-plugin/test_server.bin myself. Started a patch. | 21:40 |
| haleyb | you're too practical | 21:41 |
| *** ccamposr__ has joined #openstack-lbaas | 21:42 | |
| johnsom | That still won't solve the new grenade issue however. | 21:43 |
| *** ccamposr has quit IRC | 21:44 | |
| johnsom | I swear my neighbor has the least efficient gardener ever. It's a small lot and he has had that leaf blower going for an hour | 21:45 |
| haleyb | i have the same neighbor, has a plug-in one and doesn't like leaves on the driveway, verrry slow | 21:46 |
| johnsom | Well this is a full power gas job. | 21:46 |
| haleyb | WHAT? :) | 21:48 |
| haleyb | he must be deaf | 21:48 |
| haleyb | so how do we fix the new? update to grenade somewhere? i don't even know where that scp line is | 21:50 |
| haleyb | octavia-tempest-plugin :( | 21:51 |
| johnsom | I'm still trying to find in grenade or devstack where it's deciding to not run the test-config phase | 21:51 |
| haleyb | it doesn't do any phases in new, just installs from my recent memory of the logs | 21:52 |
| johnsom | Oh geez, pep8 update here too. A few more mintues for this patch | 21:52 |
| haleyb | yes, you'll need to squash with the other change, kitchen sink | 21:52 |
| *** ccamposr has joined #openstack-lbaas | 21:53 | |
| johnsom | there is a pep8 patch for octavia-tempest-plugin? | 21:53 |
| haleyb | oh, no, just the octavia one. you need me to gin one up while you work on the other? | 21:54 |
| johnsom | Oh, nevermind, it was a typo | 21:54 |
| *** ccamposr__ has quit IRC | 21:55 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia-tempest-plugin master: Install test_server.bin in well known location https://review.opendev.org/762716 | 21:57 |
| openstackgerrit | Michael Johnson proposed openstack/octavia stable/train: Enable octavia-tempest-plugin for grenade job https://review.opendev.org/762677 | 21:59 |
| johnsom | Let's see if that fixes old grenade | 21:59 |
| haleyb | well it's eod here, hopefully those are happy | 22:20 |
| johnsom | Yeah, I have a while here, I will keep poking at new grenade | 22:20 |
| *** gcheresh has quit IRC | 22:21 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia stable/ussuri: Add octavia-tempest-plugin to devstack plugin list https://review.opendev.org/761221 | 22:33 |
| johnsom | I think my fix for old grenade will fix new as well. | 22:33 |
| openstackgerrit | Michael Johnson proposed openstack/octavia-tempest-plugin master: Install test_server.bin in well known location https://review.opendev.org/762716 | 22:41 |
| johnsom | helps if you have permissions | 22:41 |
| *** armax has quit IRC | 23:10 | |
| *** armax has joined #openstack-lbaas | 23:13 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!