| *** SumitNaiksatam has quit IRC | 00:00 | |
| *** vivek-eb_ has joined #openstack-lbaas | 00:18 | |
| *** vivek-ebay has quit IRC | 00:18 | |
| *** bana_k has quit IRC | 00:29 | |
| *** mlavalle has quit IRC | 00:32 | |
| *** Aish has joined #openstack-lbaas | 00:42 | |
| *** Aish has quit IRC | 00:51 | |
| *** vivek-eb_ has quit IRC | 00:53 | |
| *** ganeshna has joined #openstack-lbaas | 01:10 | |
| *** Aish has joined #openstack-lbaas | 01:12 | |
| *** Aish has quit IRC | 01:12 | |
| *** bharathm has quit IRC | 01:17 | |
| *** minwang2 has quit IRC | 01:18 | |
| *** vjay15 has joined #openstack-lbaas | 01:20 | |
| *** ganeshna has quit IRC | 01:22 | |
| *** madhu_ak has quit IRC | 01:23 | |
| *** apuimedo has quit IRC | 01:25 | |
| *** minwang2 has joined #openstack-lbaas | 01:28 | |
| *** SumitNaiksatam has joined #openstack-lbaas | 01:45 | |
| *** vjay15 has quit IRC | 01:52 | |
| *** KunalGandhi has joined #openstack-lbaas | 02:01 | |
| *** KunalGan_ has joined #openstack-lbaas | 02:13 | |
| *** KunalGandhi has quit IRC | 02:15 | |
| *** ganeshna has joined #openstack-lbaas | 02:40 | |
| *** sbalukoff has quit IRC | 02:42 | |
| xgerman | blogan doubt we have stats in octavia — should we skip that test? neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_get_load_balancer_stats[smoke] | 02:54 |
|---|---|---|
| xgerman | http://logs.openstack.org/65/223265/11/check/gate-neutron-lbaasv2-dsvm-api/4546426/console.html | 02:54 |
| *** johnsom_ has joined #openstack-lbaas | 03:09 | |
| *** ganeshna has quit IRC | 03:18 | |
| *** ganeshna has joined #openstack-lbaas | 03:19 | |
| *** minwang2 has quit IRC | 03:28 | |
| *** minwang2 has joined #openstack-lbaas | 03:35 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia: Don't build amphora image if one is available https://review.openstack.org/223922 | 03:45 |
| johnsom_ | The stats issue could be caused by controller_ip_port_list not being filled in. https://bugs.launchpad.net/octavia/+bug/1490033 | 03:56 |
| openstack | Launchpad bug 1490033 in octavia "Devstack scripts need to enable lb-network controller IP" [Critical,New] - Assigned to Brandon Logan (brandon-logan) | 03:56 |
| johnsom_ | I'm going to dig through the logs a bit and see | 03:56 |
| *** Guest58973 has quit IRC | 04:04 | |
| *** Brian has joined #openstack-lbaas | 04:12 | |
| *** Brian is now known as Guest41387 | 04:13 | |
| rm_work | hmm so we're closer | 04:24 |
| rm_work | but octavia is still failing some of the scenario and load_balancer tests | 04:24 |
| rm_work | not to mention the ones we don't have jobs for yet | 04:25 |
| *** minwang2 has quit IRC | 04:27 | |
| johnsom_ | Yep. I think on the load balancer tests it is just the stats test | 04:28 |
| *** minwang2 has joined #openstack-lbaas | 04:28 | |
| rm_work | do you know how to decode what this means for gate job selection? | 04:29 |
| rm_work | branch: ^(?!stable/(?:juno|kilo)).*$ | 04:29 |
| johnsom_ | Passed: 37 Skipped: 4 Failed: 1 | 04:29 |
| rm_work | yeah on the scenario there were a few but it looked like a cascade | 04:29 |
| rm_work | possibly from a missing WAIT or something | 04:29 |
| johnsom_ | Looks like regex | 04:29 |
| rm_work | yes | 04:30 |
| rm_work | lol | 04:30 |
| rm_work | i can kinda parse it | 04:30 |
| rm_work | but | 04:30 |
| rm_work | i am not sure exactly what it means for zuul | 04:30 |
| rm_work | i will ask in infra | 04:30 |
| *** crc32 has joined #openstack-lbaas | 04:32 | |
| rm_work | cool | 04:36 |
| rm_work | johnsom_: https://review.openstack.org/#/c/225000/ | 04:36 |
| rm_work | there's the other side | 04:36 |
| rm_work | realized i forgot to push that up before because i was trying to verify the regex was right | 04:36 |
| johnsom_ | Cool | 04:36 |
| rm_work | once "various fixes" and the "split up gate tests" patches merge, we can get that merged | 04:37 |
| rm_work | and then continue testing "set octavia as the reference" | 04:37 |
| *** vivek-ebay has joined #openstack-lbaas | 04:39 | |
| johnsom_ | Looks good to me | 04:41 |
| rm_work | we still never found out if people in infra would actually ... refuse to do this | 04:43 |
| rm_work | hopefully shouldn't be an issue | 04:43 |
| rm_work | but we did just EXPLODE the number of instances our changes take | 04:43 |
| johnsom_ | Yes, but at least they turn around faster... | 04:43 |
| johnsom_ | stats error is a sqlalchemy error: InvalidRequestError: This session is in 'prepared' state; no further SQL can be emitted within this transaction. | 04:46 |
| *** crc32 has quit IRC | 04:52 | |
| *** minwang2 has quit IRC | 05:00 | |
| *** kiran-r has joined #openstack-lbaas | 05:01 | |
| *** minwang2 has joined #openstack-lbaas | 05:02 | |
| *** kiran-r has quit IRC | 05:07 | |
| *** sbalukoff has joined #openstack-lbaas | 05:15 | |
| *** vivek-ebay has quit IRC | 05:22 | |
| *** ganeshna has quit IRC | 05:29 | |
| *** ganeshna has joined #openstack-lbaas | 05:29 | |
| *** johnsom_ has quit IRC | 05:29 | |
| *** Youcef has quit IRC | 05:31 | |
| *** openstackgerrit has quit IRC | 05:31 | |
| *** openstackgerrit has joined #openstack-lbaas | 05:31 | |
| *** Youcef has joined #openstack-lbaas | 05:32 | |
| *** KunalGandhi has joined #openstack-lbaas | 05:32 | |
| *** minwang2 has quit IRC | 05:33 | |
| *** numans has joined #openstack-lbaas | 05:34 | |
| *** KunalGan_ has quit IRC | 05:35 | |
| *** KunalGandhi has quit IRC | 05:37 | |
| *** Youcef has quit IRC | 05:42 | |
| *** Youcef has joined #openstack-lbaas | 05:46 | |
| *** kiran-r has joined #openstack-lbaas | 05:48 | |
| *** Youcef has quit IRC | 05:59 | |
| *** Youcef has joined #openstack-lbaas | 06:05 | |
| *** clev-away has quit IRC | 06:27 | |
| *** sbalukoff has quit IRC | 06:27 | |
| *** clev has joined #openstack-lbaas | 06:27 | |
| *** kiran-r has quit IRC | 06:32 | |
| *** kiran-r has joined #openstack-lbaas | 06:33 | |
| openstackgerrit | Adam Harwell proposed openstack/neutron-lbaas: Split up gate tests for LBaaSv2 https://review.openstack.org/224345 | 06:57 |
| *** woodster_ has quit IRC | 07:09 | |
| *** HenryG has quit IRC | 07:21 | |
| *** bharathm has joined #openstack-lbaas | 07:23 | |
| *** ganeshna has quit IRC | 07:30 | |
| *** ganeshna has joined #openstack-lbaas | 07:30 | |
| *** Youcef has quit IRC | 07:34 | |
| *** Youcef has joined #openstack-lbaas | 07:38 | |
| *** sbalukoff has joined #openstack-lbaas | 08:10 | |
| *** HenryG has joined #openstack-lbaas | 08:12 | |
| *** HenryG has quit IRC | 08:16 | |
| *** HenryG has joined #openstack-lbaas | 08:30 | |
| *** chlong has quit IRC | 08:47 | |
| *** Youcef has quit IRC | 08:47 | |
| *** Youcef has joined #openstack-lbaas | 08:50 | |
| *** kiran-r has quit IRC | 08:54 | |
| *** Youcef has quit IRC | 08:59 | |
| *** kiran-r has joined #openstack-lbaas | 09:01 | |
| *** ganeshna has quit IRC | 09:04 | |
| *** Youcef has joined #openstack-lbaas | 09:05 | |
| *** ganeshna has joined #openstack-lbaas | 09:06 | |
| *** Youcef has quit IRC | 09:20 | |
| *** Youcef has joined #openstack-lbaas | 09:27 | |
| rm_work | johnsom: not sure what is wrong with https://review.openstack.org/#/c/225000/ | 09:41 |
| rm_work | I am heading to bed now, will take another crack at fixing it when I wake up (lunchtime or so for you) unless you need it sooner | 09:41 |
| *** Youcef has quit IRC | 10:26 | |
| *** Youcef has joined #openstack-lbaas | 10:36 | |
| *** Guest41387 has quit IRC | 10:44 | |
| *** johnsom_ has joined #openstack-lbaas | 11:02 | |
| *** johnsom has quit IRC | 11:06 | |
| *** amotoki has joined #openstack-lbaas | 11:14 | |
| *** kiran-r has quit IRC | 11:22 | |
| *** ganeshna has quit IRC | 11:25 | |
| *** chlong has joined #openstack-lbaas | 12:06 | |
| *** chlong has quit IRC | 12:07 | |
| *** chlong has joined #openstack-lbaas | 12:07 | |
| *** Brian has joined #openstack-lbaas | 12:13 | |
| *** Brian is now known as Guest95510 | 12:14 | |
| *** Guest95510 has quit IRC | 12:18 | |
| *** denghui has joined #openstack-lbaas | 12:48 | |
| *** apuimedo has joined #openstack-lbaas | 13:09 | |
| *** denghui has quit IRC | 13:26 | |
| *** denghui has joined #openstack-lbaas | 13:28 | |
| *** woodster_ has joined #openstack-lbaas | 13:32 | |
| *** openstackgerrit has quit IRC | 13:46 | |
| *** clev is now known as clev-away | 13:46 | |
| *** openstackgerrit has joined #openstack-lbaas | 13:46 | |
| *** johnsom_ has quit IRC | 14:30 | |
| *** johnsom has joined #openstack-lbaas | 14:30 | |
| *** vjay15 has joined #openstack-lbaas | 14:48 | |
| *** ganeshna has joined #openstack-lbaas | 14:56 | |
| *** denghui has quit IRC | 15:05 | |
| *** numans has quit IRC | 15:10 | |
| *** vjay15 has quit IRC | 15:19 | |
| *** vjay15 has joined #openstack-lbaas | 15:34 | |
| *** vjay15 has quit IRC | 15:40 | |
| *** akamyshnikova has quit IRC | 15:42 | |
| *** mlavalle has joined #openstack-lbaas | 15:43 | |
| *** minwang2 has joined #openstack-lbaas | 15:49 | |
| xgerman | johnsom, rm_work, blogan: If we don’t get the issues resolved by Monday we are out :-( | 15:49 |
| *** vjay15 has joined #openstack-lbaas | 15:53 | |
| *** johnsom_ has joined #openstack-lbaas | 15:57 | |
| *** minwang2 has quit IRC | 16:00 | |
| *** SumitNaiksatam has quit IRC | 16:02 | |
| *** minwang2 has joined #openstack-lbaas | 16:03 | |
| *** ganeshna has quit IRC | 16:05 | |
| *** ganeshna has joined #openstack-lbaas | 16:06 | |
| *** ganeshna has quit IRC | 16:09 | |
| *** ganeshna has joined #openstack-lbaas | 16:09 | |
| johnsom_ | rm_work I have pushed up a patchset with the job not defined issue fixed | 16:16 |
| *** ganeshna_ has joined #openstack-lbaas | 16:22 | |
| *** ganeshna has quit IRC | 16:24 | |
| blogan | hello, sorry was away yesterday, had to go out of town for a funeral | 16:24 |
| *** vjay15 has quit IRC | 16:25 | |
| *** ganeshna has joined #openstack-lbaas | 16:26 | |
| blogan | so whats the status on the jobs right now? | 16:27 |
| blogan | intermitten api test failures? | 16:27 |
| *** ganeshna_ has quit IRC | 16:28 | |
| *** ganeshna has quit IRC | 16:33 | |
| *** johnsom__ has joined #openstack-lbaas | 16:35 | |
| *** johnsom_ has quit IRC | 16:36 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/neutron-lbaas: Updated from global requirements https://review.openstack.org/225227 | 16:39 |
| *** minwang2_ has joined #openstack-lbaas | 16:39 | |
| *** minwang2 has quit IRC | 16:42 | |
| *** minwang2_ is now known as minwang2 | 16:42 | |
| *** KunalGandhi has joined #openstack-lbaas | 16:42 | |
| johnsom__ | blogan Sorry to hear that. | 16:43 |
| *** barclaac has joined #openstack-lbaas | 16:43 | |
| johnsom__ | blogan The stats test is failing with a SQL alchemy issue. I didn't have an environment to test with last night so didn't go after it | 16:43 |
| blogan | link for logs? | 16:44 |
| xgerman | I think at that point we should just skip that test and file a bug | 16:46 |
| xgerman | stats are not that important | 16:46 |
| *** vivek-ebay has joined #openstack-lbaas | 16:46 | |
| johnsom__ | http://logs.openstack.org/65/223265/11/check/gate-neutron-lbaasv2-dsvm-api/4546426/logs/screen-q-svc.txt.gz | 16:46 |
| blogan | oh its teh stats call? | 16:46 |
| johnsom__ | InvalidRequestError: This session is in 'prepared' state; no further SQL can be emitted within this transaction. | 16:47 |
| blogan | found it | 16:47 |
| johnsom__ | I think it just needs a with session, but not positive | 16:47 |
| *** ajmiller has joined #openstack-lbaas | 16:47 | |
| blogan | hmm | 16:49 |
| *** madhu_ak has joined #openstack-lbaas | 16:49 | |
| blogan | ill try to run a quick test on it | 16:49 |
| johnsom__ | Cool, thanks | 16:49 |
| blogan | we could skip it too if its not easily fixable | 16:49 |
| johnsom__ | The split stuff passes now: https://review.openstack.org/#/c/225000/2 | 16:50 |
| xgerman | thanks — I still think @skip would be ok for the stats, too | 16:50 |
| blogan | johnsom__: passes with octavia? | 16:50 |
| mestery | blogan: https://review.openstack.org/#/c/225205/, easy one, and it can merge I think because we need it and also https://review.openstack.org/#/c/213380/ and then we fold pecan back in. Yay! | 16:50 |
| blogan | xgerman: indeed, not super improtant | 16:50 |
| johnsom__ | Just the gates to get it merged, not that lbaas tests yet | 16:50 |
| blogan | mestery: thats ready for +A? | 16:51 |
| blogan | mestery: teh first? | 16:51 |
| mestery | blogan: +2 it for me, I'm watching and I'll merge it later | 16:51 |
| mestery | Soudn ok? | 16:51 |
| blogan | okay | 16:51 |
| mestery | thanks blogan ! | 16:51 |
| blogan | mestery: i +2'ed the 2nd one but didnt +A bc of hte jenkins failure, though it looks unrelated | 16:52 |
| mestery | blogan: Yup, I'm watching them, just want a second +2 so I can merge them both when ready | 16:52 |
| mestery | Thanks! | 16:52 |
| blogan | johnsom__: so have we run the split tests against the octavia driver yet? | 16:53 |
| johnsom__ | No, just the load balancer one | 16:53 |
| blogan | johnsom__: oh okay, how long did that take? | 16:53 |
| blogan | that one should be the shortest | 16:53 |
| rm_work | johnsom__: AAAAH | 16:55 |
| rm_work | johnsom__: I see | 16:55 |
| rm_work | I was lamenting to dougwig that i didn't understand how the heck those template regexes were supposed to work | 16:56 |
| rm_work | now i see: they are explicitly defined <_< | 16:56 |
| johnsom__ | blogan About an hour, but the image build still ran in that one. I have fixed that now, so should be quicker | 16:56 |
| rm_work | johnsom__: thanks for fixing that | 16:56 |
| blogan | johnsom__: awesome | 16:56 |
| johnsom__ | NP | 16:56 |
| blogan | johnsom__: i do tink the member and health monitors will go over an hour then, but it shouldnt be too bad | 16:56 |
| rm_work | so do we want to try to push infra to push https://review.openstack.org/#/c/225000/ ASAP or do we not even care | 16:56 |
| rm_work | could we go ahead with only the LB tests passing? | 16:57 |
| xgerman | mmh, we should have all tests | 16:57 |
| johnsom__ | Yeah, we should get the full test suite going | 16:58 |
| rm_work | ok, dougwig can you help move this, or mestery | 16:58 |
| blogan | i actually wonder what mestery's opinion is of that | 16:59 |
| rm_work | heh | 17:00 |
| rm_work | mestery: still around to review our ridiculous solution? https://review.openstack.org/#/c/225000/ | 17:00 |
| johnsom__ | Hahaha | 17:00 |
| xgerman | or dougwig or armax | 17:00 |
| blogan | dougwig already gave his lukewarm approval | 17:00 |
| blogan | he can't go back now | 17:01 |
| xgerman | well, he didn’t go on record with a +1 | 17:01 |
| blogan | verbal contract, unbreakable | 17:01 |
| blogan | well technically written contract | 17:01 |
| blogan | in irc | 17:01 |
| blogan | hold up in a court of law | 17:01 |
| mestery | rm_work: Looking | 17:03 |
| mestery | rm_work: I'd like armax to look at that one too, added him there | 17:03 |
| *** johnsom__ has quit IRC | 17:05 | |
| minwang2 | does anyone edit wiki page in openstack, such as https://wiki.openstack.org/wiki/Neutron | 17:09 |
| minwang2 | i am wondering can we just edit directly on the page or need to edit in github and submit patach | 17:10 |
| minwang2 | ? | 17:10 |
| blogan | minwang2: wiki is just edit in page | 17:11 |
| rm_work | maybe just need to be logged in correctly? | 17:11 |
| rm_work | or is there a group that has permissions to edit those | 17:11 |
| minwang2 | ok, so we dont need to submit patches | 17:11 |
| *** ajmiller has quit IRC | 17:12 | |
| minwang2 | after logging in, i found the edit button, so i am thinking to edit it directly there :) | 17:12 |
| *** minwang2_ has joined #openstack-lbaas | 17:13 | |
| blogan | johnsom, xgerman: think i got the stats thing figured out | 17:15 |
| blogan | running tests to verify first | 17:15 |
| xgerman | yeah!! | 17:15 |
| *** minwang2 has quit IRC | 17:16 | |
| *** minwang2_ is now known as minwang2 | 17:16 | |
| rm_work | cool | 17:18 |
| rm_work | is it ok that we're going without having operating statuses updating yet in Neutron-LBaaS? | 17:19 |
| minwang2 | folks, this patch needs some love https://review.openstack.org/#/c/224929/ :) | 17:19 |
| rm_work | mestery / dougwig: +1 the patch again plox: https://review.openstack.org/#/c/225000/ | 17:19 |
| mestery | rm_work: yes sir | 17:20 |
| rm_work | :) | 17:20 |
| *** bana_k has joined #openstack-lbaas | 17:20 | |
| rm_work | is this patch dead/obsolete? https://review.openstack.org/#/c/209675/ | 17:22 |
| rm_work | that is essentially what is being addressed by https://review.openstack.org/#/c/223265/ right? | 17:23 |
| minwang2 | rm_work do you have any patch to edit the gate_hook and post_gate_hook | 17:24 |
| rm_work | I think https://review.openstack.org/#/c/223265/ does it | 17:24 |
| rm_work | johnsom: oh wow the LB test*only* still took 1:56!? | 17:25 |
| minwang2 | then i think we dont need mine | 17:25 |
| rm_work | ok | 17:26 |
| rm_work | can you abandon it? | 17:26 |
| *** amotoki has quit IRC | 17:26 | |
| rm_work | I think johnsom just stole your work and ported it into the new patch :P lol | 17:26 |
| rm_work | make him give you a co-authored-by line, lol | 17:27 |
| minwang2 | hahaha, it is ok, we worked together for my patch too | 17:27 |
| rm_work | yeah just abandon it and reference the new patch if you can | 17:28 |
| minwang2 | rm_work https://review.openstack.org/#/c/225000/4/zuul/layout.yaml, you may want to delete 2844-2845 | 17:28 |
| minwang2 | i will do | 17:28 |
| johnsom | We need to keep the other one as it will become the namespace test I suspect | 17:29 |
| rm_work | it doesn't hurt anyway, it's experimental and non-voting | 17:29 |
| rm_work | the next time someone needs to do anything experimental, they can edit it | 17:30 |
| minwang2 | also for name “ gate-neutron-lbaasv2-dsvm-healthmonitor”, do you want to mention something like gate-neutron-lbaasv2-octavia-dsvm-healthmonitor | 17:30 |
| rm_work | technically it is only octavia because octavia will be set as defauly | 17:30 |
| rm_work | *default | 17:31 |
| rm_work | right now it isn't even testing those against octavia, it's testing them against namespace | 17:31 |
| minwang2 | hmm, ok | 17:31 |
| rm_work | or would be, if it merged | 17:31 |
| rm_work | it's not really a "hard linkage" | 17:31 |
| johnsom | Right | 17:32 |
| rm_work | so is blogan updating https://review.openstack.org/#/c/223345/ | 17:33 |
| johnsom | So, just to summarize, let's not do anything to the experimental gate job right now. | 17:33 |
| rm_work | so that it fixes the stats issue | 17:33 |
| rm_work | yeah i also don't want to wipe that +2 :P | 17:33 |
| minwang2 | i have abandoned my patch https://review.openstack.org/#/c/209675/ | 17:34 |
| rm_work | cool thanks | 17:34 |
| *** minwang2 has quit IRC | 17:34 | |
| rm_work | is good to get stuff cleaned up | 17:34 |
| *** minwang2 has joined #openstack-lbaas | 17:35 | |
| johnsom | rm_work This is good for review now: https://review.openstack.org/#/c/223922/ (don't build image) | 17:36 |
| rm_work | ok | 17:36 |
| rm_work | did anything change since i tested it? | 17:36 |
| johnsom | I did a couple of experimental tests, but it should be basically where it was | 17:37 |
| rm_work | johnsom: what is -s 2 | 17:37 |
| rm_work | to diskimage create | 17:38 |
| johnsom | Image size 2GB | 17:38 |
| rm_work | oh right | 17:38 |
| rm_work | not a huge fan of the comments sitting around | 17:38 |
| rm_work | but | 17:38 |
| rm_work | deadlines :P | 17:38 |
| johnsom | Comments? | 17:40 |
| rm_work | the tempfix there | 17:40 |
| rm_work | with the -o | 17:40 |
| rm_work | spinning a test VM | 17:41 |
| rm_work | will +W soon | 17:41 |
| johnsom | You must be looking at a different patchset than I think you are | 17:41 |
| johnsom | Oh ptoohill | 17:41 |
| johnsom | 's old comment | 17:42 |
| johnsom | That can be a separate patch | 17:43 |
| rm_work | like i said, deadlines, don't even care | 17:43 |
| rm_work | should be ~1200s | 17:44 |
| rm_work | so, in 20m i'll +W :P | 17:44 |
| *** minwang2 has quit IRC | 17:46 | |
| ptoohill | They changed the behaviour or the function. So, my comment is more of a verification question. But I think that can be used as is and comment removed. But yea, can take a look at that for another patch. | 17:53 |
| ptoohill | of* | 17:53 |
| *** minwang2 has joined #openstack-lbaas | 17:53 | |
| rm_work | so the other thing i noticed that is killing me about a ton of neutron-lbaas / octavia -- we don't use context managers for our db sessions | 17:54 |
| rm_work | I think we are leaking db-sessions all over the place | 17:54 |
| rm_work | with db.session() as db_session: | 17:55 |
| rm_work | is so good | 17:55 |
| rm_work | it also takes care of making sure commits happen after the session is over | 17:55 |
| johnsom | I thought we had that covered in the repositories.py | 17:56 |
| rm_work | https://gist.github.com/rm-you/1450b1267d636ecb4dac | 17:57 |
| rm_work | hmm, i don't think so | 17:57 |
| rm_work | i saw a lot of stuff that looked like people making sessions and just forgetting them | 17:57 |
| rm_work | but | 17:57 |
| rm_work | maybe!? | 17:57 |
| rm_work | especially in octavia | 17:58 |
| *** harlowja has quit IRC | 17:58 | |
| *** harlowja has joined #openstack-lbaas | 17:58 | |
| johnsom | Yeah, I am talking about octavia. Most everything goes through repositories and subtransactions on one session | 17:58 |
| rm_work | ah hmm | 17:58 |
| rm_work | let me try to look | 17:58 |
| johnsom | I don't remember who set all of that up | 17:59 |
| rm_work | what about https://review.openstack.org/#/c/215359/15/octavia/controller/housekeeping/house_keeping.py,cm | 18:01 |
| rm_work | line 100 or so | 18:01 |
| rm_work | that is the first example i can think of | 18:01 |
| rm_work | where i noticed it, but i think i have seen similar elsewhere | 18:01 |
| rm_work | ah | 18:02 |
| rm_work | return facade.get_session(expire_on_commit=expire_on_commit) | 18:02 |
| rm_work | interesting | 18:02 |
| rm_work | they've abstracted this so many levels deep | 18:03 |
| johnsom | Yes, you are feeling my pain now | 18:03 |
| rm_work | context managers still seem a lot cleaner to me :/ | 18:04 |
| rm_work | johnsom: | 18:17 |
| rm_work | 2015-09-18 17:58:31.566 | +++ nova image-list | 18:17 |
| rm_work | 2015-09-18 17:58:31.566 | +++ awk '/ amphora-x64-haproxy / {print $4}' | 18:17 |
| rm_work | 2015-09-18 17:58:31.941 | ERROR (CommandError): You must provide a username or user id via --os-username, --os-user-id, env[OS_USERNAME] or env[OS_USER_ID] | 18:17 |
| rm_work | 2015-09-18 17:58:31.959 | ++ AMPHORA_IMAGE_NAME= | 18:17 |
| rm_work | johnsom: not sure it worked | 18:17 |
| rm_work | time was 1720s | 18:17 |
| rm_work | longer than expected if it downloaded | 18:17 |
| rm_work | looking through stack.sh log to see if i can find it DL but only found that error so far | 18:18 |
| johnsom | Do you have the latest global requirements updates? I thought that error was from those upstream issues. | 18:18 |
| rm_work | and | 18:18 |
| rm_work | 2015-09-18 18:01:50.047 | +++ nova image-list | 18:18 |
| rm_work | 2015-09-18 18:01:50.047 | +++ awk '/ amphora-x64-haproxy / {print $4}' | 18:18 |
| rm_work | 2015-09-18 18:01:50.506 | ERROR (ConnectionRefused): Unable to establish connection to http://23.253.20.111:8774/v2.1/ | 18:18 |
| rm_work | 2015-09-18 18:01:50.524 | ++ AMPHORA_IMAGE_NAME= | 18:18 |
| rm_work | this is literally built just now | 18:18 |
| rm_work | the whole VM is fresh | 18:18 |
| johnsom | Ok, so your keystone is broken | 18:18 |
| rm_work | hmm | 18:19 |
| johnsom | Also note, that octavia patch does not download the image. You have to put that in your localrc or in your gate_hook | 18:19 |
| rm_work | oh | 18:19 |
| johnsom | as we did | 18:19 |
| rm_work | i thought i tested it before and it totally did Download it | 18:19 |
| johnsom | That patch just doesn't build if the image came in from one of those other paths | 18:19 |
| rm_work | in fact i know it did | 18:19 |
| rm_work | did you change it? | 18:20 |
| *** crc32 has joined #openstack-lbaas | 18:20 | |
| johnsom | Maybe you tested one of the experiments when I was having trouble getting the gate to pull down the image | 18:20 |
| rm_work | my last test a day or two ago i did the exact same thing and it was downloaded for me | 18:20 |
| rm_work | hmm ok | 18:20 |
| rm_work | ah yeah i guess i see | 18:21 |
| johnsom | I didn't want download to be the "default" option for everyone. That is a bigger decision than having the gate download an image | 18:21 |
| rm_work | nothing in this patch about downloading. so yeah | 18:21 |
| rm_work | ah and by just including it in IMAGE_URLS | 18:21 |
| rm_work | glance grabs it automagically | 18:22 |
| johnsom | Yep | 18:22 |
| rm_work | ok, i'm good then | 18:22 |
| rm_work | +W | 18:22 |
| rm_work | yeah i see, this way changes *inside* octavia will always try to build the image and it will not hit the issue i was concerned about before | 18:23 |
| rm_work | but in neutron-lbaas the gate specifies the prebuilt | 18:24 |
| rm_work | neat | 18:24 |
| *** Brian has joined #openstack-lbaas | 18:24 | |
| *** Brian is now known as Guest52706 | 18:24 | |
| rm_work | you rebased back off of my changes? | 18:24 |
| rm_work | err nm | 18:25 |
| rm_work | was on the wrong patch | 18:25 |
| crc32 | hey rm_work whats the hostname for the mvn repo for CLB 1.0 again? | 18:26 |
| rm_work | crc32: you on internal IRC? | 18:26 |
| crc32 | yea. | 18:26 |
| crc32 | But I'm publicly exposed too/. | 18:26 |
| rm_work | lol | 18:28 |
| *** Guest52706 has quit IRC | 18:28 | |
| johnsom | crc32 I'm not sure that is legal in Texas? | 18:30 |
| openstackgerrit | Merged openstack/octavia: Don't build amphora image if one is available https://review.openstack.org/223922 | 18:31 |
| crc32 | yea its totally illegal now. | 18:31 |
| crc32 | I'm just as suprised as you. | 18:32 |
| crc32 | s I guess they never got the Nexus jar running? | 18:36 |
| crc32 | ping me. Am I lagged? | 18:39 |
| johnsom | rm_work Your change broke the jenkins test | 18:39 |
| rm_work | johnsom: err | 18:41 |
| rm_work | johnsom: whichwat | 18:41 |
| johnsom | Job gate-neutron-lbaasv2-dsvm-api not defined | 18:41 |
| rm_work | wat | 18:42 |
| rm_work | what still calls it | 18:42 |
| rm_work | oh that's right | 18:43 |
| rm_work | it's the neutron test >_> | 18:43 |
| rm_work | alright fff | 18:43 |
| rm_work | fixing this | 18:44 |
| crc32 | don't forget about me rm_work. | 18:44 |
| crc32 | IRC FTW right | 18:44 |
| rm_work | sorry, this stuff is really high priority T_T | 18:44 |
| crc32 | ok I'll be screwing around with it. | 18:44 |
| crc32 | do get back to me though | 18:45 |
| *** bharathm has quit IRC | 18:47 | |
| openstackgerrit | Adam Harwell proposed openstack/neutron-lbaas: Split up gate tests for LBaaSv2 https://review.openstack.org/224345 | 18:54 |
| rm_work | johnsom: ok | 18:54 |
| rm_work | johnsom: updated both sides again | 18:54 |
| rm_work | johnsom: i THINK that should do it -- renamed "-api" to "-minimal" instead of removing it, since it is being used by neutron | 18:54 |
| rm_work | johnsom: and updated our test hook to make a new case for that | 18:54 |
| rm_work | since that was our plan | 18:54 |
| rm_work | i'll wait for the jenkins +1 before doing anything | 18:55 |
| rm_work | *before poking people for reviews | 18:55 |
| crc32 | I didn't really need your help with maven. Just wanted to know how far you got before I started working on it. | 18:55 |
| crc32 | rm_work ^^ | 18:56 |
| rm_work | ah | 18:56 |
| rm_work | yeah not far | 18:56 |
| rm_work | well | 18:56 |
| rm_work | crc32: can we talk on RAX? | 18:56 |
| crc32 | yea | 18:56 |
| *** apuimedo has quit IRC | 18:57 | |
| *** Youcef has quit IRC | 19:08 | |
| openstackgerrit | Brandon Logan proposed openstack/neutron-lbaas: Various fixes for tempest tests with octavia https://review.openstack.org/223345 | 19:34 |
| xgerman | yeah? | 19:36 |
| *** bharathm has joined #openstack-lbaas | 19:39 | |
| *** madhu_ak has quit IRC | 19:41 | |
| *** minwang2 has quit IRC | 20:00 | |
| *** sballe has joined #openstack-lbaas | 20:01 | |
| *** minwang2 has joined #openstack-lbaas | 20:02 | |
| *** vivek-ebay has quit IRC | 20:20 | |
| *** apuimedo has joined #openstack-lbaas | 20:20 | |
| openstackgerrit | Brandon Logan proposed openstack/neutron-lbaas: Various fixes for tempest tests with octavia https://review.openstack.org/223345 | 20:21 |
| openstackgerrit | Brandon Logan proposed openstack/neutron-lbaas: Split up gate tests for LBaaSv2 https://review.openstack.org/224345 | 20:25 |
| openstackgerrit | Brandon Logan proposed openstack/neutron-lbaas: Set Octavia as the reference LBaaSv2 driver https://review.openstack.org/223265 | 20:25 |
| *** intr1nsic has joined #openstack-lbaas | 20:31 | |
| blogan | btw rm_work, johnsom is correct the repository does take care of the session using context manager | 20:32 |
| rm_work | yeah | 20:32 |
| rm_work | i see the facade thing | 20:32 |
| blogan | oh well thats boilerplate from oslo_db docs | 20:32 |
| rm_work | yeah | 20:33 |
| *** minwang2 has quit IRC | 20:37 | |
| openstackgerrit | Carlos Garza proposed openstack/octavia: Implementing EventStreamer https://review.openstack.org/218735 | 20:38 |
| *** minwang2 has joined #openstack-lbaas | 20:41 | |
| *** minwang2 has quit IRC | 20:50 | |
| *** vivek-ebay has joined #openstack-lbaas | 20:50 | |
| *** minwang2 has joined #openstack-lbaas | 20:57 | |
| *** vivek-ebay has quit IRC | 20:57 | |
| *** vivek-ebay has joined #openstack-lbaas | 20:57 | |
| *** Brian has joined #openstack-lbaas | 21:04 | |
| *** Brian is now known as Guest20924 | 21:05 | |
| ptoohill | of*https://review.openstack.org/#/c/224435/ | 21:08 |
| *** Guest20924 has quit IRC | 21:09 | |
| *** minwang2 has quit IRC | 21:09 | |
| johnsom | I already hooked you up on that one | 21:10 |
| rm_work | johnsom: i think everything is looking ok? so i am going to switch gears to putting out internal fires now | 21:12 |
| rm_work | ping me if you need anything | 21:12 |
| johnsom | Ok. The last gate run is just about done | 21:12 |
| johnsom | Thanks! | 21:12 |
| *** minwang2 has joined #openstack-lbaas | 21:14 | |
| *** chlong has quit IRC | 21:14 | |
| johnsom | Hmmm, one more question, looking at Ubuntu's liberty cloud archive, I don't see octavia in there.... | 21:20 |
| johnsom | Does anyone know if it's bundled into something else? | 21:20 |
| johnsom | I'm looking here: http://ubuntu-cloud.archive.canonical.com/ubuntu/dists/trusty-proposed/liberty/ | 21:21 |
| xgerman | we probably need to make sure it gets bundled | 21:22 |
| xgerman | mestery? | 21:22 |
| openstackgerrit | Carlos Garza proposed openstack/octavia: Implementing EventStreamer https://review.openstack.org/218735 | 21:24 |
| *** minwang2 has quit IRC | 21:27 | |
| *** diogogmt has joined #openstack-lbaas | 21:29 | |
| mestery | xgerman johnsom: Yes, that needs to be packaged up for Ubuntu (and Fedora). | 21:33 |
| mestery | Not sure who typically does that, likely someone from the distros | 21:33 |
| *** minwang2 has joined #openstack-lbaas | 21:33 | |
| johnsom | I see some evidence that RDO is packaging it up. Just don't see it in Ubuntu's cloud archive | 21:33 |
| *** manishg has joined #openstack-lbaas | 21:34 | |
| johnsom | blogan rm_work We had an LB create timeout. This host was slow anyway, with devstack bring up over 20 minutes too | 21:35 |
| johnsom | waiting on full logs.... | 21:35 |
| blogan | grr | 21:36 |
| blogan | well i wonder if the amp went into ERROR pretty quickly | 21:36 |
| blogan | bc we dont have that "bug" fixed where it should recognize that and put the LB in error immediately | 21:37 |
| johnsom | The log I can see shows "PENDING_CREATE" and "OFFLINE" | 21:37 |
| blogan | yeah for the LB, which would happen in the amp went into ERROR | 21:37 |
| johnsom | Yeah. Really anxious for the full log set | 21:38 |
| *** minwang2 has quit IRC | 21:43 | |
| blogan | so to hedge our bets, im working on having the tests create only one or two LBs for most of our tests, see how that goes | 21:44 |
| blogan | something we should try to do anyway i think | 21:44 |
| blogan | will require skipping some tests though | 21:44 |
| blogan | but at this point i dont care about taht | 21:44 |
| blogan | we can re-enable when we get containers or vt-x enabled | 21:44 |
| *** manishg has quit IRC | 21:46 | |
| *** manishg has joined #openstack-lbaas | 21:46 | |
| *** minwang2 has joined #openstack-lbaas | 21:50 | |
| *** manishg has quit IRC | 21:50 | |
| xgerman | yeah, anything which works by Monday is goodness | 21:51 |
| rm_work | yep | 21:56 |
| johnsom | http://logs.openstack.org/65/223265/12/check/gate-neutron-lbaas-python27/fe0f128/console.html | 21:57 |
| rm_work | that's ... a weird failure? | 21:59 |
| johnsom | Unit test failure | 21:59 |
| rm_work | the error is ERROR [neutron.api.extensions] Extension path 'neutron/tests/unit/extensions' doesn't exist! ?? | 22:00 |
| rm_work | wat | 22:00 |
| *** minwang2 has quit IRC | 22:02 | |
| *** manishg has joined #openstack-lbaas | 22:06 | |
| *** adam_g has joined #openstack-lbaas | 22:09 | |
| blogan | that error is always there, its something else | 22:11 |
| johnsom | Unit test failure is: | 22:20 |
| johnsom | AssertionError: Expected call: put('/v1/loadbalancers/test_id/listeners/test_id/pools/test_id', {'description': None, 'name': None, 'lb_algorithm': None, 'enabled': None, 'protocol': None}) | 22:20 |
| johnsom | Actual call: put('/v1/loadbalancers/test_id/listeners/test_id/pools/test_id', {'description': None, 'name': None, 'lb_algorithm': None, 'enabled': None, 'id': 'test_id', 'protocol': None}) | 22:20 |
| johnsom | The id is new | 22:20 |
| blogan | oh god it must be my changes | 22:22 |
| blogan | im dumb | 22:22 |
| johnsom | There is still some other problem or it was a slow node | 22:23 |
| blogan | that one is just a unittest | 22:24 |
| ptoohill | https://review.openstack.org/#/c/224435/ <-- it's an easy review :) | 22:26 |
| rm_work | i'm heading to dinner, but i will be online most of tonight ... and this weekend, probably, at least monitoring those changes | 22:27 |
| blogan | rm_work: isnt this like lunch time for you | 22:28 |
| rm_work | blogan: yeah but i don't make a big deal out of it :P | 22:28 |
| rm_work | technically it's breakfast since i haven't eaten yet | 22:28 |
| openstackgerrit | Phillip Toohill proposed openstack/octavia: Updates for containers functionality https://review.openstack.org/199954 | 22:28 |
| *** ptoohill is now known as pc-pothole | 22:29 | |
| blogan | argh such a dumb oversight | 22:34 |
| blogan | pushing up a fix in a few minutes | 22:34 |
| openstackgerrit | Merged openstack/octavia: Make keystone verify configurable https://review.openstack.org/224435 | 22:35 |
| johnsom | Would your fix address why the lb create failed? | 22:36 |
| openstackgerrit | Brandon Logan proposed openstack/neutron-lbaas: Various fixes for tempest tests with octavia https://review.openstack.org/223345 | 22:36 |
| blogan | johnsom: probably not, but it fixes the unit test | 22:38 |
| johnsom | Ok | 22:38 |
| blogan | johnsom: you happen to find the logs for it? | 22:38 |
| johnsom | I'm just not seeing anything in the CW log other than long times for it to come up | 22:39 |
| johnsom | http://logs.openstack.org/65/223265/12/check/gate-neutron-lbaasv2-dsvm-api/bf441ef/ | 22:39 |
| blogan | i see "No more IP Addresses avaialble on network" | 22:39 |
| johnsom | Yeah, but I think that is after we went off the rails | 22:40 |
| blogan | oh okay | 22:40 |
| blogan | well that lb did finally go active | 22:43 |
| blogan | after nearly 8 minutes | 22:43 |
| blogan | oh looking at the wrong lb | 22:44 |
| blogan | damn wish we logged what nova was responding with | 22:45 |
| *** openstackgerrit has quit IRC | 22:46 | |
| *** openstackgerrit has joined #openstack-lbaas | 22:46 | |
| johnsom | Nova had to report ready or we wouldn't go into "Could not talk to instance" | 22:47 |
| blogan | oh good point | 22:47 |
| johnsom | It's just the kernel boot and service start times after that | 22:47 |
| blogan | so services didnt start for some reason | 22:47 |
| johnsom | Or the boot time was too long. | 22:48 |
| johnsom | I think those SSLContext warnings are a successful connect to the agent | 22:48 |
| blogan | that may not be for the same lb though | 22:52 |
| blogan | there's another LB getting updated at the same time, and deleted | 22:52 |
| blogan | do we connect to the amphora on delete? | 22:52 |
| *** minwang2 has joined #openstack-lbaas | 22:52 | |
| blogan | doesnt look like it | 22:53 |
| blogan | so nvm | 22:53 |
| blogan | well im not sure | 22:53 |
| johnsom | Yeah, I struggle to come up with anything that went wrong other than timeout waiting for the amp to boot | 22:55 |
| blogan | well one thing this does show, we need better logging :) | 22:55 |
| johnsom | Yes. That I know as well | 22:55 |
| blogan | though i think we all knew that already | 22:55 |
| johnsom | We have great DEBUG logging... grin | 22:56 |
| johnsom | Which is usually all I look at | 22:56 |
| blogan | ha so in this you see like 2 lines of log | 22:56 |
| blogan | oh wait | 22:57 |
| blogan | the config isn't set to debug | 22:57 |
| blogan | so its not logging debug messages | 22:57 |
| johnsom | Right, that is my point | 22:57 |
| blogan | lol | 22:57 |
| blogan | sorry over my head | 22:57 |
| johnsom | Everything we want to know is in debug | 22:57 |
| *** manishg has quit IRC | 22:57 | |
| xgerman | ok, so we should just modify our gates to switch that on? | 22:57 |
| *** minwang2 has quit IRC | 23:04 | |
| *** minwang2 has joined #openstack-lbaas | 23:04 | |
| johnsom | I don't think it is going to tell us anything more than the amps took longer than the test timeout of five minutes to come up. | 23:14 |
| johnsom | blogan Thoughts? My vote is to push that timeout up to ten minutes | 23:15 |
| *** minwang2 has quit IRC | 23:16 | |
| *** manishg has joined #openstack-lbaas | 23:17 | |
| *** minwang2 has joined #openstack-lbaas | 23:17 | |
| xgerman | +! | 23:19 |
| xgerman | +1 | 23:19 |
| openstackgerrit | Michael Johnson proposed openstack/neutron-lbaas: Split up gate tests for LBaaSv2 https://review.openstack.org/224345 | 23:20 |
| openstackgerrit | Michael Johnson proposed openstack/neutron-lbaas: Set Octavia as the reference LBaaSv2 driver https://review.openstack.org/223265 | 23:20 |
| johnsom | I might as well rebase these are get another go started | 23:20 |
| xgerman | yep | 23:23 |
| blogan | johnsom: fine by me | 23:30 |
| johnsom | Grin. Now we have to figure out how to do that... | 23:30 |
| xgerman | ok, at least the tempest fixes are approved by Jenkins | 23:34 |
| *** manishg has quit IRC | 23:41 | |
| *** crc32 has quit IRC | 23:45 | |
| openstackgerrit | Michael Johnson proposed openstack/neutron-lbaas: Various fixes for tempest tests with octavia https://review.openstack.org/223345 | 23:47 |
| openstackgerrit | Michael Johnson proposed openstack/neutron-lbaas: Split up gate tests for LBaaSv2 https://review.openstack.org/224345 | 23:47 |
| openstackgerrit | Michael Johnson proposed openstack/neutron-lbaas: Set Octavia as the reference LBaaSv2 driver https://review.openstack.org/223265 | 23:47 |
| johnsom | Ok, giving that a go | 23:47 |
| xgerman | suspense is killing me | 23:50 |
| johnsom | Sorry to say, we have a long wait.... | 23:50 |
| xgerman | I was afraid of that | 23:51 |
| johnsom | For those playing along at home: | 23:52 |
| johnsom | https://jenkins03.openstack.org/job/gate-neutron-lbaasv2-dsvm-api/1353/console | 23:52 |
| *** bharathm has quit IRC | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!