Monday, 2019-12-09

« Sunday, 2019-12-08 Index Tuesday, 2019-12-10 »
*** irclogbot_2 has joined #openstack-lbaas00:23
*** irclogbot_2 has quit IRC00:39
openstackgerritSam Morrison proposed openstack/octavia-tempest-plugin master: Test the Availability Zone [Profile] admin API  https://review.opendev.org/69529100:44
openstackgerritSam Morrison proposed openstack/octavia-tempest-plugin master: Add new scenario test to create LB in specific AZ  https://review.opendev.org/69534900:44
openstackgerritSam Morrison proposed openstack/octavia-tempest-plugin master: Add new scenario test to create LB in specific AZ  https://review.opendev.org/69534900:47
*** irclogbot_1 has joined #openstack-lbaas01:27
*** yamamoto has joined #openstack-lbaas01:39
*** irclogbot_1 has quit IRC01:48
*** yamamoto has quit IRC02:34
*** irclogbot_0 has joined #openstack-lbaas02:47
*** ramishra has joined #openstack-lbaas03:23
*** yamamoto has joined #openstack-lbaas03:41
*** sapd1 has quit IRC05:09
*** rcernin has quit IRC07:12
*** tkajinam has quit IRC08:07
*** tesseract has joined #openstack-lbaas08:30
*** tesseract has quit IRC08:31
*** tesseract has joined #openstack-lbaas08:31
*** gcheresh_ has joined #openstack-lbaas08:32
*** maciejjozefczyk has joined #openstack-lbaas08:39
*** abaindur has joined #openstack-lbaas08:57
*** gcheresh_ has quit IRC08:58
*** abaindur_ has joined #openstack-lbaas08:58
*** abaindur has quit IRC08:58
*** gcheresh_ has joined #openstack-lbaas08:59
openstackgerritCarlos Goncalves proposed openstack/octavia master: Fix unit test when run on CentOS 7  https://review.opendev.org/69795809:05
*** abaindur_ has quit IRC09:08
*** rcernin has joined #openstack-lbaas09:11
*** rpittau|afk is now known as rpittau09:15
*** yamamoto has quit IRC09:17
*** yamamoto has joined #openstack-lbaas10:03
*** yamamoto has quit IRC10:04
*** rcernin has quit IRC10:14
*** baffle has quit IRC10:16
*** salmankhan has joined #openstack-lbaas10:38
*** salmankhan has quit IRC10:45
*** salmankhan has joined #openstack-lbaas10:45
*** salmankhan has quit IRC10:45
*** salmankhan has joined #openstack-lbaas10:45
*** yamamoto has joined #openstack-lbaas10:58
*** yamamoto has quit IRC11:03
*** yamamoto has joined #openstack-lbaas11:13
*** sapd1 has joined #openstack-lbaas11:20
*** sapd1 has quit IRC11:36
*** baffle has joined #openstack-lbaas11:39
*** pcaruana has joined #openstack-lbaas11:46
*** servagem has joined #openstack-lbaas11:47
*** yamamoto has quit IRC11:49
*** yamamoto has joined #openstack-lbaas11:50
*** yamamoto has quit IRC12:08
*** yamamoto has joined #openstack-lbaas12:45
*** goldyfruit_ has quit IRC13:19
*** jamesden_ has joined #openstack-lbaas13:35
*** jamesdenton has quit IRC13:36
*** TrevorV has joined #openstack-lbaas14:39
*** goldyfruit has joined #openstack-lbaas14:44
*** gcheresh has joined #openstack-lbaas14:44
*** gcheresh_ has quit IRC14:45
*** gcheresh has quit IRC14:49
*** gcheresh has joined #openstack-lbaas15:11
*** jamesden_ is now known as jamesdenton15:15
openstackgerritMaciej Józefczyk proposed openstack/octavia-tempest-plugin master: Run tests with algorithm supported by provider driver  https://review.opendev.org/67226415:27
*** yamamoto has quit IRC15:40
openstackgerritMichael Johnson proposed openstack/octavia master: Fix multi-listener LB with missing certificate  https://review.opendev.org/69220815:48
openstackgerritMichael Johnson proposed openstack/octavia master: Fix multi-listener LB client auth/re-encryption  https://review.opendev.org/69358615:49
*** goldyfruit_ has joined #openstack-lbaas16:01
*** goldyfruit has quit IRC16:04
*** yamamoto has joined #openstack-lbaas16:15
rm_workfffff, newer images aren't coming up on our network T_T16:16
*** maciejjozefczyk has quit IRC16:37
*** rpittau is now known as rpittau|afk16:46
*** gcheresh has quit IRC16:49
*** pcaruana has quit IRC17:31
*** salmankhan has quit IRC17:35
rm_workcgoncalves: cent8 networking isn't coming ip17:37
rm_work*coming up17:37
cgoncalvesrm_work, logs plz17:38
cgoncalves"it works in devstack"17:38
rm_workheh17:42
rm_workPM17:43
*** maciejjozefczyk has joined #openstack-lbaas18:19
*** pcaruana has joined #openstack-lbaas18:23
*** maciejjozefczyk has quit IRC18:31
*** gmann is now known as gmann_afk19:17
*** yamamoto has quit IRC19:26
*** strigazi has quit IRC19:37
*** tesseract has quit IRC19:37
*** strigazi has joined #openstack-lbaas19:40
*** strigazi has quit IRC19:46
rm_workwhy is lb_id set so late on an amp :/19:50
rm_workfixxing it19:55
*** abaindur has joined #openstack-lbaas20:05
johnsomSpares pool?20:12
rm_workno, this:20:30
openstackgerritAdam Harwell proposed openstack/octavia master: Update the lb_id on an amp earlier if we know it  https://review.opendev.org/69808220:31
rm_work(ie, because we didn't bother)20:31
rm_workbut i am gonna look at the spares-pool case now too and update so it fixes both20:31
rm_workassuming it's not better20:31
rm_workyeah it's already better if it's from a spares-pool20:34
rm_worki think20:34
*** abaindur has quit IRC20:50
*** abaindur has joined #openstack-lbaas20:50
openstackgerritGregory Thiemonge proposed openstack/octavia master: WIP Add haproxy-source backend element in DIB  https://review.opendev.org/69808620:55
rm_worki need to figure out how to test this AZ patch in devstack >_>21:04
rm_worknot sure how to make multiple AZs21:04
rm_work(and have them functional)21:04
rm_work(in a single-VM devstack)21:05
openstackgerritMerged openstack/octavia-tempest-plugin master: Test the Availability Zone [Profile] admin API  https://review.opendev.org/69529121:08
*** servagem has quit IRC21:14
*** gcheresh has joined #openstack-lbaas21:15
*** maciejjozefczyk has joined #openstack-lbaas21:17
*** maciejjozefczyk has quit IRC21:23
*** yamamoto has joined #openstack-lbaas21:25
*** pcaruana has quit IRC21:31
*** nicolasbock has joined #openstack-lbaas21:40
*** gmann_afk is now known as gmann21:48
*** gcheresh has quit IRC22:06
*** cgoncalves has quit IRC22:16
*** rcernin has joined #openstack-lbaas22:16
*** cgoncalves has joined #openstack-lbaas22:23
johnsomWell, I can at least reproduce this problem in the jobboard chain locally22:23
johnsomnormal: {0} octavia_tempest_plugin.tests.scenario.v2.test_listener.ListenerScenarioTest.test_listener_CRUD [15.744696s] ... ok22:24
johnsombad: {0} octavia_tempest_plugin.tests.scenario.v2.test_listener.ListenerScenarioTest.test_listener_CRUD [106.898265s] ... ok22:24
*** cgoncalves has quit IRC22:26
*** cgoncalves has joined #openstack-lbaas22:27
*** cgoncalves has quit IRC22:27
*** cgoncalves has joined #openstack-lbaas22:28
johnsomBlah: We are triggering a failover: https://zuul.opendev.org/t/openstack/build/a041447157eb45d3b3258e089824f438/log/controller/logs/screen-o-hm.txt.gz#78822:29
johnsomI didn't see that before22:29
openstackgerritMerged openstack/octavia master: Stop supporting xenial amphora images  https://review.opendev.org/69769522:30
*** rcernin has quit IRC22:36
johnsomSigh, I think I see what is happening.22:37
rm_workso we do this braindead thing where our CI re-writes the requirements.txt for the project it's building, based on an output from pip-freeze22:44
rm_workbut it doesn't handle any of the extra conditionals like `;pythonver` stuff22:44
rm_workor if it does, it only lists the one that's actually installed22:45
rm_workso like for us, if the versions are different (building control-plane on 3.7 but amp on cent8 which is 3.6) it breaks stuff22:45
johnsomNice, plus freeze is deprecated if I remember right22:45
rm_workthat was my cent7 issue and now my cent8 issue (after the rng fix)22:45
rm_worksince gunicorn is version-specific22:46
rm_workit just doesn't install it in the amp :D22:46
sorrisonJust been looking into the two-node devstack jobs failing. anyone know about `rsync: link_stat "/var/lib/zuul/builds/b11f9ea3accc44f7bd1d603724ef7cfd/work/ca-bundle.pem" failed: No such file or directory (2)`22:46
sorrisonWas working on Dec 4th but broken sometime after that22:47
johnsomsorrison That should be a devstack issue. I think that is for the API endpoints to be TLS enabled. We then use that ca-bundle.pem for the client calls.22:48
johnsomI'm pretty sure /work/ca-bundle.pem isn't related to all of our TLS stuff.22:48
sorrisonyeah ok, thought so22:49
johnsomMine are named differently: server_ca-chain.cert.pem, etc.22:50
sorrisonI have this https://review.opendev.org/#/c/695349/ ready for review but the job I added fails now22:50
sorrisonfor testing multi az22:50
rm_worksorrison: yeah your patch looks good to me now BTW, i just need to figure out testing locally so i can play around with some edge-cases <_<22:51
johnsomHmm, so for the jobboard thing, when we do the update test (PUT) the agent goes out to lunch somehow:22:51
johnsomhttps://www.irccloud.com/pastebin/GoY81MYQ/22:51
johnsomNo listeners or pools22:51
rm_workO_o22:52
rm_workbut they are there?22:52
rm_worklike ... you're sure they didn't get deleted like you were saying before?22:52
johnsomYeah, it is a listener test. The  pools are created in setup22:52
johnsomYeah, I don't think so, but still trying to unwind this22:53
rm_workcan you literally just add some checks right before the verify that fails?22:53
rm_workand print out what it thinks is actually on there22:53
rm_workwe can get the amp info22:54
johnsomWell, that is the health message the HM gets. Blank22:54
rm_workhmmm though yeah22:54
rm_workit'll be the same thing22:54
rm_workwe can SSH in? technically22:54
rm_workparamiko in and dump that file? :D22:54
johnsomI'm going to shutdown HM now so it doesn't failover and I should have some more time to get on the instance before tempest blows it away22:54
rm_workor just peek around the FS22:54
rm_workah22:54
rm_workyou're doing it locally, right22:54
johnsomYeah, I can reproduce it22:55
rm_workjust kill off tempest :D22:55
johnsomYeah, that only works so many times though.... lol22:55
johnsomYeah, something in the agent is messed up. The stats socket is responding:23:00
johnsomhttps://www.irccloud.com/pastebin/6ZZPxhvL/23:00
johnsomThat OPEN means the listener is healthy23:00
*** TrevorV has quit IRC23:00
openstackgerritMerged openstack/octavia master: Fix multi-listener LB with missing certificate  https://review.opendev.org/69220823:05
openstackgerritMerged openstack/octavia master: Fix multi-listener LB client auth/re-encryption  https://review.opendev.org/69358623:05
openstackgerritMerged openstack/octavia-tempest-plugin master: Add listener client authentication scenario tests  https://review.opendev.org/69360723:05
openstackgerritMerged openstack/octavia-tempest-plugin master: Add a mixed HTTP and HTTPS scenario test  https://review.opendev.org/69635823:05
johnsomOk, that last test was bad, yeah, the config file is empty for some reason23:07
johnsomI mean it has the global and defaults sections, just no listener or pool like it should.23:09
openstackgerritBrian Haley proposed openstack/octavia-lib master: Stop testing python 2  https://review.opendev.org/69313223:09
*** tkajinam has joined #openstack-lbaas23:12
*** ramishra has quit IRC23:12
* johnsom does happy dance. All front end TLS have scenario coverage now.... 23:14
johnsomThe REST driver is sending a config with no listener or pool.23:17
*** rcernin has joined #openstack-lbaas23:17
johnsomWell, this is why we are doing this work in a separate driver...23:18
rm_workyes :D23:22
johnsomYeah, ok, I think we still have code in here that expects a DB object. The stored loadbalancer has no listeners, so we are getting an empty config. I wonder why it works sometimes and not others....  Time to trace the LB down from the API call23:31
johnsomI think I made a mistake in the listener to dict patch.23:37
johnsomYeah, I wonder if I missed a change set commit. listener update is not finished converting over to dicts.23:40
johnsomAh, no, I left it as load balancer wasn't done yet. I see23:41
*** goldyfruit_ has quit IRC23:50
« Sunday, 2019-12-08 Index Tuesday, 2019-12-10 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!