*** longkb has joined #openstack-lbaas | 00:32 | |
*** kiennt26 has joined #openstack-lbaas | 01:02 | |
*** hongbin has joined #openstack-lbaas | 01:18 | |
*** phuoc has quit IRC | 01:28 | |
*** phuoc has joined #openstack-lbaas | 01:28 | |
*** annp has joined #openstack-lbaas | 02:03 | |
*** hongbin has quit IRC | 03:48 | |
*** longkb has quit IRC | 04:13 | |
*** annp has quit IRC | 04:13 | |
*** longkb has joined #openstack-lbaas | 04:13 | |
*** links has joined #openstack-lbaas | 04:14 | |
*** annp has joined #openstack-lbaas | 04:14 | |
*** yamamoto has joined #openstack-lbaas | 04:28 | |
*** kobis has joined #openstack-lbaas | 04:46 | |
*** kobis has quit IRC | 05:05 | |
*** AlexeyAbashkin has joined #openstack-lbaas | 06:04 | |
*** kobis has joined #openstack-lbaas | 06:04 | |
*** nmanos has joined #openstack-lbaas | 06:18 | |
openstackgerrit | Rafal Pietrzak proposed openstack/octavia master: Adding support for the octavia listener X-Forwarded-Proto header insertion. https://review.openstack.org/573227 | 06:20 |
---|---|---|
*** pcaruana has joined #openstack-lbaas | 06:26 | |
*** yamamoto has quit IRC | 06:35 | |
*** kiennt26 has quit IRC | 06:37 | |
*** yamamoto has joined #openstack-lbaas | 06:41 | |
*** b_bezak has joined #openstack-lbaas | 07:07 | |
*** rcernin has quit IRC | 07:10 | |
*** yamamoto has quit IRC | 07:50 | |
*** links has quit IRC | 07:50 | |
*** yamamoto has joined #openstack-lbaas | 07:51 | |
*** yamamoto has quit IRC | 07:54 | |
*** yamamoto has joined #openstack-lbaas | 07:54 | |
*** yamamoto has quit IRC | 07:54 | |
*** yamamoto has joined #openstack-lbaas | 07:56 | |
*** ispp has joined #openstack-lbaas | 08:17 | |
openstackgerrit | Adit Sarfaty proposed openstack/octavia master: Use object instead of object id in the drivers delete callbacks https://review.openstack.org/571974 | 08:43 |
openstackgerrit | Adit Sarfaty proposed openstack/octavia master: Add baseline object in the drivers update callbacks https://review.openstack.org/572303 | 08:43 |
openstackgerrit | Jacky Hu proposed openstack/octavia master: fix tox python3 overrides https://review.openstack.org/572975 | 09:04 |
openstackgerrit | baiwenteng proposed openstack/octavia master: Fix typos in octavia replace seperate with separate https://review.openstack.org/574185 | 09:28 |
*** salmankhan has joined #openstack-lbaas | 09:28 | |
openstackgerrit | Jacky Hu proposed openstack/octavia master: fix tox python3 overrides https://review.openstack.org/572975 | 09:34 |
openstackgerrit | Jacky Hu proposed openstack/octavia master: fix tox python3 overrides https://review.openstack.org/572975 | 09:53 |
*** kobis has quit IRC | 10:24 | |
openstackgerrit | Merged openstack/octavia master: When SG delete fails on vip deallocate, try harder https://review.openstack.org/549263 | 10:35 |
*** kobis has joined #openstack-lbaas | 10:41 | |
openstackgerrit | Jan Zerebecki proposed openstack/neutron-lbaas master: Improve speed of listing from DB https://review.openstack.org/568361 | 11:08 |
*** atoth has joined #openstack-lbaas | 11:17 | |
*** annp has quit IRC | 11:19 | |
*** kobis has quit IRC | 11:21 | |
*** longkb has quit IRC | 11:38 | |
*** amuller has joined #openstack-lbaas | 11:51 | |
*** ivve_ is now known as ivve | 12:03 | |
*** amuller has quit IRC | 12:31 | |
*** pcaruana has quit IRC | 12:39 | |
openstackgerrit | Adit Sarfaty proposed openstack/octavia master: Providers: propose changes to create pool API https://review.openstack.org/574241 | 12:40 |
*** AlexeyAbashkin has quit IRC | 12:42 | |
*** amuller has joined #openstack-lbaas | 12:43 | |
*** amuller has joined #openstack-lbaas | 12:43 | |
*** kobis has joined #openstack-lbaas | 12:50 | |
*** kobis has quit IRC | 12:51 | |
*** kobis has joined #openstack-lbaas | 12:53 | |
*** amuller has quit IRC | 12:57 | |
*** ispp has quit IRC | 13:29 | |
*** ispp has joined #openstack-lbaas | 13:31 | |
*** dayou_ has quit IRC | 13:31 | |
*** pcaruana has joined #openstack-lbaas | 13:32 | |
*** amuller has joined #openstack-lbaas | 13:55 | |
*** gans has joined #openstack-lbaas | 14:00 | |
*** gans has quit IRC | 14:01 | |
*** ianychoi has quit IRC | 14:02 | |
*** AlexeyAbashkin has joined #openstack-lbaas | 14:04 | |
xgerman_ | o/ | 14:05 |
*** dayou has joined #openstack-lbaas | 14:09 | |
*** Alexey_Abashkin has joined #openstack-lbaas | 14:11 | |
*** yamamoto has quit IRC | 14:11 | |
*** yamamoto has joined #openstack-lbaas | 14:12 | |
*** AlexeyAbashkin has quit IRC | 14:13 | |
*** Alexey_Abashkin is now known as AlexeyAbashkin | 14:13 | |
*** yamamoto has quit IRC | 14:19 | |
cgoncalves | xgerman_, guten Tag :) | 14:22 |
xgerman_ | :-) | 14:22 |
*** yamamoto has joined #openstack-lbaas | 14:32 | |
*** mlavalle has joined #openstack-lbaas | 14:50 | |
*** ispp has quit IRC | 14:51 | |
*** fnaval has joined #openstack-lbaas | 14:51 | |
*** b_bezak has quit IRC | 14:53 | |
*** b_bezak has joined #openstack-lbaas | 14:53 | |
*** ispp has joined #openstack-lbaas | 14:54 | |
*** b_bezak has quit IRC | 14:58 | |
*** kobis has quit IRC | 15:12 | |
openstackgerrit | Merged openstack/octavia master: Amend the spelling error of a word https://review.openstack.org/572718 | 15:15 |
*** ispp has quit IRC | 15:40 | |
rm_work | guten tag herr eichberger | 16:05 |
johnsom | rm_work Morning | 16:06 |
johnsom | Jacky was busy last night fixing the pylint stuff. If you have a minute can you give your opinion on some of the exclusions? | 16:06 |
johnsom | He also bumped it all the way to 1.9.2, which I am fine with, but it brought in a bunch more tests. | 16:07 |
rm_work | morning | 16:09 |
rm_work | yeah sure | 16:09 |
rm_work | i was hesitant to add a bunch of exclusions, but ... yeah | 16:10 |
rm_work | some of those things are <_< | 16:10 |
rm_work | like `Too many nested blocks (7/5) (too-many-nested-blocks)` | 16:10 |
johnsom | Yeah, like the deprecation one, I'm not sure about | 16:10 |
rm_work | is dumb | 16:10 |
rm_work | Too many boolean expressions in if statement (6/5) (too-many-boolean-expressions) | 16:10 |
rm_work | also dumb | 16:10 |
rm_work | like wtfeven | 16:10 |
rm_work | Redefinition of app type from oslo_middleware.request_id.RequestId to octavia.common.keystone.SkippingAuthProtocol (redefined-variable-type) | 16:10 |
rm_work | that one is interesting... | 16:10 |
*** AlexeyAbashkin has quit IRC | 16:11 | |
mnaser | time for the monthly pebkac issue | 16:11 |
johnsom | I had to put a few inlines in there to get around it's ignorance of sys.PY2 | 16:12 |
mnaser | deployer trying to use ssl, we've gotten as far as making sure that all secrets and container get acl to octavia user (supe rnot user friendly but i see where the issue comes from) | 16:12 |
johnsom | mnaser Hey, how is it going? | 16:12 |
rm_work | johnsom: this one is quick if you would: https://review.openstack.org/#/c/573470/ | 16:12 |
mnaser | now creating the TERMINATED_HTTPS listener.. traceback on "InvalidRequest: Invalid request" | 16:12 |
mnaser | inside upload_config | 16:12 |
johnsom | mnaser We have a patch in the works that solves that: https://review.openstack.org/552549 | 16:12 |
mnaser | oh man that's awesome. because it was super not straight forward | 16:13 |
*** AlexeyAbashkin has joined #openstack-lbaas | 16:13 | |
johnsom | mnaser Hmmm, can you pastebin the traceback? I also suspect we need the syslog entry from that amphora instance with the amphora-agent traceback | 16:13 |
mnaser | so why would upload_config return 'Invalid request' .. a bad config? | 16:13 |
mnaser | getting to the agent might be really difficult but i'll see what i can do.. | 16:14 |
johnsom | mnaser Yeah, it's probably not passing the config validation for haproxy | 16:14 |
mnaser | http://paste.openstack.org/show/723211/ | 16:14 |
mnaser | ok so that might make it nice, if we output the config perhaps we can avoid the messing in amphora | 16:14 |
mnaser | should i drop in a LOG.info(config) | 16:14 |
johnsom | mnaser Also, under /var/lib/octavia/ somewhere there should be a "failed" or "bad" config file saved | 16:15 |
mnaser | oh even etter | 16:15 |
mnaser | in the amphora or in the controller | 16:15 |
johnsom | in the amphora | 16:15 |
* mnaser is avoiding as much as possible to go in the amphora :< | 16:15 | |
johnsom | Yeah, sorry, we haven't spent time on the admin apis into the amp to collect this stuff yet | 16:15 |
johnsom | I am guessing it is a formatting thing with the certs stored | 16:16 |
johnsom | Though that *should* have failed a cert validation at the API before it got this far | 16:16 |
mnaser | ok time to see what happens now | 16:17 |
johnsom | Did you follow this guide: https://docs.openstack.org/octavia/latest/user/guides/basic-cookbook.html#deploy-a-tls-terminated-https-load-balancer ? | 16:17 |
rm_work | mnaser: are you using the pkcs12 thing or the individual secrets in a container thing | 16:17 |
mnaser | bahahahaha | 16:17 |
mnaser | my | 16:17 |
mnaser | god | 16:17 |
mnaser | "bind 10.232.0.22:443 ssl crt /var/lib/octavia/certs/1c56b7e2-20c0-4676-b0aa-346562dac933/cloudflare origin certificate.pem" | 16:17 |
rm_work | lolwut | 16:18 |
rm_work | wait how does it even have a filename | 16:18 |
rm_work | such spaces... | 16:18 |
rm_work | i thought WE named the cert :/ | 16:18 |
johnsom | Ah, space in the filename... hmmmm | 16:18 |
johnsom | Yeah, that is a bug on our side | 16:18 |
mnaser | the secret name is | 16:18 |
rm_work | did i do something dumb | 16:18 |
rm_work | lolrly | 16:18 |
rm_work | there's no reason to not just name the cert by like | 16:19 |
rm_work | a static filename | 16:19 |
rm_work | in fact that REALLY should be what we do | 16:19 |
rm_work | my bad prolly | 16:19 |
johnsom | Yeah, I think I agree | 16:19 |
rm_work | 1 sec | 16:19 |
mnaser | yay for once it wasn't a misconfig (but maybe not yay :p) | 16:19 |
johnsom | mnaser What version are you running so we make sure to backport that far back? | 16:20 |
mnaser | queens | 16:20 |
johnsom | Awesome, no problem there | 16:20 |
rm_work | i think we can go pike? | 16:20 |
johnsom | Yeah, technically still Ocata, but I think the team is agreeing that Pike is our oldest target | 16:20 |
johnsom | Pike being v1.0 and all | 16:21 |
johnsom | mnaser We can probably have something for you by the EOD. Not sure yet if it will need an amp image rebuild yet or not. | 16:22 |
rm_work | i'm looking | 16:22 |
rm_work | it should not | 16:22 |
mnaser | johnsom: dont think it will need it, i'm looking too :) | 16:22 |
rm_work | give me one min | 16:22 |
xgerman_ | should not…. filename and haproxy.cfg are all done by the controller | 16:23 |
mnaser | https://github.com/openstack/octavia/blob/c547c63591f6c4d888aa6c5e462f0e4a91299ed2/octavia/common/jinja/haproxy/templates/macros.j2#L29-L43 | 16:23 |
mnaser | guessing not far out from here | 16:24 |
mnaser | rm_work: found it | 16:24 |
mnaser | https://github.com/openstack/octavia/blob/1f278e7ab336bb203dd4c8a01f33e8ddf5fb0220/octavia/common/jinja/haproxy/jinja_cfg.py#L205-L208 | 16:24 |
mnaser | we use the primary_cn | 16:24 |
rm_work | yeah | 16:24 |
mnaser | s/tls_cert.primary_cn/listener.tls_certificate_id/ and call it a day? | 16:24 |
rm_work | welllllllll | 16:25 |
rm_work | that leaks info | 16:25 |
rm_work | i might just do some basic cleanup on the filename | 16:25 |
mnaser | tls_cert.id ? | 16:25 |
mnaser | i dunno where it pulls that from | 16:25 |
rm_work | well | 16:25 |
johnsom | Yeah, could do the fingerprint | 16:26 |
rm_work | it's a TLSContainer data model | 16:27 |
rm_work | that id field isn't actually filled tho, lol | 16:27 |
rm_work | but it could b | 16:28 |
rm_work | we could fill it with the fingerprint | 16:28 |
johnsom | rm_work Maybe an issue here too: https://github.com/openstack/octavia/blob/master/octavia/amphorae/drivers/haproxy/rest_api_driver.py#L186 | 16:28 |
rm_work | and then use the id there later | 16:28 |
rm_work | yeah | 16:28 |
rm_work | i think those need to be consistent | 16:28 |
mnaser | so | 16:28 |
rm_work | but if we store a fingerprint in the id field | 16:29 |
rm_work | we can use ID in both places | 16:29 |
mnaser | if we fix both does that mean an amphora rebuild must be done | 16:29 |
rm_work | no | 16:29 |
rm_work | any time a config is sent, we send the tls cert and the new config | 16:29 |
johnsom | No, the second one is still server side | 16:29 |
rm_work | so they will always match | 16:29 |
mnaser | oh i see | 16:29 |
rm_work | even existing LBs will be fine on an update | 16:29 |
mnaser | it tells it where to upload, i see | 16:29 |
rm_work | (should) | 16:29 |
rm_work | ok one sec | 16:30 |
mnaser | https://github.com/openstack/octavia/blob/30bafb11d7eff23d826b39534e31acc249bfa1f3/octavia/common/tls_utils/cert_parser.py#L361-L368 | 16:30 |
mnaser | i think its generated here | 16:30 |
rm_work | yes | 16:31 |
rm_work | i'm adding in the ID there | 16:31 |
rm_work | just figuring how how to get the fingerprint from the cert with crypto | 16:31 |
*** Alexey_Abashkin has joined #openstack-lbaas | 16:35 | |
rm_work | is the fingerprint really going to be a good format? | 16:35 |
mnaser | with all the colons | 16:36 |
mnaser | i'm not sure rm_work | 16:36 |
*** AlexeyAbashkin has quit IRC | 16:36 | |
*** Alexey_Abashkin is now known as AlexeyAbashkin | 16:36 | |
mnaser | sanitize sounds liek a pain that can go wrong in some places | 16:36 |
johnsom | Yeah, maybe not. | 16:36 |
mnaser | md5sum? | 16:36 |
johnsom | Should we just SHA the cert? | 16:36 |
mnaser | yeah or that | 16:36 |
rm_work | yeah can do that | 16:37 |
mnaser | hmm | 16:37 |
mnaser | a cn can contain spaces, can it contain other things | 16:37 |
rm_work | eh | 16:37 |
rm_work | there isn't really validation | 16:37 |
rm_work | so it could be done wrong | 16:37 |
rm_work | IIRC | 16:37 |
johnsom | Yeah, e-mails, etc. We store the amp ID in the ones we generate | 16:37 |
rm_work | see: our samples had bad characters in them for a while lol | 16:37 |
mnaser | ok so best to forget about it and sha1 the cert and use that | 16:38 |
rm_work | i think SHA of the cert is fine, or md5 | 16:38 |
rm_work | yeah | 16:38 |
mnaser | would you like me to push a patch? | 16:38 |
* mnaser has free time and has to fix $customer problem so i can volunteer | 16:38 | |
rm_work | if you want, seems like you are there too | 16:38 |
mnaser | ok cool, i'll work on something | 16:38 |
rm_work | i could do it otherwise | 16:38 |
rm_work | but yeah if you do it, I can actually review it ;P | 16:38 |
mnaser | haha true | 16:38 |
openstackgerrit | Michael Johnson proposed openstack/octavia master: Implement provider drivers - Driver Library https://review.openstack.org/571358 | 16:41 |
*** Alexey_Abashkin has joined #openstack-lbaas | 16:42 | |
johnsom | mnaser BTW, instead of all that ACL stuff, many deployments just RBAC the octavia account to have access to all of the barbican containers. It's horrible security, but removed the ACL stuff until we can get the API patch done. | 16:43 |
*** AlexeyAbashkin has quit IRC | 16:44 | |
*** Alexey_Abashkin is now known as AlexeyAbashkin | 16:44 | |
mnaser | wait a second | 16:45 |
mnaser | when using sni | 16:45 |
mnaser | does it depend on the file name to pick the right certificate? | 16:46 |
johnsom | No | 16:46 |
mnaser | ret_value['crt_dir'] = os.path.join(self.base_crt_dir, listener.id) | 16:46 |
mnaser | so this won't break the behavior change of using md5'd names | 16:46 |
mnaser | context: https://github.com/openstack/octavia/blob/master/octavia/common/jinja/haproxy/jinja_cfg.py#L209-L210 | 16:46 |
johnsom | No, it's best match based on CN or in some (broken) drivers it is an ordered list. | 16:47 |
mnaser | ok cool | 16:47 |
mnaser | running pep8 locally | 16:47 |
rm_work | did you update/add tests? :P | 16:48 |
mnaser | i'll see what breaks with the change :p | 16:48 |
rm_work | would be good to DO a test with spaces in a CN and make sure the filename ends up being good | 16:48 |
mnaser | true | 16:48 |
mnaser | ill do that | 16:48 |
mnaser | ok | 17:08 |
mnaser | it looks like tls_cert.id | 17:08 |
mnaser | is equal to listener.tls_certificate_i | 17:08 |
mnaser | listener.tls_certificate_id | 17:09 |
rm_work | interesting | 17:09 |
mnaser | in tests where the id is provided | 17:09 |
rm_work | not sure HOW | 17:09 |
rm_work | AH | 17:09 |
rm_work | lol | 17:09 |
rm_work | yeah our tests are wrong tho | 17:09 |
rm_work | we never actually set it :P | 17:09 |
mnaser | OH | 17:09 |
mnaser | ;p | 17:09 |
* mnaser thinks | 17:09 | |
rm_work | i mean look at the only place we actually use that model in real code | 17:09 |
rm_work | our testing is in some places ... not great | 17:09 |
rm_work | especially around the cert stuff | 17:09 |
rm_work | we'd like to completely remove and rewrite all of cert_parser.py | 17:10 |
rm_work | it's a bit of a mess | 17:10 |
mnaser | heh okay let me see | 17:12 |
openstackgerrit | Merged openstack/octavia-dashboard master: Allow detail pages to auto refresh upon action https://review.openstack.org/561458 | 17:19 |
*** AlexeyAbashkin has quit IRC | 17:35 | |
rm_work | yeah i'm semi-out today | 17:38 |
*** kobis has joined #openstack-lbaas | 17:46 | |
*** kobis has quit IRC | 17:52 | |
openstackgerrit | Mohammed Naser proposed openstack/octavia master: Allow using spaces for primary common name in SSL certificates https://review.openstack.org/574368 | 17:55 |
openstackgerrit | Mohammed Naser proposed openstack/octavia master: Allow using spaces for primary common name in SSL certificates https://review.openstack.org/574368 | 17:57 |
mnaser | rm_work, johnsom, xgerman_ ^ :) | 17:57 |
mnaser | passes pep8 and py27 locally | 17:57 |
rm_work | looking :) | 17:57 |
rm_work | did you run functional too? | 17:57 |
mnaser | can i run functional without an existing deployment locally? | 17:57 |
mnaser | oh looks like its fixtures and all | 17:57 |
mnaser | let me run it | 17:57 |
rm_work | yeah | 17:59 |
*** kobis has joined #openstack-lbaas | 18:02 | |
mnaser | rm_work: functional: commands succeeded | 18:02 |
rm_work | will have to find a break to review later | 18:06 |
rm_work | in a day-long meetup (in-person) | 18:06 |
mnaser | np :) | 18:07 |
rm_work | mnaser: step 2: deploy it in your env :) | 18:07 |
mnaser | rm_work: i am right now ;) | 18:07 |
rm_work | woo | 18:07 |
rm_work | that is how I test all my stuff ^_^ | 18:07 |
*** salmankhan has quit IRC | 18:12 | |
mnaser | rm_work: works! | 18:16 |
rm_work | quick nits | 18:20 |
rm_work | should be easy | 18:20 |
rm_work | (just testing stuff) | 18:23 |
rm_work | code looks good ;) | 18:23 |
mnaser | rm_work: ok cool addressign them | 18:25 |
openstackgerrit | Mohammed Naser proposed openstack/octavia master: Allow using spaces for primary common name in SSL certificates https://review.openstack.org/574368 | 18:32 |
mnaser | rm_work: done! | 18:32 |
*** fnaval has quit IRC | 18:38 | |
*** fnaval_ has joined #openstack-lbaas | 18:38 | |
rm_work | cool thanks | 18:43 |
*** kobis has quit IRC | 18:55 | |
*** nmanos has quit IRC | 18:55 | |
*** kobis has joined #openstack-lbaas | 18:57 | |
*** atoth has quit IRC | 19:23 | |
mrhillsman | any thoughts on why i would be getting the following | 19:23 |
mrhillsman | https://www.irccloud.com/pastebin/DzkHNV6Z/ | 19:23 |
mrhillsman | i'm doing a simple lb create | 19:23 |
mrhillsman | i can manually create security groups no problem hitting that endpoint | 19:23 |
mrhillsman | command i am running - openstack --debug loadbalancer create --name lb1 --vip-network-id lb-mgmt-net | 19:24 |
rm_work | can you hit that from wherever the API server is running? | 19:25 |
rm_work | you might have network ACL issues? | 19:26 |
rm_work | it doesn't look like permissions so much as it literally just can't reach the URL | 19:26 |
rm_work | on that port | 19:26 |
johnsom | mrhillsman Hi Melvin, this is a configuration error. Let me get the section that is mis-configured, one minute | 19:30 |
mrhillsman | ok thx | 19:30 |
mrhillsman | sorry rm_work so late on response | 19:30 |
mrhillsman | i can hit that from anywhere | 19:30 |
mrhillsman | inside and outside where the api server is running | 19:31 |
johnsom | mrhillsman It is one of the following: | 19:31 |
johnsom | 1. Something is mis-configured for the cloud here: https://github.com/openstack/octavia/blob/master/etc/octavia.conf#L382 | 19:31 |
johnsom | 2. neutron does not have the security groups extension enabled. "openstack extension list" look for security-group | 19:32 |
johnsom | 3. The endpoint has some sort of firewall in front of it. | 19:33 |
mrhillsman | kolla bites me again it looks like | 19:34 |
johnsom | 4. The keystone endpoint for neutron is mis-configured and not listening on that IP/port | 19:34 |
mrhillsman | there is no [neutron] section :( | 19:34 |
johnsom | mrhillsman Well, in "normal" clouds, you don't need to set anything in that section | 19:34 |
mrhillsman | normal? | 19:35 |
mrhillsman | non-containerized clouds? | 19:35 |
johnsom | mrhillsman Fair point | 19:35 |
johnsom | No, just most deployments don't need to set those settings, the keystone defaults are enough | 19:35 |
mrhillsman | it is just weird that i can create a security group outside of trying osc lb ... | 19:36 |
johnsom | Like devstack doesn't set anything there | 19:36 |
mrhillsman | ok, let me dig a bit more | 19:36 |
johnsom | mrhillsman If you use the --debug on OSC does it connect to the same path? | 19:36 |
mrhillsman | yeah, that's what i used in the paste | 19:37 |
mrhillsman | without it same error | 19:37 |
johnsom | Maybe there is a security group or container config that is blocking the octavia process from reaching that endpoint? | 19:37 |
mrhillsman | ok cool, let me dig a bit more | 19:37 |
mrhillsman | appreciate the info | 19:38 |
johnsom | Sure, NP | 19:38 |
mrhillsman | ugh, something definitely going on with the firewall or some routing kungfu in the way | 19:40 |
mrhillsman | thx again | 19:40 |
mrhillsman | johnsom so if i use that override you pointed to will i be able to set it to say internal endpoint and still be able to use osc from an external host | 19:45 |
mrhillsman | for some reason there is some routing in place that from inside the container i cannot hit the public IP address of the controller | 19:46 |
johnsom | Yes, those settings should override the keystone catalog settings | 19:46 |
mrhillsman | ok thx, want to try that before i ask for something i'm likely to be told no about | 19:47 |
*** yamamoto has quit IRC | 19:51 | |
-openstackstatus- NOTICE: Zuul was restarted for a software upgrade; changes uploaded or approved between 19:30 and 19:50 will need to be rechecked | 19:56 | |
*** ispp has joined #openstack-lbaas | 20:12 | |
*** kobis has quit IRC | 20:26 | |
*** AlexeyAbashkin has joined #openstack-lbaas | 20:32 | |
*** amuller has quit IRC | 20:43 | |
*** Alexey_Abashkin has joined #openstack-lbaas | 20:46 | |
*** AlexeyAbashkin has quit IRC | 20:47 | |
*** Alexey_Abashkin is now known as AlexeyAbashkin | 20:47 | |
*** Alexey_Abashkin has joined #openstack-lbaas | 20:51 | |
*** yamamoto has joined #openstack-lbaas | 20:51 | |
*** AlexeyAbashkin has quit IRC | 20:51 | |
*** Alexey_Abashkin is now known as AlexeyAbashkin | 20:51 | |
*** AlexeyAbashkin has quit IRC | 20:56 | |
*** yamamoto has quit IRC | 20:58 | |
*** mlavalle has left #openstack-lbaas | 20:59 | |
*** AlexeyAbashkin has joined #openstack-lbaas | 21:08 | |
*** ispp has quit IRC | 21:15 | |
*** sshank has joined #openstack-lbaas | 21:47 | |
*** AlexeyAbashkin has quit IRC | 21:54 | |
*** fnaval_ has quit IRC | 22:15 | |
*** rcernin has joined #openstack-lbaas | 22:16 | |
*** SumitNaiksatam has joined #openstack-lbaas | 22:35 | |
johnsom | rm_work Able to IRC chat? | 23:29 |
rm_work | yeah | 23:29 |
johnsom | So, I am noodling on the update thing with the old objects and I'm struggling to see the real race condition. Can you refresh my memory of why we need to do anything with this "old_member"? | 23:30 |
rm_work | the listener-pool this? | 23:31 |
rm_work | *thing? | 23:31 |
rm_work | it's specifically that | 23:31 |
johnsom | Yeah, can you give me some details there? | 23:31 |
rm_work | yeah ok so | 23:31 |
rm_work | if you update a listener's default pool | 23:32 |
rm_work | we send that off to the driver | 23:32 |
johnsom | Or are you talking about Adit's listener id patch? | 23:32 |
rm_work | and then we update the DB | 23:32 |
rm_work | no | 23:32 |
rm_work | so anyway.... that much is clear, right? like if I do this: | 23:32 |
johnsom | Ok | 23:32 |
rm_work | PUT /listeners/abc1234 {'listener': {'default_pool_id': 'newpool12345'}} | 23:33 |
rm_work | it sends to the driver and then saves it to the DB | 23:33 |
johnsom | yes | 23:33 |
rm_work | the amp driver loads up, and then what it tries to do is: | 23:33 |
rm_work | well, let me just link the code | 23:33 |
johnsom | https://docs.openstack.org/octavia/latest/_images/ListenerFlows-get_update_listener_flow.svg | 23:34 |
johnsom | Well, I have the flow open | 23:34 |
rm_work | ok so | 23:34 |
rm_work | https://github.com/openstack/octavia/blob/master/octavia/common/data_models.py#L385-L407 | 23:36 |
rm_work | in the ListenerUpdate | 23:36 |
rm_work | we try to fetch the pool from the DB, via the pool_db.listeners backref | 23:37 |
rm_work | which has already been removed | 23:37 |
rm_work | so it explodes | 23:37 |
rm_work | which is the "race" | 23:37 |
johnsom | Ah, a model update. Ok, that is the part I forgot. Got it. | 23:37 |
rm_work | we need to rewrite the driver | 23:38 |
rm_work | to use the new driver lib | 23:38 |
rm_work | :( | 23:39 |
johnsom | Yeah, that is what I have been looking at today. Oslo messaging makes me not happy, but I figured out how to deal with it. | 23:39 |
rm_work | ah :/ | 23:39 |
johnsom | I don't think it's going to be that much work actually | 23:39 |
rm_work | yeah i mean | 23:40 |
rm_work | it shouldn't | 23:40 |
rm_work | i hope | 23:40 |
rm_work | in a lot of cases, the work is just "already done" | 23:40 |
rm_work | because like, that whole update-attributes task in the flow could basically disappear | 23:40 |
rm_work | because now we just immediately save the updates | 23:40 |
johnsom | Ok, that is the pointer I needed. Just looking at member update flow, I'm like... Um, don't care. | 23:40 |
rm_work | yeah | 23:40 |
rm_work | and it's not like you have to *rewrite* anything even for listener update | 23:41 |
rm_work | it's just that it was trying to do bad stuff | 23:41 |
rm_work | but it doesn't NEED to do *anything* | 23:41 |
johnsom | Yeah, we never really did the rollback thing, so... | 23:42 |
rm_work | yeah | 23:42 |
rm_work | IMO we should still just version updates and remove the need for immutability on objects | 23:42 |
* rm_work shrugs | 23:42 | |
rm_work | / just v3 things / | 23:43 |
rm_work | \ ignore me \ | 23:43 |
*** ipsecguy has quit IRC | 23:47 | |
johnsom | Ok, so pool, listener, loadbalancer, and l7policy all need updating | 23:47 |
rm_work | they do? | 23:48 |
rm_work | why | 23:48 |
rm_work | or wait, that's a little ambiguous | 23:48 |
rm_work | what do you mean exactly | 23:48 |
*** ipsecguy has joined #openstack-lbaas | 23:50 | |
rm_work | augh i need to do the TLS tests in tempest now <_< | 23:52 |
*** sshank has quit IRC | 23:53 | |
johnsom | All of those data model update methods reference the old object | 23:55 |
johnsom | For various reasons | 23:55 |
rm_work | yeah but like | 23:56 |
rm_work | i thought all of that would essentially be already finished | 23:56 |
rm_work | due to saving in the API | 23:56 |
johnsom | Yeah, maybe, I will have to evaluate each one. There are some that check if there was an object, like session persistence before but isn't now, so it goes off and deletes the SP record. Etc. | 23:57 |
rm_work | i feel like we should do that in the frontend | 23:57 |
rm_work | since ... umm | 23:57 |
rm_work | i mean, in the API | 23:57 |
rm_work | because if we're saving the object in the API side | 23:57 |
rm_work | we should do ALL that work | 23:57 |
rm_work | not just randomly orphan stuff | 23:57 |
rm_work | but IMO we may also need to figure out our "DELETED" story | 23:58 |
johnsom | Yeah, probably. | 23:58 |
rm_work | because I like that better | 23:58 |
rm_work | but it'll make our current unique-constraint on listener-port break | 23:58 |
rm_work | for example | 23:58 |
johnsom | rm_work Deleted is done in an update here: https://review.openstack.org/571358 | 23:58 |
rm_work | or rather, we already did that, but we need to fix it now | 23:58 |
rm_work | right | 23:59 |
rm_work | but remember the issue we were talking about last week | 23:59 |
rm_work | oh maybe you didn't read that scrollback | 23:59 |
johnsom | If fixed that problem already | 23:59 |
rm_work | ah ok | 23:59 |
rm_work | hpw? | 23:59 |
rm_work | *how | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!