| *** harlowja has quit IRC | 00:06 | |
| openstackgerrit | Merged openstack/octavia: Stop depending on tripleo-image-elements https://review.openstack.org/356590 | 00:07 |
|---|---|---|
| johnsom | Something is still broken. Amps are still failing over | 00:27 |
| *** harlowja has joined #openstack-lbaas | 00:34 | |
| rm_work | yeah DIB is just not respecting my settings | 00:43 |
| rm_work | can't make it happen | 00:43 |
| rm_work | it *will not* use my repo | 00:43 |
| rm_work | probably the heartbeat code has some py2 stuff | 00:45 |
| johnsom | Yeah, I'm not sure. It seems to be working ok locally | 00:45 |
| johnsom | It has to be something the test is triggering | 00:46 |
| *** zhouyaguo has quit IRC | 00:46 | |
| rm_work | hmm | 00:46 |
| rm_work | well i still can't test locally >_< | 00:46 |
| *** zhouyaguo has joined #openstack-lbaas | 00:49 | |
| johnsom | I guess I could put an image somewhere for you | 00:50 |
| rm_work | i need to resolve this issue... | 00:53 |
| bana_k | why do we have default pool for the loadbalancer and what does it mean if we add one ? is it used only for l7 ? | 01:03 |
| rm_work | default pool is only for l7 | 01:03 |
| bana_k | rm_work thanks ! | 01:03 |
| johnsom | Yes, a default pool is used when none of the l7 rules match | 01:03 |
| bana_k | got it, thanks johnsom ! | 01:04 |
| *** fnaval has joined #openstack-lbaas | 01:05 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia: Amphora-agent should log to a distinct location https://review.openstack.org/410487 | 01:08 |
| johnsom | The health thread logging still seems to go to stdout.... | 01:09 |
| rm_work | hmmm | 01:09 |
| johnsom | But the api requests go to the new file | 01:09 |
| rm_work | yeah | 01:09 |
| rm_work | health sender isn't run with gunicorn | 01:09 |
| rm_work | it's just a python process | 01:10 |
| rm_work | LOG = logging.getLogger(__name__) | 01:10 |
| rm_work | using that | 01:10 |
| rm_work | we split it off before we hit the gunicorn stuff | 01:10 |
| johnsom | Right | 01:10 |
| johnsom | So, maybe we need another file for the health stuff. | 01:10 |
| rm_work | probably wouldn't be a bad idea | 01:10 |
| rm_work | you said removing your .cache helped somehow? | 01:11 |
| rm_work | WTF | 01:11 |
| rm_work | ~/.cache/image-create/source-repositories/amphora_agent_022110a20994e6b763f32e9bbfd21a0fc6659d62/ | 01:11 |
| rm_work | ~/.cache/image-create/source-repositories/amphora_agent_022110a20994e6b763f32e9bbfd21a0fc6659d62/ | 01:12 |
| rm_work | oops | 01:12 |
| rm_work | anyway | 01:12 |
| rm_work | git log there | 01:12 |
| johnsom | Yeah, I usually end up with "missing reference" errors when stacking. It seems to use the .cache version and not the local one | 01:12 |
| rm_work | shows the right commit | 01:12 |
| rm_work | but it STILL isn't on the amp | 01:12 |
| johnsom | Want to post your devstack log? | 01:13 |
| rm_work | sure... minute | 01:13 |
| *** fnaval has quit IRC | 01:15 | |
| *** fnaval has joined #openstack-lbaas | 01:15 | |
| rm_work | johnsom: https://gist.githubusercontent.com/rm-you/6f56c37501f8a1801ee733a32557acd0/raw/e4702d97ae1d1bbd2bc6a16cdf13fde11fbcedcd/gistfile1.txt | 01:19 |
| *** kevo has quit IRC | 01:19 | |
| *** fnaval has quit IRC | 01:19 | |
| *** bana_k has quit IRC | 01:21 | |
| johnsom | rm_work The git -C is failing, so devstack is setting your ref to blank | 01:21 |
| rm_work | gah wait | 01:21 |
| rm_work | OH the plugin is doing it | 01:21 |
| rm_work | fffff | 01:21 |
| johnsom | d /opt/stack/octavia/devstack/plugin.sh:build_octavia_worker_image:32 [m git -C /opt/stack/octavia log -1 --pretty=format:%H | 01:21 |
| rm_work | because i have it set in my bash_profile | 01:21 |
| johnsom | Unknown option: -C | 01:21 |
| rm_work | yeah | 01:21 |
| rm_work | i had to change the command | 01:21 |
| johnsom | export DIB_REPOREF_amphora_agent= | 01:21 |
| johnsom | Cloning from amphora-agent cache and applying ref master | 01:24 |
| johnsom | Note: checking out 'd2c0c16574cd93ee21971a1b95e6cedcde78ce66'. | 01:24 |
| johnsom | HEAD is now at 547d03a Merge "Add support for diskimage-builder tracing" | 01:24 |
| johnsom | Updating cache of /opt/stack/octavia in /opt/stack/.cache/image-create/source-repositories/amphora_agent_022110a20994e6b763f32e9bbfd21a0fc6659d62 with ref master | 01:25 |
| johnsom | Yeah, so it's definitely getting the wrong ref | 01:25 |
| *** harlowja has quit IRC | 01:25 | |
| xgerman | are the ref’s still controlled in that element file? | 01:30 |
| johnsom | Yes and no. | 01:31 |
| johnsom | There is a default in the element, go pull master | 01:31 |
| johnsom | However, there is also an override | 01:31 |
| johnsom | The two environment variables adam is trying to set. | 01:31 |
| johnsom | The devstack plugin.sh sets those to use /opt/stack/octavia and the last commit | 01:32 |
| xgerman | ah, that’s changed then from the last time I ran it | 01:33 |
| johnsom | Yeah, likely | 01:33 |
| rm_work | ok so i need to either: fix git... or | 01:35 |
| rm_work | remove that line from our plugin | 01:35 |
| rm_work | because i've already set it | 01:35 |
| johnsom | Removing the line will get real old. | 01:35 |
| johnsom | What is up with git? centos have some strange version? | 01:35 |
| rm_work | yeah | 01:35 |
| rm_work | yeah it's ooooool | 01:35 |
| rm_work | ooooooold | 01:35 |
| rm_work | need to figure out how to update it | 01:36 |
| rm_work | but i'm not a centos guy | 01:36 |
| rm_work | what version of git is on your box | 01:36 |
| rm_work | centos is 1.8 | 01:36 |
| rm_work | my system (osx) is 2.9.3 | 01:36 |
| rm_work | i can script this hack along with all the rest of the hacks i've scripted.... | 01:37 |
| rm_work | Package git-1.8.3.1-6.el7_2.1.x86_64 already installed and latest version | 01:38 |
| johnsom | 1:2.7.4-0ubuntu1 | 01:39 |
| johnsom | git version 1.9.1 on 14.04 | 01:39 |
| rm_work | heh | 01:40 |
| rm_work | there SHOULD be a newer version in some repo ..... | 01:41 |
| xgerman | so repel and elrepo don’t have the new stuff? | 01:41 |
| rm_work | looks like not? | 01:41 |
| rm_work | i don't even know how to tell | 01:41 |
| xgerman | yeah, my centos days are well in the past | 01:41 |
| rm_work | what's the equiv command to "apt-cache policy git" | 01:42 |
| korean101 | hi guys. | 01:42 |
| korean101 | should i only use auth_version 2? | 01:43 |
| korean101 | not v3? | 01:43 |
| korean101 | (in octavia) | 01:43 |
| rm_work | i really don't like rpm distros T_T | 01:43 |
| korean101 | newton release | 01:43 |
| xgerman | rm_work: googling for fun and profit: http://stackoverflow.com/questions/21820715/how-to-install-latest-version-of-git-on-centos-6-x-7-x | 01:43 |
| rm_work | korean101: it depends on your keystone setup i think | 01:43 |
| xgerman | see how they disable repos | 01:44 |
| chenhb | hi,rm_work. How is this problem about installing octavia with devstack? We noted that the error information has changed | 01:44 |
| korean101 | rm_work: Does not Octavia force to use only auth v2? | 01:44 |
| rm_work | I believe we should support v2 or v3 | 01:45 |
| korean101 | rm_work: many thanks | 01:45 |
| johnsom | korean101 We have supported both v2 and v3. | 01:45 |
| *** yamamoto has joined #openstack-lbaas | 01:45 | |
| rm_work | ok | 01:45 |
| xgerman | yep, that is my take, too | 01:46 |
| rm_work | got it via some random dude's repo | 01:46 |
| rm_work | scripting this... | 01:46 |
| johnsom | I am really suprised that centos 7 would have that old of version | 01:46 |
| johnsom | Someone reported a but about that, but they wanted to change the script in a not so good way if I remember | 01:47 |
| korean101 | and anyone knows this message? (Driver error: HTTPConnectionPool(host='127.0.0.1', port=9876): Max retries exceeded with url: /v1/loadbalancers/ef290ebf-691c-4ffc-ba36-b4699fbe0d84) | 01:47 |
| korean101 | i don't know why /v1/loadbalancers | 01:47 |
| johnsom | Yes, that came in new. It's a bug | 01:48 |
| korean101 | johnsom: to me? | 01:48 |
| johnsom | Yes | 01:48 |
| korean101 | korean101: OMG | 01:48 |
| korean101 | johnsom: but i succeed 'lbaas-loadbalancer-create' in (devstack stable/newton) | 01:49 |
| johnsom | It snuck in during this DIB issue | 01:49 |
| johnsom | Yes, the command succeeds, but it is telling you it is still in PENDING_CREATE. You have to check the status to see if it finished | 01:50 |
| korean101 | johnsom: OMG | 01:50 |
| korean101 | johnsom: yes. i got "provisioning_status | PENDING_CREATE" | 01:51 |
| johnsom | The API is asynchronus | 01:51 |
| korean101 | johnsom: snuck -> stuck? | 01:51 |
| johnsom | Yes, for now. It will eventually go to ERROR | 01:52 |
| rm_work | ok, fixed my scripts, this has cost me a day... i feel dumb for not catching it in the devstack log though | 01:52 |
| rm_work | HOPEFULLY this should now work | 01:52 |
| *** yamamoto has quit IRC | 01:53 | |
| johnsom | korean101 Try checking out this version of octavia: https://review.openstack.org/#/c/410345/ | 01:54 |
| johnsom | It has most of the fixes and seems to be working ok. | 01:54 |
| johnsom | There is still a bug we are trying to track down | 01:54 |
| korean101 | johnsom: very appreciate | 01:57 |
| johnsom | Sure, sorry for all this trouble. This has been the worst two weeks for the project IMO | 01:57 |
| korean101 | johnsom: Could you tell when the newton release will stable? | 01:57 |
| korean101 | johnsom: Oh. thanks | 01:57 |
| johnsom | Not sure, I would hope this week | 01:58 |
| korean101 | johnsom: that's christmas present for me :) | 01:58 |
| *** fnaval has joined #openstack-lbaas | 01:58 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia: Revert "Create Octavia api V2 directory" https://review.openstack.org/411568 | 02:04 |
| johnsom | Let's see if this fixes the octavia gate and the "retries /v1/loadbalancer" | 02:04 |
| openstackgerrit | Michael Johnson proposed openstack/octavia: Revert "Create Octavia api V2 directory" https://review.openstack.org/411568 | 02:06 |
| johnsom | Ok, time to make dinner. Catch you folks tomorrow | 02:07 |
| *** armax has quit IRC | 02:27 | |
| korean101 | johnsom: but operating_status changed ' PENDING_CREATE -> ONLINE' | 02:30 |
| korean101 | (on devstack) | 02:30 |
| *** chenhb has quit IRC | 02:37 | |
| *** gongysh has joined #openstack-lbaas | 02:37 | |
| *** chenhb has joined #openstack-lbaas | 02:37 | |
| *** yamamoto has joined #openstack-lbaas | 02:54 | |
| *** ducttape_ has joined #openstack-lbaas | 02:58 | |
| *** ducttape_ has quit IRC | 03:02 | |
| *** ducttape_ has joined #openstack-lbaas | 03:04 | |
| *** yamamoto has quit IRC | 03:05 | |
| openstackgerrit | Merged openstack/octavia: The amphora agent plug_vip has an indention issue https://review.openstack.org/409953 | 03:07 |
| *** kevo has joined #openstack-lbaas | 03:19 | |
| *** fnaval has quit IRC | 03:21 | |
| openstackgerrit | Merged openstack/octavia: Fix the agent install to use pip -U https://review.openstack.org/409956 | 03:22 |
| *** ducttape_ has quit IRC | 03:26 | |
| *** ducnc has joined #openstack-lbaas | 03:31 | |
| *** ducnc has quit IRC | 03:31 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/octavia: Updated from global requirements https://review.openstack.org/411070 | 03:31 |
| *** amotoki has quit IRC | 03:33 | |
| *** amotoki has joined #openstack-lbaas | 03:34 | |
| *** amotoki has quit IRC | 03:35 | |
| *** amotoki has joined #openstack-lbaas | 03:36 | |
| *** amotoki has quit IRC | 03:42 | |
| *** fnaval has joined #openstack-lbaas | 03:46 | |
| *** diogogmt has quit IRC | 03:54 | |
| *** catintheroof has quit IRC | 04:06 | |
| *** catintheroof has joined #openstack-lbaas | 04:06 | |
| *** catintheroof has quit IRC | 04:06 | |
| *** fnaval has quit IRC | 04:19 | |
| *** ducttape_ has joined #openstack-lbaas | 04:26 | |
| *** ducttape_ has quit IRC | 04:32 | |
| *** ducttape_ has joined #openstack-lbaas | 04:33 | |
| *** diogogmt has joined #openstack-lbaas | 04:40 | |
| *** ducttape_ has quit IRC | 05:00 | |
| rm_work | HAHAHAHAHHA | 05:01 |
| rm_work | ahahahahahahahaha | 05:01 |
| rm_work | fixed that problem. OK! I can build now! NOPE | 05:01 |
| rm_work | now I'm getting this for no apparent reason: 2016-12-16 04:56:19.579 | IOError: [Errno 28] No space left on device | 05:02 |
| rm_work | when converting the image | 05:02 |
| rm_work | the universe hates me | 05:02 |
| rm_work | it had plenty of room before ._< | 05:02 |
| *** bana_k has joined #openstack-lbaas | 05:03 | |
| *** anilvenkata has joined #openstack-lbaas | 05:15 | |
| *** links has joined #openstack-lbaas | 05:21 | |
| openstackgerrit | Merged openstack/octavia: Updated from global requirements https://review.openstack.org/411070 | 05:30 |
| *** sticker has quit IRC | 05:33 | |
| *** bana_k has quit IRC | 05:38 | |
| *** diogogmt has quit IRC | 05:39 | |
| *** ducttape_ has joined #openstack-lbaas | 06:00 | |
| *** ducttape_ has quit IRC | 06:05 | |
| *** rcernin has quit IRC | 06:13 | |
| *** kevo has quit IRC | 06:20 | |
| *** kevo has joined #openstack-lbaas | 06:21 | |
| *** bana_k has joined #openstack-lbaas | 06:24 | |
| *** rcernin has joined #openstack-lbaas | 06:37 | |
| *** armax has joined #openstack-lbaas | 06:38 | |
| *** rcernin has quit IRC | 06:43 | |
| *** rcernin has joined #openstack-lbaas | 06:54 | |
| *** eezhova has joined #openstack-lbaas | 06:56 | |
| *** ducttape_ has joined #openstack-lbaas | 07:01 | |
| *** ducttape_ has quit IRC | 07:07 | |
| *** gongysh has quit IRC | 07:22 | |
| *** eezhova has quit IRC | 07:45 | |
| *** pcaruana has joined #openstack-lbaas | 07:56 | |
| *** tesseract has joined #openstack-lbaas | 07:57 | |
| *** tesseract is now known as Guest31304 | 07:58 | |
| *** yatin has quit IRC | 08:02 | |
| *** ihrachys has joined #openstack-lbaas | 08:04 | |
| *** jsheeren has joined #openstack-lbaas | 08:11 | |
| *** yatin has joined #openstack-lbaas | 08:14 | |
| *** eezhova has joined #openstack-lbaas | 08:20 | |
| rm_work | yessssss | 08:29 |
| rm_work | | 54192533-0e38-4bf6-9288-07adfa96b893 | lb1 | be51d93f8690489d96a58d969a80df15 | 10.0.0.5 | ACTIVE | octavia | 08:29 |
| *** bana_k has quit IRC | 08:31 | |
| *** amoralej|off is now known as amoralej | 08:31 | |
| *** ihrachys has quit IRC | 08:39 | |
| *** gongysh has joined #openstack-lbaas | 08:49 | |
| rm_work | hmm, can't get it to actually create the member nodes correctly, but whatever | 08:55 |
| rm_work | err I thought subnet wasn't required for a member | 09:00 |
| *** ihrachys has joined #openstack-lbaas | 09:00 | |
| rm_work | whoops, bedtime | 09:00 |
| *** ducttape_ has joined #openstack-lbaas | 09:04 | |
| *** ihrachys has quit IRC | 09:05 | |
| *** ducttape_ has quit IRC | 09:09 | |
| *** ihrachys has joined #openstack-lbaas | 09:10 | |
| *** ducttape_ has joined #openstack-lbaas | 10:05 | |
| *** ducttape_ has quit IRC | 10:09 | |
| *** openstackgerrit has quit IRC | 10:18 | |
| *** yamamoto has joined #openstack-lbaas | 10:22 | |
| *** yamamoto has quit IRC | 11:03 | |
| *** ducttape_ has joined #openstack-lbaas | 11:05 | |
| *** ducttape_ has quit IRC | 11:10 | |
| *** gongysh has quit IRC | 11:19 | |
| *** bdeschenes has joined #openstack-lbaas | 11:26 | |
| *** anilvenkata has quit IRC | 11:31 | |
| *** yamamoto has joined #openstack-lbaas | 12:03 | |
| *** ducttape_ has joined #openstack-lbaas | 12:06 | |
| *** ducttape_ has quit IRC | 12:11 | |
| *** yamamoto has quit IRC | 12:13 | |
| *** catintheroof has joined #openstack-lbaas | 12:34 | |
| *** links has quit IRC | 12:42 | |
| *** ducttape_ has joined #openstack-lbaas | 13:07 | |
| *** jsheeren has quit IRC | 13:09 | |
| *** armax has quit IRC | 13:28 | |
| *** amotoki has joined #openstack-lbaas | 13:32 | |
| *** ducttape_ has quit IRC | 13:40 | |
| *** gongysh has joined #openstack-lbaas | 13:46 | |
| *** amoralej is now known as amoralej|lunch | 13:47 | |
| *** chlong has quit IRC | 14:00 | |
| *** jsheeren has joined #openstack-lbaas | 14:03 | |
| *** jsheeren has left #openstack-lbaas | 14:08 | |
| *** amotoki has quit IRC | 14:08 | |
| *** gongysh has quit IRC | 14:09 | |
| *** ducttape_ has joined #openstack-lbaas | 14:17 | |
| *** ducttape_ has quit IRC | 14:21 | |
| *** amotoki has joined #openstack-lbaas | 14:25 | |
| *** amotoki has quit IRC | 14:32 | |
| *** fnaval has joined #openstack-lbaas | 14:32 | |
| *** amoralej|lunch is now known as amoralej | 14:36 | |
| xgerman | o/ | 14:38 |
| *** ducttape_ has joined #openstack-lbaas | 14:47 | |
| xgerman | Adam, apparently it is now… suprised me as well | 15:09 |
| *** Dave has quit IRC | 15:09 | |
| *** Dave has joined #openstack-lbaas | 15:12 | |
| *** chlong has joined #openstack-lbaas | 15:21 | |
| *** armax has joined #openstack-lbaas | 15:25 | |
| diltram | morning | 15:39 |
| *** ihrachys has quit IRC | 15:42 | |
| *** kevo has quit IRC | 15:48 | |
| *** armax has quit IRC | 15:53 | |
| *** bana_k has joined #openstack-lbaas | 15:57 | |
| *** bana_k has quit IRC | 15:59 | |
| *** Guest31304 has quit IRC | 16:02 | |
| *** ducttape_ has quit IRC | 16:06 | |
| johnsom | o/ | 16:09 |
| ankur-gupta-f | mornin | 16:09 |
| diltram | so we merged that patches :) | 16:10 |
| *** ducttape_ has joined #openstack-lbaas | 16:13 | |
| ankur-gupta-f | so everything works master branch octavia & diskimage builder? | 16:14 |
| johnsom | We still need to figure out the /v1/loadbalancer issue | 16:14 |
| diltram | but after this my change with binding there is no problems with /v1/loadbalancers | 16:15 |
| diltram | there are some other problems - timeouts? | 16:15 |
| johnsom | rm_work It looks like diltram -1'd the py3 string patch, can you take a look? | 16:15 |
| xgerman | mmh, if tye works I would keep it | 16:17 |
| johnsom | Yeah, the comment is a bit sparse. Maybe recommending an alternate way to do the logic? | 16:18 |
| diltram | xgerman: you're talking about my comment? | 16:18 |
| xgerman | yep | 16:18 |
| diltram | xgerman: one thing about me, I'm python maniac and I will always -1 anything what is not using proper tools in language | 16:18 |
| xgerman | http://stackoverflow.com/questions/1549801/differences-between-isinstance-and-type-in-python | 16:19 |
| xgerman | suggests we are doing it right | 16:19 |
| xgerman | I doubt it will make a difference in our code but … | 16:20 |
| diltram | but it's a python way to use isinstance | 16:20 |
| xgerman | sure we can respin with tat | 16:21 |
| diltram | yep even in this stack overflow post is comment about ABC PEP | 16:21 |
| diltram | which tells about using isinstance | 16:22 |
| *** rcernin has quit IRC | 16:23 | |
| xgerman | ok, I can respin | 16:23 |
| diltram | great :) | 16:23 |
| xgerman | let me do that… | 16:23 |
| *** pcaruana has quit IRC | 16:25 | |
| johnsom | Ok, thanks. I have burned down my test environment for that since we finished our collaboration session on this yesterday. So, I don't have a local test for that change. | 16:25 |
| *** reedip_ has joined #openstack-lbaas | 16:28 | |
| *** chlong has quit IRC | 16:29 | |
| xgerman | well, I will run tox and call it a day | 16:33 |
| reedip_ | Hi team , can someone please provide review comments for https://review.openstack.org/#/c/273896/ ? | 16:35 |
| reedip_ | its about adding a timeout extension for Listeners | 16:35 |
| *** kevo has joined #openstack-lbaas | 16:35 | |
| *** eezhova has quit IRC | 16:36 | |
| *** bdeschenes has quit IRC | 16:46 | |
| *** openstackgerrit has joined #openstack-lbaas | 16:47 | |
| openstackgerrit | German Eichberger proposed openstack/octavia: Fix some python3 string issues in amphora agent https://review.openstack.org/410345 | 16:47 |
| xgerman | ok, got that working again ;-) | 16:48 |
| xgerman | (submitting) | 16:48 |
| diltram | xgerman: pep8 will fail | 16:49 |
| diltram | there is more than 79 chars in line | 16:49 |
| xgerman | :-( | 16:49 |
| xgerman | ok, will look into that | 16:51 |
| reedip_ | xgerman : this is 83 chars : https://review.openstack.org/#/c/410345/9/octavia/amphorae/backends/utils/haproxy_query.py@60 | 16:53 |
| reedip_ | pep8 will fail ( I think thats what diltram was stating) | 16:53 |
| *** chlong has joined #openstack-lbaas | 16:53 | |
| xgerman | yeah, I am on it | 16:53 |
| reedip_ | :) | 16:54 |
| openstackgerrit | German Eichberger proposed openstack/octavia: Fix some python3 string issues in amphora agent https://review.openstack.org/410345 | 17:02 |
| xgerman | let’s hope I didn’t miss anything else | 17:02 |
| *** rcernin has joined #openstack-lbaas | 17:04 | |
| openstackgerrit | Lubosz Kosnik (diltram) proposed openstack/octavia: Change bind_host IP address https://review.openstack.org/411431 | 17:05 |
| diltram | reedip_: one thing, you not suppose to give +1 if you're seeing that tests are failing on the PS | 17:07 |
| reedip_ | diltram : its wasnt a big issue, and it was getting fixed .... but anyways, will ensure from next time | 17:08 |
| xgerman | nah, +1 is fine to show support… +2 definitely not | 17:08 |
| diltram | +1 means cores this code is ok, please review it | 17:09 |
| reedip_ | xgerman : exactly :) | 17:09 |
| diltram | and no this code doesn't really works - because how do you want to merge code which fails basic gate | 17:09 |
| openstackgerrit | Lubosz Kosnik (diltram) proposed openstack/octavia: Add support for policy.json https://review.openstack.org/399117 | 17:12 |
| *** anilvenkata has joined #openstack-lbaas | 17:12 | |
| *** bana_k has joined #openstack-lbaas | 17:25 | |
| *** armax has joined #openstack-lbaas | 17:30 | |
| *** reedip_ has quit IRC | 17:36 | |
| *** eezhova has joined #openstack-lbaas | 17:51 | |
| *** bdeschenes has joined #openstack-lbaas | 17:51 | |
| *** bdeschenes has quit IRC | 17:55 | |
| *** bdeschenes has joined #openstack-lbaas | 17:58 | |
| *** bdeschenes has quit IRC | 18:03 | |
| *** kevo has quit IRC | 18:23 | |
| *** kevo has joined #openstack-lbaas | 18:33 | |
| *** ducttape_ has quit IRC | 18:34 | |
| *** eezhova has quit IRC | 18:36 | |
| *** anilvenkata has quit IRC | 18:39 | |
| *** bdeschenes has joined #openstack-lbaas | 18:41 | |
| johnsom | greghaynes Any thoughts about tripleo-image-elements not having a stable/mitaka? Our stable/mitaka branch is broken | 19:10 |
| diltram | johnsom: all scenarios are passing, but we have some timeout issues | 19:25 |
| johnsom | diltram link? | 19:26 |
| diltram | https://review.openstack.org/#/c/411431/ | 19:26 |
| rm_work | i am torn between isinstance and type being fine... but i guess you're right -- though now it's annoying to read because it doesn't fit on one line, so we may as well have made it a real if/else | 19:26 |
| rm_work | but whatever | 19:26 |
| diltram | you can take a look into previous tests execution | 19:26 |
| rm_work | (just got on, my internet has been dead all morning, still is, but gave up and jumped on phone hotspot) | 19:27 |
| johnsom | diltram do you have a link to the timeout issue you saw? | 19:27 |
| diltram | previous test execution in this ps | 19:27 |
| diltram | previous logs | 19:28 |
| diltram | http://logs.openstack.org/31/411431/7/check/gate-neutron-lbaasv2-dsvm-scenario-ubuntu-xenial-nv/b1d8319/console.html | 19:28 |
| diltram | http://logs.openstack.org/31/411431/7/check/gate-neutron-lbaasv2-dsvm-scenario-ubuntu-xenial-nv/b1d8319/console.html#_2016-12-16_00_18_41_381634 | 19:29 |
| diltram | or it was because of python3 changes? | 19:30 |
| diltram | I rebased that patch so maybe it fixed everything? | 19:30 |
| xgerman | magic? | 19:30 |
| johnsom | diltram That error does not really mean it's a timing issue. The tests tend to report that when something goes wrong | 19:39 |
| johnsom | It looks like that test run failed over the amp: | 19:39 |
| johnsom | http://logs.openstack.org/31/411431/7/check/gate-neutron-lbaasv2-dsvm-scenario-ubuntu-xenial-nv/b1d8319/logs/screen-o-hm.txt.gz#_2016-12-16_00_17_19_779 | 19:39 |
| diltram | ok, sounds good to me | 19:39 |
| johnsom | Well, something went wrong that caused it to failover.... It should not have failed over | 19:40 |
| johnsom | It could be the python3 thing we fixed for stats, but I thought we had the dependencies right | 19:40 |
| diltram | Security Group edf57b3e-6b36-4b72-bb52-d459f1248e32 in use. | 19:41 |
| diltram | cleaning didn't work | 19:41 |
| johnsom | Yeah, again, side effect of the failure / failover | 19:41 |
| johnsom | The failover would have built a new one, but the test expects the old one to be there | 19:42 |
| *** kevo has quit IRC | 19:42 | |
| johnsom | Well, I guess technically the failover would have deleted the one the test created... | 19:42 |
| diltram | http://logs.openstack.org/31/411431/7/check/gate-neutron-lbaasv2-dsvm-scenario-ubuntu-xenial-nv/b1d8319/logs/screen-o-cw.txt.gz#_2016-12-16_00_18_20_970 | 19:42 |
| *** ducttape_ has joined #openstack-lbaas | 19:42 | |
| diltram | it looks like we're not removing everything properly sometimes | 19:42 |
| johnsom | Yeah, it's clear the failover threw the test off. | 19:43 |
| xgerman | credit_score_letter_12_2_16 | 19:44 |
| xgerman | wrong window | 19:44 |
| johnsom | Haha | 19:44 |
| johnsom | Wow, you are applying for a loan over IRC? ha | 19:44 |
| xgerman | nope, archiving my mail | 19:44 |
| johnsom | Ok, I am going to grab lunch and contemplate what I want to do about the stable branches. | 19:45 |
| xgerman | ok, will do some reviews | 19:46 |
| johnsom | We could pin them both to stable/newton tripleo-image-elements. It works, but it is a bit odd for stable/mitaka to use stable/newton tripleo-image-elements. | 19:46 |
| johnsom | They did not cut a stable/mitaka release | 19:46 |
| johnsom | The one before that was icehouse, which I know won't work | 19:46 |
| xgerman | netwon works for me ;- | 19:46 |
| *** ducttape_ has quit IRC | 19:47 | |
| *** ducttape_ has joined #openstack-lbaas | 19:47 | |
| *** amoralej is now known as amoralej|off | 19:48 | |
| diltram | johnsom: but it's showing that it didn't succeed with removing sec group, so problem is why it didn't remove it, and it didn't succeed because it was in use | 19:48 |
| diltram | or I'm missing something? | 19:48 |
| xgerman | let me look | 19:50 |
| xgerman | yeah, it rolled back | 19:50 |
| xgerman | but this is during cleanup? | 19:51 |
| diltram | yes | 19:52 |
| diltram | http://logs.openstack.org/31/411431/7/check/gate-neutron-lbaasv2-dsvm-scenario-ubuntu-xenial-nv/b1d8319/logs/screen-q-svc.txt.gz?level=WARNING#_2016-12-16_00_15_09_544 | 19:52 |
| xgerman | well, then the system won’t care | 19:52 |
| diltram | in neutron there is onfo about network-vif-unplugged error | 19:52 |
| xgerman | yeah, but our flow will succeed I think. If you can’t delete we won’t create a new load balancer for you in the revert :-) | 19:54 |
| xgerman | I usually don’t read too much into those runs… the hardware they run on is weird | 19:54 |
| diltram | but because of this we have failed gate tests | 19:56 |
| diltram | and it's sometimes occuring | 19:56 |
| greghaynes | johnsom: no idea, you'll have to ask tripleo folk. I want to say they should have it | 19:57 |
| diltram | so personaly I would prefer to find why they exist | 19:57 |
| greghaynes | johnsom: it's possible they just forgot to cut a mitaka one on that repo? | 19:58 |
| xgerman | greghaynes if the last one is icehouse they forgot more than mitaka ;-) | 19:58 |
| diltram | especially that we can't make it voting based on this | 19:58 |
| greghaynes | Hah, yea, I think that aligns with about when they started focusing less on t-i-e | 19:59 |
| greghaynes | It looks like tripleo-heat-templates does have those stable branches | 20:00 |
| greghaynes | So yea, it might just be a deal where no one asked | 20:00 |
| rm_work | couldn't we just pick a good commit hash and use that? | 20:09 |
| rm_work | no need for a real tag technically | 20:09 |
| openstackgerrit | Lubosz Kosnik (diltram) proposed openstack/octavia: Fix some python3 string issues in amphora agent https://review.openstack.org/410345 | 20:13 |
| openstackgerrit | Lubosz Kosnik (diltram) proposed openstack/octavia: Change bind_host IP address https://review.openstack.org/411431 | 20:14 |
| johnsom | diltram I am pretty sure we have not seen a failover triggered in the gate any time recently. This is likely from the DIB issue. | 20:26 |
| johnsom | Failover should not be occurring during these tests. | 20:27 |
| diltram | johnsom: fingers crossed | 20:27 |
| rm_work | ugh, 10.x network doesn't work at all in my devstack >_> annoying | 20:28 |
| rm_work | i'm super bad at network debugging | 20:28 |
| *** csomerville has quit IRC | 20:29 | |
| diltram | rm_work: this is why they're working on this neutron tool to verify why smth is not working | 20:38 |
| diltram | :P | 20:38 |
| rm_work | heh | 20:39 |
| rm_work | well in the meantime, i can tell that it seems all the lbaas objects were created but i can't actually test to see if it works | 20:39 |
| johnsom | rm_work 10.x as in private? | 20:40 |
| rm_work | yeah | 20:40 |
| *** ducttape_ has quit IRC | 20:41 | |
| johnsom | Probably missing a route, try from the router namespace qrouter... ip netns exec qrouter-.... bash | 20:41 |
| rm_work | err | 20:44 |
| rm_work | where is that from? | 20:44 |
| rm_work | root on the host? | 20:44 |
| rm_work | *devstack host | 20:44 |
| johnsom | Yep | 20:44 |
| rm_work | uhh | 20:45 |
| rm_work | don't appear to have any namespace | 20:45 |
| xgerman | on the devstack I build I needed to be in the NS to get to the (haproxy) LB | 20:45 |
| rm_work | that one isn't there, but there isn't even a /etc/netns | 20:45 |
| xgerman | ip netns list? | 20:45 |
| rm_work | oh | 20:45 |
| rm_work | ok yeah got it, i was expecting it to be in /etc/netns | 20:45 |
| xgerman | there should be a qrouter | 20:45 |
| johnsom | Yeah, ignore /etc/netns. Most setups don't configure that | 20:45 |
| rm_work | yep | 20:46 |
| xgerman | and to run something | 20:46 |
| xgerman | ip nentns exec <namespace> <cmd> | 20:46 |
| *** csomerville has joined #openstack-lbaas | 20:46 | |
| xgerman | this as roor and I like bash as command a lot | 20:46 |
| johnsom | If that works, you are just missing a route through br-ex | 20:46 |
| rm_work | yep works from there | 20:46 |
| rm_work | <3 | 20:46 |
| rm_work | need to figure out how to add my missing route then | 20:47 |
| johnsom | I am still finishing lunch, but after I am done I can probably give you the command | 20:48 |
| rm_work | kk | 20:48 |
| *** chlong has quit IRC | 20:48 | |
| rm_work | maybe I can figure it out in the meantime | 20:48 |
| xgerman | yeah, you can google how to add routes from namespaces | 20:49 |
| johnsom | +1 | 20:49 |
| johnsom | Nah, this is just a host route to ex-br for the subnet. No netns needed | 20:50 |
| johnsom | Netns was just a test to narrow the issue | 20:50 |
| rm_work | got it | 20:53 |
| rm_work | sudo route add -net 10.0.0.0 netmask 255.255.255.0 gw 172.24.4.7 dev br-ex | 20:53 |
| rm_work | seems to work | 20:53 |
| xgerman | nice | 20:54 |
| rm_work | i apparently remembered enough to assemble that without any real issues, success | 20:54 |
| rm_work | now to figure out how to script it | 20:54 |
| rm_work | k got it | 20:55 |
| *** kobis has joined #openstack-lbaas | 20:59 | |
| *** ihrachys has joined #openstack-lbaas | 21:07 | |
| *** catintheroof has quit IRC | 21:10 | |
| *** catintheroof has joined #openstack-lbaas | 21:11 | |
| johnsom | Ok, back to figuring out what tag/commit to use for mitaka tripleo... | 21:11 |
| *** catintheroof has quit IRC | 21:15 | |
| rm_work | woooooouhh wut | 21:17 |
| rm_work | lol | 21:17 |
| rm_work | that's my mood just now | 21:18 |
| *** csomerville has quit IRC | 21:18 | |
| *** ducttape_ has joined #openstack-lbaas | 21:20 | |
| xgerman | do I need to find cat pictures for you ;-) | 21:21 |
| rm_work | curl: (35) SSL peer reports incorrect Message Authentication Code. | 21:22 |
| rm_work | super weird, never seen that before | 21:23 |
| rm_work | when curl-ing the VIP | 21:23 |
| rm_work | (it's an https listener) | 21:23 |
| rm_work | err, https-terminated | 21:23 |
| rm_work | anyone familiar? | 21:23 |
| xgerman | what does Google think it is | 21:23 |
| rm_work | SSL_ERROR_BAD_MAC_ALERT | 21:24 |
| xgerman | also did you try -k | 21:24 |
| rm_work | yeah using -k and -v | 21:24 |
| *** ihrachys has quit IRC | 21:24 | |
| rm_work | this is the only useful thing that comes up: https://developer.mozilla.org/en-US/docs/Mozilla/Projects/NSS/SSL_functions/sslerr.html#SSL_Error_Codes | 21:24 |
| rm_work | and some stackoverflow stuff about verifying system time, which i just did | 21:24 |
| johnsom | I have seen it before, but don't remember the issue/etc. | 21:24 |
| xgerman | find cozy_bear / | 21:25 |
| johnsom | Haha | 21:25 |
| johnsom | I don't think they even had to go that far | 21:25 |
| xgerman | typo s/legit/ilegit/r would have stopped that | 21:26 |
| rm_work | let's see... only timezone oddity i note is that the amphora is in UTC while the host and the backend vms are in MST | 21:26 |
| johnsom | Ugh, just finished a stack, it passed, then I realized it probably didn't do the clone since there was already a repo there. | 21:30 |
| *** bdeschenes has quit IRC | 21:31 | |
| johnsom | rm_work it looks like the devstack infrastructure for git clone won't take commit ids, just tags/branches. | 21:35 |
| rm_work | errrrrr | 21:35 |
| johnsom | It uses --branch if you pass in a "think" | 21:36 |
| johnsom | s/think/thing/ | 21:36 |
| rm_work | wow | 21:36 |
| rm_work | yeah ok, suck | 21:36 |
| rm_work | so we do have to bug them | 21:36 |
| johnsom | Well, I might be able to find a tag that makes sense | 21:36 |
| johnsom | They just don't have a branch | 21:36 |
| diltram | ok, kicked python3 to merge | 21:38 |
| diltram | https://review.openstack.org/#/c/411431/9 - johnsom, rm_work may you merge this code | 21:38 |
| rm_work | ah yep looks simple and looks passing | 21:39 |
| rm_work | sweet. | 21:39 |
| johnsom | Ha, ok, well, I'm wrong. It did check out the tag ok... hmm, wonder what I missed trying to read the devstack code | 21:41 |
| johnsom | Oh well, it worked, so... | 21:41 |
| johnsom | Are you guys cool with this fix for mitaka? | 21:46 |
| johnsom | https://review.openstack.org/#/c/412000/1/devstack/plugin.sh | 21:46 |
| johnsom | Can you +1 it | 21:46 |
| xgerman | dine | 21:46 |
| xgerman | done | 21:47 |
| diltram | johnsom: for me ok, just want to see tests passing | 21:47 |
| johnsom | Sure, NP. Just highlighting as it is a stable and doesn't pop up here | 21:47 |
| diltram | johnsom: so we still have no stable core team? | 21:48 |
| johnsom | You are talking to them | 21:48 |
| diltram | :P | 21:48 |
| johnsom | Yeah, something else I need to figure out. | 21:48 |
| johnsom | I granted the neutron stable (the few left) access too as the are still supporting neutron-lbaas on the older stable releases, but after the split I am the only one on it. | 21:49 |
| rm_work | grats! :P | 21:52 |
| xgerman | we probably need to grow that for after the split | 21:52 |
| johnsom | Yes, it's something we need to figure out how we want to handle | 21:52 |
| johnsom | I need to read up on the rules | 21:52 |
| johnsom | Same deal, please review the newton patch (I combined it with an outstanding patch) : https://review.openstack.org/#/c/399272/ | 21:55 |
| johnsom | So glad we can drop the tripleo dependency going forward... | 21:56 |
| rm_work | I shouldn't need "ENABLED_SERVICES+=,octavia,o-api,o-cw,o-hm" with the plugin system, right? | 21:57 |
| rm_work | enable_plugin already makes that happen | 21:57 |
| rm_work | right? | 21:57 |
| johnsom | Not 100% sure | 21:57 |
| rm_work | me either... and I worked on this | 21:57 |
| johnsom | You would think so | 21:57 |
| rm_work | how did I forget so much in 3 months | 21:58 |
| xgerman | yeah, I added the services since the README said so | 21:58 |
| * rm_work checks | 21:58 | |
| xgerman | I am a bit fuzzy on https://review.openstack.org/#/c/273896/27 — do we need to make that an extension if we change the API? | 22:00 |
| openstackgerrit | Adam Harwell proposed openstack/octavia: Amphora-agent should log to a distinct location https://review.openstack.org/410487 | 22:02 |
| rm_work | just rebasing | 22:02 |
| *** eezhova has joined #openstack-lbaas | 22:03 | |
| johnsom | I thought they did add it as an extension | 22:06 |
| johnsom | I would need to be, yes | 22:06 |
| xgerman | nope, I don’t see it there | 22:06 |
| xgerman | oh, it’s there | 22:06 |
| xgerman | I am blind | 22:07 |
| johnsom | The cli is going to be a problem as it is frozen. Your point about an implementation is valid. | 22:10 |
| xgerman | frozen? So hows that openstack-cli stuff coming… the FWaaS people told me we culd just plug in the neutron client | 22:11 |
| *** bana_k has quit IRC | 22:12 | |
| johnsom | So, changes to the neutron client are frozen as is the development of osc for lbaas | 22:12 |
| *** kevo has joined #openstack-lbaas | 22:12 | |
| xgerman | mmh, so how are end-users taking advantage of that change then? | 22:13 |
| johnsom | OSC chage? | 22:13 |
| xgerman | the timeout one | 22:13 |
| xgerman | if we don’t do neutron nor osc | 22:13 |
| diltram | they need to wait until OSC work | 22:13 |
| johnsom | Well, since nothing implements it (drivers) I don't think they are | 22:13 |
| diltram | :P | 22:13 |
| *** kobis has quit IRC | 22:14 | |
| xgerman | what’s the point then of this change? | 22:14 |
| johnsom | Plus, yes, it would be API only | 22:14 |
| *** kevo has quit IRC | 22:14 | |
| xgerman | well, API only really doesn’t benefit most of our users… | 22:15 |
| johnsom | Yeah, I had asked that all of the timeouts be handled too, not just one at a time. I.e. not one per extension. | 22:15 |
| xgerman | yeah, that would be better or we just turg that to n-lbaas | 22:15 |
| xgerman | s/turg/turf/g | 22:16 |
| *** bana_k has joined #openstack-lbaas | 22:19 | |
| johnsom | Ok, added my two pennies | 22:19 |
| *** eezhova has quit IRC | 22:21 | |
| *** kevo has joined #openstack-lbaas | 22:22 | |
| rm_work | COMCAST GIVE ME MY INTERNET BACK T_T | 22:27 |
| xgerman | TWC in Cincinnati seems to not like IPv6 | 22:27 |
| johnsom | Ugh, hate that. So far we are good on comcast here. Though my modem can't do the full speed. I'm not sure I want to deal with the problems of swapping it for the 50Mbps bump. | 22:28 |
| johnsom | IPv6 has been good for me on comcast. They change things everyone in a while that will hiccup it, but in general it has been stable. | 22:29 |
| johnsom | You can always tunnel through HE if you need access to the ipv6 consoles in zuul | 22:30 |
| openstackgerrit | Merged openstack/octavia: Fix some python3 string issues in amphora agent https://review.openstack.org/410345 | 22:32 |
| xgerman | I hard-reset my router earlier today and now I have ipV6 — weird | 22:39 |
| xgerman | cool and now I could ssh -6 into my cloud server :-) | 22:42 |
| johnsom | Check if you are filtering neighbor discovery. Comcast made a change that would route my v6 for a couple of hours and then stop routing for my PD. Finally figured out they turned on ND. Changed my paranoid FW rules to all ND and fixed that. | 22:42 |
| johnsom | typo, not all ND, allow ND from them | 22:42 |
| xgerman | my FW is just a checkbox in my Asus Router :-) | 22:42 |
| xgerman | but probably should invest in better network tech | 22:43 |
| johnsom | You would shake your head at my setup.... | 22:43 |
| johnsom | I have a bunch of subnets, SSIDs, and a pretty sizable firewall ruleset | 22:44 |
| xgerman | I am pretty sure mine is so broken that probably all my devices have joined botnets | 22:44 |
| johnsom | Haha | 22:44 |
| johnsom | For basic edge device use, you can't beat the deal this is: https://www.amazon.com/Ubiquiti-EdgeRouter-Advanced-Gigabit-Ethernet/dp/B00YFJT29C/ref=sr_1_1?ie=UTF8&qid=1481928617&sr=8-1&keywords=er-x | 22:50 |
| johnsom | I use the POE-5 model. | 22:51 |
| johnsom | My only warning is that it's a hands-on CLI type device. The GUI is mostly useless and not novice friendly | 22:51 |
| *** diltram_ has joined #openstack-lbaas | 22:53 | |
| *** diltram has quit IRC | 22:53 | |
| bana_k | johnsom: just wanted to let you know that your suggestion worked for image build error. | 22:54 |
| johnsom | Oh good bana_k. We are just finishing up the fixes for the branches. I think things will be back to normal by monday | 22:54 |
| bana_k | johnsom sounds great ! thanks :) | 22:55 |
| johnsom | I have tested master and stable/mitaka with the latest patches. I'm testing stable/newton now | 22:55 |
| diltram_ | johnsom: and what you're doing with this subnets and ssids? | 22:55 |
| johnsom | HA | 22:56 |
| johnsom | Well, I have one for "devices", one for guests, one for home office, one for the house | 22:56 |
| diltram_ | you're using multiple ssids for HA? | 22:57 |
| johnsom | devices is for those IoT devices that I don't trust, ring, echo, etc. | 22:58 |
| diltram_ | :P | 22:58 |
| johnsom | No, the SSIDs are Wifi ssids that map into the vlans | 22:58 |
| diltram_ | ok, I understand | 22:58 |
| diltram_ | what you're using to monitoring? | 22:59 |
| johnsom | ssh - grin | 22:59 |
| johnsom | I mean the router and access point have some, but if I care to see what is going on I usually just hope on the devices | 22:59 |
| diltram_ | you're not using any zabbix/riemann/etc to monitor resources inside of network? | 22:59 |
| diltram_ | ok | 23:00 |
| johnsom | Nah. I have used them for other setups in the past, but not motivated enough just for the house. | 23:01 |
| johnsom | from .. import Lock, NeedRegenerationException | 23:02 |
| johnsom | ImportError: cannot import name Lock | 23:02 |
| johnsom | Ugh. | 23:02 |
| johnsom | Switching a VM from mitaka to newton, kind of ugly | 23:03 |
| johnsom | This is keystone code blowing up | 23:03 |
| *** diltram_ has quit IRC | 23:07 | |
| openstackgerrit | Merged openstack/octavia: Change bind_host IP address https://review.openstack.org/411431 | 23:10 |
| *** kevo has quit IRC | 23:17 | |
| *** kevo has joined #openstack-lbaas | 23:27 | |
| *** diltram has joined #openstack-lbaas | 23:32 | |
| bana_k | johnsom do we store anything in the octavia.sni table ? | 23:33 |
| johnsom | That is for tls offloading. | 23:33 |
| johnsom | https://en.wikipedia.org/wiki/Server_Name_Indication | 23:34 |
| bana_k | I have created a listener with default tls and sni and I dont see any data in that | 23:34 |
| bana_k | but neutron.lbaas_sni has the sni info | 23:34 |
| johnsom | It may not fill until you have more than one server name | 23:34 |
| bana_k | oh I see. thanks ! | 23:35 |
| *** ducttape_ has quit IRC | 23:40 | |
| *** armax has quit IRC | 23:42 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!