Thursday, 2016-12-15

*** fnaval has quit IRC00:01
*** ducttape_ has quit IRC00:02
rm_workgreghaynes: do you see what failed here? http://paste.openstack.org/show/592405/00:06
rm_workI am still not clear on how i see what truly caused a fail00:06
*** diogogmt has quit IRC00:15
johnsomrm_work you are missing the no-tripleo-patch00:15
korean101johnsom: HI. i got succeed devstack stable/newton (like this http://paste.openstack.org/show/592406/)00:16
korean101johnsom: thanks00:17
johnsomOk, glad you got something working while we work out these issues00:17
korean101johnsom: I peeked over 'centos-release-openstack-newton-1-1.el7.noarch'00:19
korean101johnsom: openstack-octavia-diskimage-create-0.9.0-1.el7.noarch, openstack-tripleo-image-elements-5.0.0-1.el7.noarch,00:20
korean101johnsom: not master branch, old version branch is working00:20
korean101johnsom: and when comes out .deb package?00:21
korean101johnsom: .rpm package is available00:21
johnsomI do not know.  We as a project team don't handle the packaging right now00:22
korean101johnsom: ok. got it00:22
johnsomWe take it as far as the tar and pypi00:22
johnsomI hope soon, we would like to see deb00:22
korean101johnsom: yes. i installed via 'pip install'00:23
korean101johnsom: I appreciate to octavia teams. many thanks00:23
johnsomNo problem00:23
rm_workjohnsom: ...00:31
rm_workwtf00:32
rm_workyou're correct but wtf00:32
rm_workhow did that happen00:32
johnsomdude, not your week....00:32
rm_workuuuugh00:32
rm_workAUGH copy/paste fail cost me ~2h of debugging00:33
*** ipsecguy has quit IRC00:35
*** ipsecguy has joined #openstack-lbaas00:36
rm_workdid slack go down?00:36
rm_workxgerman: ^^00:36
rm_worki guess i could check twitter00:36
rm_workah nope just me temporarily00:36
johnsomMine seems fine00:36
rm_workah they got you on it too? T_T00:36
johnsomOSIC, still trying to ignore the one that logs me out all of the time00:37
rm_workheh00:38
rm_workok THIS build SHOULD work00:38
rm_workif Friday rolls around and I still can't create a working LB in my devstack00:38
rm_worki'm going to cry00:38
rm_workBTW the centos issue, turns out the local mirrors this cloud uses for centos repos only refresh monthly... so devstack adds the RDO mirror for openstack that has the new qemu-kvm package, which assumes the deps will come in fine from the main repos, except ... not in my case00:40
rm_workswitching to a real mirror of the centos base repos fixed it00:40
johnsomJoy00:40
xgermanIgnored slack for the last hour and a half ;-)00:46
openstackgerritMichael Johnson proposed openstack/octavia: Setup translation for octavia  https://review.openstack.org/41101300:48
johnsomWell, that is part one to getting our strings translated.  Once that merges I can add the jobs.00:48
bana_k@here Hi, how do i fix error: command 'x86_64-linux-gnu-gcc' failed with exit status 1 problem01:10
johnsomHi bana_k01:10
bana_khi johnsom01:10
johnsomWe are working on a fix to that issue.  the diskimage-builder project made a change that broke us.01:10
bana_kI tried installing the header but its not helping01:11
bana_kjohnsom Ah, ok !01:11
johnsomYeah, we are like 10+ patches into fixing this fully01:11
bana_kdamn01:11
johnsomStill working on it unfortunately01:11
bana_koh ok, any work arounds ?01:12
johnsomdevstack?01:12
bana_kyou01:12
bana_kyup*01:12
*** diogogmt has joined #openstack-lbaas01:13
johnsomWell, try this:01:13
johnsommake sure your localrc does not have reclone=true01:13
johnsomyour /opt/stack/octavia can be at whatever version you need (until we start merging fixes for this).01:14
johnsomyour /opt/stack/tripleo-image-elements should be at this commit: 86dfef1360df622cec705a55535be641ac3723ac01:14
bana_kok, will try that out. thanks a lot.01:15
johnsomyour /opt/stack/diskimage-builder should be at this commit: 86dfef1360df622cec705a55535be641ac3723ac01:15
johnsomOpps, wrong commit this one: bf5af6155c43c3c764dd74e5ad6d387a0a1a0a6201:16
johnsomThose are old versions, but should pre-date this issues01:16
johnsombana_k Give that a shot and let me know if it works for you.01:17
bana_ksure johnsom, thanks !01:17
rm_worki THINK everything merged in every other project except ours01:23
rm_workso should just be octavia patches now01:23
*** ducttape_ has joined #openstack-lbaas01:27
*** ducttape_ has quit IRC01:28
*** kevo has quit IRC01:37
*** bana_k has quit IRC01:38
*** yamamoto_ has joined #openstack-lbaas01:47
rm_workaugh stack worked, amp still broken somehow02:16
*** Matias has quit IRC02:22
*** Matias has joined #openstack-lbaas02:25
*** chenhb has quit IRC02:36
*** chenhb has joined #openstack-lbaas02:37
*** harlowja has quit IRC03:03
*** ducttape_ has joined #openstack-lbaas03:22
*** yamamoto_ has quit IRC03:26
*** ducttape_ has quit IRC03:45
*** ducttape_ has joined #openstack-lbaas03:47
*** ducttape_ has quit IRC03:50
*** ducttape_ has joined #openstack-lbaas03:50
*** cody-somerville has joined #openstack-lbaas03:53
*** cody-somerville has quit IRC03:53
*** cody-somerville has joined #openstack-lbaas03:53
*** csomerville has quit IRC03:53
*** links has joined #openstack-lbaas04:06
*** yamamoto_ has joined #openstack-lbaas04:08
*** anilvenkata has joined #openstack-lbaas05:54
openstackgerritJingLiu proposed openstack/neutron-lbaas: Modify the ip of member in tests  https://review.openstack.org/41112606:15
*** afranc has quit IRC06:52
*** afranc has joined #openstack-lbaas07:01
*** ihrachys has joined #openstack-lbaas07:03
*** ihrachys has quit IRC07:06
*** Alex_Stef has joined #openstack-lbaas07:07
*** rcernin has joined #openstack-lbaas07:13
*** nmagnezi has joined #openstack-lbaas07:31
*** ihrachys has joined #openstack-lbaas07:34
*** eezhova has joined #openstack-lbaas07:38
*** bana_k has joined #openstack-lbaas07:48
*** ihrachys has quit IRC07:52
*** jsheeren has joined #openstack-lbaas07:56
*** bana_k has quit IRC08:02
*** eezhova has quit IRC08:16
*** kevo has joined #openstack-lbaas08:23
*** pcaruana has joined #openstack-lbaas08:37
*** kevo has quit IRC08:39
*** ihrachys has joined #openstack-lbaas08:41
*** eezhova has joined #openstack-lbaas08:43
*** ryu25 has quit IRC08:48
*** amoralej|off is now known as amoralej08:51
openstackgerritReedip proposed openstack/neutron-lbaas: Add Timeout on Listeners  https://review.openstack.org/27389608:52
reedipDear LBaaS team, can you please suggest changes for the following patch ?08:52
*** ducttape_ has quit IRC08:53
*** ihrachys has quit IRC09:08
*** ducnc has quit IRC09:18
rm_workwtf aughhh09:43
rm_workexport DIB_REPOLOCATION_amphora_agent='/opt/stack/octavia'09:43
rm_workexport DIB_REPOREF_amphora_agent=18a486baaa04f9dfdae2646f2b362f86c4bbca4b09:43
rm_workcommit 18a486baaa04f9dfdae2646f2b362f86c4bbca4b09:43
rm_work    Amphora-agent should log to a distinct location09:43
rm_workit's still not putting that version on the amp09:43
rm_worki am certain that was set and checked out properly before stack.sh ran >_>09:43
nmagnezirm_work, the dib party continues?09:53
rm_workno, this is on the octavia side09:53
rm_worki mean...09:53
rm_workwell it's dib related but the issue is with getting it to install a patched version of our code instead of master into the image09:54
rm_workthis SHOULD work...09:54
nmagnezirm_work, oh. this is actually quite important..09:57
nmagnezirm_work, I try give it a spin if you'd like, see if i get the same result09:58
nmagnezirm_work, i was about to re stack anyways09:58
rm_workwell, you'll need that patch to get anything to work on master09:58
rm_workso i guess you should anyway :)09:58
rm_workat least https://review.openstack.org/#/c/410345/09:59
nmagnezirm_work, I actually wanted to see if it will push https://review.openstack.org/#/c/331841/ into the amphora i build, but sure why not :)10:00
rm_workah yeah10:00
rm_workwell, it won't build a correct image without those other patches as well10:00
rm_workyou can cherry-pick yours on top of the chain i linked10:01
rm_workhttps://github.com/rm-you/devstack_deploy/blob/centos/stackme.sh#L68-L74 is what i'm doing... but it doesn't seem to be working10:01
nmagnezioh, you are using centos, so my patch will be useful to you when it is ready :)10:02
rm_workheh10:02
rm_workwell, i'm still using ubuntu for the amps10:02
rm_workah i guess if you're using RH flavored amp images, you DON'T need the patch chain i linked10:03
rm_worksince it's all about fixing the issues in xenial ...10:03
nmagnezii guess so, but it couldn't hurt + it will config your findings, so why not ? :)10:04
rm_workyou might get merge conflicts10:04
rm_workwe'll see :P10:04
nmagnezirm_work, i think you got a point there :<10:05
rm_workit's fine, just do your thing10:05
rm_workugh, i need to sleep10:05
* rm_work disappears into the night10:05
nmagnezirm_work, good night :)10:06
*** yamamoto_ has quit IRC10:15
*** ihrachys has joined #openstack-lbaas10:15
*** openstackgerrit has quit IRC10:18
*** armax_ has joined #openstack-lbaas10:54
*** armax has quit IRC10:56
*** armax_ is now known as armax10:56
*** amotoki has quit IRC10:56
*** ducttape_ has joined #openstack-lbaas11:02
*** yamamoto has joined #openstack-lbaas11:27
*** yamamoto_ has joined #openstack-lbaas11:28
*** yamamoto has quit IRC11:32
*** anilvenkata has quit IRC11:35
*** openstackgerrit has joined #openstack-lbaas11:46
openstackgerritGenadi Chereshnya proposed openstack/neutron-lbaas: Fixing the scenario tests on master branch  https://review.openstack.org/41125711:46
*** yamamoto_ has quit IRC11:53
*** yamamoto has joined #openstack-lbaas11:56
*** amotoki has joined #openstack-lbaas11:59
openstackgerritRoey Chen proposed openstack/neutron-lbaas: Fixing the scenario tests on master branch  https://review.openstack.org/41125712:04
*** ihrachys has quit IRC12:05
*** ihrachys has joined #openstack-lbaas12:05
*** dasanind has quit IRC12:06
*** dougwig_ has joined #openstack-lbaas12:07
*** dasanind has joined #openstack-lbaas12:08
*** dougwig has quit IRC12:08
*** dougwig_ is now known as dougwig12:08
*** amotoki has quit IRC12:32
*** bdeschenes has joined #openstack-lbaas12:44
*** amotoki has joined #openstack-lbaas12:50
*** chlong has joined #openstack-lbaas12:51
*** amotoki has quit IRC12:55
*** catintheroof has joined #openstack-lbaas13:00
*** catintheroof has quit IRC13:01
*** catintheroof has joined #openstack-lbaas13:01
*** yamamoto has quit IRC13:05
*** amoralej is now known as amoralej|lunch13:10
*** Alex_Stef has quit IRC13:12
openstackgerritAbed Abu dbai proposed openstack/octavia: ACTIVE-ACTIVE - controller network tasks  https://review.openstack.org/32348113:22
*** yamamoto has joined #openstack-lbaas13:24
*** yamamoto has quit IRC13:30
*** yamamoto has joined #openstack-lbaas13:31
*** links has quit IRC13:31
*** yamamoto has quit IRC13:35
*** amotoki has joined #openstack-lbaas13:51
*** amoralej|lunch is now known as amoralej14:09
*** eezhova has quit IRC14:16
*** chlong has quit IRC14:20
*** chlong has joined #openstack-lbaas14:22
*** chlong has quit IRC14:26
*** chlong has joined #openstack-lbaas14:28
*** links has joined #openstack-lbaas15:01
*** fnaval has joined #openstack-lbaas15:03
*** chlong has quit IRC15:03
*** csomerville has joined #openstack-lbaas15:04
*** cody-somerville has quit IRC15:07
*** mdavidson has quit IRC15:18
*** armax has quit IRC15:19
openstackgerritAbed Abu dbai proposed openstack/octavia: ACTIVE-ACTIVE - controller network tasks  https://review.openstack.org/32348115:36
*** jsheeren has quit IRC15:46
diltrammorning16:02
xgermangm16:02
johnsomo/16:02
xgermanyou guys recall if we had our own policy.json for neutron-lbaas16:03
xgermanI always ignored that stuff since we were using the default… and after all we are a neutron extension16:03
diltramwe didn't support the policy.json previously16:03
*** links has quit IRC16:04
diltramI implemented tat feature just two weeks ago16:04
xgermanmmh, we should have had it because we used to be an neutron extension16:04
xgerman?16:04
johnsomxgerman It was neutrons16:05
xgermanyep, that’s what I thought16:05
xgermanbut but https://github.com/openstack/neutron/blob/master/etc/policy.json16:05
xgermandoens’t have lbaas in it16:06
johnsomCheck the code, they migrated some stuff to be default in the code.16:06
xgermanyeah, I know we have defaults ;-)16:06
*** klindgren__ is now known as klindgren16:06
diltramxgerman: so you're talking about nlbaas endpoints?16:07
xgermanno, the old way16:07
johnsomThe only non-public thing was acting on other project ids\16:07
xgermanneutron-lbaas16:07
diltramjohnsom: they have in code policies?16:08
diltramwhere they keep this code?16:08
johnsomNot sure, that was why I said check.16:08
diltramaaa16:08
diltramok16:08
johnsomI think they did, when I was talking to Armando at the summit he wanted us to do it that way16:09
*** armax has joined #openstack-lbaas16:10
diltramso nova made that changes to policy in code16:10
diltramso I based on their work16:10
diltramin neutron I can't find anything16:11
xgermanwell, for n-lbaas we can do whatever16:11
johnsomxgerman diltram has a policy patch up for review on the octavia api16:12
*** diogogmt has quit IRC16:12
xgermanyep, I saw that..16:12
xgermanI am just trying to wrap my head around how it was done previously16:12
diltramin n-lbaas code there is no policy.json file16:19
*** yamamoto has joined #openstack-lbaas16:20
*** yamamoto has quit IRC16:21
xgermanyep, and this confuses me16:29
johnsomWell, any policy enforcement, if there was some, should have been done in the neutron layer as it was the actual API16:30
xgermanyeah, I have come to the same conclusion16:30
xgermanI probably should try this out somehow :-)16:31
*** rcernin has quit IRC16:34
johnsomIt looks like the neutron code already got moved to neutron-lib:16:34
johnsomhttps://github.com/openstack/neutron-lib/blob/master/neutron_lib/policy.py16:34
xgermanwell, we distinguish between admin and user role — so anything which maps users to the respective roles should be happy16:34
johnsomhttps://github.com/openstack/neutron-lib/blob/master/neutron_lib/_context.py16:34
xgermanthanks16:35
johnsomSo I would guess neutron-lbaas just checks the context for is_admin16:36
xgermanyeah, I think so16:36
xgermanso all which needs to be done is augment the neutron-policy accordingly16:36
xgermanif you want other admin types16:36
johnsomI expect this is a lot more clear in the new code16:38
johnsomStill need to look at that16:38
xgermanyeah, my problem is that we can’t really integration test the new code16:39
xgermanso have to go by what a unit test says16:39
*** pcaruana has quit IRC16:42
*** yamamoto has joined #openstack-lbaas16:42
johnsomDownside to remote work, no snow days.  The whole town is shutdown over 1.5" of snow...  (we don't get it very often)16:43
xgermanmy place is cold — some arctic breeze making it “feel” -316:43
xgermanreality is balmy 716:43
johnsomNice.  We are up to 2916:44
xgermanyeah, I could have moved to MSP as well - at least I could have beers with mestery :-)16:46
johnsomHahaha16:46
xgermanalso some new fun read: https://blog.acolyer.org/2016/12/14/scone-secure-linux-containers-with-intel-sgx/16:46
xgerman(works for vms, too)16:46
diltramjohnsom: so we're merging that patches to fix master?16:47
johnsomWhen I last looked last night, they still weren't passing16:47
johnsomYeah, https://review.openstack.org/#/c/410487 is the top of the chain, and not passing.  It looks like the py3 patch I slapped up there is still broken16:48
johnsomIt was a "I am out of time and have a ton of meetings, so post and let other poke at it" kind of patch16:49
*** yamamoto has quit IRC16:49
xgermanok, I shall poke then16:49
*** yamamoto has joined #openstack-lbaas16:50
johnsomFeel free.  Adam had  be working on it, but I think he got delayed on centos issues16:51
xgermanwell, I don’t think that logging stuff is critical so will review your patch16:51
johnsomBasically the amphora-agent has some py3 issues16:51
johnsomYeah, it's https://review.openstack.org/#/c/41034516:51
*** rcernin has joined #openstack-lbaas16:54
johnsomYeah, I have seen a few articles about sgx.  Some not so flattering.16:55
xgermanhe cautions as well16:55
*** csomerville has quit IRC16:57
*** csomerville has joined #openstack-lbaas16:57
johnsomBTW, the lbaas roles are in the neutron policy.json: https://github.com/openstack/neutron/blob/master/etc/policy.json#L13517:02
johnsomI knew we didn't really have much that was admin17:03
xgermanthanks — I was thinking as much17:03
xgermanbut looked for lbaas17:03
xgermanhope this is not lbaasv1 legacy17:04
*** diogogmt has joined #openstack-lbaas17:04
johnsomNo, all of that was already deleted17:05
xgermancool17:05
openstackgerritLubosz Kosnik (diltram) proposed openstack/octavia: Fix some python3 string issues in amphora agent  https://review.openstack.org/41034517:07
diltramjohnsom: fixed the py35 tests17:08
diltramso we can wait for it and start merging17:08
diltrambecause scenario are passing17:08
*** mjblack has quit IRC17:08
xgermancool, I was a bit slowed down since I forgot that mac’s don’t come with python3 pre-installed17:08
johnsomIt wasn't just the py35 tests that were failing.  Really?  the scenario tests were passing?17:08
diltramfunctional was failing because we changed the 'w' to 'wb'17:09
xgermanyep, caused likely the cert error17:10
*** mjblack has joined #openstack-lbaas17:10
johnsomYeah, I know py35 and functional were broken because we didn't update them, but I thought there were a bunch of additional py35 issues in the agent that weren't fixed yet17:10
*** ducttape_ has quit IRC17:10
xgermanthey were a ton of warnings17:10
*** ducttape_ has joined #openstack-lbaas17:10
johnsomI will be shocked if the scenario tests pass17:11
*** ducttape_ has quit IRC17:15
*** kevo has joined #openstack-lbaas17:18
nmagnezijohnsom, diltram, xgerman, hey guys, did you notice https://bugs.launchpad.net/octavia/+bug/1649083 ?17:18
openstackLaunchpad bug 1649083 in octavia "Scenario tests fail when running on master of tempest " [Undecided,In progress]17:18
nmagnezithis might break the gate if tempest will release a new tag and we did not fix it17:19
johnsomYes, but I can't really evaluate it until we get the DIB stuff fixed17:19
nmagnezii see a patch was sent, but the bug is yet to be triaged17:19
nmagneziunderstandable17:20
johnsomMy first thought was I thought tenant_id was being replaced with project_id, so wondering if tempest isn't behind the curve there17:21
nmagnezijohnsom, btw thank you for https://review.openstack.org/#/c/299998/17:21
nmagnezijohnsom, i didn't look closely into the this code, sec17:22
openstackgerritMichael Johnson proposed openstack/octavia: Fix missing NovaServerGroupDelete  https://review.openstack.org/40940517:30
*** armax has quit IRC17:33
*** ducttape_ has joined #openstack-lbaas17:34
*** catinthe_ has joined #openstack-lbaas17:36
*** catintheroof has quit IRC17:38
nmagnezijohnsom, i'm trying to locate the tempest patch that changed that attribute, in order to learn about the motivation for that17:39
nmagnezibut no luck tracking it down so far17:39
openstackgerritLubosz Kosnik (diltram) proposed openstack/octavia: Change bind_host IP address  https://review.openstack.org/41143117:39
nmagneziwhat I know for sure is that this patch is post tempest 13.0.0. tag17:39
johnsomnmagnezi That would be helpful to have in the commit message.  Thanks!17:39
diltramjohnsom: now should pass17:39
nmagnezijohnsom, yup17:40
nmagnezi:017:40
nmagnezi:)17:40
openstackgerritLubosz Kosnik (diltram) proposed openstack/octavia: Fix some python3 string issues in amphora agent  https://review.openstack.org/41034517:42
nmagnezijohnsom, found it: https://review.openstack.org/#/c/394902/17:48
*** cody-somerville has joined #openstack-lbaas17:49
*** cody-somerville has quit IRC17:49
*** cody-somerville has joined #openstack-lbaas17:49
*** csomerville has quit IRC17:51
*** cody-somerville has quit IRC17:54
*** csomerville has joined #openstack-lbaas17:54
diltramupdating my mac, will be probably in around 0.5 hour17:57
johnsomTaking the Sierra plunge?  Let me know how it goes17:57
nmagnezijohnsom, so reading the patch commit msg you would imagine there is a new magical way to retrieve tenant_id, but the examples they applied in the same patch do not show how to do this exactly18:00
nmagnezistrange18:00
*** eezhova has joined #openstack-lbaas18:00
*** eezhova has quit IRC18:01
*** eezhova has joined #openstack-lbaas18:06
*** ihrachys has quit IRC18:10
*** SumitNaiksatam has joined #openstack-lbaas18:13
*** chlong has joined #openstack-lbaas18:14
*** nmagnezi has quit IRC18:15
*** nmagnezi has joined #openstack-lbaas18:26
*** nmagnezi has quit IRC18:27
*** amoralej is now known as amoralej|off18:27
*** armax has joined #openstack-lbaas18:29
johnsomOk, I am shocked, the py3 passed the scenario gate.  I'm going to check it out and give it a spin, if it passed, we can start merging stuff18:30
*** harlowja has joined #openstack-lbaas18:31
rm_work\o/18:34
*** bana_k has joined #openstack-lbaas18:39
johnsomSo....18:43
johnsomamphora-agent[1172]: 2016-12-15 18:43:13.945 1293 ERROR octavia.amphorae.backends.agent.api_server.server   File "/usr/local/lib/python3.5/dist-packages/octavia/amphorae/backends/agent/api_server/listener.py", line 109, in upload_haproxy_config18:43
johnsomDec 15 18:43:13 amphora-def8c6a3-4c21-4c80-b0c4-6be505734b70 amphora-agent[1172]: 2016-12-15 18:43:13.945 1293 ERROR octavia.amphorae.backends.agent.api_server.server     file.write(b)18:43
johnsomDec 15 18:43:13 amphora-def8c6a3-4c21-4c80-b0c4-6be505734b70 amphora-agent[1172]: 2016-12-15 18:43:13.945 1293 ERROR octavia.amphorae.backends.agent.api_server.server TypeError: write() argument must be str, not bytes18:43
johnsomWhy do I get this and the gate does not?18:43
johnsomI did18:44
johnsomneutron lbaas-loadbalancer-create --name act-stby-rr-1 private-subnet18:44
johnsomneutron lbaas-listener-create --name listener1 --loadbalancer act-stby-rr-1 --protocol HTTP --protocol-port 8018:44
johnsomBoom18:44
johnsomHmm, I might be having adam's issue from yesterday.  I'm not sure I'm on the current code.  Bummer.18:47
rm_workyeah...18:48
rm_workstill working on it18:48
rm_workit just doesn't seem to be working18:49
rm_worki mean, the exports18:49
xgerman:-(18:50
*** harlowja has quit IRC18:52
johnsomI think I just checked the code out wrong18:54
johnsomI will have to give it a go again later, I need to restack for a meeting18:55
rm_worki triple checked mine...18:56
rm_workthen stacked...18:56
rm_workdidn't work18:56
rm_workfresh box18:56
rm_worktrying to actually trace what it's doing18:58
*** catintheroof has joined #openstack-lbaas19:02
*** catinthe_ has quit IRC19:06
openstackgerritLubosz Kosnik (diltram) proposed openstack/octavia: Fix some python3 string issues in amphora agent  https://review.openstack.org/41034519:19
openstackgerritLubosz Kosnik (diltram) proposed openstack/octavia: Fix the agent install to use pip -U  https://review.openstack.org/40995619:19
openstackgerritLubosz Kosnik (diltram) proposed openstack/octavia: Stop depending on tripleo-image-elements  https://review.openstack.org/35659019:19
openstackgerritLubosz Kosnik (diltram) proposed openstack/octavia: The amphora agent plug_vip has an indention issue  https://review.openstack.org/40995319:19
openstackgerritLubosz Kosnik (diltram) proposed openstack/octavia: Change bind_host IP address  https://review.openstack.org/41143119:19
rm_workugh now having another yum repo issue19:22
*** cody-somerville has joined #openstack-lbaas19:25
*** cody-somerville has quit IRC19:25
*** cody-somerville has joined #openstack-lbaas19:25
*** csomerville has quit IRC19:28
openstackgerritLubosz Kosnik (diltram) proposed openstack/octavia: Fix some python3 string issues in amphora agent  https://review.openstack.org/41034519:28
*** nicodemus_ has joined #openstack-lbaas19:30
nicodemus_hello19:31
nicodemus_quick question (I was referred here from #openstack-neutron): does anyone know if the LBaaSv2 UI in Mitaka is working?19:32
nicodemus_Because when I try to create a loadbalancer, horizon only says "Error: source_type"19:32
nicodemus_(it works through CLI though)19:32
rm_workthere are several people here looking into it19:35
rm_workit seems to be a fairly common issue that there is something wrong with the lbaasv2 horizon dashboard19:35
rm_worki haven't been following it very closely though :(19:35
rm_workI think ankur-gupta-f is one19:36
rm_worknicodemus_: ^^19:36
nicodemus_rm_work, yeah... ankur mentioned that there are some bug reports filed about it19:37
nicodemus_rm_work, thanks for your reply ! At least it's not just me doing something wrong19:38
*** eezhova has quit IRC19:45
*** eezhova has joined #openstack-lbaas19:46
rm_workugh stacks take even longer now that it has to upgrade basically the entire system package tree19:53
johnsomOk, starting a clean stack, going to grab lunch while it runs19:53
diltramand I'm analyzing Zuul status and our test execution :P19:54
diltramwaiting to pass all scenarios19:54
xgermanlet me know if I can help in any way…19:54
diltramsure19:55
diltrambut by mistake I rebased all patches in chain19:55
diltramso gate is testing all of them right now :/19:56
diltramso it will take some time19:56
xgermanmmh19:56
rm_workheh20:11
diltramok, I found that scenario can fail because timeout is too short20:16
diltramI just had a situation that cloud-init was reading data and it shutted of the whole test20:17
*** nicodemus__ has joined #openstack-lbaas20:21
*** catintheroof has quit IRC20:22
*** afranc has quit IRC20:23
*** nicodemus_ has quit IRC20:24
*** basilAB has quit IRC20:24
diltramjohnsom: binding to SERVICE_HOST breaks lbaasv2-api tests :/20:25
*** basilAB has joined #openstack-lbaas20:25
johnsomProbably another setting that needs updating20:25
diltramtests are connecting to 127.0.0.1:9876 and service is binded into xxxxx20:26
diltramSERVIE_HOST ip basicaly20:26
johnsomOr we could change what it advertises to be 127.0.0.1 instead of service host20:26
diltramfor now I will just verify that it's needed to fix the scenario20:27
diltramif it's gonna help I will find a way to configure this20:27
*** afranc has joined #openstack-lbaas20:27
johnsomFile "/usr/local/lib/python3.5/dist-packages/octavia/amphorae/backends/utils/20:29
johnsomhaproxy_query.py", line 60, in _query20:29
johnsomdata += x20:29
johnsomTypeError: Can't convert 'bytes' object to str implicitly20:29
*** eezhova has quit IRC20:32
xgermanI have seen that before20:32
xgermanyou probably need some six.b20:32
johnsomThat is the error I get with the current https://review.openstack.org/#/c/410345 and below20:33
*** catintheroof has joined #openstack-lbaas20:35
*** kbyrne has quit IRC20:36
*** nicodemus__ has quit IRC20:37
rm_workyeah using + operators for things that aren't integers is gross20:45
xgermanha20:46
rm_workI see another way to fix it20:46
johnsomI am looking into why haproxy is being strange, feel free to do a spin on the patch20:46
rm_workwhere we don't need to guess types20:46
xgermanok20:46
johnsomHa, go?20:46
rm_worklol20:46
rm_workYou can just set it to none, and if it's none, initialize it20:47
rm_workinstead of initializing it with ''20:47
xgermanwell, it will expect a string later20:47
rm_workthen it'll always be the right type20:47
rm_workwill it?20:47
rm_worklooking20:47
xgermannext line:  return data.rstrip()20:47
diltramso yeah this bind is fixing octavia scenarions but makes nlbaas scenarios failingg20:48
diltramI'm gonna make it more parametriazed so both can pass20:48
*** nicodemus__ has joined #openstack-lbaas20:49
johnsomI'm trying to figure out how that nlbaas scenario gate passed.  My guess is it was up long enough to load balance, but then gets failed over because there is no health data coming out20:49
johnsomBut, I'm not getting that result on my devstack.20:49
johnsomI'm getting no response from haproxy20:49
bana_kjohnsom for /opt/stack/diskimage-builder commit id bf5af6155c43c3c764dd74e5ad6d387a0a1a0a62 does not exist :/20:50
johnsombana_k The line below corrected my paste: --protocol-port 80 pool120:50
johnsomUgh, again...20:50
johnsombf5af6155c43c3c764dd74e5ad6d387a0a1a0a6220:51
bana_kfatal: Could not parse object 'bf5af6155c43c3c764dd74e5ad6d387a0a1a0a62'.20:51
johnsombana_k you are doing git checkout bf5af6155c43c3c764dd74e5ad6d387a0a1a0a62 in /opt/stack/diskimage-builder?20:52
bana_kI was trying to reset it to that commit id20:52
rm_workxgerman: ah yeah, you can always six.text_type everything...20:55
rm_workI don't think the time stack.sh reports at the end is correct >_>20:55
openstackgerritLubosz Kosnik (diltram) proposed openstack/octavia: Change bind_host IP address  https://review.openstack.org/41143120:56
diltramok I have a meetingg20:56
diltramwill take a look into results later20:56
johnsomYeah, ok.  So that is the issue.  The health stuff is failing so it fails over21:01
johnsomAre one of you folks already working on a new version or should I attempt?21:01
xgermana new version? Where we change the buffer to string with six.u?21:06
rm_worki prefer six.text_type usually21:07
rm_workbut21:07
rm_workI'm not actually sure what is better here21:07
rm_worki guess explicitly initializing with u'' and then using six.u works21:08
*** nicodemus__ has quit IRC21:08
johnsomsix.u for the x?21:08
xgermanyep21:09
xgermanthey say it does ASCII21:09
johnsomOk, I have a setup where I can try this stuff pretty easy, so I will give it a go21:10
xgerman+121:10
*** bdeschenes has quit IRC21:10
*** reedip_ has joined #openstack-lbaas21:10
xgermanfor some reason my tox -epy35 succeeded21:10
xgermanbut that’s probably a real world problem21:10
rm_workfor some reason stacking in this environment hates me and wants me to suffer21:10
bana_kjohnsom if I set the admin_state_up as False,  what is operating_status should be ?21:11
rm_worki wish i had ubuntu boxes...21:11
xgerman:-)21:11
rm_workthis isn't making me hate RPM distros any less21:11
johnsombana_k operating_status is what status is observed, so those two are not necessarily related.21:14
bana_koh I see. under what conditions the operating status changes?21:14
johnsomxgerman rm_work https://etherpad.openstack.org/p/dib-issue21:15
johnsomWhat did I do wrong here?21:15
xgermanI got soemthing similar with six.b — six is just bomkers21:16
johnsombana_k operating_status is the reported health for an item, so it comes from the agent21:16
johnsomIt twists my mind a bit, especially with things like socket recv21:16
bana_kAh ok. Thanks johnsom21:16
rm_workah yeah you have to do a decode from b to str21:19
rm_workstr to b is fine but21:19
rm_workb to str you need to specify that it's ascii21:19
rm_workjohnsom: fixed21:20
johnsomTesting21:20
rm_worki don't know if the send() needs to be converted21:21
rm_worki think it'll do it implicitly?21:21
rm_workwhat is "query"?21:21
rm_workthe "+" there scares me21:21
rm_workjust DON'T use + for strings T_T21:21
rm_workI tried to fix any I found to make them use .format21:21
rm_workwhich handles a lot of type issues21:22
rm_workwell, sometimes<_<21:22
johnsomhttps://github.com/openstack/octavia/blob/master/octavia/amphorae/backends/utils/haproxy_query.py21:23
rm_workah no it does bad things with bytes, guh21:23
johnsomquery is a string being send to the haproxy stats socket it appears21:23
rm_workwhatever, i guess query SHOULD be a string21:23
rm_workyeah21:23
rm_work.format() fails me with anything bytes21:24
rm_workuuuugh21:24
*** reedip_ has quit IRC21:24
rm_workbut using .decode('ascii') will fail on the py2 side21:25
rm_workfff21:25
xgermanthis is just a mess21:25
johnsomUgh, ok.  Because this code seems to be working21:25
rm_workuuuuuugh21:27
rm_work>>> six.u(b'h')21:27
rm_workb'h'21:27
rm_work>>> six.text_type(b'h')21:27
rm_work"b'h'"21:27
xgermanI think I had my hand in this code21:27
rm_workgross21:27
rm_workboth suck21:27
johnsomxgerman grin - I wasn't going to say anything21:28
xgermanit was inspired by libra21:28
*** reedip_ has joined #openstack-lbaas21:28
johnsombut then again, we were in "make it work" mode21:28
rm_workwell we can always do the ridiculous way21:28
xgermanyep21:29
reedip_LBaaS team, hi . Can someone provide review comments for https://review.openstack.org/273896 ?21:30
rm_workthat21:30
rm_workjohnsom: ^^ see etherpad21:30
rm_workre: ridiculous way21:30
rm_workit's not ... THAT bad21:30
johnsomHa21:30
rm_workbut there must be a good way to do this21:30
rm_workbrute force six-ing21:31
rm_workwhen all else fails...21:32
*** csomerville has joined #openstack-lbaas21:34
*** cody-somerville has quit IRC21:34
johnsomOk, that seems to work.  Are there any others?  Any of that ssl stuff for example?21:41
johnsomMaybe we got it all already21:42
openstackgerritMichael Johnson proposed openstack/octavia: Fix some python3 string issues in amphora agent  https://review.openstack.org/41034521:42
rm_worki'm STILL trying to get a stack working with the code changes propagating to the amps21:43
rm_workgrr21:43
rm_workthis stack is almost done but it's been running for the better part of 2 hours...21:43
rm_workmaybe more :/21:43
johnsomWow21:45
johnsomTotal runtime         98221:46
johnsomThat was my last run21:46
johnsomIt did have to download some stuff, not just pull from the cache21:46
johnsomHuh?21:52
johnsomhttp://logs.openstack.org/45/410345/7/check/gate-octavia-python35/6c38671/console.html#_2016-12-15_21_47_34_62058621:52
rm_workuhh21:55
rm_workwut21:55
rm_workso now it's a string?21:55
rm_workummmmmmmm21:55
*** SumitNaiksatam has quit IRC21:56
rm_workdoing some testing, sec21:57
openstackgerritLubosz Kosnik (diltram) proposed openstack/octavia: Change bind_host IP address  https://review.openstack.org/41143121:58
rm_worktry THAT johnsom21:59
rm_workmore intelligent21:59
rm_worklol yeah 8625 seconds for this last stack22:01
rm_workfff22:01
xgermanso pycharm has some inspector to ensure code compatibility22:07
xgermanbetween 2.7 and 3.522:08
xgermanwonder if that actually works22:08
rm_workyeah i have it on, but22:08
rm_workit doesn't really22:08
rm_workwhen it doesn't understand fully everything that'll be returned from obscure parts of other libs22:08
rm_worksince nothing is typed >_>22:09
xgerman:-(22:09
xgermanwhere is Machine Learning when you really need it?22:09
openstackgerritMichael Johnson proposed openstack/octavia: Fix some python3 string issues in amphora agent  https://review.openstack.org/41034522:11
johnsomDang it, forgot about the patch chain22:11
johnsomOk, let's try that22:11
xgermanfingers crossed22:12
rm_workFFF seriously, why isn't it picking this up22:17
rm_workhmm i should double check the var names, i'm just using the ones you pasted22:18
rm_workthey LOOK right tho22:18
rm_workdeclare -x DIB_REPOLOCATION_amphora_agent="/opt/stack/octavia"22:18
rm_workdeclare -x DIB_REPOREF_amphora_agent="18a486baaa04f9dfdae2646f2b362f86c4bbca4b"22:18
rm_workthat's how they look before i run stack.sh22:18
rm_workthat commit hash is the HEAD of what's checked out in /opt/stack/octavia22:19
rm_workmaybe there's other stuff i'm missing22:19
*** _ducttape_ has joined #openstack-lbaas22:20
johnsomhttps://github.com/openstack/octavia/blob/master/devstack/plugin.sh#L3222:20
johnsomThat is where i got it22:20
johnsomSeems to work for me22:20
rm_workyeah22:21
rm_workwhat do your exports look like22:21
johnsomYou don't have a wrapper script that is forking a new shell do you?22:21
rm_worki mean, after they ran22:21
rm_worki tried running stack.sh by hand directly this time after verifying the exports and the contents of the local clone22:21
rm_workah hmmm maybe the plugin line messes it up22:22
openstackgerritAdam Harwell proposed openstack/octavia: Amphora-agent should log to a distinct location  https://review.openstack.org/41048722:22
johnsomYeah, that would step on your setting wouldn't it22:22
*** reedip_ has quit IRC22:23
*** ducttape_ has quit IRC22:23
johnsomWant me to add the logrotate files to your patch?  I can probably do that pretty quick22:23
*** _ducttape_ has quit IRC22:24
rm_workif you know how to do it22:25
johnsomYep22:25
rm_worki was going to look it up once i GOT THIS OIYR#*(BYRC*#B&C WORKING22:25
rm_workbut if you've got time :P22:25
johnsomWatching zuul.  Don't want to dive back into quota just to come back and merge a bunch of stuff in a few minutes, so yeah, I can hammer this out22:26
xgermancool, we still use rsyslog ? So that is really straight forward22:27
rm_workmy thoughts on rsyslog are ... not favorable22:28
rm_workwish we used syslog-ng22:28
rm_workbut whatev22:28
xgermanlet’s do what we do best and bije shed on this22:29
* xgerman is getting popcorn22:29
johnsomIt doesn't look like that is using syslog...  I think gunicorn is doing logging itself as currently configured in the patch22:30
xgermanthen how does it roll?22:32
johnsomlogrotate.d22:32
johnsomand HUP122:32
johnsomNo, sorry USR122:32
xgermanmmh22:32
johnsomHa, that would have been fun22:32
johnsomSame thing flask was doing22:33
xgermanterm was logging stdout -> upstart22:33
xgermanflask22:33
rm_workwtf is with this packaging BS22:35
rm_worklike half of the mirrors must not be fully up to date or something22:35
johnsomHad to go watch the UPS truck take a few tries at getting up the hill...  Good times22:36
rm_worklol22:37
xgermanYouTube video?22:37
johnsomProbably could have made one22:38
*** yamamoto has quit IRC22:40
rm_workwhat the everliving f*#($&*22:41
rm_workwhy is yum looking for http://mirror.compevo.com/epel/7/x86_64/repodata/39a30e256aafcb6810866f9aff9bf40a41c969280c032ce8af2349e631d59f34-primary.sqlite.xz: [Errno 14] HTTP Error 404 - Not Found22:42
rm_workit isn't there22:42
rm_workgrah22:42
xgermannot yu,22:45
xgermannot yummy22:45
*** catintheroof has quit IRC22:46
johnsomrm_work Mind if I drop that debug and make this patch close to ready?22:52
rm_workyes go for it22:55
openstackgerritMichael Johnson proposed openstack/octavia: Amphora-agent should log to a distinct location  https://review.openstack.org/41048722:56
johnsomOh, dang, forgot a element depends.  One more.22:57
openstackgerritMichael Johnson proposed openstack/octavia: Amphora-agent should log to a distinct location  https://review.openstack.org/41048722:57
openstackgerritMichael Johnson proposed openstack/octavia: Amphora-agent should log to a distinct location  https://review.openstack.org/41048723:02
openstackgerritMichael Johnson proposed openstack/octavia: Change bind_host IP address  https://review.openstack.org/41143123:05
openstackgerritMichael Johnson proposed openstack/octavia: Change bind_host IP address  https://review.openstack.org/41143123:05
*** fnaval has quit IRC23:08
*** catintheroof has joined #openstack-lbaas23:17
*** catintheroof has quit IRC23:17
*** catintheroof has joined #openstack-lbaas23:18
johnsomWatch, the one test we needed to see got one of the slow hosts....23:22
johnsomYeah, one of those slow hosts from *that* company....  ha23:33
johnsomOk, it passed.  I think we are good to start merging up the chain23:33
johnsomAlso, FYI HAProxy 1.7 https://www.mail-archive.com/haproxy@formilux.org/msg24244.html23:36
*** yamamoto has joined #openstack-lbaas23:40
openstackgerritMichael Johnson proposed openstack/octavia: Change bind_host IP address  https://review.openstack.org/41143123:46
*** yamamoto has quit IRC23:50
*** harlowja has joined #openstack-lbaas23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!