Monday, 2017-06-26

*** reedip has quit IRC00:07
*** reedip has joined #openstack-lbaas00:21
*** sticker has joined #openstack-lbaas01:08
*** reedip has quit IRC01:23
korean101rm_work: hi!01:24
korean101rm_work: i use octavia (0.10.1.dev25) / neutron-lbaas (10.0.0)01:24
korean101neutron (10.0.0)01:27
*** reedip has joined #openstack-lbaas01:35
*** dayou has joined #openstack-lbaas01:39
*** dayou has quit IRC01:41
*** tonygunk has quit IRC02:01
*** tonygunk has joined #openstack-lbaas02:08
*** dayou has joined #openstack-lbaas02:26
*** armax has quit IRC03:04
*** armax has joined #openstack-lbaas03:04
*** armax has quit IRC03:14
*** aojea has joined #openstack-lbaas03:27
*** aojea has quit IRC03:32
openstackgerritVan Hung Pham proposed openstack/octavia master: Replace the usage of 'admin_manager' with 'os_admin'  https://review.openstack.org/47735703:50
*** yamamoto has joined #openstack-lbaas03:54
*** rstarmer has joined #openstack-lbaas03:57
*** amotoki_away is now known as amotoki04:02
*** rstarmer has quit IRC04:05
*** links has joined #openstack-lbaas04:40
*** cshastri has joined #openstack-lbaas05:06
*** reedip has quit IRC05:45
*** kobis has joined #openstack-lbaas05:52
*** rcernin has joined #openstack-lbaas05:59
*** tesseract has joined #openstack-lbaas06:24
*** reedip has joined #openstack-lbaas06:28
openstackgerritVan Hung Pham proposed openstack/octavia master: Replace the usage of 'admin_manager' with 'os_admin'  https://review.openstack.org/47735706:35
*** pcaruana has joined #openstack-lbaas06:45
*** reedip has quit IRC06:48
*** reedip has joined #openstack-lbaas06:48
*** gcheresh has joined #openstack-lbaas06:56
*** aojea has joined #openstack-lbaas07:22
*** reedip is now known as reedip_afk07:24
*** aojea has quit IRC07:25
*** aojea has joined #openstack-lbaas07:26
*** dayou has quit IRC07:29
*** aojea has quit IRC07:45
*** aojea has joined #openstack-lbaas07:45
*** pcaruana has quit IRC07:58
*** rcernin has quit IRC07:59
*** rcernin has joined #openstack-lbaas08:11
*** pcaruana has joined #openstack-lbaas08:12
*** junbo has quit IRC08:21
*** junbo has joined #openstack-lbaas08:25
*** yamamoto has quit IRC08:38
*** yamamoto has joined #openstack-lbaas08:39
*** yamamoto has quit IRC08:45
*** rstarmer has joined #openstack-lbaas08:46
*** rstarmer has quit IRC08:47
*** yamamoto has joined #openstack-lbaas09:03
*** dayou has joined #openstack-lbaas09:04
*** diltram_ has quit IRC09:09
*** diltram has joined #openstack-lbaas09:14
*** diltram has quit IRC09:19
*** diltram has joined #openstack-lbaas09:24
*** aojea has quit IRC09:38
openstackgerrittuninger proposed openstack/neutron-lbaas master: Add the code for updating the servers statistics based on haproxy stats data. Fixes Bug1699945.  https://review.openstack.org/47684809:41
*** aojea has joined #openstack-lbaas09:42
*** rcernin has quit IRC09:46
*** reedip_afk is now known as reedip09:49
openstackgerrittuninger proposed openstack/neutron-lbaas master: Add the code for updating the servers statistics based on haproxy stats data. Fixes Bug1699945.  https://review.openstack.org/47684809:50
openstackgerrittuninger proposed openstack/neutron-lbaas master: Add the code for updating the servers statistics based on haproxy stats data. Fixes Bug1699945.  https://review.openstack.org/47684809:55
*** rcernin has joined #openstack-lbaas10:02
*** yamamoto has quit IRC10:17
*** cshastri has quit IRC10:19
*** rstarmer has joined #openstack-lbaas10:27
*** rstarmer has quit IRC10:42
*** pcaruana has quit IRC10:53
*** yamamoto has joined #openstack-lbaas10:59
*** pcaruana has joined #openstack-lbaas11:05
*** aojea has quit IRC11:30
*** aojea has joined #openstack-lbaas11:31
*** aojea has quit IRC11:35
*** yamamoto has quit IRC11:37
*** atoth has quit IRC11:53
*** rcernin has quit IRC12:02
*** rcernin has joined #openstack-lbaas12:04
*** reedip has quit IRC12:07
*** yamamoto has joined #openstack-lbaas12:13
*** reedip has joined #openstack-lbaas12:19
*** rcernin has quit IRC12:21
*** rcernin has joined #openstack-lbaas12:21
*** cpuga has joined #openstack-lbaas12:45
*** cpuga_ has joined #openstack-lbaas12:48
*** cpuga has quit IRC12:51
openstackgerritThomas Herve proposed openstack/neutron-lbaas master: Send haproxy stat command as bytes  https://review.openstack.org/47486813:01
xgerman_o/13:14
*** aojea has joined #openstack-lbaas13:21
*** atoth has joined #openstack-lbaas13:33
*** gcheresh has quit IRC13:44
*** chlong has joined #openstack-lbaas13:52
*** kobis has quit IRC13:54
*** links has quit IRC13:58
*** cpuga_ has quit IRC14:00
*** chlong has quit IRC14:01
*** cpuga has joined #openstack-lbaas14:11
*** chlong has joined #openstack-lbaas14:14
openstackgerritThomas Herve proposed openstack/neutron-lbaas master: Send haproxy stat command as bytes  https://review.openstack.org/47486814:51
johnsomo/14:59
*** leitan has joined #openstack-lbaas15:01
*** leitan_ has joined #openstack-lbaas15:02
*** rcernin has quit IRC15:04
*** leitan has quit IRC15:05
*** fnaval has joined #openstack-lbaas15:07
*** kobis has joined #openstack-lbaas15:09
*** links has joined #openstack-lbaas15:17
*** yamamoto has quit IRC15:21
*** yamamoto has joined #openstack-lbaas15:24
*** links has quit IRC15:25
*** chlong has quit IRC15:27
*** yamamoto has quit IRC15:29
*** aojea has quit IRC15:37
*** aojea has joined #openstack-lbaas15:37
*** chlong has joined #openstack-lbaas15:40
*** aojea has quit IRC15:42
*** dayou has quit IRC15:50
*** jniesz has joined #openstack-lbaas15:55
cpugajohnsom: I'll be sending out an email to openstack-dev so that we may discuss flavor spec.15:56
cpugajohnsom: Is there a day/time you feel would be a best?15:56
johnsomNot really.  Some of us are on the west coast US, so a time that is compatible with that timezone would be good15:59
cpugak, I'll purpose a day/time and then we can narrow it down from there. thx.16:00
*** pcaruana has quit IRC16:03
*** amotoki is now known as amotoki_away16:05
*** cody-somerville has joined #openstack-lbaas16:08
*** cody-somerville has joined #openstack-lbaas16:08
*** pcaruana has joined #openstack-lbaas16:14
xgerman_+116:15
*** yamamoto has joined #openstack-lbaas16:27
*** sshank has joined #openstack-lbaas16:30
*** yamamoto has quit IRC16:32
*** SumitNaiksatam has quit IRC16:47
*** cpuga has quit IRC16:54
*** chlong has quit IRC17:02
*** pcaruana has quit IRC17:03
*** sshank has quit IRC17:08
*** chlong has joined #openstack-lbaas17:14
*** SumitNaiksatam has joined #openstack-lbaas17:17
*** aojea has joined #openstack-lbaas17:22
*** aojea has quit IRC17:27
*** leitan has joined #openstack-lbaas17:28
*** leitan_ has quit IRC17:30
*** cpuga has joined #openstack-lbaas17:38
rm_worknmagnezi: o/17:41
*** cpuga_ has joined #openstack-lbaas17:43
rm_worki'm looking into that test failure17:43
*** cpuga has quit IRC17:46
rm_workah michael missed one18:01
johnsomIt's from the rebase I think18:02
rm_workfixing18:03
rm_workahhh yep18:03
rm_worknew18:03
rm_workor ... no i don't think so?18:04
rm_workwell maybe18:04
rm_workah yeah18:04
*** gcheresh has joined #openstack-lbaas18:06
rm_workah there's another bug18:09
rm_worki got it tho18:09
rm_workjust gonna be a bit, because i have to afk18:09
*** kobis has quit IRC18:10
*** kobis has joined #openstack-lbaas18:11
*** kobis has quit IRC18:15
*** blogan has joined #openstack-lbaas18:17
*** JudeC has joined #openstack-lbaas18:29
*** leitan_ has joined #openstack-lbaas18:36
*** leitan has quit IRC18:39
openstackgerritMichael Johnson proposed openstack/octavia master: Add v2 L7 Policy API section  https://review.openstack.org/47717418:47
*** aojea has joined #openstack-lbaas18:49
*** aojea has quit IRC18:49
*** aojea has joined #openstack-lbaas18:49
johnsomThat section is ready for review18:49
johnsomTwo more to go.  (after lunch)18:51
*** chlong has quit IRC19:02
*** chlong has joined #openstack-lbaas19:16
*** atoth has quit IRC19:26
openstackgerritAdam Harwell proposed openstack/octavia master: Allow operators to disable v1 or v2.0 api endpoints  https://review.openstack.org/47669020:18
rm_workoh whoops nm i did that wrong20:19
rm_workhey johnsom20:20
rm_workwe only have to deprecate once something has actually made an official release right?20:20
rm_workpaging/sorting was all THIS cycle, right?20:20
rm_workso no deprecation?20:21
johnsomAh, interesting point20:21
*** tesseract has quit IRC20:21
rm_worki'm gonna snip those20:21
rm_workthat's like 75%20:21
*** aojea_ has joined #openstack-lbaas20:27
*** aojea has quit IRC20:28
rm_workjohnsom: also nmagnezi's question is interesting... COULD WE turn off v1 by default?20:30
rm_workor would that break everyone everywhere20:30
rm_workwe're still assuming neutron-lbaas is in use everywhere at this point, right?20:30
johnsomYeah, I was on the fence on that.20:30
rm_workI *think* it's probably safer to leave it on20:30
johnsomYeah, it's used20:30
rm_workbut20:30
johnsomWe would have to put in some gate fixes to turn it on too20:31
rm_workyeah bleh20:31
rm_workjust not feeling it20:31
rm_worknext cycle20:31
johnsom+120:31
rm_workk20:32
*** sshank has joined #openstack-lbaas20:32
*** sshank has quit IRC20:32
*** sshank has joined #openstack-lbaas20:33
openstackgerritAdam Harwell proposed openstack/octavia master: Allow operators to disable v1 or v2.0 api endpoints  https://review.openstack.org/47669020:33
openstackgerritAdam Harwell proposed openstack/octavia master: Allow operators to disallow creation of TLS Termination listeners  https://review.openstack.org/47670120:33
rm_workok20:33
rm_workshould be g2g20:34
openstackgerritMichael Johnson proposed openstack/octavia master: Add v2 L7 Policy API section  https://review.openstack.org/47717420:34
rm_workwaiting on gates but it passes locally now20:34
johnsomI guess you folks would be impacted by deprecating something inside the same cycle, but that is the pain of running master....20:36
cpuga_johnsom: Not sure if you saw the [openstack-dev][octavia] email for flavor-spec I sent out.20:39
cpuga_johnsom: I received a response with a proposed time for 7:00am PDT on Thursday.20:39
johnsomI haven't checked that e-mail yet today20:40
cpuga_johnsom: Is this a time that would work for west coast?20:40
xgerman_7 am PDT is 4 am EST - not gonna happen20:41
xgerman_nah, 10 am… hate the time stuff20:41
johnsom10am20:41
cpuga_:)20:41
johnsomUmmm, I can probably make that, but not sure if rm_work would be game20:42
cpuga_I can respond with 8:00am PDT if that works best for core team.20:42
rm_workeh20:44
rm_worki think the chances of me making a 7am meeting are SLIM but non-zero20:44
rm_workbut to be fair the times suck a lot for other people now20:44
rm_workso i'd be a hypocrite to refuse20:44
johnsomrm_work What about the 8am cpuga_ proposed?20:45
*** gcheresh has quit IRC20:55
xgerman_sam propsoed something else…21:02
rm_workjohnsom: hey, BTW is it supposed to reload the policy file on EVERY request?21:03
rm_workjohnsom: looks like we're seeing some performance issues with the API now and ...21:03
rm_workevery request it's being like "reloading policy file"21:03
rm_workReloading cached file /etc/octavia/policy.json read_cached_file /var/lib/kolla/venv/lib/python2.7/site-packages/oslo_policy/_cache_handler.py:4021:04
rm_workReloaded policy file: /etc/octavia/policy.json _load_policy_file/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_policy/policy.py:68121:04
rm_workit IS cached21:04
rm_workso maybe that's just annoying logging21:04
johnsomYeah, I saw that too21:04
rm_workbut performance is ... bad21:04
rm_worklike21:04
rm_worktimeout bad21:04
rm_worksometimes21:04
*** chlong has quit IRC21:04
johnsomHmmm, any details on what they were doing?  Do you front the API with haproxy?  That log would be interesting to look at21:06
rm_workwe do21:06
rm_workapi is running in kubernetes21:06
rm_workwhich means there's the kube haproxy in front of it21:07
johnsomOk, so take a look at the haproxy logs, they should have timing info for the requests.21:09
*** aojea_ has quit IRC21:09
rm_workeh it's not in haproxy21:10
*** aojea has joined #openstack-lbaas21:10
rm_worki'm seeing that it took 10s to do a LB List21:10
rm_workehhh maybe no21:10
johnsomYeah, I didn't mean it was haproxy causing the problem, just that it should have the requests and how long they took21:10
rm_workhmm21:11
rm_workactually i just found one request that took us .2 seconds to process but 10s on the requertor side21:11
rm_workto nm21:11
rm_work*requestor side21:11
rm_work*so nm21:11
rm_workfff can't type today21:11
johnsomBut if you can get it to do it with an lb list, then I guess we don't need that.21:11
*** sshank has quit IRC21:12
*** sshank has joined #openstack-lbaas21:12
*** kevinbenton has quit IRC21:12
rm_workproblem is it's hard to repro, kinda intermittent21:12
cpuga_xgerman_: "sam proposed something else..."?21:13
johnsomYeah, the other thing to check is the DB logs21:13
cpuga_xgerman_: The email I received proposes 9:00am CDT which is 7:00am PDT.21:13
johnsomWorst case, turn on TRACE logging for a bit21:13
cpuga_xgerman_: Was there another email that perhaps I'm missing?21:13
xgerman_nah, I am bad with timzeones21:14
xgerman_that’s all21:14
xgerman_no other e-mail21:14
*** aojea has quit IRC21:14
cpuga_xgerman_: k, no worries it happens to me too21:14
cpuga_rm_work: would you be okay with 7:00am or would you prefer 8:00am?21:14
rm_work8am would make me slightly more likely to make it21:15
rm_worki honestly prefer like 2am meetings to 8am :P21:15
*** kevinbenton has joined #openstack-lbaas21:15
rm_workbut i can't hold the world to my schedule21:15
rm_workif i had that kind of power, i wouldn't be working here...21:15
johnsomYeah, 8am is better for me21:15
cpuga_k, I'll respond with 8:00am21:16
cpuga_Is the day Thursday good with you all?21:16
johnsomYeah, I can do Thursday21:16
cpuga_rm_work:,xgerman_: Thursday good also?21:18
*** aojea has joined #openstack-lbaas21:21
*** sshank has quit IRC21:22
rm_work2017-06-26 21:17:21.312 12 INFO octavia.cmd.api [-] Starting API server on ('0.0.0.0',):987621:23
rm_work2017-06-26 21:17:21.312 12 CRITICAL octavia [-] Unhandled error: TypeError: coercing to Unicode: need string or buffer, tuple found21:23
rm_workjohnsom: ^^ wut how is that happening21:23
rm_worksee ('0.0.0.0',)21:23
rm_workwut21:23
johnsomDoes your config have 0.0.0.0 in the bind_host?21:24
*** jniesz has quit IRC21:25
rm_workcompare to21:25
rm_work2017-06-26 21:24:37.810 12 INFO octavia.cmd.api [-] Starting API server on 0.0.0.0:987621:25
rm_worksomething that merged recently caused that21:25
rm_workthat's the difference between my image from last week and this week with the same config21:25
*** aojea has quit IRC21:25
*** sshank has joined #openstack-lbaas21:26
rm_work@johnsom: yep21:29
johnsomI mean, it's an IPOpt so, not sure how that can be a tuple21:31
rm_workyeah <_<21:33
rm_workfound it21:35
rm_workabout to find out who typo'd21:35
rm_workme I think21:35
johnsomWhen you have a second, interested in your input on:https://review.openstack.org/#/c/477045/2/octavia/common/exceptions.py21:36
rm_workyep21:36
rm_worki have a typo in my new patch21:36
rm_workit isn't merged yet :P21:36
rm_work(but i'm using it internally already)21:36
openstackgerritAdam Harwell proposed openstack/octavia master: Allow operators to disable v1 or v2.0 api endpoints  https://review.openstack.org/47669021:37
rm_workdidn't notice in gate because gate uses apache uwsgi21:37
rm_workjohnsom: commented21:42
johnsomThanks21:42
*** leitan_ has quit IRC21:46
*** leitan has joined #openstack-lbaas21:47
*** eandersson has joined #openstack-lbaas21:48
*** leitan has quit IRC21:51
JudeCjohnsom: I am working on the statuses/statistics stuff I got it working by using the _lookup override. I created a new controller for the status tree response, should I make that controller its own file or can that live within the load_balancer.py controller as another class?21:53
*** tonygunk has quit IRC21:54
johnsomJudeC It can live in the load_balancer.py21:54
JudeCawesome ty :)21:54
eanderssonSilly question, but for neutron-lbaas, removing the lazy='joined' could that have a negative impact on anything besides performance?21:59
eanderssonin the sqlalchemy model21:59
eanderssone.g. https://github.com/openstack/neutron-lbaas/blob/master/neutron_lbaas/db/loadbalancer/models.py#L19622:00
eanderssonremoving those and all list operations are drastically faster22:03
openstackgerritMichael Johnson proposed openstack/octavia master: Correct RBAC Not Authorized status code  https://review.openstack.org/47704522:12
*** cpuga_ has quit IRC22:14
*** aojea has joined #openstack-lbaas22:22
johnsomeandersson I think the only impact might be more load on your database, but I suspect it's going to load that stuff anyway, so probably not much point in the lazy loading.22:27
*** aojea has quit IRC22:27
eanderssonYea - that is what I believe as well.22:27
eanderssonThe performance impact is huge22:28
johnsomCut it in half?22:28
eandersson10s vs 3s22:28
eanderssonwith 30 LBs with attached pools and listeners22:29
eanderssonDo you mind if I do a quick WIP pull request to run the full test suit?22:29
johnsomGo ahead22:29
eanderssonThanks johnsom22:30
openstackgerritErik Olof Gunnar Andersson proposed openstack/neutron-lbaas master: [WIP] Remove unnecessary lazy-loaded queries  https://review.openstack.org/47769822:32
rm_workI wonder if we did anything similar in octavia22:34
rm_workwith lazy-loading prematurely22:34
johnsomI'm pretty sure we did not do that in octavia22:34
rm_workk22:34
johnsomYeah, I don't see it22:35
rm_worki'm going to have to figure out how to do a performance analysis on our new API22:36
rm_workbecause this is wonky22:36
rm_workit's *intermittent* slowness22:36
rm_workit's like ...22:36
rm_work.2 .2 .2 .2 .2 10.222:36
eanderssonYea - Octavia looks good22:36
rm_work(seconds for a list LB response for the same user)22:37
johnsomHmmm22:37
rm_workit could be any number of things22:37
rm_workcould be my DB connection22:37
johnsomWell, like I said, you could turn on TRACE (for a while)22:37
rm_workcould be kubernetes oversubscription22:37
rm_workhmmm22:37
rm_worki might do that22:37
rm_workHOW do I do that22:37
rm_workdebug is a boolean22:37
rm_workis there trace=True ?22:38
johnsomhttps://review.openstack.org/#/c/366497/22:41
johnsomI see mention of CONF.default_log_levels22:42
johnsomI know it can be done, Helion had it on by default22:42
xgerman_for some time we got the neutron log config22:47
xgerman_in Helion BTW22:47
rm_workwhat's this one?22:49
rm_work2017-06-26 22:39:13.068 11 WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.22:49
rm_worknot relevant, but while we're fixing annoying messages22:50
*** fnaval_ has joined #openstack-lbaas23:00
*** fnaval_ has quit IRC23:00
*** fnaval_ has joined #openstack-lbaas23:00
*** fnaval has quit IRC23:01
johnsomFor backwards compatibility the service_token_roles_required option in [keystone_authtoken] was added. The option defaults to False and has been immediately deprecated. This will allow the current behaviour that service tokens are validated but not checked for roles to continue. The option should be set to True as soon as possible. The option will default to True in a future release.23:02
rm_workhmm so we should have23:02
rm_workthat enabled23:03
rm_worki wonder hwat that actually does23:03
johnsomThe write up is here: https://docs.openstack.org/releasenotes/keystonemiddleware/ocata.html23:03
rm_workahh interesting23:03
rm_workwellllll23:04
rm_workwe're on Liberty23:04
rm_worksooooo23:04
rm_work(I mean, Keystone is)23:04
rm_workso lulz23:05
rm_workI don't even know if setting this on the Octavia side will ... DO anything23:05
johnsomRight, not sure either23:05
rm_worki don't quite understand, wouldn't ALL of this validation be on the keystone side?23:05
rm_workthe client can't say "actually don't validate my roles plz"?23:05
rm_work<_<23:05
johnsomYeah, maybe it only matters is WE accept service tokens, but we don't, so...23:06
rm_workI'm gonna... uhh... set it23:07
rm_workand see what happens23:07
rm_workI'll report back ;P23:07
rm_workjohnsom: under POST for l7policies23:19
rm_workIn the response, the L7 policy provisioning status is ACTIVE, PENDING_CREATE, or ERROR.23:19
rm_work`provisioning status` is a link? to... ???23:20
rm_workit sends me to the top of the page23:20
rm_worki don't know what that's supposed to do23:20
johnsomYeah, different browsers seem to handle that differently....23:20
rm_workhmmm23:20
rm_workthis is Chrome O_o23:20
rm_workit goes to #prov-status23:20
rm_workit's not supposed to be like23:20
rm_work#provisioning-status ?23:20
johnsomIt goes here: https://developer.openstack.org/api-ref/load-balancer/v2/index.html#status-codes23:21
rm_workoh weird23:21
rm_workso if i copy the link23:21
rm_workand past it into the address bar23:21
rm_workit works23:21
rm_work*paste23:21
rm_workbut clicking is just broken23:21
rm_workk <_< whatever23:21
johnsomYeah, it works in firefox23:21
johnsomI just write the restructuredtext code...23:22
*** aojea has joined #openstack-lbaas23:23
rm_worksooooo23:24
rm_workdoes n-lbaas do returns on PUT/DELETE ?23:24
rm_workI wonder if we could ... remove those23:24
rm_work<_<23:24
johnsomNo return on delete23:25
johnsomBut PUT there is output23:25
rm_workfff23:26
rm_workk23:26
*** aojea has quit IRC23:27
rm_workthere we go23:28
openstackgerritAdam Harwell proposed openstack/octavia master: DELETE operations don't actually return data (204)  https://review.openstack.org/47770923:28
rm_workIMO we have to be careful23:29
rm_workbecause once we release Pike23:29
rm_workwe're going to be stuck with mistakes23:29
*** dayou has joined #openstack-lbaas23:29
johnsomYeah, good news on those, it wasn't actually returning anything as the return type was None.  We were just wasting cycles.23:30
*** sshank has quit IRC23:31
rm_workyeah lol23:31
*** SumitNaiksatam has quit IRC23:32
rm_workbut23:32
rm_worki am concerned about other possible cases of that23:32
johnsomThat is why I spent so much time going through and comparing the two APIs.23:32
rm_workyeah23:32
johnsomI need to go back and look at those bugs I opened and see if they are still bugs or not.23:33
*** dayou has quit IRC23:35
openstackgerritErik Olof Gunnar Andersson proposed openstack/neutron-lbaas master: [WIP] Remove unnecessary lazy-loaded queries  https://review.openstack.org/47769823:36
openstackgerritMichael Johnson proposed openstack/octavia master: Correct RBAC Not Authorized status code  https://review.openstack.org/47704523:52
*** JudeC has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!