Wednesday, 2016-11-16

*** dfisher has quit IRC00:20
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration: Nothing to see here.  https://review.openstack.org/39800300:42
mwhahahaHunner: fyi, https://tickets.puppetlabs.com/browse/MODULES-411400:52
*** morazi has quit IRC00:53
*** jtriley has joined #puppet-openstack00:59
*** jtriley has quit IRC01:06
*** fultonj has quit IRC01:38
*** xingchao has joined #puppet-openstack01:38
openstackgerritMerged openstack/puppet-gnocchi: Fix common options position in params.pp  https://review.openstack.org/39469802:02
Hunnermwhahaha: ah, we forgot a mergeback after release https://github.com/puppetlabs/puppetlabs-git/pull/7702:19
mwhahahaCool thanks. I figured be it was something like that02:20
mwhahahas/be //02:20
*** jtriley has joined #puppet-openstack02:25
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Prepare 6.0.0 (ocata-1)  https://review.openstack.org/39804602:38
*** zhongshengping has quit IRC02:40
openstackgerritIury Gregory Melo Ferreira proposed openstack/puppet-glance: Remove old authtoken options  https://review.openstack.org/39474902:40
openstackgerritIury Gregory Melo Ferreira proposed openstack/puppet-nova: Remove old authtoken options  https://review.openstack.org/39475302:45
*** ilbot3 has quit IRC02:46
*** ilbot3 has joined #puppet-openstack02:48
openstackgerritIury Gregory Melo Ferreira proposed openstack/puppet-heat: Remove old authtoken options  https://review.openstack.org/39475003:02
openstackgerritIury Gregory Melo Ferreira proposed openstack/puppet-cinder: Use new naming for authtoken variables  https://review.openstack.org/39805603:03
openstackgerritMerged openstack/puppet-magnum: Add magnum::clients class  https://review.openstack.org/39180703:18
*** xingchao has quit IRC03:45
*** xingchao has joined #puppet-openstack03:45
*** xingchao has quit IRC03:52
*** xingchao has joined #puppet-openstack03:53
*** xingchao_ has joined #puppet-openstack03:56
*** xingchao has quit IRC03:57
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration: Temporarily include newer PyMySQL  https://review.openstack.org/39800304:04
*** jtriley has quit IRC04:16
*** jtriley has joined #puppet-openstack04:35
*** jtriley has quit IRC04:40
*** xingchao_ has quit IRC04:45
*** xingchao has joined #puppet-openstack04:46
*** xingchao has quit IRC05:01
*** xingchao has joined #puppet-openstack05:45
*** jaosorior has joined #puppet-openstack06:16
*** xingchao has quit IRC06:20
*** xingchao has joined #puppet-openstack06:23
*** markvoelker has quit IRC06:28
openstackgerritgyani pillala proposed openstack/puppet-cinder: VSA templates Cinder Backend  https://review.openstack.org/39812506:30
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Remove explicit hiera calls for heat in keystone profile  https://review.openstack.org/39812806:35
*** jaosorior has quit IRC06:41
*** richm has quit IRC06:41
*** jaosorior has joined #puppet-openstack06:42
*** snarwade has quit IRC06:57
*** xingchao has quit IRC06:59
*** snarwade has joined #puppet-openstack07:00
*** xingchao has joined #puppet-openstack07:06
*** rasca has joined #puppet-openstack07:15
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Remove explicit hiera calls for heat in keystone profile  https://review.openstack.org/39812807:17
*** jaosorior has quit IRC07:34
*** jaosorior has joined #puppet-openstack07:54
*** shardy has joined #puppet-openstack07:56
*** skramaja_ has joined #puppet-openstack08:05
*** skramaja has quit IRC08:06
*** karthiks has quit IRC08:07
*** ccamacho has joined #puppet-openstack08:07
*** amoralej|off is now known as amoralej08:20
*** karthiks has joined #puppet-openstack08:22
*** markvoelker has joined #puppet-openstack08:29
*** jpich has joined #puppet-openstack08:31
*** jpena|off is now known as jpena08:34
*** markvoelker has quit IRC08:34
*** saneax-_-|AFK is now known as saneax08:36
*** hjensas has joined #puppet-openstack08:36
*** saneax is now known as saneax-_-|AFK08:55
*** saneax-_-|AFK is now known as saneax09:00
openstackgerritgyani pillala proposed openstack/puppet-cinder: VSA templates Cinder Backend  https://review.openstack.org/39812509:00
*** dtantsur|afk is now known as dtantsur09:03
*** skramaja has joined #puppet-openstack09:06
*** skramaja_ has quit IRC09:06
*** karthiks has quit IRC09:06
*** saneax is now known as saneax-_-|AFK09:13
*** karthiks has joined #puppet-openstack09:19
*** dgurtner has joined #puppet-openstack09:21
*** dgurtner has quit IRC09:21
*** dgurtner has joined #puppet-openstack09:21
*** lucas-afk is now known as lucasagomes09:32
*** gfidente has joined #puppet-openstack09:32
*** dtantsur is now known as dtantsur|afk09:33
*** paramite has joined #puppet-openstack09:33
*** dtantsur|afk is now known as dtantsur|bbl09:33
*** saneax-_-|AFK is now known as saneax09:38
*** _nick is now known as yankcrime09:38
*** derekh has joined #puppet-openstack09:41
*** bogdando has quit IRC09:50
*** bogdando has joined #puppet-openstack09:52
*** saneax is now known as saneax-_-|AFK09:59
*** dgurtner has quit IRC10:19
*** markvoelker has joined #puppet-openstack10:30
*** markvoelker has quit IRC10:35
openstackgerritgyani pillala proposed openstack/puppet-cinder: VSA templates Cinder Backend  https://review.openstack.org/39812510:42
*** xingchao has quit IRC11:05
*** xingchao has joined #puppet-openstack11:06
*** richm has joined #puppet-openstack11:12
*** xingchao has quit IRC11:17
*** jaosorior is now known as jaosorior_lunch11:25
openstackgerritgyani pillala proposed openstack/puppet-cinder: HPLeftHandISCSIDriver support for Cinder Backend  https://review.openstack.org/39812511:33
*** dtantsur|bbl is now known as dtantsur11:44
*** bogdando has quit IRC11:55
*** bogdando has joined #puppet-openstack11:57
*** dprince has joined #puppet-openstack12:01
*** xingchao has joined #puppet-openstack12:02
*** fultonj has joined #puppet-openstack12:04
iurygregorygood morning12:07
*** dgurtner has joined #puppet-openstack12:08
*** jaosorior_lunch is now known as jaosorior12:09
*** lucasagomes is now known as lucas-hungry12:11
*** shardy is now known as shardy_lunch12:11
*** psanchez has quit IRC12:13
*** dprince has quit IRC12:15
*** rook-out has quit IRC12:15
*** psanchez has joined #puppet-openstack12:15
*** dprince has joined #puppet-openstack12:16
*** rook has joined #puppet-openstack12:18
*** rook is now known as Guest4566512:18
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Sort parameters in keystone profile alphabetically  https://review.openstack.org/39832312:21
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Sort parameters in keystone profile alphabetically  https://review.openstack.org/39832312:24
*** ken_barber has quit IRC12:24
*** fxpester has joined #puppet-openstack12:40
*** shardy_lunch is now known as shardy12:45
*** xingchao has quit IRC12:49
*** pradk has joined #puppet-openstack12:55
*** morazi has joined #puppet-openstack13:00
*** johnmilton has joined #puppet-openstack13:01
*** ccamacho is now known as ccamacho|lunch13:04
*** morazi has quit IRC13:07
*** morazi has joined #puppet-openstack13:08
*** ducttape_ has joined #puppet-openstack13:08
*** ducttape_ has quit IRC13:09
*** ducttape_ has joined #puppet-openstack13:10
*** trown|outtypewww is now known as trown13:11
*** dgurtner has quit IRC13:18
*** lucas-hungry is now known as lucasagomes13:20
jaosorioriurygregory: hey, is CI officially broken? Or should I still recheck?13:23
*** jayg|g0n3 is now known as jayg13:25
*** ken_barber has joined #puppet-openstack13:29
iurygregoryjaosorior, recheck =)13:31
openstackgerritgyani pillala proposed openstack/puppet-cinder: HPLeftHandISCSIDriver support for Cinder Backend  https://review.openstack.org/39812513:33
*** ducttape_ has quit IRC13:38
*** ducttape_ has joined #puppet-openstack13:38
*** ducttape_ has quit IRC13:43
*** jpena is now known as jpena|lunch13:43
*** markvoelker has joined #puppet-openstack13:44
*** amoralej is now known as amoralej|lunch13:52
jaosorioriurygregory: do you happen to know, in puppet-heat, where would the "beaker tests" be?14:01
iurygregoryjaosorior, yep spec/acceptance14:01
iurygregoryhttps://github.com/openstack/puppet-heat/blob/master/spec/acceptance/basic_heat_spec.rb14:02
jaosorioriurygregory: thanks14:02
iurygregoryjaosorior, np14:02
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-heat: Add manifests to deploy APIs over httpd  https://review.openstack.org/39483514:05
iurygregoryjaosorior, maybe you should create a new acceptance for the wsgi i think =)14:06
iurygregoryor the deploy in wsgi is mandatory?14:07
jaosorioriurygregory: well, EmilienM -1ed the patch cause he wanted it tested there.14:07
jaosorioreither I could create a new acceptance test, or just run one or two API's over httpd14:07
iurygregoryyeah14:08
jaosorioriurygregory: what would you recommend?14:08
iurygregoryjaosorior, let's first see the result in the CI14:09
iurygregoryand when EmilienM come back we can talk :D14:09
jaosoriortrue14:10
jaosoriorand lets see if it works, I do need a fix I did for heat-templates to be available, and I'm not sure if it's there yet.14:10
iurygregoryok =)14:11
*** Guest45665 is now known as rook14:13
*** jperry has joined #puppet-openstack14:16
*** ducttape_ has joined #puppet-openstack14:20
*** ccamacho|lunch is now known as ccamacho14:28
*** ducttape_ has quit IRC14:31
*** jtriley has joined #puppet-openstack14:31
*** zhongshengpin has joined #puppet-openstack14:31
*** ducttape_ has joined #puppet-openstack14:32
*** amoralej|lunch is now known as amoralej14:32
*** ducttape_ has quit IRC14:36
*** jaosorior has quit IRC14:41
*** jaosorior has joined #puppet-openstack14:42
openstackgerritSteven Hardy proposed openstack/puppet-tripleo: Release 6.0.0  https://review.openstack.org/39838714:43
*** jaosorior has quit IRC14:47
*** morazi has quit IRC14:47
*** agrebennikov has joined #puppet-openstack14:48
*** morazi has joined #puppet-openstack14:52
*** richm has quit IRC14:53
*** ducttape_ has joined #puppet-openstack14:54
*** dfisher has joined #puppet-openstack14:57
*** rmart04 has joined #puppet-openstack14:58
*** jpena|lunch is now known as jpena15:01
*** richm has joined #puppet-openstack15:09
mwhahahaugh looks like scenario004 on ubuntu is broken, http://logs.openstack.org/31/397431/1/check/gate-puppet-openstack-integration-4-scenario004-tempest-ubuntu-xenial/749c65e/logs/puppet.txt.gz#_2016-11-15_22_39_4015:19
mwhahahathanks, openstack.15:19
dfisherlol15:19
mwhahahawhat the hell is URL has an invalid label15:20
iurygregorydamm it15:20
mwhahahaso i guess that's a unicode error15:25
mwhahahathe package list is the same from a working and a broken, so it's not an ubuntu change15:27
* mwhahaha cries15:28
iurygregoryD:15:28
mwhahahagotta take the kids to school then i'll poke infra to see if there were any xenial changes overnight15:28
*** michapma_alt has quit IRC15:35
*** ducttape_ has quit IRC15:35
*** jtriley has quit IRC15:38
openstackgerritzhongshengping proposed openstack/puppet-openstack_extras: Modify the annotation for the release parameter  https://review.openstack.org/39842015:42
*** morazi has quit IRC15:44
*** jtriley has joined #puppet-openstack15:46
*** fxpester has quit IRC15:53
*** morazi has joined #puppet-openstack15:57
*** ducttape_ has joined #puppet-openstack16:02
dmsimardmwhahaha: be careful who you blame for the issue16:03
dmsimardit might be very well be some ruby gem crap16:04
mwhahahathis is a python error, but it's a possible16:04
mwhahahait seems more environmental than code16:04
mwhahahajust trying to rule out all the things16:04
mwhahahait's also only senario004 which is weird16:05
*** danpawlik has quit IRC16:06
*** zhongshengpin has quit IRC16:06
*** zhongshengpin has joined #puppet-openstack16:07
openstackgerritBradley Klein proposed openstack/puppet-monasca: Add support for monasca-notification hipchat and slack  https://review.openstack.org/39798916:14
*** zhongshengpin has quit IRC16:17
*** ducttape_ has quit IRC16:22
openstackgerritMerged openstack/puppet-tripleo: Remove explicit hiera calls for heat in keystone profile  https://review.openstack.org/39812816:22
*** ducttape_ has joined #puppet-openstack16:23
openstackgerritBradley Klein proposed openstack/puppet-monasca: Add support for monasca-notification hipchat and slack  https://review.openstack.org/39798916:26
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration: [DONOTMERGE] puppet debug  https://review.openstack.org/39846516:29
*** hjensas has quit IRC16:37
*** rmart04 has quit IRC16:39
*** jistr is now known as jistr|biab16:48
*** rasca has quit IRC16:49
*** paramite has quit IRC16:51
openstackgerritMerged openstack/puppet-tripleo: Increase haproxy timeouts  https://review.openstack.org/39782216:51
*** dtantsur is now known as dtantsur|afk16:58
mwhahahaayoung: are you around?16:59
ayoungmwhahaha, will be in a few minutes...finishin a meeting17:00
mwhahahathe  scenario004 thing seems to be some sort of keystone itneraction17:01
openstackgerritBradley Klein proposed openstack/puppet-monasca: Add support for monasca-notification hipchat and slack  https://review.openstack.org/39798917:01
mwhahahaayoung: ok i've got a meeting now, had a question about a log entry17:01
mwhahaha[Tue Nov 15 22:36:34.403664 2016] [wsgi:error] [pid 30091:tid 140370284582656] 2016-11-15 22:36:34.403 30091 DEBUG keystone.middleware.auth [req-e77274d6-276c-4181-80ee-08bb0bd5f671 - - - - -] There is either no auth token in the request or the certificate issuer is not trusted. No auth context will be set. fill_context17:01
mwhahaha/usr/lib/python2.7/dist-packages/keystone/middleware/auth.py:21017:01
mwhahahaayoung: https://www.diffchecker.com/NuNvKZXy from the admin error log17:16
ayoungmwhahaha, we'll chat after your meeting17:18
mwhahahasince i got stood up, i guess i'm free17:18
mwhahahaayoung: basically we're seeing failures in our scenario004 and it's currently failing when trying to prefetch the project list for the keystone tenant provider17:19
mwhahahaayoung: what i've spotted so far is that diff. it seems that when it was working it was using the admin token rather than a fernet  token and it tries to post to tokens but gets a 401 back17:20
mwhahahaayoung: when it was working, it never posted to tokens and just was able to pull the list. so i'm wondering what would posibly generate that middleware error since that seems to be the only error to go on at the moment17:21
*** rmart04 has joined #puppet-openstack17:24
ayoungmwhahaha, is scenario004  tempest?  Link?17:27
mwhahahait's our puppet scenario00417:27
mwhahahahttps://github.com/openstack/puppet-openstack-integration#description17:28
ayoungmwhahaha, so, if you were using ADMIN_TOKEN before you were in a state of Sin.  You know that now, right?17:28
mwhahahaso we only use it temporarily i think. but at the moment i'm just trying to figure out wtf is happening17:29
mwhahahaworked: http://logs.openstack.org/91/395791/5/gate/gate-puppet-openstack-integration-4-scenario004-tempest-ubuntu-xenial/7f874a0/logs/puppet-20161115_154439.txt.gz#_2016-11-15_15_40_3617:29
mwhahahafailed: http://logs.openstack.org/91/395791/5/check/gate-puppet-openstack-integration-4-scenario004-tempest-ubuntu-xenial/ad7e956/logs/puppet.txt.gz#_2016-11-15_22_36_3217:30
mwhahahaso as far as I can dig in to the apache logs, we don't request a token for that first interaction17:30
mwhahahasince the packaging hasn't changed (and this is ubuntu not centos) i can't for the life of me figure out why this only happening here with only that error i pasted previously17:31
mwhahahaso what could possibly generate that error17:31
ayoungmwhahaha, you do realize I have absolutely no idea what you are trying to actually run here.  I could figure it out from the logs, but it would be much nicer to me if you told me, or pointed me at a link to the test code, or something17:32
mwhahahahi, welcome to my world17:32
ayoung"This I know from Nothing!"17:33
mwhahahabasically scenaio004 is just a way of us deploying stuff, uses the same ways as everything else17:33
mwhahahamy question to you is what could generate that error i pasted previously17:33
mwhahaha2016-11-15 22:36:34.403 30091 DEBUG keystone.middleware.auth [req-e77274d6-276c-4181-80ee-08bb0bd5f671 - - - - -] There is either no auth token in the request or the certificate issuer is not trusted. No auth context will be set. fill_context /usr/lib/python2.7/dist-packages/keystone/middleware/auth.py:21017:34
ayoungthat is not an error17:35
*** jistr|biab is now known as jistr17:36
mwhahahait's a wsgi:error17:36
ayoungwe just spam it all over the place17:36
ayounghttp://git.openstack.org/cgit/openstack/keystone/tree/keystone/middleware/auth.py#n18817:37
ayoungbut since that code gets execute on token request, it trips it up17:37
ayoungmwhahaha, don't get me started on the code base...token issue really shoukld be a separate microservice from everything else17:37
mwhahahaso somehow we're managing to fail all the previous context seting conditions, http://git.openstack.org/cgit/openstack/keystone/tree/keystone/middleware/auth.py#n17417:39
ayoungmwhahaha, you need to get a token before performing an operation now17:40
mwhahahain ocata sure17:40
mwhahahathis is ubuntu newton17:40
ayoungand you probably are not setting the appropriate variables for the keystoneauth plugins to do that17:40
mwhahahaand nothing has changed between the two errors17:40
mwhahahabecause ci has been blocked for days now because of cinder17:40
mwhahahaso some how it's magically screwing up :/17:40
ayoungnot magic, just sufficiently advanced technology, but it is indistinguishabl17:41
ayounge17:41
mwhahahaso i'm looking for ideas of what configuration items might cause those conditions to fail now (today) when they were working (yesterday)17:41
mwhahahait might just be a race condition of some sor tbut i'm not sure what to look for17:42
mwhahahathis is happening early in the deployemnt17:42
ayoungdid you switch over to using bootstrap?17:44
mwhahahait's been using bootstrap for a while now17:45
mwhahahaif you looked at the puppet log that ran prior to the apache restart17:45
ayoungmwhahaha, so my guess ios you were using ADMIN_TOKEN for operations.  And now you are not enabling it17:45
ayoungdo you have a full error log etc17:45
mwhahahafull error log of what17:46
mwhahahafails, http://logs.openstack.org/65/398465/1/check/gate-puppet-openstack-integration-4-scenario004-tempest-ubuntu-xenial/d3c7f54/logs/apache/keystone_wsgi_admin_error.txt.gz17:46
mwhahahaworked, http://logs.openstack.org/91/395791/5/gate/gate-puppet-openstack-integration-4-scenario004-tempest-ubuntu-xenial/7f874a0/logs/apache/keystone_wsgi_admin_error.txt.gz17:46
ayoungmwhahaha, yeah, but that does not have all the files17:46
mwhahahaerror log of what17:46
*** lucasagomes is now known as lucas-afk17:47
*** derekh has quit IRC17:47
ayoungmwhahaha, where is the gerrit review that triggered that?17:47
mwhahahahttps://review.openstack.org/#/c/395791/17:47
ayounghttps://review.openstack.org/#/c/39579117:47
ayounggot it17:47
ayoungHeh scenario 4 seems to be the only one passing there17:47
ayoungon centos17:48
mwhahahadon't get me started with centos17:48
ayoungthe opposite on xenial17:48
ayoungadmin_token = a_big_secret17:50
ayounghttp://logs.openstack.org/91/395791/5/check/gate-puppet-openstack-integration-4-scenario004-tempest-ubuntu-xenial/ad7e956/logs/etc/keystone/keystone.conf.txt.gz17:50
ayoungso did we do something else to wipe that out...17:50
ayounghttp://logs.openstack.org/91/395791/5/check/gate-puppet-openstack-integration-4-scenario004-tempest-ubuntu-xenial/ad7e956/logs/etc/keystone/keystone-paste.ini.txt.gz17:50
ayoungstill there:17:50
ayoungpipeline = cors sizelimit http_proxy_to_wsgi osprofiler url_normalize request_id admin_token_auth build_auth_context token_auth json_body ec2_extension public_service17:50
ayoungadmin_token_auth17:50
mwhahaharight we remove it later17:51
mwhahahaas part of the deployment process17:51
*** trown is now known as trown|lunch17:52
mwhahahayou know i bet it's something silly like apache restarting slower or faster17:55
dmsimarddid we merge that apache warmup thing ?&17:56
mwhahahano it broke a bunch of stuff17:56
ayoungmwhahaha, sorry RWI17:57
ayounglets see...17:58
mwhahahai'm so irritated at CI this week between the cinder thing and now this17:59
ayoungmwhahaha, is that the cause of this failure: https://review.openstack.org/#/c/397381/  ?  gate-tripleo-ci-centos-7-ovb-ha17:59
ayoungor is this later than the cinder thing?18:00
*** cdelatte has joined #puppet-openstack18:00
ayoungI think we have all the puppet code for Fernet merged...18:00
* ayoung goes to check18:00
mwhahahaayoung: no, your issue was httpd hanging, http://logs.openstack.org/81/397381/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/db9630e/logs/postci.txt.gz#_2016-11-14_23_58_19_00018:01
mwhahahawe have not merged the fernet defaults in openstack puppet, it was previously reverted18:01
mwhahahathat being said this scenario that is failing I think uses fernet tokens18:01
ayoungmwhahaha, not the defaults, just the mgmgt piece18:01
openstackgerritgyani pillala proposed openstack/puppet-cinder: HPLeftHandISCSIDriver support for Cinder Backend  https://review.openstack.org/39812518:02
mwhahahaayoung: you meanhttps://review.openstack.org/#/c/397391/18:02
mwhahahasorry https://review.openstack.org/#/c/397391/18:02
ayounghttps://review.openstack.org/#/c/334678/18:03
mwhahahawhats super annoying about this failure is that we really need logs from openstack client18:03
mwhahahayea we merged that 4 months ago, like i said nothing really has changed in the last 24 hours in terms of puppet or packaging for xenial that could easily be pointed at for this failure18:04
mwhahahaso it seems to totally be a race condition or some sort of odd state that we're now hitting and only hitting on that one scenario18:04
mwhahahabut as far as I can tell the configs are the same at the same point18:05
mwhahahasomething's happening when it tries to fill that context and i don't know enough about it to say what18:05
mwhahahahttps://www.diffchecker.com/hHqAX4bb18:05
mwhahahait looks like previously we were successfully entering this block of code, http://git.openstack.org/cgit/openstack/keystone/tree/keystone/middleware/auth.py#n17418:07
mwhahahabut we're not longer getting in18:07
ayoungNah...I think it is later18:08
ayounglet me see...18:08
mwhahahathe reason why i say that block is because of http://logs.openstack.org/91/395791/5/gate/gate-puppet-openstack-integration-4-scenario004-tempest-ubuntu-xenial/7f874a0/logs/keystone/keystone-admin.txt.gz#_2016-11-15_15_40_44_48818:08
mwhahahawhere auth_context is {}18:08
ayoungUm./..waht about the SSL error at the bottom of the file>?18:10
*** jperry has quit IRC18:10
mwhahahathat's later in the deployment18:10
ayoungrevocation_list18:10
ayoungOK, that needs to go away18:10
mwhahahayea i spotted that today along with a bunch of other errors while looking at this thing18:11
mwhahahaoh we should also be looking at the newton version of this file18:11
mwhahahanot the master18:11
mwhahahaxenial is newton18:11
ayoungI love that we are doing IPv618:12
ayoungpoint me at the right place.  BUt the lack or return codes/error codes make it hard to debug18:13
mwhahahahttps://github.com/openstack/keystone/blob/stable/newton/keystone/middleware/auth.py#L182-L21318:13
mwhahahagithub is easier to pass links arounds with18:13
mwhahahaso that's the conditional block it would be running through18:13
mwhahahaso it would either be the first if or the first elif18:13
mwhahahabut it's not the first elif because we don't get that deprecation notice18:14
mwhahahaso my assumption is that request.env.get(core.CONTEXT_ENV, {}).get('is_admin', False) is no longer evaulating to true18:14
mwhahahabut i have no idea wtf that line is18:14
mwhahahawhere does that stuff come from? apache?18:14
mwhahahamod_wsgi?18:14
mwhahahai guess i could just try disabling the admin_token all together to see if that addresses it18:16
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration: [DONOTMERGE] puppet debug  https://review.openstack.org/39846518:17
mwhahahawe shouldn't be using admin_token in our testing anyway because we support admin_password now instead18:17
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration: [DONOTMERGE] puppet debug  https://review.openstack.org/39846518:19
*** jperry has joined #puppet-openstack18:24
mwhahahaso we appear to still be using the auth token for part of the intial setup18:29
mwhahahaoh probably cause we don't have an openrc file yet at that point of the deploy18:30
openstackgerritMerged openstack/puppet-tripleo: Prepare 6.0.0 (ocata-1)  https://review.openstack.org/39804618:33
openstackgerritAlex Schultz proposed openstack/puppet-keystone: nothing to see here  https://review.openstack.org/39852918:36
*** jpich has quit IRC18:36
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration: [DONOTMERGE] puppet debug  https://review.openstack.org/39846518:36
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration: [DONOTMERGE] puppet debug  https://review.openstack.org/39846518:37
*** jpena is now known as jpena|off18:42
*** jtriley has quit IRC18:46
*** rmart04_ has joined #puppet-openstack18:48
*** rmart04 has quit IRC18:49
*** rmart04_ is now known as rmart0418:49
*** shardy is now known as shardy_afk19:01
*** trown|lunch is now known as trown19:05
openstackgerritAde Lee proposed openstack/puppet-nova: Added ipaclient class  https://review.openstack.org/39783619:05
*** amoralej is now known as amoralej|off19:12
*** shardy_afk is now known as shardy19:16
*** shardy is now known as shardy_afk19:17
*** jtriley has joined #puppet-openstack19:27
mwhahahait's ipv619:34
* mwhahaha throws tables19:35
dfisherhaha.19:35
iurygregorydamm it19:35
dfisher^ the proper response19:35
iurygregory=(19:35
mwhahahahttps://github.com/kennethreitz/requests/blob/master/requests/models.py#L372-L37519:35
mwhahahathe host is '[::1]'19:35
mwhahahawhich causes the encode to puke19:35
mwhahahahttps://github.com/kennethreitz/requests/blob/master/requests/models.py#L372-L37519:35
mwhahahaer19:36
mwhahahaidna.core.InvalidCodepoint: Codepoint U+005B not allowed at position 1 in u'[::1]'19:36
mwhahahahttp://paste.openstack.org/show/589502/19:36
mwhahahai bet we somehow switched to ipv6 which i think only works on centos19:37
mwhahahahow the hell did this ever work19:38
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration: Align stars to fix CI  https://review.openstack.org/39800319:42
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration: Align stars to fix CI  https://review.openstack.org/39800319:44
*** johnmilton has quit IRC19:56
*** rmart04 has left #puppet-openstack20:02
mfischmwhahaha: you around?20:23
mwhahahaif i must20:23
mwhahahawhat's up?20:23
mfischlol20:23
mfischwondering should we just remove all eventlet support instead of my change to move stuff around?20:24
mwhahahadid we deprecate it?20:24
mwhahaha:D20:24
mfischyeah I think in L20:24
mwhahahawhen did keystone drop the eventlet support, was that part of newton?20:24
mfischI will look into it20:24
mwhahahalike it's just not a thing anymore20:24
mwhahaharight?20:25
mfisch[blueprint removed-as-of-newton] Removed [eventlet_server] and [eventlet_server_ssl] sections from the keystone.conf.20:26
mfischremoved in N20:26
mfisch[blueprint removed-as-of-newton] Removed support for running keystone under eventlet. It is recommended to run keystone in an HTTP server.20:26
mwhahahayea if it's just not there anymore, let's pull it20:26
mfischok20:26
mfischI will update20:26
mfischhopefully I can get the unit tests functional again on my mac20:27
mfischsomething broke them20:27
mfischmwhahaha: have you seen this before?20:46
mfisch  /Users/mfischer/code/puppet/puppet-keystone/spec/spec_helper.rb:6:in `require': cannot load such file -- puppet-openstack_spec_helper/facts (LoadError)20:46
mfischwhen running rake spec20:46
mwhahahayea20:47
mwhahahanuke your Gemfile.lock and try rerunning bundle install20:47
*** rcernin has joined #puppet-openstack20:58
mwhahahathis whole ci thing is so frustrating, i managed to fix scenario004 and get pymysql for centos only to get timed out21:08
iurygregory=(21:09
*** dprince has quit IRC21:13
*** morazi has quit IRC21:14
openstackgerritPradeep Kilambi proposed openstack/puppet-tripleo: Remove Combination alarms support  https://review.openstack.org/39857921:15
openstackgerritMerged openstack/puppet-heat: Don't default metadata server URLs to localhost  https://review.openstack.org/39764421:19
openstackgerritAde Lee proposed openstack/puppet-nova: Added ipaclient class  https://review.openstack.org/39783621:20
*** jayg is now known as jayg|g0n321:25
*** jtriley_ has joined #puppet-openstack21:30
*** gfidente has quit IRC21:31
openstackgerritMatt Fischer proposed openstack/puppet-keystone: Drop all eventlet support  https://review.openstack.org/39647521:32
*** jtriley has quit IRC21:32
*** fultonj_ has joined #puppet-openstack21:33
*** fultonj_ has quit IRC21:33
mfischmwhahaha: thats a Work in progress ^21:33
mfischI'll ping you when ready21:33
*** cdelatte has quit IRC21:34
*** jtriley_ has quit IRC21:34
mwhahahaok21:35
openstackgerritMatt Fischer proposed openstack/puppet-keystone: Drop all eventlet support  https://review.openstack.org/39647521:50
*** trown is now known as trown|outtypewww21:52
*** ayoung has quit IRC21:55
mwhahahadmsimard: https://review.openstack.org/#/c/398003/ plz4me21:58
dmsimardI saw, getting to it soon22:00
dmsimardI was going to nit about setting ipv6 to false in both if and else22:00
dmsimardbut ... yeah22:00
dmsimard:P22:00
mwhahahaugh22:00
mwhahahaat this point i just want to merge all my 10.0.0 patches so i can get the stupid release out the door22:01
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration: Fix scenario004 ipv6  https://review.openstack.org/39860322:02
dmsimardmwhahaha: yeah I was mostly kidding22:02
mwhahahathere ya go as a followon since we won't be able to cleanly revert that patch anyway22:02
dmsimardI'll point it out anyway cause I'm like that22:03
iurygregorymwhahaha, you already have the release patches topic?22:17
mwhahahahttps://review.openstack.org/#/q/topic:ocata-122:17
iurygregorytks22:17
openstackgerritAde Lee proposed openstack/puppet-nova: Added ipaclient class  https://review.openstack.org/39783622:25
openstackgerritAlex Schultz proposed openstack/puppet-ec2api: Prepare 10.0.0 release  https://review.openstack.org/39862722:27
openstackgerritAlex Schultz proposed openstack/puppet-octavia: Prepare 10.0.0 release  https://review.openstack.org/39862822:27
*** fultonj has quit IRC22:27
openstackgerritAlex Schultz proposed openstack/puppet-vswitch: Prepare 6.0.0 release  https://review.openstack.org/39743722:36
*** jperry has quit IRC22:42
*** ayoung has joined #puppet-openstack22:44
*** pradk has quit IRC22:48
*** ducttape_ has quit IRC23:16
patrickeasthello, this might be a dumb question, but is there a "right" way to pin my puppet manifests to install certain releases of openstack? I went to add some new compute nodes to my mitaka based cloud and am getting errors like http://paste.openstack.org/show/589532/ which looks like its getting conflicts with newton packages23:22
*** dfisher has quit IRC23:24
mwhahahapatrickeast: it's hard to say without seeing your repo configuration, it seems that you've got newton yum repos configured which would be a problem23:27
openstackgerritBradley Klein proposed openstack/puppet-monasca: Add support for monasca-notification hipchat and slack  https://review.openstack.org/39798923:34
patrickeastmwhahaha: oooh yea, sure enough i had both newton and mitaka rdo repos, removing the newton one fixes the issues... guess i just need to track back which script installed the latest ones too23:40
patrickeastmwhahaha: thanks for the pointer23:40
mwhahahanp23:40
*** cdelatte has joined #puppet-openstack23:49
*** rcernin has quit IRC23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!