Friday, 2016-08-05

*** omiday has quit IRC00:01
*** omiday has joined #openstack-ansible00:01
*** sdake_ has joined #openstack-ansible00:06
*** thorst has quit IRC00:06
*** sdake has quit IRC00:09
*** markvoelker has joined #openstack-ansible00:12
*** markvoelker_ has quit IRC00:14
*** gouthamr_ has joined #openstack-ansible00:44
*** retreved has joined #openstack-ansible00:49
*** elo has joined #openstack-ansible00:54
*** jamielennox is now known as jamielennox|away00:55
*** jamielennox|away is now known as jamielennox00:57
*** markvoelker has quit IRC00:59
*** thorst has joined #openstack-ansible01:04
*** thorst has quit IRC01:11
*** retreved has quit IRC01:13
*** thorst has joined #openstack-ansible01:15
*** thorst has quit IRC01:16
*** wadeholler has joined #openstack-ansible01:28
openstackgerritMerged openstack/openstack-ansible-os_designate: Disable stderr logging  https://review.openstack.org/35130401:33
openstackgerritMerged openstack/openstack-ansible-os_tempest: Disable stderr logging  https://review.openstack.org/35131601:49
openstackgerritMerged openstack/openstack-ansible-os_zaqar: Disable stderr logging  https://review.openstack.org/35131701:51
openstackgerritMichael Gugino proposed openstack/openstack-ansible-os_nova: WIP: Implement tests for nova-lxd hypervisor  https://review.openstack.org/35022601:53
*** weezS has joined #openstack-ansible02:02
*** sdake has joined #openstack-ansible02:03
*** sdake_ has quit IRC02:04
*** zerda2 has joined #openstack-ansible02:05
*** wadeholler has quit IRC02:06
*** jamielennox is now known as jamielennox|away02:12
*** sdake_ has joined #openstack-ansible02:14
*** thorst has joined #openstack-ansible02:17
*** sdake has quit IRC02:17
*** thorst has quit IRC02:25
cloudnullany cores around that might want to give this a shove https://review.openstack.org/#/c/351322/02:28
cloudnullits rechecking because of SNI issues on trusty02:28
cloudnull's/trusty/xenial/'02:28
*** gouthamr_ has quit IRC02:29
cloudnullbut we're going to need that to either get https://review.openstack.org/#/c/344884/ or this https://review.openstack.org/#/c/351385/ through02:29
*** abelur is now known as abelur|brb02:29
cloudnull-cc automagically02:29
cloudnullit seems ceilometer is once again not happy.02:29
cloudnull^ jmccrory02:30
cloudnull^^ stevelle too <- resident ceilometer expert :)02:31
openstackgerritMerged openstack/openstack-ansible-plugins: Backport py_pkgs changes from Newton  https://review.openstack.org/35061202:35
*** abelur|brb is now known as abelur02:35
jmccrorycloudnull : looks like  https://review.openstack.org/#/c/351385/ has some hidden whitespace on L23 too after 3512322 goes in02:40
*** retreved has joined #openstack-ansible02:40
cloudnullgood catch02:42
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: disable ceilometer and its supporting services  https://review.openstack.org/35138502:42
cloudnullidk if thats the right fix, maybe the multi rabbit pr will converge and we can do that instead02:42
*** thorst has joined #openstack-ansible02:43
jmccroryhave you had a chance to look into this horizon tempest failure at all? http://logs.openstack.org/01/350001/1/check/gate-openstack-ansible-os_horizon-ansible-func-ubuntu-trusty/1f2bf57/console.html#_2016-08-04_03_05_15_12979302:43
*** thorst has quit IRC02:43
cloudnulli've not.02:45
logan-i posted a ton of debugging about it earlier02:45
* cloudnull scrolling back02:46
cloudnulllogan-: a broken tempest test... wat!?! say it aint so...02:47
jmccroryyeah, read your notes in the backlog logan-. think you're on to something with keystone auth's failing, but haven't been able to get it working even after going back to before this change in the tempest role https://github.com/openstack/openstack-ansible-os_tempest/commit/ebe329597980eeb330827ee38c525f4869e96aa102:47
jmccrorya role on the default domain added to tempest created users, but i don't know that one ever was before when it was working02:48
jmccroryisn't added*02:48
cloudnullmaybe its a new requirement.02:48
jmccrorymaybe, no luck tracking down a related change yet02:49
cloudnullare we setting a default domain ?02:50
cloudnulllooks like it needs it https://github.com/openstack/tempest-horizon/commit/64302f192f9be68e4072c43262fb0928923e8cba#diff-934c70aaceee603d4ffb5bad01cf81ddR10602:50
*** retreved has quit IRC02:50
logan-i tested with https://review.openstack.org/#/c/351410/ earlier and no luck02:51
logan-sec ill pastebin another keystone debug with that tempest patch applied02:51
cloudnullok , sorry to have you re-hash that.02:51
logan-i still have the env running so very easy02:52
cloudnullawesome02:52
logan-http://cdn.pasteraw.com/ex2y553b7cmuhlhema1z9f28bmgl9y102:54
logan-wait..02:55
logan-need to redeploy tempest real quick to refresh tempest.conf02:55
cloudnullhave we tried 's/Default/default/g'02:56
logan-http://cdn.pasteraw.com/6nexfix9eqycf0niv7oqbfrrrgjncek with https://review.openstack.org/#/c/351410/ applied02:58
logan-trying with 'default'02:58
logan-http://cdn.pasteraw.com/ibvuzm1towta0lj9dnj3nsdpfi0w5f202:59
cloudnulldamn,03:01
cloudnulllogan-: have we tried reving back to this sha bfbfffa3a036b904fab0dc469a8d3a8350fdd79003:04
cloudnullwhich was the commit right before the config updates?03:04
cloudnullsha from "https://github.com/openstack/tempest-horizon"03:05
cloudnullill be right back, i need to take the dogs out.03:05
logan-Afk a min but I'll check03:10
*** weezS has quit IRC03:12
openstackgerritMichael Gugino proposed openstack/openstack-ansible-os_nova: WIP: Implement tests for nova-lxd hypervisor  https://review.openstack.org/35022603:13
logan-http://cdn.pasteraw.com/fhzm10lpmmgyc41rz02qmiupqeu4k6j03:16
openstackgerritMerged openstack/openstack-ansible-repo_build: Fix selective repo_build for aodh[mysql] requirement  https://review.openstack.org/35132203:16
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Disable V-38660 in integrated gate job  https://review.openstack.org/34748403:32
*** jamielennox|away is now known as jamielennox03:35
*** sdake_ has quit IRC03:42
*** thorst has joined #openstack-ansible03:44
*** sguduru has joined #openstack-ansible03:45
cloudnullback03:48
cloudnulllogan-: well thats exciting03:49
cloudnullim assuming that was from the sha before ?03:49
cloudnullodyssey4me: do we have an idea on why these SNI issues are poping up all of the sudden ?03:50
cloudnullchanges in the infra images?03:51
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone: Implement CentOS 7 support in os_keystone  https://review.openstack.org/32021603:52
*** thorst has quit IRC03:52
cloudnullnevermind i think we just need to add pyOpenSSL pyasn1 ndg-httpsclient to the pip install role as a base package set and it'll fix it everywhere.03:57
*** sdake has joined #openstack-ansible03:57
logan-Yeah that's from the tempest-horizon tag you put above04:03
logan-With os_tempest master04:03
logan-Out for the night04:03
cloudnulltake care logan-04:04
*** abelur is now known as abelur|meet04:08
*** sdake has quit IRC04:14
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-pip_install: Add SNI support via OS pip  https://review.openstack.org/35148204:15
*** woodard has quit IRC04:17
*** xnodeza has joined #openstack-ansible04:18
*** woodard has joined #openstack-ansible04:20
*** javeriak has joined #openstack-ansible04:22
*** sdake has joined #openstack-ansible04:24
*** sguduru has quit IRC04:28
*** abelur|meet is now known as abelur04:33
*** markvoelker has joined #openstack-ansible04:38
*** jamielennox is now known as jamielennox|away04:43
*** markvoelker has quit IRC04:43
openstackgerritMichael Gugino proposed openstack/openstack-ansible-os_nova: WIP: Implement tests for nova-lxd hypervisor  https://review.openstack.org/35022604:50
*** thorst has joined #openstack-ansible04:51
*** javeriak has quit IRC04:54
*** hybridpollo has quit IRC04:56
*** thorst has quit IRC04:58
*** sguduru has joined #openstack-ansible05:18
*** janki has joined #openstack-ansible05:19
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Support multiple rabbitmq clusters  https://review.openstack.org/34488405:35
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Support multiple rabbitmq clusters  https://review.openstack.org/34488405:38
cloudnullim off to sleep.05:38
cloudnullautomagically: ^ I updated the multi-rabbit pr. in test it looks good now. hopfully the gate will be happy with it.05:38
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-pip_install: Add SNI support via pip  https://review.openstack.org/35148205:39
*** evilt0ne has quit IRC05:51
*** thorst has joined #openstack-ansible05:56
odyssey4mecloudnull SNI issues are popping up as more and more site certs use the updated standards (as they renew I guess)05:59
odyssey4methey're fairly random, but we see them when trying to download get-pip and generally when Ansible is trying to use httplib2 (on the deployment host)06:00
*** thorst has quit IRC06:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer: Revert "RabbitMQ config rework"  https://review.openstack.org/35149906:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build: Only clone git repositories for services which are deployed  https://review.openstack.org/34564206:18
*** jimbaker has quit IRC06:19
*** jimbaker has joined #openstack-ansible06:23
*** jimbaker has quit IRC06:23
*** jimbaker has joined #openstack-ansible06:23
*** javeriak has joined #openstack-ansible06:29
*** Andrew_jedi has joined #openstack-ansible06:29
*** jiteka has joined #openstack-ansible06:33
*** markvoelker has joined #openstack-ansible06:40
*** markvoelker has quit IRC06:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: Add SNI support via OS packages using run_tests.sh  https://review.openstack.org/35151606:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: Add python packages for SNI support  https://review.openstack.org/35151706:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: Add python packages for SNI support in tests  https://review.openstack.org/35151706:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: Add SNI support via OS packages using run_tests.sh  https://review.openstack.org/35151606:54
openstackgerritMerged openstack/openstack-ansible-os_ceilometer: Revert "RabbitMQ config rework"  https://review.openstack.org/35149906:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Implement container bind mount for all logs  https://review.openstack.org/35118806:59
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Adding Magnum-UI Horizon support  https://review.openstack.org/35108907:01
*** thorst has joined #openstack-ansible07:01
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Adding Magnum-UI Horizon support  https://review.openstack.org/35108907:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Adding Magnum-UI Horizon support  https://review.openstack.org/35108907:04
openstackgerritWang Qing wu proposed openstack/openstack-ansible-os_nova: Rename PowerVM Driver class path. Add a dependency package  https://review.openstack.org/35152307:07
*** thorst has quit IRC07:08
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: Add python packages for SNI support in tests  https://review.openstack.org/35151707:09
*** mikelk has joined #openstack-ansible07:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: [WIP] Add python packages for SNI support in tests  https://review.openstack.org/35151707:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: [WIP] Add SNI support via OS packages using run_tests.sh  https://review.openstack.org/35151607:09
*** jimbaker has quit IRC07:16
*** jimbaker has joined #openstack-ansible07:19
*** jimbaker has quit IRC07:20
*** jimbaker has joined #openstack-ansible07:20
*** woodard has quit IRC07:21
*** Andrew_jedi has quit IRC07:22
*** aszeszo has joined #openstack-ansible07:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: Add SNI support via OS packages using run_tests.sh  https://review.openstack.org/35151607:26
*** DrifterZA has joined #openstack-ansible07:27
DrifterZAhi all07:27
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: [WIP] Add python packages for SNI support in tests  https://review.openstack.org/35151707:30
*** sguduru has quit IRC07:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: [WIP] Add python packages for SNI support in tests  https://review.openstack.org/35151707:41
*** admin0 has joined #openstack-ansible07:44
evrardjpgood morning everyone08:02
*** openstackgerrit has quit IRC08:03
*** openstackgerrit has joined #openstack-ansible08:04
DrifterZAhiya08:04
*** Andrew_jedi has joined #openstack-ansible08:06
*** thorst has joined #openstack-ansible08:08
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_horizon: Adding Magnum-UI support to horizon  https://review.openstack.org/35109108:11
DrifterZAodyssey4me : I've tested this change on my mitaka deployment and it works08:12
*** thorst has quit IRC08:13
openstackgerritDonovan Francesco proposed openstack/openstack-ansible-os_horizon: Adding Magnum-UI support to horizon  https://review.openstack.org/35109108:14
*** asettle has joined #openstack-ansible08:21
*** woodard has joined #openstack-ansible08:22
*** sguduru has joined #openstack-ansible08:24
*** woodard has quit IRC08:27
*** sdake has quit IRC08:37
*** markvoelker has joined #openstack-ansible08:40
andymccrif anybody is about for a review: https://review.openstack.org/#/c/351256/ its a bit of a critical one :)08:41
*** markvoelker has quit IRC08:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: Add python packages for SNI support in tests  https://review.openstack.org/35151708:57
odyssey4meevrardjp ^08:58
odyssey4meevrardjp I mean https://review.openstack.org/#/c/351256/ actually08:58
evrardjpI've open both08:58
evrardjped08:58
evrardjpconfidence vote ?08:59
*** coreping has joined #openstack-ansible09:01
andymccrthanks kids :D09:02
DrifterZAodyssey4me: I fixed the patches09:05
DrifterZAI decided to create a pip package09:05
DrifterZAnow everything works09:05
DrifterZAand i've tested it09:07
DrifterZA;)09:07
*** thorst has joined #openstack-ansible09:10
*** thorst has quit IRC09:18
odyssey4meDrifterZA ok, but that's not how it should be done - because now we have to rely on you updating the package :)09:18
odyssey4methe role should build from source, and the integrated build will do that on the repo server already09:19
*** woodard has joined #openstack-ansible09:24
DrifterZAso do you mean, horizon_developer_mode: true and put the egg in there ?09:25
*** woodard has quit IRC09:28
odyssey4meDrifterZA do you mind if I tweak the patch to get it done, then you can see?09:28
DrifterZAPlease do09:29
*** javeriak has quit IRC09:29
DrifterZAI'm really confused09:29
DrifterZAI think if I see it, Ill understand it09:29
*** sguduru has quit IRC09:30
odyssey4meyep09:30
odyssey4meas background, developer_mode is activated in the role tests already09:30
DrifterZAaah okay09:30
DrifterZAkeeping the pip up to date is not hard. But I get your point about the build dependancy on it09:31
openstackgerritMerged openstack/openstack-ansible-os_swift: Properly default pretend_min_part_hours_passed  https://review.openstack.org/35125609:32
DrifterZABut honestly upstream should really keep the pip up to date in any event, considering its part of the tent.09:33
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon: Adding Magnum-UI support to horizon  https://review.openstack.org/35109109:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon: Add Magnum-UI plugin support to Horizon  https://review.openstack.org/35109109:37
odyssey4meDrifterZA that should do it09:37
*** sguduru has joined #openstack-ansible09:37
odyssey4meDrifterZA openstack-CI has the jobs to do it... it just seems that the magnum project isn't doing the right things to make it happen09:38
DrifterZAah09:39
evrardjpodyssey4me: is horizon_git_repo only used in developer mode? I thought this was used for py_pkg to get the list of the required packages to clone even on non developers09:41
evrardjpor we are using existing wheels?09:41
evrardjpI'll check the code09:41
odyssey4meevrardjp py_pkgs can look it up from there, but it actually gets it from https://github.com/openstack/openstack-ansible/blob/master/playbooks/defaults/repo_packages/openstack_services.yml09:43
evrardjpthat's true we set the precedence in pkg_locations, right09:43
odyssey4meit's plausible that we could remove it from there and only implement the SHA somewhere... perhaps in group_vars... but the point is that in the roles, that's why that's there right now09:44
odyssey4meevrardjp I guess it is a precedence :)09:44
odyssey4meevrardjp although I'm not sure that it is - perhaps worth looking into09:44
* odyssey4me adds it to his very long TODO list09:44
evrardjpdon't add that, it's not that important09:45
evrardjpit's just that the text for the commit 351091 could be confusing09:47
odyssey4meevrardjp at the moment, that text is the reality09:51
odyssey4mehttps://github.com/openstack/openstack-ansible/blob/master/playbooks/defaults/repo_packages/openstack_services.yml is used for the repo build, the role entries are used for developer mode09:51
evrardjpit is09:51
evrardjpI thought of writing this instead:09:52
evrardjp(used in developer mode, overriden in standard builds)09:52
evrardjpor value overriden for standard builds09:52
evrardjpit's a nit09:52
evrardjpjust giving opinion09:52
evrardjplet's forget this for now09:54
evrardjp:p09:54
odyssey4meevrardjp in fact, py_pkgs doesn't look at those at all I don't think09:54
evrardjpthe next time I see a new UI for horizon, I'll probably refactor the way we are doing it09:54
odyssey4melemme check to be sure09:55
evrardjpI'm pretty sure it's the pkg_locations09:56
evrardjpbut it's just a gut feeling09:56
evrardjpyup09:58
evrardjpyou remove the ../ from the pkg_locations and you see horizon_git_repo to https://git.openstack.org/openstack/horizon@master09:58
evrardjpso "used in developer mode" makes me think this variable is only used in that case, which it isn't09:59
evrardjpbut that's details like I said10:00
odyssey4meevrardjp patch updated10:00
odyssey4meie I've updated https://review.openstack.org/35109110:01
odyssey4meit appears that gerritbot is missing messages today10:02
evrardjpyup I'm now thinking about the pattern of the enable10:02
evrardjpfor now that's what we use so we're good10:02
DrifterZAIt is rather confusing though10:02
evrardjpDrifterZA: which part?10:02
*** javeriak has joined #openstack-ansible10:03
evrardjpit basically ensures a way to disable the dashboard instead of just not caring10:03
DrifterZAhaving to add things to the developer mode and not knowing if it would actually run if developer mode is off10:03
evrardjpDrifterZA: that's not really that -- these variables are used anyway developer mode or not10:04
evrardjpthat's why odyssey4me changed the text10:04
odyssey4meDrifterZA developer mode is only run in the role tests, or you you decide to use it.10:04
DrifterZAso in prod I wouldnt have developer mode on, but I would like to have the global var applied as ui_enabled10:04
odyssey4meIf you're choosing to build from source, then one would hope you know what you're doing.10:04
odyssey4meDrifterZA yes, in prod - assuming you're using the integrated build, the source build is handled on the repo server10:05
evrardjpthe ui enabled is independant of the developer_node10:05
DrifterZAyes true, this is why I figured the pip_install would be better10:05
odyssey4meit still does a pip install10:05
odyssey4meit just does it directly from the git source, instead of from a pre-built package/wheel10:05
evrardjpit's far more modular imo10:06
openstackgerritDarren Birkett proposed openstack/openstack-ansible: Update manual upgrade docs with new galera steps  https://review.openstack.org/35162710:07
odyssey4meevrardjp a review of https://review.openstack.org/345642 would be appreciated if you have a moment to do so10:10
evrardjpok10:14
*** thorst has joined #openstack-ansible10:16
odyssey4meevrardjp oh, and these backports need review please: https://review.openstack.org/350576 & https://review.openstack.org/35060510:19
DrifterZAit actually makes sense now10:19
odyssey4meDrifterZA :) I'm glad that it does.10:20
DrifterZAJenkins abit slow to do the retest ?10:20
odyssey4mehttp://status.openstack.org/zuul/10:21
odyssey4meit's in the queue, which has grown since this morning10:21
odyssey4methe afternoon/evening queues (basically the US day) have been really bad lately10:22
*** thorst has quit IRC10:23
*** woodard has joined #openstack-ansible10:25
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Refactor and improve swift-rings.py  https://review.openstack.org/35122710:27
evrardjpodyssey4me: I've marked them as part of my short term todolist -- will go back to these patches later10:28
*** woodard has quit IRC10:29
odyssey4methanks evrardjp10:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: Add python packages for SNI support in tests  https://review.openstack.org/35151710:35
openstackgerritMerged openstack/openstack-ansible: Update all SHAs for Newton 2016-08-01  https://review.openstack.org/34961110:49
*** javeriak has quit IRC10:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Disable V-38660 for OpenStack-CI  https://review.openstack.org/34748410:54
*** zerda2 has quit IRC10:59
Andrew_jedistderr: E: Failed to fetch https://mirror.rackspace.com/ubuntu/pool/main/q/qemu/qemu-utils_2.0.0+dfsg-2ubuntu1.26_amd64.deb  HttpError40411:17
*** thorst has joined #openstack-ansible11:20
*** javeriak has joined #openstack-ansible11:20
*** sguduru has quit IRC11:24
*** woodard has joined #openstack-ansible11:26
*** thorst has quit IRC11:28
*** smatzek has joined #openstack-ansible11:29
*** woodard has quit IRC11:31
mancdazanyone able to review https://review.openstack.org/#/c/349953/ ? I'd like to get this in so I can backport to mitaka11:31
Andrew_jediodyssey4me: Hello, qemu-utils_2.0.0+dfsg-2ubuntu1.26_amd64.deb  is not available in the rackspace mirror https://mirror.rackspace.com/ubuntu/pool/main/q/qemu/11:32
*** sguduru has joined #openstack-ansible11:33
odyssey4meAndrew_jedi ok, why does this matter?11:33
Andrew_jediodyssey4me: stable/mitaka task TASK: [repo_build | Install apt packages] is failing11:34
odyssey4meAndrew_jedi that's likely because of the timing - this is around the time that the mirror updates, so the request for the package was done after the package was removed, or before the package is there11:35
odyssey4mea retry should work fine - or use an alternative mirror11:35
*** javeriak has quit IRC11:35
Andrew_jediodyssey4me: ahh okayy, thanks . I pinged you because i thought i might have to chnage the version somewhere. Let me try again. :)11:36
*** javeriak has joined #openstack-ansible11:37
odyssey4memancdaz done - one tweak and we're good11:37
*** retreved has joined #openstack-ansible11:45
*** asettle has quit IRC11:45
*** retreved has quit IRC11:45
*** retreved has joined #openstack-ansible11:46
openstackgerritDarren Birkett proposed openstack/openstack-ansible: Better control of mariadb restarts in upgrades  https://review.openstack.org/34995311:47
*** thorst has joined #openstack-ansible11:48
*** asettle has joined #openstack-ansible11:58
*** psilvad has joined #openstack-ansible11:58
*** weshay has joined #openstack-ansible11:59
*** gouthamr has joined #openstack-ansible12:04
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Refactor and improve swift-rings.py  https://review.openstack.org/35122712:06
*** sguduru has quit IRC12:06
*** asettle has quit IRC12:17
odyssey4meapologies in advance for the noise12:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-apt_package_pinning: Add python packages for SNI support in tests  https://review.openstack.org/35168412:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client: Add python packages for SNI support in tests  https://review.openstack.org/35168512:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server: Add python packages for SNI support in tests  https://review.openstack.org/35168612:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Add python packages for SNI support in tests  https://review.openstack.org/35168712:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: Add python packages for SNI support in tests  https://review.openstack.org/35168812:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-memcached_server: Add python packages for SNI support in tests  https://review.openstack.org/35168912:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts: Add python packages for SNI support in tests  https://review.openstack.org/35169012:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_openrc: Add python packages for SNI support in tests  https://review.openstack.org/35169112:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops: Add python packages for SNI support in tests  https://review.openstack.org/35169212:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_aodh: Add python packages for SNI support in tests  https://review.openstack.org/35169312:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_barbican: Add python packages for SNI support in tests  https://review.openstack.org/35169412:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer: Add python packages for SNI support in tests  https://review.openstack.org/35169512:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder: Add python packages for SNI support in tests  https://review.openstack.org/35169612:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cloudkitty: Add python packages for SNI support in tests  https://review.openstack.org/35169712:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate: Add python packages for SNI support in tests  https://review.openstack.org/35169812:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance: Add python packages for SNI support in tests  https://review.openstack.org/35169912:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_gnocchi: Add python packages for SNI support in tests  https://review.openstack.org/35170012:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_heat: Add python packages for SNI support in tests  https://review.openstack.org/35170112:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon: Add python packages for SNI support in tests  https://review.openstack.org/35170212:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic: Add python packages for SNI support in tests  https://review.openstack.org/35170312:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone: Add python packages for SNI support in tests  https://review.openstack.org/35170412:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum: Add python packages for SNI support in tests  https://review.openstack.org/35170512:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron: Add python packages for SNI support in tests  https://review.openstack.org/35170612:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Add python packages for SNI support in tests  https://review.openstack.org/35170712:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_rally: Add python packages for SNI support in tests  https://review.openstack.org/35170812:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_sahara: Add python packages for SNI support in tests  https://review.openstack.org/35170912:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift: Add python packages for SNI support in tests  https://review.openstack.org/35171012:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest: Add python packages for SNI support in tests  https://review.openstack.org/35171112:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_zaqar: Add python packages for SNI support in tests  https://review.openstack.org/35171212:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_lock_down: Add python packages for SNI support in tests  https://review.openstack.org/35171312:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server: Add python packages for SNI support in tests  https://review.openstack.org/35171412:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build: Add python packages for SNI support in tests  https://review.openstack.org/35171512:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_server: Add python packages for SNI support in tests  https://review.openstack.org/35171612:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rsyslog_client: Add python packages for SNI support in tests  https://review.openstack.org/35171712:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rsyslog_server: Add python packages for SNI support in tests  https://review.openstack.org/35171812:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-security: Add python packages for SNI support in tests  https://review.openstack.org/35171912:23
jitekawooh12:25
jiteka:D12:25
DrifterZAodyssey4me: any particular reason the build is failing still ?12:25
DrifterZAI can't see anything with the actuall play12:25
odyssey4meDrifterZA yes, because the horizon test is executing the tempest plugin and that's failing... that's why nothing is merging into the os_horizon role at the moment12:26
*** woodard has joined #openstack-ansible12:26
odyssey4mein a test environment I see this in keystone, but haven't managed to work out what's going on yet: http://paste.openstack.org/show/550406/12:26
odyssey4memorning logan- Did you come to any discovery when looking into the br-mgmt interface startup issue in containers?12:28
odyssey4methat's a plague at the moment12:28
*** woodard has quit IRC12:31
odyssey4meDrifterZA you can see the magnum-ui package is being installed into the venv as it should, so your patch is good: http://logs.openstack.org/91/351091/9/check/gate-openstack-ansible-os_horizon-ansible-func-ubuntu-trusty/e0f42ab/console.html#_2016-08-05_10_24_43_19960112:31
logan-well, i've got an aio with 2 containers taht failed to start like that right now. on both containers the logs are filled with this http://cdn.pasteraw.com/r7ir6qxwfhg2zzciguo1fv94saesy4h12:32
logan-on one of the containers i ran ifup eth1 and the interface came up immediately12:32
*** thorst_ has joined #openstack-ansible12:45
*** thorst has quit IRC12:49
logan-i think its clear ifup -a errored, because none of the eth10, eth11, etc interfaces on the neutron_agents container are started. not seeing any useful logs stored though :(12:49
odyssey4mehmm, so I *think* that the container always uses the *host* kernel - and may also inherit the parameters set on the hosts by the security role12:51
odyssey4meso it is *possible* that the martian source notifications are coming from there... and perhaps some of the security bits are causing problem12:52
odyssey4me*problems12:52
odyssey4methat's pure conjecture though12:52
odyssey4meis there any way that we can gain better logs for diagnosis?12:52
*** catintheroof has quit IRC12:53
openstackgerritAdam Reznechek proposed openstack/openstack-ansible-os_nova: Update PowerVM compute driver path  https://review.openstack.org/34872012:54
*** psilvad has quit IRC12:55
odyssey4melogan- can you check upstart - there should be logs there12:56
odyssey4me /var/log/upstart12:56
logan-yeah I checked the upstart networking log, nothing :/12:56
logan-just dhcp messages for eth012:56
*** markvoelker has joined #openstack-ansible12:56
logan-dhclient output*12:56
*** psilvad has joined #openstack-ansible12:58
*** jamesdenton has joined #openstack-ansible13:01
*** xnodeza has quit IRC13:01
odyssey4mehmm, I wonderif somehow the default interfaces change to source files from interfaces.d is somehow not making it into the container on time?13:01
*** psilvad has quit IRC13:02
odyssey4methen again, the container does get restarted... so I guess that's unlikely13:02
openstackgerritAdam Reznechek proposed openstack/openstack-ansible-repo_build: [WIP] Add support for multi-repo/multi-arch repo builds  https://review.openstack.org/34686313:04
*** catintheroof has joined #openstack-ansible13:05
*** cbits has joined #openstack-ansible13:05
odyssey4meblast, it looks like mhayden was wrong about the SNI support needed only on the deployment host13:06
*** messy has joined #openstack-ansible13:07
mrhillsmang'morning13:09
logan-http://cdn.pasteraw.com/gdhhv2g2l8dximhvbg852v992qv7gpl13:09
*** javeriak has quit IRC13:10
odyssey4melogan- weird - if you compare that to a container which worked - is there a difference?13:10
*** abelur has quit IRC13:11
*** sdake has joined #openstack-ansible13:11
*** psilvad has joined #openstack-ansible13:12
logan-upstart log has an interesting difference13:13
*** asettle has joined #openstack-ansible13:13
logan-one that worked: http://cdn.pasteraw.com/bhjzb29ucwlh692h1qj7orzcz0nvn4f, one that didn't: http://cdn.pasteraw.com/5xxn1y8ix9iv02nd1tlk87r78uns9sv13:13
logan-last line of the log seems to confirm that the interface wasn't prepped yet13:14
logan-interface file*13:14
logan-also, looking thru syslog there, I do not see any reboot13:14
*** DrifterZA has quit IRC13:21
*** woodard has joined #openstack-ansible13:27
*** woodard has quit IRC13:32
odyssey4melogan- hmm, so something appears to be going wrong in this sequence: https://github.com/openstack/openstack-ansible-lxc_container_create/blob/master/tasks/container_create.yml#L155-L24313:32
odyssey4meor the notifier didn't fire properly13:33
*** janki has quit IRC13:33
*** janki has joined #openstack-ansible13:33
logan-my screen buffer doesn't go back that far :(13:34
logan-i guess the gate logs should have that though13:34
logan-I don't see where it is restarting the container after all of these network configurations are dropped13:35
odyssey4mehttp://logs.openstack.org/55/350955/2/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-trusty/47dd23f/console.html#_2016-08-05_12_59_37_67415813:35
odyssey4meso that's one that didn't work13:36
odyssey4mehttp://logs.openstack.org/55/350955/2/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-trusty/47dd23f/console.html#_2016-08-05_12_39_00_26154913:36
logan-oh, there it is13:36
odyssey4methat's the restart bit13:36
logan-i was a few retries down I guess13:36
odyssey4meI have this one which has more verbose logging13:37
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [TESTING] Try to determine the cause of container secondary interface start failures  https://review.openstack.org/35112813:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [TESTING] Try to determine the cause of container secondary interface start failures  https://review.openstack.org/35112813:40
*** ametts has joined #openstack-ansible13:42
*** galstrom_zzz is now known as galstrom13:44
*** galstrom is now known as galstrom_zzz13:45
*** michaelgugino has joined #openstack-ansible13:53
*** weezS has joined #openstack-ansible13:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Fix incorrect operations link in run-playbooks.sh  https://review.openstack.org/35085813:53
automagicallyFWIW, eventbrite links for midcycle dinners are now fixed here: https://etherpad.openstack.org/p/osa-midcycle-newton13:54
automagicallyThanks spotz for setting them up13:54
*** TxGirlGeek has joined #openstack-ansible13:56
odyssey4methanks spotz_zzz & thanks to automagically for the update13:57
*** cyborg-ninja has joined #openstack-ansible13:58
*** klamath has joined #openstack-ansible13:58
odyssey4meunfortunately I leave on Friday, so can't make Friday night13:59
cyborg-ninjahas I have created an AIO openstack enviroment but have an odd issue. Has anyone experienced an issue with horizon not allowing the creation of a network13:59
*** catintheroof has quit IRC14:00
odyssey4mecyborg-ninja your best bet is to look at the neutron-server/neutron-agent logs with debug enabled (which is done by default on the AIO)14:01
cyborg-ninjaok i will start there thanks14:02
*** openstackgerrit has quit IRC14:03
*** openstackgerrit has joined #openstack-ansible14:04
*** catintheroof has joined #openstack-ansible14:07
*** janki has quit IRC14:11
*** jthorne has joined #openstack-ansible14:12
*** spotz_zzz is now known as spotz14:12
*** aszeszo has quit IRC14:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [WIP] Remove Tempest git source  https://review.openstack.org/35176514:14
spotzodyssey4me: I'm hoping you guys stay at La GLoria late on Wednesday and I'll come by after class14:14
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible: Support multiple rabbitmq clusters  https://review.openstack.org/34488414:19
odyssey4merather annoyingly, I'm seeing tempest runs often go longer than 15 mins... which is one of the reasons we hit the build timeout so often14:20
logan-i wonder if it is hitting the dnsmasq issue in the gate14:20
*** TxGirlGeek has quit IRC14:21
logan-http://cdn.pasteraw.com/q3zsfblxkpkpz6iq4ydwu543poi6p5314:21
*** Mudpuppy has joined #openstack-ansible14:21
*** TxGirlGeek has joined #openstack-ansible14:21
logan-tempest was exposing that yesterday on my local builds as it would spin forever trying to ssh the instances before timing out and failing eventually14:21
*** DrifterZA has joined #openstack-ansible14:22
odyssey4mehmm, and this was due to dbus not being accessible?14:22
logan-i haven't determined the cause yet, but i saw it on 2 builds14:22
logan-maybe some issue with the container filesystem mounts?14:23
logan-btw, that paste doesn't have the neutron log, but the issue was neutron-dhcp-agent not being able to start dnsmasq because of that libdbus error14:25
*** TxGirlGeek has quit IRC14:26
*** woodard has joined #openstack-ansible14:28
automagicallyWeird14:28
*** Jeffrey4l has quit IRC14:29
*** Jeffrey4l has joined #openstack-ansible14:29
odyssey4melogan- hmm, I wonder if in that case it didn't have the right AppArmor profile14:30
*** TxGirlGeek has joined #openstack-ansible14:32
*** woodard has quit IRC14:32
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-memcached_server: Adding idempotency testing to the role func test  https://review.openstack.org/35177414:34
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Refactor and improve swift-rings.py  https://review.openstack.org/35122714:36
*** sguduru has joined #openstack-ansible14:37
*** TxGirlGeek has quit IRC14:38
*** mkrish004 has joined #openstack-ansible14:40
DrifterZAhmmm I wonder if its worth while writing an opencontrail role14:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [TEST] Only use overlayfs if the kernel version is >= 3.18  https://review.openstack.org/35177614:43
mkrish004Hi Guys, i am trying to install Mitaka using OSA, when setting up repo, the apt package lxc-dev is not installing and saying "E: Failed to fetch https://mirror.rackspace.com/ubuntu/pool/main/q/qemu/qemu-utils_2.0.0+dfsg-2ubuntu1.26_amd64.deb  HttpError404"14:43
mkrish004even 404 error code on the browser,14:44
odyssey4memkrish004 it would appear that your apt source deleted the file between the apt-get update and the apt-get install14:44
odyssey4meyou can just retry14:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [TEST] Only use overlayfs if the kernel version is >= 3.18  https://review.openstack.org/35177614:45
messymkrish004: odyssey4me I think the repo is out of date right now14:46
messyit only has qemu-utils_2.0.0+dfsg-2ubuntu1.25_amd64.deb  on there right now14:46
odyssey4memessy yes, and a simple retry will make it work14:47
mkrish004odyssey4me, i tried to install this on other containers to test still the same, let me retry again..thanks a lot14:52
mkrish004thanks messy14:52
odyssey4memkrish004 don't retry installing that package - re-run the playbook14:53
odyssey4methe playbook will execute an apt-get update, then apt-get install14:53
odyssey4methe apt-get update will refresh the apt cache, which will give the new package URL/version14:53
mkrish004okay odyssey4me, let me recreate the container or re run the playbook...14:54
openstackgerritAndy McCrae proposed openstack/openstack-ansible: Docs: Enabling LBaaSv2 horizon panel  https://review.openstack.org/35178615:02
*** cyborg-ninja has left #openstack-ansible15:03
*** aszeszo has joined #openstack-ansible15:11
*** jiteka has quit IRC15:14
*** cyborgninja has joined #openstack-ansible15:18
*** galstrom_zzz is now known as galstrom15:18
*** javeriak has joined #openstack-ansible15:20
*** TxGirlGeek has joined #openstack-ansible15:23
*** cyborgninja has quit IRC15:24
*** cyborgninja has joined #openstack-ansible15:24
*** admin0 has quit IRC15:27
*** janki has joined #openstack-ansible15:27
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-memcached_server: Adding Vagrantfile for developer testing  https://review.openstack.org/35179715:27
*** woodard has joined #openstack-ansible15:29
*** aszeszo1 has joined #openstack-ansible15:33
*** woodard has quit IRC15:34
*** gouthamr has quit IRC15:34
*** KLevenstein has joined #openstack-ansible15:35
*** aszeszo has quit IRC15:36
michaelguginofyi, more discussion on this would be helpful:  https://review.openstack.org/#/c/350806/15:37
*** javeriak has quit IRC15:42
*** javeriak has joined #openstack-ansible15:43
*** javeriak has quit IRC15:43
*** TxGirlGeek has quit IRC15:45
odyssey4memichaelgugino if the nova role didn't fail most of the time I would be less inclined to be concerned, but unfortunately the nova role fails at least half the time15:46
cyborgninjahas anyone seen this error from horizon 'Error: Failed to create network' i was able to grab some info from the neutron-server logs if anyone is interested15:47
michaelguginoodyssey4me: nova role fails due to a known bug.  It's the same failure, 500 delete for floating IP.15:48
odyssey4memichaelgugino bug link?15:49
cloudnullmornings15:49
odyssey4memichaelgugino also, then why would we want to increase our exposure to that bug (and more like it) by replicating a large build-out in the tempest role?15:49
*** gfa has quit IRC15:50
*** gfa has joined #openstack-ansible15:50
odyssey4mehowdy cloudnull - on the pip install story... I wonder if we could do an in-place upgrade when pip itself uses SSL to download from pypi... and therefore if it doesn't have the packages already, it may have SNI failures too15:51
michaelguginoodyssey4me: https://bugs.launchpad.net/tempest/+bug/158693115:51
openstackLaunchpad bug 1586931 in tempest "TestServerBasicOps: Test fails when deleting server and floating ip almost at the same time" [Undecided,In progress] - Assigned to Monica Tian (ytianyt)15:51
cloudnullodyssey4me:  https://review.openstack.org/#/c/351482/15:51
cloudnulli commented there.15:51
cloudnulloh as did you15:52
odyssey4memichaelgugino so either there's a regression, or the problem was not fixed15:52
cloudnullso idk that there's any reason to limit the installation of those packages15:52
cloudnullas long as we're using py215:52
michaelguginointroducing an intermittent bug to testing coverage is better than 0 testing coverage, IMO.  I don't think os_tempest is updated all that frequently, so it's not like people are going to be losing sleep over it.  And the bug is of such nature that you can tell the run as completed, it's literally the cleanup step that is failing on tempest, so you know if it got to that point your code is good, just run recheck15:53
odyssey4memichaelgugino the roles test directly form the head of the branch, only the integrated gate check has a fixed SHA... so the role failure indicates that either we're not doing something right, or the bug is not fixed15:53
openstackgerritNolan Brubaker proposed openstack/openstack-ansible: Remove old inventory conditional support  https://review.openstack.org/34966715:53
michaelguginoodyssey4me: that bug is not fixed, I updated to that effect15:53
cloudnullthe SNI issues w/ python-requests and others are becoming more fequent and if those packages solve for it then I say we do that. Additionally, I see no reason to limit the installatio of those packages.15:53
michaelguginobut, it is a known bug, other people are seeing it, there's already some traction in neutron to getting it fixed, we just need to either wait for it to be fixed, or fix it ourselves ;)15:54
odyssey4mecloudnull FYI I'm trying to get it into g-r so that we don't have to manage the capping and such15:55
odyssey4mehttps://review.openstack.org/35153415:55
cloudnullcool15:55
odyssey4mecloudnull so FYI trusty uses python <2.7.9 while xenial uses python > 2.7.915:56
*** sdake has quit IRC15:56
odyssey4meie xenial doesn't need that extra package, but trusty does15:56
cloudnullxenial is where we see more of the sni issues15:56
*** sdake has joined #openstack-ansible15:56
odyssey4mecloudnull if we just ensure that pyasn1 and pyopenssl are there, that should not be happening15:57
cloudnulland we're going to see more when we get newer versions of requests15:57
cloudnullhttps://bugs.launchpad.net/ubuntu/+source/requests/+bug/129907515:57
openstackLaunchpad bug 1299075 in requests (Ubuntu) "SSL SNI support broken in python2" [Undecided,Confirmed]15:57
*** mikelk has quit IRC15:57
cloudnullso i say just install the three packages across the board.15:57
cloudnullthey dont hurt15:57
*** cbits has quit IRC15:59
automagicallycloudnull: Thx for the review on https://review.openstack.org/#/c/344884/16:00
automagicallyAnd the testing16:00
cloudnull++ hopfully its happy now :)16:00
automagicallyI hope so too. I’m trying to test in my 5 node lab, but keep losing connectivity to it in the middle of playbook runs16:01
automagicallyThe joys of testing16:01
cloudnulllololol16:01
cloudnullbbl. i have a meeting to attend, should be about an hour16:01
odyssey4meautomagically I had to do this to get the gate unblocked: https://review.openstack.org/35149916:01
cloudnulllet me know how it goes.16:01
automagicallyodyssey4me: Yep, I saw that, my apologies for hosing the gate16:02
odyssey4meit happens16:02
cloudnull++ it does16:02
automagicallyI was afk all day yesterday or would have been able to help out more16:02
odyssey4mecloudnull so as far as I know we need the SNI solution where Ansible executes things... which means in system packages on hosts and perhaps in the containers16:03
cloudnullwe need it for requests too16:03
odyssey4meugh, that pretty much means everywhere - including in venvs16:03
cloudnullmy exporation of SNI issues wasn't ansible related.16:04
cloudnullwhich lead me to https://bugs.launchpad.net/ubuntu/+source/requests/+bug/129907516:04
openstackLaunchpad bug 1299075 in requests (Ubuntu) "SSL SNI support broken in python2" [Undecided,Confirmed]16:04
*** TxGirlGeek has joined #openstack-ansible16:04
*** pcaruana has quit IRC16:05
*** galstrom is now known as galstrom_zzz16:06
*** TxGirlGeek has quit IRC16:07
*** TxGirlGeek has joined #openstack-ansible16:08
*** jimbaker has quit IRC16:11
openstackgerritMerged openstack/openstack-ansible: Define retries on ceph keyring fetch task  https://review.openstack.org/34978016:12
odyssey4melogan- heh, finally https://review.openstack.org/34978016:13
logan-yes!!! finally lol16:13
*** jimbaker has joined #openstack-ansible16:15
*** jimbaker has quit IRC16:15
*** jimbaker has joined #openstack-ansible16:15
michaelguginowe were not hitting these sni issues on xenial a month or two ago when I first started to convert some of the roles16:17
michaelguginoit does seem like some sort of regression somewhere16:17
odyssey4memichaelgugino or that the SNI extensions are being used more and more as certificates are renewed16:19
odyssey4melogan- if I understand this correctly, you're pulling packages into the pip cache, then executing the install as normal. Is that right? https://github.com/openstack/openstack-ansible-pip_install/blob/master/tasks/install_offline.yml16:20
logan-correct16:20
*** DrifterZA has quit IRC16:20
odyssey4mehmm, in that case I think we could optimise the role somewhat16:20
logan-no change to the install process except the files are sourced from local wheels16:21
odyssey4mebasically I'm thinking that we pull out the cache options, which only activates if it's an offline install16:21
odyssey4methen we can try and get-pip... and if that doesn't work try again isolated... and if that doesn't work, try installing a distro package16:21
odyssey4methen as part of the post install we actually install the required package versions16:22
*** asettle has quit IRC16:22
*** Oku_OS is now known as Oku_OS-away16:22
odyssey4meoh, and if there's already a pip - skip the downloading and all that and simply do the package installs16:23
*** asettle has joined #openstack-ansible16:23
*** TxGirlGeek has quit IRC16:23
logan-i wonder if some of the local cache tasks might be best implemented at the playbook level, and then pass in the local wheel paths to pip_install16:26
odyssey4mecloudnull the seemingly more than random issues with container secondary interfaces not starting is actually more pressing right now as it hits us more often than the SNI issues16:26
*** TxGirlGeek has joined #openstack-ansible16:26
odyssey4melogan- yes, actually that is a good idea16:26
odyssey4melogan- in fact, the playbook could copy an entire pip cache from the deployment host if there is a user-provided cache dir given16:27
*** asettle has quit IRC16:27
odyssey4melogan- that would take all the offline install stuff out of the role and simplify things a bit16:27
logan-i guess the issue with that is, tons of roles depend on pip_install, so unless it can skip all of the tasks it will just fail every time a dependent role calls it16:28
odyssey4melogan- the same could be done for a git cache actually - I've been working towards being able to take advantage of the git cache in OpenStack-CI16:28
logan-so maybe best to keep it in the role and streamline like you were saying16:28
odyssey4melogan- I'm more in favor of actually having it done in the container prep perhaps, and in the hosts setup.16:29
logan-true16:29
odyssey4meie container cache prep16:30
odyssey4meanyway, time for me to take a break16:30
odyssey4meI'll catch a bunch of you next week!16:31
automagicallylater odyssey4me16:32
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-pip_install: Add SNI support via pip  https://review.openstack.org/35148216:34
spotzseeya od16:40
spotzseeya odyssey4me16:40
*** KLevenstein has quit IRC16:43
Andrew_jediguys how can i change the mirror?16:46
Andrew_jediseems like qemu package 404 is very consistent16:47
Andrew_jediretrying playbook or recreating the container is not working16:47
openstackgerritMichael Gugino proposed openstack/openstack-ansible-os_nova: WIP: Implement tests for nova-lxd hypervisor  https://review.openstack.org/35022616:51
*** eil397 has joined #openstack-ansible16:53
*** eil397_ has joined #openstack-ansible16:53
*** TxGirlGeek has quit IRC17:02
automagicallyAndrew_jedi: The LXC containers get the apt sources from the physical host: https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/vars/ubuntu-14.04.yml17:04
*** chart has joined #openstack-ansible17:06
charthello, My name is Chart. How many network interface for openstack ansible aio?17:06
*** janki has quit IRC17:07
automagicallyChart: 1 should work17:08
openstackgerritIan Cordasco proposed openstack/openstack-ansible-os_tempest: Disable stderr logging  https://review.openstack.org/35184917:10
cyborgninjahas anyone seen this error from horizon 'Error: Failed to create network' i was able to grab some info from the neutron-server logs if anyone is interested17:11
spotzcyborgninja: Yeah I think folks will need the logs to being to help17:12
automagicallycyborgninja: Sure, drop a pastebin or gist link to the neutron-server logs17:12
chartOK!!! and how to create external network for instance?? I use "neutron net-create ext-net --router:external True --provider:physical_network vlan --provider:network_type flat". but it show physical_network "vlan" unknown for flat provider network17:12
cyborgninjaok thanks guys http://pastebin.com/5FKM9Rpf17:14
*** itlinux has quit IRC17:15
cyborgninjain addition this is what Horizon says fwiw http://pastebin.com/hGCV7tK017:17
*** TxGirlGeek has joined #openstack-ansible17:20
automagicallycyborgninja: Thanks for sharing the logs. As you probably noticed, they don’t seem to contain any helpful details17:21
*** electrofelix has quit IRC17:21
openstackgerritIan Cordasco proposed openstack/openstack-ansible-os_glance: Disable stderr logging  https://review.openstack.org/35185217:21
cyborgninjaautomagically Thanks for the look and yes. Anythoughts on a next step for troubleshooting?17:23
openstackgerritIan Cordasco proposed openstack/openstack-ansible-os_heat: Disable stderr logging  https://review.openstack.org/35185417:24
automagicallycyborgninja I’d verify that you see the same behavior when creating a network using the CLI tools17:25
openstackgerritIan Cordasco proposed openstack/openstack-ansible-os_neutron: Disable stderr logging  https://review.openstack.org/35185517:25
cyborgninjaautomagically: good point i will give that a shot, many thanks!17:26
automagicallygood luck!17:26
openstackgerritIan Cordasco proposed openstack/openstack-ansible-os_keystone: Disable stderr logging  https://review.openstack.org/35185617:26
sigmavirusI think ^ is the last of the backports17:27
Andrew_jediautomagically: Thanks! trying new mirror...17:44
*** chart has quit IRC17:50
*** aszeszo1 has quit IRC17:54
*** aszeszo has joined #openstack-ansible17:54
*** weshay has quit IRC17:58
mkrish004chart, hope you would have fixed it, if not... pls change --provider:network_type flat to --provider:network_type vlan if you want to create vlan network17:58
*** albertcard has joined #openstack-ansible17:59
*** weshay has joined #openstack-ansible18:01
*** jthorne has quit IRC18:11
*** klamath has quit IRC18:20
*** KLevenstein has joined #openstack-ansible18:24
*** galstrom_zzz is now known as galstrom18:26
cyborgninjahas anyone runinto the following error when creating a physical network via cli? http://pastebin.com/vvEZjEbJ18:27
eil397cyborgninja: youa re workign with aio installation, right ? I'm not sure what youa re trying to achieve with aio by creating networks18:30
*** Andrew_jedi has quit IRC18:33
cyborgninjayes it is an aio install, i'm trying to get a dev network created18:33
eil397s_youa re_you are_g18:34
*** sguduru has quit IRC18:37
*** TxGirlGeek has quit IRC18:47
*** omiday has quit IRC18:49
*** Mudpuppy has quit IRC18:56
*** jimbaker has quit IRC18:58
*** hybridpollo has joined #openstack-ansible19:00
*** catintheroof has quit IRC19:00
*** messy has quit IRC19:00
*** jimbaker has joined #openstack-ansible19:02
*** jimbaker has quit IRC19:02
*** jimbaker has joined #openstack-ansible19:02
eil397cyborgninja: about your error message from neutron client. you don't have physical_network=public and network_type=flat.19:03
eil397cyborgninja: you can check your configuration here /etc/openstack_deploy/openstack_user_config.yml19:04
*** TxGirlGeek has joined #openstack-ansible19:07
eil397cyborgninja: role os_tempest creates vxlan network for testing: https://github.com/openstack/openstack-ansible-os_tempest/blob/master/tasks/tempest_resources.yml#L206 (private) and public (line 228)19:07
*** Andrew_jedi has joined #openstack-ansible19:09
odyssey4meAndrew_jedi if you're using stable/mitaka, then you need to use override vars to change the mirror. And I think it has to be done prior to container build.19:10
odyssey4meIf you've already built, then just use an ad-hoc ansible command to change the mirror.19:10
*** TxGirlGeek has quit IRC19:10
odyssey4meautomagically is too used to working in master :)19:10
automagicallyI’ve got the scars to show for it19:10
Andrew_jediodyssey4me: I updated the sources.list inside the container and then executed the playbook19:10
*** TxGirlGeek has joined #openstack-ansible19:11
odyssey4meAndrew_jedi in mitaka, these are the vars which are used for the container sources setting: https://github.com/openstack/openstack-ansible-lxc_hosts/blob/stable/mitaka/vars/ubuntu-14.04.yml#L20-L2119:12
odyssey4meif you set them in user_variables.yml then that'll work on your next build19:12
eil397Andrew_jedi: I have one installation from mitaka. It was builded today. was builded successfully.19:13
Andrew_jediodyssey4me: Damn... i searched for these everywhere. thanks for sharing !19:14
Andrew_jedieil397: Lucky you. I have failed like 5-6 times just today.19:15
eil397Andrew_jedi: I'm using proxy to access external repos. but with all other defautl values for variables19:17
odyssey4meyeah, but the rackspace ubuntu mirror appears to be hosed today19:17
odyssey4methis is one of the reasons we changed the config in master19:17
Andrew_jedieil397: Is it possible that you can share your openstack_user_config.yml ?19:17
eil397Andrew_jedi: yes. of course. it is defauld aio config. without changes. I jsut added proxy settings to user_variables.yml19:19
Andrew_jediodyssey4me: rackspace mirror is missing the qemu package.19:19
Andrew_jedieil397:ohhhh19:19
odyssey4meAndrew_jedi it's probably missing other packages because it appears to have an incomplete update19:20
odyssey4menow that I've checked-in, going back offline19:22
*** thorst__ has joined #openstack-ansible19:23
Andrew_jediodyssey4me: may be thats the case19:23
*** thorst_ has quit IRC19:26
*** thorst__ is now known as thorst_19:26
*** sdake has quit IRC19:26
eil397Andrew_jeddi: my openstack_user_config.yml ( was generated by bootstrap-aio.sh) http://pastebin.com/K8dmXWkR19:27
*** sdake has joined #openstack-ansible19:28
eil397Andrew_jeddi: dpkg -l | grep "qemu "  ----returns--> ii  qemu                                 2.0.0+dfsg-2ubuntu1.26                amd64        fast processor emulator19:29
michaelguginocloudnull: odyssey4me Question about config overrides.  How can I make it work with a section header that contains dashes.  IE:  compute-feature-enabled19:34
logan-did you try 'config-thing': 'setting'19:36
logan-you're talking about something like this right? http://cdn.pasteraw.com/97obwuscvz24x0jjg4pg5vr37z01rnm19:36
michaelguginodoes this look correct:  tempest_tempest_conf_overrides: {'compute-feature-enabled': {'config_drive': 'false'}}19:36
michaelgugino?19:36
michaelguginologan-: thanks, that might work19:37
logan-no prob, yep your paste looks fine to me19:38
michaelguginocool, I'll try the yaml format first like your paste19:38
michaelguginologan-: do you know if I have to override the whole section, or will it happily append/replace?19:40
logan-no I don't think you have to do the whole section, it is per-var19:40
openstackgerritMichael Gugino proposed openstack/openstack-ansible-os_nova: WIP: Implement tests for nova-lxd hypervisor  https://review.openstack.org/35022619:41
michaelguginothat's awesome.  I hope it actually works, haven't had to use it yet ;)19:41
logan-actually i'm certain you don't have to do the whole section or my configs would be a lot more verbose :)19:41
michaelguginonova-lxd testing is so close, so close.  I get the instance up, able to ssh in, and then it's failing with some blkid command nonse in tempest.19:42
michaelguginoturns out, the nova-lxd maintainers removed support for config_drive, no stated reason.19:43
michaelguginobut, happily, looks like tempest can account for this out of the box.19:43
logan-that is going to be awesome19:45
*** Mudpuppy has joined #openstack-ansible19:50
michaelguginomore -1's for you automagically19:54
automagicallyHurray!19:55
automagicallygood feedback michaelgugino19:56
Andrew_jedieil397: Thanks for sharing :)20:11
eil397Andrew_jedi: I jsut catched this error on rackspace cloud. I was trying to check mitaka on it. Same error about inconsistency with packages: Failed to fetch http://mirror.rackspace.com/ubuntu/pool/main/q/qemu/qemu-utils_2.0.0+dfsg-2ubuntu1.26_amd64.deb20:13
eil397Andrew_jedi: I was using http://docs.openstack.org/developer/openstack-ansible/developer-docs/quickstart-aio.html and image from section Quick AIO build on Rackspace Cloud : - )20:15
*** cyborgninja has quit IRC20:16
*** Andrew_jedi has quit IRC20:16
*** thorst__ has joined #openstack-ansible20:16
*** thorst_ has quit IRC20:18
michaelguginowoohoo!  nova-lxd is passing the tempest testing!  http://logs.openstack.org/26/350226/15/check/gate-openstack-ansible-os_nova-ansible-func-ubuntu-trusty/5e263f5/console.html20:21
cloudnulland back :)20:23
cloudnullmichaelgugino: did you get your question answered ?20:23
michaelguginoyes, thanks20:24
cloudnullcool20:24
michaelguginolots of smart people in here these days20:24
*** Andrew_jedi has joined #openstack-ansible20:25
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible: Updated from global requirements  https://review.openstack.org/34964320:25
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-pip_install: Add SNI support via pip  https://review.openstack.org/35148220:26
*** ametts has quit IRC20:26
openstackgerritLogan V proposed openstack/openstack-ansible: WIP: Project Calico integration  https://review.openstack.org/34017520:32
*** gtracy200 has joined #openstack-ansible20:33
*** Jeffrey4l has quit IRC20:35
*** Jeffrey4l has joined #openstack-ansible20:36
*** thorst__ has quit IRC20:46
openstackgerritMichael Gugino proposed openstack/openstack-ansible-os_nova: Implement tests for nova-lxd hypervisor  https://review.openstack.org/35022620:47
*** spotz is now known as spotz_zzz20:47
michaelguginocloudnull: https://review.openstack.org/#/c/350226/  Is there anything else I need to do to get the extra lxd tests to fire off?20:48
michaelguginoI made it look like neutron's tox.ini, is there something that needs to be done elsewhere?20:49
*** Andrew_jedi has quit IRC20:49
*** thorst_ has joined #openstack-ansible20:50
*** retreved has quit IRC20:51
*** smatzek has quit IRC20:54
*** thorst_ has quit IRC20:55
michaelguginoafaict, it looks like https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml needs to be updated.20:59
*** TxGirlGeek has quit IRC21:02
*** weezS has quit IRC21:02
michaelguginolooking for reviews on https://review.openstack.org/#/c/346984/21:02
*** TxGirlGeek has joined #openstack-ansible21:03
*** psilvad has quit IRC21:04
*** sdake has quit IRC21:12
cloudnullmichaelgugino: looking21:13
*** kstev1 has quit IRC21:13
cloudnullmichaelgugino: for the lxd-gate jobs you'll need to make a pr to project-config to enroll the new jobs.21:15
cloudnullsomething like https://review.openstack.org/#/c/329892/21:15
cloudnullif odyssey4me is around he should be able to get that going.21:15
michaelguginoyeah, I would think a core would need to make that pull request21:16
cloudnullindeed.21:16
cloudnullI can PR it, i forget how its all glued together.21:17
cloudnullI think its just the line here https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L995221:17
cloudnullbut odyssey4me and I can work that out.21:17
michaelguginocloudnull: I think it's probably supposed to look like this:  https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L993721:18
michaelguginobut yeah, I'll leave you guys to it.  I have a bunch of reviews in that need more eyes:  https://review.openstack.org/#/q/owner:michael.gugino%2540walmart.com+status:open21:19
michaelguginoI'm signing off for the weekend.  I'll talk to you all online Monday.  I'm not able to make the midcycle unfortunately, but I'll be online all next week.21:19
michaelguginohave a good weekend21:19
cloudnullmichaelgugino: i'm reviewing those now.21:20
cloudnullhave a good weekend21:20
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Do not override Horizon ServerName in playbook  https://review.openstack.org/35095521:23
openstackgerritSteve Lewis (stevelle) proposed openstack/openstack-ansible-openstack_openrc: Add alias for OS_ENDPOINT_TYPE  https://review.openstack.org/35192921:23
*** michaelgugino has quit IRC21:28
*** jthorne has joined #openstack-ansible21:31
*** KLevenstein has quit IRC21:35
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-pip_install: Add SNI support via pip  https://review.openstack.org/35148221:40
gtracy200It's been a really long time since I used IRC chat, so treat me like a newbie and excuse my mistakes. TRYINGGGG to install Openstack-Ansible. I've installed Openstack using devstack and packstack and both came up. But Ansible is a whole other experience. I followed a couple of "Beginner Install" on line and the Openstack-Ansible instructions on Oprestack.org are useless for someone doing it for the first ti21:40
gtracy200me. I've installed it using the git clone steps and ran the AIO install but nothing appears when I try to log into the dashboard. lxc-ls -f yields nothing. So where to turn? Isn't this supposed to install and at least funadmentally work? Sorry for the rant. Kind of frustrated now.21:40
*** galstrom is now known as galstrom_zzz21:41
*** mkrish004 has quit IRC21:43
*** jamesdenton has quit IRC21:53
cloudnullgtracy200: welcome21:53
cloudnullare you just trying to install a stack in an "all in one"21:53
cloudnullalso is this a physical host or a vm?21:54
*** sdake has joined #openstack-ansible21:54
cloudnulltell me a little more about what you're trying to do and I'd be happy to help .21:54
*** jthorne has quit IRC21:56
*** jthorne has joined #openstack-ansible21:56
cloudnulljthorne: ohai :)21:58
jthorneoh hello21:58
*** timl0101 has quit IRC22:02
*** weshay has quit IRC22:02
*** hj-hpe has quit IRC22:19
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-pip_install: Add SNI support via pip  https://review.openstack.org/35148222:24
*** omiday has joined #openstack-ansible22:34
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_horizon: Create nova endpoints for tempest test  https://review.openstack.org/35194022:39
jmccrorycloudnull logan- ^ should unblock horizon role's gate22:40
cloudnulljmccrory: wow so it just needed a compute endpoint ?22:41
jmccroryyep, no idea horizon had permissions on pages like that22:42
cloudnullme neither.22:45
cloudnullseems suspect22:45
cloudnullbut so does horizon22:45
cloudnullso idk22:45
cloudnull+2 if it makes the gate happy :)22:46
jmccroryheh yeah, only used horizon a handful of times. was interesting to learn more how it worked at least22:48
*** Mudpuppy has quit IRC22:52
*** Mudpuppy has joined #openstack-ansible22:53
*** Mudpuppy has quit IRC22:57
*** TxGirlGeek has quit IRC22:58
*** asettle has joined #openstack-ansible23:02
*** asettle has quit IRC23:06
cloudnullanyone around to do the needful here : https://review.openstack.org/#/c/351482/23:13
cloudnullthat should help w/ our SNI issues.23:13
*** Mudpuppy has joined #openstack-ansible23:16
*** Mudpuppy has quit IRC23:16
cloudnulljmccrory:  if you're around , i'd love your thoughts on https://review.openstack.org/#/c/349485/23:17
*** Mudpuppy has joined #openstack-ansible23:17
cloudnull-cc automagically ^23:17
*** Mudpuppy_ has joined #openstack-ansible23:19
*** Mudpuppy has quit IRC23:19
logan-nice jmccrory!23:20
cloudnullodyssey4me: you around to review 351482 ?23:21
*** aszeszo has quit IRC23:21
openstackgerritMerged openstack/openstack-ansible-openstack_openrc: Add alias for OS_ENDPOINT_TYPE  https://review.openstack.org/35192923:21
stevellejust need one more for 35148223:27
stevellenow back to punching rabbit to make telemetry work23:28
*** sdake has quit IRC23:31
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-pip_install: Add SNI support via pip  https://review.openstack.org/35148223:44
cloudnullstevelle: updated based on odyssey4me feedback23:44
cloudnullthanks for reviewing earlier23:44
cloudnullopps one more coming in23:45
cloudnulloh nevermind  its good23:46
stevelleah, those group vars get confusing with the multiple uses, forgot about those23:48
*** aszeszo has joined #openstack-ansible23:49
*** aszeszo has quit IRC23:50
*** Mudpuppy_ has quit IRC23:54
cloudnulli hate group vars.23:55
cloudnulli may simply be jaded from juno/icehouse.23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!