| openstackgerrit | Ratnakar Kolli proposed openstack/tripleo-heat-templates: Adding optional aci-opflex hiera data https://review.openstack.org/352661 | 00:11 |
|---|---|---|
| *** onovy has quit IRC | 00:11 | |
| *** onovy has joined #tripleo | 00:13 | |
| *** bkero has joined #tripleo | 00:17 | |
| *** thrash is now known as thrash|g0ne | 00:26 | |
| *** fragatin_ has quit IRC | 00:27 | |
| *** fragatina has joined #tripleo | 00:28 | |
| bkero | How does tripleo deploy to nodepool multinode during 'openstack overcloud deploy'? | 00:28 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Implement scenari001, 002 and 003 https://review.openstack.org/362504 | 00:44 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: DNM: test scenario001 https://review.openstack.org/362505 | 00:46 |
| *** limao has joined #tripleo | 00:48 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: DNM: test scenario002 https://review.openstack.org/362506 | 00:48 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: DNM: test scenario002 https://review.openstack.org/362506 | 00:49 |
| EmilienM | bkero: it uses 2-nodes deployment | 00:51 |
| EmilienM | it doesnt use ironic boot etc | 00:51 |
| bkero | EmilienM: Yeah, I'm wondering what the heat templates and 'openstack overcloud deploy' look like for those, since it doesn't need to use the baremetal stuff since the host is already provisioned. | 00:52 |
| EmilienM | bkero: have you looked at openstack-infra/tripleo-ci? | 00:53 |
| bkero | EmilienM: I have. In particular I've been reading scripts/tripleo.sh, especially around OVERCLOUD_DEPLOY_ARGS | 00:54 |
| bkero | but AFAICT it's not using any ARGS, so I'm guessing this is handled through heat templates. | 00:55 |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: WIP wire in jinja templating for custom roles https://review.openstack.org/362465 | 00:57 |
| *** tzumainn has quit IRC | 00:58 | |
| bkero | This might be what I'm looking for. http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_gate_test.sh#n158 | 01:05 |
| *** xuao has joined #tripleo | 01:09 | |
| EmilienM | bkero: indeed. Every job has its own variables defined here. | 01:13 |
| *** bana_k has quit IRC | 01:22 | |
| *** xuao has quit IRC | 01:23 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Add ML2/OVN support for neutron profile https://review.openstack.org/314875 | 01:23 |
| *** fragatina has quit IRC | 01:30 | |
| *** saneax is now known as saneax-_-|AFK | 01:32 | |
| *** chem has quit IRC | 01:37 | |
| *** jcoufal has quit IRC | 02:04 | |
| *** bana_k has joined #tripleo | 02:07 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Implement scenari001, 002 and 003 https://review.openstack.org/362504 | 02:08 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: DNM: test scenario001 https://review.openstack.org/362505 | 02:09 |
| *** dtrainor has quit IRC | 02:18 | |
| *** bana_k has quit IRC | 02:22 | |
| *** kbyrne has quit IRC | 02:22 | |
| *** kbyrne has joined #tripleo | 02:24 | |
| *** Ryjedo_ has joined #tripleo | 02:31 | |
| *** Ryjedo has quit IRC | 02:32 | |
| *** Ryjedo_ is now known as Ryjedo | 02:32 | |
| *** jefrite has quit IRC | 02:39 | |
| *** jdob has quit IRC | 02:43 | |
| *** jefrite has joined #tripleo | 02:43 | |
| *** jcoufal has joined #tripleo | 02:45 | |
| *** yamahata has quit IRC | 03:13 | |
| openstackgerrit | Karthik S proposed openstack/tripleo-heat-templates: Customize the reservation of memory for host processes https://review.openstack.org/327705 | 03:13 |
| openstackgerrit | Karthik S proposed openstack/tripleo-heat-templates: Added DPDK environment file and nic configs samples https://review.openstack.org/361238 | 03:20 |
| *** jeckersb is now known as jeckersb_gone | 03:26 | |
| *** anbu has quit IRC | 03:32 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/361501 | 03:34 |
| *** xinwu has joined #tripleo | 03:41 | |
| *** jcoufal has quit IRC | 03:41 | |
| colonwq | EmilienM, I have verified RGW/Glance/IPv4/NoSSL. I hope to verify SSL tomorrow. http://paste.openstack.org/show/564728/ | 03:41 |
| *** limao has quit IRC | 03:50 | |
| *** links has joined #tripleo | 03:51 | |
| *** xinwu has quit IRC | 03:55 | |
| *** xinwu has joined #tripleo | 04:00 | |
| *** fragatina has joined #tripleo | 04:02 | |
| *** numans has joined #tripleo | 04:03 | |
| *** numans has quit IRC | 04:04 | |
| *** numans has joined #tripleo | 04:04 | |
| *** akrzos_ has quit IRC | 04:07 | |
| *** fragatina has quit IRC | 04:07 | |
| *** bana_k has joined #tripleo | 04:09 | |
| *** akrzos has joined #tripleo | 04:09 | |
| *** xinwu has quit IRC | 04:13 | |
| *** bana_k has quit IRC | 04:16 | |
| *** limao has joined #tripleo | 04:17 | |
| *** xinwu has joined #tripleo | 04:22 | |
| *** anbu has joined #tripleo | 04:28 | |
| *** xinwu has quit IRC | 04:31 | |
| *** jrist has quit IRC | 04:33 | |
| *** limao has quit IRC | 04:33 | |
| *** jrist has joined #tripleo | 04:34 | |
| *** ayoung has quit IRC | 04:58 | |
| *** limao has joined #tripleo | 05:03 | |
| *** jaosorior has joined #tripleo | 05:10 | |
| *** lifeless_ is now known as lifeless | 05:15 | |
| *** skramaja has joined #tripleo | 05:26 | |
| *** bkopilov has joined #tripleo | 05:27 | |
| *** xinwu has joined #tripleo | 05:31 | |
| *** bvandenh has quit IRC | 05:45 | |
| *** xinwu has quit IRC | 05:48 | |
| *** milan has joined #tripleo | 05:50 | |
| *** xinwu has joined #tripleo | 05:50 | |
| *** apetrich has quit IRC | 05:53 | |
| *** apetrich has joined #tripleo | 05:55 | |
| *** milan has quit IRC | 05:59 | |
| *** ebalduf has quit IRC | 06:00 | |
| openstackgerrit | Saravanan KR proposed openstack/python-tripleoclient: Tripleoclient leaks temporary files https://review.openstack.org/330638 | 06:01 |
| *** oshvartz has quit IRC | 06:01 | |
| *** milan has joined #tripleo | 06:04 | |
| openstackgerrit | Saravanan KR proposed openstack/python-tripleoclient: Tripleoclient leaks temporary files https://review.openstack.org/330638 | 06:07 |
| *** bfournie has quit IRC | 06:11 | |
| *** bfournie has joined #tripleo | 06:12 | |
| *** akrzos has quit IRC | 06:13 | |
| *** akrzos has joined #tripleo | 06:15 | |
| *** aqkhan_ has quit IRC | 06:18 | |
| *** aqkhan_ has joined #tripleo | 06:18 | |
| *** bana_k has joined #tripleo | 06:19 | |
| *** rcernin has joined #tripleo | 06:19 | |
| *** rhefner has quit IRC | 06:20 | |
| *** paramite has joined #tripleo | 06:21 | |
| *** xinwu has quit IRC | 06:22 | |
| *** pgadiya has joined #tripleo | 06:25 | |
| *** pcaruana has joined #tripleo | 06:26 | |
| *** leanderthal|afk is now known as leanderthal | 06:30 | |
| *** bvandenh has joined #tripleo | 06:32 | |
| *** florianf has joined #tripleo | 06:33 | |
| *** anbu has quit IRC | 06:37 | |
| *** ubijtsa has joined #tripleo | 06:39 | |
| *** ubijtsa is now known as Guest54568 | 06:39 | |
| *** bana_k has quit IRC | 06:39 | |
| *** Guest54568 has quit IRC | 06:42 | |
| *** Guest54568 has joined #tripleo | 06:42 | |
| *** Guest54568 is now known as assassin | 06:43 | |
| *** HoloIRCUser6 has joined #tripleo | 06:44 | |
| *** masco has joined #tripleo | 06:46 | |
| *** HoloIRCUser6 is now known as paramite|cell | 06:46 | |
| *** xinwu has joined #tripleo | 06:46 | |
| *** jbadiapa has joined #tripleo | 06:47 | |
| *** saneax-_-|AFK is now known as saneax | 06:47 | |
| *** zaneb has quit IRC | 06:48 | |
| *** zaneb has joined #tripleo | 06:48 | |
| *** rasca has joined #tripleo | 06:50 | |
| *** liverpooler has joined #tripleo | 06:51 | |
| *** aufi has joined #tripleo | 06:52 | |
| *** oshvartz has joined #tripleo | 06:53 | |
| *** jprovazn has joined #tripleo | 06:55 | |
| *** mhenkel has joined #tripleo | 06:58 | |
| *** mcornea has joined #tripleo | 07:02 | |
| *** tesseract- has joined #tripleo | 07:07 | |
| *** zoli_gone-proxy is now known as zoliXXL | 07:09 | |
| *** dsariel has joined #tripleo | 07:09 | |
| *** jpena|off is now known as jpena | 07:12 | |
| *** dtantsur|afk is now known as dtantsur | 07:13 | |
| openstackgerrit | Merged openstack/tripleo-ui: Parameters listing and updating https://review.openstack.org/351554 | 07:19 |
| *** tremble has joined #tripleo | 07:20 | |
| *** ifarkas_afk is now known as ifarkas | 07:22 | |
| *** milan has quit IRC | 07:22 | |
| *** milan has joined #tripleo | 07:24 | |
| *** xinwu has quit IRC | 07:28 | |
| *** hewbrocca-afk is now known as hewbrocca | 07:29 | |
| hewbrocca | Morning folks | 07:30 |
| *** tvignaud has quit IRC | 07:31 | |
| dtantsur | o/ | 07:34 |
| *** akuznetsov has joined #tripleo | 07:37 | |
| *** bvandenh has quit IRC | 07:38 | |
| *** bvandenh has joined #tripleo | 07:38 | |
| *** jpich has joined #tripleo | 07:40 | |
| *** abregman has joined #tripleo | 07:40 | |
| *** fzdarsky|afk has joined #tripleo | 07:41 | |
| *** tremble has quit IRC | 07:42 | |
| *** fzdarsky|afk is now known as fzdarsky | 07:44 | |
| *** tremble has joined #tripleo | 07:45 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-common: Use Openstack cli instead in order to get the instance status https://review.openstack.org/353996 | 07:45 |
| *** ohamada has joined #tripleo | 07:46 | |
| *** anbu has joined #tripleo | 07:46 | |
| shadower | d0ugal: last three to go: https://review.openstack.org/#/c/353899/ :-) (mistral validations) | 07:48 |
| honza | hello folks, the puppet module for apache is deleting the tripleo-ui config file when it runs --- is there a common fix for this kind of issue? | 07:49 |
| honza | http://paste.openstack.org/show/564786/ | 07:49 |
| honza | line 50 | 07:49 |
| *** yolanda has joined #tripleo | 07:51 | |
| d0ugal | shadower: I'll trade you for reviews of this series ;) This is the first: https://review.openstack.org/#/c/359784/ | 07:53 |
| shadower | d0ugal: fair deal | 07:53 |
| jaosorior | honza: tripleo-ui also needs to be in the puppet catalog for it not to get deleted | 07:54 |
| jaosorior | honza: I stumbled upon this same issue yesterday | 07:54 |
| d0ugal | shadower: Going out for a run now, I'll look at the remaining validations patches when I get back. | 07:54 |
| d0ugal | shadower: I actually started reviewing the first earlier. | 07:54 |
| * d0ugal will bbiab | 07:54 | |
| shadower | d0ugal: enjoy your run! | 07:54 |
| honza | jaosorior: i see! what repo is this in? | 07:54 |
| jaosorior | honza: what? | 07:55 |
| jaosorior | honza: the deletion of stuff you mean? That should be in puppetlabs-apache | 07:55 |
| jaosorior | honza: but yeah, basically any apache-related configuration for tripleo-ui needs to be done via puppet. out-of-band stuff will get deleted. | 07:55 |
| honza | jaosorior: sounds like i need to add tripleo-ui to the catalogue as you said, so i'm wondering where this place is | 07:56 |
| honza | interesting, right now it's done via rpm | 07:56 |
| jaosorior | honza: and that's fine... but you need to add your configurations somewhere. probably here: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/ui.pp | 07:57 |
| jaosorior | honza: yesterday I did the mistake of just running the setup of an apache module locally. And it whiped my keystone configuration from the undercloud X_x | 07:57 |
| jaosorior | so yeah, it doesn't work like one would think it does. But I guess there's not much to do about it :/ | 07:58 |
| honza | jaosorior: i don't know much about puppet so i'm trying to orient myself | 07:58 |
| honza | jaosorior: but this sounds like a good starting point | 07:58 |
| openstackgerrit | Matthias Runge proposed openstack/tripleo-heat-templates: Clarify horizon allowed hosts setting https://review.openstack.org/362683 | 07:59 |
| jaosorior | honza: If you can point to someone what exact configurations you need to have for tripleo-ui. I'm sure someone here can help out getting those to puppet. | 07:59 |
| honza | all i need is to tell puppet to not delete /etc/httpd/conf.d/openstack-tripleo-ui.conf :) | 08:02 |
| *** r-mibu has quit IRC | 08:02 | |
| *** r-mibu has joined #tripleo | 08:03 | |
| dtantsur | vicious puppet... | 08:03 |
| *** shardy has joined #tripleo | 08:03 | |
| *** derekh has joined #tripleo | 08:07 | |
| openstackgerrit | Jiri Stransky proposed openstack/puppet-tripleo: Defaults to ceph_mon_node_ips and ceph_mon_node_names https://review.openstack.org/361108 | 08:07 |
| *** bvandenh has quit IRC | 08:12 | |
| *** HoloIRCUser6 has joined #tripleo | 08:15 | |
| *** paramite|cell has quit IRC | 08:15 | |
| shardy | therve: Hey, thanks for you yaql help on the ML :) | 08:18 |
| shardy | therve: I send another update showing what we need, any help appreciated, I'll be sure to credit you as a co-author when we work it out ;) | 08:18 |
| *** HoloIRCUser6 has quit IRC | 08:18 | |
| *** HoloIRCUser7 has joined #tripleo | 08:18 | |
| *** HoloIRCUser7 is now known as paramite|cell | 08:21 | |
| jaosorior | shardy, jistr: Can you guys check this CR out? https://review.openstack.org/#/c/359645/ I've been testing it and mcornea just tried it out too manually | 08:23 |
| *** gfidente has joined #tripleo | 08:25 | |
| jistr | jaosorior: looks good, +A | 08:26 |
| jaosorior | jistr: thanks dude | 08:26 |
| jistr | gfidente: morning, i published a minor edit on https://review.openstack.org/361108 and also rechecked the t-h-t patch that depends on it | 08:26 |
| jistr | gfidente: just a bracket that we missed | 08:27 |
| *** vijaykc4 has joined #tripleo | 08:28 | |
| gfidente | hey morning | 08:28 |
| *** milan has quit IRC | 08:29 | |
| gfidente | thanks :) | 08:29 |
| *** yolanda has quit IRC | 08:33 | |
| Jokke_ | morning folks | 08:34 |
| *** abregman has quit IRC | 08:35 | |
| *** electrofelix has joined #tripleo | 08:35 | |
| honza | shardy: do you happen to know how to make puppet not delete my apache config file? | 08:36 |
| therve | shardy, No problem, glad I could help! | 08:37 |
| shardy | therve: yup, your example is really really close, I'm just trying to figure out how to flatten the list-of-lists vs selecting the first item | 08:38 |
| therve | shardy, There is nifty CL tool in the yaql repo, I don't know if you saw it | 08:38 |
| shardy | therve: No actually I didn't - I've been testing via heat with a minimal template | 08:38 |
| openstackgerrit | Martin André proposed openstack/instack-undercloud: Unit tests for _create_default_plan() https://review.openstack.org/362701 | 08:39 |
| therve | If you type "yaql" in the heat venv you should see it | 08:39 |
| shardy | aha, yeah, that may speed things up a bit | 08:39 |
| *** chem has joined #tripleo | 08:40 | |
| shardy | tbh the main problem is lack of docs, I end up reading the yaql code/tests when figuring out what syntax is needed | 08:40 |
| shardy | I know there's an effort underway to improve that tho | 08:40 |
| *** vijaykc4 has quit IRC | 08:46 | |
| *** abregman has joined #tripleo | 08:47 | |
| therve | Yeah I'm getting better at reading the source as well, but it's not an easy process | 08:48 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Move service/endpoint configuration to keystone profile https://review.openstack.org/359681 | 08:52 |
| *** bvandenh has joined #tripleo | 08:55 | |
| *** links has quit IRC | 09:00 | |
| therve | shardy, OK I may have one solution, but it's not pretty | 09:02 |
| therve | dict($.selectMany($.items()).groupBy($[0], $[1]).select($[0]).zip($.selectMany($.items()).groupBy($[0], $[1]).select($[1].flatten()))) | 09:02 |
| therve | It may look like I'm trying to crash your IRC client, but I'm not | 09:02 |
| shardy | therve: hehe, thanks - I'll give it a try | 09:03 |
| shardy | I got pretty close with a different approach: | 09:03 |
| shardy | $.data.l.selectMany($.items()).groupBy($[0], $[1].reduce($1 + $2)) | 09:03 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Use Mistral/Zaqar for folder-based plan-creation https://review.openstack.org/360550 | 09:04 |
| shardy | the problem is the reduce reduces the nested lists, not just the wrapper from the select | 09:04 |
| shardy | therve: if I just wrote a map_deep_merge function for heat right now, is there any chance we can land it for newton? | 09:05 |
| shardy | this yaql stuff is kinda fun, but it's pretty scary from a maintenance perspective ;) | 09:06 |
| therve | shardy, Possibly. I don't feel super stressed about the n3 deadline TBH | 09:06 |
| shardy | therve: Ok, I'll play with the yaql a little bit more, make some coffee and ponder the next move | 09:06 |
| shardy | therve: context is, this is needed for our custom-roles feature, which is going to be a FFE | 09:07 |
| jaosorior | mcornea: did you get a chance to test this one out? https://review.openstack.org/#/c/355366 | 09:07 |
| therve | shardy, Yeah, I'm not super confident we should ship template with those undebuggable calls | 09:07 |
| mcornea | jaosorior: currently deploying, will update once it's done | 09:07 |
| jaosorior | mcornea: awesome :D | 09:08 |
| shardy | therve: Yeah, if we do then I'd say it has to be a stopgap until heat provides a cleaner way to do the same transformation | 09:08 |
| shardy | there are a few other yaql-isms landing where I'd like to refactor into heat native calls for ocata anyway | 09:08 |
| *** jaosorior is now known as jaosorior_lunch | 09:08 | |
| therve | Oh | 09:11 |
| therve | shardy, dict($.selectMany($.items()).groupBy($[0], $[1], [$[0], $[1].flatten()])) looks more reasonable | 09:11 |
| therve | Seems to work with the basic example I have, and I think I can mostly comprehend it :) | 09:12 |
| shardy | therve: woohoo! It works! :) | 09:13 |
| shardy | http://paste.openstack.org/show/564793/ | 09:13 |
| shardy | thanks :) | 09:13 |
| therve | No problem :) | 09:13 |
| shardy | I'll do some more testing, but that seems like it may do what we need, and I'll add the map_deep_merge thing on my todo list for ocata | 09:13 |
| *** vijaykc4 has joined #tripleo | 09:14 | |
| *** links has joined #tripleo | 09:15 | |
| *** limao has quit IRC | 09:17 | |
| vijaykc4 | shardy, we are waiting for the OVB ha to clear our patches (SRIOV/DPDK) and it has been consistently failing... i was wondering if this continues what we need to do considering today being the last day. | 09:19 |
| *** limao has joined #tripleo | 09:22 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Fix check of rpm-python. https://review.openstack.org/357022 | 09:23 |
| *** chem has quit IRC | 09:34 | |
| *** chem has joined #tripleo | 09:35 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Handle galera_node_names being an array https://review.openstack.org/362046 | 09:37 |
| shardy | vijaykc4: do you have a link to the failing patches please? | 09:40 |
| shardy | vijaykc4: if patches don't land due to CI issues they will most likely be considered valid feature freeze exceptions | 09:40 |
| jaosorior_lunch | seems to me like some merrors are having issues for some reason | 09:41 |
| vijaykc4 | shardy, https://review.openstack.org/#/c/327705/ https://review.openstack.org/#/c/361430/ | 09:41 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Inject CA certificate via service profile https://review.openstack.org/357791 | 09:41 |
| jaosorior_lunch | shardy: what are the requirements for applying for an FFE? I want to submit the TLS work as an FFE, but I haven't finished all the patches (some depend on the composable roles work... somewhat) | 09:42 |
| *** jaosorior_lunch is now known as jaosorior | 09:42 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Conditionally expose haproxy endpoints https://review.openstack.org/359645 | 09:42 |
| shardy | jaosorior: I replied to your ML question, did you see my response? | 09:42 |
| jaosorior | shardy: ah, let me check that out | 09:42 |
| shardy | jaosorior: basically we've got to balance the risk vs benefit | 09:42 |
| shardy | if a feature is nearly complete and/or low risk I think a FFE is fine | 09:43 |
| *** tosky has joined #tripleo | 09:43 | |
| shardy | if it's large, incomplete and/or risky we have to ensure there's a very strong justification of why we don't defer to ocata | 09:43 |
| jaosorior | shardy: in this case I would say medium. most of the blockers have been worked on. But some composable roles work is still needed before the haproxy parts | 09:43 |
| saneax | shardy, it seems like the failures are on timeout of dismantling the stack? https://paste.fedoraproject.org/417163/50205147/ | 09:44 |
| jistr | yea the nova memory reservation patch went all the way to successful pingtest and then it timed out http://logs.openstack.org/30/361430/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/22f09dc/console.html#_2016-08-30_08_44_09_139301 | 09:44 |
| jistr | just +2'd | 09:44 |
| saneax | shardy, http://logs.openstack.org/05/327705/12/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/6acd1ca/console.html#_2016-08-30_08_52_33_846152 | 09:45 |
| shardy | jaosorior: ack - I think your tls stuff should be a valid FFE, but we really need a mail which clearly enumerates the remaining patches, so we can focus review attention, and help with any remaining WIP pieces | 09:45 |
| saneax | jistr, seems like same issue | 09:45 |
| jaosorior | shardy: alright, will do | 09:46 |
| shardy | saneax: Yeah in that case I think the job hit the infra timeout | 09:47 |
| shardy | lately we've been seeing that a lot, we have to figure out ways to optimize such that the job walltime decreases | 09:48 |
| mandre | d0ugal: remember the mistral workflow to copy SSH keys I told you about yesterday? | 09:48 |
| shardy | for now a recheck is valid, I think provided all jobs pass on some combination of rechecks we can merge the patches | 09:48 |
| mandre | d0ugal: well... it turns out it needs to run at the end of overcloud deploy, because it copies the keys to the overcloud nodes | 09:49 |
| saneax | shardy, doing a once more recheck :) after previous two failure at the same point | 09:50 |
| vijaykc4 | shardy, thanks for the info..one is a samples patch and two T-H-T's (all low risks and good to have patches) i believe if CI continues to fail we should be eligible for FFE. Yes for now we will continue to recheck. | 09:50 |
| shardy | vijaykc4: ack, thanks - I'll definitely support FFEs for anything blocked by CI | 09:51 |
| mandre | d0ugal: I suppose my code woud go there? https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L949 | 09:51 |
| shardy | thanks for your patience, hopefully we can work on a proper fix for these timeouts very soon | 09:51 |
| jaosorior | jistr: hey dude, with the FQDN stuff that landed, I made a profile to add those VIP hostnames to /etc/hosts in the nodes. Can you check it out? https://review.openstack.org/#/c/357765/ | 09:51 |
| vijaykc4 | shardy, JFYI these are the three patches, https://review.openstack.org/#/c/327705/ , https://review.openstack.org/#/c/361430/ and https://review.openstack.org/#/c/361238/ Thanks for your inputs and hopefully we can close them today. | 09:55 |
| *** vijaykc4 has quit IRC | 09:57 | |
| d0ugal | mandre: I would rather it was part of the overcloud deploy workflow, we don't want more logic in the CLI. | 09:57 |
| d0ugal | mandre: Is there a way we can automatically detect if validations have been enabled? | 09:57 |
| mandre | d0ugal: there is an enable_validations hiera key | 09:59 |
| mandre | can we easily retrieve the value from the workflow? | 09:59 |
| *** nyechiel has joined #tripleo | 10:01 | |
| *** vijaykc4 has joined #tripleo | 10:02 | |
| d0ugal | mandre: good question, I guess so, but I am not sure. | 10:03 |
| mandre | d0ugal: it might require a custom mistral action | 10:03 |
| *** r2bit__ is now known as r2bit | 10:03 | |
| *** r2bit has quit IRC | 10:04 | |
| *** r2bit has joined #tripleo | 10:04 | |
| d0ugal | mandre: Yeah, it will, I think | 10:04 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add HAProxy TLS handled by certmonger as composable service https://review.openstack.org/356430 | 10:07 |
| *** akrivoka has joined #tripleo | 10:07 | |
| openstackgerrit | Merged openstack/tripleo-validations: Added check for keystone token_flush cronjob. https://review.openstack.org/355557 | 10:07 |
| dtantsur | folks, https://review.openstack.org/#/c/361165/ passed both gates in several attempts, could you please merge it? | 10:08 |
| mandre | d0ugal: we're talking about the deploy_plan workflow, right? | 10:08 |
| dtantsur | otherwise future changes in puppet might break tripleo | 10:09 |
| shardy | dtantsur: +2, I agree I think we can probably merge it | 10:11 |
| dtantsur | thanks! | 10:12 |
| *** ebarrera has joined #tripleo | 10:13 | |
| d0ugal | mandre: Yeah, but we have not really added anything optional to it yet so it would be good to have a discussion with a few folks about it | 10:13 |
| d0ugal | mandre: rbrady is looking at adding something else optional that is based on shardy's work: https://review.openstack.org/#/c/362465/ | 10:14 |
| dtantsur | actually, we're delaying https://review.openstack.org/#/c/359138/ because otherwise it'll break tripleo | 10:14 |
| *** vijaykc4 has quit IRC | 10:16 | |
| *** paramite|cell has quit IRC | 10:17 | |
| d0ugal | mandre: (that linked patch is integrating in the process templates action which is called at deploy time btw) | 10:18 |
| d0ugal | mandre: I'd expect for your integration, you would want a new action that is triggered in the deploy workflow. | 10:18 |
| *** HoloIRCUser4 has joined #tripleo | 10:18 | |
| *** adarazs is now known as adarazs_lunch | 10:19 | |
| *** vijaykc4 has joined #tripleo | 10:20 | |
| *** HoloIRCUser6 has joined #tripleo | 10:21 | |
| *** vijaykc4 has quit IRC | 10:21 | |
| *** HoloIRCUser7 has joined #tripleo | 10:22 | |
| *** HoloIRCUser6 has quit IRC | 10:22 | |
| *** HoloIRCUser6 has joined #tripleo | 10:23 | |
| *** HoloIRCUser7 has quit IRC | 10:23 | |
| *** ebarrera has quit IRC | 10:23 | |
| *** HoloIRCUser6 has quit IRC | 10:24 | |
| *** limao has quit IRC | 10:24 | |
| *** HoloIRCUser8 has joined #tripleo | 10:24 | |
| *** HoloIRCUser4 has quit IRC | 10:25 | |
| *** HoloIRCUser6 has joined #tripleo | 10:25 | |
| *** HoloIRCUser8 has quit IRC | 10:26 | |
| *** HoloIRCUser4 has joined #tripleo | 10:26 | |
| *** HoloIRCUser6 has quit IRC | 10:26 | |
| *** apetrich has quit IRC | 10:28 | |
| *** HoloIRCUser4 has quit IRC | 10:29 | |
| *** HoloIRCUser4 has joined #tripleo | 10:30 | |
| d0ugal | shardy: Hey | 10:31 |
| *** paramite has quit IRC | 10:31 | |
| jaosorior | d0ugal: hey dude, trying to review https://review.openstack.org/#/c/360305/19 but am I bit confused about the plan deploy | 10:32 |
| jaosorior | what's up with that? | 10:32 |
| d0ugal | jaosorior: So, with the new Mistral workflows we have plans that are created and stored in swift. Without that command there wont actually be a way to deploy plans from the CLI | 10:33 |
| d0ugal | jaosorior: The current command is being updated to create plans in the fly, but to be backwards compatible it doesn't really follow the workflow. | 10:33 |
| *** HoloIRCUser4 has quit IRC | 10:33 | |
| *** HoloIRCUser6 has joined #tripleo | 10:33 | |
| jaosorior | d0ugal: wasn't plan the old term used for tuskar? | 10:34 |
| d0ugal | jaosorior: Yeah, it's back. | 10:34 |
| d0ugal | jtomasek: You use "plan" in the GUI, right? | 10:34 |
| dtantsur | jaosorior, hey! when you have a second, mind reviewing https://review.openstack.org/#/c/361165/ please? it's small and actually passed both gates (in 2 attempts) | 10:35 |
| jaosorior | d0ugal: I think that since that term was being used before, it's quite confusing... so, either another term should be used. Or more documentation should be added | 10:35 |
| jaosorior | dtantsur: sure thing. Just one question there. Weren't we using the pxe element still? seems like this stuff should go alongside the deletion of that element, no | 10:35 |
| jaosorior | ? | 10:35 |
| d0ugal | jaosorior: Okay, I guess we will need to go with more documentation. Changing it now is probably a non-starter. I have started some related documentation here but I probably need to tell people what a plan is. https://review.openstack.org/358685 | 10:36 |
| jtomasek | d0ugal: yes | 10:36 |
| dtantsur | jaosorior, no, these are not related. this is only for ironic.conf, and pxe element is for building the actual environment | 10:36 |
| jaosorior | dtantsur: got it | 10:36 |
| *** HoloIRCUser8 has joined #tripleo | 10:36 | |
| d0ugal | jtomasek: phew, just a sanity check, thanks :) | 10:36 |
| *** apetrich has joined #tripleo | 10:37 | |
| jaosorior | d0ugal: I'm fine if it's just more documentation | 10:37 |
| jtomasek | d0ugal: we call it deployment plan | 10:37 |
| d0ugal | jtomasek: That is a long name for the CLI :) but maybe we should have used it... | 10:38 |
| jaosorior | so... these new plans in CLI are the same as deployment plans in UI? | 10:38 |
| jtomasek | jaosorior: yes | 10:39 |
| jaosorior | sorry for the basic questions, things got confusing terms-wise | 10:39 |
| jtomasek | jaosorior: the general reason is that gui can't operate with files in the filesystem, so a plan resembles to a set of templates | 10:39 |
| d0ugal | jaosorior: Thanks! | 10:40 |
| *** HoloIRCUser9 has joined #tripleo | 10:40 | |
| *** HoloIRCUser6 has quit IRC | 10:40 | |
| jaosorior | d0ugal: I would really suggest you write a blog post or something of the sort with the ideas behind the mistral work | 10:41 |
| jaosorior | d0ugal: that way it'll be easier for folks to review | 10:41 |
| d0ugal | jaosorior: Sure, I guess it is best wrapped up in the spec at the moment. Adding something that is updated and relevant now to the tripleo-docs would be a good idea. | 10:42 |
| jaosorior | that would be good too | 10:42 |
| d0ugal | jaosorior: Once people stop me landing code for N I'll move my focus to documentation :) | 10:43 |
| jaosorior | gfidente: ping | 10:43 |
| *** HoloIRCUser8 has quit IRC | 10:43 | |
| *** ebarrera has joined #tripleo | 10:45 | |
| mcornea | jaosorior: https://review.openstack.org/#/c/355366 looked good in my testing | 10:46 |
| jaosorior | mcornea: thanks dude! | 10:46 |
| gfidente | jaosorior, pong | 10:47 |
| gfidente | jistr, think I found the issue in https://review.openstack.org/#/c/355067/ | 10:48 |
| jaosorior | gfidente: Hey dude, can you check out again the commit adding the VIP hosts to /etc/hosts? https://review.openstack.org/#/c/357765/ | 10:50 |
| jaosorior | gfidente: I'm still unsure if we should have that enabled by default or just enable it via an environment file | 10:50 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Move ceph cluster config out of allNodesConfig https://review.openstack.org/355067 | 10:52 |
| gfidente | jaosorior, I think if we can replace the hosts element with that | 10:53 |
| gfidente | we should and we should enable it by default | 10:53 |
| gfidente | but if we can't, or if we can't by the code freeze, then probably not | 10:53 |
| gfidente | and maybe enable it from one of the tls endpoints | 10:53 |
| *** ebarrera has quit IRC | 10:53 | |
| gfidente | to start with, until we can enable it by default when deprecating the hosts element | 10:53 |
| jaosorior | gfidente: I actually don't remember which element was that :/ | 10:56 |
| *** sshnaidm|afk is now known as sshnaidm | 10:56 | |
| *** pkovar has joined #tripleo | 10:57 | |
| *** vijaykc4 has joined #tripleo | 10:59 | |
| *** rhallisey has joined #tripleo | 10:59 | |
| gfidente | jaosorior, I think it's named just hosts | 11:02 |
| jaosorior | gfidente: so, right now the only hosts we set are the ones for the specific nodes. We never set the overcloud VIP hosts | 11:02 |
| jaosorior | gfidente: that's why I tried to introduce that profile | 11:03 |
| gfidente | yeah | 11:03 |
| *** fzdarsky is now known as fzdarsky|lunch | 11:03 | |
| jaosorior | gfidente: I guess it wouldn't be too hard to get the other hosts on another profile too | 11:03 |
| gfidente | but it feels like we don't want competing stuff editing the hosts file | 11:03 |
| jaosorior | gfidente: well, it seems to me that they get ran in different times. Do they're not really competing in that sense | 11:07 |
| *** zoliXXL is now known as zoli|lunch | 11:08 | |
| jistr | jaosorior, gfidente: i wonder how confined the methods are, that is if they just manage individual entries vs. the whole file. I guess puppet would be entry based but not sure about the element | 11:09 |
| jaosorior | jistr: the element gets ran before puppet AFAIK | 11:09 |
| jaosorior | jistr: and puppet is quite entry-based for that resource | 11:10 |
| dtantsur | jistr, hey! that update problem, was it fixed after all? | 11:10 |
| jistr | jaosorior: yea but on stack-update it could destroy the VIP records for a period of time before puppet runs again. Potentially, that is. I'm still not sure if the element actually rewrites the file. | 11:11 |
| * jistr searches | 11:11 | |
| jistr | dtantsur: yup, should be all right, but i'm not sure if it's just in trunk or also in current-tripleo pin | 11:11 |
| *** apetrich has quit IRC | 11:11 | |
| * jaosorior is running an update with the VIP hosts profile right now | 11:11 | |
| dtantsur | ack | 11:12 |
| gfidente | jistr, jaosorior the script is this one https://github.com/openstack/tripleo-image-elements/blob/master/elements/hosts/os-refresh-config/configure.d/51-hosts | 11:12 |
| jaosorior | daaaamn that's some funky bash right there | 11:13 |
| gfidente | jaosorior, yeah and it does get re-run at every os-refresh-config | 11:13 |
| jistr | jaosorior: yea trying to decrypt that :D | 11:14 |
| sshnaidm | does anybody know about keystone db-sync problem? | 11:14 |
| jaosorior | gfidente: it seems to have different paths whether it finds the HEAT_HOSTS_START tag or not | 11:14 |
| jaosorior | sshnaidm: which problem? | 11:14 |
| sshnaidm | AttributeError: 'module' object has no attribute 'RegionInvalidationStrategy' | 11:14 |
| gfidente | I like especially the f=1 part | 11:14 |
| sshnaidm | in undercloud installation | 11:14 |
| jaosorior | sshnaidm: no idea dude. I had other issues with the undercloud related to augeas | 11:15 |
| sshnaidm | jaosorior, and what are they? | 11:15 |
| jaosorior | the augeas call on lvm.conf fails | 11:15 |
| jaosorior | sshnaidm: no logs, it just says it fails | 11:15 |
| sshnaidm | ok | 11:15 |
| jaosorior | sshnaidm: I tried for a LONG time yesterday to get something relevant about that failure and couldn't | 11:16 |
| jaosorior | just makes the install fails and doesn't report anything else :( | 11:16 |
| jaosorior | happens on update for the undercloud | 11:16 |
| sshnaidm | jaosorior, which jobs does it affect? | 11:16 |
| jaosorior | sshnaidm: locally | 11:16 |
| sshnaidm | undercloud update? | 11:16 |
| jaosorior | sshnaidm: no jobs that I know of | 11:16 |
| jaosorior | sshnaidm: yeah | 11:16 |
| sshnaidm | oh, I see | 11:16 |
| jaosorior | sshnaidm: when trying to update to the latest undercloud in current | 11:17 |
| sshnaidm | my errors are in periodic jobs.. | 11:17 |
| jaosorior | sshnaidm: well, it does sound like an actual error in keystone | 11:17 |
| sshnaidm | jaosorior, for example: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha/37fe6d7/logs/undercloud/var/log/undercloud_install.txt.gz#_2016-08-30_06_29_34_000 | 11:18 |
| *** vijaykc4 has quit IRC | 11:18 | |
| *** milan has joined #tripleo | 11:18 | |
| jaosorior | jistr, gfidente: running an update seems to leave things in a pretty good state. I can see the stuff generated by the element like it was before. And the stuff generated by the profile is there too. | 11:18 |
| jaosorior | sshnaidm: yep, looks like an actual keystone issue | 11:19 |
| *** oshvartz has quit IRC | 11:19 | |
| *** ramishra has quit IRC | 11:21 | |
| *** oshvartz has joined #tripleo | 11:21 | |
| jaosorior | gfidente, jistr: Ah... well, at least judging from the code. It seems to me like the element overwrites the whole file every time it gets ran. the reason why I see that the puppet stuff is still there is cause on update it also gets ran; so the file ends up being updated first by the element and afterwards by puppet | 11:22 |
| jaosorior | gfidente: jistr https://github.com/openstack/tripleo-image-elements/blob/master/elements/hosts/os-refresh-config/configure.d/51-hosts#L24 | 11:23 |
| *** ramishra has joined #tripleo | 11:23 | |
| jistr | jaosorior: can you try to write some custom gibberish outside of the HEAT_HOSTS_START/END and see if it gets preserved? | 11:23 |
| jistr | jaosorior: i have a suspicion that yes, it does rewrite the whole file, but it has logic built in that awk madness that preserves everything outside those markers | 11:24 |
| jaosorior | jistr: sure, I can do that. it'll just take a bit cause I'm updating an HA deployment. | 11:24 |
| hewbrocca | awk madness | 11:25 |
| * hewbrocca despairs | 11:25 | |
| *** apetrich has joined #tripleo | 11:25 | |
| * hewbrocca rechecks that it is in fact 2016 | 11:26 | |
| hewbrocca | Yep | 11:26 |
| * hewbrocca looks for a better profession | 11:26 | |
| *** vijaykc4 has joined #tripleo | 11:27 | |
| jaosorior | mcornea: still have that deployment up? | 11:27 |
| mcornea | jaosorior: no but I'm currently redeploying | 11:28 |
| jaosorior | mcornea: if you do an update can you add a host in /etc/hosts to any controller? | 11:29 |
| jaosorior | outside of the HEAT_HOSTS_START/END tags? | 11:29 |
| mcornea | jaosorior: I'll try. fwiw I know this worked in the past | 11:30 |
| jaosorior | mcornea: so the stuff that gets added outside of those tags gets preserved? | 11:31 |
| mcornea | jaosorior: yes, I tried that on mitaka - https://bugzilla.redhat.com/show_bug.cgi?id=1360398#c22 | 11:32 |
| openstack | bugzilla.redhat.com bug 1360398 in rhel-osp-director "In IPv6 deployment cluster fails when 1/2 DNS servers are unreachable" [Urgent,New] - Assigned to athomas | 11:32 |
| jaosorior | jistr, gfidente ^^ | 11:32 |
| openstackgerrit | Merged openstack/tripleo-common: Use Openstack cli instead in order to get the instance status https://review.openstack.org/353996 | 11:32 |
| openstackgerrit | Merged openstack/tripleo-common: Workflows to run validations https://review.openstack.org/353899 | 11:33 |
| openstackgerrit | Merged openstack/python-tripleoclient: Fix doc page for overcloud deploy https://review.openstack.org/358577 | 11:33 |
| openstackgerrit | Merged openstack/instack-undercloud: Handling defaults for pxe_bootfile_name and pxe_config_template moved to puppet https://review.openstack.org/361165 | 11:33 |
| jistr | jaosorior, mcornea, gfidente: well if that survives stack-update then i think we're good | 11:34 |
| jaosorior | gfidente, jistr: so now the question remains. Do you think that profile I added should be default in the overcloud deploy? | 11:35 |
| *** akrivoka has quit IRC | 11:37 | |
| *** thrash|g0ne is now known as thrash | 11:38 | |
| *** oshvartz has quit IRC | 11:39 | |
| *** vijaykc4 has quit IRC | 11:39 | |
| *** maeca1 has joined #tripleo | 11:40 | |
| *** vijaykc4 has joined #tripleo | 11:40 | |
| rbrady | shardy: ping re: j2 | 11:46 |
| *** morazi has joined #tripleo | 11:47 | |
| karthiks | shardy, jaosorior jistr These reviews has +2 and all green in CI. Need your attention. https://review.openstack.org/#/c/327705/ https://review.openstack.org/#/c/361238/ | 11:47 |
| *** lucasagomes is now known as lucas-hungry | 11:47 | |
| *** akrivoka has joined #tripleo | 11:49 | |
| *** adarazs_lunch is now known as adarazs | 11:49 | |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Default haproxy listeners activation on hiera service _enabled https://review.openstack.org/362798 | 11:52 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Generate composable service node_names lists https://review.openstack.org/355068 | 11:53 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Upgrade ceph-osd https://review.openstack.org/357312 | 11:55 |
| *** jayg|g0n3 is now known as jayg | 11:56 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Cleanup haproxy service from explicit services enablement https://review.openstack.org/362800 | 11:56 |
| shardy | rbrady: Hi! | 11:56 |
| shardy | karthiks: thanks, looking | 11:56 |
| karthiks | Thanks shardy gfidente | 11:57 |
| shardy | karthiks: when those two merge, can we declare tripleo-ovs-dpdk complete? | 11:58 |
| rbrady | shardy: I just had a couple of questions...does the result of the jinja template need to be used as the value of the 'template' key in the dict we send to heat for deployment? | 11:59 |
| karthiks | yes shardy ... 1 pending for SRIOV which is still failing on CI | 11:59 |
| jistr | hmm i'm leaning a bit more towards yes... The default deployment sorta assumes that full DNS is not in place anyway, as it writes manual /etc/hosts entries for all the nodes. Seems expectable to me that we'd do it for VIPs too. I wonder if we should fix the default value for CloudName in that case though. | 11:59 |
| shardy | rbrady: basically yes, I wrote it to overcloud.yaml, which would then be read and passed via heatclient by tripleoclient | 12:00 |
| shardy | rbrady: I would like it if we persisted the data as overcloud.yaml in the plan, even if we then pass it directly to heat as well | 12:00 |
| jistr | jaosorior: i think CloudName isn't used by default anywhere, right? We use IPs by default? | 12:00 |
| shardy | as it will help a lot with debugging the j2 template | 12:00 |
| *** jpena is now known as jpena|lunch | 12:00 | |
| *** pkovar has quit IRC | 12:00 | |
| jistr | jaosorior: just trying to think how safe it would be to change the default there | 12:01 |
| shardy | rbrady: my debug cycle with the tripleoclient patch was to start a deployment, then look at the /tmp/.../overcloud.yaml | 12:01 |
| shardy | so we'll need a similar approach with the swift stored plan I think | 12:01 |
| jaosorior | gfidente: don't we have to provide a default here? https://review.openstack.org/#/c/362798/1/manifests/haproxy.pp | 12:01 |
| jaosorior | jistr: well... I actually don't know. That's why I didn't change it | 12:02 |
| *** trown|outtypewww is now known as trown | 12:02 | |
| *** pradk has joined #tripleo | 12:02 | |
| jaosorior | jistr: but then again, it shouldn't be too bad. Don't see it being used in that many places | 12:02 |
| jaosorior | I can try | 12:02 |
| shardy | rbrady: I was thinking, particularly if it simplifies things, that we could just write out overcloud.yaml, then use the existing deployment workflow completely unmodified | 12:02 |
| rbrady | shardy: I think we'll need to. when a plan is created, the capabilities map file is parsed and overcloud.yaml is identified as the root tempate. that template is used for parameters management prior to deployment | 12:02 |
| gfidente | jaosorior, yep it's setting the defaults from l306 | 12:02 |
| shardy | rbrady: ack, can we just do the j2 part prior to that step in the workflow? | 12:02 |
| *** pkovar has joined #tripleo | 12:03 | |
| gfidente | I want to add the ceph_rgw listener, that's why I am changing that | 12:03 |
| rbrady | shardy: that's the path I started on after your email, but I'm just looking where it needs to happen at this point | 12:03 |
| shardy | I can imagine this being a pretty early step, e.g the first thing a custom-roles aware UI would do is ask for the list of role names I think | 12:03 |
| jaosorior | gfidente: right now you can do it in puppet/services/haproxy.yaml that already takes those hiera parameters | 12:03 |
| shardy | jtomasek: ^^ FYI | 12:03 |
| jaosorior | gfidente: but shouldn't it be hiera('keystone_enabled', false) >? | 12:03 |
| rbrady | shardy: is this a one time operation or should there be a way to trigger this N times against a plan? | 12:03 |
| *** jaosorior has quit IRC | 12:04 | |
| shardy | rbrady: I think we'll need to allow re-running it, as folks might want to add a new role to an existing deployment | 12:04 |
| shardy | rbrady: the way I wired it into tripleoclient, we'd just run it every time "openstack overcloud deploy" was run | 12:05 |
| *** jaosorior has joined #tripleo | 12:05 | |
| shardy | so we probably need similar behavior via mistral I think | 12:05 |
| gfidente | jaosorior, oh a default for the hiera calls, better to have it yes, I'll do it | 12:05 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Change CloudName default value to include domain https://review.openstack.org/362806 | 12:05 |
| shardy | if the roles_data is unchanged, we'll just write out an identical overcloudl.yaml | 12:05 |
| jaosorior | jistr: ^^ | 12:05 |
| *** fultonj has joined #tripleo | 12:06 | |
| *** mat128 has joined #tripleo | 12:07 | |
| shardy | rbrady: so, I think that means store-plan -> optionally update roles_data -> j2 templating -> <normal deploy workflow> | 12:07 |
| mat128 | good morning TripleO | 12:07 |
| *** ebarrera has joined #tripleo | 12:07 | |
| jaosorior | jistr, gfidente: by the way, can you guys check that out? That sets the ports from haproxy to be configured by the endpoint map | 12:07 |
| shardy | good morning mat128 | 12:07 |
| *** rlandy has joined #tripleo | 12:08 | |
| mat128 | I've seen a TripleO failure that didnt "fail" my build, but I still wanted to act on it. | 12:08 |
| mat128 | http://logs.openstack.org/47/360547/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/1f83412/logs/undercloud/var/log/undercloud_install.txt.gz#_2016-08-29_23_07_01_000 | 12:08 |
| gfidente | jaosorior, which one? | 12:08 |
| jaosorior | gfidente, jistr: https://review.openstack.org/#/c/355366/ | 12:08 |
| rbrady | shardy: yep. thanks. I've separated the code into its own action again and now looking where to trigger. we don't provide a means to update a plan, that is done directly through swift, yet I find myself now wanting some sort of post update trigger when plan files are changed | 12:09 |
| * jtomasek reads back | 12:09 | |
| EmilienM | hello | 12:09 |
| shardy | rbrady: Yeah, I guess for now we can just say "optionally update roles_data" is a no-op, and later we can wire in pushing a modified yaml file into the plan | 12:10 |
| shardy | should be easy enough to do directly via swift in the meantime? | 12:10 |
| *** akuznetsov has quit IRC | 12:11 | |
| *** jaosorior has quit IRC | 12:11 | |
| *** mhenkel has quit IRC | 12:11 | |
| *** akuznetsov has joined #tripleo | 12:11 | |
| rbrady | shardy: I'm thinking we have a AfterPlanUpdateAction that will need to be called manually at the moment via run-action or creating an execution | 12:12 |
| *** jaosorior has joined #tripleo | 12:12 | |
| shardy | rbrady: Ok, sounds good, either wfm | 12:12 |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Default haproxy listeners activation on hiera service _enabled https://review.openstack.org/362798 | 12:13 |
| jtomasek | rbrady: so that action is going to be called as part of the plan creation, right? | 12:13 |
| jistr | jaosorior: is there a matching puppet-tripleo change or not yet? | 12:13 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: test periodic job https://review.openstack.org/355859 | 12:13 |
| jtomasek | florianf: create plan is called as an action now in GUI? | 12:13 |
| jaosorior | jistr: for what? | 12:13 |
| rbrady | shardy: unless there is some piece of swift middleware that sends zaqar notifications in the event of container or object updates :) | 12:13 |
| jistr | jaosorior: for the haproxy endpoint settings. Or it doesn't need one? | 12:13 |
| jaosorior | jistr: it doesn't need one | 12:14 |
| jaosorior | jistr: the interface has been there for a while. It was just never used | 12:14 |
| karthiks | EmilienM, gfidente jaosorior jistr bnemec Could you please have a look at the only outstanding patch for DPDK :) . Please do the honors !!!! https://review.openstack.org/#/c/361238/ | 12:14 |
| rbrady | jtomasek: yeah, I'll have it run in the CreatePlanAction. If you update files, you will need to call AfterUpdatePlanAction directly | 12:15 |
| jtomasek | rbrady: ack | 12:15 |
| jtomasek | rbrady: sounds good | 12:15 |
| *** masco has quit IRC | 12:15 | |
| *** akuznetsov has quit IRC | 12:16 | |
| jtomasek | shardy, rbrady: so the custom roles work is almost done? | 12:16 |
| karthiks | Thanks EmilienM jaosorior !!! | 12:17 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Replace ssh public key for sshnaidm https://review.openstack.org/362814 | 12:17 |
| sshnaidm | derekh, hi | 12:17 |
| shardy | jtomasek: it's getting closer, and wiring this in via mistral is a key part of completing it | 12:17 |
| jtomasek | ack | 12:17 |
| shardy | karthiks: great, can you please update the implementation status of the blueprint when the patches merge? | 12:18 |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Add Ceph RGW listener to HAProxy https://review.openstack.org/362816 | 12:18 |
| jtomasek | rbrady: roles listing patch will then get updated to accommodate that, right? | 12:18 |
| karthiks | Sure shardy . | 12:18 |
| shardy | jtomasek: yes | 12:19 |
| jtomasek | shardy: does Heat send any zaqar messages when deployment is in progress? | 12:19 |
| shardy | the current roles listing patch will actually still work provided it runs after the j2 templating is completed | 12:19 |
| jtomasek | shardy: good point | 12:19 |
| rbrady | jtomasek, shardy: it should work without changes for now | 12:20 |
| shardy | jtomasek: You can define an event sink in the environment file, then all events can be sent to a zaqar queue | 12:20 |
| shardy | I don't think we currently do that though | 12:20 |
| shardy | http://docs.openstack.org/developer/heat/template_guide/environment.html#retrieving-events | 12:20 |
| jtomasek | shardy: ok, seems like we'll use polling for that for now | 12:20 |
| shardy | jtomasek: Yeah, but we should look at moving away from polling when possible | 12:21 |
| florianf | jtomasek: no, create plan is called as a workflow. list_plans is called as an action | 12:22 |
| jtomasek | shardy: yes, definitely something to discuss on the summit (or earlier) afaik, the deployment workflow is not able to run the whole time the deployment is in progress | 12:23 |
| shardy | jtomasek: Yeah, we risk hitting a token timeout because mistral can't yet reauthenticate via trusts | 12:24 |
| shardy | jtomasek: can't we just pass event_sinks to heat and have a queue defined to recieve the events from heat? | 12:24 |
| florianf | jtomasek: I wasn't aware, it was available as an action. Should change that in the UI. | 12:24 |
| shardy | seems like a fairly simple alternative to polling, although I've not tested it | 12:24 |
| *** dprince has joined #tripleo | 12:26 | |
| jtomasek | florianf: hold it untill we know that rbrady calls that new jinja processing from the action or as a separate action in plan creation | 12:26 |
| EmilienM | shardy: have you looked yet why ci is not promoted since 1 week? | 12:26 |
| florianf | jtomasek: ok | 12:26 |
| EmilienM | shardy: if not i'll look today | 12:26 |
| *** pkovar has quit IRC | 12:26 | |
| shardy | EmilienM: Not yet, sorry - although ramishra did mention a regression related to deleting stacks in heat which I need to check on | 12:27 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Upgrade ceph-mon https://review.openstack.org/357130 | 12:27 |
| jtomasek | shardy: is that a simple Heat api call to pass the event_sinks? | 12:27 |
| shardy | jtomasek: No it's an environment file you can pass, via the same method we pass all the environments defined e.g in the capabilities map | 12:28 |
| shardy | so we could have environments/ui-events.yaml or something | 12:28 |
| shardy | with a pre-defined queue name | 12:28 |
| *** jdob has joined #tripleo | 12:29 | |
| shardy | The only gotcha is I suspect that interface won't yet support nested events | 12:29 |
| shardy | so we probably can't yet switch the CLI over to use it | 12:29 |
| EmilienM | pradk: i'm currently testing gnocchi in tripleo ci | 12:29 |
| jtomasek | shardy: yep, that could work, I am not 100% sure we're able to get it in for newton, but I totally see it as a viable solution for next | 12:29 |
| EmilienM | pradk: https://review.openstack.org/#/c/362505/ and https://review.openstack.org/#/c/362504/ | 12:29 |
| shardy | jtomasek: yup, agreed, probably not high priority until we've got basic functionality proven | 12:30 |
| jtomasek | yeah | 12:30 |
| EmilienM | pradk: it fails to create OS::Aodh::GnocchiResourcesAlarm | 12:30 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-incubator: Replace sshnaidm SSH public key https://review.openstack.org/362824 | 12:31 |
| EmilienM | pradk: I see this error http://logs.openstack.org/05/362505/2/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-nv/ad71d22/logs/subnode-2/var/log/gnocchi/app.txt.gz | 12:31 |
| EmilienM | pradk: have you seen that before? | 12:31 |
| pradk | EmilienM, sounds like its not able to talk to redis | 12:31 |
| EmilienM | pradk: right | 12:32 |
| thrash | d0ugal: was testing out 'overcloud plan create', and it just kinda hung there. | 12:32 |
| EmilienM | pradk: have you tried gnocchi using tripleo before? | 12:32 |
| *** zoli|lunch is now known as zoli|wfh | 12:32 | |
| EmilienM | pradk: it sounds like it does not work | 12:32 |
| thrash | d0ugal: I looked at the mistral executions, and the plan create was stuck in error, and it looked like a zaqar error. | 12:32 |
| pradk | EmilienM, yep and it works | 12:32 |
| thrash | d0ugal: I was trying to use a custom template dir. | 12:32 |
| EmilienM | pradk: ok good I hope I did a mistake in my templates | 12:32 |
| pradk | EmilienM, we even QA'ed and shipped in mitaka.. dont say it doesnt work :) | 12:32 |
| EmilienM | pradk: can you review the patch when you have time? | 12:33 |
| jistr | jaosorior, gfidente: +2'd the CloudName default change, it's only used from the tls-dns env file, and i'd assume if someone uses that, they're also feeding their own CloudName based on their DNS settings | 12:33 |
| pradk | EmilienM, hehe sure i'll take a look.. perhaps we have some regression from composable roles work | 12:33 |
| thrash | d0ugal: point being, I'm not sure it ever noticed the error. | 12:33 |
| EmilienM | pradk: https://review.openstack.org/#/c/362504/ | 12:33 |
| EmilienM | pradk: specially https://review.openstack.org/#/c/362504/2/test-environments/scenario001-multinode.yaml | 12:33 |
| shardy | mat128: Thanks for the info, I'll raise a bug as it seems like an issue with the testenv nic numbering, similar to a problem we fixed recently for the multinode job | 12:34 |
| mat128 | cool :), didnt know what to do with it | 12:34 |
| mat128 | thanks for your help | 12:34 |
| shardy | mat128: I raised https://bugs.launchpad.net/tripleo/+bug/1618441 | 12:36 |
| openstack | Launchpad bug 1618441 in tripleo "ovb job fails to find eth1 nic" [Undecided,New] | 12:36 |
| jaosorior | jistr: :D | 12:36 |
| d0ugal | thrash: hrm, intersting. I am not sure how we handle that, if we never recieve messages on the zaqar queue, what do we do? | 12:37 |
| thrash | d0ugal: timeout perhaps? | 12:37 |
| d0ugal | thrash: I guess a sensible timeout per command could work. Plan create is quick, some things could be slow. | 12:37 |
| thrash | :) | 12:37 |
| d0ugal | thrash: Yeah, okay, I guess this is an issue with all the merged commands too. Probably need something generic - I'll take a look. | 12:38 |
| thrash | d0ugal: I'll add a comment on the first patch for tracking. | 12:38 |
| d0ugal | thrash: Thanks | 12:38 |
| *** jeckersb_gone is now known as jeckersb | 12:39 | |
| pradk | EmilienM, looking at these logs http://logs.openstack.org/04/362504/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-mitaka/4686f25/logs/overcloud-controller-0/var/log/messages | 12:40 |
| shardy | d0ugal: IME if we don't get the messages for any reason, we hang forever, so a timeout is definitely something we need to investigate | 12:40 |
| pradk | EmilienM, i dont see any aodh/gnocchi errors .. i do see some newutron/haproxy errors | 12:40 |
| EmilienM | pradk: wyh | 12:40 |
| pradk | EmilienM, if you see aodh/gnocchi logs the services come up fine and talk to redis | 12:40 |
| EmilienM | pradk: no... | 12:40 |
| EmilienM | wrong logs | 12:41 |
| d0ugal | shardy: +1, I'll look into it | 12:41 |
| EmilienM | pradk: you need to look at https://review.openstack.org/#/c/362505/ | 12:41 |
| pradk | EmilienM, that the ha mitaka job failing | 12:41 |
| EmilienM | pradk: in scenario001 logs | 12:41 |
| *** lucas-hungry is now known as lucasagomes | 12:41 | |
| pradk | <EmilienM> pradk: specially https://review.openstack.org/#/c/362504/2/test-environments/scenario001-multinode.yaml | 12:41 |
| pradk | so looks at logs for that patch | 12:41 |
| d0ugal | shardy: I'm not sure it should block things landing, as it is an issue with the merged CLI workflow calls | 12:41 |
| EmilienM | yes because the scenario001 is only run when we modify telemetry files | 12:42 |
| shardy | d0ugal: Yeah, but we should probably raise a bug to track fixing it (for all commands) before the final release | 12:42 |
| d0ugal | shardy: Yeah, good point. I'll open a bug now. | 12:42 |
| EmilienM | pradk: one sec... i'll explain you how it works | 12:42 |
| EmilienM | pradk: logs are here anysay http://logs.openstack.org/05/362505/2/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-nv/ad71d22/ | 12:42 |
| shardy | d0ugal: please target it at newton-rc1 | 12:42 |
| d0ugal | shardy: will do | 12:43 |
| EmilienM | pradk: https://review.openstack.org/#/c/361433/ please look what im doing in CI | 12:43 |
| EmilienM | pradk: specially https://review.openstack.org/#/c/361433/1/zuul/layout.yaml | 12:43 |
| EmilienM | pradk: now look https://review.openstack.org/#/c/362505/ and why I did this | 12:44 |
| EmilienM | pradk: you got it? | 12:44 |
| pradk | EmilienM, so looking at http://logs.openstack.org/05/362505/2/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-nv/ad71d22/logs/postci.txt.gz | 12:46 |
| pradk | EmilienM, where are the overcloud logs? the stack created successfully.. but dint gather any logs | 12:46 |
| EmilienM | pradk: pingtest failed | 12:47 |
| EmilienM | http://logs.openstack.org/05/362505/2/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-nv/ad71d22/console.html#_2016-08-30_03_33_00_872487 | 12:47 |
| d0ugal | shardy, thrash: FYI https://bugs.launchpad.net/tripleo/+bug/1618445 | 12:47 |
| openstack | Launchpad bug 1618445 in tripleo "Add a timeout in tripleoclient when waiting for Zaqar messages" [High,Confirmed] - Assigned to Dougal Matthews (d0ugal) | 12:47 |
| jaosorior | mcornea, gfidente: is the keystone admin port supposed to be exposed in the external network? | 12:48 |
| *** fzdarsky|lunch is now known as fzdarsky|afk | 12:48 | |
| pradk | EmilienM, right, just trying to understand why you think gnocchi is not working without any log suggesting so | 12:48 |
| EmilienM | pradk: http://logs.openstack.org/05/362505/2/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-nv/ad71d22/console.html#_2016-08-30_03_33_00_840840 | 12:49 |
| EmilienM | pradk: the gnocchi resource alarm is not created | 12:49 |
| gfidente | jaosorior, external | 12:49 |
| jaosorior | gfidente: is it? | 12:49 |
| pradk | EmilienM, k any way to gather logs.. hard to say whats happening without seeing the error | 12:49 |
| gfidente | AFAIK v2 client defaults to the admin endpoint | 12:49 |
| jaosorior | gfidente: or is it supposed to be in the internal? | 12:49 |
| dtantsur | folks, how do you test stuff locally? how do you fight with constant inconsistency between THT (checkout) and puppet on the image? | 12:50 |
| EmilienM | pradk: well the redis error in gnocchi logs looks quite problematic | 12:50 |
| gfidente | dtantsur, if you need to pull updates in THT, the only way is to rebuild the overcloud-image too | 12:50 |
| EmilienM | pradk: did you have it in our local tests? | 12:50 |
| dprince | d0ugal: going to try it again today, rebuilding everything instead of just tripleo-common and python-tripleoclient | 12:50 |
| gfidente | dtantsur, or at least that is what I do | 12:50 |
| jaosorior | dtantsur: I recently started using this https://hardysteven.blogspot.fi/2016/08/tripleo-deploy-artifacts-and-puppet.html | 12:51 |
| gfidente | dtantsur, if you need a particular puppet change, then DeployArtifacts | 12:51 |
| d0ugal | dprince: Hey, no need to do that yet - I can confirm your problem :) | 12:51 |
| dprince | d0ugal: oh, you found it then? | 12:51 |
| thrash | d0ugal: I think it's just zaqar being "broken" at that moment. | 12:51 |
| d0ugal | thrash: agreed | 12:51 |
| *** fzdarsky|afk is now known as fzdarsky | 12:52 | |
| d0ugal | dprince: I don't know what the problem is yet - but I have these two test cases, interestingly one works and one doesn't: https://github.com/d0ugal/tripleo-util/tree/master/test-scenarios/network_isolation | 12:52 |
| *** vijaykc4 has quit IRC | 12:52 | |
| pradk | EmilienM, where do you see redis error in this review https://review.openstack.org/#/c/362505/ | 12:52 |
| thrash | d0ugal: but definitely still a problem. :) | 12:52 |
| dtantsur | meh, that's complex.... anyway, thanks jaosorior | 12:52 |
| d0ugal | dprince: (well, the one that works complained about a missing param, but I think that is because I don't have your custom.yaml file) | 12:52 |
| d0ugal | thrash: +1 | 12:52 |
| jaosorior | dtantsur: well, it's a long read but I found it helps out a lot in making developing faster | 12:52 |
| shardy | dtantsur: it's really not complex, I just included a lot of context | 12:52 |
| EmilienM | pradk: http://logs.openstack.org/05/362505/2/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-nv/ad71d22/logs/subnode-2/var/log/gnocchi/app.txt.gz | 12:53 |
| shardy | dtantsur: tl;dr tripleo-common/scripts/upload-puppet-modules -d <direcory of modules> | 12:53 |
| d0ugal | dprince: given it changed depending how the paths are passed in, it must be something to do with the merging code - I'll need to dive in and see. | 12:53 |
| d0ugal | dprince: trying to do that now | 12:53 |
| EmilienM | pradk: just read scenario001 logs, like I said. | 12:53 |
| EmilienM | pradk: scenario001 == telemetry scenario | 12:54 |
| dprince | d0ugal: ack, carry on then. Let me know if you need help | 12:54 |
| dprince | d0ugal: my custom.yaml file is just some 'parameter_defaults:' | 12:54 |
| d0ugal | dprince: Can you send me them? Just so I can confirm that it fully works eventually | 12:55 |
| pradk | EmilienM, so its not just gnocchi.. see aodh and ceilometer they cant talk to redis either | 12:55 |
| *** dtrainor has joined #tripleo | 12:55 | |
| pradk | EmilienM, so issue perhaps is that redis is not up | 12:55 |
| pradk | the config for redis looks fine to me | 12:56 |
| pradk | in gnocchi.conf | 12:56 |
| dtantsur | shardy, okie, lemme try | 12:56 |
| pradk | EmilienM, see http://logs.openstack.org/05/362505/2/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-nv/ad71d22/logs/subnode-2/var/log/aodh/evaluator.txt.gz | 12:56 |
| dprince | d0ugal: sent you via email | 12:56 |
| d0ugal | dprince: Thanks | 12:56 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable TLS for keystone admin endpoint. https://review.openstack.org/362853 | 12:57 |
| pradk | EmilienM, similarly ceilo.. http://logs.openstack.org/05/362505/2/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-nv/ad71d22/logs/subnode-2/var/log/ceilometer/central.txt.gz | 12:57 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Implement scenari001, 002 and 003 https://review.openstack.org/362504 | 12:57 |
| pradk | EmilienM, so its not just gnocchi.. redis is not up and hence all services are failing | 12:57 |
| shadower | mandre: I replied to: https://review.openstack.org/#/c/354775/ would appreciate your thoughs when you have a few | 12:57 |
| jaosorior | shardy: by the way, great blog post. That's been really helpful | 12:57 |
| shadower | mandre: it's the openstack-config question with johnbro's patches | 12:58 |
| EmilienM | pradk: ok I'll try to investigate more today though i'm not sure i can | 12:58 |
| pradk | EmilienM, i guess check why redis is not up first | 12:58 |
| pradk | cool, i'll take a look this afternoon as well | 12:58 |
| shardy | jaosorior: thanks :) | 12:58 |
| *** tzumainn has joined #tripleo | 12:58 | |
| *** vijaykc4 has joined #tripleo | 12:59 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Mv Nova, Neutron, Horizon out of controller.yaml https://review.openstack.org/361362 | 12:59 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Mv pacemaker and firewall out of controller https://review.openstack.org/361398 | 12:59 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Move snmp settings into composable services https://review.openstack.org/360062 | 12:59 |
| *** ebarrera has quit IRC | 12:59 | |
| *** jpena|lunch is now known as jpena | 12:59 | |
| EmilienM | pradk: yes lets sync a bit later on this | 13:00 |
| gfidente | jaosorior, I could very well add ceph/rgw specific data in the endpoint map though instead of reusing swift proxy data | 13:00 |
| gfidente | if we don't want to share tcp ports | 13:00 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: configure heat with new authtoken parameters https://review.openstack.org/361409 | 13:03 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: configure Heat with new authtoken parameters https://review.openstack.org/361412 | 13:03 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add NetApp Manila driver integration and tidy up generic https://review.openstack.org/354019 | 13:03 |
| jaosorior | gfidente: well, however you see fit. However, if ceph rgw is a replacement for swift. I think making them mutually exclusive would help avoiding issues. | 13:06 |
| EmilienM | shardy: https://review.openstack.org/362858 | 13:07 |
| mandre | shadower: looking at your config parser module | 13:07 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: Refactor upgrade checks. https://review.openstack.org/357750 | 13:07 |
| shadower | mandre: thanks. I've tested it briefly but it's mostly an illustration of what we could do there | 13:07 |
| thrash | d0ugal: you have any docs/pointers/is it actually ready for 'overcloud plan deploy'? | 13:08 |
| dtantsur | shardy, the same failure... should I specify something explicitly for the uploaded stuff to be used? | 13:08 |
| thrash | d0ugal: got this: http://paste.openstack.org/show/564827/ | 13:08 |
| mandre | shadower: looking good to me | 13:09 |
| *** rodrigods has quit IRC | 13:09 | |
| shardy | dtantsur: No, but you have to be careful of naming, e.g puppet_modules/ironic not puppet_modules/puppet-ironic when cloning | 13:09 |
| *** rodrigods has joined #tripleo | 13:09 | |
| d0ugal | thrash: is what ready? | 13:09 |
| shardy | dtantsur: could that be the problem? | 13:09 |
| thrash | d0ugal: 'overcloud plan deploy' | 13:09 |
| dtantsur | shardy, aha, that's what I missed | 13:09 |
| *** david-lyle has quit IRC | 13:10 | |
| d0ugal | thrash: well, you could deploy normally, then re-deploy it as a plan (to update or delete the stack first for a create) | 13:10 |
| mandre | shadower: I don't think it needs to be any more complex | 13:10 |
| shardy | EmilienM: thanks! | 13:10 |
| d0ugal | thrash: Parameters need to be set manually if you just create an empty plan - there is a patch to improve some of that. https://review.openstack.org/#/c/361440/ | 13:10 |
| *** pgadiya has quit IRC | 13:10 | |
| thrash | d0ugal: that's what I'm missing I think. :) | 13:11 |
| derekh | lucasagomes: the problem with the pyghmi timeouts is something to do with its session handling (and possibly not getting rid of old sessions of of its cache) | 13:11 |
| thrash | d0ugal: looks like it's just those three, so I'll just make an env file with them. | 13:11 |
| d0ugal | thrash: Yeah, based on your error :) but you might be missing passwords etc. too? | 13:11 |
| d0ugal | thrash: cool | 13:12 |
| thrash | d0ugal: already fixed that with a yaml. :) | 13:12 |
| thrash | the passwords. | 13:12 |
| d0ugal | cool | 13:12 |
| derekh | lucasagomes: it looks like it happens any time the source UDP port that was used is one that had been used before (to talk to the same bmc) | 13:12 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add NeutronGlobalPhysnetMtu to neutron-base.yaml https://review.openstack.org/361539 | 13:12 |
| lucasagomes | derekh, yeah, I didn't dig much into it to see. But have you seem it reproduce with ovb ? | 13:12 |
| d0ugal | thrash: FWIW, I done a regular deploy and saved the params so I could quickly do a deploy: https://github.com/d0ugal/tripleo-util/blob/master/mistral-params.json | 13:12 |
| lucasagomes | derekh, a-ha nice finding | 13:12 |
| derekh | lucasagomes: yup, reproducing it here, looking through the code now | 13:13 |
| thrash | d0ugal: ack. | 13:13 |
| thrash | d0ugal: *appears* to be working! :) | 13:13 |
| thrash | just got all the CREATE_IN_PROGRESS messages! \o/ | 13:14 |
| *** vijaykc4 has quit IRC | 13:14 | |
| rbrady | shardy: the jinja template needs to be processed only as jinja or processed first as jinja and then as yaml? | 13:14 |
| *** egafford has joined #tripleo | 13:15 | |
| thrash | d0ugal: stack create failed, but at least the mistral stuff worked. :) | 13:16 |
| d0ugal | thrash: \o/ | 13:16 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 13:16 |
| mandre | EmilienM: earlier with honza we noticed that the apache puppet module was purging the /etc/httpd/conf.d directory | 13:17 |
| EmilienM | mandre: yes | 13:17 |
| mandre | EmilienM: which is annoying since that where the tripleo-ui package puts its configuration :/ | 13:17 |
| EmilienM | i said it yesterday to jaosorior | 13:18 |
| EmilienM | mandre: and like I said its normal | 13:18 |
| jaosorior | EmilienM: I actually said that to honza too | 13:18 |
| EmilienM | puppet manages config that we told it to manage | 13:18 |
| EmilienM | you need to manage ui vhost with puppet | 13:18 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 13:18 |
| EmilienM | like we do with horizon etc | 13:18 |
| *** david-lyle has joined #tripleo | 13:18 | |
| EmilienM | its puppet 101 | 13:18 |
| gfidente | jaosorior, can you check https://review.openstack.org/289027 especially the part with the endpoints and see if I missed anything? | 13:18 |
| EmilienM | puppet ensure manual actions are purged | 13:19 |
| dprince | mandre: is tripleo-ui getting installed with puppet? | 13:19 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 13:19 |
| honza | EmilienM: that's what we figured but wanted to double check | 13:19 |
| mandre | EmilienM: ok, I see... can we ship that configuration file with puppet-tripleo or should it be it's own puppet module? | 13:20 |
| EmilienM | it could be in puppet tripleo | 13:20 |
| EmilienM | tripleo::ui for ex | 13:20 |
| mandre | dprince: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/ui.pp#L20 | 13:20 |
| EmilienM | in theory it should not be in a profile | 13:20 |
| EmilienM | logic should not be in the profile | 13:21 |
| EmilienM | but in a regular class | 13:21 |
| EmilienM | and the class should be called in a profile | 13:21 |
| EmilienM | look at how we do other profiles | 13:21 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 13:21 |
| jaosorior | gfidente: will we need a keystone endpoint for ceph rgw? | 13:21 |
| *** cdearborn has joined #tripleo | 13:22 | |
| gfidente | jaosorior, it does need one as it's public facing service replacing swiftproxy | 13:22 |
| jaosorior | gfidente: where is that created? | 13:22 |
| gfidente | jaosorior, but it should be of object-store type | 13:22 |
| mandre | EmilienM: perfect, will give it a try, thanks | 13:22 |
| EmilienM | yw | 13:22 |
| openstackgerrit | Merged openstack/tripleo-specs: Specification for tripleo-lldp-validation blueprint https://review.openstack.org/329203 | 13:23 |
| Jokke_ | shardy: https://blueprints.launchpad.net/tripleo/+spec/manila-cephfs-integration | 13:23 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add NetApp Manila driver integration and tidy up generic https://review.openstack.org/354019 | 13:23 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: IGNORE - testing manila-generic deploy after tidyup https://review.openstack.org/362866 | 13:23 |
| gfidente | jaosorior, either we use swift::keystone::auth | 13:24 |
| *** mhenkel has joined #tripleo | 13:25 | |
| gfidente | or I'll have to copy that into puppet-ceph | 13:25 |
| *** lblanchard has joined #tripleo | 13:25 | |
| gfidente | jaosorior, and I think I'll have to copy it to accomodate a slightly different endpoint url | 13:26 |
| gfidente | $hit :) | 13:26 |
| EmilienM | rbrady, dprince: do you guys know when mistral will switch to modern keystone authtoken parameters? https://github.com/openstack/mistral/blob/c2424d6ccedc6d8a4448d78612a82521472443e1/mistral/utils/openstack/keystone.py | 13:26 |
| dprince | EmilienM: when you push a patch for it :) | 13:27 |
| rbrady | EmillienM: I don't know of any planned efforts to change that currently in mistral. | 13:27 |
| EmilienM | rbrady, dprince: in mistral.conf it's still old keystone params | 13:27 |
| dprince | EmilienM: not sure what the plans are for that... | 13:27 |
| EmilienM | dprince: ok asking because it's one of the last projects in OpenStack that does it | 13:28 |
| rbrady | EmillienM: maybe we can get that into the planning for O-1 | 13:28 |
| EmilienM | dprince: context https://bugs.launchpad.net/puppet-aodh/+bug/1604463/ | 13:28 |
| openstack | Launchpad bug 1604463 in puppet-swift "Modules should use keystone::resource::authtoken to configure keystone_authtoken settings" [Medium,Fix committed] - Assigned to Iury Gregory Melo Ferreira (iurygregory) | 13:28 |
| dprince | rbrady: no need to plan it I think, just do it | 13:28 |
| d0ugal | EmilienM: I think there is a bug for it somewhere, but I don't know of anyone actually working on it. | 13:28 |
| EmilienM | d0ugal: ack | 13:28 |
| jaosorior | gfidente: well, you need to set up the keystone::auth stuff in that case | 13:31 |
| *** pkovar has joined #tripleo | 13:31 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: oooq undercloud install https://review.openstack.org/358919 | 13:32 |
| gfidente | jaosorior, yeah | 13:32 |
| lucasagomes | derekh, yeah if I send a lot of ipmi commands quickly I can reproduce the problem http://paste.openstack.org/show/564834/ | 13:32 |
| gfidente | working on it right now | 13:32 |
| lucasagomes | derekh, (that's running with virtualbmc) | 13:32 |
| derekh | lucasagomes: try this first to limit the source port allocation | 13:33 |
| derekh | lucasagomes: echo "32768 32777" | sudo tee /proc/sys/net/ipv4/ip_local_port_range | 13:33 |
| derekh | lucasagomes: you'll reproduce it a lot faster | 13:33 |
| lucasagomes | derekh, ty, will do | 13:33 |
| *** jeckersb is now known as jeckersb_gone | 13:34 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 13:35 |
| *** jeckersb_gone is now known as jeckersb | 13:37 | |
| rook | beagles curious, why do we ship with two "default" | 13:38 |
| rook | security-groups? | 13:38 |
| beagles | rook: in overcloud? | 13:38 |
| beagles | rook, or undercloud? but to answer your question - I don't know off hand but now I'm curious too :) | 13:39 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: oooq undercloud install https://review.openstack.org/358919 | 13:39 |
| rook | yup overcloud | 13:39 |
| rbrady | dprince: guess it depends if you're trying to work in an organized sprint | 13:40 |
| rook | https://gist.github.com/jtaleric/11a0429695286dc539ddc6a62b5649d1 | 13:40 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Migrate to using osc-lib https://review.openstack.org/335460 | 13:40 |
| rook | dprince if you have a newton cloud, do you have two Default sec-groups? | 13:40 |
| dprince | rbrady: I always "sprint" man :) | 13:41 |
| dprince | rbrady: spinning up one now, I will look in a bit | 13:41 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Use relative paths in ci-scripts for quickstart.sh https://review.openstack.org/360649 | 13:41 |
| d0ugal | dprince: daily sprints! That sounds super agile! | 13:42 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Use relative paths in ci-scripts for quickstart.sh https://review.openstack.org/360649 | 13:42 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Document Third Party CI and developer usage https://review.openstack.org/360007 | 13:44 |
| *** fultonj has quit IRC | 13:44 | |
| *** fultonj has joined #tripleo | 13:46 | |
| *** mcornea has quit IRC | 13:47 | |
| openstackgerrit | John Browning proposed openstack/tripleo-validations: Added check for ceilometerdb size https://review.openstack.org/354775 | 13:47 |
| openstackgerrit | John Browning proposed openstack/tripleo-validations: Added check for ceilometerdb size https://review.openstack.org/354775 | 13:48 |
| *** ayoung has joined #tripleo | 13:52 | |
| *** liverpooler has quit IRC | 13:53 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: [WIP] Wire in jinja templating for custom roles https://review.openstack.org/362465 | 13:54 |
| *** ebarrera has joined #tripleo | 13:55 | |
| dtantsur | #openstack-meeting-alt | 13:55 |
| dtantsur | oops | 13:55 |
| d0ugal | yes, We should all go there :) | 13:55 |
| shardy | Good reminder dtantsur ;) | 13:55 |
| shardy | meeting is in 5mins | 13:55 |
| *** yamahata has joined #tripleo | 13:57 | |
| *** myoung|afk is now known as myoung | 14:00 | |
| *** jprovazn has quit IRC | 14:01 | |
| *** pkovar has quit IRC | 14:01 | |
| openstackgerrit | John Browning proposed openstack/tripleo-validations: Added check for ceilometerdb size https://review.openstack.org/354775 | 14:02 |
| *** mcornea has joined #tripleo | 14:02 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 14:04 |
| *** jcoufal has joined #tripleo | 14:06 | |
| openstackgerrit | John Browning proposed openstack/tripleo-validations: Added check for ceilometerdb size https://review.openstack.org/354775 | 14:07 |
| openstackgerrit | Babu Shanmugam proposed openstack/tripleo-heat-templates: OVN heat templates https://review.openstack.org/307734 | 14:08 |
| *** jprovazn has joined #tripleo | 14:09 | |
| jaosorior | gfidente: why not just reuse swift::keystone::auth? | 14:10 |
| gfidente | jaosorior, I think we could yes | 14:11 |
| gfidente | I am not sure what level of separation we should have amongst the two | 14:11 |
| gfidente | and where to draw the line | 14:11 |
| larsks | EmilienM: you mentioned that puppet/{compute,controller}.yaml are going away. With what are they being replaced? | 14:11 |
| EmilienM | larsks: tripleo meeting right now | 14:12 |
| larsks | EmilienM: okay. Whenever you have time... | 14:12 |
| *** chem has quit IRC | 14:13 | |
| *** chem has joined #tripleo | 14:13 | |
| *** ebalduf has joined #tripleo | 14:14 | |
| openstackgerrit | Jeff Peeler proposed openstack/tripleo-common: Add List Roles Action https://review.openstack.org/330283 | 14:14 |
| gfidente | jaosorior, but swift::keystone::auth is pulling in some swift::deps | 14:14 |
| jaosorior | gfidente: alright, then it's fine to have the specific one | 14:15 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: [NO MERGE] Test Ceph RadosGW as replacement for Swift https://review.openstack.org/357182 | 14:16 |
| gfidente | though it currently depends on two different puppet-tripleo changes I should stack up | 14:18 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add NetApp Manila driver integration and tidy up generic https://review.openstack.org/354019 | 14:18 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for keystone https://review.openstack.org/327029 | 14:19 |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Add Ceph RGW listener to HAProxy https://review.openstack.org/362816 | 14:19 |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Add Ceph RGW profile https://review.openstack.org/334081 | 14:21 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 14:22 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Split additional features across the periodic jobs https://review.openstack.org/362904 | 14:23 |
| *** vijaykc4 has joined #tripleo | 14:24 | |
| *** tosky has quit IRC | 14:25 | |
| beagles | dprince, I owe you a beer for this MTU thing - I also need to adapt my MO to vary my what network environment's I deploy with | 14:25 |
| larsks | dprince: in https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller.yaml#L394, shouldn't that be bootstrap_nodeid, rather than bootstack_nodeid? | 14:26 |
| *** tosky has joined #tripleo | 14:27 | |
| *** jprovazn has quit IRC | 14:27 | |
| dprince | beagles: thanks for having a look and digging into it | 14:28 |
| *** jprovazn has joined #tripleo | 14:28 | |
| *** vijaykc4 has quit IRC | 14:28 | |
| *** dtantsur is now known as dtantsur|mtg | 14:28 | |
| dprince | larsks: bootstack is the right one | 14:28 |
| larsks | dprince: huh, okay. because there also exists bootstrap_ in other places, so I was confused. | 14:28 |
| dprince | larsks: a legacy thing... we might be weening off of it. I haven't checked. but bootstack was a thing at one point | 14:28 |
| larsks | dprince: as long as you're here, can you point me at any info (reviews?) about what will be happening to puppet/{controller,compute}.yaml? I hear they are going away... | 14:29 |
| *** ppradhan has joined #tripleo | 14:33 | |
| dprince | larsks: rbrady and shardy are working on it. Look for there incoming patches regarding jinja templating within the Mistral workflows | 14:33 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-common: Fix upload-swift-artifacts work new OSclient https://review.openstack.org/362915 | 14:35 |
| jaosorior | EmilienM: where is the keystone URL set for the provider that does the endpoints and all that stuff? | 14:35 |
| EmilienM | its tripleo meeting now FYI | 14:36 |
| rbrady | larsks: writing a test for this now to remove the WIP flag https://review.openstack.org/#/c/362465/ | 14:36 |
| adarazs | pabelanger: I don't see that we break anything there by the 'rdo-ci-check' behavior. -- we're not triggering by default so we don't need recheck support either for now IMO. | 14:36 |
| adarazs | pabelanger: of course if we would start to trigger on all patchsets uploaded we'd add recheck and remove this extra codeword. | 14:37 |
| sshnaidm | EmilienM, can you please to update the bug with patch number, in your time? I'll close it then: https://bugs.launchpad.net/tripleo/+bug/1618418 | 14:38 |
| openstack | Launchpad bug 1618418 in tripleo "CI: periodic jobs fail on undercloud install because "AttributeError: 'module' object has no attribute 'RegionInvalidationStrategy'"" [High,Triaged] | 14:38 |
| pabelanger | adarazs: The reason is, we don't want to run per 3rd party CI on patches in review.openstack.org. Other wise, people can just abuse the command and keep rechecking a broken 3rdparty CI system until it is green | 14:39 |
| *** jprovazn has quit IRC | 14:39 | |
| pabelanger | as such, we only support recheck systax | 14:40 |
| pabelanger | syntax* | 14:40 |
| *** cdearborn has quit IRC | 14:40 | |
| pabelanger | and this is outlined in the requirements: http://docs.openstack.org/infra/system-config/third_party.html#requirements | 14:40 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Replace ssh public key for sshnaidm https://review.openstack.org/362814 | 14:41 |
| *** cdearborn has joined #tripleo | 14:41 | |
| adarazs | pabelanger: I understand the reasoning, but we're not even voting on anything for now. you can think of it as a demo mode. would love to have some jobs that will actually vote and then we can conform to the standard. | 14:41 |
| pabelanger | adarazs: unfortunately this is how the process works today. And how openstack-infra requires 3rd party CI system to work. | 14:42 |
| pabelanger | If you think the policy should change, I encourage to raise a topic in #openstack-infra IRC or mailing list | 14:43 |
| *** david-lyle has quit IRC | 14:43 | |
| adarazs | pabelanger: I don't see how this break anything by having an undocumented magic word that some developer can use to test their change against our latest RDO images/testing images. it doesn't trigger normally, it doesn't vote, it's only enabled for a few selected repos. | 14:44 |
| adarazs | pabelanger: I can't enable it on any repo normally because it will crush our CI system if it runs on all changes for now. | 14:44 |
| *** jaosorior is now known as jaosorior_away | 14:45 | |
| *** david-lyle has joined #tripleo | 14:48 | |
| adarazs | pabelanger: I showed that we have this kind of functionality on the meeting just so that people can actually use the method, with maybe more resources than we have on centos ci currently :) | 14:48 |
| pabelanger | adarazs: see https://review.openstack.org/#/c/329049/ | 14:48 |
| *** aufi has quit IRC | 14:49 | |
| pabelanger | First of all third party requirements at the items _every_ third party system has to have in place in order to keep their gerrit account. Failure to implement _all_ requirements risks having your account shut off. Requirements are stable at this point and are not changed lightly. Since I'm the one that does most of the decision making regardling toggling of system accounts and following up with account | 14:49 |
| pabelanger | holders, I consider it a courtesy to be consulted should something actually need to be changed in third party requirements. | 14:49 |
| pabelanger | basically, you run the risk of having your account shut off. I don't know your CI specific issues, and not able to help fix that. However, I encourage you to use recheck systax | 14:50 |
| pabelanger | and, I encourage you to raise your objections in #openstack-infra. Specifically, anteaya and fungi would have more to say on the subject | 14:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-collect-config: Updated from global requirements https://review.openstack.org/350905 | 14:52 |
| openstackgerrit | Merged openstack/tripleo-validations: Added check for ceilometerdb size https://review.openstack.org/354775 | 14:52 |
| adarazs | pabelanger: I really don't see your point. what are you trying to prevent here? yes. it doesn't work like that. but this functionality is in demo mode. we have proper gate jobs on this account for tripleo-quickstart that adheres to the rules completely. otherwise we have a few repos that this magic command works and it does a comment about the results. if I make the jobs silent would that help? | 14:52 |
| adarazs | nobody minds that on those repos that we have this. | 14:53 |
| fungi | yeah, we're generally flexible on ci systems dedicated to specific projects where the team maintaining the ci is the team maintaining the project being tested/commented on | 14:53 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/361875 | 14:53 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 14:54 |
| adarazs | that's pretty much what's happening now /o\ | 14:54 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/361501 | 14:54 |
| fungi | what it comes down to is that if people in charge of the project whose changes are receiving these ci comments object to them, then we convince the ci operator to stop doing that (or we disable their account if we can't track them down quickly enough) | 14:55 |
| *** bana_k has joined #tripleo | 14:55 | |
| fungi | the only other typical case is that if the ci system's comment volume is significant enough to impact performance of our gerrit server (mostly only happens when a system begins looping and responding to its own comments), then we tend to shoot first and ask questions afterward | 14:56 |
| adarazs | yeah, that won't be a problem with the tripleo repos we're testing this CI, to eventually have proper upgrade jobs that the regular infra can't do. | 14:56 |
| saneax | https://review.openstack.org/#/c/361238/ failed on merge (After workflow) - is this something which we need to address? | 14:56 |
| pradk | EmilienM, i think its an issue with redis.. seems like the haproxy config is getting the ping but not ponging back for redis and hence redis is not reachable | 14:57 |
| adarazs | fungi: this seems all reasonable. :) | 14:57 |
| pabelanger | fungi: okay, that is a little different from what anteaya had explained before. There was objections to having pre CI syntax regardless of project | 14:57 |
| EmilienM | pradk: tripleo meeting now | 14:57 |
| fungi | effectively, while the current third-party ci documentation doesn't really get explicit about it, there are two fairly distinct classes of third-party ci... those which are focused on testing a specific project in ways our upstream ci cannot but is run by that project, and those focused on testing integration with some other project or projects who are not in control of the ci | 14:58 |
| *** rajinir has joined #tripleo | 14:58 | |
| fungi | for ci systems operated by a project and only testing repos for that same project, the infra team tends not to get involved in its operation at all | 14:59 |
| marios | shardy: fyi filed https://bugs.launchpad.net/tripleo/+bug/1618479 for manila and added the closes-bug to the tht https://review.openstack.org/#/c/354019 | 14:59 |
| openstack | Launchpad bug 1618479 in tripleo "Add integration for manila-netapp backend" [Undecided,In progress] - Assigned to Marios Andreou (marios-b) | 14:59 |
| shardy | marios: ack, thanks! | 14:59 |
| fungi | however, those are a very small fraction of the overall number of third-party ci systems reporting into our gerrit, so the documentation doesn't really cover them directly | 14:59 |
| saneax | shardy, https://review.openstack.org/#/c/361238/ failed on merge - I havent seen this, any idea why? | 15:00 |
| panda | EmilienM: so you're only creating the jobs definitions for the periodic ha-ipv6 jobs ? | 15:00 |
| pabelanger | fungi: okay, great. So I stand corrected. adarazs you shouldn't have an issue then | 15:00 |
| *** vijaykc4 has joined #tripleo | 15:00 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for keystone https://review.openstack.org/327029 | 15:00 |
| fungi | we're mostly focused on the third-party ci systems operated by hardware vendors doing things like test neutron/cinder/nova/ironic drivers and report on changes to those projects | 15:00 |
| adarazs | fungi, pabelanger: so yeah, these jobs are by tripleo people, for tripleo projects and for now very special cases (when we're trying to fix some bug in the rdo promotion and we want to make sure the specific patch helps), so I think we're okay. | 15:00 |
| shardy | saneax: it depends on https://review.openstack.org/#/c/327705/ (in a series), which failed the gate CI | 15:01 |
| saneax | oh ok shardy, thanks | 15:01 |
| shardy | If you think that failure was spurious, you can use "reverify" to re-run the gate verify jobs | 15:01 |
| adarazs | yeah, we're not trying to do that. :) | 15:01 |
| EmilienM | panda: yes in project config | 15:01 |
| EmilienM | pradk: can you file a bug please? i think its critical | 15:02 |
| pabelanger | fungi: we should likely revisit https://review.openstack.org/#/c/329049/ with updates about per-project CI systems. That is where my confusion came from | 15:02 |
| *** david-lyle has quit IRC | 15:02 | |
| fungi | adarazs: _if_ you later decide that the scenarios being tested should also validate and comment on, say, proposed ironic changes, then we'll need to revisit | 15:02 |
| *** mcornea has quit IRC | 15:02 | |
| adarazs | fungi: ack, understood. thanks for the clarification :) | 15:03 |
| panda | EmilienM: you talking to me regarding the bug ? | 15:03 |
| fungi | pabelanger: it's more that almost none of the documentation in that file relates to those rare third-party ci systems which are operated by the projects tey're commenting on | 15:03 |
| EmilienM | panda: no pradk about redis bug | 15:04 |
| sshnaidm | tripleo cores, please consider to merge this tempest patches: https://review.openstack.org/#/c/355641/ https://review.openstack.org/#/c/361936/ | 15:04 |
| *** rhallisey has quit IRC | 15:05 | |
| *** tremble has quit IRC | 15:05 | |
| *** HoloIRCUser9 has quit IRC | 15:05 | |
| *** HoloIRCUser has joined #tripleo | 15:05 | |
| *** HoloIRCUser2 has joined #tripleo | 15:06 | |
| *** HoloIRCUser5 has joined #tripleo | 15:07 | |
| *** HoloIRCUser2 has quit IRC | 15:07 | |
| *** coolsvap is now known as coolsvap_ | 15:07 | |
| *** chem has quit IRC | 15:08 | |
| *** panda is now known as panda|bbl | 15:08 | |
| openstackgerrit | Merged openstack/puppet-pacemaker: Fix CI puppet-lint and type issues https://review.openstack.org/355202 | 15:08 |
| *** chem has joined #tripleo | 15:08 | |
| *** HoloIRCUser5 has quit IRC | 15:09 | |
| *** HoloIRCUser has quit IRC | 15:10 | |
| *** numans has quit IRC | 15:12 | |
| pradk | EmilienM, https://bugs.launchpad.net/tripleo/+bug/1618510 | 15:12 |
| openstack | Launchpad bug 1618510 in tripleo "unable to reach redis service" [Undecided,New] | 15:12 |
| *** bana_k has quit IRC | 15:13 | |
| openstackgerrit | Merged openstack/puppet-pacemaker: Move other-requirements.txt to bindep.txt https://review.openstack.org/355001 | 15:13 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add support for configuring the OVS firewall driver https://review.openstack.org/357556 | 15:14 |
| *** saneax is now known as saneax-_-|AFK | 15:16 | |
| *** abregman is now known as abregman|mtg | 15:17 | |
| *** zoli|wfh is now known as zoli|afk | 15:19 | |
| *** ohamada has quit IRC | 15:20 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add base neutron service configuration https://review.openstack.org/361367 | 15:20 |
| *** abregman|mtg has quit IRC | 15:22 | |
| *** david-lyle has joined #tripleo | 15:22 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Update configuration docs https://review.openstack.org/356700 | 15:22 |
| *** dtantsur|mtg is now known as dtantsur | 15:25 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add `overcloud parameters set` to set Heat params in a plan https://review.openstack.org/360391 | 15:25 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add 'openstack overcloud plan create' command https://review.openstack.org/359784 | 15:25 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Print the execution ID when starting Mistral workflows https://review.openstack.org/340711 | 15:25 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add `openstack overcloud plan deploy` https://review.openstack.org/360305 | 15:25 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Update the 'overcloud deploy --templates' command to use Mistral https://review.openstack.org/342261 | 15:25 |
| dtantsur | EmilienM, re https://review.openstack.org/#/c/362504/ is it possible to add ironic to one of these? | 15:26 |
| d0ugal | dprince: ^ I think that should solve your issue, if you could give it another test that would be great. | 15:26 |
| dtantsur | even without fancy checks, just make sure it still can be installed | 15:26 |
| *** leanderthal is now known as leanderthal|afk | 15:26 | |
| EmilienM | dtantsur: thats the goal Sir | 15:26 |
| EmilienM | dtantsur: but let me finish this baby step | 15:26 |
| EmilienM | dtantsur: and I | 15:27 |
| dtantsur | yeah, cool, thanks! just making sure I understand the plan | 15:27 |
| EmilienM | err this new keyboard | 15:27 |
| dtantsur | heh | 15:27 |
| EmilienM | and I'll add it to scenario002 like in puppet ci | 15:27 |
| dtantsur | awesome | 15:27 |
| dtantsur | dprince, I've finally managed to build a local environment to test your ironic patch.. | 15:27 |
| *** links has quit IRC | 15:28 | |
| EmilienM | bnemec: what is periodic-ovb-ha2 ? | 15:30 |
| EmilienM | bnemec: random question feel free to say idk | 15:30 |
| bnemec | EmilienM: I believe that's the version of the ha job that we're running right now. | 15:31 |
| bnemec | It was added when derekh started working on ovb support in tripleo-ci. | 15:31 |
| EmilienM | bnemec: ok merci | 15:31 |
| *** bana_k has joined #tripleo | 15:32 | |
| *** xinwu has joined #tripleo | 15:34 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Defaults to ceph_mon_node_ips and ceph_mon_node_names https://review.openstack.org/361108 | 15:34 |
| *** jcoufal has quit IRC | 15:34 | |
| derekh | bnemec: if tou see random ipmitool calls to the ovb BMC timeout in ironic, I belive this fixes them https://review.openstack.org/#/c/362944/1 | 15:34 |
| derekh | bnemec: I spent some time tracking it down today and it turns out if the same source udp port is used twice things didn't work | 15:35 |
| *** xinwu has quit IRC | 15:36 | |
| openstackgerrit | Merged openstack/tripleo-quickstart: Revert "Move unique socket generation into quickstart.sh" https://review.openstack.org/362292 | 15:36 |
| *** jcoufal has joined #tripleo | 15:36 | |
| EmilienM | bnemec, dprince, panda|bbl, shardy: can you guys review please https://review.openstack.org/362966 | 15:37 |
| derekh | EmilienM: I added ha2 as the ha job on ovb was different to the origional ha job , we shouldn't need it any longer, is it still being used? | 15:39 |
| EmilienM | derekh: i have not idea | 15:39 |
| EmilienM | derekh: i havent seen this job running lately | 15:39 |
| bnemec | Yes, ha2 is still the ha job we're running. | 15:39 |
| derekh | EmilienM: bnemec ok we should probably make the ha and ha2 cases in the switch statment the same | 15:40 |
| *** david-lyle has quit IRC | 15:40 | |
| derekh | EmilienM: bnemec then change the JOB_TYPE in project-config to ha and finally delete the ha2 entry from the toci_gate_test switch statment | 15:41 |
| bnemec | Agreed. | 15:41 |
| EmilienM | yeah | 15:42 |
| EmilienM | who's on this? | 15:42 |
| *** dtantsur is now known as dtantsur|afk | 15:42 | |
| derekh | EmilienM: I'll push up the first patch now and will come back to it later | 15:42 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Use relative paths in ci-scripts for quickstart.sh https://review.openstack.org/360649 | 15:42 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Document Third Party CI and developer usage https://review.openstack.org/360007 | 15:44 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Update section header indicators https://review.openstack.org/360522 | 15:44 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Update configuration docs https://review.openstack.org/356700 | 15:44 |
| *** ebarrera has quit IRC | 15:46 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Sync the config of the ha JOBTYPE with ha2 https://review.openstack.org/362974 | 15:46 |
| derekh | EmilienM: bnemec ^ patch one, gotta run will do the project-config patch this evening | 15:46 |
| *** derekh has quit IRC | 15:46 | |
| bnemec | gfidente: Now that we're testing ceph in the nonha job again, do we still need it in the ha job too? | 15:48 |
| bnemec | It would be nice to drop it if we can. We'd need one less node and the ha job would probably be a little faster. | 15:49 |
| *** david-lyle has joined #tripleo | 15:50 | |
| gfidente | bnemec, we can drop it yes | 15:50 |
| gfidente | though I wanted to turn it into osd on compute scenario | 15:50 |
| gfidente | which would still permit us to remove the additional node | 15:50 |
| gfidente | until then, if we need resources, I think it's fine testing it in a single job | 15:51 |
| bnemec | gfidente: Yeah, we can certainly do that too. | 15:51 |
| ayoung | quickstart seems to be setting an obsolete value | 15:51 |
| ayoung | $ openstack baremetal import --json instackenv.json | 15:51 |
| ayoung | Invalid input [name=tripleo.baremetal.v1.register_or_update, class=DirectWorkflowSpec, unexpected=[u'instance_boot_option']] | 15:51 |
| gfidente | bnemec, problem with that was steps synchronization outside roles which we don't have yet | 15:51 |
| bnemec | It would probably be good to test the non-ceph path anyway. Right now we aren't. | 15:51 |
| ayoung | assuming there is a patch to work around that? | 15:51 |
| gfidente | bnemec, also yes | 15:52 |
| *** trown is now known as trown|lunch | 15:52 | |
| *** pkovar has joined #tripleo | 15:52 | |
| ayoung | running using devmode...is that the problem? Running like this: ~/.quickstart/tripleo-quickstart/quickstart.sh --release master --extra-vars @config/general_config/devmode.yml ayoung-dell-t1700.test | 15:52 |
| bnemec | gfidente: Okay, I'll write a patch. | 15:52 |
| openstackgerrit | imain proposed openstack/tripleo-common: Create new docker command hook. https://review.openstack.org/312723 | 15:53 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Enable modern authtoken for Neutron and Glance https://review.openstack.org/362980 | 15:53 |
| openstackgerrit | Jeff Peeler proposed openstack/tripleo-common: Include environments in capabilities output https://review.openstack.org/355598 | 15:53 |
| *** pkovar has quit IRC | 15:54 | |
| jpeeler | jtomasek: i imagine you don't have much day left, but if you do ^ | 15:55 |
| jtomasek | jpeeler: cool, will test it tomorrow morning! | 15:55 |
| jtomasek | jpeeler: or you need it reviewed immediately? | 15:55 |
| jpeeler | jtomasek: if you have time to do it now, that would be great since i have ~6 hours left | 15:56 |
| jtomasek | jpeeler: ok, I'll check it in horizon of 2 hours | 15:57 |
| jpeeler | of 2 hours? | 15:57 |
| jtomasek | jpeeler: I am at the meeting now and then need to go afk for a bit, so I can do it right when I get back | 15:58 |
| ayoung | hrybacki, what is the blessed configuration to run quickstart today? | 15:58 |
| jtomasek | jpeeler: is that fine? | 15:58 |
| jpeeler | jtomasek: yes, thanks! | 15:58 |
| * jpeeler was thinking horizon UI... | 15:59 | |
| *** bana_k has quit IRC | 15:59 | |
| *** dprince has quit IRC | 15:59 | |
| *** dprince has joined #tripleo | 16:00 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Remove Ceph from the ha job https://review.openstack.org/362990 | 16:00 |
| bnemec | gfidente: ^ | 16:01 |
| *** ifarkas is now known as ifarkas_afk | 16:01 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add `overcloud parameters set` to set Heat params in a plan https://review.openstack.org/360391 | 16:02 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add 'openstack overcloud plan create' command https://review.openstack.org/359784 | 16:02 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Print the execution ID when starting Mistral workflows https://review.openstack.org/340711 | 16:02 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add `openstack overcloud plan deploy` https://review.openstack.org/360305 | 16:02 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Update the 'overcloud deploy --templates' command to use Mistral https://review.openstack.org/342261 | 16:02 |
| *** pkovar has joined #tripleo | 16:04 | |
| ayoung | Um...guys? Does anyone here use quickstart? Has anyone run it in, say, 2-3 days? Cuz the last known good incantation I had no longer works, and I am trying to figure out if it is me or if it is Memorex. | 16:06 |
| *** zoli|afk is now known as zoli|wfh | 16:09 | |
| *** pkovar has quit IRC | 16:09 | |
| *** pkovar has joined #tripleo | 16:10 | |
| *** bana_k has joined #tripleo | 16:14 | |
| jrist | d0ugal++ | 16:14 |
| openstackgerrit | John Browning proposed openstack/tripleo-validations: Check to ensure debug is disabled on undercloud services. https://review.openstack.org/355559 | 16:15 |
| chem | jistr: marios hi guys, could you give the final workflow to https://review.openstack.org/#/c/354713/, we still can see if gate-tripleo-ci-centos-7-ovb-hais fixed during POST_FAILURE gating ? | 16:15 |
| jrist | mandre, shadower ^ | 16:15 |
| jrist | :o | 16:15 |
| shadower | jrist: what are you pointing at? | 16:16 |
| shadower | jrist: as in, what should I look at? | 16:17 |
| hewbrocca | validations! | 16:17 |
| jrist | shadower: what hewbrocca said :) | 16:17 |
| ayoung | So are we giving up on Tripleo Quickstart? | 16:17 |
| shadower | oh, johnbro's patch? | 16:18 |
| shadower | yea I'm on it | 16:18 |
| shadower | merged two of his today | 16:18 |
| shardy | ayoung: You may want to chat with trown|lunch and larsks re any quickstart issues | 16:18 |
| shardy | folks are just super overloaded atm with newton3 stuff | 16:18 |
| *** akrivoka has quit IRC | 16:18 | |
| shadower | hewbrocca, jrist: need to relocate but it's on my radar, don't worry :-) | 16:18 |
| ayoung | shardy, they the only ones that use it? | 16:18 |
| shardy | I can't help personally because I don't use it myself atm | 16:18 |
| shardy | ayoung: No, but a lot of folks don't use it upstream because it's not currently what we run in CI | 16:19 |
| shardy | RDO CI does use it, as do quite a few developers | 16:19 |
| ayoung | shardy, yeah, I am aware, which is why I don't bother you. I'll bug people in #rdo then | 16:19 |
| shardy | so, unfortuntely that dilutes the pool of folks in this channel equipped to help | 16:19 |
| shardy | ayoung: I identifed trown|lunch and larsks because they were the original authors of it | 16:20 |
| jrist | shardy, ayoung we just had a retrospective and we decided that we're going to centralize on one installer | 16:20 |
| jrist | it will probably be tripleo quickstart | 16:20 |
| ayoung | shardy, yes, and I appreciate that. It is the continuing difficulty of getting a working Tripleo development environment that leads me back here. | 16:21 |
| jrist | :( | 16:21 |
| *** david-lyle has quit IRC | 16:21 | |
| shardy | ayoung: Yeah, it's far from ideal | 16:21 |
| ayoung | jrist, it makes sense to me. Ansible based provisioning is the ost important part. | 16:21 |
| jrist | that was one of the things we just discussed as well in our retrospective | 16:21 |
| ayoung | jrist, are you running it? | 16:21 |
| shardy | tbh I'm perfectly happy with tripleo.sh myself | 16:21 |
| jrist | ayoung: I am not, but shadower is and he has some instructions | 16:21 |
| ayoung | shardy, I'm neutral. I just want to use the tool that the team is using. But it needs to work for the single host, resource constrained developer use case...cuz that is me. | 16:22 |
| ansiwen | chem: around? | 16:23 |
| chem | ansiwen:yep | 16:23 |
| *** david-lyle has joined #tripleo | 16:23 | |
| chem | ansiwen: what's up ? | 16:23 |
| ansiwen | chem: hi. could you point me to the keystone tests that also used a provider to create credentials for tests? I think you mentioned something like that, no? | 16:24 |
| marios | chem: done | 16:25 |
| shardy | ayoung: Yeah I am too, but it works for me, and gets me close to what we actually run in CI | 16:25 |
| chem | ) | 16:25 |
| shardy | if we switch to quickstart in CI, I will start using that instead | 16:25 |
| chem | marios: thanks | 16:25 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Upgrade ceph-osd https://review.openstack.org/357312 | 16:26 |
| chem | ansiwen: hum, it's for the ec2 tempest credential api creator... I don't recall something similar in keystone test. Everything is hardcoded, not dinamically generated. Your problem is not like the openrc stuff. | 16:27 |
| openstackgerrit | Mathieu Mitchell proposed openstack/diskimage-builder: (WIP) Zuul-cloner first attempt https://review.openstack.org/363013 | 16:27 |
| *** dmacpher has quit IRC | 16:28 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add Ceph cluster health validation on upgrade https://review.openstack.org/359410 | 16:28 |
| pradk | shardy, Hey did we recently make any changes to how redis is configured in OSP10? we're seeing some issues | 16:29 |
| ansiwen | chem: but sketched an idea about a provider that created a file with the credentials, I thought you mentioned something similar would be in keystone... | 16:29 |
| chem | ansiwen: this is the openrc stuff | 16:29 |
| ansiwen | chem: so, whats the openrc stuff? | 16:32 |
| shardy | pradk: yes, possibly, we reworked how the redis_node_ips hieradata is created | 16:32 |
| shardy | https://review.openstack.org/#/c/348974/6/puppet/all-nodes-config.yaml | 16:32 |
| chem | ansiwen: hold no | 16:32 |
| chem | on | 16:32 |
| shardy | pradk: we now auto-generate a list in hiera for all services, when before it was a yaml string | 16:32 |
| shardy | gfidente and jistr have been helping with some adjustments in puppet-tripleo to align with that | 16:32 |
| shardy | pradk: got a link to the failures you're seeing? | 16:32 |
| pradk | shardy, hmm i see .. | 16:33 |
| shardy | this passed CI so I guess we missed something | 16:33 |
| pradk | sure i opened a bug: https://bugs.launchpad.net/tripleo/+bug/1618510 | 16:33 |
| openstack | Launchpad bug 1618510 in tripleo "unable to reach redis service" [Undecided,New] | 16:33 |
| pradk | shardy, so you can see the issue in ceilo/aodh/gnocchi logs where it fails to connect to redis coordination backend | 16:33 |
| jaosorior_away | EmilienM: hey dude, seems that the keystone provider only works with ssl if the ssl parameters were set in the keystone manifest. I'm setting them in the keystone::wsgi::apache. How do we get the provider to take those into account too? | 16:34 |
| *** jpich has quit IRC | 16:35 | |
| shardy | pradk: hmm, *coordination_url references "%{hiera('redis_vip')}", so not *_node_ips | 16:35 |
| EmilienM | jaosorior_away: ::keystone::enable_ssl: True | 16:35 |
| shardy | pradk: can you reproduce this locally? | 16:35 |
| EmilienM | also set public_bind_host and admin_bind_host | 16:35 |
| pradk | shardy, i'm in progress of deploying locally | 16:35 |
| EmilienM | jaosorior_away: /me afk lunch a bit let me know please | 16:36 |
| *** david-lyle_ has joined #tripleo | 16:36 | |
| shardy | pradk: ack, it'd be good to see the output of hiera aodh::evaluator::coordination_url on the CLI | 16:36 |
| pradk | shardy, but shouldnt the node ips map to vip in haproxy config? | 16:36 |
| chem | ansiwen: https://github.com/openstack/puppet-openstacklib/blob/master/lib/puppet/provider/openstack/auth.rb | 16:36 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: [NO MERGE] Test Ceph RadosGW as replacement for Swift https://review.openstack.org/357182 | 16:36 |
| shardy | and probably grep redis /etc/puppet/hieradata/* | 16:36 |
| shardy | pradk: Yeah, there's two data items, the ip of each node, and the vip associated with the service | 16:37 |
| shardy | only the former (so far) has been reworked | 16:37 |
| shardy | so the change I referenced may not be related | 16:37 |
| pradk | understood | 16:37 |
| * shardy has a vip rework patch posted, but not yet landed | 16:37 | |
| chem | ansiwen: in the end whatever code you're doing should ends up in puppet tempest. It should be some kind of provider that takes a project as input and add the ec2 credential into the tempest conf. | 16:37 |
| pradk | shardy, if we comment out the tcp-check in haproxy it goes through and we can connect to redi via vip | 16:38 |
| chem | ansiwen: that basically the only proper way to do it in puppet | 16:38 |
| pradk | shardy, but i dont think we should have to do that | 16:39 |
| *** electrofelix has quit IRC | 16:39 | |
| chem | ansiwen: the file you're creating could be used for a simple idempotency test, and should be hashed by project | 16:39 |
| *** yamahata has quit IRC | 16:39 | |
| *** david-lyle has quit IRC | 16:39 | |
| shardy | jaosorior_away had some patches related to haproxy which just landed, so we might want to check those aren't related | 16:39 |
| pradk | ok, i'll look at the recently merged | 16:40 |
| chem | ansiwen: but the best would be to ask the api for the value each time, but not sure that is possible, so saving parameter in a file might be the only solution. | 16:40 |
| shardy | https://github.com/openstack/tripleo-heat-templates/commit/628be72f7ca25355f1bdd7b8b8ac8f22b5ec90d9 | 16:40 |
| shardy | pradk: there was that one, so perhaps ensure hiera redis_enabled returns true | 16:41 |
| pradk | https://review.openstack.org/#/c/359645/ | 16:41 |
| ansiwen | chem: which api? keystone api? | 16:41 |
| shardy | and that the interpolation e.g hiera tripleo::haproxy::redis is true | 16:41 |
| chem | ansiwen: the ec2 api | 16:41 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Customize the reservation of memory for host processes https://review.openstack.org/327705 | 16:41 |
| chem | ansiwen: that's the one that give you the cred back, isn't it ? | 16:42 |
| ansiwen | chem: no, I think you need the credentials to access the api... | 16:42 |
| chem | ansiwen: the keystone cred are already taken care by puppet-openstacklib, you don't need to worry about those, or I'm missing something here. | 16:43 |
| ansiwen | chem: you create the credentials with "openstack ec2 credentials create" or so... and then they are stored somewhere (I thought it's keystone) | 16:43 |
| gfidente | pradk, that is sort of "superseded" by https://review.openstack.org/#/c/362800/ | 16:43 |
| gfidente | pradk, and it's depends-on https://review.openstack.org/#/c/362798/ | 16:43 |
| gfidente | pradk, if there is something we need to amend there, please comment on those | 16:43 |
| ansiwen | chem: well, I'm completely confused by all this, so I'm probably absolutely wrong :-) | 16:43 |
| ansiwen | chem: the problem is I have no idea about the ec2api, but I have to integrate it into tripleo... that's not exactly helpful :-) | 16:44 |
| *** hewbrocca is now known as hewbrocca-afk | 16:44 | |
| hrybacki | ayoung one second. omw back from lunch | 16:45 |
| chem | ansiwen: inside puppet provider you can use "request("ec2 credential", "create" ...) and the keystone authentication will be done for your, no problem there. | 16:45 |
| ansiwen | chem: aha! so I need an equivalent of this bash code for puppet-tempest: https://github.com/openstack/ec2-api/blob/master/devstack/create_config#L51-L53 | 16:46 |
| pradk | gfidente, hmm so these default to false? https://review.openstack.org/#/c/362798/2/manifests/haproxy.pp | 16:46 |
| pradk | gfidente, where are these overridden to true? | 16:46 |
| gfidente | pradk, heat will dump _enabled: true | 16:47 |
| gfidente | for those roles which are deployed | 16:47 |
| openstackgerrit | imain proposed openstack/tripleo-heat-templates: WIP: Containerized Services for Composable Roles https://review.openstack.org/330659 | 16:47 |
| openstackgerrit | imain proposed openstack/tripleo-heat-templates: Bind mount files to run DiD in latest atomic host https://review.openstack.org/347218 | 16:47 |
| hrybacki | ayoung: what do you mean by which config? What are you trying to deploy with ooq? | 16:47 |
| hrybacki | oooq* | 16:47 |
| Slower | flaper87: there you go.. hopefully it's all there :) | 16:48 |
| *** thrash is now known as thrash|biab | 16:49 | |
| pradk | gfidente, i see, ok.. so redis_enabled should be turned to true | 16:49 |
| *** bana_k has quit IRC | 16:49 | |
| *** liverpooler has joined #tripleo | 16:50 | |
| ayoung | hrybacki, simple developers setup. HA, one controller | 16:50 |
| *** fragatina has joined #tripleo | 16:50 | |
| gfidente | pradk, redis_enabled should be true yes, let me check CI configs to confirm | 16:50 |
| pradk | gfidente, weird donno why else the vip wouldnt work | 16:50 |
| *** fragatin_ has joined #tripleo | 16:51 | |
| *** jaosorior_away has quit IRC | 16:51 | |
| gfidente | pradk, just found it redis_enabled: true | 16:51 |
| gfidente | http://logs.openstack.org/98/362798/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/8453786/logs/ | 16:51 |
| hrybacki | ayoung: I don't often deploy HA locally but for vanilla deploy I use the tripleo-quickstart/ci-scripts/fully-deploy.sh script (to closely mimic CI) with this local wrapper https://paste.fedoraproject.org/417438/75851147/ | 16:51 |
| *** trown|lunch is now known as trown | 16:52 | |
| hrybacki | ayoung: but swap out 'minimal' for 'ha' on line 22 and give that a go | 16:52 |
| ayoung | hrybacki, ah, no don't want Mitaka, trying to get up to Newton dev | 16:52 |
| hrybacki | flip 'mitaka' for master | 16:52 |
| chem | ansiwen: oki, so you create ec2 cred, then use them in "aws configure ..." | 16:53 |
| hrybacki | ayoung: yeah, so swap 'mitaka' with 'master' and 'minimal' with 'ha' | 16:53 |
| hrybacki | note that I'm pulling a local clone of tripleo-quickstart (you might not be doing that?) | 16:53 |
| *** pradk has quit IRC | 16:53 | |
| *** pradk- has joined #tripleo | 16:53 | |
| ayoung | hrybacki, so, I was running something pretty minimal, and was getting : | 16:53 |
| ayoung | $ openstack baremetal import --json instackenv.json | 16:53 |
| ayoung | <ayoung> Invalid input [name=tripleo.baremetal.v1.register_or_update, class=DirectWorkflowSpec, unexpected=[u'instance_boot_option']] | 16:53 |
| chem | ansiwen: what is that "aws" command ? | 16:54 |
| sshnaidm | ayoung, do you use devmode? | 16:54 |
| ayoung | sshnaidm, I was | 16:54 |
| gfidente | tty tomorrow! | 16:54 |
| hrybacki | ayoung: I haven't seen that before (I don't use devmode though) | 16:54 |
| ayoung | sshnaidm, I am running a deploy now without it, but the image fetch takes close to an hour | 16:54 |
| sshnaidm | ayoung, I saw such errors in devmode jobs | 16:54 |
| *** gfidente has quit IRC | 16:54 | |
| *** fragatina has quit IRC | 16:55 | |
| ayoung | sshnaidm, I suspected it was something along those lines. I see a patch to remove devmode | 16:55 |
| beagles | ayoung, did you recently yum update in an existing undercloud? | 16:55 |
| ayoung | WTF does doing anything with images take so long: either downloading or creating them from scratch is by far the longest part of the deploy. | 16:55 |
| ansiwen | chem: I think the aws configure part is not necessary, is it? | 16:55 |
| openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: Fixes for race condition when adding primitives without OCF present https://review.openstack.org/356086 | 16:55 |
| beagles | ayoung, if so, you probably need to update the mistral workbooks | 16:55 |
| ayoung | beagles, blew away the undercloud. THe failure is coming from quickstart files | 16:55 |
| sshnaidm | ayoung, afaik there is a problem with performance on rdo artifacts site | 16:56 |
| hrybacki | ayoung: yes the ^^ | 16:56 |
| beagles | ayoung, oh.. interesting | 16:56 |
| openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: Fixes for race condition when adding primitives without OCF present https://review.openstack.org/356086 | 16:56 |
| openstackgerrit | Ivan Berezovskiy proposed openstack/puppet-pacemaker: Execute reset_cib in wait_for_online https://review.openstack.org/363035 | 16:56 |
| ayoung | is there any way to speed up the image issue? | 16:56 |
| beagles | ayoung, same answer probably :) I just don't know where you'd need to do it :)\ | 16:56 |
| hrybacki | ayoung: note that if you have cached images you can circumvent the potential of downloading by handing this extra param (/me goes to get) | 16:56 |
| chem | ansiwen: got no idea :) | 16:56 |
| hrybacki | ayoung: -e _force_cached_image=true | 16:57 |
| ayoung | hrybacki, the problem is that I seem to lose the cached files. Don't they get put into the /home/stack directory? | 16:57 |
| hrybacki | this will reuse the previously used undercloud image | 16:57 |
| *** rhallisey has joined #tripleo | 16:57 | |
| hrybacki | ayoung: no, /var/cache/<something> | 16:57 |
| pradk- | same problem here.. i'm just waiting on fetch_image step for quite some time now | 16:57 |
| sshnaidm | ayoung, you can try devmode though, it should still work, but with force_cached_images=false and using the patch: https://review.openstack.org/#/c/335953/ | 16:57 |
| ayoung | Oh wow look at all them | 16:58 |
| *** lucasagomes is now known as lucas-dinner | 16:58 | |
| hrybacki | ayoung: ya, and they eat up a lot of space at like 2.8GB/image | 16:58 |
| ayoung | sshnaidm, dangit, I *KNEW* about that patch | 16:58 |
| ayoung | hrybacki, its OK, space I got | 16:58 |
| *** jpena is now known as jpena|off | 16:58 | |
| chem | ansiwen: could you just show me a paste of how you would like it to be working as user . A sample puppet code that would do what you want as if it existed. | 16:58 |
| ayoung | sshnaidm, what would it take to get that patch merged? | 16:59 |
| hrybacki | ayoung: did I give you enough to get rolling? | 16:59 |
| chem | ansiwen: it would be much easier to work on | 16:59 |
| sshnaidm | ayoung, there is a work in progress about new "devmode", so.. | 16:59 |
| sshnaidm | weshay, adarazs ^^ | 17:00 |
| sshnaidm | weshay, adarazs maybe let's merge this anyway? | 17:00 |
| *** rasca has quit IRC | 17:00 | |
| ayoung | https://review.openstack.org/#/admin/groups/1355,members | 17:00 |
| trown | merged | 17:01 |
| ayoung | larsks, trown and Gabriele Cerami | 17:01 |
| ayoung | trown, TYVM | 17:01 |
| sshnaidm | trown, just was writing to you :)) | 17:01 |
| larsks | ayoung: what what? | 17:01 |
| ayoung | larsks, you too slow! trown got it | 17:01 |
| trown | though... do we even have overcloud images for "devmode" now? | 17:01 |
| larsks | That means I win! | 17:02 |
| ayoung | larsks, yes. yes you do. | 17:02 |
| sshnaidm | trown, yes | 17:02 |
| trown | I looked yesterday and there was no new overcloud images from tripleo-ci | 17:02 |
| larsks | trown: my understanding was that devmode is basically useles now. | 17:02 |
| larsks | trown: I think there is even a "get rid of devmode" review open. | 17:02 |
| chem | ansiwen: in the meantime that how you would get in in puppet-tempest https://github.com/openstack/puppet-tempest/blob/master/lib/puppet/provider/tempest_glance_id_setter/openstack.rb#L31 | 17:02 |
| sshnaidm | trown, actually now they are in rh1 cloud, different ip, but should be still available in rh2 too | 17:02 |
| ansiwen | chem: so, I thought the credentials just have to end up in the tempest.conf | 17:02 |
| trown | larsks: ya it seems that way... though one use case is not suffering the horrible download speeds from centos artifacts server :P | 17:02 |
| trown | sshnaidm: do you have the IP? I think it is not updated in quickstart | 17:03 |
| ansiwen | chem: what I wanted to do with the puppet-tempest module | 17:03 |
| larsks | trown: so actually, solving that is I hope one of our priorities, because I have over the past two days had several people say basically "I can't use quickstart because the downloads take forever" | 17:03 |
| *** pradk- is now known as pradk | 17:03 | |
| ayoung | So no devmode, right? Or devmode good? | 17:03 |
| sshnaidm | trown, yes, but there is no "instack.qcow2", only overcloud: http://66.187.229.18/builds/current-tripleo/ | 17:03 |
| larsks | ayoung: devmode not really useful. I've been using config/release/master.yml for recent versions of things. | 17:03 |
| larsks | trown: this is no instack.qcow2, ONLY ZUUUUUUL. | 17:04 |
| larsks | Ah, darn. s/this/there/ | 17:04 |
| ansiwen | chem: but maybe you are right, and the aws command is also necessary? | 17:04 |
| sshnaidm | ayoung, devmode should work | 17:04 |
| *** abregman has joined #tripleo | 17:04 | |
| ayoung | ~/.quickstart/tripleo-quickstart/quickstart.sh --release master --extra-vars force_cached_images=true ayoung-dell-t1700.test | 17:04 |
| larsks | sshnaidm: reaallly? I thought it was trying to fetch images that are no longer updated. | 17:04 |
| trown | larsks: ya, there is a centos bug opened to fix the md5sum issue with the CDN, https://bugs.centos.org/view.php?id=11367 but ya until we have some alternative place to pull images quickstart is pretty much useless | 17:04 |
| sshnaidm | larsks, there are updated anyway in devmode | 17:04 |
| ayoung | or do I not want --extra-vars force_cached_images=true | 17:05 |
| ansiwen | chem: all I know is that I have to put ec2 credentials into the tempest.conf | 17:05 |
| larsks | sshnaidm: okay. the last discussion I had with weshay was "devmode is totally broked", but I haven't followed closely since then. | 17:05 |
| hrybacki | trown: do you know if they have made any movement on that bug? adarazs pinged them earlier but no comments :( | 17:05 |
| trown | hrybacki: I dont see anything, but I can bug kb in #centos-devel | 17:05 |
| chem | ansiwen: ok, so this is a good description, input: "a project", output: "ec2 cred in the tempest.conf" | 17:05 |
| sshnaidm | larsks, it should work, this merged patch should have solved all problems | 17:06 |
| chem | ansiwen:? | 17:06 |
| larsks | Awesome. | 17:06 |
| weshay | ya.. we're updating devmode to use the ansible-role-tripleo-gate and the master image built from current-tripleo | 17:06 |
| openstackgerrit | Merged openstack/tripleo-quickstart: Devmode: rename delorean current so any existing repo is overwritten https://review.openstack.org/335953 | 17:06 |
| sshnaidm | larsks, ^ | 17:06 |
| ayoung | weshay, so devmode good, or wait a while? | 17:06 |
| * ayoung hoping for a set of command line parameters for newton based setup reasonably likely to succeed... | 17:07 | |
| weshay | the incarnation that sshnaidm is talking about will go away.. ayoung if it's working w/ that patch great. Expect an updated workflow and doc for devmode in the next week or so | 17:07 |
| ayoung | OK, so not today | 17:07 |
| weshay | aye | 17:07 |
| ayoung | any reason to do anything more than | 17:07 |
| ayoung | ~/.quickstart/tripleo-quickstart/quickstart.sh --release master ayoung-dell-t1700.test | 17:08 |
| weshay | ayoung, if you just want to deploy newton that's all you need | 17:08 |
| trown | ayoung: I would actually use devmode... since the image will get pulled from tripleo server instead of super slow centos server | 17:09 |
| ayoung | weshay, I want a 3 VM setup: one undercloud, one controller, one compute. HA proxy. | 17:09 |
| ayoung | OK so | 17:09 |
| ayoung | ~/.quickstart/tripleo-quickstart/quickstart.sh --release master --extra-vars @config/general_config/devmode.yml ayoung-dell-t1700.test | 17:09 |
| trown | ayoung: devmode does a complete update of all of the packages on undercloud and overcloud images, so it should not matter that the image itself is out of date | 17:09 |
| sshnaidm | ayoung, master-tripleo | 17:10 |
| trown | ayoung: s/--release master/--release master-tripleo/ | 17:10 |
| ayoung | trown, now, the last time I ran that, I was getting the error I posted above ..I'll repost | 17:10 |
| trown | that is the part that points to tripleo server | 17:10 |
| sshnaidm | ayoung, devmode uses its own config and "master-tripleo" config | 17:10 |
| ayoung | so don't need devmode to get that? | 17:10 |
| ayoung | ah | 17:10 |
| ayoung | ok... | 17:10 |
| ayoung | so... | 17:10 |
| ayoung | ~/.quickstart/tripleo-quickstart/quickstart.sh --release master-tripleo --extra-vars @config/general_config/devmode.yml ayoung-dell-t1700.test | 17:11 |
| sshnaidm | ayoung, yeah | 17:11 |
| ayoung | my last couple of runs were failing on the post-undercloud, due to a malformed json file: | 17:11 |
| ayoung | $ openstack baremetal import --json instackenv.json | 17:11 |
| ayoung | <ayoung> Invalid input [name=tripleo.baremetal.v1.register_or_update, class=DirectWorkflowSpec, unexpected=[u'instance_boot_option']] | 17:11 |
| trown | ya IIUC the patch I just merged should fix that | 17:11 |
| ayoung | Kool | 17:12 |
| *** rcernin has quit IRC | 17:12 | |
| ayoung | OK, running now | 17:12 |
| *** bana_k has joined #tripleo | 17:12 | |
| openstackgerrit | Merged openstack/tripleo-validations: Check to ensure debug is disabled on undercloud services. https://review.openstack.org/355559 | 17:13 |
| *** thrash|biab is now known as thrash | 17:13 | |
| *** tesseract- has quit IRC | 17:14 | |
| *** milan has quit IRC | 17:15 | |
| *** mhenkel has quit IRC | 17:17 | |
| chem | ansiwen: so are we oki about the provider jobs ? | 17:17 |
| ayoung | hrybacki, that option to force cache...what does it do in devmode? | 17:20 |
| hrybacki | ayoung: I can't speak to that. I haven't tested devmode personally | 17:20 |
| ayoung | ok... | 17:20 |
| ayoung | so OOOqs failed again but this time much faster, so ++ there. | 17:21 |
| hrybacki | my work has me mocking CI as closely as possible | 17:21 |
| ayoung | fatal: [undercloud]: FAILED! => {"changed": true, "cmd": "/home/stack/undercloud-install.sh > /home/stack/undercloud_install.log 2>&1", "delta": "0:00:10.040743", "end": "2016-08-30 17:20:42.711475", "failed": true, "rc": 1, "start": "2016-08-30 17:20:32.670732", "stderr": "", "stdout": "", "stdout_lines": [], "warnings": []} | 17:21 |
| *** yolanda has joined #tripleo | 17:21 | |
| *** pkovar has quit IRC | 17:21 | |
| ayoung | and that is the same error I saw before. | 17:21 |
| sshnaidm | ayoung, about instackevnv.json? | 17:21 |
| ayoung | ah...nope | 17:21 |
| ayoung | this looked more like the yum error,... | 17:21 |
| hrybacki | can you paste undercloud_install.log | 17:22 |
| ayoung | hrybacki, yeah, looks like the yum error...debugging | 17:22 |
| sshnaidm | ayoung, did you update the quickstart to latest? | 17:22 |
| sshnaidm | ayoung, because patch was merged a 15 minutes ago | 17:23 |
| hrybacki | ok | 17:23 |
| ayoung | sshnaidm, hrybacki http://paste.openstack.org/show/564865/ | 17:23 |
| ayoung | sshnaidm, I thought I had...but maybe I fooled myself and jumped the gunnnn | 17:23 |
| ayoung | sshnaidm, yep...when I rebased, the patch, while merged on gerrit, had not made its way to origin/master | 17:24 |
| ayoung | easy to fix that one... | 17:24 |
| *** tesseract- has joined #tripleo | 17:24 | |
| ayoung | I don't mind failures so long as they fail fast.... | 17:25 |
| *** pcaruana has quit IRC | 17:25 | |
| hrybacki | ayoung: can you also paste the call to ansible-playbook for me? | 17:25 |
| ayoung | hrybacki, for the origianl error? | 17:26 |
| ayoung | the JSON one...sure? | 17:26 |
| hrybacki | well for whichever is the immediate problem | 17:26 |
| ayoung | hrybacki, I'm good for the moment, as I had missed a known-necessary patch | 17:27 |
| * hrybacki failed to read up | 17:27 | |
| hrybacki | ++ | 17:27 |
| ayoung | it failed in a different way this time than it did before, just looked the same at first glance | 17:27 |
| *** tesseract- has quit IRC | 17:28 | |
| ansiwen | chem: sorry, was afk | 17:29 |
| ansiwen | chem: so, isn't puppet-tempest already responsible for adding stuff to tempest.conf | 17:30 |
| *** tosky has quit IRC | 17:30 | |
| chem | ansiwen: hum ... yes, what's the question ? | 17:31 |
| chem | ansiwen: anyway, the way to go is take inspiration from https://github.com/openstack/puppet-tempest/blob/master/lib/puppet/provider/tempest_neutron_net_id_setter/openstack.rb#L31 | 17:34 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Mv Nova, Neutron, Horizon out of controller.yaml https://review.openstack.org/361362 | 17:35 |
| chem | ansiwen: you see the keystone auth is done there https://github.com/openstack/puppet-tempest/blob/master/lib/puppet/provider/tempest_neutron_net_id_setter/openstack.rb#L8 | 17:35 |
| chem | ansiwen: then you make the request as in line 32 | 17:35 |
| chem | ansiwen: you get back the values and add them to tempest.conf | 17:36 |
| *** florianf has quit IRC | 17:36 | |
| chem | ansiwen: it's all there really | 17:36 |
| ansiwen | chem: unfortunately I have to go now, but thanks a lot for now! I will look at it tomorrow, and come back to you with my many questions ;-) | 17:36 |
| ansiwen | chem: again, thanks a lot! | 17:36 |
| chem | ansiwen: np :) | 17:36 |
| EmilienM | dprince, bnemec: any chance to get https://review.openstack.org/361409 ? I have more coming | 17:38 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Enable modern authtoken for Neutron and Glance https://review.openstack.org/362980 | 17:43 |
| colonwq | EmilienM, Can you look at 339106 and 247956? I have hopefully knocked all of the rough edges off. | 17:43 |
| EmilienM | colonwq: looking | 17:44 |
| EmilienM | colonwq: done | 17:49 |
| EmilienM | good work here | 17:49 |
| EmilienM | read my comment | 17:49 |
| *** vijaykc4 has quit IRC | 17:51 | |
| *** egafford has quit IRC | 17:56 | |
| *** egafford has joined #tripleo | 17:56 | |
| colonwq | EmilienM, Thanks. I'll fix | 17:56 |
| EmilienM | shardy: mitaka releases | 17:56 |
| EmilienM | err, released | 17:56 |
| EmilienM | i hate my new US keyboard | 17:56 |
| *** mcornea has joined #tripleo | 17:56 | |
| *** zoli|wfh is now known as zoli|gone | 17:58 | |
| *** akrivoka has joined #tripleo | 17:59 | |
| * bnemec wonders if they swapped the s and d on EmilienM's new keyboard ;-) | 17:59 | |
| *** zoli|gone is now known as zoli_gone-proxy | 17:59 | |
| EmilienM | bnemec: dude I have a new laptop | 18:00 |
| EmilienM | and i lost french keyboard | 18:00 |
| EmilienM | i'll need 3 months to learn that | 18:00 |
| bkero | oh no D: | 18:00 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates: Add Barbican to the overcloud - WIP https://review.openstack.org/352458 | 18:00 |
| colonwq | EmilienM, Do you need some key cap stickers? | 18:00 |
| bkero | No French keyboard in Canada? This sounds like it violates some law. | 18:00 |
| bnemec | This is why I have a very nice mechanical keyboard. I don't care what keyboard my laptop has. | 18:00 |
| *** jdob has quit IRC | 18:01 | |
| EmilienM | yeah i need to buy one | 18:01 |
| *** jdob has joined #tripleo | 18:01 | |
| jtomasek | jpeeler: reviewed, https://review.openstack.org/#/c/355598/2 | 18:02 |
| jtomasek | jpeeler: almost there | 18:02 |
| jpeeler | jtomasek: perfect, i'll get it cleaned up for you to look at tomorrow | 18:02 |
| jtomasek | jpeeler: cool, once you have it, I could take a look immediately | 18:03 |
| jtomasek | jpeeler: thanks! | 18:04 |
| *** tesseract- has joined #tripleo | 18:05 | |
| beagles | Das Keyboard ftw! | 18:05 |
| *** tesseract- has quit IRC | 18:05 | |
| beagles | my keyboard has no labels | 18:06 |
| *** tesseract- has joined #tripleo | 18:06 | |
| beagles | security by obscurity from the non-touch-typist | 18:06 |
| bkero | I hope you remember which of 3 the insert and scroll-lock keys are :) | 18:07 |
| *** tesseract- has quit IRC | 18:08 | |
| EmilienM | beagles: 260 CAD !!! what??? | 18:08 |
| beagles | EmilienM, what? holy crap | 18:08 |
| beagles | EmilienM, it was not that expensive when I bought it | 18:08 |
| beagles | mm.. the new ones have more features | 18:09 |
| beagles | EmilienM, mine was like 130 -140 .. of course the CDN dollar wasn't so crappy then either | 18:09 |
| *** yamahata has joined #tripleo | 18:10 | |
| *** tesseract- has joined #tripleo | 18:10 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Allow for building specific images https://review.openstack.org/363095 | 18:11 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add NeutronGlobalPhysnetMtu to neutron-base.yaml https://review.openstack.org/361539 | 18:11 |
| ayoung | hrybacki, specatacular failage | 18:12 |
| ayoung | there is so much log spew I can;t scroll to the top of the failing section | 18:12 |
| EmilienM | I found what I need | 18:12 |
| EmilienM | https://www.amazon.ca/French-Keyboard-Stickers-Transparent-Background/dp/B01BW91MA4/ref=sr_1_2?ie=UTF8&qid=1472580731&sr=8-2 | 18:12 |
| bkero | EmilienM: can you fix it with setxkbmap? | 18:14 |
| hrybacki | ayoung: lol. I know that pain &> <some_file>.log is a need | 18:14 |
| ayoung | EmilienM, I once had to try and type on A French Keyboard. T'was not easy | 18:14 |
| EmilienM | bkero: yeah | 18:14 |
| ayoung | hrybacki, looks like something in the image update. Lots of RPM/Yum type commands in there | 18:14 |
| bkero | Put them in French DVORAK layout :D | 18:14 |
| trown | ayoung: I am seeing the same thing... looking into it | 18:15 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Split additional features across the periodic jobs https://review.openstack.org/362904 | 18:18 |
| openstackgerrit | Dimitri Savineau proposed openstack/tripleo-heat-templates: apache: Remove product informations https://review.openstack.org/363105 | 18:19 |
| sshnaidm | shardy, can you please merge it? https://review.openstack.org/#/c/355641/ | 18:20 |
| EmilienM | sshnaidm: done | 18:22 |
| sshnaidm | EmilienM, thanks! | 18:22 |
| EmilienM | sshnaidm: I want to work with you on something when you can | 18:23 |
| sshnaidm | EmilienM, what is it? | 18:23 |
| EmilienM | sshnaidm: now we have the scenarios almost in place I would like to investigate if we could run tempest sometimes | 18:23 |
| EmilienM | sshnaidm: have you followed my stuff on scenarios? | 18:23 |
| sshnaidm | EmilienM, partially, where should I look firstly? | 18:24 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-docs: Switch docs to use tripleo-build-images https://review.openstack.org/337669 | 18:24 |
| EmilienM | sshnaidm: https://review.openstack.org/#/c/362504/ | 18:24 |
| sshnaidm | EmilienM, in which utc are you? | 18:25 |
| EmilienM | sshnaidm: I'm in polar circle | 18:25 |
| EmilienM | now I'm joking | 18:25 |
| sshnaidm | :) | 18:25 |
| EmilienM | eastern | 18:25 |
| EmilienM | sshnaidm: nothing urgent, we can talk about it later this week | 18:25 |
| sshnaidm | EmilienM, ok, then I'll look at it today and let's sync tomorrow when you're here | 18:26 |
| sshnaidm | EmilienM, ok | 18:26 |
| EmilienM | bnemec, dprince: I have another patch for composable CI jobs, all green https://review.openstack.org/#/c/362504/ | 18:27 |
| *** nyechiel has quit IRC | 18:28 | |
| *** tesseract- has quit IRC | 18:30 | |
| *** tesseract- has joined #tripleo | 18:30 | |
| *** jdob has quit IRC | 18:30 | |
| *** tesseract- has quit IRC | 18:30 | |
| *** jdob has joined #tripleo | 18:31 | |
| *** tesseract- has joined #tripleo | 18:31 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-docs: Switch docs to use tripleo-build-images https://review.openstack.org/337669 | 18:32 |
| *** yamahata has quit IRC | 18:37 | |
| *** tesseract- has quit IRC | 18:37 | |
| openstackgerrit | Merged openstack/tripleo-incubator: Replace sshnaidm SSH public key https://review.openstack.org/362824 | 18:38 |
| *** fragatin_ has quit IRC | 18:38 | |
| *** rbrady has quit IRC | 18:38 | |
| *** egafford1 has joined #tripleo | 18:41 | |
| sshnaidm | pabelanger, hi | 18:43 |
| *** myoung is now known as myoung|bbl | 18:43 | |
| sshnaidm | pabelanger, I use on rh1 cloud the template-centos-7-1472086539 image as undercloud, but I don't see there /etc/nodepool/provider. /etc/nodepool dir is empty. Do you know what could be a problem? | 18:44 |
| *** egafford has quit IRC | 18:44 | |
| pabelanger | sshnaidm: how did you launch it? | 18:45 |
| sshnaidm | pabelanger, with ovb | 18:45 |
| pabelanger | sshnaidm: okay, manually? That info is populated by nodepool | 18:45 |
| sshnaidm | pabelanger, create-env etc | 18:45 |
| sshnaidm | pabelanger, yeah, manually. On which step is it populated? | 18:45 |
| sshnaidm | pabelanger, I thought is comes with this already | 18:46 |
| pabelanger | no, there is a process in nodepool.o.o, when we launch a node we first try to SSH into it, if we can, then we populate the provider / node information | 18:46 |
| pabelanger | your create-env process will need to do that | 18:47 |
| pabelanger | or we see how to get nodepool.o.o to manage OVB | 18:47 |
| sshnaidm | not good.. but how can it get this info and from where | 18:47 |
| *** dsariel has quit IRC | 18:47 | |
| *** yamahata has joined #tripleo | 18:48 | |
| sshnaidm | at least those AFS mirrors and env vars that are required for toci_gate_test.sh | 18:48 |
| pabelanger | since you launch ovb from your test jobs, you'll have to sync of the data from /etc/nodepool from the zuul worker | 18:49 |
| sshnaidm | pabelanger, ok, how do I do it? | 18:50 |
| pabelanger | sshnaidm: http://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/nodepool.py#n630 is the process | 18:50 |
| pabelanger | that nodepool uses today | 18:50 |
| *** ramishra has quit IRC | 18:50 | |
| *** etp has quit IRC | 18:50 | |
| pabelanger | sshnaidm: how do you copy data to ovb nodes today? | 18:50 |
| *** saneax-_-|AFK is now known as saneax | 18:51 | |
| *** abregman has quit IRC | 18:51 | |
| *** jtomasek has quit IRC | 18:51 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Add env. setup for virt deployments doc https://review.openstack.org/363120 | 18:51 |
| sshnaidm | pabelanger, what do you mean? undercloud image I have it there already as "template_centos-<timestamp>" | 18:51 |
| *** ianw has quit IRC | 18:51 | |
| *** apetrich has quit IRC | 18:52 | |
| *** jrist has quit IRC | 18:52 | |
| *** NobodyCam has quit IRC | 18:52 | |
| *** cmyster has quit IRC | 18:52 | |
| *** therve has quit IRC | 18:52 | |
| *** ramishra has joined #tripleo | 18:52 | |
| pabelanger | sshnaidm: right, so after the ovb node is online, scp /etc/nodepool/providers ovh_node:/etc/nodepool/providers, then run your test | 18:53 |
| *** cmyster has joined #tripleo | 18:53 | |
| sshnaidm | pabelanger, but I don't have /etc/nodepool/providers anywhere, that's the problem | 18:53 |
| *** yolanda has quit IRC | 18:53 | |
| sshnaidm | pabelanger, you said it's populated when nodepool takes this image for job, right? | 18:54 |
| *** rbrady has joined #tripleo | 18:54 | |
| pabelanger | sshnaidm: are you saying it is failing in the gate or for manual testing? | 18:54 |
| *** NobodyCam has joined #tripleo | 18:54 | |
| sshnaidm | pabelanger, manual testing on the cloud, it should be the same as in jobs, but without nodepool | 18:54 |
| sshnaidm | pabelanger, https://etherpad.openstack.org/p/tripleo-ci-devenvs | 18:55 |
| *** etp has joined #tripleo | 18:56 | |
| *** therve has joined #tripleo | 18:56 | |
| pabelanger | sshnaidm: logic needs to be added to toc_gate_test.sh to support this then. Because, this works today in the gate right? Otherwise ovb nodes would not be able to access the AFS mirror | 18:58 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Update section header indicators https://review.openstack.org/360522 | 18:58 |
| pabelanger | but, from a tripleo-centos-7 node, you'd scp the nodepool info to the ovb node | 18:58 |
| sshnaidm | pabelanger, I think nodepool/zuul inject there these dirs when starting the job, and I don't have it because don't use them | 18:58 |
| pabelanger | since nodepool doesn't manage OVH | 18:58 |
| pabelanger | sshnaidm: yes, nodepool will add them to tripleo-centos-7 nodes | 18:59 |
| pabelanger | not ovh | 18:59 |
| pabelanger | ovb* | 18:59 |
| sshnaidm | pabelanger, yeah, I'm looking how to do it, so the question - can I get the data from anywhere? | 18:59 |
| pabelanger | /etc/nodepool/provider on tripleo-centos-7 nodes | 18:59 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Update section header indicators https://review.openstack.org/360522 | 19:00 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Add env. setup for virt deployments doc https://review.openstack.org/363120 | 19:00 |
| bnemec | Excellent. I think we may indeed have broken ipv6. | 19:00 |
| bnemec | Error: Error from DataBinding 'hiera' while looking up 'tripleo::trusted_cas::ca_map': (<unknown>): found unexpected ':' while scanning a plain scalar at line 102 column 32 on node overcloud-novacompute-0.localdomain | 19:00 |
| sshnaidm | pabelanger, sorry, I meant nodepool injects it to tripleo-centos-7 nodes - so I don't have it there right now | 19:00 |
| bnemec | Seems to be unhappy about this line: nova::compute::vncproxy_host: [2001:db8:fd00:1000::14] | 19:01 |
| pabelanger | sshnaidm: which server are you looking at? | 19:01 |
| sshnaidm | pabelanger, I'll reformulate - can I get this info without any involvment of nodepool? | 19:01 |
| sshnaidm | pabelanger, for example template-centos-7-1472086539 on rh1 cloud | 19:01 |
| pabelanger | sshnaidm: you can, once you have /etc/nodepool/provider the contents are static. you'll be able to reuse it mulitple times in tripleo-test-cloud-rh1, however I would not manually manage the file | 19:03 |
| pabelanger | in case we make changes in openstack-infra | 19:03 |
| *** jtomasek has joined #tripleo | 19:03 | |
| pabelanger | sshnaidm: http://paste.openstack.org/show/564885/ is all the file contains | 19:04 |
| *** apetrich has joined #tripleo | 19:04 | |
| sshnaidm | pabelanger, in best case I wanted to do it transparent for CI, without additional patches.. seems like it's not the case | 19:04 |
| *** abregman has joined #tripleo | 19:05 | |
| *** david-lyle_ is now known as david-lyle | 19:05 | |
| pabelanger | sshnaidm: Can you provide more context? I am having a hard time following what the issue is | 19:05 |
| sshnaidm | pabelanger, sorry need to leave now, I'll talk to you tomorrow then, when you'll have a time, is it ok? maybe in bluejeans it'll be faster to explain | 19:07 |
| pabelanger | ok | 19:07 |
| *** jrist has joined #tripleo | 19:07 | |
| *** jrist has joined #tripleo | 19:07 | |
| sshnaidm | for now will try you file, thanks | 19:07 |
| *** sshnaidm is now known as sshnaidm|afk | 19:08 | |
| *** coolsvap_ has quit IRC | 19:12 | |
| hrybacki | trown: do you have time to BJ about docs? | 19:14 |
| *** mcornea has quit IRC | 19:14 | |
| trown | hrybacki: sure | 19:15 |
| pabelanger | sshnaidm|afk: if you are trying to get reproducibility CI build downstream from zuul / nodepool. I wouldn't spend too much time write code. We are already working on solving that issue with zuulv3. We already have the ansible playbooks created today, for somebody to re-run a job. EG: http://logs.openstack.org/10/346510/3/check/gate-openstack-ansible-docs-ubuntu-xenial/9b5a401/_zuul_ansible/playbook | 19:15 |
| pabelanger | and we can solve for the issue of launching a cloud resource today with ansible | 19:16 |
| *** vijaykc4 has joined #tripleo | 19:16 | |
| hrybacki | trown: https://bluejeans.com/8559013623 | 19:16 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Enable modern authtoken for Neutron and Glance https://review.openstack.org/362980 | 19:19 |
| *** mlupton has joined #tripleo | 19:21 | |
| *** ianw_ has joined #tripleo | 19:28 | |
| saneax | For bp/sriov to close these needs a workflow, jenkins passed - https://review.openstack.org/#/c/361430/ | 19:30 |
| *** dprince has quit IRC | 19:35 | |
| ayoung | trown, any clue? Need any help debugging it? | 19:35 |
| trown | ayoung: something is failing in the update image part of devmode and I was hoping it was something with a cached image so I tried nuking all my old images, but hit the same thing | 19:37 |
| openstackgerrit | Mathieu Mitchell proposed openstack/diskimage-builder: (WIP) Zuul-cloner second attempt https://review.openstack.org/363013 | 19:38 |
| *** jcoufal has quit IRC | 19:38 | |
| ayoung | trown, I'm running again now redirecting to a logfile trying to get a better error message | 19:38 |
| ayoung | it was not clear what actually failed | 19:38 |
| trown | ya | 19:39 |
| *** rcernin has joined #tripleo | 19:39 | |
| openstackgerrit | Mathieu Mitchell proposed openstack/diskimage-builder: (WIP) Zuul-cloner third attempt https://review.openstack.org/363013 | 19:39 |
| *** jcoufal has joined #tripleo | 19:40 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Bump tempest version to latest https://review.openstack.org/355641 | 19:42 |
| *** fragatina has joined #tripleo | 19:43 | |
| openstackgerrit | Martin André proposed openstack/puppet-tripleo: Manage tripleo-ui configuration files with puppet https://review.openstack.org/363167 | 19:43 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Add fluentd client service https://review.openstack.org/353506 | 19:45 |
| EmilienM | bnemec: another one ready https://review.openstack.org/#/c/361412/ | 19:48 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Availability monitoring agents support https://review.openstack.org/254788 | 19:50 |
| *** dprince has joined #tripleo | 19:50 | |
| *** fzdarsky is now known as fzdarsky|afk | 19:52 | |
| flaper87 | Slower: thanks | 19:53 |
| *** akshai has joined #tripleo | 19:53 | |
| *** jcoufal has quit IRC | 19:54 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: midonet: update neutron parameter https://review.openstack.org/363178 | 19:59 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Add fluentd client service https://review.openstack.org/353506 | 20:00 |
| *** shardy has quit IRC | 20:02 | |
| ayoung | trown, so...the image errors went away, and I am back to | 20:04 |
| ayoung | + openstack baremetal import --json instackenv.json | 20:04 |
| ayoung | Invalid input [name=tripleo.baremetal.v1.register_or_update, class=DirectWorkflowSpec, unexpected=[u'instance_boot_option']] | 20:04 |
| *** shardy has joined #tripleo | 20:05 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Add fluentd client service https://review.openstack.org/353506 | 20:05 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Last round of modern authtoken update https://review.openstack.org/363182 | 20:05 |
| trown | ayoung: hmm... I am still stuck on the image update errors | 20:06 |
| trown | trying to boot up the undercloud.qcow2 to manually hack on it since the virt-customize output isnt helping | 20:07 |
| *** jcoufal has joined #tripleo | 20:08 | |
| shardy | pradk: Hey re your Redis issue, try openstack stack environment show overcloud | grep RedisPassword | 20:09 |
| shardy | that should tell you if the problem is with the value passed by the client, or something wrong in the templates/puppet | 20:10 |
| EmilienM | shardy: fyi we found this issue with my scenario testing work, scenario001 fails to run Gnocchi API calls | 20:10 |
| ayoung | trown, what is "capabilities": "profile:{{ node.flavor }},boot_option:local" | 20:11 |
| ayoung | in instackenv.json.j2 | 20:11 |
| shardy | EmilienM: Yeah I think that's what pradk is investigating, and it's been traced to a misconfiguration related to Redis | 20:11 |
| *** pradk has quit IRC | 20:11 | |
| trown | ayoung: that is the capabilities that get applied to the node in ironic, it is used to match nodes to the correct roles | 20:12 |
| shardy | (unless your failure is some other issue) | 20:12 |
| EmilienM | shardy: no it's the same | 20:12 |
| shardy | EmilienM: pradk was saying the hiera for the redis password was unset, so the first step is the command above to check the parameter is set | 20:13 |
| EmilienM | shardy: do we need this parameter manually set or is ther a default? | 20:13 |
| shardy | then work backwards from the hieradata files on the node | 20:13 |
| shardy | EmilienM: it's set inside python-tripleoclient | 20:13 |
| ayoung | $ openstack baremetal import --json instackenv.json | 20:13 |
| ayoung | Invalid input [name=tripleo.baremetal.v1.register_or_update, class=DirectWorkflowSpec, unexpected=[u'instance_boot_option']] | 20:13 |
| EmilienM | ok so the template in CI should be good | 20:13 |
| shardy | we never set defaults for passwords inside the templates | 20:13 |
| EmilienM | right | 20:14 |
| ayoung | seems to happen whether I have that boot_option:local value or not | 20:14 |
| EmilienM | shardy: have you gone through all bugs for triage? I finally have time now | 20:14 |
| shardy | EmilienM: Not yet, been busy with other things this afternoon | 20:16 |
| *** pradk has joined #tripleo | 20:16 | |
| *** akrivoka has quit IRC | 20:16 | |
| shardy | any help appreciated, but I know you're busy so don't spend too much time on it | 20:16 |
| *** dsariel has joined #tripleo | 20:18 | |
| trown | ayoung: I am pretty confused... booted the undercloud that was failing in that update script and ran yum update manually successfully... maybe devmode is indeed borked atm... I will continue to dig on it tomorrow, but in the meantime you could use the CDN location to pull a master image for RDO | 20:20 |
| trown | it is only a couple days old | 20:20 |
| trown | http://buildlogs.centos.org/centos/7/cloud/x86_64/tripleo_images/master/delorean/ | 20:20 |
| ayoung | trown, but that does not seem to be what is killing my installs | 20:20 |
| EmilienM | shardy: there are 61 bugs not triaged | 20:21 |
| EmilienM | shardy: in "new" status | 20:21 |
| ayoung | this is with the JSON used to enroll nodes, and I've had a consistent error with it, module some other things messing up earlier in the process | 20:21 |
| EmilienM | shardy: I'll try to get them triaged at least | 20:21 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add missing reference to ExternalPort for DVR https://review.openstack.org/363188 | 20:22 |
| *** jayg is now known as jayg|g0n3 | 20:22 | |
| trown | ayoung: ya, nothing has changed with that instackenv.json in months | 20:22 |
| ayoung | trown, then it is something in Ironic? | 20:23 |
| ayoung | No one else is seeing this, are they: | 20:23 |
| trown | ayoung: so it has to be some issue with the set of packages we are getting via devmode | 20:23 |
| ayoung | hmmm, ok | 20:23 |
| ayoung | trown, so ~/.quickstart/tripleo-quickstart/quickstart.sh --release master ayoung-dell-t1700.test \ | 20:24 |
| trown | the error is a cryptic mistral error... so I am not sure exactly what is going on there, and I can not even get my environment to that point | 20:24 |
| ayoung | --? | 20:24 |
| openstackgerrit | Mathieu Mitchell proposed openstack/diskimage-builder: Introduce 'zuul' as a new source-repositories type https://review.openstack.org/363013 | 20:24 |
| trown | ayoung: "--extra-vars undercloud_image_url=http://buildlogs.centos.org/centos/7/cloud/x86_64/tripleo_images/master/delorean/undercloud.qcow2" | 20:24 |
| beagles | trown, ayoung, I was just running into this today after updating | 20:25 |
| beagles | trown, ayoung I was able to resolve | 20:25 |
| beagles | looking for what I did | 20:26 |
| *** saneax is now known as saneax-_-|AFK | 20:27 | |
| EmilienM | dprince: can you make auto triage when you file a bug? example with https://bugs.launchpad.net/tripleo/+bug/1618488 | 20:27 |
| openstack | Launchpad bug 1618488 in tripleo "upload-swift-artifacts fails with: More than one endpoint exists with the name 'swift'." [Undecided,New] | 20:27 |
| EmilienM | is it for rc1 ? | 20:27 |
| EmilienM | can it slip to ocata? | 20:27 |
| EmilienM | i'll let you change infos on the bug | 20:27 |
| EmilienM | shardy: same for you https://bugs.launchpad.net/tripleo/+bug/1618441 | 20:28 |
| openstack | Launchpad bug 1618441 in tripleo "ovb job fails to find eth1 nic" [Undecided,New] | 20:28 |
| EmilienM | shardy: we have "ci" tag to track all CI bugs | 20:28 |
| beagles | ayoung, trown: openstack workbook update /usr/share/tripleo-common/workbooks/baremetal.yaml or some such | 20:28 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Add env. setup for virt deployments doc https://review.openstack.org/363120 | 20:28 |
| ayoung | beagles, which issue did that resolve? | 20:29 |
| beagles | ayoung, Invalid input [name=tripleo.baremetal.v1.register_or_update, class=DirectWorkflowSpec, unexpected=[u'instance_boot_option']] | 20:30 |
| EmilienM | I need to remind everyone again to make auto triage when filing a bug | 20:30 |
| EmilienM | we have so much new bugs every day not triaged :( | 20:30 |
| beagles | ayoung, or are you running into something else now | 20:30 |
| ayoung | beagles, nah, that is the problem | 20:30 |
| trown | hmm shouldnt that happen as part of the undercloud install though | 20:31 |
| ayoung | beagles, any idea of parameters? I have never seen the 'workbook' subcommand before | 20:31 |
| *** hrybacki is now known as hrybacki|afk | 20:31 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Added DPDK environment file and nic configs samples https://review.openstack.org/361238 | 20:32 |
| beagles | trown, it should.. if there was a yum update after install it might pull it in | 20:32 |
| beagles | ayoung, it's a consequence of moving to mistral for some bits | 20:32 |
| trown | that seems like a bug that we might be masking in tripleo-ci | 20:32 |
| beagles | trown, sorry.. it might pull incompatible changes in. | 20:33 |
| openstackgerrit | Mathieu Mitchell proposed openstack/diskimage-builder: Introduce 'zuul' as a new source-repositories type https://review.openstack.org/363013 | 20:33 |
| *** rcernin has quit IRC | 20:33 | |
| *** rcernin has joined #tripleo | 20:33 | |
| ayoung | beagles, OK, walk me through this. I can list the workbooks, and I see the one you refernce | 20:34 |
| ayoung | openstack workbook show tripleo.baremetal.v1 shows a very short summary | 20:34 |
| *** trown is now known as trown|outtypewww | 20:35 | |
| ayoung | I can read through the whole /usr/share/tripleo-common/workbooks/baremetal.yaml file, but how do I know what is actiely being executed? | 20:35 |
| beagles | ayoung, yep. tbh, ianae - I just pick up on tidbits | 20:35 |
| beagles | ayoung, oh that's a big question :) | 20:36 |
| shardy | EmilienM: I didn't self triage that because it was reported by someone else on IRC | 20:36 |
| shardy | I can do it though I suppose | 20:36 |
| EmilienM | shardy: thanks | 20:36 |
| ayoung | beagles, help has a strang thing | 20:36 |
| ayoung | workbook show definition | 20:36 |
| shardy | All CI bugs can go to the ongoing milestone instead of rc1 I think | 20:36 |
| ayoung | but...that is not an executable command | 20:36 |
| EmilienM | shardy: sorry, so many bugs | 20:36 |
| ayoung | openstack workbook show definition | 20:36 |
| ayoung | Workbook not found [workbook_name=definition] | 20:36 |
| shardy | EmilienM: Yeah, thanks for the help! :) | 20:37 |
| beagles | ayoung: should be openstack workbook show tripleo.baremetal.v1 or the UUID that shows up in the list | 20:37 |
| ayoung | no UUID | 20:38 |
| ayoung | beagles, http://paste.openstack.org/show/564887/ | 20:38 |
| beagles | ayoung, I might be confusing with openstack workflow list | 20:38 |
| beagles | ayoung, but anyways the name should work (else a bug) | 20:39 |
| ayoung | but... I see in workflow list... | 20:39 |
| ayoung | 049ee948-2517-4b0d-9b8a- | tripleo.baremetal.v1.register_or | fee8ef3e33254a4f9baad3f600d9b995 | <none> | nodes_json, remove=False,... | 2016-08-30 20:02:41 | None | 20:39 |
| *** ianw_ is now known as ianw | 20:39 | |
| ayoung | so that is the failing operation | 20:40 |
| ayoung | workflow show definition | 20:41 |
| ayoung | also does not work | 20:41 |
| beagles | ayoung, there is a bug in the help text | 20:41 |
| ayoung | should there be a hyphen or something? | 20:42 |
| beagles | ayoung, what I suspect has happened is that the workbooks were created before tripleo-common was updated or something like that so it is firing data into mistral that it does not know about and won't accept | 20:43 |
| ayoung | beagles, so I need an updated tripleo-common? | 20:43 |
| beagles | ayoung, so by updating the workbook you bring things up to sync. It's similar to updating code and having to run the whatevercomponent-db-sync so that the db tables are in sync with the cod | 20:44 |
| ayoung | openstack-tripleo-common-5.0.0-0.20160823132420.be5b0d3.el7.centos.noarch | 20:44 |
| beagles | ayoung, actually what I said is that your tripleo-common is already up to date, mistral needs new data | 20:44 |
| ayoung | beagles, so I ran the command you suggested but no change | 20:44 |
| ayoung | openstack workbook update /usr/share/tripleo-common/workbooks/baremetal.yaml | 20:45 |
| beagles | ayoung, ah okay | 20:45 |
| ayoung | beagles, doing that should load something into mistral, right>? | 20:45 |
| ayoung | and how do I see that something? | 20:45 |
| *** myoung|bbl is now known as myoung | 20:45 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Add fluentd client service https://review.openstack.org/353506 | 20:46 |
| ayoung | short of looking direcly in the database, which I am totally ready to do | 20:46 |
| beagles | ayoung, something should.. mmm. is the 'instance_boot_option' in that file | 20:46 |
| beagles | ayoung, ie. does "grep instance_boot_option /usr/share/tripleo-common/workbooks/baremetal.yaml" find anything? | 20:46 |
| ayoung | nothing | 20:47 |
| ayoung | grep boot /usr/share/tripleo-common/workbooks/baremetal.yaml | 20:47 |
| ayoung | Bupkis | 20:47 |
| beagles | ayoung: ah... yeah mmm. Seems like there is more amiss than what I was suggesting | 20:49 |
| ayoung | beagles, is there a mistral CLI? | 20:49 |
| beagles | ayoung, either your working set of packages is out of sync or there is a bug in those packages | 20:50 |
| beagles | ayoung, sure, you were just using it I think | 20:50 |
| *** adarazs has quit IRC | 20:50 | |
| ayoung | mistral workbook-get-definition tripleo.baremetal.v1 | grep boot | 20:50 |
| ayoung | nothing there.... | 20:50 |
| * beagles nods | 20:51 | |
| *** adarazs has joined #tripleo | 20:52 | |
| beagles | ayoung, if you are using a version of the tripleoclient that does have that option and mistral doesn't know about it then I could imagine there being issues | 20:53 |
| ayoung | beagles, let me see where mistral is, then,.... | 20:53 |
| *** shardy has quit IRC | 20:53 | |
| beagles | ayoung, check if your version of python-tripleoclient and tripleo-common are in sync, of similar source repos, etc. | 20:54 |
| *** lblanchard has quit IRC | 20:54 | |
| beagles | ayoung, outside of that .. I dunno. I just piece bits together as I go. | 20:54 |
| ayoung | beagles, would that be mistral server that needs to be updated? | 20:55 |
| ayoung | python-openstack-mistral-3.0.0-0.20160823132139.bb92ee9.el7.centos.noarch | 20:55 |
| *** yolanda has joined #tripleo | 20:55 | |
| ayoung | pretty recent | 20:55 |
| ayoung | but aweek old | 20:55 |
| ayoung | openstack-tripleo-common-5.0.0-0.20160823132420.be5b0d3.el7.centos.noarch | 20:55 |
| dprince | EmilienM: ack on auto-triage | 20:55 |
| ayoung | they look in sync to me | 20:56 |
| beagles | ayoung, no I don't thinks so. Mistral should not care about this.. it would be a problem with the workbooks/workflows and whatever is trying to use them | 20:56 |
| beagles | ayoung, ie. the tripleoclient maybe? | 20:56 |
| ayoung | rpmquery -f /usr/share/tripleo-common/workbooks/baremetal.yaml | 20:57 |
| ayoung | openstack-tripleo-common-5.0.0-0.20160823132420.be5b0d3.el7.centos.noarch | 20:57 |
| *** chem has quit IRC | 20:57 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Availability monitoring agents support https://review.openstack.org/254788 | 21:01 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates: De-bracket vncproxy_host in compute profile https://review.openstack.org/363204 | 21:01 |
| *** egafford1 has quit IRC | 21:01 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates: De-bracket vncproxy_host in compute profile https://review.openstack.org/363204 | 21:02 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Add fluentd client service https://review.openstack.org/353506 | 21:03 |
| *** radeks has joined #tripleo | 21:07 | |
| *** jcoufal has quit IRC | 21:08 | |
| *** dprince has quit IRC | 21:08 | |
| *** mlupton has quit IRC | 21:10 | |
| beagles | launchpad is unhappy | 21:10 |
| *** radeks has quit IRC | 21:11 | |
| *** jcoufal has joined #tripleo | 21:12 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart: WIP: Add directory to store documentation files https://review.openstack.org/361483 | 21:12 |
| *** rhallisey has quit IRC | 21:16 | |
| *** ayoung has quit IRC | 21:19 | |
| openstackgerrit | Merged openstack/os-collect-config: Merge deployments data for zaqar collectors https://review.openstack.org/343835 | 21:19 |
| *** maeca1 has quit IRC | 21:22 | |
| *** rhefner has joined #tripleo | 21:23 | |
| *** mlupton has joined #tripleo | 21:26 | |
| *** morazi has quit IRC | 21:26 | |
| *** yolanda has quit IRC | 21:28 | |
| *** rlandy is now known as rlandy|brb | 21:28 | |
| *** dbecker has quit IRC | 21:29 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Last round of modern authtoken update https://review.openstack.org/363182 | 21:34 |
| *** dsariel has quit IRC | 21:36 | |
| *** jeckersb is now known as jeckersb_gone | 21:36 | |
| *** jcoufal has quit IRC | 21:43 | |
| *** jcoufal has joined #tripleo | 21:46 | |
| openstackgerrit | Jeff Peeler proposed openstack/tripleo-common: Include environments in capabilities output https://review.openstack.org/355598 | 21:47 |
| *** mlupton has quit IRC | 21:48 | |
| *** mlupton has joined #tripleo | 21:48 | |
| *** ppradhan has left #tripleo | 21:53 | |
| *** rlandy|brb is now known as rlandy | 21:56 | |
| *** jcoufal has quit IRC | 21:58 | |
| *** jcoufal has joined #tripleo | 22:03 | |
| *** rajinir has quit IRC | 22:05 | |
| *** vijaykc4 has quit IRC | 22:12 | |
| *** akuznetsov has joined #tripleo | 22:13 | |
| *** cdearborn has quit IRC | 22:14 | |
| *** vijaykc4 has joined #tripleo | 22:18 | |
| *** ianw has quit IRC | 22:26 | |
| *** rlandy has quit IRC | 22:27 | |
| *** apetrich has quit IRC | 22:28 | |
| *** apetrich has joined #tripleo | 22:30 | |
| *** jrist has quit IRC | 22:32 | |
| *** akuznetsov has quit IRC | 22:33 | |
| *** jrist has joined #tripleo | 22:39 | |
| openstackgerrit | Merged openstack/instack-undercloud: configure heat with new authtoken parameters https://review.openstack.org/361409 | 22:42 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Move ceph cluster config out of allNodesConfig https://review.openstack.org/355067 | 22:45 |
| *** Ryjedo_ has joined #tripleo | 22:53 | |
| *** mpsairam has quit IRC | 22:54 | |
| *** Ryjedo has quit IRC | 22:54 | |
| *** Ryjedo_ is now known as Ryjedo | 22:54 | |
| *** mpsairam has joined #tripleo | 22:55 | |
| *** ianw has joined #tripleo | 22:57 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Wire in jinja templating for custom roles https://review.openstack.org/362465 | 22:57 |
| *** ayoung has joined #tripleo | 22:59 | |
| *** pradk has quit IRC | 23:00 | |
| *** hrybacki|afk is now known as hrybacki | 23:10 | |
| *** saneax-_-|AFK is now known as saneax | 23:12 | |
| *** abregman has quit IRC | 23:14 | |
| *** abregman has joined #tripleo | 23:16 | |
| *** mlupton has quit IRC | 23:28 | |
| *** rcernin has quit IRC | 23:35 | |
| *** jcoufal has quit IRC | 23:35 | |
| *** mlupton has joined #tripleo | 23:41 | |
| *** mlupton has quit IRC | 23:45 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!