Friday, 2017-06-09

*** jamielennox|away is now known as jamielennox00:02
*** toure is now known as toure|gone00:26
*** FL1SK has joined #openstack-mistral00:33
*** FL1SK has quit IRC00:47
*** zhurong has joined #openstack-mistral00:49
*** jamielennox is now known as jamielennox|away01:00
*** jamielennox|away is now known as jamielennox01:10
*** bobh has joined #openstack-mistral01:25
*** zhurong has quit IRC01:29
*** bobh has quit IRC01:34
*** zhurong has joined #openstack-mistral02:04
*** FL1SK has joined #openstack-mistral03:02
*** bobh has joined #openstack-mistral03:29
*** gkadam has joined #openstack-mistral03:38
*** bobh has quit IRC03:43
*** bobh has joined #openstack-mistral03:45
*** bobh has quit IRC03:45
*** bobh has joined #openstack-mistral03:47
*** bobh has quit IRC03:50
*** zhurong has quit IRC04:25
*** zhurong has joined #openstack-mistral04:33
*** jaosorior has joined #openstack-mistral06:18
*** zhurong has quit IRC06:55
*** zhurong has joined #openstack-mistral06:56
*** shardy has joined #openstack-mistral06:56
*** zhurong has quit IRC06:57
*** amoralej|off is now known as amoralej07:07
openstackgerritJeffreyGuan proposed openstack/mistral master: This is only a minor defect in README.rst.  https://review.openstack.org/47255207:28
*** jpich has joined #openstack-mistral07:55
*** dtantsur|sick is now known as dtantsur08:48
openstackgerritVan Hung Pham proposed openstack/mistral master: Optimize the link address  https://review.openstack.org/47260109:21
*** zhurong has joined #openstack-mistral09:54
*** zhurong has quit IRC10:06
*** jkilpatr has joined #openstack-mistral10:59
*** shardy has quit IRC12:08
*** rbrady-afk is now known as rbrady12:08
*** shardy has joined #openstack-mistral12:17
*** bobh has joined #openstack-mistral12:18
*** bobh has quit IRC12:27
*** amoralej is now known as amoralej|lunch12:29
*** jaosorior has quit IRC12:37
*** catintheroof has joined #openstack-mistral12:40
*** shardy has quit IRC12:43
*** catintheroof has quit IRC12:45
*** catintheroof has joined #openstack-mistral12:46
fultonjrbrady: d0ugal wanted to run something by you regarding the mistral user's home dir and its impact on mistral-ansible-actions .12:54
fultonjwhen you have a minute12:54
rbradyfultonj: ack12:55
rbradyfultonj: I'm free for about 30 min12:55
fultonjrbrady: ok, thanks12:55
*** shardy has joined #openstack-mistral12:56
rbradyfultonj: am I supposed to contact d0ugal?13:06
fultonjrbrady: no, if he was there i just wanted to share it with him13:06
rbradyfultonj: ahh...the lack of a comma made it sound like you were delivering a message that he wanted to talk to me13:07
rbradyfultonj: he's got an appt this morning and won't likely be around until later13:07
*** bobh has joined #openstack-mistral13:11
fultonjrbrady: sorry someone called me; if you want to ping me when you're free i can show you my idea regarding the home dir. I can see how my message wasn't clear (i want to run it by you, not d0ugal)13:17
fultonj(or d0ugal doesn't have somthing to tell you regarding it (/me having ambiguity of language issues))13:18
rbradyfultonj: I've got a call in a few minutes, will ping you afterwards13:21
fultonjthanks13:21
*** toure|gone is now known as toure13:27
openstackgerritThomas Herve proposed openstack/mistral master: Always retrieve endpoint in mistral action  https://review.openstack.org/47268213:37
*** amoralej|lunch is now known as amoralej13:38
*** chlong has joined #openstack-mistral13:51
*** jaosorior has joined #openstack-mistral13:56
*** gkadam_ has joined #openstack-mistral14:26
*** gkadam has quit IRC14:26
*** gkadam_ has quit IRC14:31
d0ugalfultonj, rbrady - hey, I can help now.14:32
* d0ugal reads up14:32
fultonjhi d0ugal14:33
fultonjMistral's home directory is set to /home/mistral [1], as per the RDO package I suspect, but that directory does not exist. It should be set to an existing directory and doing so fixes a problem with Mistral ansible actions.14:33
fultonji have the details here14:34
fultonjhttps://github.com/fultonj/tripleo-ceph-ansible/issues/1214:34
d0ugalfultonj: any idea what directory it should be set to?14:35
fultonji don't know the back story with Mistral's home dir14:35
d0ugalfultonj: I suspect it was just a decision made in the packaging?14:36
fultonjyeah, i think so14:36
fultonjbut i wasn't sure if there was a story behind it14:36
d0ugalfultonj: honestly this stuff is over my head, but I fairly sure that Mistral doesn't need that directory - since it doesn't exist I guess that is the case :)14:36
fultonjright it certainly doesn't need it14:36
d0ugalShould we have that directory created? if not, what should it be changed to?14:37
d0ugalfultonj: is the issue that ansible wants to create temp files in the home directory?14:37
fultonjansible likes to write temp files SOMEWHERE14:37
d0ugalright14:37
fultonjexactly14:37
fultonjif i configure ansible on the server to always use a central place that runs into issues14:37
fultonjsuppose i globally tell ansible write temp files to /tmp/foo14:38
fultonjthe first user to use ansible then gets their permissions attached to /tmp/foo/.ansible14:38
fultonjso the mitral user is happy but not the stack user14:38
fultonjpoint is14:38
fultonjso far all mistral actions have managed their temp files in their own way OR not needed them14:39
fultonjit seems ^14:39
d0ugalright14:40
d0ugalI would probably ask for help in #rdo to ask if we should create the directory or change it.14:40
d0ugalTo pick a random project, Heat seems to use a shared directory: https://github.com/rdo-packages/heat-distgit/blob/rpm-master/openstack-heat.spec#L32414:40
fultonji could they will probably want mistrallers opinions14:40
d0ugalThat would be fine for us too I think14:40
rbradyI concur with d0ugal on the shared dir14:41
fultonj /var/lib/heat14:41
fultonjis what heat gets14:41
fultonji could request of the RDO packager to make14:41
fultonj /var/lib/mistral and set the msitral user's home to that14:41
fultonjwanted to check here if that's OK14:42
rbradyfultonj: can't we just submit a change to the specfile in the distgit ?14:42
fultonjrbrady: yeah14:42
fultonjin theory14:42
fultonj:)14:42
d0ugalfultonj: that sounds good to me.14:42
fultonjok, thanks14:43
fultonjif you didn't want that done for some mistrally reason14:43
fultonjthen i was tweaking the playbook action14:43
fultonjto temporarily set HOME for the playbook run14:43
*** Dinesh_Bhor has quit IRC14:44
fultonji gather you prefer the RDO pkg approach?14:44
rbradyfultonj: I do14:44
fultonjhere's a hack http://paste.openstack.org/raw/612140/14:45
fultonjbut i think i can use ansible's environment https://docs.ansible.com/ansible/playbooks_environment.html14:45
d0ugalthe pkg change seems cleaner :)14:45
fultonjcool14:45
fultonji like it too14:45
fultonjthanks guys14:45
*** jaosorior has quit IRC15:09
*** dtantsur is now known as dtantsur|afk15:19
* flaper87 back15:30
flaper87flaper87: do I have to read all the messages or is there a tl;dr ?15:30
flaper87:D15:30
flaper87fultonj: ^15:30
* flaper87 is talking to himself15:30
flaper87it's friday after all15:30
fultonjflaper87: i can tl;dr it15:31
fultonjone sec15:32
fultonjflaper87: the mistral user's home dir is set to /home/mistral as per the RDO package15:35
fultonjhttps://github.com/rdo-packages/mistral-distgit/blob/rpm-master/openstack-mistral.spec#L281-L28915:35
fultonjthis has never been a problem, but that dir doesn't exist15:36
fultonjansible wants to write temp files somewhere15:36
fultonjso i am going to propose the mistral package gets upated to make a real home dir15:37
fultonjelse mistral-ansible-actions won't work15:37
fultonjflaper87: you listed 3 workarounds you did in your kargo/ansible change15:38
fultonji'm trying to make it so you don't need them15:38
flaper87fultonj: mmh, but, I think we could tell ansible where this files should be written15:39
flaper87I'd rather configure ansible.cfg than changing the package, tbh15:39
fultonjflaper87: i tried that but it wasn't sufficient15:40
flaper87my current problems are mostly related to the ssh_keys and playbooks having to be readable by the mistral user15:40
flaper87fultonj: oh, really?15:40
flaper87mmh15:40
flaper87interesting15:40
flaper87perhaps something we should fix in ansible?15:40
fultonjflaper87: i will gladly explain the issues15:40
flaper87fultonj: please do15:40
fultonjtwo problems with just updating ansible.cfg15:41
fultonj1. setting local temp to /tmp/.ansible works on the first run by Mistral:15:42
fultonjlocal_tmp= /tmp/.ansible/tmp15:42
fultonjbut then the stack user cannot use ansible:15:42
fultonjansible.errors.AnsibleError: Unable to create local directories(/tmp/.ansible/tmp): [Errno 13] Permission denied: '/tmp/.ansible/tmp'15:42
fultonjCommenting out "local_tmp=/tmp/.ansible/tmp" so that it goes back to it's default15:42
fultonjof ~/.ansible is better for whichver user ran it.15:42
fultonj2. ansible, and it's modules, use $HOME quite a bit15:43
fultonjeven with local_tmp set15:43
fultonji still ran into problems15:43
fultonjbecause of $HOME expnsion to /home/mistral15:44
flaper87I think both could be solved by making the execution localized15:45
flaper87for example15:45
flaper87it's possible to set the local_tmp dir in the inventory, IIRC15:45
flaper87if not, we could create an ansible.cfg *per* mistral-action execution15:45
flaper87like copy the one from `/etc/ansible`/ to some dir in `/tmp` and use that15:45
flaper87just like we are doing for playbooks and inventories15:46
flaper87for 2 we can set the home directory to `/tmp/mistral` or something15:46
flaper87actually, tbh, I think we should. I don't really like the idea of mistral-ansible-actions depending on anything global15:46
flaper87or creating files that are not temp15:46
flaper87that sounds like a mess for whenever we'll have parallel executions of some sort15:47
flaper87thoughts ?15:47
flaper87I can help with both15:47
flaper87d0ugal: ^ you may be interested in this too15:47
fultonjrbrady: ^ ?15:47
* d0ugal reads15:48
d0ugalflaper87: parallel actions is a good point. What happens if ansible is ran multiple times?15:49
d0ugalflaper87: I'm fine with the execution being localized... but I have no idea how you do that :)15:50
flaper87d0ugal: exactly, well, right now, it'll just use global stuff15:50
flaper87d0ugal: oh, I mean, we create a "home" for each execution15:50
d0ugalWouldn't that require it being it its own process etc?15:50
flaper87instead of creating a temp file for playbook/inventory, what we can do is create a temp dir15:50
flaper87put stuff there15:50
d0ugalright15:50
flaper87and we create an ansible.cfg file there15:51
flaper87etc etc15:51
fultonjI don't think you can define HOME in ansible.cfg15:51
fultonjbasically if we just set $HOME for the execution, things are happy15:52
flaper87you can define it when you run the process15:52
flaper87:)15:52
fultonjyes15:52
fultonjhttp://paste.openstack.org/raw/612146/15:52
flaper87that's what I meant15:52
flaper87set it for the execution not ansible.cfg15:52
flaper87this shouldn't be too hard to do15:52
flaper87I can help out15:52
flaper87did the patch land in tripleo_common ?15:53
fultonjmistral ansible actions hasn't landed yet15:53
fultonjansible has a notion of enviornemnts that might help us here15:53
*** jpich has quit IRC15:53
* fultonj looks for the odc15:54
fultonjdoc15:54
flaper87yeah, that too15:54
fultonjhttp://docs.ansible.com/ansible/playbooks_environment.html15:54
fultonjflaper87: i conjecture that my setting $HOME alone for the life of the playbook run to something that the local mistral user can write to that it will solve the problem and not even require a change to ansible.cfg15:56
fultonjthat "my setting" but "by setting"15:56
fultonjs/that/not15:56
flaper87:)15:56
flaper87I like that solution, TBH15:56
d0ugalregardless of how we solve this for ansible, the mistral user should have a home directory that exists15:57
flaper87d0ugal: curious to know why you think that ?15:57
d0ugalflaper87: well, why have one otherwise?15:57
flaper87s/?//15:57
flaper87we can remove it15:57
flaper87:)15:57
flaper87instead of setting it15:58
d0ugalokay, that is also fine15:58
flaper87the fact that it has one might be a bug15:58
d0ugalyeah15:58
d0ugalThis stuff is mostly a level too far down for me, I have no strong opinion15:59
flaper87cool, my question was more like: "Is there something in mistral that requires this dir to exist?"15:59
flaper87if not then let's get rid of it15:59
flaper87we don't need it15:59
flaper87and I'm not a fan of leaving files hanging around the FS16:00
flaper87especially tripleo files16:00
flaper87or openstack deployment files16:00
flaper87fultonj: so, do you want to do the home dir thing or do you want me to do it ?16:00
d0ugalI don't think it is required16:00
flaper87fultonj: I can do it on top of rbrady's patch16:00
fultonjflaper87: do you know how you want to solve it?16:01
flaper87I've an idea, yes!16:01
* rbrady scrolls back up16:01
*** amoralej is now known as amoralej|brb16:02
fultonji was going to test run this http://paste.openstack.org/raw/612146/ to test my theory16:02
fultonjand then see what i can do with ansible environments16:02
flaper87I'm not sure ansible envs will help much here16:03
*** fultonj has quit IRC16:07
*** fultonj has joined #openstack-mistral16:09
fultonjhello?16:09
*** rbrady has quit IRC16:10
fultonjflaper87: sorry i bounced out for a bit ; did you already sove the problem :) ?16:10
fultonjsolve*16:10
fultonjcomcast--16:10
flaper87fultonj: hahaha, yeah, almost16:11
flaper87should have a patch soon16:11
flaper87I'm confident this will work16:11
fultonjflaper87++ cool16:11
flaper87(last famous words)16:12
fultonj:)16:12
*** rbrady has joined #openstack-mistral16:18
*** rbrady has joined #openstack-mistral16:18
*** fultonj has quit IRC16:33
*** fultonj has joined #openstack-mistral16:41
*** fultonj has quit IRC16:50
*** fultonj has joined #openstack-mistral16:52
*** amoralej|brb is now known as amoralej17:20
*** rbrady is now known as rbrady-afk18:00
*** amoralej is now known as amoralej|off18:40
*** fultonj has quit IRC18:51
*** fultonj has joined #openstack-mistral18:52
*** amoralej|off is now known as amoralej19:36
*** rbrady-afk has quit IRC20:29
fultonjflaper87: i found a way to get the home dir thing working for ansible20:35
fultonj            stderr, stdout = processutils.execute(20:35
fultonj                *command, log_errors=processutils.LogErrors.ALL,20:35
fultonjenv_variables={'HOME':'/tmp/mistral-ansible-home'})20:35
fultonjflaper87: but maybe you had something different in mind20:36
fultonj^ i guess that argument for HOME could be something created temporarily and then cleaned up after the execution20:37
*** rbrady-afk has joined #openstack-mistral20:45
*** bobh has quit IRC20:56
*** shardy has quit IRC21:13
flaper87fultonj: that's kinda what I did, yes.21:21
fultonjcool21:21
flaper87Just passing env_variables to the CLI command21:21
*** amoralej is now known as amoralej|off21:21
fultonjflaper87: is your change only local ?21:21
flaper87fultonj: for now yes, I'm about to push it but it might have to wait till monday21:24
flaper87pls, don't work on this to avoid duplicating efforts21:24
flaper87I know you need it21:24
fultonjok, thanks21:25
fultonji have my own hack so i can keep moving on my other stuff21:25
fultonji'll switch to the real thing when it lands21:25
flaper87ok21:25
fultonjthis ^ and  https://review.openstack.org/#/c/469644/8/tripleo_common/actions/validations.py21:26
fultonjshould take care of 1 and 3 in the commit message of https://review.openstack.org/#/c/471759/21:26
fultonjfor 2. make access to the `kargo` roles/playbooks, were you going to get an RPM for kargo in RDO?21:27
*** jkilpatr has quit IRC21:28
flaper87there's an RPM. What's broken there is the ansible search path. by including `kargo/roles/...` it'll try to include it from the same dir the playbook is instead of looking in the global dir21:33
fultonjis it looking for anything you can explicitly tell it about?21:36
fultonje.g. i add action_plugins = /usr/share/ceph-ansible/plugins/actions to /etc/ansible/ansible.cfg21:36
*** chlong has quit IRC21:58
*** catintheroof has quit IRC22:42
*** bobh has joined #openstack-mistral22:49
*** bobh has quit IRC22:49
*** dougshelley66 has joined #openstack-mistral22:59
*** amoralej|off is now known as amoralej23:00
*** toure is now known as toure|gone23:10
*** rbrady-afk has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!