| openstackgerrit | Andrew Lazarev proposed openstack/python-saharaclient: Added --bypass-url support for keystone 3 https://review.openstack.org/154716 | 00:02 |
|---|---|---|
| openstackgerrit | Merged openstack/sahara: Config parameters beginning with "oozie." should be in job properties file https://review.openstack.org/154214 | 00:10 |
| openstackgerrit | Merged openstack/sahara: Add efficient method for detecting installed packages https://review.openstack.org/154531 | 00:11 |
| *** sgotliv__ has quit IRC | 00:18 | |
| *** egafford has joined #openstack-sahara | 00:26 | |
| *** amcrn has quit IRC | 02:01 | |
| *** fvollero has quit IRC | 02:09 | |
| *** Nikolay_St has quit IRC | 02:23 | |
| *** Nikolay_St has joined #openstack-sahara | 02:25 | |
| *** macjack has quit IRC | 02:29 | |
| *** macjack has joined #openstack-sahara | 02:40 | |
| *** hdd has quit IRC | 02:42 | |
| *** hdd has joined #openstack-sahara | 02:47 | |
| *** hdd has quit IRC | 03:13 | |
| *** hdd has joined #openstack-sahara | 03:26 | |
| *** hdd has quit IRC | 03:41 | |
| Nikolay_St | elmiko: tmckay: hi | 03:44 |
| *** hdd has joined #openstack-sahara | 03:44 | |
| Nikolay_St | guys, just a quick notice about https://review.openstack.org/#/c/154037. I think we should first end with the spec review here: https://review.openstack.org/#/c/154448 | 03:45 |
| Nikolay_St | and make it clear which messages in Sahara should be on what logging level. I will introduce this in next patchset | 03:46 |
| *** Nikolay_St has quit IRC | 04:06 | |
| *** ViswaV has quit IRC | 04:07 | |
| *** ViswaV has joined #openstack-sahara | 04:09 | |
| *** coolsvap_ is now known as coolsvap | 04:48 | |
| *** hdd has quit IRC | 05:21 | |
| *** Nikolay_St has joined #openstack-sahara | 05:36 | |
| *** sgotliv__ has joined #openstack-sahara | 05:39 | |
| *** ghenriks has quit IRC | 05:44 | |
| *** hdd has joined #openstack-sahara | 06:04 | |
| *** Longgeek has joined #openstack-sahara | 06:31 | |
| *** hdd has quit IRC | 06:51 | |
| openstackgerrit | Nikolay Starodubtsev proposed openstack/sahara-specs: Sahara new style logging https://review.openstack.org/154448 | 06:54 |
| openstackgerrit | Artem Osadchiy proposed openstack/sahara: Refactor MapR plugin for Sahara https://review.openstack.org/147872 | 07:13 |
| *** sgotliv__ has quit IRC | 07:46 | |
| openstackgerrit | Ken Chen proposed stackforge/sahara-ci-config: Add tag 5.3.0 for CDH image registry https://review.openstack.org/154777 | 07:49 |
| openstackgerrit | Ken Chen proposed stackforge/sahara-ci-config: Add tag 5.3.0 for CDH image registry https://review.openstack.org/154777 | 07:52 |
| *** chlong has quit IRC | 08:00 | |
| *** witlessb has joined #openstack-sahara | 08:16 | |
| openstackgerrit | Ken Chen proposed stackforge/sahara-ci-config: Add tag 5.3.0 for CDH image registry https://review.openstack.org/154777 | 08:19 |
| openstackgerrit | lu huichun proposed openstack/sahara: Add impala shell solr package in the cdh plugin https://review.openstack.org/154785 | 08:53 |
| *** IvanBerezovskiy has joined #openstack-sahara | 09:13 | |
| openstackgerrit | Nikolay Starodubtsev proposed openstack/python-saharaclient: Add how to participate doc https://review.openstack.org/123898 | 09:23 |
| *** tosky has joined #openstack-sahara | 09:28 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Improve messages for validation https://review.openstack.org/154483 | 09:45 |
| openstackgerrit | Sergey Kolekonov proposed stackforge/sahara-ci-config: Use Ubuntu Trusty for Jenkins slaves https://review.openstack.org/154800 | 09:55 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Set to lower case 'image_os' variable https://review.openstack.org/154802 | 10:00 |
| openstackgerrit | Merged stackforge/sahara-ci-config: Set to lower case 'image_os' variable https://review.openstack.org/154802 | 10:11 |
| *** DenisEgorenko has joined #openstack-sahara | 10:14 | |
| *** sgotliv__ has joined #openstack-sahara | 10:14 | |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Specify branches for Vanilla 2.x jobs https://review.openstack.org/154150 | 10:28 |
| *** skolekonov has joined #openstack-sahara | 10:37 | |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Specify branches for Vanilla 2.x jobs https://review.openstack.org/154150 | 10:38 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Make status description field more useful https://review.openstack.org/154014 | 10:39 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Make status description field more useful https://review.openstack.org/154014 | 10:41 |
| openstackgerrit | Merged openstack/sahara-image-elements: Add solr-doc and search packages https://review.openstack.org/154324 | 10:45 |
| openstackgerrit | Merged openstack/sahara-image-elements: Turn off iptables via 'disable-firewall' element https://review.openstack.org/153189 | 12:30 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: [Vanilla2] Open ports for hive https://review.openstack.org/154843 | 12:46 |
| openstackgerrit | Ken Chen proposed stackforge/sahara-ci-config: Add tag 5.3.0 for CDH image registry https://review.openstack.org/154777 | 12:54 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Make status description field more useful https://review.openstack.org/154014 | 12:57 |
| openstackgerrit | Merged stackforge/sahara-ci-config: Add tag 5.3.0 for CDH image registry https://review.openstack.org/154777 | 13:02 |
| openstackgerrit | Merged stackforge/sahara-ci-config: Specify branches for Vanilla 2.x jobs https://review.openstack.org/154150 | 13:03 |
| *** Nikolay_St has quit IRC | 13:24 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding validation check for Spark plugin https://review.openstack.org/154001 | 13:50 |
| tellesnobrega | tmckay, ping | 13:58 |
| tmckay | tellesnobgrega, hi | 14:00 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Make status description field more useful https://review.openstack.org/154014 | 14:01 |
| *** crobertsrh has joined #openstack-sahara | 14:02 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Fixing log messages to avoid information duplication https://review.openstack.org/147504 | 14:05 |
| tmckay | tellesnobrega, oops, spelled your nick wrong | 14:09 |
| tellesnobrega | tmckay, hi, i was testing storm here and i found that the machines cant communicate with each other, they are asking for the permission key | 14:10 |
| tellesnobrega | shouldnt sahara enable this communication? | 14:10 |
| openstackgerrit | Merged openstack/sahara: Refactor event-log code https://review.openstack.org/153193 | 14:11 |
| tmckay | tellesnobrega, hmm, interesting. Yes, ssh keys should be set up so that you can ssh between them. So, on a standard ubuntu image you should be able to ssh around in the cluster as the ubuntu user. | 14:12 |
| tellesnobrega | tmckay, that it what i was supposing it happened | 14:13 |
| tmckay | and, of course, you can get into the cluster with the keypair from outside | 14:13 |
| tmckay | all clusters work that way, afaik. I don't *think* there is anything to do in the plugin to make that happen ... | 14:13 |
| tellesnobrega | tmckay, i can get into the cluster from outside with the keypair | 14:13 |
| tellesnobrega | but the cluster itself is not communicating | 14:14 |
| tellesnobrega | tmckay, there is no ssh keys authorized in the .ssh/authorized_keys | 14:15 |
| tellesnobrega | tmckay, weird, right? | 14:15 |
| tmckay | tellesnobrega, ah, I was going to ask about that | 14:15 |
| tmckay | oooo | 14:15 |
| tmckay | tellesnobrega, grep (I use ack) for authorized_keys in Sahara | 14:15 |
| tmckay | apparently you might have to do some work to set that up | 14:16 |
| tmckay | vanilla1 and spark both at least touch it | 14:16 |
| tellesnobrega | tmckay, i guess so. I need a way to make it configure it self without having to set it up by hand | 14:16 |
| tmckay | tellesnobrega, although service/engine.py touches it too | 14:16 |
| tellesnobrega | for the user it will be a pain | 14:16 |
| tmckay | maybe something is going wrong in that code | 14:17 |
| tmckay | tellesnobrega, should definitely be possible, I've just never investigated that code because it's always worked | 14:17 |
| tellesnobrega | tmckay, can be that storm wasnt using the engine.py (we had no edp) and it was not configuring it? | 14:17 |
| tmckay | well, that's a different engine.py I think. Taking a quick look now. | 14:19 |
| tellesnobrega | tmckay, ok | 14:21 |
| tmckay | tellesnobrega, okay, direct engine is still the default provisioning engine. Is that what you used? (yes, unless you specifically tried to use heat) | 14:26 |
| tellesnobrega | tmckay, yes, didnt try anything different from the default | 14:27 |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara-image-elements: Changing Zookeeper folder name to not use version https://review.openstack.org/154889 | 14:28 |
| tmckay | tellesnobrega, okay, I would start then with a breakpoint (or extra log message) in _wait_until_accessible in service/engine.py. According to that, an instance won't be accessible until authorized_keys is created | 14:28 |
| tellesnobrega | tmckay, ok | 14:29 |
| tmckay | tellesnobrega, two possibilities come to mind -- the auth_keys was there, but something in provisioning overwrote it, or 2) it's in a different user from where you are looking for some reason | 14:29 |
| tmckay | tellenobrega, or 3) something recently changed and there is a bug so that the cluster is coming up "active" even when the nodes weren't set up correctly | 14:30 |
| tellesnobrega | tmckay, i think it is actually a problem with storm image | 14:34 |
| tellesnobrega | tmckay, the storm image has a storm user | 14:34 |
| tmckay | tellesnobrega, is that the user that the machines use to communicate? | 14:35 |
| tmckay | base image is what, ubuntu? | 14:35 |
| tellesnobrega | which should be responsible for deploying and managing the cluster | 14:35 |
| tellesnobrega | yes | 14:36 |
| tmckay | tellesnobrega, so if there is an "ubuntu" user and a "storm" user, then the storm user probably needs extra auth_key set up in the plugin during provisioning. Or .... | 14:36 |
| tellesnobrega | tmckay, i have to check which user is configured by the plugin | 14:36 |
| tmckay | maybe if you set the user to "storm" for the image when you register it, Sahara can provision with the storm user? Just a wild guess, I don't know if that would work | 14:37 |
| tmckay | storm user would have to have sudo | 14:37 |
| tellesnobrega | yes | 14:38 |
| tellesnobrega | i will double check that | 14:38 |
| tmckay | Nikolay_St, thanks for comments, reading back ... | 14:39 |
| tmckay | tellesnobrega, interesting case | 14:39 |
| tellesnobrega | tmckay, yeah | 14:40 |
| *** sgotliv has joined #openstack-sahara | 14:45 | |
| *** sgotliv__ has quit IRC | 14:48 | |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara: Changing zookeeper to not use version number https://review.openstack.org/154902 | 14:52 |
| *** Nikolay_St has joined #openstack-sahara | 14:55 | |
| *** Longgeek has quit IRC | 15:03 | |
| *** Longgeek has joined #openstack-sahara | 15:03 | |
| *** Longgeek has quit IRC | 15:04 | |
| *** Nikolay_St has quit IRC | 15:05 | |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - base functional https://review.openstack.org/148491 | 15:22 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - scaling https://review.openstack.org/148935 | 15:25 |
| *** Networkn3rd has joined #openstack-sahara | 15:57 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add provision steps to Spark Plugin https://review.openstack.org/152132 | 15:59 |
| *** vgridnev_ has joined #openstack-sahara | 15:59 | |
| vgridnev_ | Hi tmckay, i repaired problem with 'is' in my patch | 16:00 |
| tmckay | vgridnev_, thanks! I think that came originally from a comment by elmiko, btw :) | 16:01 |
| tmckay | vgridnev_, I learned something about "is". We should always stomp it out with integers from now on | 16:02 |
| vgridnev_ | agree | 16:02 |
| tmckay | I could see how it would be easy to type "is 0" though since we are used to typing "is None" and sometimes the brain will equate 0 and None | 16:02 |
| elmiko | yea, that was a bad suggestion on my part =( | 16:03 |
| elmiko | i think "is" is only supposed to be used against None | 16:03 |
| vgridnev_ | but there are no problems with "is None", yes? | 16:04 |
| elmiko | right | 16:04 |
| elmiko | there shouldn't be a problem with "is 0" because numnbers are immutable, but None is a fixed value | 16:04 |
| tmckay | vgridnev_, right, because None is always the same object | 16:04 |
| *** Longgeek has joined #openstack-sahara | 16:04 | |
| tmckay | elmiko, is 0 is fine, but the danger is that some noob sees that and doesn't understand that you can't use it in general, only -5 to 256 | 16:05 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add provisioning steps to Storm plugin https://review.openstack.org/152143 | 16:05 |
| elmiko | tmckay: yes | 16:05 |
| elmiko | is | 16:05 |
| elmiko | er, "is" can be dangerous if it isn't understood. it's an object comparison, not value. | 16:06 |
| tmckay | elmiko, I think this is what Bill Clinton was talking about | 16:06 |
| elmiko | ha! | 16:07 |
| elmiko | i might have been a little too fancy when suggesting "if var is 0" | 16:08 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - EDP https://review.openstack.org/150042 | 16:08 |
| tmckay | elmiko, it looks nice, I'll grant you | 16:08 |
| tmckay | I didn't know about the nuance til I read up on it | 16:08 |
| elmiko | yea, it's good to know about | 16:08 |
| tmckay | tested it out in the Py27 shell, sure enough it breaks | 16:08 |
| *** Longgeek has quit IRC | 16:09 | |
| elmiko | how did it break? | 16:10 |
| elmiko | nvm, that's weird about comparing numbers beyond -5 and 255, i didn't know that | 16:11 |
| tmckay | yeah, completely unexpected | 16:13 |
| tmckay | pylint should warn about is and numeric literals, I wonder if it does | 16:13 |
| elmiko | agreed, i thought numbers were stored like string and immutable. guess not. | 16:13 |
| elmiko | oh well, sorry vgridnev_ for the confusion | 16:14 |
| elmiko | tmckay: that's a good idea | 16:14 |
| tmckay | they could be, though. I suppose it could even be implementation defined (unless the spec calls specifically for that kind of storage) | 16:14 |
| vgridnev_ | elmiko, all right. | 16:16 |
| vgridnev_ | Now we should be more careful with this | 16:16 |
| elmiko | definitely | 16:17 |
| *** IvanBerezovskiy has left #openstack-sahara | 16:27 | |
| *** coolsvap has quit IRC | 16:37 | |
| *** hdd has joined #openstack-sahara | 16:49 | |
| *** coolsvap has joined #openstack-sahara | 16:55 | |
| *** tosky has quit IRC | 16:56 | |
| *** coolsvap is now known as coolsvap_ | 17:02 | |
| *** skolekonov has quit IRC | 17:02 | |
| *** jodah has quit IRC | 17:15 | |
| *** hdd has quit IRC | 17:16 | |
| *** hdd has joined #openstack-sahara | 17:18 | |
| *** jodah has joined #openstack-sahara | 17:20 | |
| *** tosky has joined #openstack-sahara | 17:41 | |
| *** coolsvap_ is now known as coolsvap | 17:47 | |
| *** sgotliv has quit IRC | 17:48 | |
| *** Longgeek has joined #openstack-sahara | 17:54 | |
| *** Longgeek has quit IRC | 17:58 | |
| *** Networkn3rd has quit IRC | 17:59 | |
| *** Networkn3rd has joined #openstack-sahara | 18:04 | |
| *** Nikolay_St has joined #openstack-sahara | 18:12 | |
| *** Nikolay_St has quit IRC | 18:19 | |
| *** Nikolay_St has joined #openstack-sahara | 18:20 | |
| *** Nikolay_St has quit IRC | 18:24 | |
| *** Nikolay_St has joined #openstack-sahara | 18:25 | |
| *** saurabhs has joined #openstack-sahara | 18:27 | |
| *** saurabhs has quit IRC | 18:27 | |
| *** saurabhs has joined #openstack-sahara | 18:32 | |
| tellesnobrega | egafford, hey, thanks for the review | 18:35 |
| tellesnobrega | egafford, should the dependency be the patch from sahara depends on the sahara-image-elements or the other way around | 18:36 |
| tosky | tellesnobrega: I don't know this specific case, so please wait for egafford, but I would say that the question is: which patch works without the other? | 18:38 |
| tellesnobrega | sahara ones works only if the image-elements get in | 18:38 |
| tellesnobrega | i guess that answers my question | 18:38 |
| tellesnobrega | tosky, to add dependency i use review -d #patch-number right? | 18:39 |
| tellesnobrega | tosky, or is it just a special word in the commit message? | 18:39 |
| tosky | uhm, not really an expert on that; git review -d download the other page | 18:40 |
| tosky | are the patches on different repositories | 18:40 |
| tosky | ? | 18:40 |
| tellesnobrega | yes, and this wont work here | 18:40 |
| tellesnobrega | exactly | 18:40 |
| elmiko | tellesnobrega: to make a dependency, get the change you want to depend on, then rebase on top of it, then git-review | 18:41 |
| tosky | add a WIP to the second one, or ask for a temporary -1; when the first one is merged, unlock the second | 18:41 |
| tosky | elmiko: different repositories | 18:41 |
| elmiko | tosky: oh, woops | 18:41 |
| elmiko | nevermind me then =) | 18:41 |
| * elmiko backs into the shadows | 18:41 | |
| tellesnobrega | thanks | 18:42 |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara: Changing zookeeper to not use version number https://review.openstack.org/154902 | 18:43 |
| *** sgotliv has joined #openstack-sahara | 18:45 | |
| *** tellesnobrega has quit IRC | 18:50 | |
| *** coolsvap has quit IRC | 18:51 | |
| *** ViswaV has quit IRC | 19:01 | |
| *** tosky has quit IRC | 19:01 | |
| *** ViswaV has joined #openstack-sahara | 19:02 | |
| *** hdd has quit IRC | 19:05 | |
| *** Nikolay_St has quit IRC | 19:07 | |
| egafford | Juno Stable lives! https://review.openstack.org/#/c/153352/ | 19:12 |
| *** Nikolay_St has joined #openstack-sahara | 19:12 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add provision steps to Spark Plugin https://review.openstack.org/152132 | 19:12 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add provisioning steps to Storm plugin https://review.openstack.org/152143 | 19:15 |
| *** tellesnobrega has joined #openstack-sahara | 19:16 | |
| *** sgotliv has quit IRC | 19:17 | |
| *** ViswaV has quit IRC | 19:21 | |
| *** ViswaV has joined #openstack-sahara | 19:26 | |
| *** macjack has quit IRC | 19:30 | |
| *** amcrn has joined #openstack-sahara | 19:42 | |
| *** Longgeek has joined #openstack-sahara | 19:42 | |
| *** Networkn3rd has quit IRC | 19:53 | |
| *** Nikolay_St has quit IRC | 19:58 | |
| *** Networkn3rd has joined #openstack-sahara | 20:00 | |
| *** Longgeek has quit IRC | 20:04 | |
| *** saurabhs has quit IRC | 20:11 | |
| *** Networkn3rd has quit IRC | 20:17 | |
| *** Networkn3rd has joined #openstack-sahara | 20:20 | |
| *** Networkn3rd has quit IRC | 20:21 | |
| *** Networkn3rd has joined #openstack-sahara | 20:21 | |
| *** ViswaV has quit IRC | 20:28 | |
| *** hdd has joined #openstack-sahara | 20:43 | |
| elmiko | hey folks, gonna need lots of help with this one, https://review.openstack.org/#/c/155052/ | 20:57 |
| *** tellesnobrega has quit IRC | 20:57 | |
| *** tellesnobrega has joined #openstack-sahara | 21:00 | |
| *** saurabhs has joined #openstack-sahara | 21:01 | |
| *** ViswaV has joined #openstack-sahara | 21:12 | |
| *** Networkn3rd has quit IRC | 21:19 | |
| *** Networkn3rd has joined #openstack-sahara | 21:26 | |
| *** Networkn3rd has quit IRC | 21:30 | |
| *** Longgeek has joined #openstack-sahara | 21:49 | |
| *** crobertsrh is now known as _crobertsrh | 21:57 | |
| *** hdd has quit IRC | 22:08 | |
| *** Longgeek has quit IRC | 22:11 | |
| *** egafford has quit IRC | 22:43 | |
| openstackgerrit | Andrew Lazarev proposed openstack/python-saharaclient: Removed cluster validation on client side https://review.openstack.org/155092 | 22:54 |
| *** vgridnev_ has quit IRC | 23:01 | |
| *** saurabhs has quit IRC | 23:06 | |
| *** saurabhs has joined #openstack-sahara | 23:10 | |
| *** hdd has joined #openstack-sahara | 23:20 | |
| *** saurabhs has quit IRC | 23:20 | |
| *** saurabhs has joined #openstack-sahara | 23:30 | |
| *** chlong has joined #openstack-sahara | 23:37 | |
| openstackgerrit | Michael McCune proposed openstack/sahara-image-elements: Adding new update option to diskimage-create.sh https://review.openstack.org/151099 | 23:40 |
| *** tmckay has quit IRC | 23:42 | |
| *** Longgeek has joined #openstack-sahara | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!