| *** IlyaE has quit IRC | 00:18 | |
| *** IlyaE has joined #openstack-sahara | 00:18 | |
| openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: Moved information about processes names to plugins https://review.openstack.org/73713 | 00:19 |
|---|---|---|
| *** IlyaE has quit IRC | 00:48 | |
| *** IlyaE has joined #openstack-sahara | 01:05 | |
| *** bradd1 has quit IRC | 01:45 | |
| *** bradd1 has joined #openstack-sahara | 01:46 | |
| *** bradd11 has joined #openstack-sahara | 01:55 | |
| *** bradd1 has quit IRC | 01:57 | |
| *** ErikB has joined #openstack-sahara | 02:01 | |
| *** ErikB has quit IRC | 02:07 | |
| *** bradd11 has quit IRC | 02:10 | |
| *** IlyaE has quit IRC | 02:10 | |
| *** IlyaE has joined #openstack-sahara | 02:43 | |
| *** IlyaE has quit IRC | 02:57 | |
| *** openstackgerrit has quit IRC | 03:04 | |
| *** openstackgerrit has joined #openstack-sahara | 03:04 | |
| *** zhiyan_ is now known as zhiyan | 03:48 | |
| *** IlyaE has joined #openstack-sahara | 04:23 | |
| *** IlyaE has quit IRC | 04:42 | |
| *** akuznetsov has joined #openstack-sahara | 04:54 | |
| *** Ch00k has joined #openstack-sahara | 05:04 | |
| *** shakamunyi has quit IRC | 05:14 | |
| *** IlyaE has joined #openstack-sahara | 05:37 | |
| *** Ch00k has quit IRC | 06:15 | |
| *** IlyaE has quit IRC | 07:31 | |
| *** tosky has joined #openstack-sahara | 07:33 | |
| *** witlessb has joined #openstack-sahara | 07:46 | |
| *** _mattf is now known as mattf | 08:41 | |
| mattf | SergeyLukjanov, can someone look at the ci lab - https://review.openstack.org/#/c/87011/ - failure appears to be a dns issue | 08:41 |
| *** IvanBerezovskiy has joined #openstack-sahara | 08:57 | |
| dmitryme | mattf: IvanBerezovsky taken a look into it. The hostname resolution errors are misleading. They are actually harmless and caused by calling 'sudo' while machine hostname is not setup properly. The issue is caused by the change itself - see Ivan's comment on that | 09:02 |
| *** zhiyan is now known as zhiyan_ | 09:42 | |
| *** _crobertsrh is now known as crobertsrh | 11:09 | |
| mattf | dmitryme, thanks missed one in my rebase shuffle | 11:18 |
| mattf | IvanBerezovskiy, good catch | 11:18 |
| mattf | tho i'm a bit concerned that adding root-passwd breaks the ci | 11:18 |
| mattf | IvanBerezovskiy, dmitryme, what is the host system for the ci? | 11:18 |
| IvanBerezovskiy | mattf, ubuntu | 11:19 |
| mattf | is it just that sudo doesn't work on the ci system? | 11:21 |
| mattf | if so the cdh-hadoop element likely doesn't work | 11:22 |
| mattf | SergeyLukjanov, +a ? https://review.openstack.org/#/c/87003/ | 11:22 |
| IvanBerezovskiy | mattf, sudo is ok. You can see warnings like 'unable to resolv host ...'. It means that hostname isn't in /etc/hosts | 11:22 |
| openstackgerrit | Matthew Farrellee proposed a change to openstack/sahara-image-elements: Add -d option to vanilla images https://review.openstack.org/87011 | 11:23 |
| mattf | https://sahara.mirantis.com/logs/11/87011/6/check/diskimage-integration-ubuntu/74d1afe/console.html | 11:24 |
| mattf | Error during setup password for root | 11:24 |
| mattf | IvanBerezovskiy, think ^^ is the real failure? | 11:24 |
| mattf | are you able to build an image w/ the new -d option (add root-passwd to elements)? | 11:24 |
| IvanBerezovskiy | mattf, real failure is 'Error during setup password for root' | 11:25 |
| IvanBerezovskiy | mattf, i don't build images now | 11:25 |
| SergeyLukjanov | mattf, https://review.openstack.org/#/c/87003/ is in my backlog | 11:28 |
| tellesnobrega | crobertsrh: hey, are you there? | 11:35 |
| crobertsrh | I am! | 11:35 |
| crobertsrh | was sick yesterday | 11:35 |
| SergeyLukjanov | crobertsrh, hey, how are you? | 11:36 |
| SergeyLukjanov | crobertsrh, have you received some notes re horizon meeting from mattf? | 11:36 |
| crobertsrh | much better this morning | 11:36 |
| crobertsrh | I did...I'll add some testing notes | 11:37 |
| crobertsrh | was there a resolution on where to put the code/organization? | 11:40 |
| openstackgerrit | A change was merged to openstack/sahara-image-elements: Detect selinux passwd setting bug https://review.openstack.org/87003 | 12:26 |
| *** sballe has joined #openstack-sahara | 12:29 | |
| *** sballe_ has joined #openstack-sahara | 12:38 | |
| *** sballe has quit IRC | 12:40 | |
| *** sballe_ has quit IRC | 12:43 | |
| *** sballe_ has joined #openstack-sahara | 12:43 | |
| *** tmckay has joined #openstack-sahara | 12:48 | |
| *** sballe_ has quit IRC | 12:49 | |
| mattf | SergeyLukjanov, aignatov, +A? https://review.openstack.org/#/c/87011/ | 12:57 |
| tmckay | src/WordCount.java:86: warning: [deprecation] Job(Configuration,String) in Job has been deprecated | 12:59 |
| tmckay | Job job = new Job(conf, "word count"); | 12:59 |
| tmckay | I hope this is why my swift confs aren't getting through in Java actions under 2.3.0 | 13:00 |
| tmckay | still, "deprecated" shouldn't mean broken ... but it might | 13:00 |
| *** elmiko_ is now known as elmiko | 13:11 | |
| tmckay | be back soon | 13:12 |
| *** tmckay is now known as _tmckay | 13:12 | |
| tellesnobrega | crobertsrh: sorry, i just saw it now. Feeling better? how is the migration of sahara UI into horizon going? | 13:12 |
| crobertsrh | tellesnobrega: I'm doing a bit better..at least enough to work today, thanks. I hope to get some patches up for sahara UI migration today. | 13:14 |
| tellesnobrega | crobertsrh: i was thinking about working on this, but i don't know how far you have gone, and if there is still something left to do | 13:15 |
| crobertsrh | I should be able to get all the panels incorporated fairly quickly now...there was a discussion in the horizon weekly meeting yesterday that I was waiting on. They were discussing how/where to incorporate the sahara code. | 13:16 |
| crobertsrh | Once I get the panels in, I might need a hand with other tweaks that are required/requested | 13:17 |
| crobertsrh | I will keep you posted....also, please review the patches I send up, that will help greatly. | 13:19 |
| *** _tmckay has quit IRC | 13:20 | |
| openstackgerrit | Daniele Venzano proposed a change to openstack/sahara-image-elements: Better setup for custom Java installation https://review.openstack.org/89515 | 13:23 |
| tellesnobrega | crobertsrh: will do, thanks | 13:24 |
| *** ErikB has joined #openstack-sahara | 13:28 | |
| *** sballe has joined #openstack-sahara | 13:32 | |
| *** tellesnobrega has quit IRC | 13:34 | |
| *** tellesnobrega has joined #openstack-sahara | 13:41 | |
| openstackgerrit | Daniele Venzano proposed a change to openstack/sahara-image-elements: Better setup for custom Java installation https://review.openstack.org/89515 | 13:42 |
| *** ErikB has quit IRC | 13:47 | |
| *** mattf is now known as _mattf | 13:54 | |
| *** bradd1 has joined #openstack-sahara | 13:59 | |
| *** _mattf is now known as mattf | 14:03 | |
| *** tmckay has joined #openstack-sahara | 14:05 | |
| *** tmckay has quit IRC | 14:08 | |
| elmiko | how frequently are centos images created with the plain hadoop version? | 14:08 |
| *** tmckay has joined #openstack-sahara | 14:08 | |
| crobertsrh | tellesnobrega: Upon further thought, I think that moving the panels over to horizon might be easy enough to split-up. If you're still interested in doing some, let me know. | 14:34 |
| *** shakamunyi has joined #openstack-sahara | 15:01 | |
| *** IlyaE has joined #openstack-sahara | 15:02 | |
| *** shakamunyi has quit IRC | 15:02 | |
| *** shakamunyi has joined #openstack-sahara | 15:03 | |
| *** tmckay has quit IRC | 15:15 | |
| *** shakamunyi has quit IRC | 16:03 | |
| *** shakamunyi has joined #openstack-sahara | 16:05 | |
| *** IvanBerezovskiy has left #openstack-sahara | 16:06 | |
| openstackgerrit | A change was merged to openstack/sahara: Moved information about processes names to plugins https://review.openstack.org/73713 | 16:13 |
| *** bob_nettleton has joined #openstack-sahara | 16:37 | |
| openstackgerrit | A change was merged to openstack/sahara: Updated architecture diagram in docs https://review.openstack.org/89647 | 16:41 |
| *** tmckay has joined #openstack-sahara | 16:44 | |
| openstackgerrit | A change was merged to openstack/sahara: Forced lowercase for instance names https://review.openstack.org/68740 | 16:57 |
| openstackgerrit | Robert Nettleton proposed a change to openstack/sahara-image-elements: Adds SSH support to HDP plain VM image https://review.openstack.org/88411 | 17:17 |
| elmiko | bob_nettleton: i've been building some centos images using the base element and things are going well so far. i'm curious if there was a historical reason that it was turned off? | 17:19 |
| bob_nettleton | elmiko, Hi, I'm not entirely sure. When I added the HDP images to the build, I used the same patterns/conventions used by the vanilla plugin image scripts. It's possible that using base does not cause a problem anymore. Who could we ask regarding the vanilla image generation for CentOS? Is it somebody from Mirtantis? | 17:21 |
| elmiko | i'm not sure about who to ask, i've been trying to confirm that these images work by running them through the stack. | 17:22 |
| elmiko | i've only just started the testing work, but i figure if everything works while using the base element as part of the image creation we might want to turn it back on. | 17:23 |
| bob_nettleton | elmiko, yeah, it might be a good idea. What kind of things are added by base though? My only concern is that somebody must have had a reason for that -n. :) | 17:23 |
| elmiko | yea, that's what i'd like to know as well. i've been asking around but no answers yet /shrug | 17:24 |
| elmiko | bob_nettleton: i figure, at the least, if i keep testing and come up with good results it will push the issue and hopefully the answer will emerge at that point. | 17:26 |
| bob_nettleton | elmiko, sure. makes sense. Are you trying with the vanilla images or HDP, or both? | 17:26 |
| elmiko | i've been testing hdp so far | 17:27 |
| elmiko | i haven't yet made it to running jobs as i still have some configuration issues with the hdp plugin | 17:27 |
| bob_nettleton | elmiko, I've just taken a quick look at the "base" element. There are a few things that look almost Ubuntu-specific, so that may be a concern. One of the scripts also forces a package manager update across the system, so maybe this was a potential problem a while back. | 17:31 |
| *** shakayumi has joined #openstack-sahara | 17:32 | |
| *** shakamunyi has quit IRC | 17:32 | |
| elmiko | bob_nettleton: ok, that makes some sense | 17:32 |
| *** shakayumi has quit IRC | 17:40 | |
| *** IlyaE has quit IRC | 17:42 | |
| *** bob_nettleton has quit IRC | 17:42 | |
| crobertsrh | NikitaKonovalov: I re-patched my sahara api review https://review.openstack.org/#/c/86648/7, but are you sure that the new way is really better? The new way is more flexible, but I'm not sure I like making the user add that to their config since it's not something that is ever going to change. | 17:45 |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara-image-elements: Add support various oozie version for vanilla images https://review.openstack.org/87723 | 17:51 |
| *** IlyaE has joined #openstack-sahara | 17:58 | |
| openstackgerrit | Michael McCune proposed a change to openstack/sahara-image-elements: correcting the elements sequence for centos+hdp+plain+debug https://review.openstack.org/89911 | 18:13 |
| *** shakamunyi has joined #openstack-sahara | 18:19 | |
| *** tosky has quit IRC | 18:31 | |
| *** IlyaE has quit IRC | 18:39 | |
| *** IlyaE has joined #openstack-sahara | 18:41 | |
| *** ErikB has joined #openstack-sahara | 18:50 | |
| *** ErikB has quit IRC | 18:56 | |
| *** ErikB has joined #openstack-sahara | 18:56 | |
| *** bob_nettleton has joined #openstack-sahara | 19:12 | |
| *** bob_nettleton has quit IRC | 19:26 | |
| tmckay | anyone know how to force jdb to see source files? | 19:51 |
| tmckay | trying to track down this exception with swift configs in hadoop 2.3.0 | 19:51 |
| tmckay | I've got WordCount in the debugger, but I can't look at sources. Even if I put source in the current directory | 19:52 |
| tmckay | or, anybody know another command line debugger besides jdb? | 19:52 |
| elmiko | do you need to adjust the classpath that the debugger knows about? | 20:00 |
| *** IlyaE has quit IRC | 20:21 | |
| tmckay | elmiko, hmm, could be pilot error | 20:22 |
| elmiko | i'm definitely not the goto guy for java, i'm just tossin it out there | 20:23 |
| tmckay | I may have found my issue ... testing a theory now | 20:24 |
| elmiko | cool | 20:24 |
| tmckay | elmiko, I ain't no Java guy either | 20:24 |
| *** IlyaE has joined #openstack-sahara | 20:30 | |
| tmckay | elimiko, another laugh or cry dilemna | 20:48 |
| elmiko | uh oh... | 20:48 |
| tmckay | elmiko, the Java action example I was using is a modified WordCount from hadoop examples. I just added some stuff to make it work with Oozie swift configs | 20:50 |
| elmiko | sounds cool so far | 20:50 |
| tmckay | elmiko, but I never changed the package name. In hadoop 1.2.1, it didn't matter. In hadoop 2.3.0, the original hadoop example jar is on the classpath and it ran that one instead of mine .... | 20:51 |
| elmiko | doh! | 20:51 |
| tmckay | so, it looked like it was executing, but it always complained that the swift configs weren't there. Which they wouldn't be. | 20:51 |
| tmckay | name space problem, masked by 1.2.1, blows up in 2.3.0. Duh. | 20:52 |
| elmiko | hey, at least you found it within the day :) | 20:53 |
| tmckay | yeah, been busted for a while. I decided to find it today. | 20:54 |
| tmckay | SergeyLukjanov, aignatov, if we are going to make sahara java packages (for examples, let's say) what should we use for a namespace? org.openstack.sahara.examples? | 20:55 |
| * tmckay goes with it | 20:58 | |
| elmiko | sounds good to me, fwiw | 20:58 |
| tmckay | on the bright side, I found out how to compile it on 2.3.0 :) | 20:59 |
| *** IlyaE has quit IRC | 21:00 | |
| elmiko | nice! | 21:01 |
| tmckay | I think I need to break up the resource dirs for tests into hadoop-version specific dirs, and probably include the source. I'll have to double check if the 1.2.1 compiled jar will run on 2.3.0 ( I think I read that it won't) | 21:04 |
| elmiko | what do the resource dirs hold? | 21:06 |
| tmckay | elmiko, for the integration tests, the reource dirs have some jars. | 21:08 |
| tmckay | truth is, they should have source code, too, and build instructions (not just jars) | 21:08 |
| elmiko | gotcha | 21:09 |
| *** ErikB has quit IRC | 21:12 | |
| *** crobertsrh is now known as _crobertsrh | 21:13 | |
| *** IlyaE has joined #openstack-sahara | 21:14 | |
| *** shakamunyi has quit IRC | 21:17 | |
| *** IlyaE has quit IRC | 21:24 | |
| elmiko | tmckay: when you run instances in devstack, do they ever have a route to the internet? | 21:25 |
| tmckay | I believe so. If I use floating ips. | 21:26 |
| elmiko | does your floatingip pool share an ip range with the physnet? | 21:26 |
| tmckay | haven't checked for a while, but I think I had that working under both neutron and nova | 21:26 |
| tmckay | looks like most recently I just let floating_range get the default | 21:27 |
| elmiko | i'm using neutron and just doing some sanity testing on these image, but it's strange they don't have a route to the internet | 21:27 |
| tmckay | I'll have to check again, looks like I have nova set up at the moment (don't remember why) | 21:28 |
| *** elmiko is now known as elmiko_ | 22:09 | |
| *** IlyaE has joined #openstack-sahara | 22:10 | |
| *** IlyaE has quit IRC | 22:21 | |
| *** IlyaE has joined #openstack-sahara | 22:26 | |
| *** witlessb has quit IRC | 22:30 | |
| *** shakamunyi has joined #openstack-sahara | 22:39 | |
| *** tmckay has quit IRC | 22:52 | |
| *** shakamunyi has quit IRC | 22:52 | |
| *** shakamunyi has joined #openstack-sahara | 22:59 | |
| *** mattf is now known as _mattf | 23:40 | |
| *** IlyaE has quit IRC | 23:47 | |
| *** bradd1 has quit IRC | 23:47 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!