Friday, 2017-07-14

*** shuyingya has joined #openstack-sahara00:23
*** shuyingya has quit IRC00:27
*** tuanluong has joined #openstack-sahara00:33
*** esikachev has joined #openstack-sahara00:46
*** esikachev has quit IRC00:50
openstackgerritzhongshengping proposed openstack/puppet-sahara master: Update URLs in documents according to document migration  https://review.openstack.org/48364500:54
*** shuyingya has joined #openstack-sahara01:09
*** shuyingya has quit IRC01:26
*** shuyingya has joined #openstack-sahara01:42
*** esikachev has joined #openstack-sahara01:46
*** shuyingya has quit IRC01:47
*** esikachev has quit IRC01:51
*** shuyingya has joined #openstack-sahara01:55
*** shuyingya has quit IRC02:00
*** shuyingya has joined #openstack-sahara02:28
*** shuyingy_ has joined #openstack-sahara02:28
*** shuying__ has joined #openstack-sahara02:31
*** shuyingy_ has quit IRC02:31
*** shuyingya has quit IRC02:32
*** esikachev has joined #openstack-sahara02:47
*** esikachev has quit IRC02:51
*** ukaynar has quit IRC02:55
*** ukaynar has joined #openstack-sahara02:55
*** ukaynar has quit IRC02:59
*** dave-mccowan has quit IRC03:46
*** esikachev has joined #openstack-sahara03:48
*** esikachev has quit IRC03:53
*** shuying__ has quit IRC03:57
openstackgerritNgo Quoc Cuong proposed openstack/sahara master: Globalize regex objects  https://review.openstack.org/48279504:15
*** links has joined #openstack-sahara04:18
*** shuyingya has joined #openstack-sahara04:45
*** esikachev has joined #openstack-sahara04:49
*** esikachev has quit IRC04:53
*** shuyingya has quit IRC05:08
*** shuyingya has joined #openstack-sahara05:09
*** shuyingya has quit IRC05:11
*** anshul has joined #openstack-sahara05:14
openstackgerritChason Chan proposed openstack/sahara master: Update the Hacking link  https://review.openstack.org/48380805:16
openstackgerritChason Chan proposed openstack/sahara-tests master: Update the Hacking link  https://review.openstack.org/48380905:18
*** pgadiya has joined #openstack-sahara05:33
*** esikachev has joined #openstack-sahara05:50
*** rcernin has joined #openstack-sahara05:52
*** esikachev has quit IRC05:54
*** shuyingya has joined #openstack-sahara05:55
*** esikachev has joined #openstack-sahara06:09
*** remix_tj has quit IRC06:13
*** anshul has quit IRC06:17
*** pcaruana has joined #openstack-sahara06:25
*** shuyingya has quit IRC06:34
*** remix_tj has joined #openstack-sahara06:37
*** anshul has joined #openstack-sahara06:51
*** zemuvier has joined #openstack-sahara07:01
*** anshul has quit IRC07:05
*** pgadiya has quit IRC07:05
*** mgoddard_ has joined #openstack-sahara07:14
*** tesseract has joined #openstack-sahara07:14
*** anshul has joined #openstack-sahara07:17
*** pgadiya has joined #openstack-sahara07:18
openstackgerritChason Chan proposed openstack/sahara master: Update the documentation link for doc migration  https://review.openstack.org/48380807:52
*** mgoddard_ has quit IRC07:58
*** shuyingya has joined #openstack-sahara08:21
*** mgoddard_ has joined #openstack-sahara08:30
openstackgerritChason Chan proposed openstack/sahara-tests master: Update the documentation links for doc migration  https://review.openstack.org/48380909:11
openstackgerritChason Chan proposed openstack/sahara master: Update the documentation link for doc migration  https://review.openstack.org/48380809:18
*** anshul has quit IRC09:36
*** shuyingya has quit IRC09:43
*** tuanluong has quit IRC09:44
*** anshul has joined #openstack-sahara09:49
*** tosky has joined #openstack-sahara09:55
*** pcaruana has quit IRC09:56
*** pcaruana has joined #openstack-sahara10:09
*** tellesnobrega has quit IRC10:34
*** tellesnobrega has joined #openstack-sahara10:34
*** esikachev has quit IRC10:43
*** anshul has quit IRC10:43
*** tellesnobrega has quit IRC10:44
*** anshul has joined #openstack-sahara11:03
*** pcaruana has quit IRC11:25
*** tellesnobrega has joined #openstack-sahara11:25
*** esikachev has joined #openstack-sahara11:38
*** pgadiya has quit IRC12:02
*** dave-mccowan has joined #openstack-sahara12:23
*** dave-mccowan has quit IRC12:43
*** brad[] has quit IRC13:00
*** brad[] has joined #openstack-sahara13:00
*** jeremyfreudberg has joined #openstack-sahara13:01
*** ukaynar has joined #openstack-sahara13:05
jeremyfreudbergtellesnobrega, ping13:06
tellesnobregahere13:13
tellesnobregajeremyfreudberg, pong13:13
openstackgerritLuigi Toscano proposed openstack/sahara-image-elements master: mapr: fix the discovery of the version of Scala  https://review.openstack.org/48392513:13
jeremyfreudbergright, so as I was saying yesterday, hadoop 2.8.1 will not land in time to upgrade vanilla. but since we have spark on vanilla, it is possible to upgrade that - to match what's on the spark plugin.13:15
jeremyfreudbergso, what my question is, is how to handle that upgrade13:15
*** dave-mccowan has joined #openstack-sahara13:15
jeremyfreudbergall the changes are on the image-gen side only as far as I can tell13:16
esikachevtosky: btw, links already available for me :)13:16
toskyesikachev: good :)13:17
jeremyfreudbergso, tellesnobrega (and tosky can chime in too), if I upgrade spark version on vanilla plugin, it's basically being done silently, which seems very strange to me13:20
openstackgerritLuigi Toscano proposed openstack/sahara-image-elements master: mapr: fix the discovery of the version of Scala  https://review.openstack.org/48392513:21
toskyjeremyfreudberg: what do you mean by silently?13:21
tellesnobregajeremyfreudberg, good question13:21
openstackgerritMerged openstack/sahara-tests master: Update the documentation links for doc migration  https://review.openstack.org/48380913:21
jeremyfreudbergtosky, I mean since all the changes are on the image side, and the fact that we name vanilla version by hadoop version only, there is no obvious way the upgrade is visible to the naive end user13:21
tellesnobregaI think that the way to overcome that is, this will be a simple change on SIE, and it needs a RENO to ensure that we have information about the change in spark version13:22
tellesnobregaand docs as well13:22
toskydocumentation, yes, it's the only way13:22
jeremyfreudbergonce we get a new place to host pre-built images, probably a good idea to include spark version in the name as well13:23
jeremyfreudbergin the name of vanilla images, I mean13:23
*** zemuvier has quit IRC13:23
*** esikachev has quit IRC13:25
*** ukaynar has quit IRC13:25
iwonkadoes anyone kow what to restart to make sure my changes in sahara-dashboard are visible? i restarted horizon, sahara-api and sahara-eng and there were no changes but when i restacked they were in the gui13:28
toskyjeremyfreudberg: but does it scale? I was thinking about all (sub)version of components in the bigger images13:28
toskyiwonka: it should be enough to restart horizon (or httpd, if it was executed through apache)13:28
iwonkatosky: oh, maybe i should've restarted apache, restarting nly horizon did not help13:29
iwonkathanks13:29
toskyuhm, if you have horizon as standalone, it may mean that it's not managed through apache13:29
toskybut I don't have a devstack environment around to check13:30
iwonkahow to check it?13:30
iwonkathere's horizon tab in screen, i restarted it there13:30
toskyuhm, how do you access horizon?13:31
jeremyfreudbergiwonka, easiest way to check it is stop apache and see if horizon still works13:31
jeremyfreudbergtosky: regarding your image-naming question - you are right. it's been on my wishlist for a while to have our own versioning system for vanilla, and stop relying on hadoop version # to pin version13:31
iwonkajeremyfreudberg: with apache turned off there's unable to connect error, so i think apache needs to be restarted13:32
iwonkathanks :)13:32
jeremyfreudbergiwonka, no problem13:33
tellesnobregajeremyfreudberg, I like that idea of having the name of the image13:33
tellesnobregajeremyfreudberg, how do you plan to have that versioning?13:35
jeremyfreudbergtellesnobrega, it would be tricky. off the top of my head, we'd have to start at some big number like 100 that no service would ever reach (to eliminate confusion) and then do 100.X.Y where X.Y is the actual versioning and would follow semver13:37
jeremyfreudbergbut, what I mean is that if we started doing this today, the curret vanilla would be 100.1.0 or something13:37
jeremyfreudbergor, 100.0.1 depending on your confidence level13:37
tosky-> add to Queens planning, and for now just update it13:38
jeremyfreudbergtosky, yep, I'll add it13:38
toskyresource usage on infra: yesterday I jumped in a related discussion on #openstack-infra, and the answer seems to be "propose it and we will see"13:40
toskyif you missed it, check from here: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2017-07-13.log.html#t2017-07-13T15:38:1413:40
tosky(topic: heavier jobs on infra resources)13:40
tellesnobregathanks tosky13:44
tellesnobregaand jeremyfreudberg lets discuss that for queens for sure13:44
jeremyfreudbergit's added to the etherpad now. and tosky, I think adding it as experimental is totally the way to go for now13:45
jeremyfreudbergby "it" I mean the jobs13:45
tellesnobregaI will read the discussion, quite busy now13:49
tellesnobregabtw, did you guys see the patch about default templates?13:49
tellesnobregaI might not have sent it yet13:49
jeremyfreudbergtellesnobrega, I don't think you sent it13:49
jeremyfreudbergbut I'm excited to see it :)13:49
tellesnobregaÇ)13:49
tellesnobrega:)13:49
tellesnobregawill send it later today13:50
openstackgerritChason Chan proposed openstack/sahara master: Update the documentation link for doc migration  https://review.openstack.org/48380813:50
toskyno, I was fixing another unexpected breakage in sie :D13:54
toskyscala-lang.org changed -> BOOM13:54
*** pcaruana has joined #openstack-sahara13:56
*** esikachev has joined #openstack-sahara13:58
*** Poornima has joined #openstack-sahara14:02
*** Poornima has quit IRC14:04
tellesnobregalol14:08
toskyand it affects older branches too14:09
openstackgerritMerged openstack/sahara master: Globalize regex objects  https://review.openstack.org/48279514:10
tellesnobregaquick question14:14
tellesnobregahave you guys run spark-pi.py jobs recently?14:15
jeremyfreudbergtellesnobrega, I did it a few months ago14:17
jeremyfreudbergthe integration with swift is not as good14:17
tellesnobregathe main class is main correct?14:19
jeremyfreudbergin my experience, you have to set edp.spark.adapt_for_swift=False (since the UI sets it to true by default) and then I think it might take a dummy value for main class14:20
jeremyfreudbergI have to check14:20
tellesnobregafrom the sahara-tests it is main14:22
jeremyfreudbergi would use main then14:22
tellesnobregathanks14:25
jeremyfreudbergI'm going to play around with it now anyway, I remember it being confusing14:26
*** tellesnobrega has quit IRC14:30
*** ukaynar has joined #openstack-sahara14:31
*** chlong has joined #openstack-sahara14:48
*** links has quit IRC14:49
*** lucasxu has joined #openstack-sahara14:59
*** rcernin has quit IRC15:05
*** ukaynar_ has joined #openstack-sahara15:06
*** ukaynar has quit IRC15:07
*** anshul has quit IRC15:30
*** ukaynar_ has quit IRC16:14
*** jeremyfreudberg has quit IRC16:15
openstackgerritLuigi Toscano proposed openstack/sahara-image-elements master: mapr: fix the discovery of the version of Scala  https://review.openstack.org/48392516:15
toskywith a workaround this time16:16
*** Poornima has joined #openstack-sahara16:24
*** Poornima has quit IRC16:24
*** Poornima has joined #openstack-sahara16:29
*** mgoddard_ has quit IRC16:37
*** mgoddard_ has joined #openstack-sahara16:42
*** Poornima has quit IRC16:46
*** Poornima has joined #openstack-sahara16:53
*** mgoddard_ has quit IRC17:01
*** Poornima has quit IRC17:14
*** tosky has quit IRC17:24
*** pcaruana has quit IRC17:41
*** tellesnobrega has joined #openstack-sahara17:45
*** tosky has joined #openstack-sahara17:48
*** shuyingya has joined #openstack-sahara18:03
openstackgerritMerged openstack/python-saharaclient master: doc: migrate to openstackdocstheme  https://review.openstack.org/48346618:22
*** dave-mccowan has quit IRC18:28
*** lucasxu has quit IRC18:47
*** shuyingya has quit IRC19:08
openstackgerritMerged openstack/sahara-image-elements master: mapr: fix the discovery of the version of Scala  https://review.openstack.org/48392519:12
toskyooooh19:13
toskyand now backports19:13
openstackgerritLuigi Toscano proposed openstack/sahara-image-elements stable/ocata: mapr: fix the discovery of the version of Scala  https://review.openstack.org/48402119:19
openstackgerritLuigi Toscano proposed openstack/sahara-image-elements stable/newton: mapr: fix the discovery of the version of Scala  https://review.openstack.org/48402519:21
toskytellesnobrega: remember the reno release note for the CDH image review (and Ambari when you change it)19:30
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Updating default templates  https://review.openstack.org/48402819:41
tellesnobregatosky, sure will do19:41
*** esikachev has quit IRC20:10
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Image generation for CDH Plugin  https://review.openstack.org/44871220:13
*** mgoddard_ has joined #openstack-sahara20:24
openstackgerritMerged openstack/sahara-image-elements stable/ocata: mapr: fix the discovery of the version of Scala  https://review.openstack.org/48402120:27
openstackgerritMerged openstack/sahara-image-elements stable/newton: mapr: fix the discovery of the version of Scala  https://review.openstack.org/48402520:40
openstackgerritMerged openstack/sahara master: Update the documentation link for doc migration  https://review.openstack.org/48380820:53
*** ukaynar has joined #openstack-sahara21:10
*** chlong has quit IRC21:19
*** mgoddard_ has quit IRC21:36
*** iwonka has quit IRC22:16
*** mgoddard_ has joined #openstack-sahara22:21
*** mgoddard_ has quit IRC22:33
*** tosky has quit IRC23:05
*** ukaynar has quit IRC23:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!