Friday, 2015-08-28

*** saneax has quit IRC00:02
*** hdd has quit IRC00:42
*** stanchan has joined #openstack-sahara00:50
*** EinstCrazy has joined #openstack-sahara00:56
*** hdd has joined #openstack-sahara01:04
openstackgerritMerged openstack/sahara: Removing token information from debug log  https://review.openstack.org/21688201:08
openstackgerritMerged openstack/sahara: Removing token information from debug log  https://review.openstack.org/21688101:08
openstackgerritMerged openstack/sahara: Removing token information from debug log  https://review.openstack.org/21687901:08
openstackgerritMerged openstack/sahara: Expose cloudera manager information  https://review.openstack.org/21555201:08
openstackgerritMerged openstack/sahara: adding nova to session cache  https://review.openstack.org/21420501:08
openstackgerritMerged openstack/sahara: adding cinder to sessions module  https://review.openstack.org/21683401:08
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/21803201:29
*** htruta has quit IRC02:05
*** htruta has joined #openstack-sahara02:09
openstackgerritMerged openstack/sahara: adding neutron to sessions module  https://review.openstack.org/21687002:10
openstackgerritMerged openstack/sahara: Scenario tests: store ssh key if resources are retained  https://review.openstack.org/21369002:10
*** hdd has quit IRC02:19
*** tellesnobrega has quit IRC02:35
*** tellesnobrega has joined #openstack-sahara02:38
openstackgerritlu huichun proposed openstack/python-saharaclient: Add job execution update api  https://review.openstack.org/20800102:55
*** raildo-afk has quit IRC03:05
*** raildo-afk has joined #openstack-sahara03:08
*** macjack has joined #openstack-sahara03:37
*** saneax has joined #openstack-sahara03:56
*** Poornima has joined #openstack-sahara03:58
*** links has joined #openstack-sahara04:09
*** rodrigods has joined #openstack-sahara04:18
rodrigodshi everyone... is it possible to run a map reduce job written using MrJob (it uses hadoop stream) using Sahara?04:18
*** saneax has quit IRC04:23
*** saneax has joined #openstack-sahara04:25
*** saneax has quit IRC04:29
*** saneax has joined #openstack-sahara04:31
openstackgerritMerged openstack/sahara: Adding support for the Spark Shell job  https://review.openstack.org/19733304:44
*** vgridnev has joined #openstack-sahara04:50
*** vgridnev has quit IRC04:55
*** vgridnev has joined #openstack-sahara05:00
*** hdd has joined #openstack-sahara05:02
openstackgerritKazuki OIKAWA proposed openstack/sahara: internal_ip always selects IPv4 when private network has IPv4/IPv6 dual subnets  https://review.openstack.org/21766905:09
openstackgerritKazuki OIKAWA proposed openstack/sahara: Filter out IPv6 CIDR when generate auto-security group rule  https://review.openstack.org/21758105:15
*** hdd has quit IRC05:59
*** Poornima has quit IRC06:20
*** Poornima has joined #openstack-sahara06:30
openstackgerritKazuki OIKAWA proposed openstack/sahara: internal_ip always selects IPv4 in v4/v6 subnets  https://review.openstack.org/21766906:35
*** macjack has quit IRC06:48
*** nkrinner has joined #openstack-sahara06:48
*** Nikolay_St has joined #openstack-sahara07:05
*** EinstCrazy has quit IRC07:13
*** vgridnev has quit IRC07:31
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Add distribute mode for Sahara  https://review.openstack.org/19272107:35
*** witlessb has joined #openstack-sahara07:41
*** sgotliv has joined #openstack-sahara07:44
openstackgerritlu huichun proposed openstack/sahara: [EDP] Add suspend_job() for sahara edp engine(oozie implementation)  https://review.openstack.org/20144807:53
*** esikachev has joined #openstack-sahara07:59
*** pino|work has joined #openstack-sahara08:09
*** sgotliv has quit IRC08:11
openstackgerritEvgeny Sikachev proposed openstack/sahara: Use less resources in sceanrio gate job  https://review.openstack.org/21707208:36
*** vgridnev has joined #openstack-sahara08:44
*** IBerezovskiy has quit IRC08:58
*** esikachev has quit IRC08:58
*** sreshetnyak has quit IRC08:59
*** degorenko has quit IRC09:01
*** vgridnev has quit IRC09:02
*** ylobankov has quit IRC09:03
*** tosky has joined #openstack-sahara09:07
openstackgerritMerged openstack/sahara: Remove quotes from subshell call in install_scala.sh  https://review.openstack.org/21041309:09
openstackgerritMerged openstack/sahara: Added support of Hue 3.8.1 to MapR plugin  https://review.openstack.org/21709509:09
*** degorenko has joined #openstack-sahara09:30
*** ylobankov has joined #openstack-sahara09:34
*** degorenko has quit IRC09:39
*** ylobankov has quit IRC09:39
*** degorenko has joined #openstack-sahara09:44
openstackgerritArtem Osadchiy proposed openstack/sahara: Removed installation of Oozie sharelibs in MapR plugin  https://review.openstack.org/21817409:46
*** ylobankov has joined #openstack-sahara09:48
*** IBerezovskiy has joined #openstack-sahara09:48
*** sreshetnyak has joined #openstack-sahara09:50
*** vgridnev has joined #openstack-sahara09:56
openstackgerritSergey Lukjanov proposed openstack/python-saharaclient: Add job execution status update support  https://review.openstack.org/20800109:59
openstackgerritSergey Lukjanov proposed openstack/python-saharaclient: Support updates and ACL for objects  https://review.openstack.org/21818209:59
*** esikachev has joined #openstack-sahara10:09
openstackgerritSergey Reshetnyak proposed openstack/sahara-image-elements: Setup JAVA_HOME for cloudera java distro  https://review.openstack.org/21714110:23
*** saneax has quit IRC10:27
*** jamielennox has quit IRC10:27
*** links has quit IRC10:27
*** NikitaKonovalov has quit IRC10:27
*** ruhe has quit IRC10:27
*** links has joined #openstack-sahara10:29
*** NikitaKonovalov has joined #openstack-sahara10:29
*** ruhe has joined #openstack-sahara10:29
*** saneax has joined #openstack-sahara10:30
*** jamielennox has joined #openstack-sahara10:30
*** saneax has quit IRC10:30
*** jamielennox has quit IRC10:30
*** saneax has joined #openstack-sahara10:32
*** jamielennox has joined #openstack-sahara10:32
openstackgerritSergey Reshetnyak proposed openstack/sahara: Add wait condition for heat templates  https://review.openstack.org/16933810:37
*** witlessb has quit IRC11:05
*** witlessb has joined #openstack-sahara11:06
openstackgerritMerged openstack/python-saharaclient: Add support OS_ENDPOINT_TYPE env variable to CLI  https://review.openstack.org/20602511:13
openstackgerritMerged openstack/python-saharaclient: Fixing query string for multiple opts  https://review.openstack.org/21559511:47
openstackgerritMerged openstack/python-saharaclient: Updated from global requirements  https://review.openstack.org/21750311:50
openstackgerritSergey Reshetnyak proposed openstack/sahara: Add wait condition for heat templates  https://review.openstack.org/16933811:53
*** Poornima has quit IRC11:54
openstackgerritVitaly Gridnev proposed openstack/python-saharaclient: Support updates and ACL for objects  https://review.openstack.org/21818212:06
openstackgerritVitaly Gridnev proposed openstack/python-saharaclient: Support updates and ACL for objects  https://review.openstack.org/21818212:07
*** vgridnev has quit IRC12:14
*** vgridnev_ has joined #openstack-sahara12:14
*** raildo-afk is now known as raildo12:16
openstackgerritSergey Reshetnyak proposed openstack/sahara: Use internalURL endpoint by default in Sahara  https://review.openstack.org/20601712:31
openstackgerritSergey Lukjanov proposed openstack/sahara: [DO NOT MERGE] Make scaling always fail  https://review.openstack.org/21596312:34
openstackgerritSergey Lukjanov proposed openstack/sahara: Use less resources in sceanrio gate job  https://review.openstack.org/21707212:34
openstackgerritSergey Lukjanov proposed openstack/sahara: Use demo user and tenant for testing  https://review.openstack.org/21605112:34
openstackgerritSergey Lukjanov proposed openstack/sahara: Explicitly set infra engine based on job type  https://review.openstack.org/21661312:34
*** chlong has joined #openstack-sahara12:34
tellesnobregaNikitaKonovalov, _crobertsrh thanks for your help on the storm UI, got merged :D12:58
elmikotellesnobrega: that's awesome12:58
tellesnobregaelmiko, yeah12:58
tellesnobreganow we have something really awesome to talk about12:58
elmiko+112:58
*** nkrinner has quit IRC12:58
tellesnobregaelmiko, i talked with andrey yesterday and we are looking for ways to fund my trip to tokyo, hopefully it will work12:59
elmikotellesnobrega: cool, i hope it works out =)12:59
elmikoassuming everything works, we'll need to talk at some point about what you'd like me to contribute to the talk13:00
*** nkrinner has joined #openstack-sahara13:03
*** esikachev has quit IRC13:04
tellesnobregafor sure, we set a up a hangout or something to talk about that once i get all organized13:04
tellesnobregaeven if i don't make it to tokyo, andrey will, I'm sure you both can present the talk13:04
*** hdd has joined #openstack-sahara13:05
elmikotellesnobrega: ok, good.  i look forward to it13:06
tellesnobregaelmiko, :)13:06
vgridnev_event log was merged to horizon too13:13
*** saneax has quit IRC13:17
*** esikachev has joined #openstack-sahara13:17
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/21697113:18
*** tmckay has left #openstack-sahara13:22
_crobertsrhtellesnobrega:  Great news!13:22
*** tmckay has joined #openstack-sahara13:25
tellesnobrega_crobertsrh, guess now we know that how powerful you and NikitaKonovalov are :)13:26
*** _crobertsrh is now known as crobertsrh13:27
crobertsrh:)13:27
*** links has quit IRC13:29
*** egafford has joined #openstack-sahara13:31
*** degorenko has quit IRC13:52
*** vgridnev_ has quit IRC13:54
*** vgridnev_ has joined #openstack-sahara13:54
*** degorenko has joined #openstack-sahara13:56
*** saneax has joined #openstack-sahara14:12
vgridnev_tmckay, have you uploaded patch to horizon with fix on Java jobs?14:24
tmckaynope14:24
tmckayYou mean the "None", None, "" check?14:24
tmckaynever got verification from anyone else that they say the problem.  crobertsrh was going to check, don't know if he had the opportunity14:25
tmckaycould be the fault of some other library on F2114:25
crobertsrhI started to try to repro it yesterday.  Got an f21 vm running.14:25
crobertsrhNothing yet since I got sidetracked rebasing some horizon bits.14:25
tmckaydoh14:25
tmckaycrobertsrh, vgridnev_, ok.  Let14:26
tmckaylet's see if crobertsrh can repro today, and if so, we'll file a bug and the (simple) patch14:26
vgridnev_tmckay, I reproduced today that14:26
tmckaycrobertsrh, oh! :)14:27
crobertsrhexcellent14:27
tmckayvgridnev_, do you have a patch ready?  You can push if you do14:27
tmckayotherwise I can go make it14:27
vgridnev_nope14:27
tmckayok, I'll push very soon, and  you can review ;-)14:27
vgridnev_ok14:28
tmckayvgridnev_, thanks for reproducing14:28
tmckayvgridnev_, was that F21?14:28
vgridnev_I don't now, it got validation error on sahara-side14:28
vgridnev_because of wrong input_id="None"14:29
tmckayyep, that sounds like it14:30
*** hdd has quit IRC14:32
tmckaycrobertsrh, vgridnev_, now I can push what I did to work around it, but do we want to understand why we are getting "None" in the first place?14:35
tmckaythat's out of my baileywick :)14:35
tmckayrunning tox -e py27 now14:36
crobertsrhCan you tell me which version of django you have on your problem machine (pip freeze | grep Django)14:36
vgridnev_on my env Django==1.7.1014:37
tmckayoh boy, I don't think I have that problem machine anymore14:37
crobertsrhOk, 1.7.anything should be fine14:38
crobertsrhvgridnev_  Was your repro on fedora 21?14:38
vgridnev_no14:39
vgridnev_mac os14:39
vgridnev_let me recheck, probably env was outdated14:40
*** IBerezovskiy has quit IRC14:42
elmikocrobertsrh: is this the form issue i was having the other day, or another one?14:43
elmikoi have access to my other devstack machine, so i can update it and break it to try this out again14:43
crobertsrhelmiko:  it's the one tmckay had, but I suspect it is related to your issue.14:44
elmikook, i can give it a try again14:45
elmikoi have a feeling i'll run into the glance issue though14:45
tmckaycrobertsrh, I'll email you the patch, horizon won't let me push, don't really care at the moment why that is14:45
crobertsrhOk, I will take a closer look at things.14:46
elmikoif you guys get a chance, this is the last patch for the keystone/sessions bp https://review.openstack.org/#/c/217786/14:46
crobertsrhFirst, I need to be able to see the problem :)14:46
elmikoits just docs, so easy peasy =)14:46
egaffordelmiko: That's a pretty peasy patch right there.14:48
egaffordDon't know when I've seen peasier.14:48
elmikohehe, slow and right over the plate ;)14:49
openstackgerritLuigi Toscano proposed openstack/sahara: Remove useless test dependency 'discover'  https://review.openstack.org/21831814:50
*** degorenko has quit IRC14:51
tmckaybrb14:51
vgridnev_created new env, and not reproduced14:52
vgridnev_tmckay, ^^14:52
tmckayhmm14:52
vgridnev_ha14:53
*** stanchan has quit IRC14:54
crobertsrhvgridnev:  So, how old was the "old" env?14:57
*** ylobankov has quit IRC15:00
crobertsrhOk, it's time for me to finally come up with some sort of repeatable disposable devstack vm for testing this sort of thing.15:01
*** sreshetnyak has quit IRC15:01
crobertsrhWho has a favorite recipe I can steal?15:01
*** esikachev has quit IRC15:02
*** vgridnev_ has quit IRC15:02
elmikocrobertsrh: i have some crude instructions that could be formatted on how to setup a devstack vm using libvirt15:03
crobertsrhI started going down the vagrant route yesterday at one point and almost hosed everything.15:03
*** sreshetnyak has joined #openstack-sahara15:03
elmikoyea, i started on vagrant but it did me wrong15:03
crobertsrhmy current manual creation of vm and stack is getting tiresome.15:04
*** ylobankov has joined #openstack-sahara15:04
elmikosreshetnyak: hi, one question about https://review.openstack.org/#/c/20601715:04
*** hdd has joined #openstack-sahara15:04
elmikocrobertsrh: yea, i created the vm in libvirt, then snapshot once i have it ready. then i just revert to the snapshot whenever i need a clean slate15:04
elmikolet me see how bad my notes are15:05
elmikosreshetnyak: for the keystone client, we should probably pass the endpoint_type to the actual Client call, maybe instead of passing it to the Password auth object?15:07
elmikocrobertsrh: i'm gonna turn this into a blog post, but see if this helps any https://gist.github.com/elmiko/99e36a5017f5423f10b215:09
crobertsrhIt might....ah yes, I was about to go the virt-builder route :)15:09
pino|workcrobertsrh: +1 on virt-builder15:10
elmikoi tried to capture most of my workflow15:10
elmikoyea, pino|work was a bug inspiration ;)15:10
elmikoer big!15:10
elmikohe shepherded me out of vagrant land into the lush libvirt fields15:10
pino|workelmiko: btw, you can automake some of the steps as firstboot script15:11
elmikopino|work: like the setup steps?15:11
pino|workuser creation + sudoers15:12
elmikocool, i need to take this to the next level at some point =)15:12
elmikopino|work: do you know, is it possible to take a snapshot and create a new vm from it?15:12
crobertsrhpino|work:  Feel free to post any recommendations :)15:12
pino|workelmiko: where "it" being?15:12
elmikopino|work: the snapshot. like i have a snapshot of a clean vm. i want to create a new vm based on the snapshot, and then have 2 vms based on the same snapshot. is that possible?15:13
pino|workqemu-img snapshot15:14
* elmiko goes off to read man page15:15
pino|worka "lightweight" alternative is creating a new image overlay on the clean vm, and working on that; drawback is that if the backing image changes, all the overlays can be trashed15:15
*** Nikolay_St has quit IRC15:16
elmikook, obviously i need to do more reading before i start breaking things ;)15:16
pino|workfor example: qemu-img create -f qcow2 -o backing_file=original.qcow2 overlay.qcow215:17
pino|workfrom that, you can use overlay.qcow2 as if it was original.qcow2, and all the changes will be recorded only there15:17
pino|workof course you can create a new image merging original+overlay, or throw the overlay when done, and so on15:18
elmikointeresting...15:18
elmikothanks pino|work, always enlightening =)15:19
elmikopino|work: do you have a blog?15:20
pino|worknope15:21
pino|workcrobertsrh: --firstboot-command 'useradd -m -p devstack devstack' will create at the first boot a devstack user with password devstack15:22
crobertsrhcool, thanks15:22
pino|workcrobertsrh: --install pkg1,pkg2 --install pkg3 will install packages while building (also suggested --update so it is already up-to-date)15:23
crobertsrhexcellent....all good info15:23
elmikoi need to update these instructions with some of that15:24
elmikoi have the --install in there, but it could be better15:24
elmikooh, oops, i dropped the install stuff from that version of the notes15:25
crobertsrhI have to run to lunch, but keep the suggestions coming.  I am going to create the uber stack vm recipe this afternoon.  Automation or bust!!!15:25
pino|workcrobertsrh: --write "/etc/sudoers.d/devstack:devstack ALL=(ALL) NOPASSWD:ALL\n" --chmod 0440:/etc/sudoers.d/devstack will setup sudoers15:25
elmikois that on the virt-install command?15:26
pino|workalways virt-builder/virt-customize15:26
*** ylobankov has quit IRC15:32
*** ylobankov has joined #openstack-sahara15:33
*** sreshetnyak has quit IRC15:34
*** ylobankov has quit IRC15:38
*** chlong has quit IRC15:39
egaffordelmiko: Are we attempting to summarize all currently known changes to the API in the v2 spec (i.e. removal of top-level single-value input and output datasource fields from job_execution), or should such method/object-specific changes be relegated to later specs?15:44
elmikohmm, good question15:46
elmikoi'd like to summarize as many *known* changes as we'd like to put in before we declare it stable enough to release15:46
elmikobut, some of those changes might be large enough to require separate specs15:46
egaffordelmiko: Also, in this API version, are we aiming at a refactor to wholly decouple cluster-templates from clusters and job-templates from jobs? It's been thrown around (and I'm strongly for letting instances fly free of their Platonic ideals,) but. Cool. Perhaps under each bullet, we can add sub-list notes where they are already known?15:47
*** ylobankov has joined #openstack-sahara15:48
egaffordI agree that getting as many early requirements into this spec as possible, as briefly as possible, is a good idea. Keeps us honest / mnemonic later.15:48
elmikoegafford: i think it makes sense to decouple, as much as possible, but i'd need to hear more about the ideas15:48
egaffordelmiko: Cool; let's assume that's not an API spec issue then (doesn't have to be.)15:48
elmikoi mean, my intention is that we produce a stable v2 that has feature completion with v1.1, and also fixes several issues. it should also give us a starting point to tweak the api further through the microversions.15:49
elmikowe should get as many changes as possible in during the experimental phase, so that we have a clean base to build on15:49
elmikoso, if you think there is an improvement that should be in there for the experimental phase. by all means, propose it =)15:49
egaffordelmiko: +1, but in the case that there are known current fields we need to omit, omitting them early will make our lives a lot easier.15:49
elmikoegafford: +1, total agreement15:50
egaffordWe have this rare moment when subtraction is ok, and I want to make sure we rise up and seize it. :)15:50
elmikoi'm also expecting that we will have time during the experimental phase to figure out if things arent't working, or need to be adjusted more.15:50
elmikoegafford: yea, exactly!15:50
*** sreshetnyak has joined #openstack-sahara15:50
elmikoas long as we remain feature complete, it's all good15:51
egaffordelmiko: Yeah!15:52
egaffordAs a note, I was thinking about interface arguments, and how we could use them to automatically deal with cases like the required main class on Java jobs.15:52
egaffordAdd a required argument named "Main Class" mapping to that field. Validation done.15:53
egaffordAll Java jobs get one free.15:53
elmikoegafford: there is great potential in that idea15:54
*** sreshetnyak has quit IRC15:56
*** ylobankov has quit IRC15:59
*** chlong has joined #openstack-sahara16:22
*** vgridnev has joined #openstack-sahara16:24
*** ylobankov has joined #openstack-sahara16:28
*** Nikolay_St has joined #openstack-sahara16:30
*** sreshetnyak has joined #openstack-sahara16:32
*** chlong has quit IRC16:45
*** hdd has quit IRC16:50
*** ylobankov_ has joined #openstack-sahara17:17
openstackgerritKen Chen proposed openstack/sahara: Add CDH 5.4.0 contents in doc  https://review.openstack.org/21256217:34
*** ylobankov_ has left #openstack-sahara17:36
*** pino|work has quit IRC17:39
*** stanchan has joined #openstack-sahara17:41
*** hdd has joined #openstack-sahara17:45
openstackgerritVitaly Gridnev proposed openstack/python-saharaclient: Support updates and ACL for objects  https://review.openstack.org/21818217:47
vgridnevegafford, ^^17:48
egaffordvgridnev: Oh: you really didn't need to change that, but thanks. :)17:50
vgridnevegafford, you was the only reviewer17:50
vgridnevwhy not17:50
egaffordvgridnev: Yeah, that's fair. Not sure why that's not attracting more reviews.17:51
egaffordhttps://review.openstack.org/#/c/218182/4 everyone. Python-saharaclient. Review it or wait for M. :)17:51
vgridnevtmckay, elmiko sreshetnyak ^^17:51
vgridnevfolks, please also review https://review.openstack.org/#/c/197018/ and https://review.openstack.org/#/c/207399/17:53
vgridnevcrobertsrh, ^^17:54
egaffordAlso https://review.openstack.org/#/c/209683/ (tmckay, NikitaKonovalov, any).17:55
tmckaylooking17:55
crobertsrhwill do :)17:57
*** saneax has quit IRC17:57
crobertsrhah, rebases? :)17:58
crobertsrhThat's always the fun when it takes months to merge anything.17:58
egaffordcrobertsrh: SO fun.18:00
vgridnevSO SO Fun because of FF18:02
egaffordvgridnev: If it were any more fun, we'd go mad. With fun.18:05
*** esikachev has joined #openstack-sahara18:05
egaffordSergeyLukjanov: Any plans for what to do with the CRs that https://review.openstack.org/#/c/218182/ replaces? They're not abandoned yet.18:06
vgridnevegafford, I suggest we can put -2 on that with link on this commit18:07
tmckayif chad likes it, I like it18:07
egaffordvgridnev: Yeah, good call that.18:08
egaffordvgridnev: Let me just check whether Sergey's commit is a true superset of the others.18:08
vgridnevegafford, it doesn't contain https://review.openstack.org/#/c/208001/, but it requires changes on sahara side18:09
egaffordI see. So it takes https://review.openstack.org/#/c/213665/ and https://review.openstack.org/#/c/218182/, but cuts out the dependency between them because that isn't in the server yet.18:10
egaffordSensible That.18:10
egaffordvgridnev: Do you know if the Sergeys are about or asleep?18:27
vgridnevegafford, I'm not sure, but i have seen them in our local chats few hours ago18:28
egaffordvgridnev: Cool. sreshetnyak, elmiko: https://review.openstack.org/#/c/218182/ is reasonably critical, client-wise; if we can get your eyes on it so we can +A whenever CI gets done, that'd be great. Thanks!18:31
vgridnevegafford, your first -2 marks?18:31
egaffordvgridnev: :)18:31
egaffordYeah, -2 seems like it's pretty much good for process stuff like this. A bit harsh for normal usage.18:32
egaffordFolks in this community respond just fine to -1s and even 0/+1 comments.18:32
crobertsrhelmiko:  When you do your virt-customize, do you ever see the yum installs fail  (looks like network is totally absent).18:35
*** sreshetnyak has quit IRC18:41
*** ylobankov has quit IRC18:41
*** ylobankov has joined #openstack-sahara18:41
*** sreshetnyak has joined #openstack-sahara18:46
elmikoegafford: ack19:10
elmikocrobertsrh: i usually do the virt customize from the command line19:11
crobertsrhRight...that's failing for me...of course :)19:11
elmikoooph19:11
crobertsrhStill trying a few things19:12
*** hdd has quit IRC19:13
elmikousually, when i have network issues i start to check iptables first19:13
egaffordtmckay: What's status on https://bugs.launchpad.net/sahara/+bug/1486544 at the moment?19:19
openstackLaunchpad bug 1486544 in Sahara "[Spark1.3] Spark jobs doesn't work with Swift" [Critical,Triaged] - Assigned to Trevor McKay (tmckay)19:19
vgridnevegafford, it's works for spark plugin19:20
vgridnevbut there are issues with cdh5419:20
crobertsrhelmiko:  strange, when I do fire-up the qcow2 as a vm, it doesn't get an IP.19:20
elmikocrobertsrh: weird, what does your --network setting to virt-install look like?19:21
egaffordvgridnev: Yeah, I looked at 5.3 w/ Trevor a few days ago, and that seemed to be fine. Not sure how 5.4 is doing right now, though. I think we determined that as it wasn't a regression, the severity was much reduced, so I want to represent that in the bug queue.19:21
crobertsrhI used the gui to install it....trying a command line version now19:21
elmikoah, ok19:21
vgridnevdoes someone knows some special channel for devstack related questions?19:22
elmikovgridnev: openstack-dev maybe?19:22
vgridnevI'm looking for devstack core-reviewers19:22
openstackgerritBertrand Lallau proposed openstack/sahara: Removing unused dependency: discover  https://review.openstack.org/21842919:23
elmikooh, note sure on that one19:24
crobertsrhNot sure I know of any such place, vgridnev.19:25
tmckayegafford, status is it is fixed for spark standalone, cdh 54 is still messed up but not a regression19:25
tmckayit will work on cdh 53 (older version of spark)19:26
tmckayegafford, so I would call it "closed"19:26
egaffordYup; that was my impression. You feeling medium or high for the remaining bug?19:26
egaffordWell, 5.4 is still messed up.19:26
tmckaymedium19:26
tmckayI think I would make it a separate bug19:27
egaffordSo we can spin a new bug, if you like, or limit the scope of the existing one.19:27
egaffordSensible.19:27
tmckayyeah19:27
tmckaythey really function in different ways19:27
*** hdd has joined #openstack-sahara19:28
egaffordvgridnev, tmckay: Huh; did you look at this? https://bugs.launchpad.net/sahara/+bug/1474128 / https://review.openstack.org/20649819:29
openstackLaunchpad bug 1474128 in Sahara "[CDH] Unable to launch EDP Spark jobs with Swift" [High,Fix committed] - Assigned to Oleg Borisenko (al-foo)19:29
vgridnevegafford, yes19:29
egaffordvgridnev: I take it that fix was not wholly successful for 5.4.19:30
elmikoegafford: you wanna do the +A honors on https://review.openstack.org/#/c/218182 ?19:30
tmckayegafford, I think it wasn't19:30
egaffordelmiko: I think we still need to wait for the fake CI.19:30
tmckayit works fine for 5.319:30
egaffordtmckay: Yup.19:30
elmikoack19:31
egaffordelmiko: Also, I super don't care who actually does +A; I just want it +Aed, as it represents a lot of functionality client-side.19:31
elmikoegafford: ok, i think it's good to go19:31
egaffordelmiko: Eh, I am a slave to CI, and I don't think we're actually under that much time pressure.19:33
egaffordI just wanted to make sure we were ready when CI finishes. We are; all's well.19:34
egaffordThanks!19:34
elmikocool, i mean, even after +A it will still go through ci again19:34
egaffordelmiko: That's true; that's true.19:35
elmikothis one https://review.openstack.org/#/c/208001 still seems to have issues19:35
egaffordDunno. I've said it before, I'll say it again. QA background: it did things to me, man.19:35
elmikohaha, totally fair19:36
egaffordYeah, that one isn't in the server yet.19:36
egaffordWhich is why https://review.openstack.org/#/c/218182 exists.19:36
egaffordhttps://review.openstack.org/214098 and https://review.openstack.org/218318 depend on 208001, but it can't pass the gate because https://review.openstack.org/201448 still has some problems server-side.19:37
*** devlaps has joined #openstack-sahara19:37
elmikoooph19:38
egafford218182 is the two dependent changes without the dependency.19:39
elmikothat makes sense, i was like "this looks familiar"19:39
egaffordYup.19:40
egafford(Shout out to vgridnev for giving me the history on all that.)19:40
vgridnevActually there are lot of problems with huichun patches.19:42
vgridnevand it's seems that the last beg for review for today: https://review.openstack.org/#/c/197965/19:52
tmckayegafford, new bug, https://bugs.launchpad.net/sahara/+bug/149001219:58
openstackLaunchpad bug 1490012 in Sahara "[EDP] Swift access from Spark does not work with CDH 5.4" [Undecided,New]19:58
egaffordtmckay: Yay!19:59
egaffordI mean, yay new bug, granted, which is kind of a lousy flavor of yay. But, yay!19:59
elmikolol19:59
*** tmckay has quit IRC20:26
*** tmckay has joined #openstack-sahara20:26
*** Nikolay_St has quit IRC20:29
*** esikachev has quit IRC20:45
*** raildo is now known as raildo-afk21:02
*** crobertsrh is now known as _crobertsrh21:19
*** hdd has quit IRC21:25
*** hdd has joined #openstack-sahara21:25
*** hdd has quit IRC21:41
*** hdd has joined #openstack-sahara21:49
*** hdd has quit IRC21:49
*** egafford has quit IRC21:52
*** esikachev has joined #openstack-sahara22:01
*** esikachev has quit IRC22:08
*** vgridnev has quit IRC22:19
*** saneax has joined #openstack-sahara22:45
*** jamielennox is now known as jamielennox|away23:00
openstackgerritMerged openstack/sahara: Add sample spark wordcount job  https://review.openstack.org/20703923:12
openstackgerritMerged openstack/sahara: Fix problem with using auto security groups in Heat  https://review.openstack.org/21779123:13
openstackgerritMerged openstack/sahara: doc, sahara-templates: fix typo  https://review.openstack.org/21365323:13
openstackgerritMerged openstack/sahara: Deprecate Vanilla 2.6.0  https://review.openstack.org/21320123:13
openstackgerritMerged openstack/sahara: Remove never executable code from devstack plugin  https://review.openstack.org/21389523:13
openstackgerritMerged openstack/sahara: Fix wrong compute nodes name in doc  https://review.openstack.org/21180623:13
*** david-lyle has quit IRC23:24
*** tosky has quit IRC23:26
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/21697123:48

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!