*** saneax has quit IRC | 00:02 | |
*** hdd has quit IRC | 00:42 | |
*** stanchan has joined #openstack-sahara | 00:50 | |
*** EinstCrazy has joined #openstack-sahara | 00:56 | |
*** hdd has joined #openstack-sahara | 01:04 | |
openstackgerrit | Merged openstack/sahara: Removing token information from debug log https://review.openstack.org/216882 | 01:08 |
---|---|---|
openstackgerrit | Merged openstack/sahara: Removing token information from debug log https://review.openstack.org/216881 | 01:08 |
openstackgerrit | Merged openstack/sahara: Removing token information from debug log https://review.openstack.org/216879 | 01:08 |
openstackgerrit | Merged openstack/sahara: Expose cloudera manager information https://review.openstack.org/215552 | 01:08 |
openstackgerrit | Merged openstack/sahara: adding nova to session cache https://review.openstack.org/214205 | 01:08 |
openstackgerrit | Merged openstack/sahara: adding cinder to sessions module https://review.openstack.org/216834 | 01:08 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/218032 | 01:29 |
*** htruta has quit IRC | 02:05 | |
*** htruta has joined #openstack-sahara | 02:09 | |
openstackgerrit | Merged openstack/sahara: adding neutron to sessions module https://review.openstack.org/216870 | 02:10 |
openstackgerrit | Merged openstack/sahara: Scenario tests: store ssh key if resources are retained https://review.openstack.org/213690 | 02:10 |
*** hdd has quit IRC | 02:19 | |
*** tellesnobrega has quit IRC | 02:35 | |
*** tellesnobrega has joined #openstack-sahara | 02:38 | |
openstackgerrit | lu huichun proposed openstack/python-saharaclient: Add job execution update api https://review.openstack.org/208001 | 02:55 |
*** raildo-afk has quit IRC | 03:05 | |
*** raildo-afk has joined #openstack-sahara | 03:08 | |
*** macjack has joined #openstack-sahara | 03:37 | |
*** saneax has joined #openstack-sahara | 03:56 | |
*** Poornima has joined #openstack-sahara | 03:58 | |
*** links has joined #openstack-sahara | 04:09 | |
*** rodrigods has joined #openstack-sahara | 04:18 | |
rodrigods | hi everyone... is it possible to run a map reduce job written using MrJob (it uses hadoop stream) using Sahara? | 04:18 |
*** saneax has quit IRC | 04:23 | |
*** saneax has joined #openstack-sahara | 04:25 | |
*** saneax has quit IRC | 04:29 | |
*** saneax has joined #openstack-sahara | 04:31 | |
openstackgerrit | Merged openstack/sahara: Adding support for the Spark Shell job https://review.openstack.org/197333 | 04:44 |
*** vgridnev has joined #openstack-sahara | 04:50 | |
*** vgridnev has quit IRC | 04:55 | |
*** vgridnev has joined #openstack-sahara | 05:00 | |
*** hdd has joined #openstack-sahara | 05:02 | |
openstackgerrit | Kazuki OIKAWA proposed openstack/sahara: internal_ip always selects IPv4 when private network has IPv4/IPv6 dual subnets https://review.openstack.org/217669 | 05:09 |
openstackgerrit | Kazuki OIKAWA proposed openstack/sahara: Filter out IPv6 CIDR when generate auto-security group rule https://review.openstack.org/217581 | 05:15 |
*** hdd has quit IRC | 05:59 | |
*** Poornima has quit IRC | 06:20 | |
*** Poornima has joined #openstack-sahara | 06:30 | |
openstackgerrit | Kazuki OIKAWA proposed openstack/sahara: internal_ip always selects IPv4 in v4/v6 subnets https://review.openstack.org/217669 | 06:35 |
*** macjack has quit IRC | 06:48 | |
*** nkrinner has joined #openstack-sahara | 06:48 | |
*** Nikolay_St has joined #openstack-sahara | 07:05 | |
*** EinstCrazy has quit IRC | 07:13 | |
*** vgridnev has quit IRC | 07:31 | |
openstackgerrit | Denis Egorenko proposed openstack/puppet-sahara: Add distribute mode for Sahara https://review.openstack.org/192721 | 07:35 |
*** witlessb has joined #openstack-sahara | 07:41 | |
*** sgotliv has joined #openstack-sahara | 07:44 | |
openstackgerrit | lu huichun proposed openstack/sahara: [EDP] Add suspend_job() for sahara edp engine(oozie implementation) https://review.openstack.org/201448 | 07:53 |
*** esikachev has joined #openstack-sahara | 07:59 | |
*** pino|work has joined #openstack-sahara | 08:09 | |
*** sgotliv has quit IRC | 08:11 | |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Use less resources in sceanrio gate job https://review.openstack.org/217072 | 08:36 |
*** vgridnev has joined #openstack-sahara | 08:44 | |
*** IBerezovskiy has quit IRC | 08:58 | |
*** esikachev has quit IRC | 08:58 | |
*** sreshetnyak has quit IRC | 08:59 | |
*** degorenko has quit IRC | 09:01 | |
*** vgridnev has quit IRC | 09:02 | |
*** ylobankov has quit IRC | 09:03 | |
*** tosky has joined #openstack-sahara | 09:07 | |
openstackgerrit | Merged openstack/sahara: Remove quotes from subshell call in install_scala.sh https://review.openstack.org/210413 | 09:09 |
openstackgerrit | Merged openstack/sahara: Added support of Hue 3.8.1 to MapR plugin https://review.openstack.org/217095 | 09:09 |
*** degorenko has joined #openstack-sahara | 09:30 | |
*** ylobankov has joined #openstack-sahara | 09:34 | |
*** degorenko has quit IRC | 09:39 | |
*** ylobankov has quit IRC | 09:39 | |
*** degorenko has joined #openstack-sahara | 09:44 | |
openstackgerrit | Artem Osadchiy proposed openstack/sahara: Removed installation of Oozie sharelibs in MapR plugin https://review.openstack.org/218174 | 09:46 |
*** ylobankov has joined #openstack-sahara | 09:48 | |
*** IBerezovskiy has joined #openstack-sahara | 09:48 | |
*** sreshetnyak has joined #openstack-sahara | 09:50 | |
*** vgridnev has joined #openstack-sahara | 09:56 | |
openstackgerrit | Sergey Lukjanov proposed openstack/python-saharaclient: Add job execution status update support https://review.openstack.org/208001 | 09:59 |
openstackgerrit | Sergey Lukjanov proposed openstack/python-saharaclient: Support updates and ACL for objects https://review.openstack.org/218182 | 09:59 |
*** esikachev has joined #openstack-sahara | 10:09 | |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara-image-elements: Setup JAVA_HOME for cloudera java distro https://review.openstack.org/217141 | 10:23 |
*** saneax has quit IRC | 10:27 | |
*** jamielennox has quit IRC | 10:27 | |
*** links has quit IRC | 10:27 | |
*** NikitaKonovalov has quit IRC | 10:27 | |
*** ruhe has quit IRC | 10:27 | |
*** links has joined #openstack-sahara | 10:29 | |
*** NikitaKonovalov has joined #openstack-sahara | 10:29 | |
*** ruhe has joined #openstack-sahara | 10:29 | |
*** saneax has joined #openstack-sahara | 10:30 | |
*** jamielennox has joined #openstack-sahara | 10:30 | |
*** saneax has quit IRC | 10:30 | |
*** jamielennox has quit IRC | 10:30 | |
*** saneax has joined #openstack-sahara | 10:32 | |
*** jamielennox has joined #openstack-sahara | 10:32 | |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Add wait condition for heat templates https://review.openstack.org/169338 | 10:37 |
*** witlessb has quit IRC | 11:05 | |
*** witlessb has joined #openstack-sahara | 11:06 | |
openstackgerrit | Merged openstack/python-saharaclient: Add support OS_ENDPOINT_TYPE env variable to CLI https://review.openstack.org/206025 | 11:13 |
openstackgerrit | Merged openstack/python-saharaclient: Fixing query string for multiple opts https://review.openstack.org/215595 | 11:47 |
openstackgerrit | Merged openstack/python-saharaclient: Updated from global requirements https://review.openstack.org/217503 | 11:50 |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Add wait condition for heat templates https://review.openstack.org/169338 | 11:53 |
*** Poornima has quit IRC | 11:54 | |
openstackgerrit | Vitaly Gridnev proposed openstack/python-saharaclient: Support updates and ACL for objects https://review.openstack.org/218182 | 12:06 |
openstackgerrit | Vitaly Gridnev proposed openstack/python-saharaclient: Support updates and ACL for objects https://review.openstack.org/218182 | 12:07 |
*** vgridnev has quit IRC | 12:14 | |
*** vgridnev_ has joined #openstack-sahara | 12:14 | |
*** raildo-afk is now known as raildo | 12:16 | |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Use internalURL endpoint by default in Sahara https://review.openstack.org/206017 | 12:31 |
openstackgerrit | Sergey Lukjanov proposed openstack/sahara: [DO NOT MERGE] Make scaling always fail https://review.openstack.org/215963 | 12:34 |
openstackgerrit | Sergey Lukjanov proposed openstack/sahara: Use less resources in sceanrio gate job https://review.openstack.org/217072 | 12:34 |
openstackgerrit | Sergey Lukjanov proposed openstack/sahara: Use demo user and tenant for testing https://review.openstack.org/216051 | 12:34 |
openstackgerrit | Sergey Lukjanov proposed openstack/sahara: Explicitly set infra engine based on job type https://review.openstack.org/216613 | 12:34 |
*** chlong has joined #openstack-sahara | 12:34 | |
tellesnobrega | NikitaKonovalov, _crobertsrh thanks for your help on the storm UI, got merged :D | 12:58 |
elmiko | tellesnobrega: that's awesome | 12:58 |
tellesnobrega | elmiko, yeah | 12:58 |
tellesnobrega | now we have something really awesome to talk about | 12:58 |
elmiko | +1 | 12:58 |
*** nkrinner has quit IRC | 12:58 | |
tellesnobrega | elmiko, i talked with andrey yesterday and we are looking for ways to fund my trip to tokyo, hopefully it will work | 12:59 |
elmiko | tellesnobrega: cool, i hope it works out =) | 12:59 |
elmiko | assuming everything works, we'll need to talk at some point about what you'd like me to contribute to the talk | 13:00 |
*** nkrinner has joined #openstack-sahara | 13:03 | |
*** esikachev has quit IRC | 13:04 | |
tellesnobrega | for sure, we set a up a hangout or something to talk about that once i get all organized | 13:04 |
tellesnobrega | even if i don't make it to tokyo, andrey will, I'm sure you both can present the talk | 13:04 |
*** hdd has joined #openstack-sahara | 13:05 | |
elmiko | tellesnobrega: ok, good. i look forward to it | 13:06 |
tellesnobrega | elmiko, :) | 13:06 |
vgridnev_ | event log was merged to horizon too | 13:13 |
*** saneax has quit IRC | 13:17 | |
*** esikachev has joined #openstack-sahara | 13:17 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/216971 | 13:18 |
*** tmckay has left #openstack-sahara | 13:22 | |
_crobertsrh | tellesnobrega: Great news! | 13:22 |
*** tmckay has joined #openstack-sahara | 13:25 | |
tellesnobrega | _crobertsrh, guess now we know that how powerful you and NikitaKonovalov are :) | 13:26 |
*** _crobertsrh is now known as crobertsrh | 13:27 | |
crobertsrh | :) | 13:27 |
*** links has quit IRC | 13:29 | |
*** egafford has joined #openstack-sahara | 13:31 | |
*** degorenko has quit IRC | 13:52 | |
*** vgridnev_ has quit IRC | 13:54 | |
*** vgridnev_ has joined #openstack-sahara | 13:54 | |
*** degorenko has joined #openstack-sahara | 13:56 | |
*** saneax has joined #openstack-sahara | 14:12 | |
vgridnev_ | tmckay, have you uploaded patch to horizon with fix on Java jobs? | 14:24 |
tmckay | nope | 14:24 |
tmckay | You mean the "None", None, "" check? | 14:24 |
tmckay | never got verification from anyone else that they say the problem. crobertsrh was going to check, don't know if he had the opportunity | 14:25 |
tmckay | could be the fault of some other library on F21 | 14:25 |
crobertsrh | I started to try to repro it yesterday. Got an f21 vm running. | 14:25 |
crobertsrh | Nothing yet since I got sidetracked rebasing some horizon bits. | 14:25 |
tmckay | doh | 14:25 |
tmckay | crobertsrh, vgridnev_, ok. Let | 14:26 |
tmckay | let's see if crobertsrh can repro today, and if so, we'll file a bug and the (simple) patch | 14:26 |
vgridnev_ | tmckay, I reproduced today that | 14:26 |
tmckay | crobertsrh, oh! :) | 14:27 |
crobertsrh | excellent | 14:27 |
tmckay | vgridnev_, do you have a patch ready? You can push if you do | 14:27 |
tmckay | otherwise I can go make it | 14:27 |
vgridnev_ | nope | 14:27 |
tmckay | ok, I'll push very soon, and you can review ;-) | 14:27 |
vgridnev_ | ok | 14:28 |
tmckay | vgridnev_, thanks for reproducing | 14:28 |
tmckay | vgridnev_, was that F21? | 14:28 |
vgridnev_ | I don't now, it got validation error on sahara-side | 14:28 |
vgridnev_ | because of wrong input_id="None" | 14:29 |
tmckay | yep, that sounds like it | 14:30 |
*** hdd has quit IRC | 14:32 | |
tmckay | crobertsrh, vgridnev_, now I can push what I did to work around it, but do we want to understand why we are getting "None" in the first place? | 14:35 |
tmckay | that's out of my baileywick :) | 14:35 |
tmckay | running tox -e py27 now | 14:36 |
crobertsrh | Can you tell me which version of django you have on your problem machine (pip freeze | grep Django) | 14:36 |
vgridnev_ | on my env Django==1.7.10 | 14:37 |
tmckay | oh boy, I don't think I have that problem machine anymore | 14:37 |
crobertsrh | Ok, 1.7.anything should be fine | 14:38 |
crobertsrh | vgridnev_ Was your repro on fedora 21? | 14:38 |
vgridnev_ | no | 14:39 |
vgridnev_ | mac os | 14:39 |
vgridnev_ | let me recheck, probably env was outdated | 14:40 |
*** IBerezovskiy has quit IRC | 14:42 | |
elmiko | crobertsrh: is this the form issue i was having the other day, or another one? | 14:43 |
elmiko | i have access to my other devstack machine, so i can update it and break it to try this out again | 14:43 |
crobertsrh | elmiko: it's the one tmckay had, but I suspect it is related to your issue. | 14:44 |
elmiko | ok, i can give it a try again | 14:45 |
elmiko | i have a feeling i'll run into the glance issue though | 14:45 |
tmckay | crobertsrh, I'll email you the patch, horizon won't let me push, don't really care at the moment why that is | 14:45 |
crobertsrh | Ok, I will take a closer look at things. | 14:46 |
elmiko | if you guys get a chance, this is the last patch for the keystone/sessions bp https://review.openstack.org/#/c/217786/ | 14:46 |
crobertsrh | First, I need to be able to see the problem :) | 14:46 |
elmiko | its just docs, so easy peasy =) | 14:46 |
egafford | elmiko: That's a pretty peasy patch right there. | 14:48 |
egafford | Don't know when I've seen peasier. | 14:48 |
elmiko | hehe, slow and right over the plate ;) | 14:49 |
openstackgerrit | Luigi Toscano proposed openstack/sahara: Remove useless test dependency 'discover' https://review.openstack.org/218318 | 14:50 |
*** degorenko has quit IRC | 14:51 | |
tmckay | brb | 14:51 |
vgridnev_ | created new env, and not reproduced | 14:52 |
vgridnev_ | tmckay, ^^ | 14:52 |
tmckay | hmm | 14:52 |
vgridnev_ | ha | 14:53 |
*** stanchan has quit IRC | 14:54 | |
crobertsrh | vgridnev: So, how old was the "old" env? | 14:57 |
*** ylobankov has quit IRC | 15:00 | |
crobertsrh | Ok, it's time for me to finally come up with some sort of repeatable disposable devstack vm for testing this sort of thing. | 15:01 |
*** sreshetnyak has quit IRC | 15:01 | |
crobertsrh | Who has a favorite recipe I can steal? | 15:01 |
*** esikachev has quit IRC | 15:02 | |
*** vgridnev_ has quit IRC | 15:02 | |
elmiko | crobertsrh: i have some crude instructions that could be formatted on how to setup a devstack vm using libvirt | 15:03 |
crobertsrh | I started going down the vagrant route yesterday at one point and almost hosed everything. | 15:03 |
*** sreshetnyak has joined #openstack-sahara | 15:03 | |
elmiko | yea, i started on vagrant but it did me wrong | 15:03 |
crobertsrh | my current manual creation of vm and stack is getting tiresome. | 15:04 |
*** ylobankov has joined #openstack-sahara | 15:04 | |
elmiko | sreshetnyak: hi, one question about https://review.openstack.org/#/c/206017 | 15:04 |
*** hdd has joined #openstack-sahara | 15:04 | |
elmiko | crobertsrh: yea, i created the vm in libvirt, then snapshot once i have it ready. then i just revert to the snapshot whenever i need a clean slate | 15:04 |
elmiko | let me see how bad my notes are | 15:05 |
elmiko | sreshetnyak: for the keystone client, we should probably pass the endpoint_type to the actual Client call, maybe instead of passing it to the Password auth object? | 15:07 |
elmiko | crobertsrh: i'm gonna turn this into a blog post, but see if this helps any https://gist.github.com/elmiko/99e36a5017f5423f10b2 | 15:09 |
crobertsrh | It might....ah yes, I was about to go the virt-builder route :) | 15:09 |
pino|work | crobertsrh: +1 on virt-builder | 15:10 |
elmiko | i tried to capture most of my workflow | 15:10 |
elmiko | yea, pino|work was a bug inspiration ;) | 15:10 |
elmiko | er big! | 15:10 |
elmiko | he shepherded me out of vagrant land into the lush libvirt fields | 15:10 |
pino|work | elmiko: btw, you can automake some of the steps as firstboot script | 15:11 |
elmiko | pino|work: like the setup steps? | 15:11 |
pino|work | user creation + sudoers | 15:12 |
elmiko | cool, i need to take this to the next level at some point =) | 15:12 |
elmiko | pino|work: do you know, is it possible to take a snapshot and create a new vm from it? | 15:12 |
crobertsrh | pino|work: Feel free to post any recommendations :) | 15:12 |
pino|work | elmiko: where "it" being? | 15:12 |
elmiko | pino|work: the snapshot. like i have a snapshot of a clean vm. i want to create a new vm based on the snapshot, and then have 2 vms based on the same snapshot. is that possible? | 15:13 |
pino|work | qemu-img snapshot | 15:14 |
* elmiko goes off to read man page | 15:15 | |
pino|work | a "lightweight" alternative is creating a new image overlay on the clean vm, and working on that; drawback is that if the backing image changes, all the overlays can be trashed | 15:15 |
*** Nikolay_St has quit IRC | 15:16 | |
elmiko | ok, obviously i need to do more reading before i start breaking things ;) | 15:16 |
pino|work | for example: qemu-img create -f qcow2 -o backing_file=original.qcow2 overlay.qcow2 | 15:17 |
pino|work | from that, you can use overlay.qcow2 as if it was original.qcow2, and all the changes will be recorded only there | 15:17 |
pino|work | of course you can create a new image merging original+overlay, or throw the overlay when done, and so on | 15:18 |
elmiko | interesting... | 15:18 |
elmiko | thanks pino|work, always enlightening =) | 15:19 |
elmiko | pino|work: do you have a blog? | 15:20 |
pino|work | nope | 15:21 |
pino|work | crobertsrh: --firstboot-command 'useradd -m -p devstack devstack' will create at the first boot a devstack user with password devstack | 15:22 |
crobertsrh | cool, thanks | 15:22 |
pino|work | crobertsrh: --install pkg1,pkg2 --install pkg3 will install packages while building (also suggested --update so it is already up-to-date) | 15:23 |
crobertsrh | excellent....all good info | 15:23 |
elmiko | i need to update these instructions with some of that | 15:24 |
elmiko | i have the --install in there, but it could be better | 15:24 |
elmiko | oh, oops, i dropped the install stuff from that version of the notes | 15:25 |
crobertsrh | I have to run to lunch, but keep the suggestions coming. I am going to create the uber stack vm recipe this afternoon. Automation or bust!!! | 15:25 |
pino|work | crobertsrh: --write "/etc/sudoers.d/devstack:devstack ALL=(ALL) NOPASSWD:ALL\n" --chmod 0440:/etc/sudoers.d/devstack will setup sudoers | 15:25 |
elmiko | is that on the virt-install command? | 15:26 |
pino|work | always virt-builder/virt-customize | 15:26 |
*** ylobankov has quit IRC | 15:32 | |
*** ylobankov has joined #openstack-sahara | 15:33 | |
*** sreshetnyak has quit IRC | 15:34 | |
*** ylobankov has quit IRC | 15:38 | |
*** chlong has quit IRC | 15:39 | |
egafford | elmiko: Are we attempting to summarize all currently known changes to the API in the v2 spec (i.e. removal of top-level single-value input and output datasource fields from job_execution), or should such method/object-specific changes be relegated to later specs? | 15:44 |
elmiko | hmm, good question | 15:46 |
elmiko | i'd like to summarize as many *known* changes as we'd like to put in before we declare it stable enough to release | 15:46 |
elmiko | but, some of those changes might be large enough to require separate specs | 15:46 |
egafford | elmiko: Also, in this API version, are we aiming at a refactor to wholly decouple cluster-templates from clusters and job-templates from jobs? It's been thrown around (and I'm strongly for letting instances fly free of their Platonic ideals,) but. Cool. Perhaps under each bullet, we can add sub-list notes where they are already known? | 15:47 |
*** ylobankov has joined #openstack-sahara | 15:48 | |
egafford | I agree that getting as many early requirements into this spec as possible, as briefly as possible, is a good idea. Keeps us honest / mnemonic later. | 15:48 |
elmiko | egafford: i think it makes sense to decouple, as much as possible, but i'd need to hear more about the ideas | 15:48 |
egafford | elmiko: Cool; let's assume that's not an API spec issue then (doesn't have to be.) | 15:48 |
elmiko | i mean, my intention is that we produce a stable v2 that has feature completion with v1.1, and also fixes several issues. it should also give us a starting point to tweak the api further through the microversions. | 15:49 |
elmiko | we should get as many changes as possible in during the experimental phase, so that we have a clean base to build on | 15:49 |
elmiko | so, if you think there is an improvement that should be in there for the experimental phase. by all means, propose it =) | 15:49 |
egafford | elmiko: +1, but in the case that there are known current fields we need to omit, omitting them early will make our lives a lot easier. | 15:49 |
elmiko | egafford: +1, total agreement | 15:50 |
egafford | We have this rare moment when subtraction is ok, and I want to make sure we rise up and seize it. :) | 15:50 |
elmiko | i'm also expecting that we will have time during the experimental phase to figure out if things arent't working, or need to be adjusted more. | 15:50 |
elmiko | egafford: yea, exactly! | 15:50 |
*** sreshetnyak has joined #openstack-sahara | 15:50 | |
elmiko | as long as we remain feature complete, it's all good | 15:51 |
egafford | elmiko: Yeah! | 15:52 |
egafford | As a note, I was thinking about interface arguments, and how we could use them to automatically deal with cases like the required main class on Java jobs. | 15:52 |
egafford | Add a required argument named "Main Class" mapping to that field. Validation done. | 15:53 |
egafford | All Java jobs get one free. | 15:53 |
elmiko | egafford: there is great potential in that idea | 15:54 |
*** sreshetnyak has quit IRC | 15:56 | |
*** ylobankov has quit IRC | 15:59 | |
*** chlong has joined #openstack-sahara | 16:22 | |
*** vgridnev has joined #openstack-sahara | 16:24 | |
*** ylobankov has joined #openstack-sahara | 16:28 | |
*** Nikolay_St has joined #openstack-sahara | 16:30 | |
*** sreshetnyak has joined #openstack-sahara | 16:32 | |
*** chlong has quit IRC | 16:45 | |
*** hdd has quit IRC | 16:50 | |
*** ylobankov_ has joined #openstack-sahara | 17:17 | |
openstackgerrit | Ken Chen proposed openstack/sahara: Add CDH 5.4.0 contents in doc https://review.openstack.org/212562 | 17:34 |
*** ylobankov_ has left #openstack-sahara | 17:36 | |
*** pino|work has quit IRC | 17:39 | |
*** stanchan has joined #openstack-sahara | 17:41 | |
*** hdd has joined #openstack-sahara | 17:45 | |
openstackgerrit | Vitaly Gridnev proposed openstack/python-saharaclient: Support updates and ACL for objects https://review.openstack.org/218182 | 17:47 |
vgridnev | egafford, ^^ | 17:48 |
egafford | vgridnev: Oh: you really didn't need to change that, but thanks. :) | 17:50 |
vgridnev | egafford, you was the only reviewer | 17:50 |
vgridnev | why not | 17:50 |
egafford | vgridnev: Yeah, that's fair. Not sure why that's not attracting more reviews. | 17:51 |
egafford | https://review.openstack.org/#/c/218182/4 everyone. Python-saharaclient. Review it or wait for M. :) | 17:51 |
vgridnev | tmckay, elmiko sreshetnyak ^^ | 17:51 |
vgridnev | folks, please also review https://review.openstack.org/#/c/197018/ and https://review.openstack.org/#/c/207399/ | 17:53 |
vgridnev | crobertsrh, ^^ | 17:54 |
egafford | Also https://review.openstack.org/#/c/209683/ (tmckay, NikitaKonovalov, any). | 17:55 |
tmckay | looking | 17:55 |
crobertsrh | will do :) | 17:57 |
*** saneax has quit IRC | 17:57 | |
crobertsrh | ah, rebases? :) | 17:58 |
crobertsrh | That's always the fun when it takes months to merge anything. | 17:58 |
egafford | crobertsrh: SO fun. | 18:00 |
vgridnev | SO SO Fun because of FF | 18:02 |
egafford | vgridnev: If it were any more fun, we'd go mad. With fun. | 18:05 |
*** esikachev has joined #openstack-sahara | 18:05 | |
egafford | SergeyLukjanov: Any plans for what to do with the CRs that https://review.openstack.org/#/c/218182/ replaces? They're not abandoned yet. | 18:06 |
vgridnev | egafford, I suggest we can put -2 on that with link on this commit | 18:07 |
tmckay | if chad likes it, I like it | 18:07 |
egafford | vgridnev: Yeah, good call that. | 18:08 |
egafford | vgridnev: Let me just check whether Sergey's commit is a true superset of the others. | 18:08 |
vgridnev | egafford, it doesn't contain https://review.openstack.org/#/c/208001/, but it requires changes on sahara side | 18:09 |
egafford | I see. So it takes https://review.openstack.org/#/c/213665/ and https://review.openstack.org/#/c/218182/, but cuts out the dependency between them because that isn't in the server yet. | 18:10 |
egafford | Sensible That. | 18:10 |
egafford | vgridnev: Do you know if the Sergeys are about or asleep? | 18:27 |
vgridnev | egafford, I'm not sure, but i have seen them in our local chats few hours ago | 18:28 |
egafford | vgridnev: Cool. sreshetnyak, elmiko: https://review.openstack.org/#/c/218182/ is reasonably critical, client-wise; if we can get your eyes on it so we can +A whenever CI gets done, that'd be great. Thanks! | 18:31 |
vgridnev | egafford, your first -2 marks? | 18:31 |
egafford | vgridnev: :) | 18:31 |
egafford | Yeah, -2 seems like it's pretty much good for process stuff like this. A bit harsh for normal usage. | 18:32 |
egafford | Folks in this community respond just fine to -1s and even 0/+1 comments. | 18:32 |
crobertsrh | elmiko: When you do your virt-customize, do you ever see the yum installs fail (looks like network is totally absent). | 18:35 |
*** sreshetnyak has quit IRC | 18:41 | |
*** ylobankov has quit IRC | 18:41 | |
*** ylobankov has joined #openstack-sahara | 18:41 | |
*** sreshetnyak has joined #openstack-sahara | 18:46 | |
elmiko | egafford: ack | 19:10 |
elmiko | crobertsrh: i usually do the virt customize from the command line | 19:11 |
crobertsrh | Right...that's failing for me...of course :) | 19:11 |
elmiko | ooph | 19:11 |
crobertsrh | Still trying a few things | 19:12 |
*** hdd has quit IRC | 19:13 | |
elmiko | usually, when i have network issues i start to check iptables first | 19:13 |
egafford | tmckay: What's status on https://bugs.launchpad.net/sahara/+bug/1486544 at the moment? | 19:19 |
openstack | Launchpad bug 1486544 in Sahara "[Spark1.3] Spark jobs doesn't work with Swift" [Critical,Triaged] - Assigned to Trevor McKay (tmckay) | 19:19 |
vgridnev | egafford, it's works for spark plugin | 19:20 |
vgridnev | but there are issues with cdh54 | 19:20 |
crobertsrh | elmiko: strange, when I do fire-up the qcow2 as a vm, it doesn't get an IP. | 19:20 |
elmiko | crobertsrh: weird, what does your --network setting to virt-install look like? | 19:21 |
egafford | vgridnev: Yeah, I looked at 5.3 w/ Trevor a few days ago, and that seemed to be fine. Not sure how 5.4 is doing right now, though. I think we determined that as it wasn't a regression, the severity was much reduced, so I want to represent that in the bug queue. | 19:21 |
crobertsrh | I used the gui to install it....trying a command line version now | 19:21 |
elmiko | ah, ok | 19:21 |
vgridnev | does someone knows some special channel for devstack related questions? | 19:22 |
elmiko | vgridnev: openstack-dev maybe? | 19:22 |
vgridnev | I'm looking for devstack core-reviewers | 19:22 |
openstackgerrit | Bertrand Lallau proposed openstack/sahara: Removing unused dependency: discover https://review.openstack.org/218429 | 19:23 |
elmiko | oh, note sure on that one | 19:24 |
crobertsrh | Not sure I know of any such place, vgridnev. | 19:25 |
tmckay | egafford, status is it is fixed for spark standalone, cdh 54 is still messed up but not a regression | 19:25 |
tmckay | it will work on cdh 53 (older version of spark) | 19:26 |
tmckay | egafford, so I would call it "closed" | 19:26 |
egafford | Yup; that was my impression. You feeling medium or high for the remaining bug? | 19:26 |
egafford | Well, 5.4 is still messed up. | 19:26 |
tmckay | medium | 19:26 |
tmckay | I think I would make it a separate bug | 19:27 |
egafford | So we can spin a new bug, if you like, or limit the scope of the existing one. | 19:27 |
egafford | Sensible. | 19:27 |
tmckay | yeah | 19:27 |
tmckay | they really function in different ways | 19:27 |
*** hdd has joined #openstack-sahara | 19:28 | |
egafford | vgridnev, tmckay: Huh; did you look at this? https://bugs.launchpad.net/sahara/+bug/1474128 / https://review.openstack.org/206498 | 19:29 |
openstack | Launchpad bug 1474128 in Sahara "[CDH] Unable to launch EDP Spark jobs with Swift" [High,Fix committed] - Assigned to Oleg Borisenko (al-foo) | 19:29 |
vgridnev | egafford, yes | 19:29 |
egafford | vgridnev: I take it that fix was not wholly successful for 5.4. | 19:30 |
elmiko | egafford: you wanna do the +A honors on https://review.openstack.org/#/c/218182 ? | 19:30 |
tmckay | egafford, I think it wasn't | 19:30 |
egafford | elmiko: I think we still need to wait for the fake CI. | 19:30 |
tmckay | it works fine for 5.3 | 19:30 |
egafford | tmckay: Yup. | 19:30 |
elmiko | ack | 19:31 |
egafford | elmiko: Also, I super don't care who actually does +A; I just want it +Aed, as it represents a lot of functionality client-side. | 19:31 |
elmiko | egafford: ok, i think it's good to go | 19:31 |
egafford | elmiko: Eh, I am a slave to CI, and I don't think we're actually under that much time pressure. | 19:33 |
egafford | I just wanted to make sure we were ready when CI finishes. We are; all's well. | 19:34 |
egafford | Thanks! | 19:34 |
elmiko | cool, i mean, even after +A it will still go through ci again | 19:34 |
egafford | elmiko: That's true; that's true. | 19:35 |
elmiko | this one https://review.openstack.org/#/c/208001 still seems to have issues | 19:35 |
egafford | Dunno. I've said it before, I'll say it again. QA background: it did things to me, man. | 19:35 |
elmiko | haha, totally fair | 19:36 |
egafford | Yeah, that one isn't in the server yet. | 19:36 |
egafford | Which is why https://review.openstack.org/#/c/218182 exists. | 19:36 |
egafford | https://review.openstack.org/214098 and https://review.openstack.org/218318 depend on 208001, but it can't pass the gate because https://review.openstack.org/201448 still has some problems server-side. | 19:37 |
*** devlaps has joined #openstack-sahara | 19:37 | |
elmiko | ooph | 19:38 |
egafford | 218182 is the two dependent changes without the dependency. | 19:39 |
elmiko | that makes sense, i was like "this looks familiar" | 19:39 |
egafford | Yup. | 19:40 |
egafford | (Shout out to vgridnev for giving me the history on all that.) | 19:40 |
vgridnev | Actually there are lot of problems with huichun patches. | 19:42 |
vgridnev | and it's seems that the last beg for review for today: https://review.openstack.org/#/c/197965/ | 19:52 |
tmckay | egafford, new bug, https://bugs.launchpad.net/sahara/+bug/1490012 | 19:58 |
openstack | Launchpad bug 1490012 in Sahara "[EDP] Swift access from Spark does not work with CDH 5.4" [Undecided,New] | 19:58 |
egafford | tmckay: Yay! | 19:59 |
egafford | I mean, yay new bug, granted, which is kind of a lousy flavor of yay. But, yay! | 19:59 |
elmiko | lol | 19:59 |
*** tmckay has quit IRC | 20:26 | |
*** tmckay has joined #openstack-sahara | 20:26 | |
*** Nikolay_St has quit IRC | 20:29 | |
*** esikachev has quit IRC | 20:45 | |
*** raildo is now known as raildo-afk | 21:02 | |
*** crobertsrh is now known as _crobertsrh | 21:19 | |
*** hdd has quit IRC | 21:25 | |
*** hdd has joined #openstack-sahara | 21:25 | |
*** hdd has quit IRC | 21:41 | |
*** hdd has joined #openstack-sahara | 21:49 | |
*** hdd has quit IRC | 21:49 | |
*** egafford has quit IRC | 21:52 | |
*** esikachev has joined #openstack-sahara | 22:01 | |
*** esikachev has quit IRC | 22:08 | |
*** vgridnev has quit IRC | 22:19 | |
*** saneax has joined #openstack-sahara | 22:45 | |
*** jamielennox is now known as jamielennox|away | 23:00 | |
openstackgerrit | Merged openstack/sahara: Add sample spark wordcount job https://review.openstack.org/207039 | 23:12 |
openstackgerrit | Merged openstack/sahara: Fix problem with using auto security groups in Heat https://review.openstack.org/217791 | 23:13 |
openstackgerrit | Merged openstack/sahara: doc, sahara-templates: fix typo https://review.openstack.org/213653 | 23:13 |
openstackgerrit | Merged openstack/sahara: Deprecate Vanilla 2.6.0 https://review.openstack.org/213201 | 23:13 |
openstackgerrit | Merged openstack/sahara: Remove never executable code from devstack plugin https://review.openstack.org/213895 | 23:13 |
openstackgerrit | Merged openstack/sahara: Fix wrong compute nodes name in doc https://review.openstack.org/211806 | 23:13 |
*** david-lyle has quit IRC | 23:24 | |
*** tosky has quit IRC | 23:26 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/216971 | 23:48 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!