Thursday, 2017-04-20

kota_eranrom: hi06:50
eranromHi06:50
kota_eranrom: I'm now trying to play with your demo06:50
kota_https://github.com/eranr/e2emlstorlets06:50
eranromyep06:50
eranromproblems?06:51
kota_and question i have, the `tox -e functional` <- what is that06:51
kota_at Installation block06:51
kota_the tox in 2emlstorlets doesn't have the section for functional06:52
kota_but "func" exists?06:52
eranromoops! sec.06:52
kota_i did `tox -e func` but almosts fails06:52
kota_so it looks like no swift and storlets running with the instllation06:53
eranromso after running install.sh swift isn't running?06:54
kota_wait a bit, try to check06:54
kota_not running06:54
eranromone sec.06:55
kota_looking the install.sh06:55
kota_er - that calls s2aio.sh06:56
kota_so it should work06:56
eranromright06:56
eranromwhat does 'sudo docker images'show?06:56
kota_no docker command found06:57
kota_it looks like I was missing to install dependencies yet06:57
kota_so s2aio.sh seemed to fail for the reason06:58
kota_try to install the dependencies (e.g. build-essentials06:58
eranroma-ha!06:58
eranromwait!06:58
eranromthere is a problem in the committed script!06:58
eranromthere is an exit command right before the call to s2aio06:58
eranromsee line 506:59
eranromLet me fix that...06:59
eranromthis was not supposed to get committed...06:59
kota_oic06:59
kota_I'm now trying to run the install.sh removing the line 5 exit07:00
kota_it looks to run installation07:00
eranromI have just pushed the changes to install.sh and README.md07:02
eranromapologies for that!07:02
kota_np, I'd like to use the notebook for an introduction for my customer ;-)07:03
kota_eranrom: hmm... still failed at "Cannot determine the project id. Please execute install.sh [project id]"07:18
kota_it looks like docker command not installed07:18
kota_`sudo docker images` -> command not found07:19
eranromkota_: sec.07:19
eranromhas swift been installed?07:20
kota_yes07:20
kota_but it looks not runniing07:21
kota_running07:21
eranromso the storlets installation failed along the way. Do you have a file ~/storlets/install/storlets/deploy/cluster_config.json?07:23
kota_let me check07:25
kota_it looks no such a file exists07:27
eranromwhat happens if you manually go to ~/storlets and execute ./s2aio.sh dev host07:28
eranromwait07:28
eranromperhaps this is not a good idea.07:28
eranromthinking...07:28
eranromDo you have /etc/swift/ with all config files in place?07:29
kota_sec07:29
kota_the swift was set up.07:30
eranromok.07:30
kota_but it looks like keystone authentication failed07:31
eranromand this is what broke the storlets installation.07:31
eranromLet me try the whole process locally, and see what fails. few mins07:31
kota_hmm...07:32
kota_while doing try/fail, the env seems moving weird07:33
kota_so let me start with brand-new env07:33
eranromkota_: ok, will keep ypou updated on my findings07:46
eranromkota_: there seem to be a change in the Keystone default url. I am checking this07:52
eranromthis should break our functional at the gate...07:53
kota_hmm... still fail with the same point07:59
kota_that said "sudo: docker: command not found"07:59
kota_seems we need to run s2aio.sh dev docker?07:59
eranromkota_: I think that there has been a change in keystone defaults, which requires a change in s2aio.sh08:19
*** openstackgerrit has joined #openstack-storlets08:20
openstackgerritKota Tsuyuzaki proposed openstack/storlets master: Fix s2aio.sh to address trusty -> xenial  https://review.openstack.org/45838508:20
eranromkota_: I guess we have not seen it yet, as we did not run any gate job in the last several days08:20
kota_ok, eranrom and I found an issue which uses still trusty repo08:20
eranromkota_: good point. Lets see if my theory on gate being broken is true...08:21
eranromI think that Jenkins will fail on the patch, due to Keystone changes. Lets see...08:22
eranromkota_: As I thought, we run into the same issue on the gate.08:29
eranromkota_: hopefully will have a patch soon08:29
kota_eranrom: much appreciated08:31
kota_eranrom: ok, after installing docker successfully, I probably hit the issue you described08:35
eranromkota_: makes sense.08:35
eranromI hate those Keystone changes...08:35
kota_yeah08:36
kota_so you hit auth failure, right?08:36
eranromright.08:37
openstackgerritKota Tsuyuzaki proposed openstack/storlets master: Ristrict ipython upper version  https://review.openstack.org/45840108:46
openstackgerritKota Tsuyuzaki proposed openstack/storlets master: Restrict ipython upper version  https://review.openstack.org/45840108:46
kota_it seems one more patch we need08:46
openstackgerritKota Tsuyuzaki proposed openstack/storlets master: Fix s2aio.sh to address trusty -> xenial  https://review.openstack.org/45838508:48
openstackgerritEran Rom proposed openstack/storlets master: Fixing func test gate job  https://review.openstack.org/45840208:52
eranromkota_: here is a quick fix to your env:08:53
eranromedit ~/devstack/localrc08:53
eranromchange export OS_AUTH_URL="http://$KEYSTONE_IP:5000/v3" to export OS_AUTH_URL="http://$KEYSTONE_IP/identity_admin"08:54
eranromedit ~/storlets/install/storlets/deploy/cluster_config (do this with sudo)08:54
eranromyou still do not have the last file, so do this instead:08:55
kota_looking08:55
eranromexecute lines 57-72 of ~/storlets/install/swift/install_swift.sh08:57
eranromgo to ~/storlets08:57
kota_eranrom: quick qusetion, does it run with... port 80?08:57
eranromrun: install/storlets/prepare_storlets_install.sh dev host08:58
kota_it looks we needn't the port 5000 anymore but I'm not sure on that08:58
eranromkota_: right08:58
eranromthis is one of the changes08:58
eranromsee the patch I have sent08:58
eranromthen go to ~/storlets/install/storlets08:58
eranromedit (with sudo) the file deploy/cluster_config08:59
eranromchange "keystone_public_url": "http://127.0.0.1:5000/v3", to "keystone_public_url": "http://127.0.0.1/identity/v3",09:00
eranromand then run ./install_storlets.sh09:00
eranromkota_: The above steps are a quick hack to get your e2emlstorlets env up and running09:00
kota_let me step09:01
eranromkota_: it starts with the changes to ~/devstack/localrc09:02
eranromkota_: see above...09:02
kota_ok, re-run the scripts09:07
kota_eranrom: sorry, i have to leave for a while here, will be back in 2 hours or... will look at tommorow morning09:07
eranromsure09:08
eranromtalk to you later09:08
openstackgerritEran Rom proposed openstack/storlets master: Fixing func test gate job  https://review.openstack.org/45840209:09
openstackgerritEran Rom proposed openstack/storlets master: Fixing func test gate job  https://review.openstack.org/45840209:34
openstackgerritEran Rom proposed openstack/storlets master: Fixing func test gate job  https://review.openstack.org/45840210:10
kota_eranrom: quick report, the installation seems to succeed11:08
kota_eranrom: swift stat returns correct answer11:08
kota_I'll try to step the remaining steps to run the notebook11:09
openstackgerritMerged openstack/storlets master: Fixing func test gate job  https://review.openstack.org/45840211:12
kota_it looks we need to fix the keystone path in access.cfg for the demo though11:13
kota_hmm... test_recognize_face run as successful11:16
kota_others failed11:16
kota_need to go deep dive more. Will do tommorow11:16
openstackgerritEran Rom proposed openstack/storlets master: Fix s2aio.sh to address trusty -> xenial  https://review.openstack.org/45838511:27
eranromkota_: right. I will check in the meantime what breaks there11:28
*** openstackgerrit has quit IRC11:32
*** openstackgerrit has joined #openstack-storlets12:54
openstackgerritMerged openstack/storlets master: Fix s2aio.sh to address trusty -> xenial  https://review.openstack.org/45838512:54
openstackgerritEran Rom proposed openstack/storlets master: Adding invocation magics to the IPython extension  https://review.openstack.org/45264912:56
openstackgerritEran Rom proposed openstack/storlets master: Adding invocation magics to the IPython extension  https://review.openstack.org/45264913:28
openstackgerritEran Rom proposed openstack/storlets master: Adding invocation magics to the IPython extension  https://review.openstack.org/45264913:58
eranromkota_: I have made several adjustments to the e2emlstorlets repo to 'revive' the func tests. They should work now.14:11
eranromplease note, however, that passing the tests is not mandatory for the notebook to work.14:12
eranromalso, note that the neural network training has a random element, so expect different results in different executions.14:12
eranromHaving said that, in all of the execution I have done, I always got 75-100 precent success for 3 out of the 4 faces being recognized, and one with ~50% success14:13
openstackgerritEran Rom proposed openstack/storlets master: Add start / stop to s2aio  https://review.openstack.org/39515214:27
openstackgerritEran Rom proposed openstack/storlets master: Adding invocation magics to the IPython extension  https://review.openstack.org/45264914:37

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!