Thursday, 2015-07-30

kfox1111nice.... looking...00:18
kfox1111I'm guessing we don't want an upstream: ? Not entirely sure how that works.00:18
kfox1111not sure how the tests work either. since we don't have any yet.00:20
kzaitsev_mbbtw, looks like zuul is still recovering =/ I'm still waiting on some of the rechecks00:20
kfox1111yeah... its backed up pretty good. :/00:21
kfox1111kzaitsev_mb: One thing I'd really like to see, is a heat template for deploying murano.00:21
kfox1111Would make it a lot easier to deploy on non Fuel based clouds.00:21
kzaitsev_mbyep, I've seen that one from the bot =)00:22
kfox1111k. wasn't sure you saw it since you timed out.00:22
kzaitsev_mbwell, that's an interesting thought indeed =)00:22
kfox1111would make it a lot easier to deploy on our rdo clouds. :)00:22
kfox1111the amusing thing then would be you could use the app catalog to deploy murano, which would then extend the app catalog to support murano. :)00:23
kzaitsev_mbmuranception00:23
kfox1111hehe00:23
kzaitsev_mbthat would actually be a nice use case for the catalog. Like download heat murano-template, then download murano-apps.00:27
kfox1111yup. because heat templates don't actually get stored anywhere, you can just hit launch right from the catalog without doing anything else. very easy. :)00:27
docaedokfox1111: regarding upstream, that will fetch what's in your repo for the initial sync (AFAIK it won't do anything after that). We could drop that safely too.00:35
docaedoRegarding tests, I think those are the base ones that are safe, and we can add more later.00:36
kfox1111ah. ok. thats great then. :)00:36
docaedoFollowed http://docs.openstack.org/infra/manual/creators.html00:36
kfox1111is check: - gate-apps-catalog-python34 the right thing?00:38
kzaitsev_mbI guess, that the 1st commit to -ui would have to add a tox.ini that would have tests (that can like, do nothing)00:38
kfox1111or should it be gate-apps-catalog-ui-python34 or something?00:38
kfox1111yeah. thats probably fine.00:38
kzaitsev_mbOtherwise the tests would fail =)00:38
kfox1111yeah.00:40
docaedogood to add comments to that CR so infra folk can respond when things get un-broke00:41
kfox1111k.00:42
kfox1111yay. after developing it for icehouse, the posix cinder backup driver lives in liberty! :)00:45
kfox1111wow... that was an insanely long time to get such a simple driver in. :_(00:45
kfox1111gtg. l8r.00:47
docaedoah I see what you meant about the gate check, my brain was taking a little break00:54
docaedoupdated, should have had noop-jobs there00:57
docaedo(though now  can't find an example project in jenkings/jobs/projects.yaml that does not have at least the python jobs...00:59
*** kzaitsev_mb has quit IRC01:03
*** kzaitsev_mb has joined #openstack-app-catalog01:15
*** kzaitsev_mb has quit IRC01:42
*** kebray has joined #openstack-app-catalog03:21
*** kebray has quit IRC06:20
*** ig0r_ has joined #openstack-app-catalog09:32
*** kzaitsev_mb has joined #openstack-app-catalog10:40
*** ig0r_ has quit IRC13:10
*** ig0r_ has joined #openstack-app-catalog13:16
*** ig0r_ has quit IRC13:31
*** ig0r_ has joined #openstack-app-catalog14:32
*** ig0r_ has quit IRC15:03
*** ig0r__ has joined #openstack-app-catalog15:04
*** ig0r__ has quit IRC15:09
*** ig0r_ has joined #openstack-app-catalog15:09
*** ig0r__ has joined #openstack-app-catalog15:13
*** ig0r__ has quit IRC15:15
*** ig0r_ has quit IRC15:15
*** kebray has joined #openstack-app-catalog15:21
kfox1111morning15:27
kzaitsev_mbwhat I like with OS — is how we all live in different parts of the world15:27
kzaitsev_mbsry, I haven't yet looked into murano part of catalog-ui, but have that planned for todays evening15:28
*** j^2 has quit IRC15:29
kfox1111yeah. :)15:36
kfox1111no worries. no rush.15:36
kfox1111wow... zuul's still backlogged.15:49
*** ig0r_ has joined #openstack-app-catalog15:53
kzaitsev_mb675 tasks on check and seems growing =(16:02
kfox1111there's a broadcast I saw on openstack-horizon saying they fixed the issue, but now they're chewing through the backlog.16:02
kzaitsev_mbwell, yep I have some patches that are hangin for 7 hours in the queue and still have some jobs queued16:03
kfox1111Yeah. the app catalog ui horizon patch has been waiting 7 hours 39 minutes. :/16:05
kfox1111the good news is its within two page down's of the top. :)16:05
kfox1111docaedo: Have you looked at the lint stuff?16:06
docaedokfox1111: thanks for the reminder, yes :) just +2'd them16:09
docaedogotta run but will be back in time for the meeting, coming up in 50 minutes16:09
kfox1111k.16:10
kfox1111thx.16:10
kzaitsev_mbI'll add a lint job to infra as soon as 1st commit lands =)16:11
kfox1111cool. thanks. :)16:13
openstackgerritMerged stackforge/apps-catalog: Added eslint tox env  https://review.openstack.org/20673416:13
openstackgerritMerged stackforge/apps-catalog: Lint js and css files  https://review.openstack.org/20673716:13
*** j^2 has joined #openstack-app-catalog16:15
kfox1111have we decided wthat to call the common top level yaml entry?16:20
kfox1111entry? catalog? artifact?16:21
*** kzaitsev_mb has quit IRC16:22
kfox1111component maybe?16:30
docaedoI was thinking just "assets.yaml"16:41
kfox1111assets? that works.16:52
kfox1111I was thinking of whiping up a very quick patch that just changes all the root entries to the same thing so they can be easily loaded from the seperate files into one in the web app for testing pre-acutally merging the files.16:53
docaedoI like that idea, only issue for me (and I haven't even looked at this yet) is adjusting the javascript on the site so it will look for "asset_type=glance" when displaying glance, etc16:57
kfox1111yeah. wouldn't be that part yet. just the root 'applications' object gets renamed 'assets', and tweakign the js to match.16:58
kfox1111next patch set could be adding an asset type to each entry in all the files.16:59
kfox1111a third patch set would be to take the glance image schema and split it into a generic part, and a specific to glance part based on asset_type.16:59
kfox1111a 4th could try and apply the glance schema to the other asset types one at a time until they are all supported.17:00
docaedosure, for the root one you'd have to change the schema files to match (because applications is the murano one, templates is heat, and can't remember what glance is?)17:00
docaedomeeting time though ;)17:00
kfox1111at that point then the last bit would be to actually merge them all together.17:00
kfox1111right. 'images'17:00
*** kzaitsev1mb has joined #openstack-app-catalog17:22
kfox1111arg... has the glance schema check actually been happining in the jenkins reviews?18:06
docaedokfox1111: I'm honestly not sure, have been entirely out of the loop w/r/t jobs running for app-catalog sadly18:08
docaedorunning out for a while but will be back later on18:08
kfox1111I'm tweaking the root objects, and a lot of glance stuff's squawking in tox.18:09
kfox1111oh... I think I know why... it was the "applications" property thing in the schema...18:11
kfox1111that whole branch might not have been validating...18:11
kfox1111bleh.18:11
kfox1111same probably for heat templates. :(18:11
kzaitsev1mbso only murano stuff was checked O_o18:12
kfox1111seems like it maybe...18:13
kfox1111all the sahara images don't have a provided_by href....18:14
kfox1111neither does coreos...18:15
kzaitsev1mbcare to file a bug maybe?18:15
kfox1111I'm fixing it now as part of the root element switch.18:15
kfox1111since I'm already there in the code.18:15
kfox1111there we go... not too bad to fix up the glance images. just a bunch of missing provided_by hrefs and a lincense issue.18:18
kzaitsev1mbbtw. I've been thinking about that murano-heattemplate idea and I've been liking it more and more. =)18:18
kfox1111let me look at the heat one too...18:18
kfox1111cool. :)18:18
rhagarty_kfox1111: sorry for confusion, but just want to be clear on relationship between what your youtube vid shows and what Murano has now. Murano has a panel and an "Applications Catalog" submenu that shows just Murano Apps. Your new UI will have a "Catalog" panel that will contain Applications (that are directly launched) and Components (that have to be installed). And currently, these apps and components are restricted18:18
rhagarty_to Murano apps, Heat templates, and Glance images?18:18
kfox1111correct.18:19
kfox1111though we're working on making the yaml more generic, so that we can include stuff like solum Language packs.18:19
kfox1111which would be another component type.18:19
rhagarty_ok, thanks18:20
kfox1111the idea being, folks contribute to the global app catalog.18:20
kfox1111users search for an app and launch it in their tenant,18:21
kfox1111or enhance their tenant by installing components from the catalog.18:21
kzaitsev1mbI definitelly have to look into how to better launch murano apps. Since murano has a quick-launch button, that allows more-or-less ad-hoc launching of a single app, in case you do not need any dependencies.18:21
kfox1111apps could be glance images, murano apps, heat apps, etc. doesn't really matter.18:21
kfox1111the global app catalog just hands off the requtest to install/launch to the appropriate openstack component, and it deals with it.18:22
rhagarty_yes, seems like a very useful feature18:22
rhagarty_following that model, it would be cool to have Horizon know how to consume and install Horizon plug-ins18:23
kzaitsev1mboh I hope zuul would clean up at least by monday...18:23
kfox1111rhagarty_: Agreed.18:24
kfox1111but I'm afraid that may require a lot of plumbing horizon doesn't have. :/18:24
rhagarty_yup18:24
kfox1111We're not in the buisness of adding the plumbing. Just passing off the entry to the plumbing. :/18:24
rhagarty_understood18:24
*** ig0r__ has joined #openstack-app-catalog18:25
kfox1111ok. the heat templates seem to validate ok too. I think glance's schema is more restrictive (which is a good thing)18:27
kfox1111is there a way to run the website local for testing?18:28
kfox1111something like horizon's ./run_tests.sh --runserver 127.0.0.1:18000 ?18:29
*** kzaitsev2mb has joined #openstack-app-catalog18:30
*** kzaitsev2mb has quit IRC18:31
*** kzaitsev_mb has joined #openstack-app-catalog18:32
openstackgerritKevin Fox proposed stackforge/apps-catalog: Switch all the yaml files to share the same root object type  https://review.openstack.org/20757118:33
openstackgerritKevin Fox proposed stackforge/apps-catalog: Switch all the yaml files to share the same root object type  https://review.openstack.org/20757118:34
kfox1111k. I think that's ready for revew.18:34
kzaitsev1mbkfox1111: sure18:34
kzaitsev1mbhttps://wiki.openstack.org/wiki/App-Catalog#Adding_content18:34
kzaitsev1mbMake sure your edit looks good - change directory to openstack_catalog/web and run "python -m SimpleHTTPServer", then visit http://localhost:800018:34
*** kzaitsev1mb has quit IRC18:34
kfox1111ah. cool.18:34
kfox1111thx.18:34
kzaitsev_mbsorry, I guess smthng's wrong with my client18:35
kzaitsev_mbnot sure18:35
kfox1111perfect. thanks. the change seems to work that way.18:36
kfox1111wow. the queue's really backed up....18:41
kzaitsev_mbI was hoping it would clean up today, but now I fear we would not see it in good shape until Monday18:42
kfox1111yeah.18:43
*** ig0r_ has quit IRC18:50
kzaitsev_mbyou have some rogue trailing whitespaces in yamls ;)18:53
kfox1111we need a yaml linter... ;)18:54
kzaitsev_mbyep =) I now have a js, css, python and shell linter installed. but yaml.. )18:55
openstackgerritKevin Fox proposed stackforge/apps-catalog: Switch all the yaml files to share the same root object type  https://review.openstack.org/20757118:57
kfox1111:)18:57
kzaitsev_mband now I have js-yaml.19:04
*** ig0r_ has joined #openstack-app-catalog19:04
kzaitsev_mbalthough seems, that it does not complain about trailing whitespaces. guess it's just gerrit, that does not like it.19:05
kfox1111bummer.19:06
kzaitsev_mbguess I'll just configure my vim to remove them fro every file type19:08
*** kebray has quit IRC19:08
kfox1111docaedo: hows the review look to you?19:09
kzaitsev_mbkfox1111: heat and glance tabs do not work for me19:14
kfox1111let me douoble check.19:14
kfox1111odd. they seem to work for me. what part isnt? Just getting the list?19:15
kzaitsev_mbhm. Seems, that the request is not fired for the respective yamls19:16
kzaitsev_mbhm I also get `TypeError: undefined is not an object (evaluating 'tableData.length')`19:16
kfox1111which browser?19:17
kzaitsev_mbsafari19:17
kfox1111havent tried chrome. let me double check there...19:17
kfox1111chrome's workign for me too... and apps.openstack.org works?19:17
kfox1111safari's kind of becoming the new ie. :/19:18
kzaitsev_mbhmm. seems like it started to work for me too. smells like a race condition to me19:18
kzaitsev_mbyeah, I heard that joke =)19:18
kfox1111k. to the website probably has a different bug in it, unrelated to this review. :/19:19
kfox1111it might get better quickly when we don't try and load 3 files at once. :/19:19
kfox1111could you please file a bug?19:24
kzaitsev_mbsure, I'm digging through the code, to understand how it can be possibly reproduced19:24
kfox1111k.19:25
docaedo207571 LGTM, works fine locally with firefox and chrome19:29
kzaitsev_mbI'm not really sure how I got the bug. looks like it could only have happened if the yaml didn't load correctly for some reason19:30
kfox1111and you loaded it throug hthe embeded webserver?19:31
kfox1111it doesn't load off of the local file system.19:31
kzaitsev_mbLet's put it that way — when (or rather if) I encounter it again — I'll file a bug. Until then I'm thinking it was some wild glitch )19:31
kzaitsev_mbpython http server, yep19:31
kzaitsev_mbhmmm. I think I might know the reason..19:32
kzaitsev_mbdoes anyone know if `python -m SimpleHTTPServer` uses so_reuseaddr/so_reuseport? =)19:32
kfox1111no idea.19:33
kzaitsev_mbno doesn't seem like it does19:33
kzaitsev_mboh. it binds to 0.0.0.019:34
kzaitsev_mbI think I had another process bind to 127.0.0.1, that got the requests19:35
kfox1111ah. thats why I did python -m SimpleHTTPServer 18001 :)19:35
kzaitsev_mbthat's actually pretty wild. djano binds to 127.0.0.1 8000 and SimpleHTTPServer to 0.0.0.0 8000 so technically OS allows that, but I guess it randomly determines which socket would get the request. Just a wild guess though19:37
kfox1111oh, thats strange. yeah.19:37
kfox1111k. I'm going to pull the trigger then.19:39
*** openstackgerrit has quit IRC19:46
*** openstackgerrit has joined #openstack-app-catalog19:47
openstackgerritMerged stackforge/apps-catalog: Switch all the yaml files to share the same root object type  https://review.openstack.org/20757119:47
*** ig0r_ has quit IRC19:56
*** kzaitsev_mb has quit IRC19:57
kfox1111now, we wait...19:57
kfox1111there we go.... :)20:04
kfox1111k. updating the webui....20:07
kfox1111ok. fixed. :)20:09
kfox1111next up is a schema file merge.20:11
docaedo+2 from AJeager :) https://review.openstack.org/#/c/207253/20:12
kfox1111cool. :)20:13
kfox1111docaedo: what should we use to seperate the entries? type? service? engine?20:13
kfox1111engine = heat? engine = murano, etc?20:13
*** openstackgerrit has quit IRC20:16
*** openstackgerrit has joined #openstack-app-catalog20:17
*** openstackgerrit has quit IRC20:46
*** openstackgerrit has joined #openstack-app-catalog20:47
*** kzaitsev_mb has joined #openstack-app-catalog20:53
*** kebray has joined #openstack-app-catalog20:58
*** openstack has joined #openstack-app-catalog21:11
-cameron.freenode.net- [freenode-info] if you're at a conference and other people are having trouble connecting, please mention it to staff: http://freenode.net/faq.shtml#gettinghelp21:11
openstackgerritKevin Fox proposed stackforge/apps-catalog: Split glance schema to generic and specific.  https://review.openstack.org/20762621:11
kfox1111kzaitsev_ws: and docaedo: please review. :)21:11
*** kzaitsev_mb has joined #openstack-app-catalog21:13
kzaitsev_wsyou definitelly need a linter =H21:15
kzaitsev_ws21:15
kfox1111really? arg...21:15
kfox1111I thing vim may be "helping"...21:16
kfox1111think21:16
kzaitsev_wsI can share a couple of snippets, that remove trailing whitespaces in vim automatically, if you like21:16
kfox1111Or those were already there when I copied them...21:17
kfox1111since we never linted them before....21:17
openstackgerritKevin Fox proposed stackforge/apps-catalog: Split glance schema to generic and specific.  https://review.openstack.org/20762621:18
kzaitsev_mbwhy is it engine?21:18
kfox1111Take 2. :)21:18
kfox1111cause no one proposed anything better? :)21:18
kfox1111its what thing the asset belongs to.21:18
kfox1111glance, heat, murano, etc.21:18
kfox1111solum...21:18
kfox1111and stuff thats specific to it.21:18
kzaitsev_mbso, anything specific goes to engine, anything generic goes to ..21:19
kzaitsev_mbwell generic properties, right?21:19
kfox1111so like, we'll share the schema for license, provider, etc.21:19
kfox1111since those will be common for all asset types.21:20
kfox1111that way, we can put them all in one big list, and the ui can provide specific details for the specific types, or just show the generic info.21:20
kzaitsev_mbbtw, will that yaml file become an api request some day? or will it always be a giant file?21:21
kfox1111Adding a new asset type then is also just adding a new definition at the bottom for the specific type details.21:21
kfox1111thats my hope. we feed in the yaml file into elasticsearch into documents, one per entry,21:22
kfox1111and elasticsearch then gives us faceting, easy queries, etc.21:22
kzaitsev_mbI've only used solr, but grew to really like it. Hope elasticsearch is also that good.21:23
kfox1111very similar. but easier to deploy/scale. :)21:23
kzaitsev_mboh it's also based of lucene. then yep, they should be similar21:23
kfox1111both use lucene.21:23
kfox1111yeah. :)21:23
kfox1111either one would make the ui awesome. :)21:24
kzaitsev_mbat some point when I was reading about solr/lucene I stumbled upon an article, that explained, that it's not a search engine, but a token-matching engine, and that like. Opened up a whole new world of possibilities =)21:25
kfox1111yeah. :)21:25
kzaitsev_mbI even made a very simple and primitive recommendation scheme based on it at some point 021:26
kzaitsev_mb)21:26
kfox1111nice. :)21:26
kzaitsev_mbdon't know if app-catalog would ever need it, but it would be... fun21:26
kfox1111hehe. yeah. :)21:27
kfox1111at least facets for recommendations.21:27
kfox1111bbiab. meeting.21:27
kzaitsev_mblike. You've downloaded kubernetes-heat template. Users, that liked it also liked docker-debian image. =))) ot something21:27
kzaitsev_mbmaybe it should be like. 'definition' instead of 'engine'? since it's part of 'definitions' ?21:36
kzaitsev_mbI'm a bit opposed to 'engine', you know. the word seems od where it is. Not really sure why specific properties go to engine )21:40
kzaitsev_mb..as always naming the variable is the hardest part..21:41
*** ig0r__ has quit IRC21:51
*** kzaitsev_mb has quit IRC22:14
kfox1111kzaitsev_ws: its a little strange related to glance. both heat and murano are orchistration engines.22:20
kfox1111yeah, thinking service may be the closest thing to it. ie, check in the keystone service catalog if service: type: x is there. if so, show that entry.22:22
*** kebray has quit IRC22:29
*** kzaitsev_mb has joined #openstack-app-catalog22:47
openstackgerritKevin Fox proposed stackforge/apps-catalog: Make glance and heat share a common schema.  https://review.openstack.org/20762623:38
kfox1111ok. now I know for sure. I never touched a lot of those schema entries. vim 's got to be adding spaces, or they were there origonally and the diff tool wasn't showing them since they didn't change. :/23:41
openstackgerritKevin Fox proposed stackforge/apps-catalog: Make glance and heat share a common schema.  https://review.openstack.org/20762623:44
docaedoregarding elasticsearch/solr, wouldn't moving assets into glance v3 make those unnecessary? I thought you'd be able to search/query glance directly in that case (and the yaml file would go away)23:44
kfox1111docaedo: maybe? I don't think glance v3 is going to allow non authenticated users to query?23:45
docaedo+1 for "service" rather than "engine", but that's a pretty minor one for me23:45
kfox1111ok. one quick sed. just a sec. :)23:45
docaedokfox1111: the site itself would proxy the search, so the site would be authenticating against glance (at least that's the approach I would take with it - otherwise I think we're opening a huge can of worms...)23:46
docaedothat approach would also let us automate the import of new assets via review (so new things can go in or be updated/removed through CR)23:47
kfox1111it may be too much of a performance overhead to run that way. not sure.23:47
kfox1111opening it up to the wide world's going to be interesting. :)23:48
docaedoah that's true, glance is not necessarily optimized for that kind of workload23:48
kfox1111yeah. though Just having a hook like what we have for yaml -> json would be easy enough to yaml -> elasticsearch.23:48
kfox1111I'm not sure what the right solution is really. really was hoping to see that POC. :/23:49
kfox1111uh... {{if supported_by && supported_by.name}}23:54
kfox1111ReferenceError: supported_by is not defined23:54
kfox1111hmm...23:54
kfox1111well, I guess name is requred, so just checking for supported_by seems fine.23:56
openstackgerritKevin Fox proposed stackforge/apps-catalog: Make glance and heat share a common schema.  https://review.openstack.org/20762623:57
kfox1111ok. there's s/engine/service/23:57
kfox1111hows that look?23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!