| *** chopmann has quit IRC | 00:03 | |
| *** ayoung has quit IRC | 00:06 | |
| *** diogogmt has quit IRC | 00:08 | |
| openstackgerrit | qinchunhua proposed openstack/kolla: Fix dict.values() PY3 compatible https://review.openstack.org/345706 | 00:13 |
|---|---|---|
| *** jascott1_tmp has quit IRC | 00:15 | |
| *** banix has quit IRC | 00:24 | |
| *** ravig has joined #openstack-kolla | 00:26 | |
| *** brad[] has quit IRC | 00:28 | |
| Mech422 | v1k0d3n: ubuntu source builds seem to be having issues today | 00:33 |
| Mech422 | v1k0d3n: but overall work pretty well for multi-node deployment - I rebuild multiple times a day... | 00:33 |
| *** banix has joined #openstack-kolla | 00:35 | |
| *** jascott1_tmp has joined #openstack-kolla | 00:38 | |
| *** ravig has quit IRC | 00:42 | |
| *** sdake has quit IRC | 00:47 | |
| *** aernhart_ has joined #openstack-kolla | 00:47 | |
| *** jascott1_tmp has quit IRC | 00:53 | |
| *** ravig has joined #openstack-kolla | 00:54 | |
| *** aernhart__ has joined #openstack-kolla | 00:58 | |
| *** aernhart_ has quit IRC | 01:01 | |
| *** zhurong has joined #openstack-kolla | 01:05 | |
| *** daneyon has joined #openstack-kolla | 01:07 | |
| *** banix has quit IRC | 01:08 | |
| *** daneyon has quit IRC | 01:11 | |
| *** dave-mccowan has joined #openstack-kolla | 01:16 | |
| *** neophy has joined #openstack-kolla | 01:18 | |
| *** Liuqing has joined #openstack-kolla | 01:21 | |
| *** derekjhyang has joined #openstack-kolla | 01:24 | |
| derekjhyang | https://www.irccloud.com/pastebin/zkXlW8ki/nova-libvirt%20setup%20cgmanager%20error | 01:26 |
| derekjhyang | good morning, guys | 01:27 |
| *** salv-orlando has joined #openstack-kolla | 01:29 | |
| *** jtriley has joined #openstack-kolla | 01:44 | |
| *** salv-orlando has quit IRC | 01:46 | |
| *** david-lyle has joined #openstack-kolla | 01:46 | |
| *** michauds has quit IRC | 01:48 | |
| *** jtriley_ has joined #openstack-kolla | 01:49 | |
| *** jtriley has quit IRC | 01:49 | |
| *** david-lyle has quit IRC | 01:56 | |
| *** Jeffrey4l_ has joined #openstack-kolla | 01:56 | |
| *** zhurong has quit IRC | 01:58 | |
| *** zhurong has joined #openstack-kolla | 01:59 | |
| *** ravig has quit IRC | 02:04 | |
| *** JianqingJiang has joined #openstack-kolla | 02:06 | |
| *** JianqingJiang has quit IRC | 02:11 | |
| *** daneyon has joined #openstack-kolla | 02:26 | |
| *** daneyon has quit IRC | 02:28 | |
| *** jascott1_tmp has joined #openstack-kolla | 02:30 | |
| *** daneyon_ has quit IRC | 02:30 | |
| *** jtriley_ has quit IRC | 02:35 | |
| *** ravig has joined #openstack-kolla | 02:37 | |
| *** ravig has quit IRC | 02:38 | |
| *** jascott1_tmp has quit IRC | 02:40 | |
| *** wmiller has quit IRC | 02:50 | |
| *** neophy has quit IRC | 02:51 | |
| *** wmiller has joined #openstack-kolla | 02:51 | |
| *** ravig has joined #openstack-kolla | 02:51 | |
| *** daneyon has joined #openstack-kolla | 02:55 | |
| *** unicell1 has joined #openstack-kolla | 02:56 | |
| *** Liuqing has quit IRC | 02:57 | |
| *** zhurong has quit IRC | 02:57 | |
| *** unicell has quit IRC | 02:57 | |
| *** Liuqing has joined #openstack-kolla | 02:57 | |
| *** zhurong has joined #openstack-kolla | 02:58 | |
| *** daneyon has quit IRC | 03:00 | |
| openstackgerrit | Merged openstack/kolla: Added ceilometer decision in neutron.conf for event notifications https://review.openstack.org/344782 | 03:00 |
| openstackgerrit | qinchunhua proposed openstack/kolla: Fix dict.values() PY3 compatible https://review.openstack.org/345706 | 03:01 |
| openstackgerrit | qinchunhua proposed openstack/kolla: Fix dict.values() PY3 compatible https://review.openstack.org/345706 | 03:02 |
| openstackgerrit | Merged openstack/kolla: Bind the ceilometer-api process to the api_interface only https://review.openstack.org/345451 | 03:02 |
| openstackgerrit | qinchunhua proposed openstack/kolla: Fix dict.values() PY3 compatible https://review.openstack.org/345706 | 03:06 |
| *** rhallisey has quit IRC | 03:08 | |
| *** JianqingJiang has joined #openstack-kolla | 03:08 | |
| *** JianqingJiang has quit IRC | 03:08 | |
| *** JianqingJiang has joined #openstack-kolla | 03:09 | |
| *** yuanying has quit IRC | 03:21 | |
| *** JianqingJiang has quit IRC | 03:21 | |
| *** salv-orlando has joined #openstack-kolla | 03:22 | |
| *** brad[] has joined #openstack-kolla | 03:30 | |
| *** salv-orlando has quit IRC | 03:40 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Implement mongodb replication set cluster https://review.openstack.org/345751 | 03:41 |
| *** mark-casey has left #openstack-kolla | 03:43 | |
| *** dave-mccowan has quit IRC | 03:48 | |
| *** yuanying has joined #openstack-kolla | 03:50 | |
| *** ljjjustin has quit IRC | 04:09 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Use lbaas alias instead of the class name https://review.openstack.org/345777 | 04:10 |
| *** ravig has quit IRC | 04:11 | |
| *** ravig has joined #openstack-kolla | 04:11 | |
| *** ljjjustin has joined #openstack-kolla | 04:11 | |
| *** ravig has quit IRC | 04:19 | |
| *** ravig has joined #openstack-kolla | 04:20 | |
| *** ravig has quit IRC | 04:23 | |
| *** ravig has joined #openstack-kolla | 04:24 | |
| *** bdaca has joined #openstack-kolla | 04:31 | |
| *** salv-orl_ has joined #openstack-kolla | 04:42 | |
| *** daneyon has joined #openstack-kolla | 04:43 | |
| *** daneyon has quit IRC | 04:48 | |
| *** harlowja has joined #openstack-kolla | 04:57 | |
| *** sdake has joined #openstack-kolla | 04:57 | |
| *** smemon has joined #openstack-kolla | 05:06 | |
| *** ravig has quit IRC | 05:09 | |
| *** ravig has joined #openstack-kolla | 05:10 | |
| *** ravig has quit IRC | 05:12 | |
| *** ravig_ has joined #openstack-kolla | 05:12 | |
| *** ravig_ has quit IRC | 05:13 | |
| smemon | Hi | 05:18 |
| smemon | I'm trying to deploy Kolla all-in-one in a VM | 05:20 |
| smemon | when I run kolla-ansible pull I get the following error | 05:20 |
| smemon | fatal: [localhost]: FAILED! => {"changed": false, "failed": true, "msg": "Unknown error message: Tag 3.0.0 not found in repository docker.io/kolla/centos-binary-kolla-toolbox"} | 05:20 |
| smemon | where should I look to resolve the error? | 05:21 |
| smemon | any suggestions? | 05:25 |
| openstackgerrit | Mathias proposed openstack/kolla: External Ceph - Implementation Nova https://review.openstack.org/344705 | 05:25 |
| *** mewald has joined #openstack-kolla | 05:26 | |
| mewald | good morning | 05:26 |
| bjolo | morning | 05:26 |
| *** gbraad has quit IRC | 05:26 | |
| mewald | anyone care to talk about monitoring stack? | 05:26 |
| *** jascott1_tmp has joined #openstack-kolla | 05:26 | |
| smemon | Morning! | 05:27 |
| bjolo | yes | 05:27 |
| bjolo | first one q for you mewald | 05:27 |
| bjolo | TLS... it is all terminated at haproxy right? | 05:27 |
| mewald | bjolo: that's the typical setup, yes, and I believe Kolla does it the same way (haven't tried) | 05:28 |
| bjolo | i deployed a small swift with kolla yesterday to get object store right, but normal users get access denied | 05:29 |
| bjolo | got to tired to dig down on it | 05:29 |
| bjolo | ok monitoring... whats your thinking? | 05:30 |
| smemon | Could someone please give me any hint about this error? | 05:31 |
| smemon | fatal: [localhost]: FAILED! => {"changed": false, "failed": true, "msg": "Unknown error message: Tag 3.0.0 not found in repository docker.io/kolla/centos-binary-kolla-toolbox"} | 05:31 |
| bjolo | smemon, you dont have any images with tag 3.0.0 | 05:31 |
| mewald | smemon: you are trying to pull a docker image from docker.io with a tag that doesnt exist | 05:31 |
| mewald | set up your own registry and build your images | 05:32 |
| mewald | Ok, so I started implementing collectd + influxdb this week and had a look at influxdb clustering with influxdb-relay. I also looked at telegraf which seems to have a couple of advantages: 1) It uses http rest to talk to influxdb which can be load balanced 2) It allows the configuration of multiple influxdb databases as output targets. Collectd on the other hand typically uses UDP to write to influxdb which has its advantages but lacks | 05:32 |
| smemon | I tried with Tag 2.0.0 but also got the same error | 05:32 |
| bjolo | private docker registry is kinda horrible though | 05:32 |
| smemon | for all-in-one deploye do we really need private registry? | 05:33 |
| bjolo | nope, the build artifacts ends up as local images | 05:33 |
| mewald | 2nd: I could set up an entire influxdb + influxdb-relay + haproxy stack but I feel the need to separate it out to a different set of hosts in order to keep that load away from controllers | 05:33 |
| mewald | smemon: in that case look at your global.yaml | 05:34 |
| bjolo | agree on that. controllers need to be clear from as much as possible | 05:34 |
| mewald | you might have set the tag wrong so docker will first try to find the image locally and fails, then goes to docker.io | 05:35 |
| bjolo | smemon, if you build locally for an all in one, openstack_version needs to match in kolla-build.conf and globals.conf | 05:35 |
| mewald | bjolo: yeah we already have ELK on the controllers which sucks imho | 05:35 |
| bjolo | yes, i made some comments about that as well for rados_gw and swift proxy. default placement is on the controller nodes. | 05:36 |
| bjolo | bad idea IMO | 05:36 |
| bjolo | but configurable :) | 05:36 |
| bjolo | when you run fuel, you dont have that option | 05:37 |
| bjolo | controller is controller + network node combined | 05:37 |
| *** harlowja has quit IRC | 05:38 | |
| mewald | generally, the placement of influxdb + relay is configurable too, but if we really need an haproxy Kolla has to deploy a second keepalived + haproxy cluster | 05:38 |
| mewald | and I don't know if that can be done easily | 05:38 |
| bjolo | mewald, so how critical is you time metrics? my influxdb is currently wiped, but i have that running as vm on vmware | 05:38 |
| bjolo | vmware cluster | 05:38 |
| bjolo | with seperate disks for data. so if the phys node goes down, restart on other node | 05:39 |
| *** ravig has joined #openstack-kolla | 05:39 | |
| bjolo | if influx node gets corrupted, i can deploy a new one and attach the data drive. | 05:39 |
| bjolo | the cool think about collectd is that it caches locally | 05:40 |
| bjolo | so if influx is down, it will backfill ones it gets up | 05:40 |
| *** sdake_ has joined #openstack-kolla | 05:41 | |
| mewald | hmm - difficult ... | 05:41 |
| bjolo | one way of doing it... | 05:41 |
| bjolo | in the target env, what options do you have available? | 05:41 |
| mewald | you know I am thinking of extending this one day to have trending and prediction that stuff available. But maybe I am thinking to far ahead | 05:42 |
| mewald | and a single instance influxdb would be sufficient | 05:42 |
| mewald | which invalidates my telegraf argument :D | 05:43 |
| smemon | bjolo, I think kolla-build.conf is not generated yet | 05:43 |
| *** sdake has quit IRC | 05:43 | |
| mewald | smemon: I dont have to build yourself. If you node has access to docker.io just put a tag that docker.io has into global.yml | 05:43 |
| bjolo | i dont think you have to worry about performance on one influxdb. when testing it out i had about 100 nodes runing collectd with quite a few plugins all forwarding to one quad core virtual influx on vmware | 05:44 |
| mewald | ok, so I will start with a patch that includes single instance influxdb | 05:46 |
| mewald | remains the question of collectd vs telegraf | 05:46 |
| mewald | I somehow like the idea to have a consistent stack (TICK stack) | 05:46 |
| derekjhyang | https://www.irccloud.com/pastebin/mrLcMlVE/ | 05:46 |
| mewald | and it might allow for better extensibility later on | 05:46 |
| smemon | mewald, thanks! will look into it | 05:47 |
| derekjhyang | https://www.irccloud.com/pastebin/zkXlW8ki/nova-libvirt%20setup%20cgmanager%20error | 05:47 |
| bjolo | mewald, have you looked at beats from elastic? | 05:47 |
| mewald | derekjhyang: seriously? I post your conversational text in a pastebin? :D | 05:47 |
| mewald | bjolo: not really no, I have read about it some time back. why? | 05:48 |
| bjolo | https://www.elastic.co/products/beats | 05:48 |
| bjolo | this is for kolla right? | 05:48 |
| bjolo | since we already runing elastic for logs | 05:49 |
| bjolo | with beats we can add timeseries also | 05:49 |
| bjolo | get everything in the same DB, using the same kibana frontend | 05:49 |
| derekjhyang | mewald: where? I've not found it @@ | 05:50 |
| mewald | oh boy, thats horrible. too many options :D | 05:50 |
| bjolo | i know!!! | 05:50 |
| mewald | derekjhyang: https://www.irccloud.com/pastebin/mrLcMlVE/ "Hey folks, I have a question:" :D no worries, was just kidding | 05:50 |
| mewald | bjolo: but I think that option is too far from being well tested and proven to work | 05:51 |
| bjolo | i did kinda a technolog mapping a couple of months back, and it is just insane how many different options there is for data today | 05:51 |
| mewald | yeah, only a few days back someone here in the channel said prometheus.io :D never heard of that | 05:51 |
| mewald | I stumbled across kafka and other stuff though | 05:51 |
| bjolo | yes, beats is way new, but it does have some synergies | 05:51 |
| derekjhyang | mewald: Oh, I see. But I have no ideas to resolve it. Any suggestions? | 05:52 |
| mewald | derekjhyang: which version of ubuntu are you building? | 05:52 |
| derekjhyang | newald: Ubutnu 14.04 | 05:53 |
| derekjhyang | newald: Ubuntu 14.04 | 05:53 |
| mewald | hmm, let me try something | 05:53 |
| mewald | derekjhyang: that's weird, I just installed cgmanager on trusty without problems https://gist.github.com/mewald1/96227c96ccaaa7bfd0c7f7b44e98e7a8 | 05:55 |
| derekjhyang | mewald: As far as I know, libvirt-bin depends on the package cgmanager (a kinda cgroup mgmt package), but it responded me that it couldn't setup /etc/init.d/cgmanger correctly. | 05:57 |
| derekjhyang | memwald: That's so werid, right? At first, I can build the image, but a few days ago, it can't. | 05:58 |
| derekjhyang | https://www.irccloud.com/pastebin/GF52M3vL/ | 05:59 |
| bjolo | there was some talk on the channel last night about issues with ubuntu builds | 05:59 |
| bjolo | i build centos, so i was not paying that much attention, but look at the logs from later yesterday, early this morning | 06:00 |
| *** kklimonda_ has joined #openstack-kolla | 06:02 | |
| *** kklimonda_ has quit IRC | 06:02 | |
| derekjhyang | https://www.irccloud.com/pastebin/LVXHmygY/ | 06:03 |
| *** aernhart__ has quit IRC | 06:07 | |
| mewald | hmm, I seriously have not clue … could it be that your base images is faulty? like something wasn't downloaded correctly and now causes problems? | 06:12 |
| bjolo | it seems most people favor ubuntu containers. any particular reason for that? | 06:14 |
| *** sogabe has quit IRC | 06:16 | |
| mewald | bjolo: probably just personal preference. | 06:17 |
| *** smemon has quit IRC | 06:17 | |
| derekjhyang | bjolo: yup, I agree with mewald. I've also used the centos7 image in the devstack initially, but I met some issues that I couldn't resolve on OpenStack. After that, I tried to use another distro (Ubuntu), then anything has seemed to be okay. | 06:22 |
| mewald | derekjhyang: have you tried resetting everything to start including deletion of all images? | 06:23 |
| bjolo | ubuntu is the primary dev platform for openstack so it makes sense from that end | 06:23 |
| bjolo | personally i prefer to run centos on the host. in my experience, centos/RHEL is little more stable when it comes to hardware | 06:24 |
| *** dmueller-evoila has joined #openstack-kolla | 06:25 | |
| bjolo | redhat also owns ansible, and ceph. One would think those will work *best* on rhel/centos | 06:25 |
| bjolo | so i just picked centos for containers since i run centos on the hosts | 06:26 |
| derekjhyang | mewald: Definitely! Only thing I never tried is killing the Ubuntu-based image, because I've built a docker private registry repo for kolla. | 06:26 |
| mewald | try killing it all just to make sure | 06:26 |
| mewald | you can build stuff with "tools/build.py regex nova-libvirt" just to be faster :) | 06:27 |
| bjolo | mewald, aha thats how you do it :) | 06:28 |
| derekjhyang | mewald: Is there the fully detailed example ? | 06:29 |
| mewald | :D have you always waited 60min for the entire build? :D | 06:29 |
| mewald | derekjhyang: of what? | 06:29 |
| derekjhyang | mewald: for this, "tools/build.py regex nova-libvirt" just to be faster | 06:29 |
| bjolo | no i meant building in git repo | 06:29 |
| mewald | bjolo: ahh | 06:29 |
| bjolo | i have always done pip install, kolla-build | 06:30 |
| mewald | derekjhyang: tools/build.py references a script in the kolla git repository | 06:30 |
| mewald | the command is already complete | 06:30 |
| mewald | I was just using the script from the repo instead what "pip install ./kolla" installs on your system | 06:30 |
| *** daneyon has joined #openstack-kolla | 06:31 | |
| derekjhyang | mewald: I know that, I can the help command of tools/build.py. | 06:32 |
| Mech422 | mewald: yeah - don't forget reiman, prometheus, influxdb/Tick stack, etc etc - its a huge list | 06:33 |
| derekjhyang | But I don't know how to use the [regex] | 06:33 |
| derekjhyang | https://www.irccloud.com/pastebin/kYRvQ9lQ/ | 06:33 |
| mewald | just type exactly as I posted :D | 06:33 |
| mewald | nova-libvirt IS the regex | 06:34 |
| mewald | Mech422: I decided to go with telegraf + single instance influxdb for now | 06:34 |
| derekjhyang | mewald: Oh, I know what you meant. :) | 06:34 |
| Mech422 | derekjhyang: there is a problem with ubuntu source build as of 12 hours ago.. | 06:35 |
| mewald | derekjhyang: are you building source? | 06:35 |
| Mech422 | derekjhyang: the base container appears to need apt-transport-https installed - I'm getting ready to patch | 06:35 |
| Mech422 | mewald: I'm thinking about TICK for my home lab | 06:35 |
| mewald | I just doing the TI of TICK now ^^ | 06:36 |
| *** daneyon has quit IRC | 06:36 | |
| mewald | actually it's TIG :D I add Grafana optionally | 06:36 |
| Mech422 | mewald: a full os install + ubuntu source build/deploy is about an hour for me now | 06:36 |
| derekjhyang | mewald: Yes, I cloned it from github with liberty version. | 06:36 |
| Mech422 | mewald: yeah - gonna add grafana to mine too | 06:36 |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Use neutron-server image for lbaas bootstrap https://review.openstack.org/345843 | 06:37 |
| Mech422 | mewald: I was thinking of prometheus with influxdb and telegraf/grafana too | 06:37 |
| mewald | yeah I am sure there is a lot to think about but probably very few that actually works ^^ | 06:37 |
| derekjhyang | Mech422: Oh, really?! Any news about that Ubuntu problem ? | 06:38 |
| *** ravig has quit IRC | 06:38 | |
| Mech422 | derekjhyang: give me an hour or so - I'm gonna rebuild now and see if I can fix it - just need a 1 liner in the docker/base/Dockerfile to install apt-transport-https | 06:38 |
| *** kklimonda_ has joined #openstack-kolla | 06:39 | |
| derekjhyang | Mech422: No problem, thank you for your help | 06:39 |
| *** nick-ma has joined #openstack-kolla | 06:41 | |
| derekjhyang | Mech422: Which version of the Ubuntu image do you build ? | 06:45 |
| Mech422 | master | 06:47 |
| Mech422 | I build ubuntu master from source with ansible 2.1.0.0 multi-node with ceph enabled using fresh installs of Ubuntu 14.04 for all hosts | 06:48 |
| Mech422 | or at least I do when network-manager doesn't hose the DNS on my desktop | 06:49 |
| * Mech422 screams | 06:49 | |
| Mech422 | ok - got the Ubuntu installs started...we're cooking with gas now! | 06:52 |
| derekjhyang | gogo | 06:53 |
| Mech422 | derekjhyang: here's the patch I applied: http://paste.openstack.org/show/539666/ | 06:53 |
| Mech422 | derekjhyang: if I works, I'll submit it upstream | 06:54 |
| *** jascott1_tmp has quit IRC | 06:54 | |
| bjolo | Mech422, get rid of NetworkManager | 06:54 |
| derekjhyang | Wish it will not be the greenhouse gases lol | 06:54 |
| Mech422 | bjolo: yeah - it has become a pain with my work vpn... | 06:55 |
| Mech422 | bjolo: its prolly not network managers fault - the vpn prolly specifies new nameservers... | 06:55 |
| Mech422 | bjolo: but I could have sworn I told it to get 'routes only' and ignore nameservers | 06:55 |
| *** sbezverk_ has joined #openstack-kolla | 06:56 | |
| *** b_bezak has joined #openstack-kolla | 06:57 | |
| *** sbezverk has quit IRC | 06:58 | |
| *** jascott1_tmp has joined #openstack-kolla | 07:00 | |
| bjolo | gee i have no idea why swift is giving access denied | 07:01 |
| *** chopmann has joined #openstack-kolla | 07:02 | |
| nick-ma | hi all, i'm trying to deploy kolla, but it failed due to 'tag not found for heka'. how can I fix this problem? https://bugs.launchpad.net/kolla/+bug/1605492 | 07:02 |
| openstack | Launchpad bug 1605492 in kolla "tag 3.0.0 doesn't exist for heka" [Undecided,New] | 07:02 |
| Mech422 | nick-ma: I haven't seen that one... | 07:04 |
| Mech422 | nick-ma: I'm rebuilding my images/cluster now, give me an hour or so, and I'll see what I get | 07:04 |
| bjolo | does kolla-build generate any log files? i.e. i mean detailed manifest files so one can backtrack exactly what was installed in each container? | 07:06 |
| *** sdake has joined #openstack-kolla | 07:07 | |
| *** sdake_ has quit IRC | 07:07 | |
| derekjhyang | bjolo: maybe you can try to modify kolla-build.conf with the option 'debug=True', then using the linux pipe command like ' 2>&1 | tee kolla-build.log' | 07:09 |
| *** JianqingJiang has joined #openstack-kolla | 07:09 | |
| bjolo | if i had time when i come back from vacation end of august, i want to create a docker image named kolla-buildserver or something like that | 07:11 |
| bjolo | have a docker registry in it and a simple web ui where one can specify exactly what to build and keep an artifact repository | 07:12 |
| openstackgerrit | Zhijiang Hu proposed openstack/kolla: Prevent incomplete intermediate or incomplete final image when building rabbitmq https://review.openstack.org/345872 | 07:12 |
| derekjhyang | bjolo: haha, I've used the Jenkins to trigger Kolla build task. Hence, I have the full log when I build it every time. | 07:12 |
| bjolo | derekjhyang, nice | 07:13 |
| nick-ma | ok, thanks. i will try to find out the log files. | 07:13 |
| derekjhyang | bjolo: maybe you can try to do it. | 07:13 |
| bjolo | or put jenkins in the kolla-buildserver :) | 07:13 |
| dmueller-evoila | twpython dict | 07:13 |
| bjolo | i just feel that kolla needs to be alittle bit easier for operators | 07:14 |
| nick-ma | @Mech422: thanks. | 07:14 |
| derekjhyang | In fact, I imitate the progress of OpenStack CI to build my own DevOps service. | 07:15 |
| *** salv-orl_ has quit IRC | 07:16 | |
| *** tyrola has joined #openstack-kolla | 07:17 | |
| Mech422 | bjolo: I actually drive kolla from a separate set of ansible playbooks | 07:17 |
| Mech422 | bjolo: they setup the hosts, apply patches, and invoke the kolla stuff for me | 07:17 |
| bjolo | Mech422, i know, you told me :) | 07:17 |
| bjolo | and its very cool | 07:17 |
| Mech422 | bjolo: hopefully a lot of that will be added to kolla soon | 07:17 |
| Mech422 | bjolo: oh ...yeah, I talk so much I forgot what I've said :-P | 07:18 |
| bjolo | but lets think kolla running rackspace and a large team of ops that need to work together | 07:18 |
| Mech422 | bjolo: a big part of that is 'plugability' - which is high on the list of stuff to do | 07:18 |
| bjolo | large scale ops, large clouds | 07:18 |
| Mech422 | bjolo: but first, I think they want to solidify the customization stuff | 07:19 |
| bjolo | the toolset and processes needed for that | 07:19 |
| bjolo | Mech422, agree, kolla is not there yet, but... | 07:19 |
| bjolo | i have some opinions on how the code is structured today from an operators point of view | 07:20 |
| bjolo | it is not that it is wrong or doesnt work | 07:20 |
| bjolo | it is just in the large scale ops scenario, it is probably not the way you want it | 07:20 |
| Mech422 | bjolo: I think plugability and docs will go a long way... | 07:21 |
| bjolo | yes definetly | 07:21 |
| Mech422 | bjolo: kolla can do stuff like add/remove a node, upgrade the cluster, etc - its just not easy to find the docs/procedures | 07:21 |
| bjolo | agree | 07:22 |
| bjolo | im using kolla 2 right now, so upgrades/reconfig does not always work thou | 07:22 |
| Mech422 | bjolo: I'm going to start doing rolling-upgrades of our QA cluster with Kolla end of next week... | 07:22 |
| Mech422 | bjolo: hopefully, that will give me an excuse to help with docs | 07:23 |
| bjolo | Mech422, you running the QA cluster? | 07:24 |
| Mech422 | bjolo: err...for my employer - not the kolla qa stuff | 07:25 |
| bjolo | ok | 07:25 |
| *** chopmann has quit IRC | 07:25 | |
| bjolo | aha ok now i read your line again | 07:25 |
| Mech422 | bjolo: its basically POC, so we're planning on doing weekly rolling upgrades till newton is cut, just to get some experience on upgrade procedure | 07:26 |
| *** chopmann has joined #openstack-kolla | 07:26 | |
| mewald | Guys, I am having this problem again where neutron_dhcp_agent starts and the entire system starts to run mad. OOM kills and complete unavailability of the system | 07:26 |
| mewald | did anyone make any progress with this? | 07:26 |
| bjolo | mewald, kolla 3 | 07:26 |
| bjolo | ? | 07:26 |
| mewald | yes | 07:26 |
| mewald | master | 07:26 |
| bjolo | i see this on kolla 2. no matter what image i run | 07:28 |
| bjolo | [root@eselde02u37 tools]# ps -elf | grep defunct | 07:28 |
| bjolo | 1 Z root 21618 19473 0 80 0 - 0 exit 07:46 ? 00:00:00 [dnsmasq] <defunct> | 07:28 |
| bjolo | 1 Z root 21978 19534 0 80 0 - 0 exit 07:46 ? 00:00:00 [neutron-ns-meta] <defunct> | 07:28 |
| bjolo | 0 S root 24145 9935 0 80 0 - 28162 pipe_w 09:27 pts/1 00:00:00 grep --color=auto defunct | 07:28 |
| *** salv-orlando has joined #openstack-kolla | 07:28 | |
| mewald | awesome | 07:28 |
| Mech422 | huh - I haven't had any issues with that... | 07:28 |
| bjolo | i just want to sort out this swift access issue, then im done done done done and can go on vacation :) | 07:29 |
| openstackgerrit | Zhijiang Hu proposed openstack/kolla: Prevent incomplete intermediate or incomplete final image when building rabbitmq https://review.openstack.org/345872 | 07:29 |
| *** lulei has quit IRC | 07:29 | |
| bjolo | dnsmasq still works thou, it just seems like the container fails on some | 07:31 |
| bjolo | [root@eselde02u37 tools]# docker exec neutron_dhcp_agent ps -el | grep dnsmasq | 07:31 |
| bjolo | 1 Z 0 88 1 0 80 0 - 0 exit ? 00:00:00 dnsmasq <defunct> | 07:31 |
| bjolo | 5 S 99 89 1 0 80 0 - 3889 poll_s ? 00:00:00 dnsmasq | 07:31 |
| *** chopmann has quit IRC | 07:31 | |
| bjolo | so i want to move my swift proxies from control to network nodes. no new images or anything, just simply move them. what would be the "correct" way of doing that? | 07:33 |
| mewald | a reset of the box solves it | 07:33 |
| mewald | very strange bug | 07:33 |
| bjolo | kolla-ansible deploy? | 07:33 |
| bjolo | kolla-ansible reconfigure; kolla-ansible deploy? | 07:33 |
| mewald | just a deplyo | 07:33 |
| mewald | deploy | 07:33 |
| bjolo | i have update the inventory file accordingly of course :) | 07:33 |
| bjolo | mewald, and then stop the old proxies manually and remove image | 07:34 |
| bjolo | ? | 07:34 |
| mewald | also, after the reset of the box "docker ps -a" hangs for a while | 07:34 |
| *** jascott1_tmp has quit IRC | 07:44 | |
| *** aernhart__ has joined #openstack-kolla | 07:45 | |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Add note for enable_mongodb option https://review.openstack.org/345881 | 07:46 |
| *** jascott1_tmp has joined #openstack-kolla | 07:46 | |
| *** tyrola has quit IRC | 07:47 | |
| *** tyrola has joined #openstack-kolla | 07:47 | |
| b_bezak | bjolo:, I have the same case on 2.0.2 with zombie processes - dnsmasq, metadata proxy, and some time IP (when removing networks) | 07:50 |
| b_bezak | bjolo: I am using multinode baremetal (basically 3x alloinone), with dvr+l3ha on 16.04.1 | 07:53 |
| b_bezak | and I am not sure whether it is a problem with docker/kernel version, or kolla itself | 07:54 |
| bjolo | b_bezak, ok bug confirmed then :) | 07:54 |
| b_bezak | but it looks like - when process is dropping root then this old root one is going zombie | 07:55 |
| bjolo | i have 3 control, 3 network, 10 compute, 6 storage. no customization anywhere really | 07:55 |
| b_bezak | so after days of testing - removing networks, creating etc. I had max ~700 zombies :P | 07:55 |
| bjolo | ouch | 07:55 |
| b_bezak | I saw that next week there will be new release of docker 1.12, which supposedly is fixing some defunct problems | 07:56 |
| b_bezak | let's see :) | 07:56 |
| bjolo | centos 7 hosts | 07:56 |
| b_bezak | heh, so probably not kernel problem | 07:56 |
| b_bezak | docker version? | 07:56 |
| bjolo | b_bezak, 1.11.2 | 07:57 |
| b_bezak | latest then | 07:57 |
| bjolo | yup | 07:57 |
| b_bezak | let's hope 1.12 will fix it :) | 07:57 |
| bjolo | is it a docker bug though? | 07:57 |
| b_bezak | not sure | 07:57 |
| bjolo | have you done any investigation | 07:57 |
| b_bezak | not really. just some testing with regular l3agent settings. and it was the same of course | 07:58 |
| bjolo | i have not digged into it, but i have defunct and working dnsmasq in the same container so i assumed it is either openstack | 07:58 |
| bjolo | or the way that kolla starts up the container. i.e. how it spawns a new dnsmasq in the container | 07:59 |
| b_bezak | yeah, it is not functional bug - processes are working | 07:59 |
| *** jascott1_tmp has quit IRC | 07:59 | |
| b_bezak | bjolo: are you using kolla 3? | 07:59 |
| bjolo | [root@eselde02u35 haproxy]# docker exec -it neutron_dhcp_agent bash | 08:00 |
| bjolo | (neutron-dhcp-agent)[neutron@eselde02u35 /]$ ps -elf | 08:00 |
| bjolo | F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD | 08:00 |
| bjolo | 4 S neutron 1 0 1 80 0 - 51991 ep_pol 07:41 ? 00:02:38 /var/lib/kolla/venv/bin/python /var/lib/ | 08:00 |
| bjolo | 1 Z root 87 1 0 80 0 - 0 exit 07:46 ? 00:00:00 [dnsmasq] <defunct> | 08:00 |
| bjolo | 5 S nobody 88 1 0 80 0 - 3889 poll_s 07:46 ? 00:00:00 dnsmasq --no-hosts --no-resolv --strict- | 08:00 |
| bjolo | 4 S neutron 113 0 0 80 0 - 3344 wait 09:59 ? 00:00:00 bash | 08:00 |
| bjolo | 0 R neutron 141 113 0 80 0 - 12256 - 09:59 ? 00:00:00 ps -elf | 08:00 |
| bjolo | kolla 2 latest | 08:00 |
| b_bezak | ok | 08:00 |
| b_bezak | root@infra2:~# ps -ef | grep -i defunc | wc -l | 08:00 |
| b_bezak | 19 | 08:00 |
| bjolo | im new to kolla so im just trying to learn the ropes right now and get something up so my users can try it out. | 08:01 |
| bjolo | when im back from vacation end of august, i will jump on kolla 3 | 08:01 |
| Mech422 | hmm - not much info on heka vs hindsight | 08:10 |
| *** openstackgerrit has quit IRC | 08:11 | |
| *** manjeets- has quit IRC | 08:11 | |
| *** flaper87 has quit IRC | 08:12 | |
| *** tyrola has quit IRC | 08:12 | |
| *** flaper87 has joined #openstack-kolla | 08:12 | |
| *** flaper87 has quit IRC | 08:12 | |
| *** flaper87 has joined #openstack-kolla | 08:12 | |
| *** jrist has quit IRC | 08:12 | |
| *** elemoine- has quit IRC | 08:12 | |
| *** tyrola has joined #openstack-kolla | 08:12 | |
| derekjhyang | What's the tag 'heka'? | 08:13 |
| *** shardy has joined #openstack-kolla | 08:13 | |
| *** jrist has joined #openstack-kolla | 08:13 | |
| *** openstackgerrit has joined #openstack-kolla | 08:14 | |
| *** elemoine has joined #openstack-kolla | 08:14 | |
| *** JianqingJiang has quit IRC | 08:15 | |
| *** JianqingJiang has joined #openstack-kolla | 08:16 | |
| *** sdake_ has joined #openstack-kolla | 08:17 | |
| Mech422 | derekjhyang: dam - my ubuntu source build crapped out with that https transport error | 08:18 |
| Mech422 | derekjhyang: so my one liner isn't cutting it | 08:18 |
| *** sdake has quit IRC | 08:19 | |
| *** daneyon has joined #openstack-kolla | 08:20 | |
| *** sdake_ has quit IRC | 08:21 | |
| bjolo | ok anyone on the channel that knows swift and can help me TS? | 08:24 |
| bjolo | i have gone through the docs, etc and it all looks correct | 08:24 |
| *** daneyon has quit IRC | 08:24 | |
| *** aernhart_ has joined #openstack-kolla | 08:24 | |
| *** tyrola has quit IRC | 08:25 | |
| bjolo | swift works, but only admin in admin tenant can list,create,delete | 08:25 |
| *** tyrola has joined #openstack-kolla | 08:25 | |
| bjolo | all others, including admin in demo tenant, get access denied | 08:25 |
| *** aernhart__ has quit IRC | 08:28 | |
| *** lulei has joined #openstack-kolla | 08:32 | |
| *** bjolo is now known as bjolo-afk | 08:38 | |
| *** sogabe has joined #openstack-kolla | 08:42 | |
| *** bjolo-afk has quit IRC | 08:43 | |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Install python-bson for Ceilometer for ubuntu https://review.openstack.org/345912 | 08:45 |
| derekjhyang | what's the meaning of "TS" ? | 08:47 |
| *** lulei has quit IRC | 08:54 | |
| *** lulei has joined #openstack-kolla | 08:55 | |
| mewald | I have a setup with internal and external VIP (haproxy) but a load balancer that translates from internet to external vip and does SSL termination. Is there a way to tell Kolla to deploy https endpoints into the keystone service catalog? | 08:55 |
| *** gfidente has joined #openstack-kolla | 08:55 | |
| *** gfidente has joined #openstack-kolla | 08:55 | |
| *** JianqingJiang has quit IRC | 08:55 | |
| *** JianqingJiang has joined #openstack-kolla | 08:56 | |
| Mech422 | derekjhyang: ok - I got past the elastic.co https transport error...now I'm getting an error on the percona repos | 08:56 |
| derekjhyang | @Mech422: thank you | 08:58 |
| Mech422 | derekjhyang: this patch fixes the https thing, but not sure if it broke percona: http://paste.openstack.org/show/539672/ | 08:59 |
| Mech422 | derekjhyang: not sure why it would break percona repo and no other repo though | 08:59 |
| *** aernhart__ has joined #openstack-kolla | 09:00 | |
| *** aernhart__ has quit IRC | 09:01 | |
| *** aernhart__ has joined #openstack-kolla | 09:01 | |
| *** manjeets_ has joined #openstack-kolla | 09:03 | |
| *** aernhart_ has quit IRC | 09:04 | |
| *** JianqingJiang has quit IRC | 09:07 | |
| *** Jianqing_ has joined #openstack-kolla | 09:08 | |
| *** mbound_ has joined #openstack-kolla | 09:13 | |
| *** mbound has quit IRC | 09:17 | |
| *** dwalsh has joined #openstack-kolla | 09:17 | |
| *** dwalsh_ has joined #openstack-kolla | 09:19 | |
| *** b_bezak_ has joined #openstack-kolla | 09:23 | |
| *** aernhart__ has quit IRC | 09:24 | |
| *** b_bezak has quit IRC | 09:27 | |
| *** Jianqing_ has quit IRC | 09:27 | |
| openstackgerrit | Mathias proposed openstack/kolla: Implement Basic Performance Monitoring https://review.openstack.org/345938 | 09:28 |
| *** dolpher has joined #openstack-kolla | 09:29 | |
| openstackgerrit | Merged openstack/kolla: implement Ansible Tempest role https://review.openstack.org/321522 | 09:34 |
| *** athomas has quit IRC | 09:36 | |
| openstackgerrit | Mathias proposed openstack/kolla: Implement Basic Performance Monitoring https://review.openstack.org/345938 | 09:42 |
| mewald | Guys please take a look at https://review.openstack.org/#/c/345938/ It's a first step towards a performance monitoring stack in Kolla. | 09:43 |
| patchbot | mewald: patch 345938 - kolla - Implement Basic Performance Monitoring | 09:43 |
| *** athomas has joined #openstack-kolla | 09:43 | |
| *** salv-orlando has quit IRC | 09:49 | |
| *** salv-orlando has joined #openstack-kolla | 09:49 | |
| *** egonzalez has joined #openstack-kolla | 09:49 | |
| *** salv-orlando has quit IRC | 09:54 | |
| Mech422 | mewald: I think there are some customization blocks that go in the Dockerfile ? | 09:54 |
| mewald | Mech422: what exactly? | 09:55 |
| Mech422 | mewald: look at the 'base' Dockerfile.j2 | 09:55 |
| *** dolpher has left #openstack-kolla | 09:55 | |
| Mech422 | mewald: block base_header | 09:55 |
| Mech422 | mewald: not sure if each template is supposed to have block like that | 09:55 |
| Mech422 | mewald: inc0 did a whole bunch of stuff on customization recently - you could check with him | 09:56 |
| mewald | Mech422: I used keystone/Dockerfile.j2 as a template | 09:56 |
| Mech422 | mewald: dunno - like I said, inc0 knows more about that... ask him, and if its good, its good :-) | 09:57 |
| openstackgerrit | Mathias proposed openstack/kolla: Implement Basic Performance Monitoring https://review.openstack.org/345938 | 10:00 |
| Mech422 | mewald: btw - nice work :-) | 10:01 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla: Add Senlin Ansible role https://review.openstack.org/339725 | 10:01 |
| mewald | well thanks ^^ There is a lot of room for improvement | 10:01 |
| Mech422 | mewald: there always is :-) But thats a nice chunk of functionality we didn't have before !! :-D | 10:03 |
| *** zhurong has quit IRC | 10:06 | |
| *** ntpttr___ has joined #openstack-kolla | 10:07 | |
| *** daneyon has joined #openstack-kolla | 10:08 | |
| *** Liuqing has quit IRC | 10:08 | |
| *** ntpttr has quit IRC | 10:09 | |
| mewald | Mech422: What I really want to add is that the datasource is automatically created in Grafana | 10:12 |
| mewald | and having some prepared dashboards would be awesome, too | 10:13 |
| Mech422 | mewald: flashey lights always impress mgmt - be a nice 'selling' point for kolla | 10:13 |
| *** daneyon has quit IRC | 10:13 | |
| mewald | yeah ^^ | 10:13 |
| mewald | and creating dashboards is really time consuming | 10:13 |
| mewald | I have spent weeks with that shit | 10:14 |
| mewald | what will be interesting is to integrate all services properly | 10:15 |
| mewald | like haproxy stats, ceph, etc | 10:15 |
| mewald | that's the next step | 10:15 |
| Mech422 | mewald: well, for my small contribution for the night - I think I got the ubuntu source builds working again | 10:16 |
| mewald | nice! | 10:16 |
| Mech422 | mewald: just needed to add apt-transport-https and ca-certificates to the base image | 10:16 |
| mewald | tell derekjhyang :) | 10:16 |
| Mech422 | its a 2 liner, so hopefully it can be pushed out tommorrow as a 'trivialfix' | 10:16 |
| Mech422 | I think he's asleep ? | 10:16 |
| Mech422 | derekjhyang: you still around ? | 10:17 |
| *** godleon has joined #openstack-kolla | 10:29 | |
| *** egonzalez has quit IRC | 10:39 | |
| openstackgerrit | Bartłomiej Daca proposed openstack/kolla: Fixing kolla's problem with ansible var precedence https://review.openstack.org/345972 | 10:39 |
| *** sogabe has quit IRC | 10:41 | |
| openstackgerrit | Dave Walker proposed openstack/kolla: Add Watcher ansible roles and templates https://review.openstack.org/337556 | 10:45 |
| derekjhyang | Mech422: Okay, where should I get the latest Ubuntu image? | 10:55 |
| *** neophy has joined #openstack-kolla | 11:07 | |
| *** salv-orlando has joined #openstack-kolla | 11:07 | |
| *** zhurong has joined #openstack-kolla | 11:12 | |
| *** bjolo has joined #openstack-kolla | 11:14 | |
| *** zhurong has quit IRC | 11:16 | |
| *** zhurong has joined #openstack-kolla | 11:17 | |
| *** ccesario has joined #openstack-kolla | 11:18 | |
| *** mliima has joined #openstack-kolla | 11:19 | |
| Mech422 | derekjhyang: eh? | 11:20 |
| Mech422 | derekjhyang: I didn't make an image for upload - I was just running a local build from source | 11:20 |
| Mech422 | derekjhyang: here's the patch I used: http://paste.openstack.org/show/539735/ | 11:22 |
| *** rhallisey has joined #openstack-kolla | 11:35 | |
| openstackgerrit | Mathias proposed openstack/kolla: Implement Basic Performance Monitoring https://review.openstack.org/345938 | 11:55 |
| mewald | how to people make sure they get trailing whitespaces and all that stuff right before they push into gerrit? It takes to much time reacting to comments and providing new patchsets :D | 11:57 |
| Mech422 | mewald: for python, there's pep8.. dunno tools for yaml or Dockerfiles | 11:58 |
| *** zeus has quit IRC | 12:00 | |
| mewald | ok | 12:10 |
| bjolo | mewald, sed -i 's/[ \t]*$//' "$1" | 12:27 |
| mewald | bjolo: ha, didnt even think of that :D | 12:27 |
| bjolo | linux to the rescue! :) | 12:28 |
| bjolo | mewald, what editor are you using? | 12:29 |
| bjolo | vim? | 12:29 |
| mewald | yes | 12:29 |
| bjolo | can do in vim as well | 12:29 |
| bjolo | http://vim.wikia.com/wiki/Remove_unwanted_spaces | 12:29 |
| bjolo | vim +1 :) | 12:30 |
| bjolo | is ubuntu builds still having issues? | 12:30 |
| bjolo | cant get my swift access issue sorted out. it is like the requests just disappear Figure i try deploying with ubuntu | 12:31 |
| bjolo | not really hoping much that will fix it, but wanted to try ubuntu anyway | 12:33 |
| mewald | I like vim but not enough to go through this scripting hell :D | 12:33 |
| bjolo | heheh | 12:33 |
| bjolo | agree vim hacking is weird | 12:33 |
| bjolo | search replace is enough for me | 12:33 |
| *** bdaca has quit IRC | 12:40 | |
| *** dwalsh_ has quit IRC | 12:40 | |
| *** dwalsh has quit IRC | 12:41 | |
| *** dave-mccowan has joined #openstack-kolla | 12:51 | |
| openstackgerrit | Nenad Radojevic proposed openstack/kolla: Keystone "user" role added by default. https://review.openstack.org/346008 | 12:51 |
| *** salv-orlando has quit IRC | 12:53 | |
| *** inc0 has joined #openstack-kolla | 12:53 | |
| *** Serlex has joined #openstack-kolla | 12:56 | |
| bjolo | hmm if i do a git review -s, it should come up here on irc right? | 12:58 |
| *** inc0 has quit IRC | 12:59 | |
| mewald | no | 12:59 |
| mewald | only "git review" | 12:59 |
| bjolo | ok | 12:59 |
| bjolo | error missing change id? | 13:00 |
| bjolo | i just corrected a small typo in the swift documentation | 13:00 |
| mewald | git review didnt work, did it? | 13:00 |
| mewald | git review -s | 13:00 |
| *** shardy is now known as shardy_mtg | 13:01 | |
| bjolo | qbjolof@eseldulx1040:~/tmp/kolla/doc:15:01:19> git commit -s | 13:01 |
| bjolo | On branch master | 13:01 |
| bjolo | Your branch is ahead of 'origin/master' by 1 commit. | 13:01 |
| bjolo | (use "git push" to publish your local commits) | 13:01 |
| bjolo | nothing to commit, working directory clean | 13:01 |
| openstackgerrit | Mathias proposed openstack/kolla: Implement Basic Performance Monitoring https://review.openstack.org/345938 | 13:02 |
| openstackgerrit | bjorn lofdahl proposed openstack/kolla: Added weight when creating drives in swift https://review.openstack.org/346024 | 13:02 |
| bjolo | ouch | 13:03 |
| bjolo | wait damn | 13:04 |
| mewald | Question for whoever is deep in the code of Kolla: I want to add code to automatically create a "datasource" in Grafana connceting it to the influxdb instance. Grafana takes a while when starting before it is actually up accepting API requests. The only way to programmatically add a datasource I see is via API request though. What is the proper way to do this? One way I see is: Create bootstrap script that waits until API is ready, the | 13:05 |
| bjolo | the weigt is there, its just bad format in my browser. need to scroll horizontal to see it | 13:06 |
| bjolo | mewald, can i delete my own commit? | 13:07 |
| bjolo | -1 | 13:07 |
| rhallisey | mewald, I think what you want is to do some sort of bootstrap step which starts the service. Then ansible will wait until it's ready to create a datasource | 13:08 |
| mewald | rhallisey: hmm currently the runcommand is executed by https://github.com/openstack/kolla/blob/master/docker/base/start.sh So one way would be to add e.g. /run.sh wrapping the grafana service start command and use /run.sh as the commend to execute in config.json | 13:11 |
| mewald | Is that what you mean? | 13:11 |
| *** inc0 has joined #openstack-kolla | 13:11 | |
| rhallisey | mewald, I don't think we want to automatically create the datastore in the container | 13:12 |
| inc0 | good morning | 13:12 |
| bjolo | morning inc0 | 13:12 |
| rhallisey | we want it as a separate action done by ansible | 13:12 |
| *** lulei has quit IRC | 13:12 | |
| mewald | rhallisey: to the same bootstrap mechanism used by Keystone could be used | 13:13 |
| mewald | inject bootstrap script via Docker file, execute it via Ansible (docker exec) | 13:13 |
| inc0 | mewald, what's the issue | 13:14 |
| inc0 | ? | 13:14 |
| rhallisey | mewald, is this something that needs to be in the contianer? | 13:14 |
| rhallisey | or something that can get created remotely like a user/password | 13:14 |
| mewald | hmm, no actually not | 13:14 |
| *** jtriley has joined #openstack-kolla | 13:15 | |
| mewald | you're right | 13:15 |
| mewald | could just be run remotely | 13:15 |
| rhallisey | ok then look at using kolla-toolbox | 13:15 |
| *** ravig has joined #openstack-kolla | 13:15 | |
| mewald | they way I understand kolla-toolbox is as a set of arbitrary scripts, right? Why are they not just executed from Ansible directly? | 13:16 |
| inc0 | mewald, reason we created it was because of shade | 13:17 |
| rhallisey | mewald, you can add a custom module in the ansible dir | 13:17 |
| rhallisey | that works too | 13:17 |
| inc0 | we had this small part of ansible 2.0 when we were still ansible 1.9 | 13:17 |
| *** mbound has joined #openstack-kolla | 13:18 | |
| rhallisey | shade has like 1000 deps | 13:18 |
| bjolo | shade as in libshade? | 13:18 |
| mewald | what is "shade"? | 13:18 |
| inc0 | now technically we can get rid of it as shade is already in ansible 2 and we use it, however kolla-toolbox still is helpful to other consumers like k8s | 13:18 |
| inc0 | bjolo shade as openstack module for ansible | 13:18 |
| inc0 | or ansible module for openstack;) | 13:19 |
| *** mbound_ has quit IRC | 13:21 | |
| bjolo | http://docs.openstack.org/infra/shade/ | 13:22 |
| bjolo | https://pypi.python.org/pypi/shade-ansible | 13:22 |
| bjolo | right? | 13:22 |
| inc0 | "now it's all in ansible? | 13:24 |
| inc0 | " | 13:24 |
| inc0 | but right, that was the thing | 13:24 |
| bjolo | ok | 13:26 |
| bjolo | ive been playing with kolla 2 now for a few weeks, and it is great! little rough on some spots, but overall im sold :) | 13:27 |
| inc0 | glad to hear | 13:27 |
| bjolo | kudos to everyone who has made this happen | 13:27 |
| rhallisey | bjolo, let the community know about any pain points :). We'd love to help | 13:27 |
| inc0 | we work on these edges, but if we would do it all, we'd wouldn't get to keep ourselves to commit to kolla, so we take our time with this;) | 13:28 |
| bjolo | well, my back is kinda sore. thats one painpoint | 13:28 |
| bjolo | ;) | 13:28 |
| rhallisey | ha | 13:28 |
| rhallisey | ya we can't help you there :) | 13:29 |
| bjolo | off the top of my head, documentation is a little hard to follow. one thing is it says git clone.... right, but you actually have to checkout the branch you wanna deploy | 13:29 |
| rhallisey | bjolo, agreed, there is a massive re work in progress | 13:29 |
| inc0 | bjolo docs are worst part of kolla right now imho | 13:29 |
| bjolo | most operators i know unfortunately dont have a lot of git knowledge | 13:30 |
| inc0 | so if you want to commit something, that would be great place to start;) | 13:30 |
| bjolo | especially branching | 13:30 |
| bjolo | and as an operator i dont really need the git repo either (besides for the tools folder) | 13:30 |
| bjolo | would it be possible to setup a real pip package for kolla? | 13:31 |
| bjolo | so as an operator, i would just have to do a: pip install kolla version=2.0.2 | 13:31 |
| inc0 | yes | 13:31 |
| inc0 | should be;) | 13:32 |
| inc0 | let me try | 13:32 |
| bjolo | rhallisey, i go on vacation today and be gone for a month, but when im back i plan to help out if i can be of any use | 13:33 |
| rhallisey | awesome | 13:33 |
| bjolo | reading the "new" docs and have ops kollegues try them out | 13:33 |
| bjolo | is a good place to start | 13:34 |
| *** shardy_mtg has quit IRC | 13:34 | |
| *** shardy_mtg has joined #openstack-kolla | 13:36 | |
| *** shardy_mtg is now known as shardy | 13:36 | |
| *** diogogmt has joined #openstack-kolla | 13:38 | |
| bjolo | inc0, ansible is also in pip right? | 13:38 |
| bjolo | inc0, so if, pip install kolla kan select the right ansible version as well? | 13:39 |
| inc0 | bjolo in our docs we do have pip isntall ansible==2.1.0 | 13:44 |
| bjolo | inc0, where? | 13:44 |
| inc0 | btw bjolo - Bartek?:) | 13:44 |
| bjolo | ? | 13:45 |
| *** mgoddard_ has joined #openstack-kolla | 13:45 | |
| inc0 | nvm, I was seeing another Polish name in reviews and I was wondering if that's you | 13:45 |
| bjolo | im swedish! | 13:45 |
| bjolo | :) | 13:45 |
| bjolo | bjorn lofdahl | 13:45 |
| inc0 | close enough | 13:45 |
| inc0 | ;) | 13:45 |
| bjolo | haha to you maybe | 13:45 |
| inc0 | well, I'm Polish born and bred so I know significance of Baltic sea between our countries | 13:46 |
| inc0 | ;) | 13:46 |
| bjolo | ah ok | 13:46 |
| inc0 | but I used to live in Gdansk and there is ferry twice a day to Sweden | 13:46 |
| bjolo | poland is very nice | 13:47 |
| inc0 | so it felt close;) | 13:47 |
| bjolo | yes | 13:47 |
| bjolo | there is a ferry from karlskrona to gdynia i have take a few times | 13:48 |
| bjolo | sopol area is GREAT | 13:48 |
| *** mgoddard has quit IRC | 13:48 | |
| inc0 | yeah, I really like that part of Poland | 13:48 |
| mewald | I just wrote a script for kolla-toolbox to create a grafana datasource. What is the best way to deal with the situation where grafana is not up yet? Wait infinitely in the script until it is available? Can we handle this in ansible somehow? Like retry 10 times in 20s intervals or something? | 13:48 |
| inc0 | mewald, there is wait_for clausule in ansible | 13:49 |
| *** ravig has quit IRC | 13:49 | |
| inc0 | http://docs.ansible.com/ansible/wait_for_module.html | 13:49 |
| mewald | nice will look at that! | 13:49 |
| inc0 | mewald, grafana? you're adding monitoring to kolla?:) | 13:50 |
| mewald | yup | 13:50 |
| inc0 | cool! | 13:50 |
| inc0 | any chances to have it upstream? | 13:50 |
| mewald | part 1 is for review already :) | 13:50 |
| inc0 | sensu one? | 13:50 |
| mewald | no sensu yet | 13:50 |
| mewald | telegraf + influxdb | 13:50 |
| mewald | + grafana | 13:50 |
| inc0 | ok, I've seen sensu in reviews | 13:50 |
| inc0 | hold on | 13:50 |
| inc0 | let me find it | 13:51 |
| inc0 | also brb, changing PCs | 13:51 |
| *** inc0 has quit IRC | 13:51 | |
| *** inc0 has joined #openstack-kolla | 13:54 | |
| openstackgerrit | Mathias proposed openstack/kolla: Implement Basic Performance Monitoring https://review.openstack.org/345938 | 14:00 |
| *** diogogmt has quit IRC | 14:00 | |
| *** salv-orlando has joined #openstack-kolla | 14:01 | |
| *** zhurong has quit IRC | 14:04 | |
| *** zhurong has joined #openstack-kolla | 14:05 | |
| *** wmiller has quit IRC | 14:07 | |
| *** zhurong has quit IRC | 14:07 | |
| *** wmiller has joined #openstack-kolla | 14:07 | |
| bjolo | question about pluggability and customization. From what i understand, that is the "big focus" for kolla 3. is there any docs, BP, design principles i can read up on? | 14:12 |
| mewald | push | 14:12 |
| bjolo | ? | 14:13 |
| rhallisey | bjolo, https://etherpad.openstack.org/p/kolla-newton-midcycle | 14:17 |
| *** mgoddard has joined #openstack-kolla | 14:17 | |
| *** mgoddard_ has quit IRC | 14:18 | |
| *** dmueller-evoila has quit IRC | 14:21 | |
| bjolo | rhallisey, tnx exactly what i was looking for | 14:22 |
| inc0 | bjolo, I don't think we have it gathered in any single place | 14:24 |
| inc0 | but I would be person to ask, so just ask;) | 14:25 |
| bjolo | rhallisey sent me a link to etherpad from latest midcycle | 14:25 |
| bjolo | should get me started | 14:25 |
| inc0 | yeah, but that | 14:25 |
| *** diogogmt has joined #openstack-kolla | 14:26 | |
| openstackgerrit | Mathias proposed openstack/kolla: Implement Basic Performance Monitoring https://review.openstack.org/345938 | 14:27 |
| openstackgerrit | Mathias proposed openstack/kolla: Implement Basic Performance Monitoring https://review.openstack.org/345938 | 14:29 |
| *** ravig has joined #openstack-kolla | 14:29 | |
| mewald | Can I have some feedback on https://review.openstack.org/#/c/344705/ please? :) | 14:30 |
| patchbot | mewald: patch 344705 - kolla - External Ceph - Implementation Nova | 14:30 |
| *** ravig has quit IRC | 14:31 | |
| *** ravig has joined #openstack-kolla | 14:31 | |
| *** haplo37_ has joined #openstack-kolla | 14:33 | |
| bjolo | i give up on this swift issue | 14:35 |
| *** michauds has joined #openstack-kolla | 14:43 | |
| *** b_bezak_ has quit IRC | 14:46 | |
| *** jruano has joined #openstack-kolla | 14:53 | |
| *** neouf has quit IRC | 14:53 | |
| bjolo | ok folks | 14:54 |
| bjolo | im outtee | 14:54 |
| bjolo | yihah | 14:54 |
| bjolo | vacation | 14:54 |
| mewald | c ya ! | 14:55 |
| bjolo | might drop in once in a while, but i tend to unplugg completely when im off | 14:55 |
| bjolo | and you know read a book, talk to humans, etc etc :) | 14:55 |
| bjolo | have a great one | 14:56 |
| bjolo | ciao for now | 14:56 |
| bjolo | ~ | 14:56 |
| *** bjolo is now known as bjolo-has-left-t | 14:56 | |
| mewald | dont like that, I stay here :D | 14:56 |
| bjolo-has-left-t | haha | 14:57 |
| *** mliima has quit IRC | 14:57 | |
| *** inc0 has quit IRC | 14:59 | |
| *** inc0 has joined #openstack-kolla | 14:59 | |
| *** bjolo-has-left-t has quit IRC | 15:02 | |
| *** zeus has joined #openstack-kolla | 15:11 | |
| *** zeus is now known as Guest58260 | 15:11 | |
| *** mewald has quit IRC | 15:12 | |
| *** jogam has quit IRC | 15:12 | |
| *** Guest58260 is now known as zeus` | 15:13 | |
| *** zeus` is now known as zeus | 15:14 | |
| *** zeus has quit IRC | 15:14 | |
| *** zeus has joined #openstack-kolla | 15:14 | |
| *** mliima has joined #openstack-kolla | 15:17 | |
| *** daneyon has joined #openstack-kolla | 15:25 | |
| *** vhosakot has joined #openstack-kolla | 15:35 | |
| *** mgoddard has quit IRC | 15:37 | |
| *** inc0 has quit IRC | 15:38 | |
| *** inc0 has joined #openstack-kolla | 15:38 | |
| *** ravig has quit IRC | 15:39 | |
| *** godleon has quit IRC | 15:39 | |
| *** flaper87 has quit IRC | 15:39 | |
| *** brad[] has quit IRC | 15:39 | |
| *** wznoinsk_ has quit IRC | 15:39 | |
| *** PyroMani has quit IRC | 15:39 | |
| *** dasm has quit IRC | 15:39 | |
| *** mark-casey has joined #openstack-kolla | 15:39 | |
| *** david-lyle has joined #openstack-kolla | 15:46 | |
| *** flaper87 has joined #openstack-kolla | 15:47 | |
| *** wznoinsk has joined #openstack-kolla | 15:47 | |
| *** brad[] has joined #openstack-kolla | 15:47 | |
| *** dasm has joined #openstack-kolla | 15:47 | |
| *** ravig has joined #openstack-kolla | 15:47 | |
| *** flaper87 is now known as Guest32906 | 15:47 | |
| *** PyroMani has joined #openstack-kolla | 15:48 | |
| *** mgoddard has joined #openstack-kolla | 15:49 | |
| *** godleon has joined #openstack-kolla | 15:52 | |
| *** unicell1 has quit IRC | 16:07 | |
| *** wirehead_ has quit IRC | 16:11 | |
| *** wirehead_ has joined #openstack-kolla | 16:13 | |
| *** JianqingJiang has joined #openstack-kolla | 16:16 | |
| *** david-lyle_ has joined #openstack-kolla | 16:17 | |
| v1k0d3n | Mech422: yeah...been having so many issues with kolla and i've tried a few different package builds :( | 16:21 |
| v1k0d3n | kind of frustrated...i can't seem to get things working. docs are all updated too? does working off of master work correctly at this time? | 16:22 |
| v1k0d3n | or do i need to work off stable/mitaka? | 16:23 |
| *** david-lyle_ has quit IRC | 16:23 | |
| v1k0d3n | i pulled back even to a single AIO node, followed the exact same instructions that i used before...and building my images still don't work. i noticed that kolla isn't really pinning the base container, but it's pulling ubuntu:latest....is that right? could that be causing some issues? | 16:24 |
| v1k0d3n | i even got the build to deploy all the way, but horizon never came up because it couldn't find "developer" something-or-other...i'm getting really confused because of multiple issues at this point. | 16:24 |
| v1k0d3n | just want known stable deployment, multi-node for a demo that i have coming up on aug 3rd. starting to run out of time. | 16:25 |
| *** daneyon_ has joined #openstack-kolla | 16:27 | |
| v1k0d3n | brb...i need to leave chan for a few minutes to sign in on a different dev box. | 16:28 |
| *** v1k0d3n has quit IRC | 16:30 | |
| *** daneyon_ has quit IRC | 16:32 | |
| *** v1k0d3n has joined #openstack-kolla | 16:35 | |
| *** severion has joined #openstack-kolla | 16:35 | |
| *** ayoung has joined #openstack-kolla | 16:36 | |
| *** godleon has quit IRC | 16:39 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Fixing labels for glance's service and pod resources https://review.openstack.org/346123 | 16:42 |
| *** ravig has quit IRC | 16:43 | |
| *** ravig has joined #openstack-kolla | 16:44 | |
| *** ravig has quit IRC | 16:46 | |
| *** ravig has joined #openstack-kolla | 16:46 | |
| *** jruano has quit IRC | 16:48 | |
| *** ravig has quit IRC | 16:50 | |
| *** mewald has joined #openstack-kolla | 16:51 | |
| *** gfidente has quit IRC | 16:55 | |
| *** jruano has joined #openstack-kolla | 16:59 | |
| *** jruano has quit IRC | 16:59 | |
| *** inc0 has quit IRC | 17:09 | |
| *** inc0 has joined #openstack-kolla | 17:10 | |
| *** salv-orlando has quit IRC | 17:23 | |
| *** sdake has joined #openstack-kolla | 17:26 | |
| *** inc0_ has joined #openstack-kolla | 17:36 | |
| *** inc0__ has joined #openstack-kolla | 17:38 | |
| *** inc0 has quit IRC | 17:40 | |
| *** ravig has joined #openstack-kolla | 17:40 | |
| *** harlowja_at_home has joined #openstack-kolla | 17:41 | |
| *** inc0_ has quit IRC | 17:42 | |
| openstackgerrit | Merged openstack/kolla-kubernetes: Fixing labels for glance's service and pod resources https://review.openstack.org/346123 | 17:48 |
| *** JianqingJiang has quit IRC | 17:54 | |
| *** Jeffrey4l_ has quit IRC | 17:57 | |
| *** haplo37_ has quit IRC | 18:00 | |
| Mech422 | v1k0d3n: ubuntu source builds are broken atm | 18:12 |
| Mech422 | v1k0d3n: I have a patch you can apply to fix it, and I'll submit it upstream | 18:12 |
| Mech422 | v1k0d3n: the patch is: http://paste.openstack.org/show/539735/ | 18:12 |
| *** daneyon_ has joined #openstack-kolla | 18:15 | |
| sdake | hey folks | 18:16 |
| sdake | nice work mech! | 18:17 |
| sdake | Mech422 if you have trouble submitting that patch or need a walkthroug the workflow, i am here to help :) | 18:18 |
| sdake | Mech422 or would you like me to submit it? | 18:18 |
| *** daneyon_ has quit IRC | 18:20 | |
| *** david-lyle_ has joined #openstack-kolla | 18:21 | |
| Mech422 | sdake: eh - I need to learn this gerrit stuff | 18:23 |
| Mech422 | sdake: I have another trivialfix for the ceph partition stuff | 18:24 |
| *** mgoddard has quit IRC | 18:25 | |
| Mech422 | sdake: http://paste.openstack.org/show/539832/ | 18:25 |
| v1k0d3n | ah! i was wondering. | 18:25 |
| *** david-lyle_ has quit IRC | 18:25 | |
| *** bootsha has joined #openstack-kolla | 18:26 | |
| v1k0d3n | really just need to know what is actually working and not, as in versions and which to build. | 18:26 |
| v1k0d3n | want to get to a place where i can get it up, then peel back and get more involved. i've been tied up on so many other things for a few months. sdake knows this. | 18:26 |
| v1k0d3n | hence my long absence. | 18:26 |
| Mech422 | vikI build ubuntu master from source with ansible 2.1.0.0 multi-node with ceph enabled using fresh installs of Ubuntu 14.04 for all hosts | 18:27 |
| v1k0d3n | but, my role is changing soon...soon will be 100% community focused with a dev team to help out. | 18:27 |
| Mech422 | v1k0d3n: : I built ubuntu master from source with ansible 2.1.0.0 multi-node with ceph enabled using fresh installs of Ubuntu 14.04 for all hosts last night with these patches | 18:28 |
| v1k0d3n | does the kernel still need to be upgraded to wily? | 18:29 |
| Mech422 | v1k0d3n: I don't think it _needs_ to, but I upgrade | 18:30 |
| sdake | Mech422 the reason I asked about your os is because I typically use a tool called webex to train people | 18:30 |
| sdake | Mech422 it o nly runs on windows and macosx | 18:30 |
| Mech422 | sdake: oh - I can skype... | 18:30 |
| sdake | so if you can get to your linux machines frmo your windows machine, then we are all set | 18:30 |
| sdake | i need screen sharing | 18:31 |
| Mech422 | yeah - thats not a problem | 18:31 |
| sdake | so i can see what yor typing | 18:31 |
| v1k0d3n | Mech422: sdake was awesome at helping me...awesome dude, and super helpful! | 18:31 |
| Mech422 | sdake: I already installed the gerrit git plugin | 18:31 |
| sdake | are you opposed to webex or have some it policy against it? | 18:31 |
| sdake | thanks v1k0d3n :) | 18:31 |
| v1k0d3n | you guys want to try AT&T connect? i can let you guys use my bridge if you don't mind me tagging along.... | 18:31 |
| sdake | v1k0d3n now to finish the job on yoru patch :( | 18:31 |
| sdake | v1k0d3n you can tag along anyway but i like webex :) | 18:32 |
| v1k0d3n | sdake: still out there? | 18:32 |
| sdake | but not doing it now, have to run to the post office | 18:32 |
| sdake | Mech422 i'll be back in 30 minutes | 18:32 |
| Mech422 | sdake: nah - not against it...I just mean I have that available | 18:32 |
| Mech422 | oh - anyone can review code ? I thought only core devs could +1 | 18:34 |
| v1k0d3n | Mech422: anyone can review | 18:37 |
| v1k0d3n | and +1 i think, but only devs can accept/merge. | 18:37 |
| *** athomas has quit IRC | 18:38 | |
| v1k0d3n | so Mech422 i have a cluster now...fresh install...i would like multi-node, can you help me get through this? | 18:38 |
| Mech422 | v1k0d3n: possibly ? | 18:39 |
| Mech422 | v1k0d3n: I've only done ubuntu source builds - haven't touched RH boxes in 10 years | 18:39 |
| v1k0d3n | i'm doing all ubuntu | 18:40 |
| v1k0d3n | so that works perfectly from a baseline perspective. :) | 18:40 |
| Mech422 | v1k0d3n: lets give it a shot then :-) | 18:40 |
| v1k0d3n | did the current docs work 100% for you other than the patch? | 18:40 |
| Mech422 | v1k0d3n: I haven't looked at the install docs in like 3 months... | 18:42 |
| Mech422 | v1k0d3n: I have a set of ansible playbooks that 'drive' kolla for me | 18:42 |
| *** unicell has joined #openstack-kolla | 18:42 | |
| Mech422 | v1k0d3n: hmm - actually, I could probaby just upload the playbooks somewhere for you... | 18:43 |
| Mech422 | v1k0d3n: then you could see exactly how I build | 18:43 |
| v1k0d3n | Mech422 !! that's awesome...that's exactly what i was trying to do myself...!! | 18:43 |
| Mech422 | v1k0d3n: is there an imgur like sharing service for raw files? be a nuisance to paste them all into pastes | 18:44 |
| v1k0d3n | i have a private repo setup at the moment because i have some public key stuff in there...(not that big a deal), but it's not 100% complete. if you have something, i would definitely contribute to that effort...big tim. | 18:44 |
| v1k0d3n | just git them up to github? | 18:44 |
| Mech422 | v1k0d3n: oh - I could probably just tar them and dcc them to you | 18:45 |
| Mech422 | v1k0d3n: nah - I have keys and such I need to clean up before I can make them public | 18:45 |
| v1k0d3n | haha, pub or private? | 18:45 |
| v1k0d3n | here...let's do this... | 18:47 |
| *** sdake has quit IRC | 18:47 | |
| v1k0d3n | i can create a github repo, add you as a member...then you can copy the repo and only add the files you want with git add commands. that work Mech422? | 18:48 |
| v1k0d3n | what is your github id? | 18:48 |
| v1k0d3n | i will make it a private repo | 18:48 |
| Mech422 | v1k0d3n: I can upload a tar file for ya - I just tared it all | 18:48 |
| v1k0d3n | oh that works too. | 18:48 |
| Mech422 | v1k0d3n: DCC send request sent | 18:49 |
| Mech422 | 18.1 KB file | 18:49 |
| *** salv-orlando has joined #openstack-kolla | 18:49 | |
| *** salv-orl_ has joined #openstack-kolla | 18:50 | |
| *** salv-orlando has quit IRC | 18:51 | |
| *** ravig has quit IRC | 18:52 | |
| *** salv-orlando has joined #openstack-kolla | 18:54 | |
| *** salv-orl_ has quit IRC | 18:55 | |
| *** Mech422 has quit IRC | 18:55 | |
| *** ravig has joined #openstack-kolla | 18:55 | |
| *** Mech422 has joined #openstack-kolla | 18:55 | |
| Mech422 | blah | 18:56 |
| Mech422 | v1k0d3n: holler if you have any questions with that stuff | 18:56 |
| *** bootsha has quit IRC | 18:56 | |
| Mech422 | v1k0d3n: the playbook order is: prereqs, checkout, build, configure, deploy | 18:56 |
| *** mdnadeem_ has joined #openstack-kolla | 18:56 | |
| *** ravig has quit IRC | 18:57 | |
| v1k0d3n | ok, awesome. thanks Mech422 let me start playing around with this. are mech22 on github as well? | 18:58 |
| *** ravig has joined #openstack-kolla | 18:58 | |
| *** mdnadeem has quit IRC | 19:00 | |
| Mech422 | yeah | 19:00 |
| Mech422 | I'm pretty much mech422 everywhere... | 19:00 |
| Mech422 | for some reason, that nick is always available :-P | 19:01 |
| Mech422 | v1k0d3n: btw, I'm in an out of the livingroom watching the cnn coverage of berlin shootings... | 19:01 |
| Mech422 | v1k0d3n: so I might be a lil slow to respond | 19:01 |
| v1k0d3n | :( yeah...crazy times. i understand man. | 19:02 |
| v1k0d3n | thanks for the help. i'll ping if i start running into issues. | 19:02 |
| openstackgerrit | Steve Hindle proposed openstack/kolla: Ensure apt-transport-https is available. https://review.openstack.org/346178 | 19:10 |
| *** diogogmt has quit IRC | 19:13 | |
| *** diogogmt has joined #openstack-kolla | 19:14 | |
| *** v1k0d3n has quit IRC | 19:20 | |
| *** mewald has quit IRC | 19:20 | |
| *** banix has joined #openstack-kolla | 19:20 | |
| *** ravig has quit IRC | 19:21 | |
| *** ravig has joined #openstack-kolla | 19:21 | |
| *** rbergeron has quit IRC | 19:22 | |
| *** rbergeron has joined #openstack-kolla | 19:22 | |
| *** huikang has joined #openstack-kolla | 19:23 | |
| *** diogogmt has quit IRC | 19:24 | |
| *** v1k0d3n has joined #openstack-kolla | 19:24 | |
| v1k0d3n | Mech422: hey man...looks like there may be a global_vars file? | 19:25 |
| v1k0d3n | cluster_action and some others... | 19:25 |
| v1k0d3n | going to dig in and see what it's looking fro. | 19:25 |
| v1k0d3n | for | 19:25 |
| *** dave-mccowan has quit IRC | 19:25 | |
| Mech422 | v1k0d3n: hmm - don't recall global_vars - just globals.yml | 19:26 |
| v1k0d3n | ah, yeah...do you have what's being used in globals? | 19:26 |
| Mech422 | v1k0d3n: oh - I should prolly paste my group_vars/kolla | 19:26 |
| *** diogogmt has joined #openstack-kolla | 19:27 | |
| Mech422 | v1k0d3n: here's group_vars/kolla.yml: http://paste.openstack.org/show/539837/ | 19:28 |
| *** salv-orlando has quit IRC | 19:28 | |
| *** tyrola has quit IRC | 19:31 | |
| *** ravig has quit IRC | 19:31 | |
| *** ravig has joined #openstack-kolla | 19:32 | |
| v1k0d3n | hmmm Mech422 can't find cluster_action definition | 19:32 |
| openstackgerrit | Steve Hindle proposed openstack/kolla: Use $PATH to find sgdisk. Update udev after partition changes. https://review.openstack.org/346214 | 19:33 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Glance bootstrap to create service/project/role https://review.openstack.org/346215 | 19:33 |
| Mech422 | v1k0d3n: that gets passed in from the driver script | 19:33 |
| Mech422 | v1k0d3n: its just 'prereqs', 'checkout', 'build', etc | 19:33 |
| Mech422 | v1k0d3n: the cluster actions match the names of the yaml files in .../tasks | 19:34 |
| Mech422 | v1k0d3n: you'll probably want to create your own playbooks, so I'd just look at what gets done in each playbook | 19:34 |
| Mech422 | v1k0d3n: also, I run these from a seperate host, that builds the kolla depoloyment host... | 19:35 |
| v1k0d3n | yeah i do that as well... | 19:35 |
| *** ravig has quit IRC | 19:35 | |
| Mech422 | v1k0d3n: ahh...ok | 19:36 |
| v1k0d3n | just a bit different. | 19:36 |
| Mech422 | v1k0d3n: LOL - I can imagine :-) | 19:36 |
| v1k0d3n | it's an undefined variable...so it's not being declared somewhere... | 19:36 |
| *** ravig has joined #openstack-kolla | 19:36 | |
| Mech422 | v1k0d3n: cluster_action is passed in via the driver script as an 'extra var' | 19:36 |
| v1k0d3n | i included ansible_os_family: debian, because i saw that's required somewhere. | 19:36 |
| v1k0d3n | i dont see a driver script... | 19:37 |
| Mech422 | v1k0d3n: ansible sets that auto-magicaly | 19:37 |
| Mech422 | v1k0d3n: I didn't send the driver - just the role | 19:37 |
| *** banix has quit IRC | 19:37 | |
| v1k0d3n | oh! | 19:37 |
| v1k0d3n | ok...was thinking i could run against the role | 19:37 |
| Mech422 | nah - even with the driver, it'll probably blow up on you... | 19:37 |
| Mech422 | I just sent it so you could see what steps I perform to build multi-node | 19:38 |
| Daviey | Hey, cany chance i can get https://review.openstack.org/#/c/337556/ merged... i really don't want to rebase it for a 4th time. Ta :) | 19:38 |
| patchbot | Daviey: patch 337556 - kolla - Add Watcher ansible roles and templates | 19:38 |
| Mech422 | v1k0d3n: if you really want it, here's the driver: http://paste.openstack.org/show/539839/ | 19:39 |
| Mech422 | v1k0d3n: and heres the (REALLY crufty) inventory file: http://paste.openstack.org/show/539841/ | 19:41 |
| Mech422 | v1k0d3n: the inventory stuff for zookeeper and cassandra aren't needed...prolly other cruft in there too | 19:41 |
| *** mliima has quit IRC | 19:44 | |
| *** vhosakot has quit IRC | 19:53 | |
| *** sdake has joined #openstack-kolla | 19:53 | |
| sdake | hello folks back | 20:01 |
| sdake | Mech422 if you want to run through the workflow now would be a good time | 20:01 |
| sdake | Mech422 your set of ansible playboooks that drive kolla for you - would you mind expanding on what they do? | 20:02 |
| Mech422 | sdake: Nothing big/good :-P | 20:02 |
| sdake | still curious pls ;) | 20:03 |
| sdake | unless its secret sauce | 20:03 |
| Mech422 | sdake: its embarassingly crap | 20:03 |
| sdake | ok well yo udont have to show just tell what it doe ss :) | 20:04 |
| Mech422 | sdake: but I can email you the tarball of the role if ya like | 20:04 |
| *** daneyon_ has joined #openstack-kolla | 20:04 | |
| sdake | if you could djust explain it real quick | 20:04 |
| sdake | curious if its something we need in kolla proper | 20:04 |
| sdake | (new ideas = good :) | 20:04 |
| Mech422 | sdake: oh - the 'kolla' part just 'drives' kolla checkout, build, configure, and deploy | 20:04 |
| *** huikang has quit IRC | 20:04 | |
| sdake | i see - we expect that to be handled by a ci/cd pipeline | 20:05 |
| Mech422 | it installs the prereqs, applies patches, generates the multi-node inventory file, etc | 20:05 |
| sdake | sounds pretty cool ;) | 20:05 |
| sdake | which patches do you apply | 20:05 |
| *** huikang has joined #openstack-kolla | 20:05 | |
| sdake | something specific for your environment? | 20:05 |
| sdake | i think generation of inventory files will have to wait until sean gets further down teh road with bifrost | 20:06 |
| Mech422 | sdake: yeah - very site specific | 20:06 |
| Mech422 | sdake: its really just a way for me to keep track of all the steps in running kolla and make sure I don't forget anything | 20:06 |
| sdake | roger that | 20:07 |
| Mech422 | sdake: I noticed last night though, I have to use 'kolla/.tox/bin/kolla-build' rather then the path listed in the docs | 20:07 |
| sdake | docs going throug hchanges - not even sure what they say atm | 20:07 |
| sdake | should be tools/build.py | 20:07 |
| sdake | or /usr/local/bin/kolla-build | 20:08 |
| sdake | or /usr/bin/kolla-build | 20:08 |
| Mech422 | sdake: yeah - I have to use one from the .tox dir for some reason | 20:08 |
| *** daneyon_ has quit IRC | 20:08 | |
| *** huikang has quit IRC | 20:09 | |
| *** huikang has joined #openstack-kolla | 20:09 | |
| *** salv-orlando has joined #openstack-kolla | 20:09 | |
| sdake | Mech422 no idea dude | 20:10 |
| sdake | its not supposed to work like that | 20:10 |
| sdake | if you cd kolla | 20:10 |
| sdake | pip install . | 20:10 |
| sdake | it should install in system directories | 20:10 |
| Mech422 | sdake: I'll have to review my playbooks - maybe I missed a step | 20:12 |
| sdake | rhallisey coolsvap or inc0__ can one ofy ou look at https://review.openstack.org/#/c/346178/1 | 20:15 |
| patchbot | sdake: patch 346178 - kolla - Ensure apt-transport-https is available. | 20:15 |
| sdake | ubuntu is broken apparently without it | 20:15 |
| Mech422 | yeah - thats the one that gets the build working again | 20:15 |
| rhallisey | really? | 20:15 |
| rhallisey | nice | 20:16 |
| Mech422 | rhallisey: its only a 1 liner :-P | 20:17 |
| *** mewald has joined #openstack-kolla | 20:21 | |
| sdake | oh no shit mech? | 20:22 |
| sdake | nice job dude!! | 20:22 |
| Mech422 | sdake: thanks | 20:22 |
| *** david-lyle_ has joined #openstack-kolla | 20:22 | |
| sdake | rhallisey well lets wait for gate then | 20:23 |
| Mech422 | sdake: the 'hard' part was waiting for container rebuilds :-P | 20:23 |
| sdake | so we can declare victory :) | 20:23 |
| sdake | ya we need someone to make a mirroring tool that ubilds faster | 20:23 |
| sdake | for folks without fast internet an ddisks | 20:23 |
| sdake | i mean the mirroring tools exist | 20:23 |
| sdake | what we need is a ansible playbook to run them properly | 20:24 |
| Mech422 | btw - did you see mewald dropped a monitoring patch last night... | 20:24 |
| *** ccesario has quit IRC | 20:24 | |
| Mech422 | so we get live system metrics in grafana :-) | 20:24 |
| sdake | no - watched RNC last night | 20:24 |
| sdake | cool I dont know what grafana is | 20:24 |
| Mech422 | also... | 20:24 |
| Mech422 | <Daviey> Hey, cany chance i can get https://review.openstack.org/#/c/337556/ merged... i really don't want to rebase it for a 4th time. Ta :) | 20:24 |
| patchbot | Mech422: patch 337556 - kolla - Add Watcher ansible roles and templates | 20:24 |
| sdake | so could folkks tell me how grafana and collectd relate, if at all? | 20:26 |
| *** david-lyle_ has quit IRC | 20:28 | |
| Mech422 | grafan is the 'dashboard'/graphing component AFAIK | 20:28 |
| Mech422 | lots of pretty charts, and real-time display of metrics such as cpu usage | 20:28 |
| Mech422 | I guess grafana is to metrics as kibana is to logs ? | 20:29 |
| sdake | right - what produces the metrics for grafana? | 20:29 |
| sdake | what is watcher | 20:30 |
| Mech422 | dunno watcher | 20:31 |
| Mech422 | grafana can get metrics from various TSDBs that are fed via collectd, diamond, telegraf, etc. | 20:31 |
| *** huikang has quit IRC | 20:32 | |
| *** huikang has joined #openstack-kolla | 20:33 | |
| *** huikang has quit IRC | 20:37 | |
| sdake | collectd is the one i've heard of | 20:39 |
| sdake | not that means anything | 20:39 |
| sdake | but it seems pretty popular | 20:39 |
| sdake | how did mewald handle metric collection? | 20:39 |
| *** dave-mccowan has joined #openstack-kolla | 20:41 | |
| *** huikang has joined #openstack-kolla | 20:41 | |
| rhallisey | sdake, watches is an additional metric on top of ceilometer | 20:41 |
| rhallisey | I believe | 20:41 |
| sdake | cool so big tent? | 20:42 |
| rhallisey | think so | 20:42 |
| rhallisey | the patch looks good | 20:42 |
| sdake | let me check gov repo | 20:42 |
| sdake | we dont have an anti-bigtent requirement actually | 20:43 |
| sdake | ya i guess we can take non-big tent projects on a case by case basis | 20:43 |
| rhallisey | well this one is all set | 20:45 |
| rhallisey | so why not | 20:45 |
| sdake | sure | 20:47 |
| *** huikang has quit IRC | 20:50 | |
| openstackgerrit | Merged openstack/kolla: Ensure apt-transport-https is available. https://review.openstack.org/346178 | 20:52 |
| sdake | rhallisey i htink this is good for merge | 20:52 |
| sdake | https://review.openstack.org/#/c/329651/4 | 20:52 |
| patchbot | sdake: patch 329651 - kolla - Customizations for heat | 20:52 |
| *** britthouser has quit IRC | 20:57 | |
| rahuls | sdake: I have few queries | 21:03 |
| sdake | rahuls shooot | 21:03 |
| rahuls | current builds of stable/mitaka gets a tag of 2.0.3 | 21:03 |
| sdake | yes we need to fix that in stable/mitaka | 21:04 |
| rahuls | I opened this bug: https://review.openstack.org/#/c/345166/ | 21:04 |
| patchbot | rahuls: patch 345166 - kolla (stable/mitaka) - updates default registry tag to latest version | 21:04 |
| rahuls | but this seems to be wrong way | 21:04 |
| rahuls | Jeffrey pointed out that there needs to be something else | 21:04 |
| sdake | reading review | 21:04 |
| sdake | moment | 21:04 |
| Mech422 | sdake: oh! are we going to update the ceph version for newton? I notice we're still on hammer... | 21:06 |
| rahuls | when I check the python code, pbr points to version 2.0.3 | 21:06 |
| *** Serlex has quit IRC | 21:06 | |
| rahuls | >>> import pbr.version | 21:06 |
| rahuls | >>> print pbr.version.VersionInfo('kolla') | 21:06 |
| rahuls | 2.0.3 | 21:06 |
| rahuls | >>> | 21:06 |
| sdake | rahuls moment sidetracked - reading review :) | 21:06 |
| openstackgerrit | Dave Walker proposed openstack/kolla: Add initial Sensu Docker support https://review.openstack.org/341861 | 21:07 |
| *** kbyrne has quit IRC | 21:07 | |
| mewald | What's wrong with my while loop? Have this complaint: http://logs.openstack.org/38/345938/8/check/gate-kolla-pep8/3db7e68/console.html | 21:08 |
| *** ntpttr___ is now known as ntpttr | 21:08 | |
| mewald | [E] E010: The "do" should be on same line as while: 'while true; do sleep 1000; done' | 21:08 |
| mewald | well, the "do" _is_ on the same line ... | 21:09 |
| *** kbyrne has joined #openstack-kolla | 21:11 | |
| sdake | rhallisey i consider this an emergency fix | 21:12 |
| sdake | can you ack even though ejffrey is in disagreement | 21:12 |
| sdake | https://review.openstack.org/#/c/345166 | 21:12 |
| patchbot | sdake: patch 345166 - kolla (stable/mitaka) - updates default registry tag to latest version | 21:12 |
| rahuls | sdake: git tag contains only uptil 2.0.2 and then we have 3.0.0 and others | 21:13 |
| rahuls | I found one other way | 21:13 |
| *** ravig has quit IRC | 21:13 | |
| sdake | rahuls I am intimately familiar with how the versioning works :) | 21:13 |
| sdake | and tagging | 21:13 |
| sdake | and pbr | 21:13 |
| rahuls | yeah... same here | 21:13 |
| sdake | just not sure how to solve the problem to jeffrey's liking as in today | 21:13 |
| rahuls | I added a new tag 2.0.2.0rc1 | 21:13 |
| rahuls | and then did pip install --upgrade kolla/ | 21:14 |
| rahuls | and now it has proper 2.0.2 tag | 21:14 |
| sdake | yes but we want it to work from our pushed registry images | 21:14 |
| rahuls | :X | 21:14 |
| rahuls | after the new 2.0.2.0rc1 git tag | 21:14 |
| rahuls | >>> import pbr.version | 21:14 |
| rahuls | >>> print pbr.version.VersionInfo('kolla') | 21:14 |
| sdake | 2.0.2 is not the proper tag if you do a git checkout | 21:14 |
| rahuls | 2.0.2 | 21:14 |
| *** daneyon has quit IRC | 21:14 | |
| sdake | yup i get it | 21:14 |
| sdake | its 2.0.2 + some delta | 21:14 |
| rahuls | yeah | 21:14 |
| sdake | so 2.0.2 is not correct | 21:14 |
| sdake | 2.0.2 should only be used in the tarball/pip uploaded to pypi | 21:15 |
| rahuls | either we can add a new tag, or change the documentation to 2.0.3 | 21:15 |
| sdake | i can't add tags | 21:15 |
| rahuls | ohk, I had no idea, so I wanted to first check with you | 21:15 |
| sdake | that permissio nwas removed from all ptls about 3 mo ago | 21:15 |
| *** michauds has quit IRC | 21:15 | |
| sdake | which is good, tagging makes me nervous :) | 21:15 |
| rahuls | :) | 21:16 |
| *** bootsha has joined #openstack-kolla | 21:16 | |
| Mech422 | sdake: oh - now we got all these new dockerfiles coming in - were there any changes needed for inc0's customization stuff | 21:17 |
| Mech422 | ? | 21:17 |
| sdake | we will sort out the new dockerfiles later | 21:17 |
| sdake | we have a list | 21:17 |
| *** jtriley has quit IRC | 21:18 | |
| *** ravig has joined #openstack-kolla | 21:18 | |
| Daviey | sdake: I hoped that branch using pbr was going to respect the devX suffix for kolla build / deploy if using latest | 21:20 |
| Daviey | pbr does expose this.. I started working on a change that did somethin similar, before i noticed someone else did | 21:23 |
| Daviey | I was getting too much version clash when constantly building off Master, and not getting consistent deployments | 21:24 |
| *** bootsha has quit IRC | 21:24 | |
| *** dave-mccowan has quit IRC | 21:26 | |
| Mech422 | sdake: ping? | 21:29 |
| sdake | Mech422 shoot | 21:30 |
| Mech422 | just wanted to get you that code | 21:31 |
| sdake | thanks | 21:33 |
| sdake | Daviey the problem with using dev001 or whtaever is that each git change requires a change to the globals.yml | 21:37 |
| sdake | for developers thats fine | 21:37 |
| sdake | for non-develoeprs sounds like a couple trainwrecks head on | 21:37 |
| sdake | we really want non-developers to either install from pip or distro packaging | 21:38 |
| *** ayoung has quit IRC | 21:39 | |
| *** zhurong has joined #openstack-kolla | 21:41 | |
| *** zhurong has quit IRC | 21:44 | |
| *** mark-casey has quit IRC | 21:47 | |
| *** ravig has quit IRC | 21:49 | |
| *** shardy has quit IRC | 21:50 | |
| *** ravig has joined #openstack-kolla | 21:51 | |
| *** daneyon has joined #openstack-kolla | 21:52 | |
| Daviey | sdake: No.. What i was thinking is that globals.yml uses openstack_release='latest'.. and then on each run, that var is checked. If latest, then pbr version is used.. If a hard coded version, then that is used | 21:52 |
| *** mbound has quit IRC | 21:53 | |
| Daviey | sdake: I would imagine many local deployments would choose to hard-code to their own version, to have better control of image build and release.. but people that don't want that level of care, can leave it as default latest. | 21:54 |
| Daviey | (and it doesn't need to be updated on each tagged release) | 21:54 |
| Daviey | + updating configs for distros is a total PITA. | 21:55 |
| sdake | Daviey sounds reasonable at first glance - strugglign to see how you capture the pbr version inside the ansible codebase | 21:56 |
| sdake | Daviey would you mind starting a mailing list thread - clearly what we are doing now is suboptimal | 21:57 |
| *** daneyon has quit IRC | 21:57 | |
| sdake | but i'd like wider audience on the conversation if ipossible | 21:57 |
| Daviey | sdake: let me find my branch.. | 21:58 |
| Daviey | sdake: regarding the split.. I did just this for watcher.. 3 different commits... Docker, Ansible and then config .. https://blueprints.launchpad.net/kolla/+spec/watcher | 21:59 |
| Daviey | so it makes sense to me | 21:59 |
| Daviey | (but i'm not sure i agree that trival commits makes sense to split, until after the trees split) | 21:59 |
| sdake | cool so watcher | 21:59 |
| sdake | can you tell me about it | 22:00 |
| Daviey | sdake: I'm not involved with the upstream project.. but it basically uses ceilometer data to see if compute hosts are not balanced.. either due to number of vm's.. or noisy vm's co-located | 22:00 |
| Daviey | and suggests rebalancing via live migration | 22:00 |
| Daviey | Either as a daemon or on demand | 22:01 |
| sdake | is it an openstack project? | 22:01 |
| Daviey | yeah | 22:01 |
| sdake | big tent? | 22:01 |
| Daviey | https://github.com/openstack/watcher | 22:01 |
| Daviey | yeah, i checked that first. | 22:01 |
| sdake | we dont have a big tent requirement | 22:01 |
| sdake | i would like to integrate vmtp at some point | 22:01 |
| sdake | which is a pretty sweet network testing tool | 22:01 |
| sdake | as part of our sanity testing | 22:02 |
| Daviey | first time i've looked at that... looks interesting | 22:02 |
| Daviey | pretty graph aswell | 22:02 |
| Daviey | sdake: Sorry to jump on you.. but could you also have a look at https://blueprints.launchpad.net/kolla/+spec/sensu | 22:03 |
| Daviey | I'm currently blocked on getting that accepted before i push forward with it | 22:03 |
| sdake | Daviey so we decided at midcycle that monitoring was off the table for newton | 22:04 |
| sdake | that said, if you think you can handle it on your own, more power to ya :) | 22:04 |
| Daviey | Oh right.. thanks for sharing :/ | 22:04 |
| sdake | and if it merges, it merges | 22:04 |
| sdake | when we decided that | 22:04 |
| Daviey | well.. i didn't know it was off the table :) | 22:04 |
| sdake | we lacked context that someone else other the nthe cr team was going to do the work | 22:05 |
| sdake | what i mean by off the table | 22:05 |
| sdake | wrong term | 22:05 |
| sdake | we dont have capacity to deal with it in the cr team as an implementation item | 22:05 |
| sdake | review item, sure | 22:05 |
| Daviey | I pushed up a sensu docker change, but it was -2 - pending discussion... So i've pretty much shelved the work on it | 22:05 |
| sdake | implementing it - not so much | 22:05 |
| sdake | link to -2 change | 22:05 |
| Daviey | https://review.openstack.org/#/c/341861/ | 22:05 |
| patchbot | Daviey: patch 341861 - kolla - Add initial Sensu Docker support | 22:05 |
| Daviey | I've basically got it working locally.. but I probably need to spend a day cleaning it up for submission | 22:06 |
| Daviey | Only with host up / down monitoring at current tho.. but that might be enough for release, with the ability to add custom json plugins by the deployer.. Newton + 1 could probably do per-service / container checking | 22:07 |
| openstackgerrit | Ildar proposed openstack/kolla: Customizations for kibana https://review.openstack.org/346252 | 22:10 |
| *** ravig has quit IRC | 22:14 | |
| *** ravig has joined #openstack-kolla | 22:15 | |
| *** harlowja_at_home has quit IRC | 22:15 | |
| sdake | Daviey your wish is my command ;) | 22:15 |
| Daviey | sdake: I'm ok to commit to getting just host up/down monitoring done in the next 2 weeks. | 22:17 |
| sdake | well whatevery ou get done i'd be open to merging | 22:17 |
| sdake | our deadline is sept2 | 22:17 |
| Daviey | Oh, that is ages. | 22:18 |
| sdake | after that, no new features | 22:18 |
| sdake | but where we are at moment is you are blocked waiting on a discussion of a monitoring solution choice | 22:18 |
| sdake | so i kicked that off on the mailing list | 22:18 |
| sdake | folks, if your ever blocked by something please either let the mailing list know or let me know or let anothe rcore reviewer know | 22:19 |
| sdake | i have trouble keeping on top of the entire review queue | 22:19 |
| sdake | along with all the other stuff i got going on | 22:19 |
| sdake | definately dont give up ;) | 22:19 |
| Daviey | sdake: well, there isn't exactly the level of dialogue on the list that helps.. :/ | 22:20 |
| sdake | its my job to break logjams | 22:20 |
| Daviey | sdake: This thread didn't get anywhere, http://lists.openstack.org/pipermail/openstack-dev/2016-July/098707.html | 22:20 |
| sdake | ya dude sorry i was probably on pto ;) | 22:20 |
| Daviey | sdake: Not blaming you. :) | 22:21 |
| sdake | oh that discussion | 22:21 |
| *** mewald has quit IRC | 22:21 | |
| sdake | so we are going to handle that with customizations | 22:21 |
| sdake | (I think) | 22:21 |
| Daviey | sdake: but that thread is probably blocking https://review.openstack.org/#/c/336943/ , and other stuff now | 22:21 |
| patchbot | Daviey: patch 336943 - kolla - Install neutron-lbaas-dashboard from source in hor... | 22:21 |
| sdake | we want to do all plugins in customizations of kolla j2 files | 22:22 |
| Daviey | I also have a conditional horizon plugin i'd like to add | 22:22 |
| sdake | i think we can get you a condtional horizon plugin or a lbaas horizon plugin without much effort once the 40 containers customization work is finished | 22:23 |
| Daviey | sdake: So.. does that mean that not all docker images will contain the world? | 22:23 |
| Daviey | as in, conditional if they get included? | 22:23 |
| sdake | complex quesiton | 22:23 |
| sdake | could you simplif yfor me please | 22:23 |
| Daviey | I'm sorry if this was all at the midcycle.. i couldn't really follow | 22:23 |
| sdake | ya following a midcycle disucsision in person is hard :) | 22:24 |
| Daviey | sdake: Sorry, i mean... for p in $(possible horizon plugins) ; install p ; done VS for p in $(globals.yml enabled horizon plugins) ; install p ; done | 22:24 |
| *** david-lyle_ has joined #openstack-kolla | 22:25 | |
| sdake | you will be able to select which plugisn yo uwant | 22:25 |
| sdake | it doesn't key off globals.yml | 22:25 |
| Daviey | well.. but i mean, adding a plugin will need rebuilding of the images? | 22:26 |
| sdake | it keys off a customization file which tells which files to load into the container that are extra | 22:26 |
| sdake | yes rebuild required | 22:26 |
| openstackgerrit | Merged openstack/kolla: Customizations for heat https://review.openstack.org/329651 | 22:26 |
| Daviey | how does that work with versioning? | 22:26 |
| sdake | versioining is totally up to the operator | 22:26 |
| Daviey | 2.0.0 without plugin == 2.0.0 with plugin | 22:26 |
| sdake | i described how to handle this in the docs - moment | 22:27 |
| Daviey | Oh, i should have read it.. sorry | 22:27 |
| sdake | http://docs.openstack.org/developer/kolla/operating-kolla.html | 22:27 |
| sdake | its ok - it will leave you wanting | 22:27 |
| Daviey | no, i got that.. | 22:27 |
| sdake | but its the best i had at the time - hadn't considered variance like plugins | 22:27 |
| Daviey | but what i mean is.. at the moment.. we have deterministic versioning.. if i install kolla version FOO.. and build, i get known docker images, independent of how many times i change the config and rebuild | 22:28 |
| sdake | yup | 22:28 |
| sdake | and with this new method you dont | 22:28 |
| sdake | (always) | 22:28 |
| Daviey | with non-deterministic builds based on configs, i get a messy difference | 22:28 |
| Daviey | where version 3.0.0 could be anything | 22:29 |
| Daviey | and updating the config, rebuilding.. i can't be sure what is really running on the nodes | 22:29 |
| sdake | build world might be better for plugins | 22:29 |
| Daviey | Unless i use lcoal tags | 22:29 |
| openstackgerrit | Ildar proposed openstack/kolla: Customizations for kibana https://review.openstack.org/346252 | 22:29 |
| sdake | but if we do build world with plugins, i would prefer it to tie into the customizations | 22:29 |
| *** david-lyle_ has quit IRC | 22:29 | |
| *** ravig has quit IRC | 22:31 | |
| *** neophy has quit IRC | 22:32 | |
| Daviey | sdake: agree | 22:32 |
| *** ravig has joined #openstack-kolla | 22:35 | |
| openstackgerrit | qinchunhua proposed openstack/kolla: Fix dict.values() PY3 compatible https://review.openstack.org/345706 | 22:47 |
| Mech422 | sdake, Daviey: there is also mewalds monitoring stuff that was sent for review last night... it appears we now have 2 monitoring options for Kolla :-) | 22:47 |
| Mech422 | Daviey: Does sensu play nice with Grafana ? | 22:48 |
| sdake | ya grafana | 22:48 |
| sdake | well it would be an either or thing | 22:48 |
| sdake | not a both together thing i htink | 22:48 |
| Mech422 | sdake: yeah - I'd imagine you'd pick one via globals ? | 22:48 |
| sdake | i dont like picking winners | 22:49 |
| sdake | the only winner we have picked thus far is docker | 22:49 |
| sdake | and we haven't even really picked that | 22:49 |
| Mech422 | I agree - its nice to have options and let the operator pick | 22:49 |
| sdake | Mech422 wfm :) | 22:49 |
| sdake | nice to let the operators choose | 22:49 |
| Mech422 | hmm - grafana can be used by a lot of stuff (sensu maybe?) - might make sense to break that out to its own 'component' that can be used by various monitoring solutions | 22:53 |
| sdake | well here is the deal | 22:53 |
| sdake | i dont know anything at all about monitoring | 22:53 |
| *** mbound has joined #openstack-kolla | 22:53 | |
| sdake | but mewald and Daviey appear to - so lets let them sort it out :) | 22:53 |
| Mech422 | sounds good | 22:54 |
| *** mbound has quit IRC | 22:58 | |
| sdake | 10:45 pm showing of star trek ftw | 22:59 |
| *** inc0__ has quit IRC | 22:59 | |
| * sdake can't wait | 22:59 | |
| sdake | hate to admit it, but i'm more of a star trek fan then star wars fan :) | 23:00 |
| jascott1 | resisting urge to engage... | 23:03 |
| jascott1 | :) | 23:03 |
| jascott1 | heheh "engage" | 23:05 |
| sdake | Mech422 fwiw your patch did not fix ubuntu from source here https://review.openstack.org/#/c/346178/ | 23:06 |
| patchbot | sdake: patch 346178 - kolla - Ensure apt-transport-https is available. (MERGED) | 23:06 |
| sdake | it may have fixed a different problem | 23:06 |
| sdake | but not the one we have at present | 23:06 |
| sdake | or the one that is blocking the gate | 23:06 |
| Mech422 | sdake: odd - it built here this morning | 23:13 |
| sdake | it seems to build out of the gate | 23:13 |
| sdake | but not in the gate | 23:13 |
| sdake | may be a different problem like i said | 23:14 |
| Mech422 | sdake: looking at the console log, it looks like a nova issue ? | 23:15 |
| sdake | no its a rabbitmq crash i think | 23:16 |
| Mech422 | ahh | 23:16 |
| Mech422 | looks like it choked when it tried to start a vm ? | 23:22 |
| Mech422 | "fault": {"message": "No valid host was found. There are not enough hosts available.", "code": 500, "details": " File \"/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/conductor/manager.py\", line 471, in build_instances\n | 23:23 |
| *** harlowja_at_home has joined #openstack-kolla | 23:23 | |
| *** ravig has quit IRC | 23:23 | |
| *** ravig has joined #openstack-kolla | 23:24 | |
| *** ravig has quit IRC | 23:27 | |
| *** ravig has joined #openstack-kolla | 23:30 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla: Allow custom configurations for ceilometer https://review.openstack.org/346273 | 23:30 |
| *** daneyon has joined #openstack-kolla | 23:30 | |
| sdake | Mech422 yes because rabbitmq crashed | 23:37 |
| *** daneyon_ has joined #openstack-kolla | 23:41 | |
| Mech422 | sdake: hopefully, the next run will be ok :-) | 23:42 |
| Mech422 | sdake: thinking about 'pluggability' and operator options...it would be kind of cool if kolla had a suite of components designed to work together, and operators could do a 'docker compose' type thing to figure out which ones to deploy ? | 23:43 |
| Mech422 | sdake: just a thought...but it might get us out of the 'MxN' support matrix as our options for plugins grow | 23:43 |
| *** daneyon_ has quit IRC | 23:45 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Glance bootstrap to create service/project/role https://review.openstack.org/346215 | 23:46 |
| *** daneyon_ has joined #openstack-kolla | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!