*** mbound has quit IRC | 00:00 | |
*** zhiwei has quit IRC | 00:00 | |
*** prithiv1 has quit IRC | 00:02 | |
openstackgerrit | Ken Wronkiewicz proposed openstack/kolla-kubernetes: Add documentation for setting up a local SkyDNS + Kube2Sky https://review.openstack.org/329717 | 00:09 |
---|---|---|
*** ravig has quit IRC | 00:14 | |
*** sdake has quit IRC | 00:18 | |
openstackgerrit | Merged openstack/kolla-kubernetes: Add documentation for setting up a local SkyDNS + Kube2Sky https://review.openstack.org/329717 | 00:18 |
*** sacharya_ has quit IRC | 00:23 | |
*** david-lyle has quit IRC | 00:32 | |
*** ravig has joined #openstack-kolla | 00:38 | |
*** d_code has quit IRC | 00:41 | |
*** jtriley has joined #openstack-kolla | 00:44 | |
*** diogogmt has quit IRC | 00:48 | |
*** d_code has joined #openstack-kolla | 00:54 | |
*** mbound has joined #openstack-kolla | 01:01 | |
*** mbound has quit IRC | 01:06 | |
*** zhiwei has joined #openstack-kolla | 01:15 | |
*** MarMat has quit IRC | 01:20 | |
*** sdake has joined #openstack-kolla | 01:28 | |
*** sdake has quit IRC | 01:32 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Remove the pull action in the deploy_aio CI https://review.openstack.org/329735 | 01:50 |
*** d_code has quit IRC | 01:51 | |
*** d_code has joined #openstack-kolla | 01:51 | |
*** diogogmt has joined #openstack-kolla | 01:52 | |
*** sacharya has joined #openstack-kolla | 01:55 | |
*** jrist has quit IRC | 01:56 | |
*** sacharya_ has joined #openstack-kolla | 01:57 | |
*** sacharya has quit IRC | 02:00 | |
*** jrist has joined #openstack-kolla | 02:03 | |
*** coolsvap has joined #openstack-kolla | 02:18 | |
openstackgerrit | Merged openstack/kolla: Makes ml2_conf.ini configuration consistent https://review.openstack.org/329506 | 02:36 |
*** huikang has quit IRC | 02:40 | |
openstackgerrit | Merged openstack/kolla: Load the metadata definitions during Glance bootstrap https://review.openstack.org/322415 | 02:48 |
*** yuanying has quit IRC | 02:50 | |
*** yuanying has joined #openstack-kolla | 02:53 | |
*** ravig has quit IRC | 03:10 | |
*** ravig has joined #openstack-kolla | 03:16 | |
*** fragatina has quit IRC | 03:22 | |
*** tfukushima has joined #openstack-kolla | 03:27 | |
*** yuanying_ has joined #openstack-kolla | 03:48 | |
*** yuanying has quit IRC | 03:49 | |
*** david-lyle has joined #openstack-kolla | 04:06 | |
*** ravig has quit IRC | 04:25 | |
*** ravig has joined #openstack-kolla | 04:28 | |
*** sacharya_ has quit IRC | 04:33 | |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Makes ml2_conf.ini configuration consistent https://review.openstack.org/329758 | 04:43 |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Makes ml2_conf.ini configuration consistent https://review.openstack.org/329760 | 04:44 |
*** fragatina has joined #openstack-kolla | 04:52 | |
*** fragatina has quit IRC | 04:53 | |
*** fragatina has joined #openstack-kolla | 04:53 | |
*** salv-orl_ has quit IRC | 04:54 | |
*** salv-orlando has joined #openstack-kolla | 04:54 | |
*** salv-orlando has quit IRC | 05:17 | |
*** salv-orlando has joined #openstack-kolla | 05:17 | |
*** salv-orl_ has joined #openstack-kolla | 05:29 | |
*** salv-orlando has quit IRC | 05:32 | |
*** tfukushima has quit IRC | 05:40 | |
*** tfukushima has joined #openstack-kolla | 05:41 | |
*** ravig has quit IRC | 05:42 | |
*** Jeffrey4l has quit IRC | 05:49 | |
*** tfukushima has quit IRC | 05:51 | |
*** Jeffrey4l has joined #openstack-kolla | 05:54 | |
*** mbound has joined #openstack-kolla | 05:55 | |
*** coolsvap has quit IRC | 05:57 | |
*** daneyon_ has joined #openstack-kolla | 05:57 | |
*** mbound has quit IRC | 06:00 | |
*** daneyon_ has quit IRC | 06:02 | |
*** yuanying has joined #openstack-kolla | 06:03 | |
*** yuanying_ has quit IRC | 06:05 | |
*** coolsvap has joined #openstack-kolla | 06:10 | |
*** openstackgerrit has quit IRC | 06:18 | |
*** openstackgerrit has joined #openstack-kolla | 06:18 | |
*** yuanying has quit IRC | 06:21 | |
*** salv-orlando has joined #openstack-kolla | 06:24 | |
*** yuanying has joined #openstack-kolla | 06:28 | |
*** salv-orl_ has quit IRC | 06:28 | |
*** salv-orlando has quit IRC | 06:29 | |
*** tfukushima has joined #openstack-kolla | 06:34 | |
*** belmoreira has joined #openstack-kolla | 06:51 | |
*** athomas has joined #openstack-kolla | 06:56 | |
*** maestro has joined #openstack-kolla | 06:59 | |
*** yuanying has quit IRC | 07:05 | |
*** maestro has left #openstack-kolla | 07:05 | |
*** yuanying has joined #openstack-kolla | 07:08 | |
*** matrohon has joined #openstack-kolla | 07:10 | |
*** shardy has joined #openstack-kolla | 07:24 | |
*** liyi has left #openstack-kolla | 07:31 | |
*** openstackgerrit has quit IRC | 07:33 | |
*** openstackgerrit has joined #openstack-kolla | 07:33 | |
*** salv-orlando has joined #openstack-kolla | 07:41 | |
*** shardy has quit IRC | 07:43 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Revert "Added precheck to check kernel version 4.2 on Ubuntu 14.04." https://review.openstack.org/329798 | 07:44 |
*** b_bezak has joined #openstack-kolla | 07:46 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Pin to the Ubuntu 16.04 https://review.openstack.org/329454 | 07:51 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Revert "Added precheck to check kernel version 4.2 on Ubuntu 14.04." https://review.openstack.org/329808 | 07:57 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Revert "Added precheck to check kernel version 4.2 on Ubuntu 14.04." https://review.openstack.org/329808 | 08:03 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Remove the pull action in the deploy_aio CI https://review.openstack.org/329735 | 08:03 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Pin to the Ubuntu 16.04 https://review.openstack.org/329454 | 08:03 |
*** tyrola has joined #openstack-kolla | 08:07 | |
*** tyrola has quit IRC | 08:07 | |
*** shardy has joined #openstack-kolla | 08:10 | |
*** dmk0202 has joined #openstack-kolla | 08:22 | |
coolsvap | Jeffrey4l, around? | 08:24 |
Jeffrey4l | coolsvap, yep | 08:24 |
coolsvap | Jeffrey4l, regarding patch 317240 | 08:25 |
patchbot | coolsvap: https://review.openstack.org/#/c/317240/ - kolla - Add support for mistral ubuntu binary containers | 08:25 |
coolsvap | i have not tested debian | 08:25 |
coolsvap | i can test and add it | 08:25 |
coolsvap | do you think it should block the patch? | 08:25 |
Jeffrey4l | coolsvap, yes. I will remove the -1 | 08:25 |
Jeffrey4l | coolsvap, btw, we have no ubuntu binary gate now. So have u tested your PS ? | 08:27 |
coolsvap | Jeffrey4l, yes i have tested it when i submitted it i can build it again and verify for you | 08:28 |
Jeffrey4l | coolsvap, cool | 08:29 |
*** Serlex has joined #openstack-kolla | 08:39 | |
*** daneyon_ has joined #openstack-kolla | 08:40 | |
*** daneyon_ has quit IRC | 08:44 | |
coolsvap | Jeffrey4l, it builds successfully | 08:47 |
Jeffrey4l | Cool . thanks for test it. I will +workflow | 08:48 |
coolsvap | Jeffrey4l, np | 08:48 |
coolsvap | Jeffrey4l, is it only me or everyone see Merge Conflict for patch 328891 | 08:49 |
patchbot | coolsvap: https://review.openstack.org/#/c/328891/ - kolla - Remove the duplication of the inventory | 08:49 |
coolsvap | in the review queue? | 08:49 |
Jeffrey4l | coolsvap, where is the merge conflict? | 08:50 |
coolsvap | if i see it in the review queue for all kolla open patches https://review.openstack.org/#/q/status:open+project:openstack/kolla | 08:51 |
coolsvap | i see status as merge conflict even though there is none | 08:51 |
*** mbound has joined #openstack-kolla | 08:52 | |
Jeffrey4l | you are correct. there is merge conflict warning in the PS page. | 08:52 |
Jeffrey4l | still can not familiar with the new gerrit web page. :( | 08:52 |
Jeffrey4l | anyway, \i will solve it. | 08:52 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Remove the duplication of the inventory https://review.openstack.org/328891 | 08:54 |
openstackgerrit | Merged openstack/kolla: Add support for mistral ubuntu binary containers https://review.openstack.org/317240 | 08:58 |
b_bezak | Hi | 09:16 |
b_bezak | I am doing PoC with DVR - http://docs.openstack.org/mitaka/networking-guide/scenario-dvr-ovs.html | 09:17 |
b_bezak | so I would need couple of more components then kolla provides on compute nodes | 09:17 |
b_bezak | neutron_metadata_agent | 09:17 |
b_bezak | neutron_l3_agent | 09:17 |
b_bezak | how to achieve that in kolla? | 09:18 |
b_bezak | (I have already merge controllers with network nodes in multinode topolgy to simplify customization on this part) | 09:19 |
*** jmccarthy1 has joined #openstack-kolla | 09:20 | |
*** jmccarthy1 has quit IRC | 09:25 | |
*** jmccarthy has quit IRC | 09:25 | |
*** mikelk has joined #openstack-kolla | 09:26 | |
*** jmccarthy has joined #openstack-kolla | 09:26 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Pin to the Ubuntu 16.04 https://review.openstack.org/329454 | 09:35 |
*** tfukushima has quit IRC | 09:37 | |
*** tfukushima has joined #openstack-kolla | 09:38 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix build for oraclelinux base https://review.openstack.org/329844 | 09:41 |
openstackgerrit | Md Nadeem proposed openstack/kolla: Added unit test for start container https://review.openstack.org/329847 | 09:44 |
*** athomas has quit IRC | 09:45 | |
*** salv-orlando has quit IRC | 09:47 | |
*** salv-orlando has joined #openstack-kolla | 09:48 | |
*** athomas has joined #openstack-kolla | 09:50 | |
*** cinerama has quit IRC | 09:51 | |
*** cinerama has joined #openstack-kolla | 09:55 | |
openstackgerrit | Han Chao proposed openstack/kolla: Typo-fix in kolla docs https://review.openstack.org/329854 | 10:05 |
pbourke | b_bezak: kolla provides the components you mentioned | 10:12 |
pbourke | look under docker/neutron | 10:12 |
b_bezak | sure, I have those on network node. However I would need them also on compute nodes | 10:14 |
b_bezak | http://docs.openstack.org/mitaka/networking-guide/_images/scenario-dvr-services.png | 10:14 |
*** pbourke has quit IRC | 10:15 | |
*** pbourke has joined #openstack-kolla | 10:15 | |
b_bezak | I am using stable/mitaka btw | 10:16 |
b_bezak | so basically, how can I tell deployer to install 2 more components on compute nodes | 10:17 |
b_bezak | ? | 10:17 |
b_bezak | is there such customization possible? | 10:18 |
*** tfukushima has quit IRC | 10:18 | |
*** daneyon_ has joined #openstack-kolla | 10:28 | |
*** jmccarthy has left #openstack-kolla | 10:29 | |
pbourke | b_bezak: i think you would just need to customise your inventory | 10:32 |
*** daneyon_ has quit IRC | 10:32 | |
pbourke | for example to deploy the neutron_l3_agent on compute nodes, add "compute" into that subsection | 10:33 |
*** jmccarthy has joined #openstack-kolla | 10:34 | |
b_bezak | ok got it. I will check it. thx | 10:35 |
openstackgerrit | Md Nadeem proposed openstack/kolla: Added unit test for start container https://review.openstack.org/329871 | 10:41 |
*** salv-orlando has quit IRC | 10:56 | |
*** salv-orlando has joined #openstack-kolla | 10:57 | |
pbourke | b_bezak: let us know if you get it working, id be interested in getting DVR documented | 10:58 |
b_bezak | sure pbourke, I'll let you know | 11:01 |
*** dave-mccowan has quit IRC | 11:04 | |
*** salv-orlando has quit IRC | 11:06 | |
*** dave-mccowan has joined #openstack-kolla | 11:20 | |
*** mliima_ has joined #openstack-kolla | 11:29 | |
*** belmoreira has quit IRC | 11:33 | |
*** mgoddard has joined #openstack-kolla | 11:38 | |
*** dave-mccowan has quit IRC | 11:47 | |
*** rhallisey has joined #openstack-kolla | 11:57 | |
mliima_ | morning all | 12:03 |
*** mliima_ is now known as mliima | 12:03 | |
Mech422 | pbourke: ping ? | 12:04 |
pbourke | hi Mech422 | 12:04 |
Mech422 | hey - been trying to catch up with you :-) | 12:04 |
*** mgoddard_ has joined #openstack-kolla | 12:05 | |
Mech422 | Did you resolve your stale partition table stuff ? | 12:05 |
pbourke | not really :( | 12:05 |
pbourke | it seems to me udev is flaky in centos 6 | 12:06 |
Mech422 | pbourke: Jeffrey4l pointed out instead of using sgdisk like my patches, you could just call 'udevadm trigger'...ahh... | 12:06 |
*** jtriley has quit IRC | 12:06 | |
Mech422 | pbourke: my patches use sgdisk -i, so they dont rely on udev | 12:06 |
Mech422 | pbourke: might work for you ? | 12:06 |
pbourke | im not sure if we're interested in supporting older distros or not | 12:06 |
pbourke | Mech422: thanks I'll check your patch! | 12:06 |
Mech422 | pbourke: cool - https://review.openstack.org/#/c/326609 | 12:07 |
*** mgoddard has quit IRC | 12:08 | |
pbourke | in my situation its strange as sgdisk/parted does show the label, its just not available from udev | 12:08 |
pbourke | so Im not sure where the former tools are reading it from | 12:08 |
Mech422 | pbourke: no - sgdisk reads directly from device | 12:09 |
Mech422 | pbourke: and udev doesn't update the partition name until 'udevadm trigger' is called | 12:10 |
Mech422 | pbourke: Jeffrey4l figured out the udev parts... | 12:10 |
Mech422 | pbourke: so we can either add 'udevadm trigger' calls after re-writing the partition tables | 12:10 |
Mech422 | pbourke: or we can just parse the output from sgdisk | 12:11 |
*** ravig has joined #openstack-kolla | 12:11 | |
*** dwalsh has joined #openstack-kolla | 12:12 | |
*** berendt has joined #openstack-kolla | 12:14 | |
*** mbound has quit IRC | 12:15 | |
*** mbound has joined #openstack-kolla | 12:15 | |
*** daneyon_ has joined #openstack-kolla | 12:16 | |
*** prithiv has joined #openstack-kolla | 12:16 | |
Mech422 | pbourke: It seems ashame to only use half the capability of Sam's work on ceph stuff - especiallly when it only takes a 20 line patch to fix it... | 12:19 |
Mech422 | pbourke: and I've had a few more people asking about running ceph on partitiosn lately - including sean-k-mooney | 12:19 |
*** daneyon_ has quit IRC | 12:21 | |
*** jtriley has joined #openstack-kolla | 12:28 | |
*** mgoddard_ has quit IRC | 12:30 | |
*** mgoddard has joined #openstack-kolla | 12:30 | |
*** jtriley has quit IRC | 12:33 | |
*** mbound has quit IRC | 12:40 | |
*** salv-orlando has joined #openstack-kolla | 12:56 | |
*** salv-orlando has quit IRC | 12:56 | |
*** salv-orlando has joined #openstack-kolla | 12:56 | |
*** prithiv has quit IRC | 12:57 | |
*** stvnoyes has quit IRC | 13:00 | |
*** stvnoyes has joined #openstack-kolla | 13:01 | |
*** inc0 has joined #openstack-kolla | 13:03 | |
inc0 | good morning | 13:03 |
*** ccesario has quit IRC | 13:06 | |
Mech422 | inc0: Morning :-) | 13:09 |
Mech422 | inc0: just made coffee - want some ? :-) | 13:09 |
inc0 | I'm a tea drinker | 13:09 |
inc0 | but tea is lousy in US :( | 13:09 |
Mech422 | heh - my mom used to have relatives send us tea from england | 13:10 |
Mech422 | nothing fancy - just tetley's I think - but she like it a lot better | 13:10 |
coolsvap | inc0, i am with you | 13:11 |
pbourke | Mech422: well, recall our problems are slightly different | 13:11 |
pbourke | Mech422: just back from lunch I need to review your patch | 13:11 |
inc0 | tetley is kinda ok, as for normal bulk goes | 13:11 |
Mech422 | pbourke: I'd appreciate it :-) I'd like to close it out one way or the other | 13:11 |
inc0 | btw gates are broken | 13:12 |
inc0 | I think | 13:12 |
Mech422 | inc0: yeah - it's not 'tea snob' tea - but I guess its decent | 13:12 |
coolsvap | you guys will not like any tea if you drink one made by me :) can guarantee that | 13:12 |
inc0 | I like indian chai masala...super sweet too | 13:13 |
inc0 | is that what you mean? | 13:13 |
Mech422 | pbourke: Jeffrey4l's approach is definately 'cleaner' - only 2 lines, but not sure if we can trust udev and not sure we can run udevadm trigger inside container? | 13:13 |
Mech422 | pbourke: my way is more 'brute force' - but only requires you can run sgdisk (sudo) | 13:13 |
coolsvap | inc0, tea = chai (in hindi name for tea) i make my own masala each time | 13:14 |
Jeffrey4l | in fact, i am not like the udev trigger too. use a online disk is a bad idea. | 13:14 |
Mech422 | Oh! I had indian tea once at my neighbors - really good - some spice in it (cinnimon?) | 13:15 |
inc0 | I have some masala at home and I drink chai masala from time to time but I bet it's lousy comparing to what you're doing | 13:15 |
inc0 | bring some to one of summits coolsvap ;) we'll have chai masala;) | 13:15 |
*** jtriley has joined #openstack-kolla | 13:15 | |
Jeffrey4l | Mech422, pbourke ^ | 13:16 |
inc0 | Mech422, masala is mixture of several spices | 13:16 |
Mech422 | Jeffrey4l: Personally, I don't think we should be forcing that decision on people? | 13:16 |
coolsvap | inc0, sure thing Mech422 no its not cinnimon | 13:16 |
Mech422 | inc0: oh? its very tasty...I've only had british and green tea before | 13:16 |
inc0 | I love japanese teas | 13:16 |
inc0 | good sencha is a treasure | 13:16 |
Mech422 | Jeffrey4l: its the old 'policy vs ...' arguement | 13:17 |
Mech422 | Jeffrey4l: should we be making policy decisions for users ? | 13:17 |
inc0 | Mech422, as for udev, we need to figure out how to pass config to ceph | 13:17 |
inc0 | we created the label idea, and it turns out to be hard to extract | 13:17 |
inc0 | we used udev only because it seemed to be only way available to python | 13:17 |
inc0 | that didn't require stdout scrapping | 13:18 |
Mech422 | inc0: hmm - not really 'hard' - just 'distasteful' to some people... | 13:18 |
inc0 | we did stdout scrapping before, it was nightmare to debug/manage errors | 13:18 |
Mech422 | inc0: I send you a link to a code snippet that read teh device raw in python... | 13:18 |
Mech422 | inc0: to be honest - it seemed more work then benefit | 13:18 |
Jeffrey4l | So if you want to add this kind feature, I am OK. Just point this: use online is bad and danger. | 13:18 |
*** ccesario has joined #openstack-kolla | 13:18 | |
inc0 | it's not about onliune | 13:19 |
inc0 | it's about lack of tools | 13:19 |
Mech422 | Jeffrey4l: I'm NOT adding it - I told you many times, Sam had it in the original code - I just made it work | 13:19 |
inc0 | Mech422, you're referring to partitions? | 13:19 |
inc0 | for osd? | 13:19 |
Mech422 | inc0: yeah | 13:19 |
inc0 | yeah, we wanted to make it work for quite some time | 13:20 |
Mech422 | inc0: Sam had the code path in the original - he just didn't realize that 'partprobe' doesn't refresh the partition names | 13:20 |
Jeffrey4l | Mech422, where is it? the partprobe? | 13:20 |
Mech422 | Jeffrey4l: they whole block of code that deals with using partitions ? | 13:20 |
Mech422 | Jeffrey4l: I didn't add any of that | 13:20 |
*** diogogmt has quit IRC | 13:21 | |
Jeffrey4l | inc0, it's not about onliune? what's this? the only one case I think which need call `udevadm trigger` is that when use make label to online disk. | 13:21 |
Jeffrey4l | Mech422, current implement is OK. at last it works. We are talking about you PS, right? | 13:22 |
Mech422 | Jeffrey4l: the current implementation has broken support for partitions - broken, but existing | 13:22 |
Mech422 | Jeffrey4l: my patch is ONLY to fix that lil bit thats broken - its only like 20 lines :-P | 13:23 |
Jeffrey4l | Mech422, how to reproduce it? | 13:23 |
Mech422 | I added no new capabilities and changed no policies | 13:23 |
Jeffrey4l | deploy -> clean -> re-deploy? | 13:23 |
Mech422 | Jeffrey4l: yeah - try using partitions on a device thats in use | 13:23 |
Jeffrey4l | so you are using a oneline drive, right? | 13:24 |
Jeffrey4l | online | 13:24 |
Mech422 | Jeffrey4l: If the kernel whines 'using old partition table' - your're hosed | 13:24 |
Mech422 | yes | 13:24 |
Jeffrey4l | so, current issue is: kolla can not handle the online disk right? | 13:24 |
Jeffrey4l | my point is: using online disk is bad and danger. | 13:25 |
Mech422 | err...kolla ceph configuration can't handle it - other then that, it works fine... | 13:25 |
Mech422 | Jeffrey4l: my point is, thats an operator decision... | 13:25 |
Jeffrey4l | but not kolla. | 13:25 |
Mech422 | Jeffrey4l: for instance, lots of places put '/' on a raid-1 .... so its possible ALL disks in the system are 'in-use' | 13:26 |
Mech422 | even if the drives are 90% empty | 13:26 |
inc0 | Jeffrey4l, we would need partition-osd as well for gates for ceph | 13:27 |
Jeffrey4l | at least, the right direct is: deploy -> clean (fix this issue here, umount the ceph-osd mount and zap the disk osd used ) -> re-deploy | 13:27 |
inc0 | well, you can clean up partition just the same | 13:27 |
inc0 | in fact redeploying ceph on it will do that | 13:28 |
Mech422 | Jeffrey4l: I can re-deploy without zapping whole disk ? I just reset the partition names | 13:28 |
inc0 | ceph deals with it | 13:28 |
Jeffrey4l | inc0, what is partition-osd? a tool? | 13:28 |
inc0 | so for ceph you can put osd on disk as we do now, partition or even a file | 13:29 |
inc0 | we support only whole disk | 13:29 |
inc0 | as for now | 13:29 |
*** sdake has joined #openstack-kolla | 13:29 | |
Jeffrey4l | about the zapping whole disk: once i haven't zap the disk, the ceph read the old data again when re-deploy. | 13:30 |
Jeffrey4l | inc0, no. you are wrong at this point. kolla support partition now. | 13:30 |
inc0 | it does not | 13:30 |
Jeffrey4l | I used this. | 13:30 |
Mech422 | inc0: right - but there is already broken support for 2 of the 3 methods... | 13:30 |
Jeffrey4l | wait 1sec | 13:30 |
inc0 | broken support | 13:30 |
Mech422 | inc0: I supports partitions now - but only if not in use | 13:30 |
Mech422 | s/I/It/ | 13:31 |
inc0 | hmm | 13:31 |
*** diogogmt has joined #openstack-kolla | 13:31 | |
Mech422 | inc0: for that matter - I don't think the docs say anywhere you need a whole device free if you want to use ceph | 13:31 |
*** ravig has quit IRC | 13:31 | |
inc0 | ok, I might be mistaken then, I'm pretty sure docs tells how to use whole disk | 13:31 |
Jeffrey4l | inc0, it is undocumented :D | 13:31 |
inc0 | but it does write partition table | 13:31 |
Mech422 | inc0: yesh - it updates the NAMES only of partitions | 13:32 |
Mech422 | inc0: NO geometery changes | 13:32 |
Mech422 | inc0: Unless its doing a whole disk 'zap disk' | 13:32 |
Jeffrey4l | Mech422, inc0 check this http://paste.openstack.org/show/516254/ it is one of my env. i split this disk into multi osd | 13:32 |
Jeffrey4l | so what the issue really is? | 13:34 |
Mech422 | Jeffrey4l: yeah - it works currently, when the drives are not in use | 13:34 |
Mech422 | if you don't know the problem, why are you agruing about the solution ? | 13:34 |
Jeffrey4l | I know that. | 13:34 |
Jeffrey4l | wait for a moment. | 13:35 |
*** coolsvap has quit IRC | 13:39 | |
Mech422 | If kolla is going to be used by 'enterprises' - it will be extremely limiting to assume 'greenfield' setup... | 13:39 |
Mech422 | so places won't be able to dedicate DHCP to ironic | 13:40 |
Mech422 | some places will want to use existing MySQL instances | 13:40 |
Mech422 | some places will want to use calico for networking | 13:40 |
Mech422 | and some places may have disk setups where disks are (partitially) in use | 13:40 |
Mech422 | I really don't see a difference between any of those situations? | 13:40 |
Mech422 | why just say "you can't do that" for one of them ? | 13:41 |
*** mbound has joined #openstack-kolla | 13:41 | |
inc0 | guys I'll need to skip todays meeting | 13:41 |
*** sdake_ has joined #openstack-kolla | 13:42 | |
*** esharao__ has joined #openstack-kolla | 13:43 | |
Mech422 | inc0: oh - in other news, I've been unable to reproduce that 'heisenbug' :-P | 13:45 |
esharao__ | Good morning all.. | 13:45 |
*** sdake has quit IRC | 13:45 | |
esharao__ | running into the following issue - failed: [localhost] (item=haproxy) => {"failed": true, "item": "haproxy", "msg": "AnsibleUndefinedVariable: 'dict object' has no attribute u'ansible_eth1'"} | 13:45 |
inc0 | lol | 13:45 |
Mech422 | inc0: I'll keep an eye out for it, and just not rebuild the cluster if I hit it again | 13:45 |
*** v1k0d3n has quit IRC | 13:45 | |
esharao__ | is there a way to fix it.. | 13:45 |
Mech422 | esharao__: Morning :-) | 13:45 |
inc0 | esharao__, confirm that eth0 is up and have IP | 13:45 |
inc0 | etg1 | 13:46 |
inc0 | eth1* | 13:46 |
*** mbound has quit IRC | 13:46 | |
esharao__ | i dont see eth1 at all.. | 13:46 |
inc0 | well then... | 13:46 |
inc0 | ;) | 13:46 |
esharao__ | it has centos | 13:46 |
inc0 | you need to change api_interface in globals.yml | 13:46 |
esharao__ | ahh ok.. | 13:47 |
esharao__ | i see enp0s3 | 13:47 |
esharao__ | ok.. let me change that.. | 13:47 |
*** sacharya has joined #openstack-kolla | 13:49 | |
Mech422 | inc0: we could side step the partition name stuff and just throw a dict in globals that has the ceph data/journal mappings ? | 13:49 |
Mech422 | inc0: have to figure out how to make that persistent across reboots - but should be doable | 13:50 |
*** ccesario has quit IRC | 13:50 | |
inc0 | well, yes and no | 13:51 |
inc0 | it will be bitch to make for larger deployments | 13:51 |
inc0 | but I was thinking of sth like | 13:51 |
inc0 | in inventory: | 13:51 |
inc0 | 192.168.0.[1:100] ceph_osd_mapping=/dev/vda,/dev/vdb3,/var/lib/my_ceph_files/my_osd1 | 13:52 |
inc0 | but I'd love to keep backwards compatibility for 1 release | 13:52 |
inc0 | should be easy enough | 13:52 |
Mech422 | inc0: that works too ... the container bootstrap and startups would have to change | 13:53 |
inc0 | not that much | 13:53 |
*** diogogmt has quit IRC | 13:53 | |
Mech422 | inc0: right now, it uses the partition name to decide whether to bootstrap or not | 13:53 |
inc0 | since looking for ceph disks is a task | 13:53 |
*** sacharya_ has joined #openstack-kolla | 13:53 | |
inc0 | you can put a when statement | 13:53 |
inc0 | when: not ceph_osd_mapping | 13:53 |
Mech422 | inc0: but it still needs to know if the cluster is bootstrapping ? | 13:54 |
inc0 | https://github.com/openstack/kolla/blob/master/ansible/roles/ceph/tasks/bootstrap_osds.yml#L2-L8 we have this now | 13:55 |
Mech422 | inc0: anyway - we could re-jigger it around like that - would that be more acceptable ? looking... | 13:55 |
inc0 | what you can do is to add when: not set ceph_osd_mapping | 13:55 |
inc0 | thing is, we need 1 release of deprecation | 13:56 |
Mech422 | inc0: but you still need to bootstrap once if ceph_osd_mapping is set? | 13:56 |
Mech422 | inc0: yeah - that makes sense | 13:56 |
*** sacharya has quit IRC | 13:56 | |
inc0 | ahh I see what you mean | 13:56 |
Mech422 | inc0: so do nothing, and spend the next release finding a 'cleaner' solution ? | 13:56 |
inc0 | we'll need to put some lock or sth so it won't re-bootstrap | 13:56 |
inc0 | no, we need cleaner solution by N and support both for N | 13:57 |
inc0 | then we remove old on | 13:57 |
inc0 | one | 13:57 |
Mech422 | inc0: oh...hmm... | 13:57 |
inc0 | people already build CI stuff and such | 13:57 |
inc0 | we can't break it | 13:57 |
Mech422 | inc0: supporting both a clean AND a crufty way at once will be 'fun'... | 13:57 |
inc0 | without giving them time to migrate logic to new one | 13:57 |
inc0 | not that hard | 13:58 |
inc0 | again, at the end we need to fill osds_bootstrap variable | 13:58 |
inc0 | however we do it, it's up to us | 13:58 |
inc0 | in the end* | 13:58 |
*** sacharya_ has quit IRC | 13:59 | |
Mech422 | inc0: yeah - cut over to 'clean' logic and just support 'clean' and 'crufty' for populating config data | 13:59 |
inc0 | yeah | 13:59 |
Mech422 | inc0: then we can just remove the 'population by cruft' when its no longer supported | 13:59 |
*** sacharya has joined #openstack-kolla | 13:59 | |
inc0 | and put a bit red warning | 13:59 |
inc0 | during N | 13:59 |
inc0 | THIS STUFF WILL DISAPEAR WITH O | 14:00 |
inc0 | however hard part is to find new clean way | 14:00 |
Mech422 | inc0: its basically just figuring out a good way to build a partition map... | 14:01 |
inc0 | and making sure that it won't get re-bootstrapped at randon | 14:01 |
inc0 | m | 14:01 |
Mech422 | inc0: ceph doesn't really have a concept of 'whole disk' - it delegates all the file I/O stuff to local filesystem | 14:01 |
inc0 | yeah I know | 14:01 |
Jeffrey4l | Mech422, could u explain that how to define ` the dirver are use? ` | 14:01 |
Mech422 | inc0: Are file backed stores out of scope ? | 14:02 |
Mech422 | Jeffrey4l: sorry - I don't understand ? | 14:02 |
inc0 | Mech422, if we can make it cleanly and elegantly, I' | 14:02 |
inc0 | I'd love to have it | 14:02 |
*** ccesario has joined #openstack-kolla | 14:02 | |
inc0 | would make PoC stuff much easier | 14:02 |
Jeffrey4l | explain your issue, more. | 14:02 |
inc0 | Jeffrey4l, issue is, currently we need whole disk, if we put multiple osd on it, cool | 14:03 |
inc0 | but how would you add osd to a file? | 14:03 |
Mech422 | inc0: yeah - be nice for small AIO installs for people to test with | 14:03 |
inc0 | or partition on disk that is already in use? | 14:03 |
Jeffrey4l | inc0, it work. I paste you my env. | 14:03 |
inc0 | you have 3TB raid for whole machine, you use 100Gig of it for base operating system | 14:03 |
inc0 | Jeffrey4l, can you do this with other stuff on same disk as well? | 14:04 |
Jeffrey4l | i have multi osd in one disk, which is deploy by kolla. | 14:04 |
*** diogogmt has joined #openstack-kolla | 14:04 | |
Jeffrey4l | what's mean by that? inc0 | 14:04 |
b_bezak | pbourke: deployment went fine - extra components on compute were deployed, after added lines to inventory | 14:05 |
b_bezak | [neutron-l3-agent:children] | 14:05 |
b_bezak | neutron | 14:05 |
b_bezak | compute | 14:05 |
b_bezak | [neutron-metadata-agent:children] | 14:05 |
b_bezak | neutron | 14:05 |
b_bezak | compute | 14:05 |
inc0 | Jeffrey4l, I mean have /home/ubuntu at same disk | 14:05 |
Mech422 | inc0: for files, we'd just need a 'tag' for the osd: 'disk','file' or 'partition' ? we could then key the bootstrap logic by that | 14:05 |
inc0 | or /root | 14:05 |
Jeffrey4l | b_bezak, please use a past file. | 14:05 |
b_bezak | sorry | 14:05 |
*** dwalsh has quit IRC | 14:05 | |
Jeffrey4l | file/service | 14:05 |
inc0 | b_bezak, you're deploying l3 agents on compute? | 14:05 |
b_bezak | yes | 14:06 |
b_bezak | for DVR | 14:06 |
pbourke | b_bezak: ok let me know how you get on for dvr itself | 14:06 |
pbourke | please :) | 14:06 |
inc0 | ahh right | 14:06 |
Jeffrey4l | inc0, Mech422 you two are not saying the same thing. :( | 14:06 |
inc0 | b_bezak, so inventory is meant to be changed | 14:06 |
b_bezak | sure, I need to put configs to /etc/kolla/config on deployer and reconfigure first ;) | 14:06 |
inc0 | Jeffrey4l, I kinda agree with him;) | 14:06 |
inc0 | so reason I agree is for example gates | 14:06 |
inc0 | we have only one disk on gate | 14:07 |
inc0 | with current arch we can't gate on ceph | 14:07 |
Jeffrey4l | use file backend for ceph? | 14:07 |
Mech422 | Jeffrey4l: I thought we were - I was just saying '/' inc0 is saying '/home/foo' ? | 14:07 |
Mech422 | Jeffrey4l: we don't currently support file backing for ceph ? | 14:07 |
*** MarMat has joined #openstack-kolla | 14:08 | |
inc0 | another way would be to add a partition in setup_gate.sh | 14:08 |
inc0 | and use it for osd | 14:08 |
inc0 | only thing is, this disk is already in use | 14:08 |
inc0 | (root fs) | 14:08 |
Jeffrey4l | i think we are talking two things: 1. the `udevadm trigger`, which solve the online disk issue 2. support file backend storage( without a whole disk) will good for quick test/ci | 14:09 |
Jeffrey4l | right? | 14:09 |
Mech422 | Jeffrey4l: yeah - file backend is a 'new feature'... | 14:09 |
Jeffrey4l | i have no idea for the file backend. I want to talk about the issue (1) | 14:10 |
Mech422 | 'udevadm trigger' / 'sgdisk -i' is just to make existing feature work more reliabily | 14:10 |
inc0 | will udev trigger allow us to use partition on disk already in use? | 14:10 |
Mech422 | inc0: it appears too - though I'm a lil distrustful | 14:10 |
inc0 | Mech422, Jeffrey4l can we test it?;) | 14:10 |
inc0 | I honestly don't know | 14:11 |
Jeffrey4l | first of all, what mean by disk already in use. My understand is: you have a sda with 100G, first 25G is used for OS(/), others is not used. | 14:11 |
Jeffrey4l | right | 14:11 |
Mech422 | inc0: we did some 'one off' tests an it worked a treat - I'm sorta concerned if it works from inside kolla-toolbox | 14:11 |
Mech422 | inc0: I'm also a bit leary of being dependent on udev behavior...but thats just me | 14:12 |
Jeffrey4l | Or another explain: a disk/partition is mounted. | 14:12 |
Mech422 | Jeffrey4l: yes or first 25G is /home/steve | 14:12 |
Jeffrey4l | then it works. | 14:12 |
Mech422 | Jeffrey4l: 'it works' ? you mean currently, or if you add udevadm trigger ? | 14:13 |
sean-k-mooney | inc0: could we create a loop back device from a file and create a partition to test it in the gate? | 14:13 |
Jeffrey4l | other 75G is not mount. then you can change the label. and the /proc is updated without a `udevadm trigger` | 14:13 |
inc0 | sean-k-mooney, I played with loopback, not something easily done | 14:13 |
Jeffrey4l | Mech422, the /dev/disk/by-partlabel is updated too. | 14:14 |
Mech422 | Jeffrey4l: Umm - it didn't work like that for me .... | 14:14 |
Jeffrey4l | Mech422, I will show you my test. | 14:14 |
sean-k-mooney | inc0: yes that is true. its also a little tempermental at times | 14:14 |
inc0 | I'd like end solution | 14:15 |
Mech422 | inc0: whenever I have to work with loop devices, I let kpartx do the heavy lifting :-P | 14:15 |
inc0 | there are use cases for that on prod too | 14:15 |
inc0 | so let's just make it work | 14:15 |
pbourke | been frantically trying to catch up on this conversation | 14:15 |
*** diogogmt has quit IRC | 14:15 | |
pbourke | very relevant to me at the moment | 14:15 |
inc0 | pbourke, we're discussing ceph bootstrapping now | 14:15 |
pbourke | as our OVM systems do *not* work with udev | 14:15 |
Mech422 | inc0: the actual calls to the ceph setup functions are all very similiar - its just a matter of massaging the inputs a bit to support different backing stores | 14:16 |
pbourke | im doing something similar to what you guys mentioned as a workaround | 14:16 |
inc0 | yeah I know | 14:16 |
pbourke | a var containing the osd mapping | 14:16 |
sean-k-mooney | in general i think it would be nice to support disk/partition/file and folder backing in kollas ceph code but i think full disk and partition are going to be the most popular outside of dev | 14:17 |
inc0 | partitions on existing disk are quite popular | 14:17 |
Mech422 | sean-k-mooney: yeah - file backing would suck for prod. - but its awsome for say AIO testing setups... | 14:18 |
Daviey | For lab work, I can imagine loopback files is easier to setup? | 14:18 |
inc0 | files not-so but files are great for quick poc/dev/gate | 14:18 |
inc0 | and since ceph supports it no problem, we should too | 14:18 |
inc0 | so ceph-ansible uses deterministic conf | 14:18 |
sean-k-mooney | Mech422: yes i use a backing file for my cache layerer as i share the ssd with the host os but partition would be better | 14:18 |
pbourke | i have code to manually supply the osd tasks with what find_disks usually outputs | 14:18 |
inc0 | we could use variable in inv if we would somehow ensure that it won't re-bootsrap | 14:19 |
pbourke | this could be used as a bridge to something better | 14:19 |
inc0 | pbourke, yeah, we'd need to tweak up extended_start too, but that shouldn't be hard | 14:19 |
pbourke | what stops it from re-bootstrapping now out of interest | 14:19 |
Jeffrey4l | Mech422, check this. | 14:20 |
Jeffrey4l | http://paste.openstack.org/show/516267/ | 14:20 |
Mech422 | inc0: in the whole-other-can-of-worms dept. - Ceph already has a nice ceph-admin setup meant to run from a deployment host - we could use ansible to drive that... | 14:20 |
inc0 | pbourke, you do want to have your data present after rerunning deploy that doesn't change anything;) | 14:20 |
Mech422 | inc0: which gives operators a nice 'standard' ceph setup when they have to do things like replace a disk | 14:20 |
inc0 | yeah, I like that | 14:21 |
pbourke | inc0: i know, im just wondering how it does that | 14:21 |
Mech422 | I think Daviey asked me about replacing a disk with kolla - and I had nothing but a stupid look to give him :-) | 14:21 |
pbourke | what check do we do to stop this | 14:21 |
Mech422 | pbourke: partition name | 14:21 |
sean-k-mooney | Mech422: is the ceph-admin related to the ceph deploy tool? | 14:21 |
Mech422 | pbourke: on bootstrap the partitions are named BOOSTRAP | 14:21 |
Mech422 | sean-k-mooney: err..yeah - my bad ceph deploy | 14:21 |
Jeffrey4l | in AIO env, how can we start multi ceph-mon instance. IIUC, ceph not work when there is only one ceph-mon | 14:22 |
sean-k-mooney | ok ya i used that to install ceph when i hit issues with kolla 6 months ago | 14:22 |
sean-k-mooney | it was a little buggy when it came to custimistation | 14:22 |
sean-k-mooney | i could not get cepth-deploy to work with brtfs or external journals correctly | 14:23 |
Mech422 | Jeffrey4l: there's hacks to get it to run with 1 mon | 14:23 |
Mech422 | Jeffrey4l: tweaks to the config | 14:23 |
*** jrist has quit IRC | 14:23 | |
pbourke | Mech422: gotcha | 14:23 |
Jeffrey4l | Mech422, why kolla need support that? | 14:23 |
pbourke | for AIO | 14:23 |
Mech422 | sean-k-mooney: really? I have a script that provisions an entire cluster with external journals...don't think it does file backed though | 14:24 |
Jeffrey4l | pbourke, to solve ? | 14:24 |
Jeffrey4l | the CI? | 14:24 |
inc0 | Jeffrey4l, I think this got some love in Hammer/Infernalis | 14:24 |
pbourke | all-in-one setups to solve dev setups and yes CI | 14:24 |
Jeffrey4l | so only the CI? | 14:24 |
inc0 | Jeffrey4l, and PoC | 14:25 |
inc0 | \and dev | 14:25 |
inc0 | these are important use cases too | 14:25 |
sean-k-mooney | Mech422: it is ment to be supported but with a fresh centos 7.2 install it was not happy. its probly a minor misconfig on my part | 14:25 |
Mech422 | inc0: I think its worth thinking about replacing/growing/shrinking cluster in prod too.. | 14:25 |
pbourke | Mech422: that part is pretty easy no? | 14:25 |
Mech422 | sean-k-mooney: oh maybe - I use ubuntu and the ceph repos | 14:25 |
pbourke | Mech422: just add/remove from your inventory | 14:25 |
Jeffrey4l | in the most env/dev/PoC, it is very easy to plug a new disk. | 14:25 |
Mech422 | pbourke: I have NO idea how you 'replace' a ceph disk in kolla ? re-deploy ? | 14:26 |
Mech422 | what happens to existing data ? | 14:26 |
Mech422 | you need to 'bootstrap' the replacement disk, but NOT the rest of the cluster | 14:26 |
pbourke | Mech422: its replicated across other osds afaik | 14:26 |
pbourke | so you just label the new disk and it will bootstrap it | 14:27 |
Mech422 | pbourke: right - but how do you bootstrap the new drie without hosing the cluster ? | 14:27 |
pbourke | and add it to the cluster | 14:27 |
sean-k-mooney | Mech422: isnte the bootstrap lable removed after its successfully setup | 14:27 |
Mech422 | yeah - but we're talking about removing the partition labels | 14:27 |
pbourke | true we need another way to mark a node for bootstrapping | 14:27 |
inc0 | Mech422, bootstrap osd should be idempotent now | 14:28 |
Mech422 | with the existing stuff - I think it _might_ work - but I'd need to test it first... | 14:28 |
pbourke | wonder can we write some code to read the gpt table directly | 14:28 |
pbourke | still use labels, just scrap udev | 14:28 |
Mech422 | pbourke: I pasted a link to some ceph code to do that... | 14:28 |
Jeffrey4l | pbourke, why? | 14:29 |
Mech422 | pbourke: it was like 500 lines of parsing HEADER versions and crap - seemed like way too much trouble for the gain | 14:29 |
pbourke | Jeffrey4l: udev is unreliable | 14:29 |
Jeffrey4l | pbourke, bug? | 14:29 |
pbourke | Jeffrey4l: labels flat out dont work in centos 6 | 14:29 |
Jeffrey4l | why not try centos 7.... | 14:29 |
Mech422 | pbourke: if we want to scrap udev - I really think grabbing sgdisk output is pretty straight forward | 14:29 |
pbourke | Jeffrey4l: because enterprise | 14:29 |
Mech422 | pbourke: that puts the onus of keeping up to date with gpt specs on sgdisk maintainer and not us :-P | 14:30 |
Jeffrey4l | ok.. | 14:30 |
pbourke | Mech422: true, inc0 has reservations about screen scrapping though | 14:30 |
*** vhosakot has joined #openstack-kolla | 14:31 | |
pbourke | which im sure are very valid | 14:31 |
Mech422 | pbourke: I agree...normally, I'd hate it - but its 1 line scrape from pretty nice output .. | 14:31 |
pbourke | yeah its not like we dont have sed/awk elsewhere in our code | 14:31 |
Mech422 | pbourke: we already do more complicated stuff with docker info output | 14:31 |
pbourke | bingo | 14:32 |
Mech422 | pbourke: docker version check feeds `docker info` | to_yml | 14:32 |
Mech422 | pbourke: thats just waiting to bite us :-P | 14:32 |
Mech422 | pbourke: sgdisk -i is nicely formatted, 1 line per field, no fancy delimiters | 14:33 |
*** v1k0d3n has joined #openstack-kolla | 14:33 | |
pbourke | I agree, im just waiting for inc0 to get back from his tea to say no ;) | 14:33 |
Mech422 | pbourke: But I do agree - udevadm trigger would be 100x more elegant if we could trust it | 14:34 |
pbourke | udevadm trigger doesn't work for older versions fyi. the /dev/disk/by-label structure is simply missing | 14:34 |
pbourke | another option | 14:35 |
pbourke | use the disk_info variable as above, write out a sentinal file to mark bootstrapping | 14:35 |
pbourke | pretty sure we do that elsewhere also | 14:35 |
*** severion has joined #openstack-kolla | 14:35 | |
Mech422 | spacex landing in 10 minutes | 14:36 |
*** jrist has joined #openstack-kolla | 14:37 | |
Mech422 | pbourke: yeah - we're gonna need a sentinal of some sort | 14:37 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Pin to the Ubuntu 16.04 https://review.openstack.org/329454 | 14:37 |
pbourke | well, not if we use labels | 14:37 |
pbourke | along with sgdisk parsing | 14:37 |
Mech422 | pbourke: I'm still a bit concerned about drive replace/expand cluster/shrink cluster | 14:37 |
*** v1k0d3n has quit IRC | 14:37 | |
pbourke | explain again? I dont see the issue with marking a new disk for bootstrapping | 14:37 |
Mech422 | pbourke: it really appeals to me to use the same admin tools ceph recommends | 14:37 |
Mech422 | pbourke: how do you shrink a cluster ? if you remove a disk from inventory - nothing happens to it | 14:38 |
pbourke | I agree we dont have tasks for that right now | 14:38 |
pbourke | but essentially you just need to stop the osd on that node | 14:39 |
*** ppowell has quit IRC | 14:39 | |
pbourke | 5 lines of ansible | 14:39 |
Mech422 | pbourke: well yeah - should mark it out and all that jazz | 14:39 |
Mech422 | pbourke: and probably disable the startup on boot for it | 14:39 |
pbourke | does ceph not do that automatically | 14:40 |
Mech422 | pbourke: only if you tell it too | 14:40 |
Jeffrey4l | he guys, please review this https://review.openstack.org/329808 | 14:40 |
pbourke | ah | 14:40 |
Mech422 | pbourke: 'stop' is not 'delete' | 14:40 |
pbourke | I see | 14:40 |
Jeffrey4l | when remove the osd: 1. mark the osd out 2. wait for the ceph to re-balance 3. stop the osd 4. remove the osd from crushmap 5 remove the osd | 14:41 |
Mech422 | Jeffrey4l: I thought there was something went crazy if you didn't use new kernel ? shared mounts or something ? | 14:41 |
Jeffrey4l | Mech422, ubuntu 14.04 support shared mount. | 14:41 |
Jeffrey4l | in the CI, we deploy kolla on the default kernel in the ubuntu 14.04. it works and works fine. never see any kernel related issue. | 14:42 |
Mech422 | Jeffrey4l: oh - ok | 14:42 |
Mech422 | I just thought I remembered something from the install docs saying docker didn't play nice unless you upgraded | 14:43 |
Mech422 | be nice to have the option to use existing kernel though | 14:43 |
Jeffrey4l | Mech422, yes. Doc said that. I checked the history of the doc. this doc came from: aufs *may* have bug in the lower kernel. if you hit this, please try to upgrade your kernel. | 14:44 |
Jeffrey4l | yep | 14:44 |
Mech422 | pbourke: nice thing about ceph deploy is its bog standard - so if you ask for help on something ceph related, you don't get 'thats a non-standard install - ask your vendor' and you have all the tools they expect to have for debugging | 14:44 |
Mech422 | Jeffrey4l: oh cool...that would save a reboot on provisioning | 14:45 |
Jeffrey4l | Mech422, it is hard to use ceph-deploy tool. for example, how could it start the container? | 14:45 |
Jeffrey4l | mostly, upgrade kernel is not unacceptable, especially in the prod env. | 14:46 |
Mech422 | Jeffrey4l: yeah - thats the bitch - it doesn't speak container | 14:46 |
Jeffrey4l | I think we can copy the ceph-deploy script into the kolla ansible task. | 14:46 |
Jeffrey4l | it is very easy. | 14:46 |
Mech422 | Jeffrey4l: although, it could be installed IN the container... | 14:47 |
sdake_ | morning | 14:47 |
Jeffrey4l | I mean copy how the ceph-depoy works. | 14:47 |
Jeffrey4l | Mech422, no. ceph depend on the ssd. | 14:47 |
Jeffrey4l | ssh | 14:47 |
Mech422 | Jeffrey4l: and it uses ssh to talk to all the cluster members - so you could add a port to the osd containers maybe ? | 14:47 |
Jeffrey4l | that's not happend. | 14:47 |
Jeffrey4l | sdake_, moring sir | 14:47 |
Mech422 | Jeffrey4l: yeah - its uses ssh, so if it ran on the deployment host it could ssh to whatever... | 14:48 |
Mech422 | Jeffrey4l: but I agree, its probably just a pipe dream | 14:48 |
Jeffrey4l | lol | 14:48 |
*** tloeb has joined #openstack-kolla | 14:50 | |
*** v1k0d3n has joined #openstack-kolla | 14:52 | |
Jeffrey4l | sdake_, have u any idea why using pacemaker+haproxy rather than the keepavlied+haproxy in the openstack offical ha doc?http://docs.openstack.org/ha-guide/controller-ha-pacemaker.html | 14:52 |
Mech422 | Jeffrey4l: btw - does your ceph cluster calculate PG's properly ? | 14:53 |
Jeffrey4l | Mech422, I calculate it manually. | 14:53 |
Mech422 | Jeffrey4l: oh - so you don't install ceph via kolla ? | 14:54 |
Mech422 | Jeffrey4l: or you adjust it after install ? | 14:54 |
Jeffrey4l | Mech422, adjust it after install | 14:54 |
Jeffrey4l | kolla do not calcualte the pg num. | 14:54 |
Mech422 | Jeffrey4l: ahh - kk - mine is whining about too many PGs per OSD | 14:54 |
Mech422 | Jeffrey4l: yeah - I sorta figured it didn't | 14:54 |
Mech422 | just wanted to make sure it wasnt' something stupid on my end | 14:55 |
*** severion has quit IRC | 14:55 | |
*** mliima has quit IRC | 14:55 | |
tloeb | hello everyone o7, we are trying to deploy a multinode openstack with kolla. Sadly we are having some issues. The Task "Fetching Ceph Keyrings" cant reach one of the controller node. Any idea where can i start to look? | 14:57 |
sdake_ | Jeffrey4l probably red hat people wrote it - hence the slant towards pacemaker | 14:58 |
sdake_ | also pacemaker will shut down failed nodes whicih haproxy does not do | 14:58 |
*** ppowell has joined #openstack-kolla | 14:58 | |
sdake_ | tloeb are you running sudo kolla-ansible deploy? | 14:59 |
Mech422 | tloeb: there was a bug about ceph keyrings yesterday(?) - I think it said to check your ansible version ? | 14:59 |
*** severion has joined #openstack-kolla | 14:59 | |
sdake_ | tloeb i have had a probblem where ssh was not configured for root on one of the hosts | 14:59 |
*** inc0 has quit IRC | 15:00 | |
Jeffrey4l | OK | 15:00 |
tloeb | sdake_: we are not running ansible deploy with sudo | 15:00 |
*** v1k0d3n has quit IRC | 15:00 | |
sdake_ | tloeb i have noticed ceph doesnt wor without running as root | 15:01 |
Jeffrey4l | sdake_, check this please https://review.openstack.org/329808 | 15:01 |
sdake_ | although I could be wrong here | 15:01 |
*** ravig has joined #openstack-kolla | 15:02 | |
sdake_ | Jeffrey4l did you check the git glame to see why that chane was added | 15:02 |
sdake_ | I seem to recall it made sense at the time | 15:02 |
Jeffrey4l | yep. this pre-check is added based on the doc. | 15:03 |
*** b_bezak has quit IRC | 15:03 | |
Jeffrey4l | i will show u the original doc | 15:03 |
*** ravig has quit IRC | 15:03 | |
Jeffrey4l | sdake_, here it is .https://github.com/openstack/kolla/blob/2864b46957e7fbe830dc8d56a5f3915cc5aa8a2b/docs/dev-quickstart.rst#installing-dependencies | 15:05 |
sdake_ | 14.04 is eol, i thought we were going to 16.04 this release? | 15:05 |
*** dwalsh has joined #openstack-kolla | 15:05 | |
*** v1k0d3n has joined #openstack-kolla | 15:06 | |
*** severion has quit IRC | 15:07 | |
*** inc0 has joined #openstack-kolla | 15:07 | |
*** diogogmt has joined #openstack-kolla | 15:08 | |
*** sdake_ has quit IRC | 15:08 | |
*** sdake has joined #openstack-kolla | 15:10 | |
*** mliima has joined #openstack-kolla | 15:10 | |
*** sdake has quit IRC | 15:11 | |
tloeb | sdake_: We tried the following cmd, it is still running but a lot of red lines (we use kolla_version_tag:2.0.0) --> kolla-ansible deploy -i /usr/share/kolla/ansible/inventory/multinode --configdir /home/user/kolla_conf --passwords /home/user/kolla_conf/passwords.yml | 15:13 |
pbourke | tloeb: can you pastebin your error output | 15:14 |
*** SiRiuS__ has joined #openstack-kolla | 15:15 | |
Mech422 | tloeb: Umm - I think the version is 2.0.1 now ? | 15:18 |
Mech422 | tloeb: at least, thats the tag on containers it was building for me | 15:18 |
tloeb | pbourke: http://pastebin.com/U6HwYrji | 15:19 |
Mech422 | tloeb: oh - my bad, I'm thinking of openstack_release in globals | 15:20 |
tloeb | yes the default openstack_release in the globals was 3.0.0 | 15:21 |
inc0 | btw gates seems broken | 15:21 |
tloeb | Mech422: now we tried it with 2.0.0 .. do you think 2.0.1 is better? | 15:21 |
*** tyrola has joined #openstack-kolla | 15:22 | |
Mech422 | tloeb: 3.0.0 is for master | 15:23 |
Mech422 | tloeb: 2.0.1 is for stable/mitaka | 15:23 |
*** tyrola has quit IRC | 15:23 | |
Mech422 | tloeb: but your getting 'UNREACHABLE' - that means ssh is borked | 15:23 |
Mech422 | tloeb: can you ssh from your deployment host to controller001 as whatever user ansible is using ? | 15:24 |
tloeb | Mech422: we disabled the firewall now | 15:24 |
Mech422 | tloeb: ok - did that fix it ? | 15:24 |
tloeb | Mech422: yes ssh ansible_user@controller001 is working | 15:25 |
Mech422 | tloeb: should be good to go then :-) | 15:25 |
tloeb | Mech422: no we are getting the same error with deploying :( it tries to setup the ceph cluster network on a controller.. but i thought controllers have no ceph cluster network | 15:27 |
pbourke | tloeb: run your ansible command with -vvv | 15:28 |
pbourke | tloeb: check what user it's trying to use | 15:28 |
pbourke | inc0: added gates to meeting discussion | 15:28 |
inc0 | pbourke, won't be at meeting unfortunately :S | 15:28 |
pbourke | inc0: if you can't make meeting can you please check the mailing list - there's a discussion there | 15:28 |
pbourke | input appreciated | 15:29 |
inc0 | kk | 15:29 |
*** severion has joined #openstack-kolla | 15:29 | |
*** v1k0d3n has quit IRC | 15:31 | |
inc0 | pbourke, so currently we have issue of ansible looking for 3.0.0 | 15:31 |
inc0 | we didn't tag 3.0.0 yet right? | 15:31 |
*** v1k0d3n has joined #openstack-kolla | 15:31 | |
*** coolsvap has joined #openstack-kolla | 15:31 | |
inc0 | so build default won't be 3.0.0 | 15:31 |
pbourke | i thought those were fixed... | 15:31 |
pbourke | inc0: Im more interested in figuring out the overarching issue of why our gates suck so much | 15:31 |
*** ravig has joined #openstack-kolla | 15:32 | |
inc0 | agree, we need to move to voting gates | 15:32 |
pbourke | as dmsimard mentioned osad/tripleo/etc. all have voting gates | 15:32 |
*** severion has quit IRC | 15:34 | |
*** shardy has quit IRC | 15:35 | |
dmsimard | sorry :) | 15:35 |
inc0 | dmsimard, that's fair statement, our gates are bad | 15:35 |
inc0 | so part of it is that as opposed to tripleo/osad and such, we don't really have any company supporting infra for us | 15:37 |
inc0 | 8gig of ram fails to deploy full openstack from time to time | 15:37 |
inc0 | also our gate infra is far from reliable | 15:37 |
Mech422 | inc0: what are the requirements for gate boxes ? | 15:39 |
inc0 | Mech422, so current vms in gates are 8gig of ram, no swap and such | 15:39 |
Mech422 | inc0: how many concurrent VMs ? | 15:40 |
inc0 | just aio | 15:40 |
inc0 | so it's really bad | 15:40 |
Mech422 | inc0: hmm.. we just did hardware refresh this year | 15:40 |
inc0 | Mech422, I'm talking about openstack infra | 15:40 |
Mech422 | inc0: so we have a bunch of supermicro 2U twins | 15:40 |
Mech422 | inc0: I might be able to talk my way into a couple for 'testing' or 'lab' use | 15:41 |
Mech422 | inc0: I think they're 2xquad with 32G RAM ? | 15:41 |
inc0 | well, issue is | 15:41 |
inc0 | it cant really work on infra | 15:41 |
inc0 | and voting gates are on infra | 15:41 |
Mech422 | inc0: oh - they have to be on OS's network...yeah, that probably won't fly | 15:42 |
Mech422 | inc0: unless we get a tax write-off...might be able to sell that | 15:42 |
inc0 | even if you'd donate hardware to infrea | 15:42 |
inc0 | they would just spawn 8gig vms ;) | 15:42 |
tloeb | pbourke: http://pastebin.com/2drK4ihb this is the output with -vvv ... he is using the right user | 15:42 |
Mech422 | inc0: you lost me...I thought you were doing 8G AIO because you didn't have a company supporting you with hardware ? | 15:42 |
dmsimard | inc0: puppet openstack uses 100% openstack-infra | 15:43 |
dmsimard | and they tackle ram limitation by using different scenarios | 15:43 |
dmsimard | inc0: https://github.com/openstack/puppet-openstack-integration#description | 15:43 |
dmsimard | so they don't have "one all-in-one" test, but rather 3 different scenarios with interesting matrix of configurations and components that is run on centos with rdo and on ubuntu with uca. | 15:44 |
Mech422 | dmsimard: so is the issue a lack of hardware, or just re-writing configuration tests ? | 15:45 |
pbourke | tloeb: I think you have a different issue now. Try running the 'cleanup' task of kolla-ansible | 15:45 |
pbourke | tloeb: then redeploy ceph | 15:45 |
*** mikelk has quit IRC | 15:45 | |
dmsimard | Mech422: gate jobs have to run within the constraints imposed by the virtual machines provided by -infra | 15:45 |
Mech422 | dmsimard: ahhh..... | 15:45 |
pbourke | our gate is pretty minimal though | 15:45 |
dmsimard | Mech422: from memory, VMs have 8 cores, 8GB of RAM and 80GB of space | 15:45 |
pbourke | we're not really testing anything outside the core services | 15:45 |
pbourke | inc0: Im not sure the problems are memory related... | 15:46 |
dmsimard | pbourke: that statement is concerning | 15:46 |
inc0 | btw I know what's wrong with out gates now | 15:46 |
inc0 | we need new images pushed to docker.io... | 15:46 |
inc0 | only sdake has access to it right? | 15:46 |
pbourke | the problems I've seen are often environmental | 15:46 |
dmsimard | pbourke: if you don't test every project implementation in kolla, how do you tell if it works ? | 15:46 |
pbourke | in that we're not setup to handle the varibilty in the base vms | 15:47 |
pbourke | dmsimard: we dont is the honest answer | 15:47 |
pbourke | its not uncommon for people to pull down big tent services and find they flat out dont work | 15:47 |
inc0 | we had discussion about ceph just today | 15:47 |
pbourke | dmsimard: but that could be solved by creating different scenarios as you say | 15:48 |
pbourke | first though we'd need to get the core compute solid | 15:48 |
dmsimard | yeah, one with cinder, one without cinder, one with glance swift backend, one with glance file backend, etc. | 15:48 |
coolsvap | inc0, we just got the kolla namespace on docker hub | 15:49 |
pbourke | inc0: are you -2 against scraping sgdisk | 15:49 |
coolsvap | also Jeffrey4l proposed the patch to stop pulling from docker hub | 15:49 |
inc0 | pbourke, sgdisk? we don't use sgdisk.... | 15:49 |
inc0 | we use udev (unless you mean something else than ceph) | 15:49 |
pbourke | we need to replace udev | 15:49 |
inc0 | ahh | 15:49 |
inc0 | I'm not -2, we just had lots and lots of issues with scrapping | 15:50 |
inc0 | particulary error handling was a horror story | 15:50 |
inc0 | coolsvap, can you paste a link to review plz? | 15:50 |
*** Lyncos has joined #openstack-kolla | 15:51 | |
pbourke | Mech422: maybe we can finish out your patch to use sgdisk everywhere | 15:51 |
pbourke | and trial it for a while | 15:51 |
coolsvap | inc0, which one? | 15:51 |
tloeb | pbourke, Mech422: ok thanks for the help! :) now we have something to work with for debugging | 15:51 |
coolsvap | patch 329735 is proposed by Jeffrey4l related to pull | 15:51 |
patchbot | coolsvap: https://review.openstack.org/#/c/329735/ - kolla - Remove the pull action in the deploy_aio CI | 15:51 |
inc0 | coolsvap, not pulling images from dockerhub | 15:51 |
pbourke | tloeb: np. am working through similar issues atm | 15:51 |
*** jrist has quit IRC | 15:52 | |
inc0 | ah cool | 15:52 |
*** dmk0202 has quit IRC | 15:52 | |
coolsvap | inc0, but the major gate failures recently are due to nova-compute container starting issue from my observation which i think we need to track where and why happens | 15:53 |
coolsvap | is it related to again any specific hardware | 15:53 |
Jeffrey4l | which issue coolsvap ? | 15:54 |
Jeffrey4l | nova-compute start issue? | 15:55 |
coolsvap | Jeffrey4l, let me give you an example wait | 15:55 |
*** SiRiuS__ has quit IRC | 15:55 | |
coolsvap | Jeffrey4l, http://logs.openstack.org/87/327987/1/check/gate-kolla-dsvm-deploy-centos-binary/432b175/console.html#_2016-06-13_10_14_38_100 | 15:56 |
*** sean-k-mooney has quit IRC | 15:57 | |
*** SiRiuS__ has joined #openstack-kolla | 15:57 | |
Jeffrey4l | coolsvap, i know this issue. | 15:57 |
Jeffrey4l | I debuged this. | 15:57 |
*** zhiwei has quit IRC | 15:57 | |
Jeffrey4l | and see this in my locally once. | 15:57 |
Jeffrey4l | I think it is a bug from keystone. | 15:57 |
Jeffrey4l | the endpoint is cached and not updated. | 15:57 |
*** severion has joined #openstack-kolla | 15:58 | |
Jeffrey4l | coolsvap, pbourke check the tokens here http://logs.openstack.org/87/327987/1/check/gate-kolla-dsvm-deploy-centos-binary/432b175/console.html#_2016-06-13_10_14_38_090 | 15:58 |
*** v1k0d3n has quit IRC | 15:58 | |
Jeffrey4l | there is only keystone and glance endpoint. no nova, neutron. | 15:58 |
Jeffrey4l | I think restart memcached may fix this issue. But i have not any proof now. | 15:59 |
Mech422 | pbourke: actually - that patch should be good as is... I rebuild with it about 2x day, and ceph always comes up | 15:59 |
Jeffrey4l | here is my debug PS https://review.openstack.org/327146 | 15:59 |
pbourke | Mech422: ok cool | 16:00 |
Mech422 | pbourke: but I only do partition based ceph - could you try it on whole disk setup? | 16:00 |
pbourke | Mech422: I will | 16:00 |
pbourke | Mech422: how do you do parttion base | 16:01 |
coolsvap | Jeffrey4l, cool | 16:01 |
pbourke | Mech422: the bootstrap script is not setup for that | 16:01 |
* coolsvap brb dinner | 16:01 | |
*** tloeb has quit IRC | 16:01 | |
Mech422 | pbourke: I mean I just run ceph on partitions - oh yeah it is...its just 'undocumented' | 16:01 |
pbourke | meeting? | 16:01 |
pbourke | rhallisey: ^ | 16:01 |
Jeffrey4l | i think we have meeting in 30 minute right? | 16:02 |
rhallisey | in 30 | 16:02 |
rhallisey | or not | 16:02 |
rhallisey | wait it's 16:00 now | 16:02 |
Mech422 | Jeffrey4l: I've noticed, after etc/kolla/admin-openrc.sh | 16:02 |
Mech422 | err...after sourcing etc/kolla/admin-openrc.sh | 16:02 |
rhallisey | is that right? | 16:02 |
* rhallisey checks ML | 16:02 | |
pbourke | 16:00 UTC | 16:03 |
Jeffrey4l | Mech422, what? | 16:03 |
Mech422 | I have to export export OS_INTERFACE=admin | 16:03 |
Mech422 | and export OS_ENDPOINT_TYPE=admin | 16:03 |
pbourke | Mech422: would you have time to document it? | 16:03 |
pbourke | or just give me the overall steps? | 16:03 |
Mech422 | to get /tools/init-runonce to work semi-right | 16:03 |
Mech422 | glance still chokes trying to upload cirros - wants to use the public endpoint | 16:04 |
*** mummer has joined #openstack-kolla | 16:04 | |
rhallisey | the meeting prio was 16:30, but it look like for this week I think people are expecting 16:00 | 16:04 |
Mech422 | also, init-runonce hard codes the public network subnet to 10.0.0.0 instead of looking at whats already there | 16:04 |
Jeffrey4l | sdake is not here too. | 16:05 |
pbourke | true | 16:05 |
Mech422 | (its a flat network, called 'public' - so it probably shouldn't assume it can assign stuff ) | 16:05 |
*** sdake has joined #openstack-kolla | 16:05 | |
*** athomas has quit IRC | 16:05 | |
rhallisey | sdake, meeting now? | 16:05 |
sdake | yup | 16:05 |
sdake | apologis for being late | 16:05 |
rhallisey | idk if it was a type but it was 16:30 before | 16:05 |
rhallisey | kk | 16:05 |
Mech422 | pbourke: this is my current 'post-deploy' http://pastebin.com/zdtNb8te | 16:06 |
rhallisey | wirehead_, dcwangmit01 guys around? | 16:06 |
rhallisey | join #openstack-meeting-4 | 16:06 |
pbourke | Mech422: for partition based ceph? | 16:07 |
Mech422 | pbourke: well - its not related to ceph, but yes - I use partitions for ceph | 16:08 |
Mech422 | pbourke: this is because my 'public' network is not accessible via deployement_host | 16:09 |
Mech422 | pbourke: err..actually, its the internal network, not public but same idea | 16:09 |
pbourke | Mech422: im interested in docs/general steps for ceph partititions | 16:11 |
*** jmccarthy has left #openstack-kolla | 16:13 | |
Mech422 | pbourke: oh - nothing really special - just change a partition name to 'CEPH_OSD_BOOTSTRAP_1' and change the name on the journal partition to 'CEPH_OSD_BOOTSTRAP_1_J; | 16:13 |
Mech422 | pbourke: repeat with _2, _3, etc as desired | 16:13 |
wirehead_ | Gah, didn't catch the typo. | 16:13 |
*** jmccarthy has joined #openstack-kolla | 16:13 | |
Mech422 | pbourke: here's the actual play I use to setup my disks : http://pastebin.com/1LcRfaPv | 16:16 |
pbourke | Mech422: thanks | 16:16 |
Mech422 | pbourke: :-) | 16:17 |
*** Serlex has quit IRC | 16:17 | |
*** severion has quit IRC | 16:18 | |
*** v1k0d3n has joined #openstack-kolla | 16:20 | |
*** jmccarthy has left #openstack-kolla | 16:20 | |
coolsvap | did we start meeting early? | 16:22 |
*** v1k0d3n has quit IRC | 16:23 | |
vhosakot | 7 mins to meeting | 16:23 |
Mech422 | it started... | 16:23 |
coolsvap | its already started 20 mins back | 16:23 |
Mech422 | #openstack-meeting-4 | 16:23 |
vhosakot | really ? | 16:23 |
*** v1k0d3n has joined #openstack-kolla | 16:24 | |
coolsvap | yes i went for dinner since there was half n hour | 16:24 |
*** mark-casey has joined #openstack-kolla | 16:24 | |
coolsvap | :( | 16:24 |
vhosakot | I went to grab lunch as well | 16:24 |
*** mdnadeem_home has joined #openstack-kolla | 16:25 | |
*** v1k0d3n has quit IRC | 16:27 | |
vhosakot | wow, everyone left | 16:27 |
openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla: Add customizations for apt keys and packages https://review.openstack.org/326688 | 16:27 |
openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla: Macro install packages https://review.openstack.org/326734 | 16:27 |
pbourke | coolsvap:were you not the one who proposed 16:00 :) | 16:27 |
Mech422 | sdake: hope ya feel better! | 16:28 |
vhosakot | sdake: take care | 16:28 |
coolsvap | pbourke, yeah | 16:28 |
coolsvap | and i feel so bad i missed it first up | 16:28 |
coolsvap | when the clock changed -30 mins | 16:28 |
coolsvap | i dont know | 16:28 |
pbourke | coolsvap: it happens | 16:29 |
rhallisey | inc0, meeting? | 16:30 |
*** ravig has quit IRC | 16:30 | |
inc0 | rhallisey, I have meetings irl now | 16:31 |
inc0 | so afk now | 16:31 |
rhallisey | kk | 16:31 |
inc0 | all saints came over to SAT | 16:31 |
inc0 | ;) | 16:31 |
inc0 | crazy week | 16:31 |
coolsvap | harlowja_, around? | 16:32 |
*** matrohon has quit IRC | 16:33 | |
*** mummer has quit IRC | 16:41 | |
*** ravig has joined #openstack-kolla | 16:41 | |
*** mummer has joined #openstack-kolla | 16:41 | |
*** sdake has quit IRC | 16:42 | |
*** mbound has joined #openstack-kolla | 16:43 | |
pbourke | dmsimard: discussing gates in openstack-meeting-4 now if you're around | 16:45 |
*** Lyncos has left #openstack-kolla | 16:48 | |
*** NobodyCam has quit IRC | 16:59 | |
*** mgkwill has quit IRC | 16:59 | |
*** NobodyCam has joined #openstack-kolla | 17:00 | |
harlowja_ | coolsvap whats up | 17:00 |
coolsvap | rhallisey, seriously i actually checked google for utc now | 17:00 |
wirehead_ | rhallisey: https://review.openstack.org/#/c/329676/ | 17:00 |
patchbot | wirehead_: patch 329676 - kolla-kubernetes - Consolidating path resolution and searching for pr... | 17:00 |
coolsvap | harlowja_, hey | 17:00 |
*** mgkwill has joined #openstack-kolla | 17:00 | |
coolsvap | regarding the tqdm review in requirements and related reviews in kolla | 17:01 |
harlowja_ | ya | 17:02 |
harlowja_ | i gotta fix those merge conflicts | 17:03 |
coolsvap | harlowja_, i wanted to know status from both you and reviewers | 17:03 |
coolsvap | if you can update the reviews | 17:03 |
harlowja_ | yup | 17:03 |
harlowja_ | i can | 17:03 |
harlowja_ | eventually consistent review patches | 17:03 |
harlowja_ | lol | 17:03 |
coolsvap | i want to test them first thing | 17:03 |
coolsvap | maybe tomorrow morning and i need to update the requirement team in couple of days | 17:04 |
harlowja_ | k | 17:04 |
coolsvap | the worst case is they will abandon the review and you will need to submit it again | 17:04 |
*** Jeffrey4l has quit IRC | 17:05 | |
harlowja_ | who's they | 17:05 |
harlowja_ | lol | 17:05 |
harlowja_ | i will find they and abandon them | 17:05 |
harlowja_ | lol | 17:05 |
coolsvap | harlowja_, thanks | 17:05 |
coolsvap | i am one of them | 17:06 |
harlowja_ | in russia the review abandons u | 17:06 |
harlowja_ | lol | 17:06 |
coolsvap | harlowja_, i will abandon myself for today time for some sleep will see for your patches tomorrow morning ;) | 17:06 |
harlowja_ | lol | 17:07 |
coolsvap | harlowja_, lol if pronounced in my native language means roll on bed :D | 17:08 |
Mech422 | coolsvap: heh - a roll on the bed is always good for a laugh :-) | 17:10 |
coolsvap | Mech422, :) | 17:11 |
*** coolsvap has quit IRC | 17:11 | |
*** sacharya has quit IRC | 17:11 | |
Mech422 | so it appears augeas is already being used for some openstack stuff... | 17:12 |
*** sacharya has joined #openstack-kolla | 17:12 | |
harlowja_ | it is? | 17:15 |
*** harbie has joined #openstack-kolla | 17:21 | |
*** ravig has quit IRC | 17:26 | |
*** ravig has joined #openstack-kolla | 17:27 | |
Mech422 | harlowja_: yeah - I saw some bug reports about nova trying to call augeas | 17:27 |
Mech422 | harlowja_: trying to find the lenses now | 17:28 |
harlowja_ | interesting | 17:28 |
openstackgerrit | Merged openstack/kolla: Revert "Added precheck to check kernel version 4.2 on Ubuntu 14.04." https://review.openstack.org/329808 | 17:28 |
openstackgerrit | Merged openstack/kolla: Remove the pull action in the deploy_aio CI https://review.openstack.org/329735 | 17:28 |
*** fragatina has quit IRC | 17:29 | |
*** v1k0d3n has joined #openstack-kolla | 17:39 | |
*** sacharya_ has joined #openstack-kolla | 17:40 | |
rhallisey | wirehead_, nice | 17:41 |
*** ravig has quit IRC | 17:42 | |
*** sacharya has quit IRC | 17:43 | |
*** v1k0d3n has quit IRC | 17:44 | |
*** mdnadeem_home has quit IRC | 17:44 | |
dcwangmit01 | wirehead_: rhallisey: I see enough +2's for these patches, but they don't seem to be merging 328569 (2+1's, 2+2's)# Keystone interface address and memcached override | 17:49 |
dcwangmit01 | 327987 (4+1's, 2+2's)# Fix interface address for memcached atop kubernetes | 17:49 |
dcwangmit01 | 327925 (2+1's, 1+2's)# Enable kolla k8s to override bind api bind address in genconfig | 17:49 |
dcwangmit01 | 321529 (4+1's, 2+2's)# Add kolla-kubernetes bootstrap capability to Keystone | 17:49 |
rhallisey | dcwangmit01, they're dependant on https://review.openstack.org/#/c/327925/ | 17:50 |
patchbot | rhallisey: patch 327925 - kolla - Enable kolla k8s to override bind api bind address... | 17:50 |
rhallisey | which needs 1 more +2 | 17:50 |
dcwangmit01 | Got it | 17:51 |
dcwangmit01 | rhallisey: Where is the dependency link set? I would expect it in the Commit message. I don't see the dependency anywhere on the gerrit page for dependent nor dependee | 17:55 |
dcwangmit01 | ^ Sorry new to openstack /gerrit process | 17:55 |
wirehead_ | If you have the previous patch in your git log, it’ll automatically set a link and it won’t make it especially clear that’s the case. | 17:56 |
rhallisey | those patches were made on top of that patch I linked | 17:56 |
dcwangmit01 | Oh, so if I create a change off of a branch from a prior review, it is auto | 17:56 |
wirehead_ | yeah | 17:59 |
wirehead_ | The UI there is very un-clear. | 17:59 |
wirehead_ | Then again, I don’t think GitHub’s is that much better in those cases. | 17:59 |
dcwangmit01 | Github is pretty dumb about it. The 2nd PR based off of the 1st will show all of the changes from the 1st. | 18:00 |
dcwangmit01 | Gerrit seems better in this case | 18:00 |
dcwangmit01 | And I can't believe I just said that | 18:00 |
wirehead_ | Yeah. The current missing feature in source control tooling is the ability to land a large deeply integrated feature while still reviewing it properly. | 18:02 |
dmsimard | pbourke: was not around, sorry | 18:04 |
*** mbound has quit IRC | 18:06 | |
dcwangmit01 | wirehead_: I do miss the ability to have a release branch. I keep cherry-picking/re-merging the same 7 patches from kolla. I have no idea whether I'm testing with the same code as you and rhallisey | 18:06 |
dcwangmit01 | ^ less a release branch, but more a branch for patches that have not been merged. | 18:07 |
*** fragatina has joined #openstack-kolla | 18:08 | |
esharao__ | hi..i'm getting "Container exited with non-zero return code" for TASK [keystone : Running Keystone bootstrap container] | 18:11 |
dmsimard | rhallisey, pbourke, saw the meeting log about gate jobs. Thanks for the attention. | 18:12 |
*** vhosakot has quit IRC | 18:13 | |
*** vhosakot has joined #openstack-kolla | 18:21 | |
inc0 | I'm back | 18:22 |
wirehead_ | I’m still wirehead. | 18:22 |
inc0 | ahhh these jokes | 18:26 |
inc0 | all the laught | 18:26 |
inc0 | ;) | 18:26 |
*** salv-orlando has quit IRC | 18:43 | |
esharao__ | hi I tried to run kolla-ansible -vvv deploy but it does not tell me why my keystone container is failing.. any other place to look? | 18:44 |
*** salv-orlando has joined #openstack-kolla | 18:44 | |
*** mummer has quit IRC | 18:45 | |
*** SiRiuS__ has quit IRC | 18:54 | |
*** zhiwei has joined #openstack-kolla | 18:54 | |
*** salv-orl_ has joined #openstack-kolla | 18:55 | |
*** salv-orlando has quit IRC | 18:58 | |
*** zhiwei has quit IRC | 18:59 | |
*** mbound has joined #openstack-kolla | 19:06 | |
*** mbound has quit IRC | 19:11 | |
inc0 | esharao__, docker logs keystone | 19:14 |
*** mliima has quit IRC | 19:22 | |
*** ravig has joined #openstack-kolla | 19:24 | |
openstackgerrit | Joshua Harlow proposed openstack/kolla: Stop using a global logger for all the things https://review.openstack.org/321884 | 19:32 |
*** openstackgerrit has quit IRC | 19:33 | |
*** openstackgerrit has joined #openstack-kolla | 19:33 | |
*** mummer has joined #openstack-kolla | 19:34 | |
*** sdake has joined #openstack-kolla | 19:36 | |
inc0 | yo sdake are you alive? | 19:36 |
sdake | barely | 19:37 |
sdake | 2 hours of driving | 19:37 |
sdake | after cleaning up, well you know, cleaning up | 19:37 |
vhosakot | sdake: you ok? | 19:37 |
*** ravig has quit IRC | 19:38 | |
*** sdake_ has joined #openstack-kolla | 19:40 | |
*** sdake has quit IRC | 19:42 | |
*** ravig has joined #openstack-kolla | 19:42 | |
*** d_code has quit IRC | 19:43 | |
inc0 | guys can I have eyes on this one? https://review.openstack.org/#/c/326734 | 19:45 |
*** salv-orl_ has quit IRC | 19:45 | |
*** salv-orlando has joined #openstack-kolla | 19:45 | |
openstackgerrit | Joshua Harlow proposed openstack/kolla: Be smarter about what to do when making a docker client https://review.openstack.org/330171 | 19:46 |
*** SiRiuS__ has joined #openstack-kolla | 19:46 | |
*** ravig has quit IRC | 19:48 | |
*** mark-casey has left #openstack-kolla | 19:53 | |
esharao__ | inc0, it says no such container as keystone | 19:58 |
Mech422 | harlowja_: btw - is anything supposed to be kibana besides keystone-apache logs? I don't know kibana, but with a quick look, thats all I found | 19:59 |
Mech422 | inc0: btw - have you seen augeas ( http://augeas.net ) | 19:59 |
harlowja_ | Mech422 not sure | 19:59 |
Mech422 | inc0: it might help with your merge stuff ? | 19:59 |
rhallisey | esharao__, do a `sudo docker ps -a` | 19:59 |
rhallisey | esharao__, there's no keystone container there? | 20:00 |
Mech422 | inc0: (well, the non-ini file stuff) | 20:00 |
esharao__ | 0836381a1ec4 operator.local:4000/lokolla/centos-binary-keystone:3.0.0 "kolla_start" About an hour ago Exited (1) About an hour ago bootstrap_keystone | 20:00 |
esharao__ | rhallisey, no.. i do not see any that are up and running.. | 20:00 |
inc0 | esharao__, docker logs bootstrap_keystone then;) | 20:01 |
rhallisey | esharao__, docker logs boostrap_keystone | 20:01 |
esharao__ | got it after adding sudo... :) ImportError: cannot import name ssl_match_hostname | 20:02 |
inc0 | Mech422, I was rather thinking about using https://review.openstack.org/#/c/326734 | 20:02 |
inc0 | http://docs.ansible.com/ansible/lineinfile_module.html this one | 20:02 |
inc0 | paste fail | 20:02 |
esharao__ | http://pastebin.com/e4kTvsse | 20:03 |
*** ppowell has quit IRC | 20:03 | |
inc0 | esharao__, what distro you use/install type? | 20:04 |
esharao__ | centos (via vagrant) | 20:04 |
Mech422 | inc0: eewww...line in file ? really? why oh why ? :-P | 20:04 |
inc0 | Mech422, I like regex => replace | 20:05 |
Mech422 | inc0: look at the nice interface augeas gives you, and the huge number of formats it supports... | 20:05 |
Mech422 | inc0: I agree regex is pretty easy to understand...but just eww | 20:05 |
Mech422 | inc0: I do like 30 lininfiles to dynamically build my /etc/hosts - it's really nasty | 20:06 |
*** sdake_ has quit IRC | 20:07 | |
*** sdake has joined #openstack-kolla | 20:07 | |
Mech422 | inc0: Anyway, it was just a thought | 20:07 |
*** sdake_ has joined #openstack-kolla | 20:11 | |
Mech422 | harlowja_: thanks - it might just be something stupid on my end | 20:11 |
*** sdake has quit IRC | 20:12 | |
*** ravig has joined #openstack-kolla | 20:13 | |
mag009_ | how do I specify the version of docker image ? | 20:13 |
mag009_ | let say I want to build image for mitaka | 20:14 |
*** ravig has quit IRC | 20:14 | |
*** matrohon has joined #openstack-kolla | 20:16 | |
mag009_ | ok nvm i found it | 20:19 |
Mech422 | mitaka should use 3.0.0 I believe | 20:23 |
*** sdake_ has quit IRC | 20:27 | |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: GATE TESTING https://review.openstack.org/330192 | 20:28 |
*** matrohon has quit IRC | 20:34 | |
*** zhiwei has joined #openstack-kolla | 20:39 | |
*** zhiwei has quit IRC | 20:44 | |
Mech422 | rhallisey: ok - so how do I get started testing koll/k8s ? | 20:45 |
*** neilus has quit IRC | 20:45 | |
rhallisey | Mech422, so start here: https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/quickstart.rst | 20:46 |
Mech422 | rhallisey: Danke | 20:46 |
rhallisey | Mech422, there are a bunch of patches sitting in both kolla/kolla-kubernetes queue that will fix bootstrapping, CLI, ect... | 20:46 |
rhallisey | hopefully they will merge soon so you don't have to carry like 6 patches in your branches | 20:47 |
Mech422 | rhallisey: ok - I'll give it a try... | 20:47 |
rhallisey | Mech422 the patches you'll need are here: https://etherpad.openstack.org/p/GTAZV0AXm8 | 20:47 |
rhallisey | awesome | 20:47 |
wirehead_ | yay | 20:50 |
Mech422 | rhallisey: oh - I have to setup k8 manually ? | 20:50 |
rhallisey | Mech422, you can use hypecube | 20:50 |
Mech422 | this'll be fun - never did k8 before | 20:50 |
rhallisey | it will setup kubernetes running in containers | 20:50 |
Mech422 | rhallisey: cool :-) | 20:50 |
Mech422 | rhallisey: like I said - never did k8 before, so expect a bunch of really-stupid-noob questions tommorrow :-) | 20:51 |
rhallisey | no problem | 20:51 |
wirehead_ | Mech422: I’m usually on later than rhallisey, so feel free to ask away. | 20:52 |
Mech422 | wirehead_: LOL - got me working all night, eh ? :-P | 20:52 |
* Mech422 makes more coffee | 20:52 | |
wirehead_ | Well, hopefully it won’t take all night. :D | 20:53 |
Mech422 | wirehead_: it'll be a while - I gotta build my ansible bootstrap stuff for it | 20:54 |
*** ravig has joined #openstack-kolla | 20:54 | |
Mech422 | wirehead_: but once thats done, I can re-build and re-deploy a couple of times a day to test stuff | 20:54 |
*** v1k0d3n has joined #openstack-kolla | 20:57 | |
*** ravig has quit IRC | 20:58 | |
*** ravig has joined #openstack-kolla | 20:59 | |
*** ravig has quit IRC | 21:03 | |
Mech422 | wirehead_: so bare-metal + docker multinode a good starting point? http://kubernetes.io/docs/getting-started-guides/docker-multinode/ | 21:08 |
wirehead_ | Mech422: So bunches of stuff probably still breaks in the multinode case. | 21:09 |
Mech422 | wirehead_: oh - well, only one way to find out... | 21:09 |
wirehead_ | True. :) | 21:09 |
wirehead_ | You also can probably just run it on GKE. | 21:09 |
Mech422 | wirehead_: this builds a 2 node cluster with flanneld | 21:10 |
Mech422 | wirehead_: now, where would the fun be in that... cheater :-P | 21:10 |
wirehead_ | Or via the Kubernetes Vagrant, which also gives you multinode. | 21:10 |
Mech422 | I don't have a google account setup - I could do aws if you really want... | 21:10 |
Mech422 | but I sorta wanna play with setting it up from scratch - bout time I learned some k8 | 21:11 |
wirehead_ | So, dcwangmit01 has been using the Ansible playbooks to fire up bare metal Kube clusters. | 21:11 |
wirehead_ | That’s where the community seems to be moving. | 21:12 |
*** ravig has joined #openstack-kolla | 21:12 | |
wirehead_ | Those instructions ought to work. | 21:12 |
wirehead_ | You might have some fun with the DNS part. | 21:12 |
Mech422 | wirehead_: oh - let me see if I can find the ansible stuff | 21:13 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla-kubernetes: WIP - kolla-kubernetes gate https://review.openstack.org/330226 | 21:13 |
wirehead_ | https://github.com/kubernetes/contrib/tree/master/ansible | 21:14 |
*** ravig has quit IRC | 21:14 | |
rhallisey | wirehead_, I have some ideas to change the way we bootstrap/deploy | 21:15 |
rhallisey | I'll go over them tmr | 21:15 |
wirehead_ | rhallisey: k. I’m not entirely pleased with the present status. | 21:16 |
rhallisey | wirehead_, ya we're still getting rolling | 21:16 |
wirehead_ | rhallisey: so, changes good. | 21:16 |
rhallisey | tons to iron out | 21:16 |
Mech422 | wirehead_: these playbooks ? https://github.com/kubernetes/contrib/tree/master/ansible | 21:16 |
rhallisey | the more we play with this the higher likely hood we find new ways to use it | 21:17 |
wirehead_ | Mech422: yah | 21:17 |
rhallisey | see ya tmr | 21:17 |
Mech422 | wirehead_: thanks | 21:17 |
Mech422 | rhallisey: later! | 21:17 |
wirehead_ | later, rhallisey | 21:17 |
rhallisey | Mech422, good luck! :) | 21:17 |
*** rhallisey has quit IRC | 21:17 | |
Mech422 | wirehead_: blah - these only talk about supporting RH/Centos... lets see if it chokes on ubuntu | 21:19 |
*** ravig has joined #openstack-kolla | 21:21 | |
wirehead_ | Mech422: http://kubernetes.io/docs/getting-started-guides/ubuntu/ | 21:22 |
Mech422 | wirehead_: I can do that - you want flannel right ? Ubuntu 14 or 16 ? | 21:24 |
wirehead_ | 14. | 21:25 |
Mech422 | oh yeah - this guide doesnt like systemd | 21:25 |
wirehead_ | Mech422: Also, https://github.com/kubernetes/contrib/pull/761 | 21:25 |
wirehead_ | The docs in Kubernetes are starting to lag. | 21:27 |
dcwangmit01 | Mech422: If you want Kube on bare metal: https://www.davidwang.com/2016/05/21/kubernetes-bare-metal-install-on-packet-net/ | 21:27 |
dcwangmit01 | wirehead_: DNS works in the case above ^. kubernetes/contrib/ansible is awesome | 21:27 |
harlowja_ | qq, for the kube stuff, is there a doc for how kube and kolla work? | 21:27 |
harlowja_ | (am curious to see how it works together as a whole system) | 21:28 |
wirehead_ | harlowja_: https://review.openstack.org/#/c/304182/ | 21:28 |
patchbot | wirehead_: patch 304182 - kolla - Spec: Deploy Kolla images using Kubernetes | 21:28 |
wirehead_ | harlowja_: As to how it’ll work long-term… | 21:29 |
esharao__ | wirehead_, kolla-kubernetes does not work on ubuntu 16? | 21:30 |
dcwangmit01 | harlowja_: Here are some operational notes I have on how to use Kolla with Kolla-Kubernetes: https://gist.github.com/dcwangmit01/553645bc018f5bc4a36a78a5f786dee2 | 21:30 |
harlowja_ | wirehead_ fair enough :) | 21:30 |
wirehead_ | I have no idea. I am testing against Ubuntu 14. | 21:30 |
esharao__ | i'm having issues getting the docker to 1.10.3 | 21:30 |
wirehead_ | harlowja_: The big thing to understand is that the containers of Kolla work more-or-less as they do in regular Kolla, it’s just we’re taking advantage of the Kubernetes network layer and service framework. | 21:31 |
harlowja_ | yup | 21:31 |
harlowja_ | and all that state ... | 21:31 |
harlowja_ | the state, oh the sate | 21:31 |
harlowja_ | *state | 21:31 |
wirehead_ | harlowja_: Depends on the service, of course. | 21:31 |
harlowja_ | sure | 21:31 |
wirehead_ | harlowja_: e.g. Keystone seems fairly happy. | 21:31 |
harlowja_ | i mean, we were just discussing how something like zookeeper would run in kube | 21:32 |
harlowja_ | so that makes me wonder how something like galeria runs in kube to | 21:32 |
harlowja_ | and how do those services handle running in such a enivornment | 21:32 |
wirehead_ | harlowja_: After 1.3, something like this: https://github.com/kubernetes/contrib/tree/master/pets | 21:32 |
harlowja_ | :-/ | 21:32 |
harlowja_ | ya, that's not what i like :( | 21:32 |
harlowja_ | cause zookeeper really isn't a pet, mysql maybe u could say it is | 21:33 |
Mech422 | ok - so I'll follow davids link first - then we have two 'identical' setups to test with | 21:33 |
Mech422 | if needed, I can do others - coreos, etc | 21:33 |
harlowja_ | wirehead_ something sorta of feels wrong (imho) if things that are cloudy-solutions have to be called pets to work in kube | 21:33 |
harlowja_ | and/or feels off | 21:34 |
wirehead_ | Well, ElasticSearch and Cassandra work magically in Kube. | 21:34 |
harlowja_ | right, so i guess whats the underlying reason why those are different than say zookeeper? | 21:34 |
wirehead_ | No gossip. | 21:34 |
harlowja_ | so kube needs to handle things that do gossip better? | 21:35 |
wirehead_ | ElasticSearch and Cassandra need to know a list of ‘seed’ servers and then they gossip amongst themselves. | 21:35 |
harlowja_ | right, i thought zookeeper was getting similar stuff | 21:35 |
wirehead_ | Zookeeper needs to have a rigid set of servers. | 21:35 |
harlowja_ | hmmmmm, think that has changed, let me check | 21:36 |
harlowja_ | * https://zookeeper.apache.org/doc/trunk/zookeeperReconfig.html | 21:36 |
harlowja_ | might not be total gossip based i guess, but still more dynamic | 21:37 |
*** jtriley has quit IRC | 21:39 | |
wirehead_ | Like, having looked at installing it in 1.2, ZK has many attributes that make it more cattle. You can kill zk instances and respawn and things are fine. | 21:39 |
*** ravig has quit IRC | 21:39 | |
wirehead_ | It’s just it’s got some necessarily stateful infra to prevent footguns. | 21:39 |
harlowja_ | ya, i think that is starting to change | 21:39 |
harlowja_ | with some of this dynamic reconfiguration (And then i guess discovery features) | 21:39 |
wirehead_ | So, just because it’s a PetSet doesn’t mean it’s not able to be turned into a crunchy milkshake. | 21:39 |
wirehead_ | If you know what I mean. | 21:39 |
harlowja_ | lol | 21:39 |
*** ravig has joined #openstack-kolla | 21:40 | |
harlowja_ | what's the best place to read about all the things PetSets will have/do/make them special | 21:40 |
wirehead_ | Heh heh. | 21:40 |
wirehead_ | Find a Kube core at a conference and buy them a drink? | 21:40 |
wirehead_ | They are all heads-down at the moment getting 1.3 out the door. | 21:41 |
harlowja_ | lol | 21:43 |
harlowja_ | hmmmm, fair enough | 21:43 |
*** ravig has quit IRC | 21:44 | |
*** ravig has joined #openstack-kolla | 21:44 | |
wirehead_ | Yah, I can’t find any doc patches. | 21:45 |
harlowja_ | :( | 21:45 |
harlowja_ | i'd have liked that, pets seem like they require a bunch of dicussion and agreement on why they are in kube before they get added, hope that kind of discussion happened :-/ | 21:46 |
harlowja_ | cause it'd be nice to have plans to make those things not pets before adding them, lol | 21:46 |
wirehead_ | https://github.com/kubernetes/kubernetes/issues/260 | 21:46 |
wirehead_ | I’d say so. :D | 21:46 |
harlowja_ | ya, hmmmm, nobody mentioned about fixing zookeeper (as i read comments) | 21:47 |
harlowja_ | or using https://zookeeper.apache.org/doc/trunk/zookeeperReconfig.html#sc_reconfig_retrieving | 21:47 |
wirehead_ | I think they call it “zk” most of the time. | 21:47 |
wirehead_ | PetSets weren’t specifically for zk, tho. So, while the zk-side reconfig changes will make it work better in kube, there’s plenty of other stuff that needs the same abstractions. | 21:50 |
harlowja_ | ya, kick that shit out of kube ;) | 21:50 |
harlowja_ | that fixes the glitch | 21:50 |
harlowja_ | ha | 21:50 |
wirehead_ | Overall, the Kube style is to provide working abstractions to solve categories of problems. | 21:51 |
wirehead_ | This tends to mean that you need to do minor adjustments at times to fit your problems into the abstraction. | 21:51 |
Mech422 | wirehead_: btw - anyone testing atomic with this stuff ? | 21:53 |
Mech422 | wirehead_: thats RH's k8 stuff right ? | 21:53 |
wirehead_ | Maybe rhallisey? | 21:53 |
Mech422 | wait - GKE is not a GCE ? | 21:53 |
Mech422 | I thought you were just typoing...whats GKE ? | 21:54 |
wirehead_ | Google Container Engine, GKE. | 21:54 |
wirehead_ | Google Compute Engine, GCE. | 21:54 |
Mech422 | oh...I see... | 21:54 |
* Mech422 blinks | 21:54 | |
wirehead_ | GKE runs atop GCE. Basically, Google runs a HA master for you and your compute nodes just execute your compute traffic. | 21:54 |
*** arafferty_ has joined #openstack-kolla | 21:56 | |
*** mummer has quit IRC | 21:57 | |
*** inc0 has quit IRC | 22:02 | |
*** openstackgerrit has quit IRC | 22:02 | |
*** openstackgerrit has joined #openstack-kolla | 22:05 | |
*** arafferty_ has quit IRC | 22:06 | |
*** ravig has quit IRC | 22:06 | |
*** kimk0316 has quit IRC | 22:07 | |
*** mummer has joined #openstack-kolla | 22:07 | |
*** mbound has joined #openstack-kolla | 22:10 | |
*** dwalsh has quit IRC | 22:10 | |
openstackgerrit | Ken Wronkiewicz proposed openstack/kolla-kubernetes: Create ConfigMaps with dashes instead of underscores https://review.openstack.org/330247 | 22:23 |
*** ravig has joined #openstack-kolla | 22:25 | |
*** salv-orlando has quit IRC | 22:25 | |
*** salv-orlando has joined #openstack-kolla | 22:26 | |
*** vhosakot has quit IRC | 22:31 | |
esharao__ | how to get ansible 2.0.. on ubuntu 14.. i keep getting 2.1 | 22:32 |
*** ravig has quit IRC | 22:35 | |
*** ravig has joined #openstack-kolla | 22:36 | |
*** ravig has quit IRC | 22:38 | |
*** ravig has joined #openstack-kolla | 22:39 | |
*** esharao__ has quit IRC | 22:40 | |
*** ravig has quit IRC | 22:47 | |
openstackgerrit | Merged openstack/kolla-kubernetes: Check for a local kolla directory https://review.openstack.org/329090 | 22:54 |
openstackgerrit | Merged openstack/kolla-kubernetes: Switching Horizon over to work via Kubernetes network https://review.openstack.org/329204 | 22:54 |
*** zhiwei has joined #openstack-kolla | 22:55 | |
kklimonda | hmm, I've deployed liberty from ubuntu-source, and nova-novncproxy is failing because it's trying to listen on 0.0.0.0:6080, and failing to bind because HAProxy is already listening on that port. I have some extra repositories added to base docker image, but novncproxy is using virtualenv, so that shouldn't cause any issue. | 22:55 |
*** sacharya_ has quit IRC | 22:56 | |
Mech422 | kklimonda: AIO deploy ? | 22:56 |
Mech422 | kklimonda: I thought I had liberty working... | 22:57 |
kklimonda | no, multi node | 22:57 |
Mech422 | kklimonda: to be honest though, I'm too lazy to go back and check - it was a pain changing stuff to work with ansible 2 | 22:57 |
Mech422 | kklimonda: I build ubuntu from source, and run multi-node - but I don't recall that issue | 22:58 |
Mech422 | kklimonda: then again, I might have switched to mitaka before I got stuff working | 22:58 |
*** zhiwei has quit IRC | 23:00 | |
kklimonda | mhm, I'll try deploying tomorrow without my patches and see if perhaps I broke something - didn't touch nova-novncproxy image at all though | 23:00 |
*** sacharya has joined #openstack-kolla | 23:00 | |
*** mummer has quit IRC | 23:01 | |
*** sacharya_ has joined #openstack-kolla | 23:02 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!