Monday, 2016-06-13

*** tyrola has joined #openstack-kolla00:07
*** tyrola has quit IRC00:13
*** ravig has quit IRC00:25
*** daneyon_ has joined #openstack-kolla00:30
*** daneyon_ has quit IRC00:34
*** ssurana has joined #openstack-kolla00:41
*** ravig has joined #openstack-kolla00:52
*** ravig has quit IRC00:59
openstackgerritJeffrey Zhang proposed openstack/kolla: DO NOT MERGE: debug the publicURL endpoint for compute service  https://review.openstack.org/32714601:09
*** ssurana has quit IRC01:15
*** zhiwei has joined #openstack-kolla01:21
*** tfukushima has joined #openstack-kolla01:24
*** cfarquhar has quit IRC01:24
*** cfarquhar has joined #openstack-kolla01:29
*** cfarquhar has quit IRC01:29
*** cfarquhar has joined #openstack-kolla01:29
*** david-lyle has quit IRC01:34
openstackgerritJeffrey Zhang proposed openstack/kolla: DO NOT MERGE: debug the publicURL endpoint for compute service  https://review.openstack.org/32714601:36
*** tfukushima has quit IRC01:52
*** rhallisey has quit IRC02:06
*** ssurana has joined #openstack-kolla02:07
*** ssurana has quit IRC02:13
*** ssurana has joined #openstack-kolla02:13
*** daneyon_ has joined #openstack-kolla02:18
*** tfukushima has joined #openstack-kolla02:18
*** daneyon_ has quit IRC02:23
*** sacharya has joined #openstack-kolla02:27
*** ravig has joined #openstack-kolla02:47
*** ayoung has quit IRC02:48
*** klint has joined #openstack-kolla02:53
*** williamcaban has quit IRC02:58
*** ravig has quit IRC03:12
*** ravig has joined #openstack-kolla03:13
*** coolsvap has joined #openstack-kolla03:20
*** ravig has quit IRC03:48
*** williamcaban has joined #openstack-kolla03:50
*** ravig has joined #openstack-kolla03:52
*** ravig has quit IRC03:55
*** williamcaban has quit IRC03:56
*** ravig has joined #openstack-kolla03:56
*** ravig has quit IRC04:03
*** daneyon_ has joined #openstack-kolla04:07
*** ssurana has quit IRC04:09
*** ssurana has joined #openstack-kolla04:10
*** sacharya has quit IRC04:10
*** ssurana has quit IRC04:10
*** ravig has joined #openstack-kolla04:10
*** daneyon_ has quit IRC04:11
*** ssurana has joined #openstack-kolla04:12
*** ssurana has quit IRC04:14
*** ssurana has joined #openstack-kolla04:14
*** ssurana has quit IRC04:23
*** ssurana has joined #openstack-kolla04:23
*** ssurana has quit IRC04:23
*** tfukushima has quit IRC05:10
*** salv-orlando has joined #openstack-kolla05:21
*** salv-orl_ has quit IRC05:21
*** tfukushima has joined #openstack-kolla05:21
*** dave-mccowan has quit IRC05:27
*** salv-orl_ has joined #openstack-kolla05:29
*** salv-orlando has quit IRC05:31
openstackgerritJeffrey Zhang proposed openstack/kolla: DO NOT MERGE: debug the publicURL endpoint for compute service  https://review.openstack.org/32714606:05
mdnadeem_coolsvap,  I face an issue with nova nova-novncproxy container, the command nova-novncproxy gets fail with the  <WARNING: no 'numpy' module, HyBi protocol will be slower>06:13
coolsvapmdnadeem_, it fails with warning?06:14
mdnadeem_yes06:14
coolsvapmdnadeem_, not sure atm, need to verify06:15
mdnadeem_coolsvap, here is log http://pastebin.com/qTPnYTTH06:15
mdnadeem_coolsvap,  nova.conf >> http://pastebin.com/D3Qvt4r406:15
coolsvapmdnadeem_, i will check and get back to you on this, currently occupied with something else06:19
mdnadeem_coolsvap, Thanks06:20
*** ravig has quit IRC06:23
*** daneyon_ has joined #openstack-kolla06:49
*** daneyon_ has quit IRC06:54
mdnadeem_coolsvap, Here is the traceback logs for nova-novncproxy container : http://pastebin.com/yL0dMQ38, please check once get free07:01
mdnadeem_>> http://pastebin.com/yL0dMQ3807:01
openstackgerritJeffrey Zhang proposed openstack/kolla: DO NOT MERGE: TEST MASTER BRANCH  https://review.openstack.org/29490607:03
*** salv-orl_ has quit IRC07:07
*** salv-orlando has joined #openstack-kolla07:08
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the openstack_release variable in all.yml  https://review.openstack.org/32887307:08
*** Jeffrey4l has joined #openstack-kolla07:09
*** matrohon has joined #openstack-kolla07:16
*** sbezverk_ has joined #openstack-kolla07:16
*** sbezverk has quit IRC07:17
*** athomas has joined #openstack-kolla07:25
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the novnc configure in the nova.conf  https://review.openstack.org/32888207:38
*** mikelk has joined #openstack-kolla07:38
*** mikelk has quit IRC07:41
*** jamie_h has joined #openstack-kolla07:42
*** mikelk has joined #openstack-kolla07:47
openstackgerritJeffrey Zhang proposed openstack/kolla: Remove the duplication of the inventory  https://review.openstack.org/32889108:06
*** tyrola has joined #openstack-kolla08:17
*** shardy has joined #openstack-kolla08:18
*** shardy has quit IRC08:21
*** salv-orlando has quit IRC08:23
*** salv-orlando has joined #openstack-kolla08:24
*** Serlex has joined #openstack-kolla08:34
*** daneyon_ has joined #openstack-kolla08:37
*** daneyon_ has quit IRC08:42
*** dmk0202 has joined #openstack-kolla08:44
*** tfukushima has quit IRC08:50
*** tfukushima has joined #openstack-kolla08:51
*** fragatin_ has quit IRC08:52
*** SiRiuS__ has joined #openstack-kolla09:12
*** jmccarthy has quit IRC10:04
*** athomas has quit IRC10:10
*** pbourke has quit IRC10:14
*** pbourke has joined #openstack-kolla10:15
*** athomas has joined #openstack-kolla10:17
*** jmccarthy has joined #openstack-kolla10:18
openstackgerritMerged openstack/kolla: Fix the openstack_release variable in all.yml  https://review.openstack.org/32887310:20
*** daneyon_ has joined #openstack-kolla10:26
*** daneyon_ has quit IRC10:30
*** mikelk has quit IRC10:41
*** tfukushima has quit IRC10:41
openstackgerritTuan proposed openstack/kolla: Fix typos in Kolla  https://review.openstack.org/32894310:48
*** alyson_ has joined #openstack-kolla10:56
mdnadeem_pbourke, Can you please re-visit this ps : https://review.openstack.org/#/c/285138/11:00
patchbotmdnadeem_: patch 285138 - kolla - Added unit test for kolla_docker11:00
*** williamcaban has joined #openstack-kolla11:02
mdnadeem_pbourke, Thanks :)11:03
pbourkenp11:03
*** mikelk has joined #openstack-kolla11:04
openstackgerritMerged openstack/kolla: Added unit test for kolla_docker  https://review.openstack.org/28513811:05
*** alyson_ has left #openstack-kolla11:06
*** salv-orlando has quit IRC11:07
*** salv-orlando has joined #openstack-kolla11:08
*** williamcaban has quit IRC11:11
*** rhallisey has joined #openstack-kolla11:25
openstackgerritMd Nadeem proposed openstack/kolla: Added test document  https://review.openstack.org/32806911:26
*** salv-orl_ has joined #openstack-kolla11:28
openstackgerritJeffrey Zhang proposed openstack/kolla: DO NOT MERGE: debug the publicURL endpoint for compute service  https://review.openstack.org/32714611:31
*** salv-orlando has quit IRC11:32
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/32896011:38
*** williamcaban has joined #openstack-kolla11:40
*** mliima has joined #openstack-kolla11:47
*** Jeffrey4l has quit IRC11:48
*** Jeffrey4l has joined #openstack-kolla11:49
*** williamcaban has quit IRC12:00
*** coolsvap has quit IRC12:25
*** prithiv has joined #openstack-kolla12:31
*** ppowell has joined #openstack-kolla12:49
*** tyrola has quit IRC12:54
*** stvnoyes has quit IRC12:59
*** stvnoyes has joined #openstack-kolla13:00
*** klint has quit IRC13:00
*** sgordon` has joined #openstack-kolla13:01
*** dave-mccowan has joined #openstack-kolla13:03
*** daneyon_ has joined #openstack-kolla13:08
*** ayoung has joined #openstack-kolla13:09
*** daneyon_ has quit IRC13:12
*** jtriley has joined #openstack-kolla13:16
*** diogogmt has quit IRC13:26
*** prithiv has quit IRC13:27
*** prithiv has joined #openstack-kolla13:29
*** ravig has joined #openstack-kolla13:30
rhalliseywirehead_, when you're around, I got the keystone bootstrap working13:37
*** diogogmt has joined #openstack-kolla13:39
*** ravig has quit IRC13:40
*** prithiv has quit IRC13:51
*** prithiv has joined #openstack-kolla13:52
*** diogogmt has quit IRC13:53
*** Liuqing has joined #openstack-kolla13:58
*** diogogmt has joined #openstack-kolla14:02
openstackgerritPatrick Powell proposed openstack/kolla: The quickstart guide still says to use Anisble 1.9.4 which no longer works with Kolla.  https://review.openstack.org/32901514:02
*** SiRiuS__ has quit IRC14:03
*** SiRiuS__ has joined #openstack-kolla14:04
wirehead_rhallisey: Awesome.14:05
rhalliseywirehead_, I left a comment14:06
rhalliseyI'll show you what it should look like in a patch to glance14:06
openstackgerritMerged openstack/kolla: Fix typos in Kolla  https://review.openstack.org/32894314:07
rhalliseywirehead_, unless you'd rather I push what I have14:08
*** prithiv has quit IRC14:10
*** prithiv has joined #openstack-kolla14:10
*** jtriley has quit IRC14:12
*** diogogmt has quit IRC14:12
*** dwalsh has joined #openstack-kolla14:12
wirehead_rhallisey, so I just needed to execute that in a shell?14:15
wirehead_rhallisey, or was there more?14:15
rhalliseythat's all. There's a format you need to follow14:16
wirehead_rhallisey: OK, whichever works easier for you.14:16
wirehead_rhallisey: I was biking up a mountain when you asked how far I was.14:17
rhalliseyI changed to format a little to make it look neater14:17
rhalliseyha14:17
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Convert Keystone to HostNetwork=False, Fix 2/3rds of bootstrap  https://review.openstack.org/32856714:20
rhalliseywirehead_, try that out^14:21
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Convert Keystone to HostNetwork=False, Fix 2/3rds of bootstrap  https://review.openstack.org/32856714:22
*** jtriley has joined #openstack-kolla14:26
*** inc0 has joined #openstack-kolla14:37
inc0good morning14:37
rhalliseyinc0, hey :)14:39
*** sacharya has joined #openstack-kolla14:47
*** inc0 has quit IRC14:51
*** esharao has joined #openstack-kolla14:53
openstackgerritPatrick Powell proposed openstack/kolla: The quickstart guide still says to use Anisble 1.9.4  https://review.openstack.org/32901514:54
*** inc0 has joined #openstack-kolla14:59
*** jtriley has quit IRC15:00
*** Liuqing has quit IRC15:00
wirehead_rhallisey: so, I was thinking that, given that the three steps of the workflow are somewhat serialized, there's not nearly the same benefit on putting them as three individual containers.  Might be easier to just join them with a &&15:02
*** diogogmt has joined #openstack-kolla15:02
openstackgerritRyan Hallisey proposed openstack/kolla: Change the search path to look locally  https://review.openstack.org/32904415:04
*** coolsvap has joined #openstack-kolla15:05
rhalliseywirehead_, might make it hard to read15:05
rhalliseythe cost of 3 containers isn't really much15:05
*** fragatina has joined #openstack-kolla15:11
*** david-lyle has joined #openstack-kolla15:12
*** ravig has joined #openstack-kolla15:17
*** vhosakot has joined #openstack-kolla15:17
*** jtriley has joined #openstack-kolla15:21
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Look in kolla-kubernetes directory instead of kolla  https://review.openstack.org/32905815:30
openstackgerritJeffrey Zhang proposed openstack/kolla: Get package from cdn rather than github  https://review.openstack.org/32906015:34
*** harlowja_at_home has joined #openstack-kolla15:35
*** prithiv has quit IRC15:36
*** mikelk has quit IRC15:37
*** jtriley has quit IRC15:39
openstackgerritJeffrey Zhang proposed openstack/kolla: Get packages from cdn rather than github  https://review.openstack.org/32906015:41
*** gmmaha has quit IRC15:44
*** mark-casey has joined #openstack-kolla15:45
*** gmmaha has joined #openstack-kolla15:45
*** gmmaha has quit IRC15:46
*** gmmaha has joined #openstack-kolla15:47
*** vhosakot has quit IRC15:49
*** vhosakot has joined #openstack-kolla15:49
*** daneyon_ has joined #openstack-kolla15:50
mag009_busy morning here :P15:51
inc0mag009_, oh?15:51
mag009_morning y'all15:51
*** dmk0202 has quit IRC15:51
inc0hey15:51
*** sacharya_ has joined #openstack-kolla15:55
*** daneyon_ has quit IRC15:55
inc0mag009_, here goes nothing, trying to deploy your calico;)15:57
mag009_lol cool15:57
*** sacharya has quit IRC15:58
*** esharao has quit IRC15:58
mag009_multinode?15:58
mag009_I haven't tested in single15:58
inc0wouldn't have it any other way15:58
*** esharao has joined #openstack-kolla15:59
inc0would there be any point of testing it on single node?15:59
inc0one network tho15:59
inc0I mean no switches in between15:59
mag009_not really but technically it should work15:59
inc0well you wouldnt use bgp at all16:00
inc0that being said..I don't use bgp too16:00
inc0not in full in any case16:00
inc0anyway, lets see16:00
inc0we can go fancy and write a heat template later to setup calico with kolla on multiple vms connected by cumulus vx;)16:01
mag009_yep16:03
*** ayoung has quit IRC16:04
*** jtriley has joined #openstack-kolla16:06
openstackgerritPatrick Powell proposed openstack/kolla: The quickstart guide still says to use Anisble 1.9.4  https://review.openstack.org/32901516:08
*** prithiv has joined #openstack-kolla16:08
*** matrohon has quit IRC16:08
*** jtriley has quit IRC16:12
Lyncosgood morning guys16:15
*** zhiwei has quit IRC16:17
*** prithiv has quit IRC16:19
*** ayoung has joined #openstack-kolla16:19
inc0hey16:22
*** matrohon has joined #openstack-kolla16:22
vhosakothello all!16:23
mark-caseyhello16:24
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Check for a local kolla directory  https://review.openstack.org/32909016:24
*** salv-orl_ has quit IRC16:25
*** salv-orlando has joined #openstack-kolla16:25
Mech422morning16:29
*** jtriley has joined #openstack-kolla16:30
*** mummer has joined #openstack-kolla16:37
*** jtriley has quit IRC16:42
*** athomas has quit IRC16:43
*** harlowja_at_home has quit IRC16:59
*** ssurana has joined #openstack-kolla17:00
*** Serlex has quit IRC17:04
*** ayoung has quit IRC17:04
*** fragatina has quit IRC17:06
*** fragatina has joined #openstack-kolla17:06
*** sacharya has joined #openstack-kolla17:13
inc0harlowja, mag009_ Lyncos soo, it seems you all will try to deploy kolla on 1k+ nodes17:13
*** sacharya_ has quit IRC17:13
Lyncosyeah eventually 1k17:14
inc0just saying, talk to each other if needs be;) we need to start thinking about this cell stuff17:14
inc0support in kolla17:14
*** ravig has quit IRC17:15
*** sacharya_ has joined #openstack-kolla17:16
*** ayoung has joined #openstack-kolla17:18
*** sacharya has quit IRC17:19
*** jtriley has joined #openstack-kolla17:19
*** ssurana has left #openstack-kolla17:24
*** jamie_h has quit IRC17:27
*** ssurana has joined #openstack-kolla17:28
*** salv-orl_ has joined #openstack-kolla17:29
*** ssurana has left #openstack-kolla17:29
*** jtriley has quit IRC17:30
*** salv-orl_ has quit IRC17:32
*** salv-orlando has quit IRC17:32
*** salv-orlando has joined #openstack-kolla17:32
*** vhosakot has quit IRC17:36
*** vhosakot has joined #openstack-kolla17:41
harlowjaya, sadly cells in nova is in weird state (afaik)17:42
*** ravig has joined #openstack-kolla17:44
*** Mech422 has quit IRC17:45
*** Mech422 has joined #openstack-kolla17:46
Mech422Hmm - I get a wierd error with mitaka where I can't launch VM instances - the 'provisioning block device' spinner never goes away17:47
Mech422but the volume show up via the 'volumes' tab and api17:47
Mech422it's wierd - only seems to happen on like 50% of my re-builds17:47
Mech422(cluster rebuilds/redeploys that is)17:48
*** ravig has quit IRC17:49
*** jtriley has joined #openstack-kolla17:49
openstackgerritMauricio Lima proposed openstack/kolla: Remove Heat CLI deprecated commands  https://review.openstack.org/32912517:51
openstackgerritDavid Wang proposed openstack/kolla: Enable kolla k8s to override bind api bind address in genconfig  https://review.openstack.org/32792517:51
wirehead_Every open-stack project, like Green Day and The Offspring, must eventually learn that being a cell-out is inevitable.17:53
*** fragatina has quit IRC17:53
*** ravig has joined #openstack-kolla17:54
*** mbound has joined #openstack-kolla17:55
*** dwalsh has quit IRC17:55
*** coolsvap has quit IRC17:56
*** coolsvap has joined #openstack-kolla17:57
Mech422wirehead_: *groan*17:59
*** fragatina has joined #openstack-kolla18:00
Mech422inc0: so, Jeffrey4l pointed out we can get around the ceph-stale-partition names stuff by calling 'udevadm trigger' after re-writing the partition names18:04
Mech422inc0: which would get around your dis-taste for scraping command output18:04
Mech422inc0: (Not sure I have 100% faith in it doing the right thing - but I guess that would be a udev problem if it fails?)18:05
*** fragatina has quit IRC18:06
*** dwalsh has joined #openstack-kolla18:07
*** ravig has quit IRC18:09
*** coolsvap has quit IRC18:13
*** Jeffrey4l has quit IRC18:17
*** mbound has quit IRC18:19
*** mbound has joined #openstack-kolla18:22
*** sdake_ has joined #openstack-kolla18:23
sdake_morning18:24
sean-k-mooneysdake_: good morning18:24
*** mbound has quit IRC18:25
*** mbound has joined #openstack-kolla18:26
*** berendt has joined #openstack-kolla18:33
*** daneyon_ has joined #openstack-kolla18:33
openstackgerritChristian Berendt proposed openstack/kolla: Load the metadata definitions during Glance bootstrap  https://review.openstack.org/32241518:37
*** daneyon_ has quit IRC18:37
*** fragatina has joined #openstack-kolla18:39
*** ravig has joined #openstack-kolla18:40
*** ravig has quit IRC18:45
*** ravig has joined #openstack-kolla18:47
*** jtriley has quit IRC18:51
*** jtriley has joined #openstack-kolla18:59
*** The_Ball has quit IRC18:59
*** salv-orlando has quit IRC19:04
*** salv-orlando has joined #openstack-kolla19:05
sean-k-mooneyhi not sure who is about but does anyone have any guidence on how to do hostlevel configuration with kolla?19:06
sean-k-mooneyim think in relation to https://blueprints.launchpad.net/kolla/+spec/kernel-hugepage-config19:07
sean-k-mooneyi see too options to configuring kernel hugepages on the host.19:07
sean-k-mooney1 the common playbook19:07
sean-k-mooney2 the install-deps playbook i am also working on19:08
sean-k-mooneyis there any preference?19:08
sean-k-mooneyas the install-deps playbook is intended to be optional that approch would involve documenting how to configur it manually if it is not used.19:10
sean-k-mooneysdake_: inc0:  any taughts ?19:12
inc0just came back19:15
inc0reading log19:15
inc0sean-k-mooney, preconf of host is not something we normally do\19:16
sean-k-mooneyinc0: no worries19:16
inc0but I'm ok with it as long as it will be separate play19:16
sean-k-mooneyok19:17
inc0something like kolla-ansible prep-host or whatever19:17
sean-k-mooneyi think in that case then ill ammend the blueprint to suggest the install-deps playbook instead of common then19:17
sean-k-mooneystrictly speaking configuring hugepages can be done by the operator today before running kolla but i would like to provide a automated solution too19:19
inc0sean-k-mooney, so our current policy is "do not mess with host"19:20
sean-k-mooneyyes in the main playbooks19:21
inc0but having easier prep-host playbook would be valuable19:21
inc0yeah, that's my point, if you're up to prep playbook "this is host messing playbook", I'm ok with it19:21
sean-k-mooneyya i started on this https://review.openstack.org/#/c/325631/19:21
patchbotsean-k-mooney: patch 325631 - kolla - [WIP] add baremetal role to install kolla deps.19:21
*** The_Ball has joined #openstack-kolla19:22
inc0ahh I missed this one19:22
inc0yeah, just plz make it separate play19:22
inc0instead of role19:22
sean-k-mooneythe intent being that it will do all of the host level config to pass the pre checks19:22
sean-k-mooneyah ok you would like it to be an entirly different playbook19:22
sean-k-mooneyi can do that19:23
inc0yeah19:23
inc0it will prep to pass the prechecks and also I'm ok with doing optimization stuff19:23
inc0like this kernel thing19:23
inc0it's like "if you run this play, we do stuff to your host."19:23
sean-k-mooneyya so what i was thinking of doing was documenting how to configure hugpages in one of the deployment guide then automating it as part of the install-deps playbook19:24
mark-caseyinc0: can the baremetal prep be a play that calls a role like cleanup or mariadb_recovery? because otherwise where do the templates in the current change-set go?19:26
inc0so as far as I'm concerned, just name it correctly in task19:26
sean-k-mooneyoh hi mark-casey just reading your comments now19:27
inc0well, you can add new role for baremetal19:27
inc0it just wont be in normal playbook19:28
mark-caseyinc0: right, ok. yes we're thinking the same I think19:28
mark-caseysean-k-mooney: hello :)19:28
sean-k-mooneyam yes what ill do is refactor the current patchset to create a new playbook with a new role19:29
mark-caseysean-k-mooney: cool. also regarding kernel hugepages, any change for an explicit "off" setting? hugepages (or at least transparent ones) are fairly highly recommended against for applications like redis and mongo if you don't have large amounts of ram19:30
sean-k-mooneymark-casey: sure can you add that to https://blueprints.launchpad.net/kolla/+spec/kernel-hugepage-config so that i dont forget19:31
mark-caseyor.. wait. maybe this doesn't get so far as inside the VMs. I may be off base19:31
*** salv-orlando has quit IRC19:31
sean-k-mooneyyes this dose not effect inside the guest19:31
*** salv-orlando has joined #openstack-kolla19:31
sean-k-mooneyit would just be allocating them on the host19:31
sean-k-mooneyyou may want to disable transparent hugepages on the host though for some reason19:32
sean-k-mooneye.g. mongo does not like them?19:32
inc0huge pages will also affect LM right?19:35
inc0live migration19:35
mark-caseyyea I do inside those hosts. I'll add that to the bp in case someone does want that, but I don't think it matters to me19:35
mark-caseyinc0: yea i think there's been a nova thread on that in the ML19:35
mark-caseyor, someone trying to get certain page sizes on certain instances of nova19:36
sean-k-mooneyinc0: if you have hugepaged backed guest you have to livemigrate to another host with hugepage memory or it will fail19:36
sean-k-mooneyinc0: other then that i dont belive there is a restriction19:36
mark-caseysean-k-mooney: what are the upsides in this case? just compute nodes with tons of ram?19:36
inc0sean-k-mooney, restriction - no, but performance will be affected19:37
inc0LM has to copy dirtied pages19:37
inc0so if you have small number of large pages, there will be more dirtying and copying19:37
sean-k-mooneyam hugepages would be required to enable ovs with dpdk. its also is a prefromanc boost to the guest19:37
sean-k-mooneymark-casey: ^^19:38
inc0all I'm saying, it'll be tradeoff19:38
inc0so an idea19:38
inc0instead of setting it up19:38
inc0add check in prechecs19:38
*** dwalsh has quit IRC19:39
inc0if enable_dpdk: yes, then check if hugepages are on19:39
inc0and leave kernel config to ops19:39
inc0Mech422, you were one having perm denied for ceph?19:40
sean-k-mooneywell i could do both i guess? since it wont be part of the main playbook i can add a precheck for that19:40
inc0or was it mag009_ ?19:40
sean-k-mooneyinc0:  in the install-dpes playbook it would be optional and disabled by default so ops would not have to use it if they dont want too19:40
*** mliima has quit IRC19:41
mark-caseysean-k-mooney: cool. def wanting to investigate dpdk here19:43
mark-caseyinc0: I think at some level of ram (128gb+?) not having hugepages degrades performance cause the TLB gets unwieldy19:44
mark-caseytoo many pages to track19:44
sean-k-mooneymark-casey: ya its been on my todo list for far too long at this point.19:44
sean-k-mooneyyou will see performace degrdates vs with hugepages well before that for your guest but yes if you have hosts with lots of ram hugepages are become more important overall19:45
*** esharao_ has joined #openstack-kolla19:47
*** dwalsh has joined #openstack-kolla19:50
*** esharao has quit IRC19:50
openstackgerritKen Wronkiewicz proposed openstack/kolla: Keystone interface address and memcached override  https://review.openstack.org/32856919:55
inc0mag009_, Mech422 one of you had problems with permission denied during ceph deploy right?19:57
inc0ansible did change sth19:57
Mech422inc0: umm - about 50% of the time, Horizon seems to 'lose' the completion message when provisioning a new volume19:57
Mech422inc0: Not sure if its a perms problem though19:58
inc0not that19:58
inc0during deploy ansible raises perm denied19:59
Mech422inc0: no - it just doesn't see the partition renames19:59
*** esmiurium has quit IRC19:59
mag009_inc0: yes20:00
Mech422inc0: bootstrap_osd rewrites the partition names, but the kernel/udev doesn't update, so start_osd sees 'stale' partition names and thinks there's nothing to do20:00
mag009_it was me who repported it20:00
mag009_at the boostrap it tried to modify the fstab20:01
mag009_first it tried to create /var/lib/ceph20:01
mag009_why you ask ?20:01
inc0I just ran into it20:02
inc0added become=true to inventory and still no bueno20:03
mag009_not there20:03
mag009_roles/ceph/tasks/start_osd.yml20:04
mag009_at the mount20:04
Mech422oh - I added passwordless root sudo to my 'kolla' user on deployment host, and it seems to work fine20:04
mag009_Mech422: your using ansible 2.X ?20:04
Mech422start_osd works fine for me ATM - yeah ansible 2.1 I think?20:04
inc0I use ansible_user=root20:05
Mech422I think I had to fart around with the ansible_version though20:05
sdake_morning folks20:05
sdake_or afternoon I suppose20:05
sdake_does anyone know if v2 and v3 of keystone can coexist in one deployment?20:05
inc0sdake_, it can..20:05
sdake_for example, I want v3 of heat and magnum20:06
inc0it usually does20:06
sdake_but v2 of everything else20:06
mag009_inc0: i have a user ubuntu and passwordless in group sudo but i still had to add this become=true at the mount to get pass that permission denied20:06
inc0it's not that20:06
inc0it's "Looking up disks"20:06
mag009_different error ?20:06
sdake_inc0 are there any gotchas?20:06
*** sdake_ is now known as sdake20:06
mag009_ah ok20:06
inc0so from within container20:06
Mech422mag009_: odd - I don't think I had to do anything for that - my fstab does have a UUID mount for /var/lib/ceph/osd20:07
sdakeinc0 do yu end up with separate openrc files for accessing magnum in teh above use case vs say nova (which would be on keystone v2)20:07
inc0I suppose drop root stuff messed this up20:08
sdakeinc0 and does nova, cinder, and other heat dependencies require v3 if ehat is on v3?20:08
sdakeinc0 i'd take an answer of "I dont know" over a guess :)20:08
Mech422inc0: the first play in start_osds.yml is (-m find_disks) blows up with stale partition data...20:09
Mech422inc0: you sure you have a perm error ?20:09
sean-k-mooneysdake: i dont know  the answer to your question but how would you configure different keystone versions today? in the config of each of the services directly?20:09
sdakesean-k-mooney this is for our cloud services cloud at cisco (an internal cloud providere)20:10
inc0pretty sure ;) OSError: [Errno 13] Permission denied: '/home/ansible/.ansible20:10
sdakesean-k-mooney and they are not on kolla at all20:10
sean-k-mooneysdake: oh ok20:10
inc0however I see changed version in ansible  toolbox20:10
sean-k-mooneysdake: so that was a general query not kolla specific20:11
inc02 days ago20:11
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Add documentation for api_interface_address  https://review.openstack.org/32796120:11
inc0and lookup is called from within container20:11
inc0can somebody do full rebuild and try to deploy ceph please?20:11
Mech422inc0: I did about 8 hours ago - deployed fine20:11
inc0did you rebuild toolbox from master?20:11
Mech422inc0: yeah20:11
inc0hmm20:12
Mech422inc0: but I include my ceph-in-partition patch20:12
inc0can I have link plz?20:12
Mech422inc0: that adds a sudoers entry for sgdisk though - so it shouldnt affect anything20:12
sean-k-mooneyMech422: ceph-in-partition patch e.g. using partitions for OSDs?20:13
inc0actually it might20:13
inc0sean-k-mooney, yeah20:13
Mech422inc0: https://review.openstack.org/#/c/326609/420:13
patchbotMech422: patch 326609 - kolla - Read partition tables directly, bypassing stale ke...20:13
sean-k-mooneyok cool that would be useful.20:13
inc0-2 from Jeffrey tho, let me see20:14
Mech422inc0: there's crap in your scroll back today about this too - Jeffrey determined we can run 'udevadm trigger' instead of using sgdisk20:14
Mech422inc0: and pbourke said something about it might be related to a problem he was having...20:15
Mech422but I haven't seen him since20:15
sdakesean-k-mooney ya general query20:15
sdakesean-k-mooney do you know?20:15
sdakesean-k-mooney note I'd like to convert these folks over to kolla, but its brownfield20:15
sdakeand thats harder then greenfield :)20:15
sdakesean-k-mooney inc0 an answer of "I dont know" is suitable if you dont' know, if you do know, a confirmation would be great20:16
Mech422sean-k-mooney: yeah - sam yapple put everything in place to run ceph on partitons - its just the kernel gets bitchy about updating the partition table data20:16
inc0sdake, they always coexist in same install20:17
inc0try keystone_host:5000/v2 and v320:17
inc0both should be there20:17
inc0Mech422, didn't help20:18
inc0http://paste.fedoraproject.org/378700/49077146/20:18
openstackgerritMerged openstack/kolla-kubernetes: Accidently added a file on keystone merge  https://review.openstack.org/32876120:18
sean-k-mooneyMech422: ya the first time i tried to deploy ceph with kolla was before that and i tred to use a partition on the same disk as my boot partition20:19
inc0hmm I think I see the issue20:19
sean-k-mooneyMech422:  i was quickly reminded of the fact that linux will hapily nuke the partion table on the disk it is running form. havent tried it since20:20
Mech422sean-k-mooney: actually - since Sam re-writes partition name on full disk - it could be an isssue there too - its just unlikely as the disk probably isn't in-use/mounted20:20
sdakeinc0 so openrc file specifies the keystone endpoint20:24
sdakeinc0 wuld you needd separate openrc files for communicating with heat vs nova in my use case?20:24
sdakeinc0 keeep in mind this is liberty version of openstack that is hand deployed20:25
sdakerather hand upgraded20:25
sdakei htink they recently upgraded from kilo20:25
sdakelike 6 mo ago20:25
inc0yeah different openrc20:25
inc0should do the trick20:26
sdakeso heat uses nova20:26
sean-k-mooneyMech422: if i want to use a partition for an osd wont this still zap the entire disk the partion is on https://github.com/openstack/kolla/blob/master/docker/ceph/ceph-osd/extend_start.sh#L2220:26
sdakewill it just use the v2 endpoint then?20:26
sdakebecause heat only knwos the v3 endpoint, will it look up the v2 endpoint?20:26
inc0no, use different openrc to hear20:26
inc0heat20:26
Mech422sean-k-mooney: there's a guard in there...use seperate journal and it won't zap20:27
inc0or use v3 for everyone20:27
sdakeinc0 they dont want t o move everythign to 320:27
sdakejusst the bar eminimum required to get magnum to wokr20:27
inc0then use separate openrc for magnum20:27
sdakeok so magnum calls heat with v3 credentials, then heat calls nova with v3 credentials, but nova only has v220:28
sean-k-mooneyMech422: true but if i dont use the external journal and just spcify a partition do we do any checks to make sure it does not zap every thing?20:28
sdakethis is where my brain geets stuck20:28
sean-k-mooneyMech422: the fact that zaping the disk is contolled by USE_EXTERNAL_JOURNAL just seams a little odd20:29
Mech422sean-k-mooney: Umm - Blue!  actually - I gotta look at the code - its bootstrap_osd that does the dirty deeds20:29
*** jtriley has quit IRC20:31
Mech422sean-k-mooney: yeah - no external journal assumes full disk and zaps it20:32
rhalliseyanyone mind reviewing: https://review.openstack.org/#/c/320744/20:32
patchbotrhallisey: patch 320744 - kolla - Add kolla-kubernetes bootstrap capability to mariadb20:32
rhalliseyand it's attached patches20:32
*** ravig has quit IRC20:32
sean-k-mooneyMech422: looking at https://github.com/openstack/kolla/blob/master/doc/ceph-guide.rst i do not see any reference to use external jornals either or using partitions20:32
Mech422sean-k-mooney: yeah - I found the info on sam's blog20:32
Mech422sean-k-mooney: doc patches welcome :-P20:32
sean-k-mooneyhehe ya i might open a bug for it and see if i can get to it later in the week.20:33
sean-k-mooneydo you have a pointer to sams blog on the topic?20:33
Mech422sean-k-mooney: but if you want to use partitions - just use 2, 1 data, 1 journal...20:34
Mech422sean-k-mooney: err...lemme check my google fu real quick20:34
sean-k-mooneyMech422: no worries if you dont have it to hand i can find it with google too20:35
Mech422sean-k-mooney: https://yaple.net/2016/03/20/deploying-openstack-mitaka-with-kolla-docker-and-ansible/20:35
Mech422sean-k-mooney: right under the first inlined console block20:35
*** ravig has joined #openstack-kolla20:36
sean-k-mooneyMech422: cool thanks20:36
Mech422sean-k-mooney: and you just thought I was here for my charm and good looks :-)20:37
*** mark-casey has quit IRC20:37
Mech422inc0: the .ansible directory for my deployment user is owned by root - run kolla via sudo20:39
Mech422inc0: err...I run kolla via sudo that is20:39
inc0Mech422, issue is /home/ansible is owned bu root inside kolla-toolbox container20:40
inc0I think20:40
Mech422inc0: Hmm - yeah - mine is too...but it works..20:41
wirehead_rhallisey: so, it looks like it’s bootstrapping, but when I try to actually run keystone, it’s not really responding to traffic.20:41
inc0at first it couldn't even access .ansible.cfg20:41
*** ravig has quit IRC20:42
Mech422inc0: thats wierd - I rebuild all the containers a couple of times a night... never seen this problem20:42
Mech422(full process from foreman bootstrap to running cluster is about 2 hours)20:43
sdakeMech422 how many nodes20:43
sdakeMech422 in my enviornment a kolla deploy takes about 6 minutes from registry all in one20:43
*** ravig has joined #openstack-kolla20:43
sdakeis the foreman bootstrap automated?20:43
rhalliseywirehead_, how are you contacting it?20:43
wirehead_logged into the running container, did a curl http://127.0.0.1:5000/20:44
Mech422sdake: currently, it bootstraps 7 nodes including deployment host20:44
Mech422sdake: just formating drives/loading ubuntu takes me more then 6 minutes20:44
sdakewhat part takes 2 hours?20:44
Mech422sdake: all of it - blank box to working cluster == 2 hours20:44
sdakea cat at INtel deployed 64 nodes in 24 minutes20:45
sdakeMech422 are you includding imgee building in that 2 hours?20:45
Mech422sdake: yes, doing EVERYTHING from scratch - zero to cluster20:45
sdakeso yes on image building?20:45
Mech422sdake: and the killer is I don't have 10GigE at home20:45
Mech422yes, I build images 2x night on average20:46
rhalliseywirehead_, hmm20:46
Mech422and I install a private registry to pull them from20:46
sdakeok so most of the 2 hours is likely spent image bulding20:46
wirehead_now it’s working.20:46
sdakeMech422 if you want to speed  that up, just use the docker hub registry20:46
Mech422sdake: not really - deploy is the longest part20:46
rhalliseywirehead_, oh really?20:46
rhalliseywhat did you do?20:46
Mech422sdake: I think I'm saturating my 1G link20:46
sdakeMech422 ya th eintel cat had 10gige20:46
sdakeand i have 10gige20:47
wirehead_Well, I pointed it at http://127.0.0.1:5000/v3/20:47
Mech422sdake: and I run a docker registry on the deployement host20:47
sdakethe other bottleneck is often the disk20:47
Mech422sdake: so the deploy doesn't have to go off switch20:47
Mech422sdake: eh - I'm building on SSD..but not nvme20:47
sdakenvme is 3-4 x speed of regular sata ssd20:47
rhalliseywirehead_, nice :)20:48
sean-k-mooneyeven on old server with an ssd build is quick provided your upstream internet connection is quick i find20:48
*** matrohon has quit IRC20:48
sdakebuild takes me 15 minutes on gige to the internet20:48
rhalliseywirehead_, lately I've been having issues with my DB.20:48
sdakepush takes 12 minutes20:48
Mech422sdake: I build and push in one step - takes about 30ish minutes20:49
*** ravig has quit IRC20:49
*** ravig has joined #openstack-kolla20:49
wirehead_rhallisey: might also need a bit of time to come back up.20:49
sdakeMech422 you could speed things up by using docker pull to pull to your local registry from the docker hub, then using docker push to push to your local registry20:49
sdakeMech422 but we don't provide any tooling around that - perhaps you could make some :)20:49
sean-k-mooneysdake:  i site arount the 20-30 min mark which is still fine. less i i use an apt/pip cache to eliminate upstream bandwidth limits20:49
rhalliseyERROR 1047 (08S01) at line 1: WSREP has not yet prepared node for application use20:49
rhalliseyugh20:49
Mech422sdake: my internet is slower then my lan - how would hitting the net be faster then local?20:50
sean-k-mooneys/stie arount/sit around/20:50
sdakeMech422 when you build lots of networking is used20:50
sdakeMech422 much much mor enetworking hhen a docker pull20:50
Mech422sdake: oh wait - you mean instead of building ?  yeah - but I like building the containers from scratch...gives me faith in the process :-)20:50
sdakeok sounds good :)20:51
sdakeif your happy with 2 hours wfm ;)20:51
rhalliseywirehead_, have you rebuilt your mariadb container recently?20:51
sdake2 hours would drive me crazeeee20:51
wirehead_friday.20:51
Mech422sdake: I don't wanna wake up one day and find out my stuff only worked because of a magic container someone uploaded....20:51
wirehead_I’ve been zapping my env fairly frequently.20:51
sdakeMech422 instead you get to wake up to diferent changes in all the upstream packages :)20:51
wirehead_Yeah, it looks like it just takes a *while* to come up.20:51
Mech422sdake: yeah - so I know what broke :-)20:52
rhalliseywirehead_, the db?20:52
wirehead_rhallisey: Keystone itself20:52
sdakemech so accounting for the time20:52
sdakeyou said 30 minutes to build and push20:52
sean-k-mooneysdake: isnt that an argument for using the source build instead of the binary builds20:52
sdake1 hr to bulid the nodes, and 30 mins to deploy kolla?20:52
rhalliseywirehead_, how long would you say?20:52
sdakesean-k-mooney isnt which an argument20:52
sdakeI made several :)20:52
Mech422sdake: nah.. more like 30 minutes to install metal (3 reboots - dam slow boot times)20:53
sean-k-mooneyall of the above i guess but i was refering the the upstream packages changing and breaking stuff20:53
*** cfarquhar has quit IRC20:53
Mech422sdake: about 30 minutes to run my 'prep' and 'build containers'20:53
sdakesean-k-mooney RPM or DEB packaging is slower moving and more conservative20:53
wirehead_rhallisey: 3 minutes.20:53
sdakeso I think from binary packaging would give most reliable results20:54
Mech422sdake: an maybe 30-45 minutes to do deploy20:54
Mech422sdake: plus my fuck-off time when I go get a smoke/sandwich/etc20:54
sdakefor 9 nodes - what storagee graph driver are you using?20:54
Mech422sdake: storage graph?20:54
sean-k-mooneyaufs/ btrfs/device mapper?20:55
sdake--storage-driver option to docker20:55
Mech422sdake: oh - aufs20:55
sdakeI dont know  anything about aufs performance20:55
Mech422on XFS20:55
sdakebut device mapper is terrible20:55
sean-k-mooneyi generally use the btrfs storage driver20:56
Mech422sdake: hmm - actually - I think host root is ext4 - ceph osds are XFS20:56
sean-k-mooneyseams to work well20:56
sdakeMech422 if your host root is ext4, then you are using devicemapper20:56
Mech422sean-k-mooney: I've been waiting to use btrfs - but ceph backed off recommending it like last year, and I haven't seen if they changed their minds yet ?20:56
sdakeMech422 you can tell by running docker --somecommand20:56
inc0sdake, you can use aufs too20:57
inc0he can*20:57
sdakeMech422 for btrfs, just use /var/lib/docker20:57
sdakeMech422 rather mount btrfs or aufs as /var/lib/docker20:57
inc0Mech422, ubuntu 16.04 on host?20:57
sdakeMech422 my bet is your using lvm20:57
inc0or 14.04?20:57
Mech422inc0: 14.0420:57
sdakewhat is the diagnostics command for docker20:57
sdakeits a -- option20:57
sean-k-mooneysdake: i dont think the defult is lvm anymore though20:57
sdakeit tells the configured state of docker20:57
inc0Mech422, show me you docker options in /var/lib/docker plz20:58
Mech422none             75G  7.8G   64G  11% /var/lib/docker/aufs/mnt/289c7550cc7573f305c809934ef49865e9d0acbb49791fc76d354d06b720:58
inc0sorry20:58
inc0/etc/default/docker20:58
Mech422DOCKER_OPTS="--insecure-registry 192.168.101.11:4000"20:58
inc0Mech422, try to add  -s aufs20:58
sdakesean-k-mooney i see - didn't know that20:58
Mech422inc0: yeah - that was for sdake - looks like it is aufs20:58
inc014.04 uses devicemapper as default afair20:59
sdakethere is a command which will tell you20:59
inc0and you didn't seem to change it20:59
sean-k-mooneydocker info will tell you the storage driver in use too20:59
sdakedocker --diagnostics20:59
sdakeor something20:59
Mech422inc0: oh - dunno about DM20:59
sdakesean-k-mooney what is the command - i am in flagstaf atm and don't have access to my lab20:59
Mech422inc0: I meant no lvm20:59
inc0dm is equally bad20:59
sdakeMech422 docker uses lvm - you don't20:59
sdakeya dm is pos with docker20:59
inc0try to add -s aufs and see if it changes stuff21:00
Mech422sdake: Umm - lvm is not installed on box ?21:00
sean-k-mooneysdake:  docker info will shoul you what storage backend is in use21:00
sdakeMech422 run docker info | fpaste21:00
sdakeor paste it21:00
Mech422Storage Driver: aufs21:00
Mech422 Root Dir: /var/lib/docker/aufs21:00
Mech422 Backing Filesystem: extfs21:00
Mech422 Dirs: 30121:00
Mech422 Dirperm1 Supported: true21:00
Mech422Logging Driver: json-file21:00
sdakethat settles that21:00
Mech422so I don't need the -s aufs flag right, and I'm not using DM/LVM ?21:01
sdakeoverlayfs is fastest, but it eats babiess21:01
sdakeMech422 no21:01
sdakenot using dm/lvm21:01
sdakeonce overlayfs matures, it will be th way to go21:02
sean-k-mooneybtrfs is about as fast as overlayfs21:02
sdakeMech422 i'd recommend putting /var/lib/docker on its own partition so yu can have whatever filesystem type you want on it21:02
sean-k-mooneyi belive overlayfs out performs btrfs for small files but other then that they are close21:03
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Chown /home/ansible to ansible  https://review.openstack.org/32918521:03
Mech422sdake: yeah - I'm more concerned about reliability then build time though... aufs/ext/xfs are a lil safer then overlay/btrfs/etc aren't they ?21:03
*** ravig has quit IRC21:03
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Convert Keystone to HostNetwork=False, Fix bootstrap.  https://review.openstack.org/32856721:04
inc0btrfs is pretty stable now21:04
sdakebtw, meeting time is changed21:05
Mech422inc0: I lost track of it like last year... there were some issues with it and ceph...21:05
*** ChanServ sets mode: +o sdake21:05
Mech422inc0: if thats fixed, I should play with it - it seems pretty cool21:05
*** sdake changes topic to "Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b (old logs from #kolla http://goo.gl/VKpPzA)"21:06
wirehead_rhallisey: OK, I pushed another rev that should get things just about right.21:07
*** ravig has joined #openstack-kolla21:07
Mech422*sigh* now you guys got me wanting a 10GigE switch...21:08
sdakeMech422 don't put ceph on btrfs21:08
sdakeMech422 put ceph on raw volumes21:08
Mech422kinda hard to justify for a home lab though21:08
sdake850 bucks21:08
wirehead_I looked at the price of 10 GigE switches and decided I can wait.21:08
sdakenot a killer :)21:08
Mech422wirehead_: yeah - I need like 24 ports21:09
sean-k-mooneysdake: really?21:09
Mech422sdake: best I saw was $1K for arrista on ebay...what you using ?21:09
sean-k-mooneyi know you said you got it fairly cheaply set up but thats less then i taught21:09
sdakehttps://www.amazon.com/NETGEAR-ProSAFE-XS708E-Ethernet-XS708E-100NES/dp/B00B46AEE6/ref=sr_1_sc_1?s=electronics&ie=UTF8&qid=1465852172&sr=1-1-spell&keywords=10+gig+sswitch21:09
sdakeits 8 port21:10
sdakethey make a 12 and 24 port model as well21:10
sdake8/12/16/28/4821:10
sean-k-mooneythats not bad what nics are you using?21:11
sdakeintel 10gig nics21:11
sean-k-mooneyonboard or ading im guess niantic but dont recall the external name21:11
Mech422sdake: Ouch - 16 port version is $150021:11
sdakehttps://www.amazon.com/Intel-Ethernet-Converged-Network-X540T2/dp/B0077CS9UM/ref=pd_sim_sbs_229_1?ie=UTF8&dpID=41MW9E%2BrmrL&dpSrc=sims&preST=_AC_UL320_SR320%2C320_&refRID=FRMMP456PWBR9QNJ875C21:12
sean-k-mooneyya thats the one i was thinking of21:12
sdakedual port21:12
wirehead_Dig the giant heatsink.21:12
Mech422sean-k-mooney: you can get 10GigE mellanox for like $20 on ebay now21:12
*** ChanServ sets mode: -o sdake21:12
sdakewirehead_ its nice because its fanless21:12
sdakefans break21:12
wirehead_Yeah, I’m not a fan of ‘em.21:13
sdakeits bad because it geneateas alot of heat21:13
Mech422sean-k-mooney: I got the fiber ones...forget what they're called21:13
sean-k-mooneyMech422: yep i know i was tempted by them in the past21:13
sdakeand if you dont have good airflow the nics overheat and your box locks up21:13
*** zhiwei has joined #openstack-kolla21:13
sean-k-mooneythe conectx2 right?21:13
Mech422sean-k-mooney: yeah..21:13
wirehead_Yeah, but then you can at least optimize the case fans.  Large slow-spinning fans.21:14
sean-k-mooneyhttp://www.ebay.ie/itm/Lot-of-2-Mellanox-ConnectX-2-Single-Port-SFP-10GBE-Network-Card-MNPA19-XTR-/301689994552?hash=item463e1ffd38:g:hEAAAOSwgQ9VqDx221:14
sdakesean-k-mooney i wanted copper21:14
sean-k-mooneythe problem with those is they use qsfp+ connectors instead of sfp+ since they are also for infiniband21:14
sdakeright21:14
sdakei also wanted intel21:15
sdakeintel drivers for nics are the best in the world21:15
sdakeintel consisstenly has the best edrivers for all their gear compared to alternatives imo21:15
sean-k-mooneywell as an intel employee that make me happy to hear you say :)21:15
rhalliseywirehead_, man have to apply like 10 patches across 2 repos to get things working ..21:15
sdakei wouldn't buy anything but intel21:15
*** daneyon_ has joined #openstack-kolla21:15
wirehead_Some jobs ago, in the dark days when I was both Lord High Fixer and Senior Software Engineer, we had to rip out all of the Broadcom NICs and replace them with Intel NICs.21:15
sdakeya broadcom linux driver pile of steaming shit21:16
wirehead_One day, after a mostly unrelated outage that had working a day that started at 2 AM, I went on a bike ride.  And I biked past some folks with Broadcom jackets and had to restrain my animalistic urge to violence.21:16
sdakemellanox drivers are ok - but overly complex21:16
wirehead_Well, even worse than Broadcom Linux drivers is Broadcom FreeBSD drivers.21:17
*** ravig has quit IRC21:17
*** zhiwei has quit IRC21:17
inc0sooo....something is broken.21:17
wirehead_rhallisey: yeah, we need to get some patches merged. :)21:18
inc0neutron l3 didnt mount config volumes21:18
inc0Mech422, did you see sth like that?21:18
sdakewirehead_ freebsd, is that a thing :)21:18
Mech422inc0: Umm - no - my cluster works pretty much...21:18
rhalliseywirehead_, now I'm co-authored on that patch there's no one to merge it :/ . Fail21:18
Mech422inc0: except sometime when it builds - horizon loses the 'volume built' completion message when trying to spin up a VM21:19
wirehead_rhallisey: I guess it’s dcwangmit01’s turn to go power-mad with his +2 bit.21:19
rhalliseyhehe21:19
wirehead_sdake: in certain audiences, that can get you lynched and/or surrounded by a mob of weeping nerds.21:20
*** daneyon_ has quit IRC21:20
wirehead_sdake: Y! had a very baroque and bespoke FreeBSD setup.21:20
inc0nvm will look at it tomorrow21:21
inc0bye21:21
wirehead_Complete with a custom package manager with built-in containers.21:21
*** inc0 has quit IRC21:21
Mech422wirehead_: we actually have a couple of FBSD kernel committer on staff...21:21
Mech422wirehead_: only place I've ever worked that uses FBSD :-)21:21
wirehead_I mean, FreeBSD Jails were stable long before LXC.21:21
sdakewirehead_ sounds like firedrills :)21:23
sean-k-mooneyo/ time for food. talk to people tomorow. maybe some day we will deploy kolla/openstack on bsd...21:23
wirehead_Ever since I’ve gotten over my irrational infantile love of microkernels, I’ve been pretty pleased to not care about the underlying operating system.21:24
wirehead_Because I recognize that if I care, I’d probably write my own.21:24
wirehead_(one of my ex-coworkers has written his own OS along with designing his own CPU and hardware architecture, so I know where this rabbit hole leads)21:25
*** dwalsh has quit IRC21:26
sdakemicrokernel is a good idea21:29
sdakebut in reality, what adds valaue to the kernel is a rich set of driver support21:29
sdakeand nobody really cares aboutanything but mac, windows, and linux21:29
Mech422wirehead_: heh21:29
Mech422wirehead_: if I was to play with some other OS - I'd probably go with one of the BeOS clones21:30
sdakein a microkernel world, you barely would need a userspace to run docker with21:30
Mech422haiku or atheros or something21:30
*** d_code_ has joined #openstack-kolla21:31
sdakeits also a proven fact that monolithic kernels outperform (but are harder to maintain) microkernels21:31
wirehead_There was some interesting stuff done with the L4 microkernel.21:32
*** d_code has quit IRC21:33
*** d_code_ is now known as d_code21:33
Mech422wirehead_: heh - pretty much everything was done to the poor L4 kernel - weren't there like 12+ projects using it ?21:33
sdakewow msft buying inked in21:33
Mech422sdake: yeah - and symantec is buying blue coat21:34
wirehead_Pretty much, and then it petered out.21:34
Mech422all your SSL are belong to us21:34
Mech422wirehead_: yeah - same with the plan9 stuff - people maintained it a while, then it sorta...fizzled21:34
Mech422wirehead_: QNX looked really neat...I was disappointed to see their open source stuff vanish21:35
wirehead_Well, a lot of the same things that were neat about microkernels can be moved one layer up the stack with a hypervisor.21:36
wirehead_e.g. https://www.qubes-os.org/21:37
Mech422wirehead_: no..no new toys! too much in the 'I want to play with this' pile already21:39
*** rhallisey has quit IRC21:39
*** cfarquhar has joined #openstack-kolla21:40
*** cfarquhar has quit IRC21:40
*** cfarquhar has joined #openstack-kolla21:40
wirehead_My brother was actually a serious BeOS developer for a while in college.21:46
*** dmk0202 has joined #openstack-kolla21:47
Mech422wirehead_: yeah? it was a neat system..21:52
Mech422wirehead_: sorta like a consumer oriented Next box :-)21:52
sdakeinc0 can you ahve a look at my response in https://review.openstack.org/#/c/306662/421:54
patchbotsdake: patch 306662 - kolla - Make Cinder access glance in round robin fashion21:54
sdakeand either chagne your vote or provide an alternative approach :)21:55
*** jtriley has joined #openstack-kolla21:57
wirehead_Our college ACM chapter had one of the real BeBox Towers.  Complete with the blue sides and the LEDs that monitored CPU usage and GeekPort and all.21:58
*** SiRiuS__ has quit IRC22:03
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Switching Horizon over to work via Kubernetes network  https://review.openstack.org/32920422:08
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Switching Horizon over to work via Kubernetes network  https://review.openstack.org/32920422:08
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Add documentation for api_interface_address  https://review.openstack.org/32796122:09
wirehead_My brother just had a Motorola-branded PowerPC Mac Clone that he mostly used to run BeOS.22:10
Mech422wirehead_: I couldn't afford PowerPC :-P22:12
Mech422wirehead_: I think I was running amd/cyrix 486 clones back then22:12
*** ravig has joined #openstack-kolla22:12
*** rhallisey has joined #openstack-kolla22:14
wirehead_Well, he got an internship at Motorola and thus a discount.22:15
wirehead_Also, this was farther along.  The days when most folks were on Pentium II and so.22:16
*** esharao_ has quit IRC22:17
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Add documentation for api_interface_address  https://review.openstack.org/32796122:21
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Add documentation for api_interface_address  https://review.openstack.org/32796122:22
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Switching Horizon over to work via Kubernetes network  https://review.openstack.org/32920422:23
sdakei tried to geet an internship at motorola22:26
sdakethey turned me down22:26
sdakebut intel gave me one instead22:26
sdakei htink it had something to do with me asking their chief engineer what happens if two satellites fail in iridium22:26
sdakein front of our entire engineering university :)22:27
*** ayoung has quit IRC22:27
*** ravig has quit IRC22:31
*** ravig has joined #openstack-kolla22:32
*** dwalsh has joined #openstack-kolla22:33
wirehead_rhallisey: So, the underscore in configmap isn’t going to be in 1.3 according to most recent PR comments.22:33
rhalliseyok22:34
wirehead_rhallisey: so I’m not sure where that puts us with the configmap and underscores.  e.g. I’m not sure what to do about service_definition.py in Horizon and if there’s even a way to make it find that path.22:36
sdakemy suggestion would be to make it work for what is available22:37
sdakeand when 1.3 comes out change it22:37
wirehead_Well, Horizon and Nova both have some underscores.22:39
wirehead_sdake: I don’t think we’ll see underscores till 1.4.22:42
wirehead_sdake: the most recent github comment was that underscores don’t make it till 1.322:43
wirehead_till after 1.322:43
*** jtriley has quit IRC22:43
*** dave-mccowan has quit IRC22:47
wirehead_Hm.22:49
wirehead_Okay, I have a solution for 1.222:51
*** salv-orlando has quit IRC22:51
*** dmk0202 has quit IRC22:52
*** dave-mccowan has joined #openstack-kolla22:52
*** salv-orlando has joined #openstack-kolla22:52
wirehead_rhallisey / sdake: What we need to do is forcibly change all of the underscore paths to dashes in the kubectl command.  And then when you mount the configmap, you have to provide a file mapping to restore the underscores.22:52
*** ravig has quit IRC22:55
*** beekhof has quit IRC22:59
*** ravig has joined #openstack-kolla23:00
*** daneyon_ has joined #openstack-kolla23:04
*** beekhof has joined #openstack-kolla23:07
*** daneyon_ has quit IRC23:08
*** ravig has quit IRC23:10
*** dwalsh has quit IRC23:16
*** mbound has quit IRC23:23
harlowjaif i was to make https://github.com/openstack/kolla/blob/master/docker/nova/nova-base/Dockerfile.j2#L52-L53 not happen (so that i can do this later via a bind mount so that puppet configuration of those files still works); would that be ok with folks?23:27
harlowjasame question i guess for the other services config files23:27
harlowja(not to have them mved and copied around like that in the dockerfile)23:27
*** salv-orl_ has joined #openstack-kolla23:28
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Switching Horizon over to work via Kubernetes network  https://review.openstack.org/32920423:29
*** zhiwei has joined #openstack-kolla23:29
*** salv-orlando has quit IRC23:31
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Switching Horizon over to work via Kubernetes network  https://review.openstack.org/32920423:33
*** ayoung has joined #openstack-kolla23:34
*** zhiwei has quit IRC23:34
harlowjaso whats the plan on a kolla-ansible split out?23:43
harlowjathen have kolla just be the images + docker stuffs?23:43
wirehead_Well, it’s quite interesting that Kolla-kubernetes is mostly re-using the ansible templates, thus making a lot of the split-out less obviously useful.23:50
rhalliseywirehead_, it uses it for config though23:51
rhalliseyit could use anything for config23:51
wirehead_Yeah, like we’re kinda joined at the hip unless we re-implement configs on the kubernetes side.23:51
rhalliseyit's attached to the dockerfiles more though23:51
wirehead_rhallisey: https://blueprints.launchpad.net/kolla-kubernetes/+spec/fix-underscores-in-paths23:52
wirehead_yeah23:52
rhalliseyharlowja, it will be discussed at the mid cycle23:53
harlowjawhen's that again23:53
rhalliseymid july23:53
harlowjak23:53
wirehead_Ansible HQ (Durhum, NC) July 11th, 12th23:54
*** mummer has quit IRC23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!