Monday, 2016-06-20

*** dave-mccowan has joined #openstack-kolla00:01
*** dwalsh has quit IRC00:18
*** daneyon has joined #openstack-kolla00:34
*** daneyon has quit IRC00:39
*** sdake has joined #openstack-kolla00:43
*** dave-mccowan has quit IRC00:52
*** tonyb has left #openstack-kolla00:55
*** hanchao has joined #openstack-kolla00:59
*** yuanying has quit IRC01:00
*** zhiwei has joined #openstack-kolla01:10
*** SiRiuS__ has quit IRC01:15
*** SiRiuS__ has joined #openstack-kolla01:15
*** jtriley has joined #openstack-kolla01:27
*** sdake has quit IRC01:29
*** murphyslawbbs has quit IRC01:35
*** jtriley has quit IRC01:38
*** murphyslawbbs has joined #openstack-kolla01:39
*** hanchao has quit IRC02:06
*** tfukushima has joined #openstack-kolla02:21
*** dave-mccowan has joined #openstack-kolla02:29
*** klint has joined #openstack-kolla02:52
*** huikang has joined #openstack-kolla03:02
*** SiRiuS__ has quit IRC03:06
*** SiRiuS__ has joined #openstack-kolla03:07
-openstackstatus- NOTICE: static.openstack.org (which hosts logs.openstack.org) is currently migrating due to a hardware failure. It should be back up shortly.03:10
*** coolsvap has joined #openstack-kolla03:18
*** SiRiuS__ has quit IRC03:21
*** fragatina has joined #openstack-kolla03:28
*** fragatina has quit IRC03:29
*** fragatina has joined #openstack-kolla03:30
*** coolsvap has quit IRC03:40
*** huikang has quit IRC03:40
*** dave-mccowan has quit IRC03:45
*** coolsvap has joined #openstack-kolla03:47
*** coolsvap has quit IRC03:52
*** coolsvap has joined #openstack-kolla03:57
*** tfukushima has quit IRC04:00
*** yuanying has joined #openstack-kolla04:08
*** williamcaban has quit IRC04:12
openstackgerritHui Kang proposed openstack/kolla: Add named volume for nova-libvirt  https://review.openstack.org/30547104:26
*** tfukushima has joined #openstack-kolla04:27
*** williamcaban has joined #openstack-kolla04:46
*** coolsvap has quit IRC05:12
-openstackstatus- NOTICE: static.openstack.org (which hosts logs.openstack.org and tarballs.openstack.org among others) is currently being rebuilt. As jobs can not upload logs they are failing with POST_FAILURE. This should be resolved soon. Please do not recheck until then.05:21
*** ChanServ changes topic to "static.openstack.org (which hosts logs.openstack.org and tarballs.openstack.org among others) is currently being rebuilt. As jobs can not upload logs they are failing with POST_FAILURE. This should be resolved soon. Please do not recheck until then."05:21
*** hanchao has joined #openstack-kolla05:23
*** v1k0d3n has joined #openstack-kolla05:30
*** v1k0d3n has quit IRC05:40
hanchaoHello, I'm suffering an issue that when building images for rabbitmq, I got `curl: failed writing body` as a result. what could be reason? Expect for any helps.05:44
openstackgerritMd Nadeem proposed openstack/kolla: Add unit test for stop and restart container  https://review.openstack.org/33152405:48
nihiliferhanchao: that's the only error message? could you please post the whole output on paste.openstack.org?05:56
hanchao~nihilifer thank you for your responding, i have pasted my output here Paste #520554.06:01
nihiliferhanchao: can you post a link please?06:02
hanchaohttp://paste.openstack.org/show/520554/06:02
nihiliferthx06:02
nihiliferhanchao: try to do06:04
nihilifercurl -O http://www.rabbitmq.com/community-plugins/v3.5.x/rabbitmq_clusterer-3.5.x-189b3a81.ez06:04
nihilifersomewhere in /tmp06:04
nihiliferit works without problems for me, but let's see whether you'll be able to do that succesfully06:05
*** sacharya has quit IRC06:06
hanchaothis works for me too06:06
nihiliferok, did you try to build kolla images again? is this error occurring each time you try to do it?06:18
hanchaoI tried with this `curl -o /usr/lib/rabbitmq/lib/rabbitmq_server-3.5.7/plugins/rabbitmq_clusterer-3.5.x-189b3a81.ez http://www.rabbitmq.com/community-plugins/v3.5.x/rabbitmq_clusterer-3.5.x-189b3a81.ez`06:19
hanchaoand it ends with the same error...06:19
hanchaoI suppose this is the step where fails the building.06:20
*** jianqing has joined #openstack-kolla06:31
*** jianqing has quit IRC06:31
*** jianqing has joined #openstack-kolla06:33
*** mewald has joined #openstack-kolla06:40
*** jmccarthy has quit IRC06:40
*** jmccarthy has joined #openstack-kolla06:41
mewaldMy build process fails the neutron packages with a message of "Failed with status: matched" What does that mean?06:41
mewaldhttps://gist.github.com/mewald1/f710e83209153cc6a59ab17dd7eef98006:52
nihiliferhanchao: what base distro you're using?07:03
*** sacharya has joined #openstack-kolla07:06
*** hanchao has quit IRC07:07
*** matrohon has joined #openstack-kolla07:10
*** sacharya has quit IRC07:12
*** Jeffrey4l_ has quit IRC07:16
*** williamcaban has quit IRC07:26
*** williamcaban has joined #openstack-kolla07:28
*** Serlex has joined #openstack-kolla07:36
*** v1k0d3n has joined #openstack-kolla07:36
*** v1k0d3n has quit IRC07:40
*** Jeffrey4l has joined #openstack-kolla07:42
*** belmoreira has joined #openstack-kolla07:43
*** daneyon has joined #openstack-kolla07:47
*** daneyon has quit IRC07:52
mewaldI found out what's happening: In "docker/neutron/neutron-base/Dockerfile.j2" line 20, you install "neutron-lbaas". The package doesnt exist.07:55
*** phuongnh has joined #openstack-kolla08:09
mewaldis this a bug or am I doing it wrong?08:10
*** athomas has quit IRC08:13
*** hanchao has joined #openstack-kolla08:19
*** gfidente has joined #openstack-kolla08:21
*** jmccarthy has left #openstack-kolla08:30
nihilifermewald: it's a bug probably08:31
*** yuanying has quit IRC08:31
nihiliferwhat base distro you're using?08:31
openstackgerritMd Nadeem proposed openstack/kolla: Add test for remove container, get state and get env  https://review.openstack.org/33155608:33
mewaldnihilifer: I am building von 16.04. Base tag is 14.0408:36
mewaldnihilifer: when I run from "stable/mitaka" it works. But that dockerfile does not try to install neutron-lbaas08:38
*** mgoddard has joined #openstack-kolla08:41
*** papacz has joined #openstack-kolla08:44
nihilifermewald: ok. so you're building ubuntu with install_type "source" or "binary"?08:52
mewaldbinary08:53
hanchao@nihilifer sorry for the late respond... my base OS distro is CentOS 7.208:59
*** sacharya has joined #openstack-kolla09:08
*** sacharya has quit IRC09:13
mewaldI am building my images from stable/mitaka branch of kolla now but I get several errors: https://gist.github.com/mewald1/32e409af9f626714c2a2fac666da6fbf All those are images I dont really care about as I dont use them, but still whant so solve it. What's happening here?09:13
openstackgerritChristian Berendt proposed openstack/kolla: Add missing newlines to glance configuration templates  https://review.openstack.org/33157309:21
*** berendt has joined #openstack-kolla09:22
*** tfukushima has quit IRC09:23
*** tfukushima has joined #openstack-kolla09:24
berendtPlease review https://review.openstack.org/#/c/331430/, reconfiguration is broken at the moment.09:25
patchbotberendt: patch 331430 - kolla - Add reconfigure tasks for ceilometer ansible role09:25
*** daneyon has joined #openstack-kolla09:35
*** v1k0d3n has joined #openstack-kolla09:37
*** daneyon has quit IRC09:40
*** v1k0d3n has quit IRC09:42
*** zhiwei has quit IRC09:43
*** harmw_ is now known as harmw09:44
*** tfukushima has quit IRC09:46
*** yuanying has joined #openstack-kolla09:48
*** shakamunyi has quit IRC09:48
*** phuongnh has quit IRC09:49
*** shakamunyi has joined #openstack-kolla09:56
*** pbourke_ has quit IRC09:56
*** pbourke_ has joined #openstack-kolla09:57
openstackgerritChristian Berendt proposed openstack/kolla: Fix glance configuration templates  https://review.openstack.org/33157310:02
mewaldI can build my images with Ansible 2.0.0.2 but on the target node I get this: https://gist.github.com/mewald1/d89a49ca88d5a56c6b6191a0e3cece91 Downgrading to 1.9.6 passes the check10:04
*** berendt has quit IRC10:11
*** hanchao has quit IRC10:13
*** mgoddard_ has joined #openstack-kolla10:14
*** yuanying has quit IRC10:17
*** mgoddard has quit IRC10:17
*** mewald has quit IRC10:23
*** coolsvap has joined #openstack-kolla10:33
*** ChanServ changes topic to "Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b (old logs from #kolla http://goo.gl/VKpPzA)"10:38
-openstackstatus- NOTICE: static.openstack.org is back up. If you have POST_FAILURE and are missing logs from your CI jobs, please leave a 'recheck'.10:38
*** yuanying has joined #openstack-kolla10:44
*** yuanying has quit IRC10:45
*** yuanying has joined #openstack-kolla10:51
openstackgerritMerged openstack/kolla: Make Neutron QoS service plugin configurable  https://review.openstack.org/33047010:55
*** yuanying has quit IRC10:55
*** yuanying has joined #openstack-kolla10:59
*** yuanying has quit IRC11:01
*** reddydodda has joined #openstack-kolla11:04
*** reddydodda has quit IRC11:06
*** sacharya has joined #openstack-kolla11:09
*** yuanying has joined #openstack-kolla11:13
*** sacharya has quit IRC11:13
*** yuanying has quit IRC11:19
*** SiRiuS has joined #openstack-kolla11:20
*** yuanying has joined #openstack-kolla11:20
*** yuanying has quit IRC11:22
*** rhallisey has joined #openstack-kolla11:24
*** mliima has joined #openstack-kolla11:24
*** yuanying has joined #openstack-kolla11:35
*** yuanying has quit IRC11:37
*** v1k0d3n has joined #openstack-kolla11:38
*** yuanying has joined #openstack-kolla11:39
ccesariomorning folks!11:40
*** dgonzalez has quit IRC11:40
*** yuanying has quit IRC11:44
*** dgonzalez has joined #openstack-kolla11:44
*** v1k0d3n has quit IRC11:44
*** dwalsh has joined #openstack-kolla11:45
*** mewald has joined #openstack-kolla11:48
*** zhiwei has joined #openstack-kolla11:48
*** mgoddard_ has quit IRC11:48
*** zhiwei has quit IRC11:53
*** SiRiuS has quit IRC11:59
mewaldI can build my images with Ansible 2.0.0.2 but on the target node I get this: https://gist.github.com/mewald1/d89a49ca88d5a56c6b6191a0e3cece91 Downgrading to 1.9.6 passes the check. Why? Requirements say > 2.0.012:01
*** dave-mccowan has joined #openstack-kolla12:06
*** dwalsh has quit IRC12:06
*** SiRiuS has joined #openstack-kolla12:09
*** yuanying has joined #openstack-kolla12:09
*** mgoddard has joined #openstack-kolla12:11
*** yuanying has quit IRC12:12
*** Liuqing has joined #openstack-kolla12:14
*** mgoddard_ has joined #openstack-kolla12:14
*** jpeeler has quit IRC12:16
*** mgoddard has quit IRC12:16
*** daneyon has joined #openstack-kolla12:18
*** Jeffrey4l has quit IRC12:20
*** daneyon has quit IRC12:23
mewald"invoke-rc.d: policy-rc.d denied execution of start." - could this be the reason?12:23
*** zhiwei has joined #openstack-kolla12:23
*** jpeeler has joined #openstack-kolla12:23
*** coolsvap has quit IRC12:26
*** Jeffrey4l has joined #openstack-kolla12:27
*** yuanying has joined #openstack-kolla12:28
*** mdnadeem has quit IRC12:28
*** mdnadeem has joined #openstack-kolla12:30
*** yuanying has quit IRC12:31
*** yuanying has joined #openstack-kolla12:32
*** david-lyle has quit IRC12:39
*** david-lyle has joined #openstack-kolla12:42
*** yuanying has quit IRC12:43
openstackgerritRyan Hallisey proposed openstack/kolla: Spec: Deploy Kolla images using Kubernetes  https://review.openstack.org/30418212:46
*** v1k0d3n has joined #openstack-kolla12:56
*** jtriley has joined #openstack-kolla12:56
mewaldI want to build images for Mitaka on Ubuntu 14.04. Do you recommend to use the stable/mitaka branch of the repo?12:57
-openstackstatus- NOTICE: OpenID login from review.o.o is experiencing difficulties, possibly due to transatlantic network performance issues. Things are being investigated12:58
*** ChanServ changes topic to "OpenID login from review.o.o is experiencing difficulties, possibly due to transatlantic network performance issues. Things are being investigated"12:58
rhalliseymewald, ya go with the stable/mitaka branch12:59
mewaldthx12:59
*** SiRiuS has quit IRC13:01
*** v1k0d3n has quit IRC13:03
*** klint has quit IRC13:03
*** yuanying has joined #openstack-kolla13:05
*** yuanying has quit IRC13:09
*** sacharya has joined #openstack-kolla13:10
*** ChanServ changes topic to "Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b (old logs from #kolla http://goo.gl/VKpPzA)"13:12
-openstackstatus- NOTICE: OpenID logins are back to normal13:12
mewaldrhallisey: any recommendations regarding the build system? trusty? xenial?13:12
rhalliseyI don't use ubuntu much, but I think you want trusty13:13
*** sacharya has quit IRC13:14
ccesariomewald, the build system it works on both ... trusty and  xenial13:18
mewaldccesario: On both systems I see "invoke-rc.d: policy-rc.d denied execution of start" quite a lot. should I be worried?13:20
ccesariomewald, I remember saw some messages like this too.... but, this don 't cause error on image  :)13:24
*** dwalsh has joined #openstack-kolla13:25
*** belmoreira has quit IRC13:25
*** mdnadeem_ has joined #openstack-kolla13:30
*** belmoreira has joined #openstack-kolla13:30
mewaldDoes all the configuration of services (ini file merge) and setting of passwords happen during build or is this part of the deploy process?13:32
*** mdnadeem has quit IRC13:33
rhalliseymewald, deploy13:34
*** dwalsh has quit IRC13:35
*** fbarilla has joined #openstack-kolla13:35
fbarillais Kolla already supported on Ubuntu 16.04 containers ?13:37
rhalliseyhttps://review.openstack.org/#/c/329454/13:38
patchbotrhallisey: patch 329454 - kolla - Pin to the Ubuntu 16.0413:38
*** dwalsh has joined #openstack-kolla13:44
*** williamcaban has quit IRC13:48
*** williamcaban has joined #openstack-kolla13:48
*** inc0 has joined #openstack-kolla13:49
*** ppowell has joined #openstack-kolla13:50
*** SiRiuS has joined #openstack-kolla13:53
*** SiRiuS has quit IRC14:01
*** williamcaban has quit IRC14:02
*** jtriley_ has joined #openstack-kolla14:04
*** daneyon has joined #openstack-kolla14:06
*** jtriley has quit IRC14:07
*** daneyon has quit IRC14:11
*** v1k0d3n has joined #openstack-kolla14:15
openstackgerritHui Kang proposed openstack/kolla: Add named volume for nova-libvirt  https://review.openstack.org/30547114:17
*** zhiwei has quit IRC14:20
*** v1k0d3n has quit IRC14:20
*** jrist has joined #openstack-kolla14:20
*** jrist has quit IRC14:22
*** jrist has joined #openstack-kolla14:22
*** SiRiuS has joined #openstack-kolla14:23
*** cloudnautique has joined #openstack-kolla14:24
*** cloudnautique has quit IRC14:26
ccesariohi rhallisey and inc0 ... thank you so much by your answers :)14:27
rhalliseyno problem14:27
inc0np ccesario14:28
inc0hello everyone btw14:28
mewaldA conceptual question: during the build, I can see db sync happening for the various services e.g. glance-manage db_sync etc … Where does it create the tables? Does this run against the local sqlite DB? if not: how does it get into the mysql db?14:28
ccesariorhallisey, inc0 the patch already it works ? or is is "alpha" code!?14:28
inc0mewald, first, it's during deploy, build is separate thing14:29
rhalliseyccesario, I think there is only a patch out for heat, but you can implement the cinder bits if you want :)14:29
rhalliseyshouldn't be to hard14:29
mewaldinc0: I am seeing it during "kolla-build ….."14:29
ccesarioahhhh right.... let me check the ps/bp14:30
inc0and second, databases are created here: https://github.com/openstack/kolla/blob/master/ansible/roles/nova/tasks/bootstrap.yml#L214:30
inc0mewald, strange, we never create databases or anything during build14:31
inc0in fact, there is no database in existance back then14:31
mewaldinc0: maybe its just part of the "apt-get install" of the package to populate the sqlite db14:32
*** Liuqing has quit IRC14:34
*** Lyncos has joined #openstack-kolla14:41
*** belmoreira has quit IRC14:46
*** belmoreira has joined #openstack-kolla14:47
*** ayoung has quit IRC14:48
*** jtriley_ has quit IRC14:48
*** inc0_ has joined #openstack-kolla14:51
*** inc0_ has quit IRC14:53
*** inc0 has quit IRC14:53
*** matrohon has quit IRC14:54
*** Lyncos has left #openstack-kolla14:58
*** daneyon has joined #openstack-kolla15:01
*** williamcaban has joined #openstack-kolla15:02
*** sacharya has joined #openstack-kolla15:04
*** sacharya_ has joined #openstack-kolla15:05
*** sacharya has quit IRC15:09
*** sacharya has joined #openstack-kolla15:09
*** mliima has quit IRC15:10
*** sachary__ has joined #openstack-kolla15:11
*** sacharya_ has quit IRC15:12
*** sacharya has quit IRC15:14
*** mliima has joined #openstack-kolla15:15
*** jtriley has joined #openstack-kolla15:21
*** vhosakot has joined #openstack-kolla15:24
*** SiRiuS has quit IRC15:26
*** jtriley has quit IRC15:28
*** harlowja_at_home has joined #openstack-kolla15:28
*** belmoreira has quit IRC15:30
*** Serlex has quit IRC15:31
*** jtriley has joined #openstack-kolla15:32
*** mgoddard_ has quit IRC15:38
*** mewald has quit IRC15:49
*** mummer has joined #openstack-kolla15:53
*** arafferty_ has joined #openstack-kolla16:06
*** mummer has quit IRC16:09
*** arafferty__ has joined #openstack-kolla16:12
*** arafferty__ has quit IRC16:14
*** vhosakot has quit IRC16:15
*** williamcaban has quit IRC16:16
*** arafferty_ has quit IRC16:16
*** vhosakot has joined #openstack-kolla16:17
*** fbarilla has quit IRC16:21
*** inc0 has joined #openstack-kolla16:22
Mech422Morning16:23
*** zhiwei has joined #openstack-kolla16:28
*** ppowell has quit IRC16:31
*** zhiwei has quit IRC16:32
*** ayoung has joined #openstack-kolla16:38
*** harlowja_at_home has quit IRC16:47
*** daneyon_ has joined #openstack-kolla16:49
*** daneyon_ has quit IRC16:53
wirehead_heya16:54
*** inc0 has quit IRC16:58
*** ssurana has joined #openstack-kolla17:04
*** daneyon_ has joined #openstack-kolla17:06
*** daneyon has quit IRC17:09
*** mgoddard has joined #openstack-kolla17:19
*** jtriley_ has joined #openstack-kolla17:24
*** SiRiuS has joined #openstack-kolla17:26
*** jtriley has quit IRC17:27
openstackgerritMd Nadeem proposed openstack/kolla: Add unit test for stop and restart container  https://review.openstack.org/33152417:37
openstackgerritMd Nadeem proposed openstack/kolla: Add test for remove container, get state and get env  https://review.openstack.org/33155617:38
*** murphyslawbbs has quit IRC17:48
*** ppowell has joined #openstack-kolla17:48
*** ssurana has quit IRC17:49
*** inc0 has joined #openstack-kolla18:00
*** mgoddard has quit IRC18:01
openstackgerritMarc-Andre Gatien proposed openstack/kolla: merge calico integration to kolla  https://review.openstack.org/32775918:03
*** fragatina has quit IRC18:05
openstackgerritMerged openstack/kolla: Remove useless comment in the sources.list  https://review.openstack.org/33140218:11
openstackgerritMerged openstack/kolla: Remove mesos artifacts  https://review.openstack.org/33142718:11
*** shakamunyi has quit IRC18:17
*** haplo37_ has joined #openstack-kolla18:19
*** SiRiuS has quit IRC18:21
*** sbezverk_ has quit IRC18:36
Mech422wirehead_: so, I tried using the k8s contrib/ansible setup with multiple masters and it barfed...18:37
*** daneyon has joined #openstack-kolla18:37
Mech422wirehead_: do you know if thats a known issue, or am I just lucky ?18:37
Mech422wirehead_: (worked a treat with single master though :-) )18:37
*** ssurana has joined #openstack-kolla18:39
openstackgerritKen Wronkiewicz proposed openstack/kolla: Horizon interface address and memcached override  https://review.openstack.org/33082818:40
wirehead_Mech422: Not sure, we’ve got ours set up with a single master.18:40
wirehead_Mech422: Mainline is only able to do a single master, there’s a PR for multiple-master.18:41
*** daneyon has quit IRC18:42
Mech422wirehead_: ahh - thats probably it then - I just used the 'master' branch18:43
Mech422wirehead_: ok - don't need to waste time on that then - thanks!18:43
wirehead_Yeah, I probably said that when we last chatted about it but I might have been inadequately clear.18:43
Mech422inc0: btw - I'm not finding an ansible 'module' for ceph - just playbooks18:43
wirehead_Hence leading you on a wild goose chase.  Sad.18:43
Mech422wirehead_: you probably did - I'm just an idgit :-P18:44
inc0Mech422, module is find_disk18:44
Mech422inc0: no - I mean an ansible module for ceph...18:45
Mech422inc0: we wanted to discus 'alternatives' to the current setup at wed. meeting18:45
inc0why would you need module?18:45
wirehead_I think dcwangmit01_ is getting lunch, but he would be the right person if you want to know about setting up ceph outside of Kolla.18:45
inc0that's find_disk - thats module what uses udev and stuff18:45
Mech422inc0: you asked me to look at _alternatives_ to how we do it now...and mentioned a ceph module18:46
inc0Mech422, I meant find_disks18:46
inc0this is ansible module we have that ceph uses18:46
Mech422inc0: I'm just saying, I haven't found it - I did find that ceph puts out pre-cooked VMs though18:46
inc0to well...find disksl(18:46
inc0aaaa18:46
inc0hold on18:47
Mech422inc0: err..pre-cooked containers rather18:47
inc0Mech422, https://github.com/ceph/ceph-ansible18:47
Mech422inc0: ok - so there's just playbooks - no module...cool18:48
inc0yeah18:49
inc0sorry for misunderstanding18:49
Mech422inc0: No biggie - I probably was running low on caffiene at the time18:49
Mech422inc0: btw - how do we feel about using vendor supplied containers ?18:49
inc0Mech422, I'd rather have vendors work on template overrides18:50
inc0but we can deploy custom containers now if it's compatible with our own18:50
Mech422inc0: ok - just look at the ceph containers from a 'how do they work' standpoint and not a 'could we use these in kolla' standpoint ?18:50
inc0so technically we just need to figure out how to configure other services to external ceph18:53
inc0these are only apis18:53
Mech422inc0: oh - I thought 'external' ceph worked like 'external' mysql - turn off the feature in globals, but provide the connection info18:54
*** stvnoyes has quit IRC18:54
inc0there is a bit more conf that that in ceph case unfortunately18:54
*** stvnoyes has joined #openstack-kolla18:55
Mech422inc0: ok - I'll poke that later and see what it takes18:55
*** jianqing has quit IRC19:02
openstackgerritMarc-Andre Gatien proposed openstack/kolla: merge calico integration to kolla  https://review.openstack.org/32775919:06
*** fragatina has joined #openstack-kolla19:07
*** ppowell has quit IRC19:12
*** zhiwei has joined #openstack-kolla19:17
*** zhiwei has quit IRC19:21
*** inc0 has quit IRC19:24
*** Jeffrey4l_ has joined #openstack-kolla19:32
*** Jeffrey4l has quit IRC19:33
*** inc0 has joined #openstack-kolla19:42
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Fix Docker version in quickstart  https://review.openstack.org/33133719:54
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Fix docs for Ansible 2.1 support, remove some of the notes.  https://review.openstack.org/33080519:55
wirehead_rhallisey: so, I set up an all-in-one demo for Kolla-Kubernetes with Horizon and Keystone.  I can kill the Keystone pod and it’ll respawn and everything will work as if nothing’s wr ong.20:05
rhalliseynice20:06
rhalliseywirehead_, I'm trying to work on our deployment a bit20:06
rhalliseyevaluating ansible20:06
wirehead_Yeah, like everything I’ve gone after with the RC and Services in Kube ‘should just work’ for the usual definition thereof with multi-node. :D20:07
rhalliseyright20:08
wirehead_But I’m still using all-in-one.20:08
rhalliseywirehead_, once I get this poc with ansible done we can evaluate it20:08
rhalliseyI think it will make the deployment way smoother20:08
wirehead_Yeah.20:08
wirehead_I’m going to be seriously unhappy if we’re writing Yet Another Kubernetes Installer. :D20:09
rhalliseynah this would be equivalent to the CLI20:09
rhalliseysince the CLI + extend_start is essentially a workflow, ansible is a nice fit20:09
rhalliseyI just have to write the kubernetes modules20:10
rhalliseymodule*20:10
wirehead_Well, there’s contrib/ansible.20:10
wirehead_in the kube tree.20:10
rhalliseyI think that's for install kube20:11
wirehead_OH, you are orchestrating ansible to install atop kube?20:11
rhalliseyansible will contact the client to create the pods20:12
wirehead_rhallisey: https://github.com/ansible/ansible-modules-extras/issues/113920:12
*** fragatina has quit IRC20:13
rhalliseywirehead_, I looked at already, there's not enough there20:13
*** fragatina has joined #openstack-kolla20:14
wirehead_k20:14
rhalliseyat least I think so..20:15
wirehead_*shrug* I don’t think I know Ansible well enough to judge.20:15
wirehead_OTOH, this is proooobably something other people want.20:16
rhalliseyI don't think you can get status of pods/containers20:16
wirehead_No, doesn’t look it.20:18
rhalliseyapi_request20:19
rhalliseythat could be what I need20:19
wirehead_Yeah, you could always start with this branch and add stuff: https://github.com/ansible/ansible-modules-extras/pull/122920:21
wirehead_Because the comment was “Hey, where is the advantage of a ansible module above just running kubectl” :D20:23
*** daneyon has joined #openstack-kolla20:26
wirehead_Anyway, yeah, one thing that’s weird about the current setup is that I’ve got to hardcode a few things in the globals.yml file because variable substitution doesn’t work in kolla-kubernetes land.20:26
wirehead_(I’d researched this exact problem like a month ago, hence why I had that URL in mind)20:27
rhalliseygotcha20:28
rhalliseyya I think it needs to be extended to get status20:28
*** daneyon has quit IRC20:30
*** gfidente is now known as gfidente|afk20:33
*** sbezverk has joined #openstack-kolla20:34
*** mliima has quit IRC20:40
*** jtriley_ has quit IRC20:41
*** ssurana has quit IRC20:41
*** haplo37_ has quit IRC21:00
*** ssurana has joined #openstack-kolla21:05
*** dwalsh has quit IRC21:06
*** salv-orlando has joined #openstack-kolla21:22
*** inc0 has quit IRC21:28
*** zhiwei has joined #openstack-kolla21:33
*** zhiwei has quit IRC21:37
*** zhiwei has joined #openstack-kolla21:48
*** zhiwei has quit IRC21:53
openstackgerritJoshua Harlow proposed openstack/kolla: Add a cloud-init RHEL(ish) bootstrap + run kolla script  https://review.openstack.org/32180222:02
*** sachary__ has quit IRC22:06
*** sacharya has joined #openstack-kolla22:06
*** jtriley has joined #openstack-kolla22:07
*** daneyon_ has quit IRC22:14
*** jtriley has quit IRC22:20
*** kfox1111 has joined #openstack-kolla22:45
kfox1111say I want to just genconfig for kolla-kubernetes.22:46
Mech422anyone happen to know if the 'container_format' setting in glance is glance-api or glance-registry?  The config shows in the glance-registry container but in /etc/glance/glance-api.conf - in the api container, the setting doesn't show up at all ?22:46
kfox1111I'm trying to do it as my local user, but its trying to write something into /etc/.ansible_m_sysctl_PPy9B2.conf22:46
kfox1111for haproxy.... why is it trying to do that?22:46
Mech422it is the api container, it appears... odd22:52
wirehead_Hmm.22:58
wirehead_Wait, so you are trying to run kolla-kubernetes and looking at genconfig?22:58
wirehead_The genconfig stuff is a still very much kolla-styled and unnecessary and weird stuff is being done there.23:00
wirehead_rhallisey: So I dug into the keystone bootstrap failure ticket - https://review.openstack.org/#/c/330777/23:03
patchbotwirehead_: patch 330777 - kolla-kubernetes - Fix keystone bootstrap failure23:03
wirehead_rhallisey: Looks like it works only when ncpu = 1.  I’ve been running it at ncpu=2 and then it fails.23:03
*** sacharya has quit IRC23:05
kfox1111is there something else I should be doing then?23:07
kfox1111I tried just to do a kolla-kubernetes run horizon23:07
kfox1111and it almost works, but the configmap is blank.23:07
kfox1111I was assuming because the configs weren't generated and had to use kolla-ansible genconfig to build them.23:07
*** daneyon has joined #openstack-kolla23:08
kfox1111the code seems to iterate over a directory (not sure which) to build out the configmap.23:08
kfox1111I did file a bug with some of the weirdness I saw with genconfig here: https://bugs.launchpad.net/kolla/+bug/159460523:08
openstackLaunchpad bug 1594605 in kolla "kolla-ansible genconfig unprivileged" [Undecided,New]23:08
wirehead_So, I’ve been running kolla-kubernetes mostly in a vagrant box with kolla installed as editable and kolla-kubernetes installed on the system level.23:10
kfox1111confirmed... get_service_config_files is looking in directory = os.path.join('/etc/kolla/', service_name)23:11
wirehead_kfox1111: https://etherpad.openstack.org/p/kfox-kolla-kubernetes23:11
wirehead_Those are the patches I’ve applied atop mainline in kolla.23:11
kfox1111hmm. k.23:12
wirehead_I just added what my globals.yml file looks like;23:12
*** daneyon has quit IRC23:12
kfox1111cool. thanks. :)23:12
wirehead_There’s only one patch there for the kolla-kuberentes, and that’s only if you have multiple CPUs.23:13
kfox1111I was thinking of starting very very slow. We currently have a ha cloud not deployed with containers at all, except,23:13
kfox1111we have horizon deployed using standalone kubelet using kolla containers.23:13
kfox1111I was thinking of switching that around to try and use kolla-kubernetes.23:13
wirehead_OK.23:13
rhalliseywirehead_, weird that's what's causing that23:14
kfox1111and maybe contribute some code. the setup we use uses a mysql db for storage for horizon so it can be clustered.23:14
wirehead_kfox1111: OK, well I was just playing with kolla-kubernetes and Horizon today. :)23:15
kfox1111:)23:15
wirehead_Like, take a gander at https://review.openstack.org/#/c/330828/23:16
patchbotwirehead_: patch 330828 - kolla - Horizon interface address and memcached override23:16
wirehead_It’s not especially hard to dual-mode Kolla configs.23:17
kfox1111cool.23:17
kfox1111has anyone looked at petsets yet?23:18
wirehead_Either it resolves things from fixed Kolla-ansible style groups.  OR it points at a load balancer.23:18
wirehead_I’ve looked at them.23:18
wirehead_I’m mostly focusing my energy at getting kolla-kubernetes to a demonstratable state.23:18
kfox1111sure, thats a good thing. :)23:20
wirehead_While some folks are going to be quite happy with MariaDB using a Ceph mapped disk and the configurable delay time before kubernetes reschedules MariaDB off of a failed node, I’d like to see kolla-kubernetes have a HA Galera config.23:20
wirehead_But the way that Kolla-kubernetes and horizon is currently implemented, if you pull down those patches, it should at least roughly work.23:20
kfox1111yeah. us too. we have a galera cluster already, so would just use that outside of containers at least until its supported.23:20
wirehead_So, as long as you set keystone_database_address to your galera cluster, we might have actually achieved some degree of flexibility.23:21
wirehead_Err, not just keystone_database_address23:22
kfox1111yeah. my hope is, I can use kolla-kubernetes to transition a service at a time.23:23
kfox1111(once things are all done)23:23
kfox1111I've played with rolling upgrades with http servers with k8s recently. its interesting.23:24
kfox1111it does seem to pull the terminating node from the service lb right away, but estabished traffic does correctly continue to the terminating node.23:24
kfox1111k8s doesn't know how to tell if the traffic is ongoing though, so the container has to block itself until all traffic is done.23:25
*** salv-orlando has quit IRC23:25
kfox1111I'm curious how that's going to work with the api services.23:25
wirehead_Yeah.23:25
kfox1111if the python processes were run out of wsgi through apache/nginx, the stop scripts for that would drain properly. I did test that bit.23:25
kfox1111I don't know if eventlet has anything like that though. :/23:25
wirehead_Um, so I’ve spent too much time around Twisted Python developers, so eventlet bothers me in all sorts of ways.23:26
kfox1111:)23:26
kfox1111I'm hoping there's an easier solution then wrapping each service in nginx/apache though. that would make a lot of curn in the containers. :/23:26
kfox1111churn23:27
wirehead_Well, Ingress resources are interesting.23:27
kfox1111btw, watch_log_file=True   is very bad right now...23:28
kfox1111issues a blocking call eventlet doesn't override. :/23:28
wirehead_…and this is why I hate eventlet. :D23:28
kfox1111Yeah. I'm curious what they have planned there. The initial implementation isn't scalable. only scalable on the google cloud. :/23:28
kfox1111octavia looks cool, but still suffers from assuming http traffic. :/23:29
kfox1111ok. patched out some syscfg bits, and got it to fully generate config...23:30
*** yuanying has joined #openstack-kolla23:31
kfox1111yup. the genconfig thing fixed the configmap failing to generate properly.23:33
Mech422wirehead_: you don't have a patch handy for enabling novadocker do you?23:33
Mech422wirehead_: or do you run VMs inside kolla?23:34
kfox1111https://bugs.launchpad.net/kolla/+bug/1594605 for details.23:34
openstackLaunchpad bug 1594605 in kolla "kolla-ansible genconfig unprivileged" [Undecided,New]23:34
kfox1111actually, it doesn't need too much patching to get it to run as not root.23:34
kfox1111which will be awesome to be able to do, since you should be able to do kolla-kubernetes as your own user.23:35
wirehead_kfox1111: yeah, that would make a lot of stuff easier.23:35
wirehead_Mech422: Hm.  Others wrote the Nova controllers and I’m just starting to look at them so I can turn them into proper services.23:36
Mech422wirehead_: no biggie - I'm just being lazy...23:37
Mech422wirehead_: it looks like the current novadocker tree needs a slight patch to find 'my_ip' - and I didn't want to figure out how to patch in an --include file :-P23:37
*** sdake has joined #openstack-kolla23:38
Mech422oh wait - I'm tracking master on kolla now, not stable/mitaka..23:39
wirehead_Hey, sdake sorry I missed you last Friday, but to answer your -2, memcached’s patch to turn off net=host has been merged already: https://review.openstack.org/#/c/326757/23:40
patchbotwirehead_: patch 326757 - kolla-kubernetes - Convert Memcached to work without HostNetwork=True (MERGED)23:40
Mech422I'll try using the master branch for novadocker - I had it pinned at stable/mitaka23:40
kfox1111wirehead_: did you write the kolla-kubernetes tool?23:41
wirehead_kfox1111: I think I’ve contributed like 2 lines to kolla-kubernetes in total.23:41
kfox1111ah. ok.23:42
rhalliseykfox1111,  looking at ansible to better orchestrate things23:42
*** sdake_ has joined #openstack-kolla23:42
*** sdake has quit IRC23:43
sdake_hey folks23:43
wirehead_heya sdake.23:43
kfox1111hi23:43
Mech422hi sdake :-)23:44
wirehead_sdake_: if you missed it last time, to answer your -2, memcached’s patch to turn off net=host has been merged already: https://review.openstack.org/#/c/326757/23:44
patchbotwirehead_: patch 326757 - kolla-kubernetes - Convert Memcached to work without HostNetwork=True (MERGED)23:44
sdake_coolgot a link to the patch wher ethe -2 is23:45
wirehead_sdake_: https://review.openstack.org/#/c/328569/23:45
patchbotwirehead_: patch 328569 - kolla - Keystone interface address and memcached override23:45
kfox1111hmm.... Listen {{ hostvars[inventory_hostname]['ansible_' + api_interface]['ipv4']['address'] }}:8023:45
sdake_enjoy23:45
kfox1111review 327925 maybe?23:46
wirehead_sdake_: and https://review.openstack.org/#/c/327925/ is missing one +2 and blocking a bunch of tickets23:46
patchbotwirehead_: patch 327925 - kolla - Enable kolla k8s to override bind api bind address...23:46
*** vhosakot has quit IRC23:46
wirehead_:D23:46
sdake_ben out of the office all day23:46
sdake_trying to catch up on backlog23:46
sdake_give me a bit of time to read through my emails :)23:46
wirehead_Well, hopefully you didn’t melt, considering that some seasoned sportspeople said “Eh, I can handle teh Arizona Heats” and ended up not being able to handle teh Arizona Heats.23:47
*** jtriley has joined #openstack-kolla23:47
wirehead_Mech422: So, I haven’t turned Nova’s containers into RCs nor have I turned on host networking, so those may not actually work on the multi-node case.23:53
wirehead_err..  turned off host networking.23:53

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!