Wednesday, 2017-04-26

*** myoung has joined #openstack-kolla00:01
*** rwellum has quit IRC00:01
*** jrich523 has quit IRC00:01
jascott1masber does it stop libvirt before that task and fail to do so?00:02
masberjascott1, I think libvirt is not installed00:04
sbezverkkfox1111: have you played with cloud-init/cloud-config ?00:04
*** scheuk_ has quit IRC00:05
*** haplo37_ has quit IRC00:05
kfox1111sbezverk: yeah.00:05
kfox1111whats up?00:05
sbezverkkfox1111: trying to customize baremetal image to setup interfaces with static ip addresses and bring them up00:06
jascott1masber it says exists true00:06
sbezverkso far I managed only to customize host name and create a user :)00:06
masberroot@nova-compute:~# sudo systemctl start libvirtd.service00:06
masberFailed to start libvirtd.service: Unit libvirtd.service not found.00:06
sbezverkthe rest keeps ignoring my wish00:07
kfox1111sbezverk: ah...00:07
kfox1111so... cloudinit... yeah...00:07
kfox1111the big problem with cloudinit, is its a non standard. :/00:07
sbezverkkfox1111: their doc eve worse than kolla-kubernetes ;) cannot find anything00:08
kfox1111so, the cloud-init for version 7 of centos, is different then the version that comes with 6. or with ubuntu. :/00:08
jascott1masber so `sudo ls /var/run/libvirt/libvirt-sock` doesnt exist?00:08
kfox1111they have a lot of plugins, which is good,00:08
kfox1111but the assortment of plugins enabled in default images is seemingly random. :/00:08
kfox1111so half the stuff just doesn't work. :/00:08
jascott1that looks like result of stat on that path00:08
sbezverkkfox1111: great :(00:08
masberjascott1, yes it exists00:08
kfox1111sbezverk: so its best to look at your particulr image, and see what pugins are enabled and restrict yourself to that,00:09
jascott1that check must be coming back true then00:09
kfox1111or,00:09
kfox1111give up and just put shell in cloud init. it works every time. :)00:09
jascott1im not sure what state the socket is supposed to be in when the service isnt started00:09
kfox1111I've taken to doing the latter.00:09
jascott1maybe its not gettin cleaned up00:09
sbezverkkfox1111: can you elaborate more on the second way, or if you have an example that would be even better..00:10
kfox1111a kind of middleground, is to use shell to git clone a repo of "insert favorite standalone config management tool here  (puppet, chef, ansible)00:10
kfox1111and then start it up.00:10
kfox1111sbezverk: if the cloud-init script starts with #!/bin/bash, it will just execute the whole thing. :)00:10
sbezverkkfox1111: so where would I stick this script? I am passing now user-data inside of a opensatck config drive00:11
kfox1111yeah. just make your user-data a bash script.00:12
kfox1111let me rephrase. upload a bash script as user-data.00:12
sbezverkkfox1111: interesting, then basically everything get programmed by bash right?00:14
*** scheuk has joined #openstack-kolla00:14
kfox1111yeah.00:14
kfox1111I tend to do it that way. but I kind of prefer bash.00:15
kfox1111there's no reason you can't have the bash script kick off some other language process though.00:15
*** haplo37_ has joined #openstack-kolla00:16
sbezverkkfox1111: ok, thanks I will have fun then with bash :)00:16
openstackgerritMerged openstack/kolla-kubernetes master: FIX cell0 copy nova.conf permission issue  https://review.openstack.org/45978500:16
*** scheuk has quit IRC00:19
sbezverkkfox1111: cloud-init, does it run as a root?00:21
sdakesbezverk can you ack: https://review.openstack.org/#/c/452854/00:21
sdakekfox1111 sbezverk can you ack: https://review.openstack.org/#/c/452855/900:21
sdakeanything in that chain really :)00:22
kfox1111sbezverk: yes.00:22
openstackgerritMerged openstack/kolla-kubernetes master: Ensure that /tftpboot/pxelinux.cfg is owned by Ironic  https://review.openstack.org/45976900:22
sbezverkkfox1111: cool so I do not need to bother with sudo00:22
kfox1111sdake: done.00:22
openstackgerritMerged openstack/kolla-kubernetes master: Deployment guide updation for better followup  https://review.openstack.org/45787000:22
kfox1111sbezverk: yeah.00:22
sdakekfox1111 thanks :)00:23
sdakein need of a second ack: https://review.openstack.org/#/c/452857/00:23
masberjascott1, so what should I do?00:24
openstackgerritMerged openstack/kolla-kubernetes master: Remove services/iscsi  https://review.openstack.org/45285400:26
openstackgerritMerged openstack/kolla-kubernetes master: Remove services/mariadb  https://review.openstack.org/45285500:26
openstackgerritMerged openstack/kolla-kubernetes master: Remove services/memcached  https://review.openstack.org/45285600:26
masberjascott1, ok I rebooted the node and now looks ok00:27
jascott1awesome00:27
openstackgerritMerged openstack/kolla-kubernetes master: Remove services/neutron  https://review.openstack.org/45285700:29
openstackgerritMerged openstack/kolla-kubernetes master: Remove services/rabbitmq  https://review.openstack.org/45285800:29
openstackgerritMerged openstack/kolla-kubernetes master: Remove services/skydns  https://review.openstack.org/45285900:29
openstackgerritMerged openstack/kolla-kubernetes master: Modify WARNING into RST format  https://review.openstack.org/45286000:29
masberwould it be possible to create a kolla-kubernetes prove of concept with openstack + ceph using only 2 nodes?00:30
kfox1111masber: yes.00:30
kfox1111or even 1.00:31
masberone node for computing and another one for ceph?00:31
kfox1111the gate does it all in once, or ceph/controller on one and compute on another.00:31
masberI actually mean 3 nodes (1 small node for control plane, 1 node for computing and another node for ceph)00:31
kfox1111should work.00:31
masberwould you mix the control plane containers among all the nodes or would you have them running on dedicated hardware?00:32
kfox1111personally? hmmmm...00:33
kfox1111if I could afford it, seperate.00:33
kfox1111avoids the noisy neighbor problem from effecting your control plane.00:34
masberyes I agree00:34
masberI am playing with kolla-ansible and I saw better performance when I run control node separate00:34
sbezverkkfox1111: what about password for root? should I just set one up?00:34
masberhowever going back to kolla-kubernetes, all nodes would be under the same kubernetes cluster is that right? or would you also have 2 k8s clusters one for control and another for computing and another for ceph?00:35
kfox1111sbezverk: I don't think there is a default password. so unless you set one, you can't do too much.00:37
kfox1111but...00:37
kfox1111its not the most secure of communications channels.00:37
kfox1111probably best to just use ssh public key injection.00:38
*** duonghq has joined #openstack-kolla00:38
kfox1111gotta head out for a while. l8r all.00:38
*** rhallisey has quit IRC00:38
sbezverkkfox1111: got it, since it is just for demo, should not be too bad ;)00:39
sbezverkkfox1111: take care00:39
*** StephenWang1991 has joined #openstack-kolla00:40
masberhorizon container does not work properly on ubuntu-binaries images00:42
*** StephenWang1991 has quit IRC00:42
*** cuongnv has joined #openstack-kolla00:43
masberthis is what I see when I login http://pasteboard.co/8JXjPibAJ.png00:45
masberI tried deleting the horizon image and redeploying it but still same00:46
*** duonghq has quit IRC00:46
*** duonghq has joined #openstack-kolla00:47
masberthis is what I can see from the browser console/logs http://pasteboard.co/8JZb7Y46b.png00:47
*** tovin07_ has joined #openstack-kolla00:47
*** britthouser9 has joined #openstack-kolla00:54
openstackgerritMerged openstack/kolla-kubernetes master: Hardware requirements added in deployment guide  https://review.openstack.org/45975800:55
*** britthouser has quit IRC00:55
*** scheuk has joined #openstack-kolla00:56
*** MasterOfBugs has quit IRC00:59
inc0evening gents01:00
*** dmellado has quit IRC01:00
*** Administrator_ is now known as zhugaoxiao01:00
inc0and ladies ofcourse01:00
spsuryainc0: evening :)01:02
*** dmellado has joined #openstack-kolla01:02
*** yuanying_ has joined #openstack-kolla01:04
*** dixiaoli has joined #openstack-kolla01:05
*** yuanying has quit IRC01:06
sbezverkinc0: could you check one fix in kolla please?01:07
sbezverkinc0: https://review.openstack.org/45698001:07
sbezverkI hit this issue why playing with baremetal01:08
inc0thans, starred01:09
inc0I'll check it out tomorrow01:09
*** yangyapeng has joined #openstack-kolla01:14
*** yangyapeng has quit IRC01:15
inc0interesting bug on fresh neutron01:15
inc02 ips are getting associated but only one works01:16
*** yangyapeng has joined #openstack-kolla01:16
*** jayahn has joined #openstack-kolla01:16
*** scheuk has quit IRC01:18
*** scheuk has joined #openstack-kolla01:20
*** scheuk has quit IRC01:21
*** scheuk has joined #openstack-kolla01:22
*** zhubingbing has joined #openstack-kolla01:22
*** scheuk has quit IRC01:22
*** japestinho has joined #openstack-kolla01:23
*** huzhengchuan has joined #openstack-kolla01:23
*** eaguilar has quit IRC01:24
*** eaguilar has joined #openstack-kolla01:27
*** hrw has quit IRC01:30
*** hrw has joined #openstack-kolla01:32
duonghqevening inc001:37
duonghqsdake, I'm sorry, I got tired last night, cannot join your workshop01:38
*** zhuzeyu has joined #openstack-kolla01:38
*** huzhengchuan has quit IRC01:53
*** unicell has quit IRC02:03
*** felixtsang has joined #openstack-kolla02:04
*** MasterOfBugs has joined #openstack-kolla02:05
*** felixtsang has quit IRC02:06
*** felixtsang has joined #openstack-kolla02:07
*** huzhengchuan has joined #openstack-kolla02:08
*** jayahn has quit IRC02:08
*** eaguilar_ has joined #openstack-kolla02:09
*** eaguilar has quit IRC02:10
*** tervancovan has joined #openstack-kolla02:12
*** imcsk8_ has joined #openstack-kolla02:15
*** imcsk8 has quit IRC02:15
*** felixtsang has quit IRC02:27
*** felixtsang has joined #openstack-kolla02:27
*** zhurong has joined #openstack-kolla02:33
openstackgerrithosup choi proposed openstack/kolla-kubernetes master: Update deployment-guide for ubuntu user  https://review.openstack.org/45916302:42
openstackgerrithosup choi proposed openstack/kolla-kubernetes master: Seperate kolla and kolla-ansible search paths  https://review.openstack.org/45922802:43
*** adrian_otto has joined #openstack-kolla02:45
*** goldyfruit has joined #openstack-kolla02:49
sdakeduonghq its recorded02:52
sdakehttps://drive.google.com/open?id=0B8q6xDPETSkHTkZfRTVhYzhSaW802:52
duonghqsdake, thanks02:52
*** ssurana has joined #openstack-kolla02:58
*** unicell has joined #openstack-kolla03:00
*** goldyfruit has quit IRC03:00
*** ssurana has quit IRC03:03
*** adrian_otto has quit IRC03:09
*** zhurong has quit IRC03:15
*** iniazi has joined #openstack-kolla03:16
*** gkadam has joined #openstack-kolla03:19
*** schwicht has joined #openstack-kolla03:21
*** vhosakot has quit IRC03:22
*** salv-orlando has joined #openstack-kolla03:38
*** cuongnv has quit IRC03:40
*** cuongnv has joined #openstack-kolla03:41
*** salv-orlando has quit IRC03:43
*** david-lyle has quit IRC04:05
*** david-lyle_ has joined #openstack-kolla04:05
*** mcnanci has quit IRC04:10
*** huzhengchuan has quit IRC04:10
*** felixtsang has quit IRC04:11
*** david-lyle_ is now known as david-lyle04:12
*** eaguilar_ has quit IRC04:15
*** huzhengchuan has joined #openstack-kolla04:30
*** eanylin has joined #openstack-kolla04:37
*** eanylin_ has joined #openstack-kolla04:38
*** salv-orlando has joined #openstack-kolla04:39
*** eanylin has quit IRC04:41
*** skramaja has joined #openstack-kolla04:41
*** salv-orlando has quit IRC04:44
*** mcnanci has joined #openstack-kolla04:45
*** skramaja has quit IRC04:46
*** jascott1 has quit IRC04:49
*** schwicht has quit IRC04:55
*** skramaja has joined #openstack-kolla04:56
*** ssurana has joined #openstack-kolla05:02
*** zhurong has joined #openstack-kolla05:07
*** salv-orlando has joined #openstack-kolla05:16
*** jascott1 has joined #openstack-kolla05:17
*** janki has joined #openstack-kolla05:19
*** felixtsang has joined #openstack-kolla05:26
*** yangyape_ has joined #openstack-kolla05:35
*** adrian_otto has joined #openstack-kolla05:48
*** felixtsang has quit IRC05:52
*** zhurong has quit IRC05:52
*** jmccarthy has joined #openstack-kolla05:56
*** dixiaoli_ has joined #openstack-kolla05:59
*** dixiaoli_ has quit IRC06:00
*** dixiaoli has quit IRC06:00
*** dixiaoli has joined #openstack-kolla06:01
*** yingjun has joined #openstack-kolla06:02
*** huzhengchuan has quit IRC06:05
openstackgerritChen proposed openstack/kolla master: Fix table formatting issue in README.rst  https://review.openstack.org/45995406:11
openstackgerritjianyi proposed openstack/kolla-ansible master: all.yml should be in alphabetical order  https://review.openstack.org/45995606:20
*** MarginHu has joined #openstack-kolla06:24
*** zhurong has joined #openstack-kolla06:24
*** caowei has joined #openstack-kolla06:26
*** caowei has quit IRC06:27
*** caowei has joined #openstack-kolla06:28
*** zhurong has quit IRC06:33
*** matrohon has joined #openstack-kolla06:52
*** chas has joined #openstack-kolla06:55
*** MarginHu has quit IRC06:57
*** MasterOfBugs has quit IRC07:00
*** manheim has joined #openstack-kolla07:00
*** manheim has quit IRC07:04
*** manheim has joined #openstack-kolla07:04
*** shardy has joined #openstack-kolla07:05
*** janki has quit IRC07:10
*** pcaruana has joined #openstack-kolla07:19
*** zhurong has joined #openstack-kolla07:28
*** adrian_otto has quit IRC07:31
*** nathharp has joined #openstack-kolla07:32
*** athomas has joined #openstack-kolla07:47
*** janki has joined #openstack-kolla07:51
openstackgerritBertrand Lallau proposed openstack/kolla-kubernetes master: deployment-guide.rst enhancement and small fixes  https://review.openstack.org/45939207:51
*** magicboiz has quit IRC07:59
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Make Ironic inspector honour inventory  https://review.openstack.org/43692908:08
*** zhurong has quit IRC08:08
*** gfidente has joined #openstack-kolla08:09
*** gfidente has quit IRC08:09
*** gfidente has joined #openstack-kolla08:09
*** tovin07 has quit IRC08:17
*** gfidente has quit IRC08:18
*** gfidente has joined #openstack-kolla08:19
*** gfidente has quit IRC08:19
*** gfidente has joined #openstack-kolla08:19
*** mgoddard has joined #openstack-kolla08:20
*** pbourke has joined #openstack-kolla08:23
openstackgerritMathieu Rohon proposed openstack/kolla master: Add skydive service  https://review.openstack.org/45999508:28
*** jaosorior_away is now known as jaosorior08:28
*** gfidente has quit IRC08:32
openstackgerritZeyu Zhu proposed openstack/kolla-kubernetes master: Add local registry option in deployment-guide  https://review.openstack.org/45999608:33
*** gkadam is now known as gkadam-afk08:33
*** gfidente has joined #openstack-kolla08:34
*** gfidente has quit IRC08:34
*** gfidente has joined #openstack-kolla08:34
*** jascott1 has quit IRC08:34
*** trozet has joined #openstack-kolla08:35
*** blallau has joined #openstack-kolla08:40
*** ssurana has quit IRC08:42
*** kolla-slack has quit IRC08:48
*** kolla-slack1 has joined #openstack-kolla08:48
*** Serlex has joined #openstack-kolla08:48
*** janki has quit IRC08:49
*** janki has joined #openstack-kolla08:49
*** lpetrut has joined #openstack-kolla08:53
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Cleanup privileged attribut usage in containers  https://review.openstack.org/46000808:57
*** sambetts|afk is now known as sambetts09:00
*** daidv has joined #openstack-kolla09:07
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix Telegraf container restarting issue  https://review.openstack.org/46001409:11
*** dixiaoli has quit IRC09:19
*** zhurong has joined #openstack-kolla09:21
*** dixiaoli has joined #openstack-kolla09:25
*** skramaja has quit IRC09:34
*** zhurong has quit IRC09:37
*** yangyapeng has quit IRC09:40
*** dixiaoli_ has joined #openstack-kolla09:40
*** dixiaoli_ has quit IRC09:42
*** mnasiadka has joined #openstack-kolla09:44
*** dixiaoli has quit IRC09:44
tervancovansdake plz merge this one https://review.openstack.org/#/c/459163/709:45
*** haplo37 has quit IRC09:47
*** salv-orl_ has joined #openstack-kolla09:49
*** salv-orlando has quit IRC09:52
*** salv-orl_ has quit IRC09:55
*** salv-orlando has joined #openstack-kolla09:55
*** eaguilar has joined #openstack-kolla09:56
*** haplo37 has joined #openstack-kolla09:56
*** lpetrut_ has joined #openstack-kolla09:58
*** yingjun has quit IRC10:00
*** lpetrut has quit IRC10:01
*** pbourke has quit IRC10:05
*** tovin07_ has quit IRC10:06
*** cuongnv has quit IRC10:08
*** yangyape_ has quit IRC10:11
*** yangyapeng has joined #openstack-kolla10:11
*** yangyapeng has quit IRC10:15
*** trozet has quit IRC10:17
*** egonzalez has joined #openstack-kolla10:20
*** StephenWang1991 has joined #openstack-kolla10:20
*** eaguilar has quit IRC10:23
*** duonghq has quit IRC10:24
*** gkadam-afk is now known as gkadam10:30
*** gfidente has quit IRC10:30
*** gkadam has quit IRC10:31
*** gkadam has joined #openstack-kolla10:31
*** gkadam is now known as gkadam-afk10:31
*** gfidente has joined #openstack-kolla10:31
*** gfidente has quit IRC10:33
*** gfidente has joined #openstack-kolla10:33
*** gfidente has quit IRC10:33
*** gfidente has joined #openstack-kolla10:33
*** mcnanci_ has joined #openstack-kolla10:34
*** skramaja has joined #openstack-kolla10:36
*** mcnanci has quit IRC10:36
*** jascott1 has joined #openstack-kolla10:39
*** jascott1 has quit IRC10:44
hrwmorning10:47
hrwdoes someone builds ubuntu based images using kolla master?10:47
*** salv-orl_ has joined #openstack-kolla10:48
hrwcause I have a feeling that no one does that10:48
*** salv-orlando has quit IRC10:51
*** pbourke has joined #openstack-kolla10:52
*** salv-orl_ has quit IRC10:52
*** shardy is now known as shardy_lunch11:09
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Ubuntu: use Pike repository  https://review.openstack.org/46007011:09
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Support non-x86 architectures (aarch64, ppc64le)  https://review.openstack.org/43094011:10
hrwdoing mass rebuild of ubuntu images now11:13
*** rwellum has joined #openstack-kolla11:14
*** iniazi_ has joined #openstack-kolla11:18
*** iniazi has quit IRC11:22
*** gkadam-afk is now known as gkadam11:23
*** StephenWang1991 has quit IRC11:33
*** daidv has quit IRC11:34
*** Serlex has quit IRC11:34
*** gfidente has quit IRC11:34
*** gfidente has joined #openstack-kolla11:35
*** rwallner has joined #openstack-kolla11:42
*** dciabrin has quit IRC11:45
*** rwallner_ has joined #openstack-kolla11:45
*** rwallner has quit IRC11:46
*** rwallner_ has quit IRC11:48
*** rwallner has joined #openstack-kolla11:48
*** dciabrin has joined #openstack-kolla11:50
*** papacz has joined #openstack-kolla11:52
*** tvignaud has quit IRC11:52
*** tvignaud has joined #openstack-kolla11:53
*** yingjun has joined #openstack-kolla11:54
*** egonzalez has quit IRC12:00
*** egonzalez has joined #openstack-kolla12:05
*** eanylin_ has quit IRC12:06
openstackgerritEduardo Gonzalez proposed openstack/kolla stable/ocata: Fix tempest dockerfile  https://review.openstack.org/46008312:11
*** StephenWang1991 has joined #openstack-kolla12:14
openstackgerritMerged openstack/kolla-ansible master: Grafana: automatically set InfuxDB datasource  https://review.openstack.org/45709412:18
*** eanylin_ has joined #openstack-kolla12:19
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Implement Keystone zero-downtime upgrade  https://review.openstack.org/42544612:21
*** Serlex has joined #openstack-kolla12:21
*** eanylin_ has quit IRC12:23
*** tervancovan has quit IRC12:24
*** syum has joined #openstack-kolla12:24
*** syum is now known as Guest4215712:25
*** schwicht has joined #openstack-kolla12:28
hrwegonzalez: what do you feel about https://review.openstack.org/460070 one? It moves ubuntu to use Pike repo12:29
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Change serial behavior for playbooks  https://review.openstack.org/46009012:32
*** schwicht has quit IRC12:32
egonzalezhrw didn't know ubuntu was using ocata repos till now :/12:34
egonzalezgood catch btw12:34
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Implement Keystone zero-downtime upgrade  https://review.openstack.org/42544612:35
*** rwallner has quit IRC12:36
*** esharao has joined #openstack-kolla12:36
*** rwallner has joined #openstack-kolla12:37
*** shardy_lunch is now known as shardy12:39
*** rhallisey has joined #openstack-kolla12:44
*** yingjun has quit IRC12:44
*** salv-orl_ has joined #openstack-kolla12:45
*** schwicht has joined #openstack-kolla12:45
*** yingjun has joined #openstack-kolla12:45
*** trozet has joined #openstack-kolla12:47
*** srwilkers has joined #openstack-kolla12:50
*** yangyapeng has joined #openstack-kolla12:50
*** skramaja has quit IRC12:51
*** schwicht has quit IRC12:51
*** salv-orl_ has quit IRC12:59
sbezverkegonzalez: do you have a second for qq?13:00
*** janki has quit IRC13:01
*** jascott1 has joined #openstack-kolla13:02
*** janki has joined #openstack-kolla13:02
*** egonzalez has quit IRC13:04
*** yangyapeng has quit IRC13:04
*** egonzalez has joined #openstack-kolla13:05
egonzalezsbezverk yep13:05
sbezverkegonzalez: thanks.. how do you guys deal with the case when an docker image requeres the same rpm for both source and binary install type?13:06
*** schwicht has joined #openstack-kolla13:06
sbezverkcan you check this ps and let me know if it does or does not follow normal practice? https://review.openstack.org/45988513:07
egonzalezsbezverk clear example is cinder base https://github.com/openstack/kolla/blob/master/docker/cinder/cinder-base/Dockerfile.j213:08
*** goldyfruit has joined #openstack-kolla13:08
sbezverkegonzalez: thanks I will check it out13:09
*** Pavo has joined #openstack-kolla13:09
*** jascott1 has quit IRC13:09
egonzalezsbezverk usually for binary packages are append to the same package  list and in source add new macros install and then install source13:09
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Generalize api_interface_address variable usage  https://review.openstack.org/45747913:12
*** gkadam has quit IRC13:12
*** Guest42157 has quit IRC13:12
*** blallau has quit IRC13:14
*** zhuzeyu has quit IRC13:16
*** zhuzeyu has joined #openstack-kolla13:17
*** rwallner has quit IRC13:17
*** jtriley has joined #openstack-kolla13:19
*** yangyapeng has joined #openstack-kolla13:20
*** Pavo has quit IRC13:20
*** eaguilar has joined #openstack-kolla13:23
*** rwallner has joined #openstack-kolla13:24
kfox1111morning.13:25
*** yangyapeng has quit IRC13:25
*** jchhatbar has joined #openstack-kolla13:26
*** janki has quit IRC13:28
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP: Add Prometheus support.  https://review.openstack.org/45947313:29
*** yingjun has quit IRC13:29
*** papacz has quit IRC13:29
openstackgerritSerguei Bezverkhi proposed openstack/kolla master: Fixing missing genisoimage in nova-compute-ironic  https://review.openstack.org/45988513:32
sbezverkkfox1111: good morning, early today ;) ??13:32
sbezverkegonzalez: please check this version https://review.openstack.org/45988513:32
kfox1111sbezverk: alittle bit. :)13:34
hrwegonzalez: that's why I asked does someone build those ;D13:34
*** Pavo has joined #openstack-kolla13:35
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Implement Keystone zero-downtime upgrade  https://review.openstack.org/42544613:36
*** jaosorior is now known as jaosorior_away13:36
hrwsbezverk: added note13:36
*** StephenWang1991 has quit IRC13:37
*** yingjun has joined #openstack-kolla13:37
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Implement Keystone zero-downtime upgrade  https://review.openstack.org/42544613:37
sbezverkhrw: forgot that you guys are crazy about alphabet ;)13:37
openstackgerritSerguei Bezverkhi proposed openstack/kolla master: Fixing missing genisoimage in nova-compute-ironic  https://review.openstack.org/45988513:39
*** eaguilar has quit IRC13:41
srwilkersmorning o/13:41
hrwsbezverk: I had to change my patches after someone alphabetized those lists. then had to change other one cause someone forgot13:42
sbezverksrwilkers: morning13:43
*** blallau has joined #openstack-kolla13:44
*** g3ek has quit IRC13:47
srwilkerssbezverk, hows it going man?13:47
*** eaguilar has joined #openstack-kolla13:52
*** Pavo has quit IRC13:55
*** rhallisey has quit IRC13:55
*** rhallisey has joined #openstack-kolla13:56
*** yangyapeng has joined #openstack-kolla13:56
*** g3ek has joined #openstack-kolla13:56
*** eaguilar has quit IRC13:57
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Add compute inventory precheck  https://review.openstack.org/46011813:58
*** ksumit has joined #openstack-kolla13:59
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP: Add Prometheus support.  https://review.openstack.org/45947314:06
*** jascott1 has joined #openstack-kolla14:06
*** jayahn has joined #openstack-kolla14:08
*** adrian_otto has joined #openstack-kolla14:08
*** ksumit has left #openstack-kolla14:08
*** jchhatbar is now known as janki14:10
*** jascott1 has quit IRC14:11
*** adrian_otto has quit IRC14:12
*** jmccarthy has quit IRC14:14
*** rwallner has quit IRC14:15
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Add compute inventory precheck  https://review.openstack.org/46011814:17
*** jmccarthy has joined #openstack-kolla14:17
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Add compute inventory precheck  https://review.openstack.org/46011814:18
*** rwallner has joined #openstack-kolla14:19
*** athomas has quit IRC14:21
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Configure Kibana default index pattern  https://review.openstack.org/45815614:24
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix neutron agents restarted on ml2 config change  https://review.openstack.org/44799214:26
*** athomas has joined #openstack-kolla14:26
*** StephenWang1991 has joined #openstack-kolla14:28
*** srwilkers has quit IRC14:29
*** mnasiadka has quit IRC14:30
openstackgerritSerguei Bezverkhi proposed openstack/kolla master: Fixing missing genisoimage in nova-compute-ironic  https://review.openstack.org/45988514:31
*** lpetrut_ has quit IRC14:33
*** StephenWang1991 has quit IRC14:33
*** egonzalez has quit IRC14:34
*** manheim has quit IRC14:35
*** salv-orlando has joined #openstack-kolla14:38
hrwsbezverk: s/Fixing/fix/14:38
*** srwilkers has joined #openstack-kolla14:39
*** salv-orl_ has joined #openstack-kolla14:39
openstackgerritSerguei Bezverkhi proposed openstack/kolla master: Fixing missing genisoimage in nova-compute-ironic  https://review.openstack.org/45988514:39
sbezverkhrw: and what is the technical benefit of changing fixing to fix ;) ??14:40
*** manheim has joined #openstack-kolla14:40
sbezverkother than 3 bytes shorter14:41
hrwsbezverk: grammar14:41
hrw+114:42
berendtis it not possible to reduce the duplicated content?14:43
berendti commented in the review14:43
sbezverkberendt: it was reduced to a single macro call14:43
*** salv-orlando has quit IRC14:43
openstackgerritMerged openstack/kolla-ansible master: Cleanup privileged attribut usage in containers  https://review.openstack.org/46000814:43
sbezverkbut then egonzalez brought up an issue with binary/ubuntu where a special treatment kills all possibility efficiency ;)14:44
openstackgerritMerged openstack/kolla-ansible master: Add OS_REGION_NAME to admin-openrc.sh.j2  https://review.openstack.org/45915514:44
openstackgerritMerged openstack/kolla-ansible master: Fix folder creation at quickstart  https://review.openstack.org/45972514:44
*** manheim has quit IRC14:46
*** dave-mccowan has joined #openstack-kolla14:47
*** manheim has joined #openstack-kolla14:48
*** egonzalez has joined #openstack-kolla14:51
*** manheim has quit IRC14:53
*** manheim has joined #openstack-kolla14:55
*** manheim has quit IRC14:57
*** denaitre has joined #openstack-kolla15:00
*** denaitre has quit IRC15:00
*** rhallisey has quit IRC15:01
*** denaitre has joined #openstack-kolla15:01
berendtdo we not have our team meeting today?15:03
*** janki has quit IRC15:03
*** eaguilar has joined #openstack-kolla15:05
*** rhallisey has joined #openstack-kolla15:06
*** yingjun has quit IRC15:08
*** rhallisey has quit IRC15:08
*** duonghq has joined #openstack-kolla15:08
*** rhallisey has joined #openstack-kolla15:08
*** jascott1 has joined #openstack-kolla15:08
*** jrich523 has joined #openstack-kolla15:09
hrwnext hour iirc15:09
*** gianpietro has joined #openstack-kolla15:09
*** rhallisey has quit IRC15:11
*** jascott1 has quit IRC15:13
inc0good morning15:13
inc0berendt: in 1 hr15:14
inc04pm utc15:14
*** tonanhngo has quit IRC15:15
openstackgerritMurali proposed openstack/kolla-ansible master: Fix  MySQL DB create failure detection mechanism  https://review.openstack.org/46014115:15
*** rhallisey has joined #openstack-kolla15:15
hrwinc0: hi15:16
inc0hey15:16
hrwinc0: posted update non-x86 patch with some release notes added15:16
*** fooliouno has joined #openstack-kolla15:16
*** chas has quit IRC15:16
hrwinc0: https://review.openstack.org/460070 is trivial one waiting for +2 +W from someone with power15:17
hrwinc0: it moves Ubuntu based builds to Pike as they are still at Ocata15:17
inc0hrw: you know there is a way to gain these powers right?15:17
hrwinc0: I do not +2 own patches15:17
hrwit is against the rules for me15:17
inc0touche, it is against rules15:18
inc0but you could +2 other patches15:18
hrwinc0: so far I prefer to stay with +1 power for them15:18
*** StephenWang1991 has joined #openstack-kolla15:18
inc0lol15:18
*** mannamne has joined #openstack-kolla15:18
hrwI consider myself still kind of newbie in docker world15:18
hrwso far I know THREE docker commands: images, rmi, run15:19
hrwok, four. ps too15:19
inc0don't let it stop you;) everyone will have area of expertise somewhere15:19
inc0logs is useful15:19
inc0;)15:19
hrw;)15:19
*** iniazi has joined #openstack-kolla15:19
inc0speaking of docker commands, let see if my env still lives15:20
hrwinc0: I got task to handle hub/registry stuff so will learn something new15:20
inc0cool15:20
hrwinc0: thanks for +2 +w15:20
Reepicheepinc0: so is your env still alive?15:21
ReepicheepI'm still attempting as many tasks as I can think of before I pull the "Production" trigger15:22
*** yingjun has joined #openstack-kolla15:23
*** iniazi_ has quit IRC15:23
Reepicheepcurrently making sure I can upgrade a live environment from 4.0.0 to 4.0.1 with out something bad happening15:23
Reepicheepthe jury is still out on my ability to do that15:23
inc0Reepicheep: barely, but not my fault, infra I set it up on15:25
inc0openstack itself seems healthy and nice15:26
inc0yup, my env is allright15:28
*** bswartz has quit IRC15:29
Reepicheepsweet, this is the production one you have been working on?15:29
sbezverkinc0: please check https://review.openstack.org/45988515:30
inc0sbezverk: done15:31
sbezverkinc0: I am not familiar with syntax to add packages to already initalized var.. any pointers?15:34
egonzalezinc0 you know how is the behaviour of packages_append in customization, if an _append is made in dockerfile, and users add package_append, are both packages added? one overrided?15:34
kfox1111back.15:34
inc0at begginging do {% set ironic_packages=['genisoimage'] %} and then inf if do {% ironic_packages = ironic_packages + ['ironic'] %}15:35
inc0egonzalez: don't add _append in dockerfile15:35
inc0no need15:35
hrwsbezverk: {% set var = var + [ 'entry', 'entry2' ] %}15:35
hrwo, set can be optional?15:36
sbezverkinc0: got it thanks..15:36
inc0reason we have _append is because there is no way to inject new variable in between variable initialization and macro15:36
inc0hrw: no, it's required, I made mistake15:37
*** rmart04 has joined #openstack-kolla15:37
*** salv-orl_ has quit IRC15:37
inc0egonzalez: and while we could do adding packages with just initializing var in override, there would be no way to remove them15:38
*** eaguilar has quit IRC15:38
egonzalezinc0 roger, thanks for explanation15:39
duonghqanybody knows if we create nova cell0 db when upgrade from N->O?15:40
inc0we do15:40
kfox1111hehe... http://logs.openstack.org/73/459473/9/check/gate-kolla-kubernetes-deploy-centos-binary-2-external-ovs-nv/f559317/logs/prometheus/cinder-api-4249958568-5rzbd.pom15:40
duonghqI do not see any related logic in kolla-ansible @ master15:40
kfox1111some prometheus data's starting to work. :)15:40
inc0duonghq: I think it was removed in master15:40
duonghqinc0, ah, thank, so the logic has short live15:41
inc0yeah master will be pike15:41
inc0duonghq: https://github.com/openstack/kolla-ansible/blob/stable/ocata/ansible/roles/nova/tasks/simple_cell_setup.yml15:41
openstackgerritSerguei Bezverkhi proposed openstack/kolla master: Fixing missing genisoimage in nova-compute-ironic  https://review.openstack.org/45988515:43
duonghqinc0, thank you, see related-logic in upgrade.yml15:43
sbezverkinc0: is it ok now?15:43
egonzalezduonghq was removed in master due cell creation was only needed from N to O15:44
inc0one more nit sbezverk15:44
egonzalezduonghq https://github.com/openstack/kolla-ansible/blob/stable/ocata/ansible/roles/nova/tasks/upgrade.yml#L915:45
sbezverkinc0: cannot do that15:45
inc0why?15:46
sbezverkbecause then macro will be run two times for binary15:46
inc0remove one from binary then:)15:46
sbezverkinc0: egonzalez told me not to remove15:46
inc0but I guess then you'll need to remove conf file in if...15:46
inc0ok it's not a big deal, I'll remove -115:46
duonghqegonzalez, thank, saw that15:47
sbezverkinc0: cool, thanks a lot..15:47
inc0meeting in 10min15:48
inc0we don't seem to have any agenda tho15:48
inc0duonghq: we didn't do daidv's topics last week right?15:49
inc0wanna handle them today?15:49
duonghqinc0, yes, thank you15:49
duonghqegonzalez, do you want to bringup keystone again?15:49
*** MasterOfBugs has joined #openstack-kolla15:51
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Change serial behaviour for playbooks  https://review.openstack.org/46009015:52
hrwinc0: I can q&a for non-x86 questions ;D15:52
inc0lol, sure15:53
inc0hrw: https://wiki.openstack.org/wiki/Meetings/Kolla#Agenda_for_next_meeting_.28Apr_26th_2017.29 add it to agenda before open discussion15:53
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: Add Initial Prometheus support.  https://review.openstack.org/45947315:54
hrwdone15:54
*** bmace has quit IRC15:54
hrwwill logout around xx:40 due to local stuff15:55
inc0hrw: worst case scenerio we'll move it to next meeting15:55
inc0I want to make sure that we will handle daidv's topics as they were bumped twice already15:55
hrw;)15:56
hrwsure15:56
duonghqdaidv's topic should be short one15:56
inc0cool15:56
hrwinc0: my entry is more like a filler ;D15:56
duonghqt-4mins :P15:56
inc0we're nearing summit so it's always quieter time15:57
duonghqya15:57
duonghqlook forward for the summit15:57
duonghqso I can meet you guys in person15:57
inc0yeah15:57
inc0duonghq: will you be able to help me with kolla-ansible workshops?15:57
inc0I'm in dire need of mentors in room15:57
duonghqinc0, sure15:58
inc0thanks!15:58
hrwI will have to ping my manager about ptg/summit.au15:58
duonghqmy pleasure15:58
inc0its going to be cool15:58
inc0k meeting time15:58
duonghqyeah, should have much fun15:58
duonghqkk15:58
*** jascott1 has joined #openstack-kolla15:58
openstackgerritMerged openstack/kolla master: Ubuntu: use Pike repository  https://review.openstack.org/46007016:01
*** chas has joined #openstack-kolla16:03
*** trozet has quit IRC16:04
*** StephenWang1991 has quit IRC16:04
*** yingjun has quit IRC16:04
*** gianpietro has quit IRC16:05
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Support non-x86 architectures (aarch64, ppc64le)  https://review.openstack.org/43094016:07
hrwjust rebased16:07
*** chas_ has joined #openstack-kolla16:07
*** rwallner has quit IRC16:08
*** chas has quit IRC16:09
*** gianpietro has joined #openstack-kolla16:09
*** jayahn has quit IRC16:18
*** sambetts is now known as sambetts|afk16:18
*** matrohon has quit IRC16:19
*** unicell has quit IRC16:21
*** shasha___ has joined #openstack-kolla16:21
*** jaosorior_away is now known as jaosorior16:22
*** eaguilar has joined #openstack-kolla16:24
*** bmace has joined #openstack-kolla16:26
*** jaosorior has quit IRC16:26
*** jaosorior has joined #openstack-kolla16:27
*** jaosorior is now known as jaosorior_away16:27
*** eaguilar has quit IRC16:28
*** yangyapeng has quit IRC16:29
*** eaguilar has joined #openstack-kolla16:31
*** eaguilar has quit IRC16:31
*** jmccarthy has left #openstack-kolla16:33
*** mgoddard has quit IRC16:35
*** papacz has joined #openstack-kolla16:36
*** vhosakot has joined #openstack-kolla16:37
*** blallau has quit IRC16:40
*** adrian_otto has joined #openstack-kolla16:40
inc0what's up Vikram16:43
inc0?16:43
duonghqso we have at least Neutron, Glance, Keystone needed implement  their upgrade procedure16:44
inc0and nova16:44
egonzalezduonghq worked today on fixing serial issue, https://review.openstack.org/#/c/425446/23/ansible/site.yml16:44
duonghqah, yeah16:44
inc0I implemented nova at very beggining16:45
inc0and here's the thing16:45
egonzalezdepends on this new change https://review.openstack.org/#/c/460090/216:45
inc0as long as compute node services has this16:45
inc0it's good for me16:45
vhosakotinc0: yeah, so I'm giving a talk for 30 mins about Kolla and Kolla-kubernetes (with probably a demo as well) at the Red Hat summit in Boston next week.  So, just wanted to know if I need to cover anything special that benefits the community and also some tips to attract contributors/developers to Kolla and Kolla-kubernetes project in general.16:45
inc0upgrading control plane is subsecond downtime anywya16:45
vhosakotsdake: would like to hear if you have any feedback as well.16:45
inc0vhosakot: next week:16:46
inc0?16:46
*** rwallner has joined #openstack-kolla16:46
inc0so you can shout out to workshops we'll hold in summit16:46
egonzalezduonghq not sure if serial fix is the best option to go, probably there is a better implementation16:46
rwellumvhosakot: we have a deployment guide that's in pretty good shape: https://docs.openstack.org/developer/kolla-kubernetes/deployment-guide.html16:46
*** rwallner has quit IRC16:46
vhosakotinc0: yes, Red Hat summit is next in Boston May 2-4.  My talk in on Wednesday May 3rd.16:47
*** rwallner has joined #openstack-kolla16:47
duonghqegonzalez, maybe notify feature? we delegate some step to [0] node, then trigger others?16:47
vhosakotrwellum: yes, thanks for that point. I'm referring it and flashing it many times in my slides :)16:47
inc0vhosakot: https://www.openstack.org/summit/boston-2017/summit-schedule/events/18177/easier-openstack-deployment-novice-installation-using-kolla16:47
inc0if someone wants to try it for himself16:47
inc0:)16:47
vhosakotinc0: yes, I have a 2 hour slot to do a worrkshop as well, thanks for that link :)16:48
duonghqinc0, do you have any plan for the workshop?16:48
inc0duonghq: yeah16:48
inc0I'll give everyone 5 vms16:48
vhosakotinc0: how do you plan to do the workshop in https://www.openstack.org/summit/boston-2017/summit-schedule/events/18177/easier-openstack-deployment-novice-installation-using-kolla ?  hands-on?16:48
inc0ubuntu or centos of their chosing16:48
vhosakotinc0: 5 vms?  it is multi-node?16:49
inc0and walk through getting prod-like kolla up and running16:49
inc0yeah16:49
vhosakotinc0: yes, I'm planning to do the same as well next week.16:49
inc0I want multionde ha and all cool16:49
*** nathharp has quit IRC16:49
duonghqwhere do you setup the vms?16:49
vhosakotinc0: what do you plan to show at the end of the workshop? (horizon GUI, booting a nova VM?, working k8s pods) ?16:49
rwellumvhosakot: cool. Sadly didn't get funding for RH Summit.16:50
rwellumvhosakot: Definitely show how to use the cluster :) Seems to be missing mainly from the documentation.16:50
vhosakotrwellum: me too, not much funding.. no hotel, just expo booth pass for me :)16:50
vhosakotI also want to show out great gates :)16:51
spsuryasdake: ws ?16:51
inc0vhosakot: spawn first vm and ssh to it16:52
duonghqinc0, seems that your workshop does not have rsvp?16:52
sdakeindeed the upstream workshop will be held today (couple people asked)16:52
vhosakotinc0: great, that is an awesome way to end a demo.. I'm aim for it too.. cool :)16:52
inc0duonghq: maybe it ran out, I have list of users already, but I was thinking it's still incomplete16:52
vhosakotsdake: when is it today?  I'd like to attend?  was there a mail send to the ML?16:53
sdakeindeed its on the ml16:53
sdakeitsin 7 minutes vhosakot16:53
vhosakotsdake: I'll join it :)  thanks for letting me know16:53
duonghq Time remaining until you can join: 01:19  from webex16:53
Serlexgot a link?16:54
SerlexI'm not on the mailing list16:54
duonghqSerlex, https://cisco.webex.com/ciscosales/j.php?MTID=m726d1915a1fa61470a810c9c9b01a4ef16:54
Serlex<316:54
vhosakotthanks duonghq16:55
vhosakotsdake: http://lists.openstack.org/pipermail/openstack-dev/2017-April/115825.html found it16:55
*** hieulq_ has joined #openstack-kolla16:56
inc0duonghq: I think rvsp is done elsewhere16:56
duonghqinc0, ah, roger16:56
inc0not sure tho16:57
inc0in any case you don't need to rvsp16:57
inc0since you'll be mentoring16:57
spsuryasdake: passwd16:57
spsurya?16:57
Serlexopenstack16:58
duonghqinc0, got it16:58
duonghqhow do we communicate in the summit? Skype, texting, or...?16:58
*** papacz1 has joined #openstack-kolla16:59
vhosakotme too, I can access the link https://cisco.webex.com/ciscosales/j.php?MTID=m726d1915a1fa61470a810c9c9b01a4ef too without RSVP'ing.16:59
*** papacz has quit IRC17:02
*** papacz1 has quit IRC17:03
sdakeduonghq click "connect  to audio" :)17:04
sdakespsurya ^^17:04
duonghqsdake,  my desktop do not have microphone :(17:04
inc0duonghq: normally we create whatsapp group17:05
gfidenteback later17:05
inc0try to get internet in US17:05
*** gfidente has quit IRC17:05
*** jtriley has quit IRC17:06
vhosakotetherpad link - https://etherpad.openstack.org/p/kolla-demystifying-gate17:07
*** unicell has joined #openstack-kolla17:08
duonghqvhosakot, do you got error: ReferenceError: require is not defined in https://etherpad.openstack.org/p/kolla-demystifying-gate (line 552)17:10
duonghqinc0, yeah, I can get Internet in US17:10
vhosakotI can access it fine without issues duonghq17:10
duonghqvhosakot, hmm, strange17:10
vhosakotduonghq: can you access https://etherpad.openstack.org/ ?17:10
duonghqyeah17:11
duonghqinc0, I never get used to OTT app ^^, but it's not bad option17:12
duonghqthere alwasy something worrying me about the app,17:12
duonghqbut I will use anything you guys use17:13
vhosakotduonghq: in https://etherpad.openstack.org/, you can type "kolla-demystifying-gate" in the text box.17:13
*** mannamne has quit IRC17:13
duonghqvhosakot, I get same error17:14
duonghqvhosakot, ya, chromium is ok17:14
vhosakotduonghq: hmm.. strange.. may be try a different browser /17:14
duonghqthanks17:14
*** ksumit has joined #openstack-kolla17:15
inc0whatsapp is fine for this puirpose17:16
inc0allows you to share location and stuff like that17:16
*** ksumit has quit IRC17:17
duonghqinc0,  normally, I'm against location sharing :P but for summit, I just fine17:17
*** jtriley has joined #openstack-kolla17:17
inc0haha I hear ya;) well, you send loc in message so it's not tracking17:18
inc0I'm glad we meet!17:18
inc0bring some tasties from Vietnam;017:18
*** StephenWang1991 has joined #openstack-kolla17:18
duonghqinc0, iirc, you like tea?17:18
inc0I love tea, if you could bring me some I'll be really grateful17:19
inc0!17:19
*** mgoddard has joined #openstack-kolla17:19
duonghqinc0, do you use loose-leaf tea?, I prefer loose-leaf tea over other type17:19
inc0yes, me too17:19
duonghqnice17:19
inc0my wife just got back from Assam so I got a lot of good Assam tea17:20
inc0but what do you drink in Vietnam? oolong?17:20
duonghqhmm, just green tea, oolong is quite higher grade than everyday drink for me17:21
inc0yeah it's not casual17:21
inc0taste is also too strong for just casual17:21
inc0anywya, I won't keep you awake:)17:21
duonghqah, tea in Vietnam usualy has strong taste17:21
inc0but I really appreciate your thoughtfullness17:22
inc0I'm very excited to try Viet tea:)17:22
duonghqinc0, ;)17:22
*** StephenWang1991 has quit IRC17:23
inc0ok, I'm goign afk for a bit17:23
inc0talk to you all later!17:23
duonghqinc0, kk17:23
*** Serlex has quit IRC17:29
*** yangyapeng has joined #openstack-kolla17:30
*** athomas has quit IRC17:35
*** yangyapeng has quit IRC17:35
*** gfidente has joined #openstack-kolla17:36
*** gfidente is now known as gfidente|afk17:36
*** eaguilar has joined #openstack-kolla17:37
Reepicheepsdake: thanks17:38
sdakeReepicheep sure np :) - come armed with questions - need to be grilled :)17:39
ReepicheepI feel like I'm still at the stage of I need to sit in the corner and absorb info17:40
*** pcaruana has quit IRC17:40
duonghqsdake, thanks, bye for now17:40
ReepicheepI hope to get there sometime17:40
*** duonghq has quit IRC17:41
vhosakotsdake: good session, thanks17:41
*** eaguilar_ has joined #openstack-kolla17:41
sdakevhosakot sure np :)17:42
*** eaguilar_ has quit IRC17:42
*** eaguilar has quit IRC17:43
rwellumsdake: went end-to-end on the deployment guide and now have fully deployed kolla-kubernetes cluster.17:44
*** franza has joined #openstack-kolla17:44
*** hieulq_ has quit IRC17:44
*** adrian_otto has quit IRC17:49
vhosakotrwellum: cool17:50
*** shardy has quit IRC17:50
franzaRegarding https://docs.openstack.org/developer/kolla/image-building.html17:51
franzaHow can we make sure we are using Ocata (or Newton, ...), and not just master?17:51
vhosakotrwellum: you're talking end-to-end of the bare-metal guide https://docs.openstack.org/developer/kolla-kubernetes/deployment-guide.html?  I'll try it too soon.17:51
rwellumvhosakot: yes exactly. Only difference is I am running it on a VM (Centos 7) - not bare-metal. But it works just fine.17:52
vhosakotrwellum: ah cool.17:53
*** unicell has quit IRC17:53
rwellumNote: https://review.openstack.org/#/c/459392/ - it's not merged yet - has some clarifications.17:53
rwellum(to the guide)17:53
vhosakotrwellum: curious what was the end in your end-to-end deploy :)  were you able to access the Horizon GUI and ping google from inside a nova VM?17:53
*** unicell has joined #openstack-kolla17:54
rwellumI was able to run a demo VM, and assign a floating ip to it, which is the conclusion to the guide. I was going to ask in the community, what the next good steps are - like Horizon GUI etc.17:55
rwellumThat'd make a good demo as it's visual.17:56
*** ducttape_ has joined #openstack-kolla17:56
Reepicheepfranza: AFAIK when you run kolla-build checkout the taged release you want17:56
franza@Reepicheep How to do that?17:57
franzaIs it a cmd line option?17:57
Reepicheepwhen your ran "tox -e genconfig" did you run it on a kolla source directory?17:58
franzaNo, I had just installed using yum17:59
Reepicheepif you got the source with "git" you can then checkout the tagged release with something like "git checkout tags/4.0.1"18:00
vhosakotrwellum: cool, yep. that is a great demo :)18:00
franzaI see what you're saying. But the release I'd like to make sure about is the neutron release (I'd like it to be stable/ocata)18:01
rwellumvhosakot: trying that now - will update you if I get it to work :)18:01
vhosakotrwellum: yes, showing networking topology (with a public network, a private network, router, nova VM, all connected) in the Horizon is the best demo "visually/pictorially" IMO18:01
vhosakotrwellum: yes, I'll keep you posted.18:02
vhosakotrwellum: ping google from inside the nova VM is also a good next step as far as making sure neutron/L2/L3 is working fine end-to-end IMO.18:02
franzaReepicheep: and the 4.0.1 label would be the Kolla label18:02
Reepicheepfranza: the latest newtron would be 3.0.318:03
ReepicheepI'm sorry Newton18:03
franzaI mean Neutron.18:03
rwellumvhosakot: ack18:03
franzaSo from Kolla, I would like to create a neutron-server container, that uses a stable/ocata basaeline18:04
Reepicheepsorry, Neutron and Newton are too close I misread what you had said18:04
*** tonanhngo has joined #openstack-kolla18:05
franzaReepicheep: Yes, the naming can be confusing.18:05
franza:)18:05
Reepicheepso are the containers build on master?  I guess I assumed that they where stable for the realeases18:06
*** srwilkers has quit IRC18:06
franzaReepicheep: I was building from master, yes. But what I really want is to make sure I am using Ocata.18:08
*** srwilkers has joined #openstack-kolla18:09
egonzalezfranza if you use kolla installed from yum, will install kolla version depending of your openstack-release repo18:09
*** fooliouno has quit IRC18:11
Reepicheepfranza: yeah you may have to bulid the containers it from the kolla source, 4.0.x is ocata18:11
egonzalezfranza meaning, delorean repo install master and centos-release-openstack-ocata repo install kolla ocata18:11
*** StephenWang1991 has joined #openstack-kolla18:13
*** chas_ has quit IRC18:18
*** jtriley has quit IRC18:18
*** StephenWang1991 has quit IRC18:19
*** chas has joined #openstack-kolla18:21
rwellumvhosakot: http://prntscr.com/f15sj418:23
vhosakotawesome!  thanks :)18:23
rwellumI'll keep going but wanted to show you Horizon.18:23
rwellum:)18:23
vhosakot:)18:23
*** gianpietro has quit IRC18:24
*** gianpietro has joined #openstack-kolla18:24
Reepicheepegonzalez: hmm  I have not even heard of the delorean repo.. Now I have not been around very long18:24
ReepicheepI did find it referenced in the mitaka quick start docs18:25
*** chas has quit IRC18:26
egonzalezReepicheep franza said kolla was installed from yum, delorean(DLRN) is master/testing repo in RDO project18:26
egonzalezReepicheep is nothing about kolla, are openstack packages for rpm based distros, in kolla we set delorean repo https://github.com/openstack/kolla/blob/master/kolla/common/config.py#L3018:27
franzaegonzalez, Reepicheep: So if the version of the OpenStack services will always come from the overall Kolla repo, how can we have different services on different releases?18:29
franzaIt's a very feasible scenario.18:29
*** adrian_otto has joined #openstack-kolla18:30
egonzalezfranza i would say build different times for each release and then use the images you need18:31
egonzalezfranza main issue is that images share openstack-base image(eg: newton) but you need neutron-server in ocata18:32
*** yangyapeng has joined #openstack-kolla18:32
egonzalezwill likely have package conflicts18:32
franzaegonzalez: I understand your point.18:34
rwellumAny core around to +2 https://review.openstack.org/#/c/459392/8 ? - I have the next batch of changes ready...18:34
Reepicheepegonzalez: ah.. I learn, thank you18:35
*** mgoddard has quit IRC18:35
egonzalezfranza what deployment method you use? ansible or k8s?18:36
*** yangyapeng has quit IRC18:38
*** rwallner has quit IRC18:38
*** MasterOfBugs has quit IRC18:40
franzaegonzalez: I've just installed Kolla, not using Ansible or k8s at this point.18:40
franzaAnd I want to use kolla-build to build images always in Ocata, not directly from master18:41
*** chas has joined #openstack-kolla18:41
*** rwallner has joined #openstack-kolla18:43
egonzalezfranza for centos binary images you will see repo enabled inside images is centos-release-openstack-ocata18:47
*** chas has quit IRC18:47
*** shasha___ has quit IRC18:49
*** gianpietro has quit IRC18:51
sbezverkkolla cores, your attention to this PS, it is missing second +2 :) https://review.openstack.org/45988518:57
sbezverkegonzalez: thank you :)18:59
*** gianpietro has joined #openstack-kolla19:00
egonzalezsbezverk will need backport the change?19:00
sbezverkegonzalez: absolutely, I need it in ocata19:00
*** zhubingbing__ has joined #openstack-kolla19:01
*** zhubingbing has quit IRC19:01
*** MasterOfBugs has joined #openstack-kolla19:02
rwellumsbezverk: care to look at (+2) https://review.openstack.org/#/c/459392/8 ?19:05
sbezverkrwellum: great job, it looks much better :)19:07
rwellumThanks sbezverk !19:08
*** lpetrut has joined #openstack-kolla19:11
*** chas has joined #openstack-kolla19:18
*** chas_ has joined #openstack-kolla19:23
*** chas has quit IRC19:25
*** franza has quit IRC19:27
*** manheim has joined #openstack-kolla19:29
*** rmart04 has quit IRC19:33
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla stable/ocata: Fixing missing genisoimage in nova-compute-ironic  https://review.openstack.org/46028719:34
*** yangyapeng has joined #openstack-kolla19:35
*** yangyapeng has quit IRC19:40
*** rwallner has quit IRC19:42
kfox1111yay! https://github.com/kubernetes/release/pull/313/files :)19:42
kfox1111lets hope it hits rpms soon.19:44
kfox1111https://review.openstack.org/#/c/459473/ is ready for review.19:44
openstackgerritMerged openstack/kolla master: Fixing missing genisoimage in nova-compute-ironic  https://review.openstack.org/45988519:46
openstackgerritMerged openstack/kolla-kubernetes master: deployment-guide.rst enhancement and small fixes  https://review.openstack.org/45939219:48
*** shardy has joined #openstack-kolla19:48
*** gfidente|afk has quit IRC19:51
*** gfidente has joined #openstack-kolla19:52
*** gfidente has quit IRC19:52
*** gfidente has joined #openstack-kolla19:52
*** jtriley has joined #openstack-kolla20:00
sbezverkkfox1111: I got demo for summit finally working :) kolla-kube with ironic deploys new baremetal node, adds it to kube cluster and then adds it a compute node to openstack :)20:01
*** adrian_otto has quit IRC20:02
*** pbourke has quit IRC20:02
*** gianpietro has quit IRC20:03
*** gianpietro has joined #openstack-kolla20:04
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/46025420:07
*** shardy has quit IRC20:07
*** ducttape_ has quit IRC20:09
*** rwallner has joined #openstack-kolla20:12
*** matrohon has joined #openstack-kolla20:15
*** rwallner has quit IRC20:15
*** rwallner has joined #openstack-kolla20:16
*** rwallner has quit IRC20:19
kfox1111sbezverk: sweet. :)20:32
sbezverkkfox1111: I think it should be interesting to operators to be able to extend cluster and openstack deployment using the same tool..20:34
kfox1111+1 :)20:35
*** yangyapeng has joined #openstack-kolla20:37
sbezverkkfox1111: playing with this demo, I see a need for a couple of tools.. 1 is to automatically call cell host discover right after new nova compute gets deployed and 2 to add ovs bridges again automatically.20:38
*** salv-orlando has joined #openstack-kolla20:38
sbezverkwhat do you think?20:38
kfox1111one, is the helm chart we got but wrapped in a simpler command?20:38
kfox1111for 2, what kind of ovs bridges?20:39
sbezverkkfox1111: well I was thinking to add it to nova compute as a job20:39
kfox1111was this the ones used for the vm? or that a different thing?20:39
sbezverkbecause if it is a separate job then somebody needs to remember to run it20:39
kfox1111nova-compute svc?20:39
kfox1111sorry. service chart?20:39
sbezverkkfox1111: maybe even add is as a job to daemon set20:40
kfox1111the curent problem, is it has to run after all the nova-compute's enter 'nova service-list'20:40
sbezverkkfox1111: not really20:40
kfox1111so you need a task taht can query both nova-api and k8s to know how many pods are there.20:40
sbezverkbecause it can be run multiple times20:40
kfox1111you could in theory. that makes me a bit nervious for a couple reasons.20:41
sbezverkso whenever daemon set deploys nova-compute20:41
kfox11111. its doing an admin task spread around the whole cluster.20:41
kfox1111and 2, I doubt nova ever tested that level of reentrency.20:41
kfox1111I would be scared it woudl break in very unusual/interesting ways when run concurrently.20:41
kfox1111It soulds like there is a "discovery" config value you can set to have nova automatically do things periodically.20:42
sbezverkkfox1111: maybe.. it is just separating them we kind of breaking dynamic nature of kube20:42
*** yangyapeng has quit IRC20:42
kfox1111so you could set that, (if my intel is correct)20:42
kfox1111but I'd probably never want to run that that way.20:42
kfox1111agreed.20:43
sbezverkkfox1111: cool I will play more with it20:43
kfox1111though openstack does a lot of things not k8s friendly.....20:43
sbezverknow I have 6 nodes20:43
*** dixiaoli has joined #openstack-kolla20:43
sbezverkso if something is wrong with this approach I should hit it20:43
kfox1111safe is more preferable to to automagic but potentially breaking.20:43
sbezverkfor the second20:44
kfox1111I still think its solvable better with adding some abit of logic to the job to block until all nova-compute's are ready and probe k8s for the node list.20:44
sbezverkissue I have a separate ovs bridge20:44
kfox1111ovs bridge not in container?20:44
sbezverkkfox1111: -1 example my cluster was up for 5 days then I add another compute how blocking logic would work here?20:45
kfox1111then you run the job again.20:45
egonzalezkfox1111 nova config option is this https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/nova/templates/nova.conf.j2#L22820:45
kfox1111you run the job whenever you change the number of compute nodes.20:45
kfox1111yeah. that interval.20:45
kfox1111that would be better then trying to distribute it out.20:46
sbezverkkfox1111 egonzalez that could be good option, kind of compromise ;)20:46
kfox1111yeah.20:46
egonzalezdiscover_host is usually not executed after deployment, or at least to the whole cluster20:46
sbezverkI hate being required to run something manually ;)20:46
kfox1111sbezverk: I don't disagree. I'd rather something be automatic, but not at the cost of having to pick up the pieces when it breaks. :)20:47
kfox1111a hard tradeoff sometimes.20:47
*** fooliouno has joined #openstack-kolla20:47
sbezverkkfox1111: I guess in this case discover job needs to be converted into the deployment20:47
*** dixiaoli has quit IRC20:47
sbezverkso it could run periodically20:48
*** manheim has quit IRC20:48
kfox1111sbezverk: yeah. if the autothingy works, that would be best yet. and then the job is just for those wanting to do manual.20:49
kfox1111sbezverk: https://pastebin.com/ai34DuDb for how to do a bridge on boot.20:49
sbezverkkfox1111: cool I will take care of discovery deployment20:50
kfox1111sbezverk: https://pastebin.com/XdePs9ch and how to do a nic to the bridge on boot.20:50
*** dciabrin has quit IRC20:50
sbezverkkfox1111: for the bridge, it is not what I had in mind20:51
kfox1111(about to run laptop out of power fyi)20:51
sbezverkexample I have physnet2 mapped to br-provision20:51
sbezverkit is needed for neutron to be able to give dhcp ip addresses to baremetal nodes20:51
kfox1111sure.20:52
sbezverkbut that bridge must be present of every compute node where neutron agent runs20:52
kfox1111ah.20:52
kfox1111I'd do that with settings like above. but... yeah, you could do it maybe through container things...20:52
sbezverkso when I bring up new node something needs to create it before neutron ovs agent, otherwise it becomes very unhappy20:52
kfox1111its in one of those weird spaces....20:53
kfox1111it could be added as a python prep script that also parses the neutron setup, and creates the bridges.20:53
sbezverkkfox1111: for now I just added a hack to cloud-config scrtipt to add this bridge as soon as vswitchd container is up20:53
kfox1111but that part tends to be very machine/network specific. :/20:53
kfox1111yeah.20:53
kfox1111in that particular case, I always do the ovs outside of containers, so can fully manage it on the host.20:54
openstackgerritAndrey Arapov proposed openstack/kolla-ansible master: Set --ipc option to "host" for nova_compute  https://review.openstack.org/46030820:55
*** trozet has joined #openstack-kolla20:56
sbezverkkfox1111: ok for now that hack is ok, but I am sure some people will bring it up again..20:58
sbezverkegonzalez: do you know how exactly discovery process gets scheduled and by which process nova-api?20:59
*** ducttape_ has joined #openstack-kolla21:00
openstackgerritMathieu Rohon proposed openstack/kolla master: Add skydive service  https://review.openstack.org/45999521:00
*** StephenWang1991 has joined #openstack-kolla21:01
*** esmute has joined #openstack-kolla21:01
*** chas_ has quit IRC21:01
*** chas has joined #openstack-kolla21:01
egonzalezsbezverk is executed by nova-scheduler once the cell is created and with the first node registered21:02
*** Pavo has joined #openstack-kolla21:02
sbezverkegonzalez: interesting, in this case maybe the only thing needed is to have that config option enabled21:03
egonzalezsbezverk yep21:03
egonzalezdiscover host is usually executed once per cell, then let scheduler find all nodes21:04
*** mgoddard has joined #openstack-kolla21:04
sbezverkkfox1111: there is one more thing, remember we added a custom tunnel interface logic. I would like to add something similar for provider/external interface as well21:05
*** StephenWang1991 has quit IRC21:05
*** goldyfruit has quit IRC21:05
sbezverkegonzalez: cool I will test it.. thanks for the idea21:05
*** Pavo has quit IRC21:06
*** chas has quit IRC21:06
*** srwilkers has quit IRC21:07
egonzalezsbezverk better docs than deployment guide and recommended process by nova team is  fresh install https://docs.openstack.org/developer/nova/cells.html#fresh-install21:07
*** g3ek has quit IRC21:09
*** haplo37 has quit IRC21:09
*** jtriley has quit IRC21:09
*** rhallisey has quit IRC21:10
*** schwicht has quit IRC21:10
openstackgerritMathieu Rohon proposed openstack/kolla master: Add skydive service  https://review.openstack.org/45999521:11
*** chas has joined #openstack-kolla21:11
*** esmute has quit IRC21:12
openstackgerritAndrey Arapov proposed openstack/kolla-ansible master: Set --ipc option to "host" for nova_compute  https://review.openstack.org/46030821:13
*** chas has quit IRC21:13
*** chas has joined #openstack-kolla21:13
openstackgerritMathieu Rohon proposed openstack/kolla master: Add skydive service  https://review.openstack.org/45999521:14
*** chas has quit IRC21:18
*** g3ek has joined #openstack-kolla21:18
*** haplo37 has joined #openstack-kolla21:18
*** mgoddard has quit IRC21:19
*** matrohon has quit IRC21:21
*** zhenguo has quit IRC21:22
*** gianpiet_ has joined #openstack-kolla21:25
*** schwicht has joined #openstack-kolla21:26
*** gianpietro has quit IRC21:29
openstackgerritAndrey Arapov proposed openstack/kolla-ansible master: Set --ipc option to "host" for nova_compute  https://review.openstack.org/46030821:29
*** rwallner has joined #openstack-kolla21:35
*** yangyapeng has joined #openstack-kolla21:38
*** gfidente has quit IRC21:39
*** jascott1 has quit IRC21:39
*** franza has joined #openstack-kolla21:39
*** rwallner has quit IRC21:39
*** jascott1 has joined #openstack-kolla21:40
*** franza has quit IRC21:40
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding custom external interface to opevswitch-vswitchd  https://review.openstack.org/46032621:41
*** jascott1_ has joined #openstack-kolla21:42
*** yangyapeng has quit IRC21:43
*** jascott1 has quit IRC21:44
*** jascott1_ has quit IRC21:46
kfox1111sbezverk: yah, we could do that.21:47
kfox1111https://review.openstack.org/#/c/459473/ is ready for reviews.21:48
*** salv-orl_ has joined #openstack-kolla21:49
*** mannamne has joined #openstack-kolla21:51
*** jascott1 has joined #openstack-kolla21:52
*** salv-orlando has quit IRC21:52
sbezverkkfox1111: would it be better to have port as a variable? I am not sure if at one point it needed to be changed..21:53
kfox1111it only needs to be unique per pod.21:53
sbezverkor 9101 is registered promethius port?21:53
kfox1111hmm...21:53
kfox1111its a registered default.21:53
kfox1111its changable, but only if needed.21:54
kfox1111I guess it would need to be overridable if openstack tried and use that port.21:54
sbezverkkfox1111: if it is not much of a trouble, please make it as var, it will be safer :)21:54
kfox1111easily enough made a value I guess.21:54
kfox1111k.21:54
sbezverkkfox1111: thanks21:55
kfox1111np. thanks for reviewing. :)21:55
sbezverkkfox1111: so it seems this PS adds just a sidecar/collector portion right?21:57
kfox1111yup.21:57
kfox1111thats all thats needed to get the data to prometheus. :)21:57
kfox1111it has a kubernetes inventory module that queries k8s for all pods with the prometheus attributes,21:58
kfox1111then curls them.21:58
sbezverkkfox1111: ok and then prometheus will also have "svc" portion you plan to run as a deployment?21:58
kfox1111the upstream helm packages for prometheus/grafana take care of the rest.21:59
*** manheim has joined #openstack-kolla21:59
*** lpetrut has quit IRC21:59
sbezverkkfox1111: oh nice, we will use upstream charts :)21:59
*** esmute has joined #openstack-kolla22:00
kfox1111yeah. they seem to work well. not sure we need to reinvent the wheel for that part.22:00
*** schwicht has quit IRC22:00
esmuteHi guys, im new to this kolla-kubernetes project. Can you guys point me to docs where i can get openstack services running on k8s? I have a 3-node cluster k8s running.22:01
kfox1111it might be interesting to made an openstack overaching chart that has computekit/grafana/prometheus in it. :)22:01
esmuteI wonder if there are some yaml files i can do kubectl create -f22:01
kfox1111so can deploy the whole thing all together. :)22:01
sbezverkesmute: if you pull kolla-kubernetes, there is a deploymnet guide, you can use it as a baseline22:02
esmute@sbzverk this one right https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/deployment-guide.rst?22:02
sbezverkkfox1111: it is going to be more "marketing" thing ;)22:02
fooliounokfox1111: "ip netns exec <qrouter-......> ifconfig" doesnt seem to work in kolla-k8s22:03
esmutei was wondering if there was a simpler deployment guide where i can reuse the prebuilt images from dockerhub22:03
sbezverkesmute: yep, that is the one..22:03
*** manheim has quit IRC22:03
sbezverkesmute: that is exactly what you will use22:03
fooliounokfox1111: any idea why that may not be working22:03
sbezverkyou do not need to build images22:04
sbezverkall images are already posted on the docker hub, but you do need to deply them using helm packages22:04
sbezverkas it is described in the guide22:04
esmuteok.. ill follow this.. Thanks22:05
sbezverkfooliouno: this command does not work from the host22:05
sbezverkfooliouno: there is an issue in kubernetes which is still not fixed22:05
sbezverkfooliouno: but you can run it in the container22:05
fooliounosbezverk: oh .. ok. Will it run from inside the containers?22:06
fooliounook22:06
sbezverkfooliouno: yep22:06
fooliounoCant run it in the neutron-server since the user is neutron22:06
sbezverkfooliouno: you might see some error messages when you run it, just ignore them, they seem to be harmless22:06
fooliounosudo doesnt work either for ip netns22:06
fooliounofrom neutron server container22:07
fooliounois there another way I can run it22:07
kfox1111fooliouno: yeah, hters an extra step... you gotta be in the neutron-openvswitch-agent container to run the command. :/22:08
kfox1111k8s has an outstanding bug they really need to fix to make that work well. :/22:08
sbezverkfooliouno: or in dhcp agent or l3 agent22:09
*** shasha___ has joined #openstack-kolla22:09
fooliounodhcp and l3agents are logged into as neutron user. ip netns requires root permissions I believe22:10
*** gfidente has joined #openstack-kolla22:10
sbezverkdocker exec -tu root neutron-dhcp-agent ip netns22:10
sbezverkhere is how I run it22:10
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: Add Initial Prometheus support.  https://review.openstack.org/45947322:10
kfox1111sbezverk: ugg. so, 2 extra steps. :/22:11
kfox1111ssh to the host where its on, docker exec into the container. ip netns exec into the netns, run command.22:11
kfox1111:/22:11
sbezverkkfox1111: well you only do it for troubleshooting22:12
sbezverkso it is not too too bad22:12
sbezverkbut I agree it is bad :)22:12
kfox1111yeah. I won't tell you how muc htime I spent in that mode last friday... and saturday...22:12
kfox1111:/22:12
kfox1111turned out to be bad intel firmware. :/22:12
kfox1111but only when packets got passed through a network node on vms without fips. :/22:13
sbezverkkfox1111: another question it seems you want to store data in the empty dir22:13
sbezverkso if pod is gone, collected data is gone too22:13
sbezverkhow important to keep history here?22:13
kfox1111its stateless.22:14
kfox1111the emtpyDir is just for sharing the unix socket between haproxy and the haproxy_exporter.22:14
*** salv-orl_ has quit IRC22:14
kfox1111prometheus periodically does a curl to the haproxy_exporter tcp port which haproxy_exporter talks to haproxy via the socket, gets the current stats, and returns them.22:14
kfox1111thats why I like prometheus so much. the export stats protocol is basically "run a web server and export a text file with stats" :)22:16
sbezverkkfox1111: ok so locally nothing gets stored, it only pushes them on prometheus' curl22:16
kfox1111so easy to get random data sources into that format. :)22:16
kfox1111yup.22:16
fooliouno()[root@server6615 /]# ip netns exec qrouter-29f9cc55-e051-4ec6-ba68-2e30cd761ca9 ifconfig RTNETLINK answers: Invalid argument setting the network namespace "qrouter-29f9cc55-e051-4ec6-ba68-2e30cd761ca9" failed: Invalid argument22:16
fooliounoI was able to get into the container as root22:17
sbezverkfooliouno: at least you should be abe to see them ;) man, there is not much we could do about it22:17
fooliounosbezverk: :)22:18
kfox1111fooliouno: thats in the neutron-openvswitch-agent container?22:18
kfox1111oh... wait a sec..22:18
kfox1111qrouter is an l3-agent thing.22:18
kfox1111sorry. try from that container.22:18
fooliounook .. let me try from there22:18
kfox1111sbezverk: there are a bunch of other exporters too. another interesting one we should add is the mysql one.22:19
kfox1111and memcached_exporter22:19
sbezverkkfox1111: what kind of data it collects/returns? like number of requests? Can you paste, rendered to readable form ?22:20
*** palexster has quit IRC22:20
fooliounokfox1111: sbezverk: thanks. doesnt work for me. will try some other way22:20
sbezverkfoolioun: is there a particular issue you are chasing or just exploring?22:21
fooliounosbezverk: I am trying to troubleshoot my kolla-k8s + odl (layer 2) setup. Was able to create VMs and all. However, cannot ping the qrouter interface from the VM22:22
kfox1111sbezverk: the file format looks like this: http://logs.openstack.org/73/459473/9/check/gate-kolla-kubernetes-deploy-centos-binary-2-ceph-nv/487d926/logs/prometheus/glance-registry-3786748640-nswmh.pom22:23
openstackgerritAndrey Arapov proposed openstack/kolla-ansible master: Set --ipc option to "host" for nova_compute  https://review.openstack.org/46030822:23
sbezverkfooliouno: Oh I see, yeah being able to access nens in this case would be really useful22:23
kfox1111I haven't looked at the memcached/mysql one yet but would expect it to be similar.22:23
*** gfidente has quit IRC22:24
*** unicell has quit IRC22:24
kfox1111fooliouno: the ip netns didn't work from within the neutron-l3-agent container?22:24
fooliounoI tried from there too22:25
fooliouno()[root@server6615 /]# ip netns exec qrouter-29f9cc55-e051-4ec6-ba68-2e30cd761ca9 ifconfig RTNETLINK answers: Invalid argument exec of "ifconfig" failed: No such file or directory22:25
sbezverkfooliouno: it might partially work if you connect to the container with default neutron username22:25
sbezverkfooliouno: but you will be very limited in what you can do22:25
*** manheim has joined #openstack-kolla22:25
fooliounoi'll try that again22:26
fooliounoyou are right. there are not many commands I can run that way :)22:29
sbezverkfooliouno: http://paste.openstack.org/show/608157/22:29
sbezverkfooliouno: connect as root22:29
sbezverkfooliouno: there might be several qrouters22:29
sbezverkfooliouno: you need to check each22:29
sbezverkfooliouno: it seems cleaning lady is not working well ;)22:30
sbezverkfooliouno: also there is no ifconfig, use ip a to see interfacea22:30
*** unicell has joined #openstack-kolla22:30
fooliounoThanks sbezverk! I need to log off now. Will try them later in the evening22:32
*** vhosakot has quit IRC22:37
*** fooliouno has quit IRC22:41
*** mannamne has quit IRC22:42
*** StephenWang1991 has joined #openstack-kolla22:43
*** shasha___ has quit IRC22:47
*** StephenWang1991 has quit IRC22:47
kfox1111is the command in memcached.json.j2 exectued in a shell?22:48
kfox1111nm. the man page for memcached is wrong.22:49
sbezverkkfox1111: do not think so, it looks like jinja template to me22:49
sbezverkkfox1111: did you see, 1.6.2 is out22:50
kfox1111hadn't seen yet. thanks for the info.22:50
*** esharao has quit IRC22:51
kfox1111sbezverk: yay!22:52
kfox1111Fix container hostPid settings when CRI is enabled. (#44116, @feiskyer)22:52
kfox1111we might be able to disable that one hack now. :)22:52
*** goldyfruit has joined #openstack-kolla22:53
kfox1111https://github.com/kubernetes/release/pull/313/files got committed too. not sure if it is in the 1.6.2 rpms or not though.22:53
sbezverkkfox1111: it will fail on ubuntu22:55
sbezverkubuntu's docker does not use by default systemd22:55
* kfox1111 shrugs.22:55
kfox1111it says for centos7, but maybe it wil lend up breaking ubuntu.22:55
sbezverkinstead of hardcoding they need to pick up docker's settings and use it22:55
kfox1111+122:56
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: Add Initial Prometheus support.  https://review.openstack.org/45947323:02
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP Memcached Prometheus support.  https://review.openstack.org/46034523:04
kfox1111sbezverk: you were asking about what kind of data before.23:06
kfox1111https://hub.docker.com/r/prom/memcached-exporter/ has a list.23:06
*** adrian_otto has joined #openstack-kolla23:06
sbezverkkfox1111: when they talk about server, do they mean server where the container runs or they call container a server?23:08
kfox1111the memcached server process.23:08
sbezverkkfox1111: ok, got it..23:09
*** trozet has quit IRC23:09
sbezverkkfox1111: did you noticed memcached exporter uses different port? curious why is that?23:10
*** fooliouno has joined #openstack-kolla23:10
kfox1111yeah. each kind of exporter by default has a different port23:11
kfox1111probably for similar reasons why openstack services all have different default ports.23:11
kfox1111makes it easier to run them all on the same host outside of containers.23:11
sbezverkkfox1111: ok but they can still be run using the same port for our case23:12
kfox1111looks like the mysqld one will be slightly harder. we need to provision a sql user.23:12
kfox1111yeah, we could change it to do that.23:12
kfox1111default them all the same and the user can override as needed.23:12
kfox1111here's a stock dashboard for the memcached plugin:23:17
kfox1111https://grafana.com/dashboards/3723:17
*** chas has joined #openstack-kolla23:18
kfox1111and a nice one for haproxy: https://grafana.com/dashboards/367 :)23:18
*** Pavo has joined #openstack-kolla23:18
*** manheim has quit IRC23:21
*** shasha___ has joined #openstack-kolla23:22
*** chas has quit IRC23:22
*** shasha___ has quit IRC23:27
*** Pavo has quit IRC23:27
kfox1111sbezverk: " With Kube 1.6 the ClusterFirstWithHostNet has been added to make it slightly easier to handle DNS lookups for hostNetworking."23:33
kfox1111did the resolve.conf workaroudn actually make it into 1.6?23:33
sbezverkkfox1111: I was told yes, but I have never tested it23:35
*** shasha___ has joined #openstack-kolla23:36
kfox1111cool. do we have a techdept bug/blueprint for it?23:37
kfox1111would be a good low hanging fruit ps.23:37
sbezverkkfox1111: nope, it has been around for so long ;)23:43
*** shasha___ has quit IRC23:43
sbezverkkind of get used to the workaround23:43
*** Pavo has joined #openstack-kolla23:44
kfox1111yeah.23:44
kfox1111k.23:44
*** adrian_otto has quit IRC23:46
kfox1111nice. the memcached scraper is working too. :)23:50
*** Pavo has quit IRC23:51
*** adrian_otto has joined #openstack-kolla23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!