Thursday, 2017-04-13

kfox1111the numa in todays boxes is really fast in comparison. :)00:00
kfox1111pinning does help a bit.00:00
kfox1111and I think thas one of the reasons out of the box the k8s solution is faster then the openstack one.00:00
kfox1111the kvm cpus float and arn't numa aware,00:00
kfox1111while the k8s containers are aware of it and can pin out of the box.00:00
kfox1111if your sceduler supports it.00:01
masberI see00:01
masbergood to know thank you for that information00:01
kfox1111np. :)00:01
kfox1111you can make openstack numa aware and pin cores.00:02
masberyes, actually ocata makes that very easy00:02
kfox1111its just a fair amount of work.00:02
inc0kfox1111: https://review.openstack.org/#/c/456407/00:02
masberyou can set it up even on horizon when you create your image00:02
kfox1111if you look through the old summit videos you can find some of the bits.00:02
kfox1111look for tim bell's stuff.00:03
kfox1111nice. :)00:03
kfox1111haven't played with that feature yet.00:03
kfox1111my newest cloud is mitaka. should be newton in a few weeks.00:03
kfox1111I've usually been able to keep it closer to current, but getting more and more pushback on keeping it current. :/00:04
masberkolla should take care of all the pain when you do an upgrade is that right?00:05
inc0masber: we want to lower the pain00:05
inc0pain is there always00:05
masberI understand00:06
SamYaplekfox1111: pretty sure you can just set '--property hw:numa_nodes=1' on the flavor to lock it to a single numa node00:06
kfox1111openstack devs kind of like to hurt their users. :/ kolla's trying to make that better.00:06
kfox1111SamYaple: yah, but theres a bunch more to shrink the performance gap.00:06
kfox1111SamYaple: really for what I wanted to do, I want the vm to be fully numa aware.00:07
*** vhosakot has quit IRC00:07
SamYaplekfox1111: yea those are all just thinkgs you can set on the flavor though00:08
kfox1111for the system I'm depricating, we had one vm per physical host.00:08
SamYapleits far from complicated00:08
SamYaplehttps://docs.openstack.org/admin-guide/compute-flavors.html00:08
SamYaplethat should have info on it00:08
SamYapleit *used* to be harder. back in like icehouse00:08
kfox1111SamYaple: setting options, easy. finding all the right options to elminiate/mostly reduce the 20% overhead, not easy.00:08
SamYaplebut stuff like numa pinning and cpu arch has been around for awhile00:08
kfox1111yeah.00:09
masberthere is not much benefit of using the whole host for one vm00:09
SamYapleno its really nto hard at all. going to completely disagree there. this is all very straight forward00:09
SamYapleits admin territory anyway, not user territory00:09
SamYapleso all this info should be known00:09
SamYapleno guess work00:09
kfox1111it was 0 work for k8s. it was a bunch of work for openstack. I went with the 0 work. ;)00:10
kfox1111and for other reasons.00:10
kfox1111it was a free 20% esentially.00:10
SamYaplewow. that is comparing apples to oranges00:11
SamYapleVMs vs processes00:11
kfox1111yes/no.00:11
kfox1111this project's goal was to get compute cycles. they didn't care how.00:11
kfox1111openstack was the best solution at the time we stood it up with the projects requirements.00:11
SamYaplewell anyway00:11
SamYaplemnaser: numa is really easy in openstack for a couple of years now00:11
kfox1111k8s came around, and met all the requirements, and didn't have the vm overhead/admin overhead.00:12
kfox1111easy answer. :)00:12
SamYaplemnaser: set '--property hw:numa_nodes=1' on the flavor and thats what you want 90% of the time. then you can refine further00:12
inc0kfox1111: it seems we deploy ceph too;)00:13
inc0in k8s00:13
masberwhat tools do you use to meassure performance and bottlenecks?00:13
kfox1111inc0: doh. yeah.00:13
inc0I'll leave it out for tomorrow then00:13
kfox1111masber: switching to prometheus/node-exporter. having good results with it.00:14
SamYaplemnaser: loaded question! by the time i get involved, most bottlenecks are found by me stracing something. a little higher up simpilier like iostat and ps are used00:15
kfox1111inc0: and iscsi too?00:15
kfox1111iscsi and tgtd.00:15
masberthis conversation was very useful to me, thank you all00:17
masber:)00:17
inc0yeah I guess00:18
masberon the other hand I am waiting openstack to be able to use AWS/google cloud/azzure infraestructure as an expansion00:18
masberI think that would be the future00:19
*** yangyapeng has quit IRC00:19
masberso people would be able to do most of their computing requirements locally and expand if there are peaks of workloads00:19
masberalthough clouds are quite cheap nowadays00:20
jascott1_kfox1111 do you know offhand how to set net=host in a pod spec?00:20
SamYaplemnaser: yea "cloud bursting" is hat that is00:20
kfox1111jascott1_: yeah. sec.00:20
jascott1_maybe hostNetwork: true ?00:21
kfox1111https://github.com/openstack/kolla-kubernetes/blob/master/helm/microservice/neutron-openvswitch-agent-daemonset/templates/openvswitch-agent-daemonset.yaml#L11400:22
kfox1111yeah.00:22
kfox1111capital T though I think.00:22
kfox1111though probably doesn't matter since its go driven.00:22
kfox1111masber: I saw a project doing that.00:22
kfox1111added aws as a seperate openstack region.00:22
*** lrensing has joined #openstack-kolla00:23
kfox1111was just a openstack api -> aws api adapter service.00:23
kfox1111alternately, you use openstack just toget vm's, and install k8s onto it, and use k8s as your abstraction api.00:24
kfox1111I use to standardize on heat as my orchestration system for deploying software. these days I'm moving to helm.00:27
masberby the way my apologize I hijacked this channel to talk about other things00:27
kfox1111no worries.00:29
kfox1111weird weird weird....00:30
kfox1111ocata is constantly failing on ceph attachment.00:31
kfox1111newton isnt...00:31
*** duonghq has joined #openstack-kolla00:31
kfox1111packages between 3.0.3 and 4.0.0 in libvirt containers are basically the same....00:32
kfox1111so, its gotta be nova-compute somehow....00:32
kfox1111I guess I could try and pin back libvirt too...00:33
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP: v4 gates.  https://review.openstack.org/45484100:35
*** mattmceuen has quit IRC00:35
duonghqhi guys,00:36
*** ediardo has quit IRC00:37
duonghqcurrently, we are building source from tarballs.o.o or from source code?00:37
*** swinn has quit IRC00:39
SamYapleduonghq: the default is tarballs.o.o00:43
SamYapleyou can build from git directly as well00:43
duonghqSamYaple, thanks00:43
*** zhubingbing_ has quit IRC00:44
*** zhurong has joined #openstack-kolla00:44
*** daidv has joined #openstack-kolla00:45
daidvSamYaple, morning.00:45
SamYaplehello daidv00:46
SamYaplemorning00:46
daidvHow can I build source image from github?00:46
*** swinn has joined #openstack-kolla00:48
*** MasterOfBugs has quit IRC00:49
*** pramodrj07 has quit IRC00:49
*** cuongnv has joined #openstack-kolla00:51
*** swinn has quit IRC00:51
*** rwellum has quit IRC00:51
*** guoguo has joined #openstack-kolla00:53
*** jpstnh has joined #openstack-kolla00:53
*** masber has quit IRC00:54
*** japestinho_ has joined #openstack-kolla00:54
*** japestinho_ has quit IRC00:55
*** masber has joined #openstack-kolla00:55
daidvSamYaple, I have found it by myself. thanks.00:57
openstackgerritShunli Zhou proposed openstack/kolla-ansible master: Correct operating-kolla.rst document  https://review.openstack.org/45611001:08
*** Pavo has joined #openstack-kolla01:09
*** al498u_ has quit IRC01:12
*** tonanhngo has quit IRC01:20
*** jpstnh has quit IRC01:21
*** MarginHu has joined #openstack-kolla01:23
*** tonanhngo has joined #openstack-kolla01:27
*** hrw has quit IRC01:30
*** tonanhngo has quit IRC01:32
*** hrw has joined #openstack-kolla01:32
*** tonanhngo has joined #openstack-kolla01:32
*** tovin07_ has joined #openstack-kolla01:35
*** srwilkers has quit IRC01:36
openstackgerritjimmygc proposed openstack/kolla-ansible master: Add vSphere support to nova_compute  https://review.openstack.org/44952901:36
*** tonanhngo has quit IRC01:37
openstackgerritshaofeng cheng proposed openstack/kolla-ansible master: Fix ceph role set target_max_bytes for cach pools  https://review.openstack.org/45244401:38
*** eanylin has joined #openstack-kolla01:44
*** zhubingbing has joined #openstack-kolla01:45
*** Pavo has quit IRC01:54
*** guoguo has quit IRC01:58
*** guoguo has joined #openstack-kolla01:59
openstackgerritshaofeng cheng proposed openstack/kolla-ansible master: Fix ceilometer meters for swift service  https://review.openstack.org/45237302:07
sdakekfox1111 the reason the libviert container sin 4.0.0 are different is because libvirt changes the permissions02:11
sdakekfox1111 look to the implemetnation in kolla-ansible of ocnfig.json - which does the correct thing02:11
sdakekfox1111 also 3.0.0 i think02:12
*** goldyfruit has joined #openstack-kolla02:15
*** unicell has quit IRC02:15
*** mattmceuen has joined #openstack-kolla02:17
spsuryamorning all02:21
*** mkoderer has quit IRC02:27
sdakesup spsurya02:28
sdakekfox1111 t he config.json is different for 4.0.0 then 2.0.002:40
sdakekfox1111 this is one reason why kolla-ansible releases a x stream with a major release02:40
sdakebecause maintaining the compatibility becomes increasingly difficult02:40
sdakeJeffrey4l around?02:41
Jeffrey4lyep sdake02:42
kolla-slack<kfox1111> Sdake, 3.0.3 and 4.0.0 have the same packages, and 3 works but 4 doesnt.02:42
sdakeJeffrey4l I've promised emiliean we would provide a throughou review of the spec that he is working on with dhellmann of the oslo changes02:42
sdakeJeffrey4l i am not sure what review to review, but can you review it when emilien responds?02:43
kolla-slack<kfox1111> Not a config.json issue, as thats from trunk for both02:43
sdakeJeffrey4l any idea on kfox1111 's issue?02:43
sdakesame packages different config.json iirc02:43
Jeffrey4li got emilien mail. i will check it.02:44
kolla-slack<kfox1111> Same config.json02:44
sdakeJeffrey4l he has not responded yet02:44
sdakeJeffrey4l he just responded :)02:44
Jeffrey4lkfox1111, where is the issue description?02:44
sdakekfox1111 can you please provide a review on https://review.openstack.org/#/c/454897/1/specs/queens/oslo-config-db.rst with an eye to how we plan to use native helm charts for config in kolla-kubernetes02:47
kfox1111mouse suddenly is not working...02:47
kfox1111give me a bit...02:47
kfox1111gotta reboot...02:50
masberhi all, I would like to ask why kolla deploys a br-ex on each compute node? am I doing the deployment wrong or is it the expected behavior?02:50
masber*kolla-ansible02:51
kfox1111oh. suspend/resume fixed it.02:51
kfox1111Jeffrey4l: https://review.openstack.org/#/c/454841/ is the ps.02:52
kfox1111http://logs.openstack.org/41/454841/12/check/gate-kolla-kubernetes-deploy-centos-binary-3-ceph-multi-nv/f63be04/logs/ works02:52
kfox1111http://logs.openstack.org/41/454841/12/experimental/gate-kolla-kubernetes-deploy-centos-binary-4-ceph-multi-nv/a2dea00/logs/ fails.02:52
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP: v4 gates.  https://review.openstack.org/45484102:54
Jeffrey4lchecking02:54
sdakewow configmaps are 1.0mb02:54
kfox1111sdake: will review tomorrow. its a long read. but thanks for the pointer. should be interesting.02:54
sdakekfox1111 ya - i promised i'd review, although i feel you are more qualified to respond then I am02:55
sdakeI will respond after your first to review with my pov02:55
sdakeI have read it an have a certain pov, but I dont' want to poison your thoughts02:55
kfox1111the more eyes the better. :)02:55
sdakeya - emilien indicated there is no reason to proceed if there isn't broad appeal02:56
SamYaplemnaser: br-ex on each compute is for provider networks (vlan networks). its not technically needed if all of your compute traffic goes over a vxlan tunnel to the l3-agent node02:56
sdakethanks SamYaple :)02:56
Jeffrey4lkfox1111, http://logs.openstack.org/41/454841/12/experimental/gate-kolla-kubernetes-deploy-centos-binary-4-ceph-multi-nv/a2dea00/console.html#_2017-04-12_22_14_28_06427502:57
*** lrensing has quit IRC02:58
Jeffrey4lthe vm is running in your failed gate.02:58
Jeffrey4lbut there is /dev/vdb disk http://logs.openstack.org/41/454841/12/experimental/gate-kolla-kubernetes-deploy-centos-binary-4-ceph-multi-nv/a2dea00/console.html#_2017-04-12_22_14_41_32773702:58
kfox1111uh....02:58
kfox1111yeah. thats the issue.02:58
Jeffrey4lthere is no*02:59
kfox1111ceph volumes work in 3.x but not 4.x02:59
Jeffrey4lso this should not related to libvirt, at least02:59
kfox1111but same set of packages.02:59
kfox1111yea, thats what I'm thinking.02:59
kfox1111I just submitted a 4.x gate run with a 3.0.3 libvirt container just to double check.02:59
kfox1111thinking something changed in 4.x nova-compute maybe.03:00
Jeffrey4lsudo /sbin/mkfs.vfat /dev/vdb   <-- i think your gate script is wrong.03:00
Jeffrey4lthis should come from your deploy script.03:00
kfox1111works ok in the gate.03:00
kfox1111its running in cirrus03:00
*** lucasxu has joined #openstack-kolla03:01
*** goldyfruit has quit IRC03:01
Jeffrey4lthen the root cause is cirros do not load the /dev/vdb,03:01
kfox1111but same cirrus image is working fine in 3.x03:02
Jeffrey4lfound this http://logs.openstack.org/41/454841/12/experimental/gate-kolla-kubernetes-deploy-centos-binary-4-ceph-multi-nv/a2dea00/logs/openstack/kolla-nova-compute-qdqf5.txt03:02
Jeffrey4lsearch "ERROR"03:02
Jeffrey4lthe attache volume is failed.03:03
*** sayantan_ has joined #openstack-kolla03:03
kfox1111yeah.03:03
kfox1111but why.03:03
kfox1111its saying libvirt failed to attach, I think.03:03
Jeffrey4lyep. not sure why now. never saw this issue.03:03
* Jeffrey4l is asking google03:03
kfox1111still trying to figure out what could be different between 3 and 4 gates. very similar.03:03
sdakekfox1111 the gates are simliar however openstack is completel ydifferent03:04
sdakeopenstack is rewritten every 6 months :)03:04
kfox1111somewhat, yeah.03:04
sdakekolla-ansible is widely tested by the community03:05
sdakeand 4.0.0 works03:05
sdakeso something is wrong with the helm implementation03:05
Jeffrey4lcheck this03:05
Jeffrey4l<auth username="cinder">03:05
Jeffrey4l    <secret type="ceph" uuid="eee6ad83-5be4-4f29-b423-38e3e8262e22"/>03:05
Jeffrey4l  </auth>03:05
kfox1111http://logs.openstack.org/41/454841/12/experimental/gate-kolla-kubernetes-deploy-centos-binary-4-ceph-multi-nv/a2dea00/logs/virsh-secret-list.txt03:06
Jeffrey4lnova-compute/libvirt is using ceph.cinder.client to connect vms pools03:06
kfox1111there is a secret in virsh for it.03:06
kfox1111so that seems ok.03:06
Jeffrey4ldid u inject the cinder key to libivrt?03:06
Jeffrey4ljust like nova keys03:06
kfox1111yup.03:07
kfox1111the virsh list there shows its loaded.03:07
Jeffrey4lare u sure the value is correct?03:07
Jeffrey4lhow it is loaded in kolla-k8s?03:07
Jeffrey4lseem it is different with kolla-ansible03:08
*** lucasxu has quit IRC03:09
kfox1111sec.03:09
kfox1111similar to kolla-ansible.03:11
kfox1111https://github.com/openstack/kolla-kubernetes/blob/master/helm/microservice/nova-libvirt-daemonset/templates/nova-libvirt.yaml#L5503:11
kollianjapestinho: any idea about this http://paste.openstack.org/show/606396/03:12
kfox1111the log code for the init containers here: http://logs.openstack.org/41/454841/12/experimental/gate-kolla-kubernetes-deploy-centos-binary-4-ceph-multi-nv/a2dea00/logs/pods/kolla-nova-libvirt-ptx20-initialize-nova-libvirt.txt03:13
kfox1111looked like it ran ok.03:13
Jeffrey4lkfox1111, but only one key is loaded, right?03:14
*** lrensing has joined #openstack-kolla03:14
kfox1111yeah. its nova local ephemeral, ceph volumes.03:14
Jeffrey4lnova and cinder is using different secret since ocata.03:14
kfox1111that could be related.03:15
kfox1111though the log looks like its using the right uuid for the secret?03:15
Jeffrey4lyes. but i am afraid the value is not correct.03:16
Jeffrey4li guess you are using cinder's rbd key + nova's cephx key03:16
Jeffrey4lkfox1111, check this patch https://review.openstack.org/#/c/442519/03:16
kfox1111its possible...03:17
kfox1111well...03:17
kfox1111looking at tools/setup_simple_ceph_users.sh,03:20
kfox1111the main difference between nova and cinder keys is nova has access to pool vm's and pool images too.03:20
*** lrensing has quit IRC03:20
*** manheim has joined #openstack-kolla03:20
kfox1111both have perms to volumes.03:20
kfox1111so for cinder volume attachment, shouldn't matter?03:20
*** ssurana has quit IRC03:21
*** ssurana has joined #openstack-kolla03:21
*** lrensing has joined #openstack-kolla03:21
*** ssurana has quit IRC03:21
Jeffrey4lkfox1111, i thin so.03:21
Jeffrey4lso please re-check this part. whether the secret_uuid and value is expected for both cinder and nova.03:22
*** manheim has quit IRC03:24
kfox1111I think its the ceph uuid all the way through.03:27
*** zhubingbing has quit IRC03:27
*** zhubingbing has joined #openstack-kolla03:27
kfox1111cinder I mean.03:28
*** zhubingbing has quit IRC03:28
kollianJeffrey4l: can you me in this http://paste.openstack.org/show/606396/ ?03:28
kollianthough it is seem like it is independent of kolla03:29
kollianhelp me*03:29
masberkollian, ansible can't ssh to the machine03:31
kfox1111ok, confirmed 4.x nova with 3.0.3 nova-libvirt still fails.03:32
kfox1111so it nova-compute or config related.03:32
masberdid you copy the keys across?03:32
kfox1111but config should be pretty much identicle betwen 3.x and 4.x...03:32
*** lrensing has quit IRC03:32
masberis the machine up?03:32
*** lrensing has joined #openstack-kolla03:33
Jeffrey4lkollian, you need configure passwordless login for ssh.03:35
kollianJeffrey4l: I have already configured the same for each VMs [1-3]03:36
Jeffrey4lkollian, you machine do not think so : {"changed": false, "msg": "Failed to connect to the host via ssh: Host key verification failed.\r\n", "unreachable": true}03:37
kollianmasber: i am to ssh on each vm from each other03:37
kollianable to*03:37
masberkollian you can ssh without password?03:37
Jeffrey4lHost key verification faile, clear you known_hosts file03:37
kollianmasber: yes03:37
masberform the kolla host?03:38
masberusing the hostname as well or just the IP?03:38
Jeffrey4lkollian, check http://stackoverflow.com/questions/21087695/not-able-to-git-pull-host-key-verification-failed03:38
kollianmasber: using hostname03:39
kollianand IP03:39
masber"he authenticity of host 'vmachine2 (192.168.121.212)' can't be established." that tells me hat ssh is not setup correctly03:41
masberdelete the ssh keys and redeploy it again03:42
masberssh-keygen -R <hostname>03:42
masberssh-copy-if root@<hostname>03:42
masberand then ssh to the machine and make sure it doesn't ask for any password or anything03:43
masberwhy you have 3 IPs and 3 hostnames on your inventory file?03:44
masberdo you have 6 machines?03:44
*** lrensing has quit IRC03:44
masbertry using all hostnames or IPs03:44
kollianmasber: i have 3 VMs03:45
kollianusing one vm as deployment as well target node and other two as target node03:45
kollianonly03:45
masberok03:45
kollianmasber: is that fine03:46
masberI separate kolla from controll node03:46
masberbut you script is complaining about all of them03:46
*** lrensing has joined #openstack-kolla03:46
masber*complaining about the 3 vms03:47
masberdo this03:47
masberhttp://paste.openstack.org/show/606397/03:49
masberand then just make sure you only have hostnames in your inventory file03:50
masberwhich should be the file called "multinode"03:50
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP: v4 gates.  https://review.openstack.org/45484103:50
masberthen try to deploy again03:51
masberrun *prechecks sorry03:51
kollianmasber: in my case i have 'vagrant' as root and Vmachine[1-3] as hostname03:52
masberI normally run it as root03:52
*** lamt has joined #openstack-kolla03:53
*** gkadam has joined #openstack-kolla03:53
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP: v4 gates.  https://review.openstack.org/45484103:55
kollianmasber: i am using vm1 as deploy node and not bothering about the host where i have launched these three03:55
kollianvms03:55
kollianmasber: vagrant@Vmachine1:/usr/local/share/kolla-ansible$ ssh-keygen -R vagrant@vmachine1 Host vagrant@vmachine1 not found in /home/vagrant/.ssh/known_hosts vagrant@Vmachine1:/usr/local/share/kolla-ansible$03:55
*** ssurana has joined #openstack-kolla03:56
*** zhurong has quit IRC03:57
kollianmasber: http://paste.openstack.org/show/606399/  please check03:59
*** lrensing has quit IRC04:03
kollianmasber: Jeffrey4l thanks04:03
kolliani am checking at from my end04:04
*** fooliouno has joined #openstack-kolla04:11
*** gkadam is now known as gkadam-afk04:15
*** zhurong has joined #openstack-kolla04:16
*** skramaja has joined #openstack-kolla04:32
*** unicell has joined #openstack-kolla04:32
*** Seyong has joined #openstack-kolla04:37
*** gkadam-afk is now known as gkadam04:37
*** unicell1 has joined #openstack-kolla04:38
*** unicell has quit IRC04:39
openstackgerritTaejeoung Kim proposed openstack/kolla-kubernetes master: fix link error  https://review.openstack.org/45644404:50
*** pramodrj07 has joined #openstack-kolla05:05
*** MasterOfBugs has joined #openstack-kolla05:05
masberkollian, is it working now?05:08
masberkollian, sorry just came back from lunch, looks like it can't resolve the machine names, you need to edit your /etc/hosts file05:09
masberor just use IPs05:10
*** bmace has quit IRC05:11
*** bmace has joined #openstack-kolla05:11
*** claudiub has joined #openstack-kolla05:17
*** lucasxu has joined #openstack-kolla05:19
*** lucasxu has quit IRC05:20
kollianmasber: thanks for reply05:31
kollianmasber: seems like the VMs I have created using vagrant05:32
kollianis not able ssh via hostanam e05:32
kollianmasber: i am able  to ssh via root user only05:33
kollianmasber: it is not working05:38
openstackgerritjimmygc proposed openstack/kolla-ansible master: Add VMware NSXV support to neutron  https://review.openstack.org/45009205:44
masberok you have to fix that05:45
masberdeployment node should be able to ssh as root to any node, just use IPs and not hostnames so you don't need to worry about name resolving05:45
masberput IPs on the inventory file05:46
kollianmasber: i did http://paste.openstack.org/show/606402/05:51
kollianthis is my multinode05:52
kollianmasber: please see at the botom05:53
kollianof the paste05:53
*** ssurana has quit IRC05:54
masberthat looks good to me05:56
*** dixiaoli has joined #openstack-kolla06:08
*** gkadam is now known as gkadam-afk06:12
*** jaosorior_away is now known as jaosorior06:18
*** dvx has quit IRC06:18
*** dvx has joined #openstack-kolla06:21
*** lamt has quit IRC06:22
*** satyar has joined #openstack-kolla06:24
*** sayantan_ has quit IRC06:26
*** imcsk8 has quit IRC06:26
*** imcsk8 has joined #openstack-kolla06:26
kollianmasber: me too, but again the same  error06:29
masberpaste here how do you ssh into the node06:29
kollianmasber: http://paste.openstack.org/show/606405/06:32
kolliansee what is working and what is not :(06:32
masberas root06:32
*** lamt has joined #openstack-kolla06:32
kollianwithout root06:33
masberssh root@192.168.121.21206:33
kollianupdated the same paste06:34
*** imcsk8 has quit IRC06:40
*** imcsk8 has joined #openstack-kolla06:41
*** mdnadeem has joined #openstack-kolla06:42
*** varto has joined #openstack-kolla06:50
*** pbourke has quit IRC06:51
*** pbourke has joined #openstack-kolla06:53
vartoHi, question about config in kolla 4.0.0 (cinder). If I configure in global.xml backend_lvm=yes and backend_iscsi=no why in wm creation I still get error connecting to any iscsi portals ?06:56
*** manheim has joined #openstack-kolla06:56
*** pcaruana has joined #openstack-kolla07:01
*** manheim has quit IRC07:01
*** pramodrj07 has quit IRC07:02
*** MasterOfBugs has quit IRC07:02
*** pramodrj07 has joined #openstack-kolla07:03
*** MasterOfBugs has joined #openstack-kolla07:03
*** PramodJ has joined #openstack-kolla07:04
*** MasterOfBugs has quit IRC07:05
*** pramodrj07 has quit IRC07:05
*** MasterOfBugs has joined #openstack-kolla07:05
vartohmm maybe need to move iscsi portal ip from tgtd config.json to point in storage network interface ip - well anyways testing that.07:06
*** yangyapeng has joined #openstack-kolla07:06
*** mewald has joined #openstack-kolla07:08
hrwmorning07:28
hrwanyone know what is with review.openstack.org? lags terribly07:28
spsuryahrw: seems iunresponsive07:30
spsuryaunresponsive*07:30
spsuryausually happens07:31
spsuryahope will be good soon07:31
spsuryaServer Error07:32
*** lamt has quit IRC07:32
*** rmart04 has joined #openstack-kolla07:34
*** imcsk8 has quit IRC07:37
*** imcsk8 has joined #openstack-kolla07:37
*** egonzalez has joined #openstack-kolla07:40
*** egonzalez has quit IRC07:46
*** egonzalez has joined #openstack-kolla07:46
*** Serlex has joined #openstack-kolla07:48
*** calbers has joined #openstack-kolla07:51
spsuryaegonzalez: hi.....07:52
egonzalezspsurya, sup07:52
*** manheim has joined #openstack-kolla07:54
spsuryaegonzalez: there was something but i got that :)07:54
spsuryathsnk07:54
*** MasterOfBugs has quit IRC07:59
*** PramodJ has quit IRC07:59
*** jascott1_ has quit IRC08:05
*** jascott1_ has joined #openstack-kolla08:05
*** jascott1_ has quit IRC08:10
*** yangyapeng has quit IRC08:10
*** yangyapeng has joined #openstack-kolla08:10
openstackgerritBertrand Lallau proposed openstack/kolla-ansible stable/ocata: Fix outdated InfluxDB configuration  https://review.openstack.org/45649108:17
*** blallau has joined #openstack-kolla08:18
*** gfidente has joined #openstack-kolla08:36
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Support non-x86 architectures (aarch64, ppc64le)  https://review.openstack.org/43094008:36
manheimhi. If I'm deploying cinder, both iscsid and tgtd will be deployed? or only one depending on the distribution, ubuntu-tgt and rhel-iscsid?08:37
hrwok, I see that centos builds work today so sent rechecks for my patches08:41
egonzalezpbourke, around? https://bugs.launchpad.net/kolla/+bug/168192008:42
openstackLaunchpad bug 1681920 in kolla "Neutron version is missing from pip list" [Undecided,New]08:42
egonzalezpbourke, tried with images from dockerhub but dont see such issue, can  you test in neutron server oraclelinux source image "pip list | grep -i neutron" if correct version appears?08:43
openstackgerritDai Dang Van proposed openstack/kolla stable/newton: Backport "Fix Creating Ceilometer MongoDB database failed"  https://review.openstack.org/45650008:46
*** rmart04 has quit IRC08:46
kollianegonzalez: got some error http://paste.openstack.org/show/606422/ in AIO08:48
kollianpreccheck runs but deploy lands into error08:48
egonzalezkollian, finally used master or stable branch?08:50
-openstackstatus- NOTICE: zuul was restarted due to an unrecoverable disconnect from gerrit. If your change is missing a CI result and isn't listed in the pipelines on http://status.openstack.org/zuul/ , please recheck08:51
kollianegonzalez: used master08:51
kollianno registry at all08:51
kollianjust kolla-ansible install08:52
egonzalezkollian, use git pull to download latest changes, a workaround has been merged yesterday08:52
kollianegonzalez: was that related to same i am facing ?08:52
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Fix neutron vpn external network traffic  https://review.openstack.org/45650908:53
egonzalezkollian, where images come from? there are no published images for master branch. if images are from dockerhub are stable/ocata while ansible code is master08:53
egonzalezkollian, yep, is exactly that issue fix08:53
kollianegonzalez: you mean git pull in kolla-ansible dir. right ?08:54
egonzalezkollian, yep08:55
egonzalezkollian, but again, where images come from? that issue is only present with master images08:55
*** athomas has joined #openstack-kolla08:56
kollianegonzalez: you mean pulling the will also not work08:57
egonzalezkollian, if images are stable/ocata, the issue is other than the fixed in master08:58
kollianegonzalez: yes i think images are stable/ocata08:59
kollianbecoz i didn't any registry for images08:59
kollianso the issue i am facing is not related to yesterday merged fix09:00
openstackgerritDai Dang Van proposed openstack/kolla stable/newton: Fix Creating Ceilometer MongoDB database failed  https://review.openstack.org/45651309:00
kollianegonzalez: right ?09:00
openstackgerritEduardo Gonzalez proposed openstack/kolla stable/ocata: [DNM] test ocata branch  https://review.openstack.org/45651409:01
egonzalezkollian, is rabbitmq running? can you check logs from nova at /var/lib/docker/volumes/kolla_logs/_data/nova ?09:02
kollianroot@Vmachine3:/usr/local/share/kolla-ansible# vi /var/lib/docker/volumes/kolla_logs/_data/nova/ nova-api.log              nova-conductor.log        nova-manage.log           nova-scheduler.log        placement-api.log          nova-compute.log          nova-consoleauth.log      nova-novncproxy.log       placement-api-access.log09:03
kollianegonzalez: is there should be any log file rabbitmq name09:03
kolliannamed*09:04
kollianroot@Vmachine3:/usr/local/share/kolla-ansible# ps -ef | grep rabbit root     15885 28598  0 09:04 pts/0    00:00:00 grep --color=auto rabbit root@Vmachine3:/usr/local/share/kolla-ansible#09:04
kolliannot running i guess09:04
egonzalezkollian, docker logs rabbitmq09:05
*** sambetts|afk is now known as sambetts09:06
openstackgerritShunli Zhou proposed openstack/kolla-ansible master: Correct operating-kolla.rst document  https://review.openstack.org/45611009:06
kollianegonzalez: I disabled it in all.yaml09:08
kollian?09:08
kollianyes i did09:08
egonzalezkollian, rabbitmq is required for almost every openstack service09:08
kollianegonzalez: i disabled it when i ran into this http://paste.openstack.org/show/606428/09:10
kollianduring prechecks09:10
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Fix neutron vpn external network traffic  https://review.openstack.org/45650909:10
*** yangyapeng has quit IRC09:10
mewaldIs anybody using elasticsearch with kolla? I found out programname is an analyzed field which makes in impossible to display logs by openstack service since "nova-scheduler" for example is broken into "nova" and "scheduler". Where and how can I change that? Has anybody done that?09:12
egonzalezkollian, that means that the IP on api_interface has to resolve its hostname, in your case add <API IP> Vmachine3 in /etc/hosts09:12
egonzalezcheck that ping -a Vmachine3 use the correct IP09:13
kollianegonzalez: i checked it /etc/hosts container 127.0.0.1 corresponding to Vmachine309:14
kollianso i think this correct for AIO09:15
kollianand this also working ping -a Vmachine309:15
egonzalezthe IP which need to be resolvable is the IP on api_interface(eth0 or other interface)09:16
kollianok09:17
kollianegonzalez: checking09:19
*** lpetrut has joined #openstack-kolla09:21
*** jaosorior has quit IRC09:26
*** skramaja has quit IRC09:27
kollianegonzalez: http://paste.openstack.org/show/606430/09:27
kollianthis time with haproxy09:27
kollian?09:28
kolliando i need to enabled it for AIO09:28
egonzalezkollian, kolla_internal_vip_address IP should not be associated on any network device in your network09:28
kollianyou eth0 ?09:28
egonzalezwill be used by keepalived as VIP, if is used keepalived cannot use it09:28
kollianyou mean *09:28
egonzalezkolla_internal_vip_address is free IP address in the range of api_interface09:29
kollianshould i leave that variable unset09:30
kollian?09:30
*** guoguo has quit IRC09:30
*** rwsu has quit IRC09:30
*** jaosorior has joined #openstack-kolla09:30
*** gkadam-afk is now known as gkadam09:33
egonzalezkollian, nope, add a free IP in you network, my network is 192.168.100.0/24, I use 192.168.100.10 as VIP. ensure the IP is not used09:34
*** zhubingbing has joined #openstack-kolla09:37
*** varto has quit IRC09:38
kollianegonzalez: i have no free ip i thinbk. As i am deploying on one single node vm09:41
kollianso why it requires another ip09:41
kolliani.e vip ?09:42
egonzalezkollian, for load balancing. if is a VM isolated from other networks, then you have a full range with free IPs ;)09:47
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Add graceful_timeout argument to kolla_docker  https://review.openstack.org/45305509:50
*** daidv has quit IRC09:59
kollianegonzalez: what if i deploy failed10:03
kollianshould i run any command to clean10:03
kollianall the current setup10:03
kollianor just change in configuration and redeploy10:04
kollianbecox thinks are mentioned in the doc10:04
kollianthinkgs*10:04
*** tovin07_ has quit IRC10:04
egonzalezkollian, depends on which step failed, if is something blocking as db sync or ir just trying to copy a file10:05
egonzalezif is blocking run kolla-ansible destroy10:05
egonzalezif is not blocking just redeploy again10:06
*** jascott1_ has joined #openstack-kolla10:06
zhubingbinghi  egonzalez https://review.openstack.org/#/c/456509/10:07
zhubingbingplease review10:07
zhubingbing;)10:08
openstackgerritDan Ardelean proposed openstack/kolla-ansible master: Add Hyper-V role  https://review.openstack.org/45568410:08
openstackgerritzhubingbing proposed openstack/kolla stable/ocata: make yum fail on missing packages  https://review.openstack.org/45146010:08
*** MarginHu has quit IRC10:09
*** jascott1_ has quit IRC10:10
sdakekfox1111 you woudl think config is identical10:16
sdakehowever config.json is different10:16
sdakealso there is this thing called "use_neutron" which is a delta10:17
*** zhurong has quit IRC10:17
*** cuongnv has quit IRC10:17
openstackgerritDuong Ha-Quang proposed openstack/kolla master: debian: move to stretch  https://review.openstack.org/43445310:19
egonzalezzhubingbing, cannot understand what fixes in the vpn, I'm worried than setting br-ex will broke users who use more than one bridge10:19
zhubingbingok10:19
openstackgerritDuong Ha-Quang proposed openstack/kolla master: Add ceilometer agent ipmi docker file  https://review.openstack.org/45428110:21
egonzalezzhubingbing, what is not working in vpnaas?10:22
zhubingbingyeah10:22
zhubingbingvpnaas function not work10:22
zhubingbingvpnaas extern  network function not work10:23
*** rwsu has joined #openstack-kolla10:23
zhubingbingwe need to setting external_network_bridge = br-ex10:23
*** satyar has quit IRC10:23
zhubingbinghttps://review.openstack.org/#/c/59359/13/etc/l3_agent.ini10:23
zhubingbingthis patch10:23
egonzalezzhubingbing, but that patch is from 3 years ago and is meant to allow multiple external network per l3 agent, setting the bridge removes such functionality10:26
sdakesup zhubingbing10:28
*** zhubingbing has quit IRC10:28
sdakesup duonghq10:28
duonghqhi sdake10:28
sdakesup egonzalez10:28
egonzalezsup sdake10:29
*** 21WAAAWJC has joined #openstack-kolla10:31
21WAAAWJCi am hear10:31
21WAAAWJC;)10:31
21WAAAWJCegonzalez roger10:31
21WAAAWJChi sdake10:31
sdakesup 21WAAAWJC10:31
21WAAAWJC。。10:31
21WAAAWJCsdake10:32
egonzalezsuch a strange nick 21WAAAWJC hehe10:32
21WAAAWJCwait10:32
*** 21WAAAWJC has quit IRC10:32
*** zhubingbing has joined #openstack-kolla10:32
zhubingbing;)10:32
zhubingbinghi sdake10:32
zhubingbinghi egonzalez10:32
*** duonghq has quit IRC10:34
spsuryahi sdake10:40
sdakesup spsurya10:41
*** zhurong has joined #openstack-kolla10:45
*** rwellum has joined #openstack-kolla10:52
*** caowei has quit IRC10:54
*** erlon has joined #openstack-kolla11:01
openstackgerritzhubingbing proposed openstack/kolla-kubernetes master: Move ironic config to kolla-k8s  https://review.openstack.org/45070111:08
openstackgerritMerged openstack/kolla master: Add pymongo in panko images  https://review.openstack.org/45566711:13
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix Freezer service config override issue  https://review.openstack.org/45656611:17
*** Pavo has joined #openstack-kolla11:18
*** lpetrut has quit IRC11:20
*** manheim has quit IRC11:21
*** claudiub has quit IRC11:22
*** zhubingbing has quit IRC11:29
openstackgerritEduardo Gonzalez proposed openstack/kolla stable/ocata: Add pymongo in panko images  https://review.openstack.org/45656911:30
*** dixiaoli has quit IRC11:31
*** manheim has joined #openstack-kolla11:33
*** lpetrut has joined #openstack-kolla11:33
openstackgerritEduardo Gonzalez proposed openstack/kolla stable/ocata: Add pymongo in panko images  https://review.openstack.org/45656911:34
*** rhallisey has joined #openstack-kolla11:36
*** iceyao has joined #openstack-kolla11:38
sdakemorning11:38
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Fix zun images  https://review.openstack.org/45625111:39
*** MarginHu has joined #openstack-kolla11:45
*** yingjun has joined #openstack-kolla11:46
*** iceyao has quit IRC11:49
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Fix zun deployment  https://review.openstack.org/45625611:51
*** rwallner has joined #openstack-kolla11:52
*** iceyao has joined #openstack-kolla11:52
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix Freezer service config override issue  https://review.openstack.org/45656611:53
rwellumMorning sdake - I threw my hat in the ring on the kolla mentorship program thread11:53
*** rwallner has quit IRC11:53
*** rwallner has joined #openstack-kolla11:54
kollianegonzalez: can you please know what can be kolla_internal_vip_address: if ifconfig is as follow for my VM11:54
kollianhttp://paste.openstack.org/show/606439/11:54
*** mewald has quit IRC11:55
kollianlet me know*11:55
kollianbecause i ran into this http://paste.openstack.org/show/606440/11:57
*** iceyao has quit IRC11:58
*** iceyao has joined #openstack-kolla11:59
kollianjapestinho: hi11:59
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix Freezer service config override issue  https://review.openstack.org/45656612:01
openstackgerritMerged openstack/kolla master: Add missing Jinja2 block for repo enablement  https://review.openstack.org/45460812:01
sdakerwellum cool i'll read the thread - just owke up moment :)12:02
*** manheim has quit IRC12:04
*** manheim has joined #openstack-kolla12:05
*** lpetrut has quit IRC12:05
*** jascott1_ has joined #openstack-kolla12:07
*** jascott1_ has quit IRC12:11
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Add zun deploy documentation  https://review.openstack.org/45658712:11
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix 'node_config_directory' variable bad usage  https://review.openstack.org/45658812:12
egonzalezkollian, kolla_internal_vip address cannot be the same IP in api_interface12:12
egonzalezkollian, should be one IP in the same range but not used by any other device in the network12:12
*** goldyfruit has joined #openstack-kolla12:13
*** lpetrut has joined #openstack-kolla12:13
*** goldyfruit has quit IRC12:13
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Add zun deploy documentation  https://review.openstack.org/45658712:15
kollianegonzalez: ok12:16
*** lamt has joined #openstack-kolla12:22
*** manheim has quit IRC12:23
*** Daviey has quit IRC12:28
openstackgerritMerged openstack/kolla-kubernetes master: Move mariadb configs to k8s  https://review.openstack.org/45640712:31
*** iceyao has quit IRC12:33
*** iceyao has joined #openstack-kolla12:34
sdakesbezverk thanks a ton for htat last review dudue12:36
sdakesbezverk that helped me fix the ironic gate pretty sur e;)12:36
openstackgerritSteven Dake proposed openstack/kolla-kubernetes master: Revert "Update to Helm v2.3.0"  https://review.openstack.org/45550212:37
openstackgerritSteven Dake proposed openstack/kolla-kubernetes master: Placement support in nova service chart  https://review.openstack.org/45384612:37
*** Pavo has quit IRC12:43
sdakerwellum note - when I asked for a review on this - I was stuck.  Even our other core reviewers didn't find it - however through conversation in the review, it was found12:44
sdakerwellum I'd encourage you to read the conversation in the last 4 or 5 comments - however - here is the ultimate change that makes ironic pass: https://review.openstack.org/#/c/453846/22..2312:44
*** jpstnh has joined #openstack-kolla12:45
*** manheim has joined #openstack-kolla12:46
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Add zun startup guide documentation  https://review.openstack.org/45658712:46
sdakerwellum what I really want you to get out of that is the conversatoin that led to the resolution of the problem in the patch12:48
*** iceyao has quit IRC12:48
sdakerwellum you will note that sbezverk didn't catch the problem, and I didn't catch the problem, and I must have done git show -1 100+ times12:48
sdakerwellum however, through conversational exchange, his commentary that the code was already there triggered thinking in my brain to go look at he line number he pointed out, which resulted in me determing && was wrong and -a was correct12:49
sdakerwellum this is how a good review should work :)12:49
*** iceyao has joined #openstack-kolla12:50
*** MarginHu has quit IRC12:51
*** MarginHu has joined #openstack-kolla12:51
*** rhallisey has quit IRC12:51
*** lamt has joined #openstack-kolla12:56
*** zhubingbing has joined #openstack-kolla12:56
*** Daviey has joined #openstack-kolla12:57
*** Pavo has joined #openstack-kolla12:57
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Add zun startup guide documentation  https://review.openstack.org/45658712:59
*** Pavo has quit IRC13:01
*** lpetrut has quit IRC13:03
*** Pavo has joined #openstack-kolla13:03
*** Pavo has quit IRC13:03
*** Pavo has joined #openstack-kolla13:04
*** mattmceuen has quit IRC13:05
*** Pavo has joined #openstack-kolla13:06
*** jtriley has joined #openstack-kolla13:07
rwellumsdake - interesting bug :)13:10
sdakerwellum ya I'm just a dummy that doesn't know shell scripting13:10
sdakeblind to the obvious13:10
*** rhallisey has joined #openstack-kolla13:10
sdakeas were other reviewers13:11
sdakerwellum the key thing is the exchange13:11
sdakerwellum via exchange in the review, we can make forward progress when it appears no more forward progress canbe made13:11
*** esharao has joined #openstack-kolla13:11
rwellumDo you know if old shell is a standard historically? - I'm kinda surprised we're not using bash notation.13:14
openstackgerritMerged openstack/kolla-ansible master: Fix Freezer service config override issue  https://review.openstack.org/45656613:14
*** satyar has joined #openstack-kolla13:15
sdakerwellum i am super far from a bash nerd - although I know [[ ]] would work with &&13:19
sdakeand i know [ ] doesn't13:19
sdakerwellum with [ ] you have to use -a and -o13:20
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible stable/ocata: Configure coordination_url for cloudkitty processor  https://review.openstack.org/45550413:20
sdakerwellum I am not sure we have a standard in kolla-kubernetes aroudn the gate scripts related to shell13:20
sdakerwellum I was more "copying" the look and feel i saw there13:20
sdakerwellum since you voiced interest on the mailing list check out:13:21
sdakehttps://etherpad.openstack.org/p/kolla-mentorship-signup13:21
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible stable/ocata: Fix Freezer service config override issue  https://review.openstack.org/45660613:22
sdakesbezverk thanks dude - gate is green:-) https://review.openstack.org/#/c/453846/13:27
sdakethats like the first patch I've written all year of any substance...13:27
sdakesadly :(13:27
*** iceyao has quit IRC13:29
*** mbruzek has joined #openstack-kolla13:30
*** mbruzek has joined #openstack-kolla13:30
*** iceyao has joined #openstack-kolla13:30
sbezverksdake: changing names does not sound a good move, think about it, all gate jobs were ok, your not, if it were naming issue, then it would impact all other jobs..13:31
sdakesbezverk brain booting13:32
sdakesbezverk there was a little more to it13:32
*** eanylin has quit IRC13:32
sdakesbezverk trying to pull it from depths of my brain13:32
sdakesbezverk the placement api is only used in the soruce-4 ironci gate13:32
sdakeor is that correct?13:32
sbezverksdake: as it looks now unfortunately it should not get merged, no consistency13:33
sdakewell, i am happy to make it consistent13:33
sdakei just want it to be the correct consistent13:33
sdakevs the incorrect consistent ;)13:33
sbezverksdake: I suggest to revert name changes and find out if there was a real problem with it13:33
*** lpetrut has joined #openstack-kolla13:34
sdakethere is indeed13:34
sdakethe charts dont start13:34
sdakei didn't make that change for my good health ;)13:34
sdakethe history is in the gate logs - no need to even revert13:34
sbezverksdake: you are joking right? how charts were not starting if before you started working on this ps they were running for at leats 2-3 weeks?13:35
*** japestinho has quit IRC13:40
sdakesbezverk i'm not really sure how to answer your question13:40
sdakeother then I have no clue why renaming the resource fixes the problem13:40
sdakewhen dealing with third party dependencies, a no clue answer is sometimes the best answer we are able to achieve13:40
sbezverksdake: but that is the problem, I have hard time understanding when something gets changed without complete understanding of reason. In my profession it is called a root cause.13:41
sdakesbezverk sometimes the cost of determing the root cause is too expesnive13:42
sbezverkif there is no root cause, then what was changed cannot be called a fix, it is just a wild shot in dark, which luckely did not kill any body but somehow cuase this positive impact..13:42
sdakeI realize in your field determing root cause is always the most critical thing13:42
sdakein R&D engineering , root cause is often not hte most critical thing13:42
*** srwilkers has joined #openstack-kolla13:42
sbezverksdake: that is why quality is always suffering these days and we have software which is crashing or needed to be rebooted weekly13:43
sdakesbezverk can you tell me what this error means: http://logs.openstack.org/46/453846/17/check/gate-kolla-kubernetes-deploy-centos-binary-2-helm-entrypoint-nv/17c1634/console.html#_2017-04-10_01_46_56_33761813:43
sdakesbezverk you may possibly be correct :)13:43
sdakesbezverk this is *without* any renaming13:44
sbezverksdake: it means somebody made a mistake but not correctly specifying requirement, but interestingly instead of changing requirement file the solution was to start changing chrts ?!?!?13:45
*** zhubingbing has quit IRC13:45
rwellumsdake: signed up13:46
*** zhubingbing has joined #openstack-kolla13:46
*** al498u has joined #openstack-kolla13:46
sdakerwellum cool13:46
sdakesbezverk ok - not coreclty specifying requirement13:46
sbezverksdake: if you compare the line you pasted me with line just above in the log, what difference do you see?13:47
*** al498u_ has joined #openstack-kolla13:48
sdakesbezverk which line did I paste you?  I dont follow13:48
sbezverksdake: you pasted me here on IRC a log pointing to one line, right?13:48
sdakeright - the warning line13:49
sbezverkyes, I am asking you to compare that line with one just above it and tell me the difference13:49
sbezverkin the same log13:49
sbezverkspecifically the structure of the microservice name13:50
sdake2017-04-10 01:46:52.356371 | Archiving ironic-conductor-daemonset from repo file://../../microservice/ironic-conductor-daemonset13:50
sdake2017-04-10 01:46:56.337618 | Warning: nova-placement-create-keystone-endpoint-internal is in requirements.yaml but not in the charts/ directory!13:50
sdakeI dont totally follow :)13:50
sdakebut i'm willing to learn13:50
sbezverkhow the name end in both cases?13:51
*** al498u has quit IRC13:51
srwilkersmissing the suffix13:51
sdakewith teh object type13:51
srwilkers-job13:51
sbezverkswilkers, thank you :-)13:51
satyarHi All13:52
srwilkerssbezverk, cheers dude13:52
sdakei did give it a go of adding the suffix IIRC13:52
sdakesup satyar13:52
satyarif ask.openstack.org down?13:52
satyarHow are you sdake :)13:52
sdakesatyar ask @openstack-infra13:52
satyarlong time13:52
satyaryes13:52
sdake#openstack-infra that is13:52
sbezverksdake: instead on starting changing charts13:52
satyarok13:52
sbezverkyou should have analized the failure more carefully13:52
sdakei did anlyze the requirements.yaml at length13:54
sdake+    condition: global.kolla.nova.all.placement_api_enabled13:55
sdake+  - name: nova-placement-create-keystone-endpoint-public-job13:55
sdake+    repository: file://../../microservice/nova-placement-create-keystone-endpoint-public-job13:55
egonzalezsatyar, is UP for me13:55
sdakein fact I got wrapped aroudn the axle on this point  for 3 or 4 hours13:55
sdakesbezverk as you see there, the object type is properly named13:55
*** Administrator_ has quit IRC13:56
sdakesbezverk i also compared the 3 jobs that fialed with the 3 that didn't13:56
sdakeand could not discern a delta13:56
*** Administrator_ has joined #openstack-kolla13:56
*** Pavo has quit IRC13:56
*** goldyfruit has joined #openstack-kolla13:56
*** zhurong has quit IRC13:57
*** yingjun has quit IRC13:58
sdakesbezverk do you see one I am missing?13:58
*** goldyfruit1 has joined #openstack-kolla13:59
*** lamt has joined #openstack-kolla14:00
sbezverksdake: in the paste you clearly missing suffic, I suggest you revert back all changes you have done for microcharts and we analyze each failure why and how properly to address it..14:00
*** goldyfruit1 has quit IRC14:00
sdakesbezverk there is a suffix missing from something14:00
*** goldyfruit1 has joined #openstack-kolla14:00
sdakesbezverk but it is not requirements file14:00
sdakesbezverk i also took a look at the build script itself14:01
*** goldyfruit has quit IRC14:01
sdakeas i thought it was possible it was defective14:01
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-ansible stable/ocata: Updated from global requirements  https://review.openstack.org/45287014:01
*** lrensing has joined #openstack-kolla14:01
sbezverksdake: wow, that script been building for months now14:02
sbezverksdake: and why anybody else would not report it ;) ??14:02
*** signed8bit has joined #openstack-kolla14:03
sdakesbezverk i make no assumptions when develooping software :)14:03
sdakesbezverk good rule to follow :)14:03
sbezverksdake: I do :) and the first assumoption if something is not working is I made a mistake14:03
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Fix zun deployment  https://review.openstack.org/45625614:03
sdakesbezverk anyway my investigation there turned up nothign: https://github.com/openstack/kolla-kubernetes/blob/master/tools/helm_prebuild_microservices.py#L98-L10214:04
sdakereverting the resource name changes doesn't really tell us anything we dont already know in the gate14:05
sdakei am happy to do it14:05
sdakebut fail to understand what the next step from there is14:06
sdakei see that  the suffix is missign from the warning14:06
sdakeI dont understand why its missing14:06
*** goldyfruit1 has quit IRC14:07
*** yangyapeng has joined #openstack-kolla14:08
*** lpetrut has quit IRC14:08
sdakeSTDAKE-M-26CJ:kolla-kubernetes sdake$ grep -r "nova-placement-create-keystone-endpoint-public" * | grep -v job14:08
sdaketests/bin/ceph_workflow.sh:    --namespace kolla --name nova-placement-create-keystone-endpoint-public \14:08
sdaketests/bin/deploy_iscsi_common.sh:    --namespace kolla --name nova-placement-create-keystone-endpoint-public \14:08
*** iceyao has quit IRC14:09
sbezverksdake: I am sorry, but as I said if you revert back names of microcharts you changed then we can pin point the issue in PS, otherwise it is very difficult as I do not undersatnd your logic here..14:10
*** lucasxu has joined #openstack-kolla14:11
*** jpstnh has quit IRC14:13
*** sayantan_ has joined #openstack-kolla14:14
*** goldyfruit has joined #openstack-kolla14:17
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix 'node_config_directory' variable bad usage  https://review.openstack.org/45658814:17
*** iceyao has joined #openstack-kolla14:20
*** iceyao has quit IRC14:21
*** japestinho has joined #openstack-kolla14:21
*** goldyfruit has quit IRC14:22
*** claudiub has joined #openstack-kolla14:23
*** krtaylor has joined #openstack-kolla14:25
*** fguillot has joined #openstack-kolla14:26
*** japestinho has quit IRC14:30
*** manheim has quit IRC14:34
*** lpetrut has joined #openstack-kolla14:36
*** unicell has joined #openstack-kolla14:37
*** unicell1 has quit IRC14:38
*** MarginHu has quit IRC14:39
openstackgerritMerged openstack/kolla-ansible master: Split Openvswitch into own role  https://review.openstack.org/41679314:39
openstackgerritSteven Dake proposed openstack/kolla-kubernetes master: Placement support in nova service chart  https://review.openstack.org/45384614:42
sdakesbezverk ok that has been reverted, what do you suggest as a next step - this is not typically how I do development although interested to learn other's development style14:43
openstackgerritMerged openstack/kolla-ansible stable/ocata: Configure coordination_url for cloudkitty processor  https://review.openstack.org/45550414:43
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Add upgrade release note for ovs split  https://review.openstack.org/45665114:44
sbezverksdake: after we get gates results, we can go through the log14:44
sdakesbezverk k14:44
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla master: Reparent kolla-toolbox from openstack-base  https://review.openstack.org/43502314:45
*** iceyao has joined #openstack-kolla14:46
*** iceyao has quit IRC14:50
*** Pavo has joined #openstack-kolla14:52
*** zhubingbing_ has joined #openstack-kolla14:52
*** zhubingbing has quit IRC14:54
sdakesbezverk quesiton re http://logs.openstack.org/46/453846/17/check/gate-kolla-kubernetes-deploy-centos-binary-2-helm-entrypoint-nv/17c1634/console.html#_2017-04-10_01_46_56_33761814:55
sdakewhat does it mean that the chart is not in the charts directory?14:55
sdakeit may sound like an obvious statement14:55
sdakewaht I don't comprehend is how the charts directory gets populated14:56
sdakesbezverk you will also notice this further up: http://logs.openstack.org/46/453846/17/check/gate-kolla-kubernetes-deploy-centos-binary-2-helm-entrypoint-nv/17c1634/console.html#_2017-04-10_01_46_50_38455214:57
sdakewhere it was indeed archived14:57
*** fooliouno has quit IRC14:57
sdakeone of the thought procesees i went through when debugging  this was that "why is ironic packaging the placement api"14:58
*** yingjun has joined #openstack-kolla15:01
*** Pavo has quit IRC15:01
sdakekfox1111 wrt your change to workaround the 1mb limit - how much headroom do we have available now with your workaround?15:03
*** spsurya__ has joined #openstack-kolla15:03
*** yangyapeng has quit IRC15:05
*** obre has joined #openstack-kolla15:05
*** gkadam has quit IRC15:06
*** jowisz_ has joined #openstack-kolla15:06
*** yangyapeng has joined #openstack-kolla15:06
*** pomac_ has joined #openstack-kolla15:06
*** Slower_ has joined #openstack-kolla15:07
*** mdnadeem has quit IRC15:07
*** afranc has joined #openstack-kolla15:09
*** esmiurium_ has joined #openstack-kolla15:09
*** zigo_ has joined #openstack-kolla15:09
*** pcaruana has quit IRC15:10
*** kencjohnston_ has joined #openstack-kolla15:10
*** berendt has quit IRC15:10
*** pomac has quit IRC15:10
*** pron has quit IRC15:10
*** obre_ has quit IRC15:10
*** aimeeu has quit IRC15:10
*** kencjohnston has quit IRC15:10
*** alanmeadows has quit IRC15:10
*** jgriffith has quit IRC15:10
*** spsurya has quit IRC15:10
*** Aju has quit IRC15:10
*** esmiurium has quit IRC15:10
*** EmilienM has quit IRC15:10
*** serverascode has quit IRC15:10
*** zigo has quit IRC15:10
*** jowisz has quit IRC15:10
*** Slower has quit IRC15:10
*** spsurya__ is now known as spsurya15:10
*** alanmeadows_ has joined #openstack-kolla15:11
*** alanmeadows_ has quit IRC15:11
*** alanmeadows_ has joined #openstack-kolla15:11
*** aimeeu has joined #openstack-kolla15:11
*** pron has joined #openstack-kolla15:11
*** zigo_ is now known as zigo15:12
*** zigo is now known as Guest5258615:12
*** 21WAAA2JF has joined #openstack-kolla15:13
sbezverksdake: looks like infra failure15:14
*** lamt has quit IRC15:15
*** berendt has joined #openstack-kolla15:15
sdakerecheck ftw15:16
*** serverascode has joined #openstack-kolla15:20
*** lpetrut has quit IRC15:20
*** fooliouno_ has joined #openstack-kolla15:24
*** lamt has joined #openstack-kolla15:25
*** yangyapeng has quit IRC15:27
*** manheim has joined #openstack-kolla15:28
*** fooliouno_ has quit IRC15:29
*** fooliouno has joined #openstack-kolla15:30
*** manheim has quit IRC15:32
*** Manheim has joined #openstack-kolla15:32
*** Pavo has joined #openstack-kolla15:36
kfox1111morning.15:36
kfox1111sdake: no idea.15:38
zhubingbing_morning15:39
openstackgerritMerged openstack/kolla-ansible master: Remove the variable redefined in deploy-servers.yml  https://review.openstack.org/44843315:39
*** mbruzek has quit IRC15:39
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible stable/ocata: Fix outdated InfluxDB configuration  https://review.openstack.org/45649115:40
*** swinn has joined #openstack-kolla15:44
sbezverkkfox1111: good morning.. I am trying to print out the size of that config map to see if I can answer sdake question..15:45
*** goldyfruit has joined #openstack-kolla15:46
sdakesbezverk thanks - although I did notice somewhre 9can't remember where) the configmap was in raw format in the gate logs15:46
kfox1111sbezverk: good morning. ok. cool. thanks.15:46
sdakesbezverk not sure wherer i saw it15:46
kfox1111sdake: all the ocnfigmaps are. it could be extracted.15:46
sbezverkkfox1111: yyeeeessss it is only 440k now :)15:48
sbezverkApr 13 11:46:49 kube-1 journal: 2017/04/13 15:46:49 cfgmaps.go:242: Encoded data size is 41141615:48
kfox1111sbezverk: ok. cool. that buys us a bit of time.15:48
kfox1111We're going to run up against that again when we add configmap charts and parent values.15:48
sbezverkkfox1111: man it is half of limit, I would say a lot of time :)15:49
kfox1111we shall see. :)15:49
sdakecool thanks for that information sbezverk15:49
kfox1111I could see it getting close again with those two features. but should be the major missing functionality too.15:49
sdakein the meantime perhaps jascott1 can sort out how to expand the limit15:50
kfox1111we could work around it by breaking up kolla-common to a few smaller charts if needed though to work around it further.15:50
sbezverksdake: that limit is imposed by kubernetes, not helm15:50
sdakesbezverk i understand15:50
sdakesbezverk i didn't say he would fix it in helm, I said he would fix it :)15:50
kfox1111yes, but helm could work around it probably easier then k8s can.15:50
sdakeor i requested if he woudld rather ;)15:50
swinnmorning all, seems I’m working through one more issue - my compute containers do not seem to load the kvm modules even though the host supports the processor flags15:50
*** fguillot has quit IRC15:51
swinnI’ve specified the virt_type in nova.conf and still the hypervisors report QEMU as their type15:51
sbezverkkfox1111: I read some comment in kuberenetes issues queue complaining about it.. so maybe fixing it on kubernetes side is also a possible option..15:51
kfox1111could be.15:51
sbezverksdake: no luck, it looks like centos mirrors are busted again15:52
sbezverksdake: we can look into placement after infra recovers them..15:53
sdakesbezverk cool15:53
sdakei've got to jet - training today15:54
sdakesbezverk thanks for helping - hopefully we can get thatwork merged soon15:54
*** fguillot has joined #openstack-kolla15:55
*** zhubingbing_ has quit IRC15:57
*** alanmeadows_ is now known as alanmeadows16:00
*** Pavo has quit IRC16:01
*** Pavo has joined #openstack-kolla16:03
*** Pavo has quit IRC16:03
*** egonzalez has quit IRC16:03
*** Pavo has joined #openstack-kolla16:04
*** Pavo has quit IRC16:04
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix 'node_config_directory' variable bad usage  https://review.openstack.org/45658816:05
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Simplify Openstack services configuration possibilities  https://review.openstack.org/45668816:05
*** mbruzek has joined #openstack-kolla16:05
sbezverkkfox1111: question about fernet.. I ran compute-kit and the deployment worked fine, then I cleaned up all known to me kube objects and run deployment second time, on the second time I see fernet setup job is crashing. Can you think of any leftover from previous installation which might be causing it?16:08
kfox1111it only has a secret. no other perminant bits.16:09
kfox1111did you delete the secret?16:09
kfox1111the secret isn't helm managed. so we may need a job to clear it.16:10
sbezverkkfox1111: nope cause I am re-using the same secrets16:10
kfox1111the fernet creation script probably doesn't like running if the secret preexists.16:11
kfox1111never really tested for that case.16:11
*** blallau has quit IRC16:11
sbezverkkfox1111: what creates this key keystone-fernet-keys?16:11
sbezverkyour code or it is created by kollakube?16:11
swinnam I chasing a ghost? will nova compute running in a container support kvm and honor cpu overcommit (assuming the host supports the flags)?16:12
kfox1111https://github.com/openstack/kolla-kubernetes/blob/master/helm/microservice/keystone-fernet-setup-job/templates/keystone-fernet-setup-job.yaml#L47-L6616:13
*** blallau has joined #openstack-kolla16:13
kfox1111swinn: should.16:13
sbezverkkfox1111: got it16:13
sbezverkkfox1111: so I need to add it to my cleanup16:13
blallauIf some guys have freetime do this review it will be great, thank you, regards  https://review.openstack.org/#/c/454167/16:15
*** blallau has quit IRC16:15
openstackgerritOpenStack Proposal Bot proposed openstack/kolla master: Updated from global requirements  https://review.openstack.org/45592816:23
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-ansible master: Updated from global requirements  https://review.openstack.org/45592916:23
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/45593016:23
*** satyar has quit IRC16:24
kfox1111so, is infra broken?16:25
kfox1111sbezverk: yeah.16:25
kfox1111maybe need a job that does a curl with a delete instead of post.16:26
sbezverkkfox1111: well, it is a corner case.. and adding explicit delete fixed it.. so I am not sure if anything needs to be changed16:27
kfox1111well, depends on what you want users to be able to do.16:27
kfox1111if you want the keystone cleanup chart to do it all, it needs to be a job.16:27
*** openstack has joined #openstack-kolla16:36
*** hachi has quit IRC16:37
kfox1111sbezverk: k.16:37
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: Compress compute kit  https://review.openstack.org/45640616:37
*** jascott1_ has joined #openstack-kolla16:37
*** jrich523_ is now known as jrich52316:40
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-ansible master: OVS Role release note  https://review.openstack.org/45670216:41
*** haplo37 has joined #openstack-kolla16:42
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: Move ironic config to kolla-k8s  https://review.openstack.org/45070116:44
*** jaosorior has quit IRC16:44
kfox1111sbezverk: can you put your +2 back please: https://review.openstack.org/#/c/450701/516:45
sbezverkkfox1111: done16:45
kfox1111thx16:46
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-kubernetes master: Finalize move of configs to kolla-k8s  https://review.openstack.org/45641216:46
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-kubernetes master: Move ceph configs to kolla-k8s  https://review.openstack.org/45670516:46
*** jascott1_ has quit IRC16:47
inc0kfox1111: so after ceph and ironic, we'll see16:48
inc0hopefully we'll be done today16:49
kfox1111sweet. :)16:49
sdakeinc0 nice dude!16:52
inc0so let's summarize16:52
*** jascott1_ has joined #openstack-kolla16:53
sdakesbezverk quick question about our ironic implementation - can vms and baremetal be deployed in the same tenant?16:53
inc0we can get rid of secret/configmap generation with this playbook: https://review.openstack.org/#/c/447733/16:53
*** unicell has quit IRC16:53
inc0what else do we use kollakybe tool for?16:53
kfox1111inc0: still -1 on that ps.16:53
*** jaosorior has joined #openstack-kolla16:54
inc0kfox1111: we use ansible anyway for now16:54
inc0I'm trying to lower amount of tools involved16:54
kfox1111I'd rather just use kubectl for that.16:54
jascott1_kfox1111 did you get to checkout net=host?16:54
inc0kfox1111: it's about templating16:54
kfox1111jascott1_: yeah. standing it up right now.16:54
inc0kubectl does not template16:54
jascott1_oh cool16:54
kfox1111inc0: there's no templating needed to upload a configmap.16:54
inc0ahh16:54
sbezverksdake: that is what is done currently16:55
kfox1111inc0: see this instead: https://review.openstack.org/#/c/449262/16:55
kfox1111https://review.openstack.org/#/c/449262/8/tools/setup_gate_iscsi.sh16:55
kfox1111it also partially answers your quiestion.16:55
kfox1111what else needs kollakube.16:55
kfox1111the stuff not moved to kubectl still requires the templating engine in kollakube.16:56
kfox1111that should probably move to helm charts.16:56
inc0-haproxy stuff yes16:56
kfox1111right.16:56
inc0keepalived?16:56
inc0btw..keepalived in k8s?16:56
sdakesbezverk i am struggling with the "done currently" part - we use virutal BMC to simulate real hardware, is also a vm created that is not real harddware?16:56
inc0for neutron or sth else?16:57
kfox1111keepalived needs converting.16:57
kfox1111though we never have gate tested it. really should do that.16:57
kfox1111we have a bit of ceph left.16:57
kfox1111openvswitch-set-external-ip needs converting.16:57
kfox1111libvirt secret needs converting.16:57
kfox1111then I think we're in good shape.16:57
sbezverksdake: what I do there is creating 2 normal OpenStack VMs and in addition 1 virsh VM which behaves EXCATLY as baremetal node.16:58
sdakecool thanks sbezverk16:58
kfox1111sbezverk: keepalived is needed if you want ha access. k8s has no functionality around keeping a vip alive.16:59
kfox1111sorry, meant inc016:59
inc0heh...keepalived in k8s sounds so wrong16:59
inc0let's run pacemaker with k8s!17:00
kfox1111heh.17:00
kfox1111keepalived is much easier. pacemaker's safer.17:00
*** lamt has quit IRC17:01
inc0imagine glorious things that will happen when pacemaker starts fencing stuff and k8s starts restarting fence agents due to lost healthchekc17:01
kfox1111I use both in production.17:01
kfox1111its fine if they are net=host and daemonsets.17:01
kfox1111k8s is just a package shipper in that case.17:02
*** jaosorior has quit IRC17:03
*** 21WAAA2JF is now known as EmilienM17:05
*** EmilienM has joined #openstack-kolla17:05
kfox1111jascott1_: does it have a flag yet, or does it always do the net=host?17:06
jascott1_it has a flag17:06
jascott1_do helm init -h17:06
jascott1_but its --net-host=true17:06
kfox1111did a: curl -o /tmp/helm https://raw.githubusercontent.com/jascott1/bins/master/helm/nethost/_dist/linux-amd64/helm17:06
inc0I need mini-pc with Nvidia card17:06
kfox1111/tmp/helm init --net-host=true17:06
kfox1111Error: unknown flag: --net-host17:06
inc0for glory of cuda17:07
inc0any ideas guys?17:07
jascott1_hmm sorry one sec17:07
jascott1_sorry its host-net17:07
jascott1_ugh17:07
kfox1111unkown flag too.17:07
jascott1_idk how that happend, im looking at it17:08
jascott1_I mustve borked the upload let me see17:08
jascott1_sorry man Idk how that happened17:11
jascott1_one min17:11
kfox1111no worries. :)17:12
*** Mannheim has joined #openstack-kolla17:13
*** Manheim has quit IRC17:13
kfox1111sdake: https://www.cncf.io/event/openstack-north-america-2017/17:16
kfox1111see the last entry.17:16
*** jtriley has quit IRC17:17
sbezverkhere is to fix our centos gates: https://review.openstack.org/#/c/456710/17:20
*** unicell has joined #openstack-kolla17:21
kfox1111fun.17:21
kfox1111thanks for the link.17:21
sbezverkkfox1111: learning every freaking day :)17:22
kfox1111indeed. :)17:22
*** tonanhngo has joined #openstack-kolla17:23
*** sambetts is now known as sambetts|afk17:26
*** Pavo has joined #openstack-kolla17:27
*** yingjun has quit IRC17:28
*** jtriley has joined #openstack-kolla17:28
jascott1_kfox1111 should be good to go now.17:28
kfox1111k. trying.17:28
jascott1_was doing 'make dist' instead of 'make cross-build'17:29
kfox1111jascott1_: works good. :)17:32
kfox1111thanks. :)17:32
jascott1_cool!17:32
jascott1_i almost know what I am doing17:32
kfox1111no, you know what your doing. :)17:33
*** lrensing has quit IRC17:33
*** gfidente has quit IRC17:34
jascott1_so one thing, I just adde that param to tiller spec based on flag. Had to add PodSecurityContext{} with HostNetwork property. I have no idea if we need to set anything else in PodSecurityContext17:34
jascott1_i saw some note about if you set it you had to specify ports (which I think we are doing)17:35
jascott1_but not sure if there are any other ramifications. guess we will see  :)17:35
Reepicheepso is there a general rule with kolla-ansible of when to use "deploy" vs "upgrade" over the life cycle of an instance?17:35
jemcevoyinc0:   I have hit a kolla-build issue at a customer site who has one of those man-in-the-middle internet proxies. The rpm command inside the container does not trust the https_proxy.  How can I work around this? http://paste.openstack.org/show/606477/17:35
Reepicheepjemcevoy: can they exempt you from the SSL proxy?17:37
kfox1111really? never had to add a PodSecurityContext to anything else... interesting.17:40
inc0jemcevoy: normally docker containers uses CA authority from host17:41
inc0do you have CA authority in host as well?17:42
sean-k-mooneyinc0: do you mind if i rebase https://review.openstack.org/#/c/440834/2 and adapt my ovs-dpdk patches on top now that the openvswitch role is split?17:42
inc0sean-k-mooney: please do17:43
sean-k-mooneycool thanks17:43
inc0I'm happy that we got role fixed17:43
inc0in fact17:43
inc0I think this makes this change redundant17:43
sean-k-mooneylet me check the change the merged17:43
sean-k-mooneyi think we still need this to be able to skip the role17:43
inc0splitting ovs to separate role17:44
inc0enable_openvswitch: fasle17:44
inc0it's there17:44
inc0or should be17:44
*** srwilkers has quit IRC17:44
inc0yup it's there17:44
sean-k-mooneyoh cool ok ill see if that works with ovs-dpdk so.17:44
inc0in fact sean-k-mooney have you been on meeting today about opnfv?17:44
sean-k-mooneyno17:44
inc0quick call?17:45
sean-k-mooneysure17:45
*** sayantan_ has quit IRC17:47
*** fooliouno has quit IRC17:48
*** lrensing has joined #openstack-kolla17:48
openstackgerritMarcus Williams proposed openstack/kolla-ansible master: Add OpenDaylight role  https://review.openstack.org/41636717:49
*** mbruzek has quit IRC17:51
*** Pavo has quit IRC17:51
jemcevoyReepicheep: It is a defense contractor and I'll never get around using the proxy...17:53
*** Serlex has quit IRC17:53
Reepicheepjemcevoy: yeah. that would probably be wise.. I thought I would just ask the easy one first17:55
jemcevoyinc0:  The host is setup with the correct ca bundle in /etc/pki/tls/certs/ca-bundle.crt that trusts the proxy...17:55
Reepicheepsounds much simpler then baking a CA trust into each of your images17:55
jemcevoyWould the  /etc/pki/tls/certs/ca-bundle.crt only need to be in a base image?17:57
*** Pavo has joined #openstack-kolla17:58
*** lpetrut has joined #openstack-kolla17:59
*** rwallner_ has quit IRC18:00
*** rwallner has joined #openstack-kolla18:02
*** lamt has joined #openstack-kolla18:05
*** srwilkers has joined #openstack-kolla18:05
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-ansible stable/ocata: Updated from global requirements  https://review.openstack.org/45287018:10
*** ksumit has joined #openstack-kolla18:15
*** swinn has quit IRC18:18
*** Pavo has quit IRC18:19
*** Pavo has joined #openstack-kolla18:22
*** mbruzek has joined #openstack-kolla18:25
*** mbruzek has quit IRC18:25
*** mbruzek has joined #openstack-kolla18:25
*** lpetrut has quit IRC18:26
*** lamt has quit IRC18:27
*** Pavo has quit IRC18:28
hrwmorning18:30
hrwdoes anyone know why gate-kolla-dsvm-deploy-ubuntu-source-ubuntu-xenial-nv fails over and over again?18:30
kfox1111infra made some changes...18:31
*** swinn_ has joined #openstack-kolla18:31
kfox1111been trying to fix kolla-kubernetes gaets. probably the same issue for kolla/kolla-ansible too.18:32
*** lamt has joined #openstack-kolla18:33
*** jrich523_ has joined #openstack-kolla18:33
rwallnerquestion for the channel. What makes an ansible interface active? when: hostvars[inventory_hostname]['ansible_' + api_interface]['active'] in the prechecks, this is failing for me because the API interface is on a `vxlan-2000` interface but some reason is not "active"?18:35
*** jrich523 has quit IRC18:36
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: debian: move to stretch  https://review.openstack.org/43445318:37
rwallnerscratch that im realizing that ansible translates ['ansible_' + api_interface] to ansible_vxlan-2000 when there is ansible_vxlan_200018:39
rwallner:(18:39
rwallnerlooks like a bug18:39
*** lucasxu has quit IRC18:43
* hrw off18:46
*** jrich523_ is now known as jrich52318:46
*** signed8b_ is now known as signed8bit_Zzz18:56
*** signed8bit_Zzz is now known as signed8b_18:58
*** MasterOfBugs has joined #openstack-kolla18:59
inc0yeah seems like everything moved to python3.418:59
inc0as default18:59
inc0yay18:59
*** jascott1_ has quit IRC18:59
sdakeinc0 it should have been move d to 3.5 by default18:59
sdakei suspect 3.4 was a temporary thing that beame permanent :)18:59
*** swinn_ has quit IRC19:00
sbezverkkfox1111: that infra patch got merged but still epel does not get enabled before bindeps..19:02
kfox1111sbezverk: yeah. :/19:02
kfox1111need to ask infra whats going on.19:02
kfox1111maybe they dont support 34 at all anymore.19:03
kfox1111and we just need to ditch it.19:03
*** manheim has joined #openstack-kolla19:06
*** jascott1_ has joined #openstack-kolla19:09
*** manheim has quit IRC19:11
sbezverkkfox1111: how can we drop 3.4?19:13
kfox1111I think they moved on to python35?19:13
kfox1111not sure.19:13
*** manheim has joined #openstack-kolla19:19
sbezverkkfox11111: it seems the change did not get in19:20
sbezverkso hopefully when it synchronize it will unblock out gates19:21
kfox1111ah. ok.19:22
*** swinn has joined #openstack-kolla19:22
openstackgerritAnthony Lin proposed openstack/kolla-kubernetes master: To Deploy iSCSI Support with Cinder LVM  https://review.openstack.org/45503219:23
*** erhudy has joined #openstack-kolla19:24
openstackgerritAnthony Lin proposed openstack/kolla-kubernetes master: To Deploy iSCSI Support with Cinder LVM  https://review.openstack.org/45503219:26
*** dan__ has joined #openstack-kolla19:26
*** manheim_ has joined #openstack-kolla19:26
*** manheim has quit IRC19:29
*** Mannheim has quit IRC19:29
*** al498u_ has quit IRC19:32
*** al498u_ has joined #openstack-kolla19:33
*** jtriley has quit IRC19:47
*** vhosakot has quit IRC19:50
*** eanylin has joined #openstack-kolla19:51
-openstackstatus- NOTICE: The Gerrit service on http://review.openstack.org is being restarted to address hung remote replication tasks.19:51
sdakekfox1111 we shoudl be on python 3.519:53
kfox1111sdake: thats kind of what I thought. we may need to remove python 34 from somewhere then.19:53
sdakebindep is where its installed from19:53
*** Pavo has joined #openstack-kolla19:54
sdakegah who wrote our bindep file :)19:55
sdakekfox1111 is the blamee :)19:55
*** swinn has quit IRC19:56
kfox1111its been one of those days. sure, why not.19:58
sdakeepel only has ptyhon34 it apperas19:58
sdakekfox1111 how did you come up wtih that bindep.txt file?20:00
kfox1111I wana say, I took the default from infra, and poked in a couple things like jq/crudini at the end.20:01
*** swinn has joined #openstack-kolla20:01
sdakegot it20:01
sdakethanks20:01
openstackgerritSteven Dake proposed openstack/kolla-kubernetes master: Test of bindep change to fix up gates  https://review.openstack.org/45674920:04
sdakethere is a genral community goal of having python35 support in our python code20:06
*** jascott1 has quit IRC20:06
*** jascott1_ has quit IRC20:07
sdakesbezverk this says "merged" https://review.openstack.org/#/c/456710/20:07
sdakethat should just work since epel was disabled this morning20:07
*** jascott1 has joined #openstack-kolla20:07
sbezverksdake: pabelanger mentioned that the chage I pushed hs not been replcated due to some issues with gerrit20:08
sbezverkthey just restarted it, so it should be fixed soon..20:08
sdakesbezverk i see - so you ah eto resubmit?20:08
sdakeok20:08
*** g3ek has quit IRC20:10
*** manheim_ has quit IRC20:11
*** sayantan_ has joined #openstack-kolla20:11
*** rwallner has quit IRC20:16
*** jtriley has joined #openstack-kolla20:17
*** g3ek has joined #openstack-kolla20:19
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-ansible master: Updated from global requirements  https://review.openstack.org/45592920:20
*** swinn has quit IRC20:21
*** fguillot has quit IRC20:22
sbezverkyeeaahh, the change finally kicked in.. gate are working now20:23
*** rwallner has joined #openstack-kolla20:24
*** rwallner_ has joined #openstack-kolla20:26
*** jtriley_ has joined #openstack-kolla20:26
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: WIP: Enable Ceph input plugin in Telegraf  https://review.openstack.org/45560220:27
kfox1111sbezverk: nice.20:27
*** lrensing has quit IRC20:28
sbezverkkfox1111: could you please change compress compute kit to use variable instead of hardcoding 0.6.0-1?20:28
*** lrensing has joined #openstack-kolla20:28
*** rwallner has quit IRC20:29
sbezverkI would do +2 rigth after that..20:29
*** jtriley has quit IRC20:29
kfox1111sbezverk: Like I said, that code's a hack and needs much better cleanup.20:29
kfox1111either we should clean it up proper, or commit the hack.20:29
*** rwallner_ has quit IRC20:29
sbezverkkfox1111: yeah, but hardcoding version is not a hack.. cause when we switch to 0/7/0 we need need to remember changing it too20:30
kfox1111its a hack. its further code that will need to be removed when fixed for real.20:30
kfox1111proper versioning is a whole nother discussion too.20:31
*** zhenguo has quit IRC20:32
kfox1111sbezverk: if you want to grab the ps and run with it, go ahead.20:36
kfox1111fghting other fires right now. :/20:36
sbezverkkfox1111: I do not want to fight. I thought just basic code cleanness would be sufficient atm.. and we can move forward..20:37
*** ediardo has joined #openstack-kolla20:37
kfox1111sbezverk: not a fight. just don't have time to clean up the hack that it is.20:38
kfox1111if you have time/inclenation, go for it.20:38
kfox1111but I do think the proper fix is to get it into the helm_build_* stuff.20:38
kfox1111doing it in build_all is a hack.20:38
sbezverkkfox1111: ok, got it.. since sdake was very interested in compute kit he would be interested to clean things up..20:39
kfox1111ah. thats a good plan too.20:39
sdakeclean w hich up20:39
kfox1111sdake: https://review.openstack.org/#/c/456406/20:40
kfox1111its a proof of concept.20:40
sbezverksdake: the solution kfox1111 proposed needs a bit of polishing20:40
kfox1111it really belongs in tools/helm_build_* as common code shared between them.20:41
kfox1111kind of swamped at the moment though.20:41
sdakewe can sort that out later20:41
sdakei am swamped too20:41
sdakelets just get it merged and working20:41
sdakeit doesn't have to be a mona lisa20:41
sdakei've got 3 months of work to do in the next 4 weeks20:42
sdakei dont have time to gold plate20:42
*** ksumit has quit IRC20:42
sdakerwellum you up for writing some code21:03
*** dan__ has quit IRC21:11
*** jtriley_ has quit IRC21:12
openstackgerritMerged openstack/kolla-kubernetes master: Move ironic config to kolla-k8s  https://review.openstack.org/45070121:16
*** manheim has joined #openstack-kolla21:18
*** swinn has joined #openstack-kolla21:18
*** lpetrut has joined #openstack-kolla21:20
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP: v4 gates.  https://review.openstack.org/45484121:21
*** manheim has quit IRC21:22
*** manheim has joined #openstack-kolla21:22
openstackgerritAnthony Lin proposed openstack/kolla-kubernetes master: To Deploy iSCSI Support with Cinder LVM  https://review.openstack.org/45503221:23
eanylinsbezverk: Good points raised. Have updated based on your comments. Thanks.21:24
sbezverkeanylin: nope, if you can add my comments, would be great. It took me a bit of time to research solution..21:26
*** tvignaud has quit IRC21:26
eanylinsbezverk: Yeah, I have attempted to update based on your comments for the latest patch21:26
eanylinI think the steps for Cinder VG is already mentioned in https://docs.openstack.org/developer/kolla-ansible/cinder-guide.html21:27
sbezverkeanylin: hm, I am not sure if we can assume kolla-kubernetes users will read kolla-ansible doc before attempting kolla-kubernetes installation..21:28
eanylinsbezverk: Agree. That cinder-guide talks about general creation of VG21:29
eanylinwas thinking of using it or we can replicate the content for volume group creation21:29
eanylinI was following that one when I did the deployment21:29
eanylinso only the top part is relevant in this case21:30
sbezverkeanylin:  I think replicating required parts of doc is good and it prevents some users from unpleasant surprises ;)21:31
eanylinsbezverk: Okie, let me update21:31
eanylinsbezverk: That is true too21:32
*** tvignaud has joined #openstack-kolla21:32
sbezverkeanylin: please do not forget two include 2 systemctl commands I mentioned ifyou have not done it already21:32
eanylinsbezverk: I mentioned in that block21:33
eanylinbut yeah, will make sure its there21:33
sbezverkeanylin: sorry I have not checked ;)21:33
eanylinsbezverk: No problem :)21:34
*** lrensing has quit IRC21:34
*** lpetrut has quit IRC21:40
sbezverkeanylin: since we are on this subject, how about adding a small fragment from cloud.yaml with lvm related config?21:41
sbezverkeanylin: here is my config. maybe you could integrate it in the doc if it is not already there: http://paste.openstack.org/show/606488/21:43
*** signed8b_ is now known as signed8bit_Zzz21:43
eanylinsbezverk: Ok21:45
eanylinsbezverk: I believe its the same as the main document21:45
sbezverkeanylin: perfect, then21:46
eanylinsbezverk: There is a difference in identation for the cinder-volumes IP, under lvm_backends21:46
eanylinI can update to reflect that21:47
sbezverkeanylin: I can guarantee that tyhe config I pasted is working ;)21:47
eanylinsbezverk: Agree :)21:47
eanylinsbezverk: Will do the update21:48
*** lamt has quit IRC21:55
*** mbruzek has quit IRC21:55
*** erhudy has quit IRC22:00
openstackgerritAnthony Lin proposed openstack/kolla-kubernetes master: To Deploy iSCSI Support with Cinder LVM  https://review.openstack.org/45503222:06
openstackgerritAnthony Lin proposed openstack/kolla-kubernetes master: To Deploy iSCSI Support with Cinder LVM  https://review.openstack.org/45503222:11
eanylinsbezverk: Updated. Take a look when you have some time? Thanks.22:15
*** esharao has quit IRC22:16
sbezverkeanylin: +222:17
eanylinthanks :)22:17
*** tonanhngo has quit IRC22:20
inc0I'm back guys22:24
inc0so, what's gate status?22:24
sbezverkinc0: gates are working..22:26
*** srwilkers has quit IRC22:26
inc0python thing is fixed?22:26
*** tonanhngo has joined #openstack-kolla22:27
sbezverkinc0: it was not python, it was due to epel being disabled before we could re-enable it the gate script22:27
inc0ok then22:27
inc0but it's fixed right?;)22:27
sbezverkinc0: yep22:28
inc0ok so I'm getting back to config migration22:28
sbezverkinc0: cool, ironic got merged recently..22:29
inc0ceph is up22:29
*** manheim has quit IRC22:29
inc0after that I'll need to see what's left22:29
inc0I think iscsi/tgtd22:29
*** tonanhngo has quit IRC22:31
*** signed8bit_Zzz is now known as signed8b_22:33
sbezverkinc0: these should be simple ones22:33
kfox1111yeah. pretty sure iscsi/tgtd is still missing.22:33
jascott1the deployment guide calls for using `git review` but doesnt say its a dep22:39
jascott1should we change it to vanilla git or add something?22:39
*** ksumit has joined #openstack-kolla22:39
*** klindgren_ has joined #openstack-kolla22:40
*** Pavo has quit IRC22:41
sdakejascott1 i hope to have that fixed today or tomorrow22:42
sdakealthough that may not be feasible22:43
jascott1cool22:43
*** klindgren has quit IRC22:43
jascott1oh22:43
jascott1im converting that guide to playbook22:43
jascott1act now and get multinode for freeeeee22:43
inc0bbiaf, moving home22:44
sbezverksdake: if you rebase placement ps on master I think we can merge it.. currently it is based on your revert ps and we do not need reverting any longer..22:48
sdakesbezverk agreed22:49
sdakesbezverk although it doesn'twork now for compute becausei took out the placement api renames in the manifests22:49
sdakesbezverk to even test it on master, this needs to merge: https://review.openstack.org/#/c/456406/22:51
sdakesbezverk so - need the revert in the chian for the moment unitl that merges22:51
kfox1111should we just merge compress compute kit as is then?22:51
sdakewfm - its hacky but can be refactored easily22:52
kfox1111I'd rather not, but if no one has time to fix it then, at least it fixes the gate. so better then the gate being broken.22:52
sbezverkkfox1111: ok, let's do it then :(22:52
sbezverkI like even less possibility of even tem reverting..22:53
kfox1111yeah. me too.22:53
sdakejascott1 if your converting that guide that git review operation won't really work for you as it requires gerrit credentials22:55
jascott1right22:55
sdakejascott1 i'd recommend using a cherrypick - you might just single out the change from the gate changes22:55
sdakeand submit it to gerrit for the moment just to help people get moving22:55
sdakeuntil I get the gate fixedi n that patch22:55
sdakeit is very complex to fix the gate as lots of sudos are required22:56
*** swinn has quit IRC22:56
jascott1sdake ok thanks22:56
sbezverksdake: which gate you are fixing? just curious..22:57
sdakesbezverk all of them22:57
sdakeremoving ln -s22:57
openstackgerritSteven Dake proposed openstack/kolla-kubernetes master: Placement support in nova service chart  https://review.openstack.org/45384622:57
sbezverksdake: Ahh that fix :)22:58
sdakesbezverk : this one: https://review.openstack.org/#/c/439740/22:58
kfox1111sdake: I recommend just doing the simple symlink for now.22:58
kfox1111its way way easier then all the sudo junk.22:58
openstackgerritMerged openstack/kolla-kubernetes master: Compress compute kit  https://review.openstack.org/45640622:58
*** swinn has joined #openstack-kolla22:59
sbezverksdake: I still fail to see why it is so important to change how it is done at the gate..22:59
sdakeok - here is why it is important22:59
sdakeatm the guide recommends a cherrypick22:59
sdakethe cherrypick is klunky and unprofesisonal22:59
sdakethe only way to fix it is to get rid of the symlink22:59
kfox1111agreed. but your cherrypicking to avoid a symlink.22:59
kfox1111the symlink doesn't matter that much.22:59
kfox1111its a temporary thing.22:59
sbezverksdake: guide and the gate serve different purposes22:59
*** signed8b_ is now known as signed8bit_Zzz23:00
sdakei agree, however, i need a patch in gerrit to actually make the guide work23:00
sdakeas the code in master is incorrect23:00
kfox1111just put the syhmlink in the dev guide and we can move on to working on elminiating the need of kolla-ansible entirely.23:00
kfox1111then the symlink disapaears.23:00
sbezverksdake: who cares if it works, it looks more like the change for the change23:00
sbezverksince you are so busy, why waste cycles on this ??23:00
*** MasterOfBugs has quit IRC23:00
sdakeok i'm listenign to alternate approaches23:01
sbezverkwe do not gain anything at the gate23:01
sdakethe root issue is kolla res create configmap depends on a file in /usr/share/kolla23:01
sdakethere is no /usr/share/kolla23:01
sbezverksdake: so do not use in the deployment gate, why touch the gate?!?23:01
sdakewhen the repos split the code was never changed23:01
sbezverkdeployment guide I meant23:02
kfox1111yeah. just symlink it in like the gate does.23:02
kfox1111we can get rid of it entirely very soon.23:02
kfox1111inc's been working hard on making that a thing.23:02
kfox1111its less then a week out.23:02
sdakei understand inc0 is working on it23:02
sdakeother things need to be odne to make it happen23:02
sdakegenpwd23:02
sdakeinit-runonce23:02
sdakeand probably some othe rwork23:03
sdakei could work on that23:03
sdakeand we coudl leave the guide as it is23:03
kfox1111genpwd true. we need to pull that in too.23:03
kfox1111init-runonce, I don't think so?23:03
sdakeya that is a simple bootstrap23:03
kolla-slack<inc0> It's simple shell23:03
kfox1111if anything init-roneonce should be a container.23:03
sdakemaybe23:03
kolla-slack<inc0> Post deploy23:03
sdakewe have a working implementation we can just copy from kolla-ansible23:04
sdakeinc0 post deploy only creates creds it doesn tbootstrap a cloud23:04
kolla-slack<inc0> I know what it does, we need it23:04
kfox1111ok.23:04
kfox1111think it would be hard to put in a helm job?23:05
sdakeinit-runonce?23:05
kfox1111eyah.23:05
sbezverksdake: why placement charts changes are back?23:05
kfox1111yeah.23:05
sdakenot sure sbezverk - perhaps i rebased off the wrong tree23:05
sdake5% ower23:05
sdaketrying to eat dinner in the hotel restuarant23:06
sdakei'll be back to power in about an hour23:06
sdakei am entirely not clear on how to convert init-runonce to a helm chart23:06
sdakeit could be done23:06
sdakenot sure how long23:06
kfox1111where's the code?23:06
sdakehttps://review.openstack.org/#/c/452367/23:07
kfox1111tools/init-runonce looks like...23:07
kfox1111yeah... it needs work....23:07
kfox1111a lot of hardcoded stuff in it.23:08
sdakeyup its an eval tool not an end user tool23:08
sdakewe have got a ton of milage with it23:08
sdakein kolla-ansible23:08
kfox1111so, thing A, it could just be copied verbatim into kolla-kubernetes it looks like.23:08
sdakesbezverk had wanted it integrated in the gate23:09
sdakealthough i dont know if that is wise as it is super hardcoded and really only meant as a reference - not an implementation that someone would se23:09
sdakeuse23:09
kfox1111thing two, with a bit of tweaks, couidl be made a helm chart I think that was much more generic.23:09
sdakehaving peopel figure all that bootstrapping crap out is a pita - hence the evolution of that script23:09
kfox1111if all the values in the begining of the script came from values.yaml.23:10
kfox1111anyway. that lone looks trivaial to pul apart for now.23:10
kfox1111genpasswd's the only other one maybe.23:11
sbezverksdake: why do you want init-runonce to the gate? what is the goal?23:11
kfox1111not sure how hard that wone will be. but shoudln't be too hard?23:11
kfox1111sbezverk: probably good to test what we're shipping.23:11
kfox1111sbezverk: we do almost the same things in gate already. if we could combine/share that code, and make it useful outside the gate too, I'm for it.23:12
sbezverkkfox1111: basic tests is not enough??? I think that script does way more than init run once..23:12
kfox1111 sbezverk all its doing really is setting up the public network, some flavors, and loading the cirrus test image.23:12
kfox1111we do a lesser version of that.23:12
kfox1111oh and some quota's.23:12
kfox1111it would add less then a second to the gate time I think.23:13
kfox1111and then we could gate test what we're asking users to run.23:13
sdakei dont mind if its gated sbezverk23:13
sdakesbezverk i mind the time it takes for a contrib to figure out how to sort out the gating and replacement of the gate with that script23:13
sbezverkkfox1111: when I looked at init-runonce, it looked to me a lesser of basic_tests script, where we bring up 2 VMs, create/attach detach volumes23:14
sdakesbezverk i can tell you it would tkae me atleast a week of focused time23:14
sbezverkand test connectivity between VMs23:14
kfox1111sbezverk: oh. true. it looks to do that doesnt it...23:14
kfox1111well, we leave that part out, or make it conditional?23:14
sdakepeople want to test manually their clouds (based upon experience) but want to bootstrap automatically23:14
kfox1111do everything else?23:14
sdakeinit-runonce is all about evaluation23:15
sdakenot actual prodcution23:15
sdakeand not really about gating23:16
sdakeit speeds up eval time dramatically in kolla-ansible23:16
sdakealot of people have no idea how to setup a netowrk in openstack via neutron23:16
kfox1111sdake: I think the issue  is, it does two things.23:16
sdakeor to set quotas23:16
sdakeetc23:16
kfox1111it provisions an external network,23:16
kfox1111and does a bit of testing.23:16
sdakeinit-runonce does no testing23:16
*** ksumit has quit IRC23:16
kfox1111the former is needed by basically everyone, and the gate.23:16
sbezverkI must be from a different planet, I do not get why inir-runonce can trigger any changes at the gate :)23:17
kfox1111the latter part, the basic_tests.sh in the gate is far more complete.23:17
kfox1111launching a single vm isn't very useful to test the cloud is sane.23:17
sdakenobody really wants to run basic tests, they want to do that manually23:17
sdakekfox1111 i agree completely23:17
kfox1111launching a couple, network testing, and passing a volume between them covers almost all the major bugs usually hit in deployment.23:17
sdakekfox1111 its a starting point23:17
kfox1111for that part, we probably should just split out basic_tests abit and make it easily used outside the gate.23:18
sdakeits useful to go with patterns that work :)23:18
sdake1% power and switching over to slack23:18
kfox1111that way, the more useful tests can be used by everyone.23:18
kfox1111anyway. still think we're just a few days or less from elminiating kolla-ansible's dep?23:19
kfox1111so we either do a symlink for now, or just wait till that happens.23:19
kfox1111the bajillion sudo's is a very expensive stopgap that isn't needed imo.23:20
kolla-slack<sdake> Or use got fetch23:20
kolla-slack<sdake> The sudo is how a proper deploy would happen23:21
sbezverkkfox1111: screwing up with the gate for the sake of deployment guide, does not make sense :)23:21
kolla-slack<sdake> Anyway jumping around topics23:21
kfox1111sdake: a sudo shouldn't ever be needed.23:21
*** ksumit has joined #openstack-kolla23:21
kfox1111should only need sudo for k8s deployment.23:21
kfox1111everything else should be non privileged.23:22
kfox1111config's less then ideal currently, but very limited, to stuff like setting up a symlink.23:22
kfox1111far les ugly then running a tun of code as root.23:22
kolla-slack<sdake> Read the deploy guide then repeat that statement23:22
kfox1111sdake: https://review.openstack.org/#/c/439740/39/tests/bin/setup_config.sh23:23
kfox1111it should not take sudo to build a few text files.23:23
kfox1111and using a tool thats been known to change kernel perams if not configured just right.23:24
kolla-slack<sdake> I didn't say that patch was done23:24
kfox1111I'm saying, its the wrong aproach. should never have to sudo to generate configs imo.23:25
kolla-slack<sdake> Symlinkd are so terrible a deploy solution I struggle to understand why it's debated23:25
kfox1111its less terible, then running kolla-ansible genconfig as root. seriously, its terrifying.23:25
kfox1111I saw it making all sorts of root changes on my system before figuring out why.23:25
kfox1111you have to know to set: set_sysctl: "no"23:26
sbezverksdake: because you express your personal opinion wihtout 1: providing technical reasons behind 2: why gate needs this change?23:26
kolla-slack<sdake> Pick on someone else I have had enough of both of you todY23:27
kfox1111I agree the config stuff is less then ideal. until we fix it. I'm just of the opinion of root genconfig with no symlink is far worse then symlink and no root genconfig.23:28
sbezverkI can understand when you talk about deployment guide, kind of passing wisdom to masses, but the gate is wroking, and its presence does not impact anything..23:28
sbezverkI mean presence of sym link23:28
kfox1111sbezverk: I'm with sdake on we should share as much as possible between the two, and not ask the users to patch in uncommitted code.23:28
kfox1111I just think lots of sudo's are not healthy to either use case.23:29
kfox1111but I think we're at an impass here. not much value in continuing the conversation.23:29
kfox1111it will resolve it self in a few days and wont be a problem.23:29
kfox1111lets just punt for now.23:29
sbezverk:) better is enemy of good23:31
*** jtriley has joined #openstack-kolla23:31
kfox1111true.23:31
kfox1111sdake: inc0 how hard will copying genpasswd to kolla-kubernetes be. do you know?23:32
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/45593023:35
*** lrensing has joined #openstack-kolla23:36
SamYaplekfox1111: does k8s have a single "here be passwords" file?23:41
*** rwellum has quit IRC23:41
SamYaplethe genpasswd thing was mainly built for yaml and variable name parsing23:41
kfox1111SamYaple: yeah. same as kollla-ansible at the moment.23:41
SamYapleshould be easy then23:42
SamYaplejust point at file23:42
kfox1111k.23:42
kfox1111thanks.23:42
SamYapleif you have changed the variable names you might have a harder time23:42
SamYapleit detects uuid vs password vs (something else maybe?)23:43
SamYapleits been a while since i poked the code23:43
kfox1111yeah, we didn't change anything.23:44
*** goldyfruit has quit IRC23:44
kfox1111just pulling it over verbatium for now to make it require one less dep.23:44
SamYapleshould be that simple then23:44
kfox1111then will start converting it to helm.23:44
SamYaple+223:44

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!