Wednesday, 2017-01-18

kfox1111lets see if this fixes it...00:00
*** liyifeng has joined #openstack-kolla00:01
kfox1111if gerrit will work....00:02
sdakekfox1111 https://review.openstack.org/#/c/414805/00:06
*** harlowja has joined #openstack-kolla00:06
kfox1111sdake: what does this relate to?00:08
sdakelibvirt issue?00:08
sdakejust a thought00:08
kfox1111hmm....00:08
kfox1111let me think...00:08
kfox1111ceph itself doesn't access the file systems. so I think its unrelated.00:09
sdakei can build you a test 3.0.200:09
kfox1111couldn't hurt. :)00:09
sdakeof all the images for centos and call it 3.0.2-test00:09
kfox11113.0.1 works, 3.0.2 doesn't.00:09
kfox1111I"m guessing its the 2.3 vs 2.6 qemu change.00:09
sdakei thought 3.0.2 works with 2.0.2 of libvirt?00:09
kfox1111yes.00:09
kfox1111and 3.0.2 works with 3.0.1 libvirt too it seems.00:09
kfox11113.0.1 and 2.0.2 both use a 2.3 kvm.00:10
kfox11113.0.2 libvirt uses a 2.6 one.00:10
kfox1111so pretty sure its something related  to that.00:10
*** sayantani01 has joined #openstack-kolla00:11
sdakekfox1111 i've got a workaround for you to try if your up to it00:12
kfox1111whats the workaround?00:12
sdakekfox1111 https://github.com/openstack/kolla-ansible/blob/master/tools/deploy_aio.sh#L8800:13
sdakethat wont work straight up in kolla-kubernetes of course00:14
sdakebut the basic idea is to add cpu_mode=none to the default config00:14
kfox1111ah...00:14
kfox1111I ddidn't look at libvirt versions... let me look at those.00:14
sdakeif genconfig is run in the gate, that may actually work as is00:14
kfox1111genconfig from trunk is run.00:15
sdakewith the full config file there00:15
kfox1111so probably just need to slip that in after?00:15
sdakeya - we didn't add cpu_mode=none to the defualt config of kolla-ansible00:15
sdakeyup try slipping in after00:15
sdakewe did add it to the gate however00:15
sdakedmsimard turned us on to that problem - thanks dmsimard :)00:15
kfox1111heh. I'm already editing it for virt_type qemu....00:16
sdakeslip that file in before genconfig is run00:16
sdakeis virt_type=qemu not in the gating already?00:16
kfox1111will need to be after.00:16
kfox1111it is now.00:16
sdakegenconfig parses that config file00:16
sdakeand generates the defaults - so it needs to be prior to genconfig00:16
kfox1111I don't think so.00:17
sdakemaking assumptions about what genconfig does here00:17
sdake(I am that is)00:17
kfox1111last I looked, genconfig merged configs when pushing them to nodes.00:17
kfox1111that doesn't happen with kolla-kubernetes.00:17
*** unicell has quit IRC00:17
sdakeok - well something to work with :)00:17
sdakegive it a go - it made kolla-ansible's gate work properly00:17
kfox1111crudini --set /etc/kolla/nova-compute/nova.conf cpu_monde none00:18
kfox1111shoudl do the trick though.00:18
kfox1111and... wrong branch....00:18
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test rebooting in the gate  https://review.openstack.org/41319300:19
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Support 3.0.2 in the gate  https://review.openstack.org/42000900:19
kfox1111doh. but forgot to remove 3.0.1....00:19
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Support 3.0.2 in the gate  https://review.openstack.org/42000900:20
kfox1111there we go.00:20
sbezverkkfox111: have you seen the repy for "shared" issue?00:20
*** liyifeng has quit IRC00:21
kfox1111sbezverk: nope. I'm not going to hold my breath that it will be in 1.6.00:21
sbezverkkfox111: something tells me they will never fix it00:21
kfox1111sbezverk: I'm sure they will eventually. but on their time table.00:21
kfox1111thats always the problem with upstreams, and one of the reasons distro's exist.00:21
kfox1111to suit the users's time tables.00:21
kfox1111sdake: confirmed that 3.0.1 is using libvirt 1.x and 3.0.2 is using libvirt 2.x.00:23
kfox1111thats really lame. :/00:23
kfox1111all the more reason to test in gate and release tested containers. :/00:24
sbezverkkfox1111: yeam major version jump in minor, does not sounds good ;)00:24
sdakesbezverk nothing we can really do to ocontrol our dependnecies that come from upstream binaries00:25
kfox1111test and release known working good containers is the best we can do.00:25
sdakei do know we had a problem wit hthe 3.0.2 versoin of mitaka and i'm pretty sure it is that cpu_mode  issue00:25
kfox11112.0.2 you mean?00:25
sdakeand cpu_mode depends on how the virt is being used00:25
kfox1111or newton?00:25
sdakeno, i mean the 3.0.2 version of kolla-ansible00:25
kfox1111ah. ok.00:26
kfox1111well, gate check's runnin. :)00:26
sdakecool00:26
sdakethat was fast ;)00:26
kfox1111the suggestion on how to fix it was the hard part. poking it into a shell script's easy. :)00:26
sdakeportdirect you ought to appreciate this: https://dev.to/appcanary/should-you-encrypt-or-compress-first00:30
sdakesorry above 3.0.2 = newton00:33
sdake2.0.2 = newton00:33
sdake1.1 = liberty00:33
sdakether 2.0.2 = mitaka00:33
sdakerather00:33
sdakeboy - time to retire :)00:33
sbezverksdake: if you accumulated enought gold coins, why not ;)00:34
*** adrian_otto has joined #openstack-kolla00:35
*** jtriley has joined #openstack-kolla00:36
*** schwicht has quit IRC00:37
sdakesbezverk i sold my gold after the election00:37
kfox1111yeah. interesting times ahead.00:38
portdirecthttps://www.irccloud.com/pastebin/EROoo1k5/00:38
portdirectsdake: how apt, reading now :)00:38
*** lamt has joined #openstack-kolla00:39
sbezverksdake: do you think Trump will forbid gold?00:39
sdakesbezverk unlikely00:39
sdakesbezverk too much gold swaps in place00:39
portdirectsbezverk: nah, he'll just need it all for the new bathroom hes getting00:39
sdakesbezverk it would seriously damange th egolbal economy00:39
sdakesbezverk that was done ocne in us histroy00:40
sdakethe govt took all the gold for 20$/oz00:40
sdakethen overnight raised the price of gold to 35$/oz or so00:40
sdakeimmediately we had enough money to pull us out of the great depression00:40
bmacepordirect: did you get my message about the container dev setup work you had done?00:41
sbezverkportdirect: there was a president in Ukraine, when he ran away, people found toilet seats from solid gold in his palace ;)00:41
bmaceerr.. sorry ^portdirect00:41
portdirectbmace: checking now00:41
bmacetks00:42
portdirectbmace: its on my increasingly long list of things to do at somepoint when i get time...00:42
kfox1111sdake: no, its something different.00:43
portdirectbmace: i could have aquick pass at it tomorrow to get it a bit closer00:43
kfox1111http://logs.openstack.org/09/420009/13/check/gate-kolla-kubernetes-deploy-centos-binary-2-ceph-nv/c1fa6d4/console.html00:43
sdakekfox1111 are you certain the config setting took effect00:43
portdirectbut if you are doing somthing thats fanstastic!00:43
sdakekfox1111 http://logs.openstack.org/09/420009/13/check/gate-kolla-kubernetes-deploy-centos-binary-2-ceph-nv/c1fa6d4/console.html#_2017-01-18_00_24_20_20344900:43
portdirectbmace: is what you have in better shape than my old work?00:43
kfox1111sdake: pretty sure. and pretty sure a cpu emulationn mode would not affect network connectivity either way?00:44
*** unicell has joined #openstack-kolla00:44
sdakekfox1111 that is where the genconfig does its thing00:44
*** mattmceuen has joined #openstack-kolla00:44
bmaceportdirect: kk.  i got the review as it existed working fairly well but a lot changed in the last 5 weeks and when i pull it into the current code base it didn't hold up terribly well.  there was also some duplication in there that i can imagine will be sort of painful to keep up to date.00:44
sdakekfox1111 if you are doing the setting after that, i think it wont work00:44
portdirectbmace: yeah -its really rough00:44
kfox1111sdake: oh... its missing libvirt in it...00:44
*** duonghq has joined #openstack-kolla00:44
portdirectbmace: if you were to take it over id be really happy and could help out with it00:45
bmaceportdirect: i don't mind continuing my work and perhaps if you get a new version up we can get a merger of concepts for something great :)00:45
sdakekfox1111 which is?00:45
sdake[libvirt] you mean?00:45
sdakemy wife is taking me on a date00:45
portdirectbmace: sounds like a plan :D00:45
sdakeits a once a year thing00:45
sdakeso I'll be out :)00:45
sdakesup bmace00:45
portdirectbmace: whats the primary difference between the two approaches we took? you are prebuilding?00:45
bmacepordirect: sure, i'll continue my work and push up a review when it works in a way i'm happy.  i think it will take a little change to some of the existing scripts to let them take some more args / be a bit more flexible in regards to running in gate or some other dev environment, etc.00:45
portdirectbmace: if push sooner rather than later for dev env work (although only if your comfortable), you've seen the horrors I've put in gerrit ;)00:46
bmaceportdirect: yeah, i try to do most of the work during build rather than runtime, at least as far as package dependencies, and I copy in existing kolla-kubernetes / kolla-ansible repos so that devs can make changes to either and test them rather than the kolla-ansible checkout.00:46
sdakejascott1 mind sharing your email address00:47
sdakejascott1 privately if you like00:47
duonghqmorning guys00:47
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Support 3.0.2 in the gate  https://review.openstack.org/42000900:47
duonghqsdake, congratulation for the board of director result00:47
kfox1111sdake: yeah. requires a section name.00:47
sdakedougs1 thanks dude - although its more like a service :)00:47
sdakesteak-AAS00:47
bmaceportdirect: i also found it a little odd to do the rename of kolla-ansible to kolla, especially when there is a kolla repo that is something completely different right now, so i have kolla-ansible and kolla-kubernetes both live directly in /opt00:47
kfox1111I missed adding the section.00:47
sdakeand good morning to ya00:47
portdirectbmace: yeah - that work i did was done during the repo split so had some hacks to work round that as it occured00:48
jascott1sdake I pm'd you my emailz00:48
sbezverksdake: oh, why you did not tell!! Congrats!! Hopefully you will be able to stir this OPenStack ship to the right direcion..00:49
bmaceportdirect: understood.  also, maybe i'm a little ocd.. but have folks talked about a standard between _ and - as far as file names in the kolla-k8s repo?  it is driving me crazy that it is so inconsistent :)00:49
sdakejsagot it00:49
sdakesbezverk i think its mostly headed in the right direction as is00:49
kfox1111sdake: did you get the position?00:49
sdakesbezverk needs a little facilitation between communities00:49
sdakekfox1111 was elected to serve on teh board yes00:49
kfox1111congrats. :)00:49
sdaketo my surprise ;)00:49
bmaceportdirect: i'm fine chasing down all the inconsistencies and fixing them if we can choose one or the other00:49
sdake6 times i ran for the tc, never elected to serve00:50
portdirectbmace: that would be great00:50
sdakefirst time run for bod, elected00:50
sdakemindblowing :)00:50
kfox1111I was pleased to see the voting let you say how strongly you wanted someone on the board. :)00:50
portdirectbmace: the right people are in the room right now to discuss this00:50
bmacekk, so, everyone, file names in kolla-k8s.. underscore or dash?  choose! :)00:51
portdirectkfox1111/sbezverk/sdake/jascott1/duonghq ^^00:51
sdakedash00:51
kfox1111I choose the most common way its used currently. :)00:51
portdirectjascott1: the round b funding for your new foosball tables relies on this....00:51
kfox1111which I think is -'s for helm package names, and _'s for filenames?00:52
sdakeportdirect jascott1 has already been through a round b at intel :)00:52
bmacecurrently it looks to me that underscore is in the lead for script names in the codebase.. just from looking around.00:52
kfox1111yeah. I think script names also are mostly _00:52
jascott1portdirect you funny00:52
sdakebmace right - _ = private thing00:52
sbezverkyep +1 for '_' for file names and '-' helm charts00:53
sdake;)00:53
sdakeit mad esense when I was typing it :)00:53
bmacekk, fantastic.00:53
jascott1i thought pep8 or whichever was _ in filenames00:53
kfox1111it will be weird too the other way, as '_' as the first char has meaning to helm.00:53
kfox1111so otherwise, you would hav to have namaes like '_foo-bar'00:53
sbezverkkfox1111: antoher thing kube does not like '_'00:54
kfox1111in package names?00:54
sbezverkso it is fine for file names, but not for object names00:54
*** jtriley has quit IRC00:54
kfox1111ah.00:54
* portdirect goes to charts repo00:54
bmacekk, i'll make a first pass at sanity in naming tomorrow.00:54
kfox1111don't know if I've ever tried it.00:54
kfox1111cool. thanks. :)00:55
portdirectactually..00:55
portdirectI think looking at charts00:55
portdirecton k8s github00:55
bmacemy pleasure.  every day it is like looking at a picture that is off by like 20 degrees... kills me00:55
portdirectthe standard seems to be -00:55
portdirectwith _ resuerved for helm exculsion00:55
*** zhurong has joined #openstack-kolla00:56
bmacethat is in the helm examples?00:56
sdakefor filenames?00:56
*** zhurong has quit IRC00:56
portdirectbut https://github.com/kubernetes/charts00:56
sdakei think we should try to be as complaint as possible00:56
portdirectdidnt mean to have the but in ther :)00:56
sdakewith with upstream / downstream does :)00:56
kfox1111we have a lot of files that start with _ though.00:56
*** zhurong has joined #openstack-kolla00:56
kfox1111how common are those in charts?00:56
portdirectyes00:56
portdirectquite00:56
sdakefiles that start with _ make sense to me as a private00:56
portdirectthats used by helm to indicate that they should not be directly renderd, but contain helpers00:57
kfox1111I think we are leaning twoards not entering kubernetes/charts at all with our main packages. as that place can't really handle multiple major versions.00:57
portdirectso as sdake says to indicate that they are private essentially00:57
kfox1111we'd have major package repo packages in kubernetes/charts though.00:57
sdakekfox1111 not thinking of entering kubernetes/charts for the time being - still think it would make sense to match what the chart repo is doing  where poissble00:58
sdakewhen its not possible need to identify where the gaps are to get us there at some point00:58
kfox1111yeah.00:58
sdakelike the prebuild step for example00:58
sdakeif we could somehow bake that into helm, that would make our charts alot more helm native00:59
kfox1111portdirect: are ther e any examples of multi word filenames that are private in kubernetes/charts ?00:59
sdakeok - having a bad hair day - need to fix it and then dinnertime00:59
sdakebbl00:59
sbezverktechnically using '_' in the name does not pose any issues00:59
bmaceyeah, saw now uses of underscore other than prefix in any of the templates, all dashes00:59
bmacenow = no00:59
kfox1111do you see any examples of multiword though?00:59
portdirecthttps://github.com/kubernetes/charts/tree/master/stable/minecraft/templates00:59
kfox1111in a privat efile?01:00
kfox1111maybe no one has ever hit that case01:00
portdirectI've not seen anything other than _helpers.tpl no01:00
kfox1111yeah. so we are in uncharted waters.01:00
kfox1111no precident...01:01
kfox1111someone should probably ask the helm folks for advice.01:01
portdirectbut I'm tempted to say we reserve _ as a special charicter01:01
bmacewell, if we are going for dash as a multi-name separator i think it should be consistent.. unless we just keep all underscores only in files that start with an underscore... which feels odd01:01
portdirectbmace: I agree01:01
sdakeguess we are goingat 6:3001:02
* kfox1111 yells "lets get ready to play.... extreme bike shedding.... go!" :)01:02
bmaceeasy enough just to use underscore for that one prefix.. as long as there are no issues with it that will be my plan.01:02
*** chopmann has quit IRC01:02
sdakekfox1111 lol01:02
sdake|o|01:02
kfox1111:)01:02
portdirectbmace: works for me01:02
kfox1111lets ask helm what they think.01:03
kfox1111otherwise, we're just coming up with it ourselves.01:03
portdirectkfox1111: you want to?01:03
kfox1111please.01:03
sdakeya we have a workgroup with them tomorrow01:04
sdakemeeting01:04
bmacekk, will hold off for now01:04
sdakebmace if your interested in attending - its biweekly right after the kolla team meeting01:05
*** adrian_otto has quit IRC01:05
*** MasterOfBugs has quit IRC01:05
bmaceok. do you have it in the same room or somewhere else?01:05
*** tovin07 has joined #openstack-kolla01:05
sdakeits on zoom.us01:05
*** MasterOfBugs has joined #openstack-kolla01:05
*** PramodJ has joined #openstack-kolla01:05
sdakei'll forward you the invite01:05
sdakeyou can attend ornot if you want :)01:06
*** liyifeng has joined #openstack-kolla01:06
bmaceok, thanks much01:06
sdakebmace yo uwould htink i'd have your oracle email by now01:06
bmacewill try.  i have a 10am tomorrow so not sure what the time ends up being but it isn't a regular meeting.  wednesdays are usually great01:06
sdakeunfortunately i dont :(01:06
sdakebmace can you pm to me plz01:06
bmacesdake: borne.mace@oracle.com  and thanks01:06
sdakecool got it01:06
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test rebooting in the gate  https://review.openstack.org/41319301:07
bmaceoh no, all the spam i'll get from the bots that scour openstack irc logs for email address ;)  actually.. will be interesting to see if there are any01:07
kfox1111one missing /... 45 min delay.. :/01:08
*** pramodrj07 has quit IRC01:09
sdakeok - anyone else want an invite that doesn't have one on their calendar already?01:09
sdakeif so, email stdake@cisco.com01:09
sdakeand i'll forward the meeting invite to you01:09
sdakeanyone is welcome01:09
bmacesdake: got it, thanks much01:10
kfox1111sdake: I think you proved me wrong. :)01:11
kfox1111http://logs.openstack.org/09/420009/14/check/gate-kolla-kubernetes-deploy-centos-binary-2-ceph-nv/e365e52/console.html#_2017-01-18_00_51_53_51039101:11
kfox1111ran to completion.01:11
kfox1111very very strange a cpu mode would cause the vm to not be pingable.01:11
sdakebingo winner :)01:12
sdakekfox1111 its a known bug in libvirt01:12
sdakedmsimard actually figured it out01:13
sdakeor one of his clan01:13
kfox1111so, now just gotta fix it back to only affect the -3 version and we're good to go. :)01:13
*** zhubingbing has joined #openstack-kolla01:13
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Support 3.0.2 in the gate  https://review.openstack.org/42000901:14
kfox1111this will probably make the trunk build workable too.01:15
kfox1111inc0: alive?01:15
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes: Updated from global requirements  https://review.openstack.org/41934301:16
inc0alive01:18
inc0whats up?01:18
sdakeok peeps - dinner time01:19
sdakenice work on solving that one kfox1111 !01:19
*** tovin07 has quit IRC01:19
kfox1111inc0: can you rebase your trunk ps on top of https://review.openstack.org/420009 ?01:21
*** sdake has quit IRC01:21
inc0yeah01:21
kfox1111I think it hsould have the fix now needed to make it work.01:21
*** lamt has quit IRC01:22
*** salv-orlando has joined #openstack-kolla01:22
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-kubernetes: Support 3.0.2 in the gate  https://review.openstack.org/42000901:22
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-kubernetes: WIP - local registry in gates  https://review.openstack.org/41855001:22
inc0ehh01:22
inc0well01:23
inc0that didn't go as planned01:23
kfox1111weird...01:23
kfox1111:)01:23
inc0but I guess I'll have more commits01:23
kfox1111did it just rebase on trunk?01:24
inc0ah, that's why01:24
inc0yeah, muscle memory took over and I did a rebase01:24
kfox1111ah.01:24
kfox1111ok. no worries.01:25
kfox1111just trying to figure out what was different, if anything.01:25
inc0yeah, sorry for that01:25
kfox1111its all good. :)01:25
*** tonanhngo has quit IRC01:25
kfox1111I'd be lost without muscle memory. :)01:25
*** dave-mccowan has quit IRC01:26
kfox1111still needs the review bits applied too.01:26
*** salv-orlando has quit IRC01:27
inc0yeah, I'll address your comments tomorrow01:27
kfox1111ok. cool. thanks.01:27
*** athomas has quit IRC01:27
*** pbourke has quit IRC01:27
*** cliles has quit IRC01:27
*** bachp has quit IRC01:27
*** williamcaban has quit IRC01:27
*** stevemar has quit IRC01:27
*** athomas has joined #openstack-kolla01:29
*** pbourke has joined #openstack-kolla01:29
*** cliles has joined #openstack-kolla01:29
*** bachp has joined #openstack-kolla01:29
*** williamcaban has joined #openstack-kolla01:29
*** stevemar has joined #openstack-kolla01:29
*** tonanhngo has joined #openstack-kolla01:33
kfox1111inc0: did you have to do anything to get access to upload to tarballs.o.o?01:34
*** mattmceuen has quit IRC01:34
kfox1111or can you just upload stuff at the end of the jobs?01:34
kfox1111it would be cool to be able to upload the helm packages created during the gate jobs.01:34
inc0only automated updates01:34
inc0other than that, we need to ask infra01:34
inc0well we can do that01:34
inc0after merge01:35
kfox1111how does that work?01:35
*** sacharya has quit IRC01:35
*** hfu has joined #openstack-kolla01:35
inc0https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/kolla.yaml#L5301:36
*** tonanhngo has quit IRC01:37
kfox1111inc0: hmm... so you just add a scp publisher and your good to go?01:38
kfox1111do the publishers happen on merge?01:38
kfox1111where do the source come from?01:38
kfox1111is there any restrictions on the target other then it should start with tarballs/kolla-kubernetes?01:39
inc0not sure01:40
inc0you'd need to ask infra01:40
kfox1111to all the questions?01:40
inc01. yes01:41
inc0other, no idea01:41
inc0what I know is01:41
kfox1111k. thanks. :)01:41
inc0this config looks into dir and copies whatever.tar.gz01:42
inc0to tarballs.o.o01:42
openstackgerritjimmygc proposed openstack/kolla: Use install-pip macro in most source images  https://review.openstack.org/41386101:42
kfox1111yeah. but images come from check jobs?01:42
kfox1111or gate jobs? or something?01:42
inc0I assume gates01:43
inc0on merge it will run checks one more time01:43
inc0and this is registry we upload01:43
kfox1111hmm... I think there are seperate gate jobs rather then rerunning the check jobs.01:43
kfox1111its kind of a shame you can't have an initial build job,01:44
kfox1111then do a bunch of validates on it,01:44
kfox1111and then do an action on it during merge.01:44
kfox1111so the artifacts are identicle the whole run through.01:44
*** diablo_rojo has joined #openstack-kolla01:47
sbezverkkfox1111: I am thinking about reconfiguration when configmap content changes..01:48
kfox1111never seen a job-group before.. maybe thats part of it.01:48
kfox1111sbezverk: yeah. whatcha thinkin?01:48
*** diablo_rojo has quit IRC01:48
sbezverkkfox1111: if the process gets started with microservices, then it look like I have the only choice to helm delete and then helm install01:49
sbezverkso it would read new config info from updated configmap01:49
portdirectcan you HUP an openstack python process?01:49
kfox1111I was kind of thinking, maybe we go through and make all configmap names params?01:49
kfox1111then we could kick off an update by uploadin a new named configmap, and then helm upgrade the package with --set configmap=foo-201:50
sbezverkyeah, that is what I do in TPR01:50
kfox1111portdirect: sure. but it doesnt' do anything useful. :/01:50
kfox1111then all deployments are fully atomic.01:50
sbezverkkfox1111: not sure if it works as the version is not changed01:51
kfox1111they only change on a deployment upgrade/rollback.01:51
kfox1111if the configmap changes, it will count as a change.01:51
kfox1111sorry. if the configmap name changes I mean.01:51
kfox1111the bonus of that aproach is its atommic and reuses most of the k8s plumbing.01:52
kfox1111the drawback is, you have to helm install the new configmap, helm upgrade the deployment, and then helm delete the old configmap.01:52
kfox1111you could just upgrade the configmap, and we make it such that we can apply a dummy change to the deployment,01:53
kfox1111and upgrade would then work.01:54
sbezverkkfox1111: have you tried to helm upgrade chart with the same version ?01:54
kfox1111would be less effort, but rollback wouldn't work at all.01:54
openstackgerritcaoyuan proposed openstack/kolla-ansible: Fix the condition for Solum haproxy  https://review.openstack.org/42161701:54
kfox1111I haven't. but seen some docs that implied it might?01:54
kfox1111probably should try that just to be sure.01:54
kfox1111or ask on helm slack channel.01:54
sbezverkok, I am planning to asl this question tomorrow01:55
kfox1111k. sounds good.01:55
sbezverkfrom operator(s/w) point changing the same configmap and triggering process reload is definetly easier01:56
kfox1111inc0: parsing through the kolla.yaml, it kind of looks like kolla-publish-image-jobs looks like it does force a rerun of the gate build jobs.01:57
*** breitz has quit IRC01:58
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for heat  https://review.openstack.org/42118402:01
openstackgerritcaoyuan proposed openstack/kolla-ansible: Add prechecks into solum roles  https://review.openstack.org/42162202:06
kbaegisUmm. After installing from git master, I can't even see a kolla-ansible tool02:10
kbaegisIs ansible going to be removed?02:10
*** unicell has quit IRC02:10
kfox1111kbaegis: its now in the kolla-ansible repo.02:11
kfox1111the repo was split in trunk as there's now a kolla-kubernetes as well.02:12
kbaegiskfox1111: Thanks for the clarification.02:12
kbaegisI don't think k8s runs on gentoo02:14
openstackgerritQiLiang proposed openstack/kolla-kubernetes: Improve docker images pulling  https://review.openstack.org/42121002:15
*** jrist has quit IRC02:18
kbaegislooks like it requires python 3.5?02:22
openstackgerritQiLiang proposed openstack/kolla-kubernetes: Improve docker images pulling  https://review.openstack.org/42121002:22
kfox1111k8s might. its mostly just go binaries.02:28
kfox1111kolla-kubernetes might too, as its mostly helm packages now.02:28
kfox1111its stilll kind of in heavy development though.02:28
*** jrist has joined #openstack-kolla02:32
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for heat  https://review.openstack.org/42118402:33
*** MasterOfBugs has quit IRC02:35
*** PramodJ has quit IRC02:35
*** sacharya has joined #openstack-kolla02:36
*** harlowja has quit IRC02:36
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible: Pull kolla images from tarballs.o.o  https://review.openstack.org/41372002:40
*** sacharya has quit IRC02:40
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible: TEST depends on  https://review.openstack.org/42121202:40
duonghqkfox1111, are you around?02:42
duonghqwhy the test file is name like ceph_workflow or ceph_workflow_service?02:43
*** prameswar has joined #openstack-kolla02:44
*** sacharya has joined #openstack-kolla02:52
*** sacharya has quit IRC02:56
*** sacharya has joined #openstack-kolla02:56
*** sayantani01 has quit IRC02:58
openstackgerritcaoyuan proposed openstack/kolla-ansible: Add a condition into haproxy for solum  https://review.openstack.org/42161702:58
*** zhurong has quit IRC03:00
*** sacharya has quit IRC03:01
*** zhurong has joined #openstack-kolla03:02
*** inc0 has quit IRC03:04
openstackgerritzhubingbing proposed openstack/kolla: Fix designate dockerfile  https://review.openstack.org/42118803:09
openstackgerritMerged openstack/kolla-kubernetes: Support 3.0.2 in the gate  https://review.openstack.org/42000903:12
*** dave-mccowan has joined #openstack-kolla03:18
sbezverkduonghq: there are two workflows, ceph_workflow tests microservices, ceph_workflow_service tests service level packages03:22
*** dave-mccowan has quit IRC03:23
*** zhurong has quit IRC03:23
*** salv-orlando has joined #openstack-kolla03:23
duonghqsbezverk, but why the prefix is ceph_03:25
sbezverkbecause ceph is used for both, there is another one which is using iscsi03:26
duonghqsbezverk, ack, thanks03:26
sbezverkbut iscsi tests only microservices03:26
*** salv-orlando has quit IRC03:28
openstackgerritzhubingbing proposed openstack/kolla: Fix aodh dockerfile  https://review.openstack.org/42164503:31
*** sacharya has joined #openstack-kolla03:33
openstackgerritzhubingbing proposed openstack/kolla: Fix barbican dockerfile  https://review.openstack.org/42164603:36
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the set config error  https://review.openstack.org/37166903:38
openstackgerritzhubingbing proposed openstack/kolla: Fix gnocchi dockerfile  https://review.openstack.org/42164803:47
*** kbaegis has quit IRC03:47
*** sudipto_ has joined #openstack-kolla03:50
*** sudipto has joined #openstack-kolla03:50
*** sdake has joined #openstack-kolla03:52
*** kbaegis has joined #openstack-kolla03:52
sdakehey peeps03:53
sp_sdake: hi.....03:54
duonghqhi sdake03:54
*** tovin07 has joined #openstack-kolla03:57
openstackgerritJeffrey Zhang proposed openstack/kolla: install murano dashboard package in horizon  https://review.openstack.org/39595704:00
*** mdnadeem has joined #openstack-kolla04:01
*** tovin07 has quit IRC04:04
openstackgerritDuong Ha-Quang proposed openstack/kolla-kubernetes: Memcached service package  https://review.openstack.org/42165004:06
*** sudipto has quit IRC04:14
*** sudipto_ has quit IRC04:14
*** jtriley has joined #openstack-kolla04:19
sdakecan I get a core reviewer approval on https://blueprints.launchpad.net/kolla-kubernetes/+spec/more-microservices04:25
sdakeTIA :)04:25
zhubingbing;)04:26
*** celo_r has quit IRC04:33
duonghqsbezverk, around?04:34
*** sudipto_ has joined #openstack-kolla04:35
*** sudipto has joined #openstack-kolla04:35
duonghqwhen I try to run helm_prebuilt_service script, I got error glance-pv chart not found in repo http://localhost:1019104:36
duonghqI already start an repo in helm directory04:36
*** awiddersheim has quit IRC04:39
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes: Updated from global requirements  https://review.openstack.org/41934304:39
duonghqbut seem that helm serve doesn't recursive index?04:39
*** adrian_otto has joined #openstack-kolla04:41
kbaegisHey guys, using the ansible kolla build I keep getting TypeError: the JSON object must be str, not 'bytes'04:41
duonghqkbaegis, seem that python 3.5 issue04:42
*** sacharya has quit IRC04:42
duonghqwhere do you get this error?04:42
*** sacharya has joined #openstack-kolla04:43
kbaegisduonghq: Gotcha. It's on kolla-build04:43
kbaegisAnything with —push in fact04:44
*** sacharya has quit IRC04:47
duonghqkbaegis, I got this before, hoped that somebody fixed it04:51
duonghqseem that it's not in the case04:51
duonghq:)04:51
duonghqsorry guy04:52
kbaegisduonghq: That's alright. I can pull from docker.io04:53
kbaegisWhat tag/version combos are available?04:53
duonghqwhich branch are you using?04:54
kbaegis(Hoping for centos ;)04:54
kbaegisI'm using kolla-ansible04:54
duonghqcentos is ok04:54
duonghqwhich branch of kolla-ansible?04:54
duonghqmaster, stable/newton,...?04:55
kbaegismaster04:55
kbaegisnewton is back on kolla before the fork04:55
duonghqso you are out-of-luck04:55
*** adrian_otto has quit IRC04:55
kbaegisDamn. So I can't push the images to my own registry, and none have been published.04:55
kbaegisLovely :)04:55
duonghqiirc, you're using Gentoo?04:56
kbaegisduonghq: I am! :)04:58
duonghqthere are at least 2 bp relate to the issue04:59
duonghqsp_, is working on these04:59
kbaegisNice. I set my tag to master. I'll let you know if I pull a rabbit out of a hat05:00
kbaegis(kinda doubt it ;) )05:00
duonghqlong time no see you on irc, kbaegis05:00
kbaegisduonghq: Yeah, just moved. I was offline for a month or 305:01
kbaegisjust fyi, tag master worked. I have (usable?) images05:01
kbaegisI'll let you know which one breaks my deploy05:01
duonghqI don't think so05:02
duonghq:(05:02
*** adrian_otto has joined #openstack-kolla05:04
kbaegisWell, all the infra deployed :) There just aren't basic OpenStack services like keystone :)05:07
kbaegisOkay, well hopefully they have a fix for that05:08
duonghq:)05:08
*** adrian_otto has quit IRC05:09
kbaegisIt's times like this I wish I was an actual developer.05:09
*** sudipto_ has quit IRC05:10
*** sudipto has quit IRC05:10
*** sudipto has joined #openstack-kolla05:12
*** sudipto_ has joined #openstack-kolla05:13
openstackgerritMerged openstack/kolla-kubernetes: Updated from global requirements  https://review.openstack.org/41934305:15
*** sdake has quit IRC05:16
openstackgerritzhangshuai proposed openstack/kolla-ansible: Add karbor ansible role  https://review.openstack.org/40222905:16
*** jtriley has quit IRC05:21
*** skramaja has joined #openstack-kolla05:21
*** sdake has joined #openstack-kolla05:25
*** sdake has quit IRC05:25
*** sdake has joined #openstack-kolla05:25
kbaegisWell, I'm glad someone implemented the -nopush flag. Centos-source is building fine with whatever tag. I can just migrate those via tar straight through docker05:31
kbaegisAnnoying, but it works05:31
kbaegisespecially for aio05:31
openstackgerritzhubingbing proposed openstack/kolla: Fix gnocchi dockerfile  https://review.openstack.org/42164805:39
openstackgerritcaoyuan proposed openstack/kolla-ansible: Fix the error when pull keystone image  https://review.openstack.org/42167405:42
sdakegoodnight folks05:46
*** sdake has quit IRC05:46
openstackgerrityuhui proposed openstack/kolla: Added oslo_log replacing logging library,more file  https://review.openstack.org/42119905:48
*** lrensing has joined #openstack-kolla05:57
duonghqkbaegis, still around?06:04
openstackgerrityuhui proposed openstack/kolla: Added oslo_log replacing logging library,more file  https://review.openstack.org/42119906:06
*** narasimha_SV has joined #openstack-kolla06:11
*** tyrola has quit IRC06:23
openstackgerritzhubingbing proposed openstack/kolla: Fix aodh dockerfile  https://review.openstack.org/42164506:24
*** satyar has joined #openstack-kolla06:24
*** narasimha_SV has quit IRC06:24
*** tyrola has joined #openstack-kolla06:25
openstackgerritJeffrey Zhang proposed openstack/kolla: install murano dashboard package in horizon  https://review.openstack.org/39595706:25
openstackgerritDuong Ha-Quang proposed openstack/kolla-kubernetes: Memcached service package  https://review.openstack.org/42165006:27
*** lrensing has quit IRC06:29
*** tovin07 has joined #openstack-kolla06:29
*** tovin07_ has joined #openstack-kolla06:29
*** tovin07 has quit IRC06:31
*** zhangkun_ has joined #openstack-kolla06:33
openstackgerritMerged openstack/kolla-ansible: Fix the error when pull keystone image  https://review.openstack.org/42167406:34
*** unicell has joined #openstack-kolla06:37
zhangkun_hi all,i am new here,i check the code mongodb/templates/bootstrap_cluster.js.j2.06:41
zhangkun_and i have a question.why do we set storage_interface rather than api_interface when execute the task of Bootstraping the mongodb replication set?06:42
zhangkun_this is my paste http://paste.ubuntu.com/23820684/06:42
*** tonanhngo has joined #openstack-kolla06:52
openstackgerrityuhui proposed openstack/kolla: Added oslo_log replacing logging library,more file  https://review.openstack.org/42119906:53
zhangkun_anyone here?06:53
*** saneax-_-|AFK is now known as saneax07:00
openstackgerrityuhui proposed openstack/kolla: Added oslo_log replacing logging library,more file  https://review.openstack.org/42119907:03
*** msimonin has joined #openstack-kolla07:10
*** jrist has quit IRC07:11
*** jrist has joined #openstack-kolla07:12
*** salv-orlando has joined #openstack-kolla07:12
*** msimonin has quit IRC07:13
*** jrist has quit IRC07:14
*** bmace has quit IRC07:14
*** jrist has joined #openstack-kolla07:16
*** salv-orlando has quit IRC07:17
*** zhurong has joined #openstack-kolla07:37
*** salv-orlando has joined #openstack-kolla07:45
*** zhurong has quit IRC07:46
*** bmace has joined #openstack-kolla07:46
*** mgoddard has joined #openstack-kolla07:52
*** salv-orlando has quit IRC07:53
*** Unknown__ has joined #openstack-kolla07:55
Unknown__Im having an error on multinode installation07:55
Unknown__TASK [common : Creating log volume] On network node07:56
Unknown__Traceback (most recent call last):\\n  File \"/tmp/ansible_Kv4VqN/ansible_module_kolla_docker.py\", line 738, in main\\n    dw = DockerWorker(module)\\n  File \"/tmp/ansib le_Kv4VqN/ansible_module_kolla_docker.py\", line 212, in __init__\\n    self.dc = docker.Client(**options)\\nAttributeError: \\'module\\' object has no attribute \\'Client\\'\\n07:56
Unknown__I am using the git from stable/newton and ansible 2.2.0.007:56
Unknown__Thank you07:56
openstackgerritzhubingbing proposed openstack/kolla-ansible: remove avoid precheck.yml  https://review.openstack.org/42172108:08
*** qiliang28 has joined #openstack-kolla08:10
*** qiliang27 has quit IRC08:10
*** qiliang28 is now known as qiliang2708:10
*** shardy has joined #openstack-kolla08:12
openstackgerritCuong Nguyen proposed openstack/kolla-kubernetes: Uses yaml.safe_load() instead of yaml.load()  https://review.openstack.org/42172508:13
*** tovin07 has joined #openstack-kolla08:13
*** msimonin has joined #openstack-kolla08:15
*** matrohon has joined #openstack-kolla08:22
*** Serlex has joined #openstack-kolla08:32
Unknown__Help! If I install docker 2.0.1 python librery, The kolla_docker module doesnt work08:34
*** rmart04 has joined #openstack-kolla08:35
*** salv-orlando has joined #openstack-kolla08:37
*** Unknown__ has quit IRC08:39
openstackgerritzhubingbing proposed openstack/kolla-ansible: [WIP] Add fluentd role  https://review.openstack.org/40739208:44
*** magnumbonum has quit IRC08:47
*** egonzalez has joined #openstack-kolla08:47
*** mgoddard has quit IRC08:48
openstackgerritzhubingbing proposed openstack/kolla-ansible: [WIP] Add fluentd role  https://review.openstack.org/40739208:49
zhubingbingsup 188be883d25208:49
zhubingbingsup egonzalez08:49
*** rmart04 has quit IRC08:50
*** prameswar has quit IRC08:55
*** tonanhngo has quit IRC08:55
*** rmart04 has joined #openstack-kolla08:56
*** gfidente has joined #openstack-kolla09:00
*** msimonin has quit IRC09:01
duonghqnice to see you egonzalez09:02
egonzalezhey duonghq how are things going?09:02
duonghqas usual, how about your new year vacation?09:03
*** msimonin has joined #openstack-kolla09:03
*** msimonin has quit IRC09:05
*** msimonin has joined #openstack-kolla09:05
zhubingbinghi I see your submission09:06
zhubingbinghi duonghq09:06
zhubingbing;(09:06
zhubingbing;(09:06
duonghqzhubingbing, do not got your point, sorry09:06
zhubingbinghttps://review.openstack.org/#/c/421648/09:07
zhubingbingpython-xxclient is base package so i think we should move it to openstack-base09:07
zhubingbing;)09:08
zhubingbingfor exemple https://github.com/openstack/kolla/blob/master/docker/openstack-base/Dockerfile.j2#L8009:08
duonghqzhubingbing, sure, I told that maybe I missed something09:09
zhubingbing;)09:09
duonghqbut why do we put this kind of package in openstack-base09:09
duonghqimage that we need only compute kit09:09
duonghqbut we must carry over other package client09:09
duonghqI don't think it's reasonable09:10
egonzalezyeah, but for example, ceilometer may need gnocchiclient when using it as backend09:11
zhubingbingThe dockeri mage is made up of hashes09:11
duonghqzhubingbing, I understand your point09:12
zhubingbingok09:12
duonghqbut IMO, the base should be as compact as possible09:12
duonghqegonzalez, sure, maybe we put gnocchiclient in ceilometer?09:12
des_consoladohey egonzalez I got it working yesterday evening, so much woot!! :D09:13
des_consoladothe problem was that br-tun was down as well09:13
openstackgerritzhubingbing proposed openstack/kolla-ansible: remove avoid precheck.yml  https://review.openstack.org/42172109:15
egonzalezon the topic, anyone had to manually configure an IP in br-ex to make flat networks work?09:16
des_consoladoegonzalez: I didn't have to do that09:17
openstackgerritzhubingbing proposed openstack/kolla-ansible: remove  unnecessary precheck.yml  https://review.openstack.org/42172109:17
des_consoladoadding or removing IP addressing to br-ex or the external interface made no difference to the ping in the end09:17
des_consoladoone thing I'm unclear on though is, surely kolla(-ansible) should be setting the br-ex/br-tun devices and whatever network devices it needs to be up and to be up on boot? Seems strange having to manually set those up with `ip link`09:18
*** salv-orlando has quit IRC09:21
*** pq_ has joined #openstack-kolla09:24
*** tovin07 has quit IRC09:30
*** mgoddard has joined #openstack-kolla09:30
openstackgerritzhubingbing proposed openstack/kolla-ansible: [WIP] Add fluentd role  https://review.openstack.org/40739209:40
*** pcaruana has joined #openstack-kolla09:41
openstackgerritMerged openstack/kolla: Fix designate dockerfile  https://review.openstack.org/42118809:49
*** tovin07_ has quit IRC09:51
*** tovin07 has joined #openstack-kolla09:55
*** msimonin has quit IRC10:00
*** msimonin has joined #openstack-kolla10:00
egonzalezdes_consolado: still not pinging of not add an IP address weird10:01
*** hfu has quit IRC10:04
*** ccesario has joined #openstack-kolla10:07
openstackgerritJeffrey Zhang proposed openstack/kolla: install murano dashboard package in horizon  https://review.openstack.org/39595710:09
*** tovin07 has quit IRC10:11
des_consoladoegonzalez: oh by the way I set the tunnel interface to be the neutron external interface as well I think10:11
des_consoladoI need to test with the tunnel interface being the API interface10:11
Jeffrey4legonzalez, could u just merged this and solve the password issue in the future? https://review.openstack.org/#/c/415504/  i do not think add no_log to module_args is a good idea. because it is hard for debug in some cause.10:14
openstackgerritzhubingbing proposed openstack/kolla-ansible: [WIP] Add fluentd role  https://review.openstack.org/40739210:14
des_consoladoah the tunnel interface did need an IP address though, for: tunnel_interface_address: "{{ hostvars[inventory_hostname]['ansible_' + tunnel_interface]['ipv4']['address'] }}" # in group_vars/all.yml10:15
egonzalezJeffrey4l: yeah, sorry I missed that yesterday10:15
des_consoladothat was just for kolla-ansible to run through successfully, you can remove it afterwards10:15
Jeffrey4lthansk.10:16
egonzalezJeffrey4l: any clue, when using flat network for external, I have to configure an IP in br-ex and also put up the bridges (all are DOWN)10:16
des_consoladoI should probably set tunnel_interface_address manually in the group_vars10:17
Jeffrey4lwhy need add ip into br-ex?10:17
Jeffrey4li never configured that. and flat network works.10:17
openstackgerritMerged openstack/kolla-ansible: Refactor bootstrap.yml file  https://review.openstack.org/41550410:17
egonzalezdont know, if i dont add it. I cant ping to instances10:18
openstackgerritCuong Nguyen proposed openstack/kolla-kubernetes: Remove unnecessary f.close()  https://review.openstack.org/42178610:18
Jeffrey4lhrm. try tcpdump the physical nic and br-ex to check why the packet is blocked.10:19
Jeffrey4lthis should not necessary.10:19
*** zhubingbing has quit IRC10:19
*** prameswar has joined #openstack-kolla10:20
*** goldyfruit has quit IRC10:26
egonzalezJeffrey4l: had wrong network routes10:27
egonzalezbut, still need to put up br-ex, is not up automatically10:28
Jeffrey4ldown is OK. because it is managed by openvswitch, not linux.10:29
Jeffrey4li never up it manual to make the flat/vlan network work.10:29
*** willise has joined #openstack-kolla10:31
*** willise has left #openstack-kolla10:31
*** cuongnv has joined #openstack-kolla10:31
*** vcn[m] has joined #openstack-kolla10:32
*** cuongnv has quit IRC10:32
*** cuongnv has joined #openstack-kolla10:33
*** satyar has quit IRC10:35
*** pcaruana has quit IRC10:38
openstackgerritJeffrey Zhang proposed openstack/kolla: Install all python packages in global-requirements.txt file  https://review.openstack.org/39415010:39
*** cuongnv has quit IRC10:41
*** sambetts|afk is now known as sambetts10:47
*** pbourke has quit IRC10:48
sambettsHi Kolla team, I'm pretty new to kolla, but I already have a k8s cluster running, where in the docs should I start to begin a deployment of kolla on my existing cluster??10:48
*** pbourke has joined #openstack-kolla10:48
*** tonanhngo has joined #openstack-kolla10:55
*** tonanhngo has quit IRC10:57
openstackgerrityuhui proposed openstack/kolla: the kolla module has no CONTRIBUTING.rst file, add it  https://review.openstack.org/42182910:57
openstackgerritJiri Stransky proposed openstack/kolla: Reslient bootstrapping for MariaDB  https://review.openstack.org/42132310:57
*** msimonin has quit IRC10:57
*** msimonin has joined #openstack-kolla10:59
*** matrohon has quit IRC11:20
egonzalezJeffrey4l: got it, i can ping/ssh to instances from other hosts, but not from controller node without putting up br-ex and adding proper routes11:22
Jeffrey4legonzalez, do you have ip on the controller node? may be you need ping the vm in a namespace.11:23
egonzalezthe reason is because is in a kvm VM with a NAT network and no interface have an IP in that network (makes sense)11:23
egonzalezyeah, through namespace i can ping11:24
Jeffrey4lcool.11:25
*** sudipto_ has quit IRC11:25
*** sudipto has quit IRC11:25
egonzalezJeffrey4l: thanks for the help11:26
Jeffrey4lnp :)11:26
*** prameswar has quit IRC11:32
mliimamorning guys11:35
egonzalezmorning mliima11:37
*** prameswar has joined #openstack-kolla11:38
egonzalezJeffrey4l: I've been testing fluentd this week, I think is almost finished. I had no issue for now11:48
egonzalezWe should merge  before feature freeze and if something is wrong fix with bug11:48
Jeffrey4legonzalez, yep. agree.11:48
*** salv-orlando has joined #openstack-kolla11:49
egonzalezif someone want to give it a try, please help review and test https://review.openstack.org/#/c/407392/11:50
*** pcaruana has joined #openstack-kolla11:56
*** f13o_ has joined #openstack-kolla11:59
sambettsMorning kolla team o/12:02
sambettsIf I have an existing working kubernetes cluster, where is the best place for me to start with deploying kolla on there? I was working through the guide here: http://docs.openstack.org/developer/kolla-kubernetes/minikube-quickstart.html#start-minikube-and-services using the parts post-minikube setup but it seems the kolla-kubernetes-toolbox is out of date and won't work on k8s 1.5.0+12:04
*** liyifeng has quit IRC12:07
*** dasTor has quit IRC12:09
des_consoladoJeffrey4l: what is this? https://github.com/openstack/kolla/commit/be846040251ccd193135d7782cb9e04def85c828 Did you mean Newton or Neutron? And what else changes when the version changes?12:12
des_consoladoAnd howcome this changes in group_vars/all but not in globals.yml?12:13
Jeffrey4ldes_consolado, nothing except the openstack_release. it is issue introduced by sync kolla image tag and openstack_release variable in ansible.12:18
des_consoladoJeffrey4l: So the openstack_release tag should always be +0.0.1 of the actual codebase release tag? In git tags on the repo I see that there is no 3.0.3.12:20
Jeffrey4ldes_consolado, yep..12:20
des_consoladoThat's really weird and counter-intuitive D: especially when versioning is so fussy with Kolla (correct Ansible, Docker, tag, branch etc.)12:21
Jeffrey4lit is reasonable. because +0.0.1 means next release kolla and kolla-ansible.12:21
Jeffrey4lit is meaningless to continue use 3.0.2.12:22
Jeffrey4land in this way, we do not need to bump the variable when release/tagging12:22
des_consoladooh the one in globals.yml is commented out12:23
*** shardy is now known as shardy_lunch12:29
*** f13o_ has quit IRC12:29
openstackgerritMerged openstack/kolla-ansible: Pull kolla images from tarballs.o.o  https://review.openstack.org/41372012:29
*** dave-mccowan has joined #openstack-kolla12:34
*** sudipto_ has joined #openstack-kolla12:44
*** sudipto has joined #openstack-kolla12:44
*** srwilkers has joined #openstack-kolla12:51
*** zhurong has joined #openstack-kolla12:53
kbaegisHas anyone pushed a patch for the "str, not byte" issue on the ansible tree?12:55
kbaegis(Not able to push images to registry?)12:55
*** sdake_ has joined #openstack-kolla12:57
*** JeroenBo has joined #openstack-kolla12:57
*** JeroenBo has left #openstack-kolla12:58
*** sdake__ has joined #openstack-kolla12:58
*** msimonin has quit IRC13:00
*** sdake_ has quit IRC13:02
*** msimonin has joined #openstack-kolla13:02
openstackgerritMerged openstack/kolla: Fix barbican dockerfile  https://review.openstack.org/42164613:02
*** matrohon has joined #openstack-kolla13:03
*** dasTor has joined #openstack-kolla13:07
*** pq_ has quit IRC13:07
*** pq_ has joined #openstack-kolla13:08
sdake__portdirect i ntoiced you just popped in13:09
*** sdake__ is now known as sdake13:09
sdakeportdirect any chance you can give me the tldr on what helm_prebuild is doing today?13:09
sdakejust merging common bits right?13:09
sdakesbezverk ?13:11
*** zhurong has quit IRC13:11
sbezverksdake: morning13:11
sdakesup sbezverk13:11
sdakethe agenda for the helm meeting is being formed now13:11
sdakewg that is13:11
sdakei wanted to discuss how helm_prebuild works today13:12
*** zhurong has joined #openstack-kolla13:12
sdakesince imo it was always a temporary hack13:12
sdakeuntil we could sort out how to do it right in helm13:12
sbezverksdake:  I suspect it will be used for a while13:12
sdakelooking at the code13:12
sdakesbezverk that may be, would be nice if we could get it somehow merged into helm natively13:12
*** zhurong has quit IRC13:13
sdakei need to understand what it does in detail13:13
sdakecan you expalin it?13:13
sdakeits obviously changed since i looked at it in december13:13
openstackgerritMerged openstack/kolla: Remove custom images  https://review.openstack.org/42082213:13
openstackgerritMerged openstack/kolla: Add blocks for Ubuntu apt setup and package installation  https://review.openstack.org/41961013:13
openstackgerritMerged openstack/kolla: Fix gate in iax-ord node when using libvirt 2.0  https://review.openstack.org/42048013:13
sbezverksdake: it add common bits and generates values.yaml based on all.yaml13:14
sbezverkfor each microservice13:14
sdakeok so its like an out of tree include13:14
*** matrohon_ has joined #openstack-kolla13:14
*** schwicht has joined #openstack-kolla13:15
sdakeas well as something that parses all values.yamls for a tree of charts and produces one all.yaml?13:15
sbezverksdake: sort of, there is some additional logic based on the type of microservice13:15
sdakewhat does the additional logic do13:15
sdakefwiw, I think this is our greatest weakeness at present13:16
sbezverkno it does not produce all.yaml, it produces per microservice values.yaml13:16
sdakeif we can solve this, the whole "kolla-kubernetes is not helm native" nonsense will disappear13:16
sdakefrom one global yaml file?13:16
sbezverkyes13:16
*** matrohon has quit IRC13:17
sdakeok, so to dig in to more depth13:17
sdakeit reads one file which contains all globals13:17
sdakeand copies it to all the microservices?13:18
sdakeor it copies only parts of the globals?13:18
*** mdnadeem has quit IRC13:18
sbezverkyes, depending on microservice type13:18
* srwilkers reads13:18
sbezverkit copies only relevant values13:18
sdakehow are relevant values known?13:19
sdakecan you provide an example?13:19
sbezverkexample microservices using ceph, will get ceph config parameters, others will not13:19
sdakeok13:19
sdakeso it gets globals:13:19
sdakeand ceph:13:19
sdakebut nothign else13:19
sdakeand it obtains them from an out-of-tree file13:20
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfigure action for rally  https://review.openstack.org/42189313:21
openstackgerritMerged openstack/kolla: Support for multiple override files  https://review.openstack.org/41721313:21
openstackgerritMerged openstack/kolla: TLS loadbalancer creation fails due to unread neutron_lbaas.conf  https://review.openstack.org/42088013:21
openstackgerritMerged openstack/kolla: Support filtering output of --list-images  https://review.openstack.org/41998813:21
*** rhallisey has joined #openstack-kolla13:21
*** shardy_lunch is now known as shardy13:21
*** kbaegis has quit IRC13:22
*** msimonin has quit IRC13:22
*** kbaegis has joined #openstack-kolla13:22
*** lamt has joined #openstack-kolla13:23
openstackgerritMerged openstack/kolla-ansible: Add prechecks into solum roles  https://review.openstack.org/42162213:23
*** lamt has quit IRC13:24
openstackgerritcaoyuan proposed openstack/kolla-ansible: Fix the group check for glance-registry  https://review.openstack.org/42189913:26
*** schwicht_at_work has joined #openstack-kolla13:26
*** schwicht has quit IRC13:27
sdakesbezverk cool thats a good example for ceph13:27
sdakeandglance I assume works the same way13:27
sdakeso basically our requirement is to be able to copy an out-of-tree all_values.yaml and select only the globals and service specific portion into the internal chart all_values.yaml13:28
sdakesbezverk ^ ?13:28
*** sean-k-mooney has quit IRC13:29
*** zhurong has joined #openstack-kolla13:32
*** salv-orlando has quit IRC13:36
sdakeportdirect sbezverk srwilkers want to buy some brain power :)13:38
sdakecan you guys help here13:38
portdirectsup13:38
Serlexhi, anyone know if HA-lbaas is supported in kolla?13:39
sdakei'd like to get rid of helm_prebuidl step13:39
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible: Refactor Designate bootstrap.yml file  https://review.openstack.org/42190613:39
sdakeportdirect i'm not sure what to ask helm upstream for precisely13:39
sdakeportdirect so I thought I'd state our requirements and the why of it13:39
sdakeso what the requirement is and why it is so13:39
sdakeportdirect i gather from speaking with sbezverk and looking at helm_prebuild.py, it looks at an out-of-tree yaml file and merges it into some other yaml file in tree13:41
sdakethis is for the API13:41
sdaketo helm13:41
sdakee.g. : al_values here:13:42
sdakehttps://github.com/openstack/kolla-kubernetes/tree/master/helm13:42
sdakeis out of tree13:42
sdakeall_values that is13:42
sdakedoes anyone know why that is so?13:42
portdirectsdake: I'm not sure how we can remove prebuild.py13:42
sdakeportdirect lets assume for a moment it can be done (because it is software)13:43
*** yangzb09 has joined #openstack-kolla13:43
portdirectits a consequence of the arch that was used13:43
sdakelets assume we can add features to helm to solve the problem instead of  making our own tools13:43
sdakewhat would that feature of helm look like?13:43
sdakeportdirect i always saw it as a short term hack to get the ball rolling13:44
sbezverkagree with port direct, it would not require if we did not select flat model13:44
srwilkersi third that thought13:44
srwilkerssorry, getting caught up13:44
sdakesrwilkers third which thought?13:44
portdirectsdake: we would need the same think implemented in helm13:44
srwilkersit being a consequence we took on with our current design13:44
sbezverksdake: helm already support inheritance13:45
srwilkersyes, itd have to be the same thing in helm13:45
sbezverkwe just selected not to use it13:45
portdirectbut no other helm package offer the extermeme granularity combined with abstraction of kolla-k8s13:45
sdakeok guys - i'd liek us to focus on this particular point in the wg session today until we shave the yak completely13:45
sbezverksdake: I am sorry but there are other important matter to discuss13:46
sdakesbezverk ok - thats fine13:46
sdakesbezverk i'd like to spend 10 minutes on this topic13:46
sdakewhat i'm getting at is I'd like to get the helm developers to understand why we have this prebuild step13:46
*** prameswar has quit IRC13:46
sdakeand that we want to get rid of it13:47
sdakeits a serious weakenss, as I already said, in the current system13:47
sdakeparsing whatyou said above, teh fine grained control we need isn't possible thorugh inheritence13:47
sdakeis that correct?13:47
sbezverksdake: they will tell you to use hiarachy13:47
sbezverkthen you would not need it13:47
sdakeok - lets not make assumptions on what they will tell us or not tell us13:47
sdakehierarcy is not ideal because then we dont have separate helm packages for each microservice and service13:48
sdakeis the above accurate? ^^13:48
sbezverksdake: afaik they are wokring on fixing this part already13:48
sdakesbezverk could you add more details?13:49
sbezverkso you would have hiarachy and ability to access microservice package13:49
*** duonghq has quit IRC13:50
*** duonghq has joined #openstack-kolla13:50
* sbezverk need to find feature relevant helm request13:50
duonghqevening guys13:50
sdakesup duonghq13:50
*** schwicht_at_work has quit IRC13:50
srwilkersyep, sbezverk is right13:50
mliimaneed act here https://review.openstack.org/#/c/417094/13:50
sdakesrwilkers actually correct, but ok :)13:50
mliimasdake, egonzalez ^^13:50
*** duonghq_ has joined #openstack-kolla13:51
sdakesrwilkers cool - so if its being worked on, i think we can help provide feedback that from our POV its high priority13:51
sbezverksdake: https://github.com/kubernetes/helm/issues/156813:51
sdakeI dont know if that would be helpful for the helm devs or not13:51
sdakeI know it would be helpful for jascott1 who is working on helm upstream13:51
* egonzalez looking13:52
srwilkersim working on upstream helm too13:52
* portdirect feels left out13:53
*** duonghq__ has quit IRC13:54
duonghqsbezverk, ping13:55
sdakesrwilkers nice13:55
sdakesbezverk the hiarcy approach used with a plugin - how would that solve our global variables thing?13:56
duonghqmorning sdake, I wake up quite early?13:56
sdakeduonghq do you?13:56
openstackgerritchen.xing proposed openstack/kolla: [WIP] Add vitrage images  https://review.openstack.org/41759313:56
duonghq*I -> you13:56
duonghqsorry13:56
duonghqalways got trouble with pronoun13:57
duonghq:(13:57
sdakemliima is https://review.openstack.org/#/c/417094/2/ansible/roles/cinder/templates/cinder.conf.j2 line 128 correct?13:57
sdakeshouldn't that be {{ hnaas_iscsi_backend }}?13:57
sdakeduonghq np :)13:58
sdakeduonghq ya 5-6am typically13:58
*** zhubingbing has joined #openstack-kolla13:58
mliimahmm sdake13:58
mliimaok13:58
portdirectsdake: being honest - I think we need to deal with config before we resolve the build.py13:58
mliimai'll change13:58
mliima:)13:58
mliimagreat13:58
sdakemliima moment pls13:58
sdakemliima let me finish review13:58
mliimaok13:58
sbezverkportdirect +213:59
portdirectas while we rely on kolla-ansible we are not able to really deploy anywhere other than the gate :/13:59
duonghqin ceph_workflow_service test, line 70, helm has --value args, what does it for?13:59
sbezverkconfig gen needs to be addressed in a priority..14:00
sdakeportdirect ok - that is a problem for kolla-kubernetes to solve itself right?14:00
sdakeportdirect whereas this wg are problems for helm to solve?14:00
sdakeportdirect i'm not suggesting kolla-kubernetes devs would solve this problem immediately14:01
sbezverkduonghq: it is to disable logging at the gate for now14:01
mliimathank sdake and egonzalez for reviews14:01
mliima:)14:01
sdakeportdirect laying tracks for it to be solved upstream so we can rid ourselves of it14:01
sdakemliima np14:01
portdirectyes - but we cannot make demand from them untill we know what we need - and untill we have the config sorted I'm not sure what that is going to look like.14:01
duonghqsbezverk, the --value <(helm_entrypoint_general $1)14:01
sdakeportdirect i see14:02
sdakeportdirect ok - that makes sense14:02
sdakeportdirect i think we can discuss the idea as something we need to be rid of in kolla-kubernetes14:02
*** prameswar has joined #openstack-kolla14:02
* srwilkers is out of coffee14:02
sbezverkduonghq: oh this one is used to push entrypoint common variables including gate's ceph parameters. check macro above14:02
sdakeportdirect agree r enot making feature requests before we really know what we need14:02
srwilkersportdirect, i agree14:03
sdakeportdirect also, not making a demand, making a request :)14:03
*** srwilkers is now known as srwilkers_coffee14:03
*** sacharya has joined #openstack-kolla14:03
sdakeeven a request should be cautioned tho as to not waste resources14:03
portdirect+114:03
sdakei think the current solutions in that issue tracker (use a plugin and rewrite on the fly) seems super clunky to me14:04
sdakeseems like overengineering - and how would you get hte plugin into helm?14:04
sdakeportdirect sbezverk this is the kind of exchange we need to have in the wg14:05
sdakeportdirect wht I need is enough information to speak intelligently about it - which I dont have :)14:05
portdirectplugins easy14:05
portdirectI've written several14:05
sdakefor helm?14:05
portdirectyes14:05
sdakecool14:05
duonghqsbezverk, thanks14:06
openstackgerritDuong Ha-Quang proposed openstack/kolla-kubernetes: Memcached service package  https://review.openstack.org/42165014:06
*** athomas has quit IRC14:06
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Allow cinder-volume to be configured to use HNAS nfs  https://review.openstack.org/41709414:07
*** sacharya has quit IRC14:08
*** msimonin has joined #openstack-kolla14:11
sbezverkduonghq: please note that only check experimental checkes service/entrypoint deploymnet14:12
duonghqsbezverk, I just realize that14:12
sdakesbezverk can we just move that entrypoint gate to the non-experimental gate?14:13
sdakeas non-voting?14:13
duonghqportdirect, about ceph, I need to pass some info from deployment node to helm at runtime, (the OSD_PARTITION_NUM), how can I do that?14:13
duonghqportdirect, ceph-osd in particular14:14
*** schwicht has joined #openstack-kolla14:14
sbezverksdake: need to check with kfox111114:14
*** athomas has joined #openstack-kolla14:15
*** pq_ has quit IRC14:15
*** pq_ has joined #openstack-kolla14:17
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfigure action for rally  https://review.openstack.org/42189314:20
*** mgiles has joined #openstack-kolla14:20
sdakesbezverk will do14:20
sdakesbezverk let me ask, is it functional?14:20
sdakesbezverk does it pass 80%+ of the time?14:20
sdakesbezverk nonvoting gatees should be gates which are functional 80% of the time ;)14:20
sdakeexperimental gates are gates taht are functional less then 80% of the time14:21
*** salv-orlando has joined #openstack-kolla14:21
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible: Refactor Designate and Panko bootstrap.yml  https://review.openstack.org/42190614:23
sdakeportdirect srwilkers_coffee sbezverk bck on prebuild, can we have a short discussion in the wg where we all agree it needs to go :)14:24
sdakeportdirect srwilkers_coffee sbezverk how it goes, we can leave for the issue tracker14:25
sdakesup mgiles14:25
mgilesmorning sdake14:25
sdakemgiles - if your not busy at 10am pst, I'd be happy to invite you to our helm wg14:25
sdakemgiles i dont actualy own the invite so I  can forward to you14:25
sdakemgiles actually its 9am PST I think14:25
sdakemgiles might not hurt to lurk :)14:26
mgilesIs it on IRC or hangout or what?14:26
sdakemgiles the wg is biweekly on zoom14:26
sdakeso twice a month (in caseyou struggle with biweekly like I do:)14:26
sdakeits not on irc because its a kubernetes working group14:27
*** srwilkers_coffee is now known as srwilkers14:27
sdakehence not part of openstack's policies14:27
sdakealthoug hwe do try to play by both foundation's sets of rules14:27
sdake1 hour in length14:27
sdakepm me your email, it will be on your calendar you can choose to attend or not :)14:27
sdakezoom is like hangout but doesn't default to video on - thank god :)14:28
sdakezoom also available in china14:28
mgilesyeah.  Hate that about hangouts.14:28
sdakeya - thats annoying14:28
sdake"HEY IM HAVING A BAD HAIR DAY WHY MUST YOU TURN VIDEO ON BY DEFAULT"14:29
mgileslol14:30
sdakeduonghq did I forward the invite to you yet?14:30
sdakeduonghq it may be past your sleep time14:30
*** shardy has quit IRC14:30
*** shardy has joined #openstack-kolla14:31
sdakemgiles sadly i use my finger to cover up the camera when i'm having a bad hair day14:31
sdakemgiles like slacked on taking a shower or something :)14:31
sdakemgiles which ddoesn't happen often14:31
duonghqsdake, are you talking about the working group with helm or k8s community? is it done by text or video or voice?14:32
sdakemgiles working from home, it is mandatory to have good hygine all the time14:32
sdakeduonghq it is video + voice14:32
sdakeyou can call in voice only if you like14:32
mgilessdake I have another meeting at 10am pst today, but will try to make it in the future.14:32
sdakeduonghq its a working group with helm in the k8s community14:32
sdakemgiles cool i'll work on getting you added to the invitation14:32
mgilesthanks sdake14:32
*** fguillot has joined #openstack-kolla14:33
*** pq_ has quit IRC14:39
*** pq_ has joined #openstack-kolla14:39
*** jtriley has joined #openstack-kolla14:39
duonghqsdake, does the zoom work on linux?14:40
*** skramaja has quit IRC14:41
sbezverksdake: yes gate i function when the test code is right ;)14:42
sdakesbezverk cool so lets make it nonvitng then14:42
sdakesbezverk thats the metric for non-voting gates14:42
*** fguillot has quit IRC14:48
*** breitz has joined #openstack-kolla14:50
*** lrensing has joined #openstack-kolla14:52
duonghqsdake, have you had any experience with zoom before? seem that it does not have self test function14:52
sdakeduonghq what platform are you on? linux or windows or mac?14:52
*** mattmceuen has joined #openstack-kolla14:52
sdakeduonghq i run on mac, not sure on other platforms14:52
sdakeduonghq it just worked for me14:52
duonghqI'm using Ubuntu14:52
sdakeduonghq i see14:53
sdakeduonghq that may or may not work - just dont' know14:53
sdakeduonghq if that doesn't work, just dialin14:53
duonghqzoom doesn't have dial in number for Vietnam without premium plan14:54
sdakeduonghq i see14:54
sdakeduonghq is lachie not on premium plan?14:54
sdake(the meeting organizer)14:54
duonghqhope that at least the audio out works fine,14:54
sdakei wonder if its super expensive14:55
sdakeduonghq which one of these plans is it that is needed to dialin? https://zoom.us/pricing14:56
duonghqit is written: +84 **** **** (Premium Toll)14:56
sdakeduonghq sadface...14:56
*** adrian_otto has joined #openstack-kolla14:56
sdakeduonghq well I hae no idea what plan lachie has14:56
sdakewow my computer just made some new kind of beep14:56
*** msimonin has quit IRC14:57
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible: Fix keystone reconfigure  https://review.openstack.org/42199114:57
sdakewonder what that was about14:57
egonzalezJeffrey4l: could you check https://review.openstack.org/42199114:57
duonghqIf I understand correctly, it's add-ons, which cost 100 buck/mo14:57
duonghqnot cheap14:57
duonghqsdake, what kind of beep?14:57
Jeffrey4legonzalez, done. thanks.14:58
*** msimonin has joined #openstack-kolla14:58
egonzalezbtw, cool work on the reconfigure14:59
Jeffrey4lnp. but this bp can not implement in the O cycle ;(, which is i expected most15:01
sdakeduonghq one that is unfamiliar15:01
sdakeduonghq yikes15:01
*** jheroux has joined #openstack-kolla15:01
sdakeduonghq not sure if dies has that feature on their system - i'll ask15:01
sdakeDies is the co implementing helm and leading the wg15:01
*** dougs1 has quit IRC15:01
openstackgerritMark Giles proposed openstack/kolla-kubernetes: WIP - Nova service deployment  https://review.openstack.org/42145715:01
*** schwicht has quit IRC15:01
*** schwicht has joined #openstack-kolla15:02
sdakeduonghq you know, zoom shoudl work on linux15:03
sdakeduonghq it worked at red hat on fedora15:03
sdakeduonghq ca nyou google around for ubuntu + zoom problems?15:03
sdakeduonghq also I know a fella from germany dialed in, which may be the premium plan (michael schmidt)15:03
sdakeduonghq so maybe lachie is already on the premium plan15:03
duonghqsdake, sure I'll find on google, but Fedora is fine, so Ubuntu should done the job15:04
sdakeduonghq ya - it does work on linux (or did)15:04
*** jistr is now known as jistr|mtg15:05
*** mattmceuen has quit IRC15:06
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP memcached operator  https://review.openstack.org/41807315:07
*** david-lyle has joined #openstack-kolla15:13
*** openstack has joined #openstack-kolla15:21
*** Daviey has joined #openstack-kolla15:22
*** sudipto has joined #openstack-kolla15:22
*** lukl has joined #openstack-kolla15:22
*** classicsnail has joined #openstack-kolla15:22
*** zeus has joined #openstack-kolla15:22
wirehead_inc0 + sdake on stage: https://c1.staticflickr.com/1/725/32347661236_3256bd1602_b.jpg15:24
wirehead_and inc0 on stage: https://c1.staticflickr.com/1/470/31544114484_2022af897f_b.jpg15:24
*** v1k0d3n has joined #openstack-kolla15:25
sdakewirehead_ :)15:25
sdakewirehead_ what we need to do is get all the kolla cats on stage at once15:25
sdakewirehead_ we have only done that one time in tokyo15:25
sdakewirehead_ our team was much smaller15:25
*** sindhu has joined #openstack-kolla15:26
*** kong has joined #openstack-kolla15:26
*** DuncanT has joined #openstack-kolla15:26
*** turvey has joined #openstack-kolla15:26
*** yangzb09 has quit IRC15:27
*** smekel_ has joined #openstack-kolla15:27
*** ScoopIcicle has joined #openstack-kolla15:27
*** krtaylor has joined #openstack-kolla15:31
*** hogepodge has joined #openstack-kolla15:31
*** srwilkers has quit IRC15:32
wirehead_Yeah, I had a convo in Dec with a friend who was looking for a high-res headshot.. any high-res headshot that's not a selfie.  And I thought that, of all people, I'd have taken a picture of her, given I walk around with a foofy camera all of the time.15:33
wirehead_But I didn't, because I've been lazy lately about saying "Hey, let's grab a shot of all of the ___ cats"15:33
wirehead_Coulda organized it in Barcelona but didn't. :/15:33
*** v1k0d3n has quit IRC15:33
*** sp__ has joined #openstack-kolla15:34
sdakewirehead_ ya we should try to organize a photogrpah of the core and extended team in boston15:34
sdakewirehead_ Patrick Amor would be happy to take the picture I think, and he is nearly a pro photogrpaher15:34
*** v1k0d3n has joined #openstack-kolla15:34
*** david-lyle has quit IRC15:36
*** david-lyle_ has joined #openstack-kolla15:36
*** saneax is now known as saneax-_-|AFK15:36
*** david-lyle_ has quit IRC15:37
*** david-lyle_ has joined #openstack-kolla15:37
*** jtriley has quit IRC15:40
*** v1k0d3n has quit IRC15:41
*** david-lyle_ has quit IRC15:41
*** kencjohnston_ has quit IRC15:42
*** kencjohnston has joined #openstack-kolla15:43
openstackgerritzhubingbing proposed openstack/kolla-ansible: [WIP] Add fluentd role  https://review.openstack.org/40739215:44
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible: Optimize reconfiguration for tacker  https://review.openstack.org/42203615:45
*** mcnanci has joined #openstack-kolla15:45
sdakewirehead_ are you also a good photographer15:46
sdakeI took photography 101 in community college after i graduated15:46
sdakeso I've got the basics down15:46
*** jtriley has joined #openstack-kolla15:47
sdakemissed the part where you mentioned you use a foofy camera :)15:47
*** david-lyle has joined #openstack-kolla15:47
duonghqhow do you guy travel with camera?15:47
wirehead_I've got a Micro 4/3rds camera.15:49
wirehead_So, that giant backpack I'm walking around with generally has a smaller-than-average camera body and a few lenses.15:49
*** v1k0d3n has joined #openstack-kolla15:49
duonghqah, nice, travel with DSLR w/ some lens does not easily15:49
*** sp___ has joined #openstack-kolla15:49
wirehead_And then I've got a pancake lens and a rangefinder-styled body and that's about the size of a P&S, except dSLR quality.15:49
Jeffrey4legonzalez, could u review this https://review.openstack.org/371669  :)15:50
duonghqI also wish that I have a micro 4/3rds cam for traveling15:50
wirehead_Pretty much, I don't do things the normal way.15:50
wirehead_Also, Micro 4/3rds cams are astonishingly good these days, with a bunch of really neat and unique features.15:50
duonghqsure15:51
wirehead_So Micro 4/3rds is my main digital.15:51
wirehead_I've got a medium format film camera, but it ends up that Micro 4/3rds is pretty damn good and I use it a lot.15:51
duonghqya15:51
*** jistr|mtg is now known as jistr15:51
*** JeroenBo has joined #openstack-kolla15:51
duonghqmicro 4/3rds is better nowaday15:52
kfox1111morning.15:52
duonghqmorning kfox111115:52
wirehead_Here's the Museum Blau that was right next to the conference hall, at night: https://c1.staticflickr.com/1/410/32328555546_a594a67b92_b.jpg15:52
duonghqI have not traveled by airplane yet :P15:53
kfox1111wirehead_: nice. :)15:54
sdaketeam meeting in 5 minutes15:55
sdakeJeffrey4l you may have to coordinate the team meeting - not sure where inc0 is15:55
sdakeJeffrey4l i've got the agenda mostly up to date15:56
Jeffrey4lsdake, ok. but may need your help..15:58
*** jascott1 has joined #openstack-kolla15:58
sdakeJeffrey4l you know i'm here for you dude :)15:58
sdakeJeffrey4l the reality is I passed the PTL baton out of choice15:58
*** inc0 has joined #openstack-kolla15:58
sdakeoh theres inc015:58
sdakewe are good to go ;)15:58
inc0yeah15:59
inc0traffic:/15:59
sdakebummer15:59
sdaketeam meeting in 1 minute :)15:59
jrich523lol15:59
inc0I know15:59
jrich523skip it15:59
wirehead_Here's a picture to send your mother, inc0: https://c1.staticflickr.com/1/470/31544114484_2022af897f_b.jpg15:59
jrich523i had one yesterday i skipped15:59
jrich523what could they possibly need to talk about :)15:59
inc0wirehead_, cool!15:59
inc0thanks15:59
Jeffrey4lping inc016:00
inc0I'm here16:01
inc0meeting16:01
sdakesbezverk portdirect kfox1111 srwilkers_ team meeting16:01
*** Jeffrey4l has quit IRC16:01
sdake#openstack-meeting-4 if anyone else wants to join :)16:01
sdakemgiles bmace :)16:01
*** Jeffrey4l_ has joined #openstack-kolla16:01
*** Jeffrey4l_ is now known as Jeffrey4l16:02
*** yangzb09 has joined #openstack-kolla16:03
*** rhallisey has quit IRC16:03
*** msimonin has quit IRC16:04
*** igordcard has quit IRC16:05
*** adrian_otto has quit IRC16:06
*** igordcard has joined #openstack-kolla16:07
kbaegisHey, is Astara in queue or backlog for Kolla?16:07
kbaegisOr ODL?16:08
egonzalezodl is in progress16:09
*** sacharya has joined #openstack-kolla16:09
jrich523is there a... umm.... hmm.. package repo for openstack?16:09
kbaegisegonzalez: :D Awesome16:09
jrich523is there a goal of providing yum like services?16:09
kbaegisjrich523: yum already has most of them16:10
egonzalezrdo is packaging kolla if IIRC16:10
jrich523just seems like, these days, you'd be foolish not to16:10
kbaegisjrich523: Apt too16:10
jrich523oh i guess openstack isnt really worth having its own in that case16:10
jrich523sort of a pain tho, you'd have to install it yourself all over the place, but, meh16:11
kbaegisjrich523: You can do apt-get install neutron, etc. It's a huge pain to set up16:11
kbaegisjrich523: Exactly16:11
jrich523yay kolla :)16:11
jrich523our lab is getting rebuilt, cant wait to play on it again16:12
*** yangzb09 has quit IRC16:12
*** tonanhngo has joined #openstack-kolla16:12
jrich523liberty tho.....16:12
*** yangzb09 has joined #openstack-kolla16:12
jrich523and metapod... so.. its not THAT exciting... but... still :)16:12
openstackgerritzhubingbing proposed openstack/kolla: Fix aodh dockerfile  https://review.openstack.org/42164516:13
*** rmart04 has quit IRC16:15
openstackgerritzhubingbing proposed openstack/kolla: Fix gnocchi dockerfile  https://review.openstack.org/42164816:16
*** denggw has joined #openstack-kolla16:17
*** sayantani01 has joined #openstack-kolla16:19
*** zhubingbing has quit IRC16:19
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP memcached operator  https://review.openstack.org/41807316:20
*** yangzb09 has quit IRC16:21
*** yangzb09 has joined #openstack-kolla16:21
*** jheroux has quit IRC16:23
*** salv-orl_ has joined #openstack-kolla16:24
des_consoladoThis version thing still makes no sense to me. When you run kolla-build, pbr's version is called basically: https://github.com/openstack/kolla/blob/master/kolla/image/build.py#L65016:27
*** salv-orlando has quit IRC16:27
des_consoladopbr's version refers to the git tags... we have no git tag for 3.0.3, so how does it make any sense to use the 3.0.3 version in the group_vars?16:27
*** sean-k-mooney has joined #openstack-kolla16:27
egonzalezdes_consolado: pbr is used when installing kolla from pip, from pip there is no tag 3.0.3 is only on git(master of stable/newton)16:28
sean-k-mooneyegonzalez: shouldn't all git tags be available as pip packages?16:29
*** adrian_otto has joined #openstack-kolla16:31
sean-k-mooneyegonzalez: i taught that was part of the tagging process? if you create the git tag via the release repo it will create the pip package and if you do it by hand you were also ment to push the pip package manually16:31
des_consoladoah build.py can also called cfg for this I think, just reading thru the code now16:31
openstackgerritMerged openstack/kolla-ansible: Fix keystone reconfigure  https://review.openstack.org/42199116:31
openstackgerritMerged openstack/kolla-ansible: Refactor Designate and Panko bootstrap.yml  https://review.openstack.org/42190616:32
egonzalezsean-k-mooney: i used bad wording, 3.0.3 tag is not tagged yet, is the version used in globals, (the next version to be taged)16:32
*** jheroux has joined #openstack-kolla16:34
des_consoladowhat's the version used for apart from tagging of container images (and the normal use of it being a milestone in the code)?16:36
*** JoseMello has joined #openstack-kolla16:37
egonzalezdes_consolado: not getting your question16:37
sean-k-mooneyegonzalez: ah ok that makes sense16:39
*** harlowja has joined #openstack-kolla16:39
sean-k-mooneydes_consolado: the version in the global.yam is basically the version of the image. it is seperate to hte pip version though the defaults are updated in loc step16:40
*** zhubingbing has joined #openstack-kolla16:40
sean-k-mooneydes_consolado: having it in the global.yml allows the opperator to rebuild the images they have deployed for example when a security but is found in a depency16:41
des_consoladowell I have 3.0.2 stable/newton checked out and I need to build images, openstack_release is 3.0.3 in the group_vars though. Looks to me like the kolla-build just goes by the version of the repository it comes from though.16:41
zhubingbingi am sorry16:41
zhubingbingi miss meeting16:41
zhubingbing;)16:41
sean-k-mooneydes_consolado: the kolla build uses the verion in the kolla-build.conf16:41
zhubingbing;(16:41
sean-k-mooneyif you dont use the kolla-build.conf it proably tracks the pbr version16:42
des_consoladosean-k-mooney: where in the code does it use kolla-build.conf?16:43
sean-k-mooneyyou should use the kolla-build.conf though to make sure you allways build the images the same way so that you can do a 3.0.2-1 3.0.2-2 build ... when there are security issues in the software in the images16:43
des_consoladoI just read through all the code kind of... I suck at reading code clearly :'(16:43
*** mgoddard has quit IRC16:43
*** JeroenBo has quit IRC16:44
sean-k-mooneydes_consolado: the kolla build tool does not use the global.yml so it uses it when it read the config file. let me see if i can find it16:45
sean-k-mooneyit uses it from https://github.com/openstack/kolla/blob/master/kolla/common/config.py16:45
sean-k-mooneydes_consolado: https://github.com/openstack/kolla/blob/master/kolla/image/build.py#L978 is where it parses it16:46
sean-k-mooneydes_consolado: if no config is supplyed or you dont override the defaults on the commanline the defaults are used which are defined in https://github.com/openstack/kolla/blob/master/kolla/common/config.py16:48
sean-k-mooneyi belive this is where the version of the image is set https://github.com/openstack/kolla/blob/master/kolla/common/config.py#L206-L20716:49
sean-k-mooneythat becmore the pbr version https://github.com/openstack/kolla/blob/master/kolla/version.py#L1516:50
des_consolado716:50
des_consoladoyeah that's what I just read through16:51
des_consoladothanks btw but I don't see it pulling in anything like kolla-build.conf anywhere16:51
sean-k-mooneythat happens in the parse function16:51
sbezverkkfox1111: about overriding configmaps, what do you have in mind as a solution?16:52
sean-k-mooneyits a little hard to follow i was previouly convinced there was a bug  in this code16:53
sbezverkI had to use a workaround for my memchached operator.. would be good if solution you are proposing could also be used for my use case..16:53
des_consoladooh prog=kolla-build is passed to parse, maybe that's it, sec...16:54
des_consoladonah prog isn't used that's literally just the name of the program16:54
des_consoladoconf's default_config_files maybe...16:56
*** v1k0d3n has quit IRC16:58
*** salv-orl_ has quit IRC16:58
*** v1k0d3n has joined #openstack-kolla16:58
des_consoladoconf = cfg.ConfigOpts()16:59
kfox1111sbezverk: not too much thought through on configmaps yet.17:00
des_consoladowhich 'has built in support for config_file and config_dir'17:01
kfox1111just think we need a way to override the default configmap name for now.17:01
kfox1111as for how to manage the configmaps, needs more thought.17:01
duonghqsdake, the wg will start in about 1hr, right?17:01
kfox1111could be helm microservice like packages. a package per configmap.17:01
kfox1111or a single package with all configmaps in it... not sure how well that would work though...17:01
des_consoladoah okay so prog=kolla-build, and looking at this http://docs.openstack.org/developer/oslo.config/builtins.html it will look for kolla-build.conf in the given places17:02
des_consoladoso it just needs to be in /etc/kolla/kolla-build.conf ok...17:03
*** egonzalez has quit IRC17:03
sdakeduonghq no it starts now on my calendar17:04
sdakeduonghq oh ya 1 hour17:04
*** jascott1 has quit IRC17:05
duonghqsdake, nice17:06
*** sudipto has quit IRC17:07
*** sudipto_ has quit IRC17:07
sbezverkkfox1111: please check in memcached ps the way I do it now, and let me know if it does not conflict with what you would like to have17:08
*** mgiles has quit IRC17:08
kfox1111k17:08
sbezverkkfox1111: another thing I want to push ps to limit port name to 15 bytes17:08
*** inc0 has quit IRC17:08
*** rmart04 has joined #openstack-kolla17:09
sbezverkit tunred out very easy to break chart17:09
sbezverkif it is not controlled17:09
kfox1111really? hmm.17:09
*** inc0 has joined #openstack-kolla17:09
*** mgiles has joined #openstack-kolla17:09
openstackgerritzhubingbing proposed openstack/kolla: Add vitrage images  https://review.openstack.org/41759317:10
duonghqsdake, I need to take a nap, see you later17:10
sdakeduonghq sounds good bro ;)17:10
*** sp__ has quit IRC17:11
*** sp___ has quit IRC17:11
sbezverkkfox1111: yep port name > 15 fails chart deployment17:12
sbezverksince we use elementname var, I bet somebody will use name longer17:12
*** rmart04 has quit IRC17:14
kfox1111weird.17:14
kfox1111does it fail in k8s?17:14
kfox1111or just helm?17:14
kfox1111(is it a helm bug?)17:15
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Adding kubernetes imposed limit for port names  https://review.openstack.org/42212217:18
sbezverkkfox1111: yes with wrong spec thing17:19
kfox1111so the spec requires port name to be <= 15?17:19
sbezverkkfox1111: it is not a bug, it is limitation forced by kuberenetes spec17:19
kfox1111k.17:19
*** v1k0d3n has quit IRC17:21
kfox1111looks good to me.17:22
*** matrohon_ has quit IRC17:23
inc0kfox1111, let's assume I write support for galera in k8s/charts17:24
inc0do you think we can move kolla-k8s to use it?17:24
kfox1111so assumed.17:24
inc0if it gets inc0's seal of approval17:25
*** unicell has quit IRC17:25
*** rhallisey has joined #openstack-kolla17:25
inc0I want to set a precedence there;)17:25
kfox1111well, I think thats kind of more of an orchestration question?17:25
kfox1111for microservices, you can use whatever building blocks you want.17:25
kfox1111also, where do the containers come from?17:26
kfox1111back from kolla?17:26
inc0yeah, but there is world of difference between "you can" and "default"17:26
inc0kolla17:26
inc0I see no reason not to17:26
inc0use kolla built galera images17:26
kfox1111but wouldn't 'helm native' imply they should come from mariadb?17:26
inc0maybe, if mariadb people would like to take over, we would discuss17:27
*** lrensing has quit IRC17:27
inc0but imho better to have kolla-based galera than none at all17:27
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Adding kubernetes imposed limit for port names  https://review.openstack.org/42212217:27
kfox1111I agree.17:27
kfox1111just wondering what they will think of it pointing back to kolla instead of upstream.17:28
openstackgerritzhubingbing proposed openstack/kolla: Add vitrage images  https://review.openstack.org/41759317:28
kfox1111will they block it?17:28
kfox1111etc.17:28
inc0there is only one way to check it:) also kolla *is* upstream17:28
*** lrensing has joined #openstack-kolla17:28
kfox1111kolla is upstream for kolla.17:28
inc0and by doing this, I kinda sign ourselves to support it17:29
kfox1111but your submitting something to kubernetes/charts. very different use case.17:29
inc0and as long as we support it, we choose images we feel comfortable with17:29
kfox1111or are you going to call it kolla-galera or something?17:29
inc0that's my reasoning17:29
kfox1111sounds reasonable to me. but I dont run that community. :)17:29
kfox1111I'd recommend verifying with them before putting in a bunch of work though.17:30
*** jtriley has quit IRC17:32
openstackgerritzhubingbing proposed openstack/kolla: Add vitrage images  https://review.openstack.org/41759317:33
*** harlowja has quit IRC17:33
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test rebooting in the gate  https://review.openstack.org/41319317:33
*** v1k0d3n has joined #openstack-kolla17:35
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Adding kubernetes imposed limit for port names  https://review.openstack.org/42212217:37
*** yangzb09 has quit IRC17:37
*** david-lyle is now known as bailing-wire17:37
*** jtriley has joined #openstack-kolla17:43
*** msimonin has joined #openstack-kolla17:44
kfox1111sbezverk: does the operator make a configmap per memcached deployed to track state?17:44
sbezverkkfox1111: yes17:45
kfox1111k. just double checkinng I was understanding what I was reading.17:45
kfox1111there's a fair amount of code here, and I've only spent like 5 min reading through it. but if I understand the general workings properly, it looks good to me. :)17:46
*** bailing-wire has quit IRC17:46
*** DanyC has joined #openstack-kolla17:47
sbezverkkfox1111: thanks. so far I track states of all parameters and can deploy service and memcached deployment. there is one check missing for the actual pod being in running state.17:48
*** DanyC has left #openstack-kolla17:48
kfox1111nice. :)17:50
kfox1111this is a bit weird: http://logs.openstack.org/93/413193/40/experimental/gate-kolla-kubernetes-deploy-centos-binary-2-iscsi-nv/59fc4d5/console.html17:50
kfox1111only happening on the iscsi gate.17:50
kfox1111maybe they removed the lvm2 package from the vm's?17:51
kfox1111looks like its doing a yum install without the -y.17:51
des_consoladohey maybe somebody can share some insight on this: https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/neutron/tasks/start.yml#L51-L53 - the split thing, does this mean that somehow if we pass lots of bridge names and neutron external interfaces separated by , characters then they all get used? Or is this just some kind of code safety measure?17:51
sbezverkkfox1111: really strange17:53
des_consoladois it like, e.g. we have 3 compute nodes, if we put br-ex1,br-ex2,br-ex3 in the bridge name and eno0,ens2f0,eth0 in the neutron external interface variable, then the first pair will be for the first compute node, the second for the second and so on?17:54
sbezverkI think I run check experimental last night and both iscsi were green17:54
des_consoladoseems a bit far-fetched and not really important for me right now, just curious17:54
kfox1111yeah. I'm guessing they changed images on us again.17:55
kfox1111the gate code seems broken with respect to installing lvm2, as it lacks the -y flag.17:56
kfox1111but if it was already installed, then it wouldn't need to ask to install it.17:56
sbezverkkfox1111: at 10:35 it worked http://logs.openstack.org/57/421457/3/experimental/gate-kolla-kubernetes-deploy-centos-binary-2-iscsi-nv/8cb1eba/17:56
kfox1111http://logs.openstack.org/57/421457/3/experimental/gate-kolla-kubernetes-deploy-centos-binary-2-iscsi-nv/8cb1eba/console.html#_2017-01-18_15_06_30_41181717:57
kfox1111yup. in taht case, it was already installed.17:57
*** sayantani01 has quit IRC18:01
*** prameswar has quit IRC18:01
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Fix missing yum install -y in gate.  https://review.openstack.org/42214718:02
*** zhubingbing has quit IRC18:05
*** athomas has quit IRC18:09
*** sambetts is now known as sambetts|afk18:11
*** prameswar has joined #openstack-kolla18:14
*** shardy has quit IRC18:15
*** shardy has joined #openstack-kolla18:16
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test rebooting in the gate  https://review.openstack.org/41319318:20
sbezverksdake: please ack https://review.openstack.org/#/c/422122/18:20
sdakesbezverk i'll review it first ;)18:21
sbezverksdake: I would not think otherwise18:21
*** unicell has joined #openstack-kolla18:23
sdake"Your internet is unstable"18:25
sdakelol18:25
sdakesbezverk its not loading at present18:25
sdakecvo such a pOS18:25
sbezverksdake: you should stop wathcing history channel on the background ;)18:25
*** sacharya has quit IRC18:27
*** sdake has quit IRC18:30
openstackgerritFrancisco Edigleison Barbosa proposed openstack/kolla: Add how configure backend to cinder HNAS iSCSI driver guide  https://review.openstack.org/42215718:34
*** absubram has joined #openstack-kolla18:35
*** krtaylor has quit IRC18:36
*** DanyC has joined #openstack-kolla18:39
*** sdake has joined #openstack-kolla18:40
sbezverksdake: did you get your internet up?18:45
sdakeyup18:45
sdakelooking now18:45
*** fguillot has joined #openstack-kolla18:45
*** v1k0d3n has quit IRC18:48
*** prameswar has quit IRC18:48
*** MasterOfBugs has joined #openstack-kolla18:51
*** pramodrj07 has joined #openstack-kolla18:51
*** v1k0d3n has joined #openstack-kolla18:52
*** shardy is now known as shardy_afk18:52
openstackgerritMerged openstack/kolla-kubernetes: Adding kubernetes imposed limit for port names  https://review.openstack.org/42212218:53
*** DanyC has left #openstack-kolla18:54
*** pramodrj07 has quit IRC18:54
*** MasterOfBugs has quit IRC18:54
*** MasterOfBugs has joined #openstack-kolla18:58
*** pramodrj07 has joined #openstack-kolla19:00
*** sayantani01 has joined #openstack-kolla19:01
duonghqthank you sdake for the invitation19:01
*** huikang has joined #openstack-kolla19:01
*** krtaylor has joined #openstack-kolla19:03
sdakeduonghq thank Lachie on slack :)19:05
duonghqnight sdake19:06
*** MasterOfBugs has quit IRC19:06
*** pramodrj07 has quit IRC19:06
duonghqsee you later19:06
*** PramodJ has joined #openstack-kolla19:06
duonghqcan not help much this time :(19:07
*** MasterOfBugs has joined #openstack-kolla19:07
*** duonghq has quit IRC19:08
*** sdake_ has joined #openstack-kolla19:10
*** sdake has quit IRC19:14
kfox1111https://github.com/kubernetes/helm/issues/183419:16
*** absubram has quit IRC19:17
*** goldyfruit has joined #openstack-kolla19:18
kfox1111does kolla have a container for cephfs yet?19:19
sdake_anyone have the link - i seem to have misplaced it ot the etherpad19:19
kfox1111which link?19:20
sdake_the one on the helm working group19:21
sdake_i've got like literally 80 chrome windows open19:21
sdake_and i'm not sure where it is :)19:21
kfox1111not sure I have a link to that. :/19:22
*** absubram has joined #openstack-kolla19:22
*** sdake_ is now known as sdkae19:23
*** sdkae is now known as sdake19:23
sdakekfox1111 nick change19:23
sdakeinc0 do you ahve a link to that19:23
*** salv-orlando has joined #openstack-kolla19:27
*** DanyC has joined #openstack-kolla19:28
sdakeanyone have a link to that sbezverk ?19:32
*** sacharya has joined #openstack-kolla19:33
*** DanyC has quit IRC19:33
sdakehere it is: https://etherpad.openstack.org/p/openstack-helm19:33
sdakeadd issues there pls19:33
sdakeand we can prioritize them from our side in etherpad19:33
*** huikang has quit IRC19:43
*** jascott1 has joined #openstack-kolla19:43
*** huikang has joined #openstack-kolla19:44
openstackgerritDan Prince proposed openstack/kolla: Add nova-placement-api packages  https://review.openstack.org/42218519:44
sdakefolks - if you ahve an issue in the helm issue tracker, please add it to the top of this etherpad: https://etherpad.openstack.org/p/openstack-helm19:45
sdakeso we can prioritize them g lobally across openstack deployment projects19:45
*** huikang has quit IRC19:47
*** huikang has joined #openstack-kolla19:47
des_consoladohey do you guys use any commands to view all the docker networking/namespaces/sockets stuff?19:48
*** matrohon has joined #openstack-kolla19:49
des_consoladoI'm just poking around at this point, I see that the openvswitch_vswitchd container has some stuff going on in the run directory that is also going on in the host's run directory and obviously this is how the container controls the switch stuff for the host yada yada...19:51
des_consoladoI'd really like to see all the under the hood stuff tho, if there were some commands I could run or some conf I could look at that would show me all of these unix daemon sockets (a concept I'm not the most familiar with but I guess it's just like a network socket except it's a process socket and you can't do like TCP/IP stuff with it, just process communication)19:52
des_consoladoand also I've read that docker uses netns, I see there's a netns dir on the host but there's nothing in it... I know neutron uses netns and I can netns to a neutron router... Why aren't there any docker netns's?19:53
des_consoladodamn everyone's gone home19:56
jrich523ehterpad, is that a fork of chloroformPad?19:56
jrich523im home and at work19:56
des_consoladoI'm at the office but no one is here... just waiting to meet a friend... do you know anything about all this crazy shit I just asked about? ^^ :P19:56
jrich523i very highly doubt it, but i'll read it19:56
openstackgerritDan Prince proposed openstack/kolla: Add nova-placement-api packages  https://review.openstack.org/42218519:56
jrich523oh, i had this very same question once19:57
jrich523sadly, i dont recall the answer19:57
des_consoladoawwww you bastard19:57
jrich523i want to say it was a form of docker ps19:57
jrich523but, let me see if i have notes19:57
des_consoladoI know of docker ps and inspect of course... I need to join the dots though... I should probably spend more time staring at inspect, always seems hope in there19:58
jrich523wait, you're looking for forwarded ports right?19:58
des_consoladoyou mean linked ports? no I think I know how to see that, that should show in ps as well as inspect20:00
*** bailing-wire has joined #openstack-kolla20:00
jrich523well there is docker network list, but im guessing you saw that20:00
des_consoladokolla sticks everything in containers so I'm wanting to see all the unix domain socket stuff if it's possible20:00
des_consoladoand all the netns stuff20:01
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP memcached operator  https://review.openstack.org/41807320:01
jrich523hmm i think what i had attempted to do was pull the mapping (NAT)20:01
jrich523which is in iptables it seems20:01
*** bailing-wire is now known as david-lyle20:02
kbaegisIs tacker on the roadmap for kolla?20:03
*** salv-orlando has quit IRC20:04
kbaegisnevermind. :) https://blueprints.launchpad.net/kolla/+spec/tacker-support20:04
*** Serlex has quit IRC20:04
*** DanyC has joined #openstack-kolla20:05
*** DanyC has quit IRC20:09
*** krtaylor has quit IRC20:10
*** jemcevoy has joined #openstack-kolla20:11
jemcevoyHas anyone seen ceph_mon stuck in a restart loop?   Any idea how to fix it? ocker exec -i ceph_mon ceph -s20:12
jemcevoyError response from daemon: Container a944e4e11f601d4d58bbbebd06d3290421ca396914963f09381c7cd3b223b77b is restarting, wait until the container is running20:12
kbaegisdocker logs —follow should hlep20:13
jemcevoyIt is also spewing syslog message to the consoke20:13
kbaegis*help20:13
jemcevoyThanks20:13
kbaegisceph is a complex component. I suspect that it's not able to find storage, but I don't know that20:13
*** msimonin has left #openstack-kolla20:15
jemcevoykbaegins The log must be gigabytes...20:16
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test rebooting in the gate  https://review.openstack.org/41319320:18
jemcevoyunning command: '/usr/bin/ceph-mon -d -i 10.10.4.2 --public-addr 10.10.4.2:6789'20:18
jemcevoyerror: monitor data filesystem reached concerning levels of available storage space (available: 5% 2669 MB)20:18
jemcevoyyou may adjust 'mon data avail crit' to a lower value to make this go away (default: 5%)20:18
jemcevoyThere is the reason20:19
jemcevoythanks kbaegins20:19
*** matrohon has quit IRC20:19
*** huikang has quit IRC20:21
*** huikang has joined #openstack-kolla20:23
kfox1111can I get a second please: https://review.openstack.org/#/c/422147/20:23
*** krtaylor has joined #openstack-kolla20:25
*** dturner has quit IRC20:27
*** adrian_otto has quit IRC20:38
*** jemcevoy has quit IRC20:40
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Rabbitmq service deployment with entrypoint  https://review.openstack.org/42222920:41
bmacekfox1111: i missed the helm meeting this morning.  was underscore vs. dash in file names discussed?20:42
*** absubram has quit IRC20:43
*** huikang has quit IRC20:46
kfox1111no. forgot about it. :/20:48
kfox1111can bring it up on the slack channel...20:48
bmacenooooooooo!  lol20:48
kfox1111I just asked on the slack channel. lets see what pops up.20:52
bmacekk, thanks.  our corp firewall thinks slack is a dangerous place ;)20:53
kfox1111heh.20:54
kfox1111yeah... things like words happen there. :)20:54
bmacewords and books.  nothing more dangerous.20:55
kfox1111its funny, cause our corperate policy is the exact opposite. slack is safe, but irc is an evil hacker tool. ;)20:55
*** haplo37_ has quit IRC20:55
*** v1k0d3n has quit IRC20:56
*** haplo37_ has joined #openstack-kolla20:58
sbezverkkfox1111: looks like adding -y does not help, still failing :(20:59
*** absubram has joined #openstack-kolla21:00
* portdirect rejoins the living :/21:00
*** adrian_otto has joined #openstack-kolla21:01
kfox1111sbezverk: where?21:01
kfox1111the other one failed on the docker registry.21:02
mgilesAnybody have any thought about what might be causing the entrypoint test to fail on this ps (I know kfox1111 is working on the centos/iscsi failure)?21:02
kfox1111it did seem to work here: http://logs.openstack.org/47/422147/1/experimental/gate-kolla-kubernetes-deploy-centos-binary-2-iscsi-nv/51ce18e/console.html#_2017-01-18_20_23_39_70906921:02
mgileshttps://review.openstack.org/#/c/421457/21:02
kfox1111hmm... saw that when debugging the v3 gate...21:03
kfox1111but this should be v2.21:03
portdirectbmace: looks like there is a preference for '-'21:03
* portdirect continues reading scroll back on one million screens21:04
sbezverkmgiles: you need to recheck it I think21:04
mgilesok.  I'll try, alhtough I saw the same failure 2x in a row21:04
*** jheroux has quit IRC21:05
mgilesmaybe third time's a charm?  :)21:05
sbezverkmgiles: where they identical? I thought 1st failure were different, but I could be wrong21:06
mgilessbezverk seen the same error on all runs on ps321:06
mgilesAlso saw that error on ps1 before I split the nova-control and nova-compute21:06
bmaceportdirect: kk, i think we sort of determined that through looking at the contents of that helm git repo with all the implementations where underscore was only ever used as a prefix, but someone had wanted to ask them directly just in case.  so they said that in slack?21:07
kfox1111mgiles: whats the volume mount in nova_compute for?21:07
kfox1111did that break things?21:07
mgilesThat was to add the port dependency21:08
mgilesI don't think it's related since that mount didn't exist in ps1 and I saw the same error.21:08
openstackgerritMerged openstack/kolla-kubernetes: Improve docker images pulling  https://review.openstack.org/42121021:09
mgilessorry - socket, not port - typing too fast21:09
kfox1111still a bit weirded out though, as its not happening on other gates.21:09
*** jheroux has joined #openstack-kolla21:10
sbezverkkfox1111: remember when I was playing with iscsi gates there was a state barrier missing when cinder volume got detach and then re-attach to the instance21:10
portdirectbmace: yes, that info comes straight from the project lead via slack21:10
sbezverkthe error was the same21:10
kfox1111sbezverk: yeah, but I thought you fixed that.21:10
portdirectbmace: still use _ to exclude files from being rendered directly but for everything else use a '-' between words21:11
sbezverkkfox1111: right, unless it got removed somehow21:11
bmaceportdirect: perfect.  as long as folks stop adding new stuff with underscores i can try to fix our jumble :)21:11
kfox1111hmm.... but that would only happen if it was based on a really old ps, if it was in gate and other things would be affected too, or it was removed in the ps, and we'd see it.21:12
kfox1111still... something weird is going on.21:12
sbezverkkfox1111: do we collect know the state of cinder volumes at the failure time?21:12
kfox1111I wana say yes, but don't remember for sure.21:12
kfox1111weird weird weird...21:13
kfox1111ssh $USER@$line 'sudo sed -i "s/^SELINUX=.*/SELINUX=disabled/" /etc/sysconfig/selinux' should disable selinux....21:13
kfox1111but isn.t21:13
kfox1111what am I missing....21:14
*** pramodrj07 has joined #openstack-kolla21:15
sbezverkkfox1111: I think it will replace into SELINUX=SELINUX=disabled21:15
kfox1111should replace any value of SELINUX with disabled.21:15
kfox1111but its still enabled after reboot...21:16
kfox1111maybe I should just copy it over as a shell script and run it.......21:16
*** lrensing has quit IRC21:17
*** lrensing has joined #openstack-kolla21:18
*** PramodJ has quit IRC21:18
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test rebooting in the gate  https://review.openstack.org/41319321:20
kfox1111is there a container for cephfs yet?21:21
*** absubram has quit IRC21:21
sdakeoh we forgot to ask th _ vs - thing :)21:22
sdakekfox1111 its /etc/config/selinux21:22
sdakenot sysconfig21:22
sdakepretty sure21:22
sdakebut not certain21:22
sdakekfox1111 check your own centos bos for the file21:22
*** v1k0d3n has joined #openstack-kolla21:23
kfox1111yeah. that I know for sure. its /etc/sysconfig/selinux21:23
portdirectits /etc/selinux/config on 7.2 at least21:23
kfox1111hmm...21:23
kfox1111lrwxrwxrwx. 1 root root 17 Jul 11  2014 /etc/sysconfig/selinux -> ../selinux/config21:23
portdirectlol - both right21:23
kfox1111symlink now...21:23
sbezverkkfox1111: I think first volume attach is missing these two commands21:24
sbezverkwait_for_cinder test available21:24
sbezverkwait_for_cinder test attaching21:24
*** JoseMello has quit IRC21:25
sbezverkhttps://github.com/openstack/kolla-kubernetes/blob/master/tests/bin/basic_tests.sh#L10221:25
*** pramodrj07 has quit IRC21:25
*** MasterOfBugs has quit IRC21:25
*** pramodrj07 has joined #openstack-kolla21:26
*** MasterOfBugs has joined #openstack-kolla21:26
kfox1111yeah, its possible I guess.21:26
kfox1111did the output of 120 show it in a nonn attached state?21:26
sbezverkmgiles: could you add two commands from above at line 10321:27
sbezverkyes volume was in avaiable state21:27
kfox1111hmm...21:27
kfox1111available is a failed state too.21:27
mgilessbezverk will do21:27
kfox1111if you attach and it fails to attach, it will reenter available state.21:27
sbezverkkfox1111: not sure, I do not think cinder resets states??21:28
kfox1111you might need a third line abouve the other two for creating?21:28
kfox1111cinder doesn't, but nova does. :/21:29
*** sdake_ has joined #openstack-kolla21:29
openstackgerritEdmund Rhudy proposed openstack/kolla: Add block for dumb-init installation  https://review.openstack.org/42224921:30
sbezverkkfox1111: let's start with these two21:30
sbezverkand then decide21:30
*** krtaylor has quit IRC21:30
*** sdake has quit IRC21:32
kfox1111if it shows up in creating though first,21:33
kfox1111then the other two will be skipped, then when they enter that state, won't be checked.21:33
*** absubram has joined #openstack-kolla21:33
*** l4yerffeJ has quit IRC21:34
*** Jeffrey4l has quit IRC21:35
*** Jeffrey4l has joined #openstack-kolla21:35
kfox1111http://logs.openstack.org/57/421457/3/experimental/gate-kolla-kubernetes-deploy-centos-binary-2-helm-entrypoint-nv/82f5865/logs/openstack/kolla-nova-compute-9f0b6.txt is really strange looking.21:38
openstackgerritMark Giles proposed openstack/kolla-kubernetes: WIP - Nova service deployment  https://review.openstack.org/42145721:38
kfox1111oh.21:39
*** tyrola has quit IRC21:39
kfox1111mgiles: did you remove the nova libvirt secret by mistake?21:39
mgileskfox1111 still created at line 68 of ceph_workflow_service.sh21:40
*** tyrola has joined #openstack-kolla21:41
kfox1111hmm....21:41
kfox1111http://logs.openstack.org/57/421457/3/experimental/gate-kolla-kubernetes-deploy-centos-binary-2-helm-entrypoint-nv/82f5865/logs/virsh-secret-list.txt is empty.21:42
kfox1111need a ceph_backend=true somewhere maybe?21:44
inc0kfox1111, so I'm looking at sed in gates21:45
inc0for image tag21:45
inc0looks dirty...can we just explicitly say that it's 4.0.0 across the board?21:45
kfox1111not easily yet.21:46
mgileskfox1111 that could be - I'll take a look21:47
*** huikang has joined #openstack-kolla21:47
*** severion has joined #openstack-kolla21:47
kfox1111yeah. I think that may be the issue. ceph_backend on libvirt needs to be set and I don't see it being set now.21:47
mgilesaaahh  I see21:48
mgileslet me try that - thanks21:48
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Rabbitmq service deployment with entrypoint  https://review.openstack.org/42222921:48
*** huikang has quit IRC21:51
kfox1111np.21:52
inc0kfox1111, idk...shellscript seding configs on the fly seems bad to me:/21:53
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test rebooting in the gate  https://review.openstack.org/41319321:54
kfox1111inc0: I don't disagree...21:55
*** severion has quit IRC21:56
kfox1111but I think its probably the least of the possible evils at the  moment.21:56
inc0kfox1111, so there is no single default anywhere?21:56
*** severion has joined #openstack-kolla21:56
kfox1111no. there are 3.0.2 and 2.0.2 container values.21:57
kfox1111they all need updating to 4.0.0 for trunk.21:57
kfox1111you could override them on another config file used when the launch is run,21:58
*** severion has quit IRC21:58
kfox1111but I'd like to be able to push the built packages to tarballs.o.o and they should have the right versions backed into the packages.21:58
kfox1111we can talk more about that though at the ptg.21:59
*** severion has joined #openstack-kolla22:00
*** severion is now known as v1k0d3m22:00
erhudythe docker stuff in the registry seems a bit mad22:00
openstackgerritMerged openstack/kolla-kubernetes: Use upper constraints for all the jobs in tox.ini  https://review.openstack.org/42106322:00
erhudythat was word salad, let's try again22:01
inc0erhudy, what do you mean?22:01
*** v1k0d3m has quit IRC22:01
erhudystand by while i remember how to speak english22:01
sbezverkkfox1111: I chatted with technosophos about helm upgrade, it looks like until configmap is not part of chart, I cannot use helm uprgade to reload main process on configmap change..22:02
sbezverkso for now I will use helm delete/helm install on the configuration change..22:02
erhudya lot of the gate jobs on the thing i just pushed exploded even though the entirety of the change was moving two commands into their own RUN and adding a block22:02
openstackgerritEduardo Gonzalez proposed openstack/kolla: Test fix gate  https://review.openstack.org/42227222:03
erhudya bit strange22:03
*** severion has joined #openstack-kolla22:03
erhudy"2017-01-18 21:35:38.629715 | docker: Error response from daemon: linux init cgroups path: mkdir /docker: not a directory." seems to be what the voting jobs are bailing on22:03
kfox1111sbezverk: an upgrade should still work if there is something that changes in the object.22:06
kfox1111I think. let me double check..22:06
sbezverkkfox1111: yeah but the object which is known to helm is not changing..22:11
sbezverkconfigmap atm is not known/visible to release22:11
*** fguillot has quit IRC22:11
*** schwicht has quit IRC22:12
*** schwicht_at_work has joined #openstack-kolla22:12
kfox1111yeah, so either the name of the configmap would need to change,22:14
kfox1111or some other thing to twiddle a change to the object.22:14
kfox1111if you don't want to name it differently.22:14
kfox1111(I've done echo 1/2/3/etc at time to do that too)22:14
kfox1111but I really believe the new configmap should come in with a different mame.22:15
kfox1111or else deployment upgrade/downgrade won't work as intended.22:15
kfox1111configmaps need to be atomic the same ways as everything else.22:16
*** jheroux has quit IRC22:16
sbezverkkfox1111: when then kube introduced replace ;-)22:16
sbezverkwhy I meant22:16
kfox1111becuase people keep insisting on doing non atomic things. :/22:16
kfox1111that doesn't mean its right to use that way though.22:16
sbezverkI can make operator working with different configmap names but still it does not solve my problem22:17
kfox1111whats the problem?22:17
sbezverkreloading main process on the change22:17
kfox1111process I think should be:22:18
kfox11111. upload newer configmap with new name.22:18
kfox11112. helm upgrade existing deployment with the new configmap name22:18
kfox1111verify the deployment finishes rolling out.22:18
kfox11114. delete old configmap.22:18
kfox1111that should triggger k8s to do the container restarts.22:19
openstackgerritMark Giles proposed openstack/kolla-kubernetes: WIP - Nova service deployment  https://review.openstack.org/42145722:20
sbezverkok, from operator perspective. 1. Update TPR with new config map name, 2. operator detects the changes 3. triggers helm upgrade with new config map22:21
*** haplo37 has quit IRC22:22
kfox1111yeah. if configmaps are not managed by the operator, then yeah, thats the workflow.22:23
kfox1111if configmaps are managed by the operator, the config info would be in the 3rd party resource.22:23
*** v1k0d3n has quit IRC22:24
kfox1111if the 3rd party resource for config changes, it would upload a new version, helm upgrade the the deployment and remove the old one.22:24
*** severion has quit IRC22:24
*** portdirect is now known as shipindirect22:25
*** dave-mccowan has quit IRC22:28
*** jtriley has quit IRC22:28
*** lrensing has quit IRC22:29
*** haplo37 has joined #openstack-kolla22:31
*** david-lyle has quit IRC22:32
*** sdake_ has quit IRC22:38
*** sacharya has quit IRC22:39
*** david-lyle has joined #openstack-kolla22:40
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test rebooting in the gate  https://review.openstack.org/41319322:40
*** srwilkers has joined #openstack-kolla22:40
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Rabbitmq service deployment with entrypoint  https://review.openstack.org/42222922:45
*** jascott1 has quit IRC23:04
*** salv-orlando has joined #openstack-kolla23:05
*** jascott1 has joined #openstack-kolla23:05
*** jascott1 has quit IRC23:06
*** mgiles has quit IRC23:07
*** absubram has quit IRC23:09
*** salv-orlando has quit IRC23:09
*** sdake has joined #openstack-kolla23:11
*** saneax-_-|AFK is now known as saneax23:15
*** adrian_otto has quit IRC23:16
*** schwicht_at_work has quit IRC23:19
*** jrich523 is now known as MrGod23:21
*** MrGod is now known as jrich52323:22
inc0kfox1111, soo...for gates I should sed things over?23:23
inc0damn23:23
kfox1111yeah. I think thats probably best for now.23:24
*** sdake has quit IRC23:24
*** Jeffrey4l has quit IRC23:24
*** ccesario has quit IRC23:24
*** cliles has quit IRC23:24
*** bachp has quit IRC23:24
*** williamcaban has quit IRC23:24
*** stevemar has quit IRC23:24
*** goldyfruit has quit IRC23:24
kfox1111it could be added to the prebuild script, but then thats less 'helm native'23:24
kfox1111which seems to be a really dirty word.23:24
*** sdake has joined #openstack-kolla23:24
*** Jeffrey4l has joined #openstack-kolla23:24
*** ccesario has joined #openstack-kolla23:24
*** cliles has joined #openstack-kolla23:24
*** bachp has joined #openstack-kolla23:24
*** williamcaban has joined #openstack-kolla23:24
*** stevemar has joined #openstack-kolla23:24
*** sdake has quit IRC23:25
*** sdake has joined #openstack-kolla23:25
*** kbaegis has quit IRC23:26
inc0branch xt I assume means trunk?23:26
*** jascott1 has joined #openstack-kolla23:27
kfox1111yeah. t is trunk.23:27
kfox1111inc0: I filed https://github.com/kubernetes/helm/issues/1834, which has some feature requests that should make that better in the future.23:28
inc0thanks a lot23:29
kfox1111specifically, the third issue is relevent.23:29
*** Jeffrey4l has quit IRC23:29
*** adrian_otto has joined #openstack-kolla23:32
ScoopIcicleOur issues synergize our analytics-based uniformity.23:34
kfox1111heh.23:35
*** sayantani01 has quit IRC23:35
kfox1111thats right up there with the wan network storage syncronization company that was selling "zero latency".23:36
*** ruhe has joined #openstack-kolla23:36
ScoopIcicleMobile strategies culturally empower the key representatives. Feedback, reward and line-of-sight operationalize our capability, while the Chief Controlling Officer enhances our delivery frameworks reaped from our significant improvement.23:36
kfox1111:)23:37
sdakekfox1111 rofl23:39
kfox1111sdake: the company went out of buisness shortly after I saw that on their website. :)23:40
kfox1111sbezverk: technosophos confirmed just changing the configmap name would work with a helm upgrade.23:40
*** Jeffrey4l has joined #openstack-kolla23:41
*** sacharya has joined #openstack-kolla23:41
*** tonanhngo has quit IRC23:41
*** tonanhngo has joined #openstack-kolla23:42
*** Jeffrey4l has quit IRC23:42
*** Jeffrey4l has joined #openstack-kolla23:42
*** shipindirect is now known as portdirect23:43
sdakesup portdirect23:46
portdirectjust ruined my sleep schedule again :/23:47
portdirectmorning (kinda)23:48
sbezverkkfox1111: ok sounds good I will test arround this solution..23:48
sdakesbezverk portdirect is the summit submission ready to rock?23:48
portdirecthow did helm go? sorry I didnt make it23:48
sdakeportdirect went fantastically well23:48
sdakeI assume the video will be out shortly23:48
sbezverkkfox1111: are you busy? I think I came accross an issue and need a second pair of eyes to confirm..23:51
kfox1111I can look. whats up?23:52
sbezverkkfox1111: it looks like when we specify element_name in the command line works for microservices but does not work for services.. Could you check on your end if it is the case..23:53
kfox1111hmm...23:54
sbezverkbasically with deploying service if element_name is not backed by default it does not get rendered23:54
kfox1111element_name will be a Value of the service package. it won't get passed to the microservices.23:54
kfox1111thats an interesting problem.23:54
sbezverkkfox1111: very for last time I am scrathcing my head how it could happen23:55
sbezverklast hour that was..23:55
sbezverkwe have tons of dependencies for element_name in microservices23:55
sbezverkand I think the only reason we do not see massive issue is because of default23:55
kfox1111yeah...23:56
kfox1111so, it seems like what we might want, is something like the global api for the element_name.23:56
kfox1111set it it globals once and it ripples through...23:57
sbezverkkfox1111: or per service23:57
*** ruhe has quit IRC23:57
kfox1111yeah.23:57
kfox1111like globals.kolla.nova.all.element_name ... etc.23:57
sbezverkglobal/kolla/rabbitmq/all/element_name23:57
kfox1111yeah.23:57
sbezverkthen we should be able to override it23:58
sbezverkeven from the command line I hope23:58
kfox1111yeah.23:58
kfox1111I did try overriding things with dots. it does work.23:58
kfox1111would have to override it like --set globals.kolla.nova.all.element_name=foo though.23:58
kfox1111or in a values.yaml.23:58
kfox1111but I think the use case will probably be,23:58
*** ruhe has joined #openstack-kolla23:58
kfox1111embed mariadb/rabbit/memcached service package in nova/glance/etc service pckage,23:59
sbezverkman not everybody will rememeber this path23:59
kfox1111and the default values.yaml for the service package sets element_name to mariadb-<servicepackagename>23:59
sbezverkwe should have default in all.yaml23:59
jrich523i've already forgotten it23:59
*** ruhe has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!