Tuesday, 2017-01-24

kfox1111jascott1: the global api has a mechanism to provide multiple levels of value lookups, so that setting values that are general with one value, and refining them with possibly more values is possible.00:00
jascott1yes00:00
kfox1111it would solve the "I want to set one value and get all of mariadb-pv, mariadb-svc, mariadb-statefulset" etc, conditionally on.00:00
kfox1111but it does require a macro to run.00:00
kfox1111what if the code in helm was changed to rather then a value, called a gotl template and used the result?00:01
kfox1111then the values could be processed through the template to provide much richer logic?00:01
jascott1templating values?00:01
jascott1templating the values file itself?00:01
kfox1111no, templating the subpackage selection.00:01
kfox1111rather then just reading the raw values.00:01
jascott1"values processed through the template"00:02
kfox1111instad of the 2 pass processing, make it 3:00:02
kfox11111. process all non conditional templates and load them for processing.00:03
kfox11112. run macro's in that environment specified in the conditinoal subchart's conditions line00:03
kfox1111if enabled, load those charts into environment too.00:03
kfox11113 process all the loaded templates.00:03
jascott1oh you meant template the condition or put logic in it00:03
kfox1111yeah. instead of the condition line having values to look for booleans for enabled,00:04
kfox1111call the privided macro isntead and use the output to determine enabled or not.00:04
kfox1111the provided macro can be the kolla_get_val_str method in our case,00:04
kfox1111and we can use the global api then to do the enabled lookups.00:05
portdirectman that sounds complex00:05
jascott1brb00:05
kfox1111thats the drawback. but would handle a lot more cases then the current proposal.00:06
kfox1111as the conditional logic comes from gotl with all its support for logic.00:06
kfox1111while the values solution only supports flat bools.00:06
portdirectcould you not do this just through addint he logic into each template?00:07
openstackgerritsayantani proposed openstack/kolla-ansible: Update bifrost playbooks  https://review.openstack.org/42438400:07
kfox1111thats the other way to do it.00:07
jascott1but what does kolla_get_val_str get you?00:08
kfox1111we have prototyped that in memcached already.00:08
portdirectwhere?00:08
* portdirect goes to github00:08
* jascott1 goes home00:08
kfox1111jascott1: a tree structure where you can hang off values that affect multiple packages.00:08
kfox1111portdirect: helm/microservice/memcached-deployment/templates/memcached-deployment.yaml00:09
jascott1we need the inverse as well tho, this rabbit needs different settings than that00:09
kfox1111portdirect: there's an enabled flag there that will enable/disable that template.00:09
kfox1111jascott1: the global api provides that too.00:09
jascott1using condition field i can already access global api00:09
kfox1111the global value space in helm becomes a tree.00:09
*** schwicht has quit IRC00:09
jascott1imeant global values00:09
kfox1111the levels of the tree get more and more specific to individual packages.00:10
kfox1111so you can target a value between all packages, and just one, or somewhere in between.00:10
*** schwicht has joined #openstack-kolla00:10
kfox1111like, all nova services.00:10
jascott1yes00:10
*** portdirect is now known as portdirect_awayz00:10
kfox1111jascott1: hmm...00:10
kfox1111can you put a list in conditionals,00:11
kfox1111and have it honor the first defined one?00:11
jascott1would be easy00:11
kfox1111that may do the trick.00:11
jascott1but some would want compounds or other logic00:11
jascott1kfox1111 think I see what you mean tho00:11
kfox1111yeah. I can see them wanting logic. which was where the gotl idea was for.00:12
*** schwicht has quit IRC00:12
*** schwicht has joined #openstack-kolla00:12
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Openvswitch Service package with kuberentes entrypoint  https://review.openstack.org/42418200:12
kfox1111jascott1: so, have a look at this.00:12
kfox1111helm/microservice/memcached-deployment/templates/memcached-deployment.yaml00:12
jascott1alright I will add it to the existing percolations bubbling in my head00:13
kfox1111see search path:00:13
kfox1111{{- $searchPath := printf ":global.kolla.%s.deployment:global.kolla.%s.all:global.kolla.memcached.deployment:global.ko00:13
kfox1111lla.memcached.all:global.kolla.all" $elementName $elementName }}00:13
jascott1ya00:13
kfox1111what that means, is, if the user defines 'enabled' at:00:13
jascott1be a lot easier in helm since its go and not just gotpl00:13
kfox1111globals.kolla.mymariadb.deployment.enabled=true, it will honor that.00:14
*** schwicht has quit IRC00:14
kfox1111but they also can go up higher and do it really generically, globals.kolla.memcached.all.enabled=false00:14
kfox1111turn off all memcached's everywhere by default.00:14
kfox1111if those two entries were placed in a users values.yaml,00:15
kfox1111they could laucjn several servcie pakcages, and get only a mariadb on the one service.00:15
*** schwicht has joined #openstack-kolla00:15
kfox1111the problem with that package htough, is the search path is dynamic...00:16
kfox1111so wouldn't exactly work with a static value path in dependencies.yaml.00:17
kfox1111but if the service package didn't allow the user to rename the embeded package, then it would be possible to statically define it I guess.00:17
openstackgerritsayantani proposed openstack/kolla-ansible: Update bifrost playbooks  https://review.openstack.org/42438400:17
kfox1111I don't know. tradeoffs there.00:17
kfox1111but, values lists could work.00:18
kfox1111so could macro based.00:18
kfox1111so, up to you I guess which one?00:18
jascott1i will keep digin00:18
*** schwicht_ has joined #openstack-kolla00:19
kfox1111k.00:19
kfox1111if you get the values thoug as a list of values where the first defined is used, and maybe even in the format defined in the other charts,  Ithink that would work though.00:19
*** inc0 has quit IRC00:20
*** schwicht has quit IRC00:20
kfox1111thought you couldn't say, do logic that said, enable pvc/disable pvc, and enable/pv if pvc is enabled and storage_class not defined.00:20
kfox1111which we may want?00:21
*** schwicht_ has quit IRC00:21
jascott1right thats getting into the logic00:21
jascott1none of the stuff in  this area sounds hard to implement in helm00:21
kfox1111cool.00:21
*** schwicht has joined #openstack-kolla00:21
jascott1cool thanks gonna bounce home but bbiab00:22
kfox1111k. thanks for talking it out. :)00:22
*** sayantani01 has joined #openstack-kolla00:25
*** schwicht has quit IRC00:26
*** schwicht has joined #openstack-kolla00:26
*** schwicht has quit IRC00:29
*** schwicht_at_work has joined #openstack-kolla00:29
*** schwicht_at_work has quit IRC00:32
*** schwicht_at_work has joined #openstack-kolla00:32
*** schwicht_at_work has quit IRC00:34
*** schwicht_at_work has joined #openstack-kolla00:35
*** adrian_otto has joined #openstack-kolla00:36
*** duonghq has joined #openstack-kolla00:37
duonghqmorning guys00:40
duonghqanybody got trouble with helm tiler (cannot pull from grc.io)00:41
portdirect_awayzyeah00:41
duonghqoh, docker 1.13.0 issue00:42
* duonghq sad00:42
portdirect_awayzkubectl delete –namespace=kube-system deploy tiller-deploy; helm init –tiller-image docker.io/port/tiller:v2.1.300:42
portdirect_awayzis a dodgy hack that works in the short term00:42
portdirect_awayzi promise that that image is clean :)00:42
duonghqthanks portdirect_awayz00:43
*** portdirect_awayz is now known as authz00:43
duonghqwhy do you transform into authz ?00:44
duonghqWill you go to PTG?00:44
authzto hide from people who dont notice :)00:44
authzyes - I got an email late tonight00:45
authzhave you had feeback00:45
*** huzhengchuan has joined #openstack-kolla00:45
duonghqya, no luck for me this time00:45
duonghqhow about you?00:45
authz:( that sucks00:45
authzyeah00:45
*** authz is now known as portdirect00:45
duonghqnice00:45
duonghqlooking for livestream00:46
portdirectwas surprised as i thought they were all going out on friday00:46
duonghqya00:46
portdirectI promise that I'll do everything I can to get you there (via stream) man00:47
portdirectthough i think inc0 is working on that00:47
portdirectas we were in the same boat its only fair i try to help you :)00:47
openstackgerritsayantani proposed openstack/kolla-ansible: Fix MySQL DB error in bifrost container  https://review.openstack.org/42439100:48
duonghqportdirect, thanks00:48
* portdirect back to lurking00:48
duonghqlast meeting, iirc inc0 and sdake is doing their best00:48
*** zhurong has joined #openstack-kolla00:48
*** portdirect is now known as pd_00:48
*** jtriley has joined #openstack-kolla00:49
duonghqnice to know you guys00:49
*** goldyfruit has joined #openstack-kolla00:54
*** cuongnv has joined #openstack-kolla00:57
openstackgerritsayantani proposed openstack/kolla: Update Bifrost documentation  https://review.openstack.org/41711400:59
duonghqpd_, I don't know why but your image is CrashBackLoop01:04
duonghqhttps://github.com/kubernetes/helm/issues/1838 painful issue here01:05
*** saneax is now known as saneax-_-|AFK01:06
*** sayantani01 has quit IRC01:08
*** zhubingbing has joined #openstack-kolla01:08
*** sayantani01 has joined #openstack-kolla01:09
*** nihilifer has quit IRC01:09
*** nihilifer has joined #openstack-kolla01:10
*** sayantan_ has joined #openstack-kolla01:11
*** sayantani01 has quit IRC01:13
*** sayantan_ has quit IRC01:16
*** goldyfruit has quit IRC01:18
*** sdake has joined #openstack-kolla01:20
sdakesup peeps01:21
jascott1yo01:21
duonghqsup sdake01:21
*** schwicht_at_work has quit IRC01:21
sdakeduonghq just finished eating, going to work on getting the dev env going01:22
sdakeand documented01:22
sdakerather the deploy01:22
sdakekfox1111 and portdirect made a patch for it01:22
duonghqroger01:22
sdakei tested it earlier this morning and it failed01:22
sdakeit needs some attention01:22
sdakethe dev env is going and documented01:23
duonghqtoday you have dinner sooner than usual?01:23
sdakeit wasn't that hard, portdirect did a mjaority of the work01:23
sdake6pm is pretty normal for me01:23
sdakebrb, need power cable01:23
kfox1111sorry. was fighting a fire. just got back.01:24
sdakekfox1111 - during the deploy operation i ran genconfig, and it failed with a reconfigure on memcachew01:27
sdakewhat is odd about  it is it failed with an error about 0.4.0-1 as the container version01:27
sdakei only spent 1 hour looking at it before my eye appointment which cratered my day01:27
jascott1kfox1111 threw a preliminary 'would anyone freak if we made conditions do logic etc' over to helm peeps and it was not shot down so thats promising :)01:28
sdakesup jascott101:29
jascott1hey mang!01:29
kfox1111sdake: I think I saw, while reviewing the ps, that the gate is pinning kolla-ansible back a bit.01:29
kfox1111maybe that is related?01:29
sdakeback a bit?01:29
sdakeyou mean an old version?01:29
kfox1111I think sbezverk put in the patch. but I don't remeber why off hand.01:29
sdakeright - so maybe master is broken01:30
kfox1111jascott1: awesome. :)01:30
kfox1111sdake: yeah. grep setup_gate.sh for 4.0.0.0b201:30
kfox1111looks like it is pulling back a bit.01:30
sdakei see thanks :)01:30
kfox1111np.01:31
sdakei found other problems in the script as well01:31
kfox1111I kind of forgot we did that. we should figure out why and unpin.01:31
sdakei'll update the review with the corrections01:31
sdakesay - where does the iscsi device come from in the iscsi dev deploy workflow script?01:32
kfox1111setup_gate_iscsi I think.01:33
kfox1111or something similar....01:34
kfox1111no, tests/bin/setup_gate_loopback_lvm.sh it looks like.01:34
kfox1111ah.. here's the docker issue's root: https://github.com/docker/docker/issues/3008301:35
bmace_sdake: talking about the dev container scripts sdake?  i was running through trying to get that working today based on the latest bits.  seems like maybe the recent memcache change is causing an issue in it.01:36
sdakebmace_ agreed its busted01:36
sdakealso kolla needs to be renamed kolla_ansible in the script01:36
bmace_sdake: happy to hear it wasn't just me :)01:37
kfox1111seems like other repos then google are affected too. :/01:37
kfox1111bmace_: yeah. the script is untested, but should be closeish. just gotta find the remaining bugs.01:37
bmace_yeah, i didn't like the whole flow of that.. i was working with my own version that handled a lot more of the dependency stuff during build, and also has kolla-kubernetes and kolla-ansible both right in /opt with the right names01:37
kfox1111feel free to make changes. :)01:38
kfox1111In my much earlier version, I prechecked out the stuff into the container during build too.01:39
bmace_if i had the whole thing actually working and i was confident in it i definitely would.01:39
kfox1111then only need to do git pulls during udpate.01:39
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Local registry in gate for trunk builds  https://review.openstack.org/41855001:39
*** schwicht has joined #openstack-kolla01:39
bmace_at this point things keep changing and so it keeps breaking in new ways :)01:40
sdakebmace_ think of that as a joint community review01:40
kfox1111yeah. I'm hoping the microservices stay relatively stable from here on out.01:40
sdakebmace_ and please push what you learn to it - this is blocking a whole slew of people01:40
kfox1111before it was changing rapidly.01:40
sdakekfox1111 you mean the microcharts01:40
sdake?01:40
kfox1111the more we can gate on too, the less likely that it will break in the future.01:41
kfox1111sdake: yeah.01:41
sdakekfox1111 yup that is correct.  as wel las the more developers looking at it :)01:41
kfox1111they should be mostly stable from here, with maybe some api additions rather then changes.01:41
kfox1111+101:41
bmace_at this point i am definitely happy just getting it working.  i reset a lot of my changes so most of my local changes now are just to get it to work behind our pretty strict firewall.  once it is completely working i'll go back and make some of my more drastic changes that people can chat / disagree about :)01:42
kfox1111cool.01:42
sdakebmace_ if you push a review tht works for me, I'd +14 million it :)01:42
openstackgerritzhubingbing proposed openstack/kolla-ansible: Add fluentd role  https://review.openstack.org/40739201:42
*** cuongnv is now known as cuong01:42
bmace_lol, well, need to figure out the memcache issue for now.  you said you were hitting the same issue?01:43
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Local registry in gate for trunk builds  https://review.openstack.org/41855001:43
sdakei wonder if ther e is a gerrit counter01:43
sdakebesides stackalytics01:43
*** cuong is now known as cuongnv01:43
kfox1111gotta head out for a while. l8r.01:43
sdakei've only done 2414 +2's for the lifetime of oenstack01:44
bmace_i hit the issue during config gen.. looks like it tries to "check memcached container"  and talk to docker to do that.. but during config gen it seems like it really shouldn't be doing all of that.01:44
sdakelater kfox1111 enjoy your evening01:44
sdakebmace_ have exact same issue01:44
bmace_back before the memcache change i had config gen working like a champ01:44
sdakebmace_ and agree with your assertion01:44
sdakewhich memcache change are you tlaking about?01:45
bmace_i think i saw one go in over the weekend, about using memcache rather than a db to do something or rather?  perhaps not causation but that is the only change related to memcache i noticed recently01:45
sdakebmace_ the bug is in kolla-ansible not kolla-kubernetes01:45
sdakegenconfig rusn out of kolla-ansible01:46
sdakebmace_ do you recall the deliverable the ptach went into so I can hunt it down and revert it in my local repo?01:46
bmace_sure, but was memcache enabled before for kubernetes?  there are still some enable / disable settings done into the ansible environment for certain services01:46
sdakei see what your saying01:46
sdakethat memcache was enabled in the default kubernetes config01:47
sdakeand this exposed a bug in genconfig01:47
bmace_yeah, that is my expectation.. something like that.01:47
sdakebrb connecting to vpn01:48
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Support rolling upgrades of horizon  https://review.openstack.org/33399601:50
*** sdake has quit IRC01:53
*** sdake has joined #openstack-kolla01:55
*** sdake has joined #openstack-kolla01:55
*** adrian_otto has quit IRC01:56
*** goldyfruit has joined #openstack-kolla01:59
*** Marcellin__ has quit IRC01:59
*** goldyfruit has quit IRC02:02
*** cuongnv_ has joined #openstack-kolla02:04
*** cuongnv has quit IRC02:06
bmace_i'm not great at debugging ansible issues, but it looks like for some reason it isn't properly ignoring the "Check memcached container" when we are doing a genconfig action.. do you know, does it always follow those in the right order?02:08
*** schwicht has quit IRC02:08
bmace_in ansible/roles/memcached/tasks/config.yml seems like if the genconfig check is first and it always follows the order maybe it will fix it?  we might be hitting the error when it goes to check to see if the service is enabled.. which is before it in the when flow right now02:09
bmace_another kind of annoying part of the current dev container thing, it always re-pulls kolla-ansible on run from upstream where i think it would be nicer if it just used both a local kolla-kubernetes and kolla-ansible so you can tweak things in both and test fixes, etc.02:11
bmace_afk for a few02:12
*** schwicht has joined #openstack-kolla02:24
sbezverkkfox1111: ping02:25
*** cuongnv has joined #openstack-kolla02:26
*** cuongnv_ has quit IRC02:29
sdakesbezverk kfox1111 went to bed i think :)02:34
sbezverksdake: ok thanks02:35
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for ceilometer  https://review.openstack.org/42360602:36
bmace_sdake: odd.. tweaked that line in place in my container and tried again.  same error.   maybe for some reason it isn't picking up the action is genconfig in there.02:36
bmace_hrm.. looks like action=config is what it is called when passed into the playbook, not genconfig02:38
jascott1kfox1111 in you pv/pvc example earlier storage_class is a values key right?02:38
bmace_sdake: fyi, that was the fix.. someone somewhere changed either config or genconfig and didn't catch all the places it effected the other.  any idea which way it should be?02:39
bmace_maybe genconfig is the old name?02:39
bmace_i only found the term genconfig used in keystone, glance, memcached, searchlight and senlin02:40
Pavoevening everyone02:43
sdakebmace_ can you paste a diff of he fix so i can see what your talking bout?02:43
bmace_sure02:44
*** harlowja has quit IRC02:44
sdakepavo sup02:44
Pavonotta, in Baltimore for the week02:44
Pavobored02:44
sdakesorry to hear it02:44
*** tovin07_ has joined #openstack-kolla02:44
kfox1111sbezverk: ping.02:45
bmace_diff --git a/ansible/roles/memcached/tasks/config.yml b/ansible/roles/memcached/tasks/config.yml02:45
bmace_index 6b00816..63438c6 10064402:45
bmace_--- a/ansible/roles/memcached/tasks/config.yml02:45
bmace_+++ b/ansible/roles/memcached/tasks/config.yml02:45
bmace_@@ -29,5 +29,5 @@02:45
bmace_   when:02:45
*** goldyfruit has joined #openstack-kolla02:45
bmace_     - inventory_hostname in groups[service.group]02:45
bmace_     - service.enabled | bool02:45
bmace_-    - action != "genconfig"02:45
bmace_+    - action != "config"02:45
bmace_   notify: Restart memcached container02:45
bmace_that is really it.. if you look at the genconfig command it passed the action as "config" not "genconfig"02:45
kfox1111jascott1: if pvc is enabled, and storage_class (or whatever its called), isn't defined, then they may want to create the pv right away)02:45
sdakebmace_ moment - at parents watching tv at 15 million decibels bekuz they are hard of hearing02:46
bmace_there are 5 or 6 containers that look to see if the action is "genconfig" to avoid doing certain actions, like checking container state, which will fail in a config generation only scenario02:46
kfox1111though, I've never been really convinced anythone but the cloud admin should create pv's. as there's no real way to tie a pv to a pvc except by not having any but 1.02:46
Pavogot a quick question sdake, if I wanted to make some changes to different openstack services using ansible, things that couldn't be changed using a reconfigure, would I need to use only the docker exec module of ansible to achieve it?02:46
sdakepavo i dont have a good answer for that question02:47
bmace_sdake: if you make that change i posted above you will get past the memcached failure and then blow up in keystone, because it has a similar genconfig check, which I think should also be just "config"02:48
sdakepavo the concept if reconfigure is it can change anything02:48
sdakebmace_ trying to get to the repo to look at the git blame logs :)02:48
Pavowell reconfigure can't add new services that wasn't enabled during deploy02:48
sdakepavo the reality of reconfigure is it doesnt change everything02:48
sdakepavo for that, I think you can do a kolla-ansible deploy02:48
jascott1kfox1111 thanks. im updating proposal with complex use case02:49
sdakepavo or a kolla-ansible upgrade02:49
*** prameswar has joined #openstack-kolla02:49
Pavobut doing a deploy would make me lose everything that I had deploied already correct?02:49
sdakepavo no it would not02:49
sdakepavo deploy is idempotent02:49
kfox1111jascott1: k. thanks.02:49
sdakepavo personally i'd use the upgrade faatue to be safe02:49
sdakepavo also depends on your version of kolla02:50
Pavohmmm thought it would, I did try the upgrade feature but doesn't do anything unless you retag all images to something later than what you deployed with02:51
sdakebmace_ see https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/memcached/tasks/config.yml#L30-L3202:52
sbezverkkfox1111: all green https://review.openstack.org/#/c/424182/02:52
sdakebmace_ to me, that ansible looks correct02:53
sdakei noticed the deploy script pins to an old version of ansible02:53
sdake2.1 or less02:53
sdake2.1 has a slew of bugs - many related to how when works02:53
bmace_but there is no such thing as a "genconfig" action02:53
bmace_the kolla-ansible genconfig command passes in a "config" action02:53
sdakebmace_ let me look at that - moment02:53
sdakebmace_ https://github.com/openstack/kolla-ansible/blob/master/tools/kolla-ansible#L22002:55
bmace_exactly.  config != genconfig02:55
bmace_which is why when genconfig is changed to config in the task it starts to work like a charm02:56
sdakehttps://github.com/openstack/kolla-ansible/blame/master/tools/kolla-ansible#L22002:56
sdakethe correct solution is to change the action to be genconfig in kolla-ansible02:57
sdakeand change all parts where "config" is used in current master to genconfig02:57
sdakethe api name should match the action name02:57
sdakei think inc0 fixed it the wrong way :)02:57
bmace_yeah, those genconfig action checks could have never done anything the way kolla-ansible is written02:58
sdakebmace_ could you be more specific with a github pointer02:58
bmace_well, you posted them all already.  the added config action was done 8 months ago.  the genconfig checks were all newer, but since the action looks like it was always "config" and not "genconfig" i don't see how any of those != genconfig checks would have ever done anything02:59
sdakebmace_ yup - untested gerrit review looks like03:00
kfox1111sbezverk: looks good to me.03:00
bmace_the lesser of two evils, since the config / kolla-ansible code is older, is just swap the 6 or so places where genconfig is checked in the config tasks, imo03:01
sdakebmace_ https://github.com/openstack/kolla-ansible/commit/34ce7aad5acaa04bf5940c6eb87f7788ad13c4fd03:02
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Local registry in gate for trunk builds  https://review.openstack.org/41855003:02
bmace_i'm fine making the fixes if you want, if we go the route of just changing genconfig to config in the ansible config tasks.03:03
sdakebmace_ that doesn't look like a regression to me, it looks like Jeffrey4l_ broke the code ;)03:03
kfox1111sdake: can I get a quick rereview of https://review.openstack.org/#/c/422950/ ?03:04
*** tovin07 has joined #openstack-kolla03:07
sdakekfox1111 done03:07
sdakebmace_ Jeffrey4l_ has led the optimization of reconfigure03:07
sdakebmace_ which probably broke genconfig in some way03:07
bmace_well, i know the way :)  genconfig just needs to be config in 5 files and it will at least work better :)03:08
sdakebmace_ i guess since kolla-ansible used "config" in newton, we are stuck with it03:08
kfox1111sdake: thx.03:08
sdakebmace_ cool fix away :)03:08
bmace_kk03:08
sdakewe may want to change all the config to genconfig at some other time03:09
sdakealthough in the medium term we are removing genconfig entirely03:09
sdakeso it may not matter03:09
bmace_yeah, i figured in the short term, with the change set so small, this is the path of least disruption03:11
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for ceilometer  https://review.openstack.org/42360603:12
Jeffrey4l_bmace_, is reconfig still break the k8s?03:13
bmace_genconfig is broken in the k8s dev container work, and sort of in general.. i'll have a review up shortly03:13
Jeffrey4l_cool.03:15
openstackgerritBorneMace proposed openstack/kolla-ansible: Fixed config generation to check correct actions  https://review.openstack.org/42442103:15
sdakebmace_ does that get you to a working openstack?03:15
sdake(on kubernetes) via the shell script?03:16
bmace_i don't love the mix of double and single quotes in that code :/03:16
bmace_hrm.. fully working openstack? lets not hope for too much ;).  i'm just happy to have genconfig complete successfully03:16
Jeffrey4l_oops. i know what is happening.03:16
sdakebmace_ fwiw I did manage to get genconfig to work properly by installing newotn version of kolla and managed to get helm to launch all the packages against my vagrant environment03:17
Jeffrey4l_but, are u are you patch works? i am afraid that handler will be trigger still, because config file change. bmace_03:17
bmace_i need to make the rest of those changes in my container and run it, and i'll let you know how far i make it.03:17
sdakeJeffrey4l_ if you hve a better version plesae push it up - you know this code as well as anyone03:18
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Fix old container  https://review.openstack.org/42442203:18
sdakeJeffrey4l_ this is blocking kolla-kubernetes for alot of folks03:18
bmace_i made the change in my local environment, ran genconfig and it correctly did not process the container check03:18
Jeffrey4l_i am not sure now. need make some test.03:18
sdakebmace_ what Jeffrey4l_ just said there is reconfigure will break with that change03:18
sdakebmace_ which is not acceptable either :)03:19
Jeffrey4l_no.  genconfig may still not work.03:19
sdakeatlast i think that is what he said03:19
Jeffrey4l_let me test.03:19
sdakeok03:19
bmace_kk, have at it, and yeah, if there are better fixes go for it.  these at least get me past where i was stuck03:19
bmace_but the genconfig string there seemed blatantly wrong either way03:19
sdakei think it should be "" not '' tho03:20
sdakeconsistently used03:20
sdakemy kids are running me ragged03:20
bmace_other than in tox the string genconfig isn't use anywhere else in the entire kolla-ansible codebase, so i don't think reconfigure or anything else does anything magical to make action="genconfig" valid03:20
sdakebmace_ cool - i think the same03:21
openstackgerritQiLiang proposed openstack/kolla-kubernetes: Typo fix: mysql => memcached  https://review.openstack.org/42442303:22
kfox1111hmm.... I think the docker hub is acting up again. :/03:23
*** prameswar has quit IRC03:24
kfox1111we really need to finish up the container caching. :/03:24
*** qiliang28 has joined #openstack-kolla03:27
bmace_sdake: still hitting some issues.  looks like the when ordering of that line does matter, at least in glance, and i'm hitting a similar issue in heat so i'm adding in a check there03:29
*** qiliang27 has quit IRC03:29
*** qiliang28 is now known as qiliang2703:29
*** schwicht has quit IRC03:30
*** prameswar has joined #openstack-kolla03:30
bmace_sdake: fixes heat issue also.. i'll post all the updates.03:31
bmace_just blowing up now talking to my kube environment so getting closer ;)03:31
*** schwicht has joined #openstack-kolla03:31
kfox1111oh.. so close....03:32
kfox1111http://logs.openstack.org/50/418550/43/check/gate-kolla-kubernetes-deploy-centos-binary-t-ceph-multi-nv/71958f7/console.html03:32
kfox1111neutron seems to have changed their behavior, again. :/03:32
openstackgerritBorneMace proposed openstack/kolla-ansible: Fixed config generation to check correct actions  https://review.openstack.org/42442103:33
*** sp_ has quit IRC03:33
Jeffrey4l_bmace_, need condition in handlers/main.yml file too.03:34
Jeffrey4l_bmace_, i will update your patch. ;)03:34
bmace_sure.. not sure why i need it, but you know better than I about the config gen.. i know with my change i was able to make a clean / full genconfig run with no access to docker / etc to do the container checks, which is where it was blowing up before.03:35
sdakeJeffrey4l_ while your at it can yo ufix the ' to "03:36
sdakebmace_ can you test out Jeffrey4l_ 's patch03:36
Jeffrey4l_sdake, np03:36
sdakei am at my parents at present and don't have access to my personal lab03:36
sdakeas i got a new eero and don't know my ip address03:36
sdakeand eero sadly doesn't support dyndns03:37
sdakei did manage to take care of myself today and get a new pair of glasses so i can see straight03:38
sdakealtough tht cratered the whole day03:39
*** zhurong has quit IRC03:40
sdakei can't believe how thourough my eye doctor was03:41
sdakehe spent like 1 hr with me03:41
sdakeand the exam was 72 bucks03:41
sdakeof couse the glasses wer e700 bucks03:41
sdakewhich is cheap compare dto what i've paid in teh past03:41
bmace_once he pushes them up i can give it a go in my dev container, sure03:42
sdakebmace_ fwiw I am doing this on bare metal as well03:42
sdakebmace_ i'd like both to work well (for th eoperator docs)03:43
bmace_absolutely03:43
sdakegenconfig has some wierd thing where eht0 doesn't work03:43
sdakeand it hsa to be enp0s6 or something03:43
sdakefor network_interface03:43
*** schwicht has quit IRC03:43
kfox1111redhat changed the network naming in el7.03:43
kfox1111(it was supported in el6 too but defaulted off)03:43
bmace_i remember hitting an ethX related issue.. i recall working around it somehow but don't recall exactly how at this moment.03:44
kfox1111in general, its a good improvement.03:44
bmace_I don't have any eth1 / eth0 in my dev container, it is eno1, and genconfig still seems ok03:44
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible: Fixed config generation to check correct actions  https://review.openstack.org/42442103:45
Jeffrey4l_bmace_, please check it ^^03:45
*** sp_ has joined #openstack-kolla03:45
*** sudipto has joined #openstack-kolla03:46
*** sudipto_ has joined #openstack-kolla03:46
Jeffrey4l_bmace_, the issue is: the container is not started up after run "reconfig"03:46
bmace_Jeffrey4l_: it also seemed like the ordering was important in some places, like glance for example, where some of the "when" checks might actually cause failures when you were in "config" mode, so is it safe to just always put the config check first?03:47
bmace_it ends up being nicely consistent if we can03:48
*** mdnadeem has joined #openstack-kolla03:48
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfigure action for manila  https://review.openstack.org/42136503:48
bmace_it is already in most places.  there are only a couple of files i think where it isn't first in the when clause03:49
Jeffrey4l_1. action is always defined and not empty    2. in geconfig cause, just do not run the check container task and all handlers.03:49
Jeffrey4l_so i think it is OK.03:49
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfigure action for manila  https://review.openstack.org/42136503:49
sdakebmace_ i just set network_interface in globals.yml to the name of the management interface03:50
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Local registry in gate for trunk builds  https://review.openstack.org/41855003:50
bmace_ugh, the way the dev container is set up right now getting the changes into there is a pain :/03:51
Jeffrey4l_bmace_, sorry?03:52
bmace_not your fault Jeffrey :)03:52
sdakeJeffrey4l_ there  is a patch portdirect and kfox1111 wrote03:53
Jeffrey4l_ ;). tell me whether the patch works.03:53
Jeffrey4l_roger.03:53
Jeffrey4l_after you tested it.03:53
sdakehey fellas, i gotta drive home - 20 mins drive - should be bck online03:53
sdakei'll check out the log for results03:53
*** rhallisey has quit IRC03:54
*** jrobinson is now known as jrobinson-afk03:55
kfox1111bmace_: feel free to tweak it so that its less painful.03:58
bmace_sdake: Jeffrey4l_: genconfig continues to work fine with Jeffreys additional changes.03:58
*** sdake has quit IRC03:58
bmace_kfox1111: once it is all working i definitely have some tweaks i would like to continue to make to it, to better support running behind a proxy, using local kolla-ansible code, etc.03:59
Jeffrey4l_bmace_, no container is running after run "genconfig", right?03:59
bmace_Jeffrey4l_: that is correct.  it couldn't even talk to a docker daemon if it wanted to, so definitely no containers running :)04:00
Jeffrey4l_cool. we will fix all the under review patch.04:00
kfox1111bmace_: cool. :)04:04
kfox1111bmace_: would be cool if we could get a helm package into kubernetes/charts too.04:04
kfox1111so all you have to do to get going is helm install stable/kollakube or something like that.04:04
kfox1111gota go. l8r.04:05
bmace_nite kfox111104:05
jascott1kfox1111 for tomorrow https://github.com/kubernetes/helm/issues/183704:06
jascott1have a good evening04:06
*** MasterOfBugs has quit IRC04:34
sp_Jeffrey4l_: done necessary changes required after your and pbourk comments. Please check now https://review.openstack.org/#/c/422444/1304:36
*** sayantani01 has joined #openstack-kolla04:40
openstackgerritzhubingbing proposed openstack/kolla: remove /var/log/rally in rally dockerfile  https://review.openstack.org/42442904:41
*** zhubingbing has quit IRC04:42
*** jrobinson-afk is now known as jrobinson04:44
*** williamcaban has quit IRC05:00
*** adrian_otto has joined #openstack-kolla05:08
*** msimonin has joined #openstack-kolla05:08
*** goldyfruit has quit IRC05:09
Jeffrey4l_sp_, roger. sorry busy on better reconfigure bp. this should be done before m3 release, which is Jan 25.05:12
sp_Jeffrey4l_: yes05:14
Jeffrey4l_sp_, imo, test koll.summary == True is meaning less.05:14
Jeffrey4l_it return a dict, you need test whether the return dict is your expected.05:14
sp_Jeffrey4l_: for now I checked it and focused more coverage05:15
Jeffrey4l_just increase coverage is useless. we need make sure the test is useful.05:15
sp_Jeffrey4l_: ok, I will check05:16
*** ssurana has joined #openstack-kolla05:16
*** ssurana has quit IRC05:16
sp_Jeffrey4l_: I will do this and will let you know05:17
Jeffrey4l_thanks.05:17
sp_Jeffrey4l_: thanks05:17
*** adrian_otto1 has joined #openstack-kolla05:19
*** severion has joined #openstack-kolla05:22
*** adrian_otto has quit IRC05:23
*** zhangqiankun has quit IRC05:25
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for ceilometer  https://review.openstack.org/42360605:26
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for aodh  https://review.openstack.org/42367005:28
*** williamcaban has joined #openstack-kolla05:29
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for barbican  https://review.openstack.org/42372805:30
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfigure action for rally  https://review.openstack.org/42189305:31
*** cuongnv_ has joined #openstack-kolla05:32
*** cuongnv has quit IRC05:32
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for mistral  https://review.openstack.org/42378705:33
*** williamcaban has quit IRC05:33
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfigure action for cloudkitty  https://review.openstack.org/42251605:34
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfigure action for gnocchi  https://review.openstack.org/42313305:35
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfigure action for trove  https://review.openstack.org/42399005:38
*** adrian_otto1 has quit IRC05:41
*** adrian_otto has joined #openstack-kolla05:46
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for panko  https://review.openstack.org/42416405:46
*** sudipto_ has quit IRC05:47
*** skramaja has joined #openstack-kolla05:48
*** sudipto has quit IRC05:49
openstackgerritSajauddin proposed openstack/kolla: Kolla support for power server  https://review.openstack.org/42323905:51
*** adrian_otto has quit IRC05:51
*** adrian_otto has joined #openstack-kolla05:52
openstackgerritcaoyuan proposed openstack/kolla-ansible: Add the missing option into globals.yml  https://review.openstack.org/42443605:59
*** trinaths has joined #openstack-kolla06:05
openstackgerritcaoyuan proposed openstack/kolla-ansible: Fix the panko_database_port for panko  https://review.openstack.org/42444206:10
*** adrian_otto has quit IRC06:11
*** adrian_otto has joined #openstack-kolla06:12
*** satyar has joined #openstack-kolla06:16
openstackgerritcaoyuan proposed openstack/kolla-ansible: Fix a Syntax Error for panko bootstrap.yml  https://review.openstack.org/42445106:26
satyarHi jeffrey4l_06:27
Jeffrey4l_sup satyar06:27
*** sacharya_ has quit IRC06:28
satyari was looking at the bootstrap.yml for nova06:28
satyarsaw few issues over there06:28
satyari was trying to enable the nova_api_cell006:28
satyarand getting an error06:29
Jeffrey4l_satyar, kolla do not support nova cell v2 now.06:29
*** trinaths has quit IRC06:29
Jeffrey4l_a patch is trying to fix it.06:29
Jeffrey4l_https://review.openstack.org/41547206:29
Jeffrey4l_but no time on it now.06:29
satyarThis patch i know :)06:30
*** prameswar has quit IRC06:30
satyari have done the necessary changes for cell006:30
satyarand the permissions06:30
Jeffrey4l_satyar, cool.06:31
Jeffrey4l_what error you got?06:31
satyarpasting06:31
*** trinaths has joined #openstack-kolla06:32
Jeffrey4l_hrm. are u satroutr? aha, i think so :)06:33
*** harlowja has joined #openstack-kolla06:34
*** trinaths1 has joined #openstack-kolla06:35
*** trinaths has quit IRC06:35
*** cuongnv_ is now known as cuongnv06:39
satyarjeffrey4l_ http://paste.openstack.org/show/596183/06:39
Jeffrey4l_it  says credential is not correct ;(06:40
satyarjeffrey4l_ http://paste.openstack.org/show/596184/06:41
Jeffrey4l_satyar, may nova changed the default cell0 database name.06:42
Jeffrey4l_but no time to check this. will fix it after m3 is release.06:42
satyarhmm06:43
satyarlet me check with nova06:43
Jeffrey4l_busy on finish some bp ;)06:43
satyar:)06:44
*** adrian_otto has quit IRC06:50
satyarjeffrey4l_ https://review.openstack.org/#/c/420437/07:01
*** msimonin has quit IRC07:01
*** msimonin has joined #openstack-kolla07:01
Jeffrey4l_satyar, cool. thanks.07:01
satyar:)07:02
*** Pavo has quit IRC07:02
*** Pavo has joined #openstack-kolla07:04
*** williamcaban has joined #openstack-kolla07:05
*** msimonin has quit IRC07:05
*** williamcaban has quit IRC07:09
*** harlowja has quit IRC07:26
*** sacharya has joined #openstack-kolla07:28
*** sayantani01 has quit IRC07:30
*** williamcaban has joined #openstack-kolla07:31
*** sacharya has quit IRC07:33
*** williamcaban has quit IRC07:36
*** zhubingbing has joined #openstack-kolla07:39
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for watcher  https://review.openstack.org/42410507:42
*** prameswar has joined #openstack-kolla07:43
openstackgerritzhubingbing proposed openstack/kolla-ansible: Add fluentd role  https://review.openstack.org/40739207:45
*** bmace_ has quit IRC07:47
*** bmace_ has joined #openstack-kolla07:47
openstackgerritcaoyuan proposed openstack/kolla-ansible: Fix undefine error for watcher bootstrap.yml  https://review.openstack.org/42448807:52
*** ingmar23 has joined #openstack-kolla07:54
*** sacharya has joined #openstack-kolla07:59
*** openstackgerrit has quit IRC08:03
*** sacharya has quit IRC08:04
*** bjolo has joined #openstack-kolla08:06
*** openstackgerrit has joined #openstack-kolla08:07
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for sahara  https://review.openstack.org/42416508:07
*** sayantani01 has joined #openstack-kolla08:07
openstackgerritSurya Prakash Singh proposed openstack/kolla: Code coverage improvement for kolla  https://review.openstack.org/42244408:08
sp_Jeffrey4l_: done08:10
*** msimonin has joined #openstack-kolla08:11
*** sayantani01 has quit IRC08:11
*** saneax-_-|AFK is now known as saneax08:16
*** eaguilar has quit IRC08:19
*** eaguilar has joined #openstack-kolla08:20
openstackgerritzhubingbing proposed openstack/kolla-ansible: change pankor to panko  https://review.openstack.org/42449908:20
*** mgoddard has joined #openstack-kolla08:21
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible: Optimize reconfigure action for neutron  https://review.openstack.org/42450408:33
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for magnum  https://review.openstack.org/42416208:34
*** egonzalez has joined #openstack-kolla08:42
*** pcaruana has joined #openstack-kolla08:45
openstackgerritZeyu Zhu proposed openstack/kolla: Use required_if in kolla_docker.py  https://review.openstack.org/42451208:46
*** zhubingbing has quit IRC08:51
openstackgerritNiklas Wik proposed openstack/kolla-ansible: Fixes package check when ansible_python_interpreter config is used in inventory file  https://review.openstack.org/42451508:52
*** eaguilar has quit IRC08:52
*** zhubingbing has joined #openstack-kolla08:55
*** sayantani01 has joined #openstack-kolla09:01
*** eaguilar has joined #openstack-kolla09:01
openstackgerritMerged openstack/kolla-ansible: Fix a Syntax Error for panko bootstrap.yml  https://review.openstack.org/42445109:02
openstackgerritMerged openstack/kolla-ansible: Fix undefine error for watcher bootstrap.yml  https://review.openstack.org/42448809:03
openstackgerritMerged openstack/kolla-ansible: Fix the panko_database_port for panko  https://review.openstack.org/42444209:03
*** sayantani01 has quit IRC09:05
*** Serlex has joined #openstack-kolla09:10
openstackgerritcaoyuan proposed openstack/kolla-ansible: Add the missing option into globals.yml  https://review.openstack.org/42443609:11
openstackgerritNiklas Wik proposed openstack/kolla-ansible: Support non standard Python path  https://review.openstack.org/42451509:20
*** salkin has joined #openstack-kolla09:22
*** gfidente has joined #openstack-kolla09:23
*** gfidente has quit IRC09:23
*** gfidente has joined #openstack-kolla09:23
openstackgerritCornelio Hopmann proposed openstack/kolla-ansible: Fix magnum [DEFAULT] configuration.  https://review.openstack.org/42289609:27
*** jrobinson has quit IRC09:31
*** williamcaban has joined #openstack-kolla09:33
openstackgerritcaoyuan proposed openstack/kolla-ansible: Add freezer ansible role  https://review.openstack.org/40222409:37
*** williamcaban has quit IRC09:38
*** zhubingbing has quit IRC09:41
trinaths1hi09:43
*** mgoddard has quit IRC09:43
trinaths1while bring up the setup,09:43
trinaths1I was struck at09:43
trinaths1TASK [kube-join : join workers to the initialized kubernetes cluster] **********09:43
trinaths1skipping: [kube1]09:43
trinaths1and it was idle there from more than 5 hours. is there some thing wrong to decide ?09:44
*** sambetts|afk is now known as sambetts09:47
*** williamcaban has joined #openstack-kolla09:50
*** zhubingbing has joined #openstack-kolla09:50
*** athomas has joined #openstack-kolla09:52
*** williamcaban has quit IRC09:54
*** sayantani01 has joined #openstack-kolla09:55
*** mdnadeem has quit IRC09:58
*** sayantani01 has quit IRC09:59
*** trinaths1 has quit IRC10:00
*** cuongnv has quit IRC10:03
*** tovin07_ has quit IRC10:04
*** satyar has quit IRC10:06
*** strigazi_AFK is now known as strigazi10:09
*** mgoddard has joined #openstack-kolla10:14
*** mdnadeem has joined #openstack-kolla10:15
*** eaguilar has quit IRC10:24
*** trinaths has joined #openstack-kolla10:24
*** eaguilar has joined #openstack-kolla10:26
*** haplo37 has quit IRC10:27
*** pbourke has quit IRC10:29
*** pbourke has joined #openstack-kolla10:29
*** trinaths has quit IRC10:30
*** trinaths has joined #openstack-kolla10:31
des_consoladomorning all10:34
des_consoladohttps://ask.openstack.org/en/question/101828/kolla-ansible-deploy-error-run-not-a-shared-mount/ anyone have any idea what I should do with this one?10:35
*** bjolo has quit IRC10:35
*** ccesario has joined #openstack-kolla10:36
*** haplo37 has joined #openstack-kolla10:36
des_consoladogah I think it might be some SELinux shit10:43
des_consoladoAh yes SELinux was still enabled on the target machine, silly me...10:48
sp_egonzalez: pbourke It would be very helpful if review it. Some more changes done for it. https://review.openstack.org/#/c/422444/1410:48
*** shardy has joined #openstack-kolla11:05
*** bjolo has joined #openstack-kolla11:06
*** hfu has joined #openstack-kolla11:10
des_consoladohm I'm still getting the problem actually. Destroyed everything on compute01, deleted kolla-toolbox image from my registry and re-built it, no SELinux anywhere at this point, rebooted, tried deploying again and still the same error D:11:17
des_consoladomaybe I need to delete my /var/lib/docker11:19
*** rhallisey has joined #openstack-kolla11:23
des_consoladonah, issue persists... wtf...11:25
mliimamorning guys11:42
openstackgerritMerged openstack/kolla-ansible: Fix ironic inspector  https://review.openstack.org/42012211:42
*** pd_ is now known as portdirect11:47
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Refactor register.yml files  https://review.openstack.org/41604611:50
*** williamcaban has joined #openstack-kolla11:51
*** williamcaban has quit IRC11:56
*** rmart04 has joined #openstack-kolla11:57
*** athomas has quit IRC11:59
*** athomas has joined #openstack-kolla12:00
*** bjolo has quit IRC12:04
*** eaguilar has quit IRC12:08
*** simon-AS559 has joined #openstack-kolla12:09
*** zioproto has joined #openstack-kolla12:10
zioprotohello all12:10
simon-AS559Hi there :-)12:11
*** shardy is now known as shardy_lunch12:11
portdirecto/12:11
simon-AS559zioproto and I have started playing with Kolla in view of deploying it in production for our multi-region IaaS (SWITCHengines).12:12
*** sdake has joined #openstack-kolla12:12
portdirectswiss invasion :)12:12
portdirectI'm work on the kolla-k8s side of things, but there are loads of kolla-ansible peeps here - though this channel is fairly quite until the United States wakes up12:13
portdirecthows it going for you?12:14
zioprotojust starting, we are on day 2 of the project12:14
simon-AS559So-so… I'm trying to deploy the multi-node installation (only controller nodes) on a set of 3 OpenStack instances, and of course the HAProxy/VIP stuff breaks. I'll recreate those instances in a private network with port-security off.12:14
simon-AS559In production we won't have *that* problem, but another (even worse) one: Our network is pure Layer-3 with no shared subnet between servers.12:15
simon-AS559So for the VIP stuff we'll probably need to write something to inject those addresses using a routing protocol (we use OSPF/OSPFv3) rather than the usual L2/ARP way.12:16
*** sdake_ has joined #openstack-kolla12:16
*** jtriley has quit IRC12:17
sdake_sup folks12:17
sdake_hey portdirect12:17
portdirecthey sdake_ o/12:17
*** sdake has quit IRC12:17
zioprotoanyone coming to the milano OPS-midcycle ?12:18
* portdirect laughs at sdakes morning vpn ritual...12:18
sdake_zioproto up in the air for me personally12:18
sdake_portdirect ya i know rediculou12:18
sdake_someone sid I can use an irc bouncer12:18
sdake_i'm going to investigat that12:18
sdake_although I prefer my irc go over TLS12:19
*** jtriley has joined #openstack-kolla12:19
sdake_ZNC is the tool12:19
sdake_I really like textual (mac irc client)12:19
portdirectzioproto: not sure yet - going to try and make it but have a lot on that month :/12:19
sdake_with znc, you connect to a specific machine12:19
zioprotoI am probably gonna be there12:19
zioprotowith a lot a of questions12:20
zioprotoso I am going back to my inventory files :)12:20
portdirectsdake_: I just bit the bullet and went for irccloud.com - I highly recommend it12:20
sdake_its a shame the midops midcycle isn't colocated with the ptg or visaversa12:20
sdake_ya i guess i can check it out - i just really like textual12:21
sdake_portdirect i've been using irc since i was 1512:21
sdake_42 now12:21
sdake_so do the math - and this is the first irc cleint that doesnt' suck :)12:21
*** saneax is now known as saneax-_-|AFK12:22
sdake_does irccloud have a real client or is it entirely web bsaed?12:22
portdirectits pretty much entirely web based - so requires some mental buy in for sure12:24
*** jtriley has quit IRC12:24
portdirectthere are a few client apps - bet they are just thin wrappers for the web UI12:25
portdirect*but12:25
*** trinaths1 has joined #openstack-kolla12:27
portdirecttook me some convincing - used hexchat for ages - but I'm pretty sold on it now. The upside is always on and the mobile app is awesome (push notifications). The primary downside for me is pretty similar, always on and push notifications... :)12:27
sdake_the problem with web apps is I often close chrome to reset it12:28
sdake_because I end up opening 100 tabs or something12:28
sdake_and i'm not joking with teh 100tabs12:28
sdake_then to clean it all out i just force close chrome12:28
portdirectmost of the channels I'm on don't have logging - so the always on aspect is a big bonus. and I'm too lazy to set up my own bouncer.12:28
sdake_i'm going the bouncer route if i can find a machine to run it on that isn't a fortune12:29
sdake_rackspce clouds are super expensive12:29
sdake_i suspect there is irc bouncer as a service12:29
portdirecti hear you with the chrome tabs thing12:29
sdake_at one point i was paying 90$/mo for 1 rackspace vm to host a mailing list12:29
sdake_so i cleared it out and my life is alot better :)12:30
*** hfu has quit IRC12:30
portdirectwhy not run a bouncer out of your house?12:30
*** trinaths has quit IRC12:30
*** hfu has joined #openstack-kolla12:30
*** hfu has quit IRC12:31
sdake_because sometimes i am connected to a vpn12:31
sdake_and the vpn doesn't allow split routing12:31
sdake_because of rediculous policies12:31
sdake_i can't even print to my home printers when connected to the vpn12:31
*** hfu has joined #openstack-kolla12:31
sdake_everyone at cisco compalins about it12:31
*** hfu has quit IRC12:31
sdake_especially those people that are 100% telecommute12:32
*** hfu has joined #openstack-kolla12:32
*** hfu has quit IRC12:32
openstackgerritMerged openstack/kolla-ansible: Add the missing option into globals.yml  https://review.openstack.org/42443612:40
openstackgerritMerged openstack/kolla-ansible: Fix magnum [DEFAULT] configuration.  https://review.openstack.org/42289612:41
*** williamcaban has joined #openstack-kolla12:42
*** bjolo has joined #openstack-kolla12:43
*** williamcaban has quit IRC12:47
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible: Optimize reconfigure action for nova  https://review.openstack.org/40741612:47
*** rhallisey has quit IRC12:47
*** rhallisey has joined #openstack-kolla12:48
*** sdake_ is now known as sdake12:49
zioprotodumb questions12:49
zioprotolooking at this page12:49
zioprotohttp://docs.openstack.org/developer/kolla/multinode.html12:49
zioprotoit is not exactly clear what is tools/start-registry12:49
zioprotoalso12:49
*** zhubingbing has joined #openstack-kolla12:49
zhubingbinghello guys12:50
zioprotoif I have to install kolla for production, given that there are no ubuntu packages, what is the right installation procedure ? with pip ? or I have to git clone stuff and checkout a stable branch ?12:50
*** krtaylor has quit IRC12:51
*** shardy_lunch is now known as shardy12:52
mliimahello zhubingbing12:53
*** schwicht has joined #openstack-kolla12:53
zhubingbinghi mliima12:53
openstackgerritMerged openstack/kolla-ansible: Add fluentd role  https://review.openstack.org/40739212:54
*** schwicht has quit IRC12:55
berendtmy issue with packaging 16.7 was solved by https://github.com/openstack/requirements/commit/6e673baf41b4d5c1f247357683f6d4974436fa0812:56
berendtpackaging upper constraint is now 16.812:56
berendtzioproto: git clone and checkout stable branch12:57
zioprotoberendt: ok, but for kolla-ansible there is only master12:57
*** huzhengchuan has quit IRC12:57
berendtzioproto: kolla-ansible was created after the current stable branch12:57
berendtzioproto: when working with stable/newton (3.0.2 release) than everything is included in kolla repository12:58
berendtzioproto: after newton release we moved the ansible roles into the kolla-ansible repository12:58
zioprotookay !12:58
zioprotoso for stable/newton12:58
berendtzioproto: because of that there is not yet a stable branch in kolla-ansible12:58
zioprotoI just need https://github.com/openstack/kolla12:59
zioprotoand I just need to clone this repo on the operator node12:59
zioprotoalso, I should let Kolla manage the installation of Docker on all nodes, right ?12:59
zioprotoI see that Kolla pins docker to 1.1112:59
zioprotoworking on Ubuntu xenial there is any apt repo that I should add ?12:59
zioprotoor Kolla with his playbooks knows how to install the right version of Docker on xenial ?13:00
berendtzioproto: yes, checkout kolla repository on the seed/operator node and install it there13:00
berendtzioproto: i do not know how to install docker with kolla on the other nodes because i use a custom ansible role for this part of the deployment13:00
berendtzioproto: but i think the baremetal role will handle this13:01
zioprotoI tried already the 1 node installation and13:01
zioprotokolla-ansible -i <<inventory file>> bootstrap-servers13:01
zioprotothis playbook13:01
zioprotowill install Docker13:01
berendthttps://github.com/openstack/kolla/blob/stable/newton/ansible/roles/baremetal/tasks/pre-install.yml#L86-L9113:01
berendtyes, bootstrap-servers will run the baremetal role to bootstrap everything13:02
berendtand this role adds the required docker repository13:02
zioprotodeb https://apt.dockerproject.org/repo ubuntu-xenial main13:04
zioprotogreat13:04
zioprotois the same one I already use13:04
openstackgerritharsh proposed openstack/kolla-ansible: Resolves parsing issue with kolla-ansible CLI  https://review.openstack.org/42465113:04
zioprotofor the docker stuff13:04
zioprotook, so I move on13:04
zioprotothanks for clarification13:04
*** krtaylor has joined #openstack-kolla13:04
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Add zun ansible role  https://review.openstack.org/41617913:05
*** apuimedo|flu is now known as apuimedo13:06
openstackgerritMerged openstack/kolla-ansible: Allow cinder-volume to be configured to use HNAS nfs  https://review.openstack.org/41709413:08
*** huzhengchuan has joined #openstack-kolla13:10
*** jtriley has joined #openstack-kolla13:13
*** williamcaban has joined #openstack-kolla13:14
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Split Openvswitch into own role  https://review.openstack.org/41679313:15
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Add OpenDaylight role  https://review.openstack.org/41636713:15
*** williamcaban has quit IRC13:18
*** jtriley has quit IRC13:18
*** dave-mccowan has joined #openstack-kolla13:18
*** jtriley has joined #openstack-kolla13:19
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for panko  https://review.openstack.org/42416413:21
Jeffrey4l_zhubingbing, mliima please review this https://review.openstack.org/#/c/424421/13:22
zhubingbingok13:22
mliimadone Jeffrey4l_13:22
Jeffrey4l_thanks.13:22
zhubingbingdone13:24
*** jtriley has quit IRC13:24
Jeffrey4l_thanks.13:24
zhubingbingthanks your commit13:24
zhubingbing;)13:24
*** huzhengchuan has quit IRC13:25
Jeffrey4l_now need add - action != "config" in all handlers task. If not, it will break k8s genconfig. so you may need update your patch about reconfigure mliima zhubingbing13:25
zhubingbingemm13:25
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for magnum  https://review.openstack.org/42416213:25
mliimaok Jeffrey4l_13:25
zhubingbingok13:25
mliimacaoyuan is helping :)13:25
mliimahe is a commit machine haha13:26
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Split Openvswitch into own role  https://review.openstack.org/41679313:28
openstackgerritMerged openstack/kolla-ansible: Fixed config generation to check correct actions  https://review.openstack.org/42442113:29
*** williamcaban has joined #openstack-kolla13:29
openstackgerritJeffrey Zhang proposed openstack/kolla: install murano dashboard package in horizon  https://review.openstack.org/39595713:31
*** williamcaban has quit IRC13:33
*** jmontleon has quit IRC13:38
Jeffrey4l_mliima, egonzalez could u review this one? https://review.openstack.org/42450413:39
*** severion has quit IRC13:39
*** v1k0d3n has quit IRC13:39
*** mdnadeem has quit IRC13:39
*** jmontleon has joined #openstack-kolla13:40
*** v1k0d3n has joined #openstack-kolla13:40
mliimaJeffrey4l_, any notify in Waiting the openvswitch_db service to be ready?13:41
mliimahttps://review.openstack.org/#/c/424504/1/ansible/roles/neutron/handlers/main.yml13:41
Jeffrey4l_mliima, yes. check the first task in handlers/main.yml.13:42
Jeffrey4l_one handler trigger another one. ;)13:42
*** Jeffrey4l_ is now known as Jeffrey4l13:42
mliimaoh, hehe13:46
mliimaOk Jeffrey4l13:46
mliimaJeffrey4l, how I create a softlink?13:47
mliimain reconfigure file13:47
mliima:/13:47
Jeffrey4lthe really concern i care is: host_in_groups variable in neutron/default/main.yml. it is a tricker.13:47
Jeffrey4lmliima, include is fine.13:47
mliimaok :)13:47
Jeffrey4lif u want to create softlink: just use "ln -s deploy.yml reconfigure.yml"13:48
*** jmontleon has quit IRC13:48
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Optimize reconfiguration for designate  https://review.openstack.org/42415513:50
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfigure action for manila  https://review.openstack.org/42136513:50
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Optimize reconfiguration for influxdb  https://review.openstack.org/42415913:51
*** ccesario has quit IRC13:51
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Optimize reconfiguration for etcd  https://review.openstack.org/42415713:51
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfigure action for gnocchi  https://review.openstack.org/42313313:52
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Optimize reconfiguration for grafana  https://review.openstack.org/42415813:52
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for mistral  https://review.openstack.org/42378713:52
*** saneax-_-|AFK is now known as saneax13:52
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for watcher  https://review.openstack.org/42410513:53
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Optimize reconfiguration for kuryr  https://review.openstack.org/42416113:53
*** jmontleon has joined #openstack-kolla13:53
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for sahara  https://review.openstack.org/42416513:53
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Optimize reconfiguration for karbor  https://review.openstack.org/42416013:54
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Optimize reconfiguration for solum  https://review.openstack.org/42416713:54
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for aodh  https://review.openstack.org/42367013:55
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Optimize reconfiguration for elasticsearch  https://review.openstack.org/42413913:55
*** sp___ has joined #openstack-kolla13:55
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Optimize reconfiguration for collectd  https://review.openstack.org/42413313:56
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for barbican  https://review.openstack.org/42372813:56
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfigure action for rally  https://review.openstack.org/42189313:56
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfiguration for ceilometer  https://review.openstack.org/42360613:57
openstackgerritharsh proposed openstack/kolla-ansible: Resolves parsing issue with kolla-ansible CLI  https://review.openstack.org/42465113:58
openstackgerritcaoyuan proposed openstack/kolla-ansible: Optimize reconfigure action for cloudkitty  https://review.openstack.org/42251613:58
*** lamt has joined #openstack-kolla14:01
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Optimize reconfiguration for octavia  https://review.openstack.org/42384614:02
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Optimize reconfigure action for trove  https://review.openstack.org/42399014:04
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Optimize reconfigure action for congress  https://review.openstack.org/42269014:05
*** huzhengchuan has joined #openstack-kolla14:06
*** sp_ has quit IRC14:06
*** v1k0d3n has quit IRC14:08
*** v1k0d3n has joined #openstack-kolla14:09
*** williamcaban has joined #openstack-kolla14:10
openstackgerritzhubingbing proposed openstack/kolla-ansible: Add freezer ansible role  https://review.openstack.org/40222414:10
*** matrohon has joined #openstack-kolla14:12
*** rmart04 has quit IRC14:12
*** eaguilar has joined #openstack-kolla14:13
*** williamcaban has quit IRC14:14
*** goldyfruit has joined #openstack-kolla14:15
openstackgerritzhubingbing proposed openstack/kolla-ansible: Add freezer ansible role  https://review.openstack.org/40222414:16
zioprotohey I am confused about this tools/start-registry14:17
zioprotoinstalling stable kolla with pip14:17
zioprotowhere I am supposed to find this script ?14:17
*** krtaylor has quit IRC14:18
openstackgerritzhubingbing proposed openstack/kolla-ansible: Add freezer ansible role  https://review.openstack.org/40222414:18
pbourkezioproto: its in the kolla repo14:18
*** sp_ has joined #openstack-kolla14:18
*** srwilkers has joined #openstack-kolla14:19
*** srwilkers has quit IRC14:19
*** srwilkers has joined #openstack-kolla14:20
*** simon-AS559 has quit IRC14:20
srwilkersmorning14:21
*** schwicht has joined #openstack-kolla14:21
zioprotopbourke: but if I install with pip should I also anyway clone the repo ?14:22
*** williamcaban has joined #openstack-kolla14:23
*** flaper87 has quit IRC14:24
openstackgerritMerged openstack/kolla-kubernetes: Fix old container  https://review.openstack.org/42442214:24
zioprotopbourke: ok I guess I was using too new docs. Now I will stick to http://docs.openstack.org/developer/kolla/newton/quickstart.html14:24
openstackgerritMerged openstack/kolla-kubernetes: Openvswitch Service package with kuberentes entrypoint  https://review.openstack.org/42418214:25
*** gema has joined #openstack-kolla14:26
gemaberendt: ping14:26
*** tovin07_ has joined #openstack-kolla14:26
berendtgema: pong14:26
gemaberendt: I am reading your email about debian deprecation and wanted to ask about this14:27
berendtgema: feel free.. :)14:27
gemaberendt: what are the supported os when you deprecate debian?14:27
berendtgema: we actually support ubuntu and centos14:27
gemaok14:27
berendtlast cycle we dropped the fedora images, because nobody worked on it14:28
gemathe reason I am asking is because I am gearing my team towards starting to contribute images for ARM6414:28
berendtthis is the same for the debian images14:28
gemaand they are most likely going to be debian b ased14:28
openstackgerritMerged openstack/kolla-ansible: Optimize reconfiguration for magnum  https://review.openstack.org/42416214:28
berendtthe problem is that actually nobody is working/using the debian images14:28
*** satyar has joined #openstack-kolla14:28
berendtis it not possible to use ubuntu based arm images?14:28
gemawell, we are not supposed to be favoring any vendor14:29
gemathat's why we like debian14:29
openstackgerritMerged openstack/kolla-ansible: Optimize reconfiguration for panko  https://review.openstack.org/42416414:29
gemaour work has to do with enablement14:29
gemarather than being vendor specific14:29
*** tovin07_ has quit IRC14:29
berendtthe problem is that the current debian images need a lot of love and gate jobs14:29
berendtare you willing to work on them?14:30
*** breitz has quit IRC14:30
gemayes we will have to for ARM14:30
*** mattmceuen has joined #openstack-kolla14:30
gemawhether we'll be able to do the same for x86 is a question mark14:30
gemaor whether the work we do is also usable there14:30
berendti think it is a good idea to discuss this in our team meeting tomorrow14:30
gemaI have hardware to set up 3rd party CI for ARM14:31
gemabut I don't have hardware for x8614:31
berendtcan you join? then i will add it to the agenda14:31
gemasure , I will be there14:31
*** krtaylor has joined #openstack-kolla14:31
gemaI try to be active but normally get caught between the interop meeting and yours14:31
gematomorrow I will be mostly in yours :D14:31
gemaberendt: thanks14:31
berendti will add 2 topics: new architecture and debian iamges14:32
berendtwill you join the ptg in feb?14:32
berendtgema: can you please reply on the deprecation vote on openstack-dev and wrote down a summary there?14:34
berendti think this makes sense for the logs14:34
gemaberendt: sure will do14:35
gemaberendt: wanted to check with you first so that it doesn't come across as this strange person trying to stop this decision :)14:35
gemaberendt: I will also be at the ptg in feb, but again I have the conflict with interop WG14:36
berendtfor me it is fine to keep the debian images as long as anybody is working with them14:36
gemaberendt: so I will have to work out at what times I can be where14:36
berendtyes but maybe we can have a quick floor discussion about this topic there14:36
gemaberendt: yes, I understand taht14:36
gemasounds like a plan14:36
gemawill reply to your email14:36
*** krtaylor has quit IRC14:37
*** tovin07_ has joined #openstack-kolla14:38
*** jtriley has joined #openstack-kolla14:38
*** tovin07_ has quit IRC14:38
*** v1k0d3n has quit IRC14:39
*** severion has joined #openstack-kolla14:39
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible: Integrate designate with neutron  https://review.openstack.org/42467914:43
*** lrensing has joined #openstack-kolla14:44
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible: Integrate designate with neutron  https://review.openstack.org/42467914:46
*** rmart04 has joined #openstack-kolla14:50
*** tovin07_ has joined #openstack-kolla14:50
obre:q14:50
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible: Custom init-runonce values  https://review.openstack.org/42468214:52
*** severion has quit IRC14:52
*** v1k0d3n has joined #openstack-kolla14:52
*** lamt has quit IRC14:52
openstackgerritMerged openstack/kolla: remove /var/log/rally in rally dockerfile  https://review.openstack.org/42442914:53
mliimazhubingbing, egonzalez https://review.openstack.org/#/c/416046/14:53
*** rmart04 has quit IRC14:57
*** krtaylor has joined #openstack-kolla14:58
*** rmart04 has joined #openstack-kolla14:58
*** zhubingbing has quit IRC14:58
*** tovin07_ has quit IRC15:01
openstackgerritMerged openstack/kolla: install murano dashboard package in horizon  https://review.openstack.org/39595715:04
*** tovin07_ has joined #openstack-kolla15:04
*** fguillot has joined #openstack-kolla15:08
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible: Fix security group creation  https://review.openstack.org/42469015:09
*** mgiles has joined #openstack-kolla15:11
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible: Optimize reconfiguration for tacker  https://review.openstack.org/42203615:12
sdakeberendt uses the term support loosly there gema :)15:16
sdakeberendt the other reason we dropped fedor aimages is because fedora couldn't be madee to work (it was technically impossible as RDO stopped maintenance for fedora)15:16
*** rmart04 has quit IRC15:16
*** rmart04 has joined #openstack-kolla15:17
sdakegema - agree with berendt's conclusion - we don't have it out for debian - instead nobody has stepped up to do any work on them15:18
sdakegema fwiw debian has *never* worked with kolla15:18
sdakegema so your in for a bit of pain making it work :)15:19
*** skramaja has quit IRC15:19
sdakegema if you c an get the images to work its easy enough to add x86_64 gate jobs for debian15:19
sdakegema probably 4-8 hours of work15:19
gemasdake: I am enlisting some expert help15:19
gemafrom debian :D15:19
sdakealthough I am 4-8 hours of work out of blocks :)15:19
sdakeberendt this exact situation is why we have the deprecatoin policy in place that we do :)15:20
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Add cinder control package with kubernetes entrypoint  https://review.openstack.org/42469715:22
gemasdake: 4-8 hours of work per container or in total?15:22
gemasdake: you are making it sound almost too easy15:22
gemasdake: it will be harder to get the lab properly configured and up and running15:23
*** msimonin has quit IRC15:23
gema:D15:23
sdakegema for the gate for someone experienced in gate work15:24
sdakethe containers themselves will be a bigger challenge15:24
sdakegema i'd recommend bringup on x86-64 first then arm second15:24
sdakebut its your choice as to the order15:24
sdakenote kolla does not support nor implement i38615:24
gemasdake: ack15:24
sdakethe reason i recommend that order is x86_64 is in good shape15:25
sdakealthough maybe arm is too15:25
sdakenicolas pitre (a dude I used to work with at montavista) did a great job of beating the arm kernel  into submission years ago15:25
sdakenot sure if he is still doing that or not15:25
sdakegema i'd focus on getting it to work locally - then adding a gate job for x86-64, then adding third party ci if you want to do that15:26
sdakei assume debian compiles from the same sources for x86-64 and arm6415:26
gemasdake: yes15:26
gemasdake: although some packages are called slightly different15:27
sdakeif they are named differnetly - that is where the challenge will be15:27
sdakein sorting out which packages to install in which conditions15:27
sdakekolla at this point isn't multiarch15:27
sdakenever has been15:27
sdakealthough i dont' see harm in it if someone is willing to maintain it15:28
sdakewe will need to come up with a way to tag images properly for the arm case as well15:28
sdakeright now we assume x86_64 for everything15:28
sdakeso changes to build.py will be required15:28
sdakegema after the team discussion on wed (which I will miss, I have a conflicting appointment) you will probably want to file a blueprint to track the work items related to this15:29
gemasdake: ok, will do15:32
*** huzhengchuan has quit IRC15:34
*** sayantani01 has joined #openstack-kolla15:35
*** sayantani01 has quit IRC15:35
*** aj_power has joined #openstack-kolla15:36
*** sayantani01 has joined #openstack-kolla15:36
*** tonanhngo has joined #openstack-kolla15:40
*** trinaths1 has quit IRC15:45
*** sacharya has joined #openstack-kolla15:46
*** adrian_otto has joined #openstack-kolla15:48
*** hieulq_ has joined #openstack-kolla15:51
*** breitz has joined #openstack-kolla15:51
*** schwicht has quit IRC15:57
*** simon-AS559 has joined #openstack-kolla16:00
*** srwilkers has quit IRC16:01
*** schwicht has joined #openstack-kolla16:01
*** sp_ has quit IRC16:02
*** srwilkers has joined #openstack-kolla16:04
*** sayantani01 has quit IRC16:05
*** sayantani01 has joined #openstack-kolla16:06
*** schwicht_at_work has joined #openstack-kolla16:06
*** schwicht has quit IRC16:06
*** breitz has quit IRC16:07
*** breitz has joined #openstack-kolla16:08
*** rmart04 has quit IRC16:11
*** pcaruana has quit IRC16:16
*** sp_ has joined #openstack-kolla16:16
*** lamt has joined #openstack-kolla16:20
*** TxGirlGeek has joined #openstack-kolla16:29
*** TxGirlGeek has quit IRC16:32
*** TxGirlGeek has joined #openstack-kolla16:32
*** bjolo has quit IRC16:33
*** inc0 has joined #openstack-kolla16:33
*** eaguilar has quit IRC16:33
openstackgerritSurya Prakash Singh proposed openstack/kolla: Code coverage improvement for kolla  https://review.openstack.org/42244416:34
*** prameswar has quit IRC16:34
inc0another day of meetings \\o o//16:35
inc0\o/ -o- /o\16:35
*** tovin07_ has quit IRC16:36
kfox1111morning.16:37
srwilkersinc0, such is my life today16:37
inc0how are y'all doing?16:37
kfox1111alive. you? :)16:38
pbourkeinc0: would like to propose a vote on ML that we gut the kolla docs to only info related to building images16:39
pbourkeinc0: and keep the current docs under kolla-ansible for improvement16:40
pbourkeinc0: right now there's two copies of the same thing and its getting really confusing16:40
kfox1111pbourke: +116:40
openstackgerritMerged openstack/kolla-ansible: Ansible config for nova-serialproxy console  https://review.openstack.org/41587016:40
kfox1111well, +1 to the vote, and +1 my vote. :)16:41
pbourkeI know there are some people looking at improving the docs in general so will give them a day or so to chime in. But I think this can be done now and will help everyone16:41
kfox1111it will just get more confusing too, as kolla-kubernetes matures.16:41
kfox1111arg.... really need to get this local repo ps finished so we can get local repo's going for the other versions. :/16:44
*** aj_power has quit IRC16:45
*** saneax is now known as saneax-_-|AFK16:46
kfox1111hmm... interesting problem...16:46
kfox1111its failing because the keystone-admin service is internal only.16:47
*** schwicht_at_work has quit IRC16:47
*** schwicht has joined #openstack-kolla16:47
kfox1111we need a way to make the service external conditionally.16:47
*** saneax-_-|AFK is now known as saneax16:47
*** dmsimard is now known as dmsimard|off16:48
*** klindgren has quit IRC16:48
berendtpbourke: can you add the docs topic to the agenda for tomorrow?16:49
pbourkeberendt: ok16:49
openstackgerritMerged openstack/kolla-ansible: Optimize reconfigure action for rally  https://review.openstack.org/42189316:50
inc0pbourke, I don't think we need voting16:54
pbourkeinc0: fair enough, if the general consenus is positive in the meeting I'll do up a patch16:55
inc0there is no reason for keeping deploy guide in kolla other than noone wrote good guide that will allow people to navigate across deliverables16:55
sbezverkkfox1111: ping16:55
inc0that's my requirement <- people being able to find kolla-ansible from kolla docs16:55
inc0and kolla-k8s16:55
pbourkecan we not just link to kolla-[ansible,k8s,*] from the kolla docs?16:55
*** sudipto has joined #openstack-kolla16:55
inc0maybe16:55
*** sudipto_ has joined #openstack-kolla16:56
berendti think it makes sense to have a central landing page for all documents and do maintain the documents itself in each repository16:56
inc0I dunno, I'm sure we can figure that one out16:56
inc0berendt, agree, or architectural guide which will also explain use-cases, maturity and such of each deliverable16:56
pbourketbh, I dont want a massive discussion on our final vision for where the docs need to be16:56
pbourkeI just want to get rid of the duplication16:56
pbourkebecause right now its horrible16:56
inc0+2 pbourke16:57
berendtconfirmed16:57
inc0btw, we got consensus on how to add new deliverable16:57
pbourkeoh?16:57
inc02*+2 + PTL vote16:57
kfox1111sbezverk: ping.16:57
berendtgreat16:57
inc0I just closed poll16:57
inc0yeah, I hoped this will be the case16:57
pbourkeisn't there a wider discussion in that area though16:57
*** egonzalez has quit IRC16:57
inc012 out of 17 people voted;)16:57
berendtdo you send the result to the mailing list?16:58
pbourkeabout whether they need to be under the kolla umbrella16:58
*** QuentinM has quit IRC16:58
*** zioproto has quit IRC16:58
sbezverkkfox1111: I think I captured a log confirming that entrypoint is not checking if there is actual process behind a service16:58
inc0pbourke, we'll deal with it later16:58
kfox1111ugg. :/16:58
pbourkeinc0: check16:58
berendtinc0: can you see who has not voted? maybe it makes sense to ask them why16:58
inc0issue I'm having with making full breakup is mess it's going to cause16:58
openstackgerritMauricio Lima proposed openstack/kolla: Use install-pip macro in most source images  https://review.openstack.org/41386116:58
inc0we barely recovered from kolla-ansible split16:58
inc0I can't :( or I don't see how16:58
*** ingmar23 has quit IRC16:59
kfox1111sbezverk: can you file a bug with them? last time they were quite responsive.16:59
berendtmaybe it is not possible at all16:59
sbezverkI have dependency on cinder-api service, cinder-api is in init state, but cinder-scheduler which has cinder-api as a dependency is alredy in running state16:59
qwanggood morning16:59
kfox1111without that getting fixed, entrypoint's far less useful. :/16:59
kfox1111sbezverk: can you double check the dep container is in the pod?16:59
sbezverkkfox1111: maybe race conditions we keep seeing are related to it..16:59
kfox1111we missed one before.16:59
*** aj_power has joined #openstack-kolla16:59
kfox1111I thought I hit all of them, but managed to miss one. so its possible I missed 2.17:00
sbezverkkfox1111: will do that before..17:00
kfox1111or more.17:00
kfox1111thx.17:00
*** simon-AS559 has quit IRC17:00
*** sudipto has quit IRC17:01
openstackgerritMerged openstack/kolla: Add ipxe packages to Ironic PXE container  https://review.openstack.org/42431317:01
*** sudipto_ has quit IRC17:01
sbezverkkfox1111: not this case, as it uses common stateful template17:01
sbezverkand log tells that dependency got resolved17:01
kfox1111ok. thanks for double checking.17:02
kfox1111that does sound like a bug.17:02
kfox1111they might not have considered that pods can be in init state.17:02
*** schwicht has quit IRC17:02
kfox1111only pending/not ready.17:02
*** schwicht_at_work has joined #openstack-kolla17:03
kfox1111I don't know if they are using init containers yet.17:03
*** sudipto has joined #openstack-kolla17:04
*** schwicht_at_work has quit IRC17:04
*** sudipto_ has joined #openstack-kolla17:04
*** schwicht has joined #openstack-kolla17:05
sbezverkkfox1111: filed the issue and gave them link for logs. do you know when PS' logs get trashed?17:07
sbezverkis it on the next run or that link stays alive for a while?17:07
*** markmcclain has quit IRC17:09
*** markmcclain has joined #openstack-kolla17:11
*** dave-mccowan has quit IRC17:11
kfox1111sbezverk: haven't figured that out. they seem to stay alive a long time.17:13
*** sudipto_ has quit IRC17:14
*** sudipto has quit IRC17:14
*** sp___ has quit IRC17:14
sbezverkkfox1111: cool thanks, hopefully sufficient enough for entrypoint people to check this problem17:15
*** klindgren has joined #openstack-kolla17:15
kfox1111thanks for filing the issue.17:15
kfox1111do you have a link handy so I can follow it?17:15
openstackgerritFrancisco Edigleison Barbosa proposed openstack/kolla: Add how configure backend to cinder HNAS iSCSI driver guide  https://review.openstack.org/42215717:16
sbezverkkfox1111: https://github.com/stackanetes/kubernetes-entrypoint/issues/1917:17
kfox1111thx.17:17
qwangsbezverk: I can still open the logs from PS that's merged a couple of months ago.17:18
*** lrensing has quit IRC17:19
openstackgerritFrancisco Edigleison Barbosa proposed openstack/kolla: Add how configure backend to cinder HNAS iSCSI driver guide  https://review.openstack.org/42215717:19
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Add cinder control package with kubernetes entrypoint  https://review.openstack.org/42469717:20
sbezverkqwang: nice, thanks for confirming it17:21
*** lrensing has joined #openstack-kolla17:23
qwangsbezverk: you're welcome. glad to help :)17:24
openstackgerritMerged openstack/kolla-kubernetes: Typo fix: mysql => memcached  https://review.openstack.org/42442317:26
*** saneax is now known as saneax-_-|AFK17:28
kfox1111ugg.17:29
kfox1111the gate really is starting to get really messy with all the forks. :/17:29
kfox1111making fixing things harder and harder. :/17:29
*** inc0 has quit IRC17:30
kfox1111I was going to do this right in this ps, but its going to take a major refactor to do that. :/17:32
sbezverkkfox1111: we are almost all done with microservices and services, after that it will be easier for gate refactor17:36
kfox1111even just doing ceph_workflow.sh and iscsi_workflow.sh woudl really help. :/17:37
kfox1111the problem is, they aren't using the global api for config, so its getting harder to tweak things.17:37
kfox1111I'm going to lay a bit of groundwork in this ps to do that,17:37
kfox1111then we can fix it for real in a follow up ps as soon as it merges.17:38
sdakekfox1111 was it you that told me that openstack had sorted out a way to add new language choices?17:38
kfox1111no. but I heard they were working on it.17:39
kfox1111didn't hear they were done though.17:39
sdakei thought someon told m e they were done17:39
sdakenot sure who it was17:39
sdakewas looking for a pointer on the ml for the thread17:39
sdakeas jascott1 and srwilkers are taking a look at it for kolla-kubneretes17:40
kfox1111yeah. I can understand that.17:40
sbezverkkfox1111: sounds like a plan, it will also give us a bit of time to finish services..17:40
sdakesrwilkers i'll ask a few folks on the tc on that point17:41
*** Serlex has quit IRC17:41
sdakethe lsat time i asked it was blocked on a variety of things - however - I am pretty sure its unbloked now17:41
sdakeunblocked17:41
kfox1111sbezverk: yeah. services is in much better shape already, as it was written much more recently.17:41
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Local registry in gate for trunk builds  https://review.openstack.org/41855017:42
kfox1111sdake: unblocked doesn't meen imminent though.17:42
kfox1111I think they decided a little while ago, that they would come up with a process by which they could certify a language was ok to use.17:42
kfox1111which unblocked the discussion.17:42
sdakekfox1111 cool - i haven't been following the tc meetings - too busy17:43
kfox1111but that doesn't mean they nessisarily could come up with the criteria very quickly.17:43
sdakekfox1111 i'll ask around17:43
*** adrian_otto has quit IRC17:43
kfox1111yeah. let me know what you find out. :)17:43
sdakejascott1 srwilkers does that semi-answer your q, or do you need m0ar minerals? :)17:43
sbezverkkfox1111: could you please ack nova control ps?17:43
kfox1111in a few. meeting time.17:44
sbezverkk17:44
srwilkerssdake, kfox1111 an email came across last week saying the new requirements for new languages had been approved by the TC17:44
sdakesrwilkers sounds like you know more aobut it then i do :)17:44
sdakesrwilkers got alink to hte mail - i'll parse it if you like17:44
srwilkersyeah, sec17:45
pbourkedoes anyone know if oslo push pypi packages for stable branches?17:45
sdakepbourke i'd assume so17:45
sdakepbourke #openstack-oslo is the place to ask - btw your up late ;)17:45
pbourkesdake: nope only 17:44  here ;)17:45
sdakeoh cool17:45
srwilkerssdake: https://governance.openstack.org/tc/reference/new-language-requirements.html17:45
sdakesbezverk do yu ahe to have a helm server active to do helm prebuild?17:46
*** hieulq_ has quit IRC17:46
sbezverksdake: only to prebuild services17:47
sdakesrwilkers where the existing, already accepted, languages have been proven to not meet the technical requirements17:47
sbezverksrwilkers: man that is a lot of requirements ;)17:47
sdakehave to make a technical argument (which people are doing for go) not a religious one :)17:47
*** eaguilar has joined #openstack-kolla17:48
sdakeDefine how the deliverables are distributed¶17:48
srwilkersyep, its not just religious for me. makes sense from a performance standpoint17:48
sdakegolang has like 5 ways to do builds17:48
sdakethis one is going to be challenging for go specifically17:48
jascott1he preference for us is17:48
jascott1to produce Debian based containers17:48
jascott1stupid paste17:49
sdakewe could just take over the universe and produce containers ;)17:49
sdakejascott1 right - a deliverable of go in a container makes alot of sense17:49
*** eaguilar_ has joined #openstack-kolla17:49
jascott1sorry was trying to quote the ML about debian17:49
sdakesince go is targeted at cloud native apps, and building a container in go is somethign that can be delivered vs the 5 build tools17:49
sdakejascott1 oh - well I was serious17:50
jascott1sdake i agree that go in containers does make sense :)17:50
sdakedep managemeent17:50
sdakethats going to be a pain in the rear17:50
*** dave-mccowan has joined #openstack-kolla17:50
sdakewhoever manages to thread the needle on golang for openstack will be  my hero for sorting out those sets of problems :)17:51
sdakejascott1 srwilkers it will take a team - I'd suggest posting to the ml and seeing who is interested and join forces17:51
sdakethe more people interested in bringing go to openstack, the more likely it is to happen17:51
srwilkerssdake, yep. i agree. jascott and i have been chatting for about a week or so in regards to getting the discussion started17:52
sdakecould probably form a technical working group around i t - however - I am overloaded and can't do that myself17:52
bmace_unless things have improved recently i found golang dependency management amazingly obnoxious.. i know there were some third party tools for version pinning, but most projects just sat on the bleeding edge and therefore broke all the time17:52
sdakebmace_ agreed17:52
*** eaguilar has quit IRC17:52
portdirecti think some of the swift peeps may be interested?17:52
sdakesrwilkers there are a whole slew of people in the community interested in the problem17:52
sdakeincluding what portdirect just pointed out17:52
bmace_unless there are real performance needs i'm not sure i see a lot of upside.  i find python a lot more readable also.17:52
sdakemy recommendation is to start talking to them17:53
sdakebmace_ ya it is clear go is a clear performance winner17:53
sdakebmace_ although go also has significant downside17:53
srwilkerssdake, yep. jascott1 showed me some of the swift work, and we had planned to reach out to them17:53
sdake(dep managmenet, interationalization, docs generation, etc)17:53
bmace_there is that new grumpy thing.  just write your code in python and compile it down to Go :)17:53
sdakei think it would be fantastic if go were a language choice in openstack17:53
sdakelots ofpeople want it17:53
jascott1yes we do17:54
sdakenobody really knows how to do it yet :)17:54
sdakebmace_ that sounds interesting :)17:54
sdakebmace_ its a preprocessor?17:54
bmace_you hadn't heared about that?17:54
sdakebmace_ dude i hear abou tnew tech all day - i can't keep it all straight17:54
*** srwilkers is now known as srwilkers_brb17:54
bmace_sdake: https://github.com/google/grumpy17:54
jascott1heres the post talking about the python perf wall https://opensource.googleblog.com/2017/01/grumpy-go-running-python.html17:55
bmace_Google has a TON of python code and they are trying to make it more performant without doing total rewrites.17:55
sbezverkbmace_: that is really cool, thanls for the link!17:56
bmace_:)17:56
*** mgoddard has quit IRC17:56
bmace_i thought it was a really interesting idea, and based on the upside of it maybe Google won't abandon this one, lol.17:56
srwilkers_brblol well17:56
sdakeGROAN: Two design choices we made had big consequences. First, we decided to forgo support for C extension modules.17:56
srwilkers_brbthats a gamble17:56
srwilkers_brbbrb17:57
srwilkers_brbyep17:57
srwilkers_brbalso made me groan when i first read it17:57
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Add cinder control package with kubernetes entrypoint  https://review.openstack.org/42469717:57
bmace_yeah. there is certainly a set of libs that will probably need to be re-written / unsupported by Grumpy.17:57
sdakeanyway jascott1 srwilkers_brb if you fellas are keen - psot on the mailing list and ask others if someone would be keen to get going on it17:57
sdakepun intended :)17:57
bmace_but at least it can compile down all the pure python stuff17:57
jascott1sdake i think srwilkers and I can conspire todo that17:58
*** athomas has quit IRC17:59
sdakejascott1 where in kolla is there a performance limitation?17:59
sdakeor srwilkers_ ^17:59
sdakewe are always limitedd by disk io speed and netowrk bandiwdth17:59
sdakerarely cpu utilizaiton17:59
bmace_i can see it maybe in base ostk.. but in what we do in kolla / kolla-k8s i don't know where Go rather than python would actually make a bit perf diff18:00
sdakekolla in general is io-bound not cpu-bound18:00
*** inc0 has joined #openstack-kolla18:00
sdakebmace_ especially some of the base libraries like oslo.log for example18:00
*** matrohon has quit IRC18:00
sdakebmace_ also - today got jammed up on iscsi18:01
*** inc0 has quit IRC18:01
bmace_i'm sure i'll hit it soon sdake :)18:02
sdakebmace_ "there is no iscsi directory availble" when running the dev env (the last script in the chain)18:02
jascott1sdake swift18:02
*** krtaylor has quit IRC18:02
*** adrian_otto has joined #openstack-kolla18:03
jascott1i think the swift/hummingbird approach made sense. they hit a performance wall and they just re-wrote the parts in go that they needed to improve18:03
*** inc0 has joined #openstack-kolla18:04
*** inc0 has quit IRC18:05
*** strigazi is now known as strigazi_AFK18:05
jascott1imo for kolla the advantage would be to take advantage of other tooling like operators that others (coreos etc) have written18:07
sdakejascott1 yareuse is another technicl advantage18:07
sdakereuse18:07
jascott1yar18:07
sdakegroan - hopefully ou parsed that :)18:08
jascott1:)18:08
sdakei wish i had time to get go into openstack - sadly i am going 18 hrs a day to keep up with kids + work + wife + parents + extended fmailly18:08
sdakeI've got nothing left to give for anyone else :)18:08
*** inc0 has joined #openstack-kolla18:08
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Create deliverables.yaml  https://review.openstack.org/42478418:16
*** sean-k-mooney has quit IRC18:16
*** inc0 has quit IRC18:16
*** sean-k-mooney has joined #openstack-kolla18:17
*** TxGirlGeek has quit IRC18:17
jascott1sdake man you sounding like the giving tree18:21
sdakejascott1 lol18:21
sbezverkjascott1: where is the fun of reusing other people work? it kind of kills innovation spirit, no?18:22
*** inc0 has joined #openstack-kolla18:22
jascott1i always hated the kid in that story.. greedy b457ard18:22
*** lrensing has quit IRC18:22
sdakesbezverk we reuse the acii character set on a daily basis18:22
*** TxGirlGeek has joined #openstack-kolla18:22
sdakeand atleast in the US, we use the QWERTY keyboard18:22
*** sambetts is now known as sambetts|afk18:22
sdakeand we use tables, knives, forks, spoons, plates18:23
sbezverksdake: if you enjoy it, good for you ;)18:23
sdakethese are all examples of reuse :)18:23
jascott1sbezverk agree "the fun" is diminished but saving time and eating with family is nice ;)18:23
sdakesbezverk ya its not fun integrating thats for sure18:23
sdakesbezverk i think - in the oeprator example, we want to have a bit of diversity in opinions about what those things really look like18:24
*** hfu has joined #openstack-kolla18:24
*** sp___ has joined #openstack-kolla18:24
sdakenot sure a reuse technical argument makes sense for k8s-oeprators18:24
jascott1finally got PTG approval email :)18:24
sdakehowever ther eis reuse of the interface18:24
*** inc0 has quit IRC18:24
*** bpattewar has joined #openstack-kolla18:25
jascott1sdake yup interface{}18:25
sdakeinterface to kubernetes that is (the rest api)18:25
*** lrensing has joined #openstack-kolla18:25
sdakepersoanlly i'm happy with python calling kubectl or helm via shellout18:25
jascott1all the libraries for k8s/helm/yaml/templating etc18:25
sdakesince it runs in a contianer who cares18:25
sdakethat is what rocks about containers- they turn an imperative system into a delcartive system18:26
sdakeand remove all the religious battles in the process :)18:26
sbezverksdake: I think the main re-use argument, is that people do not want to undersatnd details, it is easier to get blackbox and use it hoping it will work as expected..18:27
*** bjolo has joined #openstack-kolla18:27
jascott1not to mention with golang you can create a container that is 80% smaller than a typical one if you so desire18:27
jascott1if the blackbox tests ok, i dont care (usually)18:28
*** dave-mccowan has quit IRC18:30
jascott1if there was a generic operator that worked well it would be silly to port to python just because its not python18:30
*** sp___ has quit IRC18:31
sbezverkjascott1: do not get me wrong, I am for golang.. the operator I am working on now will be re-written in go, guaranteed..18:32
sbezverkjascott1: it is just since I enjoy doing what I am doing, I do not like idea of people reducing amount of fun for me.. :)18:32
jascott1oh sorry wasnt trying to under appreciate your efforts!18:33
jascott1im happy to be fun adjacent myself18:33
*** mgoddard has joined #openstack-kolla18:33
jascott1the caffeine must flow18:33
jascott1brb18:34
*** sdake has quit IRC18:37
*** gfidente is now known as gfidente|afk18:43
*** hfu has quit IRC18:44
*** krtaylor has joined #openstack-kolla18:44
*** inc0 has joined #openstack-kolla18:44
*** sdake has joined #openstack-kolla18:45
*** hfu has joined #openstack-kolla18:46
*** hfu has quit IRC18:46
sdakesbezverk having fun is good - my kids keep me so busy - fun is not a luxury i really have often18:54
sdakesbezverk might as well maek work enjoyable18:55
*** inc0 has quit IRC18:57
*** dave-mccowan has joined #openstack-kolla18:57
*** inc0 has joined #openstack-kolla19:00
*** shardy is now known as shardy_afk19:04
openstackgerritsayantani proposed openstack/kolla: Update Bifrost documentation  https://review.openstack.org/41711419:04
*** l4yerffeJ__ has joined #openstack-kolla19:10
*** l4yerffeJ_ has quit IRC19:10
*** TxGirlGeek has quit IRC19:11
*** TxGirlGeek has joined #openstack-kolla19:12
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Add cinder control package with kubernetes entrypoint  https://review.openstack.org/42469719:13
*** inc0 has quit IRC19:14
*** MasterOfBugs has joined #openstack-kolla19:14
*** lrensing has quit IRC19:16
*** inc0 has joined #openstack-kolla19:20
*** lrensing has joined #openstack-kolla19:20
openstackgerritsayantani proposed openstack/kolla-ansible: Update bifrost playbooks  https://review.openstack.org/42438419:21
*** schwicht has quit IRC19:26
*** sayantani01 has quit IRC19:27
*** sayantani01 has joined #openstack-kolla19:28
*** schwicht has joined #openstack-kolla19:28
*** sayantani01 has quit IRC19:32
*** inc0 has quit IRC19:41
*** harlowja has joined #openstack-kolla19:41
*** inc0 has joined #openstack-kolla19:45
*** lrensing has quit IRC19:49
*** TxGirlGeek has quit IRC19:49
*** mgoddard has quit IRC19:50
*** TxGirlGeek has joined #openstack-kolla19:51
*** sdake has quit IRC19:52
*** inc0 has quit IRC19:56
*** sdake has joined #openstack-kolla19:57
*** flaper87 has joined #openstack-kolla19:59
*** eaguilar_ has quit IRC20:05
sdakesup flaper8720:07
flaper87sdake: yo! :D20:08
* flaper87 in TC meeting but almost dying20:08
sdakeflaper87 there was alot of q&a earlier on golang as a language choice for openstack - any chance you know who to put jascott1 and srwilkers_ in touch with that is leading that effort?20:10
*** sayantani01 has joined #openstack-kolla20:11
kfox1111sbezverk: here's an odd one: http://logs.openstack.org/68/424368/1/check/gate-kolla-kubernetes-deploy-centos-binary-3-ceph-multi-nv/8c04334/logs/openstack/kolla-neutron-openvswitch-agent-compute-38zf2.txt20:11
sdakeflaper87 tell me aout it - had an eye exam yesterday - doctor was overly-thorough - eyes kiling me20:11
flaper87sdake: that'd be me, at least as far as the process for introducing a new language goes. Then, I know dtroyer is working on adding testing for golang20:11
sdakeflaper87 i think thes eguys want to build some critical mass - but not sure20:12
flaper87sdake: :( that sucks :( hope you'll feel better soon20:12
sdakeflaper87 the more people working on it, i think the more likely it is to happen20:12
sdakei'll be fine :)20:12
flaper87sdake: yup, I'm happy to chat and answer questions on the topic20:12
*** adrian_otto has quit IRC20:12
flaper87or point ppl in the right direction20:12
sdakeits not as bad as a dentist torture session20:12
sdakeflaper87 i don't personally ahve time to get involved, however, i know jascott1 and srwilkers_ have an interest20:13
sdakeflaper87 they may be afk at the moment - lunch time on the west coast for jascott1, not certain of srwilkers_ 's timezone20:14
*** adrian_otto has joined #openstack-kolla20:17
*** mgoddard has joined #openstack-kolla20:21
openstackgerritBertrand Lallau proposed openstack/kolla: Update dumb-init to version 1.2.0  https://review.openstack.org/42483220:21
*** TxGirlGeek has quit IRC20:24
*** adrian_otto has quit IRC20:24
*** sdake_ has joined #openstack-kolla20:24
*** TxGirlGeek has joined #openstack-kolla20:24
sbezverkkfox1111: I think ovs datapath is not loaded20:25
sbezverkthat is why br-int returns has datapath-ID []20:26
kfox1111yeah. kind of seems like it.20:26
kfox1111but theres a dep there.20:26
*** TxGirlGeek has quit IRC20:26
sbezverkkfox1111: it is not dependency, it is modprobe20:26
*** TxGirlGeek has joined #openstack-kolla20:27
kfox1111I thought neutron-openvswitch-agent depended on openvswitch socket though?20:27
kfox1111seems like it came up too early though?20:27
*** sdake has quit IRC20:28
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Add cinder control package with kubernetes entrypoint  https://review.openstack.org/42469720:29
kfox1111is there a case where the socket gets created before the db's initted somehow?20:29
sbezverkkfox1111: ahhhh that is our issue I hit, I knew it looked familiar20:29
sbezverkkfox1111: if neutron agent comes up before vswitchd it happens20:30
*** TxGirlGeek has quit IRC20:30
sbezverkkfox1111: as vswitchd loads ovs module20:30
kfox1111I thought the vswitchd created the unix socket though?20:30
kfox1111or is that the db?20:30
sbezverkkfox1111: no onlt ovsdb creates socket20:31
kfox1111ah.20:31
kfox1111so, does the db need to load the module,20:31
kfox1111or must we ensure both are up?20:31
sbezverkkfox1111: vswitchd loads module, never tried to load it in ovsdb though20:32
kfox1111or we could just do it in both.20:32
sbezverkkfox1111: if we do it in both, second might generate an error and the whole thing fails then..20:35
sbezverkkfox1111: better solution is to ensure that pods are running, no?20:36
*** srwilkers_brb is now known as srwilkers20:36
*** lrensing has joined #openstack-kolla20:38
kfox1111I think a modprobe of somethign thats already there is a noop.20:44
kfox1111if both pods really need to be running though, then yeah, we should build that in somehow.20:44
kfox1111the problem is non pod support too.20:44
kfox1111the check to see if the pods are running should work with the case where your running openvswitch on the host too.20:45
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Local registry in gate for trunk builds  https://review.openstack.org/41855020:46
* sdake_ wtb bed20:46
*** sdake_ is now known as sdake20:46
sbezverkkfox1111: that is more complicated scenario20:47
kfox1111ah... interesting.20:47
kfox1111the arm folks are interesting in kolla with debian.20:48
kfox1111sbezverk: yes/no. it works today, as openvswitch is always started before docker.20:48
kfox1111so never really a problem.20:48
kfox1111but if we add more deps handling it may run afoul of that.20:48
kfox1111just need to be careful.20:49
sbezverkkfox1111: sure when you control things at microservice level, absolutely. I was talking about more generic service level deploymnet, where you start everything and just wait for it to converge20:50
sbezverkthe way neutron ovs agen is written today it does not restart20:50
sbezverkit just dies20:50
sbezverkthat is why it is really important for it to make sure that either internal vswitchd loaded module or your host has it already..20:51
sbezverkkfox1111: do you know a way to disassemble yum package to see what it does exactly during the install?20:53
kfox1111hmm... k. will have to think on that one...20:53
kfox1111sbezverk: from file or from installed package?20:53
sbezverkkfox1111: no worries, I will google it20:53
sbezverkkfox1111: does not matter I guess20:54
kfox1111rpm --scripts -qpf foo.rpm #for rpm20:54
kfox1111rpm --scripts -q rpmname for installed.20:54
kfox1111well, rpm --scripts -qp foo.rpm #for rpm20:54
kfox1111had an extra f there.20:54
sbezverkkfox1111: thanks!20:54
kfox1111np20:54
*** TxGirlGeek has joined #openstack-kolla20:55
openstackgerritsayantani proposed openstack/kolla-ansible: Fix bootstrap.yml in Bifrost  https://review.openstack.org/42427120:55
*** TxGirlGeek has quit IRC21:00
*** jrobinson has joined #openstack-kolla21:04
openstackgerritBertrand Lallau proposed openstack/kolla: Clean dockerfile output on Ubuntu distro  https://review.openstack.org/42484921:05
*** TxGirlGeek has joined #openstack-kolla21:05
*** gfidente|afk has quit IRC21:06
*** satyar has quit IRC21:08
*** srwilkers has quit IRC21:08
*** dave-mccowan has quit IRC21:10
*** adrian_otto has joined #openstack-kolla21:10
*** sacharya has quit IRC21:12
*** sacharya has joined #openstack-kolla21:14
*** msimonin has joined #openstack-kolla21:16
*** mgoddard has quit IRC21:20
*** shardy_afk is now known as shardy21:27
*** schwicht has quit IRC21:27
*** jrobinson has quit IRC21:27
*** jrobinson has joined #openstack-kolla21:28
*** williamcaban has quit IRC21:29
*** williamcaban has joined #openstack-kolla21:29
*** l4yerffeJ has joined #openstack-kolla21:34
*** Jeffrey4l_ has joined #openstack-kolla21:34
*** l4yerffeJ__ has quit IRC21:35
*** Jeffrey4l has quit IRC21:35
*** schwicht has joined #openstack-kolla21:39
*** zioproto has joined #openstack-kolla21:42
*** portdirect is now known as portdirect_away21:46
*** zioproto has quit IRC21:46
jascott1sdake FYI srwilkers is in St Louis21:48
*** williamcaban has quit IRC21:51
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder control package with kubernetes entrypoint  https://review.openstack.org/42469721:54
kfox1111oh... setip is run later.. hmm.21:55
*** breitz has quit IRC21:59
*** breitz has joined #openstack-kolla22:00
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Local registry in gate for trunk builds  https://review.openstack.org/41855022:01
sbezverkkfox1111: cinder deployment was successful, when you have a chance please review: https://review.openstack.org/42469722:02
*** aj_power has quit IRC22:03
*** jtriley has quit IRC22:04
*** TxGirlGeek has quit IRC22:14
*** TxGirlGeek has joined #openstack-kolla22:15
*** rhallisey has quit IRC22:15
*** l4yerffeJ has quit IRC22:16
*** l4yerffeJ has joined #openstack-kolla22:16
*** inc0 has joined #openstack-kolla22:18
*** sayantani01 has quit IRC22:22
*** sayantani01 has joined #openstack-kolla22:22
*** sayantani01 has quit IRC22:23
*** sayantani01 has joined #openstack-kolla22:23
*** fguillot has quit IRC22:23
*** TxGirlGeek has quit IRC22:24
*** TxGirlGeek has joined #openstack-kolla22:24
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder control package with kubernetes entrypoint  https://review.openstack.org/42469722:25
*** sayantani01 has quit IRC22:25
*** sayantani01 has joined #openstack-kolla22:26
*** krtaylor has quit IRC22:27
*** lrensing has quit IRC22:27
*** sayantani01 has quit IRC22:30
inc0centos gates are broken/22:32
*** MasterOfBugs has quit IRC22:33
*** pramodrj07 has joined #openstack-kolla22:33
*** matrohon has joined #openstack-kolla22:34
kfox1111inc0 more specific please22:34
kfox1111kolla-ansible, kolla-kubernetes, kolla?22:35
inc0https://review.openstack.org/#/c/424784/1 lots of red22:35
inc0kolla22:35
kfox1111k. thanks.22:35
*** mgiles has quit IRC22:39
*** TxGirlGeek has quit IRC22:40
*** adrian_otto has quit IRC22:41
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Create deliverables.yaml  https://review.openstack.org/42478422:41
inc0SamYaple, wanna get kolla-salt into the fold?22:42
inc0just submit patch to ^22:42
inc0:)22:42
*** TxGirlGeek has joined #openstack-kolla22:43
inc0bbl, moving home22:44
*** inc0 has quit IRC22:44
*** huzhengchuan has joined #openstack-kolla22:47
*** TxGirlGeek has quit IRC22:48
*** lamt has quit IRC22:49
*** david-lyle has quit IRC22:50
*** lamt has joined #openstack-kolla22:51
*** david-lyle has joined #openstack-kolla22:53
bmace_sdake: try out the latest containerized dev env stuff today?22:56
sdakebmace_ indeed this morning22:56
sdakebmace_ complaint from the devenv script about iscsi not available22:57
sdakebmace_ i had some quesitons about whether iscsi needs to be enabled in teh host os or something similar22:57
sdakebmace_ how far did you get?22:57
*** TxGirlGeek has joined #openstack-kolla22:57
bmace_got a new error in genconfig when i just re-built mine (to pick up the genconfig fixes from yesterday rather than using local patches).  something in fluentd22:58
bmace_need to chase it down22:58
sdakei did not get a new error22:58
sdakearound fulentd22:58
bmace_and you did a complete container rebuild recently?22:58
sdakebmace_ - i am installing actually on bare metal not using the container part22:59
bmace_since i was getting well past this point yesterday and the same env i had before it feels likely it is a new issue.22:59
kfox1111bmace_: maybe just pin to the same version of kolla-ansible the gate's using, until all the issues can be resolved?22:59
*** huzhengchuan has quit IRC23:00
bmace_kfox1111: yeah, i may need to do just that.  never like picking up the bleeding edge for exactly these kinds of reasons.23:01
sdakebmace_ i wiped out my gear entirely and was running the scripts manually rather then in the container23:01
sdakeagainst a self-installed version of kubernetes23:02
sdakevia kubeadm23:02
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Local registry in gate for trunk builds  https://review.openstack.org/41855023:02
*** eaguilar has joined #openstack-kolla23:04
sdakebmace_ i think if you wipe out your entire thingy and start with master and the script with a cherrypick it should work for you up to the iscsi part23:04
bmace_sdake: why not do it in a container?23:04
sdakekfox1111 do you know what the deal is with iscsi and its requirements for the host os?23:04
sdakebmace_ complicates things imo - although container I guess is worth a shot23:04
kfox1111sdake: no. sbezverk would know.23:04
sdakesbezverk wtb help :)23:05
bmace_sdake: well, the magic of containers, i did wipe out my entire "thingy" with an image delete and built a new one :)23:05
sdakehogepodge ping23:05
kfox1111sdake: or the tools/setup_gate_iscsi.sh script23:05
hogepodgesdake: hi23:05
*** mliima has quit IRC23:05
sbezverksdake: what is up?23:05
*** mliima has joined #openstack-kolla23:06
sdakehogepodge i don't know if you would be interested, however, we have a biweekly unofficial workgroup with helm happening between openstack on kubernetes efforts and the helm upstream community23:06
bmace_sdake: i think doing it all in a container actually simplifies things a lot.  you don't need to have your scripts nearly as complicated, supporting multiple os types, etc.. just support the container base image type.23:06
sdakehogepodge since your involved in interop not sure if its your area or someone elses23:06
sdakehogepodge if you like I can forward you teh meeting invitiation23:06
sdakebmace_ roger - got it23:06
hogepodgesdake: I'm definitely interested23:07
sdakebmace_ ok well not here to argue about methods, I think real operators will want to deploy on bare metla not via a contianer - but could be wrong ;)23:07
kfox1111bmace_: +123:07
sdakebmace_ as a result i was taking that approach23:07
kfox1111sdake: the ideal is, the users install k8s and helm.23:07
sdakekfox1111 right23:07
hogepodgesdake: I'm going to be getting more involved with cross-community projects between OpenStack and Kubernetes this year, so it's squarely something I'd like to participate in23:07
kfox1111then we have the dev env, in a helm chart in the stable helm repo.23:07
sdakehogepodge pm your email address and i'll forward you the invite23:07
kfox1111so the user just has to helm install kolla-dev-env.23:08
sdakehogepodge sweet - if you know others that are interested let me know23:08
kfox1111and they get all the deps handled. :)23:08
*** harlowja has quit IRC23:08
hogepodgesdake: I will. quite likely dfflanders23:08
sdakew eare working on turning this into an official workgroup with biwekely workhops hosted by someone :)23:08
bmace_sdake: well, you can use the container to get everything deployed onto bare metal just as easily as getting it deployed into the kube environment, at least that is the goal for me.23:08
*** eaguilar has quit IRC23:08
kfox1111bmace_: +1 :)23:08
sdakehogepodge where we re jammed up is we dont know how to yet turn that into an official thing and who would do the hosting23:09
sdakehogepodge for the moment we are working on making it "less kolla centric" and more "what does openstack need out of kubernetes and helm" centric23:09
hogepodgesdake: yeah, I've heard a little bit about it.23:09
sdakehogepodge its open to anyone - was on the mailing list last year23:09
*** krtaylor has joined #openstack-kolla23:09
*** matrohon has quit IRC23:10
*** sacharya has quit IRC23:12
sbezverkbmace_: deploying things in container is great when it is working, but for debugging it adds an extra layer of complexity and dependency..23:13
*** msimonin1 has joined #openstack-kolla23:13
*** huzhengchuan has joined #openstack-kolla23:13
sbezverkif you container engine is screwed up23:13
sbezverkconatiner is not going to hel much ;-)23:13
bmace_sbezverk: it hasn't been too bad really.  i just swapped the on run of the container to a forever sleep and exec -it into it to do all my running of scripts / debugging23:13
sbezverkbmace_: you must have missed people were not happy with docker 1.13 recently23:14
sbezverkthat is what I am tlaking about23:14
bmace_sbezverk: oh, that, yes I saw a lot of discussion around that.23:15
SamYaplesbezverk: what happened with docker 1.13?23:15
sbezverkSamYaple: you'd beter ask portdirect23:15
SamYapleim running it without issue :/23:15
sbezverksince he put together a workaround. I think it is somehitng with '-' in repo name23:16
bmace_SamYaple: i believe there were some helm / tiller issues that popped up because of some 1.13 behavior23:16
SamYaplebmace_: gotcha23:16
sbezverkor something like that but I might be wrong23:16
*** msimonin has quit IRC23:16
SamYapleportdirect_away: ping ^ poke ^23:16
*** lrensing has joined #openstack-kolla23:16
*** mliima has quit IRC23:17
*** sayantani01 has joined #openstack-kolla23:18
*** haplo37 has quit IRC23:18
*** mliima has joined #openstack-kolla23:18
kfox1111no.23:19
kfox1111the heart of the issue is:23:19
kfox1111docker 1.13 became more strict with the format retured from docker-registry servers.23:19
kfox1111since there wasn't a spec for the protocol, all the third  party repo's didn't implement it exatly as docker-registry did,23:20
kfox1111and 1.13 broke 3rd party repo's. :/23:20
SamYaplewith regard to naming?23:20
SamYapleor something else?23:20
sbezverkkfox1111: was it not with somehitng in repo name?23:20
kfox1111and aparently, docker never tried to pull from google's repo or some of the others to validate.23:20
*** schwicht_at_work has joined #openstack-kolla23:20
kfox1111SamYaple: no, it was a server http return field that became more strict.23:20
SamYaplekfox1111: i think they talked about that a while ago23:22
SamYapleit was part of there backwards compat effort23:22
kfox1111the review I saw seemed to indicate they might have known it was a problem but pushed forward anyway...23:22
SamYapleso now client versions will be a bit looser (older clients with newer daemon and vice versa)23:22
kfox1111can't find the issue now though. :/23:22
*** sayantani01 has quit IRC23:23
sbezverkkfox1111: this one https://github.com/docker/docker/issues/3008323:23
sbezverk?23:23
*** schwicht has quit IRC23:23
kfox1111https://github.com/kubernetes/helm/issues/183823:23
kfox1111was the root, but its nested several down....23:24
kfox1111sbezverk: yeah. thats the one.23:24
*** schwicht has joined #openstack-kolla23:25
*** haplo37 has joined #openstack-kolla23:27
*** schwicht_at_work has quit IRC23:28
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Local registry in gate for trunk builds  https://review.openstack.org/41855023:31
*** dave-mccowan has joined #openstack-kolla23:34
kfox1111sbezverk: there is an issue with the openvswitch service package.23:34
*** schwicht has quit IRC23:34
kfox1111the dep is vswitchd_network.23:34
kfox1111but if the user sets type=compute, then it has no deps.23:34
sbezverkkfox1111: values.yaml covers only gate scenario when network is used23:36
kfox1111yeah, but if it was moved up a level, then it would workf or both type=compute and type=network.23:37
kfox1111the value is just too specific.23:37
sbezverkkfox1111: user just need to add section for compute23:37
kfox1111the deps will be the same both ways. seems like a waste to force the user to set deps when just changing the type.23:37
sdakehogepodge its Chris Hoge and David Flanders correct?23:38
sbezverkI do not think itis that easy as it would add dependency to ovsdb23:39
sdakehogepodge I know your name is chris, and I think its spelled hoge :)23:39
sbezverkkfox1111: ^^23:39
sdakehogepodge jsut want ot make sure so lachie can get the names correctly in the invitation23:39
kfox1111sbezverk: should be able to set it at global.kolla.openvswitch.vswitchd.all so that it affects all vswitchd's but not db's.23:40
sbezverkkfox1111: hm, I do not think we have it in search path23:40
sbezverkactually you are right, we do have it23:41
kfox1111I thoguth we did. but if not, we probbaby shoudl add it.23:41
sdakehogepodge well if I get it wrong, sorry about that :)23:41
sbezverkkfox1111: do you want to fix it?23:42
kfox1111I've got a lot of ps's I'm juggling already. if you have a moment, could you do it please?23:42
kfox1111this trunk build one is going to be the death of me. :/23:42
*** mliima has quit IRC23:42
sbezverkkfox1111: sure no worries23:42
kfox1111thanks. :)23:43
*** mliima has joined #openstack-kolla23:43
kfox1111trying to get the trunk one in, so I can reuse the infra to cache the 2.x and 3.x containers too, to make the gate more stable.23:43
*** trey_ has joined #openstack-kolla23:43
kfox1111it was really close until we hit a neutron cli change. :/23:43
kfox1111then it went sideways really quick. :/23:44
*** sdake has quit IRC23:45
openstackgerritMarcus Williams proposed openstack/kolla: Add OpenDaylight Container to kolla  https://review.openstack.org/41636923:46
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Fixing location of dependency for vswitchd  https://review.openstack.org/42490223:47
hogepodgeGot it, thanks. Was out walking the dog (and myself)23:50
kfox1111arg.... looks like the openstack cli may be doing something different, the other way, in older versions. :/23:51
kfox1111so basic_tests may have to know version now. :/23:51
*** schwicht has joined #openstack-kolla23:53
*** schwicht has quit IRC23:58
*** harlowja has joined #openstack-kolla23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!