Tuesday, 2017-02-07

*** sacharya has joined #openstack-kolla00:03
*** crushil has quit IRC00:04
*** salv-orl_ has quit IRC00:05
*** crushil has joined #openstack-kolla00:07
*** sacharya has quit IRC00:07
*** lamt has quit IRC00:10
clilesis there a quick way to only deploy a single container from a source build?00:10
*** yingjun has joined #openstack-kolla00:11
clilesI tried using tags but that doesn't work when there are multiple containers under the tag00:13
clilesfor example, to deploy horizon from a src build also tries to deploy fluentd from src00:14
*** huzhengchuan has joined #openstack-kolla00:23
*** sdake has joined #openstack-kolla00:32
sdakebmace_ thats the one00:32
sdakebmace_ sadly it was generated by swagger it appears :(00:32
sdakeswagger = big pile of garb00:32
sdakepacke hsould b ecalled python-kubernetesclient as well00:32
sdakeoh well ;-)00:32
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: [TEST][MASTER][KOLLA-ANSIBLE]Enable dumb-init 1.1.3 debug log  https://review.openstack.org/42990800:33
bmace_sdake: not a lot of good examples, and the tests in there are complete garbage.. but i'm muddling through.  thank goodness for pycharm + auto-complete.00:34
sdakebmace_ on the plus side atleast the kubernetes community has committed to maintaing it :)00:35
bmace_not that hard when it is just a pile of auto-generated ... swagger droppings ;)00:37
*** jtriley has joined #openstack-kolla00:43
*** zhurong has joined #openstack-kolla00:45
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815000:45
*** sdake has quit IRC00:45
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: [TEST][MASTER][KOLLA-ANSIBLE]Enable dumb-init debug log  https://review.openstack.org/42968100:49
openstackgerritLi Yingjun proposed openstack/kolla-kubernetes master: Fix different repo issue for documentation  https://review.openstack.org/40505400:53
*** spsingh_ has quit IRC00:55
*** cuongnv has joined #openstack-kolla00:55
*** lrensing has quit IRC01:01
*** david-lyle has quit IRC01:06
*** yingjun has quit IRC01:11
kfox1111bmace_: yeah, someone just needs to hookin bashate into the gate.01:14
*** zhubingbing_ has joined #openstack-kolla01:18
*** sacharya has joined #openstack-kolla01:19
duonghqmorning guys01:19
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815001:23
*** sacharya has quit IRC01:24
sbezverkbmace_: let's add after refactoring gate, if you do not mind01:24
*** spsingh_ has joined #openstack-kolla01:26
spsingh_kfox1111: sorry got slept01:28
kfox1111no worries. :)01:28
spsingh_kfox1111: I run "tox -e py35"01:29
spsingh_then i got that error01:29
bmace_sbezverk: i don't mind.  there is only one script that doesn't pass bashate right now.  tools/setup_gate.sh and that can certainly be fixed before the check is official / voting01:30
kfox1111spsingh_: its off my scrollback log. can you paste.openstack.org it please?01:30
kfox1111bmace_: wow. I'm surprised there isn't more failing...01:31
kfox1111bmace_: maybe its skipping tests/bin/*.sh?01:31
bmace_kfox1111: oooh, actually, lol, right now the bashate check in tox.ini looks like it only even looks at tools/setup_gate.sh01:32
spsingh_kfox1111: do you have kolla-k8s setup env ?01:32
bmace_kfox1111: so, it is probably a lot worse.. maybe i'll fix at least that01:32
spsingh_kfox1111: if yes01:32
spsingh_then please cherry pick from https://review.openstack.org/#/c/416880/01:33
spsingh_and run the same command at once  i.e tox -e py3501:34
spsingh_if no error then it will be my env issue01:34
kfox1111bmace_: ah. that, I could believe. :)01:34
kfox1111spsingh_: currenly, just testing in the gate.01:34
sbezverkbmace_: setup_gate.sh is one the files I am currently working on.. so appreciate no merge conflicts ;)01:35
bmace_sbezverk: fair enough.  i'll control my bashate fix urge for the time being.01:35
spsingh_kfox1111: np, i hv to confirm at my end01:36
*** rwallner has joined #openstack-kolla01:36
sbezverkjascott1: ping01:36
kfox1111gotta head out again for a while. l8r.01:40
*** rwallner has quit IRC01:41
*** cuongnv_ has joined #openstack-kolla01:41
*** rhallisey has quit IRC01:42
*** cuongnv has quit IRC01:47
openstackgerritJeffrey Zhang proposed openstack/kolla master: Revert "Update dumb-init to version 1.2.0"  https://review.openstack.org/42990701:49
*** adrian_otto has quit IRC01:49
*** cuongnv_ is now known as cuongnv01:54
SamYapleJeffrey4l: you know you dont need dumb-init anymore01:56
Jeffrey4lSamYaple, really?01:57
Jeffrey4lhow?01:57
Jeffrey4lSamYaple, mind explain? or give me a key word/link?01:59
*** sacharya has joined #openstack-kolla01:59
SamYapleJeffrey4l: docker 1.1301:59
SamYapleJeffrey4l: run with 'dockerd --init'02:00
SamYaple"--init Run an init process inside containers for signal forwarding and process reaping."02:00
Jeffrey4lOK. i will check that.02:00
Jeffrey4lbut force the end-user to upgrade docker to 1.13 may a little bad.02:00
SamYapleeh you'll have to bumb the docker version at some point. just something to keep in mind02:01
SamYaplei think curling a binary from the internet is more bad personally02:01
Jeffrey4lyes. i will. thanks a lot.02:01
SamYapleno problem!02:01
Jeffrey4llol02:01
SamYapleit comes with a default init thats like dumb-init, but you can override the init that it provides too02:02
SamYapleits a pretty neat thing (and about time)02:02
*** spsingh_ has quit IRC02:02
Jeffrey4lyep. I also found there is "--init" parameter for docker run.02:03
Jeffrey4lwhich is nice.02:03
Jeffrey4lthis should be handled by docker.02:04
SamYaplei didn't know they added it for docker run. thats pretty cool02:04
Jeffrey4lSamYaple, just tested "docker run --init" which works.02:06
*** zhangqiankun has joined #openstack-kolla02:09
*** unicell1 has quit IRC02:19
openstackgerritjangseon ryu proposed openstack/kolla-ansible master: This feature is supporting for collecting log from IPA.  https://review.openstack.org/42855302:20
*** hfu has joined #openstack-kolla02:20
*** japestinho has joined #openstack-kolla02:24
*** japestinho has quit IRC02:26
*** japestinho has joined #openstack-kolla02:26
*** MasterOfBugs has quit IRC02:30
Jeffrey4lsome finds about docker run --init. docker is re-use tini as its init process. now it is using v0.13.002:33
Jeffrey4lhttps://github.com/krallin/tini02:35
SamYapleJeffrey4l: cool. anything docker official is good though02:41
*** sudipto_ has joined #openstack-kolla02:55
*** sudipto has joined #openstack-kolla02:55
openstackgerritZeyu Zhu proposed openstack/kolla-kubernetes master: Using yaml.safe_load instead of yaml.load  https://review.openstack.org/43000302:57
Jeffrey4lSamYaple, yep. I am think whether kolla should move to tini. ;)03:02
SamYapleJeffrey4l: or just make the push to docker 1.1303:05
SamYapleit has the most bug improvements than ive seen in a long time03:06
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815003:06
SamYaplewhat for docker 1.13.1 i think03:06
Jeffrey4lwe are almost at the end of this cycle. it is a little later to do so. and 1.13.1 is not release either.03:08
*** david-lyle has joined #openstack-kolla03:13
*** caowei has joined #openstack-kolla03:14
openstackgerritZeyu Zhu proposed openstack/kolla-kubernetes master: Using yaml.safe_load instead of yaml.load  https://review.openstack.org/43000303:17
*** adrian_otto has joined #openstack-kolla03:25
*** caowei_ has joined #openstack-kolla03:29
openstackgerritBorne Mace proposed openstack/kolla-kubernetes master: WIP: Added support for containerized dev bringup  https://review.openstack.org/42929503:32
openstackgerritBorne Mace proposed openstack/kolla-kubernetes master: WIP: Added support for containerized dev bringup  https://review.openstack.org/42929503:33
*** caowei has quit IRC03:34
*** caowei_ is now known as caowei03:34
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815003:37
openstackgerritZeyu Zhu proposed openstack/kolla-kubernetes master: Using yaml.safe_load instead of yaml.load  https://review.openstack.org/43000303:41
openstackgerritMerged openstack/kolla master: Delete the extra blank lines  https://review.openstack.org/42937803:48
*** adrian_otto has quit IRC03:53
*** zhurong has quit IRC03:57
openstackgerritAnh Tran proposed openstack/kolla-kubernetes master: Typo fix: amoung => among  https://review.openstack.org/43004804:10
*** dave-mccowan has quit IRC04:14
*** prameswar has joined #openstack-kolla04:15
*** adrian_otto has joined #openstack-kolla04:21
*** mdnadeem has joined #openstack-kolla04:25
*** adrian_otto has quit IRC04:30
*** rwallner has joined #openstack-kolla04:36
*** unicell has joined #openstack-kolla04:38
*** crushil has quit IRC04:39
*** rwallner has quit IRC04:40
*** adrian_otto has joined #openstack-kolla04:45
*** adrian_otto has quit IRC04:47
*** tonanhngo_ has quit IRC04:47
duonghqberendt, ping04:47
*** jrobinson is now known as jrobinson-afk04:50
*** sudipto_ has quit IRC04:50
*** sudipto has quit IRC04:50
*** sudipto_ has joined #openstack-kolla04:51
*** sudipto has joined #openstack-kolla04:51
*** sudipto has quit IRC04:51
*** sudipto_ has quit IRC04:51
*** adrian_otto has joined #openstack-kolla04:52
*** sdake has joined #openstack-kolla04:52
*** zhangqiankun has quit IRC04:52
*** tonanhngo has joined #openstack-kolla04:52
*** yingjun has joined #openstack-kolla04:52
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Correct the groups for solum in haproxy.cfg.j2  https://review.openstack.org/42040705:02
*** yingjun has quit IRC05:03
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Correct the groups for solum in haproxy.cfg.j2  https://review.openstack.org/42040705:07
*** Daviey has quit IRC05:11
*** sudipto has joined #openstack-kolla05:12
*** sudipto_ has joined #openstack-kolla05:12
*** adrian_otto has quit IRC05:17
*** skramaja has joined #openstack-kolla05:18
*** trinaths has joined #openstack-kolla05:22
*** jrobinson-afk is now known as jrobinson05:32
*** sdake_ has joined #openstack-kolla05:34
*** sdake has quit IRC05:36
*** yingjun has joined #openstack-kolla05:39
*** Guest26049 has joined #openstack-kolla05:39
*** salv-orlando has joined #openstack-kolla05:39
*** david-lyle has quit IRC05:40
*** rwallner has joined #openstack-kolla05:43
*** salv-orlando has quit IRC05:44
*** rwallner has quit IRC05:48
*** sacharya has quit IRC05:48
Guest26049Hello05:49
Guest26049my deployment failed with devstack05:50
*** Guest26049 has left #openstack-kolla05:50
*** adrian_otto has joined #openstack-kolla05:53
spsinghGuest66666: are you same Guest26049  ?06:04
*** yingjun has quit IRC06:05
*** qiliang28 has joined #openstack-kolla06:08
*** qiliang27 has quit IRC06:08
*** qiliang28 is now known as qiliang2706:08
spsinghwhere have you stuck ?06:10
spsinghafter what step deployment get hanged06:10
spsingh?06:10
*** jascott1_ has joined #openstack-kolla06:12
*** satyar has joined #openstack-kolla06:16
*** sdake_ has quit IRC06:22
*** zhurong has joined #openstack-kolla06:23
*** nihilifer has quit IRC06:25
*** nihilifer has joined #openstack-kolla06:26
*** qiliang27 has quit IRC06:33
*** rwallner has joined #openstack-kolla06:36
*** rwallner has quit IRC06:40
*** salv-orlando has joined #openstack-kolla06:40
*** jrobinson has quit IRC06:42
*** salv-orlando has quit IRC06:44
*** saneax-_-|AFK is now known as saneax06:45
*** prameswar has quit IRC06:49
*** ipsecguy has joined #openstack-kolla06:49
*** ipsecguy_ has quit IRC06:50
*** zhuzeyu has joined #openstack-kolla06:56
*** tovin07_ has joined #openstack-kolla06:57
*** adrian_otto has quit IRC06:58
openstackgerritZeyu Zhu proposed openstack/kolla-ansible master: Modify the letter in quickstart  https://review.openstack.org/43009707:10
*** unicell1 has joined #openstack-kolla07:10
*** unicell has quit IRC07:10
*** salv-orlando has joined #openstack-kolla07:11
*** bmace_ has quit IRC07:23
*** bmace_ has joined #openstack-kolla07:23
*** n0isyn0i1e has joined #openstack-kolla07:23
*** n0isyn0ise has quit IRC07:26
*** trinaths has quit IRC07:30
*** zhurong has quit IRC07:31
*** zhurong has joined #openstack-kolla07:35
*** tonanhngo has quit IRC07:36
openstackgerritJeffrey Zhang proposed openstack/kolla master: Use tini instead of dumb-init  https://review.openstack.org/43010807:36
*** leseb has quit IRC07:42
*** pcaruana has joined #openstack-kolla07:46
*** leseb has joined #openstack-kolla07:47
*** pcaruana has quit IRC07:48
*** salv-orl_ has joined #openstack-kolla07:49
berendtduonghq: pong07:50
duonghqberendt, still around?07:50
duonghqabout this bug: https://bugs.launchpad.net/kolla/+bug/162534007:51
openstackLaunchpad bug 1625340 in kolla "Barbican default basic file-based keystone not safe for production" [Critical,Confirmed] - Assigned to Duong Ha-Quang (duonghq)07:51
duonghqI cannot find any clue about using database backend in Barbican docs07:51
duonghqcan you give me some guidanc07:51
*** salv-orlando has quit IRC07:52
berendtduonghq: yes, in appr an hour, just started to work and have to do some other things first07:52
*** trinaths has joined #openstack-kolla07:53
*** matrohon has joined #openstack-kolla07:53
openstackgerritJeffrey Zhang proposed openstack/kolla master: Use tini instead of dumb-init  https://review.openstack.org/43010807:54
duonghqberendt, I'm trying to fix this bug, but cannot find any config in barbican guide07:54
*** pcaruana has joined #openstack-kolla07:55
*** prameswar has joined #openstack-kolla07:57
*** tonanhngo has joined #openstack-kolla08:03
*** tonanhngo has quit IRC08:04
openstackgerritMerged openstack/kolla-ansible master: Fix commands failing when installed from sdist  https://review.openstack.org/42976808:09
*** salv-orlando has joined #openstack-kolla08:15
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: [wip] test scenario2 in gate  https://review.openstack.org/41227908:18
*** salv-orl_ has quit IRC08:21
*** mannamne has joined #openstack-kolla08:27
*** Serlex has joined #openstack-kolla08:27
*** egonzalez has joined #openstack-kolla08:43
*** mannamne has quit IRC08:45
openstackgerritZeyu Zhu proposed openstack/kolla master: Using https instead of http  https://review.openstack.org/43012208:45
*** jascott1_ has quit IRC08:47
*** jascott1_ has joined #openstack-kolla08:48
*** qiliang27 has joined #openstack-kolla08:49
openstackgerritMerged openstack/kolla-ansible master: This feature is supporting for collecting log from IPA.  https://review.openstack.org/42855308:51
*** jascott1_ has quit IRC08:52
openstackgerritZeyu Zhu proposed openstack/kolla-ansible master: Using https instead of http  https://review.openstack.org/43012708:52
*** hachi has quit IRC09:01
*** skuda has joined #openstack-kolla09:03
*** hachi has joined #openstack-kolla09:03
*** salv-orlando has quit IRC09:04
*** zioproto has joined #openstack-kolla09:05
*** salv-orlando has joined #openstack-kolla09:07
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Correct the groups for solum in haproxy.cfg.j2  https://review.openstack.org/42040709:11
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Change Barbican default secret store to pkcs11  https://review.openstack.org/43013709:15
*** hachi has quit IRC09:21
*** Daviey has joined #openstack-kolla09:21
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Correct the groups for solum in haproxy.cfg.j2  https://review.openstack.org/42040709:24
*** hachi has joined #openstack-kolla09:24
*** strigazi1AFK is now known as strigazi09:29
*** mgoddard_ has joined #openstack-kolla09:34
*** mnasiadka has joined #openstack-kolla09:36
*** hrw has quit IRC09:42
*** hrw has joined #openstack-kolla09:43
*** zhurong has quit IRC09:44
des_consoladohey this bug was fixed with a code change https://bugs.launchpad.net/kolla/+bug/1531113 however I'm still getting this behaviour now (using master kolla and kolla-ansible)09:44
openstackLaunchpad bug 1531113 in kolla "Deploy fails with "Docker API Error: client is newer than server" error in stable/liberty" [Low,Invalid]09:44
*** duonghq has quit IRC09:49
*** tovin07_ has quit IRC09:55
*** tovin07 has quit IRC09:56
des_consoladothis is the full error, it's on the creating keystone database task. https://gist.github.com/thomasodot/5cec9a0efc3c8edc92bd001481fe7c4610:10
*** cuongnv has quit IRC10:12
egonzalezdes_consolado: have you recently update docker or docker py? or is a fresh install?10:14
des_consoladoegonzalez: this is fresh - the docker clients are successful in running other services, it's just this mariadb, the starting the db task that is failing. Just going to take a closer look at that task and what's trying to happen.10:17
openstackgerritWei Cao proposed openstack/kolla master: Add Freezer doc link in README.rst  https://review.openstack.org/43018110:18
*** salv-orl_ has joined #openstack-kolla10:19
*** gfidente has joined #openstack-kolla10:19
*** gfidente has quit IRC10:19
*** gfidente has joined #openstack-kolla10:19
*** salv-orlando has quit IRC10:21
openstackgerritWei Cao proposed openstack/kolla-ansible master: Add Freezer doc link in README.rst  https://review.openstack.org/42936710:23
*** caowei has quit IRC10:25
*** satyar has quit IRC10:28
*** mannamne has joined #openstack-kolla10:33
*** sambetts_ is now known as sambetts10:43
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla master: Move fluentd td.repo to base for consistency  https://review.openstack.org/43019310:50
*** spsingh has quit IRC10:57
*** sp_ has joined #openstack-kolla10:58
des_consoladohmmm, the --start-at-task="Name of task" option doesn't seem to work. I'm running: ansible-playbook -i multinode -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla  -e ansible_become=true -e action=deploy kolla-ansible/ansible/site.yml --start-at-task="Creating keystone11:05
des_consolado database"11:05
*** sudipto has quit IRC11:05
*** sudipto_ has quit IRC11:05
egonzalezdes_consolado: ansible version, saw a bug in ansible that doesn't support start-at-task in includes inside roles11:08
des_consoladoegonzalez: is there a version which does support this? I'm on 2.2.1.011:09
egonzalezdes_consolado: tested, with ansible 2.2.1 does not works11:12
egonzalezdes_consolado: https://github.com/ansible/ansible/issues/1573511:13
*** zhubingbing_ has quit IRC11:13
pbourkeanyone know how to convert https://packages.treasuredata.com/GPG-KEY-td-agent into the shorter shas we use in docker/base ?11:13
pbourkee.g. https://github.com/openstack/kolla/blob/master/docker/base/Dockerfile.j2#L25811:14
egonzalezdes_consolado: sorry, it works. was using wrong venv11:14
egonzalezdes_consolado: with 2.1 dont works11:16
des_consoladohmmm for me on 2.2.1.0 it was just running through and not hooking onto the play I gave it. Anyway, rolling back from docker-py 1.10.x to 1.9.x fixed my issue I was saying about above.11:22
egonzalezdes_consolado: what ansible os not evaluation are task names inside the include {{action}}.yml. But other tasks outside runs11:23
*** zhuzeyu has quit IRC11:30
*** jmccarthy has joined #openstack-kolla11:34
*** salv-orl_ has quit IRC11:47
*** salv-orlando has joined #openstack-kolla11:48
*** zhubingbing has joined #openstack-kolla11:54
mliimamorning guys12:00
*** tonanhngo has joined #openstack-kolla12:05
*** pbourke has quit IRC12:05
*** pbourke has joined #openstack-kolla12:06
*** tonanhngo has quit IRC12:06
*** jmontleon has quit IRC12:09
*** britthouser has quit IRC12:11
*** britthouser has joined #openstack-kolla12:11
*** jmontleon has joined #openstack-kolla12:11
*** jtriley has quit IRC12:15
*** rwallner has joined #openstack-kolla12:17
*** skramaja has quit IRC12:18
*** jmontleon has quit IRC12:19
*** jmontleon has joined #openstack-kolla12:25
*** jtriley has joined #openstack-kolla12:25
*** jtriley has quit IRC12:30
*** sdake has joined #openstack-kolla12:37
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815012:38
*** sdake_ has joined #openstack-kolla12:42
*** sdake has quit IRC12:42
*** trinaths has quit IRC12:45
*** mnasiadka has quit IRC12:49
des_consoladoegonzalez: when I do the --start-at-task thing, like ansible-playbook -i multinode -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla  -e ansible_become=true -e action=bootstrap-servers kolla-ansible/ansible/site.yml --start-at-task 'Install docker-py'     I get this:  http://termbin.com/4b2b12:52
des_consoladoit just runs through and does nothing12:52
*** saneax is now known as saneax-_-|AFK12:53
egonzalezdes_consolado: yep, that happens because includes are behind "{{ action }}.yml"12:53
egonzalezprobably is an ansible issue12:53
*** rwallner has quit IRC12:54
*** dave-mccowan has joined #openstack-kolla12:55
openstackgerritSteven Dake proposed openstack/kolla-kubernetes master: Change version from 0.4.0 to 0.5.0  https://review.openstack.org/42395712:58
openstackgerritMerged openstack/kolla-kubernetes master: Using yaml.safe_load instead of yaml.load  https://review.openstack.org/43000312:59
sdake_morning peeps12:59
*** rwallner has joined #openstack-kolla13:00
sdake_anyone seen dounghq around?13:02
*** magicboiz has quit IRC13:06
*** huzhengchuan has quit IRC13:06
*** salv-orlando has quit IRC13:09
*** rhallisey has joined #openstack-kolla13:12
*** sudipto has joined #openstack-kolla13:12
*** sudipto_ has joined #openstack-kolla13:12
egonzalezJeffrey4l: around?13:13
*** klindgren__ has joined #openstack-kolla13:17
*** klindgren_ has quit IRC13:20
*** jheroux has joined #openstack-kolla13:21
openstackgerritMerged openstack/kolla-kubernetes master: Typo fix: amoung => among  https://review.openstack.org/43004813:21
*** egonzalez has quit IRC13:22
*** jtriley has joined #openstack-kolla13:23
*** egonzalez has joined #openstack-kolla13:24
Jeffrey4legonzalez, yep.13:26
egonzaleztesting upgrades faced error with nova cells13:27
Jeffrey4legonzalez, what error message did u get?13:27
egonzalezJeffrey4l: centos/binary http://paste.openstack.org/show/597952/13:29
egonzalezJeffrey4l: that 3 errors. now i'm testing source upgrade to check if the issue is common13:30
*** sp__ has joined #openstack-kolla13:30
*** japestinho has quit IRC13:30
egonzalezThe third is similar to the ubuntu issue, using nova_api_cell0 db instead of nova_cell013:31
Jeffrey4lhrm. seems like the old code have different parameter, and usage in current.13:31
egonzalezyep, i'm using latest registry code at tarball.o.o13:32
*** jtriley has quit IRC13:32
Jeffrey4lwe have use different task in during upgrade13:33
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815013:33
sdake_sbezverk i've got a few patches in the queue that are braindead simple can you please ack them13:34
sdake_Jeffrey4l can you ack this release change for kolla-kubernetes: https://review.openstack.org/#/c/423957/13:35
sdake_Jeffrey4l you may want to take a look to verify i made no errors - its a simple search and replace of 0.4.0 to 0.5.013:35
Jeffrey4lchecking.13:35
egonzalezJeffrey4l: hrm, i have a guess what is the issue. simple_cell_setup is executed before flush handlers, so is using old nova_api container/code13:35
sp__portdirect: ping...13:36
sdake_sp__ i find pings with context work better13:36
sdake_e.g. "ping"13:36
sdake_the person doesn't know whaty ou want13:36
sdake_ping "topic XYZ"13:36
Jeffrey4legonzalez, in my original implementation, this should use old nova_api.13:36
sdake_a sdake: ping = naked ping = much like a naked exception in python not ideal :)13:37
*** sdake_ is now known as sdkae13:37
Jeffrey4li do not think use latest nova code works.13:37
egonzalezJeffrey4l: but, old code points to nova_api_cell0 db instead of nova_cell0, right?13:37
sdkaeJeffrey4l what state of chaos is kolla-kubernetes in atm?13:37
Jeffrey4legonzalez, yes. no idea how nova team think about this.13:38
Jeffrey4lis there any parameter in old code to  change the database name/13:39
portdirectsp_: pong?13:39
Jeffrey4lsdkae, i have no idea ;(13:39
egonzalezJeffrey4l: going to check13:39
openstackgerritVladislav Belogrudov proposed openstack/kolla-ansible master: Allow configuration of HAProxy default timeouts  https://review.openstack.org/43025113:39
Jeffrey4legonzalez, may need change nova's release note.13:39
Jeffrey4lchange/check*13:40
sdkaeportdirect can you review https://review.openstack.org/#/c/423957/ plz as well as https://review.openstack.org/#/c/423973/13:40
*** sp__ has quit IRC13:41
sdkaeJeffrey4l so bsaically kolla-ansible is busted?13:41
sdkaeJeffrey4l and that is caused by nova?13:41
Jeffrey4lsdkae, for upgrade? yes.  but deploy is OK.13:41
sdkaeok - well thats something :)13:42
sdkaewhich part of upgrade, just nova or everything?13:42
sdkaereconfigure working well?13:42
portdirectsdkae: your name makes me think of saké, which I'll need for that 1st one :) will do in the next 3013:42
sdkaeif only we had gate jobs for these things in kolla-ansible :)13:42
egonzalezsdkae: upgrade13:42
Jeffrey4ljust nova. nova changed some thing when creating cellv2.13:42
sdkaeportdirect its easy - its just a sed - should be alot of clicking and eyeballing :)13:42
sdkaeportdirect thanks :)13:42
Jeffrey4lwe have to handle this differently in deploy and upgrade.13:42
sdkaei see13:43
*** sdkae is now known as sdake13:43
sdakeany help needed from the nova team?13:43
sdakeeveryone coming right at em atm because they landed cells right at the end of the cycle13:43
sdakei think they would be willing to consult on where we need to adapt13:43
Jeffrey4li think no , at least now.13:44
sdakeJeffrey4l cool if you need help yo ucan ask on #openstack-nova - just tell em your the release liason for kolla and struggling to release since you can't sort out the cellsv2 upgrade ;)13:45
Jeffrey4li will.13:45
zioprotoI ahve a stupid question. I changed something in /etc/kolla/globals.yaml. If I run the deploy again I see that the docker containers on the controller nodes are not restarted. How do I apply the new configs ?13:45
sdakezioproto kolla-ansible reconfigure will *sometimes* take actions from a global.yamls change and make them real13:45
zioprotowell13:46
sdakezioproto and other times not13:46
zioprotoI changed from fernet tokens to uuid13:46
sdakezioproto globals.yaml changing is not particularly good13:46
sdakezioproto right -this is an example of where changing globals.yaml will probably not work13:46
zioprotowhat should I do now to restart the keystone containers ?13:46
sdakeJeffrey4l any idea on zioproto 's request?13:46
sdakezioproto i'd try reconfigure13:46
sdakezioproto if that doesn't work manual intervention would be required to do what you want13:47
sdakezioproto and i'm not sure anyone on the team knows what that manual intervention is13:47
zioprotogreat13:47
zioprotoI see what I can do13:47
Jeffrey4lzioproto, hrm. need run deploy to run fernet related container. and then reconfigure to make keystone container restart.13:47
sdakezioproto do you ahve a production cloud - or is this a de env?13:47
Jeffrey4lor restart keystone container manually.13:47
zioprotois dev env13:47
sdakezioproto looks like Jeffrey4l knows how to do the job ^ :)13:47
zioprotono worries13:47
sdakezioproto Jeffrey4l suggested kolla-ansible deploy followed by kolla-ansible reconfigure13:48
sdakezioproto if that works for you please do report back, I'd like to hear the results13:48
Jeffrey4lzioproto, which branch code are u using?13:48
Jeffrey4lif master, simple deploy works.13:48
sdakeJeffrey4l nobody really uses master as per the documentation I think13:49
zioprotoI am using stable/newtone13:49
*** mgiles has joined #openstack-kolla13:49
Jeffrey4lzioproto, then you need run "deploy" then "reconfigure"13:50
*** salv-orlando has joined #openstack-kolla13:50
zioprotoJeffrey4l, I did, but looks like from `docker ps` the containers never restart13:51
zioprotoshould they restart to pick up the new config ?13:51
Jeffrey4lzioproto, yes. reconfigure do not restart the container? hrm, maybe there are some bug.13:51
Jeffrey4lzioproto, you can try to restart it manually.13:52
*** sp__ has joined #openstack-kolla13:52
zioprotowow, now this failed like this: http://paste.openstack.org/show/597957/13:53
zioprotoI was doing 'reconfigure'13:53
Jeffrey4lzioproto, keystone container do not run or isn't exist?13:53
zioprotoit is actually running fine13:54
Jeffrey4lzioproto, which docker-engine version are u using?13:54
*** Pavo has joined #openstack-kolla13:55
zioprotoInstalled: 1.11.2-0~xenial13:55
zioprotoit was installed as well by Kolla13:55
zioprotostable/newton13:55
Jeffrey4lok.13:55
Jeffrey4ltry docker inspect keystone13:55
zioprotohttp://paste.openstack.org/show/597958/13:57
zioprotowhat is exacly the difference when doing reconfigure or deploy ?13:58
Jeffrey4lzioproto, doo keystone-ssh and keystone-fernet container running?13:58
Jeffrey4lreconfigure just roll configs into container and then may restart/recreate the container.13:59
Jeffrey4ldeploy just make sure the container is up.13:59
Jeffrey4lthis is a bad implement.13:59
Jeffrey4lin the master we have changed this.13:59
zioprotosoon master will be stable/ocata ?14:00
Jeffrey4lzioproto, yep.14:00
zioprotohow soon ?14:01
Jeffrey4locata branch will be create this week and ocata will be released Mar 10.14:01
openstackgerritJeffrey Zhang proposed openstack/kolla master: Use tini instead of dumb-init  https://review.openstack.org/43010814:02
zioprotogreat, I will try stable/ocata as soon as it is branched then14:03
*** rhallisey has quit IRC14:03
zioprotolooks like no sense to try to debug stable/newton14:03
Jeffrey4lnice.14:03
zioprotoI have some patches for packaging in snap14:03
zioprotolet me check their status14:03
Jeffrey4legonzalez, could u ack https://review.openstack.org/428124 ?14:03
zioprotoJeffrey4l, this will be maybe merged ? https://review.openstack.org/#/c/426703/14:04
Jeffrey4lpackaging kolla in snap?14:04
zioprotosnapcraft.io14:04
zioprotoI am currently using this to package Kolla on Ubuntu14:04
zioprotoit is like having a venv but you can version control it14:05
Jeffrey4lwow. cool14:05
zioprotoJeffrey4l, running on ubuntu ?14:05
Jeffrey4lzioproto, sorry? i am saying package kolla into snap is cool.14:06
zioprotoYes it is already working for me14:06
zioprotobut I cant publish the snap in the Ubuntu Store because I had to build Kolla from my own tree. I need these two things to be merged: https://review.openstack.org/#/c/426703/ and https://review.openstack.org/#/c/427139/14:07
Jeffrey4lre the patch, looks good to me.14:07
Jeffrey4lbut could u rebase the code  to trigger the gate job run again?14:08
Jeffrey4lsome job still red.14:08
zioprotosure, the 426703 right ?14:08
*** lamt has joined #openstack-kolla14:09
openstackgerritSaverio Proto proposed openstack/kolla-ansible master: Fix BASEDIR to package Kolla with snapcraft.io  https://review.openstack.org/42670314:09
Jeffrey4lyep.14:09
openstackgerritMerged openstack/kolla-ansible master: Fix gnocchi auth issue  https://review.openstack.org/42812414:10
Jeffrey4l-1 for your second patch.14:10
Jeffrey4lare u working for snap community? or personally?14:10
openstackgerritSaverio Proto proposed openstack/kolla master: Add SNAP support when finding Docker images folder  https://review.openstack.org/42713914:10
zioprotoworking with folks on #openstack-snaps14:11
zioprotohow can I improve the python patch ?14:12
mliimasomeone can check this erro? http://paste.openstack.org/show/597962/14:12
zioprotowithout that kolla-build does not work14:12
Jeffrey4lzioproto, i leaved some comments in that patch.14:12
Jeffrey4lre #openstack-snaps channel, cool. i haven't known we have that channel.14:12
Jeffrey4lso which project #openstack-snap focusing on?  https://github.com/openstack/snap.openstack ? zioproto14:14
Jeffrey4legonzalez, another simple one. https://review.openstack.org/42945514:14
*** breitz has joined #openstack-kolla14:16
openstackgerritSaverio Proto proposed openstack/kolla master: Add SNAP support when finding Docker images folder  https://review.openstack.org/42713914:17
*** breitz_ has quit IRC14:17
zioprotoJeffrey4l, still here https://github.com/zioproto/snap-kolla14:17
zioprotoAs soon I can build from the stable tree I would ask to move my work into openstack-snaps14:18
openstackgerritMerged openstack/kolla-ansible master: Fix the WARNING in copy keystone domain task  https://review.openstack.org/42937414:18
*** goldyfruit has joined #openstack-kolla14:18
openstackgerritMerged openstack/kolla-ansible master: Mount mnt folder when enabled cinder nfs backend  https://review.openstack.org/42945514:19
*** rhallisey has joined #openstack-kolla14:19
Jeffrey4lcool.14:20
*** lamt has quit IRC14:23
Jeffrey4legonzalez, another one https://review.openstack.org/429242  ;)14:23
openstackgerritJeffrey Zhang proposed openstack/kolla master: Using CI mirror host  https://review.openstack.org/36572114:24
*** sp__ has quit IRC14:26
*** jtriley has joined #openstack-kolla14:29
Jeffrey4legonzalez, this is a little more complex. if u are free please check. https://review.openstack.org/429907 , the details is reported in dumb-init's issue https://github.com/Yelp/dumb-init/issues/13614:29
Jeffrey4li can not explain whether revert work and latest dumb-init works.14:29
Jeffrey4lpbourke, ^^ please check above. your guess is correct. this issue is caused by dumb-init14:31
pbourkeJeffrey4l: ok14:31
pbourkeJeffrey4l: if tinyinit works well Id support moving to it14:32
pbourkeJeffrey4l: as I think official docker images are using it14:32
Jeffrey4lpbourke, yes. i'd like to move tinit.14:32
Jeffrey4li have a patch testing this.14:32
Jeffrey4lhttps://review.openstack.org/43010814:33
pbourkeJeffrey4l: I can approve the revert but I suggest updating your commit message as Daviey outlines14:33
Jeffrey4lpbourke, write/copy every from bug description to commit message? hrm.14:33
pbourke:\14:34
pbourkei dunno14:34
pbourkeI've always liked long commit messages but I agree duplicating info is bad14:34
*** jtriley has quit IRC14:34
pbourkeok if the bug has the info I dont mind14:34
Jeffrey4lanyway, i can add some brief reason in the commit message. but write a long commit message is bad.14:34
pbourkeJeffrey4l: agree, I think its just to help people know the reason at a glance, instead of having to click through and study the full bug report14:35
*** zhurong has joined #openstack-kolla14:35
Jeffrey4li will add a bride description in the commit message.14:35
Jeffrey4lyep. moreover, we still have no idea why revert works ;(14:36
mliimasomeone can check this erro? http://paste.openstack.org/show/597962/14:38
openstackgerritJeffrey Zhang proposed openstack/kolla master: Revert "Update dumb-init to version 1.2.0"  https://review.openstack.org/42990714:38
openstackgerritJeffrey Zhang proposed openstack/kolla master: Revert "Update dumb-init to version 1.2.0"  https://review.openstack.org/42990714:39
Jeffrey4lmliima, you may need try again.14:40
mliimaok14:40
Jeffrey4lseem like you got some network issue?14:40
*** lamt has joined #openstack-kolla14:40
openstackgerritMerged openstack/kolla-ansible master: Add the missing pull image for ironic-dnsmasq  https://review.openstack.org/42972614:43
*** huzhengchuan has joined #openstack-kolla14:44
*** sp__ has joined #openstack-kolla14:45
*** jamespage has joined #openstack-kolla14:47
*** sudipto_ has quit IRC14:48
*** sudipto has quit IRC14:48
*** jtriley has joined #openstack-kolla14:48
openstackgerritMerged openstack/kolla master: Remove include_header and include_footer in all Dockerfiles  https://review.openstack.org/42801714:56
*** srwilkers has joined #openstack-kolla14:57
srwilkersmorning o/14:58
*** tonanhngo has joined #openstack-kolla14:58
*** tonanhngo has quit IRC14:58
*** sp__ has quit IRC14:59
openstackgerritMerged openstack/kolla-kubernetes master: Fix different repo issue for documentation  https://review.openstack.org/40505415:00
openstackgerritMerged openstack/kolla-kubernetes master: Change version from 0.4.0 to 0.5.0  https://review.openstack.org/42395715:02
*** crushil has joined #openstack-kolla15:03
*** rwallner has quit IRC15:06
*** satyar has joined #openstack-kolla15:06
egonzalezJeffrey4l , pbourke , mliima: have a deployment from master running now?15:06
pbourkeegonzalez: no but I can start one very easily15:06
Jeffrey4legonzalez, yep.15:06
egonzalezJeffrey4l: can you show me the output of docker exec nova_api nova-manage cell_v2 list_cells --verbose15:07
Jeffrey4lnp 1sec15:07
egonzalezJeffrey4l: I think the best method is not use simple_cell_setup and manually create cell0 pointing to nova_cell0 db15:07
*** david-lyle has joined #openstack-kolla15:08
Jeffrey4legonzalez, http://paste.openstack.org/show/597969/15:08
Jeffrey4lyep. that may be better.15:08
*** david-lyle has quit IRC15:10
*** jascott1_ has joined #openstack-kolla15:10
*** david-lyle has joined #openstack-kolla15:11
Jeffrey4lfyi, seem tini works. lol15:11
*** mdnadeem has quit IRC15:12
egonzalezJeffrey4l: thanks15:13
Jeffrey4lnp.15:14
Jeffrey4lplease review https://review.openstack.org/429459  egonzalez pbourke  ;)15:14
*** jascott1_ has quit IRC15:15
*** david-lyle has quit IRC15:16
*** huzhengchuan has quit IRC15:16
*** sacharya has joined #openstack-kolla15:19
*** rwallner has joined #openstack-kolla15:19
*** adrian_otto has joined #openstack-kolla15:19
openstackgerritVladislav Belogrudov proposed openstack/kolla-ansible master: Allow configuration of HAProxy default timeouts  https://review.openstack.org/43025115:23
*** dave-mccowan has quit IRC15:24
*** sp__ has joined #openstack-kolla15:24
*** zhubingbing has quit IRC15:27
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815015:27
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Do not check security opt in some case in kolla_docker module  https://review.openstack.org/42945915:29
*** adrian_otto has quit IRC15:30
openstackgerritMerged openstack/kolla stable/newton: This feature is supporting for workers config in ironic-api.  https://review.openstack.org/42834215:35
openstackgerritMerged openstack/kolla stable/mitaka: This feature is supporting for workers config in ironic-api.  https://review.openstack.org/42834315:35
*** tovin07 has joined #openstack-kolla15:42
*** dave-mccowan has joined #openstack-kolla15:43
*** salv-orlando has quit IRC15:46
egonzalezJeffrey4l: cannot create cells_v2 manually, there is no command for that in newton :(15:51
Jeffrey4lgreat..;( may need ask for help from some nova guys.15:51
*** david-lyle has joined #openstack-kolla15:53
Jeffrey4lgonna to sleep. bye guys.15:54
sp__portdirect:  can i get dev env setup of kolla-k8s ?15:55
*** sayantani01 has joined #openstack-kolla15:56
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815015:56
*** hieulq_ has joined #openstack-kolla15:58
*** tonanhngo has joined #openstack-kolla15:59
sbezverkjascott1: ping16:00
*** sayantani01 has quit IRC16:01
*** adrian_otto has joined #openstack-kolla16:02
srwilkersoh, morning sbezverk and jascott116:03
*** salv-orlando has joined #openstack-kolla16:04
*** inc0 has joined #openstack-kolla16:04
inc0o/16:05
*** rhallisey has quit IRC16:07
srwilkershey inc0. whats up man16:07
inc0I just woke up16:08
inc0still waiting for brain to start16:08
*** goldyfruit has quit IRC16:08
srwilkersinc0: i share that sentiment16:09
sbezverksrwilkers: morning16:09
*** tovin07 has left #openstack-kolla16:11
*** pcaruana has quit IRC16:17
*** zhurong has quit IRC16:17
mliimakolla-build error http://paste.openstack.org/show/597985/ and http://paste.openstack.org/show/597986/16:22
mliima:/16:22
*** matrohon has quit IRC16:28
*** rwallner has quit IRC16:30
*** MasterOfBugs has joined #openstack-kolla16:30
*** sayantani01 has joined #openstack-kolla16:32
openstackgerritMerged openstack/kolla-ansible master: Load freezer dashboard  https://review.openstack.org/42938216:33
openstackgerritMerged openstack/kolla-ansible master: Fix pip install command in quickstart  https://review.openstack.org/42976916:34
openstackgerritMerged openstack/kolla-ansible master: Fluentd should not chown all files in /var/log/kolla  https://review.openstack.org/42725316:34
*** openstackgerrit has quit IRC16:35
*** prameswar has quit IRC16:37
*** openstackgerrit has joined #openstack-kolla16:42
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815016:42
*** srwilkers has quit IRC16:44
*** sp__ has quit IRC16:45
*** rwallner has joined #openstack-kolla16:50
*** hieulq_ has quit IRC16:55
des_consoladoalso I'm consistently getting this on the latest master of kolla-ansible: https://gist.github.com/thomasodot/80a7513de8d392da1d0646ab2863ee8617:00
des_consoladothen I run it manually, `sudo docker exec nova_api nova-manage cell_v2 simple_cell_setup` and it says "Already setup, nothing to do."17:02
des_consoladoand then there is no longer the error when deploying17:02
inc0hmm...haven't seen this one17:02
inc0let me redeploy and see if it reproduces on my env17:03
*** jpstnh has quit IRC17:04
egonzalezdes_consolado: are you upgrading?17:06
des_consoladono17:06
egonzalezdes_consolado: if not, simpe_cell_setup is made with newton container, which is wrong17:07
egonzalezdes_consolado: thats why is using nova_api_cell0 db, in Ocata is nova_cell0 db17:07
*** goldyfruit has joined #openstack-kolla17:08
*** unicell has joined #openstack-kolla17:08
*** unicell1 has quit IRC17:08
egonzalezdes_consolado: or using ubuntu binary, which is broken becouse is not using latest nova changes17:08
inc0also make sure to add changes to your inventory/passwords.yaml17:09
inc0but i doubt it's the case here17:09
*** rhallisey has joined #openstack-kolla17:10
des_consoladoegonzalez: ah yeah I'm using ubuntu binary17:10
inc0try switching to source and see if it works17:10
egonzalezdes_consolado: is broken until ubuntu update nova packages17:10
inc0I generally prefer source builds tbh17:10
des_consoladoalso I realised if I just delete the images using docker rmi it doesn't actually remove the images from the registry which is in /var/lib/docker/volumes somewhere... Is there a nice way to delete all the images or do you just rm -r in the /var/lib/docker/volumes/registry place?17:11
*** matrohon has joined #openstack-kolla17:11
inc0des_consolado, docker rm will just remove local images17:12
*** rhallisey_ has joined #openstack-kolla17:12
des_consoladoyeah that's what I realised17:12
inc0you can just run docker rm -f registry17:12
inc0and restart it fresh17:12
des_consoladooh yeah remove the registry container and image...17:12
inc0it won't use volume unless you tell it to17:13
inc0thats what I'm doing;) but rebuild-repush images will override them too17:13
inc0also make sure to remove images from target nodes too17:13
des_consoladodocker volume rm registry17:13
inc0easy way to do it is kolla-ansible destroy --include-images17:14
des_consoladoyeah I use kolla-ansible destroy to delete from those17:14
*** breitz has quit IRC17:15
*** rhallisey has quit IRC17:16
*** rhallisey_ is now known as rhallisey17:16
*** egonzalez has quit IRC17:20
*** zioproto has quit IRC17:22
satyarHi inc017:22
satyarhi egonzalez17:23
des_consoladoegonzalez went home I think D:17:23
des_consoladoI had a follow-up question though: how do I check when the binaries are updated so I can know when images aren't up-to-date?17:23
*** rwallner has quit IRC17:24
des_consoladoall these images fail to build for me with ubuntu source: https://gist.github.com/thomasodot/c151a1168c9421e2103d25cd55edb16d17:24
des_consoladowill build centos source now17:25
satyarThanks des_consolado17:25
satyarjust want to check i have enabled DVR17:25
satyarfor in the kolla17:25
satyarand deployed the DVR is in the compute node17:25
*** unicell has quit IRC17:26
satyarbut when i add another compute node the DVR is missing from there i used the --limit17:26
inc0des_consolado, that doesn't look right, scroll up to see actual error17:26
satyarcan you please help me on this des_consolado17:26
inc0I've just built ubuntu source without issues17:26
mliimakolla-build error http://paste.openstack.org/show/597985/ and http://paste.openstack.org/show/597986/17:27
mliima:/17:27
des_consoladosatyar: probably not, I have no idea what you're talking about :P17:29
inc0mliima, Error writing to output file - write (28: No space left on device)17:29
satyarHi pbourke17:29
des_consoladooh shitttt inc0 , I forgot to re-run the registry container :P17:30
openstackgerritMerged openstack/kolla-ansible master: Allow configuration of HAProxy default timeouts  https://review.openstack.org/43025117:31
inc0rumor is that having registry up helps with pushing to registry17:32
openstackgerritMerged openstack/kolla-ansible master: Bump docker to 1.12 in bootstrap-servers  https://review.openstack.org/42737917:32
*** rwallner has joined #openstack-kolla17:32
DavieyJeffrey4l, pbourke : BTW, i read the link on that change.. but having the issue outlined in the commit message is much better IMO.17:33
pbourkesatyar: hello17:33
*** saneax-_-|AFK is now known as saneax17:36
satyarpbrouke regarding the --limit17:44
satyarwe have enabled dvr and added another compute nde17:45
satyarnode17:45
satyarthe DVR things are missing from compute node17:45
*** jascott1_ has joined #openstack-kolla17:46
*** jascott1_ has quit IRC17:46
*** tonanhngo has quit IRC17:47
openstackgerritBorne Mace proposed openstack/kolla-kubernetes master: WIP: Added support for containerized dev bringup  https://review.openstack.org/42929517:50
*** adrian_otto has quit IRC17:53
*** dtturner has joined #openstack-kolla17:53
*** adrian_otto has joined #openstack-kolla17:53
*** adrian_otto has quit IRC17:54
*** sudipto_ has joined #openstack-kolla17:55
*** sudipto has joined #openstack-kolla17:55
dtturnerHi.  In the process of adding compute nodes to existing DVR-enabled deployment.  Using --limit to target specific compute nodes. Noticed that DVR agent containers not installed.17:57
*** jtriley_ has joined #openstack-kolla17:58
dtturner3 weeks behind trunk.  Is it expected that we pass --tags?  I had assumed if dvr is enabled and compute role association alone would trigger the DVR agent install.17:58
*** mgoddard_ has quit IRC17:59
dtturnerDVR agents get install fin on compute nodes during original deployment.  Noticing this only when adding compute nodes to deployment.17:59
inc0satyar, dtturner seems like you have same issue18:01
*** jtriley has quit IRC18:01
inc0did you check with neutron people what would be expected behaviour in this case? and submit a bug if that's different18:02
dtturnerinc0 - Ah.. satyar already asked?  My teammate on the other side of the globe.18:02
inc0I don't know dvr well enough to say what should happen tbh18:03
pbourkesatyar: dtturner: does ansible skip the tasks for metadata/l3?18:03
*** krtaylor has quit IRC18:03
dtturnerinc0: In general, does Kolla account for / expect scenarios where operators do not install the entire site at once?  It will be standard practice for us since we only receive a couple of racks at a time.18:04
satyar:)18:04
inc0yes, kolla should totally support adding compute nodes18:05
*** jtriley_ has quit IRC18:05
inc0adding controllers should work as well, not sure how well this works tbh18:05
dtturnerpbourke: Looks like it.  All standard compute containers are installed.  None of the DVR agents.18:06
SamYapleits worked perfectly in the past inc0. i used to scale from 1 to many nodes all the time18:06
inc0SamYaple, galera is where I was worried18:07
inc0it would be interesting if you add new node as first node in mariadb group18:07
inc0it might try to re-bootstrap cluster?18:08
sdakesup peeps18:08
sdakei know from 1 to 3 controllers used to work - not sure now with the changes to rabbitmq18:08
SamYapleinc0: nope. youre welcome18:08
sdakehowever adding compute nodes is no problem18:08
inc0yay18:08
inc0sdake, it might be if DVRs are involved18:09
sdakedtturner if you want ot scale out your controller infrastructure, i think that is something you would want to test18:09
sdakeinc0 i don't know what dvrs are besides for watching cable ;)18:09
inc0thats what we're discussing18:10
inc0dvr not cable18:10
sdakedtturner note we tested 123 nodes, with 20 stroage, 100 compute, 3 controllers and the controllers were barely taxed at all - so no need really to scale out th econtroller nodes18:10
sdakeinc0 it was a joke :)18:10
dtturnersdake: We are going to have that oportunity very soon. Going from 2 racks to 3.   Of course, we'll already have users on it so we'll have to make sure it works.  :-)18:10
sdakeatleast part of it is, i still don't know what dvr is other then its related to networking :)18:10
sdakedvr for us old fuddie duddies = digital video recorder18:11
satyar:P18:11
inc0sdake, what's company you work for again? something that deal with...wait..networking right?:P18:12
sdakeinc0 they didn't hire me because i'm a networking nered18:12
sdakethey hired me because i'm a container nerd18:12
inc0now I'm joking18:12
sdakethe openstack part was an add-on bonus :)18:12
sdakeinc0 yup i know :)18:13
sdakejokes - so difficult to come across well on irc without body language ;)18:13
inc0misunderstood jokes - breaks friendships since 3000bc18:13
dtturnersdake: Since we'll be adding a 3rd rack and final (3rd) control, any unknowns we should be watching for?18:14
sdakedtturner i'd test 2 to 3 nodes first18:14
sdakedtturner if it doesn't work, i'm sure it can be made to with additional patches carried on top18:14
sdakenodes/control nodes18:15
sdakedtturner like get 3 bare metal nodes and go from 2 control to 3 ontrol18:15
inc0dtturner, make sure to have odd number of controllers18:15
sdakedtturner ^^ also that ;)18:15
sdakedtturner is this a production deployment?18:16
satyarsdake for HA right?18:16
sdakesatyar ya multi-controller is mostly about ha18:16
inc0galera cluster to be precise18:16
satyaractive-passive-passive18:16
sdakesatyar as inc0 and SamYaple wrote all the code, they would knwo the most detail wise18:16
dtturnerinc0 Right.  2 controllers is temporary until we get the third rack.  We'll be running 2 controllers / 72 computes by end of day.  3rd rack coming soon.18:16
*** jtriley has joined #openstack-kolla18:16
inc0with even number of controllers fun stuff can happen during network partition18:16
sdakedtturner any chance you would be kind enough to fill out the user survey?18:17
inc0dtturner, I'd strongly suggest having 3 controllers anyway18:17
sdakedtturner (this is an OpenStack user survey, not a kolla user survey)18:17
dtturnerinc0: yeah.  I'm getting that feeling as well...18:17
dtturnersdake: sure18:17
sdakedtturner the more feedback we receive via the user survey, the better kolla can be for you18:18
inc0dtturner, it's all about quorum;)18:19
sdakekfox1111 - do you know where the user survey is located (which mailer)18:19
dtturnerinc0: Just don't like the fact of a single ToR switch outage taking down 2 controllers.  But, get the quorum issue.18:19
sdakedtturner https://www.openstack.org/user-survey/survey-2017/about-you18:19
inc0dtturner, it's better than taking 1 controller and causing net-split;)18:19
dtturnerinc0: probably not worth waiting for the 3rd rack18:19
dtturnerinc0: exactly18:20
inc0but frankly, if ToR fails it will take down your cloud anyway in this case18:20
inc0just your data will be safe18:20
inc0since 2 controllers fails and 3rd one will get into read-only mode18:20
*** ChanServ sets mode: +o sdake18:21
inc0you should have 2 ToRs:P18:21
inc0but nvm;) thats my "if I have endless amount of money, this is how I'd do my cloud" talking18:22
*** sdake changes topic to "Please fill out the OpenStack 2017 User Survey: https://goo.gl/92giOU | support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b"18:23
*** sudipto_ has quit IRC18:23
*** sudipto has quit IRC18:23
*** ChanServ sets mode: -o sdake18:23
bmace_kfox1111: around?18:23
pbourkedtturner: satyar: can you guys file a bug with ansible -vvv output18:23
pbourkedtturner: it may be those tasks are getting skipped for some reason, Id start with figuring out why18:24
satyarsure pbrouke18:24
*** MasterOfBugs has quit IRC18:24
*** MasterOfBugs has joined #openstack-kolla18:25
*** mannamne has quit IRC18:27
*** unicell has joined #openstack-kolla18:33
*** MasterOfBugs has quit IRC18:34
*** sambetts is now known as sambetts|afk18:38
*** mgoddard_ has joined #openstack-kolla18:38
*** satyar_ has joined #openstack-kolla18:39
*** krtaylor has joined #openstack-kolla18:40
*** satyar has quit IRC18:40
*** jtriley has quit IRC18:41
sdakebmace_ need a hand with something - i've got 15 mins :)18:45
bmace_sdake: hey.  i need to do some research i guess into how magnum is doing their kubernetes communication.. i thought i had seem some docs around moving to a python library vs. using kubectl, but looking through the openstack global-requirements it doesn't look like there are any "allowed" kubernetes libraries.18:47
sdakebmace_ dims is the dude that got that conversation started18:47
sdakedims happen to be around?18:48
*** Pavo has quit IRC18:48
*** Pavo has joined #openstack-kolla18:49
bmace_sdake: guess i'll keep an eye out for them, and still go look and see what magnum is doing.18:49
*** gfidente is now known as gfidente|afk18:50
sdakebmace_ another place to look is in #openstack-containers where adrian_otto is the ptl18:51
sdake(of magnum)18:51
sdakebmace_ i'd ask in #openstack-containers that exact question with the detail that you are looking at integrating magnum into kolla-kubernetes deliverable and want to do it right :)18:53
bmace_sdake: think i found it.. looks like python-k8sclient is "approved".. interesting that it isn't really the standard / google library, looks to maybe be managed by openstack itself and swagger generated, of course18:54
bmace_going to have to tweak my script18:54
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815018:54
sdakebmace_ right - dims suggested deprecating that18:54
sdakebmace_ and moving to the kubernetes provided library18:54
sdakebmace_ its on the mailing list with [magnum] tag18:55
bmace_well, it is what it is for now.. and unless magnum changes their code both would have to stick around.18:55
bmace_sdake: they talk about timeframe?18:55
bmace_sdake: mostly i just want this working right now and be able to check it in.. i don't want to wait for politics and whatever else to work themselves out18:55
sdakebmace_ there are no politics around including something in global requirements18:56
sdakebmace_ there are technical issues at present18:56
sdakebmace_ dims or openstack-containers are the peeps to tlak to18:56
sdakein the meantime you could use the python library in the global requirements while those technical problems get sorted out18:56
sdakeok got to jet - bbi1hr18:56
bmace_sdake: yeah, i'm just going to use the current supported one and if they change it, so be it18:56
*** saneax is now known as saneax-_-|AFK18:58
sdakebmace_ right - to deprecate a requirement from global requiremetns requires all big tent projects to buy into the deprecation which means we have time to fix whatever debt we incur as a result of adopting the existing library18:58
dimsbmace_ : sdake : https://github.com/kubernetes-incubator/client-python18:58
sdakebmace_ i'd suggest speaking to dims when he is available though as he got the work started to get the deprecation going18:58
dimsthat's where we are heading towards18:58
sdaketheres dims :)18:58
sdakehi dims - thanks :)18:58
sdakeok gotta jet18:59
dimsttyl sdake18:59
sdakedims can you help bmace_ understand the timeframes18:59
bmace_sdake: have a good one, and thanks dims18:59
sdakedims i think bmace_ doesn't want to block on the future for the present18:59
dimswhen requirements unfreezes, we should start switching over to that18:59
bmace_dims: yeah, that kubernetes client is the one i started using until i saw it failing in the gate due to not being in the global requirements :/18:59
dimsfor new work immediately for sure18:59
bmace_dims: do we know when it is unfreezing / when the new client will pass the gate?19:00
dimsbmace_ : y, it's a matter of few days for unfreeze19:00
dimsthen one of us can propose the new addition to g-r19:00
bmace_dims: kk, maybe i'll leave it as is then.19:00
dims+119:01
bmace_dims: thanks much for the info19:01
dimson the other side, i am actively adding e2e tests for client-python, so welcome some help there if you have some spare cycles19:01
dimsthe way am doing it is, looking at exact calls we make in magnum etc and make sure those code paths are tested in e2e tests19:02
bmace_dims: that is good.  i was looking through the tests suite in the upstream kubernetes python client itself and every single one i found was a no-op :/19:03
dimsy look in e2e directory19:04
dimsthose are tests generated by swagger, so no good19:04
bmace_dims: even in e2e, looking pretty slim :)19:05
dimsright, hence the ask :)19:06
dimsthe infra for the e2e test itself - i just added a week or two ago19:06
bmace_dims: i feel you.  i don't think personally i'll have a lot of cycles to look at that, but I expect that is true for most folks, and thus it is what it is.19:06
dimsbmace_ : ack, then please let me know which reviews to peek at, i can do something when i get a chance19:07
*** inc0 has quit IRC19:08
bmace_dims: my usage is very simple.  pretty much just getting all the pods for the kolla namespace to figure out if they are ready so we can move on to the next provisioning step.19:08
dimsthat should be already covered19:08
bmace_dims: i expect so, and seems like a pretty unlikely thing to break, and if it did i think a lot of people would notice :)19:09
dimsyep19:09
*** jemcevoy has joined #openstack-kolla19:11
jemcevoyjascott1   you there?19:12
*** tonanhngo has joined #openstack-kolla19:14
*** sayantani01 has quit IRC19:15
jemcevoyjascott1 or inc0,  I have the parking pass for today should you choose to park at my pace and we can walk over to the kube road show19:18
*** satyar_ has quit IRC19:18
*** tonanhngo has quit IRC19:19
openstackgerritManik Sidana proposed openstack/kolla-ansible master: 1662633: Updating requirements.txt to exclude Jinja2==2.9.5  https://review.openstack.org/43040719:20
dimsbmace_ : your review looks good. just peeked at it. only feed back i have would be to validate the states (if there are typo in the status args passed the command line)19:21
*** MasterOfBugs has joined #openstack-kolla19:22
*** bpattewar has quit IRC19:26
*** mgoddard_ has quit IRC19:29
*** jtriley has joined #openstack-kolla19:32
*** tonanhngo has joined #openstack-kolla19:35
*** adrian_otto has joined #openstack-kolla19:38
*** breitz has joined #openstack-kolla19:44
*** salv-orl_ has joined #openstack-kolla19:50
*** salv-orlando has quit IRC19:52
bmace_dims: yeah, plenty of improvements to make i think.  since there are a limited set of states validating those isn't unreasonable.  i think some try / catch stuff around failures connecting to the api, etc could be done.19:58
bmace_dims: thanks for taking a look19:58
*** salv-orl_ has quit IRC20:04
*** goldyfruit has quit IRC20:07
*** klindgren_ has joined #openstack-kolla20:12
*** klindgren__ has quit IRC20:14
*** klindgren has joined #openstack-kolla20:14
*** Pavo has quit IRC20:16
*** klindgren_ has quit IRC20:17
*** dave-mccowan has quit IRC20:19
*** Pavo has joined #openstack-kolla20:21
*** rwallner has quit IRC20:28
*** klindgren_ has joined #openstack-kolla20:30
*** klindgren has quit IRC20:33
*** rwallner has joined #openstack-kolla20:35
*** dave-mccowan has joined #openstack-kolla20:38
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815020:45
*** zioproto has joined #openstack-kolla20:47
*** zioproto has quit IRC20:47
*** zioproto has joined #openstack-kolla20:48
*** eaguilar has joined #openstack-kolla20:48
*** eaguilar has quit IRC20:52
*** eaguilar has joined #openstack-kolla20:52
*** Pavo has quit IRC20:53
*** crushil has quit IRC20:58
*** mannamne has joined #openstack-kolla21:07
*** harlowja has quit IRC21:09
*** klindgren has joined #openstack-kolla21:10
*** dave-mccowan has quit IRC21:10
*** sdake has quit IRC21:11
*** klindgren_ has quit IRC21:12
*** crushil has joined #openstack-kolla21:14
*** rwallner has quit IRC21:20
*** rwallner_ has joined #openstack-kolla21:25
*** jrobinson has joined #openstack-kolla21:27
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815021:27
*** rwallner_ has quit IRC21:29
*** jrobinson has quit IRC21:30
*** matrohon_ has joined #openstack-kolla21:30
*** jrobinson has joined #openstack-kolla21:31
*** goldyfruit has joined #openstack-kolla21:31
*** eaguilar has quit IRC21:31
*** matrohon has quit IRC21:32
*** sdake has joined #openstack-kolla21:32
*** Jeffrey4l has quit IRC21:35
*** harlowja has joined #openstack-kolla21:35
*** Jeffrey4l has joined #openstack-kolla21:36
*** salv-orlando has joined #openstack-kolla21:37
*** sdake_ has joined #openstack-kolla21:41
*** salv-orlando has quit IRC21:42
*** sdake has quit IRC21:44
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815021:49
*** salv-orlando has joined #openstack-kolla21:50
*** klindgren_ has joined #openstack-kolla21:52
*** klindgren has quit IRC21:53
*** krtaylor has quit IRC21:54
*** ipsecguy has quit IRC21:55
*** fguillot has quit IRC21:56
*** zioproto has quit IRC21:58
*** adrian_otto has quit IRC21:59
*** harmw_ is now known as harmw22:06
*** jtriley has quit IRC22:11
*** mannamne has quit IRC22:15
*** klindgren__ has joined #openstack-kolla22:22
*** jheroux has quit IRC22:22
*** sdake_ is now known as sdake22:23
*** klindgren_ has quit IRC22:24
sdakerhallisey - here is the ticket information for openstack summit in boston: https://www.eventbrite.com/e/openstack-summit-may-2017-boston-tickets-2837567540922:29
openstackgerritBorne Mace proposed openstack/kolla-kubernetes master: WIP: Added support for containerized dev bringup  https://review.openstack.org/42929522:29
bmace_sdake: fyi, setup_dev_env now runs without need for manual intervention.  just working on ceph_service_workflow.sh now.22:30
sdakebmace_ cool - i am actually just taking a look at your change22:30
rhalliseysdake, ya I no22:31
*** matrohon_ has quit IRC22:34
*** mannamne has joined #openstack-kolla22:36
bmace_sdake: it is getting there.  i think just that one script and some docs and it should be ready.22:37
*** Pavo has joined #openstack-kolla22:38
*** Pavo has quit IRC22:45
*** rhallisey has quit IRC22:48
sdakebmace_ i left a few commentsi n the review - nothing earthshattering22:49
sdakethe kubernetes requirements change may cause the gate to fail22:49
sdakeunless that is a python package in global requirements22:50
sdakeand k8s-devstack... bad name ;)22:50
bmace_sdake: well, that was the name from the other devenv review, so i was just re-using it :P and yes, because kubernetes isn't in global requirements yet this can't be merged.  from talking to dims it seems like it is only a matter of days until that is done22:51
bmace_sdake: so i'm fine waiting rather than re-writing to use python-k8s when it is just going to be deprecated in a few days22:52
sdakebmace_ the package will be called kubernetes?22:52
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815022:52
sdakeseems wierd ;-)22:52
bmace_sdake: https://github.com/kubernetes-incubator/client-python   pip install kubernetes22:52
sdakelibraries should start with python-* as per python naming convetniosn22:53
sdakeok - well whatever works :)22:53
sdakebmace_ does it do multinode?22:53
bmace_sdake: yup.. not mine to complain about, and not really all that unusual in the python world.22:53
bmace_sdake: does what do multi-node?  the default halcyon-vagrant env is multi-node22:54
*** Pavo has joined #openstack-kolla22:54
bmace_sdake: it uses the .kube/config stuff to determine how / where to talk to your kubernetes environment.22:54
sdakebmace_ when you bring up kolla-kubernetes does it work multinode22:55
sdakebecause kubernetes requires external storage for the PVs that is shared22:55
sdake(for multinode)22:55
sdakeanyway meeting in 5 mins, gtg - something to think about or test22:55
sdakebmace_ i was only able to bring up one master and one minion22:55
sdakeand scheduled everything to the minion22:56
sdakeor I guess its being called a compute node now22:56
bmace_sdake: i don't know what pods get brought up on what nodes, but none of it other than the ceph config is done in a way that should force things to be node locked as far as i know.22:56
sdakebmace_ cool - well if it works, that wfm22:57
bmace_sdake: something to work on / consider after the initial bits go in IMO.. need something that just basically works then we can improve on it.22:57
sdakeI think we need to understand how external storage works without ceph at some point22:57
sdakeright wfm bmace_ - ncie job :)22:57
bmace_sdake: tks, enjoy the meeting :)22:57
sdakeya 2 hrs22:58
sdakecan't wait22:58
* sdake pulls out what hair he has left22:58
*** mannamne has quit IRC23:05
*** mgiles has quit IRC23:06
*** fragatina has joined #openstack-kolla23:07
*** Pavo has quit IRC23:11
*** klindgren_ has joined #openstack-kolla23:13
*** Pavo has joined #openstack-kolla23:13
Pavosdake, question how do you do ovs-ctl cmds using kolla-ansible?23:14
PavoI assume that it would have to be done inside the neutron-server container, correct?23:14
*** klindgren__ has quit IRC23:15
*** Serlex has quit IRC23:17
*** Pavo has quit IRC23:20
*** sdake_ has joined #openstack-kolla23:24
*** lamt has quit IRC23:25
*** zhurong has joined #openstack-kolla23:26
*** sdake has quit IRC23:26
*** sdake_ has quit IRC23:27
*** sdake has joined #openstack-kolla23:28
*** zhurong has quit IRC23:28
*** sdake_ has joined #openstack-kolla23:31
*** sdake has quit IRC23:32
SamYaplePavo openvswitch contaienr23:35
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart  https://review.openstack.org/42815023:37
*** ipsecguy has joined #openstack-kolla23:43
*** gfidente|afk has quit IRC23:50
*** goldyfruit has quit IRC23:50
*** unicell has quit IRC23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!