Friday, 2016-10-07

*** gfhellma has joined #openstack-kolla00:00
kfox1111wow. looks like eternal id resource looks like may have merged too.00:00
kfox1111a lot of long on the wish list items finally got checked off.00:01
kfox1111and a yaql function...00:02
*** dwalsh has joined #openstack-kolla00:02
harlowjasounds turing complete00:03
harlowjalol00:03
kfox1111its not turing complete without a loop construct.00:03
harlowjarecursion?00:03
kfox1111branching is just this or that chunks.00:03
kfox1111recursion is kind of supported by nested stack up to 5 or a preset in the config file.00:04
harlowjasounds like a loop :-P00:04
kfox1111so, not really.00:04
kfox1111its not turing complete if you can put a garanteed stopping time on it.00:04
kfox1111:)00:05
*** ankush has quit IRC00:05
harlowjaya, i've never quite understood those kinds of mini-languages00:06
harlowjaif u trying to embed a language, just embed a real-language that u can put stop times, instruction execution limits on...00:06
kfox1111jinja2's more flexabile, as it does have a loop construct.00:06
kfox1111then its not turing complete. :)00:07
harlowjalol00:07
kfox1111and its not a real-language. by definition. :)00:07
harlowja'real'00:07
harlowjalol00:07
kfox1111I'd define real as turing complete. :)00:07
kfox1111technically, bf is turing complete. :)00:07
harlowjayup00:08
kfox1111I think the jury's still out on malbulge.00:08
harlowjahaven't heard of that one, lol00:08
kfox1111https://en.wikipedia.org/wiki/Malbolge00:08
kfox1111the programming language from hell. :)00:08
harlowjaha, nice00:09
kfox1111I've tried it... it hurts. :)00:09
harlowjai'll pass00:09
harlowjalol00:09
kfox1111I kind of like befunge too.00:09
kfox1111oh wow. they managed to complete a full hello world now. :)00:10
harlowjaha00:10
harlowjaya, see that should be in heat00:10
kfox1111last I saw, tehy had it, but with bad casing. :)00:10
kfox1111nah, I thikn the changes they made will really help make heat much more useful.00:11
harlowjagot me, not really sure who uses heat, lol00:11
kfox1111its great for standing up multiple vm's. its not so good at the stuff inside,00:12
kfox1111and until newton, a way to make generic sharable templates.00:12
harlowjaansible playbooks?00:12
kfox1111as the template tended to be required to be very specfic to the cloud. like00:12
kfox1111neutron or not, provider networs or tenant networks, floating ips, or not, etc.00:12
kfox1111with conditionals, a single template coudl handle multiple clouds.00:13
harlowjahow many clouds even have heat running?00:13
harlowja:-/00:13
kfox1111a fair number, but fewer then it should be.00:13
kfox1111a cloud without orchestartion is like a linux box with command.com instead of bash.00:13
kfox1111bleh. :)00:14
harlowjaor u just say go use os_server from ansible for orchestration :-/00:14
harlowjaand share those playbooks00:14
kfox1111-1.00:14
harlowjalol00:14
kfox1111I want something I can hand a non cs person. that means gui.00:14
kfox1111I can give a heat template to a scientist,00:14
harlowjapoor scientist00:15
kfox1111(s)he can load it into horizon, fill out a form, and bam, something useful.00:15
harlowjaprobably understands python , lol00:15
harlowjaand u just gave them that :-P00:15
kfox1111never has to actually read the template.00:15
kfox1111python, yes. launching python in a fresh vm or vm cluster, no.00:15
kfox1111the key feature of heat, is the horizon gui with the paramater entry.00:16
harlowjahow many people are running horizon? :-P00:16
kfox1111all our clouds at least.00:16
harlowjak00:16
kfox1111its not the fastest or ui friendlyiest, but still much better then cli for non cs folks.00:16
harlowjadef00:18
*** sogabe has joined #openstack-kolla00:18
*** ankush has joined #openstack-kolla00:18
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104100:22
*** gfidente has quit IRC00:30
*** dwalsh has quit IRC00:32
*** ankush has quit IRC00:33
*** huikang has joined #openstack-kolla00:36
MarMatHi, did you guys somebody hit broken delorean repo today? http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tested/delorean.repo00:38
*** tovin07 has joined #openstack-kolla00:40
*** tonanhngo has joined #openstack-kolla00:44
*** inc0 has quit IRC00:46
*** diogogmt has quit IRC00:47
*** duonghq has joined #openstack-kolla00:48
duonghqmorning00:48
*** Pavo has quit IRC00:51
*** Pavo has joined #openstack-kolla00:51
tovin07hello00:52
*** gfhellma has quit IRC00:54
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104100:59
*** phuongnh has joined #openstack-kolla00:59
kfox1111wow. rdo's really on top of this now.01:00
kfox1111they released very quickly instead of like a week or two later.01:00
kfox1111nice.01:00
*** hieulq has joined #openstack-kolla01:03
*** tonanhngo has quit IRC01:03
*** hieulq has quit IRC01:07
*** schwicht has quit IRC01:08
*** hieulq has joined #openstack-kolla01:11
*** hieulq has quit IRC01:13
*** hieulq has joined #openstack-kolla01:13
*** hieulq has quit IRC01:13
*** huikang has quit IRC01:13
*** hieulq has joined #openstack-kolla01:14
*** tonanhngo has joined #openstack-kolla01:14
*** huikang has joined #openstack-kolla01:14
*** zhurong has joined #openstack-kolla01:14
*** g3ek has quit IRC01:16
*** haplo37 has quit IRC01:16
*** huikang has quit IRC01:18
*** haplo37 has joined #openstack-kolla01:18
*** g3ek has joined #openstack-kolla01:19
sbezverk_kfox1111: still around?01:23
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104101:23
duonghqberendt: in case you can read: can you mark your bugs or Jeffrey4l_ is related to each other if it's in this case?01:24
*** dwalsh has joined #openstack-kolla01:27
kfox1111yeah.l whats up?01:29
duonghqany idea about centos gate failure?01:29
duonghqcentos and oracel01:29
*** dwalsh has quit IRC01:30
MarMatduonghq I guess it's broken delorean repo  http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tested/delorean.repo01:30
duonghqthank you, MarMat01:31
*** dwalsh has joined #openstack-kolla01:32
sbezverk_kfox1111: never mind it is long conversation and can wait until tomorrow, have a good one01:36
*** MarMat has quit IRC01:38
kfox1111I have time if you'd like, otherwise, have a good one. :)01:40
kfox1111probably pretty late there.01:41
kfox1111nice.. vlan aware vm's merged in neutron... that could come in handy. :)01:45
*** eaguilar has joined #openstack-kolla01:47
*** ayoung has quit IRC01:52
*** HyperJohnGraham has joined #openstack-kolla01:52
kfox1111thats frustrating...01:54
*** dwalsh has quit IRC01:54
kfox1111I crank up debugging and the containers crash. :/01:54
*** ayoung has joined #openstack-kolla01:55
*** zhubingbing has joined #openstack-kolla01:55
*** zhubingbing has quit IRC01:56
*** zhubingbing has joined #openstack-kolla01:57
*** MarMat has joined #openstack-kolla02:02
*** david-lyle has joined #openstack-kolla02:03
HyperJohnGrahamkfox1111 I recently learned the default yum install of docker on centos uses a slow backend02:05
kfox1111yeah. loopback based.02:06
kfox1111the ubuntu gate's doing the same thing though, and its aufs backed.02:06
HyperJohnGrahamwhats the proper way to start on centos702:06
kfox1111for testing, production, in a vm, on bare metal? :/02:07
HyperJohnGrahambare metal for kolla-kubernetes02:07
HyperJohnGrahamhigh performance ssd and nvme02:07
*** unicell has quit IRC02:07
kfox1111I've had the best luck with btrfs not eating containers.02:07
HyperJohnGraham:)02:08
kfox1111I've seen the dm based one eat things at times.02:08
HyperJohnGrahamwhats the fastest ?02:08
kfox1111for centos, probably the btrfs one.02:08
HyperJohnGrahamok cool02:08
*** zhurong has quit IRC02:09
*** david-lyle has quit IRC02:09
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104102:12
*** huikang has joined #openstack-kolla02:17
HyperJohnGrahamkfox1111: too bad there isn't a zfs backend. i already have 4 nvme devices in a pool02:18
kfox1111yeah.02:19
kfox1111I really wish oracle would get over their licensing issue and just release it gpl. then that kind of thing would get fixed.02:19
kfox1111I think very few people, if any, are switching to solaris just to get zfs.02:19
HyperJohnGrahamwe use zfsonlinux on centos7 all the time02:20
HyperJohnGrahamlooking forward to NVMe-OF games02:20
kfox1111yeah. so the licensing thing doesn't seem to prevent peoople from doing what they was hoping it would prevent.02:21
kfox1111but it does seem to be preventing closer integration.02:21
kfox1111and fueling the development of at least one competitor (btrfs)02:21
HyperJohnGrahamyup02:22
HyperJohnGrahami am destroying the pool now02:22
HyperJohnGrahamwell after a copy the data off ;)02:22
kfox1111:)02:22
*** unicell has joined #openstack-kolla02:32
*** janem has quit IRC02:33
HyperJohnGrahamkfox1111: on my 8 blades i have 2x 480G SSD and 1x 3.2TB HGST NVMe02:35
HyperJohnGrahamI should configure one of the SSDs on each blade for the docker BTRFS ?02:36
*** unicell has quit IRC02:36
HyperJohnGrahamor both ?02:36
HyperJohnGraham:)02:36
HyperJohnGrahamthey boot from SATA DOM02:37
openstackgerritMartin Matyas proposed openstack/kolla: Fix genconfig and reconfigure for magnum  https://review.openstack.org/38352802:40
*** unicell has joined #openstack-kolla02:41
kfox1111I haven't used btrfs much, so hard to say. :/02:42
kfox1111now libvirt's fairly consistently crashing... arg02:43
*** unicell has quit IRC02:46
HyperJohnGraham /dev/nvme0n1    1.9T   17M  1.9T   1% /var/lib/docker02:49
HyperJohnGrahamthat should work for this server :)02:49
*** Pavo has quit IRC02:50
*** zhurong has joined #openstack-kolla02:52
HyperJohnGrahamStorage Driver: btrfs ...  yup02:53
*** Pavo has joined #openstack-kolla02:56
openstackgerritJeffrey Zhang proposed openstack/kolla: fix can't collect horizon log in heka  https://review.openstack.org/38308002:57
kfox1111nice. :)03:15
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104103:20
*** janem has joined #openstack-kolla03:30
*** janem has quit IRC03:37
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104103:39
*** unicell has joined #openstack-kolla03:42
*** unicell has quit IRC03:47
*** huikang has quit IRC03:50
*** sdake_ has joined #openstack-kolla03:58
*** haplo37 has quit IRC04:01
*** sdake has quit IRC04:01
openstackgerritJeffrey Zhang proposed openstack/kolla: Add validate no new line at end of file  https://review.openstack.org/38034004:04
*** sdake has joined #openstack-kolla04:05
*** jmccarthy has quit IRC04:05
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104104:05
*** jmccarthy has joined #openstack-kolla04:06
*** dave-mccowan has quit IRC04:06
*** sdake has quit IRC04:07
*** sdake_ has quit IRC04:07
*** sdake has joined #openstack-kolla04:08
*** huikang has joined #openstack-kolla04:09
*** haplo37 has joined #openstack-kolla04:09
*** huikang has quit IRC04:24
*** eaguilar has quit IRC04:26
*** janem has joined #openstack-kolla04:33
*** MarMat has quit IRC04:36
*** zhubingbing has quit IRC04:38
*** janem has quit IRC04:40
*** unicell has joined #openstack-kolla04:43
*** sdake_ has joined #openstack-kolla04:45
*** sdake has quit IRC04:47
*** Pavo has quit IRC04:50
*** Pavo has joined #openstack-kolla04:55
sdake_Jeffrey4l_ ping04:57
*** haplo37_ has quit IRC05:23
*** haplo37_ has joined #openstack-kolla05:25
openstackgerritSteven Dake proposed openstack/kolla: Move RDO to Newton branches  https://review.openstack.org/38354605:26
*** salv-orlando has joined #openstack-kolla05:29
*** janem has joined #openstack-kolla05:36
*** msimonin1 has joined #openstack-kolla05:39
*** msimonin has quit IRC05:41
*** janem has quit IRC05:42
openstackgerritSteven Dake proposed openstack/kolla: Move RDO to Newton branches  https://review.openstack.org/38354605:43
*** bjolo_ has joined #openstack-kolla05:46
*** neilus has joined #openstack-kolla05:47
*** neilus has quit IRC05:52
*** coolsvap has joined #openstack-kolla05:55
Jeffrey4l_sdake_, pong06:07
sdake_Jeffrey4l_ all releases were tagged today06:07
sdake_time to move to stable branches for our upstream gates06:07
sdake_i'll do the work but it needs acks06:07
sdake_in fact, we have alot of patchs which need acks06:07
Jeffrey4l_sdake_, we need make newtone branch first. then make the change.06:08
sdake_ye that would be optimal06:08
sdake_however we would miss out on 1 week of testing06:08
sdake_ptl email says "trailing release cycles should be working on merging last minute rdo changes now"06:08
sdake_as well as the stable branches06:09
sdake_we can revert the patches after we branch06:09
Jeffrey4l_sdake_, ok cool06:09
*** egonzalez90 has joined #openstack-kolla06:09
sdake_egonzalez90 please have a look at https://review.openstack.org/38354606:09
HyperJohnGrahamsdake_: I just reconfigured docker to use btrfs on a dedicated 480GB SSD06:10
HyperJohnGrahamno more loopback06:10
sdake_HyperJohnGraham your builds willbe much faster06:10
sdake_as well as general disk io to docker06:10
Jeffrey4l_sdake_, do u wanna this PS to merge or not? then revert in the future?06:10
HyperJohnGrahamyup06:10
egonzalez90sdake_, seems fine06:10
sdake_Jeffrey4l_ yup06:11
sdake_i wantit passing thegate first obviosuly06:11
sdake_we also need one to move hte source builds06:11
sdake_i'll work on that next06:11
sdake_i'm not sure if oracle linux isbusted or not, i had read ina bug oracle linux gate is failing06:12
Jeffrey4l_sdake_, imo, we can split this PS into two. 1. install newton rather than mitaka (this is no need revert in the future)    2. remove delorean repo  ( this should be revert )06:12
sdake_Jeffrey4l_ if we do that the gate will not work properly06:13
sdake_but logic soundsgood06:13
sdake_when wehave voting gates we won't be able tobehave in this fashion06:13
Jeffrey4l_ok.06:13
*** berendt has joined #openstack-kolla06:13
*** unicell has quit IRC06:13
sdake_sup berendt06:13
*** salv-orlando has quit IRC06:14
*** unicell has joined #openstack-kolla06:15
coolsvapthere are so many patches in queue related to heka after we are planning to do the deprecation06:20
berendtcoolsvap yes, i think bug fixes should be accepted, improvements should be declined06:21
berendthave we already decided if we want be a part of the PTG in Atlanta?06:22
berendtJeffrey4l_ can you please use my other launchpad account for bugs? the correct one is berendt06:23
duonghqsdake_: around?06:23
sdake_duonghq wound me06:25
sdake_berendt no visibility into ptg planning06:25
sdake_suggest asking inc0 your question on the mailing list06:26
duonghqThe kolla deploy is done but I got 503 error when opnestack-client try to connect to keystone06:26
sdake_that way the whole community can participate int he discussion06:26
bjolo_morning06:26
sdake_duonghq you are testing against master06:26
berendtwill drop him a private mail that he can open the discussion on the list06:26
sdake_which is broken imo :)06:26
sdake_we need to be testing against stable'newton06:26
sdake_see; https://review.openstack.org/38354606:26
duonghqoh, so the master is broken atm?06:26
duonghqpoor me06:26
sdake_master of openstack06:27
Jeffrey4l_berendt, sorry?06:27
sdake_not maste rof kolla06:27
sdake_sup bjolo06:27
Jeffrey4l_berendt, what i used?06:27
berendtJeffrey4l_ i have two launchpad accounts, berendt and berendt-betacloud, use berendt instead of berendt-betacloud06:27
Jeffrey4l_OK. np.06:27
duonghqsdake_: how can I specify it in image config?06:28
duonghq*image buliding config06:28
sdake_duonghq just cuerrypick the patch06:29
sdake_and build world06:29
Jeffrey4l_gtg brb06:30
sdake_need bugs fiixing :)06:30
sdake_anyone have questions on process related thereof?06:30
duonghqsdake_: I'm sorry but I cannot find how to build Docker image from specific openstack commit06:32
*** phuongnh has quit IRC06:32
sdake_duonghq open up the review06:32
sdake_ingerrit, click download06:32
sdake_click the cherrypppick link06:32
sdake_this will copy into your paste buffer a git operation to pull down the change06:33
sdake_then pull it down and ally it06:33
sdake_by pasting your buffer into yoru kolla master repo06:33
duonghqsorry but you mean I should cherry OS or Kolla itself?06:34
duonghqcherrypick06:34
sdake_duonghq cherrypick my review aovve dude06:37
sdake_https://review.openstack.org/38354606:37
berendthttps://review.openstack.org/#/c/369184/06:38
berendtwe have to merge the fedora deprecation...06:38
duonghqsdake_, I use ubuntu base, not centos, for the centos know is broken06:38
*** ldeptula has joined #openstack-kolla06:38
duonghqguess that I should clean all image and try to rebuild everything06:39
*** janem has joined #openstack-kolla06:39
sdake_duonghq ubuntubase = building from source06:39
berendtJeffrey4l_ sorry for the confusion with the fernet change, i meant that i abandon my one06:39
sdake_building from source needs attention too06:39
duonghqyup, I'm build from source,06:39
sdake_the same attention06:39
berendtJeffrey4l_ do you want to take over/co-author https://review.openstack.org/#/c/369418?06:39
sdake_i amworking on it atm06:39
duonghqdon't openstack error, maybe my fault06:40
*** yuanying_ has joined #openstack-kolla06:40
duonghq*don't think06:41
*** yuanying has quit IRC06:44
*** janem has quit IRC06:45
*** msimonin1 has quit IRC06:46
*** Pavo has quit IRC06:50
*** sdake has joined #openstack-kolla06:50
*** sdake_ has quit IRC06:52
*** Pavo has joined #openstack-kolla06:55
*** b_bezak has joined #openstack-kolla06:57
*** haplo37 has quit IRC07:02
*** g3ek has quit IRC07:02
*** huikang has joined #openstack-kolla07:04
*** shardy has joined #openstack-kolla07:04
*** g3ek has joined #openstack-kolla07:04
*** haplo37 has joined #openstack-kolla07:05
*** salv-orlando has joined #openstack-kolla07:07
*** sdake has quit IRC07:09
*** zhubingbing has joined #openstack-kolla07:11
*** sdake has joined #openstack-kolla07:13
*** matrohon has joined #openstack-kolla07:13
*** msimonin has joined #openstack-kolla07:13
*** tonanhngo has quit IRC07:26
*** zhurong has quit IRC07:26
*** mewald has joined #openstack-kolla07:32
*** egonzalez90 has quit IRC07:34
*** mewald has quit IRC07:37
openstackgerritSteven Dake proposed openstack/kolla: Move RDO to Newton branches  https://review.openstack.org/38354607:40
*** janem has joined #openstack-kolla07:42
*** yuanying_ has quit IRC07:44
*** janem has quit IRC07:48
*** zhurong has joined #openstack-kolla07:50
*** athomas has joined #openstack-kolla07:51
*** Serlex has joined #openstack-kolla07:52
*** ldeptula has quit IRC07:53
*** ankush has joined #openstack-kolla07:53
*** ldeptula has joined #openstack-kolla07:53
*** daneyon has joined #openstack-kolla07:57
*** daneyon has quit IRC08:02
openstackgerritzhubingbing proposed openstack/kolla: add sahara log in heka  https://review.openstack.org/38357608:06
*** tonanhngo has joined #openstack-kolla08:06
*** huikang has quit IRC08:07
*** tonanhngo has quit IRC08:08
*** sdake_ has joined #openstack-kolla08:09
*** sdake has quit IRC08:10
*** gfidente has joined #openstack-kolla08:19
*** gfidente has joined #openstack-kolla08:19
*** yuanying has joined #openstack-kolla08:22
*** yuanying has quit IRC08:26
*** yuanying has joined #openstack-kolla08:26
openstackgerritzhubingbing proposed openstack/kolla: add sahara log in heka  https://review.openstack.org/38357608:27
*** yuanying_ has joined #openstack-kolla08:28
*** athomas has quit IRC08:31
*** yuanying has quit IRC08:32
*** tonanhngo has joined #openstack-kolla08:38
*** tonanhngo has quit IRC08:40
sdake_berendt Jeffrey4l_ can you ahve a look at https://review.openstack.org/38354608:41
*** salv-orl_ has joined #openstack-kolla08:43
zhubingbingsdake why move RDO to Newton branches08:45
*** janem has joined #openstack-kolla08:45
*** salv-orlando has quit IRC08:45
*** Pavo has quit IRC08:50
*** janem has quit IRC08:52
*** yuanying_ has quit IRC08:52
*** yuanying has joined #openstack-kolla08:52
sdake_zhubingbing i thought it would arbitrarily be agood idea to submit a random patch against the tree08:53
zhubingbingroger08:53
*** salv-orl_ has quit IRC08:54
*** bachp has quit IRC08:54
*** salv-orlando has joined #openstack-kolla08:55
*** Pavo has joined #openstack-kolla08:55
*** zhurong has quit IRC09:00
*** zhurong has joined #openstack-kolla09:02
openstackgerritMerged openstack/kolla: Integrate gnocchi with ceph  https://review.openstack.org/37493709:06
*** bachp has joined #openstack-kolla09:07
*** sdake_ has quit IRC09:09
pbourkedeloran repos are down anyone have info on this?09:11
*** bjolo_ has quit IRC09:12
pbourkeJeffrey4l_: why -2'ing cherry-picks to stable branches?09:15
wznoinskJeffrey4l_: which distro/release you're using mainly for kolla testing? thinking of https://bugs.launchpad.net/kolla/+bug/1631072 here and how to properly sort it out09:16
openstackLaunchpad bug 1631072 in kolla "iscsid container: mkdir /sys/kernel/config: operation not permitted" [Undecided,New]09:16
*** ayoung has quit IRC09:17
pbourkeJeffrey4l_: ah I see it looks like a mistake push09:18
*** tonanhngo has joined #openstack-kolla09:18
*** tonanhngo has quit IRC09:20
*** egonzalez90 has joined #openstack-kolla09:22
*** berendt has quit IRC09:25
*** ayoung has joined #openstack-kolla09:28
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla: Fix manila-api binds to ::  https://review.openstack.org/36756609:29
*** kbyrne has quit IRC09:32
*** kbyrne has joined #openstack-kolla09:34
*** tonanhngo has joined #openstack-kolla09:34
*** tonanhngo has quit IRC09:37
*** janem has joined #openstack-kolla09:48
*** tonanhngo has joined #openstack-kolla09:52
*** tonanhngo has quit IRC09:54
*** ankush has quit IRC09:54
openstackgerritMick Thompson proposed openstack/kolla: Updated murano configuration.  https://review.openstack.org/38361509:54
*** ankush has joined #openstack-kolla09:54
*** janem has quit IRC09:54
*** HyperJohnGraham has quit IRC09:56
*** mnasiadka has joined #openstack-kolla09:58
*** ankush has quit IRC10:01
*** zhurong has quit IRC10:11
*** athomas has joined #openstack-kolla10:11
*** zhurong has joined #openstack-kolla10:12
*** tonanhngo has joined #openstack-kolla10:13
*** ankush has joined #openstack-kolla10:13
*** zhubingbing has quit IRC10:16
*** zhubingbing_ has joined #openstack-kolla10:16
*** janem has joined #openstack-kolla10:16
*** tonanhngo has quit IRC10:18
*** tovin07 has quit IRC10:19
*** janem has quit IRC10:20
*** mewald has joined #openstack-kolla10:22
*** mewald has quit IRC10:23
*** mewald has joined #openstack-kolla10:24
*** mewald has quit IRC10:24
*** mewald has joined #openstack-kolla10:24
*** dwalsh has joined #openstack-kolla10:27
*** duonghq has quit IRC10:33
*** daneyon has joined #openstack-kolla10:40
*** egonzalez90 has quit IRC10:41
*** janem has joined #openstack-kolla10:43
*** tonanhngo has joined #openstack-kolla10:43
*** salv-orlando has quit IRC10:44
*** tonanhngo has quit IRC10:44
*** daneyon has quit IRC10:44
*** awiddersheim has quit IRC10:47
*** neilus has joined #openstack-kolla10:48
*** Pavo has quit IRC10:50
*** neilus has quit IRC10:52
*** neilus has joined #openstack-kolla10:54
*** Pavo has joined #openstack-kolla10:56
*** neilus has quit IRC10:59
*** egonzalez90 has joined #openstack-kolla11:00
*** tonanhngo has joined #openstack-kolla11:04
*** tonanhngo has quit IRC11:06
*** tonanhngo has joined #openstack-kolla11:17
*** salv-orlando has joined #openstack-kolla11:19
*** skramaja has quit IRC11:22
*** mkoderer has joined #openstack-kolla11:25
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Workflow Gate Testing  https://review.openstack.org/38202111:28
*** rhallisey has joined #openstack-kolla11:29
*** mliima has joined #openstack-kolla11:33
*** mewald has quit IRC11:50
*** egonzalez90 has quit IRC11:52
*** ldeptula has quit IRC11:52
mliimamorning guys11:59
*** shardy is now known as shardy_lunch12:00
*** portdirect has quit IRC12:03
*** zhubingbing_ has quit IRC12:04
*** schwicht has joined #openstack-kolla12:07
*** schwicht has quit IRC12:11
*** schwicht has joined #openstack-kolla12:12
*** schwicht has quit IRC12:16
*** dave-mccowan has joined #openstack-kolla12:17
*** schwicht has joined #openstack-kolla12:21
*** eaguilar has joined #openstack-kolla12:22
*** jtriley has joined #openstack-kolla12:30
*** fguillot has joined #openstack-kolla12:37
*** neilus has joined #openstack-kolla12:37
janemIm having difficulties getting cinder-volume to work on 2.0.2 kolla-ansible..12:40
janemhave installed lvm2 on the ubuntu host, this is a AIO install.12:40
janemAnd created the cinder-volumes group on host12:41
janemcreating volumes are just stuck in "Creating"12:41
*** strigazi_AFK is now known as strigazi12:41
janemno error in logs12:41
*** neilus has quit IRC12:42
*** salv-orlando has quit IRC12:42
janemany help would be much appreciated12:43
*** shardy_lunch is now known as shardy12:43
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Workflow Gate Testing  https://review.openstack.org/38202112:44
*** zhubingbing_ has joined #openstack-kolla12:45
janemcould it have anything to do with the Docker storage driver? Its an Ubuntu host, but running the default centos containers12:45
zhubingbing_ping pbourke12:49
*** schwicht has quit IRC12:50
*** Pavo has quit IRC12:50
*** jtriley has quit IRC12:51
*** jtriley has joined #openstack-kolla12:54
*** Pavo has joined #openstack-kolla12:55
zhubingbing_https://review.openstack.org/#/c/383066/12:57
zhubingbing_keystone logs have collected 2 times in heka12:57
pbourkezhubingbing_: I see admin-access|error and public-access|error13:02
pbourkezhubingbing_: what is the duplication?13:02
*** jtriley has quit IRC13:02
*** schwicht has joined #openstack-kolla13:06
zhubingbing_-rw-r-----. 1 centos 1001 136 Sep 30 12:01 keystone-apache-admin13:06
zhubingbing_-rw-r-----. 1 centos 1001 137 Sep 30 12:01 keystone-apache-public13:06
zhubingbing_-rw-r-----. 1 centos 1001 123 Oct  7 13:06 keystone_keystone13:06
zhubingbing_-rw-r-----. 1 centos 1001 136 Sep 30 12:01 keystone_keystone-apache-admin-access13:06
zhubingbing_-rw-r-----. 1 centos 1001 135 Sep 30 12:01 keystone_keystone-apache-admin-error13:06
zhubingbing_-rw-r-----. 1 centos 1001 137 Sep 30 12:01 keystone_keystone-apache-public-access13:06
zhubingbing_-rw-r-----. 1 centos 1001 136 Sep 30 12:01 keystone_keystone-apache-public-error13:06
zhubingbing_keystone-apache-public and keystone-apache-admin these 2 are repeated.13:07
*** huikang has joined #openstack-kolla13:08
*** huikang has quit IRC13:08
zhubingbing_keystone-apache-public == keystone_keystone-apache-public-access13:08
*** jheroux has joined #openstack-kolla13:08
*** huikang has joined #openstack-kolla13:08
zhubingbing_keystone-apache-admin == keystone_keystone-apache-admin-access13:08
openstackgerritOtavio Salvador proposed openstack/kolla: Refer to operator VM as primary VM  https://review.openstack.org/38317313:08
openstackgerritOtavio Salvador proposed openstack/kolla: Improve Vagrants bootstrap.sh proxy support  https://review.openstack.org/38317213:08
openstackgerritOtavio Salvador proposed openstack/kolla: Set internal vip to vagrant private network  https://review.openstack.org/38317413:08
openstackgerritOtavio Salvador proposed openstack/kolla: Fix tar command path for magnum conductor using ubuntu  https://review.openstack.org/38316913:08
openstackgerritOtavio Salvador proposed openstack/kolla: Add support for magnum ubuntu binary containers  https://review.openstack.org/38316813:08
openstackgerritOtavio Salvador proposed openstack/kolla: Vagrant plugin check  https://review.openstack.org/38318013:08
openstackgerritOtavio Salvador proposed openstack/kolla: Connect to remote hosts as root  https://review.openstack.org/38317713:09
openstackgerritOtavio Salvador proposed openstack/kolla: Only keep localhost for 127.0.0.1  https://review.openstack.org/38317613:09
openstackgerritOtavio Salvador proposed openstack/kolla: Fix docker daemon proxy support in vagrant  https://review.openstack.org/38317913:09
openstackgerritOtavio Salvador proposed openstack/kolla: Use MAC address for looking for DHCP leases for Vagrant  https://review.openstack.org/38317813:09
zhubingbing_[root@kolla-test-1 logstreamer]# diff keystone-apache-admin keystone_keystone-apache-admin-access13:10
zhubingbing_[root@kolla-test-1 logstreamer]#13:10
*** sogabe has quit IRC13:11
zhubingbing_pbourke  diff keystone-apache-admin keystone_keystone-apache-admin-access13:12
zhubingbing_diff keystone-apache-public keystone_keystone-apache-public-access13:12
Jeffrey4l_pbourke, around?13:15
pbourkeJeffrey4l_: hi13:15
pbourkezhubingbing_: what is logstreamer?13:15
zhubingbing_yes in logstreamer13:15
Jeffrey4l_pbourke, about this https://review.openstack.org/#/c/369418   do u mean export the fernet keys to ceph?13:15
*** lamt has joined #openstack-kolla13:16
pbourkeJeffrey4l_: I dont mean to ceph, I mean we should use the same mechanism the ceph role uses to distribute it's keys13:17
pbourkeJeffrey4l_: which is bslurp.py13:17
Jeffrey4l_pbourke, ok, will check this file.13:18
openstackgerritzhubingbing proposed openstack/kolla: add sahara log in heka  https://review.openstack.org/38357613:18
pbourkeJeffrey4l_: cool thanks13:18
Jeffrey4l_another Q: https://review.openstack.org/372737  could u check my comments.13:18
pbourkeJeffrey4l_: essentially we should not be using ssh as a file copy mechanism13:18
*** ankush has quit IRC13:18
pbourkeJeffrey4l_: on the other patch, I thought gnocchi was an alternative backend13:19
pbourkefor ceilometer13:19
pbourkemaybe mandatory now?13:19
Jeffrey4l_pbourke, the fernet key will re-generate and need distribute to other node.13:19
Jeffrey4l_if we do not use ssh, how can we copy files from one node to another?13:20
Jeffrey4l_the bslurp is used by ansible, which copy file through ssh, too.13:20
pbourkeyes but it doesn't require a dedicated ssh container13:20
pbourkecomplete with it's own keys etc.13:21
pbourkewehttps://github.com/openstack/kolla/blob/d75847772d0e880329eef5867caf4b87035d2ae0/ansible/roles/ceph/tasks/distribute_keyrings.yml#L1413:21
Jeffrey4l_pbourke, we need inject the key into container.   in your link, this is controlled by config.json file.13:22
*** huikang has quit IRC13:23
*** huikang has joined #openstack-kolla13:23
pbourkecan you link me where this is done?13:24
pbourkethe injection13:24
Jeffrey4l_pbourke, this line https://github.com/openstack/kolla/blob/d75847772d0e880329eef5867caf4b87035d2ae0/ansible/roles/ceph/templates/ceph-osd.json.j2#L1113:26
pbourkeyes but where is the fernet part?13:27
Jeffrey4l_pbourke, fernet keys are copied to the /etc/keystone/fernet-keys fokder though keystone-ssh.13:28
Jeffrey4l_pbourke, here https://github.com/openstack/kolla/blob/d75847772d0e880329eef5867caf4b87035d2ae0/ansible/roles/keystone/templates/fernet-node-sync.sh.j2#L1413:28
*** huikang has quit IRC13:28
*** inc0 has joined #openstack-kolla13:29
inc0good morning folks13:29
Jeffrey4l_re gnocchi: gnocchi is added to support ceilometer, who provide more efficient storage. but it is not implemented.13:30
Jeffrey4l_pbourke, ^13:30
Jeffrey4l_morning13:30
Jeffrey4l_inc0, could u check this https://review.openstack.org/37876213:30
inc0Jeffrey4l_, can you add tag to commit message?13:31
Jeffrey4l_ inc0 what tag?13:32
inc0Closes-Bug or Partial-Bug13:32
pbourkeJeffrey4l_: is there a reason we can't use config.json for this?13:32
Jeffrey4l_inc0, there is no bug for this.13:32
inc0btw delorean is down?13:33
Jeffrey4l_pbourke, 1. fernet-keys is mutative. when newer is created, the older will be removed. it is hard to write the config.json file ( actually, we can use folder )13:34
Jeffrey4l_2. if we use config.json, when the fernet keys are changed, we need restart keystone container.13:35
pbourkeJeffrey4l_: ok thanks for explaining13:35
Jeffrey4l_I do not think 2 is acceptable13:35
pbourkeJeffrey4l_: I'll remove my vote for now as it sounds non trivial13:35
Jeffrey4l_thanks.13:36
Jeffrey4l_But i admit ssh is not a optimal solution :(13:37
Jeffrey4l_the optimal is: push the keys into a shared storage ( like ceph/swift ) and keystone read the file from the storage directly.13:38
*** mewald has joined #openstack-kolla13:39
Jeffrey4l_inc0, yes. no idea when it will be fixed.13:39
Jeffrey4l_pbourke, https://review.openstack.org/383168  i do not think we will merge those backports.13:40
pbourkeJeffrey4l_: I thought some people needed the vagrant patches13:40
inc0ehh if we ever want to have voting gates we need to figue sth out:/13:40
sbezverk_inc0: the solution we talked about yesterday has some issues, let me know when you have time to chat about them..13:41
Jeffrey4l_pbourke, http://storage4.static.itmages.com/i/16/1007/s_1475847741_1044274_462a412894.png13:41
*** wirehead_ has quit IRC13:41
*** dmsimard has quit IRC13:41
Jeffrey4l_there are lots PS are pushed. I think it is pushed by mistake.13:41
inc0sbezverk_, go ahead13:42
Jeffrey4l_pbourke, http://storage4.static.itmages.com/i/16/1007/h_1475847741_1044274_462a412894.png13:42
Jeffrey4l_this one13:42
kfox1111morning13:42
*** dmsimard has joined #openstack-kolla13:42
pbourkeotavio: ping13:42
*** ccesario has joined #openstack-kolla13:43
sbezverk_inc0 kfox1111 if node goes to NotReady state it stays there forever or until it comes back up. in current logic there is a loop which checks for not ready state and action on it every second13:44
*** schwicht has quit IRC13:44
sbezverk_I think it is dangerous and wasteful13:44
inc0yeah, damn, I see what you mean13:44
inc0I think we can work around this, but what we really need is k8s support for that stuff13:44
sbezverk_inc0: imagine sending turn off signal via ipmi or trying to clean lock on ceph cluster every second13:45
inc0like "node lifecycle jobs" -> job that gets called when node dies/ressurects13:45
inc0well, it's solvable algorithmically, but meh13:45
sbezverk_inc0: we could try to keep state in a file and check13:45
sbezverk_and acti only if state changed from previous run13:46
inc0bigger issue is at hand13:46
kfox1111yeah, state would solve it.13:46
inc0we'll have n replicas of this container13:46
kfox1111if we just keep it in memory though, should be ok?13:46
*** wirehead_ has joined #openstack-kolla13:46
kfox1111if there are a few extra ipmi power off's, it should be ok.13:47
inc0I'll do something else yet13:47
kfox1111the unlock command should only issue unlocks when the hostname match.13:47
inc0check for lock in ceph erected by this node -> ipmi signal -> remove locks13:47
sbezverk_inc0: kfox1111: I wanted to propose for now do not try ceph and ipmi clean up but just to kill Terminating containers13:47
*** DanyC has joined #openstack-kolla13:47
kfox1111so shouldnt' issue extranious ones.13:47
inc0if there are no locks we don't need to ipmi this node as nothing is assumed to be connected to i13:47
inc0t13:47
inc0sbezverk_, ceph lock has to be removed anyway13:48
inc0so you can migrate stuff13:48
kfox1111inc0: true.13:48
inc0we can use ceph locks as node locks for ourselves13:48
inc0essentially13:48
inc0this would solve multi container issue13:48
sbezverk_inc0: kfox1111: maybe for now we could get around with a separate script on ceph cluster to clean locks? it looks like a safer option for now at least13:49
kfox1111so, loop, check for down node, look in local array if seen before, if not, check for any ceph locks on it13:49
inc0might cause really strange race conditions, but at the end of the day we need this to be done in k8s13:49
kfox1111if locks on it, ipmipower off, remove all locks referencing the host, add to array. sleep and repeat.13:49
inc0I'd skip "look in local array", if we have multiple replicas we need external lock13:49
sbezverk_inc0: have you put anything together from code perspective last night?13:49
inc0sbezverk_, started to work on pod declaration13:50
inc0didn't get to actual fencing yet13:50
*** diogogmt has joined #openstack-kolla13:50
kfox1111inc0: I dont think the race is so bad.13:50
kfox1111inc0: only the hammering of ceph/ipmi.13:50
kfox1111a couple of ipmipower off's won't hurt it.13:50
openstackgerritMerged openstack/kolla: Fix genconfig and reconfigure for magnum  https://review.openstack.org/38352813:51
inc0couple of ceph remove also wont as it's node specific13:51
kfox1111better  though not a constant stream of them.13:51
inc0yeah13:51
* kfox1111 nods.13:51
inc0anyway, no need for having local lock13:51
sbezverk_inc0: ok I can show you the prototype I build last night maybe it will help optimize our time :-) if you want, totally optional though13:51
inc0you don't want this pod do be spawned when you're fixing the server:)13:51
sbezverk_inc0: that is another problem13:52
inc0"let's look at this log...poof shutdown"13:52
sbezverk_NotReady states are possible for valid reasons13:52
inc0hence external lock13:52
kfox1111true.13:52
kfox1111oh... one other option...13:52
inc0fortunately we have multiple tools for that13:52
inc0ceph, etcd13:52
kfox1111what about tainting the node?13:52
inc0what do you mean?13:53
kfox1111we can taint the node, and treat that as a state.13:53
inc0so locks has to be revocable13:53
kfox11111.4 has a taint commnad. it prevents containers from starting on the node.13:53
sbezverk_kfox1111: it is already dead? what good it makes to taint it not following13:53
inc0and if we do it just in ceph, we don't need to care about that part13:53
kfox1111its like a special type of label. its metadata on the node.13:53
openstackgerritJeffrey Zhang proposed openstack/kolla: DO NOT MERGE: TEST MASTER BRANCH  https://review.openstack.org/32630713:54
kfox1111so, we check for node down. we check if its tainted already. if not, ipmi power off, remove locks, add taint.13:54
sbezverk_the node is dead, not ready nothing will get scheduled there13:54
kfox1111the op can then bring it back up and poke at it. the taint will prevent stuff from being scheduled there, and the script wont try powering it off again.13:54
sbezverk_tainting was done if I remember right for a live node which starting to perfom badly mostly due to resource constraints13:55
kfox1111sbezverk_: thats one use case. kubeadm uses it to prevent stuff from being scheduled on the 'master' node by default.13:55
kfox1111for all in one, I've had to remove that taint:13:55
kfox1111kubectl taint nodes --all dedicated-13:55
*** mgoddard has joined #openstack-kolla13:55
openstackgerritMerged openstack/kolla: Fix manila-api binds to ::  https://review.openstack.org/36756613:56
kfox1111you can have multiple taints even.13:56
kfox1111they have a prototype I think of multitenancy where each node gets assigned to a tenant with different taints.13:56
kfox1111and then the pods for that tenant have a flag letting them accept that type of taint.13:56
kfox1111pretty clever.13:56
sbezverk_kfox1111: no use for our current list of issues though13:57
*** mewald has quit IRC13:57
inc0hey, why not base onlu on ceph now?:)13:57
kfox1111sbezverk_: I think its useful to keep track of poweroff state?13:57
sbezverk_kfox1111: I think we need to build a list of possible issues with this solution and metodically address them one by one in code.13:58
inc0any locks exists -> ipmi poweroff and remove locks13:58
kfox1111k13:58
inc0end of story, when operator will fix issue, re-enable node, pods gets spawned13:58
sbezverk_if we keep track of not ready state in a variable and act on only change then one of the problem would be solved13:58
kfox1111inc0: yeah, I guess it could be flipped around that way too.13:58
inc0and if I'd have to store state somewhere -> I'd use etcde13:59
inc0etcd13:59
kfox1111inc0: I'd use k8s. :)13:59
inc0taiting node is more than metadata, but we could use metadata I guess13:59
kfox1111use a node taint, or a node label  :)13:59
*** mewald has joined #openstack-kolla14:00
sbezverk_I think using etcd is good idea and less chances it will impact anything else14:00
kfox1111sbezverk_: unrelated question. do you know why most of the containers seem to not be writing out logs?14:00
sbezverk_playing with tainting does not sound too safe14:01
kfox1111sbezverk_: why are taints unsafe?14:01
wznoinskJeffrey4l_: around?14:01
sbezverk_because it is kubernetes known condition by setting it up for our purposes we cannot be 100% sure we do not impact somehitng else14:02
kfox1111I think k8s already provides what we need for state storage. lets not use more then one api there if we can.14:02
sbezverk_where as when we use etcd in our own branch we know exactly that nothing else uses it14:02
kfox1111sbezverk_: then node label or attribute. they were designed for storing arbitrary data on the users behalf.14:02
kfox1111I kind of prefer the taint, as when the node coems back up, stuf wont just autoschedule to it.14:03
sbezverk_labels sounds much safer imho14:03
kfox1111but lebels would be good too.14:03
*** mewald has quit IRC14:03
sbezverk_if node went down it is an incident which requires people to look at it14:03
*** pbourke has quit IRC14:03
sbezverk_so they might have different practices how bring node up14:04
*** pbourke has joined #openstack-kolla14:04
kfox1111sbezverk_: exactly. and if it gets rebooted, and there is no taint, then it might start running stuff.14:04
kfox1111I guess it doesn't really matter much in the end though.14:04
sbezverk_and this is problem because? I mean if it starts just running?14:04
kfox1111cause the node might be sick still.14:05
sbezverk_My initial concern was bombarding ceph and ipmi every second14:05
sbezverk_we will address it14:05
sbezverk_in the code14:05
kfox1111k.14:05
jmccarthyHmm is it correct that heat.conf.j2 should have entries for memcached_servers and memcache_servers ? (one with and one without the d)14:05
sbezverk_kfox1111: regading logging, I have not tested all containers for formating. if there is a mismatch then it will not store the message14:07
*** lrensing has joined #openstack-kolla14:07
sbezverk_I was going to start testing each format after the summit14:07
sbezverk_I am afraid that would be a huge job, since lots of opensatck components uses different formats :-(14:07
*** DanyC has left #openstack-kolla14:08
*** DanyC has joined #openstack-kolla14:09
sbezverk_kfox1111: do you think labeling or tainting will work against the node in NotReady state?14:11
*** mnasiadka has quit IRC14:13
*** zhurong has quit IRC14:13
*** MarMat has joined #openstack-kolla14:14
*** jtriley has joined #openstack-kolla14:16
*** daneyon has joined #openstack-kolla14:16
kfox1111sbezverk_: either I guess. a taint is cool, as the operator doesn't have to do anything when bringing it back up to prevent stuff from running on it, so easier to test.14:18
kfox1111but could be a little unexpected too though.14:18
*** mewald has joined #openstack-kolla14:19
kfox1111sbezverk_: for the logs, I'm trying to gather all logs from the pods, on the host with:14:19
kfox1111sudo find /var/lib/kubelet/pods/ -type f | grep kubernetes.io~empty-dir | while read line; do \ sudo chmod 666 $line sudo cp -a $line $WORKSPACE/logs/kubelet-logs14:19
kfox1111Its not getting much by way of logs though. very strange.14:19
kfox1111I've tried going onto a few pods and gathering /var/log/kolla/*/* and got nothing too.14:20
sbezverk_kfox1111: please clarify, are you after kubernetes logs or kolla-kube components logs?14:20
kfox1111the openstack services logs.14:20
kfox1111the configs all look ok.14:21
*** daneyon has quit IRC14:21
sbezverk_kfox1111: then  all logs should be in /var/log/kolla/*/*.log14:21
kfox1111for some unknown reason, I'm having a heck of a time finding them.14:21
kfox1111yeah. I've looked there.14:21
sbezverk_we do not control that part other than just providing an empy dir14:22
kfox1111I've even doine a?14:22
*** serverascode has quit IRC14:22
*** NachoDuck has quit IRC14:22
kfox1111find /var/lib/kubelet/pods/ | grep log14:22
*** tonanhngo has quit IRC14:22
*** michauds has joined #openstack-kolla14:23
sbezverk_ocker exec d236be802ffe ls /var/log/kolla/neutron/neutron-openvswitch-agent.log14:23
kfox1111or even grabbing everything: http://logs.openstack.org/41/381041/81/experimental/gate-kolla-kubernetes-deploy-centos-binary-ceph-nv/94da3a3/console.html14:23
sbezverk_oh you are trying to get to those logs from the host14:23
kfox1111I tried in the containers with no luck, so was trying from the host.14:24
openstackgerritMick Thompson proposed openstack/kolla: Updated murano configuration  https://review.openstack.org/38361514:24
sbezverk_I just pasted logs I got for neutron-openvswitch-agenmt14:24
sbezverk_work on my side14:24
kfox1111the host woudl be easier anyway. but not seeing them. its soo weird.14:24
kfox1111yeah. its worked for me last I tried ini minikube too.14:25
kfox1111I'm not sure why the gate would be any different.14:25
*** NachoDuck has joined #openstack-kolla14:25
kfox1111but I've spent almost a whole day now thrying to figure out why I cant seem to find the logs. :/14:25
*** absubram has joined #openstack-kolla14:25
sbezverk_kfox1111: can you try ls -al /var/log/kolla/neutron/neutron-openvswitch-agent.log14:26
sbezverk_just for one container14:26
sbezverk_to confirm14:26
*** DanyC has quit IRC14:26
kfox1111k.14:27
*** serverascode has joined #openstack-kolla14:28
Jeffrey4l_wznoinsk, yep14:28
sbezverk_kfox1111: when you have a chance I need to close this small leftover issue: https://review.openstack.org/#/c/381785/114:30
kfox1111sbezverk_: looks good.14:31
sbezverk_kfox1111: thanks14:32
inc0pbourke, did you take a look at this pgnum issue?14:32
*** tonanhngo has joined #openstack-kolla14:32
pbourkeinc0: not yet, still blocked on this ssh issue I'm having14:32
*** absubram has quit IRC14:32
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104114:32
Jeffrey4l_sbezverk_, could u explain why rabbitmq_version variable is needed? https://github.com/openstack/kolla/commit/cc4150292c66b99aaf63a63e7438fa1cee3be12914:33
*** tonanhngo has quit IRC14:33
openstackgerritMerged openstack/kolla-kubernetes: Fixing TUNNEL_INTERFACE in neutron dhcp agent pod  https://review.openstack.org/38178514:34
*** jtriley has quit IRC14:35
*** absubram has joined #openstack-kolla14:36
inc0pbourke, I'll take on it then14:37
inc0sbezverk_, I'll fix ^ and go back to kolla-k8s14:37
Jeffrey4l_sbezverk_, please re in this PS https://review.openstack.org/#/c/336751/1214:37
inc0I have few ideas already:)14:37
*** bmace has quit IRC14:39
*** bmace has joined #openstack-kolla14:39
sbezverk_Jeffrey4l_: hi Jeffrey4l_ unfortunately I cannot answer that question as it was wirehead who was working on this PS, all I know before this PS we could not run rabbitmq in kube..14:40
*** schwicht has joined #openstack-kolla14:40
sbezverk_inc0: sounds good14:41
Jeffrey4l_hmm i want remove the `rabbit_version`. it is useless and misunderstand.14:41
sbezverk_Jeffrey4l_: but it should not really matter, it is only "perception", no functional impact to have it14:41
sbezverk_I mean it is your call, but if it breaks rabbitmq we will come after you ;-)14:42
Jeffrey4l_cool got it.14:42
Jeffrey4l_i do not think this value can be changed. it will be error if we change the default value.14:43
Jeffrey4l_np :)14:43
inc0jascott1, ping14:47
*** Pavo has quit IRC14:50
inc0pbourke, Jeffrey4l_ do you know if cache osd's also counts for pg count?14:51
*** Pavo has joined #openstack-kolla14:51
openstackgerritMick Thompson proposed openstack/kolla: Updated murano configuration  https://review.openstack.org/38361514:52
*** tonanhngo has joined #openstack-kolla14:56
*** tonanhngo has quit IRC14:57
*** sdake has joined #openstack-kolla14:59
kfox1111arg.. stupid extra /15:00
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104115:00
*** jtriley has joined #openstack-kolla15:01
inc0SamYaple, do you know if how much pg % should I create for cache layer15:07
inc0?15:07
inc0i15:08
*** dave-mccowan has quit IRC15:10
SamYapleinc0: you really shouldn't be using a caching layer at all these days15:12
SamYapleits a feature that is likely to be deprecated, but is 100% full of bugs15:12
*** tonanhngo has joined #openstack-kolla15:12
SamYaplebut as always, it depends on how much data will be on the cachelayer, thats how yo ucalculate pgs15:12
inc0well since we still have it in Kolla15:12
inc0we need to set it up somehow:)15:12
SamYaplei mean the defaults i put on there are fine, 128 i believe15:13
inc0not really15:13
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Workflow Gate Testing  https://review.openstack.org/38202115:13
SamYapleno really. its actually to much in most situations (but the overhead is so small as to not be noticable)15:13
inc0ceph -s as of late throws health_warn that too many pgs15:13
*** tonanhngo has quit IRC15:13
SamYaplebut if you think otherwise, do your thing i suppose15:13
inc0so yeah, it's too much:)15:14
SamYaplethats not an error though15:14
SamYaplethats a warning15:14
SamYapleand thats because you have a tiny baby cluster15:14
SamYapleits not actually affecting performance, whereas too few for a normal sized cluster is a big problem15:14
rhalliseyinc0, your cluster is weak15:14
SamYapleso its a safe and reasonable default15:14
*** neilus has joined #openstack-kolla15:14
SamYaplereducing it is a really bad idea for a default15:14
inc0SamYaple, agree, what I'm doing now essentially is to make it a bit more intelligent15:15
inc0not reducing15:15
inc0I will actually make this calculation15:15
rhallisey:)15:15
inc0in play15:15
SamYapleinc0: you are not able to do that since the calculation requires knowlege you will not have15:15
*** Pavo has quit IRC15:15
inc0and what is that knowledge?15:16
SamYaplespecifically the ratio and how much data is on the cinder vs glance vs nova pools15:16
SamYaplethat chagnes from cloud to cloud15:16
inc0we can just make this a config15:16
inc0http://ceph.com/pgcalc/ with these defaults15:16
SamYapleeh like i said, do your thing. there is a reason I did not add that stuff15:16
inc0I know15:16
SamYaplepgcalc doesnt do anything with cache stuff15:17
SamYapleremember you are splitting into two different clusters that dont share pgs15:17
inc0yeah I know, anyway, I think it's ok as long as we make it configurable15:17
*** Pavo has joined #openstack-kolla15:17
inc0I know15:17
SamYaplei disagree on attempting to automate what yo uare suggesting since pgs can be increased, not reduced.15:18
otaviopbourke: pong15:18
*** b_bezak has quit IRC15:18
inc0but 128 is too much for tiny clusters and way too small for actual ones15:18
SamYaplebut i dont work on the project anymore soooo15:18
SamYaplewrong on both accounts man15:18
pbourkeotavio: do you want all these cherry-picks backported15:18
*** b_bezak has joined #openstack-kolla15:18
inc0well, when I deployed 10node cluster it was crying that "nut enugh pgs!"15:19
otaviopbourke: we did those while getting mitaka working for our test in vagrant15:19
inc0anyway, I can keep this configurable15:19
otaviopbourke: so we wanted to contribute back as it helps new users15:19
pbourkeotavio: ok np15:19
inc0and make calculated defaults15:19
pbourkeotavio: thanks15:19
pbourkeJeffrey4l_: ^15:19
*** neilus has quit IRC15:19
otaviopbourke: master did not work fine for us, the 3.0.0 images seem broken15:19
otaviopbourke: if something seems risky, tell me and I drop15:20
SamYapleinc0: calculated defaults do not work... the user must calculate this based on how they use openstack15:20
SamYapleinc0: i dont see why this is difficult to grasp15:20
pbourkeotavio: no its fine, just some reviewers thought you had submitted these accidentally15:20
SamYapleyou cant reduce pgs ever, thats teh big issue15:20
pbourkeotavio: as there were a lot of dependant ones15:20
inc0SamYaple, I exactly know what you mean, but there are patterns15:20
pbourkeotavio: I dont think we can backport all of them but I +2'ed the ones I think are needed. Will review again later15:21
Jeffrey4l_pbourke, otavio but it break our stable branch policy. lots of your change should not be backport.15:21
SamYapleyou know best, right inc0? good luck15:21
inc0like in general case vms >> images15:21
pbourkeJeffrey4l_: I see no issue in backporting the vagrant stuff15:21
otaviopbourke: when doing backports i prefer to pick more than try do similar changes15:21
SamYaplethats 100% not true for alot of environments i work on15:21
pbourkeJeffrey4l_: if its required for a working development environment15:21
pbourkeotavio: I agree15:21
pbourkeotavio: with that approach :)15:21
zhubingbing_https://review.openstack.org/#/c/383066/  pbourke:please fix15:22
otaviopbourke: btw, does master work with mitaka?15:22
Jeffrey4l_pbourke, he backport magnum changes. all the backport is in a tree, which is bad.15:22
otavioJeffrey4l_: if you want, i drop those15:22
pbourkeJeffrey4l_: the chaining is not an issue for me, it really just makes it more difficult for otavio if there's some in the tree we dont want to accept15:23
pbourkeJeffrey4l_: as he has to rebase15:23
*** b_bezak has quit IRC15:23
otavioremote:   https://review.openstack.org/383168 Add support for magnum ubuntu binary containers15:23
otavioremote:   https://review.openstack.org/383169 Fix tar command path for magnum conductor using ubuntu15:23
*** dave-mccowan has joined #openstack-kolla15:23
otaviocan be dropped15:23
pbourkeotavio: master is for newton, you can build the images with mitaka but its not supported15:23
pbourkeotavio: I think Jeffrey4l_'s issue is you have submitted these all as dependant patches. So one can not merge with the others15:24
pbourkeotavio: if you submit each as a cherry-pick on top of master it will make things easier15:24
Jeffrey4l_yes.15:24
pbourkes/master/mitaka15:24
Jeffrey4l_the first one about magnum ubuntu binary fix shouldn't be backport, imo15:24
pbourkeJeffrey4l_: what if someone wants to use magnum binary on ubuntu in mitaka?15:25
openstackgerritOtavio Salvador proposed openstack/kolla: Refer to operator VM as primary VM  https://review.openstack.org/38317315:26
openstackgerritOtavio Salvador proposed openstack/kolla: Improve Vagrants bootstrap.sh proxy support  https://review.openstack.org/38317215:26
openstackgerritOtavio Salvador proposed openstack/kolla: Set internal vip to vagrant private network  https://review.openstack.org/38317415:26
openstackgerritOtavio Salvador proposed openstack/kolla: Vagrant plugin check  https://review.openstack.org/38318015:26
openstackgerritOtavio Salvador proposed openstack/kolla: Connect to remote hosts as root  https://review.openstack.org/38317715:26
openstackgerritOtavio Salvador proposed openstack/kolla: Only keep localhost for 127.0.0.1  https://review.openstack.org/38317615:26
openstackgerritOtavio Salvador proposed openstack/kolla: Fix docker daemon proxy support in vagrant  https://review.openstack.org/38317915:26
openstackgerritOtavio Salvador proposed openstack/kolla: Use MAC address for looking for DHCP leases for Vagrant  https://review.openstack.org/38317815:26
otavioJeffrey4l_: magnum fixes are dropped now15:26
otaviopbourke: those are less important15:26
Jeffrey4l_pbourke, magnum is buggy in mitaka. even in master. if someone want to use magnum, lots of change need backport.15:26
otaviopbourke: vagrant libvirt is broken on mitaka15:26
otavioJeffrey4l_: ok; dropped15:27
Jeffrey4l_thanks.15:27
*** jtriley has quit IRC15:27
otavioJeffrey4l_: please feel free do abandon the ones you don't agree15:27
*** salv-orlando has joined #openstack-kolla15:27
otavioJeffrey4l_: pbourke: could you tell us if build using binaries is working on master?15:28
pbourkeotavio: it absolutely should be, if not please let us know15:28
Jeffrey4l_otavio, push unrelated PS in a tree. it will be hard to review.15:28
otavioJeffrey4l_: PS?15:29
Jeffrey4l_please do not push unrelated patchset in a tree.15:29
Jeffrey4l_patch set15:29
otavioJeffrey4l_: this is not unrelated; it were need to for us to get vagrant usable15:30
otavioJeffrey4l_: sorry but I don't see value splitting it15:30
Jeffrey4l_otavio, see this http://storage7.static.itmages.com/i/16/1007/s_1475854273_2426091_17b3e26c2e.png15:30
Jeffrey4l_http://storage5.static.itmages.com/i/16/1007/h_1475854297_1636135_17b3e26c2e.png otavio15:30
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104115:31
*** jtriley has joined #openstack-kolla15:31
otavioJeffrey4l_: I can rename the topic for 'vagrant-backports'15:31
otavioall are backports15:32
Jeffrey4l_otavio, the first two are fixing magnum, others is fixing vagrant15:32
otavioJeffrey4l_: I dropped magnum ones15:32
*** athomas has quit IRC15:33
otavioJeffrey4l_: abandoned them15:33
otavioJeffrey4l_: lunch time, brb15:34
Jeffrey4l_cool.15:34
Jeffrey4l_i think it is fine now.15:34
*** sdake has quit IRC15:34
*** jtriley has quit IRC15:36
*** eaguilar has quit IRC15:41
*** tonanhngo has joined #openstack-kolla15:43
*** mgoddard has quit IRC15:44
*** tonanhngo has quit IRC15:44
*** dwalsh has quit IRC15:49
inc0SamYaple, I'll just make it configurable15:49
inc0instead of 128;)15:50
janemhi all, what storage engine should I use on my Docker host?15:52
janemaufs is fine?15:52
janemUbuntu 14.04.5 host15:52
janemkolla-ansible 2.0.215:53
inc0janem, aufs is fine15:53
inc0although has issues, you can consider btrfs too, but as long as it's not devicemapper you should be ok15:53
janeminc0: ok, thanks. Having issues with getting cinder-volume to work.. Just thought it might have anything to do with that.15:59
*** bachp has quit IRC15:59
inc0extremally unlikely, what's your config?15:59
*** bachp has joined #openstack-kolla15:59
inc0what cinder driver do are you planning to use?16:00
inc0keep in mind that in Mitaka only real choice is ceph:_)16:00
mliimahey guys, i'm trying to deploy multinode16:04
janeminc0: ah.. I was trying to set it up with lvm on the host..16:04
mliimabut when i ran the prechecks i get a ssh error16:04
mliima:/16:04
*** tonanhngo has joined #openstack-kolla16:04
*** mduggan has joined #openstack-kolla16:05
mliimaUNREACHABLE! => {"changed": false, "msg": "ERROR! SSH encountered an unknown error16:05
janeminc0: following the small guide thats available online..16:05
*** tonanhngo has quit IRC16:05
janeminc0: probably dont know what Im doing :P Will look into ceph as well, thanks for the pointer16:05
*** huikang has joined #openstack-kolla16:06
*** mewald has quit IRC16:07
*** huikang_ has joined #openstack-kolla16:07
*** matrohon has quit IRC16:09
*** neilus has joined #openstack-kolla16:10
*** huikang has quit IRC16:11
openstackgerritQin Wang (qwang) proposed openstack/kolla-kubernetes: Add ansible workflow for Horizon  https://review.openstack.org/38262016:11
openstackgerritQin Wang (qwang) proposed openstack/kolla-kubernetes: Ansible support for Mariadb  https://review.openstack.org/33425516:11
openstackgerritQin Wang (qwang) proposed openstack/kolla-kubernetes: Ansible support for Rabbitmq  https://review.openstack.org/38079616:11
openstackgerritQin Wang (qwang) proposed openstack/kolla-kubernetes: Ansible workflow for Keystone  https://review.openstack.org/38079716:11
openstackgerritQin Wang (qwang) proposed openstack/kolla-kubernetes: Ansible workflow for Glance  https://review.openstack.org/38080116:11
*** huikang_ has quit IRC16:12
*** unicell has quit IRC16:12
*** unicell has joined #openstack-kolla16:13
*** neilus has quit IRC16:14
pbourkeinc0: just fyi in case anyone else comes across this https://github.com/ansible/ansible/issues/1793516:16
pbourke(there's no answer as of yet)16:16
*** sdake has joined #openstack-kolla16:16
*** tonanhngo has joined #openstack-kolla16:17
otavioJeffrey4l_: I am back16:18
otavioCould someone clarify what is the reason of kolla and kolla-kube?16:19
Jeffrey4l_i have removed my -2 :)16:19
Jeffrey4l_otavio, ^16:19
otavioJeffrey4l_: \m/16:19
*** dwalsh has joined #openstack-kolla16:20
inc0pbourke, as I said, never..16:20
SamYapleinc0: considering that value is pool-creation-only, i don't think this is as big a deal as you are making, but a configurable for initial creation should be fine, as long as the default is reasonable (128). any smaller will cause problems for non-ceph people.16:21
pbourkeinc0: yeah, just a heads up as ansible is so central to the project. if other users start seeing it16:21
*** michauds has quit IRC16:21
inc0defaults will stay the same SamYaple16:21
SamYaplereally this might benefit more from documentation? or just point at the ceph docs on how to properly setup pgs. thats what i always did16:23
inc0yeah, it's worth documenting16:24
*** salv-orlando has quit IRC16:25
rhalliseyotavio, kolla-k8 is openstack on kubernetes16:26
rhalliseywhile kolla had containers an ansible deploying openstack16:26
otaviorhallisey: but I also found openstack-ansible ... so isn't it duplicating work?16:27
otaviorhallisey: I am asking as I am new on this16:27
inc0otavio, openstack-ansible is totally different16:27
inc0sounds similar, but in reality we have totally different arch/philosophy od deployment16:28
*** mewald has joined #openstack-kolla16:29
otavioand kolla vs kolla-k8?16:29
inc0ansible and k8s are totally different too16:30
inc0however both projects are using same container definiton16:30
otavioinc0: is intended of kolla to be deprecated?16:30
rhalliseyno16:31
inc0no, never!:P16:31
rhalliseyjust another way to deploy16:31
inc0Kolla-Ansible is and will be most supported way to deploy for any forseeable future16:31
inc0Kolla itself is about docker containers and it's shared between all sub-projects16:31
inc0so always supported16:31
inc0but it was always meant to be reusable by different orchiestration engines16:32
otavioso kolla is really kolla-ansible and projects uses the kolla-build from it?16:32
inc0if somebody would like to write Kolla-puppet, we'd welcome him/her with open arms:)16:32
inc0well, after summit we are actually spliting kolla into "kolla" and "kolla-ansible"16:33
inc0whereas kolla-ansible will be really contents of ansible dir in kolla today16:33
inc0where*16:33
otavioinc0: ok, so kolla becomes a kolla-base or similar16:34
otaviomakes sense16:34
inc0kolla stays kolla;)16:34
inc0kolla-ansible is getting it's own project16:34
otaviook16:34
*** salv-orlando has joined #openstack-kolla16:34
sdakeits not getting its own project16:36
sdakeits getting its own deliverable16:36
*** coolsvap has quit IRC16:36
*** absubram has quit IRC16:37
inc0well ok, nomenclature16:37
inc0getting its own repo, we are all Kolla16:37
*** david-lyle has joined #openstack-kolla16:37
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104116:38
otavioIt may sound stupid but looking from outside it is not easy for me to figure when point releases are made. Where I can find it?16:40
otavioI am building 2.0.3 and 3.0.0 now16:40
inc0otavio, https://github.com/openstack/kolla/releases16:43
otavioinc0: so the tags in kolla; ok16:44
otavioinc0: sorry for the dumb questions; thanks for the help16:44
*** gfidente has quit IRC16:45
inc0otavio, there are no dumb questions16:45
sdakeotavio the idea is to release z streams every 45 days16:45
inc0or rather, don't let it stop you;)16:46
sdakeotavio however, because of the rush since milestone3, we have made no zstream releases in about 60+ days16:46
otaviook; makes sense16:46
*** unicell has quit IRC16:48
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Workflow Gate Testing  https://review.openstack.org/38202116:49
*** david-lyle_ has joined #openstack-kolla16:55
*** david-lyle_ has quit IRC16:57
*** sdake has quit IRC17:01
*** ssurana has joined #openstack-kolla17:04
*** david-lyle_ has joined #openstack-kolla17:05
*** salv-orlando has quit IRC17:05
*** neilus has joined #openstack-kolla17:05
*** david-lyle_ has quit IRC17:06
*** david-lyle_ has joined #openstack-kolla17:06
*** david-lyle_ has quit IRC17:07
*** david-lyle_ has joined #openstack-kolla17:08
*** david-lyle has quit IRC17:08
kfox1111sbezverk_: I think I figured out the issue. pebkac....17:08
*** salv-orlando has joined #openstack-kolla17:08
kfox1111forgot the '/bin/bash -c' in the kubectl exec. :/17:09
*** david-lyle_ is now known as david-lyle17:09
*** neilus has quit IRC17:10
*** janem has quit IRC17:13
*** unicell has joined #openstack-kolla17:13
*** haplo37_ has quit IRC17:15
*** zhubingbing_ has quit IRC17:15
sbezverk_kfox1111: please clarify17:16
*** haplo37_ has joined #openstack-kolla17:17
*** mewald has quit IRC17:19
*** msimonin has quit IRC17:20
*** tonanhngo has quit IRC17:23
mdugganThe iscsid & multipath containers both bindmount the host directory /sys/kernel/config onto /configfs. This directory does not exist on ol6 and on ubuntu xenial and is causing deployment failures for both containers.  In Centos and OL7 the directory exists but is empty. Does anyone know if this bindmount definitely is necessary?   This was added by Serguei Bezverkhi in March ... maybe he can comment?17:26
*** shardy has quit IRC17:27
mdugganforgot to point to this exissting bug https://bugs.launchpad.net/kolla/+bug/163107217:28
openstackLaunchpad bug 1631072 in kolla "iscsid container: mkdir /sys/kernel/config: operation not permitted" [Undecided,New]17:28
*** neilus has joined #openstack-kolla17:29
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Make ceph pool sizes configurable  https://review.openstack.org/38383717:30
*** tonanhngo has joined #openstack-kolla17:33
*** tonanhngo has quit IRC17:35
*** Pavo has quit IRC17:37
otavioThe swift expirer container is failing on 2.0.2 as well as upcoming 2.0.3.17:37
otavio/usr/local/bin/kolla_start: line 24: exec: swift-object-expirer: not found17:37
*** bachp has quit IRC17:38
*** absubram has joined #openstack-kolla17:38
*** Pavo has joined #openstack-kolla17:39
kfox1111sbezverk_: I was doing kubectl exec..... "cat foo"17:39
kfox1111instald of:17:39
kfox1111kubectl exec... /bin/bash -c "cat foo"17:40
kfox1111:/17:40
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104117:42
*** narasimha_SV_ has joined #openstack-kolla17:43
*** bachp has joined #openstack-kolla17:43
narasimha_SV_I deployed ironic using kolla17:44
narasimha_SV_when I try to do pxe boot getting this issue in ironic-conductor and17:44
narasimha_SV_pxe booting is getting failed after deploying deploy_ramdisk17:45
narasimha_SV_ http://paste.openstack.org/show/584846/ getting this error in ironic-conductor which says "'sudo: no tty present and no askpass program specified"17:45
*** AJaeger has joined #openstack-kolla17:49
AJaegerinc0, sdake: I don't understand why you need special treatment for cross-project efforts. Please have a look at https://review.openstack.org/#/c/383226 and let's not force me to special case each and every project.17:52
*** daneyon has joined #openstack-kolla17:53
inc0AJaeger, well, we're still in code freeze17:53
inc0due to our release schedule and a bit of misunderstanding with release team, we still don't have stable/newton branch17:54
inc0so technically only bugs should merge now17:54
*** tonanhngo has joined #openstack-kolla17:54
AJaegerI'm not complaining about a code freeze, I'm complaining about a -2 that was quickly changed into a -1.17:54
sbezverk_kfox1111: I see, good catch17:55
inc0pbourke, ^17:55
inc0AJaeger, looking at time it seems to be misclick:)17:55
inc0but I'll let Paul confirm17:56
AJaeger-2 was a misclick, still I don't agree with the -1 and the message for such a cross-project effort.17:56
*** tonanhngo has quit IRC17:57
*** daneyon has quit IRC17:57
inc0AJaeger, well, normally we require these tags, call it a standard:) please, talk to pbourke when he's around (he's in Europe so might be a bit late for him) and discuss17:59
inc0either way, code freeze..18:00
inc0for a little less than a week18:00
AJaegerI understand code freeze, still would appreciate a policy change here - for such kind of changes.18:01
*** Pavo has quit IRC18:01
AJaegerinc0, and that's why I'm addressing the PTL and not pbourke.18:03
otavioI am seeing the bug https://bugs.launchpad.net/kolla/+bug/1630425; looking at the docker instance it does not include the binary so it seems centos package is wrong. No?'18:03
openstackLaunchpad bug 1630425 in kolla "swift_object_expirer container keeps restarting" [Undecided,New]18:03
inc0AJaeger, I'd just ask you to add simple TrivialFix to commit message - this is our way to avoid need to add 100 bugs for one liners18:04
*** rodrigo_pereira has joined #openstack-kolla18:04
*** rodrigo_pereira has quit IRC18:05
AJaegerinc0, sorry, this is not a cross-project policy. If a horizontal team does a change cross-project, I don't think it scales if every project has some specific rules that need to apply. This change follows the overall rules we have for changes cross-project.18:06
inc0AJaeger, ok, let's do this, I'll publish comment that I back you up with this. I don't overrule our core team. That being said Paul is reasonable guy, I'm sure we can work this through.18:08
*** Narayan has joined #openstack-kolla18:08
AJaegerthanks, inc0 - please discuss it with the team.18:08
AJaegerI'm just asking that you adopt your policy for such horizontal cross-project changes.18:09
AJaegerLet's conitnue next week if necessary18:09
inc0cool, thank you18:09
*** rodrigo_pereira has joined #openstack-kolla18:09
NarayanHi I am trying to use template override to add a new plugin. is there anyway to set template-override in kolla-build.conf file18:10
inc0I really think that was simple omission:)18:10
inc0Narayan, yes, you can specify this option in kolla-build18:10
Narayanhow to specify it18:10
*** sdake has joined #openstack-kolla18:11
otaviorodrigo_pereira: the bug we are seeing is here: https://bugs.launchpad.net/kolla/+bug/163042518:11
openstackLaunchpad bug 1630425 in kolla "swift_object_expirer container keeps restarting" [Undecided,New]18:11
inc0template_override: "your/file" afair18:11
inc0Narayan, ^18:12
sdakeotavio and i'm not sure when the next z stream will be18:12
sdakeotavio i suspect after summmit18:12
sdakeotavio core team at capacity atm18:12
Narayando I have to mention it in the newly added plugin section in kolla-build.conf18:12
Narayanfile18:12
Narayani did not find any example for this approach18:13
otaviosdake: no problem; rodrigo_pereira and I are looking at fixing our issues now. We have the bug above and also a failure in rabbidmq18:13
inc0no, it goes to default section18:13
otaviosdake: bug/163042518:13
*** awiddersheim has joined #openstack-kolla18:13
Narayando we have any example available for it.18:13
awiddersheimneed some cinder help with NFS18:13
awiddersheimlooking at this18:14
awiddersheimhttps://review.openstack.org/#/c/283290/18:14
awiddersheimbut not sure when cinder-rpcbind18:14
Narayanbut my template-override is only for Neutron plugin18:14
awiddersheimactually gets deployed18:14
*** jheroux has quit IRC18:14
Narayani want to use this template-override only to build neutron-server image18:14
inc0Narayan, so overrides are usually image specific18:15
inc0which means instead of having override file per container/project18:15
Narayansuppose i have two override files18:15
Narayanthen how to specify that18:16
inc0not supported yet :(18:16
inc0in newton you'll need to merge it18:16
inc0on the bright note merging should be super easy18:16
Narayanlet us say i have template override for keystone and newtron18:16
inc0just put contents of both into same file18:17
inc0since override blocks/packages are unique across project18:17
*** tonanhngo has joined #openstack-kolla18:17
Narayanyou mean based on values like "{% block neutron_server_footer %}" it will decide to which image it has to apply that change?18:18
*** tonanhngo has quit IRC18:18
Narayanif that is the case then one file is good enough18:18
inc0yeah18:18
inc0if you look at code there will be only and only one block with key neutron_server_footer18:19
Narayanok got it, thanks a lot18:19
*** Pavo has joined #openstack-kolla18:21
inc0any time18:21
*** ssurana has quit IRC18:21
*** strigazi is now known as strigazi_AFK18:23
MarMatHi there, is anybody deploying magnum?18:25
*** eaguilar has joined #openstack-kolla18:29
*** Pavo has quit IRC18:32
*** jtriley has joined #openstack-kolla18:32
*** ssurana has joined #openstack-kolla18:33
*** diogogmt has quit IRC18:36
g3ekhello all, I have a question on "container_name".json file in template directory. How can I move all files ending by the same thing to the same directory keeping the same name? Exemple : { "source": "{{ container_config_directory }}/*.pem", "dest": "/etc/ssl/private/", "owner": "nginx", "perm": "0600" }  => Taking all *.pem file from the template directory and move them to /etc/ssl/private/18:40
*** Marcellin__ has joined #openstack-kolla18:40
openstackgerritOtavio Salvador proposed openstack/kolla: ansible: swift: Fix swift-object-expirer restart loop  https://review.openstack.org/38386518:45
sdakeneed merge pls: https://review.openstack.org/#/c/383546/18:47
sdakeinc0 ^18:47
sdakepbourke ^18:47
*** openstackgerrit has quit IRC18:50
*** openstackgerrit has joined #openstack-kolla18:50
*** jascott1 has quit IRC18:50
*** manjeets has quit IRC18:50
sbezverk_sdake: just cherrypicked your PS and it fixed my problem18:51
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104118:51
*** Serlex has quit IRC18:56
*** eaguilar has quit IRC18:56
*** absubram has quit IRC18:56
*** david-lyle has quit IRC18:56
*** g3ek has quit IRC18:56
*** logan- has quit IRC18:57
*** afranc has quit IRC18:57
*** jrich523 has quit IRC18:57
*** brad[] has quit IRC18:57
*** yee379 has quit IRC18:57
*** dgonzalez has quit IRC18:57
*** mag009 has quit IRC18:57
*** cloudnull has quit IRC18:57
*** lukl has quit IRC18:57
*** sgordon has quit IRC18:57
*** gmmaha has quit IRC18:57
*** tonyb has quit IRC18:57
*** dgonzalez has joined #openstack-kolla18:57
*** cloudnull has joined #openstack-kolla18:57
*** mag009 has joined #openstack-kolla18:57
*** afranc has joined #openstack-kolla18:57
*** yee379 has joined #openstack-kolla18:57
*** g3ek has joined #openstack-kolla18:57
*** sgordon has joined #openstack-kolla18:57
*** lukl has joined #openstack-kolla18:57
*** tonyb has joined #openstack-kolla18:57
*** absubram has joined #openstack-kolla18:57
*** david-lyle has joined #openstack-kolla18:57
*** eaguilar has joined #openstack-kolla18:57
*** gmmaha has joined #openstack-kolla18:57
*** logan- has joined #openstack-kolla18:57
*** brad[] has joined #openstack-kolla18:57
*** jrich523 has joined #openstack-kolla18:58
*** DuncanT has quit IRC19:00
*** dave-mccowan has quit IRC19:02
*** DuncanT has joined #openstack-kolla19:05
*** Pavo has joined #openstack-kolla19:06
openstackgerritRyan Hallisey proposed openstack/kolla: Allow cinder-volume to be configured to use nfs  https://review.openstack.org/27991319:07
rhalliseyawiddersheim, ^19:07
rhalliseysee if that works19:07
openstackgerritRyan Hallisey proposed openstack/kolla: Allow cinder-volume to be configured to use nfs  https://review.openstack.org/27991319:07
*** dwalsh has quit IRC19:08
*** pbourke has quit IRC19:08
*** smekel_ has quit IRC19:08
*** britthouser has quit IRC19:08
*** HyperJohnGraham_ has quit IRC19:09
*** sbezverk_ has quit IRC19:09
*** jroll has quit IRC19:09
*** slagle has quit IRC19:09
*** slagle has joined #openstack-kolla19:09
*** slagle has quit IRC19:09
*** slagle has joined #openstack-kolla19:09
*** britthouser has joined #openstack-kolla19:09
*** sbezverk has joined #openstack-kolla19:09
*** HyperJohnGraham has joined #openstack-kolla19:09
*** pbourke has joined #openstack-kolla19:09
*** dwalsh has joined #openstack-kolla19:09
*** jroll has joined #openstack-kolla19:10
*** Narayan has quit IRC19:10
*** msimonin has joined #openstack-kolla19:11
*** serverascode has quit IRC19:12
imcsk8hello, i'm getting this error when i do a kolla-ansible pull: https://paste.fedoraproject.org/445753/75867477/19:13
imcsk8i've successfully built all the images but i can't find: centos-source-kolla-toolbox19:15
rhalliseyimcsk8, looks like you have a local registry19:15
rhalliseyis that right?19:15
imcsk8yeah19:15
rhalliseydid you push that image to that registry19:15
rhalliseymy guess is that image:3.0.0 doesn't exist there19:15
rhalliseyif you do a `docker images`19:16
*** smekel_ has joined #openstack-kolla19:16
rhalliseyyou should see cloud3.soho:4000/kolla/centos-source-kolla-toolbox:3.0.019:16
*** serverascode has joined #openstack-kolla19:17
*** msimonin has quit IRC19:18
*** openstackgerrit has quit IRC19:18
*** ssurana has quit IRC19:18
*** MarMat has quit IRC19:18
*** ccesario has quit IRC19:18
*** inc0 has quit IRC19:19
*** lamt has quit IRC19:19
*** mkoderer has quit IRC19:19
*** nihilifer has quit IRC19:19
*** kong has quit IRC19:19
*** mgkwill has quit IRC19:19
*** SaMnCo has quit IRC19:19
*** akwasnie has quit IRC19:19
*** SamYaple has quit IRC19:19
*** dims has quit IRC19:19
*** ntpttr has quit IRC19:19
*** quasar has quit IRC19:19
*** jrist has quit IRC19:19
*** bjolo has quit IRC19:19
*** nick-ma has quit IRC19:19
*** cj has quit IRC19:19
*** harbie has quit IRC19:19
*** harmw has quit IRC19:19
*** SamYaple has joined #openstack-kolla19:19
*** ntpttr has joined #openstack-kolla19:19
*** quasar has joined #openstack-kolla19:19
*** cj has joined #openstack-kolla19:19
*** MarMat has joined #openstack-kolla19:19
*** ssurana has joined #openstack-kolla19:19
*** dims has joined #openstack-kolla19:19
*** harmw has joined #openstack-kolla19:19
*** bjolo has joined #openstack-kolla19:19
*** inc0 has joined #openstack-kolla19:19
imcsk8rhallisey: i did, it does not exist19:19
*** jrist has joined #openstack-kolla19:19
*** ccesario has joined #openstack-kolla19:19
*** nihilifer has joined #openstack-kolla19:19
*** harbie has joined #openstack-kolla19:19
imcsk8but it does not get built when i do kolla-build centos-source-kolla-toolbox19:19
rhalliseyimcsk8, ok you need to push that an image to that registry19:19
*** openstackgerrit has joined #openstack-kolla19:19
rhalliseyimcsk8, you want the image name to be when you build it "cloud3.soho:4000/kolla/centos-source-kolla-toolbox"19:20
rhalliseythen follow it with the --push flag19:20
imcsk8rhallisey: the weird part is that it does not appear when i do docker images19:20
kfox1111yay. finally was able to extract some openstack logs: http://logs.openstack.org/41/381041/87/experimental/gate-kolla-kubernetes-deploy-centos-binary-ceph-nv/b2f1c03/logs/openstack/19:21
kfox1111that too wayyyy longer then expected. :/19:21
rhalliseygj :)19:21
*** jascott1 has joined #openstack-kolla19:21
rhalliseykfox1111, you're becoming a gate expert19:22
imcsk8the problem is that i can't find the image :S19:22
kfox1111now to actually try and debug the real issue. :/19:22
rhalliseyimcsk8, ya you need to build the image with the registry as part of the name19:23
rhalliseyand puhs it19:23
rhalliseyimcsk8, try rebuilding19:23
kfox1111libvirtError: Secret not found: rbd no secret matches uuid '056504d8-d3c1-4b51-b7a4-90bb4469c7e3'19:23
kfox1111ah. now that, helps. :)19:23
*** kong has joined #openstack-kolla19:24
HyperJohnGrahamhe needs the secret sauce19:24
kfox1111indeed. :)19:25
*** nick-ma has joined #openstack-kolla19:26
*** akwasnie has joined #openstack-kolla19:26
*** mkoderer has joined #openstack-kolla19:27
*** SaMnCo has joined #openstack-kolla19:27
*** mgkwill has joined #openstack-kolla19:28
otaviosdake: rodrigo_pereira and I have found the cause of the rabbitmq failing. It was due uid changing numbers when upgrading kolla deployment ... is it being worked on?19:30
imcsk8rhallisey:  https://paste.fedoraproject.org/445755/47586864/19:31
sdakeotavio can you file a  bug and link it please19:31
*** harlowja has quit IRC19:32
*** ajafo has quit IRC19:32
*** dave-mccowan has joined #openstack-kolla19:32
kfox1111otavio: oh really?19:32
kfox1111kolla's not pinning uids?19:33
*** Marcellin__ has quit IRC19:33
*** bachp has quit IRC19:33
*** neilus has quit IRC19:33
*** haplo37_ has quit IRC19:33
*** salv-orlando has quit IRC19:33
*** bmace has quit IRC19:33
*** dmsimard has quit IRC19:33
*** mliima has quit IRC19:33
*** rhallisey has quit IRC19:33
*** kbyrne has quit IRC19:33
*** yuanying has quit IRC19:33
*** haplo37 has quit IRC19:33
*** jmccarthy has quit IRC19:33
*** amaged__ has quit IRC19:33
*** peterjenkins_ has quit IRC19:33
*** Jeffrey4l_ has quit IRC19:33
*** hogepodge has quit IRC19:33
*** karlamrhein has quit IRC19:33
*** zigo has quit IRC19:33
*** AJaeger has quit IRC19:33
*** denaitre has quit IRC19:33
*** Mech422 has quit IRC19:33
*** NobodyCam has quit IRC19:33
*** elemoine_ has quit IRC19:33
*** dcwangmit01 has quit IRC19:33
*** zigo has joined #openstack-kolla19:33
*** dmsimard has joined #openstack-kolla19:33
*** Jeffrey4l_ has joined #openstack-kolla19:33
*** bmace has joined #openstack-kolla19:33
*** mliima has joined #openstack-kolla19:33
*** Mech422 has joined #openstack-kolla19:33
*** AJaeger has joined #openstack-kolla19:33
*** zigo is now known as Guest1007919:33
*** denaitre has joined #openstack-kolla19:33
*** jmccarthy has joined #openstack-kolla19:33
*** dcwangmit01 has joined #openstack-kolla19:34
otaviokfox1111: yes; it was 996 and after docker rebuild it ends as 99519:34
*** rhallisey has joined #openstack-kolla19:34
*** salv-orlando has joined #openstack-kolla19:34
*** yuanying has joined #openstack-kolla19:34
*** neilus has joined #openstack-kolla19:34
kfox1111otavio: oh. thats a problem. :/19:35
*** awiddersheim has quit IRC19:35
*** haplo37 has joined #openstack-kolla19:35
*** DuncanT has quit IRC19:37
otaviokfox1111: sdake: rodrigo_pereira: https://bugs.launchpad.net/kolla/+bug/163150319:38
openstackLaunchpad bug 1631503 in kolla "uid is not being kept across Docker container builds" [Undecided,New]19:38
*** hogepodge has joined #openstack-kolla19:38
*** haplo37_ has joined #openstack-kolla19:38
sdakeotavio interesting19:38
sdakeotavio are you sure its the uuid19:39
sdakeuid that is19:39
kfox1111sdake: I've seen this in other system's I've built too.19:39
sdakeotavio as in, have you tried matching uidsbetween 2.0.2 and 2.0.3 and all is good?19:39
kfox1111best not to let the package system build the users/groups but do it manually before hand.19:39
otaviokfox1111: sdake: yes; we had something similar in OpenEmbedded. We ended allowing for a "table" to be reused so it is kept constant.19:40
sdakekfox1111 yup we wnated to get ot a unified uid this cycle but that didn't hapen19:40
*** kbyrne has joined #openstack-kolla19:40
kfox1111I started preallocating all the users in the base container just to be on the safe side.19:40
sdakeotavio thats a good approach - think in this case we will just hack something to work ;)19:40
sdakekfox1111 right - we should be doing that19:40
sdakeotavio my hacking together = kfox1111 's approach :)19:40
otaviosdake: if this is being worked on, no problem. It took a while to figure but seems to be the root cause of it19:41
sdakeotavio it isn't being worked on actively19:41
sdakei just confirmed the bug and marked it critical for rc219:41
otaviosdake: thx19:41
otaviosdake: I did a fix for the swift which I am not sure is right. If you can take a look please19:42
sdakeotavio here is the triaged bug: https://bugs.launchpad.net/kolla/+bug/163150319:43
openstackLaunchpad bug 1631503 in kolla mitaka "inconsistent UID in rabbitmq results in inability to upgrade" [Critical,Confirmed]19:43
sdakeotavio the idea is to preallocate ids in openstack-base image19:43
*** NobodyCam has joined #openstack-kolla19:43
sdakeotavio from there everything else is installed19:43
sdakewhere is your swift patch?19:43
otaviosdake: https://review.openstack.org/#/c/383865/19:44
*** Marcellin__ has joined #openstack-kolla19:44
*** jtriley has quit IRC19:46
*** amaged__ has joined #openstack-kolla19:46
*** DuncanT has joined #openstack-kolla19:46
*** schwicht has quit IRC19:47
*** fguillot has quit IRC19:47
*** imcsk8 has quit IRC19:47
*** mdnadeem_ has quit IRC19:47
*** flaper87 has quit IRC19:47
*** robcresswell has quit IRC19:47
*** cu5 has quit IRC19:47
*** mandre has quit IRC19:47
*** akscram1 has quit IRC19:47
*** apuimedo has quit IRC19:48
*** timss has quit IRC19:48
*** ajpower has quit IRC19:48
*** igordcard has quit IRC19:48
*** Daviey has quit IRC19:48
*** wznoinsk has quit IRC19:48
*** esmiurium has quit IRC19:48
*** EmilienM has quit IRC19:48
*** robcresswell has joined #openstack-kolla19:48
*** imcsk8 has joined #openstack-kolla19:48
*** mandre has joined #openstack-kolla19:48
*** igordcard has joined #openstack-kolla19:48
*** mdnadeem_ has joined #openstack-kolla19:48
*** timss has joined #openstack-kolla19:48
*** Daviey has joined #openstack-kolla19:48
sdakeotavio ok - all set19:48
sdakeDaviey you about?19:48
*** cu5 has joined #openstack-kolla19:48
*** wznoinsk has joined #openstack-kolla19:48
*** akscram1 has joined #openstack-kolla19:48
*** apuimedo has joined #openstack-kolla19:48
*** peterjenkins_ has joined #openstack-kolla19:48
*** schwicht has joined #openstack-kolla19:49
*** esmiurium has joined #openstack-kolla19:49
*** EmilienM has joined #openstack-kolla19:50
*** nick-ma has quit IRC19:50
*** bachp has joined #openstack-kolla19:50
*** serverascode has quit IRC19:51
*** ppalacios has joined #openstack-kolla19:51
*** karlamrhein has joined #openstack-kolla19:53
*** dwalsh has quit IRC19:53
*** ajpower has joined #openstack-kolla19:53
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104119:53
kfox1111could this be the one? :)19:54
*** matrohon has joined #openstack-kolla19:54
kfox111188th time's the charm? :)19:54
otaviosdake: I understood your idea but wouldn't be better to fix the rpm instead? the object rpm should provide the expirer no?19:55
*** qbjolof1 has quit IRC19:56
*** PyroMani has quit IRC19:56
*** Kdecherf has quit IRC19:56
*** zeus has quit IRC19:56
*** Guest66676 has quit IRC19:56
*** jgriffith has quit IRC19:56
*** dotplus has quit IRC19:56
*** dotplus has joined #openstack-kolla19:56
*** dotplus has joined #openstack-kolla19:56
*** zeus has joined #openstack-kolla19:56
*** jgriffith has joined #openstack-kolla19:56
*** qbjolof1 has joined #openstack-kolla19:56
*** Guest66666 has joined #openstack-kolla19:56
*** zeus is now known as Guest9163919:57
*** Guest91639 is now known as zeus`19:57
*** zeus` is now known as zeus19:58
*** zeus has quit IRC19:58
*** zeus has joined #openstack-kolla19:58
*** Kdecherf has joined #openstack-kolla19:59
*** PyroMani has joined #openstack-kolla19:59
*** DuncanT has quit IRC19:59
*** mliima has quit IRC20:01
*** serverascode has joined #openstack-kolla20:02
openstackgerritOtavio Salvador proposed openstack/kolla: ansible: swift: Fix swift-object-expirer restart loop  https://review.openstack.org/38386520:04
sbezverkkfox1111: it is nice to see somebody is having fun ;-)20:05
kfox1111:)20:05
*** haplo37 has quit IRC20:05
*** haplo37_ is now known as haplo3720:05
kfox1111today, I'm trying to keep all the wildfires that are happening at least somewhat contained. :/20:05
kfox1111been a truelly crazy week.20:06
*** DuncanT has joined #openstack-kolla20:07
sdakeotavio not quite right but closer20:07
sdakeinc0 you about?20:07
sdakewhere is core team!!20:07
otaviosdake: I could bet ;-)20:07
otaviosdake: what is wrong? the learning process is hard :-)20:07
*** haplo37_ has joined #openstack-kolla20:07
sdakeotavio look at other images with that name20:08
otaviosdake: I did20:08
sdakesee how they have the docker stuff in them20:08
sdakeetc20:08
*** openstack has joined #openstack-kolla20:19
openstackgerritOtavio Salvador proposed openstack/kolla: ansible: swift: Fix swift-object-expirer restart loop  https://review.openstack.org/38386520:21
otaviosdake: I did it now20:21
*** hyakuhei- has joined #openstack-kolla20:21
*** kklimonda has joined #openstack-kolla20:21
*** Guest89847 has quit IRC20:22
*** dasm has quit IRC20:22
*** cinerama has quit IRC20:22
*** hyakuhei has quit IRC20:22
*** strigazi_AFK has quit IRC20:22
*** irtermite has quit IRC20:22
*** mewald has quit IRC20:22
*** kklimonda is now known as Guest3760520:22
*** cinerama has joined #openstack-kolla20:22
*** strigazi1AFK has joined #openstack-kolla20:22
*** fguillot has joined #openstack-kolla20:22
*** dasm has joined #openstack-kolla20:22
imcsk8rhallisey: good idea, thanks!20:23
*** irtermite has joined #openstack-kolla20:23
imcsk8rhallisey: check this out: https://paste.fedoraproject.org/445771/75871957/20:26
rhalliseyimcsk8, did that build?20:27
*** harlowja has joined #openstack-kolla20:30
*** serverascode has quit IRC20:30
*** serverascode has joined #openstack-kolla20:30
*** psanchez has quit IRC20:31
*** psanchez has joined #openstack-kolla20:31
*** DuncanT has quit IRC20:31
*** DuncanT has joined #openstack-kolla20:31
*** hyakuhei- has quit IRC20:31
*** hyakuhei- has joined #openstack-kolla20:31
sdakerhallisey ack this plz: https://review.openstack.org/#/c/383546/20:32
*** PyroMani has quit IRC20:33
*** imcsk8 has quit IRC20:33
*** ppalacios has quit IRC20:33
*** bmace has quit IRC20:33
*** Jeffrey4l_ has quit IRC20:33
*** dmsimard has quit IRC20:33
*** ccesario has quit IRC20:33
*** ntpttr has quit IRC20:33
*** jrich523 has quit IRC20:33
*** gmmaha has quit IRC20:33
*** lukl has quit IRC20:33
*** g3ek has quit IRC20:33
*** brad[] has quit IRC20:33
*** matrohon has quit IRC20:33
*** bachp has quit IRC20:33
*** schwicht has quit IRC20:33
*** apuimedo has quit IRC20:33
*** Daviey has quit IRC20:33
*** mandre has quit IRC20:33
*** hogepodge has quit IRC20:33
*** salv-orlando has quit IRC20:33
*** yuanying has quit IRC20:33
*** Guest10079 has quit IRC20:33
*** akwasnie has quit IRC20:33
*** slagle has quit IRC20:33
*** sgordon has quit IRC20:33
*** bradjones has quit IRC20:33
*** clayton has quit IRC20:33
*** otavio has quit IRC20:33
*** dave-mccowan has quit IRC20:33
*** MarMat has quit IRC20:33
*** ssurana has quit IRC20:33
*** jrist has quit IRC20:33
*** SamYaple has quit IRC20:33
*** logan- has quit IRC20:33
*** eaguilar has quit IRC20:33
*** absubram has quit IRC20:33
*** mag009 has quit IRC20:33
*** msimonin has quit IRC20:33
*** kfox1111_ has quit IRC20:33
*** Kdecherf has quit IRC20:33
*** zeus has quit IRC20:33
*** ajpower has quit IRC20:33
*** akscram1 has quit IRC20:33
*** timss has quit IRC20:33
*** igordcard has quit IRC20:33
*** amaged__ has quit IRC20:33
*** dcwangmit01 has quit IRC20:33
*** jascott1 has quit IRC20:33
*** pbourke has quit IRC20:33
*** britthouser has quit IRC20:33
*** yee379 has quit IRC20:33
*** dmsimard has joined #openstack-kolla20:34
*** DuncanT has quit IRC20:35
*** NachoDuck has quit IRC20:37
*** karlamrhein has quit IRC20:37
*** lrensing has quit IRC20:37
*** serverascode has quit IRC20:37
*** bradjones has joined #openstack-kolla20:38
*** clayton has joined #openstack-kolla20:38
*** otavio has joined #openstack-kolla20:38
*** dave-mccowan has joined #openstack-kolla20:38
*** jrist has joined #openstack-kolla20:38
*** ssurana has joined #openstack-kolla20:38
*** MarMat has joined #openstack-kolla20:38
*** SamYaple has joined #openstack-kolla20:38
*** logan- has joined #openstack-kolla20:38
*** eaguilar has joined #openstack-kolla20:38
*** absubram has joined #openstack-kolla20:38
*** mag009 has joined #openstack-kolla20:38
*** tonanhngo has joined #openstack-kolla20:39
*** matrohon has joined #openstack-kolla20:39
*** bachp has joined #openstack-kolla20:39
*** schwicht has joined #openstack-kolla20:39
*** apuimedo has joined #openstack-kolla20:39
*** Daviey has joined #openstack-kolla20:39
*** mandre has joined #openstack-kolla20:39
*** hogepodge has joined #openstack-kolla20:39
*** yuanying has joined #openstack-kolla20:39
*** salv-orlando has joined #openstack-kolla20:39
*** Guest10079 has joined #openstack-kolla20:39
*** akwasnie has joined #openstack-kolla20:39
*** slagle has joined #openstack-kolla20:39
*** sgordon has joined #openstack-kolla20:39
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP fencing pod  https://review.openstack.org/38392220:39
*** PyroMani has joined #openstack-kolla20:39
*** ppalacios has joined #openstack-kolla20:39
*** imcsk8 has joined #openstack-kolla20:39
*** bmace has joined #openstack-kolla20:39
*** Jeffrey4l_ has joined #openstack-kolla20:39
*** ccesario has joined #openstack-kolla20:39
*** ntpttr has joined #openstack-kolla20:39
*** jrich523 has joined #openstack-kolla20:39
*** brad[] has joined #openstack-kolla20:39
*** gmmaha has joined #openstack-kolla20:39
*** lukl has joined #openstack-kolla20:39
*** g3ek has joined #openstack-kolla20:39
*** tonanhngo has quit IRC20:39
*** msimonin has joined #openstack-kolla20:39
*** kfox1111_ has joined #openstack-kolla20:39
*** Kdecherf has joined #openstack-kolla20:39
*** zeus has joined #openstack-kolla20:39
*** ajpower has joined #openstack-kolla20:39
*** akscram1 has joined #openstack-kolla20:39
*** timss has joined #openstack-kolla20:39
*** igordcard has joined #openstack-kolla20:39
*** dcwangmit01 has joined #openstack-kolla20:39
*** jascott1 has joined #openstack-kolla20:39
*** pbourke has joined #openstack-kolla20:39
*** britthouser has joined #openstack-kolla20:39
*** yee379 has joined #openstack-kolla20:39
*** britthouser3 has joined #openstack-kolla20:40
*** britthouser has quit IRC20:40
*** fguillot has quit IRC20:41
sdakeotavio more feedback in that review20:42
sdakeotavio rather then create a new review, could you in the future reuse the old review you had20:42
sdakeand can you abandon the extra review you have open20:42
*** salv-orl_ has joined #openstack-kolla20:43
*** mewald has joined #openstack-kolla20:43
*** Jeffrey4l_ has quit IRC20:43
*** ediardo has quit IRC20:43
otaviosdake: I can do, for sure. But what I did wrong?20:45
*** eaguilar has quit IRC20:45
otaviosdake: I used 'git review' to submit it. Is that wrong?20:45
*** salv-orlando has quit IRC20:46
sdakeotavio nm - i was looking at an old review20:46
sdakeotavio the patch is wrong but you did the workflow correctly my bad20:46
otaviosdake: np. I am having a hard time to understand how to proper fix it. What you describe seems like my 1st patch which uses the proxy-server image.20:47
*** NachoDuck has joined #openstack-kolla20:48
*** schwicht has quit IRC20:48
sdakeotavio try adding swift-proxy-expirer to list of packages in the docker file20:48
sdakeand test that20:48
*** Jeffrey4l_ has joined #openstack-kolla20:48
sdakeotavio or figure out what the package is actually called20:48
sdakeyo Jeffrey4l_20:48
*** DuncanT has joined #openstack-kolla20:49
otaviosdake: https://www.rpmfind.net/linux/rpm2html/search.php?query=swift-object-expirer&submit=Search+20:49
*** narasimha_SV_ has quit IRC20:50
*** mduggan has quit IRC20:50
otaviosdake: so it is indeed on proxy; for me, the packaging is wrong.20:50
sbezverkotavio:  why this rpm is not part of rdo distribution?20:50
sdakeotavio we use rdo not rpmfind ;)20:51
sbezverkusually all openstack related rpm are sitting nicely in a repo20:51
*** amaged__ has joined #openstack-kolla20:51
*** karlamrhein has joined #openstack-kolla20:53
*** serverascode has joined #openstack-kolla20:54
otaviosbezverk: and there is no swift-proxy-expirer :-)20:54
*** neilus has quit IRC20:54
otaviosbezverk: http://mirror.centos.org/centos/7/cloud/x86_64/openstack-newton/; it has all packages it seems :-)20:54
sdakesbezverk can you run yum provides swift-proxy-expirer from your rdo steup20:55
sdakei am not connectedt o my machines atm20:55
otaviosdake: openstack-swift-proxy, is my bet.20:56
otaviosdake: swift-object-expirer (not proxy)20:57
kfox1111_oh... I wonder....20:58
sbezverksdake: it is failing20:59
*** ediardo has joined #openstack-kolla20:59
otaviosbezverk: now checko for swift-object-expirer please.20:59
*** tonanhngo has joined #openstack-kolla20:59
*** tonanhngo has quit IRC21:00
sbezverkotavio: openstack-swift-proxy works, but swift-object-expirer does not21:01
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: External Ceph Tools and Docs  https://review.openstack.org/38104121:01
otaviosbezverk: The openstack-swift-proxy fixed the error we had. It looks for the swift-object-expirer binary which is not on openstack-swift-object (which would be expected)21:02
sbezverkotavio: got it, so swift-object-expirer is actually a binary which yu suspct is missing, right?21:03
otaviosbezverk: YES! hehehe21:03
sbezverkotavio: if it is the case then it has to be addressed by who ever packages rpm, not by kolla21:04
otaviosbezverk: This was my initial thought as well; where I can report the error?21:04
openstackgerritMerged openstack/kolla: Move RDO to Newton branches  https://review.openstack.org/38354621:05
sbezverkotavio: you are right, I just cloned swift from github and ./swift/bin/swift-object-expirer is there, so rpm is definetly missing it21:06
otaviosbezverk: the packaging is wrong. It was include on openstack-swift-proxy RPM21:07
sbezverksdake: please correct if I am wrong but this should be addressed by rdo people, right?21:08
sdakeyum provides...21:09
sdakeso what your syaing is this expirer tool is in swift-proxy rpm?21:09
sdakeotavio sbezverk follow me to #rdo pls21:09
*** matrohon has quit IRC21:10
*** david-lyle has quit IRC21:12
*** david-lyle has joined #openstack-kolla21:12
*** tonanhngo has joined #openstack-kolla21:15
*** Jeffrey4l_ has quit IRC21:16
*** tonanhngo has quit IRC21:16
sdakewhy does everyone want bios!!21:19
sdakesomeone needs to invent "BIO's as a service"21:19
sdake1 week project21:19
sdakeenjoy :)21:19
*** schwicht has joined #openstack-kolla21:19
sdakemuch like gravatar21:20
*** neilus has joined #openstack-kolla21:26
*** msimonin1 has joined #openstack-kolla21:27
sdakeotavio do you have a clear course of action?21:28
*** msimonin has quit IRC21:29
*** daneyon has joined #openstack-kolla21:29
*** neilus has quit IRC21:31
*** schwicht has quit IRC21:31
*** daneyon has quit IRC21:33
*** mewald has quit IRC21:34
*** tonanhngo has joined #openstack-kolla21:37
*** tonanhngo has quit IRC21:39
*** Pavo has quit IRC21:41
*** Pavo has joined #openstack-kolla21:42
*** dave-mccowan has quit IRC21:42
*** Marcellin__ has quit IRC21:47
*** ajafo has joined #openstack-kolla21:53
*** tonanhngo has joined #openstack-kolla21:53
*** tonanhngo has quit IRC21:55
*** ppalacios has quit IRC21:59
*** rodrigo_pereira has quit IRC21:59
*** devananda|afk has joined #openstack-kolla22:05
*** msimonin1 has quit IRC22:08
sdakeok folks 7th today - 5 more days until release22:10
sdakelets get er done!22:10
sdakerather until our hopefully final tag22:10
*** Pavo has quit IRC22:11
*** msimonin has joined #openstack-kolla22:11
*** Pavo has joined #openstack-kolla22:15
*** dwalsh has joined #openstack-kolla22:20
*** msimonin has quit IRC22:24
*** absubram has quit IRC22:24
*** tonanhngo has joined #openstack-kolla22:28
*** tonanhngo has quit IRC22:30
*** berendt has joined #openstack-kolla22:31
*** nick-ma has joined #openstack-kolla22:42
*** elemoine_ has joined #openstack-kolla22:43
*** schwicht has joined #openstack-kolla22:43
*** berendt has quit IRC22:44
*** sdake has quit IRC22:46
*** schwicht has quit IRC22:48
*** schwicht has joined #openstack-kolla22:49
*** salv-orl_ has quit IRC22:49
*** ssurana has quit IRC22:51
*** schwicht has quit IRC22:53
*** rhallisey has quit IRC22:53
*** tonanhngo has joined #openstack-kolla22:55
*** tonanhngo has quit IRC22:57
*** elemoine_ has quit IRC22:59
*** nick-ma has quit IRC22:59
*** dwalsh has quit IRC23:00
*** neilus has joined #openstack-kolla23:15
*** inc0 has quit IRC23:16
*** neilus has quit IRC23:19
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP fencing pod  https://review.openstack.org/38392223:24
*** Pavo has quit IRC23:33
*** jtriley has joined #openstack-kolla23:33
*** lamt has joined #openstack-kolla23:34
*** awiddersheim has joined #openstack-kolla23:36
*** Pavo has joined #openstack-kolla23:39
*** zhurong has joined #openstack-kolla23:44
*** tonanhngo has joined #openstack-kolla23:47
*** tonanhngo has quit IRC23:48
*** zhurong has quit IRC23:54
kfox1111_arg... so close, and so far...23:57
kfox1111_centos seems to only fail on finding the libvirt ceph keyring.23:57
kfox1111_ubuntu seems to have an issue with finding its ip maybe...23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!