| klindgren | uuid tokens | 00:00 |
|---|---|---|
| kfox1111 | fernet's much better. | 00:00 |
| inc0 | klindgren: maybe try uwsgi? | 00:00 |
| kfox1111 | I had scaling issues with uuid until I upgraded to fernet. | 00:00 |
| inc0 | we should be able to switch if that helps | 00:00 |
| klindgren | uuid and fernet basically still have the same method of action? | 00:00 |
| kfox1111 | one avoids the db almost entirely. | 00:01 |
| klindgren | IE each token still needs validated on the keystone side for validity | 00:01 |
| inc0 | kfox1111: but that would be agnostic to http server | 00:01 |
| kfox1111 | yeah. but doesn't have multiple mysql lookups in the process. :/ | 00:01 |
| kfox1111 | inc0: yeah, but I don't thikn they test uuid with apache much anymore. | 00:01 |
| klindgren | eitherway - we are dealing with 10 tokens max in this case | 00:01 |
| inc0 | that'd be sad | 00:02 |
| kfox1111 | 10 live tokens, or 10 total tokens? | 00:02 |
| inc0 | clarkb: do you know what devstack is using? | 00:02 |
| klindgren | its totaly empty cloud with nothing running against it. | 00:02 |
| kfox1111 | lots of expired uuid tokens can cause problems | 00:02 |
| clarkb | inc0: apache + mod wsgi + fernet by default I think | 00:02 |
| clarkb | its definitely apache | 00:02 |
| clarkb | fairly certain about the other two | 00:03 |
| klindgren | the only thing that has ever been done on this cloud was to spin up 12 vm's. and upload 1 image, and create a few networks. | 00:03 |
| kfox1111 | yeah. keystone focues on apache only, as they don't want to have to recreate all of apache's auth plugins. | 00:03 |
| kfox1111 | weird. | 00:03 |
| *** absubram has joined #openstack-kolla | 00:03 | |
| kfox1111 | in that case, it seems very bad. | 00:04 |
| *** genek has joined #openstack-kolla | 00:04 | |
| klindgren | its possible that the issue is that its so new without any activity | 00:04 |
| klindgren | let me run a bunch of requests through it | 00:04 |
| klindgren | maybe each hit, is causing a new python context spunup under each api server | 00:04 |
| kfox1111 | I'd expect the first few calls maybe to be kind of slow while it compiles stuff. but should't after that. | 00:04 |
| kfox1111 | yeah. could be. | 00:04 |
| klindgren | and it will go away once everything is up and has servered a number of requests | 00:05 |
| inc0 | klindgren: maybe bump up threads? | 00:05 |
| kfox1111 | yeah. give that atry and if it still performs slow, drop by the keystone channel. they are usually quite helpful. | 00:06 |
| kfox1111 | they dont really support running it outside of apache, so if it is performing bad there, they will probably help debug in apache mode. | 00:06 |
| klindgren | kolla ansible is still using threads=1 right? | 00:06 |
| klindgren | (looking at the master template, it only seems to adjust wprocesses) | 00:07 |
| kfox1111 | sounds about right. | 00:07 |
| inc0 | processes={{ openstack_service_workers }} | 00:07 |
| inc0 | which defaults to amount of processors | 00:08 |
| *** genek has quit IRC | 00:08 | |
| *** kbaegis has quit IRC | 00:21 | |
| *** genek has joined #openstack-kolla | 00:28 | |
| *** yangyapeng has quit IRC | 00:28 | |
| *** yangyapeng has joined #openstack-kolla | 00:29 | |
| *** salv-orl_ has quit IRC | 00:29 | |
| *** jascott1 has quit IRC | 00:31 | |
| *** genek has quit IRC | 00:32 | |
| *** openstackgerrit has quit IRC | 00:33 | |
| *** yangyapeng has quit IRC | 00:33 | |
| *** goldyfruit has quit IRC | 00:34 | |
| *** zhurong has joined #openstack-kolla | 00:37 | |
| *** tovin07_ has joined #openstack-kolla | 00:42 | |
| *** jascott1 has joined #openstack-kolla | 00:42 | |
| *** kbaegis has joined #openstack-kolla | 00:45 | |
| *** masuberu has quit IRC | 00:59 | |
| *** kiennt26 has joined #openstack-kolla | 01:02 | |
| *** caowei has joined #openstack-kolla | 01:05 | |
| *** duonghq has joined #openstack-kolla | 01:05 | |
| *** genek has joined #openstack-kolla | 01:07 | |
| *** genek has quit IRC | 01:11 | |
| *** absubram has quit IRC | 01:13 | |
| *** yangyapeng has joined #openstack-kolla | 01:15 | |
| *** goldyfruit has joined #openstack-kolla | 01:16 | |
| *** genek has joined #openstack-kolla | 01:16 | |
| *** liangqi has joined #openstack-kolla | 01:19 | |
| *** absubram has joined #openstack-kolla | 01:19 | |
| *** genek has quit IRC | 01:21 | |
| *** zhangfei has joined #openstack-kolla | 01:28 | |
| *** salv-orlando has joined #openstack-kolla | 01:30 | |
| *** salv-orlando has quit IRC | 01:35 | |
| *** dardelea_ has joined #openstack-kolla | 01:39 | |
| *** dardelea_ has quit IRC | 01:44 | |
| *** dardelea_ has joined #openstack-kolla | 01:52 | |
| *** absubram has quit IRC | 01:56 | |
| *** absubram has joined #openstack-kolla | 02:09 | |
| duonghq | morning guys | 02:11 |
| *** genek has joined #openstack-kolla | 02:18 | |
| *** openstackgerrit has joined #openstack-kolla | 02:19 | |
| openstackgerrit | Xinliang Liu proposed openstack/kolla-ansible master: Make qemu use nova user on all distros https://review.openstack.org/525891 | 02:19 |
| *** zhurong has quit IRC | 02:23 | |
| *** genek has quit IRC | 02:23 | |
| *** absubram has quit IRC | 02:26 | |
| *** masber has joined #openstack-kolla | 02:27 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla stable/ocata: Use separate publish jobs in periodic pipeline https://review.openstack.org/527563 | 02:29 |
| *** dardelea_ has quit IRC | 02:29 | |
| *** zhangfei has quit IRC | 02:29 | |
| *** kiennt26 has quit IRC | 02:29 | |
| *** mdnadeem has quit IRC | 02:32 | |
| *** zhurong has joined #openstack-kolla | 02:35 | |
| *** genek has joined #openstack-kolla | 02:41 | |
| *** zhangfei has joined #openstack-kolla | 02:45 | |
| *** genek has quit IRC | 02:46 | |
| *** absubram has joined #openstack-kolla | 02:46 | |
| *** absubram has quit IRC | 02:51 | |
| *** absubram has joined #openstack-kolla | 02:56 | |
| *** genek has joined #openstack-kolla | 02:58 | |
| *** genek has quit IRC | 03:02 | |
| *** kiennt26 has joined #openstack-kolla | 03:08 | |
| *** genek has joined #openstack-kolla | 03:31 | |
| *** absubram has quit IRC | 03:31 | |
| *** absubram has joined #openstack-kolla | 03:32 | |
| *** genek has quit IRC | 03:35 | |
| *** unicell has quit IRC | 03:37 | |
| *** genek has joined #openstack-kolla | 03:42 | |
| *** genek has quit IRC | 03:48 | |
| *** ArminderSingh has quit IRC | 03:55 | |
| *** rsjethani has joined #openstack-kolla | 03:56 | |
| *** rsjethani has quit IRC | 03:56 | |
| *** unicell has joined #openstack-kolla | 04:02 | |
| *** kbaegis has quit IRC | 04:14 | |
| *** threestrands has joined #openstack-kolla | 04:14 | |
| *** threestrands has quit IRC | 04:14 | |
| *** threestrands has joined #openstack-kolla | 04:14 | |
| *** jappleii__ has quit IRC | 04:15 | |
| *** threestrands has quit IRC | 04:15 | |
| *** threestrands has joined #openstack-kolla | 04:16 | |
| *** threestrands has quit IRC | 04:16 | |
| *** threestrands has joined #openstack-kolla | 04:16 | |
| *** openstackgerrit has quit IRC | 04:18 | |
| *** openstackgerrit has joined #openstack-kolla | 04:18 | |
| openstackgerrit | Jianghua Wang proposed openstack/kolla-ansible master: XenAPI: Add guide document for XenServer https://review.openstack.org/508677 | 04:18 |
| *** dave-mcc_ has quit IRC | 04:25 | |
| *** goldyfruit has quit IRC | 04:28 | |
| *** threestrands has quit IRC | 04:36 | |
| *** mdnadeem has joined #openstack-kolla | 04:39 | |
| *** absubram has quit IRC | 04:42 | |
| *** genek has joined #openstack-kolla | 04:42 | |
| *** threestrands has joined #openstack-kolla | 04:43 | |
| *** threestrands has quit IRC | 04:43 | |
| *** threestrands has joined #openstack-kolla | 04:43 | |
| *** threestrands has quit IRC | 04:44 | |
| *** threestrands has joined #openstack-kolla | 04:44 | |
| *** threestrands has quit IRC | 04:44 | |
| *** threestrands has joined #openstack-kolla | 04:44 | |
| *** threestrands has quit IRC | 04:45 | |
| *** threestrands has joined #openstack-kolla | 04:46 | |
| *** threestrands has quit IRC | 04:46 | |
| *** threestrands has joined #openstack-kolla | 04:46 | |
| *** threestrands has quit IRC | 04:47 | |
| *** threestrands has joined #openstack-kolla | 04:47 | |
| *** threestrands has quit IRC | 04:47 | |
| *** threestrands has joined #openstack-kolla | 04:47 | |
| *** genek has quit IRC | 04:50 | |
| *** genek has joined #openstack-kolla | 04:57 | |
| *** caowei has quit IRC | 05:01 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla stable/ocata: Use separate publish jobs in periodic pipeline https://review.openstack.org/527563 | 05:01 |
| *** genek has quit IRC | 05:12 | |
| *** skramaja has joined #openstack-kolla | 05:14 | |
| *** genek has joined #openstack-kolla | 05:17 | |
| openstackgerrit | Jianghua Wang proposed openstack/kolla-ansible master: XenAPI: Support neutron configuration https://review.openstack.org/525999 | 05:18 |
| openstackgerrit | Merged openstack/kolla-ansible master: Enable heat dashboard dynamically https://review.openstack.org/527004 | 05:18 |
| *** ArminderSingh has joined #openstack-kolla | 05:20 | |
| *** genek has quit IRC | 05:21 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/pike: Fix launch instance failed in trove https://review.openstack.org/525201 | 05:21 |
| *** caowei has joined #openstack-kolla | 05:27 | |
| *** dardelea_ has joined #openstack-kolla | 05:29 | |
| *** coolsvap has joined #openstack-kolla | 05:32 | |
| *** janki has joined #openstack-kolla | 05:32 | |
| *** dardelea_ has quit IRC | 05:34 | |
| *** rich1iu has quit IRC | 05:34 | |
| *** absubram has joined #openstack-kolla | 05:37 | |
| *** mdnadeem has quit IRC | 05:58 | |
| *** threestrands has quit IRC | 06:03 | |
| *** lpetrut has joined #openstack-kolla | 06:05 | |
| *** zhangfei has quit IRC | 06:06 | |
| *** janki has quit IRC | 06:07 | |
| *** lpetrut has quit IRC | 06:08 | |
| *** lpetrut has joined #openstack-kolla | 06:09 | |
| openstackgerrit | Jianghua Wang proposed openstack/kolla-ansible master: XenAPI: Support neutron configuration https://review.openstack.org/525999 | 06:11 |
| openstackgerrit | Jianghua Wang proposed openstack/kolla-ansible master: XenAPI: Add guide document for XenServer https://review.openstack.org/508677 | 06:11 |
| *** tovin07_ has quit IRC | 06:12 | |
| *** zhangfei has joined #openstack-kolla | 06:19 | |
| *** caowei has quit IRC | 06:22 | |
| *** salv-orlando has joined #openstack-kolla | 06:22 | |
| *** caowei_ has joined #openstack-kolla | 06:22 | |
| *** caowei_ is now known as caowei | 06:24 | |
| *** unicell has joined #openstack-kolla | 06:26 | |
| *** janki has joined #openstack-kolla | 06:26 | |
| *** heigao_1212 has quit IRC | 06:27 | |
| *** jascott1 has quit IRC | 06:30 | |
| *** zhangfei has quit IRC | 06:30 | |
| *** jascott1 has joined #openstack-kolla | 06:31 | |
| *** tovin07_ has joined #openstack-kolla | 06:33 | |
| *** mdnadeem has joined #openstack-kolla | 06:35 | |
| *** jascott1 has quit IRC | 06:35 | |
| *** jascott1 has joined #openstack-kolla | 06:38 | |
| *** Ashishkark has joined #openstack-kolla | 06:40 | |
| Ashishkark | Hi all | 06:40 |
| *** zhangfei has joined #openstack-kolla | 06:43 | |
| Ashishkark | I am trying to install multinode kolla with cinder lvm as backend.. The controller is also network and storage node and another node as computer... During deploy command cinder volume throws unit http timeout at controller... PS iscsi is only disabled at compute not at the controller(as given in documentation) .. When I disabled it at controller deploy ment works fine | 06:43 |
| Ashishkark | Is the documentation wrong and iscsi needs to be disabled at controller as well... Also a few days back it worked fine without disabled iscsi at controller | 06:44 |
| *** genek has joined #openstack-kolla | 06:48 | |
| *** lpetrut has quit IRC | 06:52 | |
| *** absubram has quit IRC | 06:52 | |
| *** unicell1 has joined #openstack-kolla | 07:14 | |
| *** Ashishkark has quit IRC | 07:14 | |
| *** unicell has quit IRC | 07:15 | |
| *** egonzalez has quit IRC | 07:21 | |
| *** unicell has joined #openstack-kolla | 07:22 | |
| *** egonzalez has joined #openstack-kolla | 07:23 | |
| *** unicell1 has quit IRC | 07:24 | |
| *** caowei has quit IRC | 07:25 | |
| *** unicell1 has joined #openstack-kolla | 07:26 | |
| *** lvdombrkr has quit IRC | 07:26 | |
| *** caowei has joined #openstack-kolla | 07:26 | |
| *** unicell has quit IRC | 07:27 | |
| *** lvdombrkr has joined #openstack-kolla | 07:27 | |
| *** rajivk_ has joined #openstack-kolla | 07:30 | |
| *** lpetrut has joined #openstack-kolla | 07:31 | |
| *** mnasiadka has joined #openstack-kolla | 07:35 | |
| *** zhubingbing__ has joined #openstack-kolla | 07:36 | |
| *** zhubingbing_ has quit IRC | 07:38 | |
| *** daidv has quit IRC | 07:41 | |
| *** duonghq has quit IRC | 07:41 | |
| *** salv-orlando has quit IRC | 07:41 | |
| *** daidv has joined #openstack-kolla | 07:41 | |
| *** duonghq has joined #openstack-kolla | 07:41 | |
| *** shardy has joined #openstack-kolla | 07:46 | |
| *** salv-orlando has joined #openstack-kolla | 07:50 | |
| *** lpetrut has quit IRC | 07:53 | |
| *** unicell has joined #openstack-kolla | 07:53 | |
| *** zhangfei has quit IRC | 07:54 | |
| *** unicell1 has quit IRC | 07:54 | |
| *** b_bezak has joined #openstack-kolla | 07:58 | |
| *** egonzalez has quit IRC | 08:04 | |
| *** zhangfei has joined #openstack-kolla | 08:07 | |
| *** mewald has joined #openstack-kolla | 08:09 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Make qemu use nova user on all distros https://review.openstack.org/525891 | 08:10 |
| mewald | I got a -1 from zuul on https://review.openstack.org/#/c/486379/ I don't understand what's happening there. The failing gate is kolla-ansible-ubuntu-binary. Could this be unrelated to my code? | 08:10 |
| *** serlex has joined #openstack-kolla | 08:12 | |
| *** lvdombrkr has quit IRC | 08:12 | |
| *** amoralej|off is now known as amoralej | 08:14 | |
| *** mgoddard has joined #openstack-kolla | 08:16 | |
| *** bmace__ has quit IRC | 08:17 | |
| *** bmace__ has joined #openstack-kolla | 08:18 | |
| *** gfidente|afk has quit IRC | 08:19 | |
| coolsvap | kolla-build-oraclelinux-source is also failing | 08:21 |
| coolsvap | http://logs.openstack.org/79/486379/13/check/kolla-build-oraclelinux-source/c4eaae7/ | 08:21 |
| coolsvap | mewald: ^^ | 08:21 |
| *** magicboiz has joined #openstack-kolla | 08:24 | |
| mewald | coolsvap: how do I know which of the errors comes from my stuff? I can see "The command '/bin/sh -c yum -y install gettext httpd mod_ssl mod_wsgi && yum clean all && rm -rf /var/cache/yum' returned a non-zero code: 1" but this is not happening in my code I think. | 08:26 |
| coolsvap | My org firewall is not allowing me to view logs otherwise I would have checked. | 08:27 |
| coolsvap | Let me see what I can do | 08:27 |
| *** rajivk_ has quit IRC | 08:28 | |
| *** codenamelxl has joined #openstack-kolla | 08:29 | |
| *** magicboiz has quit IRC | 08:29 | |
| mewald | coolsvap: https://gist.github.com/mewald1/e9fd43df09722547e6c49a3e90a28da3 | 08:31 |
| codenamelxl | Hi all, i'm currently trying to deploy an old version of kolla. Can i use the newest kolla-ansible for old openstack version or i have to use the related version? | 08:32 |
| *** jascott1 has quit IRC | 08:34 | |
| *** hw_wutianwei has joined #openstack-kolla | 08:34 | |
| *** jascott1 has joined #openstack-kolla | 08:34 | |
| *** salv-orlando has quit IRC | 08:34 | |
| *** xinliang has quit IRC | 08:35 | |
| chason | codenamelxl use the related version, pls. :) | 08:35 |
| *** magicboiz has joined #openstack-kolla | 08:36 | |
| codenamelxl | Yep, i thought so too haha :) Another question, does the upgrade work cross many version :) Say...4 :) | 08:36 |
| *** mdnadeem has quit IRC | 08:37 | |
| coolsvap | mewald: looking at the gist I dont think its related to your code. | 08:39 |
| *** jascott1 has quit IRC | 08:39 | |
| mewald | coolsvap: good :D because it builds and deploys perfectly well in my lab | 08:42 |
| mewald | how do I proceed now? | 08:42 |
| coolsvap | maybe someone from oraclelinux needs to have a look, pbourke around? to have a look at https://review.openstack.org/#/c/486379/ ? | 08:44 |
| *** daidv has quit IRC | 08:46 | |
| *** tovin07_ has quit IRC | 08:46 | |
| *** daidv has joined #openstack-kolla | 08:46 | |
| *** tovin07_ has joined #openstack-kolla | 08:46 | |
| *** mdnadeem has joined #openstack-kolla | 08:46 | |
| *** xinliang has joined #openstack-kolla | 08:47 | |
| *** xinliang has joined #openstack-kolla | 08:47 | |
| *** salv-orlando has joined #openstack-kolla | 08:52 | |
| *** yuanying has quit IRC | 08:52 | |
| *** mgoddard has quit IRC | 08:56 | |
| *** dciabrin has joined #openstack-kolla | 09:02 | |
| *** lpetrut has joined #openstack-kolla | 09:03 | |
| *** masber has quit IRC | 09:09 | |
| *** manjeets_ has quit IRC | 09:20 | |
| *** dklyle has quit IRC | 09:20 | |
| *** manjeets has joined #openstack-kolla | 09:21 | |
| *** rmart04 has joined #openstack-kolla | 09:24 | |
| mewald | Is there no Jenkins going to run for https://review.openstack.org/#/c/485150/ or is it just too busy atm? | 09:28 |
| *** rajivk_ has joined #openstack-kolla | 09:30 | |
| kolla-slack1 | <egonzalez> codenamexml, nope. Openstack does not support skip level upgrades, need to go one by one | 09:30 |
| kolla-slack1 | <egonzalez> codenamelxl ^^ | 09:31 |
| *** mgoddard has joined #openstack-kolla | 09:32 | |
| codenamelxl | Ok, great :) My road from liberty all the way up to Pike would be a pain :) One more thing, do we have any guideline to move from vanilla binary deployment to kolla? If not, what do i have to take a close eye on ? Thanks :) | 09:33 |
| *** janki has quit IRC | 09:42 | |
| *** zhangfei has quit IRC | 09:42 | |
| *** janki has joined #openstack-kolla | 09:43 | |
| *** janki has quit IRC | 09:49 | |
| *** janki has joined #openstack-kolla | 09:49 | |
| *** kiennt26 has quit IRC | 09:50 | |
| pbourke | coolsvap: morning, will do | 09:51 |
| *** dardelea_ has joined #openstack-kolla | 09:52 | |
| coolsvap | thanks pbourke | 09:52 |
| *** hw_wutianwei has quit IRC | 09:56 | |
| *** zhangfei has joined #openstack-kolla | 09:58 | |
| *** yangyapeng has quit IRC | 10:06 | |
| *** yangyapeng has joined #openstack-kolla | 10:07 | |
| *** tovin07_ has quit IRC | 10:07 | |
| *** bjolo has joined #openstack-kolla | 10:07 | |
| *** yangyapeng has quit IRC | 10:09 | |
| *** dardelea_ has quit IRC | 10:09 | |
| *** dardelea_ has joined #openstack-kolla | 10:10 | |
| openstackgerrit | Merged openstack/kolla master: Add collectd-gnocchi plugin https://review.openstack.org/527043 | 10:11 |
| *** dardelea_ has quit IRC | 10:15 | |
| *** salv-orlando has quit IRC | 10:15 | |
| pbourke | coolsvap: you might be able to answer this - is there a way to easily view zuul job-outputs without having to download the tar, untar, rename to html and open in a browser? | 10:17 |
| coolsvap | pbourke: no, I am not even able to go to the look at the log, its blocked for me in my org. :-/ | 10:19 |
| *** duonghq has quit IRC | 10:23 | |
| pbourke | coolsvap: :( | 10:24 |
| pbourke | coolsvap: looks like this job maybe just timed out? | 10:24 |
| pbourke | coolsvap: I think 1h is the limit | 10:24 |
| *** dosaboy has quit IRC | 10:24 | |
| coolsvap | I remember we had increased the limit to 90 min or something | 10:25 |
| coolsvap | but lets just do a recheck and see what happens | 10:25 |
| coolsvap | if it has timed out | 10:25 |
| *** dosaboy has joined #openstack-kolla | 10:25 | |
| pbourke | kk | 10:25 |
| *** genek has quit IRC | 10:28 | |
| *** gfidente has joined #openstack-kolla | 10:31 | |
| *** gfidente has quit IRC | 10:31 | |
| *** gfidente has joined #openstack-kolla | 10:31 | |
| *** dosaboy has quit IRC | 10:31 | |
| coolsvap | mewald: ^^ | 10:32 |
| *** zhangfei has quit IRC | 10:34 | |
| *** jascott1 has joined #openstack-kolla | 10:36 | |
| *** dosaboy has joined #openstack-kolla | 10:37 | |
| *** zhurong has quit IRC | 10:37 | |
| engel75 | hi | 10:37 |
| *** caowei has quit IRC | 10:39 | |
| *** jascott1 has quit IRC | 10:40 | |
| *** codenamelxl has quit IRC | 10:41 | |
| *** janki has quit IRC | 10:46 | |
| mewald | coolsvap, pbourke Ok we'll see | 10:47 |
| pbourke | I dont see any obvious failures in the log | 10:47 |
| pbourke | it just drops off the end | 10:48 |
| *** sambetts|afk is now known as sambetts | 10:49 | |
| hrw | does someone know about rabbitmq? can it be run with erlang-base instead of erlang-base-hipe? | 10:49 |
| *** k_mouza has joined #openstack-kolla | 10:57 | |
| *** rajivk_ has quit IRC | 10:58 | |
| *** rajivk_ has joined #openstack-kolla | 10:59 | |
| *** ktibi has joined #openstack-kolla | 11:06 | |
| *** janki has joined #openstack-kolla | 11:08 | |
| *** k_mouza has quit IRC | 11:14 | |
| *** genek has joined #openstack-kolla | 11:15 | |
| *** egonzalez has joined #openstack-kolla | 11:18 | |
| *** dciabrin has quit IRC | 11:21 | |
| *** dciabrin has joined #openstack-kolla | 11:21 | |
| *** genek has quit IRC | 11:26 | |
| *** dardelea_ has joined #openstack-kolla | 11:27 | |
| *** k_mouza_ has joined #openstack-kolla | 11:38 | |
| *** salv-orlando has joined #openstack-kolla | 11:38 | |
| pbourke | hrw: yes I would think so, Im pretty sure the hipe patch only went in recently | 11:42 |
| pbourke | hrw: have a dig for it, you may be able to partially revert if its causing problems for arm | 11:42 |
| hrw | thx. will change rabbitmq a bit | 11:42 |
| hrw | dockerfile I mean | 11:42 |
| hrw | o fsck... rabbitmq is in debian and we do not use it... | 11:43 |
| *** serlex has left #openstack-kolla | 11:46 | |
| *** serlex has joined #openstack-kolla | 11:46 | |
| *** genek has joined #openstack-kolla | 11:47 | |
| *** genek has quit IRC | 11:52 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Implement ceph-mgr service https://review.openstack.org/525495 | 11:58 |
| *** rajivk_ has quit IRC | 11:59 | |
| *** kiennt26 has joined #openstack-kolla | 12:04 | |
| *** janki has quit IRC | 12:05 | |
| *** genek has joined #openstack-kolla | 12:07 | |
| *** genek has quit IRC | 12:11 | |
| *** k_mouza_ has quit IRC | 12:14 | |
| openstackgerrit | Paul Bourke (pbourke) proposed openstack/kolla-ansible master: Add tempurl to swift pipeline https://review.openstack.org/527677 | 12:17 |
| *** skramaja_ has joined #openstack-kolla | 12:18 | |
| *** skramaja has quit IRC | 12:18 | |
| openstackgerrit | Paul Bourke (pbourke) proposed openstack/kolla-ansible master: Add tempurl to swift pipeline https://review.openstack.org/527677 | 12:21 |
| *** lpetrut has quit IRC | 12:22 | |
| *** lpetrut has joined #openstack-kolla | 12:23 | |
| *** dave-mccowan has joined #openstack-kolla | 12:23 | |
| *** skramaja_ has quit IRC | 12:23 | |
| *** skramaja has joined #openstack-kolla | 12:23 | |
| mewald | pbourke, coolsvap: who is this zuul guy? He's really grinding my gears xD | 12:24 |
| mewald | I still have failures, https://review.openstack.org/#/c/486379/, but at least it is +1 now | 12:25 |
| *** genek has joined #openstack-kolla | 12:26 | |
| *** janki has joined #openstack-kolla | 12:31 | |
| *** genek has quit IRC | 12:31 | |
| *** masuberu has joined #openstack-kolla | 12:33 | |
| *** jascott1 has joined #openstack-kolla | 12:37 | |
| *** jascott1 has quit IRC | 12:42 | |
| dalvarez | egonzalez, ping | 12:46 |
| *** dmellado has quit IRC | 12:47 | |
| dalvarez | egonzalez, mandre, the kolla patch for metadata agent was merged yesterday but still the image is not available as per: http://logs.openstack.org/43/502943/18/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/bbd9217/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz#_2017-12-13_12_03_07 | 12:47 |
| dalvarez | egonzalez, mandre do i have to do something manual to push it or is it a periodic thing that will eventually happen? | 12:47 |
| mandre | dalvarez: it's a periodic job that push container images to dockerhub, happening on rdo promotion | 12:49 |
| dalvarez | mandre, ack so it'll take time i think now with the issues with rdo cloud going on :( | 12:50 |
| mandre | dalvarez: make sure your image is listed in tripleo-common otherwise it won't get built/pushed | 12:51 |
| dalvarez | mandre, this: https://review.openstack.org/#/c/525182/6/container-images/overcloud_containers.yaml ? | 12:51 |
| mandre | dalvarez: yep, that one :) | 12:52 |
| mandre | dalvarez: currently, you also need to white list the image in rdo scripts for the push but this will not be necessary anymore with https://review.rdoproject.org/r/#/c/10845/ | 12:53 |
| dalvarez | mandre, awesome then i wont do anything in rdo scripts, thanks a lot! | 12:54 |
| *** k_mouza has joined #openstack-kolla | 12:54 | |
| *** goldyfruit has joined #openstack-kolla | 12:55 | |
| *** goldyfruit has quit IRC | 12:56 | |
| *** dmellado has joined #openstack-kolla | 12:58 | |
| *** amoralej is now known as amoralej|lunch | 13:01 | |
| *** salv-orl_ has joined #openstack-kolla | 13:02 | |
| ktibi | Hi all, I want to add a file into my keystone container, so I add file in kolla/config/keystone/ but kolla doesn't copy file. Where can find the regex in kolla ? | 13:03 |
| *** mikal_ has quit IRC | 13:03 | |
| *** mikal has joined #openstack-kolla | 13:05 | |
| *** salv-orlando has quit IRC | 13:06 | |
| *** dmellado has quit IRC | 13:08 | |
| *** skramaja has quit IRC | 13:08 | |
| *** dmellado has joined #openstack-kolla | 13:09 | |
| openstackgerrit | Merged openstack/kolla master: Revert "nova-libvirt: fix kvm permission issue" https://review.openstack.org/525900 | 13:10 |
| *** rhallisey has joined #openstack-kolla | 13:13 | |
| egonzalez | ktibi, no regex to copy files into containers, only override files we copy into | 13:17 |
| ktibi | egonzalez I need to add a CA for LDAP conection on keystone. Works if I copy file in keystone/domains because kolla have task https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/keystone/tasks/config.yml#L88 | 13:18 |
| pbourke | coolsvap: mewald: that patch is looking fine now | 13:30 |
| pbourke | ubuntu-binary is failing but I think we've proved failures are unrelated | 13:30 |
| coolsvap | Thanks pbourke | 13:31 |
| pbourke | I should actually review it now :) | 13:31 |
| mewald | thanks guys! | 13:33 |
| *** k_mouza has quit IRC | 13:37 | |
| *** ansmith has joined #openstack-kolla | 13:41 | |
| *** srwilkers_ has joined #openstack-kolla | 13:45 | |
| *** genek has joined #openstack-kolla | 13:46 | |
| ktibi | egonzalez when do you freeze features for queens ? | 13:47 |
| *** genek has quit IRC | 13:51 | |
| *** hw_wutianwei has joined #openstack-kolla | 13:55 | |
| *** mdnadeem_ has joined #openstack-kolla | 13:56 | |
| *** mdnadeem has quit IRC | 13:58 | |
| *** salv-orlando has joined #openstack-kolla | 14:03 | |
| *** genek has joined #openstack-kolla | 14:06 | |
| *** salv-orl_ has quit IRC | 14:06 | |
| *** amoralej|lunch is now known as amoralej | 14:07 | |
| *** zhangfei has joined #openstack-kolla | 14:09 | |
| mewald | pbourke: thanks for +2 :) Need one more, anyone? | 14:11 |
| mewald | https://review.openstack.org/#/c/486379/ | 14:11 |
| *** genek has quit IRC | 14:11 | |
| *** kiennt26 has quit IRC | 14:13 | |
| mewald | have there been commits that add the possibility to deploy a second rabbitmq cluster for example? I would like to have a separate cluster for the sensu stuff on the monitoring nodes | 14:15 |
| *** goldyfruit has joined #openstack-kolla | 14:16 | |
| pbourke | mewald: we added a separate cluster for murano | 14:22 |
| pbourke | mewald: you could look at that as an example | 14:22 |
| pbourke | or even piggyback on it depending on what you want to do | 14:22 |
| *** genek has joined #openstack-kolla | 14:23 | |
| rwellum | sbezverk: you around buddy? | 14:26 |
| sbezverk | rwellum hey what is up? | 14:26 |
| rwellum | I'm trying to change the enabled_backends for cinder - but no matter how I change the template - when the container is brought up it's set to: "enabled_backends = 10.100.100.12_cinder-volumes". kfox1111 mentioned this was something you had worked on in the past? | 14:27 |
| *** genek has quit IRC | 14:27 | |
| sbezverk | rwellum right | 14:29 |
| sbezverk | what exactly you try to change? | 14:29 |
| rwellum | I want to change it to: "lvmdriver-1,v3700,lenovo-b" | 14:29 |
| rwellum | My own backend. | 14:29 |
| sbezverk | first, we have never tested multiple backend support | 14:31 |
| sbezverk | second, please check cloud.yaml | 14:32 |
| sbezverk | it shows the structure used for building backend name dynamically | 14:32 |
| sbezverk | at that point there was no requirement to use a static name for a backend | 14:33 |
| sbezverk | you will need to change the code for this case.. | 14:33 |
| *** openstackstatus has quit IRC | 14:36 | |
| rwellum | Ah - I see now - I missed the cloud.yaml! | 14:36 |
| *** openstackstatus_ has joined #openstack-kolla | 14:37 | |
| *** openstackstatus_ has quit IRC | 14:37 | |
| *** zhangfei has quit IRC | 14:37 | |
| rwellum | So technically I could just add more backends below lvm_backends: - but not tested. | 14:38 |
| *** openstackstatus has joined #openstack-kolla | 14:38 | |
| *** ChanServ sets mode: +v openstackstatus | 14:38 | |
| *** openstackstatus has quit IRC | 14:38 | |
| *** openstack has quit IRC | 14:39 | |
| *** openstack has joined #openstack-kolla | 14:42 | |
| *** ChanServ sets mode: +o openstack | 14:42 | |
| *** openstack has quit IRC | 14:43 | |
| *** openstack has joined #openstack-kolla | 14:47 | |
| *** ChanServ sets mode: +o openstack | 14:47 | |
| mewald | why is nothing happening here for 20 hours now? https://review.openstack.org/#/c/485150/ shouldn't the automatic tests have run by now? | 14:54 |
| egonzalez | mewald, do a rebase, yesterda infra was having issues | 14:58 |
| openstackgerrit | Mathias Ewald proposed openstack/kolla-ansible master: Add role to deploy prometheus https://review.openstack.org/485150 | 14:59 |
| mewald | egonzalez: ok done, let's see what happens :) | 14:59 |
| *** hw_wutianwei has quit IRC | 15:00 | |
| openstackgerrit | Merged openstack/kolla master: ironic-conductor: update driver dependencies for Queens https://review.openstack.org/526734 | 15:01 |
| *** pbourke has quit IRC | 15:02 | |
| *** mewald has quit IRC | 15:02 | |
| *** pbourke has joined #openstack-kolla | 15:03 | |
| *** janki has quit IRC | 15:04 | |
| *** lvdombrkr has joined #openstack-kolla | 15:16 | |
| *** genek has joined #openstack-kolla | 15:17 | |
| *** salv-orlando has quit IRC | 15:21 | |
| *** jtriley has quit IRC | 15:21 | |
| *** genek has quit IRC | 15:22 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: rabbitmq: handle Debian and aarch64 properly https://review.openstack.org/527712 | 15:22 |
| hrw | egonzalez, rwellum, sbezverk and others: please review that rabbitmq change. It makes image buildable on aarch64 | 15:23 |
| *** genek has joined #openstack-kolla | 15:23 | |
| sbezverk | rwellum right | 15:24 |
| *** dosaboy has quit IRC | 15:28 | |
| *** dosaboy has joined #openstack-kolla | 15:28 | |
| hrw | egonzalez: thx | 15:31 |
| egonzalez | hrw, is 0.0.0 a real version? | 15:32 |
| hrw | egonzalez: yes. package uses 0.0.0 | 15:32 |
| *** jtriley has joined #openstack-kolla | 15:32 | |
| egonzalez | weird version naming :/ | 15:32 |
| *** genek has quit IRC | 15:32 | |
| hrw | yep | 15:32 |
| hrw | hm. need to bump debian to use stretch-backports by default. we will get rabbitmq-server 3.6.10 which uses 3.6.10 instead of 0.0.0 | 15:36 |
| *** mewald has joined #openstack-kolla | 15:37 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: rabbitmq: handle Debian and aarch64 properly https://review.openstack.org/527712 | 15:37 |
| *** jascott1 has joined #openstack-kolla | 15:39 | |
| hrw | started build of all images for debian:stretch-backports - will compare with normal build and submit as update | 15:40 |
| openstackgerrit | Mathias Ewald proposed openstack/kolla master: Add sensu images https://review.openstack.org/486379 | 15:43 |
| *** jascott1 has quit IRC | 15:44 | |
| openstackgerrit | Merged openstack/kolla-ansible master: add official default cpu allocation ratio. https://review.openstack.org/516553 | 15:48 |
| hrw | mewald: sorry to be picky | 15:52 |
| *** duonghq has joined #openstack-kolla | 15:53 | |
| mewald | hrw: it's ok! it's good that somebody takes care of the debian parts :) | 15:53 |
| hrw | mewald: you do ubuntu rather than debian I suppose | 15:53 |
| inc0 | good mornign | 15:53 |
| *** b_bezak has quit IRC | 15:53 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: debian: use stretch-backports by default https://review.openstack.org/527726 | 15:55 |
| hrw | inc0: elo | 15:55 |
| hrw | inc0: +2 please | 15:55 |
| inc0 | meeting in 5 | 15:55 |
| hrw | ah, right | 15:56 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: rabbitmq: handle Debian and aarch64 properly https://review.openstack.org/527712 | 15:56 |
| hrw | those two are linked with each other | 15:57 |
| hrw | egonzalez: good part: stretch-backports rabbitmq-server uses 3.6.10 not 0.0.0 so dockerfile is simpler | 15:57 |
| *** egonzalez has quit IRC | 15:59 | |
| *** egonzalez has joined #openstack-kolla | 16:00 | |
| Jeffrey4l | kolla cores, please review https://review.openstack.org/527563 | 16:02 |
| *** rmart04 has quit IRC | 16:04 | |
| *** dciabrin has quit IRC | 16:04 | |
| *** jascott1 has joined #openstack-kolla | 16:05 | |
| openstackgerrit | Taeha Kim proposed openstack/kolla-ansible master: Add missing hostname to nodename in RabbitMQ for multinode deployment https://review.openstack.org/516847 | 16:06 |
| *** magicboiz has quit IRC | 16:06 | |
| *** genek has joined #openstack-kolla | 16:08 | |
| *** dave-mccowan has quit IRC | 16:11 | |
| *** mnasiadka has quit IRC | 16:13 | |
| mewald | hrw: yeah I havent touched a debian in years | 16:17 |
| hrw | my religion disallow me to touch ubuntu ;d | 16:18 |
| mewald | hrw: haha :D well, I might go back to debian once they've managed to not distribute ancient versions of everything for a couple of years | 16:19 |
| hrw | mewald: debian 9 has newer stuff than ubuntu 16.04 ;d | 16:19 |
| hrw | just not openstack things | 16:20 |
| *** dklyle has joined #openstack-kolla | 16:21 | |
| mewald | maybe I'll take a glance at debian then :) | 16:21 |
| openstackgerrit | Mathias Ewald proposed openstack/kolla master: Add sensu images https://review.openstack.org/486379 | 16:27 |
| mewald | hrw: should be the way you wanted it now :) | 16:28 |
| hrw | ;D | 16:28 |
| *** tvignaud has quit IRC | 16:28 | |
| *** mewald has quit IRC | 16:33 | |
| *** mewald has joined #openstack-kolla | 16:36 | |
| *** serlex has left #openstack-kolla | 16:37 | |
| mewald | jeiii, +1 from zuul for https://review.openstack.org/#/c/485150/ The guy isnt that bad after all :D | 16:37 |
| *** lpetrut has quit IRC | 16:38 | |
| klindgren | Since I see rabbitmq 3.6.10 above. I would suggest using a newer version. We have 3.6.10 in production right now and we are running into some problems with it. Mainly that it wont form a cluster underload. | 16:38 |
| *** salv-orlando has joined #openstack-kolla | 16:40 | |
| *** rajivk has joined #openstack-kolla | 16:44 | |
| Jeffrey4l | inc0, could you review https://review.openstack.org/527563 | 16:47 |
| *** egonzalez has quit IRC | 16:54 | |
| mrhillsman | inc0 i followed the install guide and built from source | 16:59 |
| inc0 | ok that's ok | 16:59 |
| Jeffrey4l | mrhillsman, container restarting sound like a bug or misconfiguration. and it should work. please dig more. | 16:59 |
| mrhillsman | yes, will do that, thanks | 16:59 |
| Jeffrey4l | np | 16:59 |
| inc0 | so mrhillsman check /var/lib/docker/volumes/kolla_logs | 16:59 |
| inc0 | this is host dir where all the logs live | 17:00 |
| Jeffrey4l | krtaylor, what issue? | 17:00 |
| mrhillsman | just wanted to set my expectations | 17:00 |
| mrhillsman | thx inc0 will do that buddy | 17:00 |
| inc0 | yeah mrhillsman basically if it has role, we expect it to work | 17:00 |
| inc0 | keeping it working and bug free is different matter tho...as you know;) | 17:00 |
| Jeffrey4l | mrhillsman, which release are you using? | 17:00 |
| inc0 | fyi now you can also download images from hub | 17:00 |
| mrhillsman | i just changed to yes, kicked off deployment, tested, no bueno, asked if it works out the box to set expectations | 17:00 |
| *** absubram has joined #openstack-kolla | 17:01 | |
| mrhillsman | i want to say 4.0.2 | 17:01 |
| mrhillsman | sec and i will confirm | 17:01 |
| inc0 | ocata? | 17:01 |
| mrhillsman | yeah | 17:01 |
| inc0 | I'm not sure of ocata had octavia | 17:01 |
| inc0 | I think we implemented it in Pike | 17:01 |
| Jeffrey4l | inc0, no it is implement in ocata. | 17:02 |
| Jeffrey4l | i did this. | 17:02 |
| inc0 | ah ok | 17:02 |
| inc0 | false alarm then | 17:02 |
| mrhillsman | ok cool | 17:02 |
| Jeffrey4l | mrhillsman, ocata should work. | 17:02 |
| inc0 | anyway, start debugging mrhillsman and we'll figure it out | 17:02 |
| mrhillsman | got it, i'll check back after debugging | 17:02 |
| mrhillsman | once i have some solid facts ;) | 17:02 |
| mrhillsman | thx again gents | 17:03 |
| krtaylor | Jeffrey4l, inc0 - the config override bug and patch that fixes it sure could use some attention - https://review.openstack.org/#/c/475961/ | 17:03 |
| krtaylor | like arm, we are gearing up to build and publish ppc64le images, config override would help in automation | 17:04 |
| Jeffrey4l | oslo.config should load the configuration file automatially. | 17:04 |
| krtaylor | it should, but doesnt | 17:04 |
| inc0 | krtaylor: maybe it's bug in oslo.config? | 17:04 |
| Jeffrey4l | let me check. | 17:04 |
| inc0 | if so, we should fix it there | 17:05 |
| krtaylor | I think that the way it is used is incorrect, it works after the code I added | 17:05 |
| mrhillsman | lol, if i have to do all the stuff you have in that paste Jeffrey4l then that may very well be the issue lol | 17:05 |
| Jeffrey4l | in my env, i never passed the --config-file parameter. and it load the /etc/kolla/kolla-build.conf auto. | 17:05 |
| mrhillsman | but will check back later :) | 17:05 |
| krtaylor | I bet it didn't load the config file, instead it really used the hard-coded values | 17:06 |
| inc0 | mrhillsman: well tbh none of this would mean neutron server restarting | 17:06 |
| *** absubram has quit IRC | 17:06 | |
| inc0 | so issue is elsewhere | 17:06 |
| krtaylor | Jeffrey4l, try changing a value in the config file to something very different and I bet it won't be used | 17:06 |
| hrw | klindgren: kolla uses 3.6.5 in debian/ubuntu now. I move it to 3.6.10 for debian as it it latest package | 17:07 |
| krtaylor | here is a better description in the bug https://bugs.launchpad.net/kolla/+bug/1699324 | 17:07 |
| openstack | Launchpad bug 1699324 in kolla "kolla-build.conf not found when building from local environment" [Undecided,In progress] - Assigned to Kurt Taylor (krtaylor) | 17:07 |
| mrhillsman | got it | 17:07 |
| inc0 | krtaylor: /etc/kolla/kolla-build.conf doesn't work or other files like local to user? | 17:07 |
| *** tvignaud has joined #openstack-kolla | 17:07 | |
| Jeffrey4l | hrw, you wanna to make etc/kolla/kolla-build.conf works? | 17:07 |
| krtaylor | nope, I could not get any config files to override the hardcoded build values | 17:07 |
| Jeffrey4l | sorry ping wrong person krtaylor ^^ | 17:07 |
| krtaylor | np | 17:08 |
| krtaylor | inc0 and I discussed months ago, and concluded that we'd start with this solution, then do the proper config override order | 17:09 |
| *** absubram has joined #openstack-kolla | 17:09 | |
| *** yangyapeng has joined #openstack-kolla | 17:09 | |
| Jeffrey4l | what i confused is that other project do not have such search configure file code. | 17:09 |
| inc0 | yeah now when you mention it, I vaguely remember discussion;) | 17:09 |
| Jeffrey4l | i think what you really want is: config_file = ['../../etc/kolla/kolla-build.conf'] | 17:09 |
| inc0 | Jeffrey4l: I'm not sure many projects have local config files | 17:09 |
| krtaylor | Jeffrey4l, I also looked at several other projects for clues on how to use the oslo config, the only way I was able to make it work was the code I added | 17:10 |
| Jeffrey4l | at least, nova have nova.conf which generated automatically, just like kolla does | 17:10 |
| Jeffrey4l | config_file = ['/etc/kolla/kolla-build.conf'] this is not necessary. oslo.conf search this file automatically. | 17:11 |
| krtaylor | yes, the ../../ is set in the path.dirname | 17:11 |
| *** rajivk has quit IRC | 17:11 | |
| krtaylor | I wish it wasnt necessary :) | 17:11 |
| krtaylor | I couldn't get that to work either | 17:11 |
| klindgren | hrw - yea, just giving a heads up that we are seeing issues with 3.6.10 in production. | 17:12 |
| Jeffrey4l | by using ../../ you are implementing a extra feature: load the configure file from code base path , i.e. <kolla>/etc/kolla/kolla-build.conf | 17:12 |
| krtaylor | in my testing the path has to be set, no defaults were used | 17:12 |
| krtaylor | yes, loading from code base path is how it is documented as working | 17:12 |
| Jeffrey4l | krtaylor, but line #1079-1080 is not neccessary. because it works like this before. | 17:12 |
| hrw | klindgren: 3.7 is not an option as it requires newer erlang | 17:13 |
| *** yangyapeng has quit IRC | 17:13 | |
| krtaylor | Jeffrey4l, it doenst work, it should, but doesnt unless it is set | 17:13 |
| *** tvignaud has quit IRC | 17:14 | |
| Jeffrey4l | krtaylor, sure? i use this daily. it works, really. | 17:14 |
| krtaylor | setting a value in either config file doesnt work, it is not automatically found by default search path | 17:14 |
| krtaylor | well, this is on ppc64le, but I would doubt that this would be different, hmmm, maybe | 17:15 |
| Jeffrey4l | krtaylor, are you meaning, in the current implementation, /etc/kolla/kolla-build.conf is not loaded auto? | 17:15 |
| krtaylor | correct | 17:15 |
| krtaylor | at least on ppc64le | 17:15 |
| Jeffrey4l | this is done by oslo.config, should not related to cpu arch. | 17:15 |
| openstackgerrit | Merged openstack/kolla-ansible master: RFC: disable haproxy http mode https://review.openstack.org/523876 | 17:15 |
| krtaylor | for build, it is not loaded | 17:15 |
| Jeffrey4l | https://github.com/openstack/oslo.config/blob/31ad891a62ab73daff20fbbafa2a534d7dac44ac/oslo_config/cfg.py#L644-L678 | 17:16 |
| Jeffrey4l | krtaylor, check this. this is the default search dirs. | 17:16 |
| klindgren | hrw, we are thinking for what we have seen: https://github.com/rabbitmq/rabbitmq-server/issues/1346 which is fixed in 3.6.12 might solve our issue. | 17:16 |
| hrw | klindgren: ok. but I am limited to Debian packages. | 17:17 |
| Jeffrey4l | if oslo.config won't load the configuration, i am afraid there may be some bug on oslo.config | 17:17 |
| *** tvignaud has joined #openstack-kolla | 17:17 | |
| klindgren | Bascially restarting rabbitmq server while its under load, results any server thats not a master to jsut sit there, and never join the cluster, and jsut log incoming requests. but cluster-Mange commands and other things timeout | 17:17 |
| Jeffrey4l | krtaylor, could you debug this and try to find why oslo.conf works differntly on ppc64le? | 17:18 |
| klindgren | and the whole cluster basically goes dead. | 17:18 |
| krtaylor | Jeffrey4l, maybe there is a difference in behavior becuase of platform, but I find that hard to believe, let me reproduce the problem on x86, if I can that will point to oslo | 17:18 |
| Jeffrey4l | ok. | 17:18 |
| Jeffrey4l | thanks. | 17:18 |
| rwellum | inc0, Jeffrey4l - I didn't get the conclusion of the tags discussion/releases from the meeting. Can you summarize when you get a chance please? | 17:18 |
| Jeffrey4l | about the feature. i do not see other project by using the configuration file in code. | 17:19 |
| krtaylor | agreed, I wish there was a more clear example | 17:19 |
| Jeffrey4l | rwellum, ocata next release is under review. and should be merged soon, i think. | 17:19 |
| Jeffrey4l | rwellum, about pike release, if the ceph luminouse can not resolve before friday, i think we have to release 5.0.1. and solve this issue in next release. | 17:20 |
| Jeffrey4l | inc0, ^ how do you think? | 17:20 |
| inc0 | rwellum: git tags and docker image tags are 2 diffetent things | 17:21 |
| inc0 | we were talking about git tags:) | 17:21 |
| rwellum | Oh! | 17:21 |
| inc0 | just to qualify | 17:21 |
| inc0 | Jeffrey4l: agree | 17:21 |
| inc0 | or | 17:21 |
| inc0 | you know | 17:21 |
| Jeffrey4l | inc0, btw, docker tag image is time to implement and should be easy. | 17:21 |
| inc0 | let's keep ubuntu-binary broken | 17:21 |
| inc0 | but fix ubuntu-source | 17:21 |
| inc0 | I may have and idea... | 17:22 |
| Jeffrey4l | inc0, about the ceph issue, is that possible? | 17:22 |
| inc0 | I mean | 17:22 |
| inc0 | we do have containers | 17:22 |
| Jeffrey4l | i thought ceph issue broken source and binary both. | 17:22 |
| inc0 | ahh no, forget about it, we need librbd in nova-libvirt | 17:22 |
| inc0 | Jeffrey4l: with my fix | 17:22 |
| inc0 | ubuntu binary seems to be broken | 17:22 |
| inc0 | in general | 17:22 |
| inc0 | without, ubuntu-source seems to be working | 17:23 |
| inc0 | and ceph is working | 17:23 |
| Jeffrey4l | interesting | 17:23 |
| Jeffrey4l | if so, this is a option too. | 17:23 |
| inc0 | https://review.openstack.org/#/c/527339/ | 17:23 |
| inc0 | right now we have a choice | 17:24 |
| inc0 | have ubuntu-binary totally broken and ubuntu-source working | 17:24 |
| inc0 | or have both only ceph broken | 17:24 |
| inc0 | but, that being said | 17:24 |
| *** yangyapeng has joined #openstack-kolla | 17:24 | |
| inc0 | I hate ubuntu binary and I hope not many puch people use it really | 17:24 |
| Jeffrey4l | 'qemu-img info' parsing failed. | 17:25 |
| Jeffrey4l | i am thinking this sound like a nova bug ;() | 17:25 |
| inc0 | so one thing we should *definetly* do is to say "don't upgrade if you're on ubuntu-binary" | 17:25 |
| inc0 | I'd think it's some broken versioning | 17:26 |
| Jeffrey4l | now 5.0.0 is a broken versioning for both centos and ubuntu ;( | 17:26 |
| inc0 | I mean it's just ubuntu binary... | 17:26 |
| inc0 | why centos? | 17:26 |
| Jeffrey4l | inc0, centos 7.4 | 17:27 |
| Jeffrey4l | break something | 17:27 |
| * inc0 loses faith in all that is good in the world | 17:27 | |
| Jeffrey4l | lol | 17:28 |
| inc0 | gates are green across the board tho | 17:28 |
| Jeffrey4l | are you meaning centos 7.4 issue? | 17:28 |
| *** yangyapeng has quit IRC | 17:28 | |
| Jeffrey4l | this is fixed long time ago. | 17:28 |
| inc0 | y | 17:28 |
| inc0 | ahh | 17:29 |
| inc0 | ok, I thought something is broken now | 17:29 |
| inc0 | yeah | 17:29 |
| inc0 | we deal with this all the time | 17:29 |
| inc0 | I remember (not sure if you were already in Kolla) when docker switched default ubuntu from 14.04 to 16.04 | 17:29 |
| inc0 | that was fun time | 17:29 |
| inc0 | we didn't specify back then;) | 17:30 |
| Jeffrey4l | i am in. But i forgot what the issue is. | 17:30 |
| inc0 | anyway Jeffrey4l go to sleep man | 17:30 |
| Jeffrey4l | inc0, checked the nova code. i do think it should not a big issue for ubuntu binary failure. | 17:31 |
| Jeffrey4l | better have a env to debug this. | 17:31 |
| inc0 | I'll log in today evening | 17:31 |
| inc0 | we can work on it then | 17:31 |
| Jeffrey4l | should be fixed. | 17:31 |
| Jeffrey4l | cool. thanks. | 17:31 |
| Jeffrey4l | i really need to get bed. | 17:31 |
| Jeffrey4l | see you | 17:31 |
| inc0 | yes, you do | 17:31 |
| inc0 | good night | 17:31 |
| Jeffrey4l | thanks. | 17:32 |
| *** ntpttr_laptop has joined #openstack-kolla | 17:33 | |
| *** dardelea_ has quit IRC | 17:35 | |
| *** duonghq has quit IRC | 17:36 | |
| inc0 | bbiaf | 17:38 |
| *** goldyfruit has quit IRC | 17:39 | |
| *** absubram has quit IRC | 17:40 | |
| *** mewald has quit IRC | 17:41 | |
| *** mewald has joined #openstack-kolla | 17:41 | |
| bmace__ | thanks for the review Jeffrey4l | 17:41 |
| openstackgerrit | Merged openstack/kolla stable/ocata: Use separate publish jobs in periodic pipeline https://review.openstack.org/527563 | 17:42 |
| *** gfidente has quit IRC | 17:43 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Move Cinder backend passwords to passwords.yml https://review.openstack.org/521817 | 17:45 |
| openstackgerrit | Merged openstack/kolla-ansible master: Optimize the tasks format for ovs-dpdk https://review.openstack.org/524650 | 17:50 |
| openstackgerrit | Merged openstack/kolla-ansible master: Add a missing conditional check to the common config task https://review.openstack.org/523260 | 17:50 |
| hrw | mewald: next version will be | 17:51 |
| hrw | 18:25 < Jeffrey4l> 'qemu-img info' parsing failed. | 17:52 |
| hrw | Jeffrey4l: syntax changed between qemu 2.5 and 2.10 | 17:52 |
| * hrw off | 17:54 | |
| *** mdnadeem_ has quit IRC | 17:54 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Set bash as shell when executing mariadb recovery task https://review.openstack.org/523180 | 17:58 |
| openstackgerrit | Merged openstack/kolla-ansible stable/pike: Fix ansible running issue on Debian https://review.openstack.org/520059 | 17:58 |
| openstackgerrit | Merged openstack/kolla-ansible master: automate ovs datapath configuration https://review.openstack.org/493916 | 17:58 |
| openstackgerrit | Merged openstack/kolla-ansible master: Update the service_token_roles_required to True for watcher https://review.openstack.org/516974 | 17:58 |
| openstackgerrit | Merged openstack/kolla-ansible master: Increased mariadb and kibana timeouts https://review.openstack.org/527511 | 17:58 |
| openstackgerrit | Merged openstack/kolla-ansible master: Update the job title of checking if Murano packages exists https://review.openstack.org/527317 | 17:58 |
| openstackgerrit | Merged openstack/kolla-ansible master: Restart services after a change in the external ceph configuration https://review.openstack.org/507888 | 17:58 |
| openstackgerrit | Merged openstack/kolla master: Set ES_SKIP_SET_KERNEL_PARAMETERS in elasticsearch image https://review.openstack.org/508468 | 17:59 |
| openstackgerrit | Merged openstack/kolla-ansible master: Change listen for mdns https://review.openstack.org/519302 | 18:01 |
| openstackgerrit | Merged openstack/kolla-ansible master: Add note about checking if all the hostnames are resolvable https://review.openstack.org/523846 | 18:01 |
| *** jascott1 has quit IRC | 18:02 | |
| *** jascott1 has joined #openstack-kolla | 18:02 | |
| *** yangyapeng has joined #openstack-kolla | 18:04 | |
| *** octo-fs has joined #openstack-kolla | 18:04 | |
| *** mgoddard has quit IRC | 18:06 | |
| *** dardelea_ has joined #openstack-kolla | 18:07 | |
| openstackgerrit | Mathias Ewald proposed openstack/kolla master: Add sensu images https://review.openstack.org/486379 | 18:07 |
| mewald | hrw: next try :) | 18:07 |
| *** jascott1 has quit IRC | 18:07 | |
| *** genek has quit IRC | 18:08 | |
| *** yangyapeng has quit IRC | 18:09 | |
| *** dardelea_ has quit IRC | 18:12 | |
| *** unicell has quit IRC | 18:18 | |
| *** octo-fs has quit IRC | 18:26 | |
| *** genek has joined #openstack-kolla | 18:37 | |
| *** ntpttr_laptop has quit IRC | 18:39 | |
| *** ntpttr_laptop has joined #openstack-kolla | 18:41 | |
| *** dave-mccowan has joined #openstack-kolla | 18:44 | |
| *** lpetrut has joined #openstack-kolla | 18:49 | |
| *** tvignaud has quit IRC | 18:50 | |
| *** genek has quit IRC | 18:55 | |
| *** vincent_vdk has quit IRC | 18:57 | |
| *** mgoddard has joined #openstack-kolla | 19:02 | |
| *** genek has joined #openstack-kolla | 19:05 | |
| *** goldyfruit has joined #openstack-kolla | 19:05 | |
| *** sambetts is now known as sambetts|afk | 19:06 | |
| *** lxdong has quit IRC | 19:08 | |
| *** genek has quit IRC | 19:10 | |
| *** lpetrut has quit IRC | 19:11 | |
| *** genek has joined #openstack-kolla | 19:21 | |
| rwellum | inc0: question when you are back | 19:23 |
| inc0 | ah I'm back | 19:23 |
| inc0 | :) | 19:23 |
| rwellum | :) | 19:24 |
| *** absubram has joined #openstack-kolla | 19:25 | |
| rwellum | Trying to build local source code again. Does this look correct? http://paste.openstack.org/show/628891/ | 19:25 |
| *** mgkwill_ is now known as mgkwill | 19:25 | |
| *** lpetrut has joined #openstack-kolla | 19:25 | |
| inc0 | looks good but I never tried this part myself | 19:25 |
| rwellum | I made a python change that should no compile, but horizon is built and pushed. I don't think it's picking up my local source. | 19:26 |
| *** openstackstatus has quit IRC | 19:27 | |
| inc0 | well python doesn't compile at all | 19:27 |
| inc0 | so buildtme won't show anything | 19:27 |
| *** jtriley has quit IRC | 19:27 | |
| inc0 | it would throw in runtime | 19:27 |
| inc0 | you can do docker run -it << your img >> bash | 19:28 |
| inc0 | and see if code is there manually | 19:28 |
| *** goldyfruit has quit IRC | 19:28 | |
| rwellum | Ok - and the other thing is maybe to add something unique and grep for it on the container. | 19:28 |
| inc0 | right | 19:28 |
| rwellum | But I really wish the build output would give me some clue where the source is coming from - but it's all obdfuscated. | 19:28 |
| *** goldyfruit has joined #openstack-kolla | 19:29 | |
| *** genek has quit IRC | 19:29 | |
| rwellum | I guess I can give a bad path and see if it borks.... :s | 19:30 |
| *** coolsvap has quit IRC | 19:31 | |
| *** lpetrut has quit IRC | 19:32 | |
| *** genek has joined #openstack-kolla | 19:32 | |
| inc0 | rwellum: add a log man;) | 19:33 |
| *** jtriley has joined #openstack-kolla | 19:33 | |
| rwellum | inc0: I guess I am in disbelieve that there isn't one already :) | 19:34 |
| *** mewald has quit IRC | 19:34 | |
| inc0 | after are this years, aren't you used to lack of obvious featurs in software?;) | 19:34 |
| inc0 | I became quite jaded;) | 19:34 |
| *** lpetrut has joined #openstack-kolla | 19:35 | |
| rwellum | Yeah especially debugging - fair enough :) | 19:37 |
| rwellum | Anyway I threw in a nonsense path to horizon and it is merrily building something.... | 19:38 |
| rwellum | Now I do need to debug and find out why | 19:38 |
| *** mgoddard has quit IRC | 19:40 | |
| *** genek has quit IRC | 19:40 | |
| *** genek has joined #openstack-kolla | 19:41 | |
| *** absubram has quit IRC | 19:41 | |
| *** ntpttr_laptop has quit IRC | 19:45 | |
| *** genek has quit IRC | 19:46 | |
| *** dardelean_ has quit IRC | 19:50 | |
| *** mewald has joined #openstack-kolla | 19:52 | |
| *** mewald has quit IRC | 19:54 | |
| *** mnasiadka has joined #openstack-kolla | 20:06 | |
| *** genek has joined #openstack-kolla | 20:06 | |
| *** genek has quit IRC | 20:11 | |
| *** genek has joined #openstack-kolla | 20:16 | |
| rwellum | inc0: figured out the issue | 20:19 |
| *** genek has quit IRC | 20:21 | |
| rwellum | When you use the non installed build.py - the kolla-build.conf file is not found automatically - you need to specify it with --config-file <kolla-build.conf file location> | 20:21 |
| *** openstackstatus has joined #openstack-kolla | 20:27 | |
| *** ChanServ sets mode: +v openstackstatus | 20:27 | |
| *** mewald has joined #openstack-kolla | 20:28 | |
| *** mgoddard has joined #openstack-kolla | 20:32 | |
| *** mewald has left #openstack-kolla | 20:32 | |
| inc0 | oh interesting | 20:33 |
| inc0 | krtaylor: maybe you had same issue? | 20:33 |
| krtaylor | inc0, yep, thats it - rwellum see https://bugs.launchpad.net/kolla/+bug/1699324 | 20:37 |
| openstack | Launchpad bug 1699324 in kolla "kolla-build.conf not found when building from local environment" [Undecided,In progress] - Assigned to Kurt Taylor (krtaylor) | 20:37 |
| krtaylor | rwellum, btw, what environment - I'm assuming x86, ubuntu? | 20:38 |
| rwellum | Yes to both krtaylor - although sometimes I use centos - not lately. | 20:38 |
| rwellum | Thanks for the bug btw | 20:39 |
| krtaylor | if so, then you have see the issue on x86 means that it isnt specifically a ppc64le issue | 20:39 |
| rwellum | You can also specify --config-dir and point to wherever | 20:39 |
| rwellum | krtaylor: correct | 20:39 |
| krtaylor | rwellum, if you could spare a comment on the bug, it would be much appreciated | 20:39 |
| krtaylor | I was about halfway through re-creating a centos environment on my laptop to confirm, great timing! | 20:40 |
| *** genek has joined #openstack-kolla | 20:41 | |
| *** ktibi has quit IRC | 20:41 | |
| *** vincent_vdk has joined #openstack-kolla | 20:42 | |
| krtaylor | yeah, as a workaround, but it would be really nice to be able to push and sync a config file for automating builds | 20:42 |
| *** pmisiak has quit IRC | 20:43 | |
| *** logan- has quit IRC | 20:43 | |
| *** johnthetubaguy has quit IRC | 20:43 | |
| rwellum | krtaylor: added comment and some better logging I've been working on today. | 20:43 |
| *** logan- has joined #openstack-kolla | 20:43 | |
| krtaylor | rwellum, thanks! | 20:44 |
| krtaylor | rwellum, this fixes it, might need some cleaning up https://review.openstack.org/#/c/475961 | 20:45 |
| krtaylor | it would be good to include the logging improvements | 20:45 |
| *** johnthetubaguy has joined #openstack-kolla | 20:45 | |
| *** genek has quit IRC | 20:45 | |
| *** unicell has joined #openstack-kolla | 20:48 | |
| rwellum | Looking at it krtaylor - you mention in the description passing in the config file, then that the order is local project file, global then defaults - but shouldn't the first in the order be the config file passed in? | 20:48 |
| rwellum | krtaylor: main thing about logging is to include the source path in the build log so it's really clear. | 20:50 |
| *** ntpttr_laptop has joined #openstack-kolla | 20:54 | |
| *** ansmith has quit IRC | 20:59 | |
| krtaylor | rwellum, good point, although that always worked, hm | 21:01 |
| * krtaylor looks | 21:01 | |
| *** japestinho has quit IRC | 21:02 | |
| *** amoralej is now known as amoralej|off | 21:03 | |
| *** mgoddard has quit IRC | 21:08 | |
| *** absubram has joined #openstack-kolla | 21:08 | |
| *** mdorman has joined #openstack-kolla | 21:09 | |
| *** genek has joined #openstack-kolla | 21:11 | |
| mdorman | i'm running kolla-ansible host bootstrap with the all-in-one inventory. ansible-playbook doesn't seem to be loading group_vars/all.yml variables. i mean i see ansible-playbook loading the file, but none of the data from it shows up in hostvars[localhost]. does this ring a bell to anyone? i'm sure i'm just missing something easy. | 21:14 |
| *** genek has quit IRC | 21:15 | |
| inc0 | hmm, can you please paste actual log and inventory? | 21:15 |
| *** threestrands has joined #openstack-kolla | 21:18 | |
| *** threestrands has quit IRC | 21:18 | |
| *** threestrands has joined #openstack-kolla | 21:18 | |
| mdorman | yeah one minute | 21:19 |
| *** jascott1 has joined #openstack-kolla | 21:20 | |
| mdorman | i've just been following the quickstart guide, https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html, pip installing it vs. from git. pip installed kolla-ansible (5.0.0). | 21:21 |
| mdorman | https://gist.github.com/misterdorm/2380b6920088233722d4d0dfdb4e254f | 21:21 |
| inc0 | so stable pike | 21:21 |
| mdorman | yeah | 21:21 |
| mdorman | i'm using the stock inventory file from the repo. | 21:21 |
| mdorman | i added a debug task to pre-install.yml to dump hostvars, and i don't see anything in there that the all group_vars is supposed to be introducing | 21:22 |
| inc0 | this is different error tho | 21:22 |
| mdorman | ansible ansible 2.4.1.0 | 21:23 |
| mdorman | well it comes from the fact that api_interface isn't found in hostvars, which should be put there by all.yml | 21:23 |
| inc0 | ahh | 21:23 |
| inc0 | yeah | 21:23 |
| inc0 | someone had this issue few days ago | 21:23 |
| mdorman | happy to hear i am not the only one :) | 21:23 |
| inc0 | try rolling back to ansible 2.3 | 21:24 |
| mdorman | kk | 21:24 |
| *** pramodrj07 has joined #openstack-kolla | 21:24 | |
| *** goldyfruit has quit IRC | 21:26 | |
| mdorman | inc0: that worked. tyvm!! | 21:27 |
| inc0 | great to hear that | 21:28 |
| mdorman | i'll open a bug? or is this consisdered an ansible thing that needs fixed there? | 21:28 |
| inc0 | seems to be ansible issue | 21:28 |
| mdorman | cool. | 21:29 |
| *** rhallisey has quit IRC | 21:33 | |
| *** mnasiadka has quit IRC | 21:35 | |
| *** mnasiadka has joined #openstack-kolla | 21:43 | |
| *** mnasiadka has quit IRC | 21:49 | |
| *** genek has joined #openstack-kolla | 21:49 | |
| *** mnasiadka has joined #openstack-kolla | 21:51 | |
| *** klindgren_ has joined #openstack-kolla | 21:54 | |
| *** genek has quit IRC | 21:55 | |
| *** mnasiadka has quit IRC | 21:56 | |
| *** klindgren has quit IRC | 21:57 | |
| *** mnasiadka has joined #openstack-kolla | 21:58 | |
| *** mchlumsky has quit IRC | 22:01 | |
| mdorman | not trying to be pedantic, but the following are missing 5.0.0 tags in docker hub (when the openstack_release value is auto detected from the kolla-ansible version): kolla/centos-binary-cron:5.0.0, kolla/centos-binary-fluentd:5.0.0, and kolla/centos-binary-kolla-toolbox:5.0.0. using the 'pike' tag works for everything. | 22:01 |
| mdorman | just fyi. | 22:01 |
| *** mnasiadka has quit IRC | 22:06 | |
| *** jtriley has quit IRC | 22:09 | |
| *** mnasiadka has joined #openstack-kolla | 22:11 | |
| *** vhosakot has quit IRC | 22:14 | |
| *** vhosakot has joined #openstack-kolla | 22:15 | |
| *** mnasiadka has quit IRC | 22:18 | |
| *** lpetrut has quit IRC | 22:26 | |
| *** mnasiadka has joined #openstack-kolla | 22:29 | |
| *** genek has joined #openstack-kolla | 22:29 | |
| *** rhallisey has joined #openstack-kolla | 22:29 | |
| *** genek has quit IRC | 22:33 | |
| *** mnasiadka has quit IRC | 22:33 | |
| inc0 | well pike images in hub is new thing | 22:35 |
| inc0 | and 5.0.0 is backwards compatibiliuty by now | 22:35 |
| inc0 | so while I'd love to change default, we won't because we don't want to screw people over | 22:36 |
| *** ntpttr_laptop has quit IRC | 22:38 | |
| *** absubram has quit IRC | 22:43 | |
| *** mnasiadka has joined #openstack-kolla | 22:44 | |
| *** mnasiadka has quit IRC | 22:48 | |
| *** harlowja has quit IRC | 22:54 | |
| *** dardelean_ has joined #openstack-kolla | 22:57 | |
| *** mnasiadka has joined #openstack-kolla | 22:59 | |
| *** diablo_rojo has joined #openstack-kolla | 23:02 | |
| *** mnasiadka has quit IRC | 23:03 | |
| mdorman | i see, ok. | 23:05 |
| *** genek has joined #openstack-kolla | 23:05 | |
| *** diablo_rojo has left #openstack-kolla | 23:06 | |
| mdorman | imagine there's not much real practical use to autodetecting vs. explicitly saying what release you want, anyway. | 23:06 |
| *** genek has quit IRC | 23:10 | |
| *** jascott1 has quit IRC | 23:11 | |
| *** mnasiadka has joined #openstack-kolla | 23:14 | |
| *** yuanying has joined #openstack-kolla | 23:18 | |
| *** mnasiadka has quit IRC | 23:19 | |
| *** genek has joined #openstack-kolla | 23:22 | |
| *** dave-mccowan has quit IRC | 23:23 | |
| *** jascott1 has joined #openstack-kolla | 23:23 | |
| *** genek has quit IRC | 23:27 | |
| *** absubram has joined #openstack-kolla | 23:28 | |
| *** jascott1 has quit IRC | 23:28 | |
| *** jascott1 has joined #openstack-kolla | 23:28 | |
| *** mnasiadka has joined #openstack-kolla | 23:29 | |
| *** mdorman has quit IRC | 23:32 | |
| *** mnasiadka has quit IRC | 23:33 | |
| *** itlinux has joined #openstack-kolla | 23:35 | |
| *** harlowja has joined #openstack-kolla | 23:42 | |
| *** genek has joined #openstack-kolla | 23:43 | |
| *** mnasiadka has joined #openstack-kolla | 23:44 | |
| *** genek has quit IRC | 23:48 | |
| *** mnasiadka has quit IRC | 23:48 | |
| *** jascott1 has quit IRC | 23:53 | |
| *** jascott1 has joined #openstack-kolla | 23:54 | |
| *** mnasiadka has joined #openstack-kolla | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!