| *** awiddersheim has quit IRC | 00:04 | |
| *** GonZo2000 has quit IRC | 00:13 | |
| *** GonZo2000 has joined #openstack-kolla | 00:13 | |
| *** GonZo2000 has quit IRC | 00:13 | |
| *** GonZo2000 has joined #openstack-kolla | 00:13 | |
| *** GonZo2000 has quit IRC | 00:14 | |
| *** GonZo2000 has joined #openstack-kolla | 00:14 | |
| *** GonZo2000 has quit IRC | 00:14 | |
| *** GonZo2000 has joined #openstack-kolla | 00:15 | |
| *** GonZo2000 has quit IRC | 00:15 | |
| *** GonZo2000 has joined #openstack-kolla | 00:16 | |
| *** GonZo2000 has quit IRC | 00:16 | |
| *** GonZo2000 has joined #openstack-kolla | 00:16 | |
| *** GonZo2000 has quit IRC | 00:17 | |
| *** GonZo2000 has joined #openstack-kolla | 00:17 | |
| *** GonZo2000 has quit IRC | 00:18 | |
| *** GonZo2000 has joined #openstack-kolla | 00:18 | |
| *** GonZo2000 has quit IRC | 00:18 | |
| *** GonZo2000 has joined #openstack-kolla | 00:19 | |
| *** GonZo2000 has quit IRC | 00:19 | |
| *** GonZo2000 has joined #openstack-kolla | 00:19 | |
| *** GonZo2000 has quit IRC | 00:20 | |
| *** schwicht has quit IRC | 00:20 | |
| *** GonZo2000 has joined #openstack-kolla | 00:20 | |
| *** GonZo2000 has quit IRC | 00:20 | |
| *** GonZo2000 has joined #openstack-kolla | 00:20 | |
| *** GonZo2000 has quit IRC | 00:21 | |
| *** GonZo2K has joined #openstack-kolla | 00:21 | |
| *** GonZo2K has joined #openstack-kolla | 00:21 | |
| *** GonZo2K has quit IRC | 00:22 | |
| *** GonZo2K has joined #openstack-kolla | 00:22 | |
| *** GonZo2K has quit IRC | 00:22 | |
| *** GonZo2K has joined #openstack-kolla | 00:23 | |
| *** GonZo2K has quit IRC | 00:23 | |
| *** GonZo2K has joined #openstack-kolla | 00:24 | |
| *** GonZo2K has quit IRC | 00:24 | |
| openstackgerrit | jangseon ryu proposed openstack/kolla-ansible master: Support for increasing thread cache size in TCMalloc. https://review.openstack.org/468284 | 00:25 |
|---|---|---|
| *** sbezverk has joined #openstack-kolla | 00:34 | |
| *** duonghq has joined #openstack-kolla | 00:43 | |
| *** hongbin has quit IRC | 00:44 | |
| *** huzhengchuan has quit IRC | 00:44 | |
| *** lucasxu has joined #openstack-kolla | 00:46 | |
| *** lucasxu has quit IRC | 00:46 | |
| *** schwicht has joined #openstack-kolla | 00:47 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: [NO MERGE]debug kolla gate https://review.openstack.org/472005 | 00:49 |
| *** zhurong has joined #openstack-kolla | 00:49 | |
| *** cuongnv has joined #openstack-kolla | 00:54 | |
| sdake | kfox1111 the problem is that openstack itself has the internal ip address reigstered with it | 01:00 |
| kfox1111 | its just a config option. | 01:01 |
| kfox1111 | it just has to be set in the right place in the right config file. | 01:01 |
| kfox1111 | If I remember correctly, its in the nova-compute's configmap. | 01:01 |
| sdake | yes its in nova.conf | 01:02 |
| kfox1111 | yeah. but I think its nova-compute that actually hands it out. not the controllers liek you might expect. | 01:02 |
| kfox1111 | (I use different nova config files on controllers vs computs for security reasons. so the distinction was important) | 01:02 |
| *** caoyuan has joined #openstack-kolla | 01:04 | |
| *** huzhengchuan has joined #openstack-kolla | 01:06 | |
| *** manheim has joined #openstack-kolla | 01:07 | |
| *** manheim has quit IRC | 01:11 | |
| *** sbezverk has quit IRC | 01:23 | |
| *** hieulq has quit IRC | 01:23 | |
| *** randomhack has joined #openstack-kolla | 01:24 | |
| *** hieulq has joined #openstack-kolla | 01:24 | |
| *** awidders_ has joined #openstack-kolla | 01:25 | |
| inc0 | Jeffrey4l: arround? | 01:26 |
| Jeffrey4l | inc0, yep | 01:26 |
| inc0 | https://review.openstack.org/#/c/471883/ | 01:26 |
| inc0 | ubuntu source has strange error | 01:26 |
| inc0 | but at least centos works | 01:26 |
| Jeffrey4l | yep. i am trying to debug this. | 01:27 |
| *** caowei has joined #openstack-kolla | 01:27 | |
| Jeffrey4l | base on your patch https://review.openstack.org/472005 | 01:27 |
| Jeffrey4l | found some thing wrong. but still can not fix it now. | 01:27 |
| *** randomhack has quit IRC | 01:28 | |
| inc0 | I'll ask in #ansible | 01:28 |
| Jeffrey4l | no. it should not ansible issue. | 01:28 |
| Jeffrey4l | first issue is related ubuntu + sudo. | 01:29 |
| Jeffrey4l | envriontment is not passed in ubuntu. | 01:29 |
| *** zhurong has quit IRC | 01:29 | |
| inc0 | hmm | 01:29 |
| Jeffrey4l | i added "sudo" and --become, it is OK now. | 01:29 |
| inc0 | riiight | 01:29 |
| Jeffrey4l | now. i found docker.service.d/kolla.conf is not configured properly. | 01:29 |
| inc0 | but this doesn't use become | 01:29 |
| Jeffrey4l | trying to fix this. | 01:29 |
| Jeffrey4l | maybe. will remove become to have a try. | 01:30 |
| inc0 | https://review.openstack.org/#/c/472005/13/tools/deploy_aio.sh you're defining docker registry twice | 01:31 |
| inc0 | in bootstrap | 01:31 |
| inc0 | and second one is overlay:) | 01:31 |
| inc0 | line 34 | 01:31 |
| Jeffrey4l | yes. ;( | 01:31 |
| Jeffrey4l | typo.. | 01:31 |
| inc0 | that's probably what breaks docker | 01:31 |
| Jeffrey4l | yes. | 01:32 |
| inc0 | btw https://etherpad.openstack.org/p/kolla-publisher-job-design | 01:32 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: [NO MERGE]debug kolla gate https://review.openstack.org/472005 | 01:33 |
| * Jeffrey4l is checking the link. | 01:33 | |
| Jeffrey4l | great idea. will leave some comment on the etherpad. | 01:37 |
| Jeffrey4l | brb | 01:37 |
| *** dave-mccowan has joined #openstack-kolla | 01:38 | |
| *** zhubingbing has joined #openstack-kolla | 01:40 | |
| awidders_ | Hey, do you guys know if when you do an upgrade of kolla containers the services get taken out of haproxy? | 01:45 |
| inc0 | awidders_: no | 01:45 |
| inc0 | APIs are only ones that would be affected | 01:45 |
| inc0 | and it's sub-second anyway | 01:45 |
| awidders_ | ok so there is a chance some people see issues iwth horizon or something? | 01:45 |
| inc0 | well, it's very fast if you do kolla-ansible pull before upgrade | 01:46 |
| inc0 | so maybe a blip | 01:46 |
| awidders_ | ok | 01:46 |
| awidders_ | thakns | 01:46 |
| *** eanylin has quit IRC | 01:53 | |
| *** zhubingbing has quit IRC | 02:00 | |
| *** zhurong has joined #openstack-kolla | 02:03 | |
| *** schwicht has quit IRC | 02:08 | |
| *** unicell has quit IRC | 02:13 | |
| *** unicell has joined #openstack-kolla | 02:13 | |
| *** goldyfruit has joined #openstack-kolla | 02:21 | |
| inc0 | Jeffrey4l: so yours ubuntu soruce succeed | 02:26 |
| inc0 | but centos failed, my change was other way around;) | 02:26 |
| inc0 | so we need to combine these | 02:26 |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla master: Fix kolla deploy gates https://review.openstack.org/471883 | 02:30 |
| *** zhubingbing has joined #openstack-kolla | 02:32 | |
| inc0 | Jeffrey4l: mind reviewing this too? https://review.openstack.org/#/c/471401/ when we get infra change merged we'll need this code in ocata too | 02:33 |
| inc0 | same thing when we fix kolla gates | 02:33 |
| *** unicell has quit IRC | 02:35 | |
| *** zhubingbing has quit IRC | 02:55 | |
| *** ducttape_ has joined #openstack-kolla | 02:59 | |
| *** ducttape_ has quit IRC | 03:05 | |
| *** ducttape_ has joined #openstack-kolla | 03:11 | |
| *** emccormick has joined #openstack-kolla | 03:12 | |
| *** ducttape_ has quit IRC | 03:16 | |
| *** salv-orlando has joined #openstack-kolla | 03:21 | |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla master: Fix kolla deploy gates https://review.openstack.org/471883 | 03:23 |
| *** salv-orlando has quit IRC | 03:26 | |
| *** ducttape_ has joined #openstack-kolla | 03:33 | |
| *** eanylin has joined #openstack-kolla | 03:34 | |
| *** ducttape_ has quit IRC | 03:46 | |
| *** dave-mccowan has quit IRC | 03:47 | |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla master: Fix kolla deploy gates https://review.openstack.org/471883 | 03:48 |
| inc0 | Jeffrey4l: this one might actually worh ^ | 03:48 |
| inc0 | feel free to take over patch if you find anything | 03:49 |
| inc0 | so we can merge it during my night | 03:49 |
| inc0 | and release afterwards | 03:49 |
| *** spsurya has joined #openstack-kolla | 03:51 | |
| spsurya | morning | 03:51 |
| *** ducttape_ has joined #openstack-kolla | 03:52 | |
| *** ducttap__ has joined #openstack-kolla | 03:58 | |
| *** caowei_ has joined #openstack-kolla | 03:59 | |
| *** ducttape_ has quit IRC | 04:01 | |
| *** caowei has quit IRC | 04:02 | |
| *** caowei_ is now known as caowei | 04:02 | |
| *** japestinho has joined #openstack-kolla | 04:03 | |
| *** ducttape_ has joined #openstack-kolla | 04:03 | |
| *** caowei_ has joined #openstack-kolla | 04:05 | |
| *** ducttap__ has quit IRC | 04:05 | |
| *** ducttape_ has quit IRC | 04:06 | |
| *** goldyfruit has quit IRC | 04:07 | |
| *** caowei has quit IRC | 04:09 | |
| *** caowei_ is now known as caowei | 04:09 | |
| *** ducttape_ has joined #openstack-kolla | 04:10 | |
| *** huzhengchuan has quit IRC | 04:11 | |
| *** serlex has joined #openstack-kolla | 04:13 | |
| *** unicell has joined #openstack-kolla | 04:15 | |
| *** zhubingbing has joined #openstack-kolla | 04:15 | |
| *** skramaja has joined #openstack-kolla | 04:15 | |
| *** ducttape_ has quit IRC | 04:17 | |
| *** caowei has quit IRC | 04:17 | |
| *** salv-orlando has joined #openstack-kolla | 04:22 | |
| *** zhurong has quit IRC | 04:25 | |
| *** caowei has joined #openstack-kolla | 04:25 | |
| *** salv-orlando has quit IRC | 04:26 | |
| *** zhurong has joined #openstack-kolla | 04:34 | |
| *** janki has joined #openstack-kolla | 04:42 | |
| *** salv-orlando has joined #openstack-kolla | 04:44 | |
| inc0 | Jeffrey4l: that one works https://review.openstack.org/#/c/471883/ | 04:50 |
| *** zhubingbing has quit IRC | 05:01 | |
| spsurya | Jeffrey4l: What should I set its priority as it is not occurring every time for docker 1.12.6 https://bugs.launchpad.net/kolla-ansible/+bug/1662598 | 05:10 |
| openstack | Launchpad bug 1662598 in kolla-ansible "upgrades fails while restarting some containers" [Undecided,Confirmed] | 05:10 |
| *** sbhojpur has joined #openstack-kolla | 05:16 | |
| *** huzhengchuan has joined #openstack-kolla | 05:20 | |
| *** randomhack has joined #openstack-kolla | 05:24 | |
| Jeffrey4l | inc0, yes. +2ed. but we'd better use boot-server in kolla too. | 05:26 |
| inc0 | not sure | 05:27 |
| inc0 | it doesn';t test containers | 05:27 |
| inc0 | and we test bootstrap in ansible gates | 05:27 |
| inc0 | these are just smoke test | 05:27 |
| Jeffrey4l | not test bootstrap ..just re-use the code. | 05:27 |
| inc0 | proper image testing will be in periodical publish gates | 05:27 |
| *** unicell has quit IRC | 05:28 | |
| inc0 | yeah maybe, we could get rid of installation of docker | 05:28 |
| inc0 | not sure | 05:28 |
| inc0 | anywya, my brain doesn't work now;) | 05:28 |
| Jeffrey4l | anyway, let's merge this patch and create b2 tag today. | 05:28 |
| Jeffrey4l | lol | 05:28 |
| inc0 | sure, thanks | 05:28 |
| inc0 | we'll also need to backport this patch to ocata | 05:29 |
| inc0 | speaking of which https://review.openstack.org/#/c/471401/ | 05:29 |
| *** randomhack has quit IRC | 05:29 | |
| inc0 | can you please review this too? | 05:29 |
| inc0 | because this change will run multinode gates every time https://review.openstack.org/#/c/471428/ | 05:29 |
| *** unicell has joined #openstack-kolla | 05:31 | |
| inc0 | good night everyone | 05:38 |
| Jeffrey4l | roger. | 05:40 |
| Jeffrey4l | good night. | 05:40 |
| openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Add zun log in fluentd https://review.openstack.org/472528 | 05:44 |
| *** huzhengchuan has quit IRC | 05:55 | |
| *** zhubingbing has joined #openstack-kolla | 06:16 | |
| zhubingbing | hi guys | 06:16 |
| *** jaosorior has joined #openstack-kolla | 06:18 | |
| *** randomhack has joined #openstack-kolla | 06:24 | |
| *** unicell has quit IRC | 06:25 | |
| *** unicell has joined #openstack-kolla | 06:25 | |
| *** jbadiapa_ has quit IRC | 06:28 | |
| *** randomhack has quit IRC | 06:28 | |
| *** japestinho has quit IRC | 06:32 | |
| *** skramaja is now known as skramaja_afk | 06:35 | |
| *** unicell has quit IRC | 06:35 | |
| *** unicell has joined #openstack-kolla | 06:36 | |
| *** manheim has joined #openstack-kolla | 06:42 | |
| *** manheim has quit IRC | 06:47 | |
| *** manheim has joined #openstack-kolla | 06:50 | |
| openstackgerrit | Martin André proposed openstack/kolla master: Clarify comment about swift-object-expirer for RDO https://review.openstack.org/472540 | 06:50 |
| *** salv-orlando has quit IRC | 06:52 | |
| *** salv-orlando has joined #openstack-kolla | 06:52 | |
| *** zhurong has quit IRC | 06:55 | |
| *** zhurong has joined #openstack-kolla | 06:56 | |
| *** shardy has joined #openstack-kolla | 06:56 | |
| *** zhurong has quit IRC | 06:57 | |
| *** emccormick has quit IRC | 06:59 | |
| *** jascott1_ has quit IRC | 06:59 | |
| *** jascott1 has joined #openstack-kolla | 07:00 | |
| *** zhubingbing has quit IRC | 07:01 | |
| *** jascott1 has quit IRC | 07:04 | |
| *** pcaruana has joined #openstack-kolla | 07:05 | |
| *** skramaja_afk is now known as skramaja | 07:16 | |
| *** zhubingbing_ has joined #openstack-kolla | 07:16 | |
| *** skramaja is now known as skramaja_afk | 07:30 | |
| *** rmart04 has joined #openstack-kolla | 07:34 | |
| *** msimonin has joined #openstack-kolla | 07:36 | |
| *** tumble has quit IRC | 07:39 | |
| *** egonzalez has joined #openstack-kolla | 07:41 | |
| *** karimb has joined #openstack-kolla | 07:47 | |
| *** manheim has quit IRC | 07:50 | |
| *** mandre is now known as mandre|away | 07:51 | |
| openstackgerrit | Merged openstack/kolla master: `[keystone]` should be `[keystone-base]` in doc https://review.openstack.org/472108 | 07:51 |
| *** caoyuan has quit IRC | 07:54 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Add zun log in fluentd https://review.openstack.org/472528 | 07:57 |
| *** jbadiapa_ has joined #openstack-kolla | 08:05 | |
| *** blallau has joined #openstack-kolla | 08:14 | |
| *** caoyuan has joined #openstack-kolla | 08:15 | |
| *** spsurya has quit IRC | 08:17 | |
| *** skramaja_afk is now known as skramaja | 08:17 | |
| *** msimonin has quit IRC | 08:31 | |
| *** msimonin has joined #openstack-kolla | 08:31 | |
| *** pbourke has quit IRC | 08:42 | |
| *** pbourke has joined #openstack-kolla | 08:42 | |
| *** denaitre has quit IRC | 08:48 | |
| duonghq | egonzalez, ping | 08:50 |
| egonzalez | duonghq, pong | 08:51 |
| duonghq | from last try, if we don't enable serial for keystone, what is the issue? | 08:51 |
| duonghq | I'm trying on ansible strategy | 08:51 |
| egonzalez | duonghq, that all keystone containers are restarted at the same time, and hence there is downtime there + the sort dowtime on contract step | 08:53 |
| duonghq | so, if I can hold other restart handler from execute for awhile, it should be fine? | 08:54 |
| duonghq | the problem is every task is run one-by-one, each after other? | 08:55 |
| openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Remove extra configuration item https://review.openstack.org/472595 | 09:03 |
| openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Remove extra configuration item https://review.openstack.org/472595 | 09:05 |
| openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Remove extra configuration item in solum.conf.j2 https://review.openstack.org/472595 | 09:05 |
| openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Remove extra configuration item in solum.conf.j2 https://review.openstack.org/472595 | 09:12 |
| zhubingbing_ | sup duonghq egonzalez | 09:13 |
| zhubingbing_ | ；） | 09:13 |
| zhubingbing_ | can u help me review it ？https://review.openstack.org/#/c/472595/ | 09:13 |
| duonghq | I'm reviewing | 09:14 |
| zhubingbing_ | thanks | 09:14 |
| zhubingbing_ | ;) | 09:14 |
| *** denaitre has joined #openstack-kolla | 09:15 | |
| *** omenv has joined #openstack-kolla | 09:15 | |
| *** omenv has quit IRC | 09:17 | |
| *** omenv has joined #openstack-kolla | 09:17 | |
| duonghq | zhubingbing_, can you answer my review? | 09:19 |
| zhubingbing_ | ok | 09:19 |
| *** mandre|away is now known as mandre | 09:23 | |
| zhubingbing_ | duonghq done | 09:25 |
| openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Remove extra configuration item in solum.conf.j2 https://review.openstack.org/472595 | 09:34 |
| openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Remove extra configuration item in solum.conf.j2 https://review.openstack.org/472595 | 09:35 |
| openstackgerrit | Merged openstack/kolla master: Fix kolla deploy gates https://review.openstack.org/471883 | 09:37 |
| *** msimonin has quit IRC | 09:38 | |
| duonghq | zhubingbing_, nice | 09:38 |
| zhubingbing_ | ;) | 09:38 |
| *** GonZo2K has joined #openstack-kolla | 09:40 | |
| *** GonZo2K has quit IRC | 09:40 | |
| *** GonZo2K has joined #openstack-kolla | 09:40 | |
| *** msimonin has joined #openstack-kolla | 09:41 | |
| *** msimonin1 has joined #openstack-kolla | 09:44 | |
| *** msimonin has quit IRC | 09:46 | |
| egonzalez | Jeffrey4l, gate fix was merged, guess we're ready to tag | 09:48 |
| *** athomas has joined #openstack-kolla | 09:51 | |
| duonghq | egonzalez, what is potential issue behind make enable serial per service? I notice that you mention duplicating tasks? | 09:54 |
| duonghq | is it from Jeffrey4l? | 09:54 |
| egonzalez | duonghq, have not tried yet, but maybe bootstrap tasks are executed on each serial | 09:55 |
| duonghq | what does "on each serial" mean? | 09:55 |
| *** zhurong has joined #openstack-kolla | 09:55 | |
| *** mgoddard has joined #openstack-kolla | 09:57 | |
| egonzalez | if there are 3 nodes, all 3 will execute the task | 10:00 |
| egonzalez | in their iteration (serial) | 10:00 |
| duonghq | egonzalez, roger | 10:01 |
| duonghq | will check | 10:01 |
| *** sambetts|afk is now known as sambetts | 10:04 | |
| *** zhurong has quit IRC | 10:06 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Remove extra configuration item in solum.conf.j2 https://review.openstack.org/472595 | 10:09 |
| serlex | hi, anyone using external dash with kolla+ceph | 10:10 |
| egonzalez | serlex, dash? | 10:12 |
| serlex | sorry, ceph dashboard* | 10:12 |
| serlex | I've deployed ceph with kolla(ocata) great work btw :D | 10:12 |
| *** sbhojpur has quit IRC | 10:13 | |
| serlex | Looking to monitoring ceph with some external gui to please some other users :) | 10:13 |
| *** skramaja is now known as skramaja_afk | 10:15 | |
| serlex | https://github.com/Crapworks/ceph-dash - there is already a docker image | 10:17 |
| egonzalez | that looks good, but isnt just grafana dashboard with telegraf for ceph? | 10:21 |
| *** kiennt26_ has joined #openstack-kolla | 10:23 | |
| serlex | Right, my bad, I see the options in global.yml | 10:23 |
| egonzalez | serlex, looking a bit more, it also have a rest api and some other features. the app look good | 10:27 |
| *** caowei has quit IRC | 10:27 | |
| serlex | I will test out grafana and telegraf for now. Enabled in globals, run deploy as normal? | 10:32 |
| openstackgerrit | Merged openstack/kolla master: Clarify comment about swift-object-expirer for RDO https://review.openstack.org/472540 | 10:42 |
| *** salv-orlando has quit IRC | 10:42 | |
| *** salv-orlando has joined #openstack-kolla | 10:43 | |
| hrw | does someone knows who is responsible for td-agent packages used to build fluentd images? | 10:44 |
| *** rods has joined #openstack-kolla | 10:44 | |
| reidrac | hrw: that comes from Treasure Data themselves, isn't it? | 10:45 |
| *** wahnsinn has joined #openstack-kolla | 10:45 | |
| *** lpetrut has joined #openstack-kolla | 10:45 | |
| hrw | reidrac: looks like. also looks a bit like 'we not quite know what we do' | 10:46 |
| reidrac | hrw: this is the repo they use to package: https://github.com/treasure-data/omnibus-td-agent you may be able to contact them there? | 10:46 |
| hrw | reidrac: thanks | 10:46 |
| reidrac | hrw: I'm no fan of that "omnibus" project to package things; I spent a couple of hours looking at that repo and it almost melted my brain | 10:47 |
| *** wahnsinn has quit IRC | 10:47 | |
| reidrac | hrw: looking at the resulting CentOS RPM (that btw includes a complete ruby 2.1 install); I can't really understand how it works | 10:47 |
| *** salv-orlando has quit IRC | 10:47 | |
| hrw | reidrac: cbs.centos.org has nicer packages ;D | 10:48 |
| reidrac | hrw: there's a PR that intends to use the OSS fluend bits via OpsTools CentOS SiG packages, instead of that td-agent | 10:48 |
| reidrac | hrw: but I'm not sure how equivalent the result is; the RPM has some CLI tools and stuff that it didn't look to me like is available on the fluentd repo; but may be I didn't put enough time on this | 10:49 |
| hrw | I may be old and grumpy but I just dislike a direction software nowadays goes. | 10:50 |
| hrw | all those "let us fetch important part from random space" ways | 10:50 |
| reidrac | hrw: so I'm happy to help to move from td-agent to the OSS fluentd | 10:51 |
| hrw | reidrac: Debian/Ubuntu lack fluentd package ;( | 10:51 |
| reidrac | yes, I feel the same. I kind of love the power of knowing I can fetch a tgz and get to the same place; all that blackbox "fetch this, no questions asked" | 10:52 |
| reidrac | hrw: I think it is mainly for how td-agent packaging is managed; same for SUSE | 10:53 |
| reidrac | hrw: FYI this is the PR https://review.openstack.org/467219 | 10:53 |
| reidrac | if that one succeeds, it should be possible to reproduce the same for other distros; IMHO better than current situation with td-agent | 10:54 |
| hrw | reviewing | 10:55 |
| reidrac | it is WIP though | 10:56 |
| hrw | which does not mean 'do not review it please' ;D | 10:57 |
| hrw | snet | 10:58 |
| reidrac | sure :) | 10:58 |
| hrw | the fun is that td-agent is noarch stuff | 11:00 |
| hrw | the blocker is shitty packaging | 11:00 |
| *** jascott1 has joined #openstack-kolla | 11:01 | |
| *** jascott1 has quit IRC | 11:06 | |
| *** karimb has quit IRC | 11:07 | |
| *** rwallner has joined #openstack-kolla | 11:07 | |
| *** karimb has joined #openstack-kolla | 11:15 | |
| *** ducttape_ has joined #openstack-kolla | 11:18 | |
| *** ducttape_ has quit IRC | 11:23 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible stable/ocata: Remove extra configuration item in solum.conf.j2 https://review.openstack.org/472647 | 11:25 |
| *** rwallner has quit IRC | 11:25 | |
| *** zhubingbing_ has quit IRC | 11:26 | |
| *** rwallner has joined #openstack-kolla | 11:29 | |
| *** jmccarthy has joined #openstack-kolla | 11:58 | |
| jmccarthy | Hmm is https://review.openstack.org/#/c/453738/19 ready to go ? :) | 12:00 |
| openstackgerrit | Dennis Mueller proposed openstack/kolla-ansible master: Added neutron metering-agent support https://review.openstack.org/445858 | 12:01 |
| *** ducttape_ has joined #openstack-kolla | 12:02 | |
| *** imcsk8 has quit IRC | 12:03 | |
| *** skramaja_afk has quit IRC | 12:03 | |
| *** lpetrut has quit IRC | 12:06 | |
| *** ducttape_ has quit IRC | 12:07 | |
| *** shardy has quit IRC | 12:08 | |
| *** imcsk8 has joined #openstack-kolla | 12:11 | |
| *** emccormick has joined #openstack-kolla | 12:14 | |
| *** manheim has joined #openstack-kolla | 12:16 | |
| *** lpetrut has joined #openstack-kolla | 12:16 | |
| *** shardy has joined #openstack-kolla | 12:17 | |
| *** manheim has quit IRC | 12:20 | |
| *** manheim has joined #openstack-kolla | 12:20 | |
| *** ducttape_ has joined #openstack-kolla | 12:21 | |
| *** ducttap__ has joined #openstack-kolla | 12:22 | |
| *** ducttap__ has quit IRC | 12:22 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible master: Enable cluster trust for Magnum service https://review.openstack.org/472658 | 12:23 |
| *** schwicht has joined #openstack-kolla | 12:23 | |
| *** hrw has quit IRC | 12:25 | |
| *** ducttape_ has quit IRC | 12:25 | |
| *** hrw has joined #openstack-kolla | 12:27 | |
| *** randomhack has joined #openstack-kolla | 12:31 | |
| *** schwicht has quit IRC | 12:31 | |
| manheim | hello | 12:34 |
| *** schwicht has joined #openstack-kolla | 12:35 | |
| *** jaosorior has quit IRC | 12:37 | |
| *** awidders_ has quit IRC | 12:38 | |
| *** dave-mccowan has joined #openstack-kolla | 12:43 | |
| *** shardy has quit IRC | 12:43 | |
| openstackgerrit | Paul Bourke (pbourke) proposed openstack/kolla-ansible master: Revert "Avoid facts gathered twice when deploying with --limit" https://review.openstack.org/472660 | 12:44 |
| egonzalez | pbourke, maybe the fix for ^^ is https://review.openstack.org/#/c/470291/ | 12:46 |
| Jeffrey4l | egonzalez, got. | 12:46 |
| pbourke | egonzalez: I'll try it | 12:46 |
| * Jeffrey4l is preparing tags. | 12:46 | |
| pbourke | egonzalez: seems to work, thanks | 12:47 |
| pbourke | egonzalez: is it better than a simple revert though? | 12:47 |
| *** ducttape_ has joined #openstack-kolla | 12:48 | |
| *** schwicht has quit IRC | 12:51 | |
| egonzalez | pbourke, yeah, I think there is a missunderstanding of the first task, when used --limit, the first task will get facts for the limited host and the second for all other hosts in the inventory | 12:52 |
| egonzalez | pbourke, i think is better revert | 12:52 |
| *** emccormick has quit IRC | 12:52 | |
| *** ducttape_ has quit IRC | 12:53 | |
| *** eanylin has quit IRC | 12:53 | |
| *** goldyfruit has joined #openstack-kolla | 12:55 | |
| *** shardy has joined #openstack-kolla | 12:56 | |
| *** cuongnv has quit IRC | 12:57 | |
| *** mgoddard has quit IRC | 12:59 | |
| *** emccormick has joined #openstack-kolla | 13:02 | |
| *** omenv has quit IRC | 13:02 | |
| *** lucasxu has joined #openstack-kolla | 13:03 | |
| manheim | is there an known issue with starting the DB contaienr in kolla-k8s? | 13:04 |
| manheim | https://paste.ubuntu.com/24815287/ | 13:05 |
| manheim | sometimes mariadb-init-element-2rzg6 container will start running, but the first one will not | 13:05 |
| *** ducttape_ has joined #openstack-kolla | 13:05 | |
| rwellum | That's been stable for me manheim | 13:05 |
| rwellum | kubectl describe po mariadb-init-element-2rzg6 | 13:06 |
| manheim | https://paste.ubuntu.com/24815346/ | 13:07 |
| *** lpetrut_ has joined #openstack-kolla | 13:08 | |
| manheim | logs | 13:08 |
| manheim | https://paste.ubuntu.com/24815350/ | 13:08 |
| manheim | why is there an init pod? i thought there were init container for a pod | 13:10 |
| *** rwallner has quit IRC | 13:10 | |
| *** ducttape_ has quit IRC | 13:12 | |
| rwellum | Not much there to help, you say it's intermittent? Is this in a VM? | 13:13 |
| *** rwallner has joined #openstack-kolla | 13:13 | |
| manheim | yes, ubuntu VM | 13:13 |
| rwellum | Memory ok? I always use Centos so far so maybe this is ubunut specific. | 13:13 |
| manheim | yes, sometimes the pod will run for a while | 13:14 |
| manheim | memory is fine, gave it 16gb ram, and the DB pod is the first i start | 13:15 |
| manheim | so nothing for memory preasure | 13:15 |
| *** eanylin has joined #openstack-kolla | 13:15 | |
| *** lucasxu has quit IRC | 13:16 | |
| *** ducttape_ has joined #openstack-kolla | 13:16 | |
| *** ducttape_ has quit IRC | 13:16 | |
| rwellum | Might need kfox1111 or sdake to look - I know I need to learn more about how to debug these issues... | 13:17 |
| *** ducttape_ has joined #openstack-kolla | 13:17 | |
| manheim | heh, so do I, ty :D | 13:17 |
| *** schwicht has joined #openstack-kolla | 13:17 | |
| *** ducttape_ has quit IRC | 13:21 | |
| *** mgoddard has joined #openstack-kolla | 13:27 | |
| *** sbezverk has joined #openstack-kolla | 13:28 | |
| *** vhosakot has joined #openstack-kolla | 13:28 | |
| *** daidv_ has joined #openstack-kolla | 13:28 | |
| openstackgerrit | Anthony Lin proposed openstack/kolla-kubernetes master: Remove kolla-ansible dependencies https://review.openstack.org/467767 | 13:29 |
| *** rwallner has quit IRC | 13:33 | |
| openstackgerrit | Matthieu Simonin proposed openstack/kolla-ansible master: Fix openvswitch-agents when enable_nova_fake=true https://review.openstack.org/472681 | 13:35 |
| *** rmart04 has quit IRC | 13:35 | |
| Reepicheep | hmm. I think I may have figured out why my kolla-ansible takes so long to run on my instances | 13:36 |
| *** serlex has quit IRC | 13:36 | |
| Reepicheep | it seems to take a long time on "Gathering Facts" | 13:36 |
| Reepicheep | http://docs.ansible.com/ansible/setup_module.html "If facter or ohai are installed, variables from these programs will also be snapshotted" | 13:37 |
| Reepicheep | I have facter installed on the nodes because I bootstrapped them with puppet :| | 13:37 |
| Reepicheep | is there a way I can have kolla-ansible not look to use facter? | 13:38 |
| Reepicheep | ansible all -m setup -a 'gather_subset=!facter,!ohai' | 13:38 |
| pbourke | can I get reviews please on https://review.openstack.org/#/c/453738/ and it's dependant patch | 13:39 |
| *** emccormick has quit IRC | 13:39 | |
| pbourke | duonghq: blallau: egonzalez: Jeffrey4l: inc0: akwasnie: Daviey: mandre: vhosakot: berendt: ^^ | 13:42 |
| vhosakot | cool work pbourke, I'll check it today :) | 13:43 |
| pbourke | thanks vhosakot sorry for mass ping ;) | 13:43 |
| vhosakot | pbourke: np :) | 13:43 |
| *** emccormick has joined #openstack-kolla | 13:45 | |
| *** srwilkers has joined #openstack-kolla | 13:46 | |
| *** bmaltais has joined #openstack-kolla | 13:46 | |
| *** janki has quit IRC | 13:47 | |
| bmaltais | Good morning all. I have a question regarding keystone token | 13:47 |
| bmaltais | I noticed a large file growing out of control on a controller. It happen to be the token table. | 13:48 |
| *** caoyuan_ has joined #openstack-kolla | 13:48 | |
| bmaltais | Searching for this issue many recommend not to use mariadb to store token and rather use memche | 13:48 |
| bmaltais | Trying to change the config in keystone.conf resulted in the inability to login to horizon. Any recommendations on this? | 13:49 |
| bmaltais | Anyone else running in this issue of growing mariadb token table? | 13:49 |
| *** eaguilar has joined #openstack-kolla | 13:49 | |
| *** caoyuan has quit IRC | 13:52 | |
| *** sbezverk has quit IRC | 13:53 | |
| *** serlex has joined #openstack-kolla | 13:54 | |
| berendt | sdake: regarding the bug report you mentioned yesterday, i think i implemented some kind of quick & dirty solution for this issue, i will try to figure out how we did it on Monday and will add a note to the bug report | 13:56 |
| *** jaosorior has joined #openstack-kolla | 13:56 | |
| Jeffrey4l | inc0, please check https://review.openstack.org/472672 and https://review.openstack.org/472671 release b2 patch. | 14:02 |
| *** athomas has quit IRC | 14:03 | |
| *** lucasxu has joined #openstack-kolla | 14:09 | |
| *** jamesbenson has joined #openstack-kolla | 14:13 | |
| *** lucasxu has quit IRC | 14:14 | |
| *** rwallner has joined #openstack-kolla | 14:14 | |
| *** lucasxu has joined #openstack-kolla | 14:14 | |
| *** eaguilar_ has joined #openstack-kolla | 14:15 | |
| *** lucasxu has quit IRC | 14:16 | |
| *** eaguilar has quit IRC | 14:17 | |
| jamesbenson | morning all :-) | 14:17 |
| *** lucasxu has joined #openstack-kolla | 14:20 | |
| manheim | hi | 14:21 |
| manheim | Error from server (BadRequest): container "main" in pod "mariadb-0" is waiting to start: PodInitializing | 14:21 |
| manheim | this is why the db pod is not starting | 14:21 |
| *** lucasxu has quit IRC | 14:23 | |
| *** manheim_ has joined #openstack-kolla | 14:28 | |
| pbourke | bmaltais: memcache for keystone should work out of the box | 14:35 |
| pbourke | bmaltais: have you deployed it? | 14:35 |
| *** salv-orlando has joined #openstack-kolla | 14:42 | |
| *** salv-orl_ has joined #openstack-kolla | 14:44 | |
| *** ducttape_ has joined #openstack-kolla | 14:44 | |
| *** ducttape_ has quit IRC | 14:46 | |
| *** ducttape_ has joined #openstack-kolla | 14:46 | |
| *** salv-orlando has quit IRC | 14:48 | |
| *** jbadiapa_ has quit IRC | 14:51 | |
| *** caoyuan_ has quit IRC | 14:51 | |
| *** caoyuan_ has joined #openstack-kolla | 14:51 | |
| *** egonzalez has quit IRC | 14:52 | |
| *** kbaegis has joined #openstack-kolla | 14:52 | |
| -openstackstatus- NOTICE: The Gerrit service on review.openstack.org is being restarted now to clear an issue arising from an unanticipated SSH API connection flood | 14:56 | |
| *** ephracis_ has joined #openstack-kolla | 14:59 | |
| *** caoyuan has joined #openstack-kolla | 15:01 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible stable/ocata: Fix Grafana config file template to use variables https://review.openstack.org/462161 | 15:02 |
| inc0 | Jeffrey4l: thanks, reviewed, how about 4.0.2? | 15:03 |
| Jeffrey4l | will release after b2 is merged. | 15:03 |
| Jeffrey4l | is that ok?> | 15:03 |
| inc0 | sure, but I don't think they're related | 15:03 |
| inc0 | but that's fine, go to your weekend;) | 15:04 |
| inc0 | just let's make sure it happens next week ok? | 15:04 |
| *** caoyuan_ has quit IRC | 15:04 | |
| Jeffrey4l | no problem. | 15:04 |
| inc0 | thanks | 15:05 |
| *** jaosorior has quit IRC | 15:09 | |
| sdake | sup Jeffrey4l | 15:09 |
| sdake | su inc0 | 15:09 |
| Jeffrey4l | sup sdake | 15:10 |
| *** hongbin has joined #openstack-kolla | 15:11 | |
| *** jmccarthy has left #openstack-kolla | 15:13 | |
| *** salv-orl_ has quit IRC | 15:16 | |
| *** salv-orlando has joined #openstack-kolla | 15:17 | |
| *** salv-orlando has quit IRC | 15:20 | |
| *** jbadiapa has joined #openstack-kolla | 15:21 | |
| *** blallau has quit IRC | 15:21 | |
| manheim | https://paste.ubuntu.com/24815995/ | 15:21 |
| inc0 | manheim: how was your prezentation? | 15:22 |
| manheim | mariadb pod got stuck in the main container | 15:22 |
| manheim | it was nice, waiting for the video | 15:22 |
| manheim | was full room | 15:22 |
| inc0 | cool | 15:22 |
| inc0 | ! | 15:22 |
| manheim | sadly one of my demo envs went down | 15:22 |
| manheim | but ppl got the idea | 15:22 |
| manheim | photos are on twitter if you wanna share them :D | 15:23 |
| inc0 | you demoed hyperv or general Kolla? | 15:23 |
| manheim | general kolla | 15:23 |
| inc0 | yeah, totally, what's your handle? | 15:23 |
| manheim | @DomnulDan | 15:23 |
| inc0 | got it, also I agree on Andromeda | 15:24 |
| manheim | heh :D | 15:24 |
| inc0 | I was worried from beggining that they're reanimating series in strange way | 15:24 |
| *** spsurya has joined #openstack-kolla | 15:26 | |
| *** unicell has quit IRC | 15:26 | |
| spsurya | sup all | 15:26 |
| *** unicell has joined #openstack-kolla | 15:26 | |
| inc0 | can I have review plz? https://review.openstack.org/#/c/471401/ | 15:30 |
| *** manheim has quit IRC | 15:33 | |
| *** manheim_ is now known as manheim | 15:33 | |
| pbourke | inc0: want me to approve? | 15:37 |
| inc0 | pbourke: well, if you agree with a change;) | 15:37 |
| *** rwallner has quit IRC | 15:37 | |
| inc0 | but we'll need it soon because change that will make multinode non-experimental is already up:) | 15:37 |
| *** itlinux has joined #openstack-kolla | 15:40 | |
| *** itlinux_ has joined #openstack-kolla | 15:40 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/ocata: Enable multinode gate https://review.openstack.org/471401 | 15:41 |
| *** emccormick has quit IRC | 15:44 | |
| openstackgerrit | Dave McCowan proposed openstack/kolla-kubernetes master: Add double colon in deployment guide https://review.openstack.org/472739 | 15:47 |
| *** emccormick has joined #openstack-kolla | 15:52 | |
| *** egonzalez has joined #openstack-kolla | 15:54 | |
| *** salv-orlando has joined #openstack-kolla | 15:55 | |
| *** jascott1 has joined #openstack-kolla | 15:55 | |
| openstackgerrit | Paul Bourke (pbourke) proposed openstack/kolla-ansible master: Add a new 'outward' rabbitmq instance https://review.openstack.org/453738 | 15:57 |
| *** k_mouza has joined #openstack-kolla | 15:58 | |
| *** omenv has joined #openstack-kolla | 15:59 | |
| *** jbadiapa has quit IRC | 16:01 | |
| *** jascott1 has quit IRC | 16:02 | |
| *** manheim_ has joined #openstack-kolla | 16:03 | |
| *** mgoddard has quit IRC | 16:06 | |
| *** manheim_ has quit IRC | 16:08 | |
| *** itlinux has quit IRC | 16:09 | |
| *** itlinux_ has quit IRC | 16:09 | |
| *** lpetrut has quit IRC | 16:10 | |
| *** lpetrut_ has quit IRC | 16:10 | |
| *** msimonin1 has quit IRC | 16:13 | |
| *** jascott1 has joined #openstack-kolla | 16:14 | |
| *** lpetrut_ has joined #openstack-kolla | 16:14 | |
| *** zhubingbing has joined #openstack-kolla | 16:15 | |
| *** lpetrut has joined #openstack-kolla | 16:19 | |
| *** sbezverk has joined #openstack-kolla | 16:23 | |
| *** eaguilar_ has quit IRC | 16:26 | |
| openstackgerrit | Merged openstack/kolla-kubernetes master: Add double colon in deployment guide https://review.openstack.org/472739 | 16:33 |
| *** pcaruana has quit IRC | 16:34 | |
| serlex | "Secret not found: no uuid..." when attaching volume (ceph) to an instance...anyone seen that? | 16:36 |
| *** jtriley has joined #openstack-kolla | 16:37 | |
| serlex | I see its talked about here - http://eavesdrop.openstack.org/irclogs/%23openstack-kolla/%23openstack-kolla.2017-04-10.log.html | 16:37 |
| serlex | but I can't see if it was resolved | 16:37 |
| *** rwallner has joined #openstack-kolla | 16:37 | |
| *** manheim has quit IRC | 16:38 | |
| serlex | kfox1111 ping | 16:38 |
| *** jtriley has quit IRC | 16:39 | |
| *** rwallner has quit IRC | 16:42 | |
| jamesbenson | inc0: I think there is a problem with the horizon image. apache2 doesn't seem to start | 16:42 |
| jamesbenson | or has issues | 16:42 |
| inc0 | hmm | 16:42 |
| inc0 | if horizon container is running, process should be up? | 16:42 |
| jamesbenson | horizon is running, and inside of the docker, i don't see any errors under the /var/logs/apache2 | 16:43 |
| inc0 | what do you see? | 16:43 |
| jamesbenson | ps auxw shows horizon is running | 16:43 |
| jamesbenson | http://paste.openstack.org/show/612154/. | 16:44 |
| jamesbenson | This is the error I see when I curl the external IP or internal | 16:45 |
| inc0 | you sure there is no error anywhere? | 16:45 |
| inc0 | this is 500 which means somethgin should land in apache log | 16:45 |
| inc0 | check error.log inside container | 16:46 |
| jamesbenson | http://paste.openstack.org/show/612155/ | 16:47 |
| *** jtriley has joined #openstack-kolla | 16:47 | |
| jamesbenson | that's the complete apache2/error.log | 16:48 |
| inc0 | that's strange, which file are you looking at? full path and if you're looking inside container | 16:49 |
| inc0 | also check ss -plant please | 16:49 |
| jamesbenson | inside of the horizon container: (horizon)[root@r2-710-6 /]# cat /var/log/apache2/error.log | 16:49 |
| inc0 | ok, check /var/log/kolla | 16:49 |
| *** tvignaud has quit IRC | 16:49 | |
| inc0 | (afair) | 16:50 |
| *** jtriley has quit IRC | 16:50 | |
| inc0 | or /var/lib/docker/volumes/kolla_logs on host | 16:50 |
| inc0 | (that's how I get to logs) | 16:50 |
| jamesbenson | ss -plant inside of the container? And /var/log/kolla on the host? | 16:50 |
| inc0 | no, on host it's var/lib... | 16:50 |
| inc0 | ss -plant will be the same both in and out of container | 16:51 |
| *** msimonin has joined #openstack-kolla | 16:51 | |
| jamesbenson | ss -plant: http://paste.openstack.org/show/612156/ | 16:51 |
| *** jtriley has joined #openstack-kolla | 16:51 | |
| jamesbenson | here is /var/lib/docker/volumes/kolla_logs/_data/horizon/horizon.log ... there is no error.log | 16:53 |
| jamesbenson | http://paste.openstack.org/show/612157/ | 16:53 |
| inc0 | yeah, that's the issue | 16:54 |
| jamesbenson | ? | 16:54 |
| inc0 | god I forgot what was timezone issue, I think you need to rebuild | 16:55 |
| jamesbenson | should I set the timezone? sudo timedatectl set-timezone America/Chicago | 16:55 |
| inc0 | not sure tbh | 16:56 |
| inc0 | I'm trying to figure out what was issue | 16:56 |
| inc0 | I've seen this | 16:56 |
| kolla-slack | <kfox1111> Serlex usually an issue with the libvirt secret. | 16:57 |
| SamYaple | horizon container should be in UTC timezone | 16:57 |
| SamYaple | there is an option per user to set the timezone in horizon itself | 16:57 |
| inc0 | yeah | 16:57 |
| SamYaple | you can set the default timezone in horizon config | 16:57 |
| inc0 | and I think we set it up wrong | 16:57 |
| kolla-slack | <kfox1111> Virsh secret list should show it. | 16:57 |
| inc0 | https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/horizon/templates/local_settings.j2#L428 | 16:57 |
| SamYaple | yea sometime after i left /etc/localtime started getting mapped into all containers | 16:58 |
| SamYaple | it might be in the horizon container too | 16:58 |
| SamYaple | it hsouldnt be | 16:58 |
| egonzalez | ubuntu images made a cleanup and removed timezone and locales from docker images | 16:59 |
| inc0 | https://stackoverflow.com/questions/5750150/invalid-django-time-zone try to change UTC to something like America/New_York | 16:59 |
| egonzalez | https://review.openstack.org/#/c/460770/ | 16:59 |
| *** unicell has quit IRC | 16:59 | |
| inc0 | right | 16:59 |
| inc0 | did we backport it to stable? | 16:59 |
| egonzalez | yep | 17:00 |
| inc0 | ok, that's why we need fresh images;) | 17:00 |
| sdake | sbezverk - keystone.all must have port:5000 set in order for cell0 to work | 17:00 |
| serlex | secret-list is empty, not sure which bit of the doc I missed | 17:00 |
| inc0 | thanks egonzalez | 17:00 |
| *** rwallner has joined #openstack-kolla | 17:01 | |
| sdake | sbezverk I am not sure why this is other then the port is not specified int he url in the bash script that is run in the sleep loop | 17:01 |
| jamesbenson | but I built these images not long ago... | 17:01 |
| jamesbenson | maybe a week, 2 tops. | 17:01 |
| sbezverk | sdake: sorry I do not get your point. check for keystone availability comes way way before cell0 | 17:02 |
| sbezverk | sdake: why do not you state the problem rather? | 17:02 |
| jamesbenson | weird.. | 17:03 |
| sdake | the problem is as follows | 17:03 |
| egonzalez | jamesbenson using kolla installed with pip or from git repo? pip version not have the fix yet | 17:03 |
| sdake | if i do not set globals.keystone.alll.port to 5000 in cloud.yaml | 17:03 |
| jamesbenson | ah, okay. Pip install.. | 17:03 |
| sdake | cell0 stays in 2/3 state and never finishes | 17:03 |
| jamesbenson | thanks egonzalez | 17:03 |
| jamesbenson | how far behind does pip lag? | 17:03 |
| *** bmace has quit IRC | 17:04 | |
| sdake | sbezverk ^^ | 17:04 |
| *** bmace has joined #openstack-kolla | 17:04 | |
| sbezverk | sdake: the next question would be, what it is waiting for? you know the drill right? | 17:05 |
| sdake | sbezverk if you look atyour commit - you will see you set port:5000 in your cell0 work | 17:05 |
| sdake | i know what it is wiating for | 17:05 |
| sdake | i ahve debugged it | 17:05 |
| sdake | the url that goes into the shell script is | 17:05 |
| sdake | http://url:/v3 | 17:05 |
| sdake | isntead of http:/url:5000/v3 | 17:05 |
| sdake | url:/v3 causes openstack cli to implode | 17:05 |
| sdake | it endlessly loops | 17:05 |
| sdake | openstack's keystone module cannot determine the proper authentication endpoint | 17:06 |
| sdake | with url:/v3 | 17:06 |
| sbezverk | sdake: that is happne because YOUR cloud.yaml is wrong | 17:06 |
| sdake | just t o confirm | 17:06 |
| *** tvignaud has joined #openstack-kolla | 17:06 | |
| sdake | your suggesting keystone.port shoudl always be defined as 5000 | 17:06 |
| sbezverk | sdake: the code works in the gate, right? | 17:07 |
| sdake | and the defaults don't work? | 17:07 |
| sdake | sbezverk moment | 17:07 |
| sdake | sbezverk the reason it works in the gat eis you set keystone.port to 5000 in cloud.yaml | 17:07 |
| sbezverk | look for issue in your cloud.yaml | 17:07 |
| sdake | my expectation would be that you need not set port 5000 in cloud.yaml | 17:07 |
| sdake | in your patchset where ou introduce dthe feature, you hardcode port:5000 in cloud.yaml | 17:08 |
| sdake | so of course it works iin teh gate | 17:08 |
| sdake | as its hard coded | 17:08 |
| egonzalez | jamesbenson not sure when kolla 4.0.2 is released | 17:08 |
| jamesbenson | egonzalez: no worries | 17:09 |
| jamesbenson | thanks :-) | 17:09 |
| jamesbenson | inc0: Once I set the timezone, do I restart the container or apache? | 17:09 |
| sdake | should it not work without that port hardcode (and use the keystone port that is the default?) | 17:09 |
| inc0 | jamesbenson: you need new containers | 17:09 |
| sbezverk | sdake: as you know port 5000 IS available everywhere and in addition by specifying a variable it can be overridden | 17:09 |
| sdake | sbezverk ok dude | 17:09 |
| sdake | sbezverk look at your change | 17:10 |
| sdake | sbezverk you hardcode port:5000 | 17:10 |
| sdake | why do you do that? | 17:10 |
| jamesbenson | inc0: kolla-build -t source -b ubuntu --registry 127.0.0.1:4000 --push horizon | 17:10 |
| sdake | sbezverk if you take that hardcode out of yoru patch, the gate will not work | 17:11 |
| inc0 | jamesbenson: well you did pip install kolla right | 17:11 |
| inc0 | ? | 17:11 |
| jamesbenson | yes | 17:11 |
| inc0 | you need latest stable git | 17:11 |
| jamesbenson | okay | 17:11 |
| inc0 | we release 4.0.2 next week | 17:12 |
| inc0 | early | 17:12 |
| inc0 | this bugfix will ship then | 17:12 |
| jamesbenson | pip install git+https://github.com/openstack/kolla-ansible.git@master | 17:12 |
| inc0 | kolla too | 17:12 |
| inc0 | pip install git+https://github.com/openstack/kolla.git@stable/ocata | 17:12 |
| inc0 | you want ocata right? | 17:12 |
| serlex | I see secret bit is part of deploy, redeploying | 17:13 |
| jamesbenson | yeah | 17:13 |
| sbezverk | sdake: can you get me the link please? | 17:14 |
| jamesbenson | inc0: you said I need the latest stable kolla and kolla-ansible? | 17:14 |
| inc0 | just kolla, but best both | 17:14 |
| inc0 | yes | 17:14 |
| jamesbenson | ok | 17:15 |
| inc0 | release will land next week, then just regular pip install will work | 17:15 |
| sdake | sbezverk https://review.openstack.org/#/c/469963/13/tests/bin/common_workflow_config.sh | 17:15 |
| sdake | if you remove that port:5000 deploy fails 100% | 17:15 |
| jamesbenson | okay, I'm installing both of them | 17:15 |
| jamesbenson | then do a full rebuild of all of my images or just kolla? | 17:15 |
| *** iniazi_ has quit IRC | 17:16 | |
| jamesbenson | err sorry, horizon | 17:16 |
| jamesbenson | not kolla | 17:16 |
| sbezverk | sdake: man, you are amazing.. This file is customize it for the gate only!!! When you deploy it in your environment, you just change it in cloud.yaml. | 17:17 |
| sbezverk | and provide the parameter which ever you want.. | 17:17 |
| sbezverk | the code will use what ever port you use assigned for that variable | 17:19 |
| *** tonanhngo has joined #openstack-kolla | 17:21 | |
| sdake | sbezverk i think your not listening | 17:21 |
| sdake | sbezverk let me explain it clealry | 17:21 |
| sdake | if port:5000 is not present | 17:21 |
| sdake | kolla does not deploy | 17:21 |
| sdake | if port:666 is not present | 17:21 |
| sdake | kolla does not deploy | 17:21 |
| sdake | port:5000 is a MANDATORY field in cloud.yaml las a result of yoru change | 17:22 |
| sdake | i dont think this should be the case | 17:22 |
| sdake | i htink it should use the defaults | 17:22 |
| sdake | the default for keystone is 5000, - this default is not being honored in your change | 17:23 |
| sbezverk | sdake: we should be able to override for flexibility | 17:23 |
| sdake | i totally agree override | 17:23 |
| sdake | however, take that field out | 17:23 |
| sdake | and it is set to "" | 17:23 |
| sdake | in the scripts that are run | 17:23 |
| sbezverk | sdake: problem keeping this field? | 17:24 |
| sdake | in other words, if port isn't present, the url that gets constructed is incorrect | 17:24 |
| sdake | the problem is that the field must now be ALWAYS specified in cloud.yaml | 17:24 |
| sbezverk | sdake: if you do not specify some values the solution will not work | 17:24 |
| sbezverk | as bunch of other things | 17:25 |
| sdake | i agree - so your position is that port in keystone is a mandatory key in cloud.yaml? | 17:25 |
| sdake | if port is now mandatory in keystone.all - that is fine | 17:26 |
| sdake | however i dont understand why it should be mandatory | 17:26 |
| sbezverk | sdake: for the sake of flexibility (few messages ago you were complaining about me hardcoding something) I think keep this fieald | 17:26 |
| sdake | you didn't answer my quetion | 17:26 |
| sdake | my question (yes or no answer) is keystone.all.port a mandatory field in cloud.yaml) | 17:26 |
| sbezverk | sdake: I think keeping this field is worth extra 5 bytes in cloud.yaml | 17:27 |
| sbezverk | yes | 17:27 |
| sdake | why can't it nto use the defaults already specified for port? | 17:27 |
| sdake | (with overrides if needed of course) | 17:28 |
| sdake | here is what i don't understand - the port for keystone is already defaulted to 5000 - why can't that default be used if cloud.yaml override not specifie? | 17:29 |
| sbezverk | sdake: mostly likely adding fall back to default is doable | 17:29 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Add mandatory field to deployment document https://review.openstack.org/472764 | 17:31 |
| *** iniazi has joined #openstack-kolla | 17:37 | |
| *** lpetrut has quit IRC | 17:44 | |
| *** lpetrut has joined #openstack-kolla | 17:46 | |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable fact checking when using tags https://review.openstack.org/472768 | 17:47 |
| sdake | on a different topic - sambetts came up with this approach to synchronization: https://kubernetes.io/docs/concepts/workloads/pods/init-containers/#examples | 17:47 |
| sdake | (to rid ourselves of the need for entrypoint entirely) | 17:48 |
| *** salv-orlando has quit IRC | 17:50 | |
| *** salv-orlando has joined #openstack-kolla | 17:51 | |
| *** ducttape_ has quit IRC | 17:52 | |
| serlex | thanks kfox1111 - repdeloy reinstated my secret files, not sure how they disappeared though | 17:53 |
| sbezverk | sdake: re sambetts idea, not newwe talked about similar approach in the past, how do you track socket avilability verification with this approach> | 17:54 |
| sdake | yup thats a problem | 17:54 |
| *** salv-orlando has quit IRC | 17:55 | |
| *** rwallner has quit IRC | 17:56 | |
| *** sbezverk has quit IRC | 17:56 | |
| *** sbezverk has joined #openstack-kolla | 17:57 | |
| *** rwallner has joined #openstack-kolla | 17:59 | |
| *** vhosakot has quit IRC | 18:04 | |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable multi-scenerio gates https://review.openstack.org/466815 | 18:06 |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable deploying ceph on loopback devices https://review.openstack.org/472771 | 18:06 |
| *** eaguilar has joined #openstack-kolla | 18:07 | |
| *** omenv has quit IRC | 18:08 | |
| *** vhosakot has joined #openstack-kolla | 18:13 | |
| *** k_mouza has quit IRC | 18:15 | |
| *** sbezverk has quit IRC | 18:22 | |
| *** rwallner has quit IRC | 18:22 | |
| *** srwilkers has quit IRC | 18:25 | |
| *** vhosakot has quit IRC | 18:26 | |
| *** vhosakot has joined #openstack-kolla | 18:27 | |
| *** srwilkers has joined #openstack-kolla | 18:33 | |
| *** rwallner has joined #openstack-kolla | 18:34 | |
| sdake | inc0 are the kolla and kolla-ansible gates functional atm? | 18:35 |
| sdake | in other words, are we tagging 4.0.2? | 18:35 |
| inc0 | sdake: look at infra | 18:36 |
| inc0 | gates are down in kolla-ansible because we tagged 5.0.0b2 | 18:36 |
| inc0 | but I just workflowed a change so if it merges that will get fixed | 18:36 |
| sdake | and then we can tag 4.0.2? | 18:37 |
| inc0 | next week 4.0.2 | 18:37 |
| sdake | thanks | 18:37 |
| sdake | inc0 do you know where the git upstream is for entrypoint | 18:38 |
| sdake | coreos namespace? | 18:38 |
| sdake | my galaxys8+ arrived, and the fedex dude didn't ring the doorbell | 18:40 |
| sdake | and instead filled out a pick me up later tag | 18:40 |
| sdake | yo uwould think it would be less work to ring the doorbell | 18:40 |
| * sdake nerd raging today | 18:40 | |
| inc0 | no, it's there: https://github.com/stackanetes/kubernetes-entrypoint | 18:41 |
| inc0 | it's dead :( | 18:41 |
| sdake | thanks | 18:41 |
| inc0 | we probably need to rewrite it and let's do it in python | 18:42 |
| sdake | yes | 18:43 |
| sdake | and yes | 18:43 |
| sdake | may need a fresh repo for it | 18:43 |
| sdake | thoughts? | 18:44 |
| sdake | will take months to implement i suspect :( | 18:44 |
| *** zhubingbing has quit IRC | 18:47 | |
| inc0 | it's not that complex | 18:47 |
| *** zhubingbing has joined #openstack-kolla | 18:47 | |
| inc0 | portdirect: you guys are interested too | 18:47 |
| inc0 | wanna kick this off? | 18:47 |
| inc0 | srwilkers: ^ | 18:47 |
| sdake | inc0 in the meantime i think we should continue on with microchart deployment and target that model for 1.0 release | 18:48 |
| inc0 | what do you mean by this? they're complemetary not alternative | 18:49 |
| inc0 | entry point is way to orchierstrate microcharts | 18:49 |
| *** unicell has joined #openstack-kolla | 18:50 | |
| srwilkers | afternoon | 18:50 |
| portdirect | o/ | 18:50 |
| portdirect | inc0: sounds good :) | 18:50 |
| srwilkers | inc0, im in | 18:50 |
| portdirect | could get this kicked off this weekend :D | 18:50 |
| *** ducttape_ has joined #openstack-kolla | 18:51 | |
| jascott1 | wow you guys really dont like go ;) | 18:56 |
| sdake | inc0 what i mean by this is we use a secondary mechanism to orchestrate microcharts | 18:56 |
| sdake | should hit the queues early next week | 18:56 |
| sdake | gotta jet | 18:56 |
| inc0 | sdake: I'd rather kick off proper one | 19:03 |
| inc0 | let's talk when you're back | 19:03 |
| sdake | this is a proper one | 19:03 |
| sdake | this gives us proper upgrades | 19:03 |
| sdake | anyway i'm doing it | 19:03 |
| sdake | and we have already agreed on upon it in the past | 19:03 |
| inc0 | sdake: what is that thing? | 19:03 |
| inc0 | can you elaborate? | 19:03 |
| sdake | big ansible script that launches all the helm charts | 19:04 |
| sdake | microcharts in the proper ordering | 19:04 |
| *** zhubingbing has quit IRC | 19:04 | |
| sdake | that ansible script goes in a container | 19:04 |
| sdake | and does the job | 19:04 |
| inc0 | ok, that's fine, just will not be as simple as you think, let's kickoff ML thread | 19:04 |
| inc0 | this is too important to leave off kfox1111 and others | 19:04 |
| sdake | kfox1111 already on board | 19:04 |
| inc0 | I'm onboard as well, I was one who proposed it originally;) | 19:05 |
| inc0 | however this has different issues | 19:05 |
| inc0 | which won't be that easy | 19:05 |
| inc0 | so that's why I'm saying, let's talk more | 19:06 |
| sdake | lets sort it out in the review :) | 19:06 |
| sdake | but i've got a meeting - bbiaf | 19:06 |
| *** eaguilar has quit IRC | 19:06 | |
| *** rwallner has quit IRC | 19:21 | |
| *** itlinux has joined #openstack-kolla | 19:27 | |
| *** itlinux_ has joined #openstack-kolla | 19:27 | |
| openstackgerrit | Marcus Williams proposed openstack/kolla-ansible master: Add OpenDaylight role https://review.openstack.org/416367 | 19:32 |
| *** karimb has quit IRC | 19:38 | |
| openstackgerrit | Marcus Williams proposed openstack/kolla-ansible master: Add OpenDaylight role https://review.openstack.org/416367 | 19:40 |
| *** manheim has joined #openstack-kolla | 19:44 | |
| *** egonzalez has quit IRC | 19:47 | |
| *** manheim has quit IRC | 19:48 | |
| *** jtriley has quit IRC | 19:53 | |
| *** jtriley has joined #openstack-kolla | 19:57 | |
| *** salv-orlando has joined #openstack-kolla | 19:57 | |
| *** serlex has left #openstack-kolla | 20:05 | |
| *** serlex has joined #openstack-kolla | 20:05 | |
| *** msimonin has quit IRC | 20:07 | |
| *** msimonin has joined #openstack-kolla | 20:07 | |
| *** msimonin has quit IRC | 20:08 | |
| *** msimonin has joined #openstack-kolla | 20:08 | |
| *** msimonin has quit IRC | 20:08 | |
| *** dciabrin has quit IRC | 20:09 | |
| *** msimonin has joined #openstack-kolla | 20:09 | |
| *** omenv has joined #openstack-kolla | 20:09 | |
| *** msimonin has quit IRC | 20:09 | |
| *** msimonin has joined #openstack-kolla | 20:10 | |
| *** msimonin has quit IRC | 20:10 | |
| *** ducttap__ has joined #openstack-kolla | 20:10 | |
| *** msimonin has joined #openstack-kolla | 20:10 | |
| *** msimonin has quit IRC | 20:11 | |
| *** msimonin has joined #openstack-kolla | 20:11 | |
| *** msimonin has quit IRC | 20:12 | |
| *** msimonin has joined #openstack-kolla | 20:12 | |
| *** msimonin has quit IRC | 20:12 | |
| *** ducttape_ has quit IRC | 20:13 | |
| openstackgerrit | Merged openstack/kolla master: Fix inconsistent build task attempt logging https://review.openstack.org/466738 | 20:24 |
| dave-mccowan | kfox1111 ping | 20:25 |
| *** jtriley has quit IRC | 20:25 | |
| *** ducttap__ has quit IRC | 20:27 | |
| *** msimonin has joined #openstack-kolla | 20:27 | |
| *** itlinux has quit IRC | 20:29 | |
| *** itlinux_ has quit IRC | 20:29 | |
| *** ducttape_ has joined #openstack-kolla | 20:34 | |
| *** omenv has quit IRC | 20:38 | |
| *** itlinux has joined #openstack-kolla | 20:39 | |
| *** itlinux_ has joined #openstack-kolla | 20:40 | |
| jamesbenson | inc0: just finished deploying, looks like horizon is still giving me the timezone error... | 20:41 |
| inc0 | jamesbenson: did you remove images before deployment? | 20:42 |
| inc0 | because if you deployed it once | 20:42 |
| inc0 | they'll stay on host | 20:42 |
| jamesbenson | yes, all images are tagged 4.0.2 | 20:42 |
| jamesbenson | wait | 20:42 |
| inc0 | running ones too? on all nodes? | 20:42 |
| inc0 | if not, we'll excersize upgrade;) | 20:42 |
| jamesbenson | damn it, my mistake. | 20:43 |
| inc0 | no worries | 20:43 |
| jamesbenson | some how, 4.0.1 are still on the control | 20:43 |
| inc0 | if they were downloaded they won't be re-downloaded | 20:43 |
| inc0 | and check globals.yml | 20:43 |
| inc0 | if you have 4.0.1 hardcoded | 20:43 |
| *** salv-orl_ has joined #openstack-kolla | 20:44 | |
| *** lpetrut_ has quit IRC | 20:45 | |
| *** lpetrut has quit IRC | 20:45 | |
| *** trozet has quit IRC | 20:46 | |
| *** salv-orlando has quit IRC | 20:46 | |
| *** randomhack has quit IRC | 20:49 | |
| *** kbaegis has quit IRC | 20:50 | |
| jamesbenson | yeah, forgot about that globals... | 20:51 |
| *** jbadiapa has joined #openstack-kolla | 20:52 | |
| *** goldyfruit has quit IRC | 20:53 | |
| *** kbaegis has joined #openstack-kolla | 20:53 | |
| *** kbaegis has quit IRC | 20:54 | |
| *** kbaegis has joined #openstack-kolla | 20:54 | |
| *** spsurya has quit IRC | 20:58 | |
| *** kbaegis has quit IRC | 20:58 | |
| *** trozet has joined #openstack-kolla | 21:05 | |
| *** schwicht has quit IRC | 21:06 | |
| inc0 | jamesbenson: change globals to 4.0.2 and run kolla-ansible upgrade | 21:07 |
| jamesbenson | that would have been a great test, but I already ran a destroy and deploying as we speek | 21:08 |
| inc0 | kk:) | 21:08 |
| inc0 | ironically it will probably be faster to do full redeploy | 21:09 |
| inc0 | because stopping running containers gracefully takestime | 21:09 |
| *** srwilkers has quit IRC | 21:10 | |
| jamesbenson | lol, I'll definitely be testing that though. Especially when 5 comes out... | 21:10 |
| *** msimonin has quit IRC | 21:11 | |
| *** msimonin has joined #openstack-kolla | 21:11 | |
| *** msimonin has quit IRC | 21:12 | |
| *** msimonin has joined #openstack-kolla | 21:12 | |
| *** msimonin has quit IRC | 21:12 | |
| *** msimonin has joined #openstack-kolla | 21:13 | |
| *** msimonin has quit IRC | 21:13 | |
| *** msimonin has joined #openstack-kolla | 21:13 | |
| *** shardy has quit IRC | 21:13 | |
| *** msimonin has quit IRC | 21:14 | |
| *** msimonin has joined #openstack-kolla | 21:14 | |
| *** msimonin has quit IRC | 21:15 | |
| *** msimonin has joined #openstack-kolla | 21:15 | |
| *** msimonin has quit IRC | 21:16 | |
| *** msimonin has joined #openstack-kolla | 21:16 | |
| *** msimonin has quit IRC | 21:16 | |
| *** msimonin has joined #openstack-kolla | 21:17 | |
| *** msimonin has quit IRC | 21:17 | |
| *** trozet has quit IRC | 21:18 | |
| *** schwicht has joined #openstack-kolla | 21:20 | |
| jamesbenson | I'm back in business! | 21:22 |
| inc0 | I take it's working? | 21:23 |
| jamesbenson | yep! just tested HA and it works. Do you know if Fernet is working properly in 4.0.2? | 21:53 |
| *** schwicht has quit IRC | 21:54 | |
| *** kbaegis has joined #openstack-kolla | 21:56 | |
| *** kbaegis has quit IRC | 22:00 | |
| *** itlinux has quit IRC | 22:06 | |
| *** itlinux_ has quit IRC | 22:06 | |
| *** dave-mccowan has quit IRC | 22:06 | |
| *** jamesbenson has quit IRC | 22:07 | |
| *** dave-mccowan has joined #openstack-kolla | 22:07 | |
| *** serlex has left #openstack-kolla | 22:07 | |
| *** goldyfruit has joined #openstack-kolla | 22:10 | |
| *** jamesbenson has joined #openstack-kolla | 22:11 | |
| *** jamesbenson has quit IRC | 22:16 | |
| *** k_mouza has joined #openstack-kolla | 22:21 | |
| *** k_mouza has quit IRC | 22:21 | |
| *** ducttape_ has quit IRC | 22:21 | |
| *** ducttape_ has joined #openstack-kolla | 22:27 | |
| *** ducttape_ has quit IRC | 22:32 | |
| *** goldyfruit has quit IRC | 22:34 | |
| kolla-slack | <kfox1111> I'm out on vacation today fyi | 22:42 |
| jascott1 | kfox1111 woot! very happy for you :) | 22:45 |
| *** goldyfruit has joined #openstack-kolla | 22:46 | |
| jascott1 | I'll be here slaving over a hot golang stove brewing up some helm | 22:52 |
| *** salv-orl_ has quit IRC | 22:56 | |
| *** salv-orlando has joined #openstack-kolla | 22:57 | |
| *** schwicht has joined #openstack-kolla | 22:57 | |
| openstackgerrit | Marcus Williams proposed openstack/kolla-ansible master: Add OpenDaylight role https://review.openstack.org/416367 | 22:59 |
| *** ephracis_ has quit IRC | 23:00 | |
| *** salv-orlando has quit IRC | 23:01 | |
| *** jamesbenson has joined #openstack-kolla | 23:12 | |
| *** jamesbenson has quit IRC | 23:16 | |
| *** zioproto_ has joined #openstack-kolla | 23:23 | |
| *** zioproto has quit IRC | 23:23 | |
| *** zioproto_ is now known as zioproto | 23:24 | |
| *** kolla-slack2 has joined #openstack-kolla | 23:32 | |
| *** kolla-slack has quit IRC | 23:32 | |
| openstackgerrit | Marcus Williams proposed openstack/kolla-ansible master: Add OpenDaylight role https://review.openstack.org/416367 | 23:33 |
| *** kbaegis has joined #openstack-kolla | 23:44 | |
| *** eaguilar has joined #openstack-kolla | 23:47 | |
| *** kbaegis has quit IRC | 23:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!