*** britthouser has quit IRC | 00:01 | |
*** salv-orlando has joined #openstack-kolla | 00:01 | |
*** britthouser has joined #openstack-kolla | 00:01 | |
kfox1111 | sbezverk_: that sounds good to me. | 00:02 |
---|---|---|
*** tonanhngo has quit IRC | 00:02 | |
*** tonanhng_ has quit IRC | 00:03 | |
*** salv-orlando has quit IRC | 00:05 | |
*** zhurong has quit IRC | 00:07 | |
*** schwicht has quit IRC | 00:12 | |
*** yingjun has joined #openstack-kolla | 00:12 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding logging to kolla-kubernetes services https://review.openstack.org/377104 | 00:16 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: WIP Adds Fluentd service to Kolla https://review.openstack.org/375615 | 00:18 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding logging to kolla-kubernetes services https://review.openstack.org/377104 | 00:21 |
*** britthouser has quit IRC | 00:30 | |
*** caowei has joined #openstack-kolla | 00:31 | |
*** david-lyle_ has joined #openstack-kolla | 00:38 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding logging to kolla-kubernetes services https://review.openstack.org/377104 | 00:41 |
*** david-lyle has quit IRC | 00:41 | |
*** Marcellin__ has quit IRC | 00:47 | |
*** huikang has joined #openstack-kolla | 00:51 | |
*** salv-orlando has joined #openstack-kolla | 01:02 | |
*** duonghq has joined #openstack-kolla | 01:04 | |
duonghq | morning | 01:04 |
*** phuongnh has joined #openstack-kolla | 01:05 | |
*** salv-orlando has quit IRC | 01:06 | |
duonghq | sdake: ping | 01:11 |
*** zhurong has joined #openstack-kolla | 01:11 | |
sdake | shoot | 01:11 |
duonghq | why we run haproxy only on network group? | 01:11 |
sdake | i was pretty ure pual moved it to the contorller group | 01:11 |
sdake | but maybe that didn't happen | 01:11 |
sdake | pbourke that is | 01:11 |
duonghq | ya, in latest source, it's still in network group | 01:13 |
sdake | ok | 01:13 |
sdake | well i'm sure pbourke was working on it, and if he didn't finish it its either in review queue or there was a reason | 01:13 |
sdake | inc0 also aware of this issue | 01:13 |
sdake | they were debating it | 01:13 |
sdake | to me, doesn't really matter as long as it works ;) | 01:14 |
sdake | but pbourke and inc0 closer to that particular piece of work | 01:14 |
sdake | pbourke had indicated running haproxy on controller node was more effecient and conidered best practice | 01:15 |
sdake | that argueemnt works for me | 01:15 |
duonghq | ya, | 01:15 |
sdake | eveyron really buy - maybe he just didn't get to it yet | 01:16 |
sdake | might look in the queue if its present | 01:16 |
duonghq | but haproxy and keepalived do not need to run on every node? | 01:17 |
sdake | no | 01:17 |
sdake | not on compute nodes | 01:17 |
duonghq | every node expect compute? | 01:17 |
sdake | not storage nodes | 01:17 |
sdake | just controller nodes | 01:17 |
*** MarMat has quit IRC | 01:17 | |
sdake | typically i set netowr nodes = compute nodes in my configs | 01:18 |
sdake | rather controll nodes | 01:18 |
*** hieulq has joined #openstack-kolla | 01:18 | |
duonghq | roger, thanks | 01:19 |
*** neilus has joined #openstack-kolla | 01:24 | |
*** zhubingbing has joined #openstack-kolla | 01:27 | |
*** gfhellma has quit IRC | 01:28 | |
*** sdake has quit IRC | 01:28 | |
duonghq | sdake: why we do not combine network and controller as in openstack (after liberty) | 01:29 |
*** neilus has quit IRC | 01:29 | |
*** daneyon has joined #openstack-kolla | 01:34 | |
*** harlowja has quit IRC | 01:35 | |
*** eaguilar has quit IRC | 01:36 | |
*** daneyon has quit IRC | 01:39 | |
*** huikang_ has joined #openstack-kolla | 01:54 | |
*** huikang has quit IRC | 01:55 | |
openstackgerrit | Li Yingjun proposed openstack/kolla: Support Searchlight Docker container https://review.openstack.org/377145 | 01:57 |
*** eaguilar has joined #openstack-kolla | 01:59 | |
*** haplo37_ has quit IRC | 02:00 | |
*** haplo37_ has joined #openstack-kolla | 02:02 | |
*** salv-orlando has joined #openstack-kolla | 02:03 | |
*** unicell has quit IRC | 02:03 | |
*** salv-orlando has quit IRC | 02:07 | |
*** huhaoran has joined #openstack-kolla | 02:08 | |
*** lujinluo has quit IRC | 02:09 | |
openstackgerrit | Duong Ha-Quang proposed openstack/kolla: Remove default=None when set value in config https://review.openstack.org/377154 | 02:11 |
*** huhaoran has quit IRC | 02:13 | |
*** awiddersheim has quit IRC | 02:13 | |
*** zhubingbing has quit IRC | 02:23 | |
*** zhubingbing has joined #openstack-kolla | 02:24 | |
*** huhaoran has joined #openstack-kolla | 02:25 | |
*** schwicht has joined #openstack-kolla | 02:39 | |
*** MarMat has joined #openstack-kolla | 02:44 | |
openstackgerrit | Merged openstack/kolla: add upgrade.yml in congress role https://review.openstack.org/376347 | 02:44 |
*** yuanying has quit IRC | 02:47 | |
*** david-lyle_ has quit IRC | 02:48 | |
*** david-lyle has joined #openstack-kolla | 02:49 | |
*** yuanying has joined #openstack-kolla | 02:50 | |
*** rhallisey has quit IRC | 02:50 | |
*** sgordon` is now known as sgordon | 02:52 | |
*** sdake has joined #openstack-kolla | 02:55 | |
*** huhaoran_ has joined #openstack-kolla | 02:56 | |
*** huikang_ has quit IRC | 02:58 | |
*** david-lyle has quit IRC | 03:04 | |
*** huikang has joined #openstack-kolla | 03:10 | |
*** neilus has joined #openstack-kolla | 03:12 | |
*** huhaoran has quit IRC | 03:12 | |
*** huhaoran_ has quit IRC | 03:12 | |
*** tonanhngo has joined #openstack-kolla | 03:14 | |
*** haplo37 has quit IRC | 03:14 | |
*** sdake has quit IRC | 03:15 | |
*** tonanhngo has quit IRC | 03:15 | |
*** g3ek has quit IRC | 03:15 | |
*** neilus has quit IRC | 03:16 | |
*** mdnadeem_ has quit IRC | 03:21 | |
*** g3ek has joined #openstack-kolla | 03:21 | |
*** haplo37 has joined #openstack-kolla | 03:22 | |
*** sdake has joined #openstack-kolla | 03:23 | |
*** tonanhngo has joined #openstack-kolla | 03:25 | |
*** tonanhngo has quit IRC | 03:26 | |
duonghq | do we support Ceph Jewel? | 03:29 |
sdake | yup | 03:29 |
duonghq | roger | 03:32 |
openstackgerrit | dupengfei proposed openstack/kolla: Fix keystone,database,memcache for k8s. https://review.openstack.org/372089 | 03:33 |
zhubingbing | heke and cron what different | 03:33 |
*** unicell has joined #openstack-kolla | 03:34 | |
*** tonanhngo has joined #openstack-kolla | 03:36 | |
*** tonanhngo has quit IRC | 03:36 | |
*** yuanying has quit IRC | 03:37 | |
*** sdake has quit IRC | 03:40 | |
*** sdake has joined #openstack-kolla | 03:41 | |
*** athomas has joined #openstack-kolla | 03:42 | |
Jeffrey4l | zhubingbing, heka is a log collector and cron is crontab who run jobs regularly. | 03:42 |
*** huikang has quit IRC | 03:43 | |
*** schwicht_at_work has joined #openstack-kolla | 03:43 | |
*** eaguilar has quit IRC | 03:44 | |
*** schwicht has quit IRC | 03:44 | |
*** aswadr_ has joined #openstack-kolla | 03:45 | |
*** sdake has quit IRC | 03:47 | |
*** tonanhngo has joined #openstack-kolla | 03:50 | |
*** yuanying has joined #openstack-kolla | 03:50 | |
*** dave-mccowan has quit IRC | 03:53 | |
*** huhaoran has joined #openstack-kolla | 03:56 | |
*** huhaoran_ has joined #openstack-kolla | 03:56 | |
duonghq | Jeffrey4l, which host distro do you use for OSIC test? | 03:59 |
duonghq | sorry I cannot remmeber | 03:59 |
Jeffrey4l | duonghq, ubuntu 14.04 | 03:59 |
duonghq | thank Jeffrey4l | 04:00 |
Jeffrey4l | np :) | 04:00 |
*** huhaoran has quit IRC | 04:01 | |
openstackgerrit | Tuan Luong-Anh proposed openstack/kolla: TrivialFix: Remove default=None when set value in Config https://review.openstack.org/377205 | 04:02 |
*** zhubingbing has quit IRC | 04:12 | |
*** sdake has joined #openstack-kolla | 04:15 | |
*** caowei has quit IRC | 04:17 | |
*** lujinluo has joined #openstack-kolla | 04:21 | |
*** sdake_ has joined #openstack-kolla | 04:22 | |
*** lujinluo has quit IRC | 04:22 | |
*** senk_ has joined #openstack-kolla | 04:23 | |
*** lujinluo has joined #openstack-kolla | 04:23 | |
*** sdake has quit IRC | 04:24 | |
*** zhubingbing has joined #openstack-kolla | 04:24 | |
*** bdaca has joined #openstack-kolla | 04:31 | |
*** coolsvap has quit IRC | 04:32 | |
*** unicell1 has joined #openstack-kolla | 04:33 | |
*** unicell has quit IRC | 04:35 | |
*** sdake_ has quit IRC | 04:40 | |
*** zhubingbing has quit IRC | 04:42 | |
*** sdake has joined #openstack-kolla | 04:43 | |
*** sdake_ has joined #openstack-kolla | 04:46 | |
duonghq | sdake: seem that nobody backported https://review.openstack.org/#/c/360218/ to mitaka and l | 04:48 |
*** sdake has quit IRC | 04:48 | |
*** zhubingbing has joined #openstack-kolla | 04:48 | |
*** haplo37 has quit IRC | 04:49 | |
*** g3ek has quit IRC | 04:50 | |
*** jrist has joined #openstack-kolla | 04:51 | |
*** salv-orlando has joined #openstack-kolla | 04:54 | |
*** haplo37 has joined #openstack-kolla | 04:55 | |
*** g3ek has joined #openstack-kolla | 04:56 | |
*** absubram has joined #openstack-kolla | 04:56 | |
*** sdake_ has quit IRC | 04:58 | |
*** neilus has joined #openstack-kolla | 05:00 | |
*** skramaja has quit IRC | 05:01 | |
*** skramaja has joined #openstack-kolla | 05:01 | |
*** skramaja has quit IRC | 05:04 | |
*** neilus has quit IRC | 05:04 | |
*** daneyon has joined #openstack-kolla | 05:11 | |
*** athomas has quit IRC | 05:12 | |
*** bjolo has joined #openstack-kolla | 05:14 | |
bjolo | morning | 05:14 |
*** daneyon has quit IRC | 05:16 | |
bdaca | hello bjolo | 05:19 |
*** lamt has quit IRC | 05:21 | |
openstackgerrit | zhubingbing proposed openstack/kolla: add aodh gnocchi barbican in heka.json.j2 https://review.openstack.org/377241 | 05:23 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Add a note for how to get prior release kolla doc https://review.openstack.org/376525 | 05:27 |
bjolo | sup bdaca | 05:30 |
*** absubram has quit IRC | 05:33 | |
*** senk_ has quit IRC | 05:34 | |
*** skramaja has joined #openstack-kolla | 05:37 | |
*** jrist has quit IRC | 05:53 | |
bdaca | bjolo everything OK in here, thx! (such reflex!) :) how are you today? still coping with long updates? | 06:11 |
*** senk_ has joined #openstack-kolla | 06:11 | |
bjolo | hehe | 06:11 |
bjolo | im good :) | 06:11 |
bjolo | i have a workaround for reconfigure, that i actually like better | 06:12 |
*** msimonin has joined #openstack-kolla | 06:12 | |
bjolo | COPY_ALWAYS policy. kolla-ansible genconfig; docker restart <container> | 06:12 |
*** msimonin has quit IRC | 06:12 | |
bjolo | that way i can review the generated config before activating it. | 06:13 |
bjolo | and it is also way faster. genconfig takes about 2min. | 06:13 |
bjolo | i also have version control (etckeeper) on the target nodes, so i can roll back a config change quickly. after each genconfig, i run ansible -i inventory -m command -a "etckeeper commit -m 'snapshot'" | 06:16 |
bdaca | sounds like a good idea, i will have a look on it, maybe i should use it too | 06:18 |
MarMat | bdaca ping | 06:26 |
bdaca | MarMat pong | 06:26 |
MarMat | bdaca are you sure that os_admin module can be used for domain create? http://paste.openstack.org/show/582986/ | 06:27 |
MarMat | bdaca it's not working for me | 06:27 |
MarMat | bdaca domain must exist for that already | 06:27 |
MarMat | bdaca i mean os_user module | 06:28 |
bdaca | MarMat no no, this can be used for IDs retrieving... thought that you will use kolla_toolbox for creation | 06:31 |
MarMat | bdaca oh, ok... | 06:32 |
MarMat | bdaca but then it can be read also from the toolbox module. | 06:32 |
bdaca | sorry, I should be more precise, hope you didn't lose too much time becouse of that | 06:32 |
MarMat | I already have patchset ready for that testing... | 06:32 |
bdaca | s/becouse/because/ | 06:33 |
MarMat | bdaca no problem | 06:33 |
openstackgerrit | caoyuan proposed openstack/kolla: Add bootstrap_service.yml to upgrade.yml https://review.openstack.org/377273 | 06:46 |
*** neilus has joined #openstack-kolla | 06:48 | |
*** tonanhngo has quit IRC | 06:49 | |
*** haplo37 has quit IRC | 06:50 | |
*** neilus has quit IRC | 06:53 | |
*** haplo37 has joined #openstack-kolla | 06:58 | |
*** daneyon has joined #openstack-kolla | 07:00 | |
*** salv-orl_ has joined #openstack-kolla | 07:01 | |
*** tonanhngo has joined #openstack-kolla | 07:02 | |
*** b_bezak has joined #openstack-kolla | 07:02 | |
*** tonanhngo has quit IRC | 07:02 | |
*** salv-orlando has quit IRC | 07:04 | |
*** daneyon has quit IRC | 07:04 | |
*** egonzalez90 has joined #openstack-kolla | 07:04 | |
egonzalez90 | morning guys! | 07:04 |
openstackgerrit | zhubingbing proposed openstack/kolla: remove bootstrap.yml in grafana role upgrade.yml https://review.openstack.org/375913 | 07:05 |
*** salv-orl_ has quit IRC | 07:05 | |
zhubingbing | morning | 07:05 |
*** Serlex has joined #openstack-kolla | 07:06 | |
openstackgerrit | zhubingbing proposed openstack/kolla: change perm and user wsgi file permission https://review.openstack.org/375313 | 07:11 |
*** zhenguo has joined #openstack-kolla | 07:11 | |
*** egonzalez90 has quit IRC | 07:17 | |
*** egonzalez90 has joined #openstack-kolla | 07:20 | |
*** msimonin has joined #openstack-kolla | 07:21 | |
*** egonzalez90 has quit IRC | 07:24 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: DO_NOT_MERGE: Use better URL for China https://review.openstack.org/329060 | 07:27 |
*** rmart04 has joined #openstack-kolla | 07:34 | |
openstackgerrit | zhubingbing proposed openstack/kolla: add sahara port prechecks https://review.openstack.org/377306 | 07:53 |
openstackgerrit | zhubingbing proposed openstack/kolla: add sahara port prechecks https://review.openstack.org/377306 | 08:07 |
openstackgerrit | Merged openstack/kolla: add aodh gnocchi barbican in heka.json.j2 https://review.openstack.org/377241 | 08:08 |
*** MarMat has quit IRC | 08:14 | |
openstackgerrit | Li Yingjun proposed openstack/kolla: Support Searchlight Docker container https://review.openstack.org/377145 | 08:24 |
*** yingjun has quit IRC | 08:28 | |
*** tonanhngo has joined #openstack-kolla | 08:35 | |
*** tonanhngo has quit IRC | 08:37 | |
openstackgerrit | zhubingbing proposed openstack/kolla: test https://review.openstack.org/377355 | 08:41 |
*** huhaoran_ has quit IRC | 08:44 | |
duonghq | is there anyway to deploy Ceph Hammer using Kolla 2.0.2 (stable/mitaka) | 08:44 |
*** huhaoran has joined #openstack-kolla | 08:44 | |
duonghq | I guess the answer is no? | 08:45 |
bdaca | duonghq isn't Hammer deployed on stable/mitaka? | 08:45 |
duonghq | Sorry, I mean Jewel | 08:45 |
bdaca | duonghq officially no, unofficially you can change it on your own | 08:46 |
duonghq | thank bdaca | 08:46 |
duonghq | so it is quite tricky here | 08:47 |
openstackgerrit | zhubingbing proposed openstack/kolla: test https://review.openstack.org/377361 | 08:48 |
*** daneyon has joined #openstack-kolla | 08:48 | |
*** huhaoran has quit IRC | 08:49 | |
*** huhaoran has joined #openstack-kolla | 08:49 | |
openstackgerrit | caoyuan proposed openstack/kolla: Add aodh checking to port_checks.yml https://review.openstack.org/377364 | 08:49 |
*** daneyon has quit IRC | 08:53 | |
*** lujinluo has quit IRC | 08:54 | |
*** gfidente has quit IRC | 08:57 | |
*** haplo37 has quit IRC | 09:02 | |
*** gfidente has joined #openstack-kolla | 09:06 | |
*** haplo37 has joined #openstack-kolla | 09:11 | |
*** matrohon has joined #openstack-kolla | 09:19 | |
*** tonanhngo has joined #openstack-kolla | 09:34 | |
*** tonanhngo has quit IRC | 09:35 | |
openstackgerrit | Eduardo Gonzalez proposed openstack/kolla: Fix mistral service https://review.openstack.org/374921 | 09:40 |
openstackgerrit | caoyuan proposed openstack/kolla: Add reconfigure file to Congress https://review.openstack.org/377412 | 09:44 |
openstackgerrit | Merged openstack/kolla: add sahara port prechecks https://review.openstack.org/377306 | 09:48 |
openstackgerrit | Merged openstack/kolla: add reconfigure.yml in congress role https://review.openstack.org/376421 | 09:49 |
*** tonanhngo has joined #openstack-kolla | 09:52 | |
*** tonanhngo has quit IRC | 09:53 | |
*** huhaoran has quit IRC | 09:56 | |
*** haplo37_ has quit IRC | 09:56 | |
*** eaguilar has joined #openstack-kolla | 09:57 | |
*** haplo37_ has joined #openstack-kolla | 09:59 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kolla: Updated from global requirements https://review.openstack.org/375989 | 10:00 |
*** zeus has quit IRC | 10:01 | |
*** zhurong has quit IRC | 10:02 | |
*** zeus has joined #openstack-kolla | 10:02 | |
*** zeus is now known as Guest71546 | 10:02 | |
*** berendt has joined #openstack-kolla | 10:10 | |
berendt | hi | 10:10 |
*** eaguilar has quit IRC | 10:17 | |
*** sdake has joined #openstack-kolla | 10:27 | |
*** mnasiadka has joined #openstack-kolla | 10:29 | |
*** portdirect has quit IRC | 10:39 | |
*** salv-orlando has joined #openstack-kolla | 10:39 | |
sdake | morning folks | 10:44 |
jmccarthy | o/ | 10:44 |
*** duonghq has quit IRC | 10:48 | |
sdake | hey jmccarthy | 10:50 |
sdake | i had removed you from the kolla-drivers team becauseyou seemed a bitinctive, i can add you back in if you like | 10:50 |
*** huhaoran has joined #openstack-kolla | 10:52 | |
*** zhubingbing has quit IRC | 10:56 | |
jmccarthy | sdake: Oh I don't blame you ! Hard to make time for everything :/ | 10:57 |
sdake | tell me about it :) | 10:57 |
jmccarthy | Ok - Alright I won't ;) , I'd say go for it, but I'm not sure things will improve .. | 11:00 |
*** phuongnh has quit IRC | 11:03 | |
*** eaguilar has joined #openstack-kolla | 11:04 | |
*** bdaca has quit IRC | 11:10 | |
*** sdake has quit IRC | 11:12 | |
*** tonanhngo has joined #openstack-kolla | 11:19 | |
openstackgerrit | Kobi Samoray proposed openstack/kolla: Fix a docstring typo in build.py https://review.openstack.org/377613 | 11:20 |
*** tonanhngo has quit IRC | 11:22 | |
*** salv-orlando has quit IRC | 11:27 | |
*** daneyon has joined #openstack-kolla | 11:30 | |
berendt | is it possible to request support for our docs/docstrings/... somewhere? | 11:34 |
*** daneyon has quit IRC | 11:35 | |
ccesario | morning :) | 11:35 |
openstackgerrit | Merged openstack/kolla: Fix the url of Cinder endpoints https://review.openstack.org/375169 | 11:37 |
*** salv-orlando has joined #openstack-kolla | 11:40 | |
berendt | has somebody already played with https://github.com/openstack/os-faults ? | 11:40 |
*** mdorman has quit IRC | 11:42 | |
*** tonanhngo has joined #openstack-kolla | 11:44 | |
*** tonanhngo has quit IRC | 11:45 | |
*** mdorman has joined #openstack-kolla | 11:46 | |
*** rhallisey has joined #openstack-kolla | 11:59 | |
*** dwalsh has joined #openstack-kolla | 12:01 | |
*** jamesdenton has quit IRC | 12:01 | |
*** rmart04_ has joined #openstack-kolla | 12:04 | |
*** imcsk8_ has joined #openstack-kolla | 12:06 | |
mliima | morning all | 12:06 |
*** imcsk8 has quit IRC | 12:06 | |
*** rmart04 has quit IRC | 12:07 | |
*** rmart04_ is now known as rmart04 | 12:07 | |
*** msimonin has quit IRC | 12:10 | |
*** schwicht_at_work has quit IRC | 12:11 | |
*** awiddersheim has joined #openstack-kolla | 12:11 | |
*** schwicht has joined #openstack-kolla | 12:12 | |
*** msimonin has joined #openstack-kolla | 12:14 | |
*** zhurong has joined #openstack-kolla | 12:17 | |
*** awiddersheim has quit IRC | 12:20 | |
*** awiddersheim has joined #openstack-kolla | 12:20 | |
*** zhubingbing has joined #openstack-kolla | 12:25 | |
*** huhaoran has quit IRC | 12:27 | |
*** sdake has joined #openstack-kolla | 12:28 | |
*** matrohon has quit IRC | 12:30 | |
*** b_bezak_ has joined #openstack-kolla | 12:32 | |
*** portdirect has joined #openstack-kolla | 12:33 | |
openstackgerrit | zhubingbing proposed openstack/kolla: change CollectD to collectd in collectd role https://review.openstack.org/376245 | 12:34 |
*** b_bezak has quit IRC | 12:34 | |
*** b_bezak has joined #openstack-kolla | 12:38 | |
*** schwicht_at_work has joined #openstack-kolla | 12:38 | |
*** schwicht has quit IRC | 12:38 | |
*** schwicht_at_work has quit IRC | 12:38 | |
*** b_bezak_ has quit IRC | 12:40 | |
*** salv-orlando has quit IRC | 12:45 | |
*** dave-mccowan has joined #openstack-kolla | 12:46 | |
*** matrohon has joined #openstack-kolla | 12:49 | |
*** tonanhngo has joined #openstack-kolla | 12:53 | |
Jeffrey4l | pbourke, around? | 12:53 |
Jeffrey4l | could u check this PS. https://review.openstack.org/#/c/376524/ pbourke sdake | 12:54 |
*** tonanhngo has quit IRC | 12:54 | |
sdake | Jeffrey4l looks complicated issue | 12:56 |
*** david-lyle has joined #openstack-kolla | 12:56 | |
Jeffrey4l | The explain is nice. but the issue is not complicated. it is about when to gather the ansible facts. | 12:56 |
Jeffrey4l | in some case, we should ask ansible to run gather facts explicit | 12:59 |
*** jtriley has joined #openstack-kolla | 13:00 | |
*** eaguilar has quit IRC | 13:02 | |
*** absubram has joined #openstack-kolla | 13:07 | |
*** salv-orlando has joined #openstack-kolla | 13:12 | |
*** tonanhngo has joined #openstack-kolla | 13:14 | |
pbourke | Jeffrey4l: will do | 13:14 |
*** mewald has joined #openstack-kolla | 13:14 | |
Jeffrey4l | thanks. | 13:14 |
mewald | I am trying to hunt the error "ERROR:__main__:KOLLA_CONFIG_STRATEGY is not set properly" when starting I container. Any ideas where this is coming from? It is set properly in /etc/kolla/globals.yml | 13:15 |
Jeffrey4l | mewald, if you start the container by using ansible. this variable is set automatically. | 13:16 |
Jeffrey4l | mewald, or check #config_strategy: "COPY_ALWAYS" this in your globals.yml file. | 13:16 |
mewald | Jeffrey4l: yeah, I am doing "./tools/kolla-ansible deploy" and it is properly set in globals.yml: config_strategy: "COPY_ALWAYS" | 13:17 |
Jeffrey4l | mewald, which container raise that issue? | 13:18 |
pbourke | Jeffrey4l: im having a hard time parsing what you're saying in that review | 13:18 |
mewald | Jeffrey4l: I am backporting telegraf for stable/mitaka | 13:18 |
*** eaguilar has joined #openstack-kolla | 13:18 | |
*** daneyon has joined #openstack-kolla | 13:18 | |
Jeffrey4l | pbourke, hmm. what we need is gather facters before the role. only add this in haproxy is not enough. | 13:19 |
Jeffrey4l | other service also need this. | 13:19 |
pbourke | Jeffrey4l: what andrew has there works | 13:19 |
Jeffrey4l | but run the setup explicit at the beginning will solve all the issue. | 13:19 |
*** Guest71546 is now known as zeus | 13:20 | |
Jeffrey4l | pbourke, it works but other role has such issue. | 13:20 |
*** zeus has quit IRC | 13:20 | |
*** zeus has joined #openstack-kolla | 13:20 | |
*** jheroux has joined #openstack-kolla | 13:21 | |
*** inc0 has joined #openstack-kolla | 13:21 | |
inc0 | good morning | 13:22 |
pbourke | morning | 13:22 |
Jeffrey4l | morning | 13:23 |
*** daneyon has quit IRC | 13:23 | |
*** absubram has quit IRC | 13:29 | |
*** huhaoran has joined #openstack-kolla | 13:29 | |
*** huhaoran has quit IRC | 13:29 | |
*** fguillot has joined #openstack-kolla | 13:33 | |
*** msimonin has quit IRC | 13:37 | |
*** bdaca has joined #openstack-kolla | 13:39 | |
sdake | sup peeps | 13:39 |
sdake | Jeffrey4l ya - i gree seems complex if it must go all over codebase | 13:39 |
sdake | Jeffrey4l is tht what your saying? | 13:39 |
Jeffrey4l | sdake, go all over codebase means the current implement or my? | 13:40 |
Jeffrey4l | mine? | 13:40 |
sdake | any version of the optimal implementation | 13:41 |
*** msimonin has joined #openstack-kolla | 13:42 | |
sdake | Jeffrey4l does it touch all the roles or is it centralized | 13:42 |
*** salv-orl_ has joined #openstack-kolla | 13:42 | |
Jeffrey4l | sdake, are u saying the gather facters? sorry, i can not following u :( | 13:43 |
sdake | saying gather faats | 13:43 |
Jeffrey4l | what's is centralized? | 13:43 |
sdake | how many files must be modified ;) | 13:43 |
sdake | are we tlaking 20 or a few? | 13:44 |
Jeffrey4l | only site.yml and we need change many line base on which host vars is used in certain roles. | 13:44 |
sdake | sounds better to me | 13:45 |
*** MarMat has joined #openstack-kolla | 13:45 | |
*** salv-orlando has quit IRC | 13:46 | |
*** MarMat_ has joined #openstack-kolla | 13:46 | |
Jeffrey4l | sdake, i removed lost of line in site.yml https://review.openstack.org/#/c/365483/ | 13:47 |
Jeffrey4l | if we want to fix this. either we revert that PS. or gather the fact at the first of the playbooks. | 13:48 |
inc0 | Jeffrey4l, yeah, I was wondering if that won't be the case | 13:48 |
inc0 | we can use setup task right? | 13:49 |
Jeffrey4l | yes. | 13:49 |
*** schwicht has joined #openstack-kolla | 13:50 | |
inc0 | let's use setup task for all nodes as first task in plays | 13:50 |
inc0 | and that should do i | 13:50 |
inc0 | t | 13:50 |
Jeffrey4l | inc0, like this http://paste.openstack.org/show/583082/ | 13:50 |
Jeffrey4l | inc0, check the comments in https://review.openstack.org/#/c/376524/ i made. | 13:50 |
*** MarMat has quit IRC | 13:50 | |
inc0 | Jeffrey4l, how about this http://docs.ansible.com/ansible/setup_module.html#synopsis | 13:53 |
inc0 | I'd rather use this than debug | 13:53 |
inc0 | but idea is the same | 13:53 |
openstackgerrit | Merged openstack/kolla: Changed docker_restart_policy to unless-stopped https://review.openstack.org/375322 | 13:53 |
openstackgerrit | Merged openstack/kolla: Fix a docstring typo in build.py https://review.openstack.org/377613 | 13:54 |
Jeffrey4l | i tried that. hmm. it will trigger two setup. | 13:54 |
Jeffrey4l | 1 sec. let me explain | 13:54 |
inc0 | that doesn't seem right | 13:54 |
*** bmace has quit IRC | 13:56 | |
Jeffrey4l | inc0, | 13:56 |
Jeffrey4l | inc0, http://paste.openstack.org/show/583083/ | 13:56 |
Jeffrey4l | we need second one. | 13:56 |
openstackgerrit | Merged openstack/kolla: Add aodh checking to port_checks.yml https://review.openstack.org/377364 | 13:56 |
openstackgerrit | Merged openstack/kolla: remove bootstrap.yml in grafana role upgrade.yml https://review.openstack.org/375913 | 13:56 |
inc0 | yeah makes sense | 13:57 |
inc0 | Jeffrey4l, wanna publish a patch? | 13:57 |
awiddersheim | I can modify my change | 13:58 |
Jeffrey4l | inc0, this PS container such fix with a nice explanation. i will ping the author to use ansible setup solution | 13:58 |
Jeffrey4l | awiddersheim, ^^ | 13:58 |
Jeffrey4l | awiddersheim, try to use second one here https://review.openstack.org/#/c/376524/ | 13:58 |
awiddersheim | ok sounds good | 13:58 |
inc0 | thanks | 13:58 |
*** dwalsh has quit IRC | 13:59 | |
inc0 | btw welcome:) always nice to see new names here | 13:59 |
awiddersheim | Jeffrey4l: you mean second one here http://paste.openstack.org/show/583083/ | 13:59 |
awiddersheim | thanks | 13:59 |
Jeffrey4l | awiddersheim, correct. add it at the beginning of the site.yml. it will force to gather facters in all nodes. | 14:00 |
Jeffrey4l | awiddersheim, you should add - tags: always | 14:00 |
sdake | sweet new devs :) | 14:00 |
awiddersheim | yes | 14:01 |
awiddersheim | have that as well | 14:01 |
sdake | welcome awiddersheim ;) - jeffrey4l imo we shouldn't e so quickto tke over pepels patchess | 14:01 |
openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Misc fixes https://review.openstack.org/377082 | 14:01 |
sdake | unless its critical issue | 14:01 |
inc0 | well, it's good change, and it fixes problem awiddersheim wanted to fix | 14:01 |
sdake | like broken gate | 14:01 |
inc0 | and it is critical;) | 14:01 |
inc0 | will be apparent on multinode | 14:01 |
sdake | i see | 14:02 |
Jeffrey4l | agreed with inc0 | 14:02 |
sdake | i run multinode daiy wfm | 14:02 |
inc0 | certain cases | 14:02 |
Jeffrey4l | when the api and haproxy in different nodes. | 14:02 |
sdake | got it | 14:03 |
inc0 | which is default for us - if you have network node | 14:03 |
sdake | i have api and haproxy on all ndoes in my setup | 14:03 |
sdake | all nodes do all things | 14:04 |
sdake | (only 3 nodes) | 14:04 |
inc0 | yeah, that will work for you | 14:04 |
pbourke | inc0: Jeffrey4l: I do *not* want to touch all nodes by default | 14:04 |
inc0 | pbourke, well, setup task will touch nodes which will be touched anyway later | 14:04 |
inc0 | on that note, hmm, if we run some tag | 14:05 |
Jeffrey4l | yes. setup is ran implicitly | 14:05 |
pbourke | so if I have 1000 compute nodes and 10 controls and I want to reconfigure something or deploy one service, I have to fact gather all 1000 nodes? | 14:05 |
inc0 | that would touch only controller | 14:05 |
inc0 | good point pbourke | 14:05 |
sdake | sounds bad pbourke | 14:06 |
Jeffrey4l | when you have 1000 nodes. you may need a gather cache for ansible. | 14:06 |
sdake | although its more like 100 nodes for us | 14:06 |
inc0 | Jeffrey4l, but if you do for example "deploy just glance" | 14:06 |
inc0 | you don't need to touch 990 compute nodes at all | 14:06 |
sdake | right | 14:07 |
Jeffrey4l | yes. | 14:07 |
openstackgerrit | Merged openstack/kolla: Add more packages in bindep.txt https://review.openstack.org/375418 | 14:07 |
inc0 | with this task you will | 14:07 |
Jeffrey4l | But with facters cache, touch 1000 nodes is fast. | 14:08 |
*** senk_ has quit IRC | 14:08 | |
inc0 | we might be better off if we do targeted setup at begginging of every role | 14:08 |
inc0 | but still not necessary | 14:08 |
pbourke | inc0: that's essentially what we do now in awiddersheim's patch | 14:08 |
*** athomas has joined #openstack-kolla | 14:09 | |
inc0 | hmm...and will not be default as common still be run without any tag | 14:10 |
Jeffrey4l | so this PS may need revert. | 14:11 |
* Jeffrey4l is trying to find a better solution. | 14:12 | |
Jeffrey4l | https://review.openstack.org/#/c/365483/ | 14:12 |
openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: Misc fixes https://review.openstack.org/377082 | 14:13 |
*** dwalsh has joined #openstack-kolla | 14:15 | |
inc0 | ok, I'll need more caffeine for this | 14:15 |
awiddersheim | While I like the merits of Jeffrey4l's approach which provides a much cleaner site.yml file and less potential for someone to forget to add a group of hosts to a list that might need to do fact gathering I feel like my more targeted approach helps with the problem pbourke pointed out. Also facts *may* change between plays and so gathering them all at the beginning might make things break but I say | 14:16 |
awiddersheim | that without knowing enough about the code base and what facts are being used in some of these configurations. | 14:16 |
awiddersheim | it's a tough one for sure | 14:17 |
Jeffrey4l | one workaround is: you can add --limit control when running playbooks. then -host: all will gather facter only on limit node. | 14:17 |
openstackgerrit | Merged openstack/kolla-kubernetes: Adding logging to kolla-kubernetes services https://review.openstack.org/377104 | 14:17 |
*** athomas has quit IRC | 14:18 | |
inc0 | so gathering facts on all nodes will make later development easier | 14:19 |
Jeffrey4l | yes. no one know what host should i need add to keystone, unless i check the keystone.conf file carefully. | 14:20 |
*** eaguilar has quit IRC | 14:21 | |
*** eaguilar_ has joined #openstack-kolla | 14:21 | |
Jeffrey4l | another case is: how about the operator add a file /etc/kolla/config/keystone.conf which need host_vars[ceph-mon]? | 14:21 |
Jeffrey4l | inc0, pbourke ^^ | 14:22 |
inc0 | ceph backend for keystone?;) | 14:22 |
inc0 | is this even a thing? | 14:22 |
Jeffrey4l | just a case. | 14:23 |
Jeffrey4l | hmm let's me think a real case. | 14:23 |
inc0 | pbourke, how about --limit workaround Jeffrey4l suggested? | 14:23 |
inc0 | Jeffrey4l, no worries, I get that, I was just curious | 14:23 |
Jeffrey4l | thanks :) | 14:23 |
pbourke | that sounds like pushing the knowledge out of code and onto the operator | 14:23 |
pbourke | *knowledge required for what hosts are needed for what services | 14:24 |
inc0 | well, let's be honest, if you're running enough nodes for this to be issue, you should have ansible knowledge:P | 14:24 |
*** sdake has quit IRC | 14:24 | |
Jeffrey4l | operator need setup facter cache. other wise it will be very slow during deployment | 14:24 |
Jeffrey4l | ansible-playbook run multi setup during the deploy. | 14:25 |
pbourke | right now we simply have to maintain a list of services in site.yml for the few services that need to know about nodes other than themselves (haproxy, nova, glance) | 14:26 |
pbourke | with what you're proposing it makes things a little easier on us, and a lot harder on the operator | 14:26 |
pbourke | expect to see lots of "i got an error about missing ansible_eth0 in hostvars" questions | 14:27 |
pbourke | its worked fine till now, the only reason it changed at all was so we could run the common role separately | 14:28 |
pbourke | which there are better ways to achieve, as demonstrated by awiddersheim | 14:28 |
inc0 | so one way to avoid us missing a node in task would be CI | 14:29 |
inc0 | hmm...an idea | 14:29 |
inc0 | no, my idea won't work, carry on;) | 14:30 |
pbourke | :p | 14:30 |
Jeffrey4l | how about fact caching. | 14:31 |
awiddersheim | yeah the list of nodes needing facts gathered was happening for quite a while but it seems like people might not have understood why these nodes were in the list as I tried to point out in my commit message | 14:31 |
Jeffrey4l | http://docs.ansible.com/ansible/playbooks_variables.html#fact-caching | 14:31 |
Jeffrey4l | let us document that when you have plenty of node, you'd better to enable the fact cache | 14:31 |
Jeffrey4l | awiddersheim, yes. I remove lots of host in site.yml already :( | 14:32 |
awiddersheim | it wasn't obvious to me either until pbourke pointed it out to me | 14:32 |
*** unicell has joined #openstack-kolla | 14:32 | |
awiddersheim | which is why I added a comment in my change | 14:33 |
awiddersheim | to help future me's | 14:33 |
*** unicell1 has quit IRC | 14:34 | |
inc0 | we can require some fact caching in our docs tho | 14:35 |
inc0 | this is good practice | 14:35 |
pbourke | inc0: I wouldn't require it | 14:35 |
pbourke | inc0: it can cause issues and is non trivial to maintain | 14:35 |
inc0 | memory cache is pretty much no-op | 14:35 |
pbourke | its an optimisation, we shouldn't require it for our stuff to work properly | 14:36 |
inc0 | on the other hand | 14:36 |
inc0 | we're close to release and we might create scenerios which our play is going to fail | 14:36 |
*** senk_ has joined #openstack-kolla | 14:37 | |
*** sdake has joined #openstack-kolla | 14:37 | |
inc0 | pbourke, Jeffrey4l awiddersheim how about middle ground? we will to setup on all nodes today | 14:37 |
pbourke | the fact common is running on every node regardless of tags is a pretty big regression | 14:38 |
inc0 | and will have effort to create targeted caching and CI system to keep it working in ocata? | 14:38 |
pbourke | actually sorry im wrong on that, it will respect tags | 14:39 |
pbourke | inc0: that sounds ok yeah | 14:39 |
pbourke | i agree its a bit sticky to be changing at this stage in the cycle | 14:40 |
inc0 | Jeffrey4l, awiddersheim can you work together to create potentially non-optimal but always working site.yml? | 14:40 |
inc0 | pbourke, feel free to add bp and target it to O, I think this is really good change, but I think we'll need CI for it, and that's going to be non-trivial | 14:41 |
Jeffrey4l | np. | 14:41 |
inc0 | as to make it work we'd need to have really-really multinode;) | 14:41 |
openstackgerrit | Andrew Widdersheim proposed openstack/kolla: Remove redundant common play and add haproxy hosts https://review.openstack.org/376524 | 14:41 |
inc0 | thanks guys! | 14:41 |
awiddersheim | I updated my review | 14:42 |
Jeffrey4l | how about the case i mentioned above? we can not prevent the end-user add content use other groups. | 14:42 |
inc0 | yeah I see, thanks | 14:42 |
inc0 | will it work without fact caching Jeffrey4l ? | 14:42 |
Jeffrey4l | inc0, which? gather all facters? | 14:42 |
inc0 | yeah | 14:42 |
inc0 | https://review.openstack.org/#/c/376524/2 | 14:42 |
Jeffrey4l | yes. gater all facters always work. | 14:43 |
openstackgerrit | Merged openstack/kolla: change CollectD to collectd in collectd role https://review.openstack.org/376245 | 14:43 |
inc0 | let's do this, --limit will be workaround for optimization | 14:43 |
awiddersheim | if we do this | 14:45 |
awiddersheim | there is a lot of 'guards' that can probably get removed as well | 14:45 |
awiddersheim | by 'do this' I mean settle on this approach for fact gathering for the long haul | 14:45 |
pbourke | I thought the plan for now was to do nothing | 14:46 |
inc0 | awiddersheim, yeah, I'm not convinced it's good for long run | 14:46 |
pbourke | until O | 14:46 |
inc0 | let's look at this issue in O so we can carefully examine it | 14:46 |
awiddersheim | stuff like this wouldn't make sense anymore | 14:46 |
awiddersheim | https://github.com/openstack/kolla/blob/master/ansible/roles/haproxy/tasks/main.yml#L3 | 14:46 |
sdake | if its brkoen it must be fixed | 14:46 |
pbourke | its not broken just non optimal | 14:46 |
sdake | inc0 said it was noticeable on multinode | 14:47 |
sdake | the isue that is | 14:47 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding missing localtime mounts and volumes https://review.openstack.org/377755 | 14:47 |
inc0 | sdake, awiddersheim patch will fix all the issues | 14:47 |
inc0 | but will be suboptimal | 14:48 |
sdake | cool | 14:48 |
sdake | lets roll with that | 14:48 |
sdake | we got a boatload of bugs to fix | 14:48 |
inc0 | for now, that's good discussion to have | 14:48 |
inc0 | in Ocata | 14:48 |
*** senk_ has quit IRC | 14:53 | |
*** senk_ has joined #openstack-kolla | 14:53 | |
sdake | awiddersheim you seem to understand ansible well | 14:53 |
awiddersheim | sometimes | 14:53 |
sdake | awiddersheim thats a good thing - if you think we are doing it wrong we work together to fix that :) | 14:53 |
*** mewald1 has joined #openstack-kolla | 14:53 | |
sdake | just say so | 14:53 |
awiddersheim | will do thanks | 14:53 |
sdake | sup Mech422 | 14:53 |
sdake | sup mewald | 14:53 |
sdake | ay monitoring made it in | 14:53 |
sdake | mewald1 ^^ | 14:53 |
*** mewald has quit IRC | 14:54 | |
mewald1 | sdake: hi what's up :) | 14:54 |
sdake | mewald1 I htink monitoring could use a once over | 14:55 |
sdake | mewald1 just to double check everything is in working order | 14:55 |
sdake | mewald1 i haveseen a few patches fly by to fix various things | 14:55 |
mewald1 | yeah, I have some pressure internally here about backporting that stuff to stable/mitaka … have to get that done first | 14:56 |
pbourke | inc0: Jeffrey4l: sdake while we're all discussing things here's a less tricky topic https://review.openstack.org/#/c/374652/ | 14:56 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Add a note for how to get prior release kolla doc https://review.openstack.org/376525 | 14:56 |
mewald1 | sdake: all I know: it worked in patch sets 1 :D then it was ripped apart and I didn't build / deploy every time to be honest | 14:57 |
inc0 | do we have any record of these todos? | 14:57 |
inc0 | bugs? | 14:57 |
*** senk_ has quit IRC | 14:57 | |
mewald1 | I have seen something about collectd happened - what's the reason for that? | 14:57 |
sdake | mewald1 no idea | 14:58 |
sdake | mewald1 i assume people know whatthey are doing and we are approvingappropiatly :) | 14:58 |
pbourke | inc0: yes I logged bugs for them | 14:58 |
sdake | i dont think collectd stops tig from working mewald1 ^? | 14:58 |
mewald1 | sdake: so I should find something about that in the blueprints | 14:58 |
mewald1 | sdake: no but it's a drop in replacement for telegraf | 14:59 |
sdake | mewald1 not sure - documenation tracking in this project is not verygood | 14:59 |
sdake | mewald1 is that harmful? | 14:59 |
openstackgerrit | Merged openstack/kolla: change perm 0644 to 0600 in congress role https://review.openstack.org/376425 | 14:59 |
Jeffrey4l | berendt, i think your PS https://review.openstack.org/375295 is ready to merge . | 15:00 |
berendt | Jeffrey4l anything to do there? i have no tested it as mentioned in the comments | 15:01 |
*** dwalsh has quit IRC | 15:01 | |
openstackgerrit | Christian Berendt proposed openstack/kolla: Use merge_configs for gnocchi-api-paste.ini file https://review.openstack.org/375295 | 15:01 |
mewald1 | sdake: no really, but depending on what happens could result in duplicate values in influxdb unnecessarily increasing the database | 15:01 |
sdake | mewald1 right | 15:02 |
sdake | mewald1 so maybe we need a check for that condition | 15:02 |
*** zhurong has quit IRC | 15:02 | |
Jeffrey4l | berendt, i rebased my PS on yours. then you need do nothing. | 15:02 |
mewald1 | yeah should be either telegraf or collectd but not both | 15:02 |
sdake | mewald1 roger that | 15:03 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Rename the gnocchi api-paste filename https://review.openstack.org/376092 | 15:03 |
sdake | mewald1 the ha on influxdb | 15:03 |
mewald1 | I picked telegraf because it uses rest api to connect to influxdb which is load balancable. collectd uses a UDP connector which haproxy cannot load balance | 15:03 |
sdake | mewald1 seems propreitary | 15:03 |
sdake | mewald1 i see | 15:03 |
sdake | mewald1 that does sound more optimal | 15:03 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Remove do_reconfigure.yml file for all roles https://review.openstack.org/375878 | 15:04 |
*** b_bezak has quit IRC | 15:05 | |
sdake | mewald1 is there any replacement for influxdb that has ha? | 15:06 |
mewald1 | sdake: nothing I could implement. there are tons of options for metric collection and storage out there. When we discussed the stack here we had tons to buzzwords flying around but I didnt have the impression anyone here knew any of the other stacks well enough to implement something | 15:09 |
mewald1 | from good old graphite over prometheus and some mega ultra millenium scale setups including apache kafka :D | 15:10 |
MarMat_ | ping Jeffrey4l the magnum thing | 15:11 |
sdake | mewald1 right - I'm not particially up to date on perfformance tools ;) | 15:11 |
Jeffrey4l | MarMat_, pong | 15:11 |
sdake | mewald1 the idea sounds goodto me | 15:11 |
sdake | mewald1 i think we need to sort out the ha nut or just document it exists | 15:11 |
sdake | mewald1 "Don't expect performance metrics to be ha" | 15:12 |
MarMat_ | Jeffrey4l concerning your suggestions about implementation: os_keystone_domain_module cannot be used for Newton since it's ansible 2.1. I'm then going the way add optional domain parameter into kolla_keystone_user module and insert/get ids from there in one shot. Is that approach fine with you? | 15:12 |
inc0 | database of monitoring metrics is non-trivial at least | 15:13 |
sdake | i think its ok if the eprf metrics rae not ha | 15:13 |
inc0 | I've heard good things about cassandra cluster for thrm;) | 15:13 |
Jeffrey4l | in kolla-toolbox, the ansible version is fixed on 2.1.1 | 15:13 |
sdake | inc0 we have one already - influxdb | 15:13 |
inc0 | not HA tho | 15:13 |
sdake | right | 15:13 |
inc0 | cassandra would be HA | 15:13 |
sdake | i think the key is it needs to integrate into the t and hte g | 15:13 |
Jeffrey4l | MarMat_, so you can use that module in through kolla-toolbox | 15:13 |
MarMat_ | Jeffrey4l I see :-) ok then | 15:14 |
sdake | anyway topic for next cycle | 15:14 |
sdake | not changingit now | 15:14 |
*** dwalsh has joined #openstack-kolla | 15:15 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding missing localtime mounts and volumes https://review.openstack.org/377755 | 15:15 |
*** haplo37__ has joined #openstack-kolla | 15:17 | |
*** openstackgerrit has quit IRC | 15:18 | |
*** openstackgerrit has joined #openstack-kolla | 15:18 | |
mewald1 | inc0: no offence, but "I've heard good things" is exactly why I chose what I know works when we discussed the stack before hand :) Many people suggested a lot of things, but nobody really was able to say "I know it works like a charm and I can tell how how to do it" :) | 15:19 |
inc0 | mewald1, I'm totally ok with out current implementation | 15:19 |
mewald1 | inc0: ok :) | 15:20 |
inc0 | however we shouldn't stop talking about this, we know shortcomings of influx | 15:20 |
mewald1 | yeah ^^ | 15:20 |
inc0 | but it's tested and it's very popular, we know it works, that's enough for me | 15:20 |
inc0 | but you know...this isn't solved problem, all I'm saying | 15:20 |
inc0 | cassandra has much more complex deployment logic | 15:21 |
mewald1 | sure you're right. I couldn't see why everybody is saying the influxdb ha solution is proprietary. I think all we need is influxdb-relay and the code is right there on github: https://github.com/influxdata/influxdb-relay | 15:21 |
inc0 | thats more of sharding than ha tho right? | 15:22 |
zhubingbing | i agre mewald1 | 15:23 |
zhubingbing | influxdb-relay we need it | 15:23 |
inc0 | ok, it's kinda replication | 15:23 |
mewald1 | well, if something fails the service still works :D | 15:23 |
*** eaguilar_ has quit IRC | 15:24 | |
sdake | mewald1 some cat linked me info from influxddb website saying that implementation doen't work | 15:25 |
sdake | and they don't intend to support or implementha except in their enterprise edition | 15:25 |
sdake | we ran into this problem with acls on our heka/elasticsearch implementation | 15:26 |
sdake | the acl plugins were priorietary | 15:27 |
sdake | so we just implemented around it | 15:27 |
zhubingbing | elasticsearch ha? | 15:27 |
sdake | nah thats opensource | 15:27 |
inc0 | no, it was kibana auth afair | 15:27 |
sdake | the acl plugins for password protection on the web interface | 15:27 |
sdake | sorry kibana auth | 15:27 |
sdake | so many parts ;) | 15:27 |
inc0 | we did it with haproxy http auth | 15:28 |
*** rmart04 has quit IRC | 15:28 | |
sdake | right dave-mccowan did it iirc | 15:28 |
mewald1 | ah ok - damn | 15:28 |
sdake | easy solution | 15:28 |
sdake | "HA of performance monitoring is not spported. If the ndoe hoting performance monitooring fails, data is lost." | 15:29 |
sdake | just put in docs | 15:29 |
sdake | problem solved in short term | 15:29 |
zhubingbing | -( | 15:29 |
sdake | maybe we can loook at that relay code and see if it really works or not | 15:29 |
sdake | in ocata | 15:29 |
mewald1 | imho: I dont need HA for perf data | 15:31 |
zhubingbing | performance monitoring why not need ha? | 15:31 |
mewald1 | I dont use it for capacity planning / trending just for troubleshooting and for that usually a few hours of data is enough | 15:34 |
inc0 | well, it does have it's uses in terms of alarming | 15:36 |
mewald1 | but alarming is exactly what the stack currently does not do - for that imho we should add sensu to the mix | 15:37 |
inc0 | and then HA is useful, because if it's down, you lose your alarms and other stuff might go down without you knowing about it | 15:37 |
*** senk_ has joined #openstack-kolla | 15:37 | |
inc0 | agree, but HA is still going to be an issue | 15:38 |
mewald1 | yeah not everybody thinks the way I think - I know ^^ | 15:38 |
*** zhubingbing has quit IRC | 15:38 | |
inc0 | if everybody would think in way I think I wouldn't have many friends... | 15:39 |
inc0 | :P | 15:39 |
mewald1 | :D | 15:40 |
*** senk_ has quit IRC | 15:42 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding missing localtime mounts and volumes https://review.openstack.org/377755 | 15:42 |
*** mewald1 has quit IRC | 15:44 | |
*** zhubingbing has joined #openstack-kolla | 15:48 | |
zhubingbing | - - | 15:49 |
*** mewald has joined #openstack-kolla | 15:49 | |
zhubingbing | did i missing anything? | 15:50 |
*** daneyon has joined #openstack-kolla | 16:01 | |
*** haplo37_ has quit IRC | 16:05 | |
*** zhubingbing has quit IRC | 16:05 | |
*** daneyon has quit IRC | 16:06 | |
*** haplo37_ has joined #openstack-kolla | 16:07 | |
*** inc0_ has joined #openstack-kolla | 16:09 | |
*** inc0 has quit IRC | 16:09 | |
*** salv-orl_ has quit IRC | 16:11 | |
*** salv-orlando has joined #openstack-kolla | 16:12 | |
*** matrohon has quit IRC | 16:12 | |
*** bmace has joined #openstack-kolla | 16:14 | |
*** dwalsh has quit IRC | 16:14 | |
*** eaguilar has joined #openstack-kolla | 16:16 | |
*** msimonin has quit IRC | 16:17 | |
openstackgerrit | BorneMace proposed openstack/kolla: Adding some optional destroy behavior https://review.openstack.org/377837 | 16:21 |
inc0_ | bmace, long time no see:) | 16:22 |
*** mnasiadka has quit IRC | 16:22 | |
bmace | hey inc0_ :) | 16:22 |
*** portdirect has quit IRC | 16:24 | |
pbourke | inc0_: i see you got through the proxy ;) | 16:26 |
pbourke | I mean, bmace ^ | 16:26 |
bmace | yeah.. gave up on trying to tunnel ssh and just did the goofy http password thing. | 16:26 |
inc0_ | proxy? | 16:27 |
bmace | our corporate proxy | 16:27 |
inc0_ | well I had lots of adventures with proxy, not sure if that is what you mean;) | 16:27 |
*** berendt has quit IRC | 16:28 | |
pbourke | inc0_: I had meant to point the above msg at bmace | 16:29 |
pbourke | inc0_: but yeah most of us know the pain Im sure :) | 16:29 |
*** igordcar1 has quit IRC | 16:29 | |
*** igordcard has joined #openstack-kolla | 16:29 | |
inc0_ | xchat has proxy settings | 16:30 |
inc0_ | as irc goes | 16:30 |
*** sbezverk has joined #openstack-kolla | 16:34 | |
*** inc0__ has joined #openstack-kolla | 16:34 | |
*** awidders_ has joined #openstack-kolla | 16:35 | |
*** david-lyle_ has joined #openstack-kolla | 16:35 | |
*** inc0__ is now known as inc0 | 16:35 | |
*** neilus has joined #openstack-kolla | 16:35 | |
*** zhenguo_ has joined #openstack-kolla | 16:36 | |
*** zhenguo has quit IRC | 16:36 | |
*** haplo37__ has quit IRC | 16:36 | |
*** kong has quit IRC | 16:36 | |
*** Serlex has quit IRC | 16:36 | |
*** mdorman has quit IRC | 16:36 | |
*** brad[] has quit IRC | 16:36 | |
*** haplo37 has quit IRC | 16:37 | |
*** yee3793 has quit IRC | 16:37 | |
*** aswadr_ has quit IRC | 16:37 | |
*** Pavo has quit IRC | 16:37 | |
*** gmmaha has quit IRC | 16:37 | |
*** ajafo has quit IRC | 16:37 | |
*** wirehead_1 has joined #openstack-kolla | 16:37 | |
*** Kimmo__ has joined #openstack-kolla | 16:37 | |
*** yee379 has joined #openstack-kolla | 16:37 | |
*** salv-orlando has quit IRC | 16:37 | |
*** Kimmo_ has quit IRC | 16:37 | |
*** david-lyle has quit IRC | 16:37 | |
*** mliima has quit IRC | 16:37 | |
*** wirehead_ has quit IRC | 16:37 | |
*** serverascode has quit IRC | 16:37 | |
*** kbyrne has quit IRC | 16:37 | |
*** Jeffrey4l has quit IRC | 16:37 | |
*** Marx314 has quit IRC | 16:37 | |
*** papacz has quit IRC | 16:37 | |
*** jrich523 has quit IRC | 16:37 | |
*** ajafo has joined #openstack-kolla | 16:37 | |
*** 14WAAHO67 has joined #openstack-kolla | 16:37 | |
*** inc0_ has quit IRC | 16:37 | |
*** tonanhngo has quit IRC | 16:37 | |
*** imcsk8_ has quit IRC | 16:37 | |
*** rhallisey has quit IRC | 16:37 | |
*** Kdecherf has quit IRC | 16:37 | |
*** jgriffith has quit IRC | 16:37 | |
*** awiddersheim has quit IRC | 16:37 | |
*** gfidente^2nd has joined #openstack-kolla | 16:37 | |
*** jmccarthy1 has joined #openstack-kolla | 16:37 | |
*** mliima_ has joined #openstack-kolla | 16:38 | |
*** sbezverk_ has quit IRC | 16:38 | |
*** rhallisey_ has joined #openstack-kolla | 16:38 | |
pbourke | inc0: do you feel things like this are appropriate in feature freeze https://review.openstack.org/#/c/375878/ | 16:38 |
*** g3ek has quit IRC | 16:38 | |
*** ccesario has quit IRC | 16:38 | |
*** ajpower has quit IRC | 16:38 | |
*** clayton has quit IRC | 16:38 | |
*** jidar has quit IRC | 16:38 | |
*** jrich523_ has joined #openstack-kolla | 16:38 | |
*** bjolo_ has joined #openstack-kolla | 16:38 | |
*** jmccarthy has quit IRC | 16:38 | |
*** papacz1 has joined #openstack-kolla | 16:38 | |
*** gfidente has quit IRC | 16:38 | |
*** Mech422 has quit IRC | 16:38 | |
*** brad[]` has joined #openstack-kolla | 16:38 | |
*** bjolo has quit IRC | 16:38 | |
*** timss has quit IRC | 16:38 | |
*** dgonzalez has quit IRC | 16:38 | |
*** jheroux has quit IRC | 16:38 | |
openstackgerrit | Merged openstack/kolla: Update manila-share.conf https://review.openstack.org/377707 | 16:38 |
*** Pavo has joined #openstack-kolla | 16:39 | |
inc0 | I'm trying to recall why we did do-reconfigure in the first place | 16:39 |
*** jgriffith has joined #openstack-kolla | 16:39 | |
*** tonanhngo has joined #openstack-kolla | 16:39 | |
sdake | pbourke the question you have to ask is "are we fixing a defect" | 16:39 |
inc0 | correct me if I'm wrong but that was for serial | 16:39 |
sdake | if the answer to that is no, then its a feature | 16:39 |
*** gmmaha has joined #openstack-kolla | 16:39 | |
*** Mech422 has joined #openstack-kolla | 16:39 | |
*** yuanying has quit IRC | 16:40 | |
sdake | pbourke tht ptch looks big and scary to me personally | 16:40 |
*** karlamrhein has quit IRC | 16:40 | |
*** zhenguo_ is now known as zhenguo | 16:40 | |
inc0 | yeah me too tbh | 16:40 |
*** Kdecherf has joined #openstack-kolla | 16:40 | |
*** haplo37 has joined #openstack-kolla | 16:40 | |
*** yee379 has quit IRC | 16:41 | |
sdake | not sure if this is a bug https://bugs.launchpad.net/kolla/+bug/1628152 | 16:41 |
openstack | Launchpad bug 1628152 in kolla "do_reconfigure is useless now." [Undecided,In progress] - Assigned to Jeffrey Zhang (jeffrey4l) | 16:41 |
sdake | or not | 16:41 |
sdake | jeffrey4l probablygetting om ewell ddeserved rest | 16:41 |
inc0 | it's simplification of codebase | 16:41 |
pbourke | i can explain,one moment | 16:41 |
*** DuncanT has quit IRC | 16:41 | |
*** jidar has joined #openstack-kolla | 16:41 | |
*** yuanying has joined #openstack-kolla | 16:41 | |
*** serverascode has joined #openstack-kolla | 16:43 | |
*** bjolo__ has joined #openstack-kolla | 16:44 | |
pbourke | so yeah it was done originally because we thought serial had to go in the tasks | 16:44 |
*** tonanhngo_ has joined #openstack-kolla | 16:44 | |
sdake | one of the defects we have atm is reconfigure is too slow | 16:44 |
sdake | i dont know if this fixes that problem or not | 16:44 |
pbourke | maybe its a part of that effort then | 16:45 |
*** dgonzalez has joined #openstack-kolla | 16:45 | |
pbourke | otherwise its a refactor that can wait | 16:45 |
sdake | its 30 mins deploy 120 min recnofig on 64 nodees | 16:45 |
*** apuimedo has quit IRC | 16:45 | |
*** eaguilar has quit IRC | 16:45 | |
sdake | right pbourke cn you leave appropriate review | 16:45 |
pbourke | sdake: that was one persons experience though | 16:45 |
*** yuanying_ has joined #openstack-kolla | 16:45 | |
*** ajpower has joined #openstack-kolla | 16:45 | |
sdake | might link to irc conversatino | 16:45 |
pbourke | doesn't mean its representative | 16:45 |
*** clayton has joined #openstack-kolla | 16:46 | |
*** yee379 has joined #openstack-kolla | 16:46 | |
sdake | pbourke on osic 128 ndoes ddeploy took 20 min reconfig took 1 hr | 16:46 |
sdake | i have data to back it up | 16:46 |
pbourke | ah | 16:46 |
inc0 | well reconfig does much more than deploy | 16:46 |
inc0 | really | 16:46 |
pbourke | what on earth is the hold up | 16:46 |
pbourke | restarting containers? | 16:46 |
sdake | ya but a 1:3 ratio? | 16:46 |
inc0 | stopping existing containers takes time | 16:46 |
*** Guest66676 has quit IRC | 16:46 | |
*** ajafo has quit IRC | 16:46 | |
*** Pavo_ has joined #openstack-kolla | 16:46 | |
*** ajafo has joined #openstack-kolla | 16:46 | |
inc0 | but well, it shouldnt be THAT big of a difference | 16:46 |
*** mark-casey11 has joined #openstack-kolla | 16:47 | |
*** 14WAAHO67 has quit IRC | 16:47 | |
*** zeus has quit IRC | 16:47 | |
*** Pavo has quit IRC | 16:47 | |
*** Pavo_ is now known as Pavo | 16:47 | |
*** Kdecherf has quit IRC | 16:47 | |
*** g3ek has joined #openstack-kolla | 16:47 | |
inc0 | however this PS won't help | 16:47 |
*** dotplus has quit IRC | 16:47 | |
inc0 | it's harder issue | 16:47 |
*** jgriffith has quit IRC | 16:47 | |
*** hieulq has quit IRC | 16:47 | |
*** wirehead_1 has quit IRC | 16:47 | |
*** gfidente^2nd has quit IRC | 16:48 | |
*** wirehead_ has joined #openstack-kolla | 16:48 | |
*** papacz has joined #openstack-kolla | 16:48 | |
*** mliima__ has joined #openstack-kolla | 16:48 | |
*** serverascode has quit IRC | 16:48 | |
*** tonanhngo has quit IRC | 16:48 | |
*** ayoung has quit IRC | 16:48 | |
*** ayoung has joined #openstack-kolla | 16:48 | |
*** papacz1 has quit IRC | 16:48 | |
*** mark-casey1 has quit IRC | 16:48 | |
*** yuanying has quit IRC | 16:48 | |
*** brad[]` has quit IRC | 16:48 | |
*** bjolo_ has quit IRC | 16:48 | |
*** jrich523 has joined #openstack-kolla | 16:48 | |
inc0 | there is loop somewhere in our plays, for some reason | 16:48 |
sdake | if its a refactor -1 or or -2 procederal it | 16:48 |
*** logan- has quit IRC | 16:48 | |
*** jrich523_ has quit IRC | 16:48 | |
*** msimonin has joined #openstack-kolla | 16:48 | |
*** haplo37- has joined #openstack-kolla | 16:48 | |
*** jidar has quit IRC | 16:48 | |
*** mliima_ has quit IRC | 16:48 | |
*** jidar_ has joined #openstack-kolla | 16:48 | |
sdake | if its a performance fix for the 1:3 thign lets fix that if its easy | 16:48 |
*** mdorman has joined #openstack-kolla | 16:48 | |
inc0 | sdake, I think we need stable/newton branch asap | 16:48 |
*** hieulq has joined #openstack-kolla | 16:48 | |
sdake | inc0 we agreed that woudl happen when we tagged 3.0.0 | 16:48 |
*** kbyrne has joined #openstack-kolla | 16:48 | |
sdake | but i agree stable/newton now would be good | 16:49 |
inc0 | I'd rather deal with decisions whether or not backport a but than to merge it | 16:49 |
sdake | the problem is people doing the backports | 16:49 |
*** jidar_ is now known as jidar | 16:49 | |
sdake | as in we dont have thoe people | 16:49 |
*** unicell has quit IRC | 16:49 | |
*** jgriffith has joined #openstack-kolla | 16:49 | |
*** brad[] has joined #openstack-kolla | 16:49 | |
*** imcsk8 has joined #openstack-kolla | 16:49 | |
pbourke | i need to get better at that | 16:49 |
sdake | pbourke whole team does | 16:50 |
sdake | pbourke including me | 16:50 |
pbourke | the process can be a bit heavy | 16:50 |
sdake | pbourke thats why i thought we agreeed to tag at 3.0.0 :) | 16:50 |
*** Kdecherf has joined #openstack-kolla | 16:50 | |
sdake | pbourke agreeee process sucks | 16:50 |
*** ccesario has joined #openstack-kolla | 16:50 | |
sdake | our backport process is for stable branhes | 16:50 |
sdake | newton isn't stable :( | 16:50 |
*** Serlex has joined #openstack-kolla | 16:51 | |
*** jheroux has joined #openstack-kolla | 16:51 | |
sdake | so it shouldn't matter that often | 16:51 |
sdake | but with what is left in kolla - 100 bug or so | 16:51 |
sdake | do we reall ywant to backport 100 changes | 16:51 |
sdake | assuming we can fix it all | 16:51 |
sdake | which i assume :) | 16:51 |
*** timss has joined #openstack-kolla | 16:52 | |
*** gfhellma has joined #openstack-kolla | 16:52 | |
*** zeus has joined #openstack-kolla | 16:53 | |
*** zeus is now known as Guest66430 | 16:53 | |
*** logan- has joined #openstack-kolla | 16:54 | |
pbourke | are we following https://releases.openstack.org/newton/schedule.html ? | 16:54 |
pbourke | if so we have less than a week | 16:54 |
*** apuimedo has joined #openstack-kolla | 16:54 | |
*** Pavo has quit IRC | 16:55 | |
*** dotplus has joined #openstack-kolla | 16:55 | |
*** dotplus has joined #openstack-kolla | 16:55 | |
*** Pavo has joined #openstack-kolla | 16:56 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kolla: Updated from global requirements https://review.openstack.org/375989 | 16:56 |
*** gfidente has joined #openstack-kolla | 16:58 | |
*** gfidente has joined #openstack-kolla | 16:58 | |
*** Guest66666 has joined #openstack-kolla | 16:58 | |
*** bdaca has quit IRC | 16:58 | |
*** salv-orlando has joined #openstack-kolla | 16:59 | |
*** Guest66430 is now known as zeus` | 17:02 | |
*** zeus` is now known as zeus | 17:02 | |
*** zeus has quit IRC | 17:02 | |
*** zeus has joined #openstack-kolla | 17:02 | |
*** papacz1 has joined #openstack-kolla | 17:08 | |
*** inc0_ has joined #openstack-kolla | 17:08 | |
*** msimonin1 has joined #openstack-kolla | 17:09 | |
*** imcsk8_ has joined #openstack-kolla | 17:09 | |
*** lamt has joined #openstack-kolla | 17:09 | |
*** mdorman_ has joined #openstack-kolla | 17:10 | |
*** jgriffith_ has joined #openstack-kolla | 17:10 | |
*** jidar_ has joined #openstack-kolla | 17:10 | |
*** Serlex has quit IRC | 17:10 | |
*** ajafo has quit IRC | 17:10 | |
*** jidar has quit IRC | 17:10 | |
*** ajafo has joined #openstack-kolla | 17:10 | |
*** ccesario has quit IRC | 17:10 | |
*** jrich523_ has joined #openstack-kolla | 17:10 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding missing localtime mounts and volumes https://review.openstack.org/377755 | 17:10 |
*** zeus has quit IRC | 17:11 | |
*** jidar_ is now known as jidar | 17:11 | |
*** jgriffith has quit IRC | 17:11 | |
*** apuimedo has quit IRC | 17:11 | |
*** logan- has quit IRC | 17:11 | |
*** gfidente has quit IRC | 17:11 | |
*** inc0 has quit IRC | 17:11 | |
*** jheroux has quit IRC | 17:11 | |
*** jrich523 has quit IRC | 17:11 | |
*** bmace has quit IRC | 17:11 | |
*** papacz has quit IRC | 17:12 | |
*** ayoung has quit IRC | 17:12 | |
*** mliima__ has quit IRC | 17:12 | |
*** ayoung_ has joined #openstack-kolla | 17:12 | |
*** Guest66666 has quit IRC | 17:12 | |
*** mdorman has quit IRC | 17:12 | |
*** Pavo has quit IRC | 17:12 | |
*** msimonin has quit IRC | 17:12 | |
*** mliima_ has joined #openstack-kolla | 17:12 | |
*** Serlex1 has joined #openstack-kolla | 17:12 | |
*** imcsk8 has quit IRC | 17:12 | |
*** bmace_ has joined #openstack-kolla | 17:12 | |
*** jgriffith_ is now known as jgriffith | 17:12 | |
*** jheroux has joined #openstack-kolla | 17:12 | |
*** apuimedo_ has joined #openstack-kolla | 17:12 | |
*** ccesario has joined #openstack-kolla | 17:12 | |
*** pbourke has quit IRC | 17:12 | |
*** logan- has joined #openstack-kolla | 17:12 | |
*** apuimedo_ is now known as apuimedo | 17:12 | |
*** Pavo has joined #openstack-kolla | 17:14 | |
*** zeus has joined #openstack-kolla | 17:17 | |
*** harlowja has joined #openstack-kolla | 17:17 | |
*** Guest66666 has joined #openstack-kolla | 17:17 | |
*** sbezverk_ has joined #openstack-kolla | 17:18 | |
*** strigazi is now known as strigazi_AFK | 17:19 | |
*** apuimedo_ has joined #openstack-kolla | 17:20 | |
*** haplo37_ has quit IRC | 17:21 | |
*** zeus is now known as Guest45385 | 17:21 | |
*** ayoung_ has quit IRC | 17:21 | |
*** mliima has joined #openstack-kolla | 17:21 | |
*** sbezverk has quit IRC | 17:21 | |
*** harlowja_ has joined #openstack-kolla | 17:22 | |
*** Kdecherf has quit IRC | 17:22 | |
*** harlowja has quit IRC | 17:22 | |
*** Guest45385 has quit IRC | 17:22 | |
*** logan- has quit IRC | 17:22 | |
*** jheroux has quit IRC | 17:22 | |
*** Guest66676 has joined #openstack-kolla | 17:22 | |
*** apuimedo has quit IRC | 17:22 | |
*** Serlex1 has quit IRC | 17:22 | |
*** apuimedo_ is now known as apuimedo | 17:22 | |
*** serverascode has joined #openstack-kolla | 17:22 | |
*** Guest66666 has quit IRC | 17:22 | |
*** mliima_ has quit IRC | 17:22 | |
*** salv-orl_ has joined #openstack-kolla | 17:22 | |
*** rhallisey_ has quit IRC | 17:22 | |
*** zeus- has joined #openstack-kolla | 17:23 | |
*** jjheroux has joined #openstack-kolla | 17:23 | |
*** haplo37_ has joined #openstack-kolla | 17:23 | |
Daviey | Anyone testing LDAP/AD with Kolla? | 17:23 |
Daviey | (I added support for it a few weeks ago.. and it seems to have broken.. but not our fault that i can see) | 17:23 |
*** zeus- is now known as zeus` | 17:24 | |
*** Kdecherf has joined #openstack-kolla | 17:24 | |
*** david-lyle_ is now known as david-lyle | 17:24 | |
*** rhallisey_ has joined #openstack-kolla | 17:25 | |
*** ayoung_ has joined #openstack-kolla | 17:25 | |
*** salv-orlando has quit IRC | 17:25 | |
*** awidders_ is now known as awiddersheim | 17:25 | |
*** haplo37| has joined #openstack-kolla | 17:25 | |
*** gfidente has joined #openstack-kolla | 17:25 | |
*** gfidente has quit IRC | 17:25 | |
*** gfidente has joined #openstack-kolla | 17:25 | |
*** tonanhngo_ has quit IRC | 17:27 | |
*** cu5_ has joined #openstack-kolla | 17:27 | |
*** dwalsh has joined #openstack-kolla | 17:27 | |
*** unicell has joined #openstack-kolla | 17:27 | |
*** Serlex has joined #openstack-kolla | 17:27 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding missing localtime mounts and volumes https://review.openstack.org/377755 | 17:27 |
*** brad[] has quit IRC | 17:28 | |
*** mark-casey11 has quit IRC | 17:28 | |
*** haplo37 has quit IRC | 17:28 | |
*** fguillot has quit IRC | 17:28 | |
*** cu5 has quit IRC | 17:28 | |
*** haplo37- is now known as haplo37 | 17:28 | |
*** logan- has joined #openstack-kolla | 17:28 | |
*** salv-orlando has joined #openstack-kolla | 17:31 | |
*** inc0__ has joined #openstack-kolla | 17:32 | |
*** mliima_ has joined #openstack-kolla | 17:32 | |
*** unicell1 has joined #openstack-kolla | 17:32 | |
*** SamYaple has quit IRC | 17:33 | |
*** logan- has quit IRC | 17:33 | |
*** zeus` has quit IRC | 17:33 | |
*** harlowja_ has quit IRC | 17:33 | |
*** mliima has quit IRC | 17:33 | |
*** unicell has quit IRC | 17:33 | |
*** gfidente has quit IRC | 17:33 | |
*** salv-orl_ has quit IRC | 17:34 | |
*** haplo37 has quit IRC | 17:34 | |
*** haplo37 has joined #openstack-kolla | 17:34 | |
*** harlowja has joined #openstack-kolla | 17:34 | |
*** eaguilar has joined #openstack-kolla | 17:34 | |
sdake | Daviey can you file a high severity bug pls | 17:35 |
sdake | Daviey and possibly get to hthe bottom of it | 17:35 |
sdake | Daviey if you need my hep to reach out to nayone let me know | 17:35 |
*** inc0_ has quit IRC | 17:35 | |
*** awidders_ has joined #openstack-kolla | 17:38 | |
*** awiddersheim has quit IRC | 17:38 | |
*** zeus- has joined #openstack-kolla | 17:38 | |
*** cu5_ is now known as cu5 | 17:38 | |
*** SamYaple has joined #openstack-kolla | 17:38 | |
*** logan- has joined #openstack-kolla | 17:38 | |
*** zeus- is now known as zeus` | 17:39 | |
*** aswadr_ has joined #openstack-kolla | 17:39 | |
*** zeus` is now known as zeus | 17:39 | |
*** zeus has quit IRC | 17:39 | |
*** zeus has joined #openstack-kolla | 17:39 | |
*** awidders_ has quit IRC | 17:42 | |
*** harlowja has quit IRC | 17:42 | |
*** awiddersheim has joined #openstack-kolla | 17:42 | |
*** kong has joined #openstack-kolla | 17:46 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding missing localtime mounts and volumes https://review.openstack.org/377755 | 17:46 |
sdake | for those into documentaries, curiositystream rocks | 17:46 |
*** awiddersheim has quit IRC | 17:47 | |
sdake | 11 bucks a month for 4k documentariess of very high quality | 17:47 |
*** DuncanT has joined #openstack-kolla | 17:47 | |
*** awiddersheim has joined #openstack-kolla | 17:47 | |
*** harlowja has joined #openstack-kolla | 17:47 | |
inc0__ | thanks sdake I'll check that out | 17:48 |
sdake | they have cheaper packages for lower dev | 17:48 |
sdake | def | 17:48 |
inc0__ | yeah well I have 4k tv but none of platforms they have supports 4k;) | 17:50 |
*** Marcellin__ has joined #openstack-kolla | 17:51 | |
*** inc0__ is now known as inc0 | 17:51 | |
*** egonzalez90 has joined #openstack-kolla | 17:51 | |
Mech422 | So should I 'congratulate' inc0 on his election, or congratulate sdake on getting out alive ? :-) | 17:53 |
inc0 | :D | 17:53 |
sdake | Mech422 both! | 17:53 |
*** msimonin1 has quit IRC | 17:54 | |
Mech422 | LOL | 17:54 |
Mech422 | Will you guys be forming a support group for prior PTO's ? | 17:54 |
*** aswadr_ has quit IRC | 17:58 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding missing localtime mounts and volumes https://review.openstack.org/377755 | 17:58 |
*** karlamrhein has joined #openstack-kolla | 18:05 | |
*** yee3794 has joined #openstack-kolla | 18:06 | |
*** yee379 has quit IRC | 18:07 | |
*** eaguilar_ has joined #openstack-kolla | 18:08 | |
*** harlowja has quit IRC | 18:10 | |
*** ajafo has quit IRC | 18:10 | |
*** eaguilar has quit IRC | 18:10 | |
*** unicell1 has quit IRC | 18:10 | |
*** haplo37| has quit IRC | 18:10 | |
*** serverascode has quit IRC | 18:10 | |
*** haplo37- has joined #openstack-kolla | 18:10 | |
*** ajafo has joined #openstack-kolla | 18:10 | |
*** unicell has joined #openstack-kolla | 18:10 | |
*** hieulq has quit IRC | 18:10 | |
*** ayoung_ has quit IRC | 18:10 | |
*** haplo37 has quit IRC | 18:11 | |
*** gfhellma has quit IRC | 18:11 | |
*** karlamrhein has quit IRC | 18:11 | |
*** Kdecherf has quit IRC | 18:11 | |
*** rhallisey_ has quit IRC | 18:11 | |
*** rhallisey_ has joined #openstack-kolla | 18:11 | |
*** haplo37 has joined #openstack-kolla | 18:11 | |
MarMat_ | @core team, is it ok to bump shade to 1.5.0 from 1.4.0 in kolla-toolbox because of os_user_role ansible module requirements? Still for Newton? Need it for fixing magnum stuff. | 18:11 |
*** serverascode has joined #openstack-kolla | 18:12 | |
*** Kdecherf has joined #openstack-kolla | 18:13 | |
*** ayoung_ has joined #openstack-kolla | 18:16 | |
*** eaguilar_ has quit IRC | 18:17 | |
*** msimonin has joined #openstack-kolla | 18:18 | |
sdake | MarMat_ yes if its a dep issue its a bug | 18:19 |
sdake | magnum always seems to have dep issues ;( | 18:21 |
sdake | I'd realy like that owrking this cycle | 18:21 |
*** bmace_ has quit IRC | 18:21 | |
sdake | Mech422 no support group needed | 18:23 |
*** karlamrhein has joined #openstack-kolla | 18:24 | |
*** harlowja has joined #openstack-kolla | 18:24 | |
sdake | Mech422 but we back each other up when needed | 18:24 |
*** bmace_ has joined #openstack-kolla | 18:25 | |
MarMat_ | sdake ok, will submit next PS soon, let's see then. | 18:25 |
*** egonzalez90 has quit IRC | 18:30 | |
*** neilus has quit IRC | 18:31 | |
*** gfhellma has joined #openstack-kolla | 18:32 | |
*** brad[] has joined #openstack-kolla | 18:32 | |
*** mark-casey11 has joined #openstack-kolla | 18:33 | |
*** salv-orlando has quit IRC | 18:35 | |
*** sdake has quit IRC | 18:35 | |
openstackgerrit | Eduardo Gonzalez proposed openstack/kolla: Port prechecks only for enabled services https://review.openstack.org/377962 | 18:39 |
*** logan- has quit IRC | 18:39 | |
*** tonanhngo has joined #openstack-kolla | 18:39 | |
*** jjheroux has quit IRC | 18:40 | |
*** jjheroux has joined #openstack-kolla | 18:41 | |
*** neilus has joined #openstack-kolla | 18:41 | |
*** logan- has joined #openstack-kolla | 18:42 | |
openstackgerrit | Eduardo Gonzalez proposed openstack/kolla: Port prechecks only for enabled services https://review.openstack.org/377962 | 18:43 |
*** haplo37 has quit IRC | 18:48 | |
*** sdake has joined #openstack-kolla | 18:49 | |
openstackgerrit | Christian Berendt proposed openstack/kolla: Deprecate Fedora based Docker images https://review.openstack.org/369184 | 18:52 |
*** inc0_ has joined #openstack-kolla | 18:56 | |
*** haplo37 has joined #openstack-kolla | 18:57 | |
*** brad[] has quit IRC | 18:57 | |
*** mark-casey11 has quit IRC | 18:57 | |
*** DuncanT has quit IRC | 18:58 | |
*** inc0 has quit IRC | 18:59 | |
*** DuncanT has joined #openstack-kolla | 19:00 | |
Daviey | sdake: Yeah.. I havent got to the bottom of it yet... but i want to check if it is a local trivial config issue or something more | 19:05 |
sdake | Daviey sounds good | 19:06 |
sdake | Daviey i dont know anything about it | 19:06 |
sdake | so rely on the people that write it to fix it ;) | 19:06 |
*** Serlex has quit IRC | 19:06 | |
*** Pavo_ has joined #openstack-kolla | 19:10 | |
sdake | must collect ssecond chil d bbiaf | 19:10 |
*** sdake has quit IRC | 19:10 | |
*** haplo37- has quit IRC | 19:11 | |
*** Pavo has quit IRC | 19:11 | |
*** Pavo_ is now known as Pavo | 19:11 | |
*** haplo37- has joined #openstack-kolla | 19:12 | |
*** salv-orlando has joined #openstack-kolla | 19:13 | |
*** salv-orlando has quit IRC | 19:18 | |
openstackgerrit | Merged openstack/kolla-kubernetes: Adding missing localtime mounts and volumes https://review.openstack.org/377755 | 19:21 |
*** Pavo has quit IRC | 19:25 | |
*** logan- has quit IRC | 19:26 | |
*** Marcellin__ has quit IRC | 19:26 | |
*** serverascode has quit IRC | 19:27 | |
*** Marcellin__ has joined #openstack-kolla | 19:27 | |
*** ayoung_ has quit IRC | 19:27 | |
*** SamYaple has quit IRC | 19:27 | |
*** dwalsh has quit IRC | 19:27 | |
*** SamYaple has joined #openstack-kolla | 19:27 | |
*** serverascode has joined #openstack-kolla | 19:27 | |
*** dwalsh has joined #openstack-kolla | 19:27 | |
*** Pavo has joined #openstack-kolla | 19:31 | |
*** jroll has quit IRC | 19:31 | |
*** sgordon has quit IRC | 19:34 | |
*** logan- has joined #openstack-kolla | 19:34 | |
*** inc0__ has joined #openstack-kolla | 19:35 | |
*** tonyb has quit IRC | 19:35 | |
*** inc0__ is now known as inc0 | 19:35 | |
*** PyroMani has quit IRC | 19:35 | |
*** akscram1 has quit IRC | 19:35 | |
*** lukl1 has quit IRC | 19:35 | |
*** Marcellin__ has quit IRC | 19:35 | |
*** serverascode has quit IRC | 19:35 | |
*** DuncanT has quit IRC | 19:35 | |
*** rhallisey__ has joined #openstack-kolla | 19:36 | |
*** rhallisey_ has quit IRC | 19:36 | |
*** tonyb_ has joined #openstack-kolla | 19:36 | |
*** akscram1 has joined #openstack-kolla | 19:36 | |
*** lukl1 has joined #openstack-kolla | 19:36 | |
*** rhallisey__ is now known as rhallisey | 19:36 | |
*** sgordon has joined #openstack-kolla | 19:37 | |
*** jroll has joined #openstack-kolla | 19:37 | |
*** jroll has quit IRC | 19:37 | |
*** jroll has joined #openstack-kolla | 19:37 | |
*** inc0_ has quit IRC | 19:38 | |
*** PyroMani has joined #openstack-kolla | 19:39 | |
*** dcwangmit01 has quit IRC | 19:42 | |
*** eaguilar has joined #openstack-kolla | 19:43 | |
*** mandre has quit IRC | 19:44 | |
*** kfox1111 has quit IRC | 19:44 | |
*** jroll has quit IRC | 19:44 | |
*** karlamrhein has quit IRC | 19:44 | |
*** haplo37- has quit IRC | 19:44 | |
*** salv-orlando has joined #openstack-kolla | 19:45 | |
*** jheroux has joined #openstack-kolla | 19:45 | |
*** jjheroux has quit IRC | 19:45 | |
*** jroll has joined #openstack-kolla | 19:46 | |
*** jroll has quit IRC | 19:46 | |
*** jroll has joined #openstack-kolla | 19:46 | |
*** haplo37- has joined #openstack-kolla | 19:47 | |
*** mandre has joined #openstack-kolla | 19:48 | |
*** dcwangmit01 has joined #openstack-kolla | 19:49 | |
*** kfox1111 has joined #openstack-kolla | 19:49 | |
*** DuncanT has joined #openstack-kolla | 19:53 | |
*** serverascode has joined #openstack-kolla | 20:02 | |
*** schwicht has quit IRC | 20:02 | |
*** karlamrhein has joined #openstack-kolla | 20:05 | |
*** imcsk8_ is now known as imcsk8 | 20:09 | |
*** fguillot has joined #openstack-kolla | 20:11 | |
*** senk_ has joined #openstack-kolla | 20:11 | |
*** dave-mccowan has quit IRC | 20:13 | |
*** sdake has joined #openstack-kolla | 20:13 | |
*** bjolo__ has quit IRC | 20:19 | |
*** jrich523_ has quit IRC | 20:19 | |
*** bjolo__ has joined #openstack-kolla | 20:21 | |
*** logan- has quit IRC | 20:21 | |
*** jrich523 has joined #openstack-kolla | 20:22 | |
*** DuncanT has quit IRC | 20:22 | |
*** senk_ has quit IRC | 20:23 | |
*** schwicht has joined #openstack-kolla | 20:23 | |
*** lamt has quit IRC | 20:23 | |
*** sdake_ has joined #openstack-kolla | 20:23 | |
*** qbjolof has quit IRC | 20:23 | |
*** jroll has quit IRC | 20:23 | |
*** rhallisey has quit IRC | 20:23 | |
*** jroll has joined #openstack-kolla | 20:23 | |
*** jroll has quit IRC | 20:23 | |
*** jroll has joined #openstack-kolla | 20:23 | |
*** Pavo has quit IRC | 20:24 | |
*** sdake has quit IRC | 20:24 | |
*** qbjolof1 has joined #openstack-kolla | 20:24 | |
*** rhallisey_ has joined #openstack-kolla | 20:24 | |
*** Pavo has joined #openstack-kolla | 20:25 | |
*** logan- has joined #openstack-kolla | 20:26 | |
*** qwang has quit IRC | 20:30 | |
*** ntpttr has quit IRC | 20:32 | |
*** daneyon has joined #openstack-kolla | 20:32 | |
*** serverascode has quit IRC | 20:32 | |
*** schwicht has quit IRC | 20:32 | |
*** PyroMani has quit IRC | 20:32 | |
*** qbjolof1 has quit IRC | 20:33 | |
*** rhallisey_ has quit IRC | 20:33 | |
*** jroll has quit IRC | 20:33 | |
*** PyroMani has joined #openstack-kolla | 20:33 | |
*** rhallisey has joined #openstack-kolla | 20:33 | |
*** qbjolof1 has joined #openstack-kolla | 20:33 | |
*** ntpttr has joined #openstack-kolla | 20:33 | |
*** jroll has joined #openstack-kolla | 20:34 | |
*** jroll has quit IRC | 20:34 | |
*** jroll has joined #openstack-kolla | 20:34 | |
*** dave-mccowan has joined #openstack-kolla | 20:35 | |
*** daneyon has quit IRC | 20:37 | |
*** jtriley has quit IRC | 20:38 | |
*** senk_ has joined #openstack-kolla | 20:38 | |
*** DuncanT has joined #openstack-kolla | 20:38 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding resolv.conf workaround to logging containers https://review.openstack.org/378021 | 20:39 |
*** dave-mcc_ has joined #openstack-kolla | 20:41 | |
*** senk_ has quit IRC | 20:43 | |
*** neilus has quit IRC | 20:43 | |
*** serverascode has joined #openstack-kolla | 20:43 | |
*** dave-mccowan has quit IRC | 20:46 | |
*** DuncanT has quit IRC | 20:46 | |
*** sdake_ has quit IRC | 20:46 | |
*** jroll has quit IRC | 20:46 | |
*** jroll has joined #openstack-kolla | 20:46 | |
*** jroll is now known as Guest49945 | 20:46 | |
*** sdake has joined #openstack-kolla | 20:47 | |
*** Guest49945 is now known as jroll|dupe | 20:47 | |
*** jroll|dupe has quit IRC | 20:47 | |
*** jroll|dupe has joined #openstack-kolla | 20:47 | |
*** lamt has joined #openstack-kolla | 20:49 | |
*** brad[] has joined #openstack-kolla | 20:50 | |
*** jroll|dupe is now known as jroll | 20:54 | |
*** huikang has joined #openstack-kolla | 20:57 | |
*** DuncanT has joined #openstack-kolla | 20:57 | |
*** neilus has joined #openstack-kolla | 20:57 | |
*** eaguilar has quit IRC | 20:58 | |
*** qwang has joined #openstack-kolla | 20:59 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding resolv.conf workaround to logging containers https://review.openstack.org/378021 | 21:01 |
*** eaguilar has joined #openstack-kolla | 21:03 | |
*** neilus has quit IRC | 21:03 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding resolv.conf workaround to logging containers https://review.openstack.org/378021 | 21:04 |
*** haplo37 has quit IRC | 21:07 | |
*** g3ek has quit IRC | 21:10 | |
*** dave-mcc_ has quit IRC | 21:11 | |
*** g3ek has joined #openstack-kolla | 21:13 | |
*** mark-casey11 has joined #openstack-kolla | 21:13 | |
*** bjolo__ has quit IRC | 21:16 | |
*** haplo37 has joined #openstack-kolla | 21:16 | |
*** schwicht has joined #openstack-kolla | 21:20 | |
*** sdake has quit IRC | 21:22 | |
*** Pavo has quit IRC | 21:22 | |
*** mewald has quit IRC | 21:25 | |
*** schwicht_at_work has joined #openstack-kolla | 21:26 | |
*** schwicht has quit IRC | 21:27 | |
*** Pavo has joined #openstack-kolla | 21:28 | |
*** dave-mccowan has joined #openstack-kolla | 21:31 | |
*** jheroux has quit IRC | 21:36 | |
*** neilus has joined #openstack-kolla | 21:39 | |
*** neilus has quit IRC | 21:44 | |
openstackgerrit | Martin Matyas proposed openstack/kolla: Fix Magnum trustee issues https://review.openstack.org/326163 | 21:45 |
openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate https://review.openstack.org/378056 | 21:54 |
*** tonyb_ is now known as tonyb | 21:56 | |
*** huikang has quit IRC | 21:59 | |
*** huikang has joined #openstack-kolla | 22:00 | |
*** eaguilar has quit IRC | 22:02 | |
*** huikang has quit IRC | 22:04 | |
*** neilus has joined #openstack-kolla | 22:07 | |
*** ccesario has quit IRC | 22:12 | |
*** haplo37- has quit IRC | 22:12 | |
*** neilus has quit IRC | 22:12 | |
*** haplo37- has joined #openstack-kolla | 22:14 | |
*** salv-orlando has quit IRC | 22:15 | |
*** neilus has joined #openstack-kolla | 22:15 | |
kfox1111 | rhallisey: thanks for setting up the gate... it does seem to let us run our code already. should be easy to fill this out with real tests. :) | 22:16 |
rhallisey | ya | 22:17 |
rhallisey | for sure | 22:17 |
*** neilus has quit IRC | 22:19 | |
sbezverk_ | kfox1111: hit anouther macro related collateral | 22:22 |
sbezverk_ | need to discuss | 22:23 |
*** salv-orlando has joined #openstack-kolla | 22:23 | |
*** ccesario has joined #openstack-kolla | 22:24 | |
*** Pavo has quit IRC | 22:26 | |
*** Pavo has joined #openstack-kolla | 22:29 | |
*** fguillot has quit IRC | 22:29 | |
kfox1111 | k | 22:30 |
kfox1111 | rhallisey: know what version of ubuntu the gate checks use? | 22:41 |
*** schwicht_at_work has quit IRC | 22:41 | |
rhallisey | 16.04 | 22:41 |
kfox1111 | nice. k. thanks. :) | 22:42 |
*** britthouser has joined #openstack-kolla | 22:43 | |
*** salv-orlando has quit IRC | 22:46 | |
*** britthouser has quit IRC | 22:46 | |
*** britthouser has joined #openstack-kolla | 22:47 | |
openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate https://review.openstack.org/378056 | 22:47 |
*** gmmaha has quit IRC | 22:49 | |
*** sbezverk has joined #openstack-kolla | 22:50 | |
*** gmmaha has joined #openstack-kolla | 22:50 | |
*** msimonin has quit IRC | 22:53 | |
*** sbezverk_ has quit IRC | 22:54 | |
*** sdake has joined #openstack-kolla | 22:56 | |
*** sdake_ has joined #openstack-kolla | 22:58 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding resolv.conf workaround to logging containers https://review.openstack.org/378021 | 22:59 |
*** sdake has quit IRC | 23:01 | |
tonanhngo | sdake: ping | 23:04 |
*** lamt has quit IRC | 23:10 | |
*** neilus has joined #openstack-kolla | 23:11 | |
tonanhngo | sdake_: ping | 23:12 |
sdake_ | yes sur tonanhngo what can i do for ya | 23:12 |
sdake_ | sur/sir | 23:12 |
tonanhngo | Hi Steve, got some questions. | 23:12 |
tonanhngo | I was trying out the all-in-one install, but it seems the 3.0.0 images are not all there yet | 23:13 |
tonanhngo | I guess these are the Newton release | 23:13 |
*** daneyon has joined #openstack-kolla | 23:14 | |
tonanhngo | Are they still being tested? | 23:14 |
*** neilus has quit IRC | 23:16 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Fixing keystone logging related issue https://review.openstack.org/378076 | 23:18 |
*** daneyon has quit IRC | 23:18 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Fixing keystone logging related issue https://review.openstack.org/378076 | 23:23 |
*** g3ek has quit IRC | 23:28 | |
sbezverk | sdake: ping | 23:30 |
*** schwicht has joined #openstack-kolla | 23:36 | |
*** g3ek has joined #openstack-kolla | 23:37 | |
*** rhallisey has quit IRC | 23:38 | |
openstackgerrit | Kevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate https://review.openstack.org/378056 | 23:43 |
*** jtriley has joined #openstack-kolla | 23:44 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Adding resolv.conf workaround to logging containers https://review.openstack.org/378021 | 23:46 |
*** zhurong has joined #openstack-kolla | 23:48 | |
*** dwalsh has quit IRC | 23:52 | |
*** salv-orlando has joined #openstack-kolla | 23:53 | |
*** huikang has joined #openstack-kolla | 23:55 | |
*** salv-orlando has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!