Friday, 2016-09-30

inc0MarMat, sorry was on call, just put a note in docs I think00:01
*** neilus has quit IRC00:01
inc0and skip globals.yml00:01
*** neilus_ has joined #openstack-kolla00:01
MarMatinc0 roger that00:01
inc0we have this: https://github.com/openstack/kolla/blob/500560cd0c70f8fd2b5710fda812eb0608c72841/doc/image-building.rst#building-behind-a-proxy00:02
inc0but that's a build guide00:02
*** neilus_ has quit IRC00:02
inc0either look for better place or just put it there and we'll figure it out later00:02
*** neilus has joined #openstack-kolla00:03
MarMatinc0 I found a better place, submitting PS, you can comment there :-)00:03
inc0sure00:03
inc0thanks m800:03
*** robcresswell has quit IRC00:04
inc0I gtg, havent eaten a dinner;)00:04
*** neilus has quit IRC00:04
*** zhurong has quit IRC00:04
inc0cya all tomorrow00:04
*** inc0 has quit IRC00:04
*** neilus has joined #openstack-kolla00:04
*** neilus has quit IRC00:06
*** neilus has joined #openstack-kolla00:06
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805600:07
*** neilus has quit IRC00:07
*** neilus has joined #openstack-kolla00:08
openstackgerritMartin Matyas proposed openstack/kolla: Documentation of proxy setting inside containers  https://review.openstack.org/37986200:08
*** neilus_ has joined #openstack-kolla00:10
*** neilus has quit IRC00:10
*** neilus_ has quit IRC00:11
*** neilus has joined #openstack-kolla00:12
*** neilus_ has joined #openstack-kolla00:13
*** haplo37_ has quit IRC00:14
*** neilus_ has quit IRC00:15
*** neilus_ has joined #openstack-kolla00:15
*** haplo37_ has joined #openstack-kolla00:16
*** neilus has quit IRC00:16
*** neilus_ has quit IRC00:17
*** neilus has joined #openstack-kolla00:17
*** neilus has quit IRC00:18
*** neilus has joined #openstack-kolla00:19
*** neilus_ has joined #openstack-kolla00:20
*** neilus has quit IRC00:21
*** neilus_ has quit IRC00:22
*** neilus has joined #openstack-kolla00:22
*** neilus has quit IRC00:24
*** neilus_ has joined #openstack-kolla00:24
*** yingjun has joined #openstack-kolla00:25
*** neilus_ has quit IRC00:26
*** neilus has joined #openstack-kolla00:26
*** neilus has quit IRC00:27
*** neilus has joined #openstack-kolla00:28
*** neilus has quit IRC00:29
*** neilus has joined #openstack-kolla00:29
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805600:30
*** neilus has quit IRC00:31
*** neilus has joined #openstack-kolla00:31
*** neilus_ has joined #openstack-kolla00:33
*** neilus has quit IRC00:33
*** neilus_ has quit IRC00:34
*** neilus has joined #openstack-kolla00:35
*** neilus_ has joined #openstack-kolla00:37
*** neilus has quit IRC00:37
*** neilus_ has quit IRC00:38
*** neilus has joined #openstack-kolla00:38
*** neilus has quit IRC00:40
*** neilus has joined #openstack-kolla00:40
*** neilus has quit IRC00:41
*** neilus has joined #openstack-kolla00:42
*** neilus has quit IRC00:43
*** neilus has joined #openstack-kolla00:44
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805600:44
*** neilus has quit IRC00:45
*** neilus has joined #openstack-kolla00:45
*** neilus has quit IRC00:47
*** neilus has joined #openstack-kolla00:47
*** phuongnh has joined #openstack-kolla00:48
*** neilus has quit IRC00:49
*** neilus has joined #openstack-kolla00:49
*** neilus has quit IRC00:50
*** neilus has joined #openstack-kolla00:51
*** daneyon has joined #openstack-kolla00:52
*** neilus_ has joined #openstack-kolla00:53
*** neilus has quit IRC00:53
*** neilus has joined #openstack-kolla00:54
*** neilus_ has quit IRC00:54
*** neilus has quit IRC00:56
*** neilus has joined #openstack-kolla00:56
*** daneyon has quit IRC00:58
*** neilus has quit IRC01:00
*** neilus_ has joined #openstack-kolla01:00
*** eaguilar has quit IRC01:01
*** neilus_ has quit IRC01:01
*** neilus has joined #openstack-kolla01:02
*** tonanhngo has quit IRC01:02
*** neilus has quit IRC01:03
*** neilus_ has joined #openstack-kolla01:04
*** neilus has joined #openstack-kolla01:05
*** neilus has quit IRC01:07
*** neilus__ has joined #openstack-kolla01:07
*** neilus__ has quit IRC01:08
*** neilus_ has quit IRC01:08
*** neilus has joined #openstack-kolla01:09
*** neilus has quit IRC01:10
*** neilus has joined #openstack-kolla01:10
*** neilus has quit IRC01:12
*** neilus has joined #openstack-kolla01:12
*** neilus has quit IRC01:14
*** neilus has joined #openstack-kolla01:14
*** tonanhngo has joined #openstack-kolla01:15
*** neilus has quit IRC01:15
*** neilus has joined #openstack-kolla01:16
*** neilus has quit IRC01:17
*** neilus_ has joined #openstack-kolla01:18
*** neilus_ has quit IRC01:19
*** tonanhngo has quit IRC01:19
*** neilus has joined #openstack-kolla01:20
*** zhurong has joined #openstack-kolla01:20
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805601:21
*** neilus_ has joined #openstack-kolla01:21
*** neilus has quit IRC01:21
*** neilus has joined #openstack-kolla01:23
*** neilus_ has quit IRC01:23
*** neilus_ has joined #openstack-kolla01:25
*** neilus_ has quit IRC01:26
*** neilus__ has joined #openstack-kolla01:26
*** neilus has quit IRC01:28
*** neilus__ has quit IRC01:28
*** neilus has joined #openstack-kolla01:28
*** neilus has quit IRC01:30
*** neilus has joined #openstack-kolla01:30
*** neilus_ has joined #openstack-kolla01:32
*** neilus has quit IRC01:32
*** neilus_ has quit IRC01:33
*** neilus has joined #openstack-kolla01:34
*** eaguilar has joined #openstack-kolla01:37
*** neilus__ has joined #openstack-kolla01:37
*** neilus has quit IRC01:37
*** neilus__ has quit IRC01:39
*** neilus has joined #openstack-kolla01:39
*** neilus has quit IRC01:41
*** neilus has joined #openstack-kolla01:41
*** neilus has quit IRC01:42
*** neilus has joined #openstack-kolla01:43
*** salv-orlando has joined #openstack-kolla01:44
*** neilus has quit IRC01:44
*** neilus has joined #openstack-kolla01:45
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805601:46
*** salv-orl_ has quit IRC01:46
*** neilus_ has joined #openstack-kolla01:46
*** neilus has quit IRC01:46
*** neilus_ has quit IRC01:48
*** neilus has joined #openstack-kolla01:48
*** neilus_ has joined #openstack-kolla01:50
*** neilus has quit IRC01:50
*** neilus_ has quit IRC01:51
*** neilus has joined #openstack-kolla01:52
*** neilus_ has joined #openstack-kolla01:53
*** neilus has quit IRC01:54
*** coolsvap has joined #openstack-kolla01:54
*** neilus_ has quit IRC01:55
*** neilus has joined #openstack-kolla01:55
*** neilus has quit IRC01:57
*** neilus has joined #openstack-kolla01:57
*** neilus has quit IRC01:59
*** neilus has joined #openstack-kolla01:59
*** neilus_ has joined #openstack-kolla02:01
*** unicell1 has quit IRC02:02
*** neilus_ has quit IRC02:02
*** neilus_ has joined #openstack-kolla02:02
*** neilus has quit IRC02:03
*** neilus_ has quit IRC02:04
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805602:04
*** hfu has quit IRC02:04
*** neilus has joined #openstack-kolla02:04
*** neilus_ has joined #openstack-kolla02:06
*** neilus_ has quit IRC02:07
*** neilus_ has joined #openstack-kolla02:08
*** neilus has quit IRC02:09
*** neilus has joined #openstack-kolla02:09
*** neilus_ has quit IRC02:10
*** caowei has joined #openstack-kolla02:11
*** neilus_ has joined #openstack-kolla02:11
*** rhallisey has quit IRC02:12
*** neilus__ has joined #openstack-kolla02:13
*** neilus has quit IRC02:13
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805602:13
*** neilus__ has quit IRC02:15
*** neilus has joined #openstack-kolla02:15
*** neilus_ has quit IRC02:16
*** neilus_ has joined #openstack-kolla02:17
*** neilus has quit IRC02:17
*** neilus_ has quit IRC02:18
*** neilus has joined #openstack-kolla02:18
*** neilus_ has joined #openstack-kolla02:20
*** neilus has quit IRC02:20
*** neilus_ has quit IRC02:22
*** neilus has joined #openstack-kolla02:22
*** neilus has quit IRC02:23
*** dave-mccowan has quit IRC02:24
*** neilus has joined #openstack-kolla02:24
*** MarMat has quit IRC02:24
*** neilus_ has joined #openstack-kolla02:25
*** neilus_ has quit IRC02:27
*** neilus__ has joined #openstack-kolla02:27
*** neilus__ has quit IRC02:29
*** neilus has quit IRC02:29
*** neilus_ has joined #openstack-kolla02:29
*** neilus_ has quit IRC02:31
*** britthouser2 has joined #openstack-kolla02:31
*** neilus has joined #openstack-kolla02:31
*** neilus has quit IRC02:33
*** neilus_ has joined #openstack-kolla02:33
*** britthouser has quit IRC02:33
*** neilus has joined #openstack-kolla02:34
*** neilus has quit IRC02:36
*** neilus has joined #openstack-kolla02:36
*** neilus_ has quit IRC02:36
*** neilus has quit IRC02:38
*** neilus_ has joined #openstack-kolla02:38
*** neilus has joined #openstack-kolla02:40
*** inc0 has joined #openstack-kolla02:41
inc0wassup02:41
inc0Jeffrey4l, around?02:41
*** neilus has quit IRC02:41
*** neilus has joined #openstack-kolla02:42
*** neilus_ has quit IRC02:43
*** neilus has quit IRC02:43
*** neilus_ has joined #openstack-kolla02:43
*** neilus_ has quit IRC02:45
*** neilus has joined #openstack-kolla02:45
*** neilus_ has joined #openstack-kolla02:47
*** yuanying has quit IRC02:47
*** eaguilar has quit IRC02:48
*** neilus_ has quit IRC02:48
*** neilus_ has joined #openstack-kolla02:49
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805602:49
*** neilus has quit IRC02:50
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: DO NOT MERGE : checking docker-py requirements update  https://review.openstack.org/37990102:50
*** neilus_ has quit IRC02:50
*** neilus has joined #openstack-kolla02:50
coolsvapsdake: inc0 ^^ we need to respond to https://review.openstack.org/#/c/366948/ before oct 402:51
*** neilus_ has joined #openstack-kolla02:52
*** neilus has quit IRC02:52
*** neilus_ has quit IRC02:53
*** neilus has joined #openstack-kolla02:54
*** neilus has quit IRC02:55
*** yuanying has joined #openstack-kolla02:55
inc0coolsvap, done02:56
*** neilus has joined #openstack-kolla02:56
inc0thanks for keeping tabs on it02:56
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805602:56
*** neilus has quit IRC02:57
*** neilus has joined #openstack-kolla02:57
Jeffrey4linc0, yep02:58
inc0Jeffrey4l, any chances you could block off 1hr after next Wed meeting?02:58
inc0I invited openstack-security folks to start thread analysis process02:59
Jeffrey4linc0, ok. np02:59
inc0thanks02:59
*** neilus has quit IRC02:59
*** neilus has joined #openstack-kolla03:00
coolsvapinc0: is it on channel or is it a meeting?03:00
*** neilus has quit IRC03:01
inc0coolsvap, here, on channel, if you'd like to participate, that'd be great03:01
*** neilus has joined #openstack-kolla03:01
coolsvapinc0: yes,I asked for the same reason, thanks03:01
*** neilus has quit IRC03:02
*** neilus has joined #openstack-kolla03:03
*** huikang has quit IRC03:04
*** neilus has quit IRC03:04
*** david-lyle has quit IRC03:04
*** neilus has joined #openstack-kolla03:05
*** huikang_ has joined #openstack-kolla03:06
*** neilus_ has joined #openstack-kolla03:06
*** neilus has quit IRC03:06
*** neilus has joined #openstack-kolla03:08
*** neilus_ has quit IRC03:08
*** gfhellma has quit IRC03:09
*** neilus has quit IRC03:10
*** neilus_ has joined #openstack-kolla03:10
*** neilus_ has quit IRC03:11
*** neilus has joined #openstack-kolla03:12
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805603:12
*** neilus has quit IRC03:13
*** neilus_ has joined #openstack-kolla03:14
*** neilus_ has quit IRC03:15
*** neilus has joined #openstack-kolla03:15
*** neilus has quit IRC03:17
*** neilus has joined #openstack-kolla03:17
*** inc0 has quit IRC03:18
*** unicell has joined #openstack-kolla03:19
*** neilus_ has joined #openstack-kolla03:19
*** neilus has quit IRC03:19
*** neilus_ has quit IRC03:20
*** neilus has joined #openstack-kolla03:21
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805603:22
*** neilus_ has joined #openstack-kolla03:22
*** neilus has quit IRC03:22
*** aswadr_ has joined #openstack-kolla03:23
*** huikang_ has quit IRC03:24
*** neilus_ has quit IRC03:24
*** neilus has joined #openstack-kolla03:24
*** neilus has quit IRC03:26
*** neilus has joined #openstack-kolla03:26
*** neilus has quit IRC03:28
*** neilus has joined #openstack-kolla03:28
*** neilus_ has joined #openstack-kolla03:30
*** neilus has quit IRC03:30
*** MarMat has joined #openstack-kolla03:31
*** neilus has joined #openstack-kolla03:31
*** neilus has quit IRC03:33
*** neilus has joined #openstack-kolla03:33
*** neilus_ has quit IRC03:34
*** neilus has quit IRC03:35
*** neilus has joined #openstack-kolla03:35
*** neilus has quit IRC03:36
*** neilus has joined #openstack-kolla03:37
*** neilus has quit IRC03:38
*** yuanying has quit IRC03:38
*** neilus has joined #openstack-kolla03:39
*** g3ek has quit IRC03:39
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805603:40
*** neilus has quit IRC03:40
*** g3ek has joined #openstack-kolla03:40
*** neilus has joined #openstack-kolla03:40
*** neilus has quit IRC03:42
*** neilus_ has joined #openstack-kolla03:42
*** neilus_ has quit IRC03:44
*** neilus has joined #openstack-kolla03:44
*** neilus_ has joined #openstack-kolla03:46
*** neilus_ has quit IRC03:47
*** neilus_ has joined #openstack-kolla03:47
*** neilus has quit IRC03:49
*** neilus_ has quit IRC03:49
*** yuanying has joined #openstack-kolla03:49
*** neilus has joined #openstack-kolla03:49
*** neilus has quit IRC03:51
*** neilus has joined #openstack-kolla03:51
*** neilus has quit IRC03:52
*** neilus has joined #openstack-kolla03:53
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805603:54
*** neilus has quit IRC03:54
*** neilus_ has joined #openstack-kolla03:55
*** neilus_ has quit IRC03:56
*** neilus has joined #openstack-kolla03:56
*** neilus has quit IRC03:58
*** neilus_ has joined #openstack-kolla03:58
*** neilus has joined #openstack-kolla04:00
*** jmccarthy has quit IRC04:01
*** neilus has quit IRC04:01
*** neilus has joined #openstack-kolla04:02
*** jmccarthy has joined #openstack-kolla04:02
*** neilus_ has quit IRC04:03
*** neilus has quit IRC04:03
*** neilus__ has joined #openstack-kolla04:03
*** neilus has joined #openstack-kolla04:05
*** neilus__ has quit IRC04:05
*** neilus has quit IRC04:07
*** neilus has joined #openstack-kolla04:07
*** neilus has quit IRC04:09
*** neilus_ has joined #openstack-kolla04:09
*** neilus_ has quit IRC04:10
*** neilus has joined #openstack-kolla04:11
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805604:11
*** neilus has quit IRC04:12
*** neilus has joined #openstack-kolla04:12
*** neilus has quit IRC04:14
*** neilus has joined #openstack-kolla04:14
*** neilus has quit IRC04:16
*** neilus has joined #openstack-kolla04:16
*** neilus has quit IRC04:17
*** neilus has joined #openstack-kolla04:18
sdakecoolsvap sorry - been busy today - someone w going to take a look t it04:18
sdakew/was04:19
sdakezhubingbing as i recall04:19
*** neilus_ has joined #openstack-kolla04:19
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805604:20
*** neilus_ has quit IRC04:21
*** neilus_ has joined #openstack-kolla04:21
*** portdirect has quit IRC04:21
*** portdirect_ has joined #openstack-kolla04:22
*** portdirect_ is now known as portdirect04:22
*** neilus has quit IRC04:22
coolsvapsdake: i am looking into it04:22
*** neilus_ has quit IRC04:23
sdakecoolsvap thanks04:23
sdakeyou were out a bit04:23
sdakei think on pto or somtehing04:23
*** neilus has joined #openstack-kolla04:23
sdakei can't do it alone :)04:23
sdakehey folks04:24
coolsvapyes I was not well from monday04:24
sdakejust a fyi - i dont want to ambush our devs with this04:24
sdakehttps://review.openstack.org/37992404:24
*** neilus has quit IRC04:25
*** neilus has joined #openstack-kolla04:25
sdakecoolsvap no problem dude04:25
sdakecoolsvap we have alot of moving prts tm :)04:25
sdakeincluding devs and core reviewers04:25
sdakezhubingbingoffered04:26
sdakei took him up on it :)04:26
*** neilus has quit IRC04:26
*** neilus has joined #openstack-kolla04:27
coolsvapi was looking for your mail regarding 37992404:27
*** neilus has quit IRC04:28
*** neilus_ has joined #openstack-kolla04:28
sdakecoolsvap ya hven't sent the mail04:30
sdakeseems tc mails start flame wars :)04:30
*** neilus has joined #openstack-kolla04:30
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805604:30
*** neilus_ has quit IRC04:30
sdakecoolsvap however its coming04:32
*** neilus has quit IRC04:32
*** neilus has joined #openstack-kolla04:32
*** neilus_ has joined #openstack-kolla04:34
*** neilus has quit IRC04:34
coolsvapsdake: yes saw for the first time discussions on TC candidacy mails04:34
sdakecoolsvap imo inappropriate but people can do what they want :)04:35
sdakewhat I think and what other people might think are different04:35
*** neilus has joined #openstack-kolla04:35
*** neilus_ has quit IRC04:36
coolsvapyes, i mean if you do not think this is something you dont like to be in a TC candidate dont vote04:36
coolsvapbut again04:36
*** neilus_ has joined #openstack-kolla04:37
sdakefree speech04:37
*** neilus has quit IRC04:37
sdakeftw :)04:37
sdakegrillling a leader on their value system in a public thread seems unideal04:38
*** neilus_ has quit IRC04:39
sdakeus presential election year04:39
sdakeeverything nutty in the us :)04:39
*** neilus has joined #openstack-kolla04:39
*** neilus has quit IRC04:41
*** neilus_ has joined #openstack-kolla04:41
*** neilus_ has quit IRC04:42
*** sdake_ has joined #openstack-kolla04:42
*** neilus has joined #openstack-kolla04:43
*** neilus has quit IRC04:44
*** neilus has joined #openstack-kolla04:44
*** sdake has quit IRC04:46
*** neilus_ has joined #openstack-kolla04:46
*** neilus has quit IRC04:46
MarMatcaowei ping04:48
*** neilus_ has quit IRC04:48
*** neilus has joined #openstack-kolla04:48
sdake_ok patch +2d04:48
sdake_hitting mailing list04:48
*** haplo37_ has quit IRC04:49
*** neilus has quit IRC04:50
*** neilus_ has joined #openstack-kolla04:50
*** haplo37_ has joined #openstack-kolla04:51
*** neilus_ has quit IRC04:51
*** neilus has joined #openstack-kolla04:52
*** neilus_ has joined #openstack-kolla04:53
*** neilus has quit IRC04:53
*** neilus_ has quit IRC04:55
*** neilus has joined #openstack-kolla04:55
*** neilus_ has joined #openstack-kolla04:57
sdake_inc0 the problem with deprecation now is we need to produce a migration path in the proposal to the operators list04:57
sdake_not in the actual work done04:57
sdake_guess he is in bed :)04:58
sdake_folks - dont approve any deprecation of heka please04:58
*** neilus__ has joined #openstack-kolla04:59
sdake_its not that i'm in love with heeka04:59
sdake_i want to ensure we are in complaince with the policy on deprecation04:59
*** neilus has quit IRC05:00
*** neilus has joined #openstack-kolla05:00
*** neilus__ has quit IRC05:01
*** neilus_ has quit IRC05:02
*** neilus has quit IRC05:02
*** neilus_ has joined #openstack-kolla05:02
bjolomorning05:04
*** neilus_ has quit IRC05:04
*** neilus has joined #openstack-kolla05:04
*** Satya_ has joined #openstack-kolla05:06
*** neilus_ has joined #openstack-kolla05:06
*** neilus has quit IRC05:06
Satya_while deploying mysql using ansible I am getting the below error05:06
Satya_ FAILED! => {"changed": true, "failed": true, "invocation": {"module_args": {"action": "start_container", "api_version": "auto", "auth_email": null, "auth_password": null, "auth_registry": "slc11gdr.us.oracle.com:5000", "auth_username": null, "cap_add": [], "detach": true, "environment": {"KOLLA_CONFIG_STRATEGY": "COPY_ALWAYS", "KOLLA_SERVICE_NAME": "mysqlcluster-mgmt"}, "image": "slc11gdr.us.oracle.com:5000/cas/oraclelinux-s05:07
*** neilus_ has quit IRC05:07
*** neilus has joined #openstack-kolla05:08
Satya_does anyone faced similar issue05:08
sdake_sup bjolo05:08
sdake_Satya_ are you using master?05:09
Satya_yes I am using master branch05:09
Satya_in create_container\\n  File \"/usr/lib/python2.7/site-packages/docker/api/container.py\", line 135, in create_container\\n    return self.create_container_from_config(config, name)\\n  File \"/usr/lib/python2.7/site-packages/docker/api/container.py\", line 146, in create_container_from_config\\n    return self._result(res, True)\\n  File \"/usr/lib/python2.7/site-packages/docker/client.py\", line 178, in _result\\n    self._05:09
*** neilus_ has joined #openstack-kolla05:09
*** neilus has quit IRC05:09
Satya_ raise errors.APIError(e, response, explanation=explanation)\\nAPIError: 500 Server Error: Internal Server Error (\"Invalid volume spec \"y\": volumeabs: Invalid volume destination path: \\'y\\' mount path must be absolute.\")\\n'"}05:10
Satya_i am able to run the container manually on target machines05:10
Satya_it seems something wrong with ansible or ansible related configuration05:10
sdake_Satya_ pip show docker-py05:10
Satya_Metadata-Version: 2.0 Name: docker-py Version: 1.10.3 Summary: Python client for Docker. Home-page: https://github.com/docker/docker-py/ Author: UNKNOWN Author-email: UNKNOWN Installer: pip License: UNKNOWN Location: /usr/lib/python2.7/site-packages Requires: requests, backports.ssl-match-hostname, ipaddress, six, docker-pycreds, websocket-client Classifiers:   Development Status :: 4 - Beta   Environment :: Other Environment05:11
*** neilus_ has quit IRC05:11
Satya_this is the out put on target machine where i am deploying openstack05:11
*** neilus has joined #openstack-kolla05:11
sdake_Satya_ dunno - bed time here - 10pm05:12
sdake_Satya_ gotta jet shortly05:12
Satya_any help in how to debug is also fine05:12
sdake_Satya_ i'd consult with pbourke05:13
sdake_Satya_ he keeps oracle linux in good working order05:13
*** neilus_ has joined #openstack-kolla05:13
Satya_ok05:13
Satya_do you have any method in debugging ansible05:13
Satya_other than -vvv option05:13
sdake_Satya_ ansible debugging is super weak05:13
sdake_is -vvv05:13
Satya_i could not find any other way05:14
Satya_ok good night05:14
Satya_will try to figure out05:14
*** neilus_ has quit IRC05:14
sdake_cool good nght05:15
*** neilus_ has joined #openstack-kolla05:15
*** neilus has quit IRC05:16
*** neilus_ has quit IRC05:16
*** neilus has joined #openstack-kolla05:17
*** neilus has quit IRC05:18
*** neilus_ has joined #openstack-kolla05:19
*** sdake_ has quit IRC05:19
*** neilus has joined #openstack-kolla05:20
*** neilus_ has quit IRC05:20
*** neilus has quit IRC05:22
*** neilus has joined #openstack-kolla05:22
*** daneyon has joined #openstack-kolla05:23
*** skramaja has joined #openstack-kolla05:23
*** neilus has quit IRC05:24
*** neilus_ has joined #openstack-kolla05:24
*** neilus_ has quit IRC05:26
*** neilus has joined #openstack-kolla05:26
*** neilus has quit IRC05:27
*** neilus has joined #openstack-kolla05:28
*** daneyon has quit IRC05:28
*** neilus_ has joined #openstack-kolla05:29
*** neilus has quit IRC05:29
*** neilus has joined #openstack-kolla05:31
*** neilus_ has quit IRC05:31
*** neilus has quit IRC05:33
*** papacz1 has quit IRC05:33
*** neilus has joined #openstack-kolla05:33
*** neilus_ has joined #openstack-kolla05:35
*** neilus has quit IRC05:35
*** neilus_ has quit IRC05:37
*** neilus has joined #openstack-kolla05:37
*** neilus has quit IRC05:38
*** neilus_ has joined #openstack-kolla05:38
*** neilus_ has quit IRC05:40
*** neilus has joined #openstack-kolla05:40
*** neilus has quit IRC05:42
*** neilus_ has joined #openstack-kolla05:42
*** zhubingbing has joined #openstack-kolla05:43
*** neilus_ has quit IRC05:44
*** neilus has joined #openstack-kolla05:44
*** neilus has quit IRC05:45
*** neilus has joined #openstack-kolla05:45
*** neilus has quit IRC05:47
*** neilus_ has joined #openstack-kolla05:47
*** neilus_ has quit IRC05:49
*** neilus has joined #openstack-kolla05:49
*** neilus has quit IRC05:51
*** neilus has joined #openstack-kolla05:51
*** neilus has quit IRC05:53
*** neilus_ has joined #openstack-kolla05:53
*** neilus_ has quit IRC05:54
*** neilus has joined #openstack-kolla05:54
*** Satya_ has quit IRC05:56
*** salv-orlando has quit IRC05:56
*** neilus has quit IRC05:56
*** zhubingbing has quit IRC05:56
*** neilus has joined #openstack-kolla05:57
*** zhubingbing has joined #openstack-kolla05:58
*** neilus has quit IRC05:58
*** neilus has joined #openstack-kolla05:58
*** sdake has joined #openstack-kolla05:59
*** msimonin has joined #openstack-kolla06:00
*** neilus_ has joined #openstack-kolla06:00
*** neilus has quit IRC06:00
*** egonzalez90 has joined #openstack-kolla06:01
*** neilus has joined #openstack-kolla06:02
*** neilus_ has quit IRC06:02
*** neilus has quit IRC06:03
*** neilus has joined #openstack-kolla06:04
egonzalez90morning guys06:05
*** msimonin has quit IRC06:05
*** neilus_ has joined #openstack-kolla06:05
*** zhubingbing has quit IRC06:05
bjolomorning egonzalez9006:07
*** neilus_ has quit IRC06:07
*** neilus_ has joined #openstack-kolla06:07
*** neilus has quit IRC06:08
*** neilus_ has quit IRC06:09
*** neilus has joined #openstack-kolla06:09
*** neilus_ has joined #openstack-kolla06:11
*** neilus has quit IRC06:11
*** zhubingbing has joined #openstack-kolla06:11
*** msimonin has joined #openstack-kolla06:12
*** neilus has joined #openstack-kolla06:13
*** pallavi has joined #openstack-kolla06:14
*** neilus has quit IRC06:14
*** neilus__ has joined #openstack-kolla06:14
pallaviHi, I am trying to build images using kolla-build command. The command is able to build only few images.06:14
pallaviin the middle of the build operation it is throwing Failed to fetch http://ubuntu-cloud.archive.canonical.com/ubuntu/pool/main/p/python-requestsexceptions/python-requestsexceptions_1.1.2-0ubuntu1~cloud0_all.deb  403  Forbidden error.06:15
*** neilus_ has quit IRC06:16
*** g3ek has quit IRC06:16
pallaviPlease help me to resolve this issue and build the images06:16
*** neilus has joined #openstack-kolla06:16
*** neilus__ has quit IRC06:16
*** haplo37 has quit IRC06:16
*** zhubingbing has quit IRC06:16
sdakepallavi this has been reported - i believe someone found a workaround06:17
*** g3ek has joined #openstack-kolla06:17
pallavican you please give the details.06:17
*** neilus has quit IRC06:18
*** haplo37 has joined #openstack-kolla06:18
*** neilus has joined #openstack-kolla06:18
sdakeJeffrey4l around - do you recall the solution?06:19
sdakepallavi been running since 5am - its midnight - so i'm pretty wiped out06:19
sdakethe last i recall we suggested using curl06:19
Jeffrey4lpallavi, could u paste all the logs out?06:19
sdakeperhaps it was you :)06:19
Jeffrey4li still have no idea why it happen.06:20
*** neilus_ has joined #openstack-kolla06:20
*** salv-orlando has joined #openstack-kolla06:20
pallaviThanks sdake...06:20
sdakepallavi what i  mean is perhaps it was you who reportedit yesterday06:20
pallaviINFO:kolla.cmd.build:openstack-base:E: INFO:kolla.cmd.build:openstack-base:Failed to fetch http://ubuntu-cloud.archive.canonical.com/ubuntu/pool/main/p/python-requestsexceptions/python-requestsexceptions_1.1.2-0ubuntu1~cloud0_all.deb  403  Forbidden INFO:kolla.cmd.build:openstack-base: INFO:kolla.cmd.build:openstack-base:E: INFO:kolla.cmd.build:openstack-base:Unable to fetch some archives, maybe run apt-get update or try wit06:20
Jeffrey4lpallavi, may be canonical block you ip?06:20
Jeffrey4lpallavi, all of them. not just two lines.06:21
*** neilus_ has quit IRC06:21
sdakepallavi use a paste service pls06:21
Jeffrey4lpallavi, do you have a proxy and docker running under some proxy?06:21
sdakei seem to recall something about a proxy06:21
pallavisure... yes... I am using my company proxy06:22
*** neilus_ has joined #openstack-kolla06:22
sdakeand handing off to inc0 to help with the proxy06:22
Jeffrey4lhmm.06:22
pallaviand docker is running under proxy06:22
sdakeok the 403 error is coming from your proxy would be my suspicsion06:22
sdakewhy must proxy servers exist06:22
*** neilus has quit IRC06:23
Jeffrey4lpallavi, try this command: docker run centos:7 curl http://ubuntu-cloud.archive.canonical.com/ubuntu/pool/main/p/python-requestsexceptions/python-requestsexceptions_1.1.2-0ubuntu1\~cloud0_all.deb  -vv06:23
Jeffrey4lsee what will return.06:23
pallavibut I could able to download the package when I tried diretcly in firefox06:23
*** neilus_ has quit IRC06:23
sdakepallavi you ahve to configure kolla to use a proxy server06:23
*** neilus has joined #openstack-kolla06:23
sdakepallavi have you done that?06:23
pallavicurl: (6) Could not resolve host: ubuntu-cloud.archive.canonical.com; Unknown error06:24
sdakepallavi lets start with the basics first06:24
pallaviya this the error I got06:24
Jeffrey4lsdake, i this pallavi set the proxy in docker-engine side.06:24
Jeffrey4lthis/think06:24
sdakepallavi are you doing an eval/deploy or doing development on kolla06:24
pallaviok... Thanks for the support.. I am new to kolla and wanted to explore...06:24
sdakepallavi sure - so what i would recommend is to give 2.0.2 a spin06:25
*** zhubingbing has joined #openstack-kolla06:25
sdakethen yo uwont have ot build images06:25
*** neilus_ has joined #openstack-kolla06:25
*** neilus has quit IRC06:25
sdakemaster is not quite stable yet06:25
pallaviok I will try with 2.0.206:26
sdakepallavi ou will need some help i think to ge tgoing06:26
sdakefirst run pip show kolla06:26
pallaviyes.06:26
Jeffrey4lpallavi, i think you may need fix that you can download package from canonical in the containers.06:26
pallaviI need help to start06:27
sdakedid you read the qsg06:27
*** neilus has joined #openstack-kolla06:27
*** neilus_ has quit IRC06:27
pallavino.. I have not read qsg06:27
sdakeok well thats where to begin06:27
sdakelets get our env in a place where it will work06:28
sdakerun pip show kolla06:28
*** phuongnh has quit IRC06:28
sdake-> paste06:28
pallaviJeffrey41, How to do that? please give the instructions06:28
sdakehttp://docs.openstack.org/developer/kolla/06:28
*** neilus_ has joined #openstack-kolla06:28
*** phuongnh has joined #openstack-kolla06:29
*** ChanServ sets mode: +o sdake06:29
*** ChanServ sets mode: +o sdake06:29
*** neilus__ has joined #openstack-kolla06:30
pallavi-> paste --- Metadata-Version: 2.0 Name: kolla Version: 2.0.2 Summary: Kolla OpenStack Deployment Home-page: http://www.openstack.org/ Author: OpenStack Author-email: openstack-dev@lists.openstack.org Installer: pip License: UNKNOWN Location: /usr/local/lib/python2.7/dist-packages Requires: graphviz, six, GitPython, beautifulsoup4, setuptools, pycrypto, oslo.config, Jinja2, pbr, gitdb, docker-py Classifiers:   Environment ::06:30
MarMatGuys don't you experience build failures of rabbitmq? I commented here: https://bugs.launchpad.net/kolla/+bug/161165506:31
openstackLaunchpad bug 1611655 in kolla "kolla.image.build.rabbitmq curl No such directory" [Undecided,Confirmed]06:31
*** zhubingbing has quit IRC06:31
*** sdake changes topic to "RC2 DEADLINE - OCT 12, 2016; Please read the documentation here: http://docs.openstack.org/developer/kolla/; Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b (old logs from #kolla http://goo.gl/VKpPzA)"06:32
sdake[20:44:37] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[20:46:07] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[20:47:38] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[20:47:57] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[20:49:06] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Ping timeout: 264 seconds)06:32
sdake[20:49:35] yuanying (~yuanying@FL1-122-135-42-171.tky.mesh.ad.jp) joined the channel06:32
sdake[20:49:35] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
pallavisdake this is the result of pip show kolla06:32
sdake[20:49:38] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[20:51:20] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[20:51:45] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[20:52:53] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[20:53:16] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[20:54:39]  <openstackgerrit>Kevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805606:32
*** neilus has quit IRC06:32
sdake[20:54:57] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[20:55:01] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[20:56:23] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[20:56:49] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[20:58:38] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[20:58:38] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:00:38] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:01:37] jmccarthy (~jmccarthy@ukc1-proxy-mwg01-o.oracle.com) left IRC (Remote host closed the connection)06:32
sdake[21:01:49] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[21:02:05] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:02:16] jmccarthy (~jmccarthy@ukc1-proxy-mwg03-o.oracle.com) joined the channel06:32
sdake[21:03:52] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Ping timeout: 272 seconds)06:32
sdake[21:03:54] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[21:03:55] neilus__ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
*** neilus has joined #openstack-kolla06:32
sdake[21:05:40] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:05:48] neilus__ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
*** neilus__ has quit IRC06:32
sdake[21:07:03] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[21:07:27] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:09:09] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[21:09:16] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:10:44] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[21:11:03] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:11:14]  <openstackgerrit>Kevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805606:32
sdake[21:12:35] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[21:12:52] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:14:11] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[21:14:34] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:16:06] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[21:16:41] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:17:52] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[21:18:09] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:18:34]  <sdake>coolsvap sorry - been busy today - someone w going to take a look t it06:32
sdake[21:19:00]  <sdake>w/was06:32
sdake[21:19:08]  <sdake>zhubingbing as i recall06:32
sdake[21:19:58] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:20:46]  <openstackgerrit>Kevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805606:32
sdake[21:21:21] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:32
sdake[21:21:45] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:32
sdake[21:21:56] portdirect (~portdirec@cpc101976-sgyl38-2-0-cust167.18-2.cable.virginm.net) left IRC (Quit: portdirect)06:32
sdake[21:22:07] portdirect_ (~portdirec@cpc101976-sgyl38-2-0-cust167.18-2.cable.virginm.net) joined the channel06:32
sdake[21:22:19] portdirect_ is now known as portdirect06:32
sdake[21:22:45] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Ping timeout: 244 seconds)06:32
sdake[21:22:56]  <coolsvap>sdake: i am looking into it06:33
sdake[21:23:08] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:33
sdake[21:23:08]  <sdake>coolsvap thanks06:33
sdake[21:23:12]  <sdake>you were out a bit06:33
sdake[21:23:18]  <sdake>i think on pto or somtehing06:33
sdake[21:23:30] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:23:34]  <sdake>i can't do it alone :)06:33
sdake[21:24:17]  <sdake>hey folks06:33
sdake[21:24:27]  <coolsvap>yes I was not well from monday06:33
sdake[21:24:30]  <sdake>just a fyi - i dont want to ambush our devs with this06:33
sdake[21:24:35]  <sdake>https://review.openstack.org/37992406:33
sdake[21:25:04] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:33
sdake[21:25:17] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:25:31]  <sdake>coolsvap no problem dude06:33
sdake[21:25:40]  <sdake>coolsvap we have alot of moving prts tm :)06:33
sdake[21:25:52]  <sdake>including devs and core reviewers06:33
sdake[21:26:06]  <sdake>zhubingbingoffered06:33
sdake[21:26:09]  <sdake>i took him up on it :)06:33
sdake[21:26:51] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:33
sdake[21:27:03] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:27:07]  <coolsvap>i was looking for your mail regarding 37992406:33
sdake[21:28:48] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:33
sdake[21:28:53] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:30:08]  <sdake>coolsvap ya hven't sent the mail06:33
sdake[21:30:21]  <sdake>seems tc mails start flame wars :)06:33
sdake[21:30:37] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:30:42]  <openstackgerrit>Kevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805606:33
sdake[21:30:43] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:33
sdake[21:32:20]  <sdake>coolsvap however its coming06:33
sdake[21:32:30] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:33
sdake[21:32:44] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:34:13] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:34:18] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:33
sdake[21:34:34]  <coolsvap>sdake: yes saw for the first time discussions on TC candidacy mails06:33
sdake[21:35:02]  <sdake>coolsvap imo inappropriate but people can do what they want :)06:33
sdake[21:35:30]  <sdake>what I think and what other people might think are different06:33
sdake[21:35:58] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:36:06] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:33
sdake[21:36:13]  <coolsvap>yes, i mean if you do not think this is something you dont like to be in a TC candidate dont vote06:33
sdake[21:36:31]  <coolsvap>but again06:33
sdake[21:37:48] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:37:54]  <sdake>free speech06:33
sdake[21:37:54] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:33
sdake[21:37:58]  <sdake>ftw :)06:33
sdake[21:38:39]  <sdake>grillling a leader on their value system in a public thread seems unideal06:33
sdake[21:39:15] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:33
sdake[21:39:19]  <sdake>us presential election year06:33
sdake[21:39:24]  <sdake>everything nutty in the us :)06:33
sdake[21:39:51] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:41:12] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:33
sdake[21:41:20] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:42:17] Disconnected06:33
sdake[21:42:54] sdake_ (~sdake@fedora/sdake) joined the channel06:33
sdake[21:42:54] Topic is Please vote for summit sessions! http://civs.cs.cornell.edu/cgi-bin/vote.pl?id=E_8368e1e74f8a0049&akey=91bbcf4baeff0a2f; RC2 DEADLINE (HARD) Oct 10th-Oct 13th; Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b (old logs from #kolla  http://goo.gl/VKpPzA)06:33
sdake[21:42:54] Set by openstackstatus on September 26, 2016 at 9:09:27 AM MST06:33
sdake[21:43:06] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:43:12] Mode is +cnt06:33
sdake[21:44:30] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:33
*** neilus_ has quit IRC06:33
sdake[21:44:53] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:33
sdake[21:46:42] sdake (~sdake@fedora/sdake) left IRC (Ping timeout: 264 seconds)06:33
sdake[21:46:42] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[21:46:46] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
*** neilus has quit IRC06:34
sdake[21:48:14]  <MarMat>caowei ping06:34
sdake[21:48:36] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
sdake[21:48:46]  <sdake_>ok patch +2d06:34
sdake[21:48:46] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[21:48:50]  <sdake_>hitting mailing list06:34
sdake[21:49:33] haplo37_ (~haplo37@192.207.61.71) left IRC (Read error: Connection reset by peer)06:34
sdake[21:50:18] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
sdake[21:50:19] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[21:51:48] haplo37_ (~haplo37@192.207.61.71) joined the channel06:34
sdake[21:51:59] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
sdake[21:52:05] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[21:53:49] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[21:53:50] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
sdake[21:55:42] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
sdake[21:55:54] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[21:57:23] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
*** neilus has joined #openstack-kolla06:34
sdake[21:57:44]  <sdake_>inc0 the problem with deprecation now is we need to produce a migration path in the proposal to the operators list06:34
sdake[21:57:49]  <sdake_>not in the actual work done06:34
sdake[21:58:06]  <sdake_>guess he is in bed :)06:34
sdake[21:58:17]  <sdake_>folks - dont approve any deprecation of heka please06:34
sdake[21:59:16] neilus__ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[21:59:31]  <sdake_>its not that i'm in love with heeka06:34
caoweihiasdfhihhhihhsdfsd06:34
sdake[21:59:46]  <sdake_>i want to ensure we are in complaince with the policy on deprecation06:34
sdake[22:00:30] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Ping timeout: 264 seconds)06:34
sdake[22:00:55] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[22:01:07] neilus__ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
sdake[22:02:07] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Ping timeout: 272 seconds)06:34
sdake[22:02:44] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
sdake[22:02:49] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[22:04:10]  <bjolo>morning06:34
sdake[22:04:31] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
sdake[22:04:48] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
caoweihi sdake06:34
sdake[22:06:04] Satya_ (c40f1067@gateway/web/freenode/ip.196.15.16.103) joined the channel06:34
sdake[22:06:17] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[22:06:23] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
sdake[22:06:57]  <Satya_>while deploying mysql using ansible I am getting the below error06:34
sdake[22:07:00]  <Satya_> FAILED! => {"changed": true, "failed": true, "invocation": {"module_args": {"action": "start_container", "api_version": "auto", "auth_email": null, "auth_password": null, "auth_registry": "slc11gdr.us.oracle.com:5000", "auth_username": null, "cap_add": [], "detach": true, "environment": {"KOLLA_CONFIG_STRATEGY": "COPY_ALWAYS", "KOLLA_SERVICE_NAME": "mysqlcluster-mgmt"}, "image": "slc11gdr.us.oracle.com:5000/cas/oraclelinux-06:34
sdake[22:07:50] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
sdake[22:08:03] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[22:08:15]  <Satya_>does anyone faced similar issue06:34
sdake[22:08:51]  <sdake_>sup bjolo06:34
sdake[22:09:13]  <sdake_>Satya_ are you using master?06:34
sdake[22:09:27]  <Satya_>yes I am using master branch06:34
sdake[22:09:44]  <Satya_>in create_container\\n  File \"/usr/lib/python2.7/site-packages/docker/api/container.py\", line 135, in create_container\\n    return self.create_container_from_config(config, name)\\n  File \"/usr/lib/python2.7/site-packages/docker/api/container.py\", line 146, in create_container_from_config\\n    return self._result(res, True)\\n  File \"/usr/lib/python2.7/site-packages/docker/client.py\", line 178, in _result\\n    self.06:34
sdake[22:09:52] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[22:09:56] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
sdake[22:10:03]  <Satya_> raise errors.APIError(e, response, explanation=explanation)\\nAPIError: 500 Server Error: Internal Server Error (\"Invalid volume spec \"y\": volumeabs: Invalid volume destination path: \\'y\\' mount path must be absolute.\")\\n'"}06:34
sdake[22:10:20]  <Satya_>i am able to run the container manually on target machines06:34
sdake[22:10:45]  <Satya_>it seems something wrong with ansible or ansible related configuration06:34
sdake[22:10:50]  <sdake_>Satya_ pip show docker-py06:34
sdake[22:11:36]  <Satya_>Metadata-Version: 2.0 Name: docker-py Version: 1.10.3 Summary: Python client for Docker. Home-page: https://github.com/docker/docker-py/ Author: UNKNOWN Author-email: UNKNOWN Installer: pip License: UNKNOWN Location: /usr/lib/python2.7/site-packages Requires: requests, backports.ssl-match-hostname, ipaddress, six, docker-pycreds, websocket-client Classifiers:   Development Status :: 4 - Beta   Environment :: Other Environmen06:34
sdake[22:11:39] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:34
sdake[22:11:55]  <Satya_>this is the out put on target machine where i am deploying openstack06:34
sdake[22:11:57] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:34
sdake[22:12:37]  <sdake_>Satya_ dunno - bed time here - 10pm06:34
sdake[22:12:50]  <sdake_>Satya_ gotta jet shortly06:34
sdake[22:12:57]  <Satya_>any help in how to debug is also fine06:34
sdake[22:12:59]  <sdake_>Satya_ i'd consult with pbourke06:34
sdake[22:13:13]  <sdake_>Satya_ he keeps oracle linux in good working order06:35
sdake[22:13:26] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:35
sdake[22:13:32]  <Satya_>ok06:35
sdake[22:13:44]  <Satya_>do you have any method in debugging ansible06:35
sdake[22:13:51]  <Satya_>other than -vvv option06:35
sdake[22:13:55]  <sdake_>Satya_ ansible debugging is super weak06:35
sdake[22:13:58]  <sdake_>is -vvv06:35
sdake[22:14:08]  <Satya_>i could not find any other way06:35
sdake[22:14:28]  <Satya_>ok good night06:35
sdake[22:14:37]  <Satya_>will try to figure out06:35
sdake[22:14:48] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:35
sdake[22:15:12]  <sdake_>cool good nght06:35
sdake[22:15:14] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:35
sdake[22:15:17] Disconnect for Sleep Mode06:35
sdake[22:59:19] sdake (~sdake@fedora/sdake) joined the channel06:35
sdake[22:59:19] Topic is Please vote for summit sessions! http://civs.cs.cornell.edu/cgi-bin/vote.pl?id=E_8368e1e74f8a0049&akey=91bbcf4baeff0a2f; RC2 DEADLINE (HARD) Oct 10th-Oct 13th; Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b (old logs from #kolla  http://goo.gl/VKpPzA)06:35
sdake[22:59:19] Set by openstackstatus on September 26, 2016 at 9:09:27 AM MST06:35
sdake[22:59:36] Mode is +cnt06:35
sdake[23:00:21] msimonin (~Adium@tsv35-1-78-232-147-61.fbx.proxad.net) joined the channel06:35
sdake[23:00:31] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:35
sdake[23:00:34] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:35
sdake[23:01:42] egonzalez90 (~eduardogo@89.107.183.4) joined the channel06:35
sdake[23:02:16] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:35
sdake[23:02:26] neilus_ (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:35
sdake[23:03:40] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) left IRC (Read error: Connection reset by peer)06:35
sdake[23:04:03] neilus (~neilus@catv-5-148-241-114.catv.broadband.hu) joined the channel06:35
*** sdake has quit IRC06:35
*** neilus has quit IRC06:35
*** sdake has joined #openstack-kolla06:35
*** zhubingbing has joined #openstack-kolla06:35
*** neilus has joined #openstack-kolla06:36
sdakeapologies if i just spammed the channel06:36
sdakesome kind of wierd cut and paste problem when changing the topic06:36
*** neilus has quit IRC06:37
MarMatso once again :-) Guys don't you experience build failures of rabbitmq? I commented here: https://bugs.launchpad.net/kolla/+bug/161165506:37
openstackLaunchpad bug 1611655 in kolla "kolla.image.build.rabbitmq curl No such directory" [Undecided,Confirmed]06:37
*** neilus has joined #openstack-kolla06:38
sdakemarmat distro is what06:38
MarMatcentos source06:39
sdakemarmat centos builds06:39
*** neilus has quit IRC06:39
sdakesbezverk built it 4-6 hours ago on my gear06:39
*** hfu has joined #openstack-kolla06:39
*** neilus has joined #openstack-kolla06:39
coolsvapMarMat: can you confirm your docker-py version?06:39
sdakeya i am pretty sure docker-py dep change is not good06:39
sdakehence why it needs to be tested06:40
coolsvapsdake: have a look at this https://review.openstack.org/#/c/379901/06:40
coolsvapcentos and oraclelinux fails06:40
MarMatcoolsvap how that is relevant?06:40
coolsvapwith rabbitmq, but i am not getting how that is relevant06:41
*** neilus has quit IRC06:41
*** duonghq has joined #openstack-kolla06:41
*** neilus has joined #openstack-kolla06:41
coolsvapMarMat: i am also not sure, but I observed it when I was testing it06:42
*** msimonin has quit IRC06:43
*** neilus_ has joined #openstack-kolla06:43
sdakecoolsvap rabbitmq builds in gate: http://logs.openstack.org/01/379901/1/check/gate-kolla-dsvm-build-centos-binary-centos-7-nv/bdfc6f9/console.html#_2016-09-30_05_00_04_31294806:43
*** neilus has quit IRC06:43
*** msimonin has joined #openstack-kolla06:43
MarMatI simply pulled centos image, added delorean repo, installed rabbitmq-server, tried that curl and the error was there06:43
*** msimonin has quit IRC06:43
sdakemarmat did you add the rdo dep repo?06:44
sdakethere are two repos that go in there not one06:44
coolsvapsdake: http://logs.openstack.org/01/379901/1/check/gate-kolla-dsvm-build-centos-binary-centos-7-nv/bdfc6f9/console.html#_2016-09-30_05_00_02_59514306:44
coolsvapin the same log06:44
*** neilus_ has quit IRC06:45
*** neilus has joined #openstack-kolla06:45
*** zhubingbing has quit IRC06:45
coolsvaphttp://logs.openstack.org/01/379901/1/check/gate-kolla-dsvm-build-centos-binary-centos-7-nv/bdfc6f9/console.html#_2016-09-30_05_00_04_31510006:46
*** neilus_ has joined #openstack-kolla06:46
sdakecoolsvap rabbitmq version changed in rdo06:46
sdakeit was 3.6.206:46
*** neilus has quit IRC06:47
sdakethe reason it is failing - because plugins get installed in 3.6.2 dir not 3.6.5 dir06:47
*** neilus_ has quit IRC06:47
sdakemoment i'll fix06:47
MarMatonce i changed raabitmq directories in Dockerfile to curl -o /usr/lib/rabbitmq/lib/rabbitmq_server-3.6.5/plugins.. it's passing for me06:47
coolsvapyes its 0:3.6.506:48
*** neilus has joined #openstack-kolla06:48
MarMatthe way it is hardcoded in dockerfile is error-prone06:48
sdakeMarMat you dont say06:49
*** neilus_ has joined #openstack-kolla06:49
*** neilus has quit IRC06:49
*** zhubingbing has joined #openstack-kolla06:49
openstackgerritSteven Dake proposed openstack/kolla: Fix rabbitmq bustage  https://review.openstack.org/37996006:50
sdakemarmat give that a spin06:51
*** neilus has joined #openstack-kolla06:51
MarMatsdake that looks a bit better :-)06:51
sdakethanks even exhausted I can come u pwith 1 liner fixes ;)06:52
MarMatsdake but going sleep now, midnight is here, will check tomorrow06:52
sdakewish my kids could go to bedd so i could06:52
sdakecould would06:52
*** neilus__ has joined #openstack-kolla06:52
duonghqI got a question from 1 Kolla user06:53
sdakeduonghq which sort of q06:53
duonghqhe ask due to Kolla use vxlan as default, but their system is CentOS 7.2 -> kernel 3.1006:53
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: DO NOT MERGE : checking docker-py requirements update  https://review.openstack.org/37990106:54
*** neilus_ has quit IRC06:54
duonghqand the official doc tell VXLAN  should run on 3.13 or better06:54
MarMatsdake but does not solve the problem completely, few weeks ago it was 3.5.something06:54
coolsvapi am not sure why we got the issue in docker-py change only and not others, i hope its just timing06:55
*** neilus has quit IRC06:55
*** phuongnh has quit IRC06:56
*** neilus__ has quit IRC06:58
MarMatsdake nice try with that question mark, but not working07:03
*** matrohon has joined #openstack-kolla07:03
sdakemarmat which distro arey ou on?07:04
MarMatsdake centos07:04
sdakeduonghq redhat backports any relevant patches into their 3.10 ernel07:04
sdakeduonghq think of redhats 3.10 kernel as master - minus some stuff ;)07:04
sdakethat is sort of off, but close07:05
duonghqsdake: tyvm07:05
sdakeMarMat ok well you should know how to fix it from the patchset07:05
sdakeif the question mark doesn't work we will have to encode in a variable or somehting07:05
MarMatsdake sure, for now i'm unblocked07:05
sdakenot sure too tired to think - just killing time until my kids go to bed07:06
MarMatsdake thanks for now, goodnight07:08
sdakeenjoy07:08
sdakecoolsvap docker-py is not reelevant to the rabbitmq bug07:10
sdakecoolvap docker-py cloud sig changed rabbitmq version #07:10
*** rkrum has joined #openstack-kolla07:10
coolsvapsdake: yea but I am not approving the requirements update until I see green gate07:11
rkrumhey sdake07:12
*** MarMat has quit IRC07:13
rkrumI've been able to reproduce the netns issue outside of kolla07:13
rkrumhttps://bugs.launchpad.net/kolla/+bug/161626807:13
openstackLaunchpad bug 1616268 in kolla mitaka "Stale namespace removal causing "RTNETLINK answers: Invalid argument" errors" [Critical,Confirmed]07:13
sdakecoolsvap works for me bro07:14
sdakecoolsvap I think that is a good policy :)07:14
sdakecoolsvap thats why I put a -1 on it :)07:14
*** zhubingbing has joined #openstack-kolla07:15
sdakecoolsvap but i thought it had been tested and changd my vote07:15
sdakeapparently not07:15
*** hieulq has quit IRC07:15
sdakezomg not the netns thing again07:17
sdakerkrum oh - snap07:18
sdakeJeffrey4l ^^^^^^^^^^^^^^^^^^^07:18
sdakerkrum thats fantastic news07:18
sdakelead me read bug log07:18
Jeffrey4lcool07:18
sdakehotnesss07:19
sdakedocker bug07:19
sdakeand root caused07:19
sdakerkrum +++++07:20
bjoloi also have build issues with centos source. My daily build crapped out07:20
sdakei'll see if lk4d4 is around tomorrow and report it to him07:20
sdakehe can fix it07:20
bjolorabbitmq07:20
sdakebjolo yes we know about this one07:20
Jeffrey4lrkrum, where the strace come from? docker? ip netns?07:20
bjolojust confirming :)07:20
*** zhubingbing has quit IRC07:21
sdakebjolo whole core team burning midnight oil, candles from both ends, and endless other idioms i could com up with :)07:21
sdakebjolo one issue with kolla in general is that our deps change (stuff like rabbitmq)07:21
sdakebjolo i'll put up a patch for you - moment07:22
bjolono worries sdake, no need for a patch just for me. i deploy ubuntu instead for todays testing07:23
openstackgerritSteven Dake proposed openstack/kolla: Fix rabbitmq bustage  https://review.openstack.org/37996007:23
bjoloor i can use that patch :)07:23
sdakebjolo patch already up07:23
sdakeso - up to you :)07:23
bjolotnx07:23
sdakeits not the end patch07:23
sdakei think we need to make that more robust07:23
openstackgerritDennis Mueller proposed openstack/kolla: Added neutron_metering_agent to ansible tasks for neutron  https://review.openstack.org/34663007:23
sdakenot sure how at this late hour07:23
sdakei need to hit the rack07:23
sdakewaiting on kids to ptfo07:23
duonghqsdake: ping07:25
duonghqdid you hit the rack07:25
sdakenope07:25
sdakeputting clock on the kids07:25
sdakesup07:25
duonghqwell, seem that our configuration files have not had naming convention07:26
duonghqsuch as07:26
rkrumJeffrey4l the strace from 'ip netns del '07:26
sdakeoh cool iputils bug07:26
sdakethat should be easier to fix07:26
duonghqneutron image use <agent-name>/ml2_conf.ini schema, but glance use <component>/<coponent>.conf07:26
sdakeharder to get a release of07:26
Jeffrey4lhmm. i do not think so..07:26
*** msimonin has joined #openstack-kolla07:27
duonghqIt doesn't follow original project config file name as well07:27
Jeffrey4lMNT_DETACH (since Linux 2.4.11)07:27
Jeffrey4l              Perform  a  lazy  unmount:  make the mount point unavailable for new accesses, immediately disconnect the filesystem and all filesystems mounted below it from each07:27
Jeffrey4l              other and from the mount table, and actually perform the unmount when the mount point ceases to be busy.07:27
*** ldeptula has joined #openstack-kolla07:27
Jeffrey4li think the root cause should: docker-engine still opened that mount point event i delete the namespace .07:28
Jeffrey4lMNT_DETACH should be fine.07:28
sdakeok well get me a root cause in the bug id07:28
sdakeJeffrey4l mail me the bug id wehn you shut down for the night07:28
sdakeor day07:28
Jeffrey4lsdake, you mean the docker bug id?07:29
sdakeis there a docker bug id?07:29
sdakeI was going to talk to docker engineer tomrrow07:29
sdakeassuming he is still there07:29
sdakesince we have simple reproducer07:29
Jeffrey4lno idea. i will search in the docker bug list. if not, i will try to create one.07:30
sdakeand let him tackle it07:30
sdakewe have good relationship - he will fix easily i'm sure07:30
Jeffrey4lthat's cool07:31
sdakeif you can get to bottom of root cause that would help it along07:31
Jeffrey4land thanks rkrum ;p07:31
rkrumnp07:31
sdakeunclear how to handle for the release07:31
sdakeseems like a major flaw in docker07:31
sdakeand our use thereof07:31
sdakerkrum did you try different versions of docker07:32
rkrumnot yet07:32
*** sdake_ has joined #openstack-kolla07:34
*** neilus has joined #openstack-kolla07:34
rkrumI can test in a few days07:35
sdake_rkrum which version of docker are you using07:36
sdake_it could be a docker-engine regression07:36
sdake_as SamYaple said, it worked in 1.11.0 iirc07:36
sdake_or 1.10.007:36
rkrumdocker-engine-1.11.2-1.el7.centos.x86_6407:36
*** sdake has quit IRC07:37
*** coolias has joined #openstack-kolla07:37
sdake_ok well if its a docker regression simple answer is to pin our docker-engine version to an old version until they fix it07:37
sdake_old being 1.10.whatever07:37
sdake_Jeffrey4l did you try an older version of docker-engine with your test case?07:38
rkrumI gtg for now, thanks guys07:38
sdake_rkrum thank you!07:38
*** neilus has quit IRC07:38
sdake_rkrum huge fix for us thanks!07:38
Jeffrey4li saw this error in 1.12 too. so i think all docker should have such issue.07:38
*** rkrum has quit IRC07:38
sdake_what about 1.10?07:38
sdake_it could have worked in old version, and regressed in new version07:40
sdake_or alternatively never worked at all07:40
Jeffrey4li will test 1.10 later today.07:40
sdake_sounds good07:40
sdake_shoot me an email07:40
Jeffrey4lOK.07:40
sdake_i may be slow to wake in the morning :)07:40
sdake_stdake@cisco.com wfm07:40
Jeffrey4lroger.07:40
sdake_also send me any relevant info07:41
Jeffrey4lnp07:42
*** salv-orl_ has joined #openstack-kolla07:44
*** hieulq has joined #openstack-kolla07:45
*** salv-orlando has quit IRC07:46
*** ayoung has quit IRC07:47
*** coolias has quit IRC07:49
*** Serlex has joined #openstack-kolla07:52
openstackgerritDuong Ha-Quang proposed openstack/kolla: Add profile usage to kolla-build guide  https://review.openstack.org/37823007:53
*** ayoung has joined #openstack-kolla07:53
*** ayoung has quit IRC08:00
*** neilus has joined #openstack-kolla08:02
*** hfu has quit IRC08:02
*** daneyon has joined #openstack-kolla08:06
*** neilus has quit IRC08:07
*** Jeffrey4l_ has joined #openstack-kolla08:09
*** Jeffrey4l has quit IRC08:10
*** daneyon has quit IRC08:10
sdake_night all08:11
sdake_i have hit the wall abou 2 hours ago08:11
*** Chong has joined #openstack-kolla08:14
*** coolias has joined #openstack-kolla08:15
*** shardy has joined #openstack-kolla08:16
*** ldeptula has quit IRC08:20
*** ldeptula has joined #openstack-kolla08:21
Jeffrey4l_good night08:22
*** egonzalez90 has quit IRC08:23
*** sdake_ has quit IRC08:23
*** berendt has joined #openstack-kolla08:36
berendtmorning guys08:37
*** zhurong has quit IRC08:39
*** b_bezak has joined #openstack-kolla08:41
openstackgerritbjorn lofdahl proposed openstack/kolla: Bug #1629206  https://review.openstack.org/38001408:41
openstackbug 1629206 in kolla "keystone fernet prechecks fail" [Undecided,New] https://launchpad.net/bugs/162920608:41
bjoloaaahh still need to learn git/gerrit08:42
bjolomy commit message was not ok08:42
bjolohow do i revert it?08:42
berendtbjolo no problem, it is not that easy08:42
berendtbjolo you can simply edit the commit message using the gerrit webinterface08:42
bjolook08:42
berendtgo to https://review.openstack.org/#/c/380014/1//COMMIT_MSG08:43
berendtthere you have an editor icon next to "Patch Set 1" above the content of the patch08:43
bjologot it08:43
bjolotnx08:43
berendthttps://wiki.openstack.org/wiki/GitCommitMessages08:44
berendtthere are some samples for openstack messages08:44
bjolook done08:49
bjolonow you can give me +1 instead :)08:50
berendtbjolo you do not want to have a +2?08:50
bjoloor +2 :)08:50
berendtbut you have not yet saved/published the modification08:50
openstackgerritbjorn lofdahl proposed openstack/kolla:   https://review.openstack.org/38001408:51
berendtbjolo you missed to add a title, this is required08:52
berendtTITLE .. NEWLINE.. BODY08:52
bjolook08:53
*** phuongnh has joined #openstack-kolla08:54
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla: Unmount Ceph OSD disks as part of destroy  https://review.openstack.org/38002808:56
*** papacz has joined #openstack-kolla08:57
berendtpbourke your are doing self -2? :)08:57
pbourkeberendt: procedural08:57
pbourkeberendt: this is for O08:57
berendtyes of course, just looks funny08:57
pbourke:)08:57
berendtpbourke i think it makes sense to not use /etc/fstab as source08:58
openstackgerritbjorn lofdahl proposed openstack/kolla: fixed kestone fernet prechecks for multinode deployments  https://review.openstack.org/38001408:58
pbourkeberendt: rekcon output of 'mount' would be better?08:59
berendti think so, yes..08:59
pbourkeberendt: thanks will do09:01
*** Chong has quit IRC09:02
openstackgerritChristian Berendt proposed openstack/kolla: Document how to remove a service  https://review.openstack.org/38003209:03
openstackgerritChristian Berendt proposed openstack/kolla: Document how to remove a service  https://review.openstack.org/38003209:04
*** salv-orl_ has quit IRC09:05
berendtpbourke is it necessary to block changes not related to the code base?09:08
openstackgerritbjorn lofdahl proposed openstack/kolla: fixed kestone fernet prechecks for multinode deployments  https://review.openstack.org/38001409:08
pbourkeberendt: I think its the best policy to follow myself. Docs and gate scripts are still related to the code base09:10
berendtberendt makes sense09:10
pbourkeIf its not critical it can wait09:11
berendthttps://review.openstack.org/#/c/379815/09:11
berendtnot sure if this is critical. but i think we do not check kibana on the gates.09:11
*** dasTor has joined #openstack-kolla09:13
*** pbourke has quit IRC09:14
*** pbourke has joined #openstack-kolla09:14
*** robcresswell has joined #openstack-kolla09:25
*** yingjun has quit IRC09:27
*** hfu has joined #openstack-kolla09:30
*** salv-orlando has joined #openstack-kolla09:31
*** athomas has joined #openstack-kolla09:35
*** b_bezak has quit IRC09:49
*** neilus has joined #openstack-kolla09:50
*** daneyon has joined #openstack-kolla09:54
*** neilus has quit IRC09:55
*** daneyon has quit IRC09:58
*** egonzalez90 has joined #openstack-kolla10:00
openstackgerritprameswar proposed openstack/kolla:  As of Ubuntu 16.04 apt instead of apt-get to install packages  https://review.openstack.org/37947710:18
*** b_bezak has joined #openstack-kolla10:21
*** coolias has quit IRC10:23
*** coolias has joined #openstack-kolla10:24
openstackgerritChristian Berendt proposed openstack/kolla: Use sudo to create loop device on gate nodes  https://review.openstack.org/38012710:30
*** gfidente|afk is now known as gfidente10:37
*** salv-orl_ has joined #openstack-kolla10:41
*** salv-orlando has quit IRC10:41
*** phuongnh has quit IRC10:45
*** neilus has joined #openstack-kolla10:45
openstackgerritprameswar proposed openstack/kolla:  apt instead of apt-get to install packages  in Ubuntu  https://review.openstack.org/37947710:45
openstackgerritChristian Berendt proposed openstack/kolla: Make deploy aio script workable on non-gate nodes  https://review.openstack.org/38014810:46
*** egonzalez90 has quit IRC10:47
openstackgerritChristian Berendt proposed openstack/kolla: Enable further sanity checks on the gates  https://review.openstack.org/38015110:48
*** neilus has quit IRC10:50
openstackgerritDuong Ha-Quang proposed openstack/kolla: Fix docs formatting error  https://review.openstack.org/38016110:53
*** coolias has quit IRC10:55
*** shardy is now known as shardy_lunch10:59
*** duonghq has quit IRC11:00
*** dwalsh has joined #openstack-kolla11:05
*** JoseMello has joined #openstack-kolla11:05
*** zhubingbing has joined #openstack-kolla11:13
*** rhallisey has joined #openstack-kolla11:19
*** dave-mccowan has joined #openstack-kolla11:20
openstackgerritChristian Berendt proposed openstack/kolla: Populate mistral db during bootstrap  https://review.openstack.org/38017211:21
*** bjolo has quit IRC11:27
*** bjolo has joined #openstack-kolla11:27
pbourkeJeffrey4l_: any suggestions on how we might disable dumb-init for Ceph without refactoring every start.sh script?11:28
pbourkeJeffrey4l_: it seems to be breaking Ceph but I can't figure out why11:28
*** ccesario has joined #openstack-kolla11:31
*** schwicht has quit IRC11:34
*** eaguilar has joined #openstack-kolla11:34
*** neilus has joined #openstack-kolla11:39
*** shardy_lunch is now known as shardy11:42
*** daneyon has joined #openstack-kolla11:42
*** Mech422 has quit IRC11:43
*** neilus has quit IRC11:44
*** jtriley has joined #openstack-kolla11:45
*** Mech422 has joined #openstack-kolla11:47
*** daneyon has quit IRC11:47
*** eaguilar has quit IRC11:50
*** hfu has quit IRC11:52
*** hfu has joined #openstack-kolla11:53
*** hfu has quit IRC11:53
*** egonzalez90 has joined #openstack-kolla11:56
*** eaguilar has joined #openstack-kolla11:57
*** caowei has quit IRC11:58
openstackgerritDuong Ha-Quang proposed openstack/kolla: Add profile usage to kolla-build guide  https://review.openstack.org/37823011:59
*** zhubingbing has quit IRC12:02
*** eaguilar_ has joined #openstack-kolla12:02
*** eaguilar has quit IRC12:03
*** dwalsh has quit IRC12:05
*** schwicht has joined #openstack-kolla12:08
bjoloanyone setup keystone domains with newton and got it to work?12:08
berendtbjolo this should work out of the box12:09
bjoloi can create the domain and configure the ldap setting so all my users are visible12:09
bjolobut i can not give admin the admin role for the new domain12:09
openstackgerritDuong Ha-Quang proposed openstack/kolla: Add profile usage to kolla-build guide  https://review.openstack.org/37823012:10
bjolorole assignment list shows correctly but not working really12:11
*** zhubingbing has joined #openstack-kolla12:12
bjolocreate a new project from cli works, but in horizon it does not list the domain12:14
Jeffrey4l_pbourke, what error message did u get?12:16
pbourkeJeffrey4l_: the mons just hang, trying to run 'ceph -s' times out12:16
pbourkeJeffrey4l_: https://bugs.launchpad.net/kolla/+bug/162923712:16
openstackLaunchpad bug 1629237 in kolla "Ceph monitors not responding (Error connecting to cluster: TimedOut)" [Critical,Confirmed] - Assigned to Paul Bourke (pauldbourke)12:16
pbourkeJeffrey4l_: sean-k-mooney also seeing this12:16
*** schwicht has quit IRC12:17
*** jtriley has quit IRC12:17
Jeffrey4l_pbourke, ok. i will take a look.  are u sure it will work when disable dump-init?12:17
*** schwicht has joined #openstack-kolla12:18
Serlex" libvirtError: internal error: Cannot find suitable emulator for x86_64" - anyone seen that before?12:19
berendtSerlex context?12:19
Serlexnova_compute when lauching a Cirros instance12:20
*** gfidente has quit IRC12:20
Serlexfrom nova_compute...running on a xen hypervisor12:20
Jeffrey4l_Serlex, i think you should use virt_type=qemu in nova.conf12:20
*** jtriley has joined #openstack-kolla12:20
Serlexbut its a zen hypervisor12:21
Serlexxen*12:21
*** pallavi has quit IRC12:21
Jeffrey4l_hmm. not familiar with zen.12:21
Jeffrey4l_does kvm work on xen?12:21
SerlexAren't they the same thing?12:22
berendtXen != KVM12:22
SerlexI've ran kolla openstack before on Xen, but setting seems to have changed, and I'm not sure what12:22
Jeffrey4l_Serlex, i think you are test kolla on xen. Then that means you run kvm on xen server, right?12:23
Serlexno, this is a baremetal server with Oracle VM server running xen. Don't think KVM has anything to do with it12:23
Serlexmy nova.conf has the correct virt_type=xen...but I can't launch an instance12:24
*** athomas has quit IRC12:24
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805612:24
*** eaguilar_ has quit IRC12:24
Jeffrey4l_I though you are testing kolla. does kolla support xen as hypervisor?12:25
*** eaguilar has joined #openstack-kolla12:26
*** jtriley has quit IRC12:26
berendtJeffrey4l_ in theory it should be possible to use Libvirt/Xen with kolla12:27
Jeffrey4l_Got. never used Xen.12:28
berendtbut i have never tested this and i know there are some issues with the Libvirt/Xen integration12:28
berendtwe use Libvirt/Xen on an other big environment and we had some interesting issues there :)12:28
openstackgerritMerged openstack/kolla: Fix mistral service  https://review.openstack.org/37492112:29
SerlexHas to be a recent change, I will keep digging12:29
*** gfidente has joined #openstack-kolla12:30
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805612:31
*** Serlex has quit IRC12:31
*** skramaja has quit IRC12:33
*** Serlex has joined #openstack-kolla12:34
*** b_bezak has quit IRC12:37
sbezverkMorning, anybody happen to have a link for Ceph Jewel for centos 7 repo?12:38
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805612:41
*** schwicht has quit IRC12:42
*** schwicht has joined #openstack-kolla12:43
*** Jeffrey4l_ has quit IRC12:47
*** schwicht has quit IRC12:48
*** Jeffrey4l_ has joined #openstack-kolla12:48
*** jheroux has joined #openstack-kolla12:51
*** egonzalez90 has quit IRC12:51
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805612:51
*** jtriley has joined #openstack-kolla12:56
*** david-lyle has joined #openstack-kolla12:57
openstackgerritHironori Shiina proposed openstack/kolla: Fix a few typos in documentation  https://review.openstack.org/38026613:00
*** schwicht has joined #openstack-kolla13:03
*** sdake has joined #openstack-kolla13:04
*** dwalsh has joined #openstack-kolla13:05
*** imcsk8 has quit IRC13:06
*** b_bezak has joined #openstack-kolla13:06
*** imcsk8 has joined #openstack-kolla13:08
*** caowei has joined #openstack-kolla13:08
pbourkesbezverk: master is using jewel13:10
pbourkeSerlex: im pretty sure that's a libvirt config issue on OVM13:11
pbourkeSerlex: there's a range of availble cpu's it can emulate, Im not sure how it figures out what's available though. did the version of libvirt change recently or something like that?13:11
*** jtriley has quit IRC13:13
pbourkeJeffrey4l_: looks like I might be wrong, still seeing issues without dumb-init :(13:20
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805613:20
Jeffrey4l_pbourke, how many ceph-mon nodes are u running?13:21
pbourkeJeffrey4l_: three. Its strange it seems to work every second deploy. Works perfectly, then I tear it down, redeploy and the problem happens13:22
pbourkeJeffrey4l_: it seems persistent with dumb-init enabled but again it might be red herring13:22
*** mag009 has quit IRC13:23
sdakemorning13:23
*** mag009 has joined #openstack-kolla13:23
sdakedumb init is broken in master???????13:23
sdakepbourke or stable branches13:24
sdakeare problematic without dumb_init13:24
*** inc0 has joined #openstack-kolla13:24
inc0good morning13:24
inc0kfox1111, let me know when you wake up:)13:24
pbourkesdake: ceph is broken on master (at least for me and sean)13:25
Jeffrey4l_pbourke, hmm. do u mean it is related to dumb-init or not :(13:25
pbourkesdake: I thought it was dumb-init related but not sure13:25
inc0pbourke, how?13:25
pbourkeJeffrey4l_: I dont know!13:25
pbourkewe have the master version of ceph in our oracle fork and dont see this issue13:25
berendtcould it be related to the used distro?13:25
pbourkethe only difference is we dont have dumb-init13:25
sdakepbourke thats good data13:25
pbourkehttps://bugs.launchpad.net/kolla/+bug/162923713:25
openstackLaunchpad bug 1629237 in kolla "Ceph monitors not responding (Error connecting to cluster: TimedOut)" [Critical,Confirmed] - Assigned to Paul Bourke (pauldbourke)13:26
inc0pbourke, what are the symptoms13:26
inc0?13:26
berendti am running with ubuntu xenial and there it is working (at least with my last deployment)13:26
pbourkewould be good if someone else could test master ceph13:26
inc0ok, so I have good/bad news13:26
inc0ubuntu works, I deployed ceph yesterday13:26
inc0I'll confirm that it's all good tho, give me a sec13:26
pbourkemaybe just rht distros13:26
berendtinc0 same here13:26
sdakepbourke  i have a few weeks ago after the change to jewel and it worked on my 3 node cluster13:27
Serlexinc0 - do you have warning such as too many PGs per OSD?13:27
pbourkehmm13:27
sdakepbourke however all my storage and compute and control are collocated13:27
inc0Serlex, indeed I do13:27
sdakepbourke Jeffrey4l_ tests mostly with centos as well13:28
inc0which is strange, I can't recall changing anything in that place13:28
sdakewell in reality dumb-init fundamentally changes how kolla operates13:28
sdakethe key is to get to the root cause13:28
Serlexok good  - because thats what I got :D13:28
inc0but I don't think this is problem13:28
inc0I have working ceph, master from yesterday13:28
sdakepbourke if you add dumb-init in your internally carried branch (its not a fork if you rebase;) does that fix the problem?13:29
Serlexcommitting 128 PGs per pool resulting over 300, which is the default. You can silence it, but its like ignoring the problem13:29
inc0let me fix the pg issue and see if I'll have HEALTH_OK13:29
pbourkeSerlex: the reason I came across the ceph issue we're discussing was because I was trying to deploy upstream to verify the pgs issue ;)13:29
Serlexsure its not a problem, but worth looking at13:29
Serlexok pbourke :D13:29
inc0if it's only centos, than we might have even bigger problem to debug13:30
*** jtriley has joined #openstack-kolla13:30
inc0but oracle linux is rht-ish too isn't it?13:30
pbourkeinc0: tis13:30
inc0so, centos-broken, ubuntu-ok, oracle-ok13:31
inc0what's different?13:31
pbourkeno oracle is not ok :)13:31
*** daneyon has joined #openstack-kolla13:31
Serlex:d13:31
inc0ok, oracle broken too?13:31
pbourkeyes13:31
inc0which repos for ceph are you using?13:31
pbourkesame as centos13:31
pbourkethough in our internal build we're using oracle built packages13:31
Serlexhow many pools do you have inc0?13:31
inc0can you confirm if they work?13:32
pbourkesame problem13:32
pbourkewe're talking about the pgs thing right?13:32
inc03 pools13:32
pbourkenot the mons freezing one13:32
inc0no, I was talking about mon not responding13:32
pbourkeoh13:32
inc0uff13:32
inc0ok, let's tackle mons freeze first13:32
SerlexI confused things, my bad13:32
inc0pg is one line fix for anyone13:32
Serlexsure13:32
inc0just need to call one command13:32
inc0I just think default changed really13:33
pbourkeok so mons freezing is happening in oraclelinux upstream build, but not with our internal build13:33
inc0because before that it was like 25, so not really good as well13:33
pbourkeits also happening for sean, afaik he uses ubuntu but i may be wrong13:33
inc0let's assume not for a moment, as ubuntu seems ok13:33
inc0at least for me13:34
Jeffrey4l_i tested centos+source several days ago. it works too.13:34
pbourke:/13:34
berendtubuntu works for me13:35
inc0as pg group count goes, best way would be to add task to do this math http://ceph.com/pgcalc/13:35
inc0and just docker exec correct pg num13:35
pbourkeinc0: would it not be better to set them correctly initially13:35
pbourkenova/ceph.yml13:35
*** daneyon has quit IRC13:35
inc0Jeffrey4l_, would you mind testing centos now? source or bin shouldnt change anything13:36
inc0pbourke, that depends on number of OSDs13:36
inc0so we can't really13:36
pbourkeim not sure it does13:36
Jeffrey4l_inc0, ok13:36
inc0look at the bottom of page I linked13:37
inc0you have formula there13:37
berendtpbourke it depends, change the osd value in the table and the pg cound value will change13:37
Jeffrey4l_pbourke, do u means the first deploy failed or the second deploy failed? ( you comment above )13:37
*** dasTor has quit IRC13:37
inc0we can just hardcode pgnum per osd I think13:37
Serlexcurrently 128 isn;t it?13:37
Serlexits in ceph_pools.yml13:38
pbourkethe warning is per osd13:38
pbourkeregardless of number of osds13:38
Jeffrey4l_inc0, the pgnum is a property of ceph pool.13:38
pbourkehttps://github.com/ceph/ceph/commit/7f3dcdb089b4342e8624d37abfe5437db8a15c3913:38
inc0pbourke, but you set total number of pgs13:38
pbourkeJeffrey4l_: the second. so if it works the first time tear it down and redeploy. again may be co-incidence13:38
*** portdirect has quit IRC13:38
inc0Jeffrey4l_, yeah but we do set up initial pool13:39
inc0s13:39
Jeffrey4l_pbourke, did u check wether all the data is destroyed before re-deploy?13:39
pbourkeJeffrey4l_: 100% yes13:39
Jeffrey4l_cool13:39
pbourkeJeffrey4l_: inc0: it looks like the mons are failing to form a quorum in the failure scenario, will update the bug with logs13:42
inc0https://github.com/openstack/kolla/blob/master/ansible/roles/ceph_pools.yml imho in this file we need to add ceph pool pg change13:42
*** huikang has joined #openstack-kolla13:42
*** jtriley has quit IRC13:42
pbourkeinc0: +113:42
pbourkeinc0: static value is probably bad though13:43
Jeffrey4l_inc0, yes.13:43
pbourkeinc0: I think you're correct a docker exec based on some introspection would be best13:43
inc0so formula will be (number of osds) * 100 / (total number of storage nodes)13:43
*** jtriley has joined #openstack-kolla13:43
*** salv-orlando has joined #openstack-kolla13:43
Jeffrey4l_i think we can make these value dynamic.13:43
inc0and closes power of 2 to this (rounded up)13:43
inc0http://docs.ceph.com/docs/jewel/rados/operations/placement-groups/#choosing-the-number-of-placement-groups13:43
Serlex100 :D13:44
inc0since we setup pools all across cluster13:44
inc0that's what ceph said:P13:44
Jeffrey4l_inc0, the pg_num is proper of ceph pool. and you are calculate the total pg_num i think.13:45
SerlexI didn't have this before because only one pool (ephemeral vms) was created13:45
inc0Jeffrey4l_, no need, we set them up per pool anyway13:45
inc0ceph osd pool set {pool-name} pg_num {pg_num}13:45
*** salv-orl_ has quit IRC13:46
Jeffrey4l_so the formula for each pool is :  ( number of osds ) * 100 / totla number of storage nodes / number of pool13:46
inc0what is number of pool?13:47
Serlexare you asking how many pools there are?13:48
Jeffrey4l_we have: vms volumes images, so 3 at least.13:48
*** jtriley has quit IRC13:48
berendtJeffrey4l_ +backup13:48
inc0Jeffrey4l_, but you don't need to set up total number of pgs13:48
inc0you need to set them up per pool13:48
Jeffrey4l_the volumes-cache may added when enabled ceph cache.13:48
Jeffrey4l_berendt, yes. thanks.13:49
inc0so every time we create ceph pool, we setup pg groups13:49
berendtand -cache will be added for every existing pool13:49
Jeffrey4l_berendt, right ;)13:49
Jeffrey4l_so it will be very dynamic.13:49
inc0https://github.com/openstack/kolla/blob/master/ansible/roles/ceph_pools.yml which means adding this task 2 times to this file13:49
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805613:49
inc0which is called every time we add rbd pool13:50
inc0we don't need to calculate total number of pgs because we can't do anything with it;)13:50
Jeffrey4l_remember: that file is setting each pool's pg_num.  and we want to control pg_num on each osds.  the number of pool is key point.13:50
britthouser2( number of osds ) * 100 / totla number of storage nodes gives you the recommended number of PG for your entire cluster13:51
britthouser2then you allocate them across sthe pools based on usage13:51
britthouser2that is what the spreadsheet here is doing: <http://ceph.com/pgcalc/>13:51
britthouser2if you select ‘OpenStack’ as the use cae13:51
britthouser2then it gives a certain percentage of the PG to VMs, volumes, images, etc13:52
inc0britthouser2, no, look13:52
inc0every pool has power of 2 placement groups13:52
inc0this is number we calculate13:52
Jeffrey4l_i think the pg_num should be leave it that and it should configured by the operator based on his case.13:52
inc0what they did play around is % of data13:53
inc0per pool13:53
britthouser2Right…they used formula to come upw tih total PG_num for entire cluster13:53
Jeffrey4l_for example, how about i only have 4 image in images pool and 9999 image in vms pool13:53
Jeffrey4l_it is different.13:53
inc0we have enough info for basic use case13:53
inc0let's add default13:53
britthouser2then they divided that across the 4 pools, based on “Best practice” percentage13:53
Jeffrey4l_and if we set the same pg_num, it is bad.13:54
inc0ok, how about we use numbers from there13:54
Jeffrey4l_the point is: the pg_num can not be reduce.13:54
inc0which puts as at broken state now13:54
inc0as kolla puts too many of them for whatever reason13:55
britthouser2Yeah, older ceph docs neglected to give % allocations13:55
britthouser2but many people over allocated.13:55
inc0we can calculate it.13:55
britthouser2I think using their percentages as a default isn’t a bad idea.13:56
inc0and hardcode % as per suggested usage13:56
britthouser2yes +!13:56
britthouser2+113:56
Serlex+2113:56
Serlex213:56
inc0we have all the info needed13:56
inc0we can calculate nubmer of OSDs13:56
britthouser2calculate the total, use their percentage as default, let an operator override the percentages if they so choose13:56
inc0we can calculate number of nodes13:57
inc0yup13:57
inc0btw do we have bug for too many pgs ?13:59
SerlexI can create one, as my first13:59
Serlexactually, ignore that13:59
SerlexI don't have an account at launchpad13:59
inc0Serlex, then make acc on lp and create bug;)14:00
inc0as your first:P14:00
Serlexhaha ok14:00
inc0kfox1111, up already?:P14:00
*** MarMat has joined #openstack-kolla14:02
*** tmcpeak has joined #openstack-kolla14:02
tmcpeakhey inc0 sdake14:03
tmcpeakI remembered I'm not working Wednesday14:03
inc0good morning tmcpeak14:03
tmcpeakso can't attend the meeting14:03
inc0ok, let's move it then14:03
tmcpeakbut I think I can get either dg or hyakuhei or both14:03
tmcpeakor we can move it :)14:03
inc0Jeffrey4l_, pbourke meet tmcpeak, he's from openstack-security team14:03
tmcpeako/ Jeffrey4l_14:03
tmcpeakpbourke: o/14:03
sdakesup tmcpeak14:03
Jeffrey4l_tmcpeak, hi14:03
tmcpeakheya14:03
sdaketmcpeak we can't move thte meeting but we can move when we meet for this topic :)14:04
inc0we want to meet together sometime next week for an hour to start security analisys14:04
tmcpeakheh, come on guys, you won't change your entire meeting schedule for me? :P14:04
tmcpeakinc0: awesome!14:05
tmcpeakmaybe we can get you all started with that and synch up the Weds after?14:05
inc0how about 2 hrs before your security meeting?14:05
inc015 UTC?14:05
inc0Thur14:06
* tmcpeak checks14:06
tmcpeaksure, sounds good14:06
inc0just to kick us off the cliff so we can try to fly on our own;)14:06
inc0or crush on rocks14:06
inc0birds have to be badass.14:06
tmcpeakis there any other way? :)14:07
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032314:07
inc0Jeffrey4l_, pbourke how about you? that time would work? It'd be great to have you around14:07
Jeffrey4l_i am OK with that.14:07
pbourkegood for me14:08
inc0great, let's do that14:08
inc0Thur, 6th oct 15 UTC14:08
tmcpeakawesome14:08
tmcpeakwe'll swing by here and then maybe migrate to hangouts?14:09
Jeffrey4l_roger14:09
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032314:09
tmcpeakawesome, thanks all14:09
inc0thank you14:09
*** tmcpeak has left #openstack-kolla14:10
MarMatinc0 can you comment on pbourke s comments on https://review.openstack.org/#/c/379862 You core guys should make clear what kind of solution for that you want in newton :-)14:11
*** huikang has quit IRC14:12
*** huikang has joined #openstack-kolla14:13
inc0pbourke, so this is just a workaround:)14:13
inc0as it doesn't need any changes in code14:13
inc0but pretty complete no_proxy logic I must say MarMat ;)14:14
pbourkedo we want to document workarounds?14:14
MarMatinc0 cost me half a day yesterday :-)14:14
inc0I think we should, it's better to document it and change it if we fix it14:14
Jeffrey4l_inc0, we have introduced docker build --build-args feature.14:14
Jeffrey4l_you use such solution.14:14
pbourkethat's build time14:14
inc0Jeffrey4l_, issue MarMat had was to have pre-build containers and add it on runtime14:15
pbourkei doubt people want them baked in. but it is decent workaround14:15
inc0for example containers from dockerhub14:15
Jeffrey4l_hmm. OK.14:15
*** huikang has quit IRC14:16
inc0I'm not 100% sure if we need to re-declare all the defaults14:16
*** huikang has joined #openstack-kolla14:16
pbourkeinc0: MarMat: feel free to override me on it no hard feelings14:16
pbourkepersonally I dont like that solution14:16
MarMatMarMat I don't like that doc much either honestly14:16
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032314:17
inc0we can just drop the doc patch if you guys are against it14:17
inc0I just figured out that others might have same issue14:17
*** srwilkers has joined #openstack-kolla14:17
inc0especially if they run magnum, which originated whole thing14:17
Jeffrey4l_sdake, inc0 pbourke please review this  https://review.openstack.org/372737  ?14:18
inc0sbezverk, so I have mixed feelings about running keepalived with k8s14:18
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix ironic failed  https://review.openstack.org/37910614:18
MarMatinc0 well, there is a bug report with that workaround described. This is sufficient from my pov14:19
inc0fair enough14:19
MarMatinc0 https://bugs.launchpad.net/kolla/+bug/162833514:19
openstackLaunchpad bug 1628335 in kolla "magnum-conductor container failing behind a proxy" [High,In progress] - Assigned to Martin Matyáš (martinx-maty)14:19
sdakeJeffrey4l_ need to take kid to school right now - will look when i return14:19
*** lrensing has joined #openstack-kolla14:19
inc0I just wanted it to be documented somewhere14:19
sdakewhich documented?14:20
*** jtriley has joined #openstack-kolla14:20
inc0ok, your call guys, we can abandon patch14:20
sdakegotta jet14:20
MarMatinc0 I'm fine with abandon14:20
*** bjolo has quit IRC14:21
*** neilus has joined #openstack-kolla14:22
*** Jeffrey4l_ has quit IRC14:22
inc0sbezverk, kfox1111 rhallisey so I wanted to run an idea with you guys14:22
*** Jeffrey4l_ has joined #openstack-kolla14:23
inc0kfox1111, we discussed yesterday that people have reservations towards ansible, and it's true14:23
inc0but here's idea how we can solve keepalived issue and ansible workflow issue at same time14:23
inc0let's move it all to kolla-ansible.14:24
inc0create playbook to setup ha for k8s using our normal haproxy role14:24
inc0(I don't want to run keepalived in k8s...I dread to think what would happen if it float away somewhere)14:24
inc0also it would require for k8s apis and kubelets to be on same hosts14:25
inc0which might not be the case14:25
*** msimonin has quit IRC14:25
inc0or we can just ignore issue and require operator to setup functional k8s for us14:25
rhalliseywhat would be in the k8s dir?14:25
*** jtriley has quit IRC14:25
rhalliseycli + templates?14:25
inc0rhallisey, not project, just add playbook to bootstrap kolla-k8s14:25
inc0we have dependency on kolla-ansible anyway for configs14:26
rhalliseythat changes though if config is split out14:26
inc0yes, but on the other hand14:26
inc0kfox1111 and me discussed that some people might want to run it with puppet14:26
rhalliseyyup agreed14:26
inc0so it's safe to assume they'll have their own configs14:27
inc0anyway, it might or might not affect config split14:27
*** neilus has quit IRC14:27
inc0would strengthen dep on kolla-ansible, but for time being it might not be that bad14:27
rhalliseyidk14:27
openstackgerritJeffrey Zhang proposed openstack/kolla: Add validate no new line at end of file  https://review.openstack.org/38034014:27
inc0would make stuff whole lot easier to get us up and running fast tho14:28
rhalliseythis may be on the 2nd summit session14:28
rhalliseykolla-ansible container ansible playbooks for both deployments14:28
inc0so here's thing, I'd like to have auto-bootstrap done before summit14:28
*** msimonin has joined #openstack-kolla14:28
inc0we can change it all the way till 1.0.014:28
*** msimonin has left #openstack-kolla14:31
*** inc0 has quit IRC14:31
*** inc0 has joined #openstack-kolla14:32
sbezverkinc0: about your comment that api and kubelet should run on the same box, it is not entirely true14:32
sbezverkkeepalived offers "external" HA14:32
inc0sbezverk, could not, not should not14:32
inc0and if it doesn't, keepalived running with k8s is worthless14:33
inc0ok, maybe nto if we run haproxy too14:33
inc0but uhh...moving IP with container sounds scary14:33
*** tonanhngo has joined #openstack-kolla14:34
sbezverkinc0 keepalived runs in net=host so container is not moving, it is alive or it is dead, in case it is dead other instance of keepalived pod takes over14:34
inc0imho we could just ignore this issue and assume that operator will provide us functional k8s14:34
*** tonanhngo has quit IRC14:34
inc0functional == HA14:35
sdakeinc0 as i see it what we are really after long term is a native k8s implementation of kolla14:35
sbezverkinc0: that is true when I sent request to operators, most of them mentioned that they use their own external solution whether it is haproxy or something else14:35
sdakegetting  from here to there, i think ansible is a fine approach14:36
inc0sdake, elaborate14:36
sdakenative as in k8s does everything no ansible involved14:36
inc0oh, you mean bootstrapping14:36
sdakenote k8s lacks feature parity to make that happen14:36
inc0well, not possible now, we'll see how k8s evolves14:36
sdakethat wont be the case forever14:37
sdakeJeffrey4l_ any movement on the netns problem14:37
*** david-lyle has quit IRC14:37
*** david-lyle has joined #openstack-kolla14:38
sbezverkinc0: personnaly I fail to see how moving more to ansible will atract people who is not so fan of ansible14:38
inc0sbezverk, it will keep ansible out of kolla-k8s14:38
inc0that's the goal really14:38
sdakei think our approach should be "we want a native k8s solution but k8s doesn't have the featureset we need yet so we use ansible instead"14:38
inc0we need somethign for workflow14:38
inc0and deps14:38
sdakeinc0 right these are the gaps i was speaking of :)14:38
inc0and we need it now14:39
inc0question is where to put actual code14:39
sdakeagree with inc0 on that14:39
inc0and I'd say kolla-ansible14:39
sdake"we need it now"14:39
sbezverkinc0: I undersatnd workflow, sure but it should not mean if somebody else wants to use something else they need to reprogram certain features just because we moved them to ansible14:39
inc0since we need it anyway for config generation14:39
sdakesbezverk great point - so lets avoid that :)14:39
inc0what would they reprogram?14:40
inc0kolla-k8s will stay ansible-agnostic14:40
openstackgerritWaldemar Znoinski proposed openstack/kolla: install pxelinux for ironic_pxe  https://review.openstack.org/38035014:40
sbezverkinc0: your example myabe it is more theoretical14:40
inc0sbezverk, I think it is theoretical tbh, we need kolla-ansible today for configs14:41
inc0that's a fact14:41
sbezverkyou want to move keepalive to ansible and implement it there, if puppet people want to use keepalive , they will have to implement it in puppet14:41
inc0sbezverk, I'm not talking about keepalived now14:41
sbezverkwhere as if it is common functionality, they just need to call out kolla-kubernete4s cli to get it going14:41
inc0I'm talking about boostrap automation14:41
sbezverkkeepalived was just an example14:41
inc0sbezverk, but today we don't have this functionality in k8s14:41
openstackgerritWaldemar Znoinski proposed openstack/kolla: install pxelinux for ironic_pxe  https://review.openstack.org/38035014:42
sbezverkI wanted to use to illustrate the principle14:42
inc0sbezverk, I agree, just your way is not possible now;)14:42
sbezverkwhat can be done in kube, must be done in kube14:42
inc0ok, this thing can't be done in kube - config generation and dependencies14:42
inc0today14:42
sbezverkinc0: sorry what exactly is not possible?14:42
sbezverkinc0: sure sure,14:43
inc0sbezverk, dependency management, like first deploy mariadb, wait for it to start, then deploy nova14:43
inc0I'd say let's do this in kolla-ansible and move on until it has native k8s support14:43
inc0then we move to native k8s14:43
sbezverkinc0: that part is 100% clear, for that we need workflow, but for what else we would need ansible?14:43
inc0sbezverk, config generation14:44
inc0we use genconfig today14:44
*** tonanhngo has joined #openstack-kolla14:44
inc0in fact if we put our workflow to kolla ansible today14:44
inc0we can generate configs when needed as needed14:45
inc0no need for separate step14:45
sbezverkinc0: ok good it can still be considered as a part of workflow14:45
inc0yeah14:45
*** haplo37_ has quit IRC14:45
inc0and don't get me wrong, I consider this all a prothesis myself14:45
sbezverkinc0: we had and still having lots of difficulties with combined appraoch14:45
inc0but we need this to stand up14:45
*** lamt has joined #openstack-kolla14:45
inc0rhallisey, how about that? put it all into kolla-ansible for now14:46
*** SamYaple has quit IRC14:46
*** SamYaple has joined #openstack-kolla14:46
inc0I know you had issues with this approach14:46
sbezverkinc0: it seems things can be done more clean with separate approach14:46
inc0I doubt that tbh14:47
rhalliseyinc0, I was thinking we do that post summit14:47
rhalliseywant to split the repos14:47
rhalliseyand discuss it at summit14:47
inc0rhallisey, I'd want to showcase deployment on summit14:47
rhalliseyya I agree14:47
*** jtriley has joined #openstack-kolla14:47
rhalliseywe merge it in kolla-k8s14:47
*** salv-orlando has quit IRC14:47
rhalliseyand move it to kolla-ansible after discussion and repo split14:47
*** haplo37_ has joined #openstack-kolla14:48
inc0I'd start with kolla-ansible and move it out after discussion14:48
inc0as in, more tools there14:48
inc0already14:48
inc0configs and whatnot14:48
inc0variables, roles14:48
inc0more logical imho14:48
rhalliseythere is, but it will require more work to merge the two14:49
rhalliseyunless I make a new dir14:49
rhalliseykubernetes/ansible14:49
rhalliseyif I merge them together then I need logic to pick one or the other14:49
rhalliseysomething to think about14:50
inc0I don't think moving stuff around will be hard14:50
inc0anyway, let's get it running before summit14:50
rhalliseythat's my point about discussion though14:50
inc0we'll clean the house later14:50
rhalliseythere are multiple ways to do this14:50
inc0we have 3 weeks left, let's pick up the fastest:)14:50
rhalliseywould rather do the 'get it working part' and figure out the best way after14:50
sbezverkrhallisey +114:50
rhalliseythe code will be mostly re used anyway14:50
rhalliseyso it won't be a waste14:51
openstackgerritJeffrey Zhang proposed openstack/kolla: DO_NOT_MERGE: Use better URL for China  https://review.openstack.org/32906014:52
*** jtriley has quit IRC14:53
*** dave-mccowan has quit IRC14:57
*** huikang has quit IRC14:57
*** huikang has joined #openstack-kolla14:58
inc0rhallisey, btw you have some poc alrady?14:58
rhalliseyye14:58
rhalliseyinc0, sec I'll post an update in a minute14:58
rhalliseyit's not idea at the moment14:59
rhalliseyerrors are cryptic14:59
rhalliseybut we can iterate on that14:59
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032315:02
*** huikang has quit IRC15:02
*** v1k0d3n has joined #openstack-kolla15:08
*** jtriley has joined #openstack-kolla15:10
*** dave-mccowan has joined #openstack-kolla15:13
*** zhubingbing has quit IRC15:16
*** jtriley has quit IRC15:17
*** daneyon has joined #openstack-kolla15:19
*** eaguilar has quit IRC15:21
*** daneyon has quit IRC15:24
*** berendt has quit IRC15:24
*** huikang has joined #openstack-kolla15:24
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix rabbitmq bustage  https://review.openstack.org/37996015:26
*** b_bezak has quit IRC15:27
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix ironic failed  https://review.openstack.org/37910615:28
*** inc0 has quit IRC15:30
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Ansible support for Mariadb  https://review.openstack.org/33425515:30
*** inc0 has joined #openstack-kolla15:30
*** ldeptula has quit IRC15:30
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032315:31
*** jrich523 has quit IRC15:41
*** jrich523 has joined #openstack-kolla15:41
*** zhenguo has quit IRC15:43
*** huikang has quit IRC15:45
*** Serlex has quit IRC15:46
*** huikang has joined #openstack-kolla15:46
*** huikang has quit IRC15:50
*** eaguilar has joined #openstack-kolla15:52
*** matrohon has quit IRC15:52
kfox1111sorry I missed the converation.15:53
*** Pavo has quit IRC15:53
*** Pavo has joined #openstack-kolla15:54
inc0kfox1111, so after our yestedays discussion to keep ansible out of kolls-k8s15:54
inc0I figured that we can put workflow playbook into kolla-ansible15:55
kfox1111yeah.15:55
inc0and have kolla-ansible deploy-k8s15:55
kfox1111hmm... yeah. that would be a good place for it.15:55
inc0wouldn't need genconfig step as well15:55
kfox1111well, in fact,15:55
kfox1111the config already has knowlege of orchestration_engine,15:55
kfox1111so deploy could do raw if orchestration_engine=ANSIBLE and k8s stuff if =KUBERNETES15:56
kfox1111so wouldn't even need a diffrent command that way.15:56
inc0yeah, but what I mean is we can use config.yml from roles themselves15:56
*** caowei has quit IRC15:56
kfox1111so, tangengential topic there....15:56
openstackgerritAndrew Widdersheim proposed openstack/kolla: Remove redundant common play and add haproxy hosts  https://review.openstack.org/37652415:56
kfox1111I've been working with the theory of building things like:15:57
kfox1111kolla-kubernetes takes in two sets of configs, and through manual commands deploys stuff to k8s which further stands things up.15:58
*** zhenguo has joined #openstack-kolla15:59
kfox1111the two sets of configs are, 1. the openstack config files/config.json's and 2. config to kolla-kubernets for things like image naames, dvr enabled, etc.15:59
kfox1111most of those come from genconfig right now, or via ansible stuff built into kolla-kubernetes that parses out kolla-ansibles stuff..16:00
kfox1111the latter part not being a very clean seperation.16:00
*** inc0 has quit IRC16:01
kfox1111I'd kind of like to formalize the config a bit so that kolla-kubernetes expectations for config are well known, and rather flat. just yaml with no conditionals.16:01
*** inc0 has joined #openstack-kolla16:01
*** Satya_ has joined #openstack-kolla16:01
kfox1111kolla-ansible can do its amazing logic to generate the configs, flatten out its stuff, and drop the config/flattened yaml out in a place kolla-kubernetes can see it then.16:01
kfox1111That way, if other workflow/genconfig tools come about, they have a known target to hit.16:02
*** neilus has joined #openstack-kolla16:02
*** lamt has quit IRC16:02
kfox1111mostly the gap is the ansible/roles/f*/defaults/* stuff that kolla-kubernetes has to parse today.16:03
inc0kfox1111, btw https://docs.ansible.com/ansible/kubernetes_module.html16:03
kfox1111yeah. ryan's been using that I think. but it has a few gaps yet last I heard. :/16:03
kfox1111so I was thinking, maybe we want to do two changes.16:03
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032316:04
kfox11111. have kolla genconfig have a magic dir it reads from in addition to /etc/kolla/globals.yml, but have a /etc/kolla/globals.d that is loads all of the files under and automatically merges.16:04
kfox1111thist would make it easy for kolla-kubernetes to throw in some of its own defaults easily by just dropping in a file in /etc/kolla/globals.d/00-kolla-kubernetes.yml16:05
rhalliseyinc0, the module isn't complete16:05
kfox1111second, genconfig would flatten out all the role default yamls into regular old yaml files under something like /etc/kolla/rendered/<servicename>/config.yaml or something.16:05
rhalliseyI have a patch to complete, but ansible community hasn't review it in like 4 months16:06
kfox1111then kolla-kubernetes could read all the values without having to use ansible to import the roles.16:06
*** neilus has quit IRC16:07
rhalliseykfox1111, I think that all exists16:07
rhalliseykolla is setup to handle it16:07
rhalliseyI added a patch a while back to specify a project_name16:07
rhalliseyif you do kolla-kuberentes then configs will be in /etc/kolla-kubernetes/*16:08
kfox1111rhallisey: which part are tyou talking about? thing one or thing 2?16:08
rhallisey116:08
rhalliseyand 216:08
rhalliseywell not so much 216:08
rhalliseybut in the ball park16:08
kfox1111oh. so you have a way to change the path... yeah, that would be really cool.16:09
rhalliseyservice_resources &  kolla-kubernetes need to be distributed16:09
kfox1111that would be really useful too for multiregion for example.16:09
rhalliseyamong <serivce>/default/main.yaml and ansible/all.yaml16:09
kfox1111I started to talk with sbezverk about this... I think service_resources is more of an internal struture then a config file.16:10
rhalliseyya that should all be defaulted16:10
rhalliseyand hidden away16:10
kfox1111yeah.16:10
rhalliseywith some bits to expose pieces of it16:10
*** jtriley has joined #openstack-kolla16:10
rhalliseykolla-kubernetes would become the 'all.yaml' in anisble16:11
kfox1111yeah. I think the kollakube map command exposes it as much as an op might need.16:11
kfox1111-1.16:11
kfox1111kolla-kubernetes.yml is the config file for kolla-kubernetes. there are some things that need to be there.16:11
rhalliseythen there would be a globals.yaml on top16:11
*** awidders_ has joined #openstack-kolla16:11
kfox1111in the ansible workflow then, I think,16:11
rhalliseyyes I agree, most of it will be exposed16:11
kfox1111kolla-ansible builds kolla-kubernetes.yml.16:11
rhalliseypossible all16:11
rhalliseybut some of that stuff should be defaulted16:11
rhalliseylike which services are enabled16:12
kfox1111so if you want to use the workflow, it manages it. but if you want to roll your own, you have control of it.16:12
rhalliseyonly thing though16:12
rhalliseythe cli can't be completly tied into anisble16:12
*** awiddersheim has quit IRC16:12
rhalliseyit needs to be =16:12
rhalliseyneed to have easy consumption procedure16:12
kfox1111yeah, which is why I think kolla-kubernetes.yml needs to exist outside of ansible.16:12
rhalliseyit will16:12
rhalliseybut there will be a copy of it as all.yaml16:13
*** awidders_ has quit IRC16:13
rhalliseyfor default16:13
rhalliseys16:13
kfox1111what format is all.yaml? regular yaml or ansible?16:13
rhalliseyregular yaml16:13
kfox1111ah. k.16:13
*** awiddersheim has joined #openstack-kolla16:13
kfox1111yeah, I think we're on the same page then.16:13
rhalliseyexact same format as kolla-kubernetes.yaml is now16:13
rhalliseyyup16:13
kfox1111so, we ship an all.yaml (defaults.yaml ? :) not in /etc/kolla-kukbernetes, /usr/share/kolla-kubernetes maybe and include that first,16:14
kfox1111then include /etc/kolla-kubernetes/kola-kubernetes.yml over it?16:14
kfox1111(we probably shoudl rename kolla-kubernetes.yml too while were at it)16:14
*** huikang has joined #openstack-kolla16:15
kfox1111/etc/kolla-kubernetes/config.d/* ? :)16:15
kfox1111kolla-ansible can drop bits in there then.16:15
*** awiddersheim has quit IRC16:16
*** awiddersheim has joined #openstack-kolla16:16
sbezverkkfox1111: +1 for config.d16:16
Satya_I am getting the below error while using master branch code16:16
Satya_TASK [keystone : Creating admin project, user, role, service, and endpoint] **** task path: /usr/share/kolla/ansible/roles/keystone/tasks/register.yml:2 <slcan665> ESTABLISH SSH CONNECTION FOR USER: kolla <slcan665> SSH: EXEC ssh -C -q -o ControlMaster=auto -o ControlPersist=60s -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=16:16
Satya_fatal: [slcan665]: FAILED! => {"failed": true, "msg": "ERROR! The conditional check '{{ (keystone_bootstrap.stdout | from_json).changed }}' failed. The error was: Expecting ',' delimiter: line 1 column 220 (char 219)"}16:16
kfox1111ok. so maybe we come up with a plan for seperating all these config bits out, and do a few ps's that move us there.16:17
Satya_is anyone facing similar issue?16:17
rhalliseykfox1111, pre summit, let get this working for a demo16:18
rhalliseykfox1111, then discuss what we talked about at summit16:18
rhalliseyI'll write up a step by step plan16:18
kfox1111I'd love to see the remaining ansible parsing move out to kolla-ansible, but thats unlikely for a while if we still want to target 3.0 for stability while the ansible repos get shuffled around.16:18
rhalliseythen post summit we can distrubute the work16:18
kfox1111we could seperate the ansible stuff into its own cli command for now though, generate the configs like we mentioned above and then havethe main kubecli tool consume those. then merge the first tool into kolla-ansible when ready.16:19
kfox1111yeah, true.16:19
*** awiddersheim has quit IRC16:19
kfox1111sounds like a plan.16:19
rhalliseygood stuff16:19
*** awiddersheim has joined #openstack-kolla16:19
kfox1111lets shoot for having the doc before the summit though.16:20
rhalliseyagreed16:20
kfox1111that way, we can tell people, yeah, this is a little suboptomal, but look, here's our plan to fix it.16:20
kfox1111"see, nice and clean" :)16:21
rhalliseyhttps://etherpad.openstack.org/p/kolla-kubernetes-ocata-roadmap16:21
kfox1111ah. cool.16:21
*** awiddersheim has quit IRC16:22
*** awiddersheim has joined #openstack-kolla16:22
*** jtriley has quit IRC16:23
*** awiddersheim has quit IRC16:25
*** shardy has quit IRC16:28
rhalliseykfox1111, good start16:29
kfox1111yeah.16:29
*** awiddersheim has joined #openstack-kolla16:29
*** huikang has quit IRC16:30
*** huikang has joined #openstack-kolla16:31
*** huikang has quit IRC16:35
*** neilus__ has joined #openstack-kolla16:37
*** huikang has joined #openstack-kolla16:40
*** gfhellma has joined #openstack-kolla16:40
*** neilus__ has quit IRC16:42
*** lrensing has quit IRC16:44
*** srwilkers has quit IRC16:44
inc0ehh kargo isn't perfect playbook16:53
inc0I'll keep fixed version locally16:53
*** eaguilar_ has joined #openstack-kolla16:59
*** eaguilar has quit IRC16:59
*** tonanhngo_ has joined #openstack-kolla17:00
*** tonanhngo has quit IRC17:00
*** huikang has quit IRC17:02
inc0rhallisey, in case you'd like to try https://github.com/inc0/kargo/blob/master/run_kargo.sh17:02
*** huikang has joined #openstack-kolla17:02
rhalliseyworking for you?17:03
*** jtriley has joined #openstack-kolla17:03
inc0kinda yeah17:03
inc0still making tweaks here and there17:03
*** huikang has quit IRC17:07
*** jtriley has quit IRC17:13
*** jtriley has joined #openstack-kolla17:17
*** inc0 has quit IRC17:19
*** salv-orlando has joined #openstack-kolla17:19
*** inc0 has joined #openstack-kolla17:19
*** jrich523 has quit IRC17:19
*** unicell has quit IRC17:20
*** jheroux has quit IRC17:21
*** unicell has joined #openstack-kolla17:21
*** salv-orlando has quit IRC17:21
*** salv-orlando has joined #openstack-kolla17:22
*** absubram has joined #openstack-kolla17:26
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805617:26
*** jrich523 has joined #openstack-kolla17:27
*** Satya_ has quit IRC17:41
*** neilus has joined #openstack-kolla17:42
*** neilus has quit IRC17:46
*** jrich523 has quit IRC17:46
*** jrich523 has joined #openstack-kolla17:48
*** srwilkers has joined #openstack-kolla17:49
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032317:52
*** Pavo has quit IRC17:54
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805617:55
*** Pavo has joined #openstack-kolla17:55
*** eaguilar_ has quit IRC17:57
*** eaguilar has joined #openstack-kolla17:59
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805618:09
*** lrensing has joined #openstack-kolla18:13
*** huikang has joined #openstack-kolla18:14
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805618:21
*** bmace_ has quit IRC18:21
*** bmace_ has joined #openstack-kolla18:22
*** zhenguo has quit IRC18:23
*** srwilkers has quit IRC18:28
inc0kfox1111, rhallisey sbezverk to run kolla-k8s I just need kubectl to point me to k8s cluster right?18:30
rhalliseyya18:30
inc0btw I just deployed k8s cluster on 5 fresh vms with kargo, will push changes to my github in a sec18:30
inc0(hacky but works)18:30
*** nhlfr has joined #openstack-kolla18:33
*** imcsk8 has quit IRC18:34
*** nhlfr has quit IRC18:34
*** nihilifer has joined #openstack-kolla18:37
*** nihilifer has joined #openstack-kolla18:38
*** lamt has joined #openstack-kolla18:44
*** huikang has quit IRC18:46
*** huikang has joined #openstack-kolla18:46
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805618:47
*** salv-orlando has quit IRC18:50
*** huikang has quit IRC18:51
*** aswadr_ has quit IRC18:52
*** srwilkers has joined #openstack-kolla18:53
inc0guys I need k8s coaching:P18:53
inc0I can access my k8s locally over 127.0.0.1:8080 but I have no idea how to access it from different node18:53
*** lrensing has quit IRC18:55
*** daneyon has joined #openstack-kolla18:55
*** mliima has quit IRC18:55
*** mark-casey1 has joined #openstack-kolla18:57
*** daneyon has quit IRC19:00
*** kbyrne has quit IRC19:01
*** neilus has joined #openstack-kolla19:02
*** huikang has joined #openstack-kolla19:02
*** kbyrne has joined #openstack-kolla19:06
*** neilus has quit IRC19:07
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032319:08
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805619:14
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032319:15
*** openstackgerrit has quit IRC19:18
*** openstackgerrit has joined #openstack-kolla19:18
MarMatsdake that ugly rabbit 3.6.5 is not working for me, rabbitmq-server dies on startup19:22
*** eaguilar has quit IRC19:24
*** dwalsh has quit IRC19:25
*** msimonin has joined #openstack-kolla19:27
*** dwalsh has joined #openstack-kolla19:27
*** eaguilar has joined #openstack-kolla19:28
*** msimonin has quit IRC19:28
*** srwilkers has quit IRC19:33
*** msimonin has joined #openstack-kolla19:33
*** dwalsh has quit IRC19:35
*** dwalsh has joined #openstack-kolla19:36
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805619:43
sdakemarmat huh?19:45
sdakemarmat here is the deal19:45
sdakei've got alot on my plate for today - and would love to help debug that issue and think its critical if its failing to start19:45
sdakecritical in the most critical sense of the meaning19:45
sdakemarmat I will be around tomorrow - maybe i will get a chance to dig itno it if nobody else does19:45
sdakei expect if its blocking you its blocking everyone19:45
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032319:46
sdakeif anyone has some spare cycles to sort out the rabbitm 3.6.5 mess that the centos cloud sig has created, would be greatly appreciated19:46
dmsimardsdake: explain ?19:48
dmsimardthe cloud sig is essentially RDO :)19:48
dmsimardwhat's going on ?19:48
*** gfhellma1 has joined #openstack-kolla19:49
sdakedmsimard not clear what the issue marmat is suffering from19:50
sdakedmsimard in essence we were stable on 3.6.219:50
sdakedmsimard we are not stable on 3.6.519:50
sdakei dont know if this is our fault or packaging fault or what19:50
dmsimardI've seen some people chase us down in regards to a rabbitmq/erlang update so that might be related19:51
sdakedmsimard i dont have time to look into it today - my personal life is falling behind and the grass has grown as long as it can19:51
dmsimardI can look if there is something in the pipe but without details I can't do much19:51
*** gfhellma has quit IRC19:51
sdakeMarMat have any details?19:51
sdakedmsimard one thing to keep in mind is we use a plugin called clusterer19:51
sdakedmsimard this is what makes rabbitmq work correctly in a clustered environment19:52
*** huikang has quit IRC19:52
sdakedmsimard there may be a possible incompatibility there although the y streams of plugins abi are supposed to be frozen19:52
*** huikang has joined #openstack-kolla19:52
sdakedmsimard do yo uhave any reference to any erlang update or whwatnot19:53
sdakei get the need to move to the latest z stream19:53
sdakebut not if it doesn't work ;)19:53
*** Pavo has quit IRC19:54
*** Pavo has joined #openstack-kolla19:54
dmsimardafaict 3.6.5 has been pushed out on sept 219:54
*** huikang has quit IRC19:57
* kfox1111 crosses his fingers20:04
kfox1111this gate check looks like it might be the one. :)20:04
*** gfhellma has joined #openstack-kolla20:05
*** gfhellma1 has quit IRC20:05
*** salv-orlando has joined #openstack-kolla20:09
dmsimardsdake: yeah I don't know man -- the latest update around rabbitmq goes back to sept 2nd and that's to 3.6.520:11
*** eaguilar has quit IRC20:11
dmsimardRDO CI has no issues with it afaik20:11
sdakedmsimard roger20:12
sdakedmsimard our gate has been using 3.6.2 since yesterday20:12
sdakeso the fact that it was pushed out on sept 220:12
sdakedidn't hit the cloud sig repos until yesterday20:12
sdakenow our gate is using 3.6.5 and its bustola20:13
dmsimardsdake: do you use the -infra repos or buildlogs directly ?20:13
sdakedmsimard i am not sure what the delta is, but i think we use buildlogs20:14
sdakebuildlogs rings a bell20:14
sdakeinfra has no mirroring of those repos atm20:14
*** salv-orlando has quit IRC20:14
dmsimardaye, I believe infra only mirrors stable releases20:14
sdakedmsimard infra hasn't set a policy on that20:14
dmsimardperhaps, but that's what they do right now20:15
sdakedmsimard the issue is only pbalenger is the only cat who knows how to make mirrors20:15
* dmsimard shrugs20:15
sdakedmsimard and he hasn't trained anyone yet - so no new mirrors have been added :)20:15
MarMatsdake just came from lunch, going to continue to work on the rabbit20:15
sdakeso infra mirroring isn't happening in this scenario20:15
dmsimardsdake: right20:15
sdakeMarMat do you have any data for dmsimard20:15
MarMatsdake not so far, no any logs, looking for some20:16
dmsimardMarMat: We have successful jobs in RDO CI running rabbitmq-server-3.6.5-1.el7.noarch20:17
dmsimardAlthough, like I mentioned, I do not believe we have an implementation with the cluster plugin.20:17
MarMatneed to take some time to look for symptoms20:19
*** salv-orlando has joined #openstack-kolla20:19
*** tonanhngo has joined #openstack-kolla20:20
*** tonanhngo_ has quit IRC20:22
*** dave-mccowan has quit IRC20:23
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Ansible support for Mariadb  https://review.openstack.org/33425520:24
*** eaguilar has joined #openstack-kolla20:26
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Ansible support for Mariadb  https://review.openstack.org/33425520:29
*** jtriley has quit IRC20:30
*** Jeffrey4l_ has quit IRC20:35
openstackgerritnarasimha18sv proposed openstack/kolla: Enable CADF events in Keystone  https://review.openstack.org/38064120:37
MarMatdsimard ping20:37
MarMatdmsimard ^^^20:37
dmsimardMarMat: yeah ?20:37
MarMatare you the rabbit expert to help me find more symtoms/root cause?20:39
*** absubram has quit IRC20:40
kfox1111YAY! http://logs.openstack.org/56/378056/72/experimental/gate-kolla-kubernetes-deploy-ubuntu-source-nv/7a230c4/console.html :)20:40
rhalliseykfox1111, woo20:40
*** inc0 has quit IRC20:41
dmsimardMarMat: I'm not a rabbit expert at all but I'm a RDO maintainer so if there is a problem with packaging, I can help or find someone that can.20:41
*** inc0 has joined #openstack-kolla20:41
MarMatdmsimard np I found it20:42
*** daneyon has joined #openstack-kolla20:43
*** amuller has joined #openstack-kolla20:44
amullerhi there20:44
inc0o/20:44
MarMatsdake https://github.com/openstack/kolla/blob/789f50b2f3bc733015d11287054b63db7c01c03a/ansible/group_vars/all.yml#L30920:44
amullerduring the deploy command, it seems stuck on TASK [keystone : Creating admin project, user, role, service, and endpoint] ****20:44
amullerany hints?20:44
MarMatamuller yes, thats the rabbit issue20:45
inc0amuller, networking issue most likely20:45
MarMatinc0 nope20:45
inc0MarMat, no, ks doesn't use rabbitmq20:45
inc0MarMat, speaking of rabbimq, what seems to be an issue?20:45
MarMatinc0 https://github.com/openstack/kolla/blob/789f50b2f3bc733015d11287054b63db7c01c03a/ansible/group_vars/all.yml#L30920:45
amullerside note: I'm trying kolla from master, I want to deploy *only* neutron, so I disabled keystone, but then it failed to start the heka_bootstrap container because of a missing file related to keystone. Once I enabled keystone it got past that stage.20:46
inc0amuller, you need some keystone:)20:46
MarMatinc0 bump to rabbit 3.6.5 in delorean20:46
inc0duh20:47
*** huikang has joined #openstack-kolla20:47
inc0I run ubuntu, that's why it's working for me20:47
amullerthis also on an ubuntu VM, base image ubuntu also20:47
*** eaguilar has quit IRC20:47
amullerrabbitmq 3.5.7, ubuntu xenial20:48
inc0amuller, you should be able to disable keystone, but people don't really test it this way;)20:48
*** daneyon has quit IRC20:48
inc0can you show me your inventory?20:48
amulleryeah I figured no one else tried to run it this way20:48
amullerinc0: can you be more specific? =D ansible and docker noob here, winging it as I go20:48
inc0what command did you use?20:49
inc0to deploy?20:49
amullerhmm, it seems to have gone past the keystone issue20:49
amullerdefault20:49
inc0just kolla-ansible deploy?20:49
inc0ok so it's all on localhost20:49
amulleryes20:49
inc0show me "docker ps"20:49
amullerdamn, now Waiting the openvswitch_db service to be ready is failing20:49
inc0docker ps;)20:50
amullerhttp://paste.openstack.org/show/583678/20:50
inc0docker logs openvswitch_db20:50
amullerheh /usr/local/bin/kolla_start: line 24: exec: start-ovsdb-server: not found20:51
amullerthat doesn't look right =p20:51
inc0yup20:51
inc0did you build your images?20:51
amullerhmm, only neutron and keystone now that I think about it20:52
inc0yeah...:)20:52
inc0try to build openvswitch and rabbitmq too20:52
amullerI guess I should have run a full kolla-build20:52
inc0or full build20:52
amullerok20:53
amuller will do20:53
amullerinc0++20:53
inc0safest bet;)20:53
inc0MarMat, so deloeran has 3.6.5?20:53
inc0I think we bumper version of rabbimq lately20:53
*** neilus has joined #openstack-kolla20:53
amullertoying with the idea of using kolla for neutron ci20:54
MarMatinc0 as far as I say they have both 3.6.2 and 3.6.5, yum probably takes the newer one20:54
rhalliseyamuller, oh neat :)20:54
amullerI can run multiple instances of say, ovs-agent, l3-agent, dhcp-agent on localhost right?20:55
amullerto simulate multi-node neutron20:55
inc0amuller, nope:(20:55
amulleroy20:55
amullerok, there goes that idea =p20:55
inc0we run net=host20:55
inc0we don't separate networking stack20:55
inc0while we could probably play around different services20:56
inc0neutron is particulary bad because of network namespaces;)20:56
amullerright20:56
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805620:56
inc0you could try to run docker container and in that docker container run kolla20:56
inc0docker in docker20:56
inc0but I don't have faintest idea what will happen to network namespaces20:57
inc0this is where containers doesn't behave like vms;)20:57
rhalliseyya we haven't had a need to not use net=host20:57
amullerthe end goal is to rewrite http://docs.openstack.org/developer/neutron/devref/development.environment.html#fullstack-tests20:57
amullerright now we have a test infra that starts up processes on localhost20:58
amullerso we can start multiple copies of neutron-openvswitch-agent for example20:58
*** neilus has quit IRC20:58
amullerwe'd like better isolation20:58
amullercontainers..20:58
amullerbecause containers can solve any problem20:58
amullerso I've been promised :)20:58
rhalliseyhehe20:58
amullerI think it's still worth investigating20:59
amullerwe might be able to work something out networking wise20:59
rhalliseyamuller, it would be interesting.  Up to this point we haven't had a need for it20:59
rhalliseybut that doesn't mean it's not possible21:00
inc0so low lever networking stack is where things become interesting21:00
inc0it's like putting network namespaces into network namespaces21:00
inc0what can go wrong?21:00
*** dwalsh has quit IRC21:00
inc0ok..docker in docker probably will fail too21:01
rhalliseyamuller, should bring up the idea at summit21:01
rhalliseywould be worth a spec21:02
MarMatsdake confirmed, changing ansible's rabbitmq_version cures the issue21:02
amulleryeah I'm in such a beginner stage I don't know what I don't know21:02
amullerstill building the images =p21:02
*** huikang has quit IRC21:02
*** huikang has joined #openstack-kolla21:03
inc0MarMat, let's hope it wont break ubuntu21:05
inc0anyway it should show up in gates21:06
MarMatdo gates build use docker build cache?21:06
*** huikang has quit IRC21:07
inc0no21:08
inc0every gate run is fresh vm21:08
MarMatinc0 I'd guess it will fail on any distro with rabbitmq version != 3.6.221:13
*** neilus has joined #openstack-kolla21:13
inc0issue is, fact that delorean removed 3.6.2 doesn't mean that uca has it21:16
inc0can you push patch up? gates should pick that up21:16
dmsimardMarMat, inc0: Need details, really, please. Saying that 3.6.5 doesn't work isn't helpful when we are unable to reproduce the issue in RDO CI. Have you tried without the clustering plugin to see if it is part of the issue ?21:17
dmsimardRDO doesn't do any arcane magic around rabbitmq/erlang, we just rebuild21:17
MarMatdmsimard be cool, the problem is in kolla, rabbitmq is fine21:17
dmsimardMarMat: ok, not trying to be rude, just need to have more information to troubleshoot if the issue is on our end21:18
MarMatdmsimard fine, no problem :-)21:18
dmsimardinc0: ^ this is part of the reason why I want Kolla integrated in RDO CI :)21:19
*** tonanhngo has quit IRC21:19
*** sdake has quit IRC21:19
MarMatinc0 patch is in progress https://review.openstack.org/#/c/379960 I'll try to patch the patch.21:22
inc0ok, gates are green on this one21:23
*** sdake has joined #openstack-kolla21:25
sdakeMarMat the problem is in kolla how21:26
sdakeMarMat could you please expand21:26
sdakedmsimard imo ci coverage is one of kolla's biggest issues21:26
MarMatsdake see my comment https://review.openstack.org/#/c/37996021:26
sdakemarmat i dont expect we will be on 3.7 any time soon21:27
sdakeatleast on rdo21:28
MarMatsdake not this one21:28
sdakerdo unlikely to change to 3.7 in stable branches21:28
MarMatsdake the last one. There is additional rabbit version hardcoding https://github.com/openstack/kolla/blob/789f50b2f3bc733015d11287054b63db7c01c03a/ansible/group_vars/all.yml#L30921:28
sdakeya21:29
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Ansible support for Mariadb  https://review.openstack.org/33425521:29
sdakei knew that woudl be trouble21:29
sdakebut needed  for kubernetes so +2'ed it21:29
*** Pavo has quit IRC21:29
sdakemarmat thanks for sorting that out21:29
sdakedmsimard - looks like problem on our end - didn't mean to offend, have alot going on today21:29
MarMatsdake that +2 paid off :-)21:29
sdakedmsimard working on getting my personal life in order (getting cars serviced, detailed, getting back yard landscaped, etc)21:30
sdakedmsimard spending alot of moeny all at once makes me grumpy :)21:30
sdakedmsimard sorry if you feel like i took it out on you21:30
MarMatsdake should I take fix of https://review.openstack.org/#/c/379960 ?21:32
sdakejust picked up jeep21:32
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805621:32
sdakemarmat passing gate, what is issue wit hthat resolution?21:33
sdakemarmat another option is to pull down that patch and coauthor with the other hardcode fix21:33
*** amuller has quit IRC21:33
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805621:34
MarMatsdake rabbitmq has then wrong path for clusterer plugin21:34
sdakemarmat yes i know21:34
dmsimardsdake: np, I'm happy to help if it's something I can help with, just need info :)21:34
sdakei said above i kne wthat patch would be trouble :)21:34
dmsimardfeel free to ping anytime, you know21:34
sdakedmsimard problem on our end21:34
sdakemarmat frustrated i think that we have gone from 3.5 to 3.62 to 3.6.5 in like 2 weeks :)21:35
sdakewe went from 3.5 because it wasn't the rdo version21:35
sdakeand the erlang deps in 3.5 are afu21:35
sdake3.6.5 is a natural upstream change we have to adapt to21:36
sdakeMarMat the patch that would be trobule is that hardcode patch that sbezverk added to make kubernetes roll21:36
*** v1k0d3n has quit IRC21:36
*** neilus has quit IRC21:38
*** neilus has joined #openstack-kolla21:39
MarMatis it possible to see build logs in the gate checks? I can't find that...21:40
*** sdake has quit IRC21:45
*** sdake has joined #openstack-kolla21:46
sdake marmat after the job finishes yes21:48
sdakeMarMat while the job is running yes as well as long as it isn't finished21:49
sdakezuul.openstack.org MarMat ^^21:49
*** alwaysatthenoc has joined #openstack-kolla21:53
*** mark-casey1 has quit IRC21:53
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805621:53
*** sdake has quit IRC21:59
*** schwicht has quit IRC21:59
*** huikang has joined #openstack-kolla22:02
*** neilus has quit IRC22:02
*** msimonin has quit IRC22:04
*** msimonin has joined #openstack-kolla22:04
MarMatsdake I'm a bit confused... can I see logs of image builds checks of that PS https://review.openstack.org/#/c/379960 ?22:06
*** neilus has joined #openstack-kolla22:06
*** huikang has quit IRC22:06
*** huikang has joined #openstack-kolla22:09
*** alwaysatthenoc has quit IRC22:13
*** inc0 has quit IRC22:13
*** neilus__ has joined #openstack-kolla22:13
*** neilus has quit IRC22:14
*** tonanhngo has joined #openstack-kolla22:17
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032322:20
*** neilus__ has quit IRC22:20
*** schwicht has joined #openstack-kolla22:21
*** huikang has quit IRC22:21
*** huikang has joined #openstack-kolla22:22
*** msimonin has quit IRC22:24
*** huikang has quit IRC22:26
*** schwicht has quit IRC22:32
*** daneyon has joined #openstack-kolla22:32
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032322:33
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805622:33
*** daneyon has quit IRC22:37
*** schwicht has joined #openstack-kolla22:40
openstackgerritMerged openstack/kolla-kubernetes: Adding keepalived functionality to kolla-kubernetes  https://review.openstack.org/38032322:43
*** schwicht has quit IRC22:53
*** salv-orlando has quit IRC22:58
*** JoseMello has quit IRC23:11
*** salv-orlando has joined #openstack-kolla23:16
*** Pavo has joined #openstack-kolla23:17
*** schwicht has joined #openstack-kolla23:24
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Test setting up the gate  https://review.openstack.org/37805623:25
*** sdake has joined #openstack-kolla23:29
*** Pavo has quit IRC23:31
*** huikang has joined #openstack-kolla23:31
*** Pavo has joined #openstack-kolla23:39
*** neilus has joined #openstack-kolla23:40
*** neilus has quit IRC23:41
*** neilus has joined #openstack-kolla23:44
*** gfhellma has quit IRC23:46
*** salv-orlando has quit IRC23:48
*** huikang has quit IRC23:50
*** huikang has joined #openstack-kolla23:50
*** absubram has joined #openstack-kolla23:54
*** huikang_ has joined #openstack-kolla23:54
*** huikang has quit IRC23:55
*** neilus has quit IRC23:57
*** eaguilar has joined #openstack-kolla23:57
*** neilus has joined #openstack-kolla23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!