| *** jgriffith is now known as jgriffith_away | 00:04 | |
| *** liyifeng has quit IRC | 00:07 | |
| *** tonanhngo has joined #openstack-kolla | 00:12 | |
| *** sdake_ has quit IRC | 00:13 | |
| *** tonanhngo has quit IRC | 00:13 | |
| *** Marcellin__ has quit IRC | 00:27 | |
| *** yingjun has joined #openstack-kolla | 00:28 | |
| *** tonanhngo has joined #openstack-kolla | 00:32 | |
| *** tonanhngo has quit IRC | 00:33 | |
| *** ssurana has quit IRC | 00:37 | |
| *** haplo37 has quit IRC | 00:41 | |
| *** g3ek has quit IRC | 00:41 | |
| *** tonanhngo has joined #openstack-kolla | 00:44 | |
| *** yingjun has quit IRC | 00:45 | |
| *** tonanhngo has quit IRC | 00:45 | |
| *** portdirect has left #openstack-kolla | 00:46 | |
| *** sdake has joined #openstack-kolla | 00:47 | |
| sdake | yo peeps | 00:48 |
|---|---|---|
| *** haplo37 has joined #openstack-kolla | 00:48 | |
| *** g3ek has joined #openstack-kolla | 00:48 | |
| *** yingjun has joined #openstack-kolla | 00:50 | |
| *** tovin07 has joined #openstack-kolla | 00:52 | |
| *** awidders_ has joined #openstack-kolla | 00:53 | |
| *** awiddersheim has quit IRC | 00:53 | |
| *** HyperJohnGraham_ has joined #openstack-kolla | 00:53 | |
| *** zhubingbing has joined #openstack-kolla | 00:54 | |
| *** tonanhngo has joined #openstack-kolla | 00:56 | |
| *** duonghq has joined #openstack-kolla | 00:57 | |
| *** tonanhngo has quit IRC | 00:57 | |
| *** duonghq has quit IRC | 00:57 | |
| *** duonghq has joined #openstack-kolla | 00:58 | |
| duonghq | morning | 00:58 |
| *** asalkeld has quit IRC | 01:02 | |
| *** duonghq has quit IRC | 01:03 | |
| openstackgerrit | zhubingbing proposed openstack/kolla: add influxdb log in heka https://review.openstack.org/384257 | 01:08 |
| zhubingbing | moring | 01:08 |
| zhubingbing | duonghq | 01:08 |
| openstackgerrit | zhubingbing proposed openstack/kolla: add os_gnocchi_apache_log.lua in heka container https://review.openstack.org/384599 | 01:10 |
| openstackgerrit | zhubingbing proposed openstack/kolla: add aodh os_aodh_apache_log.lua in heka containers https://review.openstack.org/384602 | 01:12 |
| zhubingbing | ping Vikram Hosakote | 01:12 |
| *** tonanhngo has joined #openstack-kolla | 01:13 | |
| *** zhurong has joined #openstack-kolla | 01:14 | |
| *** tonanhngo has quit IRC | 01:14 | |
| *** duonghq has joined #openstack-kolla | 01:16 | |
| *** MarMat has quit IRC | 01:17 | |
| sdake | zhubingbing his nick is vhosakot | 01:20 |
| sdake | zhubingbing but he isn'there atm | 01:20 |
| *** mgoddard has joined #openstack-kolla | 01:20 | |
| *** Jeffrey4l has joined #openstack-kolla | 01:21 | |
| *** Jeffrey4l has quit IRC | 01:22 | |
| *** salv-orlando has joined #openstack-kolla | 01:23 | |
| *** Jeffrey4l has joined #openstack-kolla | 01:23 | |
| zhubingbing | ok thanks sdake | 01:24 |
| *** Jeffrey4l has quit IRC | 01:24 | |
| *** Jeffrey4l has joined #openstack-kolla | 01:25 | |
| *** Jeffrey4l has quit IRC | 01:26 | |
| *** Jeffrey4l has joined #openstack-kolla | 01:26 | |
| *** salv-orlando has quit IRC | 01:27 | |
| zhubingbing | sdake | 01:30 |
| zhubingbing | can u reivew | 01:30 |
| zhubingbing | it ？ | 01:30 |
| zhubingbing | https://review.openstack.org/#/c/384599/ | 01:30 |
| zhubingbing | －）； | 01:30 |
| *** sdake has quit IRC | 01:31 | |
| *** tonanhngo has joined #openstack-kolla | 01:32 | |
| *** tonanhngo has quit IRC | 01:35 | |
| *** williamcaban has joined #openstack-kolla | 01:37 | |
| openstackgerrit | Merged openstack/kolla: remove extra blank lines https://review.openstack.org/384612 | 01:37 |
| *** mgoddard has quit IRC | 01:38 | |
| openstackgerrit | gecong proposed openstack/kolla-kubernetes: Remove white space between print and () https://review.openstack.org/384761 | 01:40 |
| *** caowei has joined #openstack-kolla | 01:43 | |
| *** tonanhngo has joined #openstack-kolla | 01:43 | |
| *** tonanhngo has quit IRC | 01:45 | |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Add missing uwsgi for barbican-api Dockerfile https://review.openstack.org/384763 | 01:52 |
| *** Jeffrey4l_ has joined #openstack-kolla | 01:54 | |
| *** Jeffrey4l has quit IRC | 01:57 | |
| *** williamcaban has quit IRC | 01:59 | |
| *** dave-mccowan has quit IRC | 01:59 | |
| *** unicell has quit IRC | 02:01 | |
| *** tonanhngo has joined #openstack-kolla | 02:02 | |
| *** tonanhngo has quit IRC | 02:03 | |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Fix 'Address already in use' for barbican-api https://review.openstack.org/384771 | 02:06 |
| *** sdake has joined #openstack-kolla | 02:07 | |
| *** sdake has quit IRC | 02:07 | |
| *** sdake has joined #openstack-kolla | 02:07 | |
| *** williamcaban has joined #openstack-kolla | 02:09 | |
| sdake | sup peeps | 02:09 |
| *** sdake has quit IRC | 02:09 | |
| *** williamcaban has quit IRC | 02:09 | |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Enable keystone authentication for Barbican https://review.openstack.org/384161 | 02:09 |
| *** williamcaban has joined #openstack-kolla | 02:10 | |
| *** sdake has joined #openstack-kolla | 02:12 | |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Enable keystone authentication for Barbican https://review.openstack.org/384161 | 02:13 |
| *** MarMat has joined #openstack-kolla | 02:14 | |
| *** rkrum has joined #openstack-kolla | 02:15 | |
| *** Liuqing has joined #openstack-kolla | 02:15 | |
| zhubingbing | sdake http://logs.openstack.org/99/384599/2/check/gate-kolla-docs-ubuntu-xenial/8f60d32/console.html#_2016-10-11_01_11_11_462082 | 02:21 |
| sdake | zhubingbing yes? | 02:21 |
| sdake | you think test should not be there? | 02:21 |
| zhubingbing | no | 02:22 |
| sdake | i dont have an ubuntu system | 02:22 |
| sdake | so I don't know the name of the libffi dependency | 02:22 |
| zhubingbing | http://logs.openstack.org/99/384599/2/check/gate-kolla-docs-ubuntu-xenial/8f60d32/console.html#_2016-10-11_01_11_11_222926 | 02:22 |
| *** tonanhngo has joined #openstack-kolla | 02:22 | |
| zhubingbing | this network proble | 02:22 |
| zhubingbing | prolem | 02:23 |
| *** tonanhngo has quit IRC | 02:23 | |
| sdake | zhubingbing is it blocking a gate | 02:23 |
| sdake | or just causing a warning | 02:23 |
| *** salv-orlando has joined #openstack-kolla | 02:24 | |
| sdake | zhubingbing run a recheck on those jobs | 02:26 |
| sdake | osic1 was upgraded | 02:26 |
| zhubingbing | ok | 02:27 |
| zhubingbing | root@ip-172-31-22-78:~# apt-get install libffi-dev | 02:27 |
| zhubingbing | Reading package lists... Done | 02:27 |
| zhubingbing | Building dependency tree | 02:27 |
| zhubingbing | Reading state information... Done | 02:27 |
| zhubingbing | libffi-dev is already the newest version. | 02:27 |
| zhubingbing | 0 upgraded, 0 newly installed, 0 to remove and 122 not upgraded. | 02:27 |
| zhubingbing | i test is passed~~ | 02:27 |
| *** salv-orlando has quit IRC | 02:28 | |
| sdake | zhubingbing - try recheck | 02:28 |
| zhubingbing | roger | 02:29 |
| sdake | zhubingbing openstack-infra just indicated there i a problem with the osic mirrors and they are either working to fix it or have already fixe dit | 02:29 |
| *** Liuqing has quit IRC | 02:31 | |
| *** Liuqing has joined #openstack-kolla | 02:32 | |
| *** tonanhngo has joined #openstack-kolla | 02:33 | |
| *** tonanhngo has quit IRC | 02:36 | |
| *** yingjun has quit IRC | 02:36 | |
| *** yingjun has joined #openstack-kolla | 02:42 | |
| *** tonanhngo has joined #openstack-kolla | 02:48 | |
| -openstackstatus- NOTICE: Jobs running on osic nodes are failing due to network issues with the mirror. We are temporarily disabling the cloud. | 02:48 | |
| *** tonanhngo has quit IRC | 02:48 | |
| *** sdake_ has joined #openstack-kolla | 02:56 | |
| *** sdake has quit IRC | 02:59 | |
| *** tonanhngo has joined #openstack-kolla | 03:02 | |
| *** tonanhngo has quit IRC | 03:04 | |
| *** williamcaban has quit IRC | 03:08 | |
| *** jascott1_ has quit IRC | 03:09 | |
| *** tonanhngo has joined #openstack-kolla | 03:12 | |
| *** tonanhngo has quit IRC | 03:13 | |
| *** tonanhngo has joined #openstack-kolla | 03:22 | |
| *** salv-orlando has joined #openstack-kolla | 03:24 | |
| *** salv-orlando has quit IRC | 03:29 | |
| *** haplo37 has quit IRC | 03:36 | |
| *** g3ek has quit IRC | 03:36 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix rabbitmq upgrade permission issue in CentOS https://review.openstack.org/384598 | 03:38 |
| *** haplo37 has joined #openstack-kolla | 03:41 | |
| *** g3ek has joined #openstack-kolla | 03:42 | |
| *** zhubingbing has quit IRC | 03:52 | |
| *** yuanying_ has joined #openstack-kolla | 03:57 | |
| *** yuanying has quit IRC | 04:01 | |
| *** yuanying_ has quit IRC | 04:02 | |
| *** yingjun has quit IRC | 04:04 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Use mariadb.cnf for mariadb custom file name https://review.openstack.org/384043 | 04:05 |
| *** neilus has joined #openstack-kolla | 04:06 | |
| *** neilus has quit IRC | 04:11 | |
| *** lamt has quit IRC | 04:14 | |
| *** robcresswell has quit IRC | 04:23 | |
| *** zhubingbing has joined #openstack-kolla | 04:24 | |
| *** robcresswell has joined #openstack-kolla | 04:25 | |
| *** salv-orlando has joined #openstack-kolla | 04:25 | |
| *** yingjun has joined #openstack-kolla | 04:30 | |
| *** salv-orlando has quit IRC | 04:30 | |
| *** unicell has joined #openstack-kolla | 04:45 | |
| *** unicell1 has joined #openstack-kolla | 04:50 | |
| *** unicell has quit IRC | 04:50 | |
| *** bmace has quit IRC | 04:56 | |
| *** bmace has joined #openstack-kolla | 04:56 | |
| *** salv-orlando has joined #openstack-kolla | 04:56 | |
| *** salv-orl_ has joined #openstack-kolla | 05:05 | |
| *** salv-orl_ has quit IRC | 05:06 | |
| *** salv-orl_ has joined #openstack-kolla | 05:06 | |
| *** salv-orlando has quit IRC | 05:07 | |
| *** zhubingbing has quit IRC | 05:15 | |
| *** zhubingbing has joined #openstack-kolla | 05:18 | |
| *** zhurong has quit IRC | 05:18 | |
| *** ayoung has quit IRC | 05:18 | |
| *** ayoung has joined #openstack-kolla | 05:20 | |
| *** zhurong has joined #openstack-kolla | 05:20 | |
| *** zhubingbing has quit IRC | 05:22 | |
| *** ayoung has quit IRC | 05:22 | |
| *** jascott1 has joined #openstack-kolla | 05:27 | |
| *** rkrum has quit IRC | 05:31 | |
| *** unicell has joined #openstack-kolla | 05:40 | |
| *** unicell1 has quit IRC | 05:41 | |
| *** yingjun has quit IRC | 05:42 | |
| *** yuanying has joined #openstack-kolla | 05:50 | |
| *** salv-orl_ has quit IRC | 06:00 | |
| *** egonzalez90 has joined #openstack-kolla | 06:00 | |
| *** yingjun has joined #openstack-kolla | 06:06 | |
| bjolo | morning | 06:06 |
| *** g3ek has quit IRC | 06:06 | |
| *** tonanhngo has quit IRC | 06:13 | |
| *** g3ek has joined #openstack-kolla | 06:15 | |
| *** yingjun has quit IRC | 06:19 | |
| *** bjolo_ has joined #openstack-kolla | 06:21 | |
| *** janem has joined #openstack-kolla | 06:29 | |
| *** tonanhngo has joined #openstack-kolla | 06:33 | |
| *** tonanhngo has quit IRC | 06:35 | |
| *** tovin07 has quit IRC | 06:40 | |
| *** tovin07 has joined #openstack-kolla | 06:41 | |
| *** yuanying has quit IRC | 06:41 | |
| *** tovin07 has quit IRC | 06:41 | |
| *** tovin07 has joined #openstack-kolla | 06:42 | |
| *** zhubingbing has joined #openstack-kolla | 06:45 | |
| *** mnasiadka has joined #openstack-kolla | 06:51 | |
| *** yingjun has joined #openstack-kolla | 06:51 | |
| *** salv-orlando has joined #openstack-kolla | 07:06 | |
| *** matrohon has joined #openstack-kolla | 07:09 | |
| *** b_bezak has joined #openstack-kolla | 07:13 | |
| *** janem has quit IRC | 07:16 | |
| *** flaper87 has quit IRC | 07:24 | |
| duonghq | after deploy OpenStack cluster using Kolla, I create instance (successful), but cannot ping to the instance's IP, is there any configuration expect ones provided in quickstart guide? | 07:29 |
| *** janem has joined #openstack-kolla | 07:36 | |
| *** neilus has joined #openstack-kolla | 07:38 | |
| *** MarMat has quit IRC | 07:41 | |
| *** neilus has quit IRC | 07:42 | |
| *** salv-orlando has quit IRC | 07:43 | |
| *** jrich523 has quit IRC | 07:47 | |
| *** jrich523 has joined #openstack-kolla | 07:49 | |
| *** hogepodge has quit IRC | 07:51 | |
| duonghq | *except | 07:54 |
| *** hogepodge has joined #openstack-kolla | 07:58 | |
| *** salv-orlando has joined #openstack-kolla | 08:07 | |
| *** athomas has joined #openstack-kolla | 08:15 | |
| openstackgerrit | Mick Thompson proposed openstack/kolla: Updated murano configuration https://review.openstack.org/383615 | 08:18 |
| *** sdake_ has quit IRC | 08:21 | |
| *** yingjun has quit IRC | 08:21 | |
| *** yingjun has joined #openstack-kolla | 08:22 | |
| *** jascott1 has quit IRC | 08:22 | |
| *** yingjun_ has joined #openstack-kolla | 08:23 | |
| *** yingjun has quit IRC | 08:24 | |
| *** neilus has joined #openstack-kolla | 08:25 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Use mariadb.cnf for mariadb custom file name https://review.openstack.org/384043 | 08:25 |
| *** yuanying has joined #openstack-kolla | 08:27 | |
| openstackgerrit | prameswar proposed openstack/kolla: Modify QSG to install dependencies needed to build code with pip https://review.openstack.org/384073 | 08:27 |
| *** neilus has quit IRC | 08:30 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Add validate no new line at end of file https://review.openstack.org/380340 | 08:31 |
| *** bjolo__ has joined #openstack-kolla | 08:32 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Enable Gnocchi plugin in grafana https://review.openstack.org/384303 | 08:33 |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Fix 'Address already in use' for barbican-api https://review.openstack.org/384771 | 08:34 |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Enable keystone authentication for Barbican https://review.openstack.org/384161 | 08:35 |
| *** hieulq_ has joined #openstack-kolla | 08:37 | |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Add missing uwsgi for barbican-api Dockerfile https://review.openstack.org/384763 | 08:38 |
| *** jascott1 has joined #openstack-kolla | 08:39 | |
| *** jmccarthy1 has joined #openstack-kolla | 08:40 | |
| *** caowei has quit IRC | 08:41 | |
| *** HyperJohnGraham_ has quit IRC | 08:41 | |
| *** hieulq has quit IRC | 08:41 | |
| *** jmccarthy has quit IRC | 08:41 | |
| *** Mech422 has quit IRC | 08:41 | |
| *** bjolo has quit IRC | 08:41 | |
| *** ediardo has quit IRC | 08:41 | |
| *** amaged__ has quit IRC | 08:41 | |
| *** irtermite has quit IRC | 08:41 | |
| *** kklimonda has quit IRC | 08:41 | |
| *** hyakuhei has quit IRC | 08:41 | |
| openstackgerrit | Jack Ning proposed openstack/kolla: Make ceph monitor nodes deploy separately https://review.openstack.org/384878 | 08:41 |
| *** berendt has joined #openstack-kolla | 08:41 | |
| berendt | morning | 08:42 |
| *** Mech422 has joined #openstack-kolla | 08:42 | |
| zhubingbing | hi | 08:42 |
| zhubingbing | morning | 08:42 |
| *** salv-orl_ has joined #openstack-kolla | 08:44 | |
| *** caowei has joined #openstack-kolla | 08:44 | |
| duonghq | hi berendt | 08:46 |
| *** salv-orlando has quit IRC | 08:46 | |
| *** HyperJohnGraham_ has joined #openstack-kolla | 08:46 | |
| *** manjeets_ has joined #openstack-kolla | 08:46 | |
| *** yingjun_ has quit IRC | 08:48 | |
| *** yingjun has joined #openstack-kolla | 08:48 | |
| *** ediardo has joined #openstack-kolla | 08:49 | |
| *** amaged__ has joined #openstack-kolla | 08:49 | |
| *** irtermite has joined #openstack-kolla | 08:49 | |
| *** kklimonda has joined #openstack-kolla | 08:49 | |
| *** hyakuhei has joined #openstack-kolla | 08:49 | |
| *** yingjun has quit IRC | 08:50 | |
| *** yingjun has joined #openstack-kolla | 08:50 | |
| openstackgerrit | Merged openstack/kolla: fix mistral requires auth_uri to point to v3 explicitly https://review.openstack.org/384147 | 08:52 |
| *** strigazi_AFK is now known as strigazi | 08:52 | |
| *** gfidente has joined #openstack-kolla | 08:52 | |
| openstackgerrit | prameswar proposed openstack/kolla: Modify QSG to install dependencies needed to build code with pip https://review.openstack.org/384073 | 08:53 |
| *** HyperJohnGraham_ has quit IRC | 08:53 | |
| *** salv-orl_ has quit IRC | 08:55 | |
| *** JianqingJiang has joined #openstack-kolla | 08:57 | |
| *** JianqingJiang has quit IRC | 08:57 | |
| *** JianqingJiang has joined #openstack-kolla | 09:00 | |
| *** HyperJohnGraham_ has joined #openstack-kolla | 09:09 | |
| *** yingjun has quit IRC | 09:11 | |
| *** yingjun has joined #openstack-kolla | 09:11 | |
| *** g3ek has quit IRC | 09:17 | |
| *** haplo37 has quit IRC | 09:19 | |
| *** haplo37 has joined #openstack-kolla | 09:19 | |
| *** g3ek has joined #openstack-kolla | 09:20 | |
| *** salv-orlando has joined #openstack-kolla | 09:25 | |
| *** openstack has joined #openstack-kolla | 09:29 | |
| *** JianqingJiang has quit IRC | 09:31 | |
| *** HyperJohnGraham_ has quit IRC | 09:33 | |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Enable keystone authentication for Barbican https://review.openstack.org/384161 | 09:34 |
| jmccarthy1 | Is anyone aware of dns or other issues with the rabbitmq clusterer plugin ? Or this seems to work pretty ok for folks ? | 09:34 |
| *** jmccarthy1 has left #openstack-kolla | 09:35 | |
| *** jmccarthy1 has joined #openstack-kolla | 09:36 | |
| *** jmccarthy1 has left #openstack-kolla | 09:36 | |
| *** jmccarthy has joined #openstack-kolla | 09:36 | |
| *** caowei has quit IRC | 09:38 | |
| jmccarthy | (client hiccup) Is anyone aware of dns or other issues with the rabbitmq clusterer plugin ? Or this seems to work pretty ok for folks ? | 09:41 |
| *** janem has quit IRC | 09:44 | |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Fix 'Address already in use' for barbican-api https://review.openstack.org/384771 | 09:46 |
| openstackgerrit | Li Yingjun proposed openstack/kolla: Enable keystone authentication for Barbican https://review.openstack.org/384161 | 09:46 |
| *** shardy has joined #openstack-kolla | 09:47 | |
| *** tonanhngo has joined #openstack-kolla | 09:50 | |
| *** tonanhngo has quit IRC | 09:53 | |
| *** dwalsh has joined #openstack-kolla | 09:54 | |
| *** zhubingbing has quit IRC | 09:56 | |
| *** yingjun has quit IRC | 09:58 | |
| *** tovin07 has quit IRC | 09:59 | |
| *** duonghq has left #openstack-kolla | 10:00 | |
| *** duonghq has quit IRC | 10:00 | |
| *** zhurong has quit IRC | 10:02 | |
| *** tonanhngo has joined #openstack-kolla | 10:02 | |
| *** tonanhngo has quit IRC | 10:04 | |
| *** zhubingbing has joined #openstack-kolla | 10:04 | |
| *** Serlex has joined #openstack-kolla | 10:07 | |
| *** tonanhngo has joined #openstack-kolla | 10:12 | |
| *** tonanhngo has quit IRC | 10:15 | |
| jmccarthy | Is it in the kolla docs somewhere about setup user may have to do to satisfy these prechecks ? | 10:15 |
| jmccarthy | Check if all rabbit hostnames are resolvable | 10:15 |
| jmccarthy | Hostname has to resolve to IP address of api_interface | 10:15 |
| *** bjolo_ has quit IRC | 10:18 | |
| *** zhubingbing has quit IRC | 10:19 | |
| *** zhubingbing has joined #openstack-kolla | 10:19 | |
| *** Liuqing has quit IRC | 10:22 | |
| *** sdake has joined #openstack-kolla | 10:23 | |
| sdake | morning | 10:24 |
| jmccarthy | Morning ! | 10:24 |
| jmccarthy | Actually question for you sdake :) | 10:24 |
| *** tonanhngo has joined #openstack-kolla | 10:24 | |
| sdake | shoot | 10:24 |
| *** tonanhngo has quit IRC | 10:24 | |
| jmccarthy | About rabbitmq, this precheck for example 'Hostname has to resolve to IP address of api_interface', if this fails or is this doc'd what users should have in place for this ? | 10:24 |
| jmccarthy | Apologies for not finding it myself if it is, I could have missed it | 10:25 |
| jmccarthy | There are problems here as far as getting a workable cluster up unless this stuff is aligned / prechecks pass | 10:26 |
| sdake | dunno just woke up | 10:26 |
| jmccarthy | Or the failed msg is enough and folks can work it out from there ? :) Good morning lol | 10:27 |
| jmccarthy | I'm still not awake lol, ok coffee | 10:27 |
| berendt | does it makes sense to remove old images after an upgrade? | 10:30 |
| sdake | berendt upt o you | 10:30 |
| sdake | berendt atm ther eis no way tor oll back | 10:30 |
| sdake | berendt so it probably does | 10:30 |
| *** ntpttr has quit IRC | 10:30 | |
| *** ntpttr has joined #openstack-kolla | 10:31 | |
| berendt | i will open a bug report, at least it should be documented that it is required to manually cleanup the images after an upgrde | 10:31 |
| berendt | https://bugs.launchpad.net/kolla/+bug/1632282 | 10:33 |
| openstack | Launchpad bug 1632282 in kolla "Remove old images after an upgrade" [Undecided,New] | 10:33 |
| jmccarthy | Ok I've got my coffee :) sdake: Any thoughts ? | 10:35 |
| jmccarthy | besides 'I'm going back to bed' ;) | 10:36 |
| sdake | ya that | 10:38 |
| sdake | could you more precisely ask your question | 10:39 |
| *** liyifeng has joined #openstack-kolla | 10:40 | |
| *** tonanhngo has joined #openstack-kolla | 10:42 | |
| jmccarthy | Ok, it's to do with how does a user know what they should do if the 'Hostname has to resolve to IP address of api_interface' prechecks fails ? | 10:44 |
| *** janem has joined #openstack-kolla | 10:44 | |
| *** tonanhngo has quit IRC | 10:44 | |
| *** salv-orlando has quit IRC | 10:45 | |
| *** eaguilar has joined #openstack-kolla | 10:47 | |
| pbourke | jmccarthy: they will need to configure /etc/hosts | 10:47 |
| pbourke | jmccarthy: can you describe the env where that would not be possible? | 10:47 |
| pbourke | jmccarthy: (I was never up to date on this issue) | 10:47 |
| jmccarthy | It's not about whether it's possible, we just assume they glean this ? | 10:48 |
| pbourke | jmccarthy: well, we could make the error more clear | 10:48 |
| jmccarthy | sake: Sorry don't know enough about rabbit to ask better .. we have a patch that add short hosts names to nodes automatically, trying to decide what needs doing about it :) | 10:48 |
| jmccarthy | sdake: Sorry don't know enough about rabbit to ask better .. we have a patch that add short hosts names to nodes automatically, trying to decide what needs doing about it :) | 10:49 |
| sdake | the FQDN in /etc/hosts doesn't work? | 10:49 |
| jmccarthy | sadke: Hmm not sure, what adds that ? (If the user hasn't done?) | 10:50 |
| sdake | my /etc/hosts has short versions | 10:50 |
| jmccarthy | omg typing | 10:50 |
| jmccarthy | sdake :) Yea mine too, but I added them myself | 10:50 |
| sdake | the operator adds it before deploying | 10:50 |
| sdake | the biforst playbook also adds it | 10:51 |
| berendt | we even have a preparation task in the baremetal role that will generate an accurate /etc/hosts file | 10:51 |
| berendt | sdake baremetal not bifrost..? | 10:52 |
| sdake | berendt right - 4am... | 10:52 |
| jmccarthy | berendt: Ok that's interesting, I thought that had to do with ironic ? | 10:52 |
| *** tonanhngo has joined #openstack-kolla | 10:52 | |
| berendt | the name is still confusing, haven't we decided to rename the role? | 10:52 |
| berendt | jmccarthy no.. baremetal role is the role to prepare baremetal systems | 10:53 |
| openstackgerrit | Merged openstack/kolla: Add missing uwsgi for barbican-api Dockerfile https://review.openstack.org/384763 | 10:53 |
| berendt | the name is "a little bit" confusing | 10:53 |
| *** tonanhngo has quit IRC | 10:53 | |
| sdake | jmccarthy the baremetal role will deploybaremetal machines | 10:53 |
| jmccarthy | Why is doctoring up the hosts file for the user only in the baremetal case ? | 10:53 |
| sdake | jmccarthy it has nothing to do with openstack deployment and eveyrthing to do with baremetal deployment | 10:54 |
| jmccarthy | Ok but I like to sort out my hosts file for the user/rabbitmq automatically aside from baremetal, no ? | 10:55 |
| sdake | i hear what your saying | 10:55 |
| jmccarthy | Just trying to work out if there is a patch here I can submit :) | 10:55 |
| sdake | i dont have any easy answers for you | 10:55 |
| berendt | the baremetal role prepares all systems, it does not matter if it is really a baremetal or not | 10:56 |
| berendt | a better name would be bootstrap or something like this | 10:56 |
| sdake | kola's model is to use baremetal role for system prep | 10:56 |
| sdake | /etc/hosts is a system file | 10:56 |
| sdake | berendt the api is called bootstrap | 10:56 |
| *** zhubingbing has quit IRC | 10:57 | |
| jmccarthy | Ok, I didn't know about the baremetal role providing this functionality, I'll have to take a closer look at what that does - ah yes ok I see in multinode inv but not all in one | 10:58 |
| *** janem has quit IRC | 11:02 | |
| jmccarthy | sdake: berendt: pbourke: Sorry for the noise - thanks for the help guys :) ! | 11:06 |
| *** rhallisey has joined #openstack-kolla | 11:06 | |
| berendt | jmccarthy you are welcome | 11:06 |
| *** janem has joined #openstack-kolla | 11:09 | |
| *** afranc has quit IRC | 11:09 | |
| *** afranc has joined #openstack-kolla | 11:10 | |
| *** tonanhngo has joined #openstack-kolla | 11:12 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla: Install python-mysqldb for Ubuntu in openstack-base container (type source) https://review.openstack.org/384938 | 11:14 |
| *** tonanhngo has quit IRC | 11:14 | |
| *** sdake_ has joined #openstack-kolla | 11:14 | |
| *** sdake has quit IRC | 11:15 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla: Install MySQL-python in openstack-base container (type source) https://review.openstack.org/384938 | 11:19 |
| *** tonanhngo has joined #openstack-kolla | 11:22 | |
| berendt | pbourke why have you delayed the missing upgrade tasks for mongodb to ocata? | 11:22 |
| berendt | pbourke i think we need them for newton to be able to upgrade mongodb? | 11:23 |
| *** tonanhngo has quit IRC | 11:23 | |
| pbourke | berendt: i guess so. Sorry being very conservative in bug fixes leading up to branching | 11:23 |
| pbourke | berendt: will remove -2 | 11:23 |
| *** williamcaban has joined #openstack-kolla | 11:24 | |
| mliima_ | morning guys | 11:29 |
| *** tonanhngo has joined #openstack-kolla | 11:33 | |
| *** tonanhngo has quit IRC | 11:35 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla: Install mistral-dashboard in horizon container (type source) https://review.openstack.org/384941 | 11:35 |
| *** yingjun has joined #openstack-kolla | 11:39 | |
| *** srwilkers has joined #openstack-kolla | 11:45 | |
| *** eaguilar has quit IRC | 11:45 | |
| *** openstackgerrit has quit IRC | 11:48 | |
| *** openstackgerrit has joined #openstack-kolla | 11:48 | |
| *** flaper87 has joined #openstack-kolla | 11:57 | |
| *** flaper87 is now known as Guest9738 | 11:58 | |
| *** Guest9738 has quit IRC | 12:01 | |
| *** tonanhngo has joined #openstack-kolla | 12:04 | |
| *** ppalacios has joined #openstack-kolla | 12:05 | |
| *** zhurong has joined #openstack-kolla | 12:05 | |
| *** tonanhngo has quit IRC | 12:05 | |
| *** Liuqing has joined #openstack-kolla | 12:08 | |
| *** qwang has quit IRC | 12:08 | |
| *** dave-mccowan has joined #openstack-kolla | 12:12 | |
| *** salv-orlando has joined #openstack-kolla | 12:14 | |
| *** tonanhngo has joined #openstack-kolla | 12:15 | |
| *** g3ek has quit IRC | 12:17 | |
| *** tonanhngo has quit IRC | 12:17 | |
| *** openstackgerrit has quit IRC | 12:18 | |
| *** openstackgerrit has joined #openstack-kolla | 12:18 | |
| *** zhubingbing has joined #openstack-kolla | 12:19 | |
| *** haplo37 has quit IRC | 12:19 | |
| *** zhubingbing has quit IRC | 12:22 | |
| *** Liuqing has quit IRC | 12:24 | |
| *** haplo37 has joined #openstack-kolla | 12:24 | |
| *** g3ek has joined #openstack-kolla | 12:24 | |
| *** bjolo_ has joined #openstack-kolla | 12:27 | |
| *** zhubingbing has joined #openstack-kolla | 12:32 | |
| *** tonanhngo has joined #openstack-kolla | 12:34 | |
| *** tonanhngo has quit IRC | 12:34 | |
| *** janem has quit IRC | 12:39 | |
| *** dmsimard|pto is now known as dmsimard | 12:40 | |
| openstackgerrit | Ryan Hallisey proposed openstack/kolla-kubernetes: Workflow Gate Testing https://review.openstack.org/382021 | 12:41 |
| openstackgerrit | Ryan Hallisey proposed openstack/kolla-kubernetes: Ansible support for Mariadb https://review.openstack.org/334255 | 12:41 |
| openstackgerrit | Ryan Hallisey proposed openstack/kolla-kubernetes: Ansible support for Rabbitmq https://review.openstack.org/380796 | 12:41 |
| openstackgerrit | Ryan Hallisey proposed openstack/kolla-kubernetes: Ansible workflow for Keystone https://review.openstack.org/380797 | 12:41 |
| openstackgerrit | Ryan Hallisey proposed openstack/kolla-kubernetes: Ansible workflow for Glance https://review.openstack.org/380801 | 12:41 |
| *** mgoddard has joined #openstack-kolla | 12:43 | |
| *** tonanhngo has joined #openstack-kolla | 12:44 | |
| *** jgriffith_away is now known as jgriffith | 12:44 | |
| *** tonanhngo has quit IRC | 12:45 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla: WIP: Add mistral-event-engine service https://review.openstack.org/384978 | 12:45 |
| openstackgerrit | zhubingbing proposed openstack/kolla: Make Kuryr upgrade not crater the upgrade https://review.openstack.org/384383 | 12:48 |
| *** flaper87 has joined #openstack-kolla | 12:51 | |
| *** flaper87 has quit IRC | 12:51 | |
| *** flaper87 has joined #openstack-kolla | 12:51 | |
| *** zhubingbing has quit IRC | 12:55 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: WIP Adds Fluentd service to Kolla https://review.openstack.org/375615 | 13:02 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Adding kubetoolbox image https://review.openstack.org/384988 | 13:02 |
| *** jheroux has joined #openstack-kolla | 13:02 | |
| *** prithiv has joined #openstack-kolla | 13:03 | |
| *** srwilkers has quit IRC | 13:05 | |
| *** jtriley has joined #openstack-kolla | 13:05 | |
| *** fguillot has joined #openstack-kolla | 13:05 | |
| *** mgoddard has quit IRC | 13:06 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Fencing pod https://review.openstack.org/383922 | 13:11 |
| *** eaguilar has joined #openstack-kolla | 13:13 | |
| *** dwalsh has quit IRC | 13:13 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Adds Fluentd docker image required for kolla-kube https://review.openstack.org/375615 | 13:24 |
| *** tonanhngo has joined #openstack-kolla | 13:24 | |
| *** tonanhngo has quit IRC | 13:25 | |
| *** dwalsh has joined #openstack-kolla | 13:27 | |
| *** egonzalez90 has quit IRC | 13:30 | |
| *** dwalsh_ has joined #openstack-kolla | 13:33 | |
| *** zhubingbing has joined #openstack-kolla | 13:34 | |
| *** mgoddard has joined #openstack-kolla | 13:34 | |
| *** dave-mccowan has quit IRC | 13:39 | |
| *** haplo37_ has quit IRC | 13:40 | |
| *** srwilkers has joined #openstack-kolla | 13:42 | |
| *** lamt has joined #openstack-kolla | 13:42 | |
| *** yingjun has quit IRC | 13:42 | |
| *** haplo37_ has joined #openstack-kolla | 13:42 | |
| *** yingjun has joined #openstack-kolla | 13:42 | |
| *** tonanhngo has joined #openstack-kolla | 13:43 | |
| *** tonanhngo has quit IRC | 13:43 | |
| *** janem has joined #openstack-kolla | 13:46 | |
| *** prithiv has quit IRC | 13:47 | |
| *** yingjun has quit IRC | 13:47 | |
| *** eaguilar has quit IRC | 13:48 | |
| *** eaguilar has joined #openstack-kolla | 13:52 | |
| *** lrensing has joined #openstack-kolla | 13:54 | |
| *** papacz has joined #openstack-kolla | 13:56 | |
| *** zhubingbing has quit IRC | 13:57 | |
| *** williamc_ has joined #openstack-kolla | 13:57 | |
| *** williamcaban has quit IRC | 13:59 | |
| *** absubram has joined #openstack-kolla | 14:01 | |
| *** dave-mccowan has joined #openstack-kolla | 14:01 | |
| *** zhubingbing has joined #openstack-kolla | 14:01 | |
| *** papacz has quit IRC | 14:03 | |
| *** absubram_ has joined #openstack-kolla | 14:03 | |
| *** MarMat has joined #openstack-kolla | 14:04 | |
| *** msimonin has quit IRC | 14:05 | |
| *** absubram has quit IRC | 14:05 | |
| *** absubram_ is now known as absubram | 14:05 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Adds Fluentd docker image required for kolla-kube https://review.openstack.org/375615 | 14:08 |
| *** Liuqing has joined #openstack-kolla | 14:10 | |
| openstackgerrit | Merged openstack/kolla: Add netaddr to requirements file https://review.openstack.org/382892 | 14:11 |
| *** msimonin has joined #openstack-kolla | 14:11 | |
| *** tonanhngo has joined #openstack-kolla | 14:15 | |
| *** tonanhngo has quit IRC | 14:16 | |
| sbezverk_ | zhubingbing: ping | 14:19 |
| zhubingbing | here | 14:20 |
| sbezverk_ | zhubingbing: if you -1, do not you think you should provide a reason? I have done it twice now. what is going on? | 14:20 |
| zhubingbing | done | 14:20 |
| *** HyperJohnGraham_ has joined #openstack-kolla | 14:22 | |
| sbezverk_ | zhubingbing: also if you ask a clarification, I do not think it is a good reason for -1 either. | 14:23 |
| zhubingbing | https://review.openstack.org/#/c/375615/10 | 14:24 |
| openstackgerrit | Merged openstack/kolla: Make Kuryr upgrade not crater the upgrade https://review.openstack.org/384383 | 14:24 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Adds Fluentd docker image required for kolla-kube https://review.openstack.org/375615 | 14:25 |
| *** lrensing has quit IRC | 14:26 | |
| *** lrensing has joined #openstack-kolla | 14:27 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Adding kubetoolbox image https://review.openstack.org/384988 | 14:27 |
| zhubingbing | sbezverk_ RUN ulimit -n 65536 this i think it should set in base | 14:27 |
| *** bjolo_ has quit IRC | 14:28 | |
| *** msimonin1 has joined #openstack-kolla | 14:28 | |
| *** msimonin has quit IRC | 14:28 | |
| sbezverk_ | zhubingbing: changing base for a specific application requirement is difficult | 14:28 |
| sbezverk_ | and I doubt right approach | 14:30 |
| *** b_bezak has quit IRC | 14:30 | |
| *** mnasiadka has quit IRC | 14:30 | |
| zhubingbing | chmod 2775 /var/log/kolla why set 2775? | 14:30 |
| zhubingbing | i thinks it should is 755 | 14:31 |
| zhubingbing | https://github.com/openstack/kolla/blob/master/docker/ceilometer/ceilometer-base/extend_start.sh#L12 | 14:32 |
| sbezverk_ | zhubingbing: check heka please | 14:32 |
| sbezverk_ | I suggested you guys sort out first how it should be and then I will change for the standard you come up with.. | 14:33 |
| *** bmace has quit IRC | 14:33 | |
| openstackgerrit | Paul Bourke (pbourke) proposed openstack/kolla: Allow operators to change hw_disk_discard in Nova https://review.openstack.org/385035 | 14:34 |
| openstackgerrit | Christian Berendt proposed openstack/kolla: Install MySQL-python with pip in openstack-base container (type source) https://review.openstack.org/384938 | 14:35 |
| *** msimonin1 has quit IRC | 14:35 | |
| *** msimonin has joined #openstack-kolla | 14:35 | |
| openstackgerrit | Christian Berendt proposed openstack/kolla: Install MySQL-python with pip in openstack-base container (type source) https://review.openstack.org/384938 | 14:36 |
| *** berendt has quit IRC | 14:40 | |
| *** sdake_ is now known as sdake | 14:42 | |
| *** dwalsh_ has quit IRC | 14:42 | |
| NachoDuck | Hi all, having a bit of a strange issue with a deployment I'm trying. 3 nodes with 2 neutron nodes, instance on a flat network it can see traffic, ping out etc but it seems that no connections from other machines on the same network can establish connections, ping/ssh etc fails. Have tried with a cirros and CentOS image but the results are the same, usually | 14:42 |
| NachoDuck | I'd lean towards firewall config here but I'm not sure where that would come into it as that's not configured on the instance (and I don't think its possible on cirros?). Any help would be much appreciated :) | 14:42 |
| *** salv-orl_ has joined #openstack-kolla | 14:43 | |
| sdake | morning peeps | 14:43 |
| lrensing | morning | 14:43 |
| *** salv-orlando has quit IRC | 14:46 | |
| *** papacz has joined #openstack-kolla | 14:46 | |
| zhubingbing | sdake | 14:47 |
| zhubingbing | {%- if orchestration_engine == 'KUBERNETES' %} | 14:47 |
| zhubingbing | "command": "/usr/bin/ceph-mon -d -i @MONID@ --public-addr @MONADDR@:6789", | 14:47 |
| zhubingbing | {%- else %} | 14:47 |
| jmccarthy | Hey guys, got another question about the baremetal role; I notice where the hosts file is doctored up in pre-install.yml the blockinfile is for "{% for host in groups['all'] %}" - isn't this potentially a *lot of nodes in a large deployment ? | 14:47 |
| zhubingbing | why add it "-" | 14:47 |
| sdake | zhubingbing i don't know with - you are talking about | 14:48 |
| sdake | which | 14:48 |
| zhubingbing | sorry | 14:48 |
| sdake | jmccarthy ya it takes awhile | 14:48 |
| pbourke | jmccarthy: its only text though right? | 14:48 |
| pbourke | how long can it take | 14:48 |
| zhubingbing | https://github.com/openstack/kolla/blob/master/ansible/roles/ceph/templates/ceph-mon.json.j2#L2 | 14:49 |
| zhubingbing | sdake | 14:49 |
| pbourke | all nodes need to be able to reference each other, at least for control | 14:49 |
| zhubingbing | i thinks should remove "-" {%- if orchestration_engine == 'KUBERNETES' %} | 14:49 |
| pbourke | NachoDuck: check neutron security rules? | 14:49 |
| jmccarthy | Ok, I just don't know offhand, would this be common practice to put them *all in like this vs being able to look up names in dns ? | 14:50 |
| jmccarthy | What if I have loads of computes ? | 14:50 |
| sdake | zhubingbing wrong :) | 14:51 |
| jmccarthy | pbourke: Or yea maybe it should only be a subset | 14:51 |
| zhubingbing | so, we should remove it ? | 14:51 |
| sdake | jmccarthy someone i think inc0 was going to make the host setting only set the control nodes | 14:51 |
| sdake | but that didn't happen | 14:51 |
| sdake | another option is to write out the hosts file once | 14:51 |
| sdake | and then copy it to each node | 14:52 |
| sdake | atm the host file is calculated each time for each node | 14:52 |
| sdake | which is sluggish | 14:52 |
| sdake | it takes about 10 mins to gete thru that code on 100 node cluster | 14:52 |
| jmccarthy | sdake: Oh ok yea that seems a bit saner to me, I'm not that worried about the time as such just the scope of what nodes are all being listed out in the hosts file | 14:52 |
| jmccarthy | Oh do we need a patch for this ? | 14:52 |
| sdake | depends - i'd like to keep the host files consistent betweeen nodes | 14:53 |
| sbezverk_ | sdake: please before removing anything that starts with "kube*." would be great to check with folks working on it, right? | 14:53 |
| sdake | but what we have is not optimal from a performance standpoint | 14:53 |
| sdake | zhubingbing run that by sbezverk_ :) | 14:53 |
| jmccarthy | sdake: I know what you mean, that is good for consistency hmm | 14:53 |
| zhubingbing | sbezverk_ | 14:54 |
| sbezverk_ | zhubingbing: here, please exaplain why you want to remove this check? | 14:54 |
| *** Liuqing has quit IRC | 14:55 | |
| NachoDuck | pbourke: Thanks, I had read "default" thinking that mean all but I realise it means something different now. Thanks for your time :) | 14:55 |
| *** papacz has quit IRC | 14:56 | |
| *** tonanhngo has joined #openstack-kolla | 14:56 | |
| *** zhurong has quit IRC | 14:56 | |
| *** tonanhngo has quit IRC | 14:56 | |
| *** prithiv has joined #openstack-kolla | 14:57 | |
| *** tonanhngo has joined #openstack-kolla | 14:57 | |
| *** papacz has joined #openstack-kolla | 14:58 | |
| sdake | tag rc2 in t-15 hours | 14:59 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Adds Fluentd docker image required for kolla-kube https://review.openstack.org/375615 | 15:00 |
| openstackgerrit | Merged openstack/kolla: Added missing cleanup-images in setup.cfg https://review.openstack.org/384716 | 15:03 |
| *** msimonin has quit IRC | 15:06 | |
| *** msimonin has joined #openstack-kolla | 15:06 | |
| *** msimonin has quit IRC | 15:10 | |
| *** dwalsh has quit IRC | 15:11 | |
| *** prithiv has quit IRC | 15:11 | |
| sdake | pbourke you workflowed https://review.openstack.org/#/c/384383/ | 15:11 |
| sdake | pbourke did you notice the gate failures | 15:11 |
| sdake | pbourke and if so, is master ci broken or something else? | 15:12 |
| *** dwalsh has joined #openstack-kolla | 15:12 | |
| *** msimonin has joined #openstack-kolla | 15:13 | |
| sdake | Jeffrey4l_ ping | 15:14 |
| zhubingbing | hi sdake | 15:15 |
| zhubingbing | http://logs.openstack.org/83/384383/2/check/gate-kolla-dsvm-build-ubuntu-source-ubuntu-xenial-nv/ab045b8/console.html#_2016-10-11_13_28_40_369636 | 15:15 |
| pbourke | sdake: the gates are unrelated to that change and upgrades aren't tested in the gates | 15:15 |
| sdake | pbourke upgrade is t ested - but from same version to same version :) | 15:15 |
| sdake | or atleasat it was | 15:15 |
| sdake | apparently not anymore | 15:15 |
| sdake | pbourke so master ci iss gtg then? | 15:15 |
| pbourke | no it seems busted | 15:16 |
| pbourke | something to do with pbr? | 15:17 |
| sdake | groan | 15:17 |
| *** ccesario has quit IRC | 15:17 | |
| sdake | ok - here is deal folks - we tag rc2 on 12th at 23:45 UTC | 15:18 |
| sdake | then we have about 1 week to fix CRITICAL only bugs in master for rc3 | 15:18 |
| sdake | rc3 i expect to have less then 3-5 bugs | 15:18 |
| sdake | 3.0.0 will be tagged from rc3 | 15:18 |
| sdake | master branch will be cretaed on our around the time of rc2 | 15:19 |
| sdake | rather stable/newton | 15:19 |
| sdake | any rc3 bug fixes must be backported | 15:19 |
| *** g3ek has quit IRC | 15:19 | |
| sdake | an example of a critical bug was that bug i linked earlier to pbourke | 15:20 |
| *** lrensing has quit IRC | 15:20 | |
| sdake | something that breaks maor functionality | 15:20 |
| sdake | i.e. sudo kolla-ansible upgrade -> crater = critical | 15:20 |
| pbourke | sdake: that's why I +a'd it | 15:21 |
| *** srwilkers has quit IRC | 15:21 | |
| sdake | roger | 15:21 |
| pbourke | sdake: though there really should have been a bug id I guess | 15:21 |
| sdake | pbourke agree i was just being lazy ;) | 15:22 |
| sdake | pbourke actually i was working on patch after that | 15:22 |
| sdake | pbourke that patch wasn't quite ready to merge | 15:22 |
| sdake | i.e. it was lacking a bug id | 15:22 |
| sdake | after r c2, everything *MUSt8 havv a bug id to be backported | 15:22 |
| Jeffrey4l_ | sdake, pong | 15:22 |
| sdake | Jeffrey4l_ did you wrap up that ubuntu upgrade problem or need me to look today | 15:23 |
| pbourke | sdake: that's what I thought ;) so I cut you slack | 15:23 |
| sdake | pbourke merciless ;) | 15:23 |
| pbourke | that upgade.yml missing thing has come up tonnes of times by the way | 15:23 |
| pbourke | and continues to do so | 15:24 |
| Jeffrey4l_ | sdake, https://review.openstack.org/384598 patch is still under review. | 15:24 |
| sdake | pbourke yup - although master atm doesn't seem to have problems | 15:24 |
| sdake | ok pbourke need to bring you up to pseed on the above change | 15:24 |
| pbourke | Jeffrey4l_: how do you feel about just doing chmod in extend_start.sh for that patch | 15:24 |
| pbourke | sdake: the rabbitmq upgrade/ | 15:25 |
| pbourke | ? | 15:25 |
| sdake | pbourke we have been down that path of discussion already - this has been bikeshedded for about 6-8 hours | 15:25 |
| Jeffrey4l_ | ubuntu upgrade busted for all containers. | 15:25 |
| sdake | pbourke this seems to make the most people happiest, but not you because youw eren't in the bikeshed discussion :) | 15:25 |
| Jeffrey4l_ | ubuntu is the real issue. and that's why we want set_config . | 15:25 |
| sdake | the reason we don't put that stuff in extend_start is because it will become permanent | 15:25 |
| sdake | we want the contaniers lightweight | 15:26 |
| sdake | i do atleast | 15:26 |
| pbourke | but we do chmod/chown in almost every other start script | 15:26 |
| sdake | i need to TRY to get my son to school | 15:26 |
| sdake | bbiaf | 15:26 |
| sdake | pbourke be back in 20 mins to discuss | 15:26 |
| pbourke | the above is a feature, that could potentially affect every other container 1 week from release | 15:26 |
| *** qwang has joined #openstack-kolla | 15:26 | |
| pbourke | sdake: np | 15:26 |
| *** papacz has quit IRC | 15:27 | |
| Jeffrey4l_ | pbourke, do u have any idea about the ubuntu upgrade issue? | 15:27 |
| pbourke | Jeffrey4l_: from what I've read on the bug the rabbitmq user id changed | 15:27 |
| Jeffrey4l_ | all the containers in ubuntu is change between mitaka and newtone. | 15:27 |
| pbourke | is there more to it than that? | 15:27 |
| Jeffrey4l_ | this is talked in irc. | 15:27 |
| Jeffrey4l_ | yes. | 15:27 |
| pbourke | background info should go in the commit message | 15:28 |
| Jeffrey4l_ | ubuntu xenial introduced systemd which take one of uid/gid. then all the users created in the ubuntu container has a high uid/gid than mitaka. | 15:28 |
| *** g3ek has joined #openstack-kolla | 15:28 | |
| pbourke | this effects every container? | 15:28 |
| Jeffrey4l_ | pbourke, correct. | 15:29 |
| pbourke | will a patch be needed for every container? | 15:29 |
| Jeffrey4l_ | pbourke, yes. :( | 15:29 |
| pbourke | Jeffrey4l_: what's wrong with this: https://github.com/openstack/kolla/blob/master/docker/rabbitmq/extend_start.sh#L6 | 15:30 |
| *** ccesario has joined #openstack-kolla | 15:31 | |
| Jeffrey4l_ | pbourke, 1. not all container has this. actually, it is not needed normally. | 15:31 |
| Jeffrey4l_ | 2. another thing we need care is log file /var/log/kolla/rabbitmq/*.log | 15:32 |
| *** dwalsh has quit IRC | 15:32 | |
| pbourke | your patch does the exact same thing as updating extend_start | 15:32 |
| pbourke | except in python | 15:32 |
| pbourke | no? | 15:32 |
| Jeffrey4l_ | pbourke, no. i can handle logs folder https://review.openstack.org/#/c/384598/2/ansible/roles/rabbitmq/templates/rabbitmq.json.j2 | 15:33 |
| pbourke | sudo chown -R rabbitmq: /var/log/kolla/rabbitmq | 15:33 |
| *** dwalsh has joined #openstack-kolla | 15:33 | |
| Jeffrey4l_ | rabbitmq case is easy. the hardest is nova. different file in /var/lib/nova/instance/ has different permission. | 15:34 |
| Jeffrey4l_ | pbourke, we do not want to change the extend_start.sh file. | 15:34 |
| pbourke | why | 15:34 |
| Jeffrey4l_ | it is hard code. set_configs solution is more light. | 15:35 |
| *** sean-k-mooney has joined #openstack-kolla | 15:35 | |
| *** dwalsh has quit IRC | 15:36 | |
| *** dwalsh has joined #openstack-kolla | 15:37 | |
| *** zhubingbing has quit IRC | 15:37 | |
| pbourke | has noone tested upgrade on ubuntu till now? | 15:38 |
| pbourke | i'll go back and read logs from yesterday to save you repeating too much | 15:38 |
| Jeffrey4l_ | i use CentOS. no idea about this. | 15:39 |
| *** unicell1 has joined #openstack-kolla | 15:39 | |
| *** salv-orl_ has quit IRC | 15:39 | |
| *** unicell has quit IRC | 15:40 | |
| Jeffrey4l_ | But the uid/gid issue exist. | 15:40 |
| *** zhubingbing has joined #openstack-kolla | 15:41 | |
| *** dwalsh_ has joined #openstack-kolla | 15:43 | |
| *** dwalsh has quit IRC | 15:44 | |
| sean-k-mooney | Jeffrey4l_: in relateion to https://bugs.launchpad.net/kolla/+bug/1564773 rabbitmq as not producing any logs. | 15:48 |
| openstack | Launchpad bug 1564773 in kolla mitaka "Continously restarting rabbitmq container for CentOS" [High,Confirmed] - Assigned to Md Nadeem (mail2nadeem92) | 15:48 |
| *** papacz has joined #openstack-kolla | 15:48 | |
| Jeffrey4l_ | OK. will check it later. | 15:49 |
| sdake | pbourke it would appear not | 15:50 |
| pbourke | disaster | 15:50 |
| sean-k-mooney | Jeffrey4l_: have others been able to deploy rabbitmq from master without this issue? | 15:50 |
| sdake | pbourke right | 15:50 |
| sdake | pbourke so - disaster averted | 15:50 |
| Jeffrey4l_ | sean-k-mooney, yes. I can. | 15:50 |
| sdake | we simply chown volumes at start of container | 15:51 |
| sdake | if we put in extend_start, it remains there forever | 15:51 |
| sdake | if we put in the json,w e can remove it in 2 cycles when newton goes deprecated | 15:51 |
| sean-k-mooney | Jeffrey4l_: how did you build the container? ubuntu source vs centos binary? | 15:51 |
| sdake | pbourke that is main rationale behind the json vs extend_start | 15:51 |
| Jeffrey4l_ | sean-k-mooney, centos + source | 15:51 |
| sdake | Jeffrey4l_ - hate to bark orders, but could you pls take a look at the gate | 15:52 |
| sdake | and make sure its working | 15:52 |
| sdake | I want the gate working when we tag :) | 15:52 |
| sean-k-mooney | ok ill try building that. i know there are other issue with running centos contaienr on ubunutu host but i want ot see if i get the same restart behavior | 15:52 |
| Jeffrey4l_ | sdake, it should. but the openstack ci seems not stable today. :( | 15:52 |
| sdake | ok so its a ci problem not kolla problem? | 15:53 |
| Jeffrey4l_ | sean-k-mooney, could u provide /etc/hosts `ip a` /etc/kolla/globals.yml file? | 15:53 |
| Jeffrey4l_ | sdake, should be. | 15:53 |
| sdake | Jeffrey4l_ join me on #opnestack-infra pls | 15:53 |
| sean-k-mooney | sure ill grab them and place it on pastbin | 15:53 |
| Jeffrey4l_ | sdake, i am in that channel. | 15:54 |
| pbourke | Jeffrey4l_: how will the above even work given drop root | 15:54 |
| sdake | pbourke set_config.py is run as root | 15:55 |
| pbourke | ah its run as root | 15:55 |
| pbourke | I see | 15:55 |
| *** eaguilar has quit IRC | 15:55 | |
| pbourke | all this context should be in the commit message | 15:55 |
| sean-k-mooney | Jeffrey4l_: http://paste.openstack.org/show/tFkdFyb24Mh2x77LcqfH/ | 15:57 |
| Jeffrey4l_ | sean-k-mooney, have u ever run pre-check before deploying? | 16:00 |
| Jeffrey4l_ | the rabbitmq need hostname be resolved. | 16:00 |
| sean-k-mooney | yes but not in a few days. i can run it again. | 16:01 |
| sean-k-mooney | the host name is resolveable | 16:01 |
| Jeffrey4l_ | internal dns name? | 16:01 |
| *** salv-orlando has joined #openstack-kolla | 16:01 | |
| sean-k-mooney | 192.168.10.1 silpixa00385225 silpixa00385225 #a_kolla_ansible_host | 16:01 |
| Jeffrey4l_ | oh. sorry. | 16:01 |
| wznoinsk | more so, the IP you have as your VIP has to be the first your hostname resolves to, I recommend removing other entries for silpixa00385225 from /etc/hosts on the host | 16:02 |
| sean-k-mooney | wznoinsk: what? rabbit dose not use the vip ip | 16:02 |
| Jeffrey4l_ | sean-k-mooney, why the hostname is repeated? 192.168.10.6 silpixa00385230 silpixa00385230 | 16:05 |
| sean-k-mooney | the second one is the fqdn but it dose not have a full domain name | 16:05 |
| sean-k-mooney | Jeffrey4l_: this is how the current host file is beeing templated by the kolla-host playbook | 16:06 |
| Jeffrey4l_ | OK. try 1) run pre-check and check the result. | 16:06 |
| wznoinsk | sean-k-mooney: I mean, api_address | 16:06 |
| *** vhosakot has joined #openstack-kolla | 16:07 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: DO NOT MERGE: TEST MASTER BRANCH https://review.openstack.org/326307 | 16:12 |
| sean-k-mooney | wznoinsk: the hostnames currently resolve to the api_address which is the same address rabbit uses | 16:12 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Adds Fluentd docker image required for kolla-kube https://review.openstack.org/375615 | 16:13 |
| wznoinsk | sean-k-mooney: what steps fails/error you're seeing? | 16:14 |
| *** matrohon has quit IRC | 16:15 | |
| sean-k-mooney | wznoinsk: the play book succeds but rabbitmq container keeps restarting | 16:15 |
| *** neilus has joined #openstack-kolla | 16:16 | |
| pbourke | sean-k-mooney: the 'suceeds but restarting issue' i have noted down for pain points at the summit | 16:16 |
| pbourke | sean-k-mooney: pia on larger deployments | 16:16 |
| pbourke | *pita | 16:16 |
| sean-k-mooney | pbourke: yes wasnt that why inc0 started work on the sanity checks last cycle | 16:16 |
| pbourke | sean-k-mooney: yeah true | 16:17 |
| sean-k-mooney | pbourke: they never got finished but it would atleast force teh playbook to bail out early | 16:17 |
| sbezverk_ | pbourke: I tired to use curl to get kubectl but it generates bunch of garbage on the screen, with wget works fine, am I missing some keywords, I am using curl -O | 16:18 |
| *** jascott1_ has joined #openstack-kolla | 16:18 | |
| *** jascott1_ has quit IRC | 16:18 | |
| *** neilus has quit IRC | 16:20 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Adding kubetoolbox image https://review.openstack.org/384988 | 16:20 |
| sean-k-mooney | Jeffrey4l_: the prechecks pass on my local server. if i run them on all servers they are failing with the barbican api port but im not using barbican | 16:23 |
| Jeffrey4l_ | sean-k-mooney, what the docker logs rabbitmq? | 16:23 |
| sean-k-mooney | ill redeploy just rabbit and check | 16:24 |
| Jeffrey4l_ | ok. thanks. | 16:24 |
| *** athomas has quit IRC | 16:25 | |
| *** papacz has quit IRC | 16:26 | |
| sean-k-mooney | Jeffrey4l_: http://paste.openstack.org/show/585356/ | 16:28 |
| * Jeffrey4l_ is checking. | 16:28 | |
| sean-k-mooney | Jeffrey4l_: there is noting there that i can see. jsut same repeated over and over | 16:29 |
| Jeffrey4l_ | hmm no any error.. how about /var/lib/docker/volumes/kolla_logs/_data/rabbitmq, is there any info? | 16:29 |
| openstackgerrit | Merged openstack/kolla: Bump openstack-mitaka package version in Oracle image https://review.openstack.org/384304 | 16:30 |
| sean-k-mooney | Jeffrey4l_: the directory is empty | 16:30 |
| *** zhubingbing has quit IRC | 16:30 | |
| Jeffrey4l_ | weird :( | 16:31 |
| sean-k-mooney | if i change the command in the config.json to bash i can try strating rabbit by hand but it did not give much infor the last time i tryed that | 16:31 |
| *** extra_cheese has joined #openstack-kolla | 16:31 | |
| *** extra_cheese has left #openstack-kolla | 16:31 | |
| Jeffrey4l_ | sean-k-mooney, can u start one rabbitmq instance ( without cluster ), right? | 16:32 |
| sean-k-mooney | ill try swaping to the allinone inventory and check | 16:33 |
| sdake | nothign worse then taking a swig of a two day old pepsi | 16:35 |
| sdake | :( | 16:35 |
| Jeffrey4l_ | sdake, could u check this comment? https://bugs.launchpad.net/kolla/+bug/1631984/comments/1 | 16:37 |
| openstack | Launchpad bug 1631984 in kolla "failed to launch instance when enabled ceph" [Critical,Triaged] | 16:37 |
| sdake | Jeffrey4l_ whisky tango foxtrot! | 16:37 |
| *** unicell1 has quit IRC | 16:38 | |
| sean-k-mooney | Jeffrey4l_: actully the last time i launched i did not spcify the inventory so that was singel node so no that also fails | 16:38 |
| rhallisey | Jeffrey4l_, let me translate that for you: WTF! | 16:38 |
| rhallisey | :) | 16:38 |
| Jeffrey4l_ | thanks. ;) | 16:39 |
| rhallisey | lol | 16:39 |
| sdake | Jeffrey4l_ lets go to #rdo | 16:39 |
| Jeffrey4l_ | internet tell me: it is a interjection word ;( | 16:39 |
| Jeffrey4l_ | sdake, i am in. | 16:39 |
| sean-k-mooney | wait you enabled the evaluation build of qemu/kvm for centos? | 16:40 |
| sean-k-mooney | it would probably be safer to go with the virt sig | 16:40 |
| Jeffrey4l_ | sean-k-mooney, can not deploy aio env? | 16:42 |
| sean-k-mooney | Jeffrey4l_: no aio fails. or rather "tools/kolla-ansible deploy --tags rabbitmq" succeds but rabbit container is restarting | 16:43 |
| sean-k-mooney | Jeffrey4l_: i have built the centos source version so im going to quickly try deploying that | 16:45 |
| *** HyperJohnGraham_ has quit IRC | 16:45 | |
| *** papacz has joined #openstack-kolla | 16:47 | |
| sdake | sean-k-mooney pip show kolla | 16:47 |
| sean-k-mooney | im using master form about a week ago s pip show kolla is blank | 16:47 |
| sean-k-mooney | im currently using 3eac91d526058ad72d57c584246640fd56cded3c | 16:48 |
| *** dwalsh_ has quit IRC | 16:48 | |
| sdake | sean-k-mooney rabbitmq has undergone some changesi n the last week | 16:48 |
| sdake | try a rebase | 16:48 |
| *** haplo37_ has quit IRC | 16:48 | |
| sean-k-mooney | ok ill try that but i have been hitting this for a few weeks. | 16:49 |
| *** haplo37_ has joined #openstack-kolla | 16:50 | |
| *** neilus has joined #openstack-kolla | 16:52 | |
| sdake | tonanhngo ping | 16:52 |
| *** papacz has quit IRC | 16:54 | |
| *** neilus has quit IRC | 16:57 | |
| sean-k-mooney | sdake: by the way when is the stable/newton branch planned to be created? i was going to swap to that once it is available for this deployment | 16:58 |
| sdake | sean-k-mooney 12th 23;45 pst | 16:58 |
| sdake | rather utc :) | 16:58 |
| sean-k-mooney | oh tomorrow ok cool. | 16:58 |
| *** dwalsh has joined #openstack-kolla | 16:58 | |
| *** ssurana has joined #openstack-kolla | 16:58 | |
| sdake | sean-k-mooney that is assuming what is in master works to some degree ;-) | 16:59 |
| sdake | 3-5 bugs in rc3... | 17:00 |
| sdake | lets keep rc3 SMALL | 17:00 |
| sean-k-mooney | yes i havent been able to get master deployed sucessfully in about 2 weeks. 4 if you count the 2 weeks i was on vacations. | 17:01 |
| *** Serlex has quit IRC | 17:01 | |
| sdake | vaction doesn't count | 17:01 |
| sdake | master deploys for me | 17:01 |
| sdake | master on centos with jeffrey'schange also upgrades | 17:01 |
| tonanhngo | sdake: Hi Steve, sorry I was in the Magnum meeting | 17:01 |
| sdake | no prob tonanhngo | 17:01 |
| *** lamt has quit IRC | 17:03 | |
| wznoinsk | I saw a similar (not same) problem with rabbitmq last time I deployed on a baremetal (~2.5weeks ago) | 17:04 |
| wznoinsk | I've rebuilt the baremetal node and stil lhad rabbit mq crashdumping, don't see that problem in a VM in last 2 weeks tho | 17:05 |
| sdake | tonanhngo see PM :) | 17:06 |
| tonanhngo | sdake: PM? | 17:08 |
| sdake | private message | 17:08 |
| sdake | probably at the bottom of your client on the left | 17:08 |
| tonanhngo | ah ok | 17:08 |
| *** papacz has joined #openstack-kolla | 17:10 | |
| *** ayoung has joined #openstack-kolla | 17:11 | |
| mliima_ | hello guys, i'm trying to test kolla multinode using ceph, but when i try to create an image I get this error http://paste.openstack.org/show/585322/ | 17:12 |
| *** ayoung has quit IRC | 17:12 | |
| mliima_ | using filesystem i haven't it, but when i'm using rbd .... | 17:13 |
| *** ayoung has joined #openstack-kolla | 17:13 | |
| *** ayoung has quit IRC | 17:14 | |
| *** papacz has quit IRC | 17:15 | |
| *** ayoung has joined #openstack-kolla | 17:17 | |
| *** msimonin has quit IRC | 17:18 | |
| sdake | mliima_ we are on that problem | 17:23 |
| mliima_ | sdake, ok | 17:24 |
| *** Pavo has quit IRC | 17:25 | |
| *** Pavo has joined #openstack-kolla | 17:31 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix the failure to launch instance when enabled Ceph https://review.openstack.org/385102 | 17:31 |
| *** mkoderer has quit IRC | 17:32 | |
| *** unicell has joined #openstack-kolla | 17:33 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: [wip] remove epel repo https://review.openstack.org/385104 | 17:34 |
| *** portdirect has joined #openstack-kolla | 17:35 | |
| Jeffrey4l_ | sdake, another thing is about the namespace issue. i re-produced it and it is a bug upstream. i have filed a bug in docker https://bugs.launchpad.net/kolla/+bug/1616268 | 17:35 |
| openstack | Launchpad bug 1616268 in kolla mitaka "Stale namespace removal causing "RTNETLINK answers: Invalid argument" errors" [Critical,Confirmed] | 17:35 |
| sdake | Jeffrey4l_ nice | 17:35 |
| sdake | Jeffrey4l_ is there a workaround we can apply in koll ato deal with it | 17:35 |
| Jeffrey4l_ | sdake, no :( | 17:35 |
| Jeffrey4l_ | afaik | 17:36 |
| sdake | Jeffrey4l_ need a release note on it | 17:36 |
| sdake | seems like a critical issue to me | 17:36 |
| Jeffrey4l_ | yes. | 17:36 |
| sdake | need to inform operators of the limitations | 17:36 |
| sdake | i was thinking one workaround would be to make neutron a fat container | 17:36 |
| sdake | Jeffrey4l_ would that work - or same issue resuslt? | 17:37 |
| Jeffrey4l_ | sdake, it is not related to the fat container or thin. | 17:37 |
| sdake | right its related to the mounting properties | 17:37 |
| Jeffrey4l_ | sdake, check this https://github.com/docker/docker/issues/27277 | 17:37 |
| Jeffrey4l_ | sdake, yes. in the reproduce step. i only created one container. | 17:37 |
| otavio | sdake: Jeffrey4l_: the RDO bug, regarding the exprirer (https://bugzilla.redhat.com/show_bug.cgi?id=1382921) has lead to a deadend, it seems. | 17:38 |
| openstack | bugzilla.redhat.com bug 1382921 in openstack-swift "swift-object-expirer packaged in wrong package" [High,New] - Assigned to tshefi | 17:38 |
| *** shardy has quit IRC | 17:38 | |
| sdake | otavio workaround the problem pls | 17:39 |
| sdake | otavio is there a koll abug filed for this issue? | 17:39 |
| otavio | sdake: yes | 17:40 |
| otavio | sdake: https://review.openstack.org/#/c/383865/ | 17:40 |
| otavio | sdake: I was discussing this with dmsimard and https://review.openstack.org/#/c/383865/ seems to be the only option for now | 17:41 |
| sdake | otavio make it happen then ;) | 17:41 |
| otavio | sdake: I restored it, please review | 17:42 |
| sdake | otavio yo uhave a review from jeffrey4l that is outstanding | 17:42 |
| dmsimard | sdake: like I discussed with otavio, splitting expirer into it's own package is an option but we can't realistically backport that to existing stable releases | 17:42 |
| sdake | I think the net result of his review is that you handle the ubuntu case improperly | 17:42 |
| sdake | dmsimard roger i understadn | 17:42 |
| dmsimard | sdake: so it'd be effective >= ocata | 17:42 |
| sdake | dmsimard 9 years at rht, remember - :) | 17:42 |
| otavio | sdake: I did not touch ubuntu case | 17:43 |
| otavio | sdake: so it is kept as it was before, no? | 17:43 |
| dmsimard | sdake: well it's not just that, some stuff we can backport (bugfixes) but this could break deployments so I'd rather keep it trunk | 17:43 |
| otavio | ahhh | 17:43 |
| sdake | dmsimard yup - i know red hat's processes ;) | 17:43 |
| sdake | dmsimard i suffered through them for years and years | 17:43 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla: Ansible config for nova-serialproxy console https://review.openstack.org/358839 | 17:43 |
| dmsimard | sdake: it's not just process, it's common sense :) | 17:43 |
| sdake | dmsimard in this case yes, in many cases no :) | 17:44 |
| dmsimard | sure | 17:44 |
| openstackgerrit | Otavio Salvador proposed openstack/kolla: ansible: swift: Fix swift-object-expirer restart loop https://review.openstack.org/383865 | 17:44 |
| sdake | Jeffrey4l_ can you hve a look at otavio's patch and see if it meets your requirements | 17:45 |
| otavio | dmsimard: splitting it and make it a dependency on openstack-swift-proxy would solve any current deployment | 17:45 |
| *** markt_ has joined #openstack-kolla | 17:45 | |
| sdake | otavio not gonna happen for newton | 17:46 |
| sdake | otavio so lets work around it for nwo | 17:46 |
| otavio | dmsimard: and the dependency could be dropped for O | 17:46 |
| dmsimard | otavio: the end result would be the same, no ? | 17:46 |
| * Jeffrey4l_ is chekcing the PS. | 17:46 | |
| otavio | dmsimard: not in kolla; we cold add this to object container and avoid a new one | 17:46 |
| sdake | otavio it doesn't fit in with rdo's project plans for newton | 17:47 |
| otavio | dmsimard: See the PS I sent | 17:47 |
| sdake | otavio so letss work around it | 17:47 |
| *** markt_ has quit IRC | 17:47 | |
| otavio | sdake: ok | 17:47 |
| dmsimard | otavio: what you're suggesting is to split expirer into it's own package and then add that new package as a requirement on openstack-swift-proxy.. so what's the difference now ? expirer is still installed with swift-proxy ? | 17:47 |
| *** Pavo has quit IRC | 17:47 | |
| dmsimard | trying to understand | 17:47 |
| *** Pavo has joined #openstack-kolla | 17:47 | |
| otavio | dmsimard: it keeps an upgrade path while we can add the new package on our swift-object container (where it belongs) | 17:48 |
| sdake | dmsimard right - that doesn't really solve the problem if they are isomorphic | 17:48 |
| sdake | otavio we have full control over our z stream upgrades - trust me when I say this will be a minor issue to deal with | 17:48 |
| sdake | rather our x stream upgrades | 17:48 |
| sdake | and z stream :) | 17:48 |
| otavio | dmsimard: for N it would be in object and proxy but would offer a seamless transition for us in O | 17:48 |
| dmsimard | sdake: look at you and your complicated words /me looks up isomorphic | 17:49 |
| sdake | dmsimard blame pete | 17:49 |
| otavio | hhehehe | 17:49 |
| sdake | he was the one that threw that in the bug log ;) | 17:49 |
| sdake | i had to look it up as well | 17:49 |
| Jeffrey4l_ | otavio, LGTM. | 17:50 |
| sdake | thanks Jeffrey4l_ | 17:51 |
| *** srwilkers has joined #openstack-kolla | 17:53 | |
| openstackgerrit | Otavio Salvador proposed openstack/kolla: ansible: swift: Fix swift-object-expirer restart loop https://review.openstack.org/383865 | 17:57 |
| otavio | Jeffrey4l_: I sent an amended fix | 17:57 |
| Jeffrey4l_ | otavio, thanks. let's wait for the gate. | 17:58 |
| *** eaguilar has joined #openstack-kolla | 17:58 | |
| *** lamt has joined #openstack-kolla | 17:59 | |
| sdake | the devil went down to george | 18:01 |
| sdake | when he came across this young man and playign a fiddle hot | 18:01 |
| sdake | winning :) | 18:01 |
| sdake | sit down right there in that chair and let me show you how its done ! | 18:02 |
| *** janem has quit IRC | 18:08 | |
| *** lrensing has joined #openstack-kolla | 18:09 | |
| *** dwalsh has quit IRC | 18:09 | |
| *** dwalsh has joined #openstack-kolla | 18:10 | |
| *** bjolo_ has joined #openstack-kolla | 18:11 | |
| *** salv-orlando has quit IRC | 18:19 | |
| *** papacz has joined #openstack-kolla | 18:26 | |
| *** papacz has quit IRC | 18:34 | |
| *** tonanhngo has quit IRC | 18:36 | |
| *** lrensing has quit IRC | 18:36 | |
| *** tonanhngo has joined #openstack-kolla | 18:40 | |
| *** MarMat_ has joined #openstack-kolla | 18:43 | |
| *** MarMat has quit IRC | 18:43 | |
| *** papacz has joined #openstack-kolla | 18:45 | |
| sdake | gbbb | 18:46 |
| *** msimonin has joined #openstack-kolla | 18:46 | |
| *** eaguilar has quit IRC | 18:47 | |
| *** MarMat__ has joined #openstack-kolla | 18:49 | |
| *** MarMat_ has quit IRC | 18:49 | |
| *** mgoddard has quit IRC | 18:52 | |
| jascott1 | hi everyone. trying to build kolla images and looks like ceph.com is down? | 18:54 |
| jascott1 | http://ceph.com/ | 18:55 |
| *** awebber has joined #openstack-kolla | 18:56 | |
| sdake | jascott1 yup ceph is best | 18:57 |
| sdake | bust | 18:57 |
| sdake | jascott1 not sure what irc channel they hang out in but may want to know their website is broken | 18:57 |
| jascott1 | ah good idea | 18:57 |
| jascott1 | posted in there but crickets so far | 19:00 |
| *** msimonin1 has joined #openstack-kolla | 19:01 | |
| *** mgoddard has joined #openstack-kolla | 19:01 | |
| *** msimonin has quit IRC | 19:02 | |
| *** papacz has quit IRC | 19:04 | |
| *** HyperJohnGraham_ has joined #openstack-kolla | 19:05 | |
| sdake | jascott1 give it time :) | 19:06 |
| sdake | jascott1 irc is an async communication solution like mailinglists, but faster ;) | 19:06 |
| jascott1 | haha | 19:06 |
| *** dwalsh has quit IRC | 19:07 | |
| jascott1 | someone in ceph posted this | 19:07 |
| jascott1 | http://www.dreamhoststatus.com/2016/10/11/dreamcompute-us-east-1-cluster-service-disruption/ | 19:07 |
| *** dwalsh has joined #openstack-kolla | 19:07 | |
| *** eaguilar has joined #openstack-kolla | 19:08 | |
| *** dwalsh has quit IRC | 19:09 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kolla: Updated from global requirements https://review.openstack.org/385127 | 19:09 |
| *** dwalsh has joined #openstack-kolla | 19:10 | |
| *** pbourke has quit IRC | 19:10 | |
| *** pbourke has joined #openstack-kolla | 19:11 | |
| *** berendt has joined #openstack-kolla | 19:11 | |
| awebber | anyone familiar with this glance error when uploading an image to an external CEPH "ERROR glance.common.wsgi FunctionNotSupported: error creating image - File "rbd.pyx", line 528, in rbd.RBD.create (/build/ceph-10.2.3/src/build/rbd.c:3487)' | 19:12 |
| *** srwilkers has quit IRC | 19:13 | |
| *** lrensing has joined #openstack-kolla | 19:13 | |
| *** srwilkers has joined #openstack-kolla | 19:14 | |
| *** srwilkers has quit IRC | 19:15 | |
| *** srwilkers has joined #openstack-kolla | 19:15 | |
| *** bjolo_ has quit IRC | 19:22 | |
| *** papacz has joined #openstack-kolla | 19:32 | |
| *** papacz has quit IRC | 19:36 | |
| sdake | awebber ya - we think ceph is broken at present | 19:41 |
| sdake | awebber we are working on fixing our implmeentation thereof | 19:41 |
| sdake | awebber appears to be a packaging issue with our consumption thereof | 19:41 |
| *** salv-orlando has joined #openstack-kolla | 19:42 | |
| sdake | awebber but you must be sure to use jewel - are you using jewel? | 19:42 |
| awebber | @sdake i am using 3.0.0.0rc1 | 19:44 |
| awebber | sdake 3.0.0.0rc1 (sorry new to irc) | 19:46 |
| *** dave-mccowan has quit IRC | 19:48 | |
| sdake | awebber cool new to irc- your doing a fantstic job :) | 19:49 |
| sdake | awebber we are tagging rc2 - i am hoepful this bug makes that release candidate | 19:50 |
| sdake | awebber thats in about 12-15 hours | 19:50 |
| sdake | awebber but for jewel - i meant your external ceph | 19:50 |
| sdake | is it jewel or hammer or some other version? | 19:51 |
| awebber | sdake ceph version 0.94.3 (95cefea9fd9ab740263bf8bb4796fd864d9afe2b) | 19:51 |
| *** lamt has quit IRC | 19:51 | |
| sdake | is that jewel | 19:51 |
| sdake | lots of version numbers in this project ;-) | 19:51 |
| awebber | sdake google says hammer | 19:52 |
| sdake | that may or may not be a problem | 19:53 |
| sdake | is it hard to setup jewel in your environment for a quick test? | 19:53 |
| awebber | sdake yes, quite, i wonder if there is any minimum versions required for openstack integration or if the compatablity to kept with the rbd protocol | 19:53 |
| sdake | the libraries used in our containers are for jewel | 19:54 |
| sdake | as for rbd protocol with ceph clients, i don't know enough about their versioning to know if they maintain protocol compatibility | 19:54 |
| sdake | myguess is no | 19:54 |
| *** haplo37_ has quit IRC | 19:54 | |
| awebber | sdake we early adopted the "we dont recommend rolling out ceph in containers" approach back then and i am testing an installation on that version (in production) | 19:54 |
| sdake | awebber you are awre kolla has ceph built in? | 19:55 |
| awebber | sdake yes but i cant wipe my production ceph cluster, i either need to upgrade it or hope that kolla works on that version | 19:56 |
| sdake | it appears broken atm - but just wanted to let you know we have that built in vs external ceph | 19:56 |
| sdake | awebber roger | 19:56 |
| sdake | awebber the advantage of internal ceph is that upgrades/etc all work | 19:56 |
| sdake | the disadvantage is less management control | 19:56 |
| awebber | sdake the external ceph seems to be working in that it correctly shows the remaining storage in horizon | 19:56 |
| *** mliima_ has quit IRC | 19:56 | |
| *** haplo37_ has joined #openstack-kolla | 19:57 | |
| sdake | awebber so you think its just a glance problem then? | 19:57 |
| awebber | sdake i guess i need a simple tool that just trys to insert "hello world.txt" into the external ceph to verify permissions/etc. | 19:58 |
| *** lrensing has quit IRC | 19:58 | |
| sdake | awebber i have no doubt your ceph version works | 19:58 |
| sdake | the question is does it work with the libraries(clients) from jewel | 19:58 |
| awebber | sdake we use the gateway (S3 compatible) to interface with ceph. | 19:58 |
| sdake | kolla doesn't use the s3 to interface, we use the libraries directly | 19:59 |
| awebber | sdake i guess some libraries are fine because they can how the correct storage status in horizon | 19:59 |
| sdake | ya thats the mon protocool | 20:00 |
| sdake | the questoin is around rbd protocol (which is what is used in glance) | 20:00 |
| sdake | awebber do you hae extra geary ou could test a jewel cluster in? | 20:00 |
| sdake | (without wiping out what you have) | 20:01 |
| *** srwilkers has quit IRC | 20:01 | |
| awebber | sdake i have a bare metal lab that has a pre-installed ceph which i am currently deploying kolla to. I can take a couple of days investigating upgrading from 0.94 to jewel, and then hope kolla will deploy successfully. Or I can focus on investing kolla on 0.94.... | 20:03 |
| *** lrensing has joined #openstack-kolla | 20:03 | |
| *** eaguilar_ has joined #openstack-kolla | 20:04 | |
| awebber | sdake i can understand from your point of view it would make little sense to have to support really old versions of ceph. at some point that should probably be a document stating a minimum required external ceph version | 20:04 |
| awebber | sdake however at this stage its difficult to say if its kolla or kolla not being able to integrate with 0.94 | 20:05 |
| sdake | awebber totally agree it should be documented | 20:05 |
| *** eaguilar has quit IRC | 20:05 | |
| sdake | awebber for some reason i thought hammer was 0.84 | 20:05 |
| awebber | sdake for some reason i cannot reach ceph.com so google says "ceph.com/releases/v0-94-hammer-released/" | 20:06 |
| sdake | i can't reach ceph.com either | 20:06 |
| sdake | their website is busted | 20:06 |
| sdake | if you use centos - this problem doesn't happen since we build fro the cloud sig's work product | 20:07 |
| awebber | sdake oh great i thought i was crazy - cant be a storage issue ;-) | 20:07 |
| awebber | sdake i guess i will have to bite the bullet and investigate upgrading my ceph cluster to maintain compatablity with your project | 20:08 |
| sdake | well its not my project | 20:08 |
| sdake | as far as upgrading goes, there are people in this channel that can help but this is kind of downtime for our contribs | 20:08 |
| sdake | 1-4pm pst seems slow | 20:09 |
| awebber | sdake i think we conducted some research in this area but we got laze as there was little demand for us to upgrade ceph. | 20:09 |
| sdake | ya why fix what isn't broken ;-) | 20:10 |
| awebber | sdake with the kolla external ceph integration finally here we decided to give it a try... | 20:10 |
| sdake | he laid that golden fiddle at the ground of johnnie's feet | 20:10 |
| HyperJohnGraham | :) | 20:11 |
| awebber | sdake yes, it didnt occur to use that in order to use the feature we may need to upgrade our ceph cluster. we were betting on a "freeze" at the protocol level | 20:11 |
| sdake | awebber who knows the protocol might be frozen | 20:12 |
| sdake | awebber ceph irc channel should be able to answer that | 20:12 |
| sdake | awebber having developed protocols for over 10 years | 20:12 |
| awebber | sdake that would be may bet as there are probably alot of programs that cant be upgraded that use the protocol | 20:12 |
| sdake | I can tell you, there is no such thing as a protocol freeze with binary protocols ;) | 20:12 |
| sdake | a proper protocol can be mathmatically proven | 20:13 |
| sdake | ceph hasnt done this | 20:13 |
| sdake | not many people do with many protocols | 20:13 |
| sdake | and it ends up haunting them later :) | 20:13 |
| sdake | (or their operators more likely) | 20:13 |
| awebber | sdake i think this is why people prefer the gateway (S3 - rest) interface | 20:14 |
| sdake | ya - that doesn't work with openstack integration | 20:14 |
| sdake | rest api solves the protocol freeze problem for sure | 20:14 |
| sdake | makes performance pokey | 20:15 |
| awebber | sake the protocol just gets upgraded in one place at the gateway level | 20:15 |
| * sdake likes sake | 20:15 | |
| awebber | sdake this is why i am holding out on grpc vs REST ;) | 20:15 |
| sdake | we use rbd protcool exclusively in kolla for storage - the rest api in ceph pretty sure is not integrated into openstack | 20:16 |
| sdake | i traced my foorptints through the sand the other day | 20:19 |
| sdake | man this cat has a good comprehension of life ;) | 20:19 |
| awebber | sdake thanks for your help - will ask the #ceph guys about the protocol and if there are any versioning concepts/issues. | 20:20 |
| awebber | sdake i will also test your build in 12 hours | 20:20 |
| sdake | awebber cool do report back pls ;) | 20:20 |
| awebber | sdake sure, awesome project | 20:22 |
| sdake | awebber thanks - the developers and operators contributing to this project are what make it fantastic | 20:24 |
| sdake | win one for diverse:affiliation | 20:24 |
| *** lamt has joined #openstack-kolla | 20:26 | |
| *** inc0 has joined #openstack-kolla | 20:28 | |
| inc0 | hey | 20:29 |
| *** HyperJohnGraham_ has quit IRC | 20:29 | |
| sdake | inc0 sup | 20:29 |
| sdake | inc0 awebber has a question for you re compatibility between jewel and an external hammer | 20:29 |
| sdake | between our jewel clients that is | 20:30 |
| *** lrensing has quit IRC | 20:30 | |
| inc0 | shouldn't really matter, since we'll install jewel clients it should just work | 20:30 |
| sdake | inc0 there is some question if the jewel clients are compatible with the hammer server | 20:31 |
| sdake | awebber can you link your output for glance load | 20:31 |
| inc0 | I haven't tested that | 20:31 |
| *** HyperJohnGraham_ has joined #openstack-kolla | 20:32 | |
| *** gfidente has quit IRC | 20:32 | |
| sdake | inc0 right | 20:33 |
| sdake | i suspect nobody has | 20:34 |
| sdake | awebber said he may be able to setup a jewel cluster to see if external ceph works | 20:34 |
| sdake | i think he said hat | 20:34 |
| sdake | ;) | 20:34 |
| inc0 | if it doesn't pretty easy to fix | 20:34 |
| sdake | how so | 20:35 |
| inc0 | just install hammer ceph client - possible with template customization or custom sources.list for ubuntu | 20:35 |
| inc0 | we didn't really change anything on client conf side | 20:36 |
| sdake | except the versions of the clients.. | 20:36 |
| sdake | and allthe code that goes with it | 20:36 |
| sdake | librados etc | 20:36 |
| inc0 | we didn't change anything besides versions | 20:37 |
| *** sdake_ has joined #openstack-kolla | 20:39 | |
| *** dwalsh has quit IRC | 20:39 | |
| otavio | Jeffrey4l_: gate went alright, it seems | 20:41 |
| *** sdake has quit IRC | 20:41 | |
| otavio | sdake_: o/ | 20:41 |
| *** dwalsh has joined #openstack-kolla | 20:41 | |
| *** jtriley has quit IRC | 20:43 | |
| *** salv-orl_ has joined #openstack-kolla | 20:43 | |
| *** salv-orlando has quit IRC | 20:46 | |
| *** inc0 has quit IRC | 20:47 | |
| *** dwalsh_ has joined #openstack-kolla | 20:48 | |
| *** dwalsh has quit IRC | 20:49 | |
| *** sdake has joined #openstack-kolla | 20:51 | |
| *** jheroux has quit IRC | 20:51 | |
| sdake | sup otavio | 20:52 |
| *** sdake_ has quit IRC | 20:53 | |
| awebber | sdake "awebber can you link your output for glance load" what does this mean :) should i pastebin some logs? | 21:01 |
| sdake | awebber ya - file a bug too while your about it :) | 21:02 |
| sdake | awebber i wanted to show to inc0 but h eis gone | 21:02 |
| awebber | sdake yes i could test a jewel cluster, would need some time... | 21:02 |
| sdake | inc0 did our jewel transition | 21:02 |
| sdake | hes the guy to talk to on that topic | 21:02 |
| *** kbyrne has quit IRC | 21:04 | |
| awebber | sdake http://pastebin.com/LVs8SyyZ | 21:05 |
| sdake | awebber meeting now - bbi1hr | 21:05 |
| *** janem has joined #openstack-kolla | 21:05 | |
| *** kbyrne has joined #openstack-kolla | 21:10 | |
| *** janem has quit IRC | 21:10 | |
| *** eaguilar_ has quit IRC | 21:14 | |
| *** portdirect has quit IRC | 21:18 | |
| *** salv-orl_ has quit IRC | 21:18 | |
| *** janem has joined #openstack-kolla | 21:26 | |
| *** ppalacios has quit IRC | 21:31 | |
| *** haplo37 has quit IRC | 21:36 | |
| *** g3ek has quit IRC | 21:36 | |
| *** dwalsh_ has quit IRC | 21:41 | |
| *** haplo37 has joined #openstack-kolla | 21:45 | |
| *** g3ek has joined #openstack-kolla | 21:45 | |
| *** salv-orlando has joined #openstack-kolla | 21:48 | |
| openstackgerrit | Qin Wang (qwang) proposed openstack/kolla-kubernetes: Add ansible support for nova service https://review.openstack.org/385170 | 21:50 |
| *** janem has quit IRC | 21:51 | |
| *** janem has joined #openstack-kolla | 21:52 | |
| *** zigo has quit IRC | 22:02 | |
| *** zigo has joined #openstack-kolla | 22:05 | |
| *** zigo is now known as Guest50630 | 22:05 | |
| kfox1111 | sbezverk_: you there? | 22:09 |
| *** janem has quit IRC | 22:09 | |
| *** neilus has joined #openstack-kolla | 22:30 | |
| *** mgoddard has quit IRC | 22:32 | |
| *** neilus has quit IRC | 22:32 | |
| *** neilus has joined #openstack-kolla | 22:32 | |
| *** neil has joined #openstack-kolla | 22:35 | |
| *** neil is now known as Guest59741 | 22:35 | |
| *** berendt has quit IRC | 22:35 | |
| *** neilus has quit IRC | 22:36 | |
| *** lamt has quit IRC | 22:45 | |
| *** awebber has quit IRC | 22:48 | |
| *** vhosakot has quit IRC | 22:52 | |
| *** msimonin1 has quit IRC | 22:52 | |
| *** msimonin has joined #openstack-kolla | 22:52 | |
| *** Guest59741 has quit IRC | 22:53 | |
| *** mtaylor22 has joined #openstack-kolla | 22:53 | |
| mtaylor22 | hello ! | 22:53 |
| *** rhallisey has quit IRC | 23:03 | |
| *** haplo37_ has quit IRC | 23:03 | |
| *** MarMat__ has quit IRC | 23:04 | |
| *** MarMat_ has joined #openstack-kolla | 23:04 | |
| *** haplo37_ has joined #openstack-kolla | 23:05 | |
| *** msimonin has left #openstack-kolla | 23:07 | |
| sdake | yo peeps | 23:09 |
| sdake | hey mtaylor22 | 23:09 |
| sdake | ok dinner time bbl | 23:15 |
| *** sdake has quit IRC | 23:16 | |
| *** HyperJohnGraham_ has quit IRC | 23:21 | |
| mtaylor22 | sup | 23:26 |
| mtaylor22 | back from japan now :) | 23:26 |
| *** david-lyle has joined #openstack-kolla | 23:31 | |
| *** david-lyle has quit IRC | 23:34 | |
| *** david-lyle has joined #openstack-kolla | 23:35 | |
| *** salv-orlando has quit IRC | 23:35 | |
| *** bachp has quit IRC | 23:36 | |
| *** david-lyle has quit IRC | 23:38 | |
| *** david-lyle has joined #openstack-kolla | 23:39 | |
| *** lamt has joined #openstack-kolla | 23:39 | |
| *** tonanhngo has quit IRC | 23:43 | |
| *** williamc_ has quit IRC | 23:43 | |
| *** zhurong has joined #openstack-kolla | 23:45 | |
| *** bachp has joined #openstack-kolla | 23:46 | |
| *** david-lyle has quit IRC | 23:49 | |
| *** williamcaban has joined #openstack-kolla | 23:49 | |
| *** sdake has joined #openstack-kolla | 23:50 | |
| *** sdake_ has joined #openstack-kolla | 23:51 | |
| *** tonanhngo has joined #openstack-kolla | 23:55 | |
| *** sdake has quit IRC | 23:55 | |
| *** rkrum has joined #openstack-kolla | 23:56 | |
| *** jtriley has joined #openstack-kolla | 23:56 | |
| *** tonanhngo_ has joined #openstack-kolla | 23:57 | |
| *** tonanhngo has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!