Wednesday, 2017-07-05

*** manheim has joined #openstack-kolla00:02
*** japestinho has joined #openstack-kolla00:13
*** rwallner has joined #openstack-kolla00:19
openstackgerritMerged openstack/kolla-ansible master: Fix bootstrap-servers with invalid api_interface  https://review.openstack.org/43494000:21
*** ddyer2 has joined #openstack-kolla00:21
*** ddyer2 has quit IRC00:22
*** ddyer has quit IRC00:23
*** caoyuan has joined #openstack-kolla00:25
*** ducttape_ has joined #openstack-kolla00:31
*** ducttape_ has quit IRC00:36
*** ddyer has joined #openstack-kolla00:36
*** caoyuan has quit IRC00:37
*** iniazi has joined #openstack-kolla00:39
*** iniazi_ has quit IRC00:42
*** tovin07_ has joined #openstack-kolla00:45
*** cuongnv has joined #openstack-kolla00:48
*** manheim has quit IRC00:57
openstackgerritMerged openstack/kolla-ansible master: Neutron: nova_metadata_ip property is deprecated  https://review.openstack.org/47844601:05
*** goldyfruit has joined #openstack-kolla01:09
*** huzhengchuan has joined #openstack-kolla01:29
*** kevzha01 has joined #openstack-kolla01:31
*** kevzha01 is now known as kevinz01:33
*** tovin07__ has joined #openstack-kolla01:37
*** cuongnv_ has joined #openstack-kolla01:37
*** cuongnv has quit IRC01:39
*** tovin07_ has quit IRC01:39
*** caoyuan has joined #openstack-kolla01:41
*** goldyfruit has quit IRC01:50
*** manheim has joined #openstack-kolla02:01
openstackgerritNoboru Iwamatsu proposed openstack/kolla master: Add designate dashboard to horizon ubuntu/binary  https://review.openstack.org/48032502:01
*** manheim has quit IRC02:05
*** Pavo has quit IRC02:09
*** cuongnv_ is now known as cuongnv02:12
*** zhurong has joined #openstack-kolla02:12
openstackgerritjangseon ryu proposed openstack/kolla-ansible master: The external_ceph_cephx_enabled option is duplicated in the global.yml. So one of them was deleted.  https://review.openstack.org/48032802:31
*** ducttape_ has joined #openstack-kolla02:33
*** ducttape_ has quit IRC02:37
openstackgerritjangseon ryu proposed openstack/kolla-ansible master: The external_ceph_cephx_enabled option is duplicated in the global.yml. So one of them was deleted.  https://review.openstack.org/48032902:39
*** japestinho has quit IRC02:43
*** zhubingbing has joined #openstack-kolla02:44
*** dixiaoli has joined #openstack-kolla02:52
*** ipsecguy has quit IRC03:07
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Fix field data is too large  https://review.openstack.org/47636703:07
*** ipsecguy has joined #openstack-kolla03:11
*** mdnadeem has joined #openstack-kolla03:40
openstackgerritshaofeng cheng proposed openstack/kolla-ansible master: Add block_device_allocate_retries config option  https://review.openstack.org/47911903:47
zhubingbingHi guys04:03
spsuryagood morning04:04
spsuryasup zhubingbing04:04
zhubingbinghi spusurya04:05
zhubingbing;)04:05
masberhi, I need to check if the sr-iov drivers are loaded to the database, I checked the /etc/kolla/passwords.yml but can't find the password for mariadb?04:07
duonghqhi zhubingbing spsurya04:08
zhubingbingmasber04:08
zhubingbingu can04:08
*** lpetrut has joined #openstack-kolla04:09
zhubingbingU can cat /etc/password.yml | grep mariadb04:09
masberzhubingbing, cat /etc/kolla/passwords.yml | grep mariadb shows nothing04:11
*** kolla-slack1 has quit IRC04:11
*** kolla-slack has joined #openstack-kolla04:11
masberI am checking the deployment node where I run my kolla-ansible commands, is that the right place?04:12
zhubingbingkolla-genpwd04:12
*** spsurya has quit IRC04:12
*** lpetrut has quit IRC04:12
*** spsurya has joined #openstack-kolla04:12
zhubingbingrun this command kolla-genpwd04:12
masberdone04:13
masberstill same04:14
zhubingbing[root@control01 ~]# cat /etc/kolla/passwords.yml | grep database04:19
zhubingbingdatabase_password:04:19
zhubingbingsorry04:19
*** lpetrut has joined #openstack-kolla04:19
zhubingbingdatabse_password  it is mariadb password04:19
zhubingbingsorry04:19
masberthank you!04:20
masberfound it04:20
zhubingbingspusurya04:20
zhubingbingCan u review it ? https://review.openstack.org/#/c/476367/04:21
*** yuanying has joined #openstack-kolla04:21
*** yuanying_ has quit IRC04:21
spsuryazhubingbing: sure I will04:29
zhubingbingthanks04:29
*** ducttape_ has joined #openstack-kolla04:31
*** janki has joined #openstack-kolla04:31
*** ducttape_ has quit IRC04:35
spsuryazhubingbing: done04:35
spsuryasup duonghq04:36
zhubingbing3q04:41
*** jamesbenson has joined #openstack-kolla04:50
*** yangyapeng has joined #openstack-kolla04:50
openstackgerritjangseon ryu proposed openstack/kolla-ansible master: Removing deplicated option from global.yml file.  https://review.openstack.org/48032904:52
*** kevinz has quit IRC04:53
*** yangyapeng has quit IRC04:57
*** yangyapeng has joined #openstack-kolla04:58
*** dixiaoli has quit IRC05:00
*** lpetrut has quit IRC05:02
*** yangyapeng has quit IRC05:05
*** yangyapeng has joined #openstack-kolla05:06
*** yangyape_ has joined #openstack-kolla05:07
*** prateek has joined #openstack-kolla05:07
*** jamesbenson has quit IRC05:09
*** jamesbenson has joined #openstack-kolla05:10
*** yangyapeng has quit IRC05:11
*** ducttape_ has joined #openstack-kolla05:11
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix outdated barbican-api-paste.ini file  https://review.openstack.org/46993905:14
*** jamesbenson has quit IRC05:14
*** ducttape_ has quit IRC05:16
*** yangyape_ has quit IRC05:20
*** yangyapeng has joined #openstack-kolla05:21
*** skramaja has joined #openstack-kolla05:21
*** lpetrut has joined #openstack-kolla05:25
*** dixiaoli has joined #openstack-kolla05:27
masberhi, is Derek Ditch around?05:37
masberI was wondering whether I could ask him a couple of questions regarding this document he wrote https://review.openstack.org/gitweb?p=openstack/kolla.git;a=commitdiff;h=840b73181eaaae2e29565f245ccf25b046da89be05:37
*** yangyapeng has quit IRC05:40
*** yangyapeng has joined #openstack-kolla05:41
*** jamesbenson has joined #openstack-kolla05:55
*** jamesbenson has quit IRC05:59
*** Teck72 has joined #openstack-kolla06:01
*** Teck7 has quit IRC06:05
*** serlex has joined #openstack-kolla06:21
*** lpetrut has quit IRC06:27
*** magicboiz has joined #openstack-kolla06:32
*** jamesbenson has joined #openstack-kolla06:36
*** magicboiz has quit IRC06:37
openstackgerritshaofeng cheng proposed openstack/kolla-ansible master: Change destroy confirmation string  https://review.openstack.org/48036706:39
*** jamesbenson has quit IRC06:41
*** lpetrut has joined #openstack-kolla06:50
openstackgerritJuan Badia Payno proposed openstack/kolla master: Changed fluentd repository for CentOS  https://review.openstack.org/46721906:53
*** rwsu has joined #openstack-kolla07:00
*** mgoddard_ has joined #openstack-kolla07:09
*** ducttape_ has joined #openstack-kolla07:12
*** shardy has joined #openstack-kolla07:16
*** lpetrut has quit IRC07:16
*** caoyuan has quit IRC07:16
*** ducttape_ has quit IRC07:17
*** mgoddard_ has quit IRC07:18
*** lpetrut has joined #openstack-kolla07:23
*** yuanying has quit IRC07:31
*** lpetrut has quit IRC07:32
*** yuanying has joined #openstack-kolla07:37
*** oanson has quit IRC07:38
*** oanson has joined #openstack-kolla07:38
*** egonzalez has joined #openstack-kolla07:39
*** reidrac has joined #openstack-kolla07:42
*** serlex has quit IRC07:56
*** manheim has joined #openstack-kolla08:06
openstackgerritJuan J. Martínez proposed openstack/kolla-ansible master: Upgrade dev environment from docker-py to docker  https://review.openstack.org/48040008:08
reidracre: https://review.openstack.org/480400 I had problems to push images in the dev environment using master and docker-py; installing docker python package fixes the issue08:10
*** manheim has quit IRC08:15
*** mgoddard_ has joined #openstack-kolla08:18
*** shardy is now known as shtab08:27
*** shtab is now known as shardy08:27
*** gfidente has joined #openstack-kolla08:34
*** gfidente has quit IRC08:34
*** gfidente has joined #openstack-kolla08:34
openstackgerritMartin André proposed openstack/kolla master: Add new --skip-existing option to kolla-build  https://review.openstack.org/47988108:38
openstackgerritMartin André proposed openstack/kolla master: Fix mock order  https://review.openstack.org/48043408:38
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: WIP remove docker-py  https://review.openstack.org/48043808:39
*** yangyape_ has joined #openstack-kolla08:42
*** magicboiz has joined #openstack-kolla08:43
*** yangyape_ has quit IRC08:46
*** magicboiz has quit IRC08:46
*** yangyapeng has quit IRC08:46
*** yangyapeng has joined #openstack-kolla08:48
*** magicboiz has joined #openstack-kolla08:53
*** tvignaud has quit IRC08:57
*** yangyapeng has quit IRC08:59
*** yangyapeng has joined #openstack-kolla09:00
*** jamesbenson has joined #openstack-kolla09:01
*** yangyapeng has quit IRC09:04
*** yangyapeng has joined #openstack-kolla09:05
*** magicboiz has quit IRC09:05
*** jamesbenson has quit IRC09:06
Seyongkeystone is not installing on CentOS with this error: failed for volume "keystone-fernet-keys" : secrets "keystone-fernet-keys" not found09:08
Seyongbut in Ubuntu works09:09
Seyongdo you have any idea?09:09
*** tvignaud has joined #openstack-kolla09:09
*** ducttape_ has joined #openstack-kolla09:13
egonzalezSeyong, by installing means build images or deploy containers?09:15
*** ducttape_ has quit IRC09:17
*** sambetts|afk is now known as sambetts09:18
*** omenv has quit IRC09:22
*** jamesbenson has joined #openstack-kolla09:22
*** Pavo has joined #openstack-kolla09:24
*** jamesbenson has quit IRC09:26
*** magicboiz has joined #openstack-kolla09:33
*** magicboiz has quit IRC09:37
*** magicboiz has joined #openstack-kolla09:37
*** dixiaoli has quit IRC09:38
*** jamesbenson has joined #openstack-kolla09:43
*** jamesbenson has quit IRC09:47
*** rwallner has quit IRC09:54
*** rwallner has joined #openstack-kolla09:54
*** yangyapeng has quit IRC09:55
*** yangyapeng has joined #openstack-kolla09:55
*** manheim has joined #openstack-kolla09:55
*** serlex has joined #openstack-kolla09:56
*** rwallner has quit IRC09:59
*** manheim has quit IRC10:00
reidracegonzalez: I get those "unregister_netdevice: waiting for lo to become free. Usage count = 1" quite frequently on the operator when I'm building the images10:02
reidracit doesn't seem to have any effect on CentOS, but in SUSE sometimes kills container connectivity as described in https://github.com/moby/moby/issues/561810:02
reidracwhen you saw those, was it in other nodes or just building images as in my case?10:03
*** jamesbenson has joined #openstack-kolla10:04
*** omenv has joined #openstack-kolla10:04
*** Pavo has quit IRC10:05
*** jamesbenson has quit IRC10:08
*** manheim has joined #openstack-kolla10:10
openstackgerritMerged openstack/kolla master: Add IPV6 radvd package to neutron-l3-agent  https://review.openstack.org/47978810:11
*** omenvl has joined #openstack-kolla10:11
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: WIP: Change zun storage to etcd  https://review.openstack.org/48049710:11
*** yangyapeng has quit IRC10:12
*** manheim has quit IRC10:12
*** manheim has joined #openstack-kolla10:12
*** cuongnv has quit IRC10:14
*** omenv has quit IRC10:14
*** bmace has quit IRC10:19
*** bmace has joined #openstack-kolla10:19
*** schwicht has quit IRC10:21
*** jamesbenson has joined #openstack-kolla10:24
*** schwicht has joined #openstack-kolla10:25
*** tovin07__ has quit IRC10:28
*** jamesbenson has quit IRC10:29
openstackgerritMerged openstack/kolla master: Add designate dashboard to horizon ubuntu/binary  https://review.openstack.org/48032510:39
*** zhurong has quit IRC10:45
*** pbourke has quit IRC10:48
*** pbourke has joined #openstack-kolla10:49
*** rwallner has joined #openstack-kolla10:56
*** schwicht has quit IRC11:01
*** shardy is now known as shardy_lunch11:08
pbourkeegonzalez: hey eduardo, wondering have you done an upgrade of openvswitch in kolla recently?11:27
egonzalezpbourke, yes11:33
openstackgerritsean mooney proposed openstack/kolla master: introduces support for the OVS DPDK dataplane  https://review.openstack.org/34235411:35
*** schwicht has joined #openstack-kolla11:39
openstackgerritsean mooney proposed openstack/kolla master: enable the kolla build system to use out of tree docker files  https://review.openstack.org/46613211:58
*** yangyapeng has joined #openstack-kolla12:02
*** yangyapeng has quit IRC12:07
*** caoyuan has joined #openstack-kolla12:09
*** goldyfruit has joined #openstack-kolla12:12
*** goldyfruit has quit IRC12:12
*** bmace has quit IRC12:16
*** bmace has joined #openstack-kolla12:16
*** schwicht has quit IRC12:20
*** hrw has quit IRC12:26
*** dims has quit IRC12:29
pbourkeegonzalez: im finding its dropping the bridges when the new container comes up12:30
pbourkeegonzalez: like br-tun, br-ex, etc. Not sure if you've seen anything like that12:30
egonzalezpbourke, all bridges?12:31
pbourkeegonzalez: yeah12:31
egonzalezlet me try12:31
pbourkeegonzalez: from what I can see that state is kept in /etc/openvswitch/conf.db in the openvswitch_db container. That file isn't under a volume so Im unsure how its working for others12:31
*** hrw has joined #openstack-kolla12:32
egonzalezactually, does mariadb upgrade worked for you? from ocata->master fails to me12:32
pbourkeegonzalez: hmm have not tested that yet12:33
*** rhallisey has joined #openstack-kolla12:33
*** ansmith has joined #openstack-kolla12:34
*** mdnadeem has quit IRC12:35
*** ducttape_ has joined #openstack-kolla12:36
*** yangyapeng has joined #openstack-kolla12:37
*** shardy_lunch is now known as shardy12:41
*** ducttape_ has quit IRC12:41
egonzalezpbourke, conf.db should be at /var/lib/openvswitch which is a volume https://github.com/openstack/kolla/blob/master/docker/openvswitch/openvswitch-db-server/start_ovsdb_server.sh#L2912:42
egonzalezcheck this change from Dec 2016 https://github.com/openstack/kolla/commit/f62b16f8a447b7c90da3844720a200fb4d3ef5d512:42
pbourkeegonzalez: great find let me check that thanks12:42
*** dims has joined #openstack-kolla12:44
*** omenvl has quit IRC12:48
*** daidv_ has joined #openstack-kolla12:49
*** mattmceuen has quit IRC12:51
*** caoyuan has quit IRC12:53
*** daidv_ has left #openstack-kolla12:56
*** skramaja has quit IRC12:59
*** lucasxu has joined #openstack-kolla13:00
*** goldyfruit has joined #openstack-kolla13:01
openstackgerritAndy Smith proposed openstack/kolla-ansible master: Add qdrouterd role for messaging infrastructure component  https://review.openstack.org/46946213:03
*** schwicht has joined #openstack-kolla13:04
openstackgerritMerged openstack/kolla-ansible master: Fix outdated barbican-api-paste.ini file  https://review.openstack.org/46993913:04
*** keico has joined #openstack-kolla13:04
openstackgerritMerged openstack/kolla-ansible master: Removing deplicated option from global.yml file.  https://review.openstack.org/48032913:09
*** omenvl has joined #openstack-kolla13:09
*** denaitre has joined #openstack-kolla13:10
*** omenvlad has joined #openstack-kolla13:10
*** omenvl has quit IRC13:13
*** zhubingbing has quit IRC13:15
keicoHello. I'm trying to deploy an Openstack (ocata) cloud using Kolla-ansible (version 4.0.2). Currently, on the control01 node, my mariadb Docker container fails to start.13:20
keicoThe following are the errors I received from /var/log/kolla/mariadb/mariadb.log:13:20
*** caoyuan has joined #openstack-kolla13:21
keico[ERROR] Can't open the mysql.plugin table. Please run mysql_upgrade to create it. [Warning] Failed to load slave replication state from table mysql.gtid_slave_pos: 1146: Table 'mysql.gtid_slave_pos' doesn't exist [ERROR] Can't open and lock privilege tables: Table 'mysql.servers' doesn't exist [Note] Server socket created on IP: 'x.x.x.x'. Fatal error: Can't open and lock privilege tables: Table 'mysql.user' doesn't exist13:21
keicomysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended13:22
keicoDoes anyone know what causes these errors and how to resolve it?13:22
*** jtriley has joined #openstack-kolla13:25
reidraclooks like maridb db wasn't bootstrapped13:25
keicoSo, I followed this instruction doc as my starting point: https://docs.openstack.org/project-deploy-guide/kolla-ansible/ocata/multinode.html. I was able to build the kolla Docker images with tag 4.0.2 and pushed them to my private docker registry. So, @reidrac, do you know how to bootstrap the mariadb database?13:30
reidrackolla-ansible deploy should do it13:31
reidracit it didn't happen, you should have errors13:31
keicoThis is the errors I received, after running: kolla-ansible deploy -i ./multinode command:13:33
keicoTASK [mariadb : Waiting for MariaDB service to be ready] **************************************************************************************************** FAILED - RETRYING: Waiting for MariaDB service to be ready (10 retries left). FAILED - RETRYING: Waiting for MariaDB service to be ready (9 retries left). FAILED - RETRYING: Waiting for MariaDB service to be ready (8 retries left). FAILED - RETRYING: Waiting for MariaDB13:33
reidracso mariadb didn't start13:34
keicoFAILED - RETRYING: Waiting for MariaDB service to be ready (1 retries left).13:34
keicofatal: [control01]: FAILED! => {"attempts": 10, "changed": false, "elapsed": 60, "failed": true, "msg": "Timeout when waiting for search string MariaDB in x.x.x.x:3306"}         to retry, use: --limit @/usr/share/kolla-ansible/ansible/site.retry13:34
reidracgo to control01 and check docker logs mariadb13:34
sdakemorning pbourke eglute_s13:34
sdakeegonzalez :)13:34
keicoyes. That's exactly what I did.13:34
reidrac(check with docker ps that it has the expected containers)13:34
egonzalezmorning sdake13:34
pbourkesdake: o/13:34
reidracand it complains about the tables not being there13:35
keicoIt looks like on the control01 node, the mariadb container keeps restarting.13:35
reidrackeico: yep, take a look at /var/lib/docker/volumes/kolla_logs/_data/mariadb/mariadb.log13:35
reidracIIRC there's a bootstrap_mariadb container; does it showin docker ps -a?13:37
keicoThese are the last messages I see from this log:13:38
keicoERROR] Can't open the mysql.plugin table. Please run mysql_upgrade to create it.13:38
keico[Warning] Failed to load slave replication state from table mysql.gtid_slave_pos: 1146: Table 'mysql.gtid_slave_pos' doesn't exist13:38
sdakekeico first off - if a deploy craters, you ahve to start fresh13:38
keico[ERROR] Can't open and lock privilege tables: Table 'mysql.servers' doesn't exist13:38
reidracthat sounds like a consequence of the boostrap failing13:38
keico[Note] Server socket created on IP: 'x.x.x.x'.13:39
keico[ERROR] Fatal error: Can't open and lock privilege tables: Table 'mysql.user' doesn't exist13:39
sdakekeico ansibel has no way of knowing if the deployment you have was valid or wasn't13:39
keico mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended13:39
sdakekeico what i'd suggest is a) kolla-ansible destroy13:39
sdakeb) kolla-ansible prechecks13:39
sdakefix whatever b turn up13:39
sdakekolla-ansible deploy13:39
keicowait a min. So,  there's a bootstrap_mariadb container? Is it supposed to run on the control01 node as well?13:40
sdakekeico there are a bunch off bootstrap_* containers13:40
sdakethey are run per service13:40
sdakemariadb has one13:40
egonzalezkeico, bootstrap_mariadb runs in the first mariadb node in inventory13:40
egonzalezcheck logs with docker logs bootstrap_mariadb13:41
sdakethe bootstrap service doe the initial setup of the service (create databases, create users, create keystone creds, etc)13:41
keicoGot it.13:41
*** zhurong has joined #openstack-kolla13:44
keicoSo, where can I find information of the bootstrap_* containers? In the inventory/multinode config? In other words, where can I find a list of these bootstrap containers?13:45
pbourkeJeffrey4l: hey Jeffrey, don't quite understand your comment on https://review.openstack.org/#/c/448654/6/ansible/roles/glance/tasks/deploy.yml13:46
pbourkeJeffrey4l: can you elaborate?13:46
Jeffrey4lpbourke, this should not related to glance_file_datadir_volume variable.13:46
Jeffrey4lif i use glance_file_datadir_volume=/glance/image, should we use single glance api host?13:47
reidrackeico: look in ansible/roles/mariadb/tasks/* for example for mariadb13:48
pbourkeJeffrey4l: the issue is that may be NFS mounted13:48
reidracthose bootstrap containers are destroyed once they do their job13:48
pbourkeJeffrey4l: in which case it should use all api hosts13:48
Jeffrey4lok. you are correct.13:48
Jeffrey4lthanks.13:48
reidrackeico: I was trying to go trhough a normal troubleshooting sequence; if the bootstrap container doesn't provide a clue, kolla_toolbox can be to blame too13:49
emccormickanyone tried using the policy overwrite in horizon? I'm trying to replace keystone_policy.json and the reconfigure goes boom.13:50
emccormickfatal: [v69ctrl01]: FAILED! => {"failed": true, "msg": "the field 'args' has an invalid value, which appears to include a variable that is undefined. The error was: dict object has no element 0\n\nThe error appears to have been in '/usr/share/kolla-ansible/ansible/roles/horizon/tasks/config.yml': line 87, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears13:50
emccormickto be:\n\n\n- name: Copying over existing policy.json\n  ^ here\n"}13:50
emccormickI looked at the code, but my Ansible-fu is not quite strong enough to figure out what's happening there.13:50
emccormickall I did here was drop a keystone_policy.json in /etc/kolla/config/horizon/13:51
keico@reidrac, Thanks so much for your help. I will run kolla-ansilbe destroy and re-deploy the cluter.13:51
Jeffrey4lseems there a bug here.  trying it. emccormick13:52
reidrackeico: you're welcome13:52
emccormickThanks. This is latest Ocata fyi13:53
*** rwallner has quit IRC13:53
egonzalezemccormick, cany you try commenting this line https://github.com/openstack/kolla-ansible/blob/stable/ocata/ansible/roles/horizon/tasks/config.yml#L97 ?13:54
Jeffrey4lreoger.13:54
sdakekeico to find a list of bootstrap containers - you willh ave to make one by readin gthe ansible code and searching for _bootstrap)13:55
emccormickdoing it now13:55
egonzalezemccormick, i think that is the issue because is item.item.enabled is undefined13:56
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Avoid launching "local" actions too many times  https://review.openstack.org/48025613:56
emccormickgetting in there now13:57
Jeffrey4legonzalez, check this http://paste.openstack.org/show/614458/ emccormick13:57
* Jeffrey4l gonna file a bug and fix this issue.14:00
egonzalezJeffrey4l, good catch14:00
Jeffrey4l;)14:01
*** huzhengchuan has quit IRC14:01
*** reidrac_ has joined #openstack-kolla14:02
egonzalezdoes anybody understand how mariadb upgrade makes the order to upgrade? is broken in master ATM14:02
egonzalezI don't fully understand the lookup_cluster.yml14:02
egonzalezhttps://bugs.launchpad.net/kolla-ansible/+bug/169250714:02
openstackLaunchpad bug 1692507 in kolla-ansible "optimize reconfiguration breaks mariadb upgrade" [Critical,New]14:02
Jeffrey4lreconfigure mariadb is bust ;(14:02
*** schwicht has quit IRC14:02
Jeffrey4lit stop all mariadb instance right now14:03
*** ducttape_ has joined #openstack-kolla14:03
*** reidrac has quit IRC14:04
emccormickJeffrey4l do I leave item.item.enabled commented out?14:06
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Use proper variable in horizon copy policy task  https://review.openstack.org/48059814:07
emccormickfyi just with that commented out it bombed still14:07
*** schwicht has joined #openstack-kolla14:07
Jeffrey4lemccormick, check above patch ^^14:08
emccormickright I got that. was talking about egonzalez suggestion. Just asking if both should be applied or just yours14:09
*** zhurong has quit IRC14:09
egonzalezemccormick, apply Jeffrey4l's patch14:09
egonzalezi was wrong14:09
emccormicklooks like it worked14:11
emccormickThanks guys. You want me to file an official bug for it?14:12
egonzalezemccormick, already opened https://bugs.launchpad.net/kolla-ansible/+bug/170248614:13
openstackLaunchpad bug 1702486 in kolla-ansible "horizon policy file won't work" [Undecided,In progress] - Assigned to Jeffrey Zhang (jeffrey4l)14:13
emccormickThanks you sir. Much appreciated.14:15
*** prateek has quit IRC14:18
*** schwicht has quit IRC14:24
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix keystone-paste.ini custom file management  https://review.openstack.org/48060814:25
*** yangyape_ has joined #openstack-kolla14:29
*** schwicht has joined #openstack-kolla14:30
*** yangyapeng has quit IRC14:32
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix keystone-paste.ini custom file management  https://review.openstack.org/48060814:32
*** bmace has quit IRC14:33
*** jamesbenson has joined #openstack-kolla14:34
*** prateek has joined #openstack-kolla14:34
*** jamesbenson has quit IRC14:39
*** jamesbenson has joined #openstack-kolla14:40
*** huzhengchuan has joined #openstack-kolla14:41
*** schwicht has quit IRC14:42
*** reidrac has joined #openstack-kolla14:43
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fix tools/cleanup-images script error  https://review.openstack.org/48062814:45
*** reidrac_ has quit IRC14:46
*** kiennt has joined #openstack-kolla14:53
*** caoyuan has quit IRC14:53
*** schwicht has joined #openstack-kolla14:54
*** mmehan has joined #openstack-kolla14:58
*** rwallner has joined #openstack-kolla14:58
*** blallau has joined #openstack-kolla15:00
*** lucasxu has quit IRC15:00
*** omenvlad has quit IRC15:01
*** rwallner has quit IRC15:02
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Add designate dashboard to horizon  https://review.openstack.org/47815815:04
*** iniazi_ has joined #openstack-kolla15:05
*** blallau has quit IRC15:07
*** iniazi has quit IRC15:08
egonzalezdo we have meeting today? there is no item in the agenda15:11
*** duonghq has quit IRC15:13
*** duonghq has joined #openstack-kolla15:14
duonghqenevning guys15:14
*** duonghq_ has joined #openstack-kolla15:14
openstackgerritjangseon ryu proposed openstack/kolla-ansible master: Remove wrong command in "ceph in kolla" guide.  https://review.openstack.org/48064015:14
*** fooliouno has joined #openstack-kolla15:15
openstackgerritMerged openstack/kolla-ansible master: Use proper variable in horizon copy policy task  https://review.openstack.org/48059815:17
spsuryaegonzalez: inc0  can tell better15:18
spsuryaduonghq: evening15:18
kolla-slack<inc0> We can cancel if you feel like it15:18
kolla-slack<inc0> US had long weekend15:19
kolla-slack<inc0> So I expect day to be quiet15:19
kolla-slack<inc0> I'll send mail.15:19
spsuryainc0: roger15:20
duonghqdo we still have meeting today?15:22
kolla-slack<inc0> Duong no I just sent cancel mail15:22
duonghqinc0,  roger15:23
*** schwicht has quit IRC15:23
kolla-slack<inc0> Jeffrey4l and other Asia folk, no need to stay awake. Talk to you all later15:24
duonghqinc0, cya15:26
*** schwicht has joined #openstack-kolla15:26
*** janki has quit IRC15:31
*** duonghq has quit IRC15:32
*** lucasxu has joined #openstack-kolla15:35
Jeffrey4lroger. thanks.15:36
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/ocata: Use proper variable in horizon copy policy task  https://review.openstack.org/48064915:37
*** dixiaoli has joined #openstack-kolla15:39
*** dixiaoli has quit IRC15:44
*** prateek has quit IRC15:45
*** rwallner has joined #openstack-kolla15:48
*** schwicht has quit IRC15:52
*** vhosakot has joined #openstack-kolla15:55
*** schwicht has joined #openstack-kolla15:56
*** jascott1 has joined #openstack-kolla16:01
vhosakotno meeting today?16:02
kfox1111morning.16:02
inc0good morning16:03
inc0no, no meeting today vhosakot16:03
*** egonzalez has quit IRC16:03
vhosakotah ok cool, why no meeting? :)16:03
inc0no agenda so I figured we'll let Asia and Europe go for a evening/night:)16:03
vhosakotcool cool :)16:03
inc0how was Cisco live?16:04
inc0what did you announce with Kolla? any more reading about it?:)16:04
vhosakotwas great, did many Kolla sessions :) many hands-on.16:04
inc0great news16:04
vhosakotwanted to get back to upgrade gates :)  duonghq_ ping again :)16:05
inc0vhosakot:  I can help you with that16:05
vhosakotinc0: so, are we submitting any kolla talks for Sydney?  If so, I'd love to be a co-speaker :)16:05
*** coolsvap has joined #openstack-kolla16:06
*** schwicht has quit IRC16:06
inc0I think upgrade gate would make great talk on it;s own16:06
vhosakotinc0: yeah, I was thiknking about it too.16:06
inc0I'm also thinkining of dockerhub publishing talk... maybe we could join these16:06
vhosakotinc0: cool, did you submit any talk?16:07
inc0since it's all about gates and infra16:07
vhosakotinc0: any kolla hands-on workshops in Sydney?16:07
kfox1111+1 more gates. :)16:07
vhosakotkfox1111: yeah, upgrade gates will be very useful.16:07
kfox1111hep's finally winding down I think. so hoping I can get more time back now.16:08
inc0great news kfox111116:08
inc0we can kick off orch work with your benevolent oversight;)16:08
vhosakotwho's winding down from what? :)16:08
kfox1111sorry. me, and hep=high energy physics16:09
kfox1111I need to dust off the upgrade and reboot gates.16:09
kfox1111and the logging ps.16:10
inc0vhosakot kfox1111 maybe you can work together? as most of infra-related issues will be generally common16:10
inc0and outside of infra-related issues it's mostly kolla-ansible upgrade;)16:11
kfox1111+1 for shared infra. though I think I've pretty much got all the infra in already in the kolla-kubernetes gates.16:11
vhosakotinc0: should the upgrade gates test both scenarios - upgrade from minor release-to-minor release, and upgrade to major release?16:11
kfox1111the one ps already successfully does a reboot. just not all of the services come up.16:11
kfox1111the upgrade gate doesn't need anythign special out of infra.16:11
inc0kfox1111: I'm thinking in a lines of "pull old images, pull new images, download old version, deploy, download new version, upgrade"16:11
inc0and some testing scenarios16:11
kfox1111inc0: yeah. but that code isn't common between k8s and ansible?16:12
inc0gate code to pull images from trarballs will be common16:12
kfox1111ah. true.16:12
inc0scenarios will be common16:12
*** huzhengchuan has quit IRC16:12
kfox1111already have a ps up for that for kolla-kubernetes. should be adaptable for ansible side.16:13
inc0and logic between "deploy old" (so figure out which one is old and where is the link), spawn vm, download/deploy new, check if vm exists16:13
inc0most of it is actually common16:13
kfox1111inc0: not sure I follow.16:13
inc0well, in my brain it's gonna be more common than not common;)16:14
inc0but we'll see16:14
kfox1111your upgrading a vm, not launching a new one?16:14
inc0I was thinking of checking if old vm didn't break during upgrade16:14
kfox1111OH. your meaning sanity checks after the upgrade?16:14
kfox1111yeah. that should all be sharable.16:14
inc0persistence tests and sanity tests16:14
inc0yeah16:15
kfox1111+116:15
inc0I think most of hard part for ansible is that kind of stuff16:15
inc0since upgrade is already written16:15
kfox1111yeah.16:15
*** manheim has quit IRC16:16
*** athomas has quit IRC16:21
vhosakotinc0: kfox1111: so, let me know how can I help with upgrade gates. Last time I chcecked was inc0's review with infra hooks to add upgrade gates.  should I start with that?16:22
vhosakotI'm back from my PTO and traveling.16:22
kfox1111not sure how much in common the ansible and k8s gates have in common.16:22
kfox1111k8s launches two vm's, does a cinder volume, does some sanity checks around network/vms/cinder.16:23
kfox1111the upgrade test for k8s should start assuming that was done, then do some more.16:23
*** igordcard has quit IRC16:24
*** lucasxu has quit IRC16:27
*** jascott1 has quit IRC16:27
vhosakotkfox1111: yes, I agree not much is common in ansible and k8s gates.16:27
*** jascott1 has joined #openstack-kolla16:27
*** igordcard has joined #openstack-kolla16:30
*** jascott1 has quit IRC16:32
*** igordcard has quit IRC16:33
*** schwicht has joined #openstack-kolla16:34
*** reidrac has quit IRC16:34
*** igordcard has joined #openstack-kolla16:35
*** jascott1 has joined #openstack-kolla16:39
*** sambetts is now known as sambetts|afk16:44
*** kiennt has quit IRC16:44
*** daidv_ has joined #openstack-kolla16:48
*** jascott1 has quit IRC16:52
*** jascott1 has joined #openstack-kolla16:53
*** itlinux has joined #openstack-kolla16:54
*** jascott1 has quit IRC16:56
*** unicell has quit IRC16:59
*** daidv_ has quit IRC17:06
*** mgoddard_ has quit IRC17:08
*** duonghq_ has quit IRC17:09
*** serlex has quit IRC17:09
*** hieulq has quit IRC17:09
*** daidv has quit IRC17:09
*** igordcard has quit IRC17:10
*** igordcard has joined #openstack-kolla17:11
*** igordcard has quit IRC17:11
*** igordcard has joined #openstack-kolla17:12
*** hieulq has joined #openstack-kolla17:25
*** daidv has joined #openstack-kolla17:25
*** duonghq_ has joined #openstack-kolla17:25
*** ducttape_ has quit IRC17:31
*** ducttape_ has joined #openstack-kolla17:38
*** igordcard has quit IRC17:41
*** igordcard has joined #openstack-kolla17:42
*** igordcard has quit IRC17:44
*** igordcard has joined #openstack-kolla17:44
*** mgoddard_ has joined #openstack-kolla17:48
*** igordcard has quit IRC17:48
*** igordcard has joined #openstack-kolla17:48
*** jascott1 has joined #openstack-kolla18:00
*** unicell has joined #openstack-kolla18:02
*** tonanhngo has joined #openstack-kolla18:08
*** rwsu has quit IRC18:08
*** rwsu has joined #openstack-kolla18:09
*** coolsvap has quit IRC18:15
*** omenvlad has joined #openstack-kolla18:18
*** dave-mccowan has joined #openstack-kolla18:21
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Allow tmp path to download registry  https://review.openstack.org/47594018:26
*** schwicht has quit IRC18:26
*** schwicht has joined #openstack-kolla18:28
jamesbensonare all of the centos images available on docker hub for 4.0.0?18:33
inc0jamesbenson: they are, tho outdated18:40
jamesbensonyep, is it faster to build docker images from source/binary due to pip/yum vs source tarball+pip?  odd question, sorry18:46
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla master: Dockerfile publishing pipeline  https://review.openstack.org/47546918:47
inc0usually source is a little faster18:48
inc0not much of a difference tho18:48
jamesbensonokay, thanks :-)18:48
*** daidv has quit IRC18:49
*** hieulq has quit IRC18:49
*** duonghq_ has quit IRC18:50
*** hongbin has joined #openstack-kolla18:56
hongbinhi, i tried to follow this guide: https://docs.openstack.org/kolla-ansible/latest/quickstart.html , but couldn't manage to pass the precheck: http://paste.openstack.org/show/614497/18:57
hongbinis anything i need to do to pass the precheck?18:58
inc0hongbin: how did you install kolla-ansible18:58
hongbininc0: install from source : git clone ... ; pip install -e ...18:59
inc0go to source dir and run tools/kolla-ansible18:59
inc0that should fix it18:59
vhosakothongbin: "-i" must be the path to inventory instead of "all-in-one".  https://github.com/openstack/kolla-ansible/blob/master/tools/kolla-ansible#L37.    AIO inventory is usually in ${BASEDIR}/ansible/inventory/all-in-one  per  https://github.com/openstack/kolla-ansible/blob/master/tools/kolla-ansible#L10719:01
hongbininc0: thx, it seems to fix this error19:01
inc0yeah, we have issue with our pip isntallation from source19:01
hongbini see19:02
*** ducttape_ has quit IRC19:02
*** daidv has joined #openstack-kolla19:04
*** hieulq has joined #openstack-kolla19:04
*** duonghq_ has joined #openstack-kolla19:05
*** schwicht has quit IRC19:05
*** iniazi has joined #openstack-kolla19:06
vhosakotthe deadline to submit talks for Sydney is July 14th.  we could submit many talks about kolla (automated build, container snapshot/commit, prod-sanity checks, upgrades for which inc0 has ideas, containers with fast-data DPDK, SR-IOV).. let me know if anyone like sto submit talks and I'd love to be a co-speaker.19:07
inc0vhosakot: yeah, let's submit talk this week19:08
vhosakotcool, inc0 can we discuss it in next week's meeting so anyone interested can submit more talks :)19:08
inc0opendaylight+dpdk+kolla would also make awesome talk+demo19:09
vhosakotyep!19:09
inc0next meeting is at 12th19:09
inc0so not much time left afterwards19:09
*** iniazi_ has quit IRC19:09
*** schwicht has joined #openstack-kolla19:09
vhosakotah right19:09
inc0sean-k-mooney mgkwill interested?^19:09
vhosakothere is my opendaylight+openstack workshop I did at Cisco Live last week.  many people attended.  https://www.ciscolive.com/us/learn/sessions/session-catalog/?search=DEVNET-2041.   I did not include DPDK container as I could not get neutron's security groups not drop control plance traffic from fast data sender.19:12
vhosakotI got basic ping (icmp) working with neutron+dpdk by allowing incoming/outgoing imcp in security groups, but other trafffic from my fast data sender had random udp ports that neutron promptly dropped :)19:13
vhosakotI added some custom configs for Cisco boxes in https://review.openstack.org/#/c/416369/.19:14
*** ducttape_ has joined #openstack-kolla19:20
rwellumvhosakot: inc0: how about something on building your own images from source - then run them OS with them? I managed to do that last week and noticed that there was no documentation of the whole process?19:20
*** gfidente is now known as gfidente|afk19:22
vhosakotrwellum: meaning, use non-kolla DockerFiles with custom repos?19:23
vhosakotrwellum: source for the packages? or source for the container itself (DockerFile)?19:23
rwellumCreating kolla images from a custom repo, running (kolla-kubernetes) with that/those image(s).19:25
vhosakotrwellum: ah, I think building kolla images with custom repos will be a nice talk as many ops want to do it and do not want upstream/out-of-the-box repos that kolla provides, and want kolla to build internal/curated custom packages19:25
*** ducttap__ has joined #openstack-kolla19:25
*** ducttape_ has quit IRC19:26
vhosakotrwellum: did you have to change a lot apart from setting rpm_setup_config in kolla-build.conf to custom repos per https://github.com/openstack/kolla/blob/master/doc/image-building.rst#custom-repos ?19:28
rwellumYeah more than that :)19:29
vhosakotrwellum: like, did you have to edit DockerFiles? Ansible playbooks too?19:29
rwellumvhosakot: This isn't complete - but I'll update it shortly: https://etherpad.openstack.org/p/kolla-kubernetes_with_your_own_source_images19:30
rwellumTake a look - let me know?19:30
hongbinhi, running into this error now when i ran deploy: http://paste.openstack.org/show/614504/19:31
vhosakotrwellum: nice! so is the idea point kolla-build.conf to each service's custom repo and build custom container from source, and not touch anything else like DockerFile and Anisble playbook?19:31
hongbini shouldn't enable anything about fluentd, not sure why it complained about it19:32
rwellumRight - exactly. And the point being exactly what you detailed above very eloquently :)19:32
vhosakotrwellum: yes, I think it will be a good talk.  inc0 I think running kolla with custom internal repos will be a great talk for anyone/ops.19:33
*** ducttape_ has joined #openstack-kolla19:34
rwellumCool vhosakot !19:35
*** eaguilar has quit IRC19:37
*** ducttap__ has quit IRC19:38
vhosakotrwellum: after building custom keystone image, how did you start it? ran "kolla-ansible deploy"?19:38
sbezverkI have some interesting things going on with sriov and kubernetes, not sure if it would be a good topic for openstack talk ;)19:40
rwellumvhosakot: I'm using kubernetes - and I'm running it with my own tool I've developed. But basically, some additions to cloud.yaml and then using kubeadm19:41
vhosakotsbezverk: oooh, which cards did you use for SR-IOV?  Cisco VICs 1340, 1380?  or Intel/Mellanox?  I've deployed SR-IOV with OpenStack but not with k8s tho...19:41
rwellumsbezverk: that would be more than inetersting!19:41
vhosakotrwellum: ah cool19:41
sbezverkvhosakot : it is Intel ixgbe, the best NIC of all times ;)19:42
vhosakotsbezverk: ah, I'm using some Intel ixgbe's recently to test VPP/DPDK compute kit, cool man :)19:42
vhosakotrwellum: so, you did not use rpm_setup_config to build custom packages because you wanted to build from source and use "install_type = source" in kolla-build.conf, right?19:43
rwellumsbezverk: I think I fixed a ton of bugs in the that driver in XR vpp :)19:44
rwellumCost me more than a few months.19:44
vhosakotrpm_setup_config is for binary custom packages pulled from custome repo files.19:44
sbezverkrwellum : have you fixed in upstream driver?19:45
rwellumvhosakot: correct. But i really just asked the cores here for advise and this is what they told me to do.19:45
vhosakotrwellum: cool cool... building from custom source is a great idea.. yes,.19:45
rwellumsbezverk: no - at the time it was Dave Barach's proprietary version I think - no sure where it went.19:45
vhosakotrwellum: so, did you end up having a section for each container like [keystone-ssh], [keystone-fernet], [barbican-keystone-listener] for each container... the etherpad's example just has [keystone-base] under the section "Edit kolla-build.conf and add pointer to source" in https://etherpad.openstack.org/p/kolla-kubernetes_with_your_own_source_images.19:46
sbezverkrwellum : I see unfortunately it never left that group. Intel built a relatively good driver for x540 5.1.4 so far I do not see much troubles19:46
rwellumvhosakot: so far I have only done it for keystone, but yes that's the general idea. I am going to add in horizon and cinder next - as those are areas I'm interested in.19:49
rwellumsbezverk: cool19:49
vhosakotrwellum: cool, great work. can you please add a doc for it in our kolla repo, may add a section "building from source" under the existing header "Custom repos" in https://github.com/openstack/kolla/blob/master/doc/image-building.rst#custom-repos.19:50
rwellumYes will do.19:51
vhosakotrwellum: thanks!19:51
vhosakotsbezverk: have you deployed OVS or Linuxbridge too incase a VM does not want to use SR-IOV and wants the legacy virtual L2 switch like OVS or Linuxbridge?19:52
sbezverkvhosakot : deployed where?19:52
vhosakotsbezverk: I meant, can  VM also use OVS or LinuxBridge too when using SR-IOV... like in my case, my customer wanted few VMs using SR-IOV and bypass the hypervisor and other VMs using OVS.. so, I had to deploy OVS with SR-IOV for the customer.19:55
sbezverkvhosakot : in my old day ;) while I was still playing with sriov on openstack, that was not the case. You did not need ovs to give access to VM for sriov interfaces19:57
*** rwallner has quit IRC19:57
vhosakotright right, yeah.. I think neutron uses macv-type as direct (without OVS) with connecting a port to SR-IOV.. cool19:58
*** rwallner_ has joined #openstack-kolla20:00
*** manheim has joined #openstack-kolla20:02
*** manheim has quit IRC20:04
*** manheim has joined #openstack-kolla20:04
*** rwallner_ has quit IRC20:04
inc0vhosakot: btw https://review.openstack.org/#/c/342354/20:08
*** jgruber has quit IRC20:10
*** jgruber has joined #openstack-kolla20:12
keicoHello. I am trying to deploy an Openstack cloud (ocata) using kolla-ansible (version 4.0.2).20:13
keicoCurrently, the task "Creating admin project, user, role, service, and endpoint" fails with the exact errors:20:13
keicoTASK [keystone : Creating admin project, user, role, service, and endpoint] *******20:13
vhosakotinc0: thanks for the pointer.20:13
keico[WARNING]: when statements should not include jinja2 templating delimiters such as {{ }} or {% %}. Found: {{ (keystone_bootstrap.stdout | from_json).changed }}20:14
keicofatal: [control01]: FAILED! => {"failed": true, "msg": "The conditional check '{{ (keystone_bootstrap.stdout | from_json).changed }}' failed. The error was: Expecting ',' delimiter: line 1 column 133 (char 132)"}20:14
keicoDoes anyone know how to resolve this problem? Thank you in advance for your help!20:14
inc0hmm I've never seen this20:16
jamesbensoncould this be a jinja2 version issue?20:16
vhosakot^^^ I think the same too20:16
jamesbensonkeico, what version of jinja2 do you have?20:17
keicoHere's the source/config file for this task: https://github.com/openstack/kolla-ansible/blob/4.0.2/ansible/roles/keystone/tasks/register.yml20:17
keicoOne second. Let me check20:17
keico[root@kolla-deployment inventory]# pip show Jinja2 Name: Jinja2 Version: 2.9.6 Summary: A small but fast and easy to use stand-alone template engine written in pure python. Home-page: http://jinja.pocoo.org/ Author: Armin Ronacher Author-email: armin.ronacher@active-4.com License: BSD Location: /usr/lib64/python2.7/site-packages Requires: MarkupSafe20:18
keicoI believe I have Jinja2 version 2.9.6.20:20
inc0keico: hmm, also what images are you using20:20
inc0?20:20
keicoI was able to build all the docke images with version 4.0.2.20:21
inc0ok that's good20:22
keicoI am not sure if this is relavent. I also see this error from my keystone container, running on the control node:20:22
inc0probably relevant20:22
keico2017-07-05 15:46:09.986 58 ERROR keystone ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table 'keystone.project' doesn't exist") [SQL: u'INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)'] [parameters: {'is_domain': 1, 'description': 'The default domain', 'extra20:23
inc0definetly relevant:)20:23
inc0seems like something broke down during database syncdb?20:23
inc0did you see any issues before?20:23
*** ansmith has quit IRC20:26
*** hieulq has quit IRC20:26
*** daidv has quit IRC20:26
inc0pbourke: will it run Kolla? https://thenewstack.io/oracle-opens-oci-container-runtime ;)20:27
keicoNo. To be honest, I am still newbie to kolla/kolla-ansible. So, this is where I have made that far :)20:28
inc0keico: best advice, let's try to destroy/recreate20:28
inc0kolla-ansible -i path-to-inv destroy --yes-i-really-really-mean-it20:28
keicook. thanks!20:28
inc0maybe something wierd happened during sync and it failed quietly for whatever reason20:29
inc0if problem persists, we'll investigate more20:29
rwellumsbezverk: any luck with 1.7.0? - seems stable to me. Worked on centos - trying ubuntu now.20:32
sbezverkrwellum : look ok to me too, there was a chance in authorization, but with rbac roles/bindings we have currently, it seems to be not affecting us20:33
*** shardy has quit IRC20:35
keicoinc0: thanks so much for your advice! It works!20:37
inc0glad to hear20:37
inc0good thing about Kolla is that it can be re-run within few minutes;)20:37
*** jtriley has quit IRC20:39
*** keico has quit IRC20:40
*** daidv has joined #openstack-kolla20:41
*** hieulq has joined #openstack-kolla20:42
rwellumsbezverk: nice. Good to have a stable release.20:47
*** dciabrin has quit IRC20:49
*** dciabrin has joined #openstack-kolla20:49
*** rwallner has joined #openstack-kolla20:55
*** rwallner has quit IRC20:59
*** manheim has quit IRC21:04
*** gfidente|afk is now known as gfidente21:07
openstackgerritMerged openstack/kolla master: introduces support for the OVS DPDK dataplane  https://review.openstack.org/34235421:08
openstackgerritBertrand Lallau proposed openstack/kolla master: Fix searchlight_api container starting issue  https://review.openstack.org/48074321:14
*** rhallisey has quit IRC21:15
*** goldyfruit has quit IRC21:16
*** Manheim has joined #openstack-kolla21:17
*** fooliouno has quit IRC21:21
*** mgoddard_ has quit IRC21:44
*** hieulq has quit IRC21:45
*** duonghq_ has quit IRC21:45
*** daidv has quit IRC21:46
*** Pavo has joined #openstack-kolla21:57
*** daidv has joined #openstack-kolla22:04
*** duonghq has joined #openstack-kolla22:05
*** hieulq has joined #openstack-kolla22:05
*** schwicht has quit IRC22:05
*** daidv has quit IRC22:07
*** Manheim has quit IRC22:13
*** jascott1 has quit IRC22:13
*** jascott1 has joined #openstack-kolla22:14
*** Pavo has quit IRC22:14
*** jascott1 has quit IRC22:15
*** rfxn has joined #openstack-kolla22:18
*** tonanhngo has quit IRC22:21
*** Teck72 has quit IRC22:21
*** manheim has joined #openstack-kolla22:21
*** daidv has joined #openstack-kolla22:23
*** schwicht has joined #openstack-kolla22:23
*** tonanhngo has joined #openstack-kolla22:26
*** tonanhngo has quit IRC22:31
*** jascott1 has joined #openstack-kolla22:31
*** goldyfruit has joined #openstack-kolla22:33
*** schwicht has quit IRC22:49
*** schwicht has joined #openstack-kolla22:49
*** itlinux has quit IRC22:50
*** klindgren_ is now known as klindgren22:52
*** Pavo has joined #openstack-kolla22:54
*** schwicht has quit IRC22:55
*** goldyfruit has quit IRC22:58
*** Pavo has quit IRC22:58
*** Pavo has joined #openstack-kolla23:05
*** Pavo has quit IRC23:07
*** ansmith has joined #openstack-kolla23:09
*** ducttape_ has quit IRC23:12
*** hongbin has quit IRC23:15
*** hieulq has quit IRC23:21
*** duonghq has quit IRC23:21
*** daidv has quit IRC23:21
*** schwicht has joined #openstack-kolla23:22
*** ducttape_ has joined #openstack-kolla23:23
*** manheim has quit IRC23:24
*** ducttape_ has quit IRC23:28
*** daidv has joined #openstack-kolla23:35
*** duonghq has joined #openstack-kolla23:35
*** hieulq has joined #openstack-kolla23:35
*** bmace has joined #openstack-kolla23:40
*** manheim has joined #openstack-kolla23:40

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!