| *** vhosakot has joined #openstack-kolla | 00:01 | |
| *** yangyapeng has quit IRC | 00:02 | |
| *** yangyapeng has joined #openstack-kolla | 00:02 | |
| *** yangyapeng has quit IRC | 00:07 | |
| *** vhosakot has quit IRC | 00:09 | |
| *** ntpttr_laptop has quit IRC | 00:12 | |
| *** sbezverk has joined #openstack-kolla | 00:16 | |
| *** vhosakot has joined #openstack-kolla | 00:27 | |
| *** daidv_ has quit IRC | 00:33 | |
| *** kbaegis has quit IRC | 00:39 | |
| *** kbaegis has joined #openstack-kolla | 00:40 | |
| *** kbaegis has quit IRC | 00:40 | |
| *** tovin07_ has joined #openstack-kolla | 00:46 | |
| *** unicell has quit IRC | 00:53 | |
| *** sbezverk has quit IRC | 00:55 | |
| *** duonghq has joined #openstack-kolla | 00:56 | |
| *** kbaegis has joined #openstack-kolla | 01:00 | |
| *** kbaegis has quit IRC | 01:00 | |
| *** kbaegis has joined #openstack-kolla | 01:00 | |
| *** kbaegis has quit IRC | 01:01 | |
| *** kbaegis has joined #openstack-kolla | 01:01 | |
| *** kbaegis has joined #openstack-kolla | 01:01 | |
| *** kbaegis has joined #openstack-kolla | 01:02 | |
| *** kbaegis has quit IRC | 01:02 | |
| *** kbaegis has joined #openstack-kolla | 01:02 | |
| *** caowei has joined #openstack-kolla | 01:07 | |
| *** sbezverk has joined #openstack-kolla | 01:08 | |
| *** Pavo has quit IRC | 01:12 | |
| chason | krtaylor ping | 01:13 |
|---|---|---|
| *** yangyapeng has joined #openstack-kolla | 01:16 | |
| *** mrunge has quit IRC | 01:24 | |
| *** genek has joined #openstack-kolla | 01:24 | |
| *** dardelean has joined #openstack-kolla | 01:24 | |
| *** genek has quit IRC | 01:29 | |
| *** zhubingbing has joined #openstack-kolla | 01:35 | |
| *** vhosakot has quit IRC | 01:38 | |
| *** zhangfei has joined #openstack-kolla | 01:44 | |
| *** zhangfei has quit IRC | 01:53 | |
| *** dardelean has quit IRC | 01:53 | |
| *** zhubingbing has quit IRC | 02:04 | |
| *** zhangfei has joined #openstack-kolla | 02:06 | |
| *** jascott1 has quit IRC | 02:08 | |
| *** jascott1 has joined #openstack-kolla | 02:08 | |
| *** jascott1 has quit IRC | 02:12 | |
| openstackgerrit | Kevin Zhao proposed openstack/kolla master: nova-libvirt: fix kvm permission issue https://review.openstack.org/501653 | 02:22 |
| *** coolsvap has joined #openstack-kolla | 02:33 | |
| *** mrunge has joined #openstack-kolla | 02:39 | |
| *** yingjun has joined #openstack-kolla | 02:46 | |
| *** junbo has quit IRC | 02:52 | |
| *** ArminderSingh has quit IRC | 02:58 | |
| *** ArminderSingh has joined #openstack-kolla | 03:06 | |
| openstackgerrit | Naichuan Sun proposed openstack/kolla master: XenServer: Add packages for initial support for ocata https://review.openstack.org/511379 | 03:11 |
| openstackgerrit | Naichuan Sun proposed openstack/kolla master: XenServer: Add packages for initial support https://review.openstack.org/510266 | 03:16 |
| openstackgerrit | Naichuan Sun proposed openstack/kolla master: XenServer: Add packages for initial support https://review.openstack.org/510266 | 03:20 |
| openstackgerrit | Merged openstack/kolla master: Re-enable bifrost test_build https://review.openstack.org/465012 | 03:22 |
| *** mdnadeem has joined #openstack-kolla | 03:26 | |
| *** mdnadeem has quit IRC | 03:37 | |
| *** mdnadeem has joined #openstack-kolla | 03:38 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/ocata: Mount /lib/modules folder for neutron-l3-agent https://review.openstack.org/510834 | 03:43 |
| masber | good morning, I am getting this error from kolla-ansible pull https://bpaste.net/show/c7bca33b0faa, any thoughts? | 03:50 |
| spsurya | morning a;; | 03:51 |
| *** dave-mccowan has quit IRC | 03:54 | |
| spsurya | chason: can you please reply on this https://review.openstack.org/#/c/508102/ | 04:06 |
| chason | spsurya OK, let me see. | 04:06 |
| *** tvignaud has quit IRC | 04:07 | |
| *** jemcevoy has quit IRC | 04:08 | |
| *** gkadam has joined #openstack-kolla | 04:09 | |
| chason | spsurya done | 04:14 |
| spsurya | chason: thanks | 04:19 |
| Sean-md | masber I think your private repository has a problem. | 04:26 |
| openstackgerrit | Surya Prakash (spsurya) proposed openstack/kolla-ansible master: Quickstart guide updated for better users experience https://review.openstack.org/508102 | 04:26 |
| Sean-md | what is the result of "docker pull 192.168.20.1:5000/kolla/centos-binary-cron:5.0.0" on test-openstack-controller | 04:27 |
| Sean-md | ? | 04:27 |
| masber | Sean-md, probably, I am not a docker expert but I can query the catalog and see the images... I can also pull manually from docker http://paste.openstack.org/show/623407/ | 04:28 |
| *** tvignaud has joined #openstack-kolla | 04:32 | |
| Sean-md | When I couldn't pull the image, I had a same issue, sorry | 04:36 |
| masber | Sean-md, are you using version 5.0.0? | 04:40 |
| Sean-md | masber: Yes | 04:43 |
| masber | Sean did you follow the quick start guide? | 04:43 |
| Sean-md | masber yes | 04:43 |
| masber | did you download kolla-ansible from github or just pip install? | 04:44 |
| Sean-md | both... by following the guide. | 04:45 |
| Sean-md | what is your docker version? | 04:45 |
| Sean-md | I didn't apply MTU limitation to docker daemon | 04:46 |
| Sean-md | and use "kolla-ansible -i <<inventory file>> bootstrap-servers" | 04:47 |
| Sean-md | to configure nodes | 04:48 |
| Sean-md | I ran "kolla-ansible -i <<inventory file>> bootstrap-servers" to configure nodes | 04:48 |
| *** lpetrut_ has joined #openstack-kolla | 04:54 | |
| *** kevzha01_ is now known as kevinz | 04:54 | |
| *** palexster has quit IRC | 04:57 | |
| masber | Sean-md, my docker vesion is Docker version 1.12.0, build 8eab29e | 04:58 |
| Sean-md | I use the latest version of docker, and replaced "docker daemon" to "dockerd" | 05:02 |
| *** palexster has joined #openstack-kolla | 05:02 | |
| Sean-md | I don't know if this help you or not. | 05:03 |
| masber | Sean-md, how did you install docker? | 05:03 |
| Sean-md | Yes | 05:03 |
| masber | Sean-md, did you install docker from repository or using or by running -sSL https://get.docker.io | bash? | 05:05 |
| Sean-md | I followed "https://docs.docker.com/engine/installation/linux/docker-ce/centos/#install-using-the-repository" | 05:06 |
| *** unicell has joined #openstack-kolla | 05:19 | |
| *** lpetrut_ has quit IRC | 05:26 | |
| *** danardelean has joined #openstack-kolla | 05:30 | |
| *** danardelean has quit IRC | 05:35 | |
| *** gkadam_ has joined #openstack-kolla | 05:38 | |
| *** gkadam has quit IRC | 05:40 | |
| *** gkadam__ has joined #openstack-kolla | 05:40 | |
| *** gkadam__ has quit IRC | 05:42 | |
| *** gkadam_ has quit IRC | 05:43 | |
| *** gkadam has joined #openstack-kolla | 05:43 | |
| *** mrunge has quit IRC | 05:44 | |
| *** janki has joined #openstack-kolla | 05:47 | |
| *** serlex has joined #openstack-kolla | 06:02 | |
| *** mrunge has joined #openstack-kolla | 06:06 | |
| *** cah_link_ has joined #openstack-kolla | 06:15 | |
| *** brad[] has quit IRC | 06:20 | |
| *** skramaja has joined #openstack-kolla | 06:23 | |
| *** brad[] has joined #openstack-kolla | 06:32 | |
| *** pc_m has quit IRC | 06:33 | |
| *** mgoddard has joined #openstack-kolla | 06:35 | |
| *** pc_m has joined #openstack-kolla | 06:35 | |
| *** b_bezak has joined #openstack-kolla | 06:36 | |
| *** gkadam has quit IRC | 06:40 | |
| *** gkadam has joined #openstack-kolla | 06:42 | |
| *** b_bezak has quit IRC | 06:42 | |
| hrw | is there a way to get some usable logs from kolla-ansible? | 06:48 |
| hrw | TASK [keystone : Creating admin project, user, role, service, and endpoint] *********************************************************************************** | 06:48 |
| hrw | fatal: [kolla-test.local]: FAILED! => {"failed": true, "msg": "The conditional check '(keystone_bootstrap.stdout | from_json).changed' failed. The error was: Expecting ',' delimiter: line 1 column 121 (char 120)"} | 06:48 |
| hrw | adding -vvv gives wrapped message. is there a way to get it clean? | 06:49 |
| *** gfidente has joined #openstack-kolla | 06:53 | |
| *** b_bezak has joined #openstack-kolla | 07:02 | |
| *** danardelean has joined #openstack-kolla | 07:04 | |
| *** vincent_vdk has joined #openstack-kolla | 07:13 | |
| *** vincent_vdk has quit IRC | 07:13 | |
| *** vincent_vdk has joined #openstack-kolla | 07:14 | |
| *** danardelean has quit IRC | 07:15 | |
| *** pcaruana has joined #openstack-kolla | 07:17 | |
| *** dardelean has joined #openstack-kolla | 07:18 | |
| *** lpetrut_ has joined #openstack-kolla | 07:18 | |
| *** yangyapeng has quit IRC | 07:19 | |
| *** yangyapeng has joined #openstack-kolla | 07:19 | |
| *** gkadam is now known as gkadam-afk | 07:24 | |
| *** shardy has joined #openstack-kolla | 07:30 | |
| *** dardelean_ has joined #openstack-kolla | 07:31 | |
| *** rwsu has joined #openstack-kolla | 07:33 | |
| cah_link_ | hrw : Hi. what files have you edited before starting kolla-ansible? | 07:34 |
| *** dardelean has quit IRC | 07:34 | |
| hrw | nevermind. keystone started when I removed all images from target machine | 07:35 |
| hrw | cah_link_: globals.yml is the only edited one | 07:36 |
| *** genek has joined #openstack-kolla | 07:38 | |
| *** mgoddard has quit IRC | 07:41 | |
| *** egonzalez has joined #openstack-kolla | 07:45 | |
| *** genek has quit IRC | 07:48 | |
| *** genek has joined #openstack-kolla | 07:50 | |
| *** Sean-md has quit IRC | 07:54 | |
| *** dougsz has joined #openstack-kolla | 07:57 | |
| *** genek has quit IRC | 07:58 | |
| *** genek has joined #openstack-kolla | 08:01 | |
| *** cah_link__ has joined #openstack-kolla | 08:02 | |
| *** danardelean has joined #openstack-kolla | 08:08 | |
| *** danardel_ has joined #openstack-kolla | 08:10 | |
| *** danardelean has quit IRC | 08:13 | |
| *** athomas has joined #openstack-kolla | 08:18 | |
| *** danardel_ has quit IRC | 08:20 | |
| *** danardelean has joined #openstack-kolla | 08:22 | |
| *** danardel_ has joined #openstack-kolla | 08:23 | |
| *** Sean-md has joined #openstack-kolla | 08:24 | |
| *** danardelean has quit IRC | 08:25 | |
| *** gkadam-afk has quit IRC | 08:28 | |
| *** shardy has quit IRC | 08:29 | |
| *** shardy has joined #openstack-kolla | 08:29 | |
| *** mgoddard has joined #openstack-kolla | 08:29 | |
| *** gkadam has joined #openstack-kolla | 08:31 | |
| *** rmart04 has joined #openstack-kolla | 08:32 | |
| *** genek has quit IRC | 08:35 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix deployment with public TLS enabled https://review.openstack.org/509186 | 08:41 |
| *** genek has joined #openstack-kolla | 08:42 | |
| daidv | spsurya, Can you help me review this again https://review.openstack.org/#/c/511186/ | 08:44 |
| egonzalez | spsurya, what doc change we merge finally, chason or krtaylor one? | 08:48 |
| *** genek has quit IRC | 08:48 | |
| spsurya | egonzalez: https://review.openstack.org/#/c/486423/ i.e of chason | 08:50 |
| spsurya | added krtaylor as Co-Author | 08:50 |
| spsurya | as per krtaylor ToDo needs to be added in PTG doc session eatherpad for doc change | 08:51 |
| spsurya | to avoid the duplicate work | 08:52 |
| spsurya | daidv: checking | 08:53 |
| openstackgerrit | Dai Dang Van proposed openstack/kolla-ansible master: Add note about overwriting policy.json file https://review.openstack.org/511186 | 08:53 |
| *** korean101 has joined #openstack-kolla | 08:55 | |
| korean101 | hi guys | 08:55 |
| korean101 | INFO:kolla.image.build.base:Cannot open: http://repo.percona.com/release/7/RPMS/x86_64/percona-release-0.1-4.noarch.rpm. Skipping. | 08:55 |
| korean101 | i got this ERRORs | 08:55 |
| korean101 | how can i do? | 08:55 |
| korean101 | something strange | 08:55 |
| korean101 | i got rpm file that links | 08:56 |
| egonzalez | korean101, do you reach http://repo.percona.com/release/7/RPMS/x86_64/percona-release-0.1-4.noarch.rpm from the host? | 08:58 |
| korean101 | egonzalez: yes! | 08:58 |
| spsurya | daidv: already done by egonzale | 08:58 |
| egonzalez | are you behind a proxy? | 08:58 |
| korean101 | egonzalez: nope~ | 08:58 |
| korean101 | egonzalez: OMG this is you!!! (http://egonzalez.org/openstack-kolla-deployment-from-rdo-packages/) | 08:58 |
| korean101 | CentOS 7 | 08:59 |
| egonzalez | is really outdated that post | 08:59 |
| korean101 | i wanna Pike release | 08:59 |
| korean101 | egonzalez: hmmmm | 08:59 |
| korean101 | egonzalez: where's updated post? | 08:59 |
| egonzalez | i've not any newer with building steps, only with deploy | 09:00 |
| openstackgerrit | Dai Dang Van proposed openstack/kolla-ansible master: Add note about overwriting policy.json file https://review.openstack.org/511186 | 09:01 |
| egonzalez | korean101, in the topic, can you run ``docker run centos:7 curl -Lo /tmp/percona_repo.rpm http://repo.percona.com/release/7/RPMS/x86_64/percona-release-0.1-4.noarch.rpm`` | 09:03 |
| egonzalez | korean101, and see if that works, if not there is some network issue in docker | 09:03 |
| *** blallau has quit IRC | 09:06 | |
| openstackgerrit | Dai Dang Van proposed openstack/kolla-ansible master: Add note about overwriting policy.json file https://review.openstack.org/511186 | 09:06 |
| *** genek has joined #openstack-kolla | 09:06 | |
| *** blallau has joined #openstack-kolla | 09:07 | |
| *** jascott1 has joined #openstack-kolla | 09:10 | |
| daidv | egonzalez, spsurya I just update doc about policy file: https://review.openstack.org/#/c/511186/, please review it again, thanks. | 09:12 |
| *** jascott1 has quit IRC | 09:14 | |
| *** genek has quit IRC | 09:21 | |
| *** genek has joined #openstack-kolla | 09:22 | |
| *** genek has quit IRC | 09:26 | |
| *** logan- has quit IRC | 09:27 | |
| *** gkadam_ has joined #openstack-kolla | 09:36 | |
| *** yingjun has quit IRC | 09:36 | |
| *** gkadam has quit IRC | 09:38 | |
| *** genek has joined #openstack-kolla | 09:39 | |
| masber | good afternoon, I don't know why kolla-ansible is giving me an error when pulling the containers http://paste.openstack.org/show/623428/ | 09:41 |
| masber | the thing is that I can query the registry and pull from single node http://paste.openstack.org/show/623407/ | 09:41 |
| masber | any thoughts? | 09:41 |
| *** genek has quit IRC | 09:43 | |
| egonzalez | masber, docker py version in all nodes is the same? | 09:46 |
| egonzalez | looks like the python library is not the correct | 09:46 |
| masber | egonzalez, ok let me check | 09:47 |
| masber | this is to install python docker right? pip install -U docker | 09:47 |
| egonzalez | yep, but first remove docker-py or will conflict | 09:48 |
| *** danardel_ has quit IRC | 09:50 | |
| *** danardelean has joined #openstack-kolla | 09:53 | |
| *** danardel_ has joined #openstack-kolla | 09:55 | |
| *** danardelean has quit IRC | 09:55 | |
| *** danardel_ has quit IRC | 10:00 | |
| openstackgerrit | Merged openstack/kolla master: Rearrange existing documentation to fit the new standard layout https://review.openstack.org/486423 | 10:00 |
| *** tovin07_ has quit IRC | 10:00 | |
| *** egonzalez has quit IRC | 10:03 | |
| *** danardelean has joined #openstack-kolla | 10:06 | |
| *** danardel_ has joined #openstack-kolla | 10:07 | |
| openstackgerrit | wangwei proposed openstack/kolla-ansible master: Optimize the configuration of ceph https://review.openstack.org/496608 | 10:10 |
| *** danardelean has quit IRC | 10:10 | |
| *** danardel_ has quit IRC | 10:12 | |
| *** caowei has quit IRC | 10:13 | |
| *** pbourke has quit IRC | 10:15 | |
| *** pbourke has joined #openstack-kolla | 10:17 | |
| *** egonzalez has joined #openstack-kolla | 10:17 | |
| *** sbezverk has quit IRC | 10:21 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Quickstart guide updated for better users experience https://review.openstack.org/508102 | 10:23 |
| *** yangyape_ has joined #openstack-kolla | 10:23 | |
| *** yangyapeng has quit IRC | 10:27 | |
| openstackgerrit | serlex proposed openstack/kolla-ansible master: Allow outward_rabbitmq with enable_outward_rabbitmq https://review.openstack.org/511298 | 10:27 |
| *** yangyape_ has quit IRC | 10:28 | |
| hrw | ech. | 10:31 |
| *** danardelean has joined #openstack-kolla | 10:31 | |
| hrw | to deploy from locally built images docker registry is required. registry image is x86-64 only. | 10:32 |
| hrw | docker-- | 10:32 |
| *** blallau has quit IRC | 10:36 | |
| *** zhangfei has quit IRC | 10:45 | |
| *** clayton has quit IRC | 10:49 | |
| *** clayton has joined #openstack-kolla | 10:51 | |
| *** logan- has joined #openstack-kolla | 10:57 | |
| *** sambetts|afk is now known as sambetts | 11:01 | |
| *** dave-mccowan has joined #openstack-kolla | 11:03 | |
| *** serlex has quit IRC | 11:07 | |
| *** shardy is now known as shardy_lunch | 11:08 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla master: Implement Almanach Docker images https://review.openstack.org/498938 | 11:17 |
| masber | egonzalez, I uninstalled and then reinstalled docker-py, now prechecks does not complains but error persists https://bpaste.net/show/477739c19436 | 11:21 |
| hrw | masber: You deploy pike, right? and python docker is 2.4+? | 11:25 |
| masber | hrw, how can I check the version? | 11:28 |
| bjolo_ | howhy | 11:35 |
| bjolo_ | looking at the mariadb version | 11:36 |
| bjolo_ | baseurl = https://yum.mariadb.org/10.0/centos7-amd64 | 11:36 |
| bjolo_ | any reason why we are still using 10.0? | 11:37 |
| bjolo_ | we have some issues in our prod environment and need 10.2 to resolve them | 11:37 |
| kolla-slack | <egonzalez> bjolo, nobody made the work to upgrade. Need some changes more than install newer version | 11:38 |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible master: Implement Almanach ansible role https://review.openstack.org/498944 | 11:38 |
| bjolo_ | performance and galerareplication is friking out | 11:38 |
| pomac | galera replication is faster and more efficient in the newer releases since you don't have to do a full binlog | 11:38 |
| bjolo_ | egonzalez, whats needed? | 11:38 |
| bjolo_ | i mean 10.2 should be a minor version right? | 11:39 |
| pomac | There is also some additional issues with the databases being one large file, no table separation | 11:39 |
| *** yangyapeng has joined #openstack-kolla | 11:39 | |
| kolla-slack | <egonzalez> From 10.1 to 10.2 was major | 11:39 |
| pomac | (we will be doing some testing with this, don't know the upgrade path though) | 11:39 |
| *** yangyapeng has quit IRC | 11:39 | |
| *** yangyapeng has joined #openstack-kolla | 11:40 | |
| bjolo_ | ok | 11:40 |
| kolla-slack | <egonzalez> It breaks while creating the cluster | 11:40 |
| bjolo_ | 10.0 - 10.1 minor? | 11:40 |
| pomac | egonzalez: but 10.1 is ok? | 11:40 |
| bjolo_ | pomac, will 10.1 resolve all/some of our issues | 11:40 |
| kolla-slack | <egonzalez> Sorry, from 10.0 to 10.1 was major changes with wsrep iirc | 11:40 |
| masber | hrw, docker version is 2.5.1 | 11:40 |
| pomac | it should enable us to do the smalle replication | 11:40 |
| pomac | ah | 11:40 |
| *** ansmith has quit IRC | 11:40 | |
| kolla-slack | <egonzalez> We want to remove epel and use rdo packages for mariadb | 11:41 |
| pomac | Has anyone used memcached as a backend for keystones token stuff - does it interfere with other memcached things? | 11:46 |
| pomac | I've been thinking of how to move load away from the database.... Since locks timeout atm | 11:47 |
| hrw | bjolo_: can we move to use RDO mariadb packages? | 11:50 |
| bjolo_ | egonzalez, epel packages? arnt we using yum.mariadb.org packages today? | 11:52 |
| pomac | egonzalez: according to base we use https://yum.mariadb.org/10.0/centos7-amd64 | 11:52 |
| hrw | maybe you ;D | 11:53 |
| bjolo_ | hrw, dont think im the right guy to answer that. need more research | 11:53 |
| kolla-slack | <egonzalez> right, are some deps from epel | 11:53 |
| pomac | hrw: this is from docker/base/MariaDB.repo in kolla-ansible | 11:53 |
| pomac | egonzalez: ah | 11:53 |
| hrw | pomac: if you use them. yes | 11:54 |
| pomac | s/(.*)-ansible/$1/ apparently | 11:54 |
| hrw | aarch64-cbs.repo is what I use instead. but that's other story | 11:55 |
| *** coolsvap has quit IRC | 11:55 | |
| pomac | hrw: arm? cool | 11:55 |
| *** serlex has joined #openstack-kolla | 11:58 | |
| *** Croata has joined #openstack-kolla | 12:04 | |
| *** shardy_lunch is now known as shardy | 12:09 | |
| *** jtriley has quit IRC | 12:12 | |
| openstackgerrit | zhubingbing proposed openstack/kolla master: test https://review.openstack.org/511467 | 12:13 |
| openstackgerrit | Merged openstack/kolla-ansible master: Allow outward_rabbitmq with enable_outward_rabbitmq https://review.openstack.org/511298 | 12:14 |
| *** jtriley has joined #openstack-kolla | 12:14 | |
| *** genek has joined #openstack-kolla | 12:17 | |
| *** genek has quit IRC | 12:22 | |
| *** ansmith has joined #openstack-kolla | 12:39 | |
| *** cah_link_ has quit IRC | 12:41 | |
| *** cah_link_ has joined #openstack-kolla | 12:41 | |
| Sean-md | Hi all, could you tell me how to enter containers which exited to check logs? | 12:42 |
| egonzalez | Sean-md, if container is exited or restarting cannot access to it, in any case there is no need to access, logs are in the host /var/lib/docker/volumes/kolla_logs/_data/ | 12:44 |
| egonzalez | any other thing that need to be shared/storaged in the host, is in its own volume | 12:44 |
| *** gkadam_ has quit IRC | 12:46 | |
| Sean-md | logs not exists in that directory. Do I need to configure for it? | 12:48 |
| Sean-md | I am deploying kolla-kubernetes | 12:49 |
| egonzalez | Sean-md, sorry, that is for kolla-ansible, no idea where kubernetes store logs | 12:49 |
| serlex | hi, anyone tried offline migration with ceph+ephemeral? | 12:50 |
| Sean-md | Thanks egonzalez | 12:51 |
| egonzalez | Sean-md, is there a /var/lib/docker/volumes/kolla-logs volume? | 12:53 |
| Sean-md | No, there is only metadata.db in /var/lib/docker/volumes in the host | 12:56 |
| *** jtriley has quit IRC | 12:58 | |
| *** mdnadeem has quit IRC | 12:58 | |
| Sean-md | egonzalez, in case kolla-ansible, where is the configure file to set for it? | 12:58 |
| egonzalez | Sean-md, there is no configuration file to set logs destination, defaults to a docker volume called kolla_logs mounted in the container to /var/log/kolla | 13:00 |
| hrw | is 'AMPQ server' rabbitmq? | 13:01 |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible master: Fix Ansible WARNING logs on reserved name: action https://review.openstack.org/511473 | 13:01 |
| egonzalez | yep | 13:01 |
| Sean-md | egonzalez Thank you so much. | 13:02 |
| dasTor | is there an easy way to get into a tennant network from a kolla host? | 13:03 |
| hrw | kolla-ansible deploy is 'fun' with non-root user. needs more sudo | 13:04 |
| egonzalez | dasTor, if have access to qrouter namespace ``ip netns`` you have direct connection to private networks | 13:05 |
| egonzalez | hrw, non-root is not fully implemented yet | 13:05 |
| egonzalez | only a couple of roles | 13:05 |
| hrw | egonzalez: as long as I do "sudo chmod 777 /etc/kolla /etc/kolla/*" it goes | 13:06 |
| dasTor | egonzalez, thanks. i tried ip netns on the compute host, didn't work. but on the network node it's working. | 13:06 |
| egonzalez | hrw, should fail because keepalived need some sudo things, also ovs, neutron and libvirt https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/nova/tasks/config.yml#L2 | 13:07 |
| egonzalez | can bypass that disabling setting sysctl but probably networks and instances wont work | 13:08 |
| egonzalez | dasTor, if not using distributed routers, namespaces are in network nodes, is good. should have access from network too | 13:08 |
| hrw | egonzalez: set_sysctl: "no" in place. | 13:12 |
| hrw | egonzalez: but yes, it is a mess | 13:12 |
| hrw | moving to ansible_user=root | 13:16 |
| krtaylor | egonzalez, spsurya - thanks for the merge of chason 's patch, I didn't care which, just that it got done | 13:22 |
| krtaylor | I wish that had popped up in the weeks prior to ptg when I was gathering all this info together | 13:23 |
| spsurya | krtaylor: thanks for work | 13:23 |
| spsurya | yeah | 13:23 |
| krtaylor | I WIPed mine last night to force the decision :) | 13:23 |
| *** k_mouza has joined #openstack-kolla | 13:24 | |
| spsurya | nice | 13:24 |
| *** jtriley has joined #openstack-kolla | 13:24 | |
| k_mouza | hello all! I have an issue with Sahara and Horizon. I'm using kolla 5.0.1, but I still get a non-booting horizon container when I enable the sahara_ui in the globals file. From docker logs horizon I get this error: cp: cannot stat '/usr/lib/python2.7/site-packages/sahara_dashboard/enabled/_*[^__].py': No such file or directory | 13:25 |
| krtaylor | yea! now on to individual docs, I hope to get all of your help - I'll ping chason to make sure we are on that same page | 13:25 |
| k_mouza | any suggestions please ? | 13:26 |
| *** jaosorior has quit IRC | 13:27 | |
| rwellum | Sean-md: you need to hop onto the container to see the logs | 13:27 |
| openstackgerrit | Dai Dang Van proposed openstack/kolla-ansible master: Add note about overwriting policy.json file https://review.openstack.org/511186 | 13:29 |
| rwellum | e.g: kubectl -n kolla exec -it mariadb-0 -- bash | 13:29 |
| *** daidv_ has joined #openstack-kolla | 13:31 | |
| dasTor | k_mouza, i walked into the same bug with the trove dashboard, disabled it in globals.yml and seemed to work for now | 13:34 |
| k_mouza | dasTor, yup, if I disable the sahara_horizon part in the globals file, the container starts fine, but the dashboard doesn't have the tab for Sahara | 13:36 |
| dasTor | just disable the dashboard, it will appear none the less | 13:36 |
| dasTor | enable_sahara: "yes" and enable_horizon_sahara: "no" | 13:37 |
| egonzalez | k_mouza, what distro / install_type are you using | 13:38 |
| dasTor | wanted to file a bug, but didn't get to it just yet | 13:38 |
| k_mouza | centos binary | 13:38 |
| dasTor | egonzalez, it's ubuntu with binary, for example | 13:38 |
| dasTor | maybe all binaries : | 13:38 |
| *** sbezverk has joined #openstack-kolla | 13:39 | |
| k_mouza | egonzalez, I tried with centos binary on kolla 5.0.1 and I'm getting the above error | 13:39 |
| k_mouza | egonzalez, dasTor, now trying just without the dashboard part of sahara, but I tried it earlier and the tab wasn't there. Double checking now again and I'll let you know | 13:41 |
| egonzalez | k_mouza, i'd say that with centos binary, does not care if you enable the dashboard or not. horizon tab is installed and enabled by default in the rpm. if horizon discover sahara endpoint will show it | 13:42 |
| egonzalez | k_mouza, can you check if there is somth in /usr/share/openstack-dashboard/openstack_dashboard/local/enabled/ ? | 13:43 |
| *** goldyfruit has joined #openstack-kolla | 13:44 | |
| hrw | kolla-test.local : ok=176 changed=48 unreachable=0 failed=0 | 13:44 |
| hrw | looks like deploy worked | 13:44 |
| *** skramaja has quit IRC | 13:45 | |
| *** rmart04 has quit IRC | 13:50 | |
| egonzalez | k_mouza, i have the sahara files in expected path, sure is using 5.0.0 ? | 13:53 |
| egonzalez | ()[root@434ff61b901c /]# find / -name _1810_data_processing_panel_group.py | 13:53 |
| egonzalez | /etc/openstack-dashboard/enabled/_1810_data_processing_panel_group.py | 13:53 |
| egonzalez | /usr/lib/python2.7/site-packages/sahara_dashboard/enabled/_1810_data_processing_panel_group.py | 13:53 |
| *** hrw has quit IRC | 13:55 | |
| *** itlinux has joined #openstack-kolla | 13:58 | |
| *** hrw has joined #openstack-kolla | 13:58 | |
| hrw | ok. horizon responds. just have to find login/pass info ;d | 13:59 |
| *** mgoddard has quit IRC | 13:59 | |
| *** mgoddard has joined #openstack-kolla | 13:59 | |
| egonzalez | hrw, have you created a instance with the ceph patch? gates error is during instance creation | 14:04 |
| hrw | egonzalez: once find out any user/pass combo will make an image and instance | 14:04 |
| hrw | etc/kolla/passwords.yml is definitelly wrong place to look for it | 14:05 |
| egonzalez | hrw, easier, source /etc/kolla/admin-openrc.sh and then sh tools/init-runonce.sh | 14:05 |
| egonzalez | will create image, networks and show you the command to create an instance | 14:05 |
| egonzalez | in etc/kolla/passwords is the admin password for horizon | 14:06 |
| *** janki has quit IRC | 14:06 | |
| hrw | egonzalez: no /etc/kolla/admin-openrc.sh on deployed machine. also not in config-dir of machine used to control deploy | 14:06 |
| egonzalez | kolla-ansible post-deploy | 14:07 |
| egonzalez | to generate creds file | 14:07 |
| hrw | fatal: [localhost]: FAILED! => {"changed": true, "failed": true, "msg": "Destination directory /etc/kolla does not exist"} | 14:07 |
| *** janki has joined #openstack-kolla | 14:07 | |
| hrw | who wrote that part... it should check/follow --config-dir | 14:08 |
| *** janki has quit IRC | 14:08 | |
| *** jaosorior has joined #openstack-kolla | 14:09 | |
| hrw | I have a feeling that kolla-ansible is a tool which should be used in VM as root to deploy to other root@machine systems | 14:09 |
| *** vincent_vdk has left #openstack-kolla | 14:10 | |
| hrw | https://paste.fedoraproject.org/paste/14wBxoTeOjic~V68YDOz1A | 14:11 |
| hrw | will submit it later | 14:11 |
| k_mouza | egonzalez, yup, I'm using 5.0.1, but the _18* files are not there for some reason, although the openstack-sahara-ui package is installed... | 14:11 |
| *** itlinux has quit IRC | 14:12 | |
| egonzalez | k_mouza, can you run in horizon container find / -name _1810_data_processing_panel_group.py | 14:12 |
| *** hongbin has joined #openstack-kolla | 14:13 | |
| k_mouza | egonzalez, only the links under /etc/openstack_dashboard exist, but the files they link to are not there ! (links are red) | 14:14 |
| hrw | egonzalez: thanks! got bug | 14:15 |
| egonzalez | k_mouza, what openstack-dashboard version is installed? | 14:16 |
| k_mouza | egonzalez, it's 12.0.0 | 14:17 |
| *** faridda has joined #openstack-kolla | 14:19 | |
| *** aagate has joined #openstack-kolla | 14:23 | |
| *** itlinux has joined #openstack-kolla | 14:24 | |
| hrw | egonzalez: is glance_registry a container keeping images or is it glance_api one? | 14:24 |
| egonzalez | hrw, ceph | 14:24 |
| egonzalez | glance api send the image to ceph | 14:24 |
| egonzalez | registry just is database stuff | 14:24 |
| hrw | egonzalez: I do not have ceph containers in this deploy | 14:25 |
| hrw | https://pastebin.ca/3886594 is docker ps | 14:25 |
| egonzalez | then is api yes, but the issue is with nova+ceph+glance | 14:25 |
| hrw | egonzalez: no. issue is with nova and qemu. I got htat bug in deployment without ceph | 14:26 |
| egonzalez | yeah, without ceph also fail, my bad | 14:27 |
| egonzalez | is failing in nova-compute with qemu-img | 14:27 |
| egonzalez | http://logs.openstack.org/66/510866/1/check/gate-kolla-ansible-dsvm-deploy-ubuntu-binary-ubuntu-xenial-nv/90956d5/logs/kolla/nova/nova-compute.txt.gz#_2017-10-10_13_43_51_858 | 14:27 |
| hrw | egonzalez: yep. see it here in logs of nova-compute too | 14:28 |
| hrw | egonzalez: to make fun 'qemu-img info 6bc82522-c4fc-4355-be12-7045ceab8d37' in glance_api container gives proper output | 14:28 |
| hrw | with qemu 2.5 | 14:28 |
| hrw | will dig | 14:28 |
| egonzalez | nova compute download the image into /var/lib/nova/ | 14:28 |
| *** itlinux has quit IRC | 14:32 | |
| *** genek has joined #openstack-kolla | 14:33 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: post-deploy: honour --config-dir argument https://review.openstack.org/511491 | 14:35 |
| *** itlinux has joined #openstack-kolla | 14:36 | |
| hrw | please review ^^ | 14:36 |
| *** faridda has quit IRC | 14:36 | |
| *** yingjun has joined #openstack-kolla | 14:43 | |
| *** jtriley has quit IRC | 14:52 | |
| hrw | how to start fresh nova-compute container? "docker run gossamer.lan:5000/kolla/ubuntu-binary-nova-compute:pike" is not enough | 14:53 |
| egonzalez | k_mouza, just deployed horizon with sahara and the panel appears (centos binary pike) | 14:53 |
| -openstackstatus- NOTICE: Job log uploads are failing due to lack of inodes. Jobs also fail due to mismatches in gnutls packages. Workarounds for both in progress with proper fixes to follow. | 14:54 | |
| egonzalez | hrw, start fresh? do kolla-ansible pull to download newer image and kolla-ansible deploy, will detect the image differs and replace it | 14:54 |
| *** ChanServ changes topic to "Job log uploads are failing due to lack of inodes. Jobs also fail due to mismatches in gnutls packages. Workarounds for both in progress with proper fixes to follow." | 14:54 | |
| hrw | egonzalez: I committed some changes to container, stopped it and need to run exactly one I have on host. /me is docker n00b still | 14:54 |
| hrw | egonzalez: s/some changes/extra debugs/ | 14:55 |
| egonzalez | hrw, inside the running container or in the image? | 14:55 |
| egonzalez | if running container just restart it, docker restart nova_compute | 14:55 |
| hrw | did in running, exit, docker commit nova_compute | 14:55 |
| hrw | thx! | 14:56 |
| *** lpetrut_ has quit IRC | 14:57 | |
| * hrw off | 14:59 | |
| *** jamesbenson has joined #openstack-kolla | 15:00 | |
| *** b_bezak has quit IRC | 15:00 | |
| *** sebastien__ has joined #openstack-kolla | 15:00 | |
| openstackgerrit | Farid Da Encarnacao proposed openstack/kolla-ansible master: Gnocchi not covered by external Ceph https://review.openstack.org/511500 | 15:05 |
| *** jaosorior has quit IRC | 15:05 | |
| *** jtriley has joined #openstack-kolla | 15:09 | |
| *** ntpttr_laptop has joined #openstack-kolla | 15:16 | |
| *** itlinux has quit IRC | 15:17 | |
| *** danardelean has quit IRC | 15:18 | |
| *** ntpttr_laptop has quit IRC | 15:20 | |
| *** cah_link__ has quit IRC | 15:23 | |
| *** cah_link_ has quit IRC | 15:23 | |
| openstackgerrit | Farid Da Encarnacao proposed openstack/kolla-ansible master: Gnocchi not covered by external Ceph https://review.openstack.org/511500 | 15:27 |
| *** serlex has quit IRC | 15:36 | |
| *** itlinux has joined #openstack-kolla | 15:42 | |
| *** unicell has quit IRC | 15:54 | |
| *** athomas has quit IRC | 15:54 | |
| *** egonzalez has quit IRC | 15:55 | |
| *** unicell has joined #openstack-kolla | 15:57 | |
| *** erlon has quit IRC | 16:07 | |
| *** masber has quit IRC | 16:09 | |
| inc0 | good morning | 16:29 |
| *** itlinux has quit IRC | 16:32 | |
| *** sambetts is now known as sambetts|afk | 16:34 | |
| *** danardelean has joined #openstack-kolla | 16:41 | |
| *** k_mouza has quit IRC | 16:44 | |
| *** danardelean has quit IRC | 16:45 | |
| *** oanson has quit IRC | 16:50 | |
| *** oanson has joined #openstack-kolla | 16:50 | |
| *** danardelean has joined #openstack-kolla | 16:51 | |
| *** danardelean has quit IRC | 16:52 | |
| *** dougsz has quit IRC | 16:59 | |
| *** zhubingbing__ has joined #openstack-kolla | 17:01 | |
| *** mgoddard has quit IRC | 17:05 | |
| *** jbadiapa has quit IRC | 17:07 | |
| *** genek has quit IRC | 17:11 | |
| *** danardelean has joined #openstack-kolla | 17:11 | |
| *** ntpttr has joined #openstack-kolla | 17:13 | |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Move to zuul v3 in project jobs https://review.openstack.org/508759 | 17:13 |
| *** b_bezak has joined #openstack-kolla | 17:22 | |
| rwellum | kfox1111: afayk - are these the only PS's needed for k8s 1.8? | 17:28 |
| *** shardy has quit IRC | 17:29 | |
| rwellum | kfox1111 https://www.irccloud.com/pastebin/Zadql6fd/ | 17:29 |
| *** genek has joined #openstack-kolla | 17:31 | |
| *** yingjun has quit IRC | 17:32 | |
| *** danardelean has quit IRC | 17:33 | |
| *** genek has quit IRC | 17:43 | |
| *** jamesbenson has quit IRC | 17:44 | |
| rwellum | kfox1111: so seeing a lot of crashes and wondering if I am missing something. | 17:44 |
| *** jamesbenson has joined #openstack-kolla | 17:44 | |
| *** jamesbenson has quit IRC | 17:48 | |
| *** rwsu has quit IRC | 17:51 | |
| *** genek has joined #openstack-kolla | 17:52 | |
| *** jamesbenson has joined #openstack-kolla | 17:54 | |
| *** genek has quit IRC | 17:56 | |
| *** jascott1 has joined #openstack-kolla | 17:57 | |
| kfox1111 | morning. | 17:57 |
| *** jamesbenson has quit IRC | 17:58 | |
| *** mgoddard has joined #openstack-kolla | 17:58 | |
| kfox1111 | rwellum: unsure. no one is running it currently that I'm aware of on 1.8 outside the gate. | 17:58 |
| kfox1111 | its workign reliably in the gate I think, but it doesn't run for very long. | 17:59 |
| rwellum | Well I debugged a little - the nova pods are complaining: "error: package qemu-system-x86 is not installed" | 17:59 |
| kfox1111 | what kind of things are you seeing? | 17:59 |
| kfox1111 | hmm... | 17:59 |
| kfox1111 | that I think was a workaround for older versions. does it crash there or just continue on? | 17:59 |
| *** zhubingbing__ has quit IRC | 17:59 | |
| rwellum | It continues, but the pod is in crashloopbackoff | 18:00 |
| rwellum | https://www.irccloud.com/pastebin/pEW5JdLv/ | 18:00 |
| *** jtriley has quit IRC | 18:01 | |
| rwellum | The other pod, is complaining about the usual 'no hosts' issue: | 18:02 |
| rwellum | https://www.irccloud.com/pastebin/lfK0UGnn/ | 18:02 |
| kfox1111 | unrelated I think. | 18:02 |
| kfox1111 | we need to get the libvirt logs I think. | 18:02 |
| rwellum | Ok. You think the above could be a root cause? | 18:03 |
| kfox1111 | quite possible. | 18:03 |
| *** jtriley has joined #openstack-kolla | 18:05 | |
| *** genek has joined #openstack-kolla | 18:06 | |
| rwellum | Well I am pointed to the placement_api by googling this issue but I think my cloud.yaml is fine? | 18:07 |
| rwellum | https://www.irccloud.com/pastebin/JhTTQeX8/ | 18:07 |
| *** jamesbenson has joined #openstack-kolla | 18:09 | |
| kfox1111 | but Idon't think any nova-compute will properly register if its libvirt's are crashing. | 18:09 |
| SamYaple | kfox1111: it will show a libvirt connect error in nova service-list | 18:10 |
| *** genek has quit IRC | 18:10 | |
| SamYaple | and be disabled | 18:11 |
| *** jamesbenson has quit IRC | 18:11 | |
| kfox1111 | yeah. I don't know if placement_api would do too well in that state. | 18:12 |
| kfox1111 | we should fix the libvirt crashing issue before debugging the placement thing. | 18:12 |
| *** jamesbenson has joined #openstack-kolla | 18:14 | |
| *** unicell has quit IRC | 18:15 | |
| *** genek has joined #openstack-kolla | 18:15 | |
| rwellum | SamYaple: I'm not far along enough to do a nova service-list | 18:16 |
| *** jamesbenson has quit IRC | 18:17 | |
| *** hachi_ has joined #openstack-kolla | 18:25 | |
| *** jamesbenson has joined #openstack-kolla | 18:27 | |
| *** jamesbenson has quit IRC | 18:28 | |
| *** b_bezak has quit IRC | 18:30 | |
| inc0 | kfox1111: got a second for pm? | 18:34 |
| *** jamesbenson has joined #openstack-kolla | 18:34 | |
| *** lrensing has joined #openstack-kolla | 18:37 | |
| *** jamesbenson has quit IRC | 18:38 | |
| *** mgoddard has quit IRC | 19:02 | |
| *** harlowja has quit IRC | 19:03 | |
| *** masber has joined #openstack-kolla | 19:05 | |
| *** danardelean has joined #openstack-kolla | 19:07 | |
| *** masber has quit IRC | 19:10 | |
| *** jamesbenson has joined #openstack-kolla | 19:11 | |
| *** danardelean has quit IRC | 19:14 | |
| *** lrensing has quit IRC | 19:20 | |
| *** lrensing has joined #openstack-kolla | 19:23 | |
| *** lrensing has quit IRC | 19:32 | |
| *** gfidente is now known as gfidente|afk | 19:35 | |
| *** lpetrut_ has joined #openstack-kolla | 19:46 | |
| *** vhosakot has joined #openstack-kolla | 19:51 | |
| *** Pavo has joined #openstack-kolla | 19:54 | |
| *** lvdombrkr has quit IRC | 19:57 | |
| *** harlowja has joined #openstack-kolla | 19:57 | |
| *** pcaruana has quit IRC | 19:58 | |
| *** Pavo has quit IRC | 19:59 | |
| *** Pavo has joined #openstack-kolla | 20:01 | |
| *** ansmith has quit IRC | 20:28 | |
| *** hachi_ has quit IRC | 20:30 | |
| *** Pavo has quit IRC | 20:42 | |
| *** lpetrut_ has quit IRC | 20:49 | |
| *** jtriley has quit IRC | 21:14 | |
| *** danardelean has joined #openstack-kolla | 21:15 | |
| *** danardelean has quit IRC | 21:19 | |
| *** jascott1 has quit IRC | 21:22 | |
| *** Croata has quit IRC | 21:36 | |
| *** danardelean has joined #openstack-kolla | 21:51 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements https://review.openstack.org/509443 | 21:55 |
| *** danardelean has quit IRC | 21:59 | |
| *** jamesbenson has quit IRC | 22:02 | |
| *** dardelean_ has quit IRC | 22:03 | |
| *** jamesbenson has joined #openstack-kolla | 22:04 | |
| *** danardelean has joined #openstack-kolla | 22:07 | |
| *** jamesbenson has quit IRC | 22:09 | |
| *** jascott1 has joined #openstack-kolla | 22:12 | |
| *** jascott1 has quit IRC | 22:16 | |
| *** jascott1 has joined #openstack-kolla | 22:16 | |
| *** jascott1 has quit IRC | 22:21 | |
| *** jascott1 has joined #openstack-kolla | 22:25 | |
| *** kbyrne has quit IRC | 22:30 | |
| *** kbyrne has joined #openstack-kolla | 22:33 | |
| *** goldyfruit has quit IRC | 22:47 | |
| *** ChanServ changes topic to "support: ask.openstack.org | New to Kolla: docs @ https://docs.openstack.org/kolla/latest/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b" | 23:03 | |
| -openstackstatus- NOTICE: Workarounds are in place for libcurl and similar dependency errors due to stale ubuntu mirroring, and for POST_FAILURE results stemming from runaway inode utilization on the logs site; feel free to recheck failing changes for either of these problems now | 23:03 | |
| *** danardelean has quit IRC | 23:08 | |
| *** rwsu has joined #openstack-kolla | 23:14 | |
| *** hongbin has quit IRC | 23:15 | |
| *** danardelean has joined #openstack-kolla | 23:24 | |
| *** lvdombrkr has joined #openstack-kolla | 23:25 | |
| *** danardelean has quit IRC | 23:28 | |
| *** masber has joined #openstack-kolla | 23:47 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!