| *** manheim has quit IRC | 00:00 | |
| *** masuberu has quit IRC | 00:02 | |
| *** salv-orlando has joined #openstack-kolla | 00:15 | |
| *** salv-orlando has quit IRC | 00:20 | |
| *** kbaegis has quit IRC | 00:29 | |
| *** eaguilar has joined #openstack-kolla | 00:32 | |
| *** eaguilar has quit IRC | 00:33 | |
| sdake | jamespr currently stable/ocata doesn't build properly | 00:39 |
|---|---|---|
| sdake | jamespr this patch works for me for kolla-kubernetes backported: https://review.openstack.org/#/c/468632/ | 00:41 |
| sdake | although as you cna see it doesn't pass the master gates | 00:41 |
| *** tovin07_ has joined #openstack-kolla | 00:47 | |
| *** duonghq has joined #openstack-kolla | 00:49 | |
| *** cuongnv has joined #openstack-kolla | 00:49 | |
| jamesPR | sdake, There are no longer separate MariaDB Galera Cluster releases for MariaDB 10.1 and above. Simply download MariaDB (10.1 or above) and configure your cluster as normal. | 00:50 |
| jamesPR | ;) | 00:50 |
| sdake | i'd rather eject mariadb.org as a repo | 00:50 |
| duonghq | morning guys | 00:50 |
| jamesPR | sdake, why? | 00:50 |
| jamesPR | duonghq, morning | 00:51 |
| sdake | red hat has 20+ people maintaining mariadb | 00:51 |
| sdake | sup duonghq | 00:52 |
| sdake | jamesPR also we have 3 repos that contain mariadb, we only need one | 00:54 |
| jamesPR | sdake, ;) then RDO instead ? | 00:54 |
| sdake | jamesPR with 3 repos with the same package names, there is no wayt o properly select the correctpackage | 00:54 |
| sdake | yes that patch uses the rdo version | 00:54 |
| jamesPR | sdake, is posible to use RDO repo for everything? | 00:56 |
| sdake | yup | 00:56 |
| jamesPR | how? | 00:56 |
| sdake | write code to do so | 00:56 |
| sdake | which is what that patch does | 00:56 |
| jamesPR | ok | 00:57 |
| sdake | however its the weekend and i'm tired of working | 00:57 |
| sdake | so not working on it | 00:57 |
| sdake | feel free to take it over :) | 00:57 |
| jamesPR | I think there is another way much simpler | 00:57 |
| jamesPR | egonzales have something like: vi /etc/kolla/kolla-build.conf | 00:58 |
| jamesPR | base = centos | 00:58 |
| jamesPR | base_tag = mitaka | 00:58 |
| jamesPR | push = true | 00:58 |
| jamesPR | install_type = rdo | 00:58 |
| jamesPR | registry = docker.io | 00:58 |
| jamesPR | ;) | 00:58 |
| *** jgriffith has quit IRC | 01:00 | |
| *** Pavo has quit IRC | 01:15 | |
| *** salv-orlando has joined #openstack-kolla | 01:16 | |
| *** eaguilar has joined #openstack-kolla | 01:17 | |
| *** salv-orlando has quit IRC | 01:21 | |
| *** hrw has quit IRC | 01:32 | |
| *** hrw has joined #openstack-kolla | 01:34 | |
| *** masber has joined #openstack-kolla | 01:41 | |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla master: Remove all Heka related remaining stuff https://review.openstack.org/446036 | 01:42 |
| *** Pavo has joined #openstack-kolla | 01:52 | |
| *** Pavo has quit IRC | 02:01 | |
| *** emccormick has joined #openstack-kolla | 02:21 | |
| *** jamesPR has quit IRC | 02:45 | |
| *** kbaegis has joined #openstack-kolla | 02:45 | |
| *** itlinux has joined #openstack-kolla | 03:14 | |
| *** eaguilar has quit IRC | 03:25 | |
| *** janki has joined #openstack-kolla | 03:44 | |
| *** itlinux has quit IRC | 03:57 | |
| *** Pavo has joined #openstack-kolla | 03:58 | |
| *** itlinux has joined #openstack-kolla | 04:01 | |
| *** itlinux has quit IRC | 04:04 | |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: Optimize reconfiguration for mariadb https://review.openstack.org/433480 | 04:09 |
| *** emccormick has quit IRC | 04:10 | |
| *** emccormick has joined #openstack-kolla | 04:10 | |
| *** itlinux has joined #openstack-kolla | 04:13 | |
| *** itlinux has quit IRC | 04:17 | |
| *** itlinux has joined #openstack-kolla | 04:23 | |
| *** itlinux has quit IRC | 04:28 | |
| *** salv-orlando has joined #openstack-kolla | 04:29 | |
| *** emccormick has quit IRC | 04:29 | |
| *** jamesbenson has joined #openstack-kolla | 04:37 | |
| *** jaosorior has joined #openstack-kolla | 04:45 | |
| *** itlinux has joined #openstack-kolla | 04:45 | |
| *** Pavo has quit IRC | 04:46 | |
| *** Pavo has joined #openstack-kolla | 04:47 | |
| *** jamesbenson has quit IRC | 04:52 | |
| *** jamesbenson has joined #openstack-kolla | 04:52 | |
| *** jamesbenson has quit IRC | 04:54 | |
| *** jamesbenson has joined #openstack-kolla | 04:54 | |
| *** jamesbenson has quit IRC | 04:59 | |
| *** masber has quit IRC | 05:04 | |
| *** masber has joined #openstack-kolla | 05:04 | |
| *** jamesbenson has joined #openstack-kolla | 05:12 | |
| *** Pavo has quit IRC | 05:18 | |
| *** itlinux has quit IRC | 05:33 | |
| *** skramaja has joined #openstack-kolla | 05:55 | |
| *** ahonda has joined #openstack-kolla | 06:08 | |
| *** sbezverk_ has quit IRC | 06:09 | |
| *** magicboiz has joined #openstack-kolla | 06:22 | |
| *** tvignaud_pto is now known as tvignaud | 06:24 | |
| *** magicboiz has quit IRC | 06:27 | |
| *** magicboiz has joined #openstack-kolla | 06:27 | |
| *** jamesbenson has quit IRC | 06:32 | |
| *** jamesbenson has joined #openstack-kolla | 06:32 | |
| *** jamesbenson has quit IRC | 06:36 | |
| *** jamesbenson has joined #openstack-kolla | 06:46 | |
| *** jamesbenson has quit IRC | 06:48 | |
| *** jamesbenson has joined #openstack-kolla | 06:48 | |
| *** jamesbenson has quit IRC | 06:49 | |
| *** jamesbenson has joined #openstack-kolla | 06:49 | |
| *** jamesbenson has quit IRC | 06:54 | |
| *** salv-orl_ has joined #openstack-kolla | 07:04 | |
| *** magicboiz has quit IRC | 07:07 | |
| *** salv-orlando has quit IRC | 07:07 | |
| *** korzen has joined #openstack-kolla | 07:09 | |
| *** cristicalin has joined #openstack-kolla | 07:11 | |
| *** chas has joined #openstack-kolla | 07:15 | |
| *** cristicalin has quit IRC | 07:21 | |
| *** magicboiz has joined #openstack-kolla | 07:26 | |
| *** ahonda has quit IRC | 07:26 | |
| *** magicboiz has quit IRC | 07:30 | |
| *** dasTor_ has quit IRC | 07:36 | |
| *** dasTor has joined #openstack-kolla | 07:37 | |
| *** magicboiz has joined #openstack-kolla | 07:38 | |
| *** magicboiz has quit IRC | 07:38 | |
| *** sgrasley has quit IRC | 07:40 | |
| *** sgrasley1 has joined #openstack-kolla | 07:40 | |
| *** egonzalez has joined #openstack-kolla | 07:43 | |
| *** matrohon has joined #openstack-kolla | 07:44 | |
| *** manheim has joined #openstack-kolla | 07:52 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Add jinja2-py version check in pre_checks https://review.openstack.org/454590 | 07:53 |
| *** tvignaud has quit IRC | 08:02 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Enabled pxe_ssh driver in ironic https://review.openstack.org/468606 | 08:10 |
| *** tvignaud has joined #openstack-kolla | 08:15 | |
| berendt | sdake: ping | 08:22 |
| openstackgerrit | Christian Berendt proposed openstack/kolla-ansible master: Fix "key_repository is world readable: /etc/keystone/fernet-keys/" warning https://review.openstack.org/468452 | 08:23 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Move mDNS to network nodes https://review.openstack.org/468534 | 08:25 |
| *** lpetrut has joined #openstack-kolla | 08:30 | |
| *** pbourke has quit IRC | 08:34 | |
| *** pbourke has joined #openstack-kolla | 08:34 | |
| mandre | egonzalez: hi Eduardo, do we have a hard rule about 4 space indenting in Dockerfile? | 09:03 |
| egonzalez | mandre, I dont think so, but is common jinja style | 09:04 |
| egonzalez | most dockefiles follows 4 space indents | 09:04 |
| mandre | egonzalez: I mean if that's something we expect from new contributors, it should be documented somewhere | 09:04 |
| mandre | and potentially enforced in CI | 09:05 |
| *** magicboiz has joined #openstack-kolla | 09:08 | |
| mandre | I'm personally for not nitpicking on the formatting, but if you guys think it's better for consistency for instance, it should be done by a computer IMO | 09:08 |
| *** bjolo has joined #openstack-kolla | 09:08 | |
| *** magicboiz has quit IRC | 09:12 | |
| *** magicboiz has joined #openstack-kolla | 09:13 | |
| bjolo | morning | 09:25 |
| hrw | morning | 09:27 |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: Specify 'become' for only necessary tasks (default roles) https://review.openstack.org/398684 | 09:29 |
| openstackgerrit | Merged openstack/kolla master: Add short README file for contrib/template-override directory https://review.openstack.org/422552 | 09:39 |
| openstackgerrit | Merged openstack/kolla-ansible master: Change default permissions in jinja templates. https://review.openstack.org/445797 | 10:17 |
| *** cuongnv has quit IRC | 10:22 | |
| *** tovin07_ has quit IRC | 10:24 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Remove deprecated options designate https://review.openstack.org/450715 | 10:24 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Remove deprecated options designate https://review.openstack.org/450715 | 10:36 |
| hrw | egonzalez: can you +2 https://review.openstack.org/#/c/467568/ one? it makes dragonflow buildable for debian/source combo | 10:37 |
| hrw | https://review.openstack.org/#/c/468348/ (fix gnocchi for centos/source non-x86 combo) and https://review.openstack.org/#/c/464045/ (let build kubernetes stuff also for aarch64) are also easy pickups | 10:38 |
| egonzalez | hrw, why using developer files instead of main? | 10:38 |
| hrw | egonzalez: my golden rule is to not depend on library packages. | 10:45 |
| hrw | I consider it a bad practise | 10:45 |
| *** bmaltais has quit IRC | 10:46 | |
| hrw | but doing check with libzmq5 now | 10:47 |
| *** MarginHu has joined #openstack-kolla | 10:48 | |
| *** jamesPR has joined #openstack-kolla | 10:51 | |
| Seyong | Hello guys, I created an instance and gave a float ip address to it, I can log in via SSH from compute node to the instance. However in the instance, I can not access internet(external network). Anyone have any idea on this? | 10:58 |
| jamesPR | Seyong, can you ping an external ip from instance? | 10:59 |
| jamesPR | for example ping 8.8.8.8 | 10:59 |
| manheim | i have a docker question, which is the best way to run commands in a container after it's creation? i used docker exec <command> from outside the container, but what if i want to automate it in a more elegent way | 11:05 |
| manheim | CMD from the dockerdile? | 11:05 |
| egonzalez | MarginHu, around? | 11:05 |
| Seyong | jamesPR: ping does not pong any of external ip address. | 11:06 |
| jamesPR | sup egonzalez | 11:06 |
| egonzalez | hey jamesPR | 11:06 |
| Seyong | jamesPR: ping reached to compute host ip addr only | 11:06 |
| jamesPR | Seyong, maybe a routing issue | 11:08 |
| jamesPR | can you ping the gateway from instance? | 11:08 |
| Seyong | jamesPR: hmm I have one NIC, then should network_interface and neutron_external_interface are the NIC what I have? is it correct..? | 11:09 |
| Seyong | ping doent work to gw also | 11:09 |
| Seyong | both configuration is of /etc/kolla/global.yml | 11:09 |
| egonzalez | Seyong, nope, unless you create sub interfaces neutron_external_interface cannot be network_interface | 11:10 |
| egonzalez | actually now you should not be able to ping outside from the host itself | 11:10 |
| Seyong | egonzalez: from host(compute) not an instance? from host I can access outside as well.. | 11:11 |
| egonzalez | hrm, weird, usually networking is lost while applying ovs role when using single interface | 11:12 |
| jamesPR | egonzalez, recently I update all my images then now mariadb give an error when Running MariaDB bootstrap | 11:12 |
| *** jtriley has quit IRC | 11:12 | |
| egonzalez | jamesPR, how recently? | 11:12 |
| jamesPR | yesterday | 11:12 |
| egonzalez | which vesion? | 11:12 |
| *** circ-user-TeTGj has joined #openstack-kolla | 11:13 | |
| Seyong | egonzalez: well, I tried add my nic to br-ex bridge then host can not access external.... is it your saying..? | 11:13 |
| jamesPR | latest from git | 11:13 |
| egonzalez | jamesPR, let me try with centos source | 11:14 |
| egonzalez | Seyong, yep, that's what happen while applying ovs role because the interface is added into br-ex | 11:15 |
| MarginHu | hi, is it necessary that br-ex is existed in compute node ? | 11:20 |
| sdake | eglute this needs work: https://review.openstack.org/#/c/468632/ | 11:27 |
| sdake | egonzalez ^^ | 11:27 |
| manheim | egonzalez did you see my question/ | 11:33 |
| egonzalez | sdake, what question? | 11:34 |
| egonzalez | MarginHu, nope, br-ex should not exists on compute nodes unless dvr is enabled, was fixed upstream and backported to ocata | 11:35 |
| MarginHu | do you know which commit id ? | 11:36 |
| egonzalez | MarginHu, sorry, is not merged on ocata https://review.openstack.org/#/c/465865/ | 11:37 |
| MarginHu | thank you very much. | 11:38 |
| egonzalez | MarginHu, regarding the memcached reconfigure bug, it worked for me, what ansible and kolla version are you using? | 11:40 |
| *** salv-orl_ has quit IRC | 11:40 | |
| MarginHu | ansible 2.3.0.0, kolla 4.0.0.1 | 11:41 |
| MarginHu | what ansible version are you using? | 11:42 |
| egonzalez | 2.3 too | 11:43 |
| egonzalez | can you check the contents of ansible/roles/memcached/tasks/reconfigure.yml ? | 11:44 |
| egonzalez | is a symbolic link to depoy.yml | 11:44 |
| MarginHu | no , it's content is one line: deploy.yml , not a symbolic link | 11:44 |
| egonzalez | ok, thats fine | 11:45 |
| egonzalez | jamesPR, mariadb bootstrap wfm | 11:45 |
| egonzalez | built 2 hours ago | 11:46 |
| MarginHu | my kolla version is older than latest kolla upstream | 11:46 |
| sdake | egonzalez stable/ocat is broken | 11:48 |
| sdake | egonzalez the soltuion is to fix that review above | 11:48 |
| sdake | egonzalez that review above works for me on kolla-kubernetes, but not kolla-ansible | 11:48 |
| sdake | egonzalez any chance you can take al ook? | 11:48 |
| egonzalez | sdake, ooo, we fixed it pining version to 10.0.30 instead of 10.0 until mariadb packages are fixed (mariadb missed build galera packages) | 11:49 |
| sdake | that is the wrong solution | 11:49 |
| egonzalez | but, yes. we talked about removing mariadb repos and use rdo | 11:50 |
| *** chandankumar is now known as chkumar|hackersp | 11:52 | |
| MarginHu | egonzalez, I test my ansible think that is syntax error | 11:54 |
| MarginHu | I remember old version is symblic | 11:57 |
| *** bmaltais has joined #openstack-kolla | 11:57 | |
| jamesPR | egonzalez, how can I fix the mariadb issue? | 11:58 |
| sdake | egonzalez mariadb didn't miss building galera packages | 12:05 |
| *** janki has quit IRC | 12:05 | |
| sdake | egonzalez they are in the repository under a different name | 12:05 |
| sdake | egonzalez anyway imo we need to eject mariadb.org as a repo dep and just use rdo | 12:06 |
| sdake | egonzalez any chance you can take on that activity? | 12:06 |
| egonzalez | sdake, galera packages were merged into mariadb-server in mariadb 10.1, in 10.0 remain being different packages | 12:06 |
| egonzalez | 10.0.30 have the package but with the release of 10.0.31 missed | 12:06 |
| jamesPR | There are no longer separate MariaDB Galera Cluster releases for MariaDB 10.1 and above. Simply download MariaDB (10.1 or above) and configure your cluster as normal. | 12:09 |
| sdake | rdo uses maridb 10.1 | 12:10 |
| sdake | and it has a mariadb-server-galera pacakkge | 12:10 |
| sdake | no idea what is in it | 12:10 |
| *** sbezverk has joined #openstack-kolla | 12:10 | |
| sdake | maradb 10.1 from mariadb.org ALSO HAS a mariadb-server-galera package | 12:10 |
| sdake | egonzalez what I want to know is if you will tkae over that review i started | 12:11 |
| sdake | or not | 12:11 |
| egonzalez | sdake, im looking into it, but im not a mariadb expert | 12:12 |
| bmaltais | egonzalez: Morning. Do you run your openstack environment with LDAP Domain integration? | 12:12 |
| sdake | https://review.openstack.org/#/c/468632/ | 12:12 |
| bmaltais | egonzalez: I am not sure what is going on but I think there might be an issue with ldap domain integration with the current 4.0.0 kolla-ansible builds | 12:13 |
| bmaltais | egonzalez: I can configure ldap domain, list ldap users using "openstack user list --domain ducourrier" | 12:14 |
| bmaltais | egonzalez: Validate that keystone is indeed validating credentials of users in ldap | 12:14 |
| bmaltais | egonzalez: But when I login with one of them I keep getting "An error occurred authenticating. Please try again later." | 12:15 |
| sdake | egonzalez the fact that stable/ocata is unbuildable is a critical issue - need some help in resolving it | 12:15 |
| bmaltais | egonzalez:: And I see a bunch of errors in keystone logs: "ERROR keystone.common.wsgi result = method(req, **params)" | 12:18 |
| bmaltais | Anyone that successfully run LDAP Domain authentication with kolla-ansible in the channel? | 12:18 |
| *** salv-orlando has joined #openstack-kolla | 12:20 | |
| *** pcaruana has joined #openstack-kolla | 12:20 | |
| sdake | jamesPR is percona integrated into mariadb10..1? | 12:20 |
| *** caoyuan has joined #openstack-kolla | 12:35 | |
| jamesPR | sdake, ? I think that percona is like another fork of mysql ;) | 12:39 |
| sdake | jamesPR we use xtrabackup - for whatever godawful reason | 12:43 |
| *** janki has joined #openstack-kolla | 12:52 | |
| *** janki has quit IRC | 12:54 | |
| *** skramaja has quit IRC | 12:57 | |
| *** goldyfruit has joined #openstack-kolla | 12:58 | |
| openstackgerrit | Steven Dake proposed openstack/kolla master: Consume centos-pike-testing mariadb version https://review.openstack.org/468632 | 13:01 |
| openstackgerrit | Mathieu Rohon proposed openstack/kolla master: Add skydive service https://review.openstack.org/459995 | 13:03 |
| *** jtriley has joined #openstack-kolla | 13:04 | |
| *** salv-orl_ has joined #openstack-kolla | 13:04 | |
| *** salv-orlando has quit IRC | 13:07 | |
| *** jtriley has quit IRC | 13:08 | |
| *** jtriley has joined #openstack-kolla | 13:09 | |
| *** jtriley has quit IRC | 13:14 | |
| *** Pavo has joined #openstack-kolla | 13:17 | |
| *** manheim has quit IRC | 13:35 | |
| *** jamesPR has quit IRC | 13:36 | |
| *** jtriley has joined #openstack-kolla | 14:03 | |
| *** MarginHu has quit IRC | 14:04 | |
| openstackgerrit | Mathieu Rohon proposed openstack/kolla master: Add skydive service https://review.openstack.org/459995 | 14:07 |
| *** jtriley has quit IRC | 14:08 | |
| *** jtriley has joined #openstack-kolla | 14:08 | |
| kbaegis | Morning all! Still troubleshooting cinder/iscsi configs: https://hastebin.com/womunobomi.sql, https://hastebin.com/xeqoruhoqi.sql | 14:11 |
| *** jgriffith_ has joined #openstack-kolla | 14:12 | |
| *** jtriley has quit IRC | 14:14 | |
| *** magicboiz has quit IRC | 14:14 | |
| kbaegis | Here's my custom config; reconfiguring now https://hastebin.com/mikaweheso.makefile | 14:14 |
| kbaegis | Going to replicate my configuration inside an instance with gentoo installed- requirement for the gentoo deployment guide to make sure it all works | 14:16 |
| *** caoyuan_ has joined #openstack-kolla | 14:20 | |
| *** caoyuan has quit IRC | 14:20 | |
| bmaltais | I think the LDAP Domain authentication issue is linked to this bug: https://bugs.launchpad.net/keystone/+bug/1662762 | 14:20 |
| openstack | Launchpad bug 1662762 in OpenStack Identity (keystone) ocata "Authentication for LDAP user fails at MFA rule check" [High,Fix released] - Assigned to Matthew Edmonds (edmondsw) | 14:20 |
| kbaegis | Anyone with experience with cinder/lvm/iscsi and kolla that can help would be greatly appreciated | 14:21 |
| *** zhubingbing has joined #openstack-kolla | 14:24 | |
| zhubingbing | hi guys | 14:24 |
| bmaltais | kbaegis: Sorry. Would help if I could but not much experience with that. | 14:25 |
| kbaegis | bmaltais: Thanks anyways :) | 14:26 |
| bmaltais | Is there a way to "login" to the keystone container to make manual changes to a file inside? | 14:29 |
| bmaltais | Tried "docker exec keystone bash" and I only get dead air | 14:29 |
| bmaltais | I want to apply a manual patch to it to make LDAP domain authentication work as the current 4.0.0 container has a bug | 14:30 |
| pomac | docker exec -it keystone bash | 14:32 |
| *** jgriffith_ is now known as jgriffith | 14:32 | |
| pomac | bmaltais: but depending on the file you want to change, /etc/kolla/ might be where you want to look | 14:32 |
| bmaltais | pomac: I did it with "docker cp t keystone:/usr/lib/python2.7/site-packages/keystone/identity/backends/ldap/core.py" | 14:34 |
| hrw | egonzalez: with libzmq5 it builds too. which looks weird for me | 14:35 |
| bmaltais | And I have proven that my LDAP Domain authentication issue was a bug in keystone 4.0.0 container all along! | 14:35 |
| bmaltais | Arrrrggggg | 14:35 |
| openstackgerrit | zhubingbing proposed openstack/kolla master: Fix rally create verifier error https://review.openstack.org/467837 | 14:35 |
| bmaltais | Spent 2 days debugging my config file when it was fine all along ;-) | 14:35 |
| *** manheim has joined #openstack-kolla | 14:36 | |
| *** hongbin has joined #openstack-kolla | 14:37 | |
| *** faridda has joined #openstack-kolla | 14:41 | |
| *** eaguilar has joined #openstack-kolla | 14:43 | |
| kbaegis | Figured it out everyone! Another kernel dependency for CONFIG_ISCSI_TCP | 14:44 |
| kbaegis | All the stuff upstream ubuntu takes care of for you when they're not breaking stuff with systemd ;) | 14:45 |
| *** salv-orl_ has quit IRC | 14:54 | |
| manheim | for linux, ansible_default_ipv4 will always take the IP of the interface I am connecting from? | 14:55 |
| *** eaguilar has quit IRC | 14:55 | |
| *** salv-orlando has joined #openstack-kolla | 14:55 | |
| manheim | e.g. if I have multiple networks, and I want the IP of the interface which is in the subnet i run facts gather from | 14:56 |
| *** salv-orlando has quit IRC | 14:59 | |
| *** eaguilar has joined #openstack-kolla | 15:01 | |
| *** jtriley has joined #openstack-kolla | 15:03 | |
| *** jtriley has quit IRC | 15:07 | |
| hrw | egonzalez: now I know why. | 15:08 |
| *** jtriley has joined #openstack-kolla | 15:08 | |
| hrw | dragonflow is just broken on ALL distros | 15:08 |
| hrw | in funny way | 15:09 |
| *** jtriley has quit IRC | 15:13 | |
| *** Pavo has quit IRC | 15:14 | |
| *** manheim has quit IRC | 15:15 | |
| *** manheim has joined #openstack-kolla | 15:15 | |
| *** salv-orlando has joined #openstack-kolla | 15:16 | |
| *** jamesPR has joined #openstack-kolla | 15:16 | |
| hrw | ~curse developers | 15:18 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: dragonflow: install proper package on all distros https://review.openstack.org/467568 | 15:18 |
| *** manheim has quit IRC | 15:19 | |
| *** kbaegis has quit IRC | 15:19 | |
| *** jroll has joined #openstack-kolla | 15:20 | |
| *** mgoddard has joined #openstack-kolla | 15:25 | |
| egonzalez | sdake, been debugging mariadb all the morning but not found any clue about why is failing bootstrapping | 15:29 |
| sdake | i have found one clue | 15:29 |
| sdake | an ERROR is printed indicating a kill thread cannot be started | 15:29 |
| sdake | not sure why that is | 15:29 |
| *** korzen has quit IRC | 15:29 | |
| egonzalez | gathered some process list during bootstrap, maybe is in some kind useful http://paste.openstack.org/show/610894/ | 15:29 |
| egonzalez | where is the ERROR? | 15:30 |
| sdake | /var/log/kolla/mariadb/* | 15:30 |
| openstackgerrit | Sven Anderson proposed openstack/kolla master: Add ec2-api image https://review.openstack.org/468518 | 15:30 |
| hrw | sdake: https://review.openstack.org/467568 please. we need to make sure that libzmq devel headers are installed or we use bundled one instead ;( | 15:33 |
| sdake | egonzalez 2017-05-29 4:33:27 140080962648256 [Note] Plugin 'FEEDBACK' is disabled. | 15:34 |
| sdake | 2017-05-29 4:33:27 140080962648256 [Note] /usr/libexec/mysqld: ready for connections. | 15:34 |
| sdake | Version: '10.1.20-MariaDB' socket: '/var/lib/mysql/mysql.sock' port: 0 MariaDB Server | 15:34 |
| sdake | 2017-05-29 4:33:28 140080829192960 [ERROR] Can't create thread to kill server (errno= 11) | 15:34 |
| *** eaguilar has quit IRC | 15:35 | |
| *** chkumar|hackersp is now known as chandankumar | 15:36 | |
| *** eaguilar has joined #openstack-kolla | 15:37 | |
| sdake | egonzalez https://da.gd/FtGSD -> https://paste.fedoraproject.org/paste/r0URRWfvoiBHT5DhgZZqoF5M1UNdIGYhyRLivL9gydE=/ | 15:43 |
| *** zhubingbing has quit IRC | 15:47 | |
| *** kbaegis has joined #openstack-kolla | 15:50 | |
| *** lpetrut has quit IRC | 15:50 | |
| hrw | sdake: thx | 15:51 |
| *** Pavo has joined #openstack-kolla | 15:57 | |
| *** pester has quit IRC | 16:01 | |
| *** jtriley has joined #openstack-kolla | 16:02 | |
| dmsimard | I'm trying to understand what the skip_parents parameter does | 16:06 |
| dmsimard | It will make it so kolla-build will build missing parents if they don't exist but only build the children layers if the base layers are there ? | 16:06 |
| *** eaguilar has quit IRC | 16:07 | |
| *** jtriley has quit IRC | 16:07 | |
| dmsimard | say I build centos-binary-nova-base -- it will not build centos-binary-base, centos-binary-openstack-base and then centos-binary-nova-base if they exist. Correct ? | 16:07 |
| *** jtriley has joined #openstack-kolla | 16:07 | |
| dmsimard | er, take two: say I build centos-binary-nova-base -- it will not build centos-binary-base, centos-binary-openstack-base if they exist. Correct ? | 16:08 |
| egonzalez | dmsimard, yep | 16:08 |
| dmsimard | egonzalez: ok, thanks | 16:08 |
| hrw | dmsimard: iirc, it will not try to build them at all. even if they not exist | 16:09 |
| dmsimard | hrw: ah, see, that's what I was afraid of | 16:09 |
| dmsimard | hrw: I guess I need to try to find out | 16:09 |
| hrw | but I can go wrong - too many rebuilds recently | 16:09 |
| hrw | most of my builds rebuild base as well ;( | 16:10 |
| openstackgerrit | Mathieu Rohon proposed openstack/kolla-ansible master: Add skydive service https://review.openstack.org/460922 | 16:11 |
| *** jtriley has quit IRC | 16:12 | |
| hrw | dmsimard: ERROR:kolla.image.build.dragonflow-base:Error: image test2/ubuntu-source-openstack-base:4.0.0 not found | 16:14 |
| egonzalez | dmsimard, just tested and not build the image if missing http://paste.openstack.org/show/610897/ | 16:14 |
| hrw | dmsimard: so for --skip-parents you need to be sure that you have those parent images available | 16:14 |
| dmsimard | damn... | 16:15 |
| dmsimard | that's not convenient | 16:15 |
| dmsimard | Basically I'm building each end image separately to have great granularity to properly profile/troubleshoot if need be | 16:16 |
| hrw | dmsimard: I do './build-images.sh DISTRONAME BUILDTYPE' and wait few hours to have all images built | 16:16 |
| dmsimard | hrw: that's not super convenient :) | 16:17 |
| hrw | https://paste.fedoraproject.org/paste/GXzi5ihMOFGes~R7qYO2TF5M1UNdIGYhyRLivL9gydE=/ is my script | 16:17 |
| *** pcaruana has quit IRC | 16:17 | |
| dmsimard | mandre: ^ skip_parents doesn't build the parents if they're not built, do you think we can do something ? | 16:17 |
| hrw | dmsimard: if your work is making sure that images can be built it is handy | 16:17 |
| dmsimard | hrw: it's for consumption | 16:17 |
| *** egonzalez has quit IRC | 16:21 | |
| *** mgoddard has quit IRC | 16:21 | |
| hrw | sdake: can you help me fix gnocchi centos/source? https://review.openstack.org/#/c/468348/ just needs +2+W ;d | 16:22 |
| sdake | hrw i cannot merge that patch with the current state of the gate there | 16:23 |
| hrw | ok | 16:23 |
| hrw | recheck sent | 16:24 |
| * hrw off for today | 16:27 | |
| *** mgoddard has joined #openstack-kolla | 16:30 | |
| *** matrohon has quit IRC | 16:32 | |
| mandre | dmsimard: what a bummer :) what you need really is a --skip-existing flag but I don't know how easy that would be to implement | 16:35 |
| dmsimard | mandre: dang, you got my hopes up | 16:35 |
| dmsimard | but yeah --skip-existing makes sense | 16:36 |
| dmsimard | as in that's the desired behavior | 16:36 |
| mandre | dmsimard: or you can try to play with the dependency tree and selectively build the new images you need with --skip-parent | 16:36 |
| *** Serlex has joined #openstack-kolla | 16:40 | |
| dmsimard | mandre: rather avoid doing that :p | 16:41 |
| dmsimard | mandre: so should I file a RFE in kolla launchpad or something ? | 16:42 |
| mandre | dmsimard: yes please! | 16:44 |
| *** pcaruana has joined #openstack-kolla | 16:45 | |
| mandre | looks like a fun task to work on, someone will likely pick it up, if not me | 16:46 |
| sdake | hey mandre | 16:48 |
| sdake | long time no talk dude | 16:48 |
| sdake | whats up | 16:48 |
| *** manheim has joined #openstack-kolla | 16:50 | |
| dmsimard | mandre: https://bugs.launchpad.net/kolla/+bug/1694302 | 16:50 |
| openstack | Launchpad bug 1694302 in kolla "RFE: Skip building images that have already been built" [Undecided,New] | 16:50 |
| bmaltais | Hi, I have to proposed changes stuck at +1... Could someone help push them along? https://review.openstack.org/#/c/466881/ & https://review.openstack.org/#/c/467695/ | 16:50 |
| bmaltais | Or let me know if I should just abandon them | 16:51 |
| sdake | bmaltais looking | 16:51 |
| sdake | bmaltais lots o doc chagnes | 16:52 |
| sdake | bmaltais reason its moving slowly | 16:52 |
| bmaltais | OK | 16:52 |
| sdake | mandre can you stamp https://review.openstack.org/#/c/467695/4 | 16:52 |
| sdake | bmaltais that first change will require several hours to review | 16:52 |
| bmaltais | sdake: I se. For sure, going through the exercise of building a test environment to validate time does indeed take time. | 16:54 |
| *** manheim has quit IRC | 16:54 | |
| bmaltais | sdake: I am trying to add documentation to help others. I also want to add a section to get LDAP Domain authentication working against a MS AD backend. | 16:55 |
| bmaltais | sdake: All working now and I think it could help other users of kolla-ansible | 16:56 |
| *** lucasxu has joined #openstack-kolla | 17:02 | |
| *** jtriley has joined #openstack-kolla | 17:02 | |
| *** lucasxu has quit IRC | 17:02 | |
| openstackgerrit | Merged openstack/kolla master: dragonflow: install proper package on all distros https://review.openstack.org/467568 | 17:05 |
| kbaegis | Anyone else seeing this bug on stable/ocata? Didn't make the cut for the release by the looks: https://bugs.launchpad.net/neutron/+bug/1629484 | 17:05 |
| openstack | Launchpad bug 1629484 in neutron "Key error when try to assign a floating ip to a VM" [High,Fix released] - Assigned to Hao Chen (chenh1987) | 17:05 |
| *** jtriley has quit IRC | 17:06 | |
| *** jtriley has joined #openstack-kolla | 17:07 | |
| *** jtriley has quit IRC | 17:12 | |
| kbaegis | Sad :'( Have to disable designate because of that bug | 17:15 |
| kbaegis | Or a regression identical to it | 17:16 |
| *** salv-orlando has quit IRC | 17:18 | |
| *** Pavo has quit IRC | 17:21 | |
| *** jamesPR has quit IRC | 17:24 | |
| *** jamesPR has joined #openstack-kolla | 17:32 | |
| *** Pavo has joined #openstack-kolla | 17:32 | |
| *** eaguilar has joined #openstack-kolla | 17:37 | |
| *** Manheim has joined #openstack-kolla | 17:50 | |
| *** fguillot has joined #openstack-kolla | 17:53 | |
| *** Manheim has quit IRC | 17:56 | |
| *** Manheim has joined #openstack-kolla | 17:56 | |
| *** jtriley has joined #openstack-kolla | 18:01 | |
| *** egonzalez has joined #openstack-kolla | 18:04 | |
| egonzalez | kbaegis how designate was deployed, followed post deployment steps to integrate with nova/neutron? https://github.com/openstack/kolla-ansible/blob/master/doc/designate-guide.rst#neutron-and-nova-integration | 18:06 |
| egonzalez | designate is weird role, because need IDs in its config generated by designate itself:/ | 18:06 |
| *** jtriley has quit IRC | 18:06 | |
| *** jtriley has joined #openstack-kolla | 18:06 | |
| kbaegis | egonzalez: Hey, I didn't see that! Thanks :) | 18:10 |
| egonzalez | kbaegis probably thats why neutron is failing to allocate the floatingip | 18:10 |
| kbaegis | Writing a step-by-step guide for the gentoo install w/ kolla | 18:10 |
| kbaegis | egonzalez: I needed the floatingip, but I don't need dns yet | 18:10 |
| kbaegis | Thanks for showing me the docs. | 18:11 |
| *** jtriley has quit IRC | 18:11 | |
| Manheim | i have an issue if I run deploy on an existing env | 18:17 |
| Manheim | "Access denied for user 'root'@'192.168.10.11' (using password: YES)\")"} | 18:18 |
| Manheim | i enabled a role in globals, thus the second deploy | 18:18 |
| Manheim | but i keep seeing this issue for mariadb | 18:18 |
| *** eaguilar has quit IRC | 18:22 | |
| sdake | egonzalez i htink i have found the problem with mariadb | 18:44 |
| sdake | egonzalez ansibull looks for /usr/lib/galera.so while in fact it is now in /usr/lib64/galera.so | 18:45 |
| *** eaguilar has joined #openstack-kolla | 18:45 | |
| egonzalez | sdake cool, galera only or libgalera_smm.so? | 18:46 |
| sdake | ya libgalera_smm.so | 18:46 |
| sdake | i was just being lazy | 18:46 |
| egonzalez | is looking at the correct place https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/mariadb/templates/galera.cnf.j2#L1 | 18:47 |
| egonzalez | there is a check depending on the distro | 18:48 |
| sdake | your correct i read that code wrong | 18:48 |
| * sdake groans | 18:48 | |
| sdake | the good news is xtrabackup is integrated in 10.1 | 18:48 |
| sdake | so we can eject percona onc ewe figure this crap out | 18:48 |
| egonzalez | cool, also percona-xtrabackup package is in epel | 18:49 |
| sdake | i wonder if htis OOMs the system: https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/mariadb/templates/galera.cnf.j2#L45 | 18:49 |
| sdake | we should remove epel too | 18:49 |
| egonzalez | for mariadb 10.1 wsrep_on must be set to ON, was active by default before 10.1 but now is disabled | 18:50 |
| sdake | egonzalez this consitently occurs: https://da.gd/kxW7 -> https://paste.fedoraproject.org/paste/xi5XeYO83-As8bg11XgkCl5M1UNdIGYhyRLivL9gydE=/ | 18:51 |
| sdake | requiring a reboot | 18:51 |
| sdake | any ideas how to avoid the reboot? | 18:52 |
| egonzalez | bjolo have a similar issue in their env with libvirt, what docker storage driver, docker version and kernel are you using? | 18:53 |
| sdake | rhel docker | 18:58 |
| sdake | latest centos kernel | 18:58 |
| sdake | rhel/centos docker | 18:58 |
| sdake | btrfs storage driver | 18:58 |
| *** mgoddard has quit IRC | 18:58 | |
| sdake | wsrep_on is a new config option that you suggest setting? | 18:59 |
| *** chas has quit IRC | 18:59 | |
| *** chas has joined #openstack-kolla | 18:59 | |
| *** jtriley has joined #openstack-kolla | 19:01 | |
| *** chas has quit IRC | 19:04 | |
| *** eaguilar has quit IRC | 19:05 | |
| *** jtriley has quit IRC | 19:05 | |
| sdake | this reboot every time is annoying :( | 19:06 |
| *** jtriley has joined #openstack-kolla | 19:06 | |
| sdake | i don't understand how my system could possibly oom - i have 128gb ram | 19:07 |
| sdake | kolal uses 4gb | 19:07 |
| *** eaguilar has joined #openstack-kolla | 19:08 | |
| egonzalez | sdake here suggests to use docker community version instead of rhel to fix a similar issue https://bugs.launchpad.net/kolla/+bug/1668059/comments/8 | 19:08 |
| openstack | Launchpad bug 1668059 in kolla "Failed to Starting kolla-toolbox container" [Critical,Triaged] | 19:08 |
| *** jtriley has quit IRC | 19:11 | |
| sdake | setting wrap_on=on does nothing special egonzalez | 19:14 |
| *** bjolo_ has joined #openstack-kolla | 19:15 | |
| *** bjolo has quit IRC | 19:15 | |
| openstackgerrit | Steven Dake proposed openstack/kolla master: Consume centos-pike-testing mariadb version https://review.openstack.org/468632 | 19:15 |
| *** bjolo has joined #openstack-kolla | 19:17 | |
| *** manheim_ has joined #openstack-kolla | 19:19 | |
| *** bjolo_ has quit IRC | 19:19 | |
| *** jaosorior is now known as jaosorior_away | 19:29 | |
| *** eaguilar_ has joined #openstack-kolla | 19:41 | |
| *** eaguilar has quit IRC | 19:42 | |
| *** Pavo has quit IRC | 19:48 | |
| *** bmaltais has quit IRC | 19:53 | |
| *** jtriley has joined #openstack-kolla | 20:00 | |
| kbaegis | Anyone know why rsync would be getting blocked? | 20:03 |
| kbaegis | I don't need to create a custom protocol security group do I? | 20:03 |
| *** jtriley has quit IRC | 20:05 | |
| *** jtriley has joined #openstack-kolla | 20:05 | |
| *** manheim_ has quit IRC | 20:07 | |
| *** jtriley has quit IRC | 20:10 | |
| *** salv-orlando has joined #openstack-kolla | 20:13 | |
| Manheim | egonzalez you on? | 20:20 |
| kbaegis | Anyone have a vm able to ping, but not to retrieve websites? | 20:21 |
| kbaegis | https://hastebin.com/apipoqujed.sql | 20:22 |
| kbaegis | capture from a compute node | 20:23 |
| kbaegis | on eth1 which is my networking interface | 20:23 |
| *** pcaruana has quit IRC | 20:24 | |
| kbaegis | I'm betting this is DVR/SNAT related | 20:25 |
| sdake | egonzalez check this out: | 20:26 |
| sdake | https://da.gd/6FHtA -> https://paste.fedoraproject.org/paste/IqhlsiTe71ZcMcn7cKLEfF5M1UNdIGYhyRLivL9gydE=/ | 20:26 |
| sdake | i turned on set -ex in extend_start.sh | 20:26 |
| sdake | I suspect but can't confirm extend_start.sh is exiting in some way | 20:26 |
| egonzalez | kbaegis ping to domain or curl? | 20:31 |
| kbaegis | egonzalez: ping works. Curl hangs | 20:32 |
| egonzalez | hrm, maybe mtu? | 20:32 |
| kbaegis | Just swapped the router out with a centralized one | 20:32 |
| sdake | here is my extend_start output: https://da.gd/2uXL0 -> https://paste.fedoraproject.org/paste/JFSA-AYjE8iEC-h2~0cnCV5M1UNdIGYhyRLivL9gydE=/ | 20:33 |
| kbaegis | egonzalez: Worked. I think it's double-nat or something. My compute nodes aren't accessible from my edge; they're in their own DMZ | 20:34 |
| kbaegis | Don't know why specifically, but dvr ports have never worked for me for snat | 20:34 |
| *** Serlex has quit IRC | 20:38 | |
| *** jamesPR has quit IRC | 20:40 | |
| sdake | egonzalez something is busted with extend_start.sh: https://da.gd/VMw9H -> https://paste.fedoraproject.org/paste/DtYwJZVHwn8-IYdSmK1a7F5M1UNdIGYhyRLivL9gydE=/ | 20:44 |
| sdake | egonzalez if that were working - it would instead finish and secure mysql | 20:45 |
| *** fguillot has quit IRC | 20:45 | |
| *** jtriley has joined #openstack-kolla | 21:00 | |
| *** chas has joined #openstack-kolla | 21:00 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Add a complete example of configuring a basic 3 nodes Ceph environment. https://review.openstack.org/467695 | 21:03 |
| *** faridda has quit IRC | 21:03 | |
| sdake | egonzalez if I delete this: https://github.com/openstack/kolla/blob/master/docker/mariadb/extend_start.sh#L19-L33 - mariadb seems to bootstrap | 21:04 |
| *** chas has quit IRC | 21:05 | |
| *** eaguilar_ has quit IRC | 21:08 | |
| *** jtriley has quit IRC | 21:10 | |
| *** Manheim has quit IRC | 21:31 | |
| *** goldyfruit has quit IRC | 21:31 | |
| *** circ-user-TeTGj has quit IRC | 21:33 | |
| *** manheim has joined #openstack-kolla | 21:38 | |
| sdake | from the grep man page | 21:43 |
| sdake | EXIT STATUS | 21:43 |
| sdake | Normally, the exit status is 0 if selected lines are found and 1 otherwise. | 21:43 |
| sdake | exit status of 1 will automatically trigger bash to exit | 21:44 |
| *** n0isyn0i1e has joined #openstack-kolla | 21:58 | |
| *** jtriley has joined #openstack-kolla | 21:59 | |
| *** n0isyn0ise has quit IRC | 22:02 | |
| *** jtriley has quit IRC | 22:04 | |
| *** jtriley has joined #openstack-kolla | 22:04 | |
| sdake | Jeffrey4l when your about would like to speak about commits 4417ffbfab77efd67eafe0d5ed57263c6a1b796c and ae8df40b - they are mutually incompatible imo | 22:05 |
| *** jtriley has quit IRC | 22:09 | |
| *** salv-orlando has quit IRC | 22:12 | |
| openstackgerrit | Andy Smith proposed openstack/kolla-ansible master: Add support for hybrid messaging backends https://review.openstack.org/468966 | 22:15 |
| *** jamesPR has joined #openstack-kolla | 22:24 | |
| *** manheim has quit IRC | 22:47 | |
| *** powerd has joined #openstack-kolla | 22:48 | |
| *** egonzalez has quit IRC | 22:54 | |
| *** jtriley has joined #openstack-kolla | 22:59 | |
| *** chas has joined #openstack-kolla | 23:01 | |
| *** jtriley has quit IRC | 23:03 | |
| *** jtriley has joined #openstack-kolla | 23:04 | |
| *** chas has quit IRC | 23:06 | |
| *** jtriley has quit IRC | 23:09 | |
| *** bmaltais has joined #openstack-kolla | 23:24 | |
| bmaltais | Hi, I am trying to specify different interfaces name for some physical servers | 23:24 |
| bmaltais | My globals.yml file specify ens160 and ens192... but those physical servers use enp4s0f0 & enp4s0f1 | 23:25 |
| bmaltais | I tried using the inventory file to specify the right interface name for those nodes but it does not appear to work | 23:26 |
| bmaltais | TASK [common : Copying over fluentd input config files] keep failing with | 23:27 |
| bmaltais | failed: [compute1] (item=01-syslog) => {"failed": true, "item": "01-syslog", "msg": "AnsibleUndefinedVariable: {{ hostvars[inventory_hostname]['ansible_' + api_interface]['ipv4']['address'] if orchestration_engine == 'ANSIBLE' else '0.0.0.0' }}: 'dict object' has no attribute u'ansible_ens160'"} failed: [compute2] (item=01-syslog) => {"failed": true, "item": "01-syslog", "msg": "AnsibleUndefinedVariable: {{ hostvars[inventor | 23:27 |
| bmaltais | ;-( | 23:27 |
| *** powerd has quit IRC | 23:39 | |
| *** Pavo has joined #openstack-kolla | 23:43 | |
| bmaltais | So it appear as if customization for network interface passed in the inventory files are not properly applied | 23:57 |
| *** kbaegis has quit IRC | 23:57 | |
| *** jtriley has joined #openstack-kolla | 23:58 | |
| bmaltais | Is there a way to set them via the /etc/kolla/config/node method? | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!