Monday, 2017-05-29

*** manheim has quit IRC00:00
*** masuberu has quit IRC00:02
*** salv-orlando has joined #openstack-kolla00:15
*** salv-orlando has quit IRC00:20
*** kbaegis has quit IRC00:29
*** eaguilar has joined #openstack-kolla00:32
*** eaguilar has quit IRC00:33
sdakejamespr currently stable/ocata doesn't build properly00:39
sdakejamespr this patch works for me for kolla-kubernetes backported: https://review.openstack.org/#/c/468632/00:41
sdakealthough as you cna see it doesn't pass the master gates00:41
*** tovin07_ has joined #openstack-kolla00:47
*** duonghq has joined #openstack-kolla00:49
*** cuongnv has joined #openstack-kolla00:49
jamesPRsdake, There are no longer separate MariaDB Galera Cluster releases for MariaDB 10.1 and above. Simply download MariaDB (10.1 or above) and configure your cluster as normal.00:50
jamesPR;)00:50
sdakei'd rather eject mariadb.org as a repo00:50
duonghqmorning guys00:50
jamesPRsdake, why?00:50
jamesPRduonghq, morning00:51
sdakered hat has 20+ people maintaining mariadb00:51
sdakesup duonghq00:52
sdakejamesPR also we have 3 repos that contain mariadb, we only need one00:54
jamesPRsdake, ;) then RDO instead ?00:54
sdakejamesPR with 3 repos with the same package names, there is no wayt o properly select the correctpackage00:54
sdakeyes that patch uses the rdo version00:54
jamesPRsdake, is posible to use RDO repo for everything?00:56
sdakeyup00:56
jamesPRhow?00:56
sdakewrite code to do so00:56
sdakewhich is what that patch does00:56
jamesPRok00:57
sdakehowever its the weekend and i'm tired of working00:57
sdakeso not working on it00:57
sdakefeel free to take it over :)00:57
jamesPRI think there is another way much simpler00:57
jamesPRegonzales have something like: vi /etc/kolla/kolla-build.conf00:58
jamesPRbase = centos00:58
jamesPRbase_tag = mitaka00:58
jamesPRpush = true00:58
jamesPRinstall_type = rdo00:58
jamesPRregistry = docker.io00:58
jamesPR;)00:58
*** jgriffith has quit IRC01:00
*** Pavo has quit IRC01:15
*** salv-orlando has joined #openstack-kolla01:16
*** eaguilar has joined #openstack-kolla01:17
*** salv-orlando has quit IRC01:21
*** hrw has quit IRC01:32
*** hrw has joined #openstack-kolla01:34
*** masber has joined #openstack-kolla01:41
openstackgerritDuong Ha-Quang proposed openstack/kolla master: Remove all Heka related remaining stuff  https://review.openstack.org/44603601:42
*** Pavo has joined #openstack-kolla01:52
*** Pavo has quit IRC02:01
*** emccormick has joined #openstack-kolla02:21
*** jamesPR has quit IRC02:45
*** kbaegis has joined #openstack-kolla02:45
*** itlinux has joined #openstack-kolla03:14
*** eaguilar has quit IRC03:25
*** janki has joined #openstack-kolla03:44
*** itlinux has quit IRC03:57
*** Pavo has joined #openstack-kolla03:58
*** itlinux has joined #openstack-kolla04:01
*** itlinux has quit IRC04:04
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Optimize reconfiguration for mariadb  https://review.openstack.org/43348004:09
*** emccormick has quit IRC04:10
*** emccormick has joined #openstack-kolla04:10
*** itlinux has joined #openstack-kolla04:13
*** itlinux has quit IRC04:17
*** itlinux has joined #openstack-kolla04:23
*** itlinux has quit IRC04:28
*** salv-orlando has joined #openstack-kolla04:29
*** emccormick has quit IRC04:29
*** jamesbenson has joined #openstack-kolla04:37
*** jaosorior has joined #openstack-kolla04:45
*** itlinux has joined #openstack-kolla04:45
*** Pavo has quit IRC04:46
*** Pavo has joined #openstack-kolla04:47
*** jamesbenson has quit IRC04:52
*** jamesbenson has joined #openstack-kolla04:52
*** jamesbenson has quit IRC04:54
*** jamesbenson has joined #openstack-kolla04:54
*** jamesbenson has quit IRC04:59
*** masber has quit IRC05:04
*** masber has joined #openstack-kolla05:04
*** jamesbenson has joined #openstack-kolla05:12
*** Pavo has quit IRC05:18
*** itlinux has quit IRC05:33
*** skramaja has joined #openstack-kolla05:55
*** ahonda has joined #openstack-kolla06:08
*** sbezverk_ has quit IRC06:09
*** magicboiz has joined #openstack-kolla06:22
*** tvignaud_pto is now known as tvignaud06:24
*** magicboiz has quit IRC06:27
*** magicboiz has joined #openstack-kolla06:27
*** jamesbenson has quit IRC06:32
*** jamesbenson has joined #openstack-kolla06:32
*** jamesbenson has quit IRC06:36
*** jamesbenson has joined #openstack-kolla06:46
*** jamesbenson has quit IRC06:48
*** jamesbenson has joined #openstack-kolla06:48
*** jamesbenson has quit IRC06:49
*** jamesbenson has joined #openstack-kolla06:49
*** jamesbenson has quit IRC06:54
*** salv-orl_ has joined #openstack-kolla07:04
*** magicboiz has quit IRC07:07
*** salv-orlando has quit IRC07:07
*** korzen has joined #openstack-kolla07:09
*** cristicalin has joined #openstack-kolla07:11
*** chas has joined #openstack-kolla07:15
*** cristicalin has quit IRC07:21
*** magicboiz has joined #openstack-kolla07:26
*** ahonda has quit IRC07:26
*** magicboiz has quit IRC07:30
*** dasTor_ has quit IRC07:36
*** dasTor has joined #openstack-kolla07:37
*** magicboiz has joined #openstack-kolla07:38
*** magicboiz has quit IRC07:38
*** sgrasley has quit IRC07:40
*** sgrasley1 has joined #openstack-kolla07:40
*** egonzalez has joined #openstack-kolla07:43
*** matrohon has joined #openstack-kolla07:44
*** manheim has joined #openstack-kolla07:52
openstackgerritMerged openstack/kolla-ansible master: Add jinja2-py version check in pre_checks  https://review.openstack.org/45459007:53
*** tvignaud has quit IRC08:02
openstackgerritMerged openstack/kolla-ansible master: Enabled pxe_ssh driver in ironic  https://review.openstack.org/46860608:10
*** tvignaud has joined #openstack-kolla08:15
berendtsdake: ping08:22
openstackgerritChristian Berendt proposed openstack/kolla-ansible master: Fix "key_repository is world readable: /etc/keystone/fernet-keys/" warning  https://review.openstack.org/46845208:23
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Move mDNS to network nodes  https://review.openstack.org/46853408:25
*** lpetrut has joined #openstack-kolla08:30
*** pbourke has quit IRC08:34
*** pbourke has joined #openstack-kolla08:34
mandreegonzalez: hi Eduardo, do we have a hard rule about 4 space indenting in Dockerfile?09:03
egonzalezmandre, I dont think so, but is common jinja style09:04
egonzalezmost dockefiles follows 4 space indents09:04
mandreegonzalez: I mean if that's something we expect from new contributors, it should be documented somewhere09:04
mandreand potentially enforced in CI09:05
*** magicboiz has joined #openstack-kolla09:08
mandreI'm personally for not nitpicking on the formatting, but if you guys think it's better for consistency for instance, it should be done by a computer IMO09:08
*** bjolo has joined #openstack-kolla09:08
*** magicboiz has quit IRC09:12
*** magicboiz has joined #openstack-kolla09:13
bjolomorning09:25
hrwmorning09:27
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Specify 'become' for only necessary tasks (default roles)  https://review.openstack.org/39868409:29
openstackgerritMerged openstack/kolla master: Add short README file for contrib/template-override directory  https://review.openstack.org/42255209:39
openstackgerritMerged openstack/kolla-ansible master: Change default permissions in jinja templates.  https://review.openstack.org/44579710:17
*** cuongnv has quit IRC10:22
*** tovin07_ has quit IRC10:24
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Remove deprecated options designate  https://review.openstack.org/45071510:24
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Remove deprecated options designate  https://review.openstack.org/45071510:36
hrwegonzalez: can you +2 https://review.openstack.org/#/c/467568/ one? it makes dragonflow buildable for debian/source combo10:37
hrwhttps://review.openstack.org/#/c/468348/ (fix gnocchi for centos/source non-x86 combo) and https://review.openstack.org/#/c/464045/ (let build kubernetes stuff also for aarch64) are also easy pickups10:38
egonzalezhrw, why using developer files instead of main?10:38
hrwegonzalez: my golden rule is to not depend on library packages.10:45
hrwI consider it a bad practise10:45
*** bmaltais has quit IRC10:46
hrwbut doing check with libzmq5 now10:47
*** MarginHu has joined #openstack-kolla10:48
*** jamesPR has joined #openstack-kolla10:51
SeyongHello guys, I created an instance and gave a float ip address to it, I can log in via SSH from compute node to the instance. However in the instance, I  can not access internet(external network). Anyone have any idea on this?10:58
jamesPRSeyong, can you ping an external ip from instance?10:59
jamesPRfor example ping 8.8.8.810:59
manheimi have a docker question, which is the best way to run commands in a container after it's creation? i used docker exec <command> from outside the container, but what if i want to automate it in a more elegent way11:05
manheimCMD from the dockerdile?11:05
egonzalezMarginHu, around?11:05
SeyongjamesPR: ping does not pong any of external ip address.11:06
jamesPRsup egonzalez11:06
egonzalezhey jamesPR11:06
SeyongjamesPR: ping reached to compute host ip addr only11:06
jamesPRSeyong, maybe a routing issue11:08
jamesPRcan you ping the gateway from instance?11:08
SeyongjamesPR: hmm I have one NIC, then should network_interface and neutron_external_interface are the NIC  what I have? is it correct..?11:09
Seyongping doent work to gw also11:09
Seyongboth configuration is of /etc/kolla/global.yml11:09
egonzalezSeyong, nope, unless you create sub interfaces neutron_external_interface cannot be network_interface11:10
egonzalezactually now you should not be able to ping outside from the host itself11:10
Seyongegonzalez: from host(compute) not an instance? from host I  can access outside as well..11:11
egonzalezhrm, weird, usually networking is lost while applying ovs role when using single interface11:12
jamesPRegonzalez, recently I update all my images then now mariadb give an error when Running MariaDB bootstrap11:12
*** jtriley has quit IRC11:12
egonzalezjamesPR, how recently?11:12
jamesPRyesterday11:12
egonzalezwhich vesion?11:12
*** circ-user-TeTGj has joined #openstack-kolla11:13
Seyongegonzalez: well, I tried add my nic to br-ex bridge then host can not access external.... is it your saying..?11:13
jamesPRlatest from git11:13
egonzalezjamesPR, let me try with centos source11:14
egonzalezSeyong, yep, that's what happen while applying ovs role because the interface is added into br-ex11:15
MarginHuhi, is it necessary that  br-ex  is existed in compute node ?11:20
sdakeeglute this needs work: https://review.openstack.org/#/c/468632/11:27
sdakeegonzalez ^^11:27
manheimegonzalez did you see my question/11:33
egonzalezsdake, what question?11:34
egonzalezMarginHu, nope, br-ex should not exists on compute nodes unless dvr is enabled, was fixed upstream and backported to ocata11:35
MarginHudo you know which commit id ?11:36
egonzalezMarginHu, sorry, is not merged on ocata https://review.openstack.org/#/c/465865/11:37
MarginHuthank you very much.11:38
egonzalezMarginHu, regarding the memcached reconfigure bug, it worked for me, what ansible and kolla version are you using?11:40
*** salv-orl_ has quit IRC11:40
MarginHuansible 2.3.0.0,  kolla  4.0.0.111:41
MarginHuwhat ansible version are you using?11:42
egonzalez2.3 too11:43
egonzalezcan you check the contents of ansible/roles/memcached/tasks/reconfigure.yml ?11:44
egonzalezis a symbolic link to depoy.yml11:44
MarginHuno , it's content is one line:  deploy.yml , not a symbolic link11:44
egonzalezok, thats fine11:45
egonzalezjamesPR, mariadb bootstrap wfm11:45
egonzalezbuilt 2 hours ago11:46
MarginHumy kolla version is  older than latest kolla upstream11:46
sdakeegonzalez stable/ocat is broken11:48
sdakeegonzalez the soltuion is to fix that review above11:48
sdakeegonzalez that review above works for me on kolla-kubernetes, but not kolla-ansible11:48
sdakeegonzalez any chance you can take al ook?11:48
egonzalezsdake, ooo, we fixed it pining version to 10.0.30 instead of 10.0 until mariadb packages are fixed (mariadb missed build galera packages)11:49
sdakethat is the wrong solution11:49
egonzalezbut, yes. we talked about removing mariadb repos and use rdo11:50
*** chandankumar is now known as chkumar|hackersp11:52
MarginHuegonzalez, I test my ansible think  that is syntax error11:54
MarginHuI remember old version is symblic11:57
*** bmaltais has joined #openstack-kolla11:57
jamesPRegonzalez, how can I fix the mariadb issue?11:58
sdakeegonzalez mariadb didn't miss building galera packages12:05
*** janki has quit IRC12:05
sdakeegonzalez they are in the repository under a different name12:05
sdakeegonzalez anyway imo we need to eject mariadb.org as a repo dep and just use rdo12:06
sdakeegonzalez any chance you can take on that activity?12:06
egonzalezsdake, galera packages were merged into mariadb-server in mariadb 10.1, in 10.0 remain being different packages12:06
egonzalez10.0.30 have the package but with the release of 10.0.31 missed12:06
jamesPRThere are no longer separate MariaDB Galera Cluster releases for MariaDB 10.1 and above. Simply download MariaDB (10.1 or above) and configure your cluster as normal.12:09
sdakerdo uses maridb 10.112:10
sdakeand it has a mariadb-server-galera pacakkge12:10
sdakeno idea what is in it12:10
*** sbezverk has joined #openstack-kolla12:10
sdakemaradb 10.1 from mariadb.org ALSO HAS a mariadb-server-galera package12:10
sdakeegonzalez what I want to know is if you will tkae over that review i started12:11
sdakeor not12:11
egonzalezsdake, im looking into it, but im not a mariadb expert12:12
bmaltaisegonzalez: Morning. Do you run your openstack environment with LDAP Domain integration?12:12
sdakehttps://review.openstack.org/#/c/468632/12:12
bmaltaisegonzalez: I am not sure what is going on but I think there might be an issue with ldap domain integration with the current 4.0.0 kolla-ansible builds12:13
bmaltaisegonzalez: I can configure ldap domain, list ldap users using "openstack user list --domain ducourrier"12:14
bmaltaisegonzalez: Validate that keystone is indeed validating credentials of users in ldap12:14
bmaltaisegonzalez: But when I login with one of them I keep getting "An error occurred authenticating. Please try again later."12:15
sdakeegonzalez the fact that stable/ocata is unbuildable is a critical issue - need some help in resolving it12:15
bmaltaisegonzalez:: And I see a bunch of errors in keystone logs: "ERROR keystone.common.wsgi result = method(req, **params)"12:18
bmaltaisAnyone that successfully run LDAP Domain authentication with kolla-ansible in the channel?12:18
*** salv-orlando has joined #openstack-kolla12:20
*** pcaruana has joined #openstack-kolla12:20
sdakejamesPR is percona integrated into mariadb10..1?12:20
*** caoyuan has joined #openstack-kolla12:35
jamesPRsdake, ? I think that percona is like another fork of mysql ;)12:39
sdakejamesPR we use xtrabackup - for whatever godawful reason12:43
*** janki has joined #openstack-kolla12:52
*** janki has quit IRC12:54
*** skramaja has quit IRC12:57
*** goldyfruit has joined #openstack-kolla12:58
openstackgerritSteven Dake proposed openstack/kolla master: Consume centos-pike-testing mariadb version  https://review.openstack.org/46863213:01
openstackgerritMathieu Rohon proposed openstack/kolla master: Add skydive service  https://review.openstack.org/45999513:03
*** jtriley has joined #openstack-kolla13:04
*** salv-orl_ has joined #openstack-kolla13:04
*** salv-orlando has quit IRC13:07
*** jtriley has quit IRC13:08
*** jtriley has joined #openstack-kolla13:09
*** jtriley has quit IRC13:14
*** Pavo has joined #openstack-kolla13:17
*** manheim has quit IRC13:35
*** jamesPR has quit IRC13:36
*** jtriley has joined #openstack-kolla14:03
*** MarginHu has quit IRC14:04
openstackgerritMathieu Rohon proposed openstack/kolla master: Add skydive service  https://review.openstack.org/45999514:07
*** jtriley has quit IRC14:08
*** jtriley has joined #openstack-kolla14:08
kbaegisMorning all! Still troubleshooting cinder/iscsi configs: https://hastebin.com/womunobomi.sql, https://hastebin.com/xeqoruhoqi.sql14:11
*** jgriffith_ has joined #openstack-kolla14:12
*** jtriley has quit IRC14:14
*** magicboiz has quit IRC14:14
kbaegisHere's my custom config; reconfiguring now https://hastebin.com/mikaweheso.makefile14:14
kbaegisGoing to replicate my configuration inside an instance with gentoo installed- requirement for the gentoo deployment guide to make sure it all works14:16
*** caoyuan_ has joined #openstack-kolla14:20
*** caoyuan has quit IRC14:20
bmaltaisI think the LDAP Domain authentication issue is linked to this bug: https://bugs.launchpad.net/keystone/+bug/166276214:20
openstackLaunchpad bug 1662762 in OpenStack Identity (keystone) ocata "Authentication for LDAP user fails at MFA rule check" [High,Fix released] - Assigned to Matthew Edmonds (edmondsw)14:20
kbaegisAnyone with experience with cinder/lvm/iscsi and kolla that can help would be greatly appreciated14:21
*** zhubingbing has joined #openstack-kolla14:24
zhubingbinghi guys14:24
bmaltaiskbaegis: Sorry. Would help if I could but not much experience with that.14:25
kbaegisbmaltais: Thanks anyways :)14:26
bmaltaisIs there a way to "login" to the keystone container to make manual changes to a file inside?14:29
bmaltaisTried "docker exec keystone bash" and I only get dead air14:29
bmaltaisI want to apply a manual patch to it to make LDAP domain authentication work as the current 4.0.0 container has a bug14:30
pomacdocker exec -it keystone bash14:32
*** jgriffith_ is now known as jgriffith14:32
pomacbmaltais: but depending on the file you want to change, /etc/kolla/ might be where you want to look14:32
bmaltaispomac: I did it with "docker cp t keystone:/usr/lib/python2.7/site-packages/keystone/identity/backends/ldap/core.py"14:34
hrwegonzalez: with libzmq5 it builds too. which looks weird for me14:35
bmaltaisAnd I have proven that my LDAP Domain authentication issue was a bug in keystone 4.0.0 container all along!14:35
bmaltaisArrrrggggg14:35
openstackgerritzhubingbing proposed openstack/kolla master: Fix rally create verifier error  https://review.openstack.org/46783714:35
bmaltaisSpent 2 days debugging my config file when it was fine all along ;-)14:35
*** manheim has joined #openstack-kolla14:36
*** hongbin has joined #openstack-kolla14:37
*** faridda has joined #openstack-kolla14:41
*** eaguilar has joined #openstack-kolla14:43
kbaegisFigured it out everyone! Another kernel dependency for CONFIG_ISCSI_TCP14:44
kbaegisAll the stuff upstream ubuntu takes care of for you when they're not breaking stuff with systemd ;)14:45
*** salv-orl_ has quit IRC14:54
manheimfor linux, ansible_default_ipv4 will always take the IP of the interface I am connecting from?14:55
*** eaguilar has quit IRC14:55
*** salv-orlando has joined #openstack-kolla14:55
manheime.g. if I have multiple networks, and I want the IP of the interface which is in the subnet i run facts gather from14:56
*** salv-orlando has quit IRC14:59
*** eaguilar has joined #openstack-kolla15:01
*** jtriley has joined #openstack-kolla15:03
*** jtriley has quit IRC15:07
hrwegonzalez: now I know why.15:08
*** jtriley has joined #openstack-kolla15:08
hrwdragonflow is just broken on ALL distros15:08
hrwin funny way15:09
*** jtriley has quit IRC15:13
*** Pavo has quit IRC15:14
*** manheim has quit IRC15:15
*** manheim has joined #openstack-kolla15:15
*** salv-orlando has joined #openstack-kolla15:16
*** jamesPR has joined #openstack-kolla15:16
hrw~curse developers15:18
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: dragonflow: install proper package on all distros  https://review.openstack.org/46756815:18
*** manheim has quit IRC15:19
*** kbaegis has quit IRC15:19
*** jroll has joined #openstack-kolla15:20
*** mgoddard has joined #openstack-kolla15:25
egonzalezsdake, been debugging mariadb all the morning  but not found any clue about why is failing bootstrapping15:29
sdakei have found one clue15:29
sdakean ERROR is printed indicating a kill thread cannot be started15:29
sdakenot sure why that is15:29
*** korzen has quit IRC15:29
egonzalezgathered some process list during bootstrap, maybe is in some kind useful http://paste.openstack.org/show/610894/15:29
egonzalezwhere is the ERROR?15:30
sdake /var/log/kolla/mariadb/*15:30
openstackgerritSven Anderson proposed openstack/kolla master: Add ec2-api image  https://review.openstack.org/46851815:30
hrwsdake: https://review.openstack.org/467568 please. we need to make sure that libzmq devel headers are installed or we use bundled one instead ;(15:33
sdakeegonzalez 2017-05-29  4:33:27 140080962648256 [Note] Plugin 'FEEDBACK' is disabled.15:34
sdake2017-05-29  4:33:27 140080962648256 [Note] /usr/libexec/mysqld: ready for connections.15:34
sdakeVersion: '10.1.20-MariaDB'  socket: '/var/lib/mysql/mysql.sock'  port: 0  MariaDB Server15:34
sdake2017-05-29  4:33:28 140080829192960 [ERROR] Can't create thread to kill server (errno= 11)15:34
*** eaguilar has quit IRC15:35
*** chkumar|hackersp is now known as chandankumar15:36
*** eaguilar has joined #openstack-kolla15:37
sdakeegonzalez https://da.gd/FtGSD -> https://paste.fedoraproject.org/paste/r0URRWfvoiBHT5DhgZZqoF5M1UNdIGYhyRLivL9gydE=/15:43
*** zhubingbing has quit IRC15:47
*** kbaegis has joined #openstack-kolla15:50
*** lpetrut has quit IRC15:50
hrwsdake: thx15:51
*** Pavo has joined #openstack-kolla15:57
*** pester has quit IRC16:01
*** jtriley has joined #openstack-kolla16:02
dmsimardI'm trying to understand what the skip_parents parameter does16:06
dmsimardIt will make it so kolla-build will build missing parents if they don't exist but only build the children layers if the base layers are there ?16:06
*** eaguilar has quit IRC16:07
*** jtriley has quit IRC16:07
dmsimardsay I build centos-binary-nova-base -- it will not build centos-binary-base, centos-binary-openstack-base and then centos-binary-nova-base if they exist. Correct ?16:07
*** jtriley has joined #openstack-kolla16:07
dmsimarder, take two: say I build centos-binary-nova-base -- it will not build centos-binary-base, centos-binary-openstack-base if they exist. Correct ?16:08
egonzalezdmsimard, yep16:08
dmsimardegonzalez: ok, thanks16:08
hrwdmsimard: iirc, it will not try to build them at all. even if they not exist16:09
dmsimardhrw: ah, see, that's what I was afraid of16:09
dmsimardhrw: I guess I need to try to find out16:09
hrwbut I can go wrong - too many rebuilds recently16:09
hrwmost of my builds rebuild base as well ;(16:10
openstackgerritMathieu Rohon proposed openstack/kolla-ansible master: Add skydive service  https://review.openstack.org/46092216:11
*** jtriley has quit IRC16:12
hrwdmsimard: ERROR:kolla.image.build.dragonflow-base:Error: image test2/ubuntu-source-openstack-base:4.0.0 not found16:14
egonzalezdmsimard, just tested and not build the image if missing http://paste.openstack.org/show/610897/16:14
hrwdmsimard: so for --skip-parents you need to be sure that you have those parent images available16:14
dmsimarddamn...16:15
dmsimardthat's not convenient16:15
dmsimardBasically I'm building each end image separately to have great granularity to properly profile/troubleshoot if need be16:16
hrwdmsimard: I do './build-images.sh DISTRONAME BUILDTYPE' and wait few hours to have all images built16:16
dmsimardhrw: that's not super convenient :)16:17
hrwhttps://paste.fedoraproject.org/paste/GXzi5ihMOFGes~R7qYO2TF5M1UNdIGYhyRLivL9gydE=/ is my script16:17
*** pcaruana has quit IRC16:17
dmsimardmandre: ^ skip_parents doesn't build the parents if they're not built, do you think we can do something ?16:17
hrwdmsimard: if your work is making sure that images can be built it is handy16:17
dmsimardhrw: it's for consumption16:17
*** egonzalez has quit IRC16:21
*** mgoddard has quit IRC16:21
hrwsdake: can you help me fix gnocchi centos/source? https://review.openstack.org/#/c/468348/ just needs +2+W ;d16:22
sdakehrw i cannot merge that patch with the current state of the gate there16:23
hrwok16:23
hrwrecheck sent16:24
* hrw off for today16:27
*** mgoddard has joined #openstack-kolla16:30
*** matrohon has quit IRC16:32
mandredmsimard: what a bummer :) what you need really is a --skip-existing flag but I don't know how easy that would be to implement16:35
dmsimardmandre: dang, you got my hopes up16:35
dmsimardbut yeah --skip-existing makes sense16:36
dmsimardas in that's the desired behavior16:36
mandredmsimard: or you can try to play with the dependency tree and selectively build the new images you need with --skip-parent16:36
*** Serlex has joined #openstack-kolla16:40
dmsimardmandre: rather avoid doing that :p16:41
dmsimardmandre: so should I file a RFE in kolla launchpad or something ?16:42
mandredmsimard: yes please!16:44
*** pcaruana has joined #openstack-kolla16:45
mandrelooks like a fun task to work on, someone will likely pick it up, if not me16:46
sdakehey mandre16:48
sdakelong time no talk dude16:48
sdakewhats up16:48
*** manheim has joined #openstack-kolla16:50
dmsimardmandre: https://bugs.launchpad.net/kolla/+bug/169430216:50
openstackLaunchpad bug 1694302 in kolla "RFE: Skip building images that have already been built" [Undecided,New]16:50
bmaltaisHi, I have to proposed changes stuck at +1... Could someone help push them along? https://review.openstack.org/#/c/466881/ & https://review.openstack.org/#/c/467695/16:50
bmaltaisOr let me know if I should just abandon them16:51
sdakebmaltais looking16:51
sdakebmaltais lots o doc chagnes16:52
sdakebmaltais reason its moving slowly16:52
bmaltaisOK16:52
sdakemandre can you stamp https://review.openstack.org/#/c/467695/416:52
sdakebmaltais that first change will require several hours to review16:52
bmaltaissdake: I se. For sure, going through the exercise of building a test environment to validate time does indeed take time.16:54
*** manheim has quit IRC16:54
bmaltaissdake: I am trying to add documentation to help others. I also want to add a section to get LDAP Domain authentication working against a MS AD backend.16:55
bmaltaissdake: All working now and I think it could help other users of kolla-ansible16:56
*** lucasxu has joined #openstack-kolla17:02
*** jtriley has joined #openstack-kolla17:02
*** lucasxu has quit IRC17:02
openstackgerritMerged openstack/kolla master: dragonflow: install proper package on all distros  https://review.openstack.org/46756817:05
kbaegisAnyone else seeing this bug on stable/ocata? Didn't make the cut for the release by the looks: https://bugs.launchpad.net/neutron/+bug/162948417:05
openstackLaunchpad bug 1629484 in neutron "Key error when try to assign a floating ip to a VM" [High,Fix released] - Assigned to Hao Chen (chenh1987)17:05
*** jtriley has quit IRC17:06
*** jtriley has joined #openstack-kolla17:07
*** jtriley has quit IRC17:12
kbaegisSad :'( Have to disable designate because of that bug17:15
kbaegisOr a regression identical to it17:16
*** salv-orlando has quit IRC17:18
*** Pavo has quit IRC17:21
*** jamesPR has quit IRC17:24
*** jamesPR has joined #openstack-kolla17:32
*** Pavo has joined #openstack-kolla17:32
*** eaguilar has joined #openstack-kolla17:37
*** Manheim has joined #openstack-kolla17:50
*** fguillot has joined #openstack-kolla17:53
*** Manheim has quit IRC17:56
*** Manheim has joined #openstack-kolla17:56
*** jtriley has joined #openstack-kolla18:01
*** egonzalez has joined #openstack-kolla18:04
egonzalezkbaegis how  designate was deployed, followed post deployment steps to integrate with  nova/neutron? https://github.com/openstack/kolla-ansible/blob/master/doc/designate-guide.rst#neutron-and-nova-integration18:06
egonzalezdesignate is weird role, because need IDs in its config generated by designate itself:/18:06
*** jtriley has quit IRC18:06
*** jtriley has joined #openstack-kolla18:06
kbaegisegonzalez: Hey, I didn't see that! Thanks :)18:10
egonzalezkbaegis probably thats why  neutron is failing to  allocate the floatingip18:10
kbaegisWriting a step-by-step guide for the gentoo install w/ kolla18:10
kbaegisegonzalez: I needed the floatingip, but I don't need dns yet18:10
kbaegisThanks for showing me the docs.18:11
*** jtriley has quit IRC18:11
Manheimi have an issue if I run deploy on an existing env18:17
Manheim"Access denied for user 'root'@'192.168.10.11' (using password: YES)\")"}18:18
Manheimi enabled a role in globals, thus the second deploy18:18
Manheimbut i keep seeing this issue for mariadb18:18
*** eaguilar has quit IRC18:22
sdakeegonzalez i htink i have found the problem with mariadb18:44
sdakeegonzalez ansibull looks for /usr/lib/galera.so while in fact it is now in /usr/lib64/galera.so18:45
*** eaguilar has joined #openstack-kolla18:45
egonzalezsdake cool, galera only  or libgalera_smm.so?18:46
sdakeya libgalera_smm.so18:46
sdakei was just being lazy18:46
egonzalezis looking at the correct place https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/mariadb/templates/galera.cnf.j2#L118:47
egonzalezthere is  a check  depending on the distro18:48
sdakeyour correct i read that code wrong18:48
* sdake groans18:48
sdakethe good news is xtrabackup is integrated in 10.118:48
sdakeso we can eject percona onc ewe figure this crap out18:48
egonzalezcool, also percona-xtrabackup  package is in epel18:49
sdakei wonder if htis OOMs the system: https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/mariadb/templates/galera.cnf.j2#L4518:49
sdakewe should remove epel too18:49
egonzalezfor mariadb 10.1 wsrep_on must be  set to  ON, was active by default before  10.1 but now is disabled18:50
sdakeegonzalez this consitently occurs: https://da.gd/kxW7 -> https://paste.fedoraproject.org/paste/xi5XeYO83-As8bg11XgkCl5M1UNdIGYhyRLivL9gydE=/18:51
sdakerequiring a reboot18:51
sdakeany ideas how to avoid the reboot?18:52
egonzalezbjolo have a similar issue in their env with  libvirt, what docker storage driver,  docker version and kernel  are you using?18:53
sdakerhel docker18:58
sdakelatest centos kernel18:58
sdakerhel/centos docker18:58
sdakebtrfs storage driver18:58
*** mgoddard has quit IRC18:58
sdakewsrep_on is a new config option that you suggest setting?18:59
*** chas has quit IRC18:59
*** chas has joined #openstack-kolla18:59
*** jtriley has joined #openstack-kolla19:01
*** chas has quit IRC19:04
*** eaguilar has quit IRC19:05
*** jtriley has quit IRC19:05
sdakethis reboot every time is annoying :(19:06
*** jtriley has joined #openstack-kolla19:06
sdakei don't understand how my system could possibly oom - i have 128gb ram19:07
sdakekolal uses 4gb19:07
*** eaguilar has joined #openstack-kolla19:08
egonzalezsdake here suggests to  use  docker  community version instead of   rhel to fix a similar issue https://bugs.launchpad.net/kolla/+bug/1668059/comments/819:08
openstackLaunchpad bug 1668059 in kolla "Failed to Starting kolla-toolbox container" [Critical,Triaged]19:08
*** jtriley has quit IRC19:11
sdakesetting wrap_on=on does nothing special egonzalez19:14
*** bjolo_ has joined #openstack-kolla19:15
*** bjolo has quit IRC19:15
openstackgerritSteven Dake proposed openstack/kolla master: Consume centos-pike-testing mariadb version  https://review.openstack.org/46863219:15
*** bjolo has joined #openstack-kolla19:17
*** manheim_ has joined #openstack-kolla19:19
*** bjolo_ has quit IRC19:19
*** jaosorior is now known as jaosorior_away19:29
*** eaguilar_ has joined #openstack-kolla19:41
*** eaguilar has quit IRC19:42
*** Pavo has quit IRC19:48
*** bmaltais has quit IRC19:53
*** jtriley has joined #openstack-kolla20:00
kbaegisAnyone know why rsync would be getting blocked?20:03
kbaegisI don't need to create a custom protocol security group do I?20:03
*** jtriley has quit IRC20:05
*** jtriley has joined #openstack-kolla20:05
*** manheim_ has quit IRC20:07
*** jtriley has quit IRC20:10
*** salv-orlando has joined #openstack-kolla20:13
Manheim egonzalez you on?20:20
kbaegisAnyone have a vm able to ping, but not to retrieve websites?20:21
kbaegishttps://hastebin.com/apipoqujed.sql20:22
kbaegiscapture from a compute node20:23
kbaegison eth1 which is my networking interface20:23
*** pcaruana has quit IRC20:24
kbaegisI'm betting this is DVR/SNAT related20:25
sdakeegonzalez check this out:20:26
sdakehttps://da.gd/6FHtA -> https://paste.fedoraproject.org/paste/IqhlsiTe71ZcMcn7cKLEfF5M1UNdIGYhyRLivL9gydE=/20:26
sdakei turned on set -ex in extend_start.sh20:26
sdakeI suspect but can't confirm extend_start.sh is exiting in some way20:26
egonzalezkbaegis ping to  domain or curl?20:31
kbaegisegonzalez: ping works. Curl hangs20:32
egonzalezhrm,  maybe  mtu?20:32
kbaegisJust swapped the router out with a centralized one20:32
sdakehere is my extend_start output: https://da.gd/2uXL0 -> https://paste.fedoraproject.org/paste/JFSA-AYjE8iEC-h2~0cnCV5M1UNdIGYhyRLivL9gydE=/20:33
kbaegisegonzalez: Worked. I think it's double-nat or something. My compute nodes aren't accessible from my edge; they're in their own DMZ20:34
kbaegisDon't know why specifically, but dvr ports have never worked for me for snat20:34
*** Serlex has quit IRC20:38
*** jamesPR has quit IRC20:40
sdakeegonzalez something is busted with extend_start.sh: https://da.gd/VMw9H -> https://paste.fedoraproject.org/paste/DtYwJZVHwn8-IYdSmK1a7F5M1UNdIGYhyRLivL9gydE=/20:44
sdakeegonzalez if that were working - it would instead finish and secure mysql20:45
*** fguillot has quit IRC20:45
*** jtriley has joined #openstack-kolla21:00
*** chas has joined #openstack-kolla21:00
openstackgerritMerged openstack/kolla-ansible master: Add a complete example of configuring a basic 3 nodes Ceph environment.  https://review.openstack.org/46769521:03
*** faridda has quit IRC21:03
sdakeegonzalez if I delete this: https://github.com/openstack/kolla/blob/master/docker/mariadb/extend_start.sh#L19-L33 - mariadb seems to bootstrap21:04
*** chas has quit IRC21:05
*** eaguilar_ has quit IRC21:08
*** jtriley has quit IRC21:10
*** Manheim has quit IRC21:31
*** goldyfruit has quit IRC21:31
*** circ-user-TeTGj has quit IRC21:33
*** manheim has joined #openstack-kolla21:38
sdakefrom the grep man page21:43
sdakeEXIT STATUS21:43
sdake       Normally, the exit status is 0 if selected lines are found and 1 otherwise.21:43
sdakeexit status of 1 will automatically trigger bash to exit21:44
*** n0isyn0i1e has joined #openstack-kolla21:58
*** jtriley has joined #openstack-kolla21:59
*** n0isyn0ise has quit IRC22:02
*** jtriley has quit IRC22:04
*** jtriley has joined #openstack-kolla22:04
sdakeJeffrey4l when your about would like to speak about commits 4417ffbfab77efd67eafe0d5ed57263c6a1b796c and ae8df40b - they are mutually incompatible imo22:05
*** jtriley has quit IRC22:09
*** salv-orlando has quit IRC22:12
openstackgerritAndy Smith proposed openstack/kolla-ansible master: Add support for hybrid messaging backends  https://review.openstack.org/46896622:15
*** jamesPR has joined #openstack-kolla22:24
*** manheim has quit IRC22:47
*** powerd has joined #openstack-kolla22:48
*** egonzalez has quit IRC22:54
*** jtriley has joined #openstack-kolla22:59
*** chas has joined #openstack-kolla23:01
*** jtriley has quit IRC23:03
*** jtriley has joined #openstack-kolla23:04
*** chas has quit IRC23:06
*** jtriley has quit IRC23:09
*** bmaltais has joined #openstack-kolla23:24
bmaltaisHi, I am trying to specify different interfaces name for some physical servers23:24
bmaltaisMy globals.yml file specify ens160 and ens192... but those physical servers use enp4s0f0 & enp4s0f123:25
bmaltaisI tried using the inventory file to specify the right interface name for those nodes but it does not appear to work23:26
bmaltaisTASK [common : Copying over fluentd input config files] keep failing with23:27
bmaltaisfailed: [compute1] (item=01-syslog) => {"failed": true, "item": "01-syslog", "msg": "AnsibleUndefinedVariable: {{ hostvars[inventory_hostname]['ansible_' + api_interface]['ipv4']['address'] if orchestration_engine == 'ANSIBLE' else '0.0.0.0' }}: 'dict object' has no attribute u'ansible_ens160'"} failed: [compute2] (item=01-syslog) => {"failed": true, "item": "01-syslog", "msg": "AnsibleUndefinedVariable: {{ hostvars[inventor23:27
bmaltais;-(23:27
*** powerd has quit IRC23:39
*** Pavo has joined #openstack-kolla23:43
bmaltaisSo it appear as if customization for network interface passed in the inventory files are not properly applied23:57
*** kbaegis has quit IRC23:57
*** jtriley has joined #openstack-kolla23:58
bmaltaisIs there a way to set them via the /etc/kolla/config/node method?23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!