| *** sdake has quit IRC | 00:00 | |
| *** sdake has joined #openstack-kolla | 00:02 | |
| *** sdake has quit IRC | 00:05 | |
| *** henriqueof has quit IRC | 00:15 | |
| *** Sravan has joined #openstack-kolla | 00:27 | |
| *** sdake has joined #openstack-kolla | 00:33 | |
| *** JamesBenson has joined #openstack-kolla | 00:35 | |
| *** Sravan has quit IRC | 00:35 | |
| *** Sravan has joined #openstack-kolla | 00:36 | |
| *** Sravan has quit IRC | 00:37 | |
| *** JamesBenson has quit IRC | 00:39 | |
| *** wolverineav has quit IRC | 00:42 | |
| *** zhanglong has joined #openstack-kolla | 00:43 | |
| *** JamesBenson has joined #openstack-kolla | 00:51 | |
| *** JamesBenson has quit IRC | 00:55 | |
| *** sdake has quit IRC | 00:59 | |
| *** _fragatina has quit IRC | 01:14 | |
| *** itlinux has joined #openstack-kolla | 01:17 | |
| *** sdake has joined #openstack-kolla | 01:35 | |
| *** _fragatina has joined #openstack-kolla | 01:35 | |
| *** itlinux has quit IRC | 01:36 | |
| *** sdake has quit IRC | 02:09 | |
| *** sdake has joined #openstack-kolla | 02:10 | |
| *** sdake has quit IRC | 02:13 | |
| *** sdake has joined #openstack-kolla | 02:13 | |
| *** sdake has quit IRC | 02:16 | |
| *** skramaja has joined #openstack-kolla | 02:27 | |
| *** hongbin has joined #openstack-kolla | 02:38 | |
| *** sdake has joined #openstack-kolla | 02:40 | |
| *** hongbin has quit IRC | 02:43 | |
| *** sdake has quit IRC | 02:45 | |
| *** _fragatina has quit IRC | 02:45 | |
| *** sdake has joined #openstack-kolla | 02:46 | |
| openstackgerrit | Dat Le proposed openstack/kolla master: Support Shibboleth service provider for keystone to keystone. https://review.openstack.org/632009 | 02:47 |
|---|---|---|
| *** sdake has quit IRC | 02:55 | |
| *** sdake has joined #openstack-kolla | 02:56 | |
| *** sdake has quit IRC | 03:01 | |
| *** Sravan has joined #openstack-kolla | 03:01 | |
| *** sdake_ has joined #openstack-kolla | 03:02 | |
| *** Sravan has quit IRC | 03:06 | |
| *** sdake_ has quit IRC | 03:10 | |
| *** sdake has joined #openstack-kolla | 03:10 | |
| *** nguyenhai_ has quit IRC | 03:13 | |
| *** nguyenhai_ has joined #openstack-kolla | 03:14 | |
| *** sdake has quit IRC | 03:15 | |
| *** sdake has joined #openstack-kolla | 03:15 | |
| openstackgerrit | Taeha Kim proposed openstack/kolla master: Add RHEL subscription registration https://review.openstack.org/495148 | 03:16 |
| *** wolverineav has joined #openstack-kolla | 03:18 | |
| *** sdake_ has joined #openstack-kolla | 03:23 | |
| *** sdake has quit IRC | 03:23 | |
| *** sdake_ has quit IRC | 03:25 | |
| *** sdake has joined #openstack-kolla | 03:27 | |
| openstackgerrit | Dat Le proposed openstack/kolla master: Support Shibboleth service provider for keystone to keystone. https://review.openstack.org/632009 | 03:27 |
| *** sdake has quit IRC | 03:30 | |
| *** itlinux has joined #openstack-kolla | 03:31 | |
| *** sdake has joined #openstack-kolla | 03:32 | |
| *** sdake has quit IRC | 03:35 | |
| *** sdake has joined #openstack-kolla | 03:36 | |
| *** sdake has quit IRC | 03:44 | |
| *** sdake_ has joined #openstack-kolla | 03:45 | |
| *** sdake_ has quit IRC | 03:51 | |
| *** sdake has joined #openstack-kolla | 03:52 | |
| *** wolverineav has quit IRC | 03:55 | |
| *** sdake has quit IRC | 03:55 | |
| *** sdake has joined #openstack-kolla | 03:58 | |
| *** sdake has quit IRC | 04:00 | |
| *** sdake has joined #openstack-kolla | 04:05 | |
| openstackgerrit | Yongjun Bai proposed openstack/kolla master: Add cyborg to kolla https://review.openstack.org/619587 | 04:11 |
| *** sdake has quit IRC | 04:11 | |
| *** sdake_ has joined #openstack-kolla | 04:13 | |
| openstackgerrit | Dat Le proposed openstack/kolla master: Support Shibboleth service provider for keystone to keystone. https://review.openstack.org/632009 | 04:15 |
| *** spsurya has joined #openstack-kolla | 04:15 | |
| *** sdake_ has quit IRC | 04:17 | |
| *** Sravan has joined #openstack-kolla | 04:24 | |
| *** Sravan has quit IRC | 04:25 | |
| *** janki has joined #openstack-kolla | 04:33 | |
| *** zhanglong has quit IRC | 04:41 | |
| *** Sravan has joined #openstack-kolla | 04:43 | |
| *** Sravan has quit IRC | 04:44 | |
| *** Sravan has joined #openstack-kolla | 04:46 | |
| *** Sravan has quit IRC | 04:49 | |
| *** _fragatina has joined #openstack-kolla | 04:52 | |
| *** Sravan has joined #openstack-kolla | 04:57 | |
| *** wolverineav has joined #openstack-kolla | 05:01 | |
| *** itlinux has quit IRC | 05:01 | |
| *** wolverineav has quit IRC | 05:02 | |
| *** dave-mccowan has quit IRC | 05:05 | |
| *** Sravan has quit IRC | 05:10 | |
| *** shyamb has joined #openstack-kolla | 05:16 | |
| *** Sravan has joined #openstack-kolla | 05:26 | |
| *** Sravan has quit IRC | 05:36 | |
| *** Sravan has joined #openstack-kolla | 05:51 | |
| *** ivve has joined #openstack-kolla | 06:08 | |
| *** hamzaachi has joined #openstack-kolla | 06:12 | |
| *** Sravan has quit IRC | 06:16 | |
| *** shyamb has quit IRC | 06:18 | |
| *** wolverineav has joined #openstack-kolla | 06:21 | |
| *** hamzaachi has quit IRC | 06:25 | |
| *** wolverineav has quit IRC | 06:38 | |
| *** wolverineav has joined #openstack-kolla | 06:39 | |
| *** rgogunskiy has joined #openstack-kolla | 06:46 | |
| *** Luzi has joined #openstack-kolla | 06:47 | |
| *** wolverineav has quit IRC | 06:54 | |
| *** zhanglong has joined #openstack-kolla | 07:13 | |
| *** shyamb has joined #openstack-kolla | 07:16 | |
| *** ivve has quit IRC | 07:17 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/pike: Fix MariaDB bootstrap issues on CentOS https://review.openstack.org/637501 | 07:22 |
| *** ivve has joined #openstack-kolla | 07:34 | |
| *** wolverineav has joined #openstack-kolla | 07:44 | |
| *** zhangfei has joined #openstack-kolla | 08:01 | |
| *** pcaruana has joined #openstack-kolla | 08:13 | |
| *** wolverineav has quit IRC | 08:18 | |
| *** zbr|ssbarnea has joined #openstack-kolla | 08:21 | |
| *** zbr|ssbarnea is now known as zbr | 08:22 | |
| *** pcaruana has quit IRC | 08:28 | |
| openstackgerrit | Surya Prakash (spsurya) proposed openstack/kolla master: [DNM]Drop py35 jobs https://review.openstack.org/639593 | 08:30 |
| *** zhanglong has quit IRC | 08:31 | |
| openstackgerrit | Surya Prakash (spsurya) proposed openstack/kolla-ansible master: [DNM]Drop py35 jobs https://review.openstack.org/639594 | 08:33 |
| openstackgerrit | Lee Yarwood proposed openstack/kolla master: nova: Only link OVMF_CODE.fd on EL 7 https://review.openstack.org/639596 | 08:38 |
| *** pcaruana has joined #openstack-kolla | 08:42 | |
| openstackgerrit | Quique Llorente proposed openstack/kolla master: WIP: Fedora support for python3 package testing https://review.openstack.org/624838 | 08:45 |
| *** wolverineav has joined #openstack-kolla | 08:51 | |
| *** pcaruana has quit IRC | 08:51 | |
| openstackgerrit | Surya Prakash (spsurya) proposed openstack/kolla-ansible master: Drop py35 jobs https://review.openstack.org/639594 | 08:57 |
| openstackgerrit | Surya Prakash (spsurya) proposed openstack/kolla master: Drop py35 jobs https://review.openstack.org/639593 | 08:57 |
| *** pcaruana has joined #openstack-kolla | 08:58 | |
| *** pcaruana|afk| has joined #openstack-kolla | 09:01 | |
| *** pcaruana has quit IRC | 09:03 | |
| *** shyamb has quit IRC | 09:03 | |
| *** shyamb has joined #openstack-kolla | 09:04 | |
| *** dougsz has joined #openstack-kolla | 09:05 | |
| *** ivve has quit IRC | 09:11 | |
| *** k_mouza has joined #openstack-kolla | 09:18 | |
| *** shyamb has quit IRC | 09:21 | |
| *** shyamb has joined #openstack-kolla | 09:22 | |
| *** hjensas has quit IRC | 09:23 | |
| *** wolverineav has quit IRC | 09:23 | |
| *** ivve has joined #openstack-kolla | 09:26 | |
| *** k_mouza has quit IRC | 09:26 | |
| *** k_mouza has joined #openstack-kolla | 09:27 | |
| mgoddard | morning all | 09:29 |
| *** fxpester has joined #openstack-kolla | 09:29 | |
| spsurya | mgoddard: morning | 09:30 |
| mgoddard | hi spsurya, how are you? | 09:30 |
| *** janki has quit IRC | 09:30 | |
| spsurya | mgoddard: fine, what abt you ? | 09:30 |
| *** janki has joined #openstack-kolla | 09:30 | |
| openstackgerrit | Lee Yarwood proposed openstack/kolla master: nova: Remove bridge_utils from base package https://review.openstack.org/638403 | 09:31 |
| mgoddard | spsurya: good thanks. Getting quite close to Stein release now - feature freeze next week | 09:31 |
| spsurya | mgoddard: yeah | 09:32 |
| hrw | imho stein shows that most of people use source based images | 09:34 |
| *** Luzi has quit IRC | 09:36 | |
| mgoddard | hrw: what makes you say that? | 09:39 |
| mnasiadka | morning | 09:39 |
| hrw | mgoddard: Debian is basically source only, Ubuntu binary is at rocky in kolla. so only CentOS looks uptodate | 09:40 |
| mgoddard | hrw: what people use != what works in master | 09:41 |
| hrw | mgoddard: let say that I do not care about <master | 09:41 |
| mgoddard | hrw: you != people :) | 09:42 |
| hrw | mgoddard: let me rephrase then. | 09:42 |
| mgoddard | hrw: it suggests to me that maybe people using ubuntu binary images aren't too involved upstream | 09:43 |
| hrw | mgoddard: for me it looks like users of kolla based stein images go rather for source than binary images. | 09:43 |
| mgoddard | tripleo folks will use centos/rhel binary images | 09:43 |
| *** shyamb has quit IRC | 09:45 | |
| *** shyamb has joined #openstack-kolla | 09:46 | |
| *** zhangfei has quit IRC | 09:46 | |
| mnasiadka | mgoddard: I would say most people asking about help/complaining about issues on the channel are using Ubuntu mainly ;) | 09:49 |
| *** Luzi has joined #openstack-kolla | 09:51 | |
| *** owalsh_ has joined #openstack-kolla | 09:57 | |
| *** owalsh has quit IRC | 09:58 | |
| *** zhangfei has joined #openstack-kolla | 09:58 | |
| mgoddard | mnasiadka: because centos works? :p | 10:00 |
| mnasiadka | mgoddard: I know, that's why I use it ;) | 10:00 |
| *** sdake has joined #openstack-kolla | 10:02 | |
| *** sdake has quit IRC | 10:05 | |
| *** hjensas has joined #openstack-kolla | 10:05 | |
| *** priteau has joined #openstack-kolla | 10:06 | |
| *** sdake has joined #openstack-kolla | 10:08 | |
| *** owalsh has joined #openstack-kolla | 10:09 | |
| *** owalsh_ has quit IRC | 10:10 | |
| *** sdake has quit IRC | 10:10 | |
| *** hjensas has quit IRC | 10:11 | |
| *** hjensas has joined #openstack-kolla | 10:12 | |
| *** sdake has joined #openstack-kolla | 10:13 | |
| *** sdake has quit IRC | 10:15 | |
| *** sdake has joined #openstack-kolla | 10:16 | |
| *** sdake has quit IRC | 10:17 | |
| *** wolverineav has joined #openstack-kolla | 10:20 | |
| *** sdake has joined #openstack-kolla | 10:21 | |
| *** sdake has quit IRC | 10:25 | |
| *** sdake has joined #openstack-kolla | 10:26 | |
| *** heikkine has quit IRC | 10:27 | |
| *** sdake has quit IRC | 10:30 | |
| *** sdake has joined #openstack-kolla | 10:31 | |
| *** sm806 has quit IRC | 10:32 | |
| *** sm806 has joined #openstack-kolla | 10:33 | |
| *** sdake has quit IRC | 10:35 | |
| *** sdake has joined #openstack-kolla | 10:35 | |
| *** shyamb has quit IRC | 10:36 | |
| *** shyamb has joined #openstack-kolla | 10:37 | |
| *** priteau has quit IRC | 10:40 | |
| *** sdake_ has joined #openstack-kolla | 10:40 | |
| *** sdake has quit IRC | 10:41 | |
| *** priteau has joined #openstack-kolla | 10:44 | |
| *** sdake_ has quit IRC | 10:45 | |
| *** sdake has joined #openstack-kolla | 10:46 | |
| *** sdake has quit IRC | 10:50 | |
| *** sdake has joined #openstack-kolla | 10:50 | |
| *** wolverineav has quit IRC | 10:54 | |
| *** sdake has quit IRC | 10:55 | |
| *** sdake has joined #openstack-kolla | 10:57 | |
| mgoddard | sdake: what's going on with your client? lots of joins & quits | 10:59 |
| *** sdake has quit IRC | 11:00 | |
| *** sdake has joined #openstack-kolla | 11:01 | |
| *** k_mouza_ has joined #openstack-kolla | 11:04 | |
| *** k_mouza_ has quit IRC | 11:05 | |
| *** k_mouza_ has joined #openstack-kolla | 11:06 | |
| *** k_mouza has quit IRC | 11:07 | |
| *** dciabrin_ has quit IRC | 11:30 | |
| *** zhanglong has joined #openstack-kolla | 11:31 | |
| k_mouza_ | good morning/afternoon all! I have a quick question please. I'm trying to do an all-in-one deployment in a VM. It works fine when the internal and the external kolla VIP is the same, but when they are different, haproxy sits and waits for the ip to come up and it eventually times out. Anyone seen this before ? | 11:31 |
| *** dciabrin_ has joined #openstack-kolla | 11:31 | |
| k_mouza_ | I'm using stable/queens release | 11:31 |
| *** fxpester has quit IRC | 11:31 | |
| *** shyamb has quit IRC | 11:44 | |
| *** shyamb has joined #openstack-kolla | 11:44 | |
| *** sshnaidm|afk is now known as sshnaidm | 11:49 | |
| *** wolverineav has joined #openstack-kolla | 11:51 | |
| *** henriqueof has joined #openstack-kolla | 11:53 | |
| henriqueof | Good morning. | 11:53 |
| henriqueof | Does the kolla-ansible source deployment uses the latest code available on source repo? How frequently it is build? | 11:54 |
| *** ivve has quit IRC | 12:00 | |
| *** Luzi has quit IRC | 12:00 | |
| *** Luzi has joined #openstack-kolla | 12:02 | |
| mnasiadka | it uses the latest RELEASED tarballs, not the git repo code | 12:05 |
| mgoddard | k_mouza_: are the network interfaces for internal and external VIPs different? | 12:05 |
| mgoddard | henriqueof: mnasiadka: stable releases use released tarballs, master tag uses latest master. Both should be built daily | 12:07 |
| mnasiadka | mgoddard: yeah, thanks for correcting ;) | 12:07 |
| henriqueof | mgoddard: So latest backported fixes will not be available on the next builds? | 12:08 |
| k_mouza_ | mgoddard: I've tried with both different interfaces and the same one and it still behaves the same. | 12:08 |
| k_mouza_ | mgoddard: keepalived logs are full of this message as well: "Keepalived_vrrp[12]: /check_alive.sh exited with status 1" | 12:16 |
| k_mouza_ | and running the check_alive script directly in the container I'm getting this connection refused message: "2019/02/27 12:17:28 socat[379] E connect(5, AF=1 "/var/lib/kolla/haproxy/haproxy.sock", 37): Connection refused" | 12:18 |
| mnasiadka | k_mouza_: and what is the haproxy status? | 12:18 |
| henriqueof | How can I deploy only one container using master tag? | 12:20 |
| k_mouza_ | mnasiadka: haproxy ontainer restarting. From docker logs this is the only message: http://paste.openstack.org/show/746421/. FYI, the 172.16.0.254 ip is the external one, but haproxy is waiting to find the internal one I think | 12:23 |
| *** wolverineav has quit IRC | 12:24 | |
| mnasiadka | k_mouza_: now the question is why it cannot bind socket :) | 12:24 |
| k_mouza_ | mnasiadka: I know god damn it! :p Selinux is off and there's no firewall running... And bare in mind that if I make the external ip same as the internal one, it deploys fine! | 12:26 |
| mnasiadka | henriqueof: $service_tag = "master", e.g. blazar_tag = "master" | 12:27 |
| mnasiadka | k_mouza_: I can feel the irritation here :) | 12:27 |
| mnasiadka | can you share the haproxy.cfg from /etc/kolla/haproxy from the node? | 12:27 |
| henriqueof | mnasiadka: Thanks! I couldn't find it in the docs tho. | 12:28 |
| mnasiadka | henriqueof: feel free to update them :) | 12:28 |
| henriqueof | mnasiadka: Sure I was looking for the contributing steps, also I would like to add some aditional steps to configures Octavia,there is a lot of manual work to do after kolla deploy it. | 12:29 |
| henriqueof | mnasiadka: Do I need to re-deploy after updating container tag or can I just re-run deploy command? | 12:30 |
| mnasiadka | henriqueof: have no clue, you need to test it by yourself I guess | 12:31 |
| k_mouza_ | mnasiadka: Here's the haproxy.conf: http://paste.openstack.org/show/746425 | 12:43 |
| k_mouza_ | mnasiadka: and just FYI, this is the error from the reconfigure command: http://paste.openstack.org/show/746426/ | 12:44 |
| *** k_mouza_ has quit IRC | 12:44 | |
| *** k_mouza has joined #openstack-kolla | 12:45 | |
| *** dciabrin has joined #openstack-kolla | 12:50 | |
| *** dciabrin_ has quit IRC | 12:51 | |
| *** ivve has joined #openstack-kolla | 12:57 | |
| *** sm806 has quit IRC | 12:58 | |
| *** sm806 has joined #openstack-kolla | 12:58 | |
| *** shyamb has quit IRC | 13:03 | |
| *** rgogunskiy has quit IRC | 13:07 | |
| *** pcaruana|afk| has quit IRC | 13:09 | |
| *** mchlumsky has joined #openstack-kolla | 13:15 | |
| *** sdake has quit IRC | 13:16 | |
| *** priteau has quit IRC | 13:19 | |
| *** wolverineav has joined #openstack-kolla | 13:21 | |
| *** hamzaachi has joined #openstack-kolla | 13:21 | |
| *** zhangfei has quit IRC | 13:22 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: debian/ubuntu: make use of Python3 based packages https://review.openstack.org/625298 | 13:24 |
| hrw | install_pip macro got fixed | 13:24 |
| hrw | now should pass zuul | 13:25 |
| mgoddard | k_mouza: haproxy should not fail if the VIP is not present - that is the normal case for a VRRP standby mode | 13:26 |
| mgoddard | k_mouza: is the VIP assigned to the network interface? | 13:26 |
| henriqueof | mnasiadka: re-runnning the deploy command updated the container tags but they won't start now, just keep restart... | 13:29 |
| k_mouza | mgoddard: the VIP is not automatically assigned (which could be another issue), but I assign it manually on the corresponding interface. | 13:34 |
| *** skramaja has quit IRC | 13:34 | |
| mgoddard | k_mouza: that would be an issue | 13:35 |
| mgoddard | keepalived should assign the VIP automatically | 13:35 |
| mgoddard | I would remove your IP and restart keepalived | 13:35 |
| *** hamzaachi has quit IRC | 13:43 | |
| *** hamzaachi has joined #openstack-kolla | 13:43 | |
| *** janki has quit IRC | 13:53 | |
| *** wolverineav has quit IRC | 13:55 | |
| henriqueof | mgoddard: I'e got a problem with a master tag container, the logs show /usr/local/bin/kolla_octavia_extend_start: line 22: /var/lib/octavia: Is a directory, do you know what can be the reason? | 13:55 |
| mgoddard | henriqueof: I don't think it's guaranteed for new images to work with old kolla-ansible | 13:57 |
| *** mjturek has joined #openstack-kolla | 13:58 | |
| hrw | henriqueof: use same version of kolla-ansible as kolla images | 13:59 |
| mgoddard | henriqueof: are you running master kolla-ansible? | 13:59 |
| henriqueof | I used rocky kolla and only one container tagged master. | 14:00 |
| hrw | henriqueof: there can be changes which make things go wrong when releases are mixed with development images | 14:00 |
| henriqueof | If I use master kolla does the rocky containers could fail? | 14:00 |
| hrw | yes | 14:01 |
| henriqueof | Are there any high risks of using master on production? | 14:01 |
| openstackgerrit | Doug Szumski proposed openstack/kolla-ansible master: Default to Prometheus tag for all Prometheus images https://review.openstack.org/639671 | 14:02 |
| *** hamzaachi_ has joined #openstack-kolla | 14:02 | |
| *** hamzaachi has quit IRC | 14:02 | |
| dougsz | ^ easy one | 14:07 |
| *** mjturek has quit IRC | 14:09 | |
| mgoddard | henriqueof: I would recommend against using master in production, unless you have very good testing and CI/CD in place | 14:10 |
| *** mjturek has joined #openstack-kolla | 14:12 | |
| *** sdake has joined #openstack-kolla | 14:12 | |
| *** sdake has quit IRC | 14:12 | |
| henriqueof | I just need one feature that's available on one container, will check if I can fix it and make it run from here. | 14:13 |
| *** priteau has joined #openstack-kolla | 14:16 | |
| *** Luzi has quit IRC | 14:17 | |
| mgoddard | henriqueof: you could build an octavia image using a custom config pointing to stable/rocky | 14:20 |
| mgoddard | henriqueof: https://docs.openstack.org/kolla/latest/admin/image-building.html#build-openstack-from-source | 14:21 |
| henriqueof | I'll need a local registry to do that, right? | 14:22 |
| mgoddard | henriqueof: yes, or push to your personal dockerhub repo | 14:27 |
| mgoddard | or your org's | 14:27 |
| *** zhanglong has quit IRC | 14:41 | |
| *** sdake has joined #openstack-kolla | 14:48 | |
| *** gkadam has joined #openstack-kolla | 14:49 | |
| *** zhanglong has joined #openstack-kolla | 14:50 | |
| *** ktibi has joined #openstack-kolla | 14:50 | |
| egonzalez | henriqueof if deploy a master version of an openstack service, will need to upgrade your db schemas and it may change during the development which is not really safe for prod unless you have a CI with daily builds and deployment tests | 14:50 |
| egonzalez | and ansible deployment may be different in some cases as deprecated options or services needed to be deployed | 14:51 |
| henriqueof | egonzalez: I installed two master tag services, Magnum and Octavia, Magnum had problems that I could solve by upgrading database, but Octavia problem looks like configuration script error, I am trying to figure out how to change/fix that. | 14:52 |
| *** wolverineav has joined #openstack-kolla | 14:52 | |
| henriqueof | The container fails to start with this error: '/usr/local/bin/kolla_octavia_extend_start: line 22: /var/lib/octavia: Is a directory', do you know where can I change to upgrade this script to a compatible version? | 14:52 |
| *** sdake has quit IRC | 14:55 | |
| egonzalez | henriqueof which octavia container fails? cannot find a reference in ansible or images to var/lib/octavia | 14:55 |
| k_mouza | mgoddard: we have progress! It's finished the deploy now and all the VIPs are up on the right interfaces. SSL is enabled as well, but the new problem now is that horizon keeps restarting every ~30secs with no apparent reason in the logs. Anything in mind? | 14:56 |
| henriqueof | egonzalez: octavia_api | 14:56 |
| *** pcaruana has joined #openstack-kolla | 14:57 | |
| mgoddard | k_mouza: great, what did you have to change? | 14:58 |
| mgoddard | not sure about horizon | 14:58 |
| henriqueof | I found this on th kolla repo: 'kolla/docker/octavia/octavia-api/Dockerfile.j2:COPY extend_start.sh /usr/local/bin/kolla_octavia_extend_start ' | 14:58 |
| egonzalez | henriqueof might be the db migrations which fails? | 14:58 |
| egonzalez | but should be failing at bootstrap | 14:58 |
| henriqueof | egonzalez: I did the db upgrade but still, it fails to event start the container. | 14:59 |
| *** itlinux has joined #openstack-kolla | 14:59 | |
| egonzalez | team meeting at #openstack-meeting-4 | 14:59 |
| k_mouza | mgoddard: I deleted the VIPs from the interfaces, restarted the VM with selinux disabled (it was on permissive) and ran a reconfigure... And boom... | 15:00 |
| k_mouza | although, still not sure why it was working fine with just one VIP...! | 15:01 |
| egonzalez | k_mouza VIPs cannot be attached to an iface, keepalived will be moving from host to host and will cause conflicts | 15:01 |
| *** sdake has joined #openstack-kolla | 15:03 | |
| k_mouza | egonzalez: yup, I've tried with no VIPs before as well (that's how I always start the deploy) and I was still getting that timeout error... Good thing that it's gone now, although have to tackle through horizon now! | 15:06 |
| *** VickyG has joined #openstack-kolla | 15:10 | |
| egonzalez | k_mouza ensure if have other deployments running or service using vrrp, to change the vrrp id | 15:10 |
| egonzalez | or wont be able to connect each others | 15:11 |
| *** wolverineav has quit IRC | 15:24 | |
| *** chrizl has joined #openstack-kolla | 15:25 | |
| *** itlinux_ has joined #openstack-kolla | 15:31 | |
| *** JamesBenson has joined #openstack-kolla | 15:33 | |
| *** sdake has quit IRC | 15:33 | |
| *** itlinux has quit IRC | 15:34 | |
| *** priteau has quit IRC | 15:35 | |
| *** sdake has joined #openstack-kolla | 15:35 | |
| *** zhanglong has quit IRC | 15:40 | |
| *** dmellado has quit IRC | 15:42 | |
| *** dmellado has joined #openstack-kolla | 15:43 | |
| *** ktibi has quit IRC | 15:43 | |
| *** itlinux_ has quit IRC | 15:46 | |
| spsurya | mnasiadka: congrats !! and welcome :) | 15:50 |
| JamesBenson | egonzalez or spsurya: any help on PG ceph count? I know the ceph calculator, I know kolla deploys 5 pools, but my calculations and what ansible spits back at me with error codes, just don't make sense. | 15:52 |
| spsurya | JamesBenson: haven't check ceph calculator ;) | 15:53 |
| spsurya | :( | 15:54 |
| erolg | guys, please review https://review.openstack.org/#/c/638679/ | 15:54 |
| JamesBenson | okay, then any suggestions in general? deployed probably 5 times in the past few days trying to get this to work... I've lowered it to my new low, 32 and still nothing, | 15:54 |
| erolg | JamesBenson, btw ceph pg count precheck is a good idea. thanks | 15:55 |
| *** hamzaachi_ has quit IRC | 15:55 | |
| JamesBenson | erolg, thanks! | 15:55 |
| *** hamzaachi has joined #openstack-kolla | 15:55 | |
| *** hamzaachi has quit IRC | 15:57 | |
| spsurya | JamesBenson: nothing as of now, will let you know if find, meanwhile you can check with egonzalez | 15:57 |
| *** hamzaachi has joined #openstack-kolla | 15:57 | |
| egonzalez | JamesBenson have to leave, but share the error to look at it later | 15:58 |
| JamesBenson | also, I'm not sure how our images are built, but this might be a good read: https://snyk.io/blog/top-ten-most-popular-docker-images-each-contain-at-least-30-vulnerabilities/ | 15:58 |
| JamesBenson | ERANGE: pg_num 128 size 3 would mean 768 total pgs, which exceeds max 750 (mon_max_pg_per_osd 250 * num_in_osds 3)", "stderr_lines": ["Error ERANGE: pg_num 128 size 3 would mean 768 total pgs, which exceeds max 750 (mon_max_pg_per_osd 250 * num_in_osds 3)" | 15:58 |
| JamesBenson | "Error ERANGE: pg_num 125 size 3 would mean 759 total pgs, which exceeds max 750 (mon_max_pg_per_osd 250 * num_in_osds 3)", "stderr_lines": ["Error ERANGE: pg_num 125 size 3 would mean 759 total pgs, which exceeds max 750 (mon_max_pg_per_osd 250 * num_in_osds 3)"] | 15:58 |
| JamesBenson | Error ERANGE: pg_num 120 size 3 would mean 1104 total pgs, which exceeds max 750 (mon_max_pg_per_osd 250 * num_in_osds 3)", "stderr_lines": ["Error ERANGE: pg_num 120 size 3 would mean 1104 total pgs, which exceeds max 750 (mon_max_pg_per_osd 250 * num_in_osds 3)"] | 15:58 |
| JamesBenson | Here are the errors for 3 failed deploys: | 15:58 |
| *** chrizl has quit IRC | 15:59 | |
| JamesBenson | I've tried pg size, 128, 125, 120 (I know those aren't 2^n), 64, and 32.... all failed. | 15:59 |
| *** ivve has quit IRC | 16:01 | |
| JamesBenson | I think ceph also says that if it is close to a 2^n that is higher, to use that one than a lower one. For example, if you calculations come out to be 116, go ahead and use 128 instead of 64. But not sure if we can build that logic into it. | 16:01 |
| mnasiadka | spsurya: thanks :) | 16:02 |
| spsurya | mnasiadka: can you try your power on https://review.openstack.org/#/c/639298/ https://review.openstack.org/#/c/639593/ https://review.openstack.org/#/c/639594/ | 16:06 |
| spsurya | :) | 16:06 |
| mnasiadka | spsurya: Will do, in a middle of a call, give me 30 minutes :) | 16:07 |
| spsurya | mnasiadka: np | 16:07 |
| spsurya | take your time | 16:07 |
| *** ktibi has joined #openstack-kolla | 16:12 | |
| *** wolverineav has joined #openstack-kolla | 16:22 | |
| *** hamzaachi_ has joined #openstack-kolla | 16:29 | |
| *** hamzaachi has quit IRC | 16:29 | |
| *** dmellado has quit IRC | 16:32 | |
| *** dmellado has joined #openstack-kolla | 16:34 | |
| *** _fragatina has quit IRC | 16:36 | |
| *** ktibi_ has joined #openstack-kolla | 16:43 | |
| *** ktibi has quit IRC | 16:45 | |
| *** hamzaachi_ has quit IRC | 16:47 | |
| *** ktibi_ has quit IRC | 16:47 | |
| *** gouthamr has quit IRC | 16:48 | |
| *** gouthamr has joined #openstack-kolla | 16:50 | |
| *** sdake has quit IRC | 16:52 | |
| *** sdake has joined #openstack-kolla | 16:54 | |
| *** wolverineav has quit IRC | 16:55 | |
| *** pcaruana has quit IRC | 16:57 | |
| *** _fragatina has joined #openstack-kolla | 16:58 | |
| *** _fragatina_ has joined #openstack-kolla | 16:59 | |
| *** sdake has quit IRC | 17:02 | |
| *** _fragatina has quit IRC | 17:02 | |
| JamesBenson | any help with the ceph pg calculations? | 17:07 |
| *** _fragatina_ has quit IRC | 17:07 | |
| mnasiadka | spsurya: I'm only core in k-a, and the third patch is failing Zuul check ;) | 17:09 |
| *** wolverineav has joined #openstack-kolla | 17:16 | |
| *** gkadam has quit IRC | 17:18 | |
| *** mjturek has quit IRC | 17:20 | |
| openstackgerrit | Alex Schultz proposed openstack/kolla master: Add python3 packages for RHEL systems https://review.openstack.org/632156 | 17:32 |
| openstackgerrit | Alex Schultz proposed openstack/kolla master: Add distro_package_manager configuration https://review.openstack.org/639219 | 17:32 |
| openstackgerrit | Alex Schultz proposed openstack/kolla master: WIP: Fedora support for python3 package testing https://review.openstack.org/624838 | 17:32 |
| *** dims has quit IRC | 17:35 | |
| *** ivve has joined #openstack-kolla | 17:36 | |
| *** wolverineav has quit IRC | 17:46 | |
| *** dims has joined #openstack-kolla | 17:48 | |
| *** k_mouza_ has joined #openstack-kolla | 17:55 | |
| *** k_mouza_ has quit IRC | 17:55 | |
| *** k_mouza_ has joined #openstack-kolla | 17:55 | |
| *** chrizl has joined #openstack-kolla | 17:56 | |
| *** _fragatina has joined #openstack-kolla | 17:58 | |
| *** k_mouza has quit IRC | 17:59 | |
| *** hamzaachi_ has joined #openstack-kolla | 18:01 | |
| *** dougsz has quit IRC | 18:02 | |
| *** k_mouza_ has quit IRC | 18:04 | |
| *** iinuwa has joined #openstack-kolla | 18:04 | |
| *** mjturek has joined #openstack-kolla | 18:11 | |
| iinuwa | I am using ubuntu binary rocky images for deployment, and I am having trouble with mariadb. The bootstrap_mariadb container fails with an error `Neither host 'lightning' nor 'localhost' could be looked up with '/usr/sbin/resolveip'` The hostname is set in DNS and in /etc/hsots, so I'm not sure why this is failing. | 18:22 |
| hrw | mnasiadka: welcome in core team! | 18:23 |
| iinuwa | I don't know if my intro message came through: Hello, I am not sure if this is the right place to ask for help deploying a cluster with kolla-ansible. I am new to OpenStack, Kolla, Ansible and IRC, so let me know if I should go somewhere else for help. | 18:24 |
| mnasiadka | hrw: thanks ;) | 18:24 |
| *** sdake has joined #openstack-kolla | 18:25 | |
| mnasiadka | iinuwa: are you using latest release of kolla-ansible or stable/rocky from git? | 18:25 |
| iinuwa | I installed using `pip install`, so I suppose that means I'm using the latest release. | 18:26 |
| *** wolverineav has joined #openstack-kolla | 18:26 | |
| hrw | mnasiadka: so in month or so you will be kolla as well? | 18:26 |
| mnasiadka | hrw: you should ask egonzalez I guess :) | 18:27 |
| hrw | mnasiadka: it is up to you | 18:27 |
| mnasiadka | hrw: if I behave well?;) | 18:28 |
| hrw | mnasiadka: I applied for kolla first. turned out that I was first to not go for whole set. | 18:28 |
| hrw | mnasiadka: looks like you are first to apply only for k-a | 18:28 |
| *** sshnaidm is now known as sshnaidm|afk | 18:28 | |
| *** chrizl has quit IRC | 18:29 | |
| mnasiadka | hrw: well, I got nominated, did not apply anywhere | 18:30 |
| hrw | mnasiadka: but got asked before, right? | 18:30 |
| hrw | ;d | 18:30 |
| iinuwa | mnasiadka: The documentation for kolla-ansible/rocky [1] says that if you installed from pip, you should use the latest stable version, "so openstack_release should be set to queens." [1] https://docs.openstack.org/kolla-ansible/rocky/user/quickstart.html#kolla-globals-yml. I didn't know if that was a typo, since the latest stable release is now rocky, right? | 18:31 |
| mnasiadka | hrw: yeah ;) the plan was first k-a, and kolla later ;) | 18:31 |
| mnasiadka | iinuwa: must be a typo, I’ll note to fix that | 18:31 |
| *** _fragatina has quit IRC | 18:31 | |
| iinuwa | mnasiadka: Would it help if I reported a bug for the documentation? | 18:32 |
| mnasiadka | iinuwa: so, the resolveip problem is fixed in latest unreleased stable, so if you would pull the code from git, and use that - should be better | 18:32 |
| mnasiadka | iinuwa: it would help not to forget, or you can raise a PR by yourself | 18:33 |
| *** sdake has quit IRC | 18:33 | |
| iinuwa | mnasiadka: OK, so I would need to build the source and have my own registry then? I'll try to see what I can do with my hardware constraints. (Trying to provision some machines for my small team since there isn't enough space in our VMware cluster) | 18:34 |
| *** _fragatina has joined #openstack-kolla | 18:35 | |
| mnasiadka | iinuwa: no no, this is kolla-ansible part, no need to build images | 18:35 |
| iinuwa | mnasiadka: I'll try a PR, if I can remember my password. | 18:35 |
| iinuwa | mnasiadka: gotcha. Still OK to use rocky? | 18:35 |
| *** sdake has joined #openstack-kolla | 18:38 | |
| mnasiadka | mnasiadka: yeah | 18:39 |
| iinuwa | mnasiadka: great, thanks! | 18:40 |
| *** iinuwa has quit IRC | 18:40 | |
| *** ivve has quit IRC | 18:43 | |
| *** sdake has quit IRC | 18:44 | |
| *** sdake has joined #openstack-kolla | 18:45 | |
| *** sdake has quit IRC | 18:51 | |
| *** lvdombrkr has joined #openstack-kolla | 18:55 | |
| lvdombrkr | hello folks | 18:56 |
| *** sdake has joined #openstack-kolla | 18:56 | |
| *** wolverineav has quit IRC | 18:59 | |
| *** andrein has joined #openstack-kolla | 19:03 | |
| *** lvdombrkr has quit IRC | 19:05 | |
| *** wolverineav has joined #openstack-kolla | 19:16 | |
| *** wolverineav has quit IRC | 19:16 | |
| *** wolverineav has joined #openstack-kolla | 19:16 | |
| *** lvdombrkr has joined #openstack-kolla | 19:17 | |
| lvdombrkr | egonzalez: hi | 19:18 |
| lvdombrkr | folks who can help with glance troubleshooing | 19:20 |
| lvdombrkr | install rocky version | 19:20 |
| lvdombrkr | but cant upload image in glance | 19:20 |
| lvdombrkr | in glance-api.log no errors | 19:20 |
| lvdombrkr | any ideas? | 19:20 |
| *** wolverineav has quit IRC | 19:24 | |
| *** wolverineav has joined #openstack-kolla | 19:29 | |
| jroll | egonzalez: this is blocking a long chain of approved patches, do you have time to revisit? https://review.openstack.org/#/c/625954/ | 19:39 |
| lvdombrkr | folks? | 19:40 |
| *** spsurya has quit IRC | 19:52 | |
| *** lvdombrkr has quit IRC | 19:57 | |
| *** wolverineav has quit IRC | 20:00 | |
| *** Sravan has joined #openstack-kolla | 20:00 | |
| *** henriqueof has quit IRC | 20:01 | |
| *** wolverineav has joined #openstack-kolla | 20:01 | |
| *** wolverineav has quit IRC | 20:06 | |
| *** hamzaachi_ has quit IRC | 20:10 | |
| *** lvdombrkr has joined #openstack-kolla | 20:11 | |
| *** andrein has quit IRC | 20:18 | |
| *** Sravan has quit IRC | 20:26 | |
| *** Sravan has joined #openstack-kolla | 20:26 | |
| *** chrizl has joined #openstack-kolla | 20:27 | |
| *** Sravan has quit IRC | 20:28 | |
| lvdombrkr | anybody around? | 20:29 |
| *** Sravan has joined #openstack-kolla | 20:33 | |
| *** wolverineav has joined #openstack-kolla | 20:35 | |
| *** Sravan has quit IRC | 20:39 | |
| *** wolverineav has quit IRC | 20:40 | |
| *** wolverineav has joined #openstack-kolla | 20:41 | |
| *** wolverineav has quit IRC | 20:41 | |
| *** wolverineav has joined #openstack-kolla | 20:41 | |
| *** lvdombrkr has quit IRC | 20:42 | |
| *** wolverineav has quit IRC | 20:45 | |
| *** dave-mccowan has joined #openstack-kolla | 20:45 | |
| *** andrein has joined #openstack-kolla | 20:49 | |
| *** henriqueof has joined #openstack-kolla | 20:57 | |
| *** chrizl has quit IRC | 21:00 | |
| *** ivve has joined #openstack-kolla | 21:03 | |
| openstackgerrit | Isaiah Inuwa proposed openstack/kolla-ansible stable/rocky: Updates references to latest release to rocky. https://review.openstack.org/639827 | 21:08 |
| *** jaosorior has quit IRC | 21:08 | |
| *** iinuwa has joined #openstack-kolla | 21:12 | |
| *** ivve has quit IRC | 21:14 | |
| *** iinuwa has quit IRC | 21:16 | |
| *** hamzaachi has joined #openstack-kolla | 21:21 | |
| *** redrobot has quit IRC | 21:25 | |
| *** wolverineav has joined #openstack-kolla | 21:27 | |
| *** hamzaachi has quit IRC | 21:29 | |
| *** wolverineav has quit IRC | 21:30 | |
| *** wolverineav has joined #openstack-kolla | 21:30 | |
| *** Guest66940 has joined #openstack-kolla | 21:37 | |
| *** Guest66940 is now known as redrobot | 21:38 | |
| *** lvdombrkr has joined #openstack-kolla | 21:38 | |
| *** wolverineav has quit IRC | 21:45 | |
| *** wolverineav has joined #openstack-kolla | 21:45 | |
| *** lvdombrkr has quit IRC | 21:45 | |
| *** benj_- has quit IRC | 21:48 | |
| *** benj_ has joined #openstack-kolla | 21:48 | |
| *** Sravan has joined #openstack-kolla | 21:55 | |
| *** mchlumsky has quit IRC | 21:59 | |
| *** mjturek has quit IRC | 22:02 | |
| *** Sravan has quit IRC | 22:10 | |
| *** Sravan has joined #openstack-kolla | 22:14 | |
| *** Sravan has quit IRC | 22:18 | |
| *** Sravan has joined #openstack-kolla | 22:21 | |
| *** scottsol has joined #openstack-kolla | 22:24 | |
| *** Sravan has quit IRC | 22:25 | |
| *** Sravan has joined #openstack-kolla | 22:27 | |
| *** Sravan has quit IRC | 22:30 | |
| *** Sravan has joined #openstack-kolla | 22:31 | |
| *** sdake has quit IRC | 22:36 | |
| *** scottsol has quit IRC | 22:37 | |
| *** Sravan has quit IRC | 22:40 | |
| *** Sravan has joined #openstack-kolla | 22:43 | |
| *** Sravan has quit IRC | 22:48 | |
| *** Sravan has joined #openstack-kolla | 22:51 | |
| *** mjturek has joined #openstack-kolla | 22:51 | |
| *** sdake has joined #openstack-kolla | 22:53 | |
| *** Sravan_ has joined #openstack-kolla | 22:54 | |
| *** JamesBenson has quit IRC | 22:55 | |
| *** Sravan has quit IRC | 22:56 | |
| *** chrizl has joined #openstack-kolla | 22:57 | |
| *** sm806 has quit IRC | 23:07 | |
| *** sm806 has joined #openstack-kolla | 23:08 | |
| *** mjturek has quit IRC | 23:09 | |
| *** dave-mccowan has quit IRC | 23:14 | |
| *** dave-mccowan has joined #openstack-kolla | 23:20 | |
| *** itlinux has joined #openstack-kolla | 23:26 | |
| mwhahaha | not sure if anyone has noticed but the source installs are broken in CI, I filed https://bugs.launchpad.net/kolla/+bug/1817970 | 23:27 |
| openstack | Launchpad bug 1817970 in kolla "kolla source installs failing on neutron due to Unhandled error: ImportError: cannot import name agent_resources_synced" [Undecided,New] | 23:27 |
| *** k_mouza has joined #openstack-kolla | 23:27 | |
| mwhahaha | i'm trying to poke at it to see if I can fix, it seems like an old upper-constraints.txt is being used | 23:27 |
| *** chrizl has quit IRC | 23:30 | |
| *** k_mouza has quit IRC | 23:31 | |
| mwhahaha | tl;dr: requirements tarballs are out of date and have broken source installs | 23:36 |
| *** Sravan_ has quit IRC | 23:37 | |
| *** sdake has quit IRC | 23:38 | |
| *** Sravan has joined #openstack-kolla | 23:38 | |
| *** Sravan has quit IRC | 23:38 | |
| *** sdake has joined #openstack-kolla | 23:38 | |
| *** sdake has quit IRC | 23:38 | |
| *** Sravan has joined #openstack-kolla | 23:38 | |
| *** Sravan has quit IRC | 23:41 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!