Friday, 2019-09-13

openstackgerritJames Kirsch proposed openstack/kolla-ansible master: WIP: Refactor service, endpoint and user registration  https://review.opendev.org/58759000:00
*** wuchunyang has quit IRC00:00
*** jcmdln has quit IRC00:03
*** k_mouza has quit IRC00:05
*** henriqueof1 has joined #openstack-kolla00:45
*** henriqueof has quit IRC00:45
*** calbers has quit IRC01:02
*** wuchunyang has joined #openstack-kolla01:19
*** wuchunyang has quit IRC01:51
*** wuchunyang has joined #openstack-kolla01:52
*** wuchunyang has quit IRC01:57
*** hongbin has joined #openstack-kolla02:32
*** hongbin has quit IRC03:34
*** factor has quit IRC03:35
*** wuchunyang has joined #openstack-kolla03:37
*** wuchunyang has quit IRC03:42
*** wuchunyang has joined #openstack-kolla03:48
*** skramaja has joined #openstack-kolla03:57
*** wuchunyang has quit IRC04:00
*** wuchunyang has joined #openstack-kolla04:06
*** wuchunyang has quit IRC04:11
*** wuchunyang has joined #openstack-kolla04:17
*** wuchunyang has quit IRC04:22
*** radeks has quit IRC04:35
*** pcaruana has joined #openstack-kolla05:02
*** wuchunyang has joined #openstack-kolla05:13
*** radeks has joined #openstack-kolla05:17
*** wuchunyang has quit IRC05:18
*** Luzi has joined #openstack-kolla05:23
*** wuchunyang has joined #openstack-kolla05:25
*** wuchunyang has quit IRC05:29
*** wuchunyang has joined #openstack-kolla05:31
hrwmorning05:32
hrwppc64le situation looks just bad05:32
hrwshit. I run out of space05:32
*** wuchunyang has quit IRC05:36
*** cah_link has joined #openstack-kolla05:49
*** rpittau|afk is now known as rpittau06:08
hrwrestarted builds with 'docker image prune -a -f' after each distro06:09
*** henriqueof has joined #openstack-kolla06:27
*** henriqueof1 has quit IRC06:28
*** wuchunyang has joined #openstack-kolla07:06
*** jbadiapa has joined #openstack-kolla07:06
*** Florian has joined #openstack-kolla07:10
*** wuchunyang has quit IRC07:10
*** henriqueof has quit IRC07:12
*** henriqueof has joined #openstack-kolla07:12
mnasiadkahrw: does anybody else build ppc64le images, or just you?:)07:21
hrwmnasiadka: not even me07:22
hrwmnasiadka: it was added as side effect of doing aarch64.07:22
hrwfrom time to time someone appear on irc telling that they use kolla on ppc64le07:22
hrwand I can spend a bit of time on doing build to check how situation looks07:23
hrwUNBUILDABLE_IMAGES var helps07:24
openstackgerritAndreas Jaeger proposed openstack/kolla master: Remove unneeded Zuul branch matcher  https://review.opendev.org/68197507:27
*** gfidente has joined #openstack-kolla07:37
*** priteau has joined #openstack-kolla07:57
*** Tengu has quit IRC07:59
*** ivve has joined #openstack-kolla08:00
*** Tengu has joined #openstack-kolla08:03
*** gfidente has quit IRC08:06
*** k_mouza has joined #openstack-kolla08:24
*** gfidente has joined #openstack-kolla08:25
*** wuchunyang has joined #openstack-kolla08:30
BlinkizHello08:32
mgoddardmorning08:33
*** wuchunyang has quit IRC08:34
BlinkizAm deploying without DNS for internal IP addresses. This means vip.example.com is not resolved correctly into 192.168.38.11 (in my case) from within containers. On baremetal I have modified /etc/hosts file so vip.example.com is known. I do not like that I need to keep high uptime for an internal dns only for vip.example.com address. Any suggestions how to solve this?08:35
BlinkizI would like to see kolla push out the kolla_internal_fqdn everywhere. It is hard coded in globals.yml so why not..08:36
mgoddardBlinkiz: if it is in /etc/hosts when the containers are created, then they should be able to see it08:38
BlinkizMy problems begins at "TASK [mariadb : Waiting for MariaDB service to be ready through VIP]" because vip.example.com is not known. And kolla prechecks to not check if kolla_internal_fqdn is resolved into kolla_internal_vip_address08:38
Blinkizmgoddard, So containers is copying the baremetals /etc/hosts file?08:38
BlinkizMaybe I just need to remove previous created containers and it will pick it up..08:39
mgoddardBlinkiz: yes, try it08:39
*** gfidente has quit IRC08:39
mgoddardBlinkiz: try just running a test container08:40
Blinkizmgoddard, Is "kolla-ansible -i ./multinode destroy" enough?08:40
*** wuchunyang has joined #openstack-kolla08:41
mgoddardBlinkiz: --yes-i-really-really-meant-it08:41
Blinkizmgoddard, Thanks08:41
*** gfidente has joined #openstack-kolla08:43
BlinkizI have a management server standing beside the OpenStack cluster that's running a few services inside LXD (LXC) containers. I would like to install centralized logging into on of these containers.08:50
BlinkizI have install docker (with kolla ansible bootstrap playbook) into a lxd container and it works great. But am having one problem. It fails at one task all the time. "common : Restart kolla-toolbox container". https://paste.ubuntu.com/p/PFqmf36gTS/08:51
BlinkizThis is not about Kolla but I thought I ask if anyone had an idea what the problem can be. Error message is "path /run is mounted on /run but it is not a shared mount"08:52
BlinkizFound some more information from journalctl. Apparently container kolla_toolbox fails to start because of "Error response from daemon: path /run is mounted on /run but it is not a shared mount"09:04
mgoddardBlinkiz: why not just run docker on the host?09:14
Blinkizmgoddard, That is possible yes. Next to LXD. I tried it ones but got error about not finding my defined interface for api_interface. Yeah, it is different on management server. Maybe I should go that route.. Am guessing I can change api_interface on individual hosts.. Hmm09:16
mgoddardyes, you can set host_vars09:16
mgoddardbut anything in globals.yml will override host_vars, so needs care09:17
Blinkizmgoddard, okay.. So where should I set my "*_interface:" options for my special "mgmt.example.com" host?09:18
Blinkizinventory file? :-O09:18
mgoddardyes, or host_vars or group_vars directory next to it09:18
*** Florian has quit IRC09:19
mgoddardbut then you have to put _interface variables for all hosts in there, and not in globals.yml09:19
*** FlorianFa has joined #openstack-kolla09:19
Blinkizmgoddard, okay,. got it. globals.yml override everything in host_vars, group_vars.09:20
Blinkizmgoddard, Thanks for the guidance :)09:20
mgoddardBlinkiz: np09:21
*** ivve has quit IRC09:32
Blinkizmgoddard, I have tried a few times but all hosts fails at "TASK [baremetal : Generate /etc/hosts for all of the nodes". It tries to read "ansible_eth0" interface that do not exist. Am getting the feeling that group_vars/all.yml and host_vars/mgmt.example.com is never used.09:44
BlinkizI have inventory in /etc/kolla/multinode. I have group_vars at /etc/kolla/group_vars. I have host_vars at /etc/kolla/host_vars. I have not defined any of these paths in /etc/ansible/ansible.cfg09:45
*** wuchunyang has quit IRC09:49
openstackgerritMark Goddard proposed x/kayobe master: WIP: Fix kayobe-overcloud-centos CI job flakiness  https://review.opendev.org/68170009:51
mgoddardBlinkiz: I'd try manually debugging with a playbook of your own and ansible-playbook and debug module09:53
Blinkizand now I have found out that host_vars/mgmt.lm100.se.yml is read correctly but not group_vars/all.yml09:53
*** wuchunyang has joined #openstack-kolla09:55
openstackgerritMark Goddard proposed x/kayobe master: WIP: Fix kayobe-overcloud-centos CI job flakiness  https://review.opendev.org/68170009:57
*** wuchunyang has quit IRC10:04
*** ivve has joined #openstack-kolla10:05
*** k_mouza has quit IRC10:09
*** wuchunyang has joined #openstack-kolla10:11
*** pcaruana has quit IRC10:11
*** wuchunyang has quit IRC10:16
*** wuchunyang has joined #openstack-kolla10:22
*** wuchunyang has quit IRC10:26
*** k_mouza has joined #openstack-kolla10:33
*** luksky has joined #openstack-kolla10:36
*** wuchunyang has joined #openstack-kolla10:39
*** jbadiapa has quit IRC11:08
*** luksky has quit IRC11:09
*** k_mouza has quit IRC11:09
*** k_mouza has joined #openstack-kolla11:09
*** kplant has joined #openstack-kolla11:11
*** cah_link has quit IRC11:12
*** pcaruana has joined #openstack-kolla11:24
*** luksky has joined #openstack-kolla11:26
*** watersj has joined #openstack-kolla11:27
*** luksky11 has joined #openstack-kolla11:28
*** luksky has quit IRC11:31
*** calbers has joined #openstack-kolla11:32
*** calbers has quit IRC11:40
*** luksky11 has quit IRC11:40
hrwyoctozepto, mnasiadka: https://review.opendev.org/#/c/681694/ - RP+2 to kill xtrabackup11:47
*** luksky11 has joined #openstack-kolla11:56
*** wuchunyang has quit IRC12:02
*** wuchunyang has joined #openstack-kolla12:07
*** wuchunyang has quit IRC12:11
*** goldyfruit has quit IRC12:12
*** wuchunyang has joined #openstack-kolla12:18
*** cah_link has joined #openstack-kolla12:19
*** luksky11 has quit IRC12:22
*** luksky11 has joined #openstack-kolla12:23
*** wuchunyang has quit IRC12:23
*** dave-mccowan has joined #openstack-kolla12:24
mgoddardhrw: approved it12:27
*** dave-mccowan has quit IRC12:28
*** wuchunyang has joined #openstack-kolla12:29
hrwcool12:30
*** watersj has quit IRC12:33
*** wuchunyang has quit IRC12:37
*** dave-mccowan has joined #openstack-kolla12:43
*** jbadiapa has joined #openstack-kolla12:44
*** henriqueof1 has joined #openstack-kolla12:49
*** henriqueof has quit IRC12:50
*** EmilienM is now known as EvilienM12:55
*** dave-mccowan has quit IRC12:58
hrwfsck. ubuntu broken python3 in repo13:03
hrwINFO:kolla.common.utils.kolla-toolbox: python3-dev : Depends: libpython3-dev (= 3.6.7-1~18.04) but it is not going to be installed13:04
hrwINFO:kolla.common.utils.kolla-toolbox:               Depends: python3.6-dev (>= 3.6.7-1~) but it is not going to be installed13:04
mgoddardyeah I've noticed that in a few places13:05
mgoddardis that what's broken xtrabackup?13:05
hrwno13:05
*** Luzi has quit IRC13:06
*** luksky11 has quit IRC13:06
openstackgerritMark Goddard proposed x/kayobe master: WIP: Fix kayobe-overcloud-centos CI job flakiness  https://review.opendev.org/68170013:07
openstackgerritMark Goddard proposed x/kayobe master: WIP: Fix kayobe-overcloud-centos CI job flakiness  https://review.opendev.org/68170013:09
*** vmixor has joined #openstack-kolla13:10
*** Tengu has quit IRC13:11
*** Tengu has joined #openstack-kolla13:11
hrwmaybe CI mirrors are not up to date13:13
hrwlibexpat1 in ubuntu:bionic looks like it's newer than repo has13:16
hrwno. OVH mirror is outdated13:17
hrwwe will need to recheck13:17
*** vmixor has quit IRC13:21
BlinkizI have a new installation of OpenStack and I think that Horizon webgui loads slowly. Chrome says "Waiting (TTFB)" is between 500ms to 1.5 sec for all pages in Horizon. It feels slow. Is this normal?13:21
*** vmixor has joined #openstack-kolla13:21
*** goldyfruit has joined #openstack-kolla13:28
BlinkizIt is not haproxy. Directly connecting to port 80 on a control node gives same slow feeling.13:46
*** cah_link has quit IRC13:53
*** wuchunyang has joined #openstack-kolla13:57
*** wuchunyang has quit IRC14:01
*** wuchunyang has joined #openstack-kolla14:08
*** wuchunyang has quit IRC14:12
*** goldyfruit has quit IRC14:14
*** JamesBenson has joined #openstack-kolla14:15
*** wuchunyang has joined #openstack-kolla14:19
*** radeks has quit IRC14:21
*** wuchunyang has quit IRC14:24
*** k_mouza has quit IRC14:31
*** k_mouza_ has joined #openstack-kolla14:32
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: ppc64le: add UNBUILDABLE_IMAGES entries  https://review.opendev.org/68206814:34
*** goldyfruit has joined #openstack-kolla14:34
hrwwork in progress as I just added Debian ones14:34
hrwCentOS and Ubuntu have to build first14:34
hrwmgoddard: Ubuntu failures will be fixed soon. Infra needs to restart mirroring14:35
mgoddardhrw: thanks for following up14:36
hrwnext PTG someone from kolla needs to give them a bottle/hug/etc14:36
*** goldyfruit_ has joined #openstack-kolla14:42
*** goldyfruit has quit IRC14:44
*** noxoid has joined #openstack-kolla14:55
*** vmixor has quit IRC15:00
*** vmixor has joined #openstack-kolla15:00
*** k_mouza_ has quit IRC15:17
*** vmixor has quit IRC15:21
*** vmixor has joined #openstack-kolla15:21
*** k_mouza has joined #openstack-kolla15:24
*** igordc has joined #openstack-kolla15:25
*** igordc has quit IRC15:27
*** igordc has joined #openstack-kolla15:27
*** ivve has quit IRC15:29
*** weshay|ruck has quit IRC15:31
*** igordc has quit IRC15:32
*** gfidente is now known as gfidente|afk15:50
openstackgerritJoseph M proposed openstack/kolla-ansible master: [designate] Add coordination backend for designate workers  https://review.opendev.org/68209515:57
*** calbers has joined #openstack-kolla16:02
*** owalsh has quit IRC16:11
*** wuchunyang has joined #openstack-kolla16:21
*** rpittau is now known as rpittau|afk16:22
*** wuchunyang has quit IRC16:26
*** owalsh has joined #openstack-kolla16:29
*** owalsh has quit IRC16:34
*** k_mouza has quit IRC16:42
*** owalsh has joined #openstack-kolla16:54
*** k_mouza has joined #openstack-kolla16:57
*** k_mouza has quit IRC17:01
yoctozeptohrw: yup, infra guys are really nice and helpful to us17:18
yoctozeptoworth a hug17:18
*** luksky11 has joined #openstack-kolla17:25
*** priteau has quit IRC17:28
*** goldyfruit_ has quit IRC17:46
*** goldyfruit_ has joined #openstack-kolla17:49
openstackgerritMark Flynn proposed openstack/kolla-ansible master: Fix prometheus-alertmanager cluster bug  https://review.opendev.org/68213218:21
*** wuchunyang has joined #openstack-kolla18:24
*** wuchunyang has quit IRC18:29
yoctozeptomgoddard, hrw, mnasiadka: shameless plug: https://www.redhat.com/rhtapps/services/certifications/badge/verify/ZPKKI46PNM5OP2N6J3X5PIEDIYAEQU3CUPSQX2KSDXT6RW46LQ34UFHA6EGV4MX6OEQWWNEDUIWXWPUWTPNOZCAXTQD32BJ2PLFPHS3STVWDCMJUD3KGSZYJTPS2YGTCOKOWYMJRGQPNI2LHBGN6LLA2MI======18:40
openstackgerritRadosÅ‚aw Piliszek proposed openstack/kolla-ansible master: WIP: Use VXLAN overlay in CI  https://review.opendev.org/67069018:46
*** kplant has quit IRC18:49
mnasiadkayoctozepto: so now you do all ansible optimization work, good :)18:53
*** signed8bit has joined #openstack-kolla18:55
yoctozeptomnasiadka: or help you do it :-)18:59
*** goldyfruit___ has joined #openstack-kolla18:59
yoctozeptonew cert, time to refresh linkedin profile18:59
yoctozeptonot looking for a job atm but it will probably trigger another wave of job proposals, sigh :/19:00
*** vmixor has quit IRC19:01
*** goldyfruit_ has quit IRC19:02
yoctozeptopoor head hunters :-(19:05
mnasiadkaI have no certs, and get like 10 messages a week...19:07
yoctozeptomnasiadka: I clicked through some popups19:08
yoctozeptonow it's telling me my profile will be visited 27x more19:08
yoctozeptosheeet :D19:08
yoctozeptook, clicked through some options sounding like "I'm not looking for a job now", should help now19:13
*** noxoid has quit IRC19:38
*** noxoid has joined #openstack-kolla19:38
*** mflynn has joined #openstack-kolla19:52
*** mflynn has quit IRC19:53
*** igordc has joined #openstack-kolla20:10
*** gfidente|afk has quit IRC20:11
*** hjensas has quit IRC20:24
*** hjensas has joined #openstack-kolla20:28
*** vmixor has joined #openstack-kolla20:39
*** jovial[m] has quit IRC20:41
*** dannins has quit IRC20:44
*** openstackgerrit has quit IRC20:51
*** henriqueof1 has quit IRC20:54
*** pcaruana has quit IRC21:03
*** vmixor has quit IRC21:10
*** luksky11 has quit IRC21:14
*** KeithMnemonic has quit IRC21:19
*** iniazi has quit IRC21:27
*** jbadiapa has quit IRC21:37
*** JamesBenson has quit IRC21:46
*** iniazi has joined #openstack-kolla21:48
*** EvilienM is now known as EmilienM21:52
*** iniazi_ has joined #openstack-kolla21:59
*** iniazi has quit IRC22:00
*** noxoid has quit IRC22:01
*** noxoid has joined #openstack-kolla22:01
*** k_mouza has joined #openstack-kolla22:30
*** goldyfruit___ has quit IRC22:49
*** openstackgerrit has joined #openstack-kolla22:52
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: WIP: Refactor service, endpoint and user registration  https://review.opendev.org/58759022:52
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Add support for self-signed SSL certificates  https://review.opendev.org/66451723:09
*** wuchunyang has joined #openstack-kolla23:14
*** wuchunyang has quit IRC23:19
*** JamesBenson has joined #openstack-kolla23:23
*** JamesBenson has quit IRC23:27
*** k_mouza has quit IRC23:39

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!