Friday, 2020-05-15

*** gfidente|afk has quit IRC00:15
*** JamesBenson has joined #openstack-kolla00:34
*** rouk has quit IRC00:37
*** Manheim has quit IRC01:02
*** wuchunyang has joined #openstack-kolla01:03
*** xinliang has joined #openstack-kolla01:44
*** xinliang has quit IRC01:49
*** Manheim has joined #openstack-kolla02:03
*** Manheim has quit IRC02:08
*** icarusfactor has joined #openstack-kolla02:25
*** factor has quit IRC02:26
*** schwicht has quit IRC02:33
*** schwicht has joined #openstack-kolla02:51
*** icarusfactor has quit IRC02:51
*** icarusfactor has joined #openstack-kolla02:52
*** jcmdln has quit IRC03:23
*** kevinz has quit IRC03:37
*** factor has joined #openstack-kolla03:45
*** kevinz has joined #openstack-kolla03:46
*** icarusfactor has quit IRC03:47
*** skramaja has joined #openstack-kolla03:49
*** factor has quit IRC03:51
*** factor has joined #openstack-kolla03:52
*** ykarel|away is now known as ykarel03:54
*** wuchunyang has quit IRC04:02
*** wuchunyang has joined #openstack-kolla04:07
*** wuchunyang has quit IRC04:12
*** zzzeek has quit IRC04:23
*** zzzeek has joined #openstack-kolla04:24
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-kolla04:33
*** wuchunyang has joined #openstack-kolla04:38
*** wuchunyang has quit IRC04:49
*** vishalmanchanda has joined #openstack-kolla04:55
*** cah_link has joined #openstack-kolla05:07
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: DNM: enable TLS for all jobs  https://review.opendev.org/71862805:11
*** cah_link has quit IRC06:03
yoctozeptomorning06:07
oklhostHi guys, short question. The prometheus node exporter (train) does not work unless we copy our internal ca root certs into the running container. Do we need to build our own images to fix this, or is there some magic we miss?06:31
openstackgerritMichal Nasiadka proposed openstack/kolla master: octavia: Add ovn-octavia-driver  https://review.opendev.org/71729606:32
openstackgerritMichal Nasiadka proposed openstack/kolla master: octavia: Add ovn-octavia-driver  https://review.opendev.org/71729606:35
yoctozeptooklhost: this is being solved universally in the ussuri cycle, not sure about this particular one06:41
yoctozeptobut the machinery is being enhanced06:41
oklhostOkay great! :-) Thanks a lot!06:42
*** cah_link has joined #openstack-kolla06:47
*** ykarel is now known as ykarel|afk06:49
*** cah_link1 has joined #openstack-kolla06:52
*** cah_link has quit IRC06:54
*** cah_link1 is now known as cah_link06:54
hrwmornign06:55
*** nathharp_ has quit IRC07:04
*** lvdombrkr has joined #openstack-kolla07:04
*** nathharp has joined #openstack-kolla07:04
mnasiadkamorning07:08
*** rpittau|afk is now known as rpittau07:12
*** bengates has joined #openstack-kolla07:25
*** born2bake has joined #openstack-kolla07:27
*** wuchunyang has joined #openstack-kolla07:42
*** ykarel|afk is now known as ykarel07:57
*** e0ne has joined #openstack-kolla07:57
*** e0ne has quit IRC08:00
*** wuchunyang has quit IRC08:00
*** wuchunyang has joined #openstack-kolla08:00
*** gfidente has joined #openstack-kolla08:03
mgoddardmorning08:08
mgoddardBusy this morning08:08
oklhostmorning ;)08:08
lvdombrkrHello all. guys i disabled haproxy and set kolla_external_vip_address: "controller IP". but after deployment public ip is not accesable on this IP. i get : connection refused08:11
lvdombrkrin short : im deploying 1 controller deployment, so i disabled haproxy. but i need internal and public api working08:11
lvdombrkris there possibility to disable haproxy and get working api on controller public ip?08:12
oklhostlvdombrkr: I had similar issues relating to our physical network, in our world it helps to restart keepalived container until the VIP spawns on the right node. In our environment this is related to ARP on our switches, afaik. To clarify, in our environment this has nothing todo with haproxy etc.08:13
mgoddardlvdombrkr: if you want different IPs for public and internal you need haproxy08:13
*** bersace has quit IRC08:15
lvdombrkroklhost: i disabled haproxy, so keepalived is also disabled at the moment. in your case you disabled haproxy but enabled keepalived?08:15
*** Manheim has joined #openstack-kolla08:16
*** bersace has joined #openstack-kolla08:16
lvdombrkrmgoddard: and if i will enable haproxy it means i need +2 unused IP for both VIPs?08:17
mgoddardlvdombrkr: yes08:18
oklhostlvdombrkr: Nope, we need both, but our switches don't like the change of the mac address to another IP or so. I do not know much about network hardware. ;-) But I think I misunderstood your issue, sorry.08:20
lvdombrkrmgoddard: if i use 1node controller setup is there no way how to avoid using +2 Ips for VIPs? because in 1 controller setup is waste of Ips08:24
*** k_mouza has joined #openstack-kolla08:25
lvdombrkroklhost: yes we have two different issues..anyway thanks )08:26
oklhostlvdombrkr: Yeah, got it ;) welcome08:27
*** ykarel is now known as ykarel|lunch08:27
*** wuchunyang has quit IRC08:28
lvdombrkrmgoddard: so actually my question is how to with disabled haproxy (1controller setup) i can reach opensack endpoints by public and internal api same time08:31
lvdombrkris there possible such cofiguration?08:31
mgoddardlvdombrkr: you need to use the same IP for internal & external08:31
*** e0ne has joined #openstack-kolla08:37
*** wuchunyang has joined #openstack-kolla08:46
lvdombrkrmgoddard: if mmngm network is on internal network, can i use public IP for both api internal/external?08:51
mgoddardlvdombrkr: as mentioned earlier, I'm busy this morning so can't really answer questions08:51
lvdombrkrmgoddard: i miss this message, sorry08:52
mgoddardno problem08:52
wuchunyanglvdombrkr   hi, if you disable haproxy,you need set kolla_internal_vip_address08:58
lvdombrkrwuchunyang: hi. yes but kolla_internal_vip_address should be from same IP range as mngm network. i have mngm network with internal IPs. I need Public accessable api09:01
lvdombrkrwhats why i want to set kolla_internal_vip_address to internal IP, and external VIP to public IP09:01
lvdombrkrbut without haproxy enabled because its waste of +2 Ips09:02
wuchunyangyou can set kolla_internal_vip_address to your control ip, and disable haproxy09:02
lvdombrkrim not able for one controller use 4 different IPs09:02
lvdombrkrwuchunyang: you mean set public IP to  kolla_internal_vip_address?09:03
*** ykarel|lunch is now known as ykarel09:07
*** wuchunyang has quit IRC09:07
*** dougsz has joined #openstack-kolla09:08
*** stingrayza has quit IRC09:08
*** stingrayza has joined #openstack-kolla09:12
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Fix registration of Monasca Grafana datasource  https://review.opendev.org/72839309:17
mnasiadkamgoddard: I think we have some missing fluentd stuff regarding glance tls proxy - https://zuul.opendev.org/t/openstack/build/355b9f4634ee4df1afd92226b90bfd71/log/primary/logs/docker_logs/fluentd.txt#85209:22
mgoddardmnasiadka: yeah, doesn't look too happy09:25
mgoddardgood catch09:25
mnasiadkamgoddard: and the libvirt xml output doesn't look good, wonder from where it's coming from :)09:29
mgoddardmnasiadka: I think nova dumps some09:32
*** wuchunyang has joined #openstack-kolla09:40
born2bakeHi, I am wondering if this one https://github.com/openstack/kuryr-kubernetes can be used in conjunction with k-a and how is it different to https://docs.openstack.org/kolla-ansible/latest/reference/containers/kuryr-guide.html ?09:58
*** rpittau is now known as rpittau|bbl10:09
Manheimhello10:20
Manheimkolla-ansible reconfigure only looks in '/etc/kolla/config/' or for example if I edit /etc/kolla/nova/nova.conf on the node, it will work as well?10:21
Manheimmeaning copying the nova.conf remotely and restart the containers10:21
wuchunyangyou can put nova.conf to /etc/kolla/config/ , or create /etc/kolla/config/nova-{servicename}.conf or /etc/kolla/config/nova-{servicename}/nova.conf10:26
*** wuchunyang has quit IRC10:26
*** happyhemant has joined #openstack-kolla10:28
mgoddardManheim: you can update the file on the remote node and restart when debugging, but kolla will overwrite it on the next deploy/reconfigure/upgrade10:28
Manheimok10:30
Manheimso it's the first case, reconfigure only looks in '/etc/kolla/config'10:30
mgoddardright10:30
Manheimperfect thanks10:30
Manheimit's nice coming back and working again with Kolla :D10:31
mgoddardgood to have you back Manheim :)10:31
Manheimthanks10:31
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Custom haproxy script for monitoring galera  https://review.opendev.org/71021310:36
ManheimI have a question regarding clustering rabbitmq, I've deployed rocky on 3 nodes10:37
Manheimi've run into https://bugs.launchpad.net/kolla-ansible/+bug/173114210:37
openstackLaunchpad bug 1731142 in kolla-ansible queens "The extended control node is rabbitmq error reporting" [Low,Confirmed]10:37
Manheimwhat I did to fix it was to put version 2 on nodes 2 and 310:38
Manheimmy question is regarding the clustering mechanism here, looking on the internet I found nothing regarding rabbitmq-clusterer.config or version here10:38
Manheimor, how can I translate that with what I can see with rabbitmqctl cluster_status for example10:38
Manheimwith what is in rabbitmq-clusterer.config10:39
mgoddardManheim: there is a patch for that issue, are you using the stable/rocky branch of kolla-ansible?11:00
mgoddardpatch linked on the bug report11:00
Manheimmgoddard yes, I have stable rocky. yep, I have Merge "rabbitmq: update cluster version on reconfigure" into stable/rocky in my git lo11:04
Manheimgit log*11:04
*** cah_link has quit IRC11:10
*** cah_link has joined #openstack-kolla11:11
*** dougsz has quit IRC11:30
*** threestrands has quit IRC11:46
born2bakeHi, I am wondering if this one https://github.com/openstack/kuryr-kubernetes can be used in conjunction with k-a and how is it different to https://docs.openstack.org/kolla-ansible/latest/reference/containers/kuryr-guide.html ?11:51
*** seco has joined #openstack-kolla11:55
mgoddardhi born2bake, I haven't tried kuryr. I would try asking the kuryr folks about the differences, but I would guess it is a k8s plugin for kuryr12:02
*** rpittau|bbl is now known as rpittau12:06
*** wuchunyang has joined #openstack-kolla12:17
*** jonaspaulo has joined #openstack-kolla12:20
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Custom haproxy script for monitoring galera  https://review.opendev.org/71021312:28
yoctozeptoborn2bake: afair we do kuryr-libnetwork, just for zun12:55
*** ykarel is now known as ykarel|afk12:56
yoctozeptomnasiadka: add to tls whiteboard (that glance issue)12:56
mnasiadkageez, how many whiteboards do we have?12:58
mnasiadkaand I think we need to fix the topic - there is no Kolla SIG? :)12:59
yoctozeptoyeah, we can move it to klub now12:59
yoctozeptoand only give reference to ti12:59
yoctozeptofrom "sig"12:59
mnasiadkayup13:00
mnasiadkayoctozepto: https://review.opendev.org/#/c/694779/ is waiting for you :)13:01
patchbotpatch 694779 - kolla-ansible - CI: Add ansible-lint to tox - 45 patch sets13:01
mnasiadkaor actually the blacklist change has merged, so I can rework this.13:05
*** wuchunyang has quit IRC13:06
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox  https://review.opendev.org/69477913:07
born2bakeis ussuri coming in Jun?13:07
yoctozeptoborn2bake: we hope so13:08
born2bake:)13:08
yoctozeptoborn2bake: and work on it :D13:08
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox  https://review.opendev.org/69477913:13
*** zbr has left #openstack-kolla13:13
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Custom haproxy script for monitoring galera  https://review.opendev.org/71021313:28
mgoddardWho wants RabbitMQ TLS?13:32
openstackgerritMerged openstack/kayobe stable/train: Constraint python-openstackclient install with requirements.txt  https://review.opendev.org/72685713:35
*** jonaspaulo has quit IRC13:37
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Support TLS encryption of RabbitMQ client-server traffic  https://review.opendev.org/72844813:38
*** e0ne has quit IRC13:40
*** e0ne has joined #openstack-kolla13:44
*** kevinz has quit IRC13:50
openstackgerritMark Goddard proposed openstack/kayobe master: Copy custom certificates  https://review.opendev.org/72845313:52
*** Manheim has quit IRC13:55
*** Manheim has joined #openstack-kolla13:55
*** Manheim has quit IRC14:00
*** icarusfactor has joined #openstack-kolla14:02
*** factor has quit IRC14:05
*** ykarel|afk is now known as ykarel14:10
*** kevinz has joined #openstack-kolla14:28
yoctozeptomgoddard: gj, I did not see that on the whiteboard though14:37
yoctozeptomgoddard: so are we lacking mariadb and memcached then?14:38
mgoddardyoctozepto: it's not on the whiteboard. Customer wanted it. Not going to push for Ussuri, but if people want it then we can14:38
mgoddardyoctozepto: galera traffic yes14:39
mgoddardand memcached14:39
mgoddardno doubt other things too - etcd, redis etc14:40
*** munimeha1 has joined #openstack-kolla14:46
*** bersace has quit IRC14:47
*** bersace has joined #openstack-kolla14:49
*** seco has quit IRC14:59
*** sorin-mihai has joined #openstack-kolla15:01
*** seco has joined #openstack-kolla15:05
sorin-mihaii'm trying to create a 1st zone in designate, but 'zone' is not recognised as an openstack command, even though it is mentioned in the reference docs. am i missing something?15:06
mgoddardsorin-mihai: pip install python-designateclient?15:06
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Configure RabbitMQ user tags in nova-cell role  https://review.opendev.org/72432515:08
sorin-mihairight, makes sense. are there other 'clients' not mentioned in the docs or ones that i might've missed? i had the impression that python-openstackclient would do everything15:08
*** seco has quit IRC15:09
hrwsorin-mihai: it is a goal to have everything in openstackclient.15:12
hrwthe goal which kind of failed15:12
mgoddardsorin-mihai: openstackclient mostly has the core projects. Other projects are implemented via plugins, but still accessed via 'openstack'15:13
sorin-mihaiyeah, that's ok, i got the idea, but is there some list of which other 'clients' are not yet there? would just prefer to add them at once15:13
mgoddardthere may be, I'm not aware of it15:15
sorin-mihaithat being said, i guess i can poke around pip packages when i need something and find out, won't be that hard15:16
mgoddardsorin-mihai: if you check the Dockerfile for the openstack-base image, we install a bunch of clients in there15:16
sorin-mihaiok, will check that, thanks15:16
*** ykarel is now known as ykarel|away15:16
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: dpdk-vswitchd: some ovs tools require ovs daemons pidfiles  https://review.opendev.org/72846715:16
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: dpdk-vswitchd: some ovs tools require ovs daemons pidfiles  https://review.opendev.org/72846815:17
sorin-mihaibut going back to 'zone create, following the reference doc, with 'openstack zone create' i now get a 'Could not find Pool' error. and i did notice that trying to add a zone in horizon also fails. this looks like a incomplete designate deployment?15:18
mgoddardsorin-mihai: probably, there are bugs on it15:19
mgoddardsorin-mihai: https://bugs.launchpad.net/kolla-ansible/+bug/185587715:19
openstackLaunchpad bug 1855877 in kolla-ansible "Kolla-ansible can't create default server pool for Designate " [Medium,Triaged]15:19
mgoddardsorin-mihai: maybe you will be the person to fix it so we stop hearing about it? :)15:19
sorin-mihailol15:20
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Fix deprecation warnings in fluentd  https://review.opendev.org/72847015:21
*** bersace has quit IRC15:23
sorin-mihaii'm planning to ingrate freeipa in this deployment, any known bugs i should consider before even trying? i want to run freeipa in instance(s) inside the same deployment15:23
mgoddardsorin-mihai: wasn't a joke! someone needs to fix it15:25
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Custom haproxy script for monitoring galera  https://review.opendev.org/71021315:25
sorin-mihaimgoddard, i'll see if i can get up to the expectations :)15:26
mgoddardsorin-mihai: great15:26
openstackgerritMichal Nasiadka proposed openstack/kolla master: octavia: Add ovn-octavia-driver  https://review.opendev.org/71729615:27
*** skramaja has quit IRC15:34
openstackgerritWill Szumski proposed openstack/kayobe master: Add support for encrypted block devices  https://review.opendev.org/72004015:35
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Support TLS encryption of RabbitMQ client-server traffic  https://review.opendev.org/72844815:40
*** bersace has joined #openstack-kolla15:48
*** lvdombrkr has quit IRC15:54
*** bersace has quit IRC15:58
openstackgerritWill Szumski proposed openstack/kolla-ansible master: Improve fernet_token_expiry precheck  https://review.opendev.org/69844116:03
*** k_mouza has quit IRC16:05
*** bengates_ has joined #openstack-kolla16:06
*** k_mouza has joined #openstack-kolla16:06
*** bengates has quit IRC16:09
*** bengates_ has quit IRC16:10
born2bakemgoddard Hi, I am trying to deploy "A Universe from Nothing" on vm... Its failing at "Deploy a seed VM." stage not due to missing bifrost image but cause of http://paste.openstack.org/show/793684/16:26
*** kberger_ has joined #openstack-kolla16:31
*** KeithMnemonic has quit IRC16:31
*** kberger_ has quit IRC16:32
*** kberger_ has joined #openstack-kolla16:32
*** evrardjp has quit IRC16:33
*** evrardjp has joined #openstack-kolla16:33
*** lvdombrkr has joined #openstack-kolla16:34
*** k_mouza has quit IRC16:39
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Support TLS encryption of RabbitMQ client-server traffic  https://review.opendev.org/72844816:49
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Improve fernet_token_expiry precheck  https://review.opendev.org/69844116:50
*** mloza has joined #openstack-kolla16:51
mgoddardborn2bake: hi. Not much to go on from that. Could you try export KAYOBE_EXTRA_ARGS='-vvv'16:52
mgoddardand run again16:52
born2bakeok will do16:52
*** lvdombrkr has quit IRC16:55
born2bakemgoddard http://paste.openstack.org/show/793687/16:56
*** k_mouza has joined #openstack-kolla16:58
openstackgerritMerged openstack/kolla-cli master: Remove translation sections from setup.cfg  https://review.opendev.org/72814916:59
*** nathharp_ has joined #openstack-kolla17:05
*** nathharp has quit IRC17:08
*** rpittau is now known as rpittau|afk17:11
*** also_stingrayza has joined #openstack-kolla17:12
openstackgerritjacky06 proposed openstack/kolla-cli master: Cleanup py27 support  https://review.opendev.org/72075417:13
*** stingrayza has quit IRC17:14
*** k_mouza has quit IRC17:15
born2bakeIt seems like this guy had the same issue https://github.com/stackhpc/a-universe-from-nothing/issues/25 here...I ve checked firewalld is disabled :)17:22
openstackgerritjacky06 proposed openstack/kolla-cli master: Remove six  https://review.opendev.org/72516417:22
*** gfidente is now known as gfidente|afk17:26
*** seco has joined #openstack-kolla17:27
*** ysirndjuro has quit IRC17:28
*** seco has quit IRC17:32
openstackgerritDincer Celik proposed openstack/kolla-ansible master: [docker] Added a new flag to disable default network  https://review.opendev.org/68987017:38
openstackgerritDincer Celik proposed openstack/kolla-ansible master: [docker] Added a new flag to disable default iptables rules  https://review.opendev.org/69205217:39
mgoddardborn2bake: the original issue that looked like yours was caused by a non-english locale18:04
born2bakeyeah, I created-closed a ticket how to overcome this issue18:05
mgoddardthanks :)18:14
*** icarusfactor has quit IRC18:47
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: DNM: enable TLS for all jobs  https://review.opendev.org/71862819:01
*** JamesBenson has quit IRC19:18
*** seco has joined #openstack-kolla19:22
*** seco has quit IRC19:27
*** schwicht has quit IRC19:30
*** schwicht has joined #openstack-kolla19:34
*** schwicht has quit IRC19:36
*** schwicht has joined #openstack-kolla19:37
*** k_mouza has joined #openstack-kolla19:43
*** kberger_ has quit IRC19:48
*** k_mouza has quit IRC19:48
*** KeithMnemonic has joined #openstack-kolla19:48
*** cah_link has quit IRC19:57
*** schwicht has quit IRC20:01
*** sorin-mihai_ has joined #openstack-kolla20:04
*** schwicht has joined #openstack-kolla20:06
*** sorin-mihai has quit IRC20:06
*** sorin-mihai__ has joined #openstack-kolla20:26
*** jcmdln has joined #openstack-kolla20:27
*** sorin-mihai_ has quit IRC20:29
*** jcmdln has quit IRC20:31
*** gfidente|afk has quit IRC20:34
*** dciabrin has quit IRC20:36
*** e0ne has quit IRC20:42
*** jcmdln has joined #openstack-kolla20:42
*** seco has joined #openstack-kolla20:52
*** seco has quit IRC20:56
*** munimeha1 has quit IRC21:06
*** eliaswimmer has quit IRC21:39
*** KeithMnemonic has quit IRC21:47
*** JamesBenson has joined #openstack-kolla21:49
*** born2bake has quit IRC22:06
*** Manheim has joined #openstack-kolla22:26
*** Manheim has quit IRC22:57
*** Manheim has joined #openstack-kolla22:58
*** Manheim has quit IRC23:02
*** JamesBenson has quit IRC23:23

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!