| *** maharg101 has joined #openstack-kolla | 00:26 | |
| *** maharg101 has quit IRC | 00:31 | |
| *** LinPeiWen has joined #openstack-kolla | 00:32 | |
| *** rm_work has joined #openstack-kolla | 00:34 | |
| *** rm_work has quit IRC | 00:34 | |
| *** damiandabrowski has quit IRC | 01:23 | |
| *** yankcrime has quit IRC | 01:23 | |
| *** Wasaac has quit IRC | 01:54 | |
| *** Wasaac has joined #openstack-kolla | 01:58 | |
| *** zzzeek has quit IRC | 02:07 | |
| *** zzzeek has joined #openstack-kolla | 02:10 | |
| *** vkmc has quit IRC | 02:14 | |
| *** dking has quit IRC | 02:14 | |
| *** rockey has quit IRC | 02:14 | |
| *** vkmc has joined #openstack-kolla | 02:15 | |
| *** dking has joined #openstack-kolla | 02:20 | |
| *** rockey has joined #openstack-kolla | 02:20 | |
| *** maharg101 has joined #openstack-kolla | 02:27 | |
| *** brinzhang_ has joined #openstack-kolla | 02:30 | |
| *** maharg101 has quit IRC | 02:32 | |
| *** brinzhang0 has quit IRC | 02:34 | |
| *** rm_work has joined #openstack-kolla | 02:34 | |
| *** rm_work has quit IRC | 02:34 | |
| *** brinzhang_ has quit IRC | 02:35 | |
| *** brinzhang has joined #openstack-kolla | 02:36 | |
| *** skramaja has joined #openstack-kolla | 03:31 | |
| *** rm_work has joined #openstack-kolla | 03:40 | |
| openstackgerrit | wu.chunyang proposed openstack/kolla-ansible master: octavia: generate certificates automatically https://review.opendev.org/754280 | 04:04 |
|---|---|---|
| *** evrardjp has quit IRC | 04:33 | |
| *** evrardjp has joined #openstack-kolla | 04:33 | |
| *** hongbin has quit IRC | 05:07 | |
| *** brinzhang_ has joined #openstack-kolla | 05:07 | |
| *** brinzhang_ has quit IRC | 05:07 | |
| *** brinzhang_ has joined #openstack-kolla | 05:08 | |
| oklhost | morning all | 05:08 |
| *** brinzhang has quit IRC | 05:10 | |
| mnasiadka | r3ap3r: well, seems it's not | 05:17 |
| *** abdysn has joined #openstack-kolla | 05:22 | |
| LinPeiWen | mnasiadka: I want to perform CI tasks locally, where should I start | 05:38 |
| *** cah_link has joined #openstack-kolla | 05:39 | |
| openstackgerrit | wu.chunyang proposed openstack/kolla-ansible master: [CI] use command to generate certificates https://review.opendev.org/755182 | 05:47 |
| *** shyamb has joined #openstack-kolla | 05:49 | |
| mnasiadka | LinPeiWen: just look into this change https://review.opendev.org/#/c/652030/ - this is mgoddard's change to add Magnum CI job | 05:50 |
| patchbot | patch 652030 - kolla-ansible - CI: add magnum scenario, also covering octavia (MERGED) - 9 patch sets | 05:50 |
| hrw | morning | 05:57 |
| *** brinzhang has joined #openstack-kolla | 05:59 | |
| LinPeiWen | morning | 06:00 |
| *** brinzhang_ has quit IRC | 06:00 | |
| LinPeiWen | mnasiadka: Do I just need to execute 'tox' ? | 06:01 |
| mnasiadka | LinPeiWen: no, we are not using tox - I'm afraid there is no good method of running all of it locally, a lot depends on zuul variables - most of the ''logic'' is in run.yml | 06:02 |
| LinPeiWen | mnasiadka: Doesn't seem to be a simple thing | 06:12 |
| yoctozepto | yeah, it's a bit convoluted | 06:13 |
| yoctozepto | I guess it might be a valid point for ptg | 06:13 |
| yoctozepto | it would sometimes be helpful to get the jobs run locally to avoid the long review cycle | 06:14 |
| *** brinzhang_ has joined #openstack-kolla | 06:14 | |
| *** brinzhang has quit IRC | 06:14 | |
| *** maharg101 has joined #openstack-kolla | 06:29 | |
| *** maharg101 has quit IRC | 06:34 | |
| *** shyamb has quit IRC | 06:36 | |
| *** brinzhang_ has quit IRC | 06:50 | |
| *** maharg101 has joined #openstack-kolla | 06:57 | |
| *** shyam89 has joined #openstack-kolla | 07:00 | |
| *** brinzhang has joined #openstack-kolla | 07:11 | |
| *** bengates has joined #openstack-kolla | 07:13 | |
| *** shyamb has joined #openstack-kolla | 07:28 | |
| *** shyam89 has quit IRC | 07:31 | |
| *** shyamb has quit IRC | 07:33 | |
| mnasiadka | hrw, mgoddard, yoctozepto: Can you try to review those two changes - https://review.opendev.org/#/q/topic:bp/container-health-check | 07:48 |
| mnasiadka | well, mgoddard already did one, so he has only one to go :) | 07:48 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: DNM: Debug ironic drivers https://review.opendev.org/755000 | 07:52 |
| *** stingrayza has joined #openstack-kolla | 07:53 | |
| yoctozepto | mnasiadka: busy atm | 07:54 |
| mnasiadka | yoctozepto: well, I guess if it doesn't land this week - then we're postponing the feature ;) | 07:55 |
| *** also_stingrayza has quit IRC | 07:56 | |
| yoctozepto | mnasiadka: if it has one mgoddard's +2, then it is on a good path to merging :-) | 07:56 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: convert STATUS_* consts into Enum https://review.opendev.org/754355 | 08:02 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: tox: add Python 3.9 https://review.opendev.org/755222 | 08:04 |
| *** brinzhang_ has joined #openstack-kolla | 08:07 | |
| hrw | meh. ''.format() | 08:07 |
| hrw | we have python 3.6: f'' | 08:08 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: WIP: Disable overcloud networks for Ironic when unused https://review.opendev.org/755015 | 08:09 |
| *** brinzhang has quit IRC | 08:11 | |
| *** kevko__ has joined #openstack-kolla | 08:23 | |
| *** wuchunyang has joined #openstack-kolla | 08:26 | |
| *** k_mouza has joined #openstack-kolla | 08:28 | |
| *** shyamb has joined #openstack-kolla | 08:32 | |
| *** jbadiapa has joined #openstack-kolla | 08:37 | |
| oklhost | am I right, there is no way to copy vendor_data.json to nova-api? | 08:45 |
| *** gfidente has joined #openstack-kolla | 08:51 | |
| *** abdysn has quit IRC | 08:59 | |
| *** shyamb has quit IRC | 09:00 | |
| *** shyamb has joined #openstack-kolla | 09:00 | |
| *** Tony31 has joined #openstack-kolla | 09:06 | |
| *** Fl1nt has joined #openstack-kolla | 09:08 | |
| Fl1nt | Hi everyone! | 09:08 |
| Tony31 | Hi guys, have any of you successfully deployed octavia? I'm trying to follow the guide in kolla docs and after following the guide the octavia deployment fails. Not much useful info for me in the logs, so I wanted to ask some questions as I may have a miunderstanding causing the block | 09:08 |
| Tony31 | hi flint | 09:08 |
| Fl1nt | yes I have why? | 09:08 |
| Tony31 | are you using kayobe? | 09:08 |
| Fl1nt | nope, kolla, but still the same. | 09:08 |
| Tony31 | what happens for me during deployment, octavia logs pause and then show errors. So I check nova logs and they say check neutron logs for more info but there's not much info in neutron logs | 09:09 |
| Fl1nt | mgoddard, Quick question, do we have any plan for the near futur about the topics raised by the diversity working group? | 09:09 |
| Tony31 | what management network type did you use for yours? | 09:10 |
| Fl1nt | Tony31, do you have your Octavia logs pasted somewhere like: paste.openstack.org ? | 09:10 |
| Tony31 | I'm unable to add a VLAN to the controllers. Does it have to be a layer 2 network? I've tried to use the external brext network but same issue. | 09:10 |
| mgoddard | Fl1nt: not yet. I guess we'll see what they come up with | 09:10 |
| Tony31 | @fl1nt - I'll paste them now | 09:10 |
| Tony31 | octavia log: http://paste.openstack.org/show/798562/ | 09:11 |
| Tony31 | the gap is where the logs pause | 09:11 |
| Fl1nt | mgoddard, I discussed a bit with them yesterday, it seems their approach isn't to propose anything except for a list of conflicting words that project should/(have to?) change but they know there are many technical issues of doing so. | 09:12 |
| Tony31 | nova log: http://paste.openstack.org/show/798563/ | 09:12 |
| Fl1nt | Tony31, your log is explicitly telling you about why you can't boot any amphora. | 09:12 |
| Tony31 | @Fl1nt - in octavia log? I must have missed it. Would you be able to help me some more by being a bit more specific? Sorry about that and thank you for your help | 09:13 |
| Fl1nt | seems like you've got an issue with the management network. | 09:13 |
| Tony31 | I assumed so because of the "see neutron log for more info" | 09:14 |
| Fl1nt | Do you have elasticsearch and fluentd installed on your infrastructure? | 09:14 |
| Tony31 | no i dont think so | 09:14 |
| wuchunyang | Tony31 must a l2 network, and can access the octavia_interface. | 09:15 |
| Fl1nt | ok, no pbs, would have been easier to catch the issue here. | 09:15 |
| Fl1nt | wuchunyang, your network can be a full L3, it's not necessary to use a L2. | 09:15 |
| wuchunyang | now it's your neutron have a problem. | 09:16 |
| wuchunyang | no.. L3 can not work for octavia.. | 09:16 |
| Tony31 | thank you @Fl1nt and @wuchunyang | 09:16 |
| Fl1nt | wuchunyang, well, I bet you should come tell that to our Octavia setup which is using a L3 network so :D | 09:16 |
| Tony31 | So can I ask you this - do I need to have a real external network interface on the controllers in this case for octavia to get this to work? | 09:17 |
| Fl1nt | hold on | 09:17 |
| Fl1nt | don't mix up things | 09:17 |
| Tony31 | too late I think mate :) | 09:17 |
| Tony31 | happy to back-track | 09:17 |
| *** kevko__ has quit IRC | 09:17 | |
| Fl1nt | external network is for network reachability, management network is used by the amphora to let the control plan operate them. | 09:17 |
| Fl1nt | so | 09:17 |
| *** kevko has joined #openstack-kolla | 09:18 | |
| wuchunyang | we have a patchset that can configure octavia , but not merged yet. | 09:18 |
| Fl1nt | you compute instances do use external network to let say reach the internet or networks external to the platform. | 09:18 |
| Fl1nt | wuchunyang, We even managed to get Octavia working over calico over there ^^ | 09:18 |
| Tony31 | Sorry i meant external network like brext | 09:18 |
| Tony31 | external network for floating ips | 09:19 |
| *** jonaspaulo has joined #openstack-kolla | 09:19 | |
| Fl1nt | oh ok, I see your setup now. | 09:19 |
| Fl1nt | so yes | 09:19 |
| Tony31 | there's a network I can use to SSH to the nodes and the nodes use this network for yum updates also | 09:19 |
| Tony31 | there's a separate API network | 09:19 |
| Fl1nt | you need a real external network | 09:19 |
| Tony31 | ah man | 09:20 |
| Tony31 | ou mean I have to redeploy the nodes with new networks? | 09:20 |
| Fl1nt | BTW, notice that the documentation isn't really explicit about that, but your external network interface have to be a dedicated interface (nic/vf/team/bond) but can't be shared and can't be a macvlan. | 09:20 |
| Tony31 | network* | 09:20 |
| wuchunyang | from your nova log http://paste.openstack.org/show/798563/ line 32 ,, you should check your neutron now. | 09:20 |
| Tony31 | ok understood, thank you | 09:21 |
| Fl1nt | Tony31, well, I'm sorry but probably ^^ | 09:21 |
| Tony31 | So basically a network where the controller can reach the compute nodes, and octavia is placed onto this network from the compute node and communicates back to the controller ? | 09:22 |
| Tony31 | only thing in neutron log is a warning: "No controller found for: lbaas - returning response code 404: PecanNotFound" | 09:25 |
| Tony31 | all others are info with 200 code | 09:25 |
| openstackgerrit | Benjamin FÜHRMANN proposed openstack/kolla-ansible master: Fix stop containers task in Swift rolling restart https://review.opendev.org/755242 | 09:26 |
| Tony31 | I'll try and do this tomorrow | 09:27 |
| Tony31 | one last thing, I am using kayobe - is it enough just to follow the kolla doc for octavia? Are any of you aware of any caveats that I should be aware of? | 09:27 |
| *** LinPeiWen has quit IRC | 09:31 | |
| Fl1nt | Tony31, you need your amphora (vm) to be able to communicate with both, your controllers and your networks (external/overlays). | 09:31 |
| Fl1nt | Can't say about the doc sorry, it's a little bit too old for me to remember exactly. I would just recommend you to be extra careful about the CA/TLS stuff. | 09:32 |
| Tony31 | thank you flint for this and your time! | 09:32 |
| *** wuchunyang has quit IRC | 09:32 | |
| *** jonaspaulo has quit IRC | 09:32 | |
| Fl1nt | sure no problems. | 09:33 |
| *** jonaspaulo has joined #openstack-kolla | 09:33 | |
| openstackgerrit | Gaël THEROND proposed openstack/kolla-ansible master: [WIP] - Add missing cloudkitty storage and collector backend support. https://review.opendev.org/752965 | 09:34 |
| Fl1nt | mgoddard, when you'll have time, I've edited my cloudkitty commit in order to integrate your comments about all the various storage and collector backend auth/url discovery mechanisms. should be way simpler now. | 09:36 |
| mgoddard | Fl1nt: cool. should get to it by tomorrow | 09:39 |
| Fl1nt | sure no rush, I've integrated this patch on our own side in order to be able to deploy our CK correctly without waiting for the final patch, so I'll let you know if something is missing by tomorrow eve ^^ | 09:40 |
| *** wuchunyang has joined #openstack-kolla | 09:41 | |
| *** shyamb has quit IRC | 09:46 | |
| *** shyamb has joined #openstack-kolla | 10:02 | |
| openstackgerrit | Fabian Bermel proposed openstack/kolla master: Checks for heat_user_domain explicitly https://review.opendev.org/711923 | 10:03 |
| *** wuchunyang has quit IRC | 10:03 | |
| recyclehero | good day ladies and gent | 10:07 |
| recyclehero | does inventory work with all ips and no fqdn s? | 10:07 |
| recyclehero | also hosts witt localhost hostnames | 10:08 |
| *** nikparasyr has joined #openstack-kolla | 10:08 | |
| yoctozepto | it does | 10:09 |
| *** shyam89 has joined #openstack-kolla | 10:23 | |
| *** shyamb has quit IRC | 10:26 | |
| *** shyam89 has quit IRC | 10:32 | |
| *** shyam89 has joined #openstack-kolla | 10:35 | |
| shyam89 | Hi | 10:39 |
| shyam89 | How can I use this variable in ussuri release? https://github.com/openstack/kolla-ansible/blob/master/ansible/group_vars/all.yml#L196 | 10:40 |
| shyam89 | This variable 'om_enable_rabbitmq_tls' is not available in ussuri | 10:40 |
| shyam89 | For Trilio service, we need this variable | 10:41 |
| shyam89 | mgoddard: Hi | 10:43 |
| shyam89 | mgoddard: ^^ Please take a look | 10:43 |
| mgoddard | shyam89: that variable was added in master/victoria | 10:44 |
| shyam89 | mgoddard: Any other variable which tells if rabbitmq has tls enabled? | 10:45 |
| shyam89 | in ussuri | 10:45 |
| mgoddard | shyam89: not required. TLS isn't supported for rmq in ussuri | 10:45 |
| shyam89 | mgoddard: Is this kolla_ansible limitation? Or in general for openstack this is not supported? | 10:46 |
| mgoddard | kolla ansible | 10:46 |
| shyam89 | mgoddard: Okay | 10:46 |
| shyam89 | thanks | 10:46 |
| recyclehero | yoctozepto: this failed TASK [rabbitmq : Check if each rabbit hostname resolves uniquely to the proper IP address] | 10:57 |
| recyclehero | prechceks : let me see the task and comeback with I plan to do | 10:58 |
| recyclehero | command: "getent {{ nss_database }} {{ hostvars[item]['ansible_hostname'] }}" | 11:07 |
| recyclehero | can sb please explain this command | 11:07 |
| recyclehero | this is how it get rabbitmq hostnames to check for uniqueness | 11:08 |
| yoctozepto | recyclehero: indeed | 11:08 |
| yoctozepto | recyclehero: the {{ }} parts are ansible for variable interpolation | 11:08 |
| recyclehero | yes | 11:08 |
| yoctozepto | recyclehero: nss_database likely depends on IP versions | 11:08 |
| recyclehero | 4 | 11:09 |
| yoctozepto | hostsv4 or v6 | 11:09 |
| yoctozepto | and the last part deals with obtaining hostname from ansible | 11:09 |
| yoctozepto | ansible deduces it from the target host | 11:09 |
| yoctozepto | it likely runs something similar to | 11:09 |
| yoctozepto | hostname | 11:09 |
| yoctozepto | or | 11:09 |
| yoctozepto | hostname -f | 11:09 |
| yoctozepto | (never remember) | 11:09 |
| *** e0ne has joined #openstack-kolla | 11:09 | |
| yoctozepto | you can run ansible -m setup | 11:09 |
| yoctozepto | against the target and check the value | 11:09 |
| recyclehero | so if I do hostname hostname on the hosts with two diffrent hostnames it will get ok | 11:10 |
| recyclehero | or should I go to /etc/hosts and add infornt of 127...... | 11:10 |
| recyclehero | ? | 11:10 |
| yoctozepto | recyclehero: they should be properly configured, yes | 11:28 |
| yoctozepto | i.e. each host has a hostname | 11:29 |
| yoctozepto | other hosts can reach it by this name | 11:29 |
| yoctozepto | rabbitmq expects this | 11:29 |
| r3ap3r | Morning everyone. | 11:37 |
| r3ap3r | mnasiadka: ok, I'll go back and look at my glance configuration on Ceph. Thing is I set it `client.glance mon "allow *" osd "allow *"` but it still gave the same results. Weird? I do understand the Ceph piece is a little outside of scope for you guys as it may not be kolla-ansible specific so I appreciate the stuff yall have told me so far. Looks like I need to revisit the Ceph docs and do some more poking | 11:42 |
| r3ap3r | around. Thanks. 😊 | 11:42 |
| mnasiadka | r3ap3r: what did you use to deploy Ceph? | 11:42 |
| r3ap3r | mnasiadka: cephadm. | 11:43 |
| r3ap3r | Brb, I'll be able to respond again when I get to the "office". | 11:46 |
| mnasiadka | r3ap3r: well, question what's your networking setup - and the rights required on glance key are really nice documented in Ceph's docs | 11:48 |
| r3ap3r | If I change the rights, probably about to get hit right now, on a client.* do I have to re-export the key to kolla-ansible and reconfigure? Didn't think so originally due to it just being permissions but starting to think I was wrong? | 11:53 |
| *** shyam89 has quit IRC | 11:57 | |
| *** ozzzo has joined #openstack-kolla | 12:26 | |
| *** born2bake has joined #openstack-kolla | 12:28 | |
| *** cah_link has quit IRC | 12:38 | |
| *** kevko has quit IRC | 12:45 | |
| *** ricolin_ has joined #openstack-kolla | 12:48 | |
| recyclehero | I installed centos 8 on the two target hosts that I will be using. one compute and one other groups | 12:49 |
| recyclehero | as for meeting dependency on the target hosts I ran the sudo dnf install python3-devel libffi-devel gcc openssl-devel python3-libselinux on them | 12:50 |
| recyclehero | python3 -m venv virtualenv for them | 12:50 |
| recyclehero | on target host I have a inventory folder, which contains multi.ini host_vars groupv_ar which I declared ansible_python_interpreter | 12:51 |
| *** hrw has quit IRC | 12:52 | |
| recyclehero | for the bootstrap playbook I comment the ansible_python_interpreter and let it do its thing without venv python intrepreter | 12:52 |
| recyclehero | but after that for prechceks and deploy I remove the comment and let it run with the virtual env interpreter | 12:52 |
| recyclehero | prechceks run fine | 12:52 |
| recyclehero | but now on coping some config files in depoly I get error for not having python_selinux ... | 12:53 |
| recyclehero | whats up? | 12:53 |
| *** hrw has joined #openstack-kolla | 12:53 | |
| recyclehero | target uses selinux but python bindings (libselinux-python) aren't installed!"} | 12:56 |
| *** kevko has joined #openstack-kolla | 12:57 | |
| mgoddard | recyclehero: try pip install selinux in your virtualenv | 13:02 |
| mgoddard | we might need to add that to bootstrap-servers | 13:02 |
| recyclehero | haha I have contributed :D | 13:03 |
| recyclehero | add that please | 13:03 |
| *** cah_link has joined #openstack-kolla | 13:04 | |
| mnasiadka | mgoddard: maybe that's the case that recyclehero used python3 -m venv instead of the virtualenv binary? I think it's not directly supported by the baremetal role :) | 13:06 |
| mnasiadka | if we want to support/change approach - then yes, contribution is needed ;) | 13:06 |
| Fl1nt | r3ap3r, if you've got a cinder/glance issue with a ceph external, don't forget that for nova you need your key and user configured to use the one from cinder. | 13:06 |
| mgoddard | mnasiadka: possibly. We do pip install selinux to the venv in kayobe, so it's likely we're missing something in kolla | 13:07 |
| mnasiadka | mgoddard: yeah, that might be true - other option is --use-system-site-packages and it might already be there | 13:08 |
| mgoddard | mnasiadka: that is the default, and I think recyclehero is doing it. It doesn't work for selinux | 13:08 |
| recyclehero | mgoddard: can I add this to the file https://dpaste.com/5Q7YMNB7T | 13:10 |
| recyclehero | ? | 13:10 |
| *** ricolin_ has quit IRC | 13:11 | |
| recyclehero | I mean I can but does it need sudo and the thing that I have mentioned | 13:11 |
| mgoddard | recyclehero: yes | 13:11 |
| recyclehero | mgoddard: tnx | 13:11 |
| *** skramaja has quit IRC | 13:24 | |
| *** priteau has joined #openstack-kolla | 13:24 | |
| *** ricolin_ has joined #openstack-kolla | 13:31 | |
| *** yankcrime has joined #openstack-kolla | 13:33 | |
| *** kevko_ has joined #openstack-kolla | 13:33 | |
| *** kevko has quit IRC | 13:36 | |
| r3ap3r | Fl1nt: oh yeah, I figure that one out a while back. Not having that configured properly caused there to be no Hypervisors listed in my deployment. I'm using the client.cinder user and keyring for nova. | 13:39 |
| *** shyamb has joined #openstack-kolla | 13:53 | |
| *** shyam89 has joined #openstack-kolla | 13:55 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: DNM: Debug ironic drivers https://review.opendev.org/755000 | 13:55 |
| *** shyamb has quit IRC | 13:58 | |
| *** k_mouza has quit IRC | 13:59 | |
| *** e0ne_ has joined #openstack-kolla | 14:02 | |
| *** e0ne has quit IRC | 14:02 | |
| *** shyam89 has quit IRC | 14:09 | |
| *** shyam89 has joined #openstack-kolla | 14:09 | |
| *** kevko_ has quit IRC | 14:11 | |
| *** ricolin_ has quit IRC | 14:14 | |
| yoctozepto | mnasiadka: commented on healthcheck first patch | 14:18 |
| *** bhagyashri|rover is now known as bhagyashri | 14:20 | |
| yoctozepto | when is this an array anyway? | 14:21 |
| *** TrevorV has joined #openstack-kolla | 14:23 | |
| *** cah_link has quit IRC | 14:24 | |
| *** cah_link has joined #openstack-kolla | 14:26 | |
| mnasiadka | yoctozepto: normally it's an array, but API allows passing a string, which it will convert to an array :D | 14:29 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker https://review.opendev.org/743958 | 14:30 |
| mnasiadka | yoctozepto: replaced names ^^ | 14:30 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: automate the deployment of designate https://review.opendev.org/754275 | 14:30 |
| *** kevko_ has joined #openstack-kolla | 14:31 | |
| *** k_mouza has joined #openstack-kolla | 14:34 | |
| yoctozepto | mnasiadka: but why would a user pass an array? | 14:34 |
| yoctozepto | I mean, I see it's on the k-a side | 14:34 |
| *** shyam89 has quit IRC | 14:38 | |
| *** shyam89 has joined #openstack-kolla | 14:38 | |
| *** cah_link has quit IRC | 14:39 | |
| *** k_mouza has quit IRC | 14:39 | |
| *** shyam89 has quit IRC | 14:43 | |
| *** shyamb has joined #openstack-kolla | 14:43 | |
| *** shyamb has quit IRC | 14:43 | |
| mgoddard | meeting in 10 minutes | 14:51 |
| mgoddard | mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi bbezak | 14:52 |
| mgoddard | #startmeeting | 15:02 |
| mgoddard | #startmeeting kolla | 15:02 |
| openstack | Meeting started Wed Sep 30 15:02:04 2020 UTC and is due to finish in 60 minutes. The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:02 |
| *** openstack changes topic to " (Meeting topic: kolla)" | 15:02 | |
| openstack | The meeting name has been set to 'kolla' | 15:02 |
| openstack | mgoddard: Error: A meeting name is required, e.g., '#startmeeting Marketing Committee' | 15:02 |
| mgoddard | #topic rollcall | 15:02 |
| *** openstack changes topic to "rollcall (Meeting topic: kolla)" | 15:02 | |
| mgoddard | \o | 15:02 |
| priteau | o/ | 15:02 |
| jovial[m] | 1o | 15:02 |
| osmanlicilegi | o/ | 15:02 |
| hrw | ]o[ | 15:02 |
| mgoddard | ioj | 15:03 |
| headphoneJames | o/ | 15:03 |
| mgoddard | #topic announcements | 15:03 |
| *** openstack changes topic to "announcements (Meeting topic: kolla)" | 15:03 | |
| mgoddard | #info Kolla feature freeze fast approaching: Sep 28 - Oct 02 | 15:04 |
| mgoddard | end of this week | 15:04 |
| mgoddard | the freeze will begin | 15:04 |
| mgoddard | #info Submit Virtual PTG topic proposals | 15:04 |
| mgoddard | #link https://etherpad.opendev.org/p/kolla-wallaby-ptg | 15:04 |
| mgoddard | #info mgoddard remains PTL for Wallaby | 15:04 |
| mgoddard | guess you're stuck with me for another cycle :) | 15:05 |
| headphoneJames | hooray! | 15:05 |
| mgoddard | Any others? | 15:05 |
| mgoddard | #info TC campaining begins this week | 15:06 |
| mgoddard | watch out for yoctozepto | 15:06 |
| yoctozepto | o/ | 15:06 |
| yoctozepto | vote yoctozepto | 15:06 |
| mgoddard | #topic Review action items from the last meeting | 15:06 |
| *** openstack changes topic to "Review action items from the last meeting (Meeting topic: kolla)" | 15:06 | |
| mgoddard | priteau to bump minimum Ansible to 2.9 | 15:08 |
| mgoddard | priteau to investigate kayobe kayobe-tox-molecule failures | 15:08 |
| mgoddard | mnasiadka to investigate ubuntu binary CI failures | 15:08 |
| mgoddard | priteau: check, check | 15:08 |
| mgoddard | mnasiadka: hmm | 15:08 |
| yoctozepto | he fixed | 15:08 |
| mnasiadka | isn't it green now? | 15:08 |
| mgoddard | ah yes, the heat deps thing | 15:08 |
| yoctozepto | only debian is red -> hrw | 15:08 |
| mgoddard | ok | 15:08 |
| hrw | qemu? | 15:08 |
| mgoddard | good work all | 15:09 |
| yoctozepto | last time I checked! | 15:09 |
| yoctozepto | best team around :-) | 15:09 |
| mgoddard | #topic CI status | 15:09 |
| *** openstack changes topic to "CI status (Meeting topic: kolla)" | 15:09 | |
| mgoddard | starting with kolla | 15:10 |
| mgoddard | bifrost stein & rocky unchanged AFAIK | 15:10 |
| mgoddard | master neutron migrations | 15:10 |
| mnasiadka | did they finally fix it, or they prefer to ship a broken release? :) | 15:11 |
| mgoddard | pass | 15:11 |
| yoctozepto | they reverted | 15:12 |
| yoctozepto | but I need to fix k-a still | 15:12 |
| yoctozepto | on it at the very moment | 15:12 |
| mgoddard | ok | 15:12 |
| mgoddard | kolla ansible | 15:13 |
| mgoddard | the main issue right now is the debian jobs | 15:13 |
| mgoddard | has anyone looked at them? | 15:13 |
| mgoddard | are the debian maintainers aware? | 15:14 |
| hrw | not at all | 15:15 |
| hrw | was in completely different projects last two weeks | 15:15 |
| hrw | started debian/source/x86-64 build to check status | 15:15 |
| mgoddard | ok, maybe we should raise it on the ML? | 15:16 |
| mgoddard | anyone want to do that? | 15:16 |
| hrw | are those kolla or k-a bugs? | 15:16 |
| yoctozepto | debian | 15:17 |
| yoctozepto | :-) | 15:17 |
| hrw | ha ha ha | 15:17 |
| hrw | ha | 15:17 |
| hrw | ha ha | 15:17 |
| yoctozepto | I mean, it's hard to pinpoint, choose either | 15:17 |
| yoctozepto | k-a breaks | 15:17 |
| yoctozepto | k does not | 15:17 |
| yoctozepto | but images are unusable | 15:17 |
| hrw | ok, that's some info | 15:17 |
| *** k_mouza has joined #openstack-kolla | 15:17 | |
| yoctozepto | see :-) | 15:17 |
| *** nikparasyr has left #openstack-kolla | 15:19 | |
| mgoddard | I will email the list | 15:20 |
| mgoddard | #action mgoddard to email openstack-discuss about debian CI issues | 15:20 |
| mgoddard | kayobe | 15:20 |
| mgoddard | we are currently blocked by an ironic issue which is migrating nodes to use the direct driver during upgrade | 15:20 |
| mgoddard | *deploy driver | 15:21 |
| mgoddard | fix approved, hopefully it lands in time for tomorrows images | 15:21 |
| mgoddard | https://review.opendev.org/755295 | 15:21 |
| patchbot | patch 755295 - ironic - Don't migrate away from iscsi if it is the default - 1 patch set | 15:21 |
| mgoddard | although kayobe uses binary, so depends on RDO | 15:21 |
| mgoddard | maybe we should use a workaround | 15:22 |
| yoctozepto | sorry for wrong time but should not we move images to victoria right away (to avoid wallaby in)? | 15:22 |
| yoctozepto | now that they have been branched | 15:22 |
| mgoddard | yes, we could do that | 15:23 |
| yoctozepto | any volunteers? | 15:24 |
| yoctozepto | (to swtich kolla sources) | 15:24 |
| mgoddard | #action mgoddard to switch images to victoria stable branches | 15:25 |
| mgoddard | easy one | 15:25 |
| mgoddard | #topic Victoria release planning | 15:25 |
| *** openstack changes topic to "Victoria release planning (Meeting topic: kolla)" | 15:25 | |
| mgoddard | we enter the last days of feature merging | 15:27 |
| mgoddard | which will we choose? | 15:27 |
| mnasiadka | healthchecks are halfway through :) | 15:27 |
| headphoneJames | I could use help with backend TLS for neutron | 15:27 |
| yoctozepto | hacluster and others of mine are ready to merge, they don't impact existing features | 15:28 |
| yoctozepto | headphoneJames: ++ | 15:28 |
| hrw | https://review.opendev.org/#/c/706982 will complete infra part of V | 15:28 |
| patchbot | patch 706982 - kolla-ansible - Introduce 'kolla_infra_install_type' variable - 14 patch sets | 15:28 |
| mgoddard | I had some concerns about backwards compatibility with that one | 15:29 |
| hrw | so leave it for W and stop worry then? | 15:30 |
| mgoddard | +1 | 15:30 |
| mgoddard | it will make more sense to users in W | 15:30 |
| mgoddard | yoctozepto: can you list your patches in order of preference? | 15:31 |
| yoctozepto | mgoddard: surrrreeee | 15:32 |
| hrw | postponed all infra to W | 15:32 |
| yoctozepto | mgoddard: this stack -> https://review.opendev.org/754568 | 15:33 |
| patchbot | patch 754568 - kolla-ansible - Add support for ACME http-01 challenge - 1 patch set | 15:33 |
| yoctozepto | very simple, huge gains | 15:33 |
| yoctozepto | https://review.opendev.org/723342 | 15:34 |
| patchbot | patch 723342 - kolla-ansible - Coordinate haproxy and keepalived restarts - 11 patch sets | 15:34 |
| yoctozepto | because I did what you wanted and it's a matter of merging | 15:34 |
| mgoddard | ok | 15:35 |
| yoctozepto | https://review.opendev.org/747592 | 15:35 |
| patchbot | patch 747592 - kolla-ansible - Make keep-alive timeout configurable - 1 patch set | 15:35 |
| yoctozepto | because it has CR+1 from mnasiadka | 15:35 |
| yoctozepto | then https://review.opendev.org/752917 | 15:35 |
| patchbot | patch 752917 - kolla-ansible - Allow to skip and unset sysctl vars - 1 patch set | 15:35 |
| yoctozepto | because it's another very simple stack | 15:35 |
| mgoddard | ok only 2 days yoctozepto | 15:36 |
| yoctozepto | this one for mnasiadka https://review.opendev.org/749908 | 15:36 |
| patchbot | patch 749908 - kolla-ansible - Make no_proxy handling more robust - 3 patch sets | 15:36 |
| yoctozepto | mgoddard: ok | 15:36 |
| mgoddard | headphoneJames: are you still seeing the memcache issue? | 15:36 |
| yoctozepto | mgoddard: we can postpone masakari to make you happier :-) | 15:36 |
| headphoneJames | mgoddard: yes | 15:37 |
| mgoddard | any idea what's going wrong? | 15:37 |
| headphoneJames | not at all | 15:37 |
| yoctozepto | :-( | 15:37 |
| headphoneJames | very odd, trying to get it working with uwsgi to see if similar failure | 15:38 |
| mgoddard | have you checked if it happens on binary images too? | 15:39 |
| mgoddard | could be some dependency issue | 15:39 |
| yoctozepto | what's the exact issue | 15:40 |
| yoctozepto | please link me | 15:40 |
| headphoneJames | the docker needs minor changes to support httpd, so haven't tried binary | 15:40 |
| headphoneJames | https://review.opendev.org/#/c/749616/ | 15:40 |
| patchbot | patch 749616 - kolla-ansible - Add support for encrypting Neutron Server API - 12 patch sets | 15:40 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Control Neutron migrations https://review.opendev.org/755328 | 15:41 |
| yoctozepto | AttributeError: 'MemcacheClientPool' object has no attribute 'getters' | 15:41 |
| yoctozepto | is not it because we switched that pool for neutron? | 15:41 |
| yoctozepto | it might have worked only with eventlet ;/ | 15:42 |
| yoctozepto | that's the issue that was tried to be mentioned I guess | 15:42 |
| yoctozepto | it was pretty unclear | 15:42 |
| priteau | Is this related to using the advanced memcache pool? | 15:43 |
| yoctozepto | https://review.opendev.org/746966 | 15:44 |
| patchbot | patch 746966 - kolla-ansible - Add workaround for keystonemiddleware/neutron memc... (MERGED) - 4 patch sets | 15:44 |
| yoctozepto | priteau | 15:44 |
| yoctozepto | oh, you here already | 15:44 |
| headphoneJames | sort of. If I disable advanced memcached pool, I get a different error | 15:44 |
| yoctozepto | headphoneJames: gimme the other error | 15:44 |
| yoctozepto | :D | 15:44 |
| yoctozepto | duh, time really flies | 15:45 |
| *** openstackgerrit has quit IRC | 15:46 | |
| mgoddard | we're not going to solve this now | 15:47 |
| mgoddard | does someone want to help headphoneJames offline? | 15:47 |
| headphoneJames | 2020-09-24 23:57:33.637 948 ERROR oslo_middleware.catch_errors AttributeError: module 'select' has no attribute 'poll' | 15:47 |
| headphoneJames | help would be greatly appreciated! | 15:48 |
| yoctozepto | headphoneJames: I feel it's important to get in so let me help | 15:48 |
| mgoddard | #action yoctozepto to help headphoneJames with neutron backend TLS | 15:49 |
| yoctozepto | headphoneJames: I want you to summarise what you already know in that review | 15:49 |
| headphoneJames | will do | 15:49 |
| mgoddard | other patches we want to land? | 15:49 |
| yoctozepto | mgoddard: how's octavia/designate? | 15:49 |
| mgoddard | I have given the main octavia patch a +2 | 15:49 |
| yoctozepto | (sorry for being unhelpful) | 15:49 |
| mgoddard | https://review.opendev.org/740180 | 15:50 |
| patchbot | patch 740180 - kolla-ansible - Implement automatic deploy of octavia - 45 patch sets | 15:50 |
| yoctozepto | (he be reading my mind again) | 15:50 |
| *** bengates has quit IRC | 15:50 | |
| yoctozepto | it has no docs | 15:50 |
| mgoddard | docs are in a separate patch | 15:50 |
| *** openstackgerrit has joined #openstack-kolla | 15:51 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: [DNM] Add NFV upgrade job https://review.opendev.org/755331 | 15:51 |
| mgoddard | https://review.opendev.org/#/q/topic:bp/implement-automatic-deploy-of-octavia+(status:open+OR+status:merged) | 15:51 |
| yoctozepto | duh, which? | 15:51 |
| yoctozepto | ok | 15:51 |
| *** bengates has joined #openstack-kolla | 15:51 | |
| yoctozepto | do they actually consider all patches to be merged? | 15:51 |
| mgoddard | yes | 15:52 |
| yoctozepto | hard life | 15:52 |
| mgoddard | but majority of the code is in the first one | 15:52 |
| yoctozepto | yeah, looking by the lines modified count ;-) | 15:52 |
| yoctozepto | choices, choices... | 15:52 |
| mgoddard | designate is simpler, but a bit less mature | 15:53 |
| mgoddard | I've given it a try | 15:53 |
| mgoddard | there's a pretty nasty designate bug that prevents deploys once you have registered a zone | 15:53 |
| yoctozepto | argh, hurts | 15:54 |
| mgoddard | I should probably focus on octavia rather than splitting effort | 15:54 |
| *** bengates has quit IRC | 15:55 | |
| mgoddard | any others? | 15:55 |
| mgoddard | I guess we have a few minutes for the last topic | 15:55 |
| mgoddard | #topic Wallaby PTG planning | 15:55 |
| *** openstack changes topic to "Wallaby PTG planning (Meeting topic: kolla)" | 15:55 | |
| mgoddard | #link https://etherpad.opendev.org/p/kolla-wallaby-ptg | 15:56 |
| mgoddard | Does anyone have any thoughts on how to run it this time | 15:56 |
| yoctozepto | I added one topic inspired by LinPeiWen | 15:56 |
| yoctozepto | what do you mean | 15:56 |
| mgoddard | well, we can do what we have done in the past | 15:57 |
| mgoddard | or we could try something new | 15:57 |
| hrw | zoom/gmeet all day with breaks? | 15:57 |
| mgoddard | zoom or meetpad | 15:57 |
| mgoddard | times are on the etherpad | 15:57 |
| hrw | no meetpad | 15:57 |
| mgoddard | 2x 4h sessions, plus 2h for kayobe | 15:57 |
| yoctozepto | meetpad = no hrw | 15:57 |
| yoctozepto | but I like hrw | 15:58 |
| yoctozepto | so zoom | 15:58 |
| mgoddard | ok | 15:58 |
| yoctozepto | current formula worked quite well | 15:58 |
| yoctozepto | I don't see how it can be improved without a major overhaul of rescheduling (e.g. to have longer breaks or whatever) | 15:59 |
| yoctozepto | my stance: let's keep it | 15:59 |
| mgoddard | ok | 15:59 |
| mgoddard | well do all try to have a think about what are the things that we need to discuss as a group | 16:00 |
| yoctozepto | ++ | 16:00 |
| mgoddard | what needs to be done in the next few cycles? | 16:00 |
| yoctozepto | I feel we need some considerable refactoring | 16:00 |
| mgoddard | blue sky ideas or iteration welcome | 16:00 |
| yoctozepto | it's happening with perf patches too | 16:00 |
| yoctozepto | otherwise in my usage we are pretty reliable now | 16:01 |
| yoctozepto | and cover most of the common usecases | 16:01 |
| mgoddard | and on that note | 16:01 |
| mgoddard | let's end | 16:01 |
| mgoddard | thanks all | 16:01 |
| mgoddard | #endmeeting | 16:01 |
| *** openstack changes topic to "IRC meetings on Wednesdays @ 15:00 UTC - agenda @ https://goo.gl/OXB0DL | Whiteboard: https://bit.ly/2MM7mWF | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b" | 16:01 | |
| openstack | Meeting ended Wed Sep 30 16:01:36 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-09-30-15.02.html | 16:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-09-30-15.02.txt | 16:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-09-30-15.02.log.html | 16:01 |
| openstackgerrit | Gaël THEROND proposed openstack/kolla-ansible master: [WIP] - Add missing cloudkitty storage and collector backend support. https://review.opendev.org/752965 | 16:01 |
| yoctozepto | thanks mgoddard | 16:01 |
| hrw | I am deploying debian now | 16:02 |
| *** k_mouza_ has joined #openstack-kolla | 16:03 | |
| yoctozepto | hrw: ++ | 16:03 |
| yoctozepto | headphoneJames: I'll assign some time for that neutron tomorrow | 16:03 |
| headphoneJames | thanks - I will update with info today | 16:03 |
| *** k_mouza has quit IRC | 16:06 | |
| ozzzo | running train, I wrote a cron job to do mariadb full backups with "kolla-ansible -i ../multinode mariadb_backup" and incrementals with "kolla-ansible -i ../multinode mariadb_backup --incremental" | 16:08 |
| ozzzo | after UTC 0 my incrementals fail until the next full runs | 16:08 |
| ozzzo | so I looked at "/opt/openstack/kolla/docker/mariadb/backup.sh" and I see: --incremental-history-name=$(date +%d-%m-%Y) \ | 16:09 |
| ozzzo | after UTC 0 this refers to a full backup that doesn't exist yet | 16:09 |
| ozzzo | am I doing something wrong, or is this a bug? | 16:09 |
| openstackgerrit | Mark Goddard proposed openstack/kolla master: Switch to Victoria stable branches https://review.opendev.org/755339 | 16:13 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: CI: workaround overcloud upgrade issue with ironic https://review.opendev.org/755342 | 16:20 |
| *** kevko_ has quit IRC | 16:25 | |
| hrw | yoctozepto: https://review.opendev.org/#/c/747534/ needs merge for debian/x86-64 | 16:25 |
| patchbot | patch 747534 - kolla - Debian: use QEMU 5.0 from buster-backports - 2 patch sets | 16:25 |
| hrw | yoctozepto: will take care of aarch64 | 16:26 |
| *** kevko_ has joined #openstack-kolla | 16:38 | |
| yoctozepto | hrw: ok | 16:39 |
| openstackgerrit | Merged openstack/kolla-ansible master: Make no_proxy handling more robust https://review.opendev.org/749908 | 16:39 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Fix Neutron migrations order https://review.opendev.org/755346 | 16:46 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Control Neutron migrations https://review.opendev.org/755328 | 16:48 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: [DNM] Add NFV upgrade job https://review.opendev.org/755331 | 16:48 |
| ozzzo | ^^ | 16:50 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Control Neutron migrations https://review.opendev.org/755328 | 16:50 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: [DNM] Add NFV upgrade job https://review.opendev.org/755331 | 16:50 |
| openstackgerrit | Stig Telfer proposed openstack/kayobe master: When EPEL install flag is not set https://review.opendev.org/755350 | 16:51 |
| openstackgerrit | Merged openstack/kolla-ansible master: Make keep-alive timeout configurable https://review.opendev.org/747592 | 17:01 |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for encrypting Neutron Server API https://review.opendev.org/749616 | 17:05 |
| *** kevko_ has quit IRC | 17:17 | |
| *** kevko_ has joined #openstack-kolla | 17:19 | |
| *** kevko_ has quit IRC | 17:27 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Add healthchecks option to kolla_docker https://review.opendev.org/743958 | 17:34 |
| *** k_mouza_ has quit IRC | 17:40 | |
| *** brinzhang0 has joined #openstack-kolla | 17:41 | |
| *** kevko_ has joined #openstack-kolla | 17:42 | |
| *** brinzhang_ has quit IRC | 17:44 | |
| *** e0ne_ has quit IRC | 17:50 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services https://review.opendev.org/676389 | 17:55 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services https://review.opendev.org/676389 | 17:55 |
| *** gfidente is now known as gfidente|afk | 18:23 | |
| *** cah_link has joined #openstack-kolla | 18:30 | |
| *** cah_link has quit IRC | 18:38 | |
| *** kevko_ has quit IRC | 18:45 | |
| *** kevko_ has joined #openstack-kolla | 18:45 | |
| *** e0ne has joined #openstack-kolla | 18:48 | |
| *** e0ne_ has joined #openstack-kolla | 18:52 | |
| *** e0ne has quit IRC | 18:53 | |
| *** priteau has quit IRC | 18:56 | |
| *** e0ne_ has quit IRC | 18:58 | |
| *** e0ne has joined #openstack-kolla | 19:04 | |
| *** e0ne has quit IRC | 19:16 | |
| r3ap3r | Fl1nt: Here is my most up-to-date network diagram for my Openstack setup. https://usercontent.irccloud-cdn.com/file/mb55jmj8/Openstack_Network_Diagram.pdf | 19:39 |
| r3ap3r | Sorry, meant to send that to mnasiadka ^^ | 19:40 |
| *** jonaspaulo has quit IRC | 20:31 | |
| openstackgerrit | Merged openstack/kayobe master: CI: workaround overcloud upgrade issue with ironic https://review.opendev.org/755342 | 21:09 |
| *** gfidente|afk has quit IRC | 21:11 | |
| *** jbadiapa has quit IRC | 21:35 | |
| *** Fl1nt has quit IRC | 21:45 | |
| *** born2bake has quit IRC | 21:54 | |
| *** kevko_ has quit IRC | 22:04 | |
| *** k_mouza has joined #openstack-kolla | 22:27 | |
| *** jobewan has joined #openstack-kolla | 22:32 | |
| jobewan | Are there any plans to create a "kolla_podman" in lieu of kolla_docker going forward? | 22:34 |
| *** k_mouza has quit IRC | 23:00 | |
| *** TrevorV has quit IRC | 23:20 | |
| *** k_mouza has joined #openstack-kolla | 23:37 | |
| *** k_mouza has quit IRC | 23:45 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!