Monday, 2021-10-18

ozzzoI'll try it tomorrow02:09
johnsomfrickler: I am not sure I understand your question. I rolled up the data from the foundation on the discuss mailing list for the survey information I added to the PTG topics. It was hard to read in the csv form.06:09
fricklerjohnsom: I hadn't seen the mail from the foundation earlier, that's what my question was about. and I agree that the format is difficult to use. but it is also valuable to see the answers for designate in the context of the other answers for that deployment07:28
opendevreviewArkady Shtempler proposed openstack/designate-tempest-plugin master: Add new test cases for TLD test suite  https://review.opendev.org/c/openstack/designate-tempest-plugin/+/80359708:41
opendevreviewArkady Shtempler proposed openstack/designate-tempest-plugin master: List enabled Designate API versions  https://review.opendev.org/c/openstack/designate-tempest-plugin/+/80311609:19
opendevreviewArkady Shtempler proposed openstack/designate-tempest-plugin master: List enabled Designate API versions  https://review.opendev.org/c/openstack/designate-tempest-plugin/+/80311609:20
ozzzoeandersson: After applying the patch I'm no longer able to duplicate the error15:19
johnsomNice, awesome work tracking that down!15:20
ozzzoty for your help w/that15:22
opendevreviewArkady Shtempler proposed openstack/designate-tempest-plugin master: New test cases for tsigkey tests suite  https://review.opendev.org/c/openstack/designate-tempest-plugin/+/79827716:07
opendevreviewArkady Shtempler proposed openstack/designate-tempest-plugin master: Adding a new test: "test_create_zone_validate_recordsets_created"  https://review.opendev.org/c/openstack/designate-tempest-plugin/+/80349019:38
eanderssonjohnsom what do you think on https://review.opendev.org/c/openstack/designate/+/814290 ?20:15
eanderssonThe original idea with the sink was that it would create a record that could only be managed by the sink (with the exception of --edit-managed for admins in case something goes terribly terribly wrong)20:15
eanderssonI honestly don't think you can modify even a recordset created by the sink without the --edit-managed, but even if not no one should be touching those records20:16
eanderssonWe could make this code a lot smarter, but it probably needs a complete overhaul20:17
eanderssonActually nvm20:19
eanderssonI guess if a VM has two IPs it would have two records under a recordset20:19
eanderssonbut even then that wouldn't be an issue, since they are both created by the sink20:20
fricklereandersson: I was more thinking what would happen if two vms have the same hostname. then deleting one would remove records for both?20:21
eandersson1) Leave patch as is and if someone adds something to the managed records they will be lost (this isn't supported anyway).20:22
eandersson2) Move managed to the recordset level and enforce as intended.20:22
eandersson3) Write something more complicated in base aka _update_or_delete_recordset.20:22
eandersson4) Fix delete_record in central.20:22
eanderssonfrickler: That happens today already20:22
eanderssonIt's super annoying today because if someone creates two VMs with the same name by accident and removes one it wipes the records20:23
eanderssonfor both20:23
frickleris that a feature or a bug?20:23
eanderssonbug I would say20:25
eanderssonI wish we had some functional tests here lol20:25
fricklerI was just about to ask, do we have a scenario test for sink at all?20:25
eanderssonI don't believe so20:26
eanderssonbtw the code is just broken atm20:26
eanderssonBecause delete_record just puts the record into PENDING delete20:26
eandersson(which is then clean up by a secondary process)20:27
eanderssonbut couldn't find that process lol20:27
fricklero.k., will try to setup something locally tomorrow, eod now20:30
johnsomeandersson It was on my list to look at a bit later today, but if it's broken..... 20:30
eanderssonThanks both of you. 20:36
eanderssonI can try some more stuff tonight. Looking at the code... I might have fixed that bug already20:36
johnsomI need to get my head around the sink code. I haven't spent much time on it.20:37
eanderssonBecause in theory it shouldn't delete the old record20:37
eanderssonI think the idea was that it was replaced by the neutron code20:38
eanderssonbecause it has a lot of flaws20:38
johnsomRight, API...20:38
eanderssonnotifications aren't reliable20:38
eanderssonOk.. I am running my forked version that is using old code.. so indeed you are right frickler20:42
eanderssonGreat call out!20:42
eanderssonWe really need functional testing for this20:43
eanderssonI'll put together a wip implementation for #3 tonight20:44
eanderssonOmg I see what I did... the problem with sink is that notifications sometimes fails, e.g. if you delete a VM off a compute that does is down (e.g. bad hardware)21:40
eanderssonBecause the notifications originate from nova-compute, not from nova-api or nova-conductor21:41
eanderssonThis means that if you delete a VM because the hypervisor is in a not so good state the records needs to be manually cleaned up by an administrator21:41
eanderssonSo in my implementation of this I delete all previous VM records. That way if a VM isn't cleaned up properly, when it is re-created it will always remove old records21:42
eanderssonThe disadvantage is that you cannot do round-robin vms21:42
eanderssonAdvantage is that you dont have to clean up old records when VM delete was done on a bad hypervisor21:43
eanderssonbtw if you have like... I don't know 10k+ hypervisors.. this is a major pain as a small percentage of hypervisors will die monthly and VMs need to be deleted and cleaned up21:44
eanderssonand automating that process isn't super easy21:45
johnsomYeah, I have an long open bug against nova (unless they rage closed it) that deletes shouldn't get resources stuck if the host is unreachable, they should just queue. It gets super nasty when you can't get IPs and ports back due to a host going down hard..... I wrote a monster patch to work around that in Octavia.22:37
opendevreviewMichael Johnson proposed openstack/designate-tempest-plugin master: Unroll DDT API tests used for refstack/interop  https://review.opendev.org/c/openstack/designate-tempest-plugin/+/81449722:51
johnsomThrowing a proposed patch out there for the PTG discussion.22:59
eanderssonI bet that might fix the nginx issue as well.23:02
johnsomnginx issue?23:02
johnsomThe wsgi problem?23:03
eanderssonYea23:03
eanderssonThose ddt tests are the only ones that trigger that issue.23:03
johnsomYeah, I never narrowed down why we get that one random broken pipe on the uwsgi socket. I spent a day or two on it. I still mean to get back to that.23:04
johnsomBut, yeah, we had tons of trouble with ddt in Octavia, mostly dependency breaking issues, etc. so we just removed it and did all stubs.23:04
eanderssonhttps://review.opendev.org/c/openstack/designate-tempest-plugin/+/70025523:05
eanderssonI was trying to do something similar23:05
johnsomI would be more than happy to do that in designate too if we are interested. Some of the others are going to be a larger list of stubs though.23:05
johnsomPersonally, I find the stubs are just simple and clear, probably saves a few lines overall too. grin23:06
eanderssonI agree23:07
johnsomfrickler If I remember right, you prefer jitsi over zoom?23:37

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!