Tuesday, 2024-04-09

fricklerinfra-root: I've had multiple events today where I open a review URL on gerrit and it silently fails to display any review comments10:00
fungithat sounds like failing rest api calls from the web client in the browser back to the server. could be intermittent tcp connection failures of some kind12:11
fricklernice map of the ptg timeslots in the cacti graphs for meetpad :) seems to be working smoothly in all the sessions I've been in so far13:49
fungisame, no issues yesterday anyway13:55
clarkbfrickler: fungi: ya I would look in gerrit's error log for any issues on the gerrit side. Another thing would be to see if apache is filling all of its connection slots14:52
clarkband yes comments, diffs, votes, etc are all retrieved as separate rest calls iirc14:53
clarkbfrickler: fungi: I occasionally see something similar and I think it coincides with when my wifi connection is dropped. Usually this is due to performing package updtes in the background that restart connectivity things, but I suspect any connection issues could lead to that. Your browser debug tools may should which network request specifically failed and then we could trace that14:58
clarkbfurther if necessary14:58
fricklerthe problem is that the issue always goes away for me after a reload, so it's not reproducible and I don't want to run with the debug session open all the time15:09
clarkbinfra-root https://review.opendev.org/c/opendev/system-config/+/915185/ and child are two easy minor system-config updates if you haev a moment16:00
clarkbin addition to dinner I have an errand I need to run a couple hours before our scheduled PTG time early tomorrow morning UTC time. Should be back well before we start but a heads up here if I end up being a little late16:09
fricklerI'll likely also be about half an hour late16:16
opendevreviewClark Boylan proposed zuul/zuul-jobs master: Add option to set compile flags for pyenv in ensure-python  https://review.opendev.org/c/zuul/zuul-jobs/+/91536616:53
opendevreviewClark Boylan proposed zuul/zuul-jobs master: Add option to set compile flags for pyenv in ensure-python  https://review.opendev.org/c/zuul/zuul-jobs/+/91536616:59
fungii'm debating whether i'll make the first ptg block. it's like midnight to 2am for me, so depends on whether i get (and then manage to wake up from) a nap earlier in the evening17:39
clarkbfungi: I wouldn't worry about it. The intention was always that it would be fine for people to skip if they had conflicts with other sessions or sleep17:40
fungiyeah, up side to sticking with my normal sleep schedule would be better presence during openstack sdk/cli sessions starting at 9am my time17:42
corvusthe zuul query changes merged, so i'm going to restart the web and scheduler containers22:19
clarkbcorvus: I think the merger change for packed refs also merged overnight22:20
corvusthis should get us some validation of the new queries in prod on mysql; then maybe this weekend we can migrate from mysql to mariadb (assuming we still want that)22:20
corvusclarkb: yeah, that requires mergers/executor updates tho, so i was thinking of leaving those for the normal restart22:20
clarkbI should've -W'd it if we wanted to hold it back, but that is only on the mergers and executors so shouldn't be affected by this restart (will be by the automated one)22:20
clarkb++ exactly22:20
corvusyeah, i think it's fine for it to have merged and is okay to deploy on a "normal" (non-holiday) weekend22:21
clarkbsounds good22:21
fungii'm in favor of this plan as well, thanks!22:22
corvus#status log restarted zuul schedulers and web to pick up split sql query change22:31
opendevstatuscorvus: finished logging22:31
corvusthe obvious web queries lgtm22:32
fungihttps://zuul.opendev.org/t/openstack/builds is still returning content for me, near-instantly22:40
clarkbthanks!22:45

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!