Tuesday, 2022-05-24

*** ysandeep|out is now known as ysandeep|rover03:24
*** ysandeep|rover is now known as ysandeep|afk04:24
*** ysandeep|afk is now known as ysandeep|rover04:45
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Moge container images to quay.io  https://review.opendev.org/c/openstack/ci-log-processing/+/84310706:56
*** ysandeep|rover is now known as ysandeep|rover|lunch08:02
*** ysandeep|rover|lunch is now known as ysandeep|rover08:38
*** dviroel|out is now known as dviroel11:21
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Ignore directories that does not exists or don't have access  https://review.opendev.org/c/openstack/ci-log-processing/+/84297711:38
opendevreviewDr. Jens Harbott proposed openstack/project-config master: Add missing volumes to Grafana AFS page  https://review.opendev.org/c/openstack/project-config/+/84313312:16
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: DNM Add support for Elastic Recheck tool  https://review.opendev.org/c/openstack/ci-log-processing/+/84313812:31
opendevreviewyatin proposed openstack/devstack-gate master: Use stable constraints for Tempest venv for stable/train testing  https://review.opendev.org/c/openstack/devstack-gate/+/84314814:12
opendevreviewMerged openstack/project-config master: Add missing volumes to Grafana AFS page  https://review.opendev.org/c/openstack/project-config/+/84313314:41
opendevreviewMerged openstack/project-config master: Add neutron-vpnaas-stable-maint group  https://review.opendev.org/c/openstack/project-config/+/84269315:11
*** ysandeep|rover is now known as ysandeep|out15:17
dansmithclarkb: I'll say this over here since the qa meeting is still going15:49
dansmithclarkb: I think my problem was staleness in ~/.local15:49
dansmithI use virtfs to mount my home dir from my throwaway VM to my host15:49
dansmithand at some point I got dbcounter installed into ~/.local probably whilst trying to debug the install failure last week15:50
dansmithso it was picking that up, with no entry_points.txt in it instead of the publicly installed one and thus failing to load15:50
dansmithso, even though the vm was fresh, my home dir was unfresh15:50
clarkbah15:51
*** dviroel is now known as dviroel|lunch15:58
*** jpena is now known as jpena|off16:51
*** dviroel|lunch is now known as dviroel16:58
opendevreviewyatin proposed openstack/devstack-gate master: Switch legacy-tempest-neutron-full-stable to focal  https://review.opendev.org/c/openstack/devstack-gate/+/84317617:18
fungiCN = wiki.openstack.org17:46
fungiNot After : May 24 23:59:59 2023 GMT17:46
fungi#status log Replaced manually-obtained X.509 HTTPS cert on legacy wiki.openstack.org server17:46
fungiclarkb: ^ thanks!17:47
clarkbperfect17:47
fungihuh, statusbot is mia17:47
fungii'll look into that now17:47
elodillesclarkb fungi : i'm planning to do some EOL'd branch cleanup if that is not interfere with your work now ^^^ (i guess, not, but wanted to be sure)17:55
fungi#status log Replaced manually-obtained X.509 HTTPS cert on legacy wiki.openstack.org server17:56
opendevstatusfungi: finished logging17:56
fungielodilles: should be fine, thanks for letting us know!17:56
elodilles++17:57
clarkbya I have nothing that would interfere17:59
opendevreviewMerged openstack/project-config master: Fix python list for requirements propose-updates job  https://review.opendev.org/c/openstack/project-config/+/84285318:18
opendevreviewClark Boylan proposed openstack/project-config master: Install setfacl on test nodes  https://review.opendev.org/c/openstack/project-config/+/84321020:05
opendevreviewMerged openstack/project-config master: Build and publish wheel mirror for Ubuntu Jammy  https://review.opendev.org/c/openstack/project-config/+/84284120:13
elodillesclarkb fungi : today these were deleted: https://paste.opendev.org/show/b35CjByPMENT1poLDjez/20:16
fungithanks elodilles!20:17
elodillesthe newton and ocata needed to be deleted half-manually, as those series are marked already EOL20:17
elodillesand now i realized that i did a mistake: requirements' newton branch was deleted, as the newton-eol tagging patch was merged: https://review.opendev.org/c/openstack/releases/+/83857120:20
elodillesbut the newton-eol was not created, as newton was EOL20:20
elodillesso now i think we lost the history of requirements' stable/newton :S20:21
elodillesfungi: can we do something about this? ^^^20:21
clarkbelodilles: so the change to releases for newton-eol merged but the tag wasn't created?20:26
clarkbI think if you know what the old HEAD was you can still tag it20:27
clarkbor create the branch again off that HEAD, tag it, then delete the branch20:27
clarkbI see d94785ceb702587131ce98a1b9f05b2869a66180 locally but I have no idea how old that is20:27
clarkbyou have until 04:17 when the git gc runs20:29
clarkbelodilles: does your script record the HEADs before you delete them?20:30
elodillesclarkb: the tagging is 'skipped' by the job if the branch is in EOL state (and newton is in EOL)20:32
fungiyeah, but does the script record the head commit id when it's deleting a branch?20:33
clarkbok. I think a few things should be changed before the next round of deletions. The script that delets should ensure that whatever branch HEAD is deletes has a corresponding tag. And you should record what those heads are20:33
elodillesclarkb: so, though openstack/releases repository contains the correct hash for newton-eol of requirements branch, it was not tagged yet, as i wanted to tag it manually20:33
clarkbelodilles: oh can you share that?20:33
clarkbbut I think what I would do is make stable/newton again from that sha right now20:34
clarkbthen go back through your process20:34
fungid94785ceb702587131ce98a1b9f05b2869a66180 refs/remotes/origin/stable/newton20:34
elodillesclarkb: here we have the hash: https://review.opendev.org/c/openstack/releases/+/83857120:34
fungithat's the last one i had for it as well20:34
opendevreviewMerged openstack/project-config master: Install setfacl on test nodes  https://review.opendev.org/c/openstack/project-config/+/84321020:34
clarkbelodilles: ya so in gerrit create a new branch for stable/newton with that set as the ref20:34
clarkbthen you should be able to go back and tag it and then remove the branc hagain20:35
clarkbBut also ensuring that you don't delete branches without a tag by comparing the tag and the branch head sha and recording every sha head for each branch deleted is a good idea as future improvements to the tooling20:35
clarkbelodilles: you should have permissions to do that via the gerrit web ui. Are you planning to do the branch creation as suggested?20:36
elodillesclarkb: OK, so now i'm creating stable/newton with hash d94785ceb702587131ce98a1b9f05b2869a6618020:36
clarkbyes that is what I would do then start the process over again20:37
elodillesclarkb: Error 403 (Forbidden): update for creating new commit object not permitted20:37
elodillesso gerrit does not allow that :S20:37
clarkbwell I think that is saying the commit has alredy been deleted?20:38
clarkbthe gc runs daily at 04:17 UTC but maybe when you tell gerrit to delete a branch it prunes automatically20:38
elodilles:S20:38
clarkb"creating new commit object not permitted" specifically doesn't seem like a branch creation problem but a I cannot create that commit for you implying it is gone20:39
clarkbin that case someone will probably have to push it back to gerrit20:39
clarkbfungi: ^ unless you haev better ideas20:40
clarkbthat commit is still in the giteas which is what I expected20:43
clarkb(just not pointed to)20:43
clarkbI'm more wary of running git show on the running repo behind gerrit20:43
clarkbelodilles: how did you try to create the branch?20:44
elodillesclarkb: here, with 'create new' >>> https://review.opendev.org/admin/repos/openstack/requirements,branches20:45
clarkbrunning as my admin account I get `fatal: not permitted: create on refs/heads/stable/newton`. I can try escalating privs even further20:46
elodillesclarkb: and can you maybe simply tag d94785ceb702587131ce98a1b9f05b2869a66180 with newton-eol? as actually that would be enough and maybe it would be easier to do (or am i wrong?) :/20:48
clarkbits not easier because then I have to go pull my key out of cold storage and it will be the wrong key20:48
clarkbfungi: any objection to me trying to run gerrit create-branch openstack/requirements stable/newton d94785ceb702587131ce98a1b9f05b2869a66180 as project boostrapper?20:49
clarkbjust in case this is a corner case acl problem and not an issue with the underlying git repo?20:49
clarkbI went ahead and ran it and it didn't fail20:50
clarkbelodilles: https://review.opendev.org/admin/repos/openstack/requirements,branches shows it now20:50
clarkbelodilles: https://opendev.org/openstack/requirements/commits/branch/stable/newton20:51
elodillesclarkb: phew. thanks! \o/20:51
clarkbelodilles: I think you should be good now and can restart the process. I don't understand why we got those permissiosn errors as admin and as a release manager. I thought the acls allowed creating branches20:51
elodillessorry for the trouble :S20:51
clarkbit may be that beacuse the sha wasn't referred to be anything it needed extra perms20:52
clarkb"gerrit create-branch openstack/requirements stable/newton d94785ceb702587131ce98a1b9f05b2869a66180" is the ssh command I ran as a project boot strapper for the record20:52
clarkb'fatal: not permitted: create on refs/heads/stable/newton' is what I got when I was an admin and not bootstrapper20:56
clarkbso ya I suspect that because the commit isn't already know by a ref gerrit is maybe not smart enough to know it may still be there20:56
elodillesclarkb: i will postpone the deletion to another day (that was my original plan, too, but i forgot it and deleted the newton branch), as I have to setup a key first to be able to do signed tags20:56
clarkbelodilles: why not update the job that does it to run if the tag doesn't already exist rather than caring about openstack management state?20:57
clarkbwhat matters is the git repo state not openstacks rules20:57
fungiclarkb: sorry, stepped away for dinner, no objection but sounds like you discovered another gerrit quirk20:59
elodillesclarkb: you are right, maybe that should be done. i was just not sure, to worth it as we have some old stale branch that was somehow missed to be tagged with newton-eol, mitaka-eol and some older, for several years ago20:59
clarkbfungi: no worries. I figured it wasn't going to make anythin worse as I'd already confirmed my local copy of the repo had that as the branch head21:01
clarkbfrom whenever I last updated21:01
clarkbI'm about to pop out on a bike ride myself21:01
elodillesclarkb: the whole story is related to my mail: http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028550.html21:01
clarkbI think manually tagging is fine too. It just seems like maybe that rule is bad if it allows this siutation to happen so maybe reconsider the rule21:02
fungii also realize now that i misread one of the questions in that ml post21:03
fungino, nevermind i didn't misread it21:03
elodillesclarkb: yepp, though i hope similar situation will not happen whenever these older branches are cleaned21:03
elodillesclarkb: thanks again for the help!21:03
elodilleshave a nice bike ride!21:04
fungiyou had "tag branches with *-eol where that is missing" as one of the actions there, i guess it was just overlooked for stable/newton on openstack/requirements21:04
* elodilles needs some sleep anyway21:04
fungiget some sleep elodilles! this will keep ;)21:04
clarkbplease double check the branch exists as expected first so that the 04:17 GC doesn't do something we don't want21:05
clarkbbut I think we are good if you confirm21:05
elodillesfungi: thanks o:)21:05
elodillesclarkb: in gitea i can see it, so that looks OK21:06
fungiif d94785c is the correct last known state, i have it here in my local repo as well so can always push the missing commits if really needed21:06
clarkbelodilles: doulbe check at https://review.opendev.org/admin/repos/openstack/requirements,branches too21:07
clarkbbut ya I think it is good21:07
elodillesI can see it there, too21:08
clarkbalright I'm off for a bit. Back later21:08
fungibut would definitely be good for the branch delete script to spit out the result of `git show-ref origin/stable/whatever` before deletion (and after a remote update of course)21:08
fungijust so that next time there's no question as to what the last known state of the branch was before it was deleted21:09
elodillesfungi: to be honest, the script what is meant to be used does check if the tag exists and matches with the head ( list_eol_stale_branches.sh )21:11
*** dviroel is now known as dviroel|out21:11
elodillesfungi: but since these are special cases, as I mentioned in my mail, it needs some manual tagging & deletion21:12
fungigot it21:16
elodillesbut definitely i will add some extra checks (with some scripting) before i continue with the stable/newton and older branch cleanup :S21:17
elodillesfortunately in the usual cases I have to run 'list_eol_stale_branches.sh' which is safe in this sense :) with that, this kind of error is not possible21:19
elodillesbut now i really need to sleep. thanks again for the help! o/21:21
opendevreviewIan Wienand proposed openstack/openstack-zuul-jobs master: wheels: Add "wheel" to build venv  https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/84322223:33

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!