| opendevreview | Ke Niu proposed openstack/openstack-zuul-roles master: remove unicode from code https://review.opendev.org/c/openstack/openstack-zuul-roles/+/851185 | 00:43 |
|---|---|---|
| *** rlandy|bbl is now known as rlandy | 01:39 | |
| *** rlandy is now known as rlandy|out | 01:39 | |
| opendevreview | Ian Wienand proposed openstack/project-config master: trigger-rtd: fix role syntax https://review.opendev.org/c/openstack/project-config/+/851274 | 02:10 |
| opendevreview | Ian Wienand proposed openstack/project-config master: linter: update some YAML whitespace issues https://review.opendev.org/c/openstack/project-config/+/851275 | 02:10 |
| opendevreview | Ian Wienand proposed openstack/project-config master: linter: add name to blocks https://review.opendev.org/c/openstack/project-config/+/851276 | 02:10 |
| opendevreview | Ian Wienand proposed openstack/project-config master: linter: use spaces between filters in jinja https://review.opendev.org/c/openstack/project-config/+/851277 | 02:10 |
| opendevreview | Ian Wienand proposed openstack/project-config master: linter: update ansible-lint; add auto-download of roles https://review.opendev.org/c/openstack/project-config/+/851278 | 02:10 |
| opendevreview | Ian Wienand proposed openstack/project-config master: linter: update ansible-lint; add auto-download of roles https://review.opendev.org/c/openstack/project-config/+/851278 | 03:10 |
| opendevreview | Ian Wienand proposed openstack/project-config master: linter: update ansible-lint; add auto-download of roles https://review.opendev.org/c/openstack/project-config/+/851278 | 03:17 |
| opendevreview | Ian Wienand proposed openstack/project-config master: linter: update ansible-lint; add auto-download of roles https://review.opendev.org/c/openstack/project-config/+/851278 | 03:29 |
| opendevreview | Ian Wienand proposed openstack/openstack-zuul-jobs master: linters: minor cosmetic updates https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/851339 | 05:24 |
| opendevreview | Ian Wienand proposed openstack/openstack-zuul-jobs master: linters: fix yaml whitespace https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/851340 | 05:24 |
| opendevreview | Ian Wienand proposed openstack/openstack-zuul-jobs master: linters: update to ansible-lint 6 https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/851341 | 05:24 |
| *** ysandeep|out is now known as ysandeep | 05:28 | |
| *** ysandeep is now known as ysandeep|brb | 06:03 | |
| *** ysandeep|brb is now known as ysandeep | 06:36 | |
| *** jpena|off is now known as jpena | 07:38 | |
| *** jpodivin_ is now known as jpodivin | 08:37 | |
| *** ysandeep is now known as ysandeep|lunch | 10:21 | |
| *** rlandy|out is now known as rlandy | 10:38 | |
| *** ysandeep|lunch is now known as ysandeep | 10:58 | |
| *** dviroel|afk is now known as dviroel | 11:31 | |
| *** ysandeep is now known as ysandeep|afk | 12:53 | |
| *** dasm|off is now known as dasm | 12:57 | |
| *** ysandeep|afk is now known as ysandeep | 13:15 | |
| lajoskatona | Hi, As I see there's a lot of post_failure in recent job runs, shall we wait or shall we recheck? | 14:10 |
| fungi | lajoskatona: it should be fine now. rackspace let their keystone api cert expire for a couple of hours | 14:16 |
| fungi | which broke our ability to upload logs to their swift | 14:17 |
| fungi | they fixed it an hour ago (13:18 utc) | 14:17 |
| lajoskatona | fungi: thanks, sounds good | 14:20 |
| *** ysandeep is now known as ysandeep|out | 14:50 | |
| elodilles | clarkb fungi : i'm about to run the usual EOL'd branch cleanup script, if i not mistaken every issue around zuul and things are sorted out by now, right? | 16:56 |
| clarkb | elodilles: I'm not sure about the issue we were discussing yesterday with the proposal jobs | 16:57 |
| clarkb | I don't think cleaning up branches triggers any proposal jobs so either way it is probably fine | 16:57 |
| melwitt | has anyone else stopped receiving gerrit email notifications from the zuul user within the last couple of days? | 16:58 |
| elodilles | clarkb: that proposal job is fine with your patch: https://zuul.opendev.org/t/openstack/builds?job_name=propose-update-constraints&skip=0 | 16:59 |
| elodilles | clarkb: so thanks again for it :) | 16:59 |
| clarkb | melwitt: I got an email from review@openstack.org for a zuul comment 2 hours ago | 17:00 |
| melwitt | ack | 17:01 |
| *** jpena is now known as jpena|off | 17:31 | |
| opendevreview | James E. Blair proposed openstack/project-config master: Synchronize diskimages on builders https://review.opendev.org/c/openstack/project-config/+/851444 | 17:36 |
| melwitt | clarkb: something I noticed, when I go onto a review and hover over the zuul user, it shows no email for it whereas the other CIs do. but maybe that's normal | 17:37 |
| melwitt | looks like VMware NSX CI also has no email | 17:39 |
| *** gibi is now known as gibi_pto | 17:43 | |
| fungi | melwitt: we can check the mta logs on the gerrit server, maybe someone's added it to a spam blocklist or something | 17:45 |
| melwitt | my email notifications are (and have been) set to "Only comments left by others" | 17:45 |
| melwitt | I did all the basic things like check spam, "all mail" in gmail, looking for any trace of "zuul" | 17:47 |
| melwitt | last email I got from zuul was Wed, 27 Jul 2022 04:44:58 -0700 which would be 11:44:58 UTC | 17:49 |
| fungi | thanks | 17:51 |
| fungi | melwitt: most recent delivery we recorded to your gmail address was 2022-07-28 11:05:41 utc (so today) | 17:52 |
| fungi | google's servers accepted the message on your behalf reporting this queue id: "250 2.0.0 OK v36-20020a05622a18a400b0031eea625bf4si272034qtc.597 - gsmtp" | 17:53 |
| melwitt | fungi: thank you for checking that | 17:53 |
| melwitt | ugh, I wonder what is happening | 17:53 |
| * melwitt continues looking | 17:54 | |
| fungi | that's not specifically the ones from zuul's comments though, that's just the last notification gerrit sent you | 17:54 |
| melwitt | oh, right ok | 17:54 |
| fungi | i'm not sure i can easily identify the ones for zuul's comments in the mta log | 17:54 |
| melwitt | yeah I have that one, it was from a person comment on a review | 17:55 |
| fungi | since that's going to be in the to header not part of the smtp exchange | 17:55 |
| opendevreview | James E. Blair proposed openstack/project-config master: Synchronize diskimages on builders https://review.opendev.org/c/openstack/project-config/+/851444 | 17:55 |
| melwitt | hm ok | 17:55 |
| fungi | not seeing any rejections today | 17:56 |
| fungi | i've definitely been getting them for zuul's comments today | 17:56 |
| clarkb | did you upadte your gerrit settings to maybe stop getting those emails? | 17:57 |
| melwitt | no, I have "Only comments left by others" that I haven't changed maybe ever. is there a chance zuul is not considered "others"? | 18:01 |
| clarkb | zuul comments are annotated wtih a tag indicating it is a bot (which is how you can filter it out in the web ui) | 18:01 |
| clarkb | its possible that they do something similar for email when considering who others are. But you said it chagned recently and we haven't chagned gerrit that recently | 18:02 |
| melwitt | I added a new ssh key recently | 18:02 |
| melwitt | I'll try setting it to "Every comment" and see if that works | 18:03 |
| fungi | melwitt: my preferences also says "email notifications: only comments left by others" | 18:06 |
| fungi | i expect that's the default | 18:06 |
| fungi | so probably not the cause | 18:07 |
| fungi | if there's a specific comment you can point to that you think should have resulted in a notification you never received, i can try to cross-reference it in the mta log | 18:07 |
| melwitt | fungi: yes, this was the one that made me notice it https://review.opendev.org/c/openstack/nova/+/826756 | 18:09 |
| melwitt | https://review.opendev.org/c/openstack/nova/+/826756/3#message-26b764e8171770fbb29b8105c9861313e41baf8b | 18:09 |
| fungi | thanks! i'll see what i can dig up in the log | 18:10 |
| melwitt | thank you | 18:10 |
| fungi | for the record, i'm looking for something gerrit would have sent at approximately 03:15:55 utc | 18:11 |
| melwitt | ack, makes sense | 18:12 |
| fungi | the last one gerrit sent you on 2022-07-27 was at 16:11:28 utc (before the log was rotated). the first one on 2022-07-28 was at 03:18:52 utc (after the log was rotated), so it might be that one | 18:13 |
| fungi | though the powerflex ci also commented at approximately that time | 18:14 |
| melwitt | yeah that sounds like it | 18:14 |
| melwitt | oh, true. yeah I have that email | 18:14 |
| fungi | three seconds prior, making me suspect you received that | 18:14 |
| fungi | so gerrit doesn't seem to have tried to deliver the zuul comment to you | 18:14 |
| melwitt | I also have openstack lightbits ci at 03:24 | 18:15 |
| melwitt | and powerkvm ci at 03:48 | 18:15 |
| fungi | i'm looking through all messages sent between 03:15:50-03:15:59 in hopes of spotting something odd | 18:16 |
| fungi | there were two messages injected from gerrit at 03:15:56 with different queue ids | 18:17 |
| fungi | i'll see who got copies of each | 18:17 |
| melwitt | I'm not the "owner" of the patch but I am the current "uploader". and nothing is in the attention set | 18:17 |
| fungi | 1oGu0C-000zqM-Ds and 1oGu0C-000zqO-EY are the two queue ids i suspect at least one of which to be the notification in question | 18:18 |
| fungi | 1oGu0C-000zqM-Ds resulted in outbound messages to what look like ci system accounts exclusively (kvmpower, nova_hyperv_ci, mlnx-openstack-ci) | 18:19 |
| fungi | 1oGu0C-000zqO-EY was sent only to lyarwood | 18:19 |
| melwitt | ok, so it has something to do with the fact that I'm not the owner. lyarwood is | 18:20 |
| fungi | since he's the change owner, i have a feeling that's the one we're looking into | 18:21 |
| fungi | and yeah, i bet uploading a new revision doesn't automatically subscribe you to the change like commenting on it would | 18:21 |
| melwitt | and the reason I never noticed is because (since I took over this patch series from lyarwood) I've generally made comments on the review that go along with push the new revision | 18:22 |
| melwitt | dang | 18:22 |
| fungi | probably the owner, reviewers and cc fields get notified but uploader does not | 18:22 |
| melwitt | it was coincidence that I got all those emails on the other patches | 18:23 |
| melwitt | yeah | 18:23 |
| fungi | and some of the accounts in reviewers and cc lack e-mail addresses, which probably accounts for the limited list of ones notified | 18:23 |
| melwitt | ugh, sorry :( this is never happened before, weirdly, so I never saw the behavior until now | 18:23 |
| fungi | no worries, this surprises me too | 18:23 |
| fungi | also i don't see notifications going to lightbits and powerflex even though they're in the cc, but it looks like they were added after that comment which would explain it | 18:25 |
| fungi | so i *think* this is "working as designed" even if somewhat surprising that it omits the uploader | 18:25 |
| melwitt | yeah, I think you're right | 18:27 |
| fungi | melwitt: i'm also completely willing to entertain there's some other actual delivery problems, so if you have a different scenario you can't explain i'm happy to take a look | 18:28 |
| melwitt | fungi: thank you, I really appreciate it | 18:29 |
| fungi | it's my pleasure, as always! | 18:29 |
| melwitt | :) | 18:29 |
| elodilles | (the list of today's deleted old branches: https://paste.opendev.org/show/bIfEQ0z9Mk6LzxRbJmMy/ ) | 18:49 |
| fungi | thanks elodilles! | 18:50 |
| fungi | i wonder what impact that will have on the periodic-stable build failure messages | 18:50 |
| elodilles | fungi: nothing o:) | 18:51 |
| fungi | probably not substantial yeah, that's a short list | 18:51 |
| elodilles | kayobe and kolla is not the ones that have periodic-stable jobs afair | 18:51 |
| elodilles | fungi: i've just sent this: https://lists.openstack.org/pipermail/openstack-discuss/2022-July/029769.html | 18:56 |
| fungi | awesome | 18:59 |
| elodilles | i'll start proposing pike-eol patches tomorrow. those will help a bit as pike branches generates ~30 mails | 18:59 |
| fungi | that'll be wonderful | 18:59 |
| fungi | thanks again! | 18:59 |
| elodilles | no problem | 18:59 |
| elodilles | i think after we closed pike, probably can continue with queens and rocky (at least) as those are xenail based branches | 19:01 |
| opendevreview | Jeremy Stanley proposed openstack/project-config master: Allow Stackalytics maintainers to rewrite history https://review.opendev.org/c/openstack/project-config/+/851454 | 19:05 |
| elodilles | fungi: i've also proposed these patches to remove murano's constantly failing periodic-stable jobs. if they don't merge it in some days then maybe you could use your power and merge them. in that case we will get rid of another 10 mails per day: https://review.opendev.org/q/I56428c7fed44c8e0970e4ae5c4a46a3c96bdcca4 | 19:27 |
| fungi | elodilles: yep, happy to, just let me know when the time comes | 19:28 |
| elodilles | fungi: ack | 19:28 |
| *** dviroel is now known as dviroel|afk | 20:24 | |
| *** dasm is now known as dasm|off | 21:47 | |
| *** rlandy is now known as rlandy|out | 21:51 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!