*** soniya29 is now known as soniya29|ruck | 03:36 | |
*** soniya29|ruck is now known as soniya29|ruck|lunch | 07:57 | |
*** jpena|off is now known as jpena | 08:36 | |
*** soniya29|ruck|lunch is now known as soniya29|ruck | 08:54 | |
opendevreview | yatin proposed openstack/tempest master: Use assertLessEqual for downtime validation https://review.opendev.org/c/openstack/tempest/+/874232 | 12:03 |
---|---|---|
ykarel | dansmith, when you get chance can you check comment https://bugs.launchpad.net/glance/+bug/1999800 | 12:17 |
*** artom_ is now known as artom | 12:31 | |
dansmith | ykarel: ah yep, I never saw it fail there so it wasn't on my radar, but makes sense | 14:33 |
dansmith | ykarel: did you already start another patch? | 14:33 |
opendevreview | Dan Smith proposed openstack/tempest master: Add retries to more glance location tests https://review.opendev.org/c/openstack/tempest/+/874260 | 14:57 |
dansmith | ykarel: ^ | 14:57 |
dansmith | hopefully that mean the retry loop is working for the other failures and just put pressure on these to fail | 14:58 |
ykarel | dansmith, Thanks and nope i didn't start any patch :) | 15:13 |
dansmith | ykarel: ack | 15:13 |
opendevreview | Merged openstack/devstack master: Added recursive for deletion of $OVN_RUNDIR https://review.opendev.org/c/openstack/devstack/+/837207 | 16:30 |
clarkb | re gate troubles, I figured I'd remind ya'll that we can stick gate bugfixes at the beginning of the gate to reduce the thrash if they are stuck behind changes that are less likely to pass | 16:50 |
opendevreview | Dan Smith proposed openstack/tempest master: Add retries to more glance location tests https://review.opendev.org/c/openstack/tempest/+/874260 | 16:52 |
clarkb | doing a reshuffle like that kicks out the currently running gate jobs, reorders git repo commits, then starts again. Which means if we can batch them up that is ideal. Also if things are stale enough with it then not doing it is also good | 16:53 |
dansmith | clarkb: you're saying just promote recently-approved fixes to the front of the gate? | 16:54 |
dansmith | I thought that was generally frowned-upon except for emergencies, but if not, that seems like a good strategy to me | 16:54 |
clarkb | its frowned upon if the cost of evicting all running jobs and restarting everything is higher than just letting things run. I don't know where we are on that cost benefit right now. | 16:55 |
clarkb | gate thrashing tends to have a high impact though and if reviewers aren't prioritizing fixes then we can prioritzie for them :) | 16:56 |
dansmith | ack | 16:56 |
dansmith | I guess I'm more thinking of promoting not-yet-passing-tests changes as the real risk | 16:57 |
dansmith | I think we're well past the point of worrying about thrashing the gate by promoting fixes to the front of the queue | 16:57 |
dansmith | meaning, I definitely think it'd be worth doing that | 16:57 |
dansmith | this past weekend a bunch of us spent all (friggin) weekend trying to land one fix that was 100% blocking several projects because it would keep failing something unrelated in check, gate, etc | 16:58 |
dansmith | continually promoting that to the front of the queue would have no doubt made it much quicker | 16:58 |
*** jpena is now known as jpena|off | 17:01 | |
opendevreview | Frank Ritchie proposed openstack/tempest master: Allow capital letters in mac address regex https://review.opendev.org/c/openstack/tempest/+/873973 | 17:12 |
gmann | dansmith: mysql thigns, you can try enabling in tempet periodic jobs https://github.com/openstack/tempest/blob/b915c7f35ff105d8ac613cc171cd9235a96eac8d/zuul.d/project.yaml#L186 | 17:59 |
dansmith | okay, how often are those run? | 18:00 |
gmann | i think every night | 18:01 |
dansmith | oh okay | 18:01 |
gmann | and they are in experimental also so on demand run | 18:01 |
dansmith | but .. we'd have to merge the devstack patch first yeah? | 18:01 |
dansmith | do you want me to remove it from devstack-multinode and only do the periodic for now? | 18:02 |
gmann | yes, i have approved that | 18:02 |
gmann | devstack-multonode is ok to verify it in devstack gate | 18:02 |
dansmith | oh okay | 18:04 |
dansmith | cool, I'll make that tempest change | 18:04 |
gmann | thanks | 18:06 |
dansmith | gmann: so those jobs listed in periodic aren't run on demand anywhere else? | 18:07 |
dansmith | and are you thinking *all* of them or just a few for sniffing? maybe -all -slow-parallel -full-parallel? | 18:08 |
gmann | dansmith: i do not think they run anywhere else than tempest. yes in -all -slow-parallel -full-parallel only will be good | 18:09 |
dansmith | gmann: cool | 18:11 |
opendevreview | Dan Smith proposed openstack/tempest master: Use MYSQL_REDUCE_MEMORY in some periodic jobs https://review.opendev.org/c/openstack/tempest/+/873653 | 18:15 |
dansmith | gmann: this passed the (relevant portion) of ceph-multistore: https://review.opendev.org/c/openstack/tempest/+/874260 | 19:00 |
dansmith | tl;dr: there are a couple more places where we can hit that glance problem, and now that we're retrying the two I changed, we're hitting the others (which I assume means the retries are working) | 19:01 |
gmann | ack, will check it | 19:02 |
opendevreview | Artom Lifshitz proposed openstack/hacking master: Bump flake8 to 5.0 to pick up fixes https://review.opendev.org/c/openstack/hacking/+/873738 | 19:07 |
dansmith | dude, +1 from zuul first try.. that has to be some sort of record lately | 19:49 |
* dansmith buys a lottery ticket | 19:49 | |
gmann | :) | 20:02 |
gmann | dansmith: is this blocking gate ? else I can leave kopecmartin to +W https://review.opendev.org/c/openstack/tempest/+/874260 | 21:08 |
dansmith | gmann: not blocking, this just reduces some more occasional fails | 21:09 |
gmann | dansmith: ack | 21:09 |
opendevreview | Frank Ritchie proposed openstack/tempest master: Allow capital letters in mac address regex https://review.opendev.org/c/openstack/tempest/+/873973 | 21:19 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!