| airship-irc-bot | <mf4716> URGENT: V2.0- reviews needed for GA: https://review.opendev.org/c/airship/treasuremap/+/778728 | 00:00 |
|---|---|---|
| *** uzumaki has quit IRC | 02:11 | |
| *** uzumaki has joined #airshipit | 03:10 | |
| *** uzumaki has quit IRC | 04:10 | |
| *** uzumaki has joined #airshipit | 05:52 | |
| *** uzumaki has quit IRC | 05:58 | |
| airship-irc-bot | <sreejith.punnapuzha> GM Team, Please review this commit. https://review.opendev.org/c/airship/airshipctl/+/783718 -> this is to add ssh key generate functionality from generate-secrets phase. | 13:03 |
| airship-irc-bot | <sreejith.punnapuzha> Can i get a review on this commit? https://review.opendev.org/c/airship/images/+/783877 -> document change to trigger image publish in images repo. last image publish have failed. | 13:38 |
| airship-irc-bot | <pramchan> Let me try review few today. Is there one with subdmain? | 14:16 |
| airship-irc-bot | <pramchan> If not will just pick few priority ones today. Thx | 14:20 |
| airship-irc-bot | <niha.twinkle> Hi Team, please review this PS related to airshipctl cluster list cmd https://review.opendev.org/c/airship/airshipctl/+/776472 (need another +2 and WF +1) needed for V2 GA | 14:30 |
| airship-irc-bot | <outbackdingo> last minute jam sessions to meet GA i suspect... :) | 15:17 |
| airship-irc-bot | <mattmceuen> +1 :) | 15:17 |
| airship-irc-bot | <mattmceuen> https://review.opendev.org/c/airship/docs/+/745974 | 16:13 |
| airship-irc-bot | <mattmceuen> would like to get that into the v2.0 release - layering documentation | 16:13 |
| airship-irc-bot | <mattmceuen> It's been reviewed to death for 3/4 of a year :slightly_smiling_face: We can keep tweaking it in 2.1 | 16:14 |
| airship-irc-bot | <alexander.hughes> Issuing my rubber stamp seal of approval | 16:14 |
| airship-irc-bot | <mattmceuen> lol tyvvm | 16:14 |
| airship-irc-bot | <mattmceuen> There are more ideas in the comments for enhancements to this documentation - @mf4716 I think we should refer back to them when we enhance this documentation in 2.1 | 16:17 |
| airship-irc-bot | <mf4716> +1 @mattmceuen | 17:58 |
| *** uzumaki has joined #airshipit | 18:00 | |
| *** spy is now known as antonym | 18:10 | |
| *** roman_g has joined #airshipit | 18:26 | |
| *** muhaha has joined #airshipit | 18:38 | |
| airship-irc-bot | <mattmceuen> Team, we're hitting more errors from our nodepool/citycloud infra than normal -- weird things like logs & other postmortem info not being logged back to zuul | 19:15 |
| airship-irc-bot | <mattmceuen> We think it's because we're putting more load on it than normal, bu trying to get a bunch of airshipctl (citycloud-hosted gates running pre-merge) and treasuremap (citycloud-hosted gates running on every patch) merged today | 19:16 |
| airship-irc-bot | <mattmceuen> I want to propose: 1. turn integration gating OFF in treasuremap entirely -- freeing capacity up for airshipctl gating 2. get required airshipctl & treasuremap changes for v2.0 merged 3. turn treasuremap gating back on and test all the merged changes simultaneously, after the fact | 19:18 |
| airship-irc-bot | <mattmceuen> If we can get things merged, I think we can turn the treasuremap gates back on right after, in the next day or so. The gates are non-voting at the moment. | 19:18 |
| airship-irc-bot | <mattmceuen> Thoughts or concerns? | 19:19 |
| *** muhaha has quit IRC | 19:20 | |
| roman_g | mattmceuen go on. +2 from me. | 19:21 |
| airship-irc-bot | <mattmceuen> Thx roman_g | 19:21 |
| airship-irc-bot | <raliev> seems we have no other choice, so I agree @mattmceuen :slightly_smiling_face: | 19:22 |
| *** muhaha has joined #airshipit | 19:24 | |
| roman_g | mattmceuen although I don't see significant problems so far https://grafana.opendev.org/d/QQzTp6EGz/nodepool-airship-citycloud?orgId=1&from=now-2d&to=now | 19:24 |
| airship-irc-bot | <mattmceuen> Yeah, the errors have been a bit mysterious roman_g -- maybe different than we've seen before? I'll find some, or @raliev you might have some handy | 19:25 |
| airship-irc-bot | <mattmceuen> Here's the change to turn voting off: https://review.opendev.org/c/airship/treasuremap/+/783960 | 19:25 |
| airship-irc-bot | <mattmceuen> Oh this one is even more different :slightly_smiling_face: https://zuul.opendev.org/t/openstack/build/6c2c51bc8ea546a19c68d12e5b115e43 | 19:26 |
| airship-irc-bot | <mattmceuen> ssh-looking errors: WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! | 19:27 |
| airship-irc-bot | <mattmceuen> when trying to collect logs etc | 19:27 |
| roman_g | Errors directly related to CityCloud are RETRY_LIMIT errors. FAILURE means failure in code, and TIMED_OUT means that check did not complete in about 2h time. In case we have TIMED_OUT, we wouldn't capture the logs properly. | 19:27 |
| roman_g | Once this one https://review.opendev.org/c/airship/airshipctl/+/783125 gets merged (it got WF+1 already), we would hopefully lower number of TIMED_OUT errors. | 19:29 |
| airship-irc-bot | <raliev> the thing is that we started to merge several PS in the morning. none of them passed gate jobs yet (around 6 hrs passed). some builds didn't even leave any logs (last two - and no timeout issue) https://zuul.opendev.org/t/openstack/builds?job_name=airship-airshipctl-gate-script-runner and nodes are being rescheduling | 19:30 |
| airship-irc-bot | <kk6740> just make sure you don’t hit rechecks too much | 19:32 |
| airship-irc-bot | <mattmceuen> Konstantine, how do you feel about turning the checks off temporarily in treasuremap to let things get merged, then pick up the pieces? | 19:33 |
| roman_g | mattmceuen https://zuul.opendev.org/t/openstack/build/6c2c51bc8ea546a19c68d12e5b115e43/console this one looks really creepy. We don't change .ssh/ and /etc/ssh, do we? | 19:33 |
| airship-irc-bot | <kk6740> Roman, we don’t | 19:33 |
| airship-irc-bot | <mattmceuen> I don't think so Roman! agree, "creepy" is a good description.... | 19:33 |
| airship-irc-bot | <kk6740> @mattmceuen i am thinking about this :slightly_smiling_face: | 19:34 |
| roman_g | Or at least not in a way to change identity completely and remove keys | 19:34 |
| airship-irc-bot | <kk6740> trying to look into history | 19:34 |
| airship-irc-bot | <raliev> I don't observe any "rechecks" overload :slightly_smiling_face: | 19:36 |
| airship-irc-bot | <kk6740> yes, and lets keep it this way | 19:37 |
| airship-irc-bot | <kk6740> @mattmceuen you know i am against disabling any CI tests :slightly_smiling_face:, what is the deadline when we MUST have everything merged? | 19:40 |
| airship-irc-bot | <mattmceuen> Goal is EOD today, maybe lagging to tomorrow morning for final push (planning on cutting the new branch tomorrow) | 19:40 |
| airship-irc-bot | <mattmceuen> so I'd say we should turn it on no later than tmo morning | 19:41 |
| airship-irc-bot | <mattmceuen> and as soon as possible after things merge | 19:41 |
| airship-irc-bot | <mattmceuen> Note: things can still merge into the new v2.0 branch after it is cut, but only critical items for the release | 19:42 |
| airship-irc-bot | <kk6740> since we don’t have much development today/tomorrow due to release, I feel that it is ok to disable | 19:46 |
| roman_g | mattmceuen kk6740 just thought to move them to experimental, not to comment out | 19:50 |
| roman_g | What is your opinion? | 19:51 |
| airship-irc-bot | <kk6740> with experimental its even better | 19:51 |
| roman_g | mattmceuen highlight me when you update PS if you agree with experimental. I will +2. | 19:53 |
| roman_g | https://review.opendev.org/c/airship/treasuremap/+/783960 | 19:53 |
| airship-irc-bot | <mattmceuen> Yeah I think that's a good idea -- updated that^ @roman_g @kk6740 @raliev | 19:59 |
| *** muhaha has quit IRC | 20:09 | |
| airship-irc-bot | <kk6740> anyone see https://zuul.opendev.org/t/openstack/status failing? | 20:11 |
| airship-irc-bot | <kk6740> with some 503 | 20:11 |
| airship-irc-bot | <mattmceuen> that link specifically? nope, loads for me | 20:12 |
| airship-irc-bot | <kk6740> its back up | 20:12 |
| airship-irc-bot | <kk6740> but it seems like everything was reseted | 20:12 |
| airship-irc-bot | <kk6740> i will recheck this patchset https://review.opendev.org/c/airship/airshipctl/+/782850 | 20:15 |
| *** uzumaki has quit IRC | 20:42 | |
| *** roman_g has quit IRC | 20:52 | |
| *** uzumaki has joined #airshipit | 21:13 | |
| airship-irc-bot | <mattmceuen> Another one for v2.0: https://review.opendev.org/c/airship/treasuremap/+/783899/ | 21:15 |
| airship-irc-bot | <mattmceuen> https://review.opendev.org/c/airship/treasuremap/+/778728 | 21:26 |
| airship-irc-bot | <mattmceuen> https://review.opendev.org/c/airship/treasuremap/+/779413 | 21:26 |
| airship-irc-bot | <ao129q> lost this one. wonder if we can merge it https://review.opendev.org/c/airship/airshipctl/+/779032 | 21:52 |
| airship-irc-bot | <kk6740> unfortunatelly first patchset in merge chain failed, because of vailed VM, and now all tree remaining patchsets re being resteted together :( | 22:23 |
| *** openstackstatus has quit IRC | 22:42 | |
| *** openstack has joined #airshipit | 22:42 | |
| *** ChanServ sets mode: +o openstack | 22:42 | |
| *** antonym has quit IRC | 22:43 | |
| airship-irc-bot | <mattmceuen> siiiiigh | 23:03 |
| airship-irc-bot | <mattmceuen> The treasuremap gate-disable change just merged | 23:04 |
| airship-irc-bot | <kk6740> The rest treasure map have +2 and wf? | 23:05 |
| *** antonym has joined #airshipit | 23:09 | |
| airship-irc-bot | <mattmceuen> Two of the three do, but the third one failed with a -1 from zuul -- https://review.opendev.org/c/airship/treasuremap/+/779413 | 23:10 |
| airship-irc-bot | <mattmceuen> I'll recheck the one that failed, it was complaining about it's dependency failing to merge (it's dependency is going through the gate again now) | 23:11 |
| airship-irc-bot | <sidney.shiba> @mattmceuen the PS https://review.opendev.org/c/airship/treasuremap/+/779413 depends on https://review.opendev.org/c/airship/treasuremap/+/778728 and that might be the reason of Zuul -1. | 23:18 |
| airship-irc-bot | <mattmceuen> Yeah I think you're right, and that one is going through gating now, so I'm optimistic that with a recheck everything will go through | 23:19 |
| airship-irc-bot | <sidney.shiba> PS https://review.opendev.org/c/airship/treasuremap/+/783899 just merged. | 23:20 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!