ianw | goern: yes, i don't think there's a great answer unfortunately ... i have also had some "fun" dealing with jobs that use secrets | 00:04 |
---|---|---|
ianw | depending on the situation, i did a lot of out-of-gate testing with local roles and patching in the secrets | 00:05 |
goern | :/ | 00:05 |
*** ssbarnea has quit IRC | 01:33 | |
*** swest has quit IRC | 02:29 | |
*** swest has joined #zuul | 02:43 | |
*** bhavikdbavishi has joined #zuul | 03:21 | |
*** bhavikdbavishi has quit IRC | 03:42 | |
*** bhavikdbavishi has joined #zuul | 03:57 | |
*** pcaruana has joined #zuul | 05:23 | |
*** bhavikdbavishi has quit IRC | 05:27 | |
*** pcaruana has quit IRC | 05:32 | |
*** swest has quit IRC | 05:34 | |
*** swest has joined #zuul | 06:22 | |
*** swest has quit IRC | 06:27 | |
*** swest has joined #zuul | 06:27 | |
*** chkumar|off is now known as chandankumar | 06:41 | |
*** sshnaidm|off is now known as sshnaidm|rover | 07:07 | |
*** goern has quit IRC | 07:39 | |
*** goern has joined #zuul | 07:40 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: WIP: Try to reproduce hanging paused job https://review.openstack.org/615493 | 08:05 |
*** pcaruana has joined #zuul | 08:06 | |
*** themroc has joined #zuul | 08:30 | |
*** jpena|off is now known as jpena | 08:56 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: WIP: Try to reproduce hanging paused job https://review.openstack.org/615493 | 08:58 |
*** pcaruana has quit IRC | 09:31 | |
*** pcaruana has joined #zuul | 09:33 | |
*** panda has joined #zuul | 10:05 | |
*** electrofelix has joined #zuul | 10:06 | |
*** ssbarnea has joined #zuul | 11:04 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Resume paused job with skipped children https://review.openstack.org/615493 | 11:06 |
tobiash | corvus: this fixes two cases where we could miss a job resume which results in buildsets that are stuck forever ^ | 11:08 |
*** rfolco|off has joined #zuul | 11:22 | |
*** rfolco|off is now known as rfolco|ruck | 11:24 | |
*** jpena is now known as jpena|lunch | 12:20 | |
Shrews | tobiash: thx for +A that role | 12:33 |
tobiash | Shrews: the related nodepool changes can land directly after too | 12:34 |
Shrews | yep | 12:34 |
openstackgerrit | Merged openstack-infra/zuul master: Fix unreachable nodes detection https://review.openstack.org/602829 | 12:34 |
openstackgerrit | Merged openstack-infra/zuul master: Also retry the job if a post job failed with unreachable https://review.openstack.org/602830 | 12:36 |
openstackgerrit | Merged openstack-infra/zuul-jobs master: Add role to install kubernetes https://review.openstack.org/605823 | 12:48 |
*** rlandy has joined #zuul | 12:49 | |
*** AJaeger has quit IRC | 13:22 | |
*** jpena|lunch is now known as jpena | 13:25 | |
openstackgerrit | Monty Taylor proposed openstack-infra/nodepool master: Implement an OpenShift resource provider https://review.openstack.org/570667 | 13:28 |
openstackgerrit | Monty Taylor proposed openstack-infra/nodepool master: Implement an OpenShift Pod provider https://review.openstack.org/590335 | 13:28 |
*** panda is now known as panda|bbl | 13:36 | |
*** AJaeger has joined #zuul | 13:37 | |
tobiash | interesting, post failure with finger link on https://review.openstack.org/535557 | 13:42 |
openstackgerrit | Merged openstack-infra/zuul master: web: uses queues uid to preserve state on change https://review.openstack.org/614933 | 13:50 |
*** panda|bbl is now known as panda | 14:15 | |
openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: WIP - Pagure driver https://review.openstack.org/604404 | 14:39 |
openstackgerrit | Merged openstack-infra/nodepool master: Implement a Kubernetes driver https://review.openstack.org/535557 | 14:54 |
openstackgerrit | Merged openstack-infra/nodepool master: Add tox functional testing for drivers https://review.openstack.org/609515 | 14:55 |
Shrews | neat. so i guess that's ^ a real thing now | 14:55 |
corvus | \o/ we should try it out :) | 14:57 |
*** sdoran has left #zuul | 15:39 | |
*** pcaruana has quit IRC | 16:06 | |
openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Proposed spec: tenant-scoped admin web API https://review.openstack.org/562321 | 16:34 |
*** openstackgerrit has quit IRC | 16:48 | |
*** themroc has quit IRC | 16:52 | |
*** sshnaidm|rover is now known as sshnaidm|afk | 16:53 | |
*** openstackgerrit has joined #zuul | 17:05 | |
openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: WIP - Pagure driver https://review.openstack.org/604404 | 17:05 |
*** caphrim007 has joined #zuul | 17:21 | |
*** jpena is now known as jpena|off | 17:48 | |
*** electrofelix has quit IRC | 18:43 | |
*** caphrim007 has quit IRC | 18:47 | |
corvus | clarkb, mordred, tobiash, fungi, Shrews: https://review.openstack.org/608453 is ready when you have a second -- it improves the experience new users (discovered during quick-start development and later confirmed by quick-start users) | 19:11 |
corvus | "experience *for* new users" | 19:12 |
openstackgerrit | Merged openstack-infra/zuul master: Small script to scrape Zuul job node usage https://review.openstack.org/613674 | 19:16 |
Shrews | corvus: should we explicitly close the temp client there? | 19:25 |
Shrews | corvus: i ask because of the comment here: http://docs.paramiko.org/en/2.4/api/client.html#paramiko.client.SSHClient.close | 19:25 |
clarkb | Shrews: oh you know thats a good question | 19:25 |
clarkb | I think yes | 19:25 |
* clarkb will change vote | 19:25 | |
corvus | yes that is worth a big fat -1 :) | 19:26 |
* Shrews posts big fat -1 | 19:26 | |
mordred | Shrews wins | 19:33 |
tobiash | mordred: zuul stream expert question | 20:13 |
tobiash | mordred: I've found the reason why we don't get more than one console stream of command/shell in loop tasks | 20:14 |
tobiash | mordred: but I have no clue how to fix that | 20:14 |
tobiash | mordred: the thing is that https://git.zuul-ci.org/cgit/zuul/tree/zuul/ansible/callback/zuul_stream.py#n172 will stop reading the log after the first "[Zuul] Task exit code" | 20:15 |
tobiash | however we have one streaming session for the entire loop and the tasks are there one after another | 20:16 |
tobiash | but we don't have knowledge in advance how many there should be as there could be skipped tasks in the loop | 20:16 |
mordred | tobiash: oh - bother | 20:16 |
tobiash | and we only have item ok/failed callbacks but no item start callbacks | 20:17 |
tobiash | so streaming per item is also not an option | 20:17 |
tobiash | this is a little bit annoying | 20:18 |
*** rlandy is now known as rlandy|brb | 20:21 | |
mordred | yah. that is very un-awesome | 20:23 |
mordred | I think we may need to finish the streaming rework | 20:23 |
tobiash | at least I don't have any further idea how to solve that | 20:25 |
tobiash | mordred: how much is needed to finish the streaming rework? | 20:25 |
mordred | that's a really good question - let me resurrect the patch and page its context back in to my brain | 20:26 |
tobiash | this was based on some ssh fancyness right? | 20:27 |
mordred | yeah - but it should actually reduce the number of moving parts | 20:28 |
tobiash | I have to note that we also shouldn't break winrm connections (which doesn't have live streaming of commands atm, but that's a different story) | 20:28 |
tobiash | but I think that should be doable to not break other connections as this anyway only applies for command and shell actions right? | 20:30 |
mordred | yes - that's right | 20:32 |
tobiash | mordred: an interims solution might be to give up on live streaming of tasks in loops and instead just post the summary once all items are finished | 20:32 |
mordred | tobiash: hrm yeah - we could do that | 20:33 |
mordred | tobiash: I'm guessing it's less likely that we'll have a loop of long-running shell items | 20:34 |
tobiash | yes, so depending on the state of the streaming rework I could look into that | 20:34 |
mordred | kk | 20:35 |
*** rlandy|brb is now known as rlandy | 20:49 | |
tobiash | mordred: I think not streaming loop tasks is a quite quick solution | 20:54 |
mordred | tobiash: yah - I was just reading the rework change | 20:55 |
mordred | tobiash: https://review.openstack.org/#/c/541434/ | 20:55 |
mordred | tobiash: I think maybe not doing streaming loop tasks for now is better | 20:55 |
mordred | since I don't think finishing that is going to be quick | 20:55 |
mordred | I do think we should do it- so I'm going to try to work on it and stop ignoring it | 20:56 |
tobiash | mordred: yes, I just tried to rebase that for two minutes... | 20:56 |
mordred | yeah. exactly :) | 20:56 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Merger: automatically add new hosts to the known_hosts file https://review.openstack.org/608453 | 21:03 |
corvus | mordred, clarkb, Shrews: ^ fixed | 21:03 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Don't do live streaming in loops https://review.openstack.org/615657 | 21:21 |
tobiash | mordred: ^ | 21:21 |
*** adam_g has quit IRC | 21:43 | |
*** AJaeger_ has joined #zuul | 22:05 | |
*** AJaeger has quit IRC | 22:07 | |
*** adam_g has joined #zuul | 22:17 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!