Friday, 2020-07-17

*** hamalq_ has quit IRC00:05
*** saneax has quit IRC00:08
*** saneax has joined #zuul00:38
*** rlandy|ruck|afk is now known as rlandy|ruck01:13
*** rlandy|ruck has quit IRC01:46
*** sgw1 has quit IRC02:28
*** sgw1 has joined #zuul02:29
*** sgw1 has quit IRC02:33
*** Goneri has quit IRC02:41
*** rfolco has quit IRC02:41
*** sgw1 has joined #zuul02:59
*** bhavikdbavishi has joined #zuul03:08
*** bhavikdbavishi has quit IRC03:11
*** bhavikdbavishi has joined #zuul03:12
*** bhavikdbavishi has quit IRC03:17
*** saneax has quit IRC03:18
*** bhavikdbavishi has joined #zuul03:22
*** bhavikdbavishi has quit IRC03:29
*** bhavikdbavishi has joined #zuul03:30
*** bhavikdbavishi has quit IRC04:01
*** vishalmanchanda has joined #zuul04:01
*** bhavikdbavishi has joined #zuul04:06
*** harrymichal has joined #zuul04:22
*** sgw1 has quit IRC04:34
*** wuchunyang has joined #zuul04:43
*** wuchunyang has quit IRC04:52
*** wuchunyang has joined #zuul04:58
*** wuchunyang has quit IRC05:02
*** wuchunyang has joined #zuul05:02
*** wuchunyang has quit IRC05:30
*** wuchunyang has joined #zuul05:52
*** bhavikdbavishi1 has joined #zuul06:04
*** bhavikdbavishi has quit IRC06:05
*** bhavikdbavishi1 is now known as bhavikdbavishi06:05
*** bhavikdbavishi has quit IRC06:19
*** bhavikdbavishi has joined #zuul06:20
*** wuchunyang has quit IRC06:24
*** harrymichal has quit IRC06:31
*** marios has joined #zuul06:47
*** bhavikdbavishi has quit IRC06:59
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Fix issues with buildset registry  https://review.opendev.org/74158407:00
*** jcapitao has joined #zuul07:13
*** bhavikdbavishi has joined #zuul07:31
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032807:32
*** tosky has joined #zuul07:33
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032807:34
*** bhavikdbavishi has quit IRC07:35
*** bhavikdbavishi has joined #zuul07:45
*** harrymichal has joined #zuul07:53
*** nils has joined #zuul07:54
*** avass has quit IRC08:17
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032808:30
*** harrymichal has quit IRC08:33
*** harrymichal has joined #zuul08:33
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032808:34
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [WIP][provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032808:35
*** reiterative has joined #zuul08:47
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [WIP][provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032808:57
*** bhavikdbavishi has quit IRC09:05
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [WIP][provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032809:11
*** bhavikdbavishi has joined #zuul09:11
*** bhavikdbavishi1 has joined #zuul09:20
*** harrymichal has quit IRC09:20
*** bhavikdbavishi has quit IRC09:21
*** bhavikdbavishi1 is now known as bhavikdbavishi09:21
*** marios has quit IRC09:38
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032809:41
*** sshnaidm|afk is now known as sshnaidm|off10:16
openstackgerritTobias Henkel proposed zuul/zuul master: Add spec for enhanced regional executor distribution  https://review.opendev.org/66341310:53
*** jcapitao is now known as jcapitao_lunch10:54
openstackgerritTobias Henkel proposed zuul/zuul master: Route streams to different zones via finger gateway  https://review.opendev.org/66496511:25
openstackgerritTobias Henkel proposed zuul/zuul master: Support ssl encrypted fingergw  https://review.opendev.org/66495011:26
*** avass has joined #zuul11:33
*** bhavikdbavishi has quit IRC11:50
*** bhavikdbavishi has joined #zuul11:51
*** rlandy has joined #zuul11:56
*** rlandy is now known as rlandy|ruck11:56
tobiashtristanC: I commented on the runner spec: https://review.opendev.org/68127712:07
*** rfolco has joined #zuul12:08
tobiashsorry for the long review delay12:08
*** bhavikdbavishi has quit IRC12:16
*** jcapitao_lunch is now known as jcapitao12:18
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Fix issues with buildset registry  https://review.opendev.org/74158413:02
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: support the approval requirement  https://review.opendev.org/74163713:31
openstackgerritTobias Henkel proposed zuul/zuul master: Stop falling back to job name for missing url  https://review.opendev.org/55405613:39
*** sgw1 has joined #zuul13:48
*** Goneri has joined #zuul13:57
openstackgerritTobias Henkel proposed zuul/zuul master: Add testcase to show inconsistency during merging  https://review.opendev.org/61924514:53
*** y2kenny has joined #zuul14:58
y2kennyFor nodepool, for a node to be in the ABORTED state and locked, is nodepool responsible to try again?  I haven't implemented "hasRemainingQuota" or "hasProviderQuota" for my driver and I wonder if that's the cause of node being stuck (they were aborted because all available nodes were assigned already.)15:10
clarkby2kenny: yes I think the expectation is that nodepool will detect the "I'm full state" then block there waiting for resources to be released so that they can be used for subsequent jobs15:17
y2kennydoes nodepool stop trying after awhile?  My understanding is that the default has*Quota  always return true.15:18
fungikeep in mind that launchers are meant to scale in a distributed fashion, so you may have launchers servicing different providers and any which lack capacity to satisfy a request should reject it so another launcher can fulfil it instead15:18
y2kennythe way my node got aborted is via QuotaException.  I have been reading the code and I noticed the pause_handler, etc. but I am not sure if there are anything the driver needs to do.15:19
y2kennylike... are there anything the nodepool driver needs to do to "unpause"?15:19
y2kennyactually... I wonder if it's because my launchComplete was not returning correct value15:21
fungiy2kenny: it looks like when passing through _waitForNodeSet() it will un-pause a request automatically when self.hasRemainingQuota(ntype) is truthy15:23
y2kennyok15:24
y2kennyI have been returning launchesComplete=False if node_state is zk.ABORTED because my driver wasn't using QuotaException initially.  That may have been the cause of things getting stuck..15:24
y2kennyI am guessing there's a cap on the number of ongoing request so when all the request were in Aborted but not complete, nothing move forward.15:27
avasstobiash: I started frankensteining together a win_zuul_console written in powershell. I sort of have a tcp server so far so I might push that as a WIP change later15:42
corvusavass: we're looking at moving the zuul_console stuff to use unix domain sockets so that we don't have to run a server on the remote side; is there any potential to do something similar for win?15:44
*** hamalq has joined #zuul15:45
avasscorvus: I have no idea :)15:45
avasscorvus: but I'll look around15:45
*** hamalq_ has joined #zuul15:47
corvusneat, windows has apparently added support for unix domain sockets15:48
*** jcapitao has quit IRC15:48
avassyeah, but only for windows 10 :)15:48
corvusavass: and you're running 3.1 right? ;)15:49
avassclose, win 7 ;)15:49
avassit's a bit mixed though and we're always trying to get rid of those old machines15:49
corvusavass: iirc, the idea was to have ssh forward the domain socket to the remote node, then have the command module do python logging to the domain socket; the executor plugin would be on the other end of that socket and read the log messages.  that way it's all pretty invisible to the worker node.15:50
*** hamalq has quit IRC15:50
corvusavass: the second best option would probably be to do the same thing with tcp port forwarding, though that's more intensive since it requires a listening port on the executor for every connection, and a listening port on the worker node too for the forwarded end (though at least the listener on the worker can listen only on loopback, so there aren't any firewall issues)15:52
avasscorvus: you mean this right? https://review.opendev.org/#/c/541434/15:55
corvusavass: yep that's the one15:56
corvusi mean, it doesn't work yet, but i think it's a sound idea and would be an improvement, so it's worth thinking about new designs that are more like that than the current system15:56
avassyeah agreed, it would also solve the problem we have with running containers as 'separate hosts' on a static node15:57
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: support the labeled event  https://review.opendev.org/74166716:07
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Fix issues with buildset registry  https://review.opendev.org/74158416:11
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Fix issues with buildset registry  https://review.opendev.org/74158416:14
corvustobiash: replied to your reply on 68127716:14
tobiashcorvus: that sounds great, another improvement would be the possibility to configure default ignores in a file like ~/.zuul16:19
tobiashavass: awesome :)16:19
*** kklimonda has quit IRC16:20
*** kklimonda has joined #zuul16:20
tobiashcorvus, avass: maybe it's even possible to tunnel a unix socket on the executor to a tcp socket on windows16:21
tobiashthen we could stick with the unix socket idea and only modify the target for windows16:22
avasstobiash, corvus: I've been trying to do that but can't get it to work. Not sure if I'm giving it the correct path for the windows host :/16:25
*** nils has quit IRC16:28
tobiashAccording to this it should be possible to have mixed unix/tcp socket forwardings: https://serverfault.com/questions/127794/forward-local-port-or-socket-file-to-remote-socket-file16:28
tobiashHowever this relies on ssh which I think we cannot rely on windows simce that is using winrm16:29
clarkbsocat?16:31
tobiashI doubt that socat can tunnel through winrm ;)16:32
avasstobiash: yeah I couldn't get unix or tcp ports working over ssh16:32
*** yolanda has quit IRC16:39
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Fix issues with buildset registry  https://review.opendev.org/74158416:41
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Fix certificate issue with use buildset registry  https://review.opendev.org/74158416:43
openstackgerritAlbin Vass proposed zuul/zuul master: WIP: add win_zuul_console.py  https://review.opendev.org/74167716:47
avasstobiash: that writes a file with the server script and runs that. not sure how to 'daemonize' a process in windows otherwise16:49
avassthere's probably a much better way of doing that16:49
tobiashwhy not, I'm thinking about doing that on linux as well because the forking part is what breaks when using mitogen16:55
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: support the approval requirement  https://review.opendev.org/74163717:09
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: support the labeled event  https://review.opendev.org/74166717:09
*** vishalmanchanda has quit IRC17:20
corvustobiash: no need to fork if we switch to unix domain17:53
tobiashthat's true17:57
avasstobiash: yeah, but it's a bit annoying to keep all of the code in a string. :)18:16
*** harrymichal has joined #zuul18:19
*** johnsom has quit IRC18:24
*** johnsom has joined #zuul18:25
openstackgerritAlbin Vass proposed zuul/zuul master: WIP: add win_zuul_console.py  https://review.opendev.org/74167718:51
openstackgerritAlbin Vass proposed zuul/zuul master: WIP: add win_zuul_console.py  https://review.opendev.org/74167718:52
*** kmalloc has quit IRC18:53
*** kmalloc has joined #zuul18:53
openstackgerritMerged zuul/zuul master: zuul_stream: avoid exception in _log_streamline  https://review.opendev.org/74125718:53
*** rlandy|ruck is now known as rlandy|ruck|mtg19:36
*** maxamillion has quit IRC19:53
*** maxamillion has joined #zuul19:54
*** rlandy|ruck|mtg is now known as rlandy|ruck20:29
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use (upload|promote)-docker-image roles in periodic jobs  https://review.opendev.org/74056020:38
*** ericsysmin has quit IRC20:46
*** ericsysmin has joined #zuul20:46
*** y2kenny has quit IRC20:54
corvusdoes anyone know why i can't copy/paste from the streaming console using the x selection buffer?21:06
fungiconfirmed i can reproduce21:09
fungiseems i can highlight and tell my browser to copy and then paste from the alternate (non middle-click) buffer21:10
fungibut normal highlight and then middle-click isn't working there21:11
corvusyeah, highlight in browser, copy, paste in emacs, highlight in emacs, middle-click in terminal does work.  it's not ideal.21:12
*** rpittau has quit IRC21:12
*** rpittau has joined #zuul21:13
corvusi guess that's what i get for not just ircing in emacs21:13
corvuslike a "real" emacs user would21:14
fungithe terminology for these seems to be "primary selection buffer" (highlight to copy, middle-click to paste) and "clipboard buffer" (highlight and explcitly ask to copy, then explicitly ask to paste)21:14
corvusi always knew it as the selection buffer, but now that you say it's called the "primary" selection buffer, i'm wondering if there are more, cause that would be cool.21:14
fungihttps://tronche.com/gui/x/icccm/sec-2.html#s-2.6.121:15
fungithere are!21:15
fungian arbitrary number even21:15
fungianyway, to summarize, it seems that something about the new console stream implementation has broken the ability for highlighting to populate the primary selection buffer in at least some browsers21:17
*** harrymichal has quit IRC21:26
*** hamalq has joined #zuul21:28
*** hamalq_ has quit IRC21:31
*** avass has quit IRC21:53
*** rlandy|ruck has quit IRC22:45
*** tosky_ has joined #zuul22:52
*** tosky has quit IRC22:53
*** tosky_ is now known as tosky23:01
*** rfolco has quit IRC23:16
*** armstrongs has joined #zuul23:31
*** tosky has quit IRC23:38
*** hamalq has quit IRC23:38
*** armstrongs has quit IRC23:40
*** rfolco has joined #zuul23:41

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!