Wednesday, 2020-08-19

*** adam_g has quit IRC00:14
*** adam_g has joined #zuul00:14
*** adam_g has quit IRC00:23
*** wuchunyang has joined #zuul00:31
*** sgw1 has quit IRC00:33
*** wuchunyang has quit IRC00:35
*** Goneri has quit IRC00:41
*** pots has quit IRC02:03
*** pots has joined #zuul02:03
*** mmedvede has quit IRC02:04
*** cloudnull8 has joined #zuul02:04
*** cloudnull has quit IRC02:04
*** cloudnull8 is now known as cloudnull02:04
*** mgoddard has quit IRC02:05
*** weshay|ruck has quit IRC02:05
*** flaper87 has quit IRC02:05
*** weshay has joined #zuul02:06
*** kgz has quit IRC02:06
*** mmedvede has joined #zuul02:12
*** mgoddard has joined #zuul02:13
*** flaper87 has joined #zuul02:19
*** kgz has joined #zuul02:23
*** rlandy|bbl is now known as rlandy02:38
*** rlandy has quit IRC02:38
*** rfolco has quit IRC02:54
*** vishalmanchanda has joined #zuul03:30
*** bhavikdbavishi has joined #zuul03:56
ianwERROR: Package 'openstacksdk' requires a different Python: 3.5.2 not in '>=3.6'  ... did openstacksdk drop python3.5 support?03:57
clarkbpip should handle that with the index requires python metadata03:59
clarkbbut we've been seeing some unhappy pypi cdn nodes and when that happens it seems we dont always get that metadata?03:59
ianwthat must be it, this is a zuul py35 tox job03:59
ianwhttps://zuul.opendev.org/t/zuul/build/156f85c8a62a48a69a0ed4d7926c491203:59
ianwnothing has changed afaics03:59
clarkbwe can use env markers to specify it in zuul too if we want04:00
clarkbthat will be more reliable04:00
*** bhavikdbavishi has quit IRC04:01
ianwi think it's probably transitive via nodepool04:01
*** bhavikdbavishi has joined #zuul04:18
*** saneax has joined #zuul04:18
*** raukadah is now known as chkumar|rover04:25
*** evrardjp has quit IRC04:33
*** evrardjp has joined #zuul04:33
*** yolanda has quit IRC04:41
*** mach1na has joined #zuul05:13
*** cloudnull is now known as kecarter05:19
*** kecarter is now known as cloudnull05:19
*** mach1na has quit IRC05:23
*** mach1na has joined #zuul05:23
*** ianychoi_ has joined #zuul05:25
openstackgerritIan Wienand proposed zuul/zuul-jobs master: [wip] json edit  https://review.opendev.org/74683405:27
*** mach1na has quit IRC05:28
*** ianychoi has quit IRC05:28
openstackgerritIan Wienand proposed zuul/zuul-jobs master: [wip] json edit  https://review.opendev.org/74683405:30
openstackgerritIan Wienand proposed zuul/zuul-jobs master: [wip] json edit  https://review.opendev.org/74683405:40
*** mach1na has joined #zuul05:55
openstackgerritIan Wienand proposed zuul/zuul-jobs master: [wip] json edit  https://review.opendev.org/74683405:56
openstackgerritIan Wienand proposed zuul/zuul-jobs master: [wip] json edit  https://review.opendev.org/74683406:05
*** bhavikdbavishi has quit IRC06:09
*** dmellado has quit IRC06:11
*** mach1na has quit IRC06:28
*** mach1na has joined #zuul06:28
*** mach1na has quit IRC06:39
*** dmellado has joined #zuul06:41
*** yolanda has joined #zuul06:50
*** mach1na has joined #zuul07:05
*** dmellado has quit IRC07:07
*** bhavikdbavishi has joined #zuul07:15
*** piotrowskim has joined #zuul07:26
*** mach1na has quit IRC07:51
*** mach1na has joined #zuul07:52
*** dmellado has joined #zuul07:53
*** mach1na has quit IRC07:54
*** mach1na has joined #zuul07:54
*** jpena|off is now known as jpena07:58
openstackgerritMerged zuul/zuul-jobs master: terraform: Add parameter for plan file  https://review.opendev.org/74665708:21
*** tosky has joined #zuul08:28
*** nils has joined #zuul08:43
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032808:59
*** bhavikdbavishi has quit IRC09:27
*** bhavikdbavishi has joined #zuul09:29
*** bhavikdbavishi has quit IRC09:52
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032809:52
*** korkakak has joined #zuul09:52
*** bhavikdbavishi has joined #zuul09:54
korkakakHi! I was trying to execute an ansible playbook that used the lookup's pipe. Apparently this is forbidden in Zuul for the last 3 years according to https://opendev.org/zuul/zuul/commit/d08b4ce374150c1b25017e11ab91256c4ec62e8009:54
korkakakmy question is, how is pipe more dangerous compared to using the `shell` or the `console` ?09:55
korkakakby `pipe` in the previous msg I denote the ansible's lookup pipe plugin09:56
tobiashkorkakak: local shell tasks are forbidden as well10:15
korkakak@tobiash, how about the console which also has similar properties?10:47
tobiashkorkakak: do you mean command or really console?10:48
korkakakyou are right, I meant command10:48
tobiashcommand is forbidden as well locally ;)10:50
korkakakhmmm, I can see that I am allowed to execute command(s) if there are in a role10:52
korkakakand the job is not trusted10:53
avasskorkakak: any arbitrary code execution is forbidden on the executor unless it's done in a trusted context )11:01
avasskorkakak: and so are most lookups, but I believe some of them are whitelisted11:01
openstackgerritMatthieu Huin proposed zuul/zuul master: REST API: improve tenant scoping of autohold, authorizations  https://review.opendev.org/72811811:03
openstackgerritMatthieu Huin proposed zuul/zuul master: CLI: add autohold-info, autohold-delete via REST  https://review.opendev.org/72841011:03
*** mach1na has quit IRC11:13
*** mach1na has joined #zuul11:14
*** mach1na has joined #zuul11:14
*** mach1na has quit IRC11:26
*** mach1na has joined #zuul11:26
*** mach1na has quit IRC11:31
korkakakavass was kind enough to educate me about ansible, how this is deployed and executed by Zuul, thanks @avass :)11:31
*** jpena is now known as jpena|lunch11:31
*** _erlon_ has joined #zuul11:44
*** hashar has joined #zuul12:01
*** rlandy has joined #zuul12:02
*** mach1na has joined #zuul12:02
*** rfolco has joined #zuul12:03
*** bhavikdbavishi has quit IRC12:06
*** sshnaidm is now known as sshnaidm|afk12:26
avasskorkakak: :)12:27
*** jpena|lunch is now known as jpena12:37
*** weshay is now known as weshay|interview12:47
*** Goneri has joined #zuul12:47
*** sgw1 has joined #zuul12:50
*** weshay|interview is now known as weshay13:10
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032813:12
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032813:18
*** weshay is now known as weshay|ruck13:21
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] use one API call to create tags  https://review.opendev.org/74692113:22
openstackgerritMatthieu Huin proposed zuul/zuul master: REST API: improve tenant scoping of autohold, authorizations  https://review.opendev.org/72811813:40
*** hashar has quit IRC14:06
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] fix exception when instance not found during cleanup  https://review.opendev.org/74693214:07
*** korkakak has quit IRC14:13
*** saneax is now known as saneax_14:26
*** hashar has joined #zuul14:33
openstackgerritMatthieu Huin proposed zuul/zuul master: CLI: add autohold-info, autohold-delete via REST  https://review.opendev.org/72841014:35
*** sshnaidm|afk is now known as sshnaidm14:42
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032815:04
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] use one API call to create tags  https://review.opendev.org/74692115:04
*** chkumar|rover is now known as raukadah15:14
fungiclarkb: ianw: catching up, are you sure it's not that we're using a too-old pip that doesn't know to query that field from the pypi metadata when selecting package versions?15:20
clarkbfungi: the ensure-pip job is supposed to address that and tosky is reporting similar for unrelated jobs in #opendev15:21
fungiensure-pip installs from distro packages by default though, right? so if this is on ubuntu-xenial (to get a default python3.5) then it may also use a fairly old pip?15:21
clarkbfungi: on xenial it installs a backported bionic pip 9 from our ppa15:23
clarkbprimarily to address the pip 8 doesn't fallback if an index doesn't have a package behavior, but that should also ensure we ave a new enough pip to handle python requires15:23
toskyfungi: the jobs where I've seen pypi failures are not consistently failing; a recheck usually pass15:25
clarkbtosky: and at least the one example of yours I checked ran on bionic15:31
clarkbwhich I think rules out any xenial related problems15:31
clarkbah though tosky's example is the package missing from the index entirely15:32
clarkbnot python3.5 or python2.7 installing package for newer python15:32
clarkbbut I think both are related to CDN is unhappy15:32
toskyno, I think it's just rax's mirror missing something15:33
clarkbwell its a proxy, the problem is in pypi's cdn15:33
toskyoh15:34
toskyso I guess there is nothing to do apart from maybe letting them know they have a problem15:35
fungiclarkb: tosky: thanks, so it's random-ish then, got it15:36
*** mach1na has quit IRC15:37
*** jpena is now known as jpena|off16:07
*** nils has quit IRC16:10
*** hashar has quit IRC16:18
openstackgerritMatthieu Huin proposed zuul/zuul master: REST API: improve tenant scoping of autohold, authorizations  https://review.opendev.org/72811816:25
openstackgerritMatthieu Huin proposed zuul/zuul master: CLI: add autohold-info, autohold-delete via REST  https://review.opendev.org/72841016:27
openstackgerritMatthieu Huin proposed zuul/zuul master: REST API: add promote endpoint  https://review.opendev.org/72848916:32
openstackgerritMatthieu Huin proposed zuul/zuul master: REST API: add promote endpoint  https://review.opendev.org/72848916:36
openstackgerritClark Boylan proposed zuul/zuul-jobs master: Generate build ssh keys in PEM format  https://review.opendev.org/74699416:38
*** hashar has joined #zuul16:50
clarkbhrm it doens't look like we do much testing of ^ problably because it is privileged and in base?17:07
clarkbdo ya'll think I should make a copy of that role, add it to opendev's base-test and test it that way?17:07
corvusclarkb: i thought there was a test job for that17:08
corvusoh, it's the "add-sshkey" role i was thinking of; that's different17:09
clarkbolder changes run the same set of jobs too https://review.opendev.org/#/c/740350/17:10
tobiashmhu: sorry, it looks like I've overlooked your promote endpoint change. In the meantime https://review.opendev.org/742848 has merged17:13
corvusclarkb: we might be able to construct a test job for that role; it'll take a little bit of work, but i bet we could start an ssh-agent on a remote node, add a key to it like zuul does, then run that role on it.17:15
tobiashclarkb: it would be great to get a second review on https://review.opendev.org/744679 in order to not block zuul-web when enqueuing/dequeuing changes during event backlog17:23
clarkbtobiash: noted. I'm about to get a bike ride in but will put that at the top of the list when I get back17:25
tobiashclarkb: of course a bike ride is more important, enjoy :)17:26
mhutobiash, ah, that makes more sense! I was scratching my head on why the rebase was failing17:35
mhutobiash, I think my change is still valid, it adds some test coverage at least17:36
tobiashmhu: yeah, test_options makes sense, the test_promote is duplicated then I think17:39
mhuright - I was interrupted during the rebase, I'm just seeing that17:39
openstackgerritMatthieu Huin proposed zuul/zuul master: REST API: improve promote endpoint testing  https://review.opendev.org/72848917:48
mhuI'm in favor of keeping the testing of the web API in addition to the CLI test, because we might split the CLI between admin stuff and user stuff17:49
openstackgerritMatthieu Huin proposed zuul/zuul master: Builds: add "held" attribute  https://review.opendev.org/72899417:50
*** bhavikdbavishi has joined #zuul17:51
mhufelixedel, do you have an ongoing change on the TableFilters component related to the PF4 migration? I'm asking before I rebase this one: https://review.opendev.org/#/c/729265/17:52
*** hashar is now known as hasharWineMusic17:55
*** vishalmanchanda has quit IRC18:49
AJaegertristanC: clarkb suggested you review https://review.opendev.org/#/c/746423/ , could you do so, please?19:20
*** bhavikdbavishi has quit IRC19:28
*** saneax_ has quit IRC19:32
*** y2kenny has joined #zuul20:01
y2kennyAre "Zookeeper suspended. Waiting" message from Nodepool normal?20:03
y2kennyNodepool's log20:03
clarkby2kenny: I don't think so? is zookeeper running20:03
y2kennyclarkb: it is... and another nodepool is working... ok I think I know where to dig, thanks.20:05
mhuAJaeger, I think tristanC is on vacation at the moment20:16
y2kennyclarkb: does nodepool retry on lost zk connection?  I am wondering if I broke the retry mechanism because my driver didn't keep a reference to the zk_conn20:18
y2kennyclarkb: I noticed the addition of "self._zk = zk_conn" while reviewing your other patch20:20
clarkby2kenny: yes it should retry20:22
corvusclarkb: good comment from zbr on 746994.  if you haven't started on anything similar, i'll take a quick stab at making a test job for that20:47
corvus(ssh pem)20:47
clarkbcorvus: I havne't. I'm just about ot dig into tobiash's change now20:48
clarkbcorvus: that would be appreciated (the test job)20:48
corvuscool, i'll do that20:48
*** dustinc has quit IRC20:49
*** zenkuro has joined #zuul20:51
corvusclarkb: :( i think there are some critical "delegate-to: localhost" shell tasks there so we won't be able to run it speculatively, sorry20:51
corvusclarkb: i think the base-test dance is the way to go on that one20:51
corvus(later, if we lift the localhost shell restriction, we may be able to test it)20:52
clarkbok, I'll work on an update that puts it in a test role thta we can merge, as well as a base-test update20:53
clarkbcorvus: tobiash for https://review.opendev.org/#/c/744679/3 we aren't worried about races between the workers right? basically all the pipeline write functions are in slow. And all the hold functions are in not slow so we shouldn't have any interacting writes in badways between threads?20:55
corvusclarkb: right -- i think if the fast ones are read-only we should be okay20:55
zenkurohi, is priblem related to ara-report: error 30 read-only file system known?20:58
corvuszenkuro: is this a problem with zuul.opendev.org?20:58
clarkbcorvus: the autoholds are also in the fast list, but those shouldn't interact with pipelines right?20:59
zenkurocorvus: do not think so. more like s local deployment issue that happens after 2-3 weeks of work20:59
corvuszenkuro: ok.  that doesn't sound familiar.  https://review.opendev.org/742971 is the most recent significant change to ara-report21:01
openstackgerritClark Boylan proposed zuul/zuul-jobs master: Generate build ssh keys in PEM format  https://review.opendev.org/74699421:02
openstackgerritClark Boylan proposed zuul/zuul-jobs master: Add test-add-build-sshkey role  https://review.opendev.org/74703521:02
corvuszenkuro: if you previously had a value for ara_report_path set, that change may have broken your setup and could result in an error like that21:02
clarkbcorvus: remote:   https://review.opendev.org/747036 Use test-add-build-sshkey in base-test21:03
*** rfolco has quit IRC21:05
corvuszenkuro: here's a little more info about that: http://lists.zuul-ci.org/pipermail/zuul-announce/2020-July/000080.html21:05
*** smyers has quit IRC21:12
*** smyers_ has joined #zuul21:12
*** smyers_ is now known as smyers21:12
*** dmsimard7 has joined #zuul21:14
*** dmsimard has quit IRC21:15
*** dmsimard7 is now known as dmsimard21:15
clarkbok think I convinced myself the split rpc worker setup should be fine (no interaction between writers in different threads)21:16
clarkbI've approved the change21:16
*** zenkuro has quit IRC21:27
*** zenkuro has joined #zuul21:37
zenkurocorvus: thanks! looks like this is my case. I am using software factory and disabling upstream playbooks helped21:37
corvuszenkuro: do you think you can fix it by adjusting the value of that variable?21:38
corvusmhu: ^ fyi21:39
*** tosky has quit IRC21:47
zenkurocorvus: hm, may be, I will think about it with a fresh head21:50
*** hasharWineMusic is now known as hahsar21:59
*** hahsar is now known as hashar21:59
*** zenkuro has quit IRC22:07
clarkbcorvus: I +2'd https://review.opendev.org/#/c/744801/ but left a couple of thoughts. Didn't approve and will let you decide if those are worth addressing before approving22:15
*** rlandy is now known as rlandy|bbl22:28
corvusclarkb: let me see if i can remember the answers to those q's :)22:29
*** hashar has quit IRC22:34
corvusclarkb: replied22:37
clarkbcorvus: sound sgood to me if you want to approve it. Or should I?22:39
corvusdone22:40
clarkbcorvus: https://review.opendev.org/#/c/740328 that is one you may be interested in. I think that may be better served by the task manager rate limiting22:56
corvusclarkb: does it seem like that driver could use the simple driver interface, or at least the taskmanager?23:14
clarkbI think at least the taskmanager23:14
corvusi sort of designed the simple driver for both aws and gce23:15
clarkbnot sure if it can be simplified to the simple driver23:15
openstackgerritIan Wienand proposed zuul/zuul master: Doc updates for Github interaction  https://review.opendev.org/74681523:15
clarkb(but maybe simple driver too)23:15
openstackgerritIan Wienand proposed zuul/zuul master: Doc updates for Github interaction  https://review.opendev.org/74681523:15
corvusclarkb: oh, heh, i just saw your cover comment (i missed it earlier and only saw the inline comments before)23:17
*** Goneri has quit IRC23:27
openstackgerritMerged zuul/nodepool master: Finish adding GCE quota support  https://review.opendev.org/74480123:29
corvustobiash: can you see comment on https://review.opendev.org/741157 ?23:37
*** piotrowskim has quit IRC23:39
openstackgerritMerged zuul/zuul master: github connection: remove unused depends_on_re  https://review.opendev.org/74643723:45
openstackgerritMerged zuul/zuul master: Fix Multi Node Builds with k8s Build Nodes  https://review.opendev.org/74651523:52

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!