Tuesday, 2017-10-31

openstackgerritMerged openstack-infra/zuul feature/zuulv3: Fix syntax with gear unRegisterFunction()  https://review.openstack.org/51640303:03
openstackgerritRui Chen proposed openstack-infra/zuul feature/zuulv3: Use user home as work directory of executor  https://review.openstack.org/51653207:03
*** hashar has joined #zuul08:46
*** electrofelix has joined #zuul09:20
*** SpamapS has quit IRC09:36
*** SpamapS has joined #zuul09:40
*** sambetts|afk is now known as sambetts09:55
*** xhku_ has joined #zuul10:01
*** fbouliane has quit IRC10:01
*** timrc has quit IRC10:01
*** timrc has joined #zuul10:02
*** tobiash has quit IRC10:12
*** tobiash has joined #zuul10:15
*** hashar is now known as hasharLunch11:12
*** hasharLunch is now known as hashar13:09
*** dkranz has joined #zuul13:21
leifmadsenjeblair: what time works for you tomorrow?14:13
jeblairleifmadsen: how is 1500 utc (8am pacific, 11 eastern)?14:48
leifmadsenjeblair: perfect15:15
leifmadsenI'll schedule it15:15
jeblairleifmadsen: thanks!15:15
leifmadsenjeblair: I'll block it off for... 3 hours, but we aren't tied to using the whole thing15:15
*** bhavik1 has joined #zuul16:20
*** bhavik1 has quit IRC16:25
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Increase github delay to 10 seconds  https://review.openstack.org/51581216:25
dmsimardjeblair: not a fire but I've noticed disparity between ara versions on executors so it might not update itself automatically as we thought. I've seen at the very least 0.14.0, 0.14.2 and 0.14.4 ran today. I've added it to zuulv3-issues as "ARA (and other things?) are not kept up to date across the different executors"17:00
jeblairhere's an idea: have the merger perform an fsck on each git repo the first time it uses it after startup, and delete it if it fails17:00
jeblair(this would include the executor's internal merger)17:00
jeblairdmsimard: hrm17:00
jeblairdmsimard: pip3 freeze agrees with you17:01
jeblairdmsimard: but let's take this to -infra17:02
dmsimardjeblair: it's likely to affect other modules we might want to keep up to date17:02
*** hashar is now known as hasharAway17:03
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Use user home as work directory of executor  https://review.openstack.org/51653217:21
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Check start time for wait_time key  https://review.openstack.org/51646517:21
SpamapSOk, so I've now written the "extract all the projects' src dirs into their own variables" role 3 times. I think it may be time to add a dictionary by project to the zuul dict.18:07
clarkbSpamapS: I think that is in progress but has been reverted a couple times?18:08
SpamapSIt can just be zuul.project_srcs or something. Doesn't have to change zuul.projects18:09
dmsimardyeah we've been struggling for the projects to dict thing18:09
SpamapSis there an unseen gotcha or just too busy?18:10
dmsimardWe've had to do two reverts so far, the first one was something obvious we missed during code review.. the second one is nasty, something around the ordering of the dict not being guaranteed18:10
dmsimardlet me pull up eavesdrop..18:11
dmsimardSpamapS: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2017-10-29.log.html#t2017-10-29T17:17:1018:12
dmsimardit tried to clone oslo.serialization from branch feature/1.0 and feature/1.0 was an ara branch18:12
dmsimardjeblair provided a summary in https://review.openstack.org/#/c/516117/18:13
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Authorize the multi-node-bridge network in iptables if there's one  https://review.openstack.org/51675718:15
SpamapSI think the list is important for some things18:15
dmsimardSpamapS: not as far as we could tell18:15
SpamapSI certainly like the fact that I can get the order in which the job user has requested projects, no?18:16
dmsimardSpamapS: well, other than adjusting the different roles that expected a list18:16
SpamapSoh so why break the interface?18:16
SpamapSjust create a new dict for things that need the dict?18:16
dmsimardSpamapS: there's a short deprecation window, there is zuul._projects and zuul.projects18:16
SpamapS-1 from me18:17
SpamapSit's out there and in use.. and we're at least trying not to break people I thought.18:17
jeblairSpamapS: that's after we relase v318:17
jeblairSpamapS: we absolutely need to be able to change things while we're still in development18:17
SpamapSyeah I'm down for changing things when it's necessary. I don't think this is, but I haven't seen the arguments, so I could be uninformed.18:18
jeblairSpamapS: we only need one copy of this data structure.  it can be very large.18:18
jeblairit quite simply should have been a dict to start with.  so we should fix it.18:19
SpamapSOk, I thought there was some important ordering being communicated.18:19
SpamapSSounds like it's just "we made everybody process it as a list"18:19
jeblairSpamapS: no, as a list it's unordered18:19
jeblairinternally it's a set18:19
jeblairso it goes set -> list currently18:19
SpamapSdoh18:20
SpamapSglad it's already considered fully.18:20
SpamapSI for one welcome our new dict overlords then. ;)18:20
jeblairSpamapS: you convinced me :)18:20
SpamapSYeah I kind of remember asking for it. :)18:20
SpamapSI just didn't know what would become of that request.18:20
jeblairso yeah, i think the only gotcha remaining is our use of it in zuul-jobs where we need to learn how to get "with_dict" and "with_together" to play nicely together18:20
jeblairSpamapS: so if you want to start using '_projects' now, you can start using it as a dict18:21
SpamapSooo a new toy18:21
* SpamapS has never used with_together18:21
jeblairSpamapS: then it'll be a one-char change once we switch .projects over to it18:21
SpamapSjeblair: ack. Well I've consolidated all of my processing of zuul.projects into one role now, so it won't hit me too hard.18:22
jeblairSpamapS: cool.  i'd recommend going ahead and trying out zuul._projects when you have a sec; you'll either be ahead of the curve or find something else we need to fix before we make the switch :)18:23
SpamapSjeblair: I have an interesting thing going on with zuul-jobs that is related to this btw.18:25
SpamapSjeblair: since I've mirrored zuul-jobs in our GHE, I went ahead and added a few basic syntax check jobs to my local zuul-jobs repo...18:25
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Authorize the multi-node-bridge network in iptables if there's one  https://review.openstack.org/51675718:26
SpamapSjeblair: but I _kind of_ want to run like, _every_ job that touches zuul-jobs. I wonder if there's a way to have like, a mode where I can say "walk through this pipeline in the layout and add any job that touches this project to this project."18:26
*** sambetts is now known as sambetts|afk18:34
jeblairSpamapS: hrm, interesting; i'll cipher on that18:49
SpamapSjeblair: it may be too heavy.. but it would be a nice thing to make sure one doesn't break any jobs on changes to central repos.18:57
*** electrofelix has quit IRC19:25
*** hasharAway is now known as hashar19:38
*** dkranz has quit IRC20:43
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Persist iptables rules  https://review.openstack.org/51394321:39
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: failing test for reconfiguration at failed head  https://review.openstack.org/51679923:41

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!