Thursday, 2018-07-05

*** sshnaidm|rover is now known as sshnaidm|afk00:56
openstackgerritVu Cong Tuan proposed openstack-infra/zuul-jobs master: Switch to stestr  https://review.openstack.org/58002802:07
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: doc: re-order GitHub Application configuration  https://review.openstack.org/58024702:20
*** pwhalen has quit IRC02:54
*** pwhalen has joined #zuul02:56
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul master: Enable ARA action plugins for ara_record and ara_read  https://review.openstack.org/58025603:02
openstackgerritMerged openstack-infra/zuul-jobs master: Ensure iptables-services is installed when persisting firewall config  https://review.openstack.org/57928303:53
*** swest has joined #zuul04:54
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: Implement an OpenShift resource provider  https://review.openstack.org/57066705:12
*** yolanda has joined #zuul05:30
*** ianychoi has joined #zuul05:34
*** pawelzny has quit IRC05:58
*** pawelzny has joined #zuul05:59
*** nchakrab has joined #zuul06:20
*** gtema has joined #zuul06:23
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Make GitHub rate limit logging configurable  https://review.openstack.org/58029506:26
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Make GitHub rate limit logging configurable  https://review.openstack.org/58029506:33
*** robled has quit IRC06:45
*** robled has joined #zuul06:50
*** robled has quit IRC06:50
*** robled has joined #zuul06:50
*** jpena|off is now known as jpena07:05
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Reduce requests to github when listing project branches  https://review.openstack.org/58021807:10
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Make GitHub rate limit logging configurable  https://review.openstack.org/58029507:10
*** sshnaidm|afk has quit IRC07:14
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Make GitHub rate limit logging configurable  https://review.openstack.org/58029507:17
*** sshnaidm|afk has joined #zuul07:21
*** sshnaidm|afk is now known as sshnaidm|rover08:16
*** zaro has quit IRC09:11
*** zaro has joined #zuul09:12
*** hashar has quit IRC09:21
*** hashar has joined #zuul09:38
*** spsurya_ has quit IRC09:49
*** gtema has quit IRC10:57
*** jpena is now known as jpena|lunch11:05
*** gtema has joined #zuul11:05
*** hashar is now known as hasharAway11:21
*** gtema has quit IRC11:25
*** gtema has joined #zuul11:26
*** sshnaidm|rover is now known as sshnaidm|rov|lnc11:33
openstackgerritMerged openstack-infra/zuul master: doc: re-order GitHub Application configuration  https://review.openstack.org/58024712:11
*** sshnaidm|rov|lnc is now known as sshnaidm|rover12:15
*** gtema_ has joined #zuul12:15
*** gtema has quit IRC12:18
*** rlandy has joined #zuul12:23
*** nchakrab has quit IRC12:23
*** nchakrab has joined #zuul12:24
*** nchakrab_ has joined #zuul12:31
*** nchakrab has quit IRC12:35
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Support skip_child_jobs via zuul_return  https://review.openstack.org/57823012:45
*** hasharAway is now known as hashar12:48
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Fix zuul startup with inexisting project template and gate  https://review.openstack.org/57985912:50
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Tolerate missing project  https://review.openstack.org/57987212:50
*** swest has quit IRC13:27
*** jpena|lunch is now known as jpena13:28
*** swest has joined #zuul13:29
*** nchakrab_ has quit IRC13:30
*** nchakrab has joined #zuul13:31
*** swest has quit IRC13:34
*** swest has joined #zuul13:34
*** swest has quit IRC13:49
mordredrcarrillocruz: yes, I looked at it - and mention it in the spec iirc - I think it's a promising possibility - but I wanted to keep things simple and start with docker14:03
rcarrillocruzack14:03
mordredrcarrillocruz: if you mean instead of pbrx - no, they do different things. if we adopt buildah for building the images, I'd update pbrx to use it14:04
rcarrillocruzso pbrx is a wrapper around an image builder, in what sense14:04
mordredit knows how to build images given a python project using bindep and pbr ... so that you don't have to duplicate the information already present in requirements and bindep14:06
mordredand also setup.cfg already contains a list of the commands that would be installed by the python project as well - so you can make per-command container images14:06
rcarrillocruzah gotcha...14:07
rcarrillocruzthat's for contanerizing zuul  i guess ?14:07
*** nchakrab has quit IRC14:07
mordredyah - or literally any other python project that uses bindep and pbr14:07
rcarrillocruzcontainerizing too14:07
mordredbut yes, exploring using it for building/publishing zuul containers14:08
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Update bindep file with build profiles  https://review.openstack.org/58015914:25
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Add job to build container images using pbrx  https://review.openstack.org/58016014:25
mordredtobiash: thanks for the review - hopefully those will suck less :)14:25
corvustobiash, jhesketh, tristanC: see my comment on https://review.openstack.org/580247 please14:26
tobiashcorvus: oh, overlooked that14:44
*** nchakrab has joined #zuul14:46
*** nchakrab_ has joined #zuul14:47
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Sync zuul from scratch github app settings  https://review.openstack.org/58040314:47
tobiashcorvus: ^14:47
*** nchakrab has quit IRC14:51
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Support zuul.child_jobs via zuul_return  https://review.openstack.org/57823014:54
*** jiapei has quit IRC14:58
*** acozine1 has joined #zuul15:21
*** nchakrab_ has quit IRC15:30
corvustobiash: i'm going to continue trying to find underlying causes of job source contexts being wrong, with the hope that might supply a clue to your incident where a proposed change to a config repo was run.  do you have any further information (or incidents)?15:49
rcarrillocruzhmm, folks , what's the default timeout for a job?15:50
rcarrillocruzjust got a timeout at 30m, wondering if i hit that value or is due to some underlying issue in RDO15:51
corvusrcarrillocruz: there is no default timeout: https://zuul-ci.org/docs/zuul/user/config.html#attr-job.timeout15:51
corvusrcarrillocruz: but the 'base' job might define a timeout15:51
corvus(which all other jobs would inherit)15:51
rcarrillocruzah...15:51
* rcarrillocruz goes check15:52
rcarrillocruzhah, indeed15:52
rcarrillocruz180015:52
rcarrillocruzthx corvus :-)15:52
corvusnp15:52
tobiashcorvus: no, this was a single event so far and I had to work on other scaling and stability fixes15:53
*** dtruong has joined #zuul15:55
tobiashLike nodepool quota handling15:56
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Update bindep file with build profiles  https://review.openstack.org/58015916:05
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Add job to build container images using pbrx  https://review.openstack.org/58016016:05
*** yolanda_ has joined #zuul16:13
*** yolanda has quit IRC16:17
corvustobiash, mordred: i see the problem that's causing our source_contexts to be wrong in openstack-infra: http://git.zuul-ci.org/cgit/zuul/tree/zuul/configloader.py#n153016:37
corvusif we fetch multiple zuul config files from a single project-branch, that causes them all to share the same source_context object.  the .path attribute is overwritten, so the last filename wins.16:38
corvusi think it's relatively harmless, since all of the security checks are only looking at project+branch, not pathname.  we're still creating new source_contexts for each project+branch.16:39
corvusso i don't immediately see a way for this to have caused the issue tobiash saw16:40
mordredcorvus: nod. so the thing tobiash saw is potentially something else - and the pathname thing is just annoying and not necessarily dangerous16:40
corvusmordred: ya, that's what it's looking like to me.16:41
gtema_mordred: any comments on shade->sdk change?16:41
corvusi'm going to work on a (one line) patch to fix this, plus a > one line test.16:41
mordredgtema_: oh - thanks for reminding me - lemme go look at that  (I'm actually touching some similar things right now)16:43
mordredcorvus: ++16:43
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Fix source context in split config  https://review.openstack.org/58044916:53
*** yolanda__ has joined #zuul16:53
corvustobiash: would you mind writing up everything you know about the error you observed and putting it in an etherpad?  i know it's not much, but it may help.16:55
tobiashcorvus: yes I can do that tomorrow. I'm afk this evening16:56
*** yolanda_ has quit IRC16:56
corvustobiash: thanks!  enjoy the afking :)16:57
tobiashThanks :)16:57
*** yolanda_ has joined #zuul17:12
*** yolanda__ has quit IRC17:15
*** hashar is now known as hasharAway17:20
*** rlandy is now known as rlandy|brb17:21
*** jpena is now known as jpena|off17:24
*** rlandy|brb is now known as rlandy17:40
*** sshnaidm|rover has quit IRC17:43
*** sshnaidm|rover has joined #zuul17:52
openstackgerritMonty Taylor proposed openstack-infra/nodepool master: Consume Task and TaskManager from openstacksdk  https://review.openstack.org/41475917:55
*** yolanda__ has joined #zuul18:13
*** yolanda_ has quit IRC18:15
openstackgerritMonty Taylor proposed openstack-infra/nodepool master: Change TaskManager from is-a to has-a thread  https://review.openstack.org/58046318:26
mordredcorvus, Shrews: ^^ this causes the test suite to hang - so I'm pretty sure I'm doing something wrong, but I can't see it18:27
mordredcorvus, Shrews: oh. hrm. if I set the daemon flag on the thread it stops hanging18:31
Shrewstobiash: left you some comments on 536930. I think I'm missing the root cause of the problem you're trying to solve.18:32
openstackgerritMonty Taylor proposed openstack-infra/nodepool master: Change TaskManager from is-a to has-a thread  https://review.openstack.org/58046318:33
openstackgerritMonty Taylor proposed openstack-infra/nodepool master: Consume Task and TaskManager from openstacksdk  https://review.openstack.org/41475918:33
openstackgerritMonty Taylor proposed openstack-infra/nodepool master: Remove Task class  https://review.openstack.org/58046618:33
Shrewsmordred: that sounds fun18:34
openstackgerritMonty Taylor proposed openstack-infra/nodepool master: Consume TaskManager from openstacksdk  https://review.openstack.org/41475918:34
mordredShrews: yah. maybe the stack will work now18:34
tobiashShrews: the root problem is that the quota calculations are not neccessarily precise due to timing or outside effects so we need to handle node launch failures caused by exceeding quota gravefully18:35
gtema_mordred: and while you are waiting for tests - do review shade=>sdk ;-)18:35
mordredgtema_: :)18:35
*** yolanda_ has joined #zuul18:35
*** yolanda__ has quit IRC18:39
*** yolanda__ has joined #zuul18:39
Shrewsmordred: the comment about logging the 'running task' portion from corvus here (https://review.openstack.org/#/c/414759/2/nodepool/task_manager.py) is still relevant. We don't log shade at debug level.18:41
*** yolanda_ has quit IRC18:42
mordredgtema_: looks great - left a couple of comments18:42
Shrewstobiash: lol, though I'm sure you meant 'gracefully', i find 'gravefully' amusing and more fun to consider when coding  :)18:43
gtema_mordred: ok, thanks18:43
tobiashlol, shitty mobile keyboard18:44
openstackgerritMonty Taylor proposed openstack-infra/nodepool master: Consume TaskManager from openstacksdk  https://review.openstack.org/41475918:45
mordredShrews: done - thanks18:46
*** sshnaidm|rover is now known as sshnaidm|off18:46
openstackgerritArtem Goncharov proposed openstack-infra/nodepool master: retire shade in favor of openstacksdk  https://review.openstack.org/57282918:50
mordredgtema_: lgtm18:55
mordredShrews: ^^ how's that look to you?18:56
gtema_good18:56
*** gtema_ has quit IRC19:23
Shrewsmordred: that change to waitForImage in driver/openstack/provider.py is radically different from the replacement20:02
Shrewsmordred: but saying that... i can't find that method actually being used anywhere. am i crazy?20:02
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Remove OpenStack driver waitForImage call  https://review.openstack.org/58048720:05
Shrewswe'll find out20:05
*** acozine1 has quit IRC20:12
mordredShrews: I agree20:13
mordredShrews: and yes - we use wait=True on create_image - so that waitForImage should be unused20:13
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Update bindep file with build profiles  https://review.openstack.org/58015920:18
*** gouthamr has quit IRC20:27
*** dmellado has quit IRC20:28
Shrewsmordred: that code removal passes tests, so i'm ok with the shade replacement change. do we want to merge that now? we'll probably want a nodepool restart with these changes at some point when they can be watched20:36
mordredShrews: as soon as the cherry-pick of your dict patch lands I wanna cut a new sdk version ... maybe let's wait until that's happened?20:44
Shrewsmordred: k. i'll just add the +2 and a note20:44
*** gouthamr has joined #zuul21:35
openstackgerritMerged openstack-infra/zuul master: Fix source context in split config  https://review.openstack.org/58044921:44
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Add container spec  https://review.openstack.org/56013622:32
jheskethcorvus: woops, sorry, didn't realise that. +W'd the fix (re 580247 & now 580403)22:34
*** hasharAway has quit IRC22:35
openstackgerritPaul Belanger proposed openstack-infra/zuul-jobs master: Switch to repos.fedorapeople.org for rdo-release package  https://review.openstack.org/58051822:37
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Add container spec  https://review.openstack.org/56013622:39
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Install build bindep profiles alongside doc and test  https://review.openstack.org/58052122:44
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Update bindep file with build profiles  https://review.openstack.org/58015922:45
openstackgerritMerged openstack-infra/zuul master: Sync zuul from scratch github app settings  https://review.openstack.org/58040322:50
*** ianychoi_ has joined #zuul23:01
logan-is it possible to use the github driver just to enable depends-on without actually registering any webhooks or setting up an app?23:03
*** ianychoi has quit IRC23:04
logan-basically, no jobs targeting any github projects, but the ability to have gerrit patches cross test github PRs23:05
*** yolanda_ has joined #zuul23:07
corvuslogan-: theoretically, yes, and i think we should support it, but i'm not sure that's tested or anyone has done it.  without an app, it should fall back to the unauthenticated client, which means pretty significant query/rate limits.23:07
*** yolanda__ has quit IRC23:08
*** yolanda__ has joined #zuul23:11
logan-thanks23:11
*** yolanda_ has quit IRC23:13
corvuslogan-: if you try it, let me know how it goes, or if you have problems23:17
*** rlandy has quit IRC23:25
logan-certainly23:25
pabelangerlogan-: corvus: I believe we've tested that the other direction with kubernetes-incubator/kubespray in zuul.o.o: https://review.openstack.org/549768/ depends-on works, and we didn't setup a webapp23:30
*** yolanda_ has joined #zuul23:40
*** yolanda__ has quit IRC23:42
logan-cool pabelanger. one other question.. to cross test a github project, would it need to be added to the config as an untrusted project, or does the driver enable testing of any github PR regardless whether it is present in the tenant layout?23:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!