Wednesday, 2019-01-02

openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: web: add OpenAPI documentation  https://review.openstack.org/53554101:17
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: config: add playbooks to job.toDict()  https://review.openstack.org/62134301:22
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: config: add tenant.toDict() method and REST endpoint  https://review.openstack.org/62134401:23
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: config: add tenant.toDict() method and REST endpoint  https://review.openstack.org/62134401:31
*** rfolco has joined #zuul01:31
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: scheduler: add job's parent name to the rpc job_list method  https://review.openstack.org/57347301:43
*** bhavikdbavishi has joined #zuul02:28
*** bhavikdbavishi has quit IRC02:47
*** rfolco has quit IRC02:59
*** bhavikdbavishi has joined #zuul03:35
*** bhavikdbavishi1 has joined #zuul03:38
*** bhavikdbavishi has quit IRC03:39
*** bhavikdbavishi1 is now known as bhavikdbavishi03:39
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: config: add playbooks to job.toDict()  https://review.openstack.org/62134303:40
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: config: add tenant.toDict() method and REST endpoint  https://review.openstack.org/62134403:40
*** swest has quit IRC06:30
*** swest has joined #zuul06:32
*** quiquell|off is now known as quiquell07:06
*** bjackman has joined #zuul07:08
*** arxcruz|next_yr is now known as arxcruz07:47
*** quiquell is now known as quiquell|brb08:04
*** quiquell|brb is now known as quiquell08:52
*** hashar has joined #zuul09:14
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Fix skipped job counted as failed  https://review.openstack.org/62591009:50
quiquellHappy new year !09:58
quiquellHave a new year question regarding nodepool09:58
quiquellIt's possible to use multipleo nodepool-launchers towards same openstack tenant/project ?09:59
*** bhavikdbavishi has quit IRC10:09
*** quiquell is now known as quiquell|brb11:11
*** sshnaidm is now known as sshnaidm|afk11:48
Shrewsquiquell|brb: you may have multiple launchers, but they should not share any providers. we currently do not have the coordination between launchers to be able to do that12:11
*** quiquell|brb is now known as quiquell12:11
quiquellShrews: ack, thanks12:12
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: Implement an OpenShift resource provider  https://review.openstack.org/57066712:18
openstackgerritSorin Sbarnea proposed openstack-infra/zuul-jobs master: Remove world writable umask from /src folder  https://review.openstack.org/62557612:26
*** rlandy has joined #zuul12:39
*** rlandy is now known as rlandy|rover12:42
*** rfolco has joined #zuul12:43
*** sshnaidm|afk is now known as sshnaidm12:43
*** quiquell is now known as quiquell|lunch12:48
*** bjackman has quit IRC12:58
*** quiquell|lunch is now known as quiquell13:48
*** nhicher has joined #zuul14:04
*** hashar has quit IRC14:12
*** hashar has joined #zuul14:12
*** dkehn has joined #zuul14:47
*** bhavikdbavishi has joined #zuul14:55
*** bhavikdbavishi has quit IRC15:10
*** bhavikdbavishi has joined #zuul15:10
pabelangermorning!15:15
* SpamapS watches the working world slowly thaw and begin to re-animate after 2 weeks of winter freeze15:16
pabelangerHa, wish we had winter freeze here. On average been 8C over the break15:17
pabelangerno snow here this year15:17
*** quiquell is now known as quiquell|off15:17
*** rfolco is now known as rfolco|lunch15:18
*** bhavikdbavishi has quit IRC15:19
Shrewsanyone here knowledgable in wheel building?15:21
SpamapSShrews: I've fashioned a wheel or two, but nothing deep. What's up? Maybe just need to talk to teddy?15:36
Shrewsfor some reason, pbrx builds are failing when installing the latest release of netifaces (see http://logs.openstack.org/70/608670/2/gate/pbrx-build-container-images/c157205/job-output.txt.gz#_2019-01-02_14_45_42_208267) during the wheel build15:37
Shrewsi can build the package fine locally with 'python setup.py install'15:38
Shrewsand the LICENSE file is indeed there15:38
Shrewsso thought maybe there was something special with what the wheel build expects/does15:38
Shrewsmordred: fyi ^^15:39
*** hashar has quit IRC15:39
pabelangerShrews: could be related to https://github.com/al45tair/netifaces/commit/0bf4a1222a91c9ad9b9c729ba2bc97456da5b559 ? there is also a new release only 5 hours old today15:39
*** hashar has joined #zuul15:40
Shrewspabelanger: that change was included in 0.10.7 back in may (https://github.com/al45tair/netifaces/commit/4fa0e314ae1fc292a2b8afd37f31e9323bccbfea)15:41
pabelangerShrews: right, seems 0.10.8 was first release to pick it up15:42
pabelangerI don't think you can include a file like that with metadata15:42
pabelangerno, I am wrong15:42
pabelangerhttps://setuptools.readthedocs.io/en/latest/setuptools.html#metadata15:42
Shrewsoh nice, so the release in pypi for 0.10.7 does not match the actual changelog changes15:44
Shrewsat any rate, not sure what the problem is or where the fault lies15:47
pabelangerShrews: the tarball is missing a LICENSE file15:48
pabelangerso I think this is a release problem15:48
Shrewspabelanger: that change is using the metadata key 'license_file' but the setuptools doc references 'license' as the key. could that be the issue?15:49
pabelangerShrews: yah, i think that is also wrong15:49
pabelangerI can test shortly15:50
pabelangerbut first issue will be getting LICENSE file added into tarball i think15:50
pabelangerbut I need to #dadops first for a bit15:50
Shrewsdoes that metadata control adding it to the tarball?15:50
corvusmordred, SpamapS: i did write down thoughts on logging: http://lists.zuul-ci.org/pipermail/zuul-discuss/2018-July/000501.html15:51
SpamapScorvus: mmm I remember these thoughts. I like them. :)15:52
*** rfolco|lunch is now known as rfolco15:55
Shrewspabelanger: oh, seems license_file is correct for wheel (https://wheel.readthedocs.io/en/stable/user_guide.html#including-license-files-in-the-generated-wheel-file)15:59
SpamapSPython packaging, where 10 years of fixes and improvements still confuse basically everyone. :-P16:02
Shrewspabelanger: LICENSE does not exist for the previous versions   #confused16:04
ShrewsSpamapS: it really is a mess, isn't it?16:04
mordred++16:04
corvusmordred, SpamapS, tobiash, tristanC: regarding https://review.openstack.org/622010 -- that still looks very bad for me at 1280x1024; how can we fix that?16:06
corvusthat's some css magic there and i don't understand where those values come from or what they mean16:07
tobiashcorvus: it's the number of columns in bootstraps grid system for different screen sizes: https://getbootstrap.com/docs/4.0/layout/grid/#grid-options16:08
tobiashif it still looks bad for 1280x1024 we probably need to remove 'col-lg-3' and live with max three columns16:09
corvustobiash: ah, thanks for that link16:10
corvusi'm seeing 4 columns at 1280... which is confusing16:10
tobiash1280 probably already fits into the large category16:11
tobiashwe could try changing col-lg-3 to col-xl-3 to use 4 columns at larger screens16:12
SpamapSI don't mind the 4 columns.16:15
corvusmaybe it's too early -- i feel like i'm missing something -- why are we changing the 'lg' class for smaller screen sizes?16:16
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Switch back to three columns for mid sized screens  https://review.openstack.org/62799716:16
tobiashcorvus: I think this should do it ^16:16
corvusSpamapS: i don't mind having as many colums as we can fit, however, on my screen we can't fit 4 in that size.  the progress bars overlap the change numbers, and the project names take up 3 lines16:17
SpamapSoh weird16:17
corvusi posted a screenshot when i first reviewed it.  it seems to have expired now, but mordred posted a similar one16:17
SpamapSI'm at 2560x1440 scaled 200% ... that doesn't happen.16:18
corvushttps://screenshots.firefox.com/ocT0BNtkqBHWdfvg/zuul.openstack.org#16:19
tobiashcorvus: yes, that really looks ugly16:19
corvustobiash: i still feel like im missing something about the bootstrap -- that reads to me as "use 6 colums for small screens and 3 columns for extra large screens" why is that backwards?16:21
tobiashoops, that misses col-md-416:22
mordredcorvus: I think it's 'make the column 6 grid units wide'16:22
corvusmordred: oh thank you :)16:22
mordredwith a max 12 grid units available16:22
corvuswhat an aweful coincidence16:22
mordredcorvus: it took me most of this conversation to figure that out16:22
tobiashcorvus: so the classes are: col-sm-6 col-md-4 col-xl-316:22
tobiashlg is missing so md takes precedence16:23
tobiashso that reads like take 6/12 units for small screens, 4/12 units for medium to large screens and 3/12 units for extra large screens16:23
corvusgot it! thanks :)16:24
* corvus clicks on status icon for http://zuul.openstack.org/status/change/627997,116:24
mordred\o/16:25
tobiashcorvus, mordred: looks like we currently use bootstrap 3, but the xl class for extra large screens were introduces with bootstrap 416:31
mordredah16:31
tobiashso it ignores theat and shows three columns on my 4k screen16:31
tobiashbut 627997 should still fix it for 1280 and probably work when we switch to bootstrap 416:32
corvusso we'll be at 3 columns x>720 until we upgrade to bs4, then we'll have 3 columns for 720<x<1140 and 4 columns x>1140?16:34
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Switch back to three columns for mid sized screens  https://review.openstack.org/62799716:37
tobiashcorvus: actually we don't really know for sure how it will look like so we should just remove the xl class for now ^16:37
tobiashafter an upgrade we can try to add it again16:38
tobiashand it looks like react-bootstrap doesn't support bootstrap 4 yet: https://react-bootstrap.github.io/16:39
dmsimardI was trying to understand why a job I'm working on did not run and noticed this: zuul.Pipeline.openstack.check: Completed node request <NodeRequest None <NodeSet []>> for job noop of item <QueueItem 0x7fdc9cfd3f98 for <Change 0x7fdc3ce6d8d0 openstack/ara-web 625666,9> in check> with nodes <NodeSet []>16:39
dmsimardShould there really be a node request for the noop job ?16:39
dmsimardI guess it's noop and doesn't really request one but /shrug16:40
tobiashdmsimard: zuul creates an empty node request (which doesn't land in zk)16:40
mordredtobiash: ++ - sounds like the sequence there should be react-bootstrap adding support for v4, us upgrading to bs4, then adding the xl column16:40
dmsimardThere's even metrics attached to the noop job heh: zuul.nodepool: Nodeset <NodeSet []> with 0 nodes was in use for 3.170967102050781e-05 seconds for build <Build 691752f3a675457e8162b00561aeea01 of noop voting:True on <Worker Unknown>> for project openstack/ara-web16:40
dmsimard"3.170967102050781e-05" that's almost pi or something16:41
mordreddmsimard: :)16:41
tobiashdmsimard: zuul self-fulfills empty node requests16:43
dmsimardtobiash: makes sense16:43
dmsimardmy brain is still frozen from the holidays :p16:43
dmsimardOh wow, there was a bunch of things merged to zuul-web during the holidays -- thanks everyone involved in that <316:45
SpamapScorvus: ah ok actually yeah mine looks a bit like yours, just a teensy bit more space around stuff16:48
SpamapShow far are we from having buildset in the API? I'm really struggling to have a meaningful github success status. :-/16:49
corvusSpamapS: yeah, it's borderline.  if you have a short project name and not too many patchsets, it's almost ok.16:49
corvusSpamapS: i don't see an outstanding change for it, but at this point i don't think there would be any blockers16:50
dmsimardWhat is the default sort order for http://zuul.openstack.org/nodes ? It feels... random and it makes it less useful ? I'd expect it to be sorted by ID but it's not.16:53
corvusdmsimard: i think it may be unsorted.16:54
corvusdmsimard: https://review.openstack.org/553998 added it and shows the code involved if you want to make a patch :)16:56
dmsimardcorvus: would the sorting be done by the API or client side ?16:56
dmsimardunless mistaken, the react data table allows for client side sorting -- a bit like you can click the table headers in the ara web interface16:57
corvusdmsimard: i think we could have the api return them in id-sorted order if you wanted; anything more is probably better done client-side.16:58
corvus(since there's no pagination, there's not much of a reason for the api to support other sort options)16:59
dmsimard++16:59
*** hashar has quit IRC17:27
*** hashar has joined #zuul17:27
tobiashmordred: looks like zuul container builds are broken: http://logs.openstack.org/70/608670/2/gate/pbrx-build-container-images/c157205/job-output.txt.gz#_2019-01-02_14_46_02_40822017:45
tobiashand http://logs.openstack.org/70/608670/2/gate/zuul-quick-start/69be362/job-output.txt.gz#_2019-01-02_14_46_46_93323117:46
tobiashmordred: that happens during installing netifaces which is pulled in by openstacksdk17:46
mordredtobiash: yeah - I think Shrews is looking at that17:46
tobiashah ok17:46
mordredsomething seems to be broken with the latest netifaces release17:46
tobiashlooks like it got an update and fails to install on alpine now17:47
mordredwhich doesn't allow us to build wheels from it17:47
mordredyeah17:47
mordredeasiest fix might just be pinning netifaces back a version until it's sorted17:47
clarkbor exclude the broken version (and hope next version fixes)17:47
tobiashoops, didn't read the whole backlog17:48
*** kmalloc has joined #zuul17:50
Shrewsmordred: tobiash: well, i've yet to determine what about this version of netifaces is broken since previous version did not include the LICENSE file either. hoping pabelanger's wheel experience can help us17:51
clarkbShrews: https://github.com/al45tair/netifaces/commit/0bf4a1222a91c9ad9b9c729ba2bc97456da5b559 the lastest version has that in it17:54
clarkbthe previous one does not17:54
Shrewsclarkb: yes, we discussed that earlier17:54
clarkbthat is what is broken in this version then?17:55
clarkbprevious versiosn didn't try to include a license file so it wouldn't execute the broken code path17:55
tobiashShrews: installing it in a local alpine container works for me17:56
Shrewstobiash: yes, i tried that earlier too17:56
tobiashweird17:57
Shrewsseems specific to using wheels17:57
clarkbI think the issue is that setuptools includes files in the python module but not things above that17:57
clarkbso LICENSE doesn't get included in the resulting sdist as is17:57
clarkbthen when you try to build a package from that it is missing the necessary file17:58
clarkbif you build from the source dir this isn't an issue17:58
*** kmalloc has quit IRC17:58
mrhillsmandoes zuul.openstack.org have some extra changes upstream zuul does not have? i ask because i am running the latest zuul and the navigation menu is different17:58
Shrewshttps://github.com/al45tair/netifaces/issues/3018:01
*** sshnaidm is now known as sshnaidm|afk18:05
mrhillsmanfor comparison - http://ci-status.openops.io/t/openops/status18:11
clarkbmrhillsman: I think it depends on your scheduler being up to date as that requires more data in the api/db18:12
clarkbopenstack isn't running any special unmerged code18:13
mrhillsmanok thx18:13
mrhillsmanwill review my end18:13
mrhillsmans/review/fix18:13
*** hashar has quit IRC18:15
*** panda is now known as panda|off18:15
*** hashar has joined #zuul18:15
*** hashar has quit IRC18:24
*** hashar has joined #zuul18:24
*** hashar has quit IRC18:33
*** hashar has joined #zuul18:33
*** hashar has quit IRC18:37
pabelangerShrews: clarkb: if we switch from license_file to license does that make setuptools happy?18:37
pabelangerI'm going to test that locally now18:37
*** hashar has joined #zuul18:37
pabelangerclarkb: Shrews: https://github.com/al45tair/netifaces/pull/31 was the fix for me18:48
pabelangerI am not familiar enough with packaging to understand why it wasn't auto added18:48
clarkbpabelanger: because it isn't part of the python package dir18:49
pabelangerclarkb: how does it work with PBR? do we generate the MANIFEST.in file automatically at run time?18:50
*** hashar has quit IRC18:52
clarkbpbr adds everythin in git by default18:53
pabelangerPR merged, guess we wait for new upload to pypi18:58
*** tobiash has quit IRC19:02
dmsimardIs there a way to trigger a autohold for a specific provider ?19:05
dmsimardor set a autohold, rather19:05
*** tobiash has joined #zuul19:06
pabelangernot unless you setup the label only for that provider19:06
dmsimardhmm, it'd be nice to have to troubleshoot intermittent failures on a specific provider :)19:07
pabelangerclarkb: Shrews: netifaces 0.10.9 released, doing a recheck now19:16
pabelangerokay, seems to be working now: http://logs.openstack.org/70/608670/2/check/pbrx-build-container-images/a8b288f/19:25
dmsimardCould nodes from a given nodeset be on different providers ? "provider" appears to be a node property, not a nodeset property19:34
dmsimardhttp://git.zuul-ci.org/cgit/zuul/tree/zuul/model.py#n53619:35
mordredpabelanger: \o/19:36
mordreddmsimard: nodes in a nodeset should all come from the same provider19:36
SpamapSbut I think what pabelanger wants to do is specifically send a test job to a provider19:37
SpamapSso like "give me 2 nodes, *from rax-ord*"19:37
dmsimardmordred: I'm looking at the possibility of specifying a provider in a autohold request but it doesn't seem readily available unless I iterate through something like nodeset.getNodes() and then inspect each individual node provider19:37
SpamapSoh, not pabelanger , dmsimard19:37
SpamapS;)19:37
dmsimardSpamapS: I want autohold to trigger for a given tenant, job but only for a specific provider19:38
dmsimardin practice, there's some jobs intermittently failing only on one of many providers and it's a pita to troubleshoot :)19:39
clarkbdmsimard: fwiw that may be an indication we need better logging too19:39
SpamapSdmsimard: would be cool if one could zuul_return something that suggested an autohold, if the admin has allowed it, so that some post-review jobs could determine if they need deeper debugging.19:39
SpamapSLike "oh snap we failed at a weird spot, check this out"19:39
dmsimardclarkb: I don't disagree on improving logging but autohold is very convenient for edge cases :)19:41
clarkbin this case we don't seem to collect logs from that node at all?19:42
dmsimardit seems possible to add a provider filter to autohold, I'm just not very familiar with the database model/relationship19:42
clarkbso I'm not sure its a corner case, we have no logs19:42
openstackgerritMerged openstack-infra/nodepool master: Ignore removed provider in _cleanupLeakedInstances  https://review.openstack.org/60867020:17
*** panda|off has quit IRC20:30
*** panda has joined #zuul20:33
SpamapSso..20:53
SpamapSif I want to retry a post job20:53
SpamapSenqueue-ref ?20:53
corvusSpamapS: yep20:53
corvusSpamapS: you can get the magic values from the inventory file20:54
SpamapSIs there a spec for an admin REST API? I seem to recall one being discussed.20:58
SpamapScorvus: ty!20:58
SpamapScorvus: what's the magic value for --trigger?20:59
SpamapSignored21:00
SpamapS(the scheduler ignored my thing, I mean)21:00
SpamapStrying the name of the driver in --trigger21:00
SpamapS(so github)21:00
corvusSpamapS: should be the name of the connection (and should match something in the pipeline's trigger section)21:01
ShrewsSpamapS: https://review.openstack.org/56232121:02
SpamapSAh ok I did the name of the connection, yeah.21:03
SpamapSlooks like it missed on the files matcher21:03
SpamapSBut the same ref did match when the job failed21:04
SpamapSAny known problems with files matchers and enqueue-ref?21:04
SpamapS2019-01-02 20:59:55,073 DEBUG zuul.layout: Job <Job gmapi-post branches: {MatchAny:{BranchMatcher:master}} source: zuul-base-jobs/zuul.yaml@master#1> did not match files in <Branch 0x7f368d99cac8 GoodMoney/tech refs/heads/master updated c30ebd1a68ef85cc114cb62c24db0b1edc3cf966..40c27a9446ab4d3d2e7d1fe895f7c13bdce28cb0>21:05
SpamapS:-/21:13
SpamapScannot get this thing to retry21:13
openstackgerritMerged openstack-infra/zuul master: Only reset working copy when needed  https://review.openstack.org/62434321:35
* SpamapS gives up and just pushes a dead commit to get it to re-run21:54
clarkbSpamapS: isn't that goign to rely on the files data in the event? but in this case there is no event data?21:54
SpamapSclarkb: Perhaps? No idea how that works.21:55
clarkbI'm guessing this is a mismatch between how enqueue-ref works and your trigger expectations on the pipeline21:55
SpamapSPretty much a non-starter if you can't retry post jobs though.21:55
SpamapSI'd have expected that the change data comes from the ref.21:55
clarkbin the gerrit driver it comes from the gerrit event iirc21:55
clarkbnot sure about github21:55
* SpamapS cheats and just has github re-send the notification21:56
clarkbwith the github case it must rely on the event beacuse a PR can have any number of commits in it?21:57
clarkbso the simple ref data isn't sufficient to know what was changed21:57
clarkbthough maybe that is what old rev gives you21:57
SpamapSIt's not a PR21:58
SpamapSit's a push21:58
SpamapSIf it were a PR I could use enqueue. ;)21:58
clarkbwell its the same problem right? a push could come with any number of commits21:58
clarkbso you need to know the old base and the new HEAD21:58
clarkb(in order to calculate it locally)21:58
SpamapSYeah, which should give you the files changed.21:58
SpamapSFrom git.21:58
SpamapSBut I see what you're saying21:59
SpamapSit comes from the event21:59
SpamapSanyway, it might make sense for Zuul to store *everything* needed for a retry somewhere.22:04
clarkbya or learn the ability to discover that data from git if it is missing22:04
SpamapSYeah for that one. I just wonder what else we pull from events.22:08
SpamapS(but yeah, now that you say that, it really should always be *git* centric, not *git|gerrit* centric.22:08
corvusSpamapS: there is a case where zuul will internally generate the files list for a PR: https://review.openstack.org/60328722:10
corvusSpamapS: that could probably be re-used for synthetic events22:11
SpamapSneat22:12
SpamapSyeah seems like we can make things more resilient by using that method when the list isn't already available.22:13
*** dkehn_ has joined #zuul23:01
*** dkehn has quit IRC23:02
*** dkehn_ is now known as dkehn23:02
*** rlandy|rover is now known as rlandy|rover|bbl23:23
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: Combine artifact URLs with log_url if empty  https://review.openstack.org/62806823:24

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!