Tuesday, 2019-07-16

*** jangutter has quit IRC00:42
*** igordc has quit IRC01:01
*** armstrongs has joined #zuul01:32
*** armstrongs has quit IRC01:46
*** jeliu_ has joined #zuul02:20
*** jeliu_ has quit IRC02:27
*** bhavikdbavishi has joined #zuul02:34
*** bhavikdbavishi1 has joined #zuul02:37
*** bhavikdbavishi has quit IRC02:38
*** bhavikdbavishi1 is now known as bhavikdbavishi02:38
*** logan- has quit IRC03:11
*** logan- has joined #zuul03:15
*** michael-beaver has quit IRC03:21
*** saneax has joined #zuul03:48
*** jamesmcarthur has quit IRC04:50
*** bolg has joined #zuul05:00
*** igordc has joined #zuul05:07
*** pcaruana has joined #zuul05:08
*** jamesmcarthur has joined #zuul05:29
*** jamesmcarthur has quit IRC05:37
*** raukadah is now known as chandankumar06:03
*** bolg has quit IRC06:59
*** igordc has quit IRC07:16
*** tosky has joined #zuul07:21
*** jangutter has joined #zuul07:32
*** jamesmcarthur has joined #zuul07:33
*** jangutter has quit IRC07:33
*** jangutter has joined #zuul07:33
*** jamesmcarthur has quit IRC07:38
*** igordc has joined #zuul07:47
*** hashar has joined #zuul07:54
*** igordc has quit IRC08:06
*** jangutter has quit IRC08:15
*** jangutter_ has joined #zuul08:15
*** jangutter_ has quit IRC08:20
*** jangutter has joined #zuul08:24
*** panda has quit IRC08:54
*** jamesmcarthur has joined #zuul08:56
*** panda has joined #zuul08:57
*** jamesmcarthur has quit IRC09:00
*** bolg has joined #zuul09:04
*** jamesmcarthur has joined #zuul09:28
*** bjackman has joined #zuul09:29
*** jamesmcarthur has quit IRC09:32
sshnaidm|roverIf I have job defined with specific branches, not including master: https://review.opendev.org/#/c/670168/2/zuul.d/standalone-jobs.yaml - can I still run it on master when specifying "branches: master" for job vars in pipeline config?09:35
sshnaidm|roverbecause it doesn't seem to work: https://review.opendev.org/#/c/670176/1/zuul.d/layout.yaml09:36
*** tosky__ has joined #zuul10:17
*** tosky has quit IRC10:17
*** tosky__ is now known as tosky10:18
openstackgerritTobias Henkel proposed zuul/zuul master: Add support for smart reconfigurations  https://review.opendev.org/65211410:19
*** hashar has quit IRC10:37
openstackgerritTobias Henkel proposed zuul/zuul master: Add --check-config option to zuul scheduler  https://review.opendev.org/54216010:43
*** electrofelix has joined #zuul10:45
zbri wonder if there is a way to make the success/failure url more dynamic. if one is unsing them for pointing to unittest results, the link would be invalid if the job failed to produce them.10:51
*** bhavikdbavishi has quit IRC10:51
zbrideally we should be able to decide which file to point to at the end of the build, not at the start. based on what happens the "outcome" could be a different file.10:53
zbrthis could lower the time needed to find the source of the error.10:53
mordredzbr: the plan there is to improve the build page in the web dashboard to be able to display "artifact" urls returned by the job via zuul_return. (you can already return them and they're already in the json in the rest api - they're just not rendered in the build page) - then we'll start linking to build pages - and on the build page there can be any number of arbitrary named urls pointing to specific results11:05
mordredzbr: the main next step is improving the build page to display links to the artifact urls11:05
mordredmhu: I approved the openapi patch, in case you want to add api docs for the new auth related endpoints11:06
openstackgerritSimon Westphahl proposed zuul/zuul master: Spec for allowing circular dependencies  https://review.opendev.org/64330911:08
mordredtobiash: I don't suppose any of the finger clients support ssl connections do they? :)11:13
zbrmordred: cool. glad to hear that.11:14
*** jamesmcarthur has joined #zuul11:29
openstackgerritMerged zuul/zuul master: Run cleanup playbooks in job thread  https://review.opendev.org/67088811:32
*** jamesmcarthur has quit IRC11:33
*** hashar has joined #zuul11:42
openstackgerritTobias Henkel proposed zuul/zuul master: Add support for smart reconfigurations  https://review.opendev.org/65211411:49
openstackgerritTobias Henkel proposed zuul/zuul master: Add --check-config option to zuul scheduler  https://review.opendev.org/54216011:50
tobiashmordred: the finger gateway is a finger gateway that will support it ;)11:50
mordredtobiash: :)11:50
tobiashdoh11:51
tobiashyou get it11:51
mordredtobiash: I meant cli clients for the folks using it to stream the logs directly11:51
mordredyeah.11:51
tobiashI don't suppose it11:51
mordrednothing would stop us from writing a client that does :)11:51
mordredfinger for the 21st century!11:51
tobiashbut you could create your own finger client with one line of bash and openssl s_client11:51
mordredhahaha. yes11:51
openstackgerritMerged zuul/zuul master: web: add OpenAPI documentation  https://review.opendev.org/53554111:52
*** bjackman has quit IRC11:53
mordredtristanC: ^^ woot. time to document the rest of the API now I guess11:54
*** hashar_ has joined #zuul11:56
*** hashar has quit IRC11:56
tobiashmordred: I've responded to your comment on the codeowners patch11:59
mordredcool11:59
mordredtobiash: also - that's a nice pile of code in there - and neat that it's starting to use graphql!11:59
tobiashmordred: so the target for this is essentially to evaluate the green checkmark for required reviews as close as possible because github lacks the required info in their api12:00
tobiashmordred: we switched to graphql because of bugs in subteam handling in the rest api...12:00
tobiashbut actually mocking graphql using graphene was much easier than I initially thought12:01
mordredtobiash: from your experience with graphql so far, do you think it will improve our existing gh api interactions? or not worth it at the moment?12:01
mordredyeah - I thought the graphql mocking was pretty neat12:01
tobiashmordred: I think we should explore that where we make more requests in succession, but there is no need to completely convert to graphql12:02
mordred++12:03
*** jamesmcarthur has joined #zuul12:03
*** hashar_ has quit IRC12:05
*** hashar_ has joined #zuul12:06
*** jamesmcarthur has quit IRC12:08
*** bhavikdbavishi has joined #zuul12:10
*** jamesmcarthur has joined #zuul12:15
*** snapiri has quit IRC12:18
*** snapiri has joined #zuul12:18
fboHi, about nodes labels, let's say I have two nodes. First with labels "fedora30, paris" and the other one with "fedora30, tokyo". Is there a way to tell zuul to pick up in a nodeset the node with labels fedora30 && tokyo ?12:22
fbohttps://zuul-ci.org/docs/zuul/user/config.html#attr-nodeset seems to allow only one label12:22
*** wznoinsk has joined #zuul12:22
tobiashfbo: no, that's currently not possible12:23
wznoinsktobiash, do you think such a function would be useful (upstream openstack or otherwise for others) ?12:23
fbotobiash: ok, what about the difficulty to implement that ? is there any blocker ?12:24
tobiashuseful probably yes, but the current algorithms are not really prepared for this use case so it could get hard to get it right without bigger modifications12:25
openstackgerritMerged zuul/zuul master: web: add tenant and project scoped, JWT-protected actions  https://review.opendev.org/57690712:26
fbotobiash: thanks for the informations. We will look if we can find a workaround or provide that feature.12:27
openstackgerritMerged zuul/zuul master: Allow operator to generate auth tokens through the CLI  https://review.opendev.org/63619712:45
AJaegermordred: have you seen https://review.opendev.org/670895 ? Feel free to -2 if you don't like it...12:46
mordredAJaeger: lgtm - thanks!12:46
AJaegergreat12:46
*** badboy has quit IRC12:48
*** hwangbo has quit IRC12:49
*** michael-beaver has joined #zuul13:06
openstackgerritSorin Sbarnea proposed zuul/zuul-jobs master: Install system dependencies for tox-molecule  https://review.opendev.org/67102913:13
*** jamesmcarthur has quit IRC13:19
fungimordred: telnet-ssl is probably a passable "finger client" too if you're not above entering finger protocol commands (which are exceedingly simple)13:20
zbrfungi: mordred: please let me know if https://review.opendev.org/#/c/671029/ looks ok.13:33
Shrewsfbo: tobiash: my initial instinct on matching multiple labels (AND logic) would be exceedingly difficult with the current codebase.13:34
Shrewsbut not opposed to someone exploring it13:35
Shrewsthere have been enough feature requests on nodepool in the recent past, i wonder if we should begin planning version 4.013:37
*** bolg has quit IRC13:39
mordredyeah - because as I think about the example from above, it makes me think of region-affinity - and the ability to say "I want a fedora30 node and I don't care what cloud-region it's in" or "I want a fedora30 node in ovh-gra"13:39
mordredbut that's a whole big mess and not something to enter in to lightly without a ton of thought and design13:40
Shrewsmordred: is that a real request from someone or hypothetical?13:40
mordredShrews: just me thinking based off of the tags in the example being "paris" and "tokyo"13:41
Shrewswe should at least begin tracking feature requests somewhere. i'll start doing that for us13:42
mordredShrews: ++13:42
Shrewsah13:42
clarkbit would be good to understand the use casebeyond region affinity too. Is the motivation cost or maybe locality? I think different scenarios change what that looks like13:48
fboShrews: that a real user request, we help them to move from Jenkins, the POC is almost done but we just discovered that issue. With Jenkins they can match on multiple labels.13:49
clarkbwith cost for example nodepool could fogure that out without region aaffinity if clouds advertise their costs13:49
clarkband data locality might tie into zuuls artifact system and so on13:49
fboand that not just about the region it can also be about the disk size or whatever hardware specification13:49
fboso they expect a basic && matching on the labels13:50
Shrewsso region affinity and node characteristics. probably separate solutions for those13:51
fboI was thinking that th logic should only be in Zuul where a nodeset would allow to provide a list of labels where a simple && will apply to select the right node from nodepool13:52
Shrewsfbo: no, that logic would lie within nodepool13:52
Shrewsit's a request-response communication channel between zuul and nodepool. zuul doesnt do any node selection13:54
fbook well I don't know well that part13:54
fboShrews: where it is done in the Zuul code, I mean the call to nodepool ?13:55
Shrewsit creates a request via zookeeper13:58
Shrewshttps://opendev.org/zuul/zuul/src/branch/master/zuul/nodepool.py#L10713:58
fbothanks13:59
Shrewsfbo: to be clear, what you want to do would require changes to both zuul and nodepool, but the actual node selection logic is all nodepool14:01
clarkbit is also a somewhat different approach14:02
clarkbwith jenkins you are asking jenkins to give the job any resource which matches some criteria (ignoring the other criteria)14:02
clarkbwith zuul+nodepool the job says I need exactly this give it to me14:03
clarkbSo we may have to do quite a bit of tweaking to represent the less concrete node requests14:04
*** bolg has joined #zuul14:04
tobiashyes, this use case seems more targeted to static nodes14:04
tobiashfor cloud providers I don't really see the need for such a mechanism14:05
fbotobiash: clarkb yes exact it is related to static nodes14:09
*** bolg has quit IRC14:13
corvusfbo: as a workaround you may be able to add a "fedora30-tokyo" label to the node?14:16
corvusobviously not a scalable solution, but since static nodes can have multiple lables, you could add the cartesian product of all of them14:17
tobiashmultiple labels on static nodes however currently don't work well yet as well (https://review.opendev.org/667371 tries to address this)14:18
corvustobiash: yes, though fbo already suggested that the node had 2 labels14:19
fbocorvus: tobiash yes and it advised in the doc to have one pool per label so it does not ease the situation14:19
fbohttps://zuul-ci.org/docs/nodepool/configuration.html#attr-providers.[static].pools14:19
tobiashfbo: that's exactly what 667371 tries to fix14:20
tobiashfbo: so maybe you want to try this14:20
corvusright, but that may be a shorter path to get something working than a redesign (which, i agree with Shrews, would be good).  i'm just trying to help come up with short *and* long-term options.14:21
Shrewsoh static driver. that multi label logic is OR. the request is for AND14:21
Shrewsadding support for both to static will be... interesting14:22
corvusShrews: yeah, i agree, i don't think we get multi-label *requests* without a redesign.  but there's a workaround for simple cases with concatenation: labels: ['fedora30', 'tokyo', 'fedora30-tokyo'].  you want fedora30 && tokyo, you ask for fedora30-tokyo.  that would work today, it just won't work with perfect efficiency because of 667371.  but there is hope we can improve that without a redesign.14:24
tobiashyes, so corvus' suggestion combined with 667371 would probably the easiest short term option14:24
Shrewsyeah14:25
fbook then I'll have a deeper look at 667371 and propose that concat solution. thanks everybody !14:26
*** bolg has joined #zuul14:34
*** bolg has quit IRC14:35
*** bolg has joined #zuul14:36
*** bolg has quit IRC14:42
*** jeliu_ has joined #zuul14:44
*** jeliu_ has quit IRC14:44
*** jeliu_ has joined #zuul14:45
*** bhavikdbavishi has quit IRC14:52
*** jamesmcarthur has joined #zuul15:03
*** bolg has joined #zuul15:08
*** bolg has quit IRC15:12
*** saneax has quit IRC15:20
*** chandankumar is now known as raukadah15:26
*** hashar_ has quit IRC15:31
*** bolg has joined #zuul15:37
openstackgerritJeff Liu proposed zuul/zuul-operator master: [WIP] Verify Operator Pod Running  https://review.opendev.org/67039515:39
openstackgerritStephen Finucane proposed zuul/zuul master: web: Add warning about incompleteness of OpenAPI spec  https://review.opendev.org/67108615:41
*** bolg has quit IRC15:42
*** igordc has joined #zuul15:47
*** mattw4 has joined #zuul16:17
*** mattw4 has quit IRC16:19
*** mattw4 has joined #zuul16:19
*** hwangbo has joined #zuul16:26
*** jamesmcarthur has quit IRC16:29
*** hashar has joined #zuul16:30
*** jamesmcarthur has joined #zuul16:31
*** electrofelix has quit IRC16:35
openstackgerritMerged zuul/zuul master: web: Add warning about incompleteness of OpenAPI spec  https://review.opendev.org/67108616:52
*** aluria has quit IRC17:06
*** hashar has quit IRC17:12
*** igordc has quit IRC17:17
*** jamesmcarthur has quit IRC17:43
*** igordc has joined #zuul17:44
*** electrofelix has joined #zuul18:00
*** tosky has quit IRC18:01
*** electrofelix has quit IRC18:03
*** jamesmcarthur has joined #zuul18:07
openstackgerritMatthieu Huin proposed zuul/zuul master: Zuul CLI: allow access via REST  https://review.opendev.org/63631518:13
openstackgerritMatthieu Huin proposed zuul/zuul master: Add Authorization Rules configuration  https://review.opendev.org/63985518:13
openstackgerritMatthieu Huin proposed zuul/zuul master: Web: plug the authorization engine  https://review.opendev.org/64088418:14
*** hashar has joined #zuul18:15
*** jamesmcarthur has quit IRC18:25
*** hashar has quit IRC18:36
*** jamesmcarthur has joined #zuul18:42
*** jamesmcarthur has quit IRC18:51
*** jamesmcarthur has joined #zuul18:52
*** jamesmcarthur_ has joined #zuul18:53
*** jamesmcarthur_ has quit IRC18:54
*** mattw4 has quit IRC18:55
*** jamesmcarthur has quit IRC18:57
*** jamesmcarthur has joined #zuul18:58
*** jamesmcarthur_ has joined #zuul18:59
*** hashar has joined #zuul19:00
*** jamesmcarthur has quit IRC19:03
*** jamesmcarthur_ has quit IRC19:04
*** jamesmcarthur has joined #zuul19:05
*** jamesmcarthur_ has joined #zuul19:06
*** jamesmcarthur has quit IRC19:10
*** jamesmcarthur_ has quit IRC19:25
*** jamesmcarthur has joined #zuul19:28
*** jamesmcarthur_ has joined #zuul19:29
*** jamesmcarthur_ has quit IRC19:32
*** jamesmcarthur_ has joined #zuul19:33
*** jamesmcarthur has quit IRC19:33
*** jamesmcarthur has joined #zuul19:34
*** jamesmcarthur_ has quit IRC19:37
*** jamesmcarthur has quit IRC19:53
*** jamesmcarthur has joined #zuul19:53
*** jamesmcarthur_ has joined #zuul19:54
*** jamesmcarthur has quit IRC19:58
*** hashar has quit IRC20:02
*** mattw4 has joined #zuul20:04
*** rfolco is now known as rfolco_l8r20:39
*** jamesmcarthur_ has quit IRC20:45
*** sgw has quit IRC20:45
*** pcaruana has quit IRC21:01
daniel2Still having issues with the zuul docker stuff.  I restored most of the original config.  This is the errors I'm getting https://shafer.cc/paste/view/raw/e527fb92 Thats the entire docker compose debug output basically.21:35
*** sgw has joined #zuul21:38
corvusdaniel2: something is wrong with mysql21:40
corvus(the scheduler is waiting for mysql to start, and everything else is waiting for the scheduler to start gearman)21:41
corvusdaniel2: mysql_1         | Version: '10.4.6-MariaDB-1:10.4.6+maria~bionic'  socket: '/var/run/mysqld/mysqld.sock'  port: 0  mariadb.org binary distribution21:41
corvusdaniel2: that should say "port: 3306"21:41
daniel2oh weird..21:41
corvusdaniel2: since it doesn't, i think that means it's not listening on tcp21:41
corvusdaniel2: any chance something is listening on that port? (container or otherwise?)21:43
daniel2corvus: no, at this point nothing is running on this server except docker and ssh22:40
daniel2corvus: stopping and starting the containers fixed it22:47
daniel2i think it timed out too soon22:47
corvusdaniel2: yay? :)22:52
SpamapSfirst boot of mysql takes a bit23:16
SpamapSespecially if you have slow IO23:16
SpamapSit makes binlogs and stuff23:16
*** tobiash has quit IRC23:51
*** tobiash has joined #zuul23:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!