Wednesday, 2020-07-29

*** wuchunyang has joined #zuul00:06
*** wuchunyang has quit IRC00:10
ianwcorvus: if you're around, i might need some help understanding testing https://github.com/pyca/cryptography/pull/534100:44
ianwzuul definitely saw it http://paste.openstack.org/show/796397/00:45
ianwjust trying to figure out what happened next00:45
*** saneax has quit IRC00:46
*** weshay|ruck has quit IRC00:53
*** weshay_ has joined #zuul00:53
ianwahhh ... pipeline configuration i think ... hrm00:53
*** ericsysmin has quit IRC00:57
*** PrinzElvis has quit IRC00:57
*** iamweswilson has quit IRC00:57
*** samccann has quit IRC00:57
*** gundalow has quit IRC00:57
*** wuchunyang has joined #zuul01:00
*** wuchunyang has quit IRC01:00
*** wuchunyang has joined #zuul01:00
*** ericsysmin has joined #zuul01:01
*** PrinzElvis has joined #zuul01:01
*** iamweswilson has joined #zuul01:01
*** samccann has joined #zuul01:01
*** gundalow has joined #zuul01:01
*** mordred has quit IRC01:03
*** wuchunyang has quit IRC01:06
*** wuchunyang has joined #zuul01:06
*** rfolco has quit IRC01:08
*** mordred has joined #zuul01:09
ianwyep; it's merging it's own project-config now https://review.opendev.org/#/q/project:pyca/project-config01:12
*** rfolco has joined #zuul01:15
*** rfolco has quit IRC01:19
*** Goneri has quit IRC01:25
*** vblando has quit IRC01:42
ianw... github pull requests still not responding ... hrm02:06
ianw<QueueItem 0x7f60df09a690 for <Change 0x7f60d5e59e10 pyca/cryptography 5341,1e17c33a404d1f67b74aa4dc031a8a73aff2fce1> in check> is a failing item because ['it has an invalid configuration']02:07
ianwit really does not help me figure out what is invalid02:07
*** rfolco has joined #zuul02:08
clarkbthe web ui should say iirc the bell icon in the tenant status page02:27
*** rfolco has quit IRC02:28
*** wuchunyang has quit IRC02:34
*** saneax has joined #zuul02:43
ianwso i had .zuul.d/playbooks/... and zuul was seemingly descending into that02:58
ianwi feel like that may be a bug, or at least something we don't want to do02:59
ianwtrying to read a playbook as a config file and then that gave me the weird config error02:59
ianwok, jobs are queued now!  https://zuul.opendev.org/t/pyca/status03:01
*** bhavikdbavishi has joined #zuul03:09
ianwhrm, NODE_FAILURE ... but now this is more an #opendev problem03:11
*** wuchunyang has joined #zuul03:11
*** bhavikdbavishi has quit IRC03:19
*** bhavikdbavishi has joined #zuul03:36
*** wuchunyang has quit IRC04:02
*** wuchunyang has joined #zuul04:12
*** wuchunyang has quit IRC04:17
*** evrardjp has quit IRC04:33
*** evrardjp has joined #zuul04:33
*** wuchunyang has joined #zuul04:50
*** marios has joined #zuul05:05
*** wuchunyang has quit IRC05:36
*** wuchunyang has joined #zuul05:36
*** saneax has quit IRC05:51
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "gate your first patch"  https://review.opendev.org/73206706:08
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "Use zuul jobs"  https://review.opendev.org/73206806:08
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "gate pipeline"  https://review.opendev.org/73206906:08
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "job secrets"  https://review.opendev.org/73207006:08
openstackgerritGuillaume Chauvel proposed zuul/zuul master: tutorial: Add "job dependencies"  https://review.opendev.org/73207106:08
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Rename quick-start to zuul-tutorial-quick-start  https://review.opendev.org/73765606:08
*** bhavikdbavishi1 has joined #zuul06:27
*** bhavikdbavishi has quit IRC06:28
*** bhavikdbavishi1 is now known as bhavikdbavishi06:28
*** marios has quit IRC06:29
openstackgerritGuillaume Chauvel proposed zuul/zuul master: [DNM] TEST run zuul tutorials to test stream+callback (+ zuul-jobs change)  https://review.opendev.org/73547706:33
openstackgerritGuillaume Chauvel proposed zuul/zuul master: [DNM] Test: run multiple tutorials ('job dependencies' 2 times)  https://review.opendev.org/74155806:33
*** vishalmanchanda has joined #zuul06:40
*** bhavikdbavishi has quit IRC06:53
*** hashar has joined #zuul07:18
*** jcapitao has joined #zuul07:19
*** wuchunyang has quit IRC07:19
*** bhagyashris is now known as bhagyashris|lunc07:22
*** bhavikdbavishi has joined #zuul07:35
*** sgw1 has quit IRC07:35
*** tosky has joined #zuul07:39
*** yolanda has quit IRC07:40
*** nils has joined #zuul07:48
*** wuchunyang has joined #zuul07:52
*** jpena|off is now known as jpena07:55
*** vblando has joined #zuul07:59
*** wuchunyang has quit IRC08:06
*** evrardjp has quit IRC08:06
*** evrardjp has joined #zuul08:08
*** yolanda has joined #zuul08:17
*** bhagyashris|lunc is now known as bhagyashris08:40
*** wuchunyang has joined #zuul08:47
*** wuchunyang has quit IRC08:50
*** wuchunyang has joined #zuul08:50
*** wuchunyang has quit IRC09:14
*** wuchunyang has joined #zuul09:14
*** wuchunyang has quit IRC09:26
*** bhavikdbavishi has quit IRC09:26
*** hashar has quit IRC09:42
*** hashar has joined #zuul10:06
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: implement the open pipeline requirement  https://review.opendev.org/74070710:06
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: implement the merged pipeline requirement  https://review.opendev.org/74070810:06
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: implement the approval reporter  https://review.opendev.org/74143810:06
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: update naming in reference pipeline  https://review.opendev.org/74145010:06
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: support the merge request approval event  https://review.opendev.org/74148310:06
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: support the approval requirement  https://review.opendev.org/74163710:06
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: support the labeled event  https://review.opendev.org/74166710:06
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: support the labels requirement  https://review.opendev.org/74189310:06
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: support the merge reporter  https://review.opendev.org/74193110:06
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: remove default mutables  https://review.opendev.org/74193810:06
openstackgerritFabien Boucher proposed zuul/zuul master: gitlab: support the MR merged event  https://review.opendev.org/74210710:06
*** vblando has quit IRC10:08
*** hashar has quit IRC10:35
*** wuchunyang has joined #zuul10:42
*** saneax has joined #zuul10:55
*** hashar has joined #zuul11:14
*** jcapitao is now known as jcapitao_lunch11:15
*** bhavikdbavishi has joined #zuul11:27
*** bhavikdbavishi1 has joined #zuul11:29
*** bhavikdbavishi has quit IRC11:31
*** bhavikdbavishi1 is now known as bhavikdbavishi11:31
*** hashar has quit IRC11:34
*** hashar has joined #zuul11:34
*** hashar has quit IRC11:42
*** hashar has joined #zuul11:42
*** hashar has quit IRC11:44
*** hashar has joined #zuul11:45
*** rfolco has joined #zuul11:51
*** jpena is now known as jpena|lunch11:52
*** hashar has quit IRC11:57
*** rlandy has joined #zuul12:02
*** hashar has joined #zuul12:05
*** sanjayu_ has joined #zuul12:16
*** saneax has quit IRC12:19
*** hashar has quit IRC12:22
*** jcapitao_lunch is now known as jcapitao12:25
*** jpena|lunch is now known as jpena12:54
*** weshay_ is now known as weshay|ruck12:54
*** Goneri has joined #zuul13:01
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: ensure-pip: add instructions for RedHat system  https://review.opendev.org/74375013:03
*** sanjayu__ has joined #zuul13:06
*** sanjayu_ has quit IRC13:09
*** bhavikdbavishi has quit IRC13:20
openstackgerritGuillaume Chauvel proposed zuul/zuul master: scheduler: Fix event process abide hasUnparsedBranchCache argument  https://review.opendev.org/73904213:23
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Fix github branch protection while already unprotected  https://review.opendev.org/74034013:23
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Fix branch name and project name for ref-updated create/delete  https://review.opendev.org/73832013:23
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Update tests/base.py to use proper git data  https://review.opendev.org/74274613:23
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Tenant reconfiguration: Add tests  https://review.opendev.org/74274713:23
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Tenant reconfiguration: Reorg scheduler event process loop  https://review.opendev.org/74274813:23
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Tenant reconfiguration: Scheduler ref-updated create/delete  https://review.opendev.org/73919813:23
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Tenant reconfiguration: Allow ref-updated newrev+oldrev reconfiguration  https://review.opendev.org/74274913:23
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Tenant reconfiguration: Get ref-updated modified files  https://review.opendev.org/73907813:23
*** piotrowskim has joined #zuul13:46
*** bhavikdbavishi has joined #zuul14:15
*** sshnaidm is now known as sshnaidm|bbl14:17
*** bhavikdbavishi has quit IRC14:40
openstackgerritTobias Henkel proposed zuul/nodepool master: Use orjson for json parsing  https://review.opendev.org/74377814:54
*** sgw1 has joined #zuul14:54
*** fdegir5 has joined #zuul14:54
*** fdegir has quit IRC14:58
*** irclogbot_3 has quit IRC14:58
*** irclogbot_3 has joined #zuul15:00
tobiashcorvus: I just found out that our nodepool nodepool-builders are constantly using 100% cpu. Thread dumps suggest that this might be due to a suboptimal behavior of the upload workers.15:03
tobiashwe have 8 upload slots so each builder constantly iterates 8 times in parallel over all provider-images checking if it needs to upload stuff15:05
tobiashthis also hammers zk quite a lot I guess15:05
fungiinteresting, this is what the cpu utilizatiob looks like on one of opendev's builders: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=63828&rra_id=all15:07
tristanCfungi: isn't nl1 a launcher host?15:08
tobiashlaunchers have high cpu utilization as well, but due to other reasons15:09
fungiyep, sorry i meant to link http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=68025&rra_id=all15:09
tobiashyes, so a base cpu load as well (that load scales linearly with the upload workers and probably with the number of images)15:10
tobiashours top out at one cpu core15:10
*** wuchunyang has quit IRC15:10
fungiwe have 8 cores but only use around half of one15:11
fungi(per builder)15:11
tobiashhow many upload slots do you have?15:11
fungiwhat's an upload slot?15:12
tobiashhttps://zuul-ci.org/docs/nodepool/operation.html#daemon-usage15:12
tobiashupload-workers I mean15:12
tobiashdefault is 415:12
fungii don't see where we're setting it in nodepool.conf, so likely the default then15:13
tobiashit's a cli arg15:13
fungi/usr/bin/dumb-init -- nodepool-builder -f -c /etc/nodepool/nodepool.yaml -l /etc/nodepool/builder-logging.conf15:14
tobiashok, so default 415:14
funginot set on our command line either, so still likely the default yeah15:14
fungiwe have roughly a dozen images uploading to a dozen cloud regions, each image is around 10gb qcow2 (several times that raw but most regions use the qcow2)15:15
fungiright now the load for that is split between two builders each with 8 vcpus and 8gb ram15:16
tobiashI think that cpu base load doesn't come from the build or upload but from constantly checking if there is a new image there for upload15:17
tobiashthe algorithm is like loop over all providers and provider-images, get most recent image upload and if there is a newer local one do the upload.15:19
tobiashone improvement could be to do this only once and only dispatch the uploads themselves to #workers15:23
tobiasha second improvement would be to cache the images as well in a treecache like we already do with the nodes15:24
tobiashI think both together should improve this and also reduce quite a lot of load on zk as well15:25
*** bhavikdbavishi has joined #zuul15:44
felixedelcorvus: You might wan to have a look at the discussion in https://review.opendev.org/#/c/743239/1 regarding the "scroll fix" of the new Zuul UI. I've had a discussion with some Patternfly developers in their slack channel and it looks like we are on the right track with this although the solution looks a little hacky. It seems that the focus topic is very complex if you deal with something like a Drawer since different15:53
felixedel users are expecting different things to happen.15:53
openstackgerritTobias Henkel proposed zuul/nodepool master: Check for images to upload single threaded  https://review.opendev.org/74379015:54
corvusfelixedel: it seems weird that the drawer wraps the page; is there an alternative way to use it?15:55
corvusfelixedel: (it seems like it should just be a dropdown menu in the header or something)15:55
felixedelI assume that's related to the animation and size of the drawer, since the element that is wrapped by the drawer defines where the drawer is shown. If I understood that correctly. E.g, in this example the Drawer only uses parts of the page https://www.patternfly.org/v4/documentation/react/demos/masterdetaildemo/master-detail-full-page (just click on any list item)15:58
felixedelI assume that so far not many users are using the Drawer to wrap the whole page but so far there seems to be no other way to get something like the NotificationDrawer in PF315:59
felixedelAlso this is listed as "beta" component, so they might be improvements in the future.15:59
felixedelAnother way would be to use something completely different to show our config errors16:00
corvusfelixedel: yeah, though it really does look like notification drawer is the right widget for that :/16:01
corvusfelixedel: thanks for digging into that, i'll take a detailed look in a little bit :)16:02
felixedelI will tie everything together tomorrow and upate my change accordingly. Then everybody who is interested in this topic can have a look :D But from what I've seen on GitHub they are quire active in developing and improving the PF4 component, especially the "beta" ones.16:04
felixedel*components16:04
*** jcapitao has quit IRC16:09
*** bhavikdbavishi has quit IRC16:20
*** bhavikdbavishi1 has joined #zuul16:20
*** bhavikdbavishi1 is now known as bhavikdbavishi16:22
*** sshnaidm|bbl is now known as sshnaidm16:28
*** hashar has joined #zuul16:42
*** fdegir5 is now known as fdegir16:57
*** harrymichal has joined #zuul17:00
*** harrymichal has quit IRC17:01
*** rlandy is now known as rlandy|mtg17:02
*** jpena is now known as jpena|off17:02
*** wuchunyang has joined #zuul17:07
*** nils has quit IRC17:12
*** sugaar has quit IRC17:12
*** sshnaidm is now known as sshnaidm|afk17:15
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul master: Use redux for handling autoReload preference  https://review.opendev.org/74343417:25
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul master: Add user preferences dialog  https://review.opendev.org/73948217:30
*** bhavikdbavishi has quit IRC17:37
*** rlandy|mtg is now known as rlandy17:43
*** harrymichal has joined #zuul17:58
*** armstrongs has joined #zuul18:01
*** harrymichal has quit IRC18:22
*** harrymichal has joined #zuul18:22
*** vishalmanchanda has quit IRC18:29
*** hashar has quit IRC18:39
*** harrymichal has quit IRC18:41
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use (upload|promote)-docker-image roles in periodic jobs  https://review.opendev.org/74056018:49
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use (upload|promote)-docker-image roles in periodic jobs  https://review.opendev.org/74056018:52
*** sanjayu__ has quit IRC18:53
*** armstrongs has quit IRC20:23
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Tenant reconfiguration: Get ref-updated modified files  https://review.opendev.org/73907822:03
*** wuchunyang has quit IRC22:45
*** piotrowskim has quit IRC23:12
*** rlandy has quit IRC23:16
*** tosky has quit IRC23:21
*** y2kenny has joined #zuul23:32
y2kennyclarkb: I made a small comment on the max-servers patch.  I am not 100% but I think zk.ABORTED is needed23:34
y2kennyI ran into launch not completing without it when I was implementing the cobbler driver23:35

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!