Friday, 2021-04-30

*** rlandy|rover has quit IRC00:01
*** jamesmcarthur has quit IRC00:03
*** jamesmcarthur has joined #zuul00:04
*** jamesmcarthur has quit IRC00:08
*** jamesmcarthur has joined #zuul00:09
*** jamesmcarthur has quit IRC00:26
*** jamesmcarthur has joined #zuul00:29
*** jamesmcarthur has quit IRC00:33
openstackgerritJames E. Blair proposed zuul/zuul master: Add waiting status to status page  https://review.opendev.org/c/zuul/zuul/+/78837600:49
*** jamesmcarthur has joined #zuul00:53
openstackgerritJames E. Blair proposed zuul/zuul master: Support overlapping repos and a flat workspace scheme  https://review.opendev.org/c/zuul/zuul/+/78745100:56
openstackgerritJames E. Blair proposed zuul/zuul master: Emit stats for semaphore holders  https://review.opendev.org/c/zuul/zuul/+/78837800:58
*** jamesmcarthur has quit IRC01:02
*** jamesmcarthur has joined #zuul01:08
*** jamesmcarthur has quit IRC01:12
*** jamesmcarthur has joined #zuul01:18
*** josefwells has quit IRC01:22
*** hamalq has quit IRC01:30
*** jamesmcarthur has quit IRC01:43
*** jamesmcarthur has joined #zuul01:50
*** jamesmcarthur has quit IRC01:54
openstackgerritMerged zuul/zuul master: Support overlapping repos and a flat workspace scheme  https://review.opendev.org/c/zuul/zuul/+/78745102:06
*** evrardjp has quit IRC02:33
*** evrardjp has joined #zuul02:33
*** bhavikdbavishi has joined #zuul03:03
*** bhavikdbavishi1 has joined #zuul03:08
*** bhavikdbavishi has quit IRC03:10
*** bhavikdbavishi1 is now known as bhavikdbavishi03:10
openstackgerritIan Wienand proposed zuul/nodepool master: [wip] switch to using devstack's clouds.yaml  https://review.opendev.org/c/zuul/nodepool/+/78868403:17
*** bhavikdbavishi has quit IRC03:23
*** bhavikdbavishi has joined #zuul03:25
*** sam_wan has joined #zuul03:30
openstackgerritIan Wienand proposed zuul/nodepool master: Remove nodepool-functional-openstack  https://review.opendev.org/c/zuul/nodepool/+/78840603:36
openstackgerritIan Wienand proposed zuul/nodepool master: Switch to using openstackclient  https://review.opendev.org/c/zuul/nodepool/+/78868403:36
openstackgerritIan Wienand proposed zuul/nodepool master: Switch functional test to Focal nodeset  https://review.opendev.org/c/zuul/nodepool/+/78887603:36
*** bhavikdbavishi has quit IRC04:00
*** bhavikdbavishi has joined #zuul04:20
*** sam_wan has quit IRC04:21
*** bhavikdbavishi has quit IRC04:24
*** bhavikdbavishi has joined #zuul04:32
*** jamesmcarthur has joined #zuul04:37
*** jamesmcarthur has quit IRC04:37
*** ajitha has joined #zuul04:50
openstackgerritIan Wienand proposed zuul/nodepool master: Switch functional test to Focal nodeset  https://review.opendev.org/c/zuul/nodepool/+/78887605:24
*** jfoufas1 has joined #zuul05:24
*** saneax has joined #zuul05:43
openstackgerritTobias Henkel proposed zuul/zuul master: Fix broken jobs overriding checkout to an unprotected branch  https://review.opendev.org/c/zuul/zuul/+/78869405:58
*** jcapitao has joined #zuul06:31
*** bhavikdbavishi has quit IRC06:36
*** bhavikdbavishi has joined #zuul07:16
*** hashar has joined #zuul07:17
*** ricolin has quit IRC07:18
*** bhavikdbavishi1 has joined #zuul07:19
*** bhavikdbavishi has quit IRC07:21
*** sam_wan has joined #zuul07:21
*** bhavikdbavishi1 is now known as bhavikdbavishi07:21
*** rpittau|afk is now known as rpittau07:24
*** nils has joined #zuul07:26
*** jpena has joined #zuul07:35
*** tosky has joined #zuul08:21
*** hashar has quit IRC08:47
*** saneax has quit IRC08:59
*** bhavikdbavishi has quit IRC09:20
*** bhavikdbavishi has joined #zuul09:21
*** sam_wan has quit IRC09:33
openstackgerritMatthieu Huin proposed zuul/zuul-client master: Add search filters when relevant  https://review.opendev.org/c/zuul/zuul-client/+/78884709:33
lyrHi there. What does this error means ? "Unable to freeze job graph: Pre-review pipeline experimental does not allow post-review job yarn-build-test". Zuul was ok with that until I added the missing secret10:25
openstackgerritFelix Edel proposed zuul/zuul master: Provide statsd client to Nodepool and make scheduler optional  https://review.opendev.org/c/zuul/zuul/+/77460510:30
openstackgerritFelix Edel proposed zuul/zuul master: Make NodeSet fully serializable  https://review.opendev.org/c/zuul/zuul/+/77460810:30
openstackgerritFelix Edel proposed zuul/zuul master: Lock/unlock nodes on executor server  https://review.opendev.org/c/zuul/zuul/+/77461010:30
openstackgerritFelix Edel proposed zuul/zuul master: Calculate build start and end time on executor server  https://review.opendev.org/c/zuul/zuul/+/78891510:30
*** jcapitao has quit IRC10:32
*** bhavikdbavishi has quit IRC10:34
*** bhavikdbavishi has joined #zuul10:34
*** bhavikdbavishi has quit IRC10:35
*** bhavikdbavishi1 has joined #zuul10:35
*** bhavikdbavishi1 is now known as bhavikdbavishi10:37
*** bhavikdbavishi has quit IRC10:42
openstackgerritFelix Edel proposed zuul/zuul master: Switch to ZooKeeper backed merge result events  https://review.opendev.org/c/zuul/zuul/+/78419510:49
fungilyr: it means the yarn-build-test job has been set so it can only run in post-review pipelines (usually for safety so as not to expose credentials, does that job use any secrets?), but its been requested to run in the experimental pipeline which happens pre-review10:51
openstackgerritFelix Edel proposed zuul/zuul master: Improve component registry  https://review.opendev.org/c/zuul/zuul/+/78768410:53
openstackgerritFelix Edel proposed zuul/zuul master: Calculate statsd metrics via ComponentRegistry  https://review.opendev.org/c/zuul/zuul/+/78768510:53
*** PrinzElvis has quit IRC11:01
openstackgerritIan Wienand proposed zuul/nodepool master: Bump dib to 3.11.0  https://review.opendev.org/c/zuul/nodepool/+/78893711:25
*** jpena is now known as jpena|lunch11:30
*** rlandy has joined #zuul11:42
*** sshnaidm is now known as sshnaidm|off11:59
lyrfungi: yarn-build-test got run & post-run & secrets, and was indeed asked to run in experimental. Can live without experimental, but is it okay as periodic ? The secret usage I mean12:05
avasslyr: yep the periodic pipeline only run on branch heads (commits that are already merged) and should be post-review12:14
lyrthanks12:14
fungii concur12:17
*** hashar has joined #zuul12:31
*** bhavikdbavishi has joined #zuul12:33
*** jpena|lunch is now known as jpena12:34
*** bhavikdbavishi1 has joined #zuul13:28
*** bhavikdbavishi has quit IRC13:29
*** bhavikdbavishi1 is now known as bhavikdbavishi13:29
*** bhavikdbavishi has quit IRC13:44
*** josefwells has joined #zuul13:51
openstackgerritMerged zuul/nodepool master: Bump dib to 3.11.0  https://review.opendev.org/c/zuul/nodepool/+/78893714:01
*** rpittau is now known as rpittau|afk14:10
*** jamesmcarthur has joined #zuul14:13
openstackgerritSimon Westphahl proposed zuul/zuul master: Store tenants in unparsed abide as dict  https://review.opendev.org/c/zuul/zuul/+/77145614:23
openstackgerritSimon Westphahl proposed zuul/zuul master: Always get all configured project config files  https://review.opendev.org/c/zuul/zuul/+/78896214:23
*** avass has quit IRC14:27
*** avass has joined #zuul14:28
*** bhavikdbavishi has joined #zuul14:35
*** bhavikdbavishi1 has joined #zuul14:38
*** bhavikdbavishi has quit IRC14:40
*** bhavikdbavishi1 is now known as bhavikdbavishi14:40
*** ssmashnuk has joined #zuul14:42
*** jamesmcarthur has quit IRC14:44
*** jamesmcarthur has joined #zuul14:46
*** jamesmcarthur has quit IRC14:53
*** jamesmcarthur has joined #zuul14:55
*** bhavikdbavishi has quit IRC15:02
*** bhavikdbavishi has joined #zuul15:02
openstackgerritMatthieu Huin proposed zuul/zuul-client master: Add change-status subcommand  https://review.opendev.org/c/zuul/zuul-client/+/75983815:04
*** jamesmcarthur has quit IRC15:05
openstackgerritMatthieu Huin proposed zuul/zuul-client master: Add change-status subcommand  https://review.opendev.org/c/zuul/zuul-client/+/78896915:10
openstackgerritMatthieu Huin proposed zuul/zuul-client master: Add console-stream subcommand  https://review.opendev.org/c/zuul/zuul-client/+/75123815:12
openstackgerritMatthieu Huin proposed zuul/zuul-client master: Add change-status subcommand  https://review.opendev.org/c/zuul/zuul-client/+/75983815:12
*** ssmashnuk has quit IRC15:12
*** jamesmcarthur has joined #zuul15:13
avassmhu: ooh nice :)15:13
mhuavass: got a few goodies in the pipe to make zuul-client a usable alternative to the GUI15:14
mhuI think this one is pretty neat: display a job's console stream in your shell https://review.opendev.org/c/zuul/zuul-client/+/75123815:15
avassmhu: yeah I saw both of those. I'm looking forward to being able to keep my entire workflow in the terminal :)15:17
*** jamesmcarthur has quit IRC15:23
*** jamesmcarthur has joined #zuul15:24
*** jamesmcarthur has quit IRC15:27
*** jamesmcarthur has joined #zuul15:27
avasswhat version of zuul is opendev on at the moment?15:30
mordred4.2.1.dev27 5f9f597a15:31
corvuswe're not running the latest zk patch yet; i'd like to restart with it today15:32
clarkbthe last restart was tuesdayish15:33
avassmordred: uh, obviously I could have checked that myself :)15:33
mordredavass: :)15:33
avasscorvus: you mean 782939?15:34
corvusavass: correct15:35
*** hashar has quit IRC15:36
*** Shrews has joined #zuul15:41
*** jamesmcarthur has quit IRC15:43
*** jamesmcarthur has joined #zuul15:43
*** jamesmcarthur has quit IRC15:43
*** jamesmcarthur has joined #zuul15:47
*** bhavikdbavishi has quit IRC15:54
*** josefwells has quit IRC16:24
*** jfoufas1 has quit IRC16:27
*** jpena is now known as jpena|off16:38
mordredmhu: reading your change-status subcommand - it made me wonder if there would be a way for the zuul-client to be able to use the state of a local git repo to figure out missing parameters. like, instead of having to provide --change -  a local repo would at least know the sha - and maybe it would be possible for the client to get from that to the change ... just thinking out loud16:51
avassmordred: the github cli works something like that and isn't it possible to get to a change by searching with a commit in gerrit?16:53
fungiif your local repo included gerrit's refs/notes/review it could potentially figure it out that way, but would be a very gerrit-centric solution. i agree some commit id lookup through the zuul api could provide interesting glue options16:53
avassyeah at least you get to my change by entering: 834c2d001c19d97cd2cd6096f0f66c9f331c4a8e in the search field16:54
fungithere was a similar request earlier in the week to be able to dereference changes to commit ids, i think, for other reasons16:54
fungior maybe it was in the other direction, i don't recall now16:54
*** rlandy is now known as rlandy|training16:55
avassmordred: you can do curl https://review.opendev.org/changes/834c2d001c19d97cd2cd6096f0f66c9f331c4a8e16:58
avassmhu: ^16:59
fungiyeah, but that requires something to tell zuulclient where to find your gerrit16:59
fungiwould be better if zuulclient could just ask zuul for the status of a commit id and get back status for a change/pull request if it corresponded to one17:00
avassfungi: right17:00
fungiand then automatically infer that commit from the current directory if it's in a git repository17:01
avassI was gonna say that you could try the "gerrit" or "origin" remote but that would require the api to be served on that and not just be used for ssh/git17:01
fungiit would also mean the client connecting to multiple apis17:02
mhuavass: what's that? the gerrit change id? or the commit hash? we'd want something that works regardless of the connection used (gerrit, git, gitlab, etc)17:03
avassmhu: commit hash17:03
mhuok so that'd work for everything, neat17:03
corvusdo people really leave their git repos sitting around in the state of a change they pushed up for review?  i push up a change and then move on to something else17:03
avassonly when I feel like slacking :)17:03
fungii leave my git repos in multiple states i call "branches" ;)17:04
mhuwe should actually do that for enqueue, dequeue etc as well, i'm never sure how to do it for a github change FWIW17:04
fungibut yes, point taken, inferring the item from the commit of the current repository state is likely of limited utility, more generally being able to look up queue items by commit id might still have other benefits17:05
corvusi just want us to spend our limited development and review bandwidth on things that will be used :)17:06
mhuI'll look into that later, the little one is calling - his periodic "sleep" job might have ended in a POOP_FAILURE17:07
fungigood luck inspecting that log17:07
clarkbmhu: I think the little ones call that SUCCESS17:07
corvuscertainly worth keeping in mind for reasons why we might want to index the commit id in the db, but since we don't have it now, it's a few steps removed17:07
avassmhu: maybe he just had a jobs: [- poop] in his pipeline?17:08
fungicorvus: that was mostly my point. to do what mordred was suggesting we'd really need an additional index exposed via the api17:08
fungi(or at least used by the api for aliasing/lookups)17:09
corvusi guess incorporating that into an ide could be useful;  or a shell prompt if you could do it in a non-laggy way17:11
avassit could be useful if you have fast jobs, however most jobs I see are at least >10min (usually up to an hour)17:13
avassoh but I was thinking about the console now, not just change-status17:14
corvusah, that's potentially more useful as i think you're more likely to still be on a branch if you're insterested in live-streaming a log17:15
avasstrue17:15
fungimaybe also useful for zuul-runner integration?17:17
*** hamalq has joined #zuul17:19
*** hamalq has quit IRC17:20
*** hamalq has joined #zuul17:21
openstackgerritJames E. Blair proposed zuul/zuul master: WIP: Add ExecutorApi  https://review.opendev.org/c/zuul/zuul/+/78783217:25
openstackgerritJames E. Blair proposed zuul/zuul master: WIP change zone handling in ExecutorApi  https://review.opendev.org/c/zuul/zuul/+/78783317:25
openstackgerritJames E. Blair proposed zuul/zuul master: WIP Add some executor API tests  https://review.opendev.org/c/zuul/zuul/+/78862417:25
openstackgerritJames E. Blair proposed zuul/zuul master: WIP Execute builds via ZooKeeper  https://review.opendev.org/c/zuul/zuul/+/78898817:25
mordredcorvus, fungi, avass yeah - I was more thinking of console (good point about IDE). of course, having a file in the repo like the .gitreview file that could indicate zuul server, tenant and repo name would also help cut down on typing. BUT - as corvus said, we have limited dev resources17:53
avasscan't the zuul-client also be configured with a zuul.conf?17:55
*** rlandy|training is now known as rlandy18:01
*** fdegir has quit IRC18:04
*** icey has quit IRC18:04
*** shanemcd has quit IRC18:04
*** fdegir has joined #zuul18:07
*** icey has joined #zuul18:07
*** shanemcd has joined #zuul18:07
*** gouthamr has quit IRC18:08
*** gouthamr has joined #zuul18:09
openstackgerritGuillaume Chauvel proposed zuul/zuul master: Add 'uuid' to 'src_dir' to allow parallel jobs for static nodes  https://review.opendev.org/c/zuul/zuul/+/73598118:16
*** jamesmcarthur has quit IRC18:33
*** jamesmcarthur has joined #zuul18:34
*** jamesmcarthur has quit IRC18:49
*** jamesmcarthur has joined #zuul18:49
*** jamesmcarthur has quit IRC18:50
*** jamesmcarthur has joined #zuul18:50
*** Shrews has quit IRC19:02
mhuavass: yes19:08
mhuyou can specify the api url and tenant in the conf19:08
mhuand you can have as many subsections as "zuuls" you interact with19:08
*** nils has quit IRC19:15
*** nils has joined #zuul19:28
*** nils has quit IRC19:29
*** nils has joined #zuul19:31
*** jamesmcarthur has quit IRC19:35
*** jamesmcarthur has joined #zuul19:35
openstackgerritJames E. Blair proposed zuul/zuul master: WIP Execute builds via ZooKeeper  https://review.opendev.org/c/zuul/zuul/+/78898819:36
*** jamesmcarthur has quit IRC19:40
mhulooks like zuul.opendev.org is kaputt?19:48
openstackgerritMatthieu Huin proposed zuul/zuul master: zuul-client: test change-status command  https://review.opendev.org/c/zuul/zuul/+/75984019:50
fungimhu: it's being restarted19:51
openstackgerritMatthieu Huin proposed zuul/zuul master: REST API: add api/tenant/{tenant}/jobs/running endpoint  https://review.opendev.org/c/zuul/zuul/+/77164819:53
corvusre-enqueing20:04
corvuswrong channel sorry20:04
*** jamesmcarthur has joined #zuul20:06
*** jamesmcarthur has quit IRC20:20
*** jamesmcarthur has joined #zuul20:33
*** jamesmcarthur has quit IRC20:37
*** jamesmcarthur has joined #zuul20:50
*** jamesmcarthur has quit IRC20:56
*** ajitha has quit IRC20:59
*** jamesmcarthur has joined #zuul21:07
*** jamesmcarthur has quit IRC21:14
*** jamesmcarthur has joined #zuul21:26
openstackgerritMatthieu Huin proposed zuul/zuul-client master: Add change-status subcommand  https://review.opendev.org/c/zuul/zuul-client/+/75983821:31
*** jamesmcarthur has quit IRC21:32
*** erbarr has quit IRC21:37
*** erbarr has joined #zuul21:40
*** nils has quit IRC21:42
*** jamesmcarthur has joined #zuul21:44
*** rlandy has quit IRC21:47
*** jamesmcarthur has quit IRC21:52
*** jamesmcarthur has joined #zuul22:06
clarkbcorvus: tobiash  I'm looking at https://review.opendev.org/c/zuul/zuul/+/788694/3/zuul/manager/__init__.py and noticing it feels odd that we add branches to a list without any tie back to their projects? I guess what that means is we'll update a branch in all projects if it is overridden in one of them?22:08
*** jamesmcarthur has quit IRC22:14
corvusclarkb: my understanding is basically: if any project specifies that branch, we better have a state for it for all the projects because we might end up checking it out22:14
clarkbya as I tpyed it out I sort of realized that this is likely desirable22:15
corvusand i think the more the merrier; we just don't want all 10,000 branches of a branch-per-pr repo22:15
corvuslooks like that's gtg so i +3d22:16
*** jamesmcarthur has joined #zuul22:25
clarkbhttps://review.opendev.org/c/zuul/zuul/+/788681 is an interesting one too22:29
clarkband related fallout from the repo state changes22:29
corvus(i wouldn't consider that negative fallout; more of a bonus)22:29
clarkbya not negative. Like shaking a tree and getting an apple22:30
corvusit's nice we can speed things up a bit right now, since we're probably about to slow them down by putting things in zk, before they speed up again by adding paralellism22:31
corvusgives us a little more headroom22:31
clarkbcorvus: https://review.opendev.org/c/zuul/zuul/+/787751/2 you've approved this one but it can't land beacuse its parent is unreviewed. I'm reviewing the parent now if you also want to take a look22:32
clarkboh wait you wrote the parent22:32
corvuslgtm!  :)22:32
corvusthat might be a good one to ask tobiash to sanity check?22:33
clarkbya as a windows user that is probably a good idea22:33
*** jamesmcarthur has quit IRC22:33
clarkbtobiash: https://review.opendev.org/c/zuul/zuul/+/787743/2 specifically is the change to double check. It adds pywinrm to the zuul ansible installs by default22:35
clarkbpywinrm is MIT licensed and you only need optional build deps if using features like kerberos22:35
avassat least the ansible docs mention pywinrm: https://docs.ansible.com/ansible/latest/user_guide/windows_winrm.html#what-is-winrm we've been using it since we started using zuul and there's a testcase in zuul that mentions it: https://opendev.org/zuul/zuul/src/branch/master/tests/unit/test_executor.py#L93422:36
avass:)22:37
clarkbcorvus: any idea with what happened to this one https://review.opendev.org/c/zuul/zuul/+/764498 ?22:38
corvusclarkb: no idea22:39
mhuhey there zuul-maint, a few quick reviews for your consideration on zuul-client:22:46
mhusetuptools dependency https://review.opendev.org/c/zuul/zuul-client/+/78397022:46
mhubetter logging and CLI output https://review.opendev.org/c/zuul/zuul-client/+/78834022:46
mhuoutput formatters https://review.opendev.org/c/zuul/zuul-client/+/78883222:47
mhuI'd like these merged before the rest if possible22:47
*** jamesmcarthur has joined #zuul22:47
clarkbmhu: to be clear pbr does imply setuptools (it won't work without it); however, if you install a wheel then you may not have setuptools or pbr22:48
clarkb(or a distro apckage I suppose)22:48
mhuclarkb, yeah I did a pip install pbr and setuptools wasn't installed22:49
clarkbmhu: ya it is because setuptools installs pbr (via setup_requires)22:49
mhuI guess the test envs have setuptools installed by default22:49
*** jamesmcarthur has quit IRC22:53
*** jamesmcarthur has joined #zuul23:07
clarkbmhu: I think you can use https://docs.python.org/3/library/datetime.html#datetime.datetime.fromisoformat instead of dateutil.isoparse and avoid adding unnecessary deps (I left that in a comment on the change too)23:19
clarkbat least I'm assuming that the other direction is emitted by something like datetime.isoformat() and so we can reverse it this way23:19
clarkb(seems likely if we're only just now adding the dateutil dep)23:20
openstackgerritMerged zuul/zuul master: Fix broken jobs overriding checkout to an unprotected branch  https://review.opendev.org/c/zuul/zuul/+/78869423:20
*** jamesmcarthur has quit IRC23:21
*** tosky has quit IRC23:31
*** jamesmcarthur has joined #zuul23:36
*** jamesmcarthur has quit IRC23:41
openstackgerritMerged zuul/zuul master: [reporter][elasticsearch] fix the timestamp when the system has a different timezone by forcing the UTC timezone  https://review.opendev.org/c/zuul/zuul/+/78644423:53
*** jamesmcarthur has joined #zuul23:55

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!