Tuesday, 2020-09-01

*** frenzyfriday has joined #zuul00:01
*** frenzyfriday has quit IRC00:06
*** decimuscorvinus_ has joined #zuul00:26
*** decimuscorvinus has quit IRC00:26
*** rlandy|bbl is now known as rlandy00:33
*** frenzyfriday has joined #zuul00:52
*** frenzyfriday has quit IRC00:56
*** rlandy has quit IRC01:03
zenkurocorvus: success-url incorectly works vsriables. I copy excat value into itself01:40
zenkuroso, no variable value extraction happens01:41
*** frenzyfriday has joined #zuul01:46
*** wuchunyang has joined #zuul01:46
*** frenzyfriday has quit IRC01:50
*** frenzyfriday has joined #zuul02:40
*** frenzyfriday has quit IRC02:45
*** frenzyfriday has joined #zuul03:34
*** frenzyfriday has quit IRC03:38
*** bhavikdbavishi has joined #zuul03:58
*** bhavikdbavishi1 has joined #zuul04:03
*** bhavikdbavishi has quit IRC04:05
*** bhavikdbavishi1 is now known as bhavikdbavishi04:05
*** wuchunyang has quit IRC04:06
*** wuchunyang has joined #zuul04:06
*** bhavikdbavishi has quit IRC04:26
*** bhavikdbavishi has joined #zuul04:26
*** evrardjp has quit IRC04:33
*** evrardjp has joined #zuul04:33
*** wuchunyang has joined #zuul04:36
*** bhagyashris is now known as bhagyashris|away05:23
*** hamalq has joined #zuul05:39
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Update hashicorp jobs file with correct title  https://review.opendev.org/74785305:43
*** hamalq has quit IRC05:43
*** bhavikdbavishi has quit IRC05:54
*** bhavikdbavishi has joined #zuul05:56
*** bhavikdbavishi1 has joined #zuul05:59
*** hamalq has joined #zuul06:00
*** bhavikdbavishi has quit IRC06:01
*** bhavikdbavishi1 is now known as bhavikdbavishi06:01
*** mach1na has joined #zuul06:04
*** hamalq_ has joined #zuul06:04
*** hamalq has quit IRC06:04
*** hamalq_ has quit IRC06:08
*** frenzyfriday has joined #zuul06:16
*** bhavikdbavishi has quit IRC06:47
*** mach1na has quit IRC06:54
*** hamalq has joined #zuul07:13
*** bhavikdbavishi has joined #zuul07:13
*** mach1na has joined #zuul07:16
*** hamalq has quit IRC07:17
*** tosky has joined #zuul07:21
*** hamalq has joined #zuul07:34
*** hamalq has quit IRC07:38
*** hamalq has joined #zuul07:49
*** holser has quit IRC07:52
*** jpena|off is now known as jpena07:52
*** hamalq has quit IRC07:53
*** hamalq has joined #zuul08:05
*** hamalq has quit IRC08:09
*** holser has joined #zuul08:11
*** holser has quit IRC08:11
*** holser has joined #zuul08:12
*** hashar has joined #zuul08:16
openstackgerritMerged zuul/zuul-jobs master: Update hashicorp jobs file with correct title  https://review.opendev.org/74785308:21
*** sshnaidm|bbl is now known as sshnaidm08:36
*** mach1na has quit IRC08:36
*** mach1na has joined #zuul08:39
*** AshBullock has joined #zuul08:49
*** nils has joined #zuul09:19
*** holser has quit IRC09:40
*** wuchunyang has quit IRC10:08
*** wuchunyang has joined #zuul10:11
*** piotrowskim has joined #zuul10:13
*** wuchunyang has quit IRC10:15
*** holser has joined #zuul10:29
*** mgagne has quit IRC10:39
*** bhavikdbavishi has quit IRC10:55
*** AshBullock has quit IRC10:56
*** holser has quit IRC11:09
*** bhavikdbavishi has joined #zuul11:12
*** mach1na has quit IRC11:19
openstackgerritMatthieu Huin proposed zuul/zuul master: gerritconnection: use generic simpleQuery over default HTTP when polling  https://review.opendev.org/74924611:34
*** jpena is now known as jpena|lunch11:34
*** vishalmanchanda has joined #zuul11:40
*** mach1na has joined #zuul11:53
*** holser has joined #zuul11:54
*** mattd01 has joined #zuul12:01
*** mach1na has quit IRC12:01
*** rlandy has joined #zuul12:01
*** mach1na has joined #zuul12:02
*** bhavikdbavishi has quit IRC12:17
*** frenzyfriday has quit IRC12:33
*** jpena|lunch is now known as jpena12:37
openstackgerritHaïkel Guémar proposed zuul/zuul-jobs master: Add-sshkey: ensure that ssh home directory exists  https://review.opendev.org/74927812:43
*** AshBullock has joined #zuul13:17
*** Goneri has joined #zuul13:27
AshBullockHey all, I've been doing some reading of the zuul codebase and documentation as I want to start contributing, particularly I'm looking at the BitBucket driver which I see some progress has already been made, I was wondering if anyone had any time for me to ask some questions around my understanding, particularly of the drivers?13:41
openstackgerritMerged zuul/zuul-jobs master: Add-sshkey: ensure that ssh home directory exists  https://review.opendev.org/74927813:44
*** frenzyfriday has joined #zuul13:44
*** AshBullock has quit IRC13:46
*** AshBullock has joined #zuul13:46
openstackgerritMatthieu Huin proposed zuul/zuul master: gerritconnection: use generic simpleQuery over default HTTP when polling  https://review.opendev.org/74924613:51
fungiAshBullock: ofosos was the one working on that patch series, but it doesn't look like he's touched it for roughly a year and the last time we saw him in this irc channel was three months ago14:03
fungii spoke with him briefly in brussels when i was there for fosdem and he seemed to still be interested in getting it working. he said it was mostly functional but he was having trouble tracking down a constant bitbucket api disconnection problem with it and he wasn't sure if the problem was the code or his network14:04
fungiAshBullock: i think lots of us in here are happy to answer general questions about zuul and its source code and writing new connection drivers, but a likely first step will be trying to deploy a patched scheduler with the current state of the bitbucket driver and see what it does. maybe do it from a quickstart deployment so you've also got a test gerrit to use as a reference connection for comparison?14:07
zbrfungi: corvus: simple E208 fixes: https://review.opendev.org/#/c/748498/14:10
*** sshnaidm has quit IRC14:34
openstackgerritMatthieu Huin proposed zuul/zuul master: gerritconnection: use generic simpleQuery over default HTTP when polling  https://review.opendev.org/74924614:43
openstackgerritClark Boylan proposed zuul/nodepool master: DNM test arm64 docker image builds  https://review.opendev.org/74929914:48
*** sshnaidm has joined #zuul14:53
*** hashar is now known as hasharAway15:02
*** yoctozepto has quit IRC15:02
*** yoctozepto has joined #zuul15:03
AshBullockfungi Thanks, yeah I've tried to reach out to ofosos last week to show interest in contributing and see where he'd got up to with it, yep that's exactly where I am at right now, I've got a dev zuul node with the patch set up and running with a github connection, it's currently failing to start up with the bitbucket configs added, but I've got some15:05
AshBullockfurther debugging to do before I've got any useful questions :D :)15:05
fungigreat! excited to see some potential for further progress on that connection driver15:08
*** AshBullock has quit IRC15:10
openstackgerritClark Boylan proposed zuul/nodepool master: Omnibus nodepool container image fixes  https://review.opendev.org/74194215:15
openstackgerritMerged zuul/zuul master: Revert PF4 build page  https://review.opendev.org/74909815:22
*** hasharAway is now known as hashar15:25
*** zenkuro15 has joined #zuul15:31
*** mach1na has quit IRC15:33
*** AshBullock has joined #zuul15:45
zenkuro15hi, it looks like success-url use some kind of safe url formating, and I cant figure out how to pass variables to it. I cant address local job variables15:46
clarkbzenkuro15: its evaluated in the context of some zuul state (I'd have to look up what state that is) but it happens within zuul not job context iirc15:49
*** sshnaidm is now known as sshnaidm|bbl15:50
zenkuro15clarkb: /usr/lib/python3.6/site-packages/zuul/model.py:2732  formatUrlPattern15:51
zenkuro15I think is somehow related to it15:51
clarkbya it is let me get a link, it sows what you can interpolate15:52
clarkbzenkuro15: https://opendev.org/zuul/zuul/src/branch/master/zuul/model.py#L2736-L275215:53
clarkbchange, pipeline, tenant, buildset, job and build seem available15:53
zenkuro15yah... but hey dont... or I do not understand how to use them15:55
clarkbzenkuro15: from our git logs back when we used it: success-url: http://logs.openstack.org/{change.number[4]}{change.number[5]}/{change.number}/{change.patchset}/{pipeline.name}/{build.uuid[0]}{build.uuid[1]}{build.uuid[2]}{build.uuid[3]}{build.uuid[4]}{build.uuid[5]}{build.uuid[6]}/15:57
zenkuro15clarkb: dark magic! Thanks!15:58
*** hamalq has joined #zuul16:00
*** bhavikdbavishi has joined #zuul16:04
*** bhavikdbavishi1 has joined #zuul16:17
*** bhavikdbavishi has quit IRC16:18
*** bhavikdbavishi1 is now known as bhavikdbavishi16:18
openstackgerritClark Boylan proposed zuul/nodepool master: DNM test arm64 docker image builds  https://review.opendev.org/74929916:28
openstackgerritClark Boylan proposed zuul/nodepool master: Use arm64 wheels from openstack if available  https://review.opendev.org/74194216:28
openstackgerritClark Boylan proposed zuul/nodepool master: Update bindep and vhd-util install for arm64  https://review.opendev.org/74935916:28
clarkbzuulians I think https://review.opendev.org/749359 is safe to land and will help arm64 builds while being covered by x86 builds (so we can land that before we do arm64 images)16:29
clarkbthe other two are sort of exploratory and maybe we'll find we aren't ready for arm64 imges yet or maybe we will find its good to go16:29
*** hamalq has quit IRC16:31
*** hamalq has joined #zuul16:31
*** hamalq_ has joined #zuul16:33
*** zenkuro15 has quit IRC16:35
*** hamalq has quit IRC16:37
clarkbfungi: fwiw ^ the first round of that confirmed the cp35 abi3 wheel for cryptography is used by newer pythons with newer pip16:44
*** zenkuro has quit IRC16:46
*** sshnaidm|bbl is now known as sshnaidm16:46
fungithat's awesome, means we don't actually need to build other abis once everyone has new enough pip16:52
fungiso circa 2030 ;)16:52
*** sshnaidm is now known as sshnaidm|afk17:11
*** jpena is now known as jpena|off17:17
*** mattd01 has quit IRC17:19
*** hashar is now known as hasharAway17:22
zbrclarkb: fungi: https://review.opendev.org/#/c/740733/ ?17:23
zbralso https://review.opendev.org/#/c/748737/2 which is fixing at least broken jobs, like https://zuul.opendev.org/t/zuul/build/cfad19b04a2148d1bb7f77821128042917:27
clarkbzbr: for that second change I don't think that is a complete normalziation17:28
clarkbthough fungi has a lot more of that paged in17:28
clarkbinstead we should just run ensure-pip and then pkg resources will be present17:28
clarkbthis is what I suggested when this first came up17:28
zbrthis seems like using a side effect from another role in order to avoid a bug17:29
clarkbthe bug is the package isn't installed. ensure-pip intentionally installs that package17:29
clarkbyes its ia side effect but an intentional one17:29
zbri wonder who will be able to explain me how prAPI came to exist17:30
zbrthat import from pkg_resources makes no sense at all17:30
zbrthe method I added is the current implementation being imported17:31
clarkbits probably just to shorten the identifier17:31
zbradding one extra dependency for an ansible module, which we all know that they are very sensitive to imports17:31
zbris like someone deliberately wanted to make it fail17:32
clarkbif that is a copied implementation then your change should make that clear17:32
clarkb(because its vendored code)17:32
clarkbwhat?17:32
clarkbno one wants anything todeliberately fail17:32
clarkbcan we please not over dramatize this?17:32
zbrso basically i need to document hat i vendor: return replace('-', '_')17:32
clarkbif its another tools verbatim api then yes I would17:33
zbrok in the title?17:33
clarkbI would just put a comment above the function with info from where it originates17:34
clarkbthat way if the api changes we can fix it17:34
clarkband its clear who that originated from17:34
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: Remove dependency on pkg_resources  https://review.opendev.org/74873717:35
zbrsure. i hope I do not have to add a copyright note for copy/pasting replace('-', '_')17:35
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: Remove dependency on pkg_resources  https://review.opendev.org/74873717:38
zbrclarkb: https://review.opendev.org/#/c/748498/ also has few E208 fixes17:44
*** rlandy has quit IRC17:44
*** sgw has quit IRC17:44
*** aluria has quit IRC17:44
*** rlandy has joined #zuul17:46
*** sgw has joined #zuul17:46
*** aluria has joined #zuul17:46
*** noonedeadpunk has quit IRC17:48
zbrMaybe I should call the topic presevegate, to be in sync with https://github.com/ansible/ansible/pull/7148617:48
clarkbon the e208 side I wanted to seehow the opendev/base-jobs change does before merging more changes as they have overlappibg concerns17:50
clarkbthat landed receently so maybe give it a few morehoursbefore landing more17:50
*** noonedeadpunk has joined #zuul17:51
*** AshBullock has quit IRC17:58
*** mattd01 has joined #zuul18:14
*** bhavikdbavishi has quit IRC18:37
clarkbcorvus: ianw: on the nodepool arm64 image side of things we time out in https://review.opendev.org/749299 which has to build wheels for things that are missing. If we mix in the openstack wheel mirror (https://review.opendev.org/741942) the job passes. That was mostly expected and points out there are wheels other than cryptography that need to be built18:55
clarkbI think we can safely use the openstack wheel mirror except we'll have problems if/when openstack constraints lag behind upstream releases (zuul doesn't pin those deps)18:55
clarkbI think that means our next steps are to identify those additional wheels and see how we can build those next18:55
clarkbthe logs from https://review.opendev.org/749299 should identify which tarballs instead of wheels we pull18:56
clarkbif we're willing to accept the constraints mismatch risk and maybe disable arm64 when that becomes a problem we could likely build arm64 images at least today :019:01
clarkber :)19:01
clarkbmight be a good experiment eithre way19:01
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: Remove dependency on pkg_resources  https://review.opendev.org/74873719:03
*** frenzyfriday has quit IRC19:16
*** openstackgerrit has quit IRC19:21
*** armstrongs has joined #zuul19:29
*** hasharAway has quit IRC19:59
*** tflink has quit IRC20:32
*** tflink has joined #zuul20:33
*** mattd01 has quit IRC20:35
*** frenzyfriday has joined #zuul20:43
*** frenzyfriday has quit IRC20:52
*** nils has quit IRC20:57
*** vishalmanchanda has quit IRC20:58
clarkbThinking out loud a bit more about the nodepool arm64 image situation: what if we used the openstack wheel mirror for arm64 but made the jobs nonvoting and also split x86 from arm64? Then when openstack is caught up we're working and when not caught up it fails and we ignore it. Then once we've got the wheels built for more than just openstack we merge back into a single image manifest?21:24
*** frenzyfriday has joined #zuul21:42
*** frenzyfriday has quit IRC21:46
clarkbianw: PyYAML, PrettyTable, voluptuous, openshift, pynacl, dogpile.cache, netifaces, cffi, MarkupSafe, ruamel.yaml.clib these are the packages we need to build wheels for. PyYAML, PrettyTable, voluptuous, and openshift build reasonably quickly. Then we hit pynacl and timeout so unsure of time to build the others.21:51
clarkbianw: it does appear that bcrypt has grown an arm64 wheel since we last did this too which is good news21:52
clarkbpynacl is another pyca project21:53
clarkbso maybe we can gently encourage them to add arm64 wheels there too :)21:53
clarkbtristanC: do you know why the openshift lib doesn't publish wheels? Looks like its pure python21:55
clarkb(thats not really a blocker, just noticing it as an oddity that maybe they want to address)21:56
*** hamalq_ has quit IRC22:16
ianwclarkb: https://github.com/pyca/pynacl/issues/601#issuecomment-684113983 on pynacl22:25
ianwthey really want release automation; something we've of course solved :)22:25
ianwthe problem is we can't offer windows and osx resources22:26
clarkbso the issue is if we cant have windows or osx then we cant have linux? its almost like one of these is freely available and accessible...22:27
ianwwell yeah, the theme of the discussion has been they want to avoid what they're doing now of manually uploading bits and do everything in one22:28
ianwit's not so much we can't have linux; it's more that we can't offer zuul as the solution22:29
ianw... maybe not *totally* true ... one thought was that zuul could trigger a github action to build those wheels in the release pipeline22:30
ianwand then collect the github artifacts, and upload that22:30
clarkbIt just seems like we're avoiding progress because we need to go buy licenses to make more people happy22:31
ianwwhile it's certainly doable -- i don't think we have lego blocks to do that out of the box22:31
clarkbya as long as there is an api it should be doable22:32
ianwthat's what they currently do; release the sdist, then trigger their github actions to build the wheels, collect them from an artifact page and upload to pypi manually22:32
*** Goneri has quit IRC22:37
*** tosky has quit IRC22:43
*** frenzyfriday has joined #zuul23:30
*** holser has quit IRC23:33
*** frenzyfriday has quit IRC23:40

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!