Thursday, 2020-03-19

openstackgerritIan Wienand proposed zuul/nodepool master: Move config merge into DiskImage object  https://review.opendev.org/71355000:01
openstackgerritIan Wienand proposed zuul/nodepool master: Add parent and abstract flags for diskimages  https://review.opendev.org/71315700:04
openstackgerritIan Wienand proposed zuul/nodepool master: Move config merge into DiskImage object  https://review.opendev.org/71355000:04
openstackgerritIan Wienand proposed zuul/nodepool master: diskimage: make name primary key  https://review.opendev.org/71338200:08
openstackgerritIan Wienand proposed zuul/nodepool master: Add parent and abstract flags for diskimages  https://review.opendev.org/71315700:08
openstackgerritIan Wienand proposed zuul/nodepool master: Move config merge into DiskImage object  https://review.opendev.org/71355000:08
*** jamesmcarthur has quit IRC00:46
*** tosky has quit IRC00:50
*** jamesmcarthur has joined #zuul00:58
*** jamesmcarthur has quit IRC00:59
*** jamesmcarthur_ has joined #zuul00:59
*** jamesmcarthur_ has quit IRC01:10
*** jamesmcarthur has joined #zuul01:13
*** ianychoi_ has joined #zuul01:38
*** ianychoi has quit IRC01:40
*** mgoddard has quit IRC01:49
*** mgoddard has joined #zuul01:57
openstackgerritIan Wienand proposed zuul/nodepool master: Move config merge into DiskImage object  https://review.opendev.org/71355001:57
*** swest has quit IRC02:06
*** mattw4 has quit IRC02:07
*** swest has joined #zuul02:21
*** rlandy|bbl is now known as rlandy02:22
*** rlandy has quit IRC02:45
*** bhavikdbavishi has joined #zuul03:00
*** jamesmcarthur has quit IRC03:03
*** jamesmcarthur has joined #zuul03:06
*** jamesmcarthur has quit IRC03:06
*** jamesmcarthur has joined #zuul03:06
*** vblando has joined #zuul03:07
openstackgerritIan Wienand proposed zuul/nodepool master: Add parent and abstract flags for diskimages  https://review.opendev.org/71315703:08
openstackgerritIan Wienand proposed zuul/nodepool master: Move config merge into DiskImage object  https://review.opendev.org/71355003:08
*** jamesmcarthur has quit IRC04:18
*** jamesmcarthur has joined #zuul04:19
*** jamesmcarthur has quit IRC04:24
*** jamesmcarthur has joined #zuul04:26
*** evrardjp has quit IRC05:36
*** evrardjp has joined #zuul05:36
*** reiterative has quit IRC05:40
*** reiterative has joined #zuul05:40
*** bhavikdbavishi has quit IRC06:05
*** bhavikdbavishi has joined #zuul06:06
openstackgerritMerged zuul/zuul-jobs master: Update ansible-lint exception  https://review.opendev.org/71374206:08
*** zxiiro has quit IRC06:24
*** jamesmcarthur has quit IRC06:31
*** dpawlik has joined #zuul06:53
*** Defolos has joined #zuul06:57
avasslooks like tox_executable isn't stored in the fact cache for some reason07:21
*** klindgren has quit IRC08:01
*** klindgren has joined #zuul08:01
*** threestrands has quit IRC08:01
*** vblando has quit IRC08:07
*** vblando has joined #zuul08:08
*** portdirect has quit IRC08:08
*** guilhermesp has quit IRC08:09
*** portdirect has joined #zuul08:10
*** mnaser has quit IRC08:10
*** mnaser has joined #zuul08:11
*** guilhermesp has joined #zuul08:12
*** tosky has joined #zuul08:21
*** klindgren has quit IRC08:31
*** klindgren has joined #zuul08:31
*** klindgren has quit IRC08:38
*** klindgren has joined #zuul08:39
*** jcapitao has joined #zuul08:42
*** jpena|off is now known as jpena08:48
*** hashar has joined #zuul08:48
*** yoctozepto has quit IRC09:07
*** klindgren has quit IRC09:10
*** klindgren has joined #zuul09:11
*** harrymichal has joined #zuul09:11
*** yoctozepto0 has joined #zuul09:16
*** yoctozepto9 has joined #zuul09:27
*** yoctozepto0 has quit IRC09:27
*** harrymichal has quit IRC09:31
*** sshnaidm|afk is now known as sshnaidm09:49
*** harrymichal has joined #zuul09:52
*** harrymichal has quit IRC09:59
*** harrymichal has joined #zuul10:11
*** harrymichal has quit IRC10:15
*** bhavikdbavishi has quit IRC10:26
*** yoctozepto9 is now known as yoctozepto10:37
*** yolanda has quit IRC11:01
*** harrymichal has joined #zuul11:06
*** yolanda has joined #zuul11:13
*** klindgren has quit IRC11:23
*** klindgren has joined #zuul11:24
openstackgerritJan Kubovy proposed zuul/zuul master: WIP: Separate connection registries in tests  https://review.opendev.org/71295811:52
openstackgerritJan Kubovy proposed zuul/zuul master: Scheduler test app manager  https://review.opendev.org/70881211:55
openstackgerritJan Kubovy proposed zuul/zuul master: Use scheduler manager consistently in tests  https://review.opendev.org/70954211:55
openstackgerritJan Kubovy proposed zuul/zuul master: Refactor executor_client in tests  https://review.opendev.org/70967211:55
openstackgerritJan Kubovy proposed zuul/zuul master: Refactor merge_client in tests  https://review.opendev.org/70967611:55
openstackgerritJan Kubovy proposed zuul/zuul master: Refactor nodepool in tests  https://review.opendev.org/70970311:55
openstackgerritJan Kubovy proposed zuul/zuul master: Refactor zookeeper in tests  https://review.opendev.org/70970911:55
openstackgerritJan Kubovy proposed zuul/zuul master: Consolidate scheduler pause/exit as hibernation  https://review.opendev.org/70972311:55
openstackgerritJan Kubovy proposed zuul/zuul master: Refactor `self.event_queues` in tests  https://review.opendev.org/70999011:55
openstackgerritJan Kubovy proposed zuul/zuul master: Scheduler's pause/resume functionality  https://review.opendev.org/70973511:55
openstackgerritJan Kubovy proposed zuul/zuul master: WIP: Separate connection registries in tests  https://review.opendev.org/71295811:55
*** rlandy has joined #zuul11:57
*** jcapitao is now known as jcapitao_lunch12:07
*** hashar is now known as hasharLunch12:14
*** bhavikdbavishi has joined #zuul12:17
*** jpena is now known as jpena|lunch12:30
mnaseravass: weird, it works here for me12:36
*** hasharLunch is now known as hashar13:01
*** jcapitao_lunch is now known as jcapitao13:30
*** jpena|lunch is now known as jpena13:32
*** bhavikdbavishi has quit IRC13:47
mnaseri would appreciate reviews on https://review.opendev.org/#/c/704266/ -- i'm waiting for it to be able to do testing for cheroot/cherrypy on the same platform14:15
corvusmnaser: is there no other way to install pyenv other than cloning from github?14:17
mnasercorvus: there is a "curl from some url on the internet" method :p14:17
corvusdoing that in ci is generally not a best practice due to github's unreliability :(14:17
mnaserbut the curl from some url is curl pipe to bash to git clone14:17
mnaserhttps://github.com/pyenv/pyenv-installer/blob/master/bin/pyenv-installer this is the "installer" that curl pipe to bash does.. but yeah, bunch of git clones14:18
mordredI think this is going to wind up being the last-ditch option any way once we add support for consuming the stow dirs and mnaser adds those to his images14:19
mnasercorvus: there seems to be releases tho -- https://github.com/pyenv/pyenv/releases -- so i guess we can download that .tar.gz and export it ..14:19
mnaser_if_ that's more reliable14:19
corvuswe should probably, at some point, update that to handle the case where pyenv is already installed (just like the ensure-python role does for python itself), but this is forward-compatible with that, so i don't think we need to block it.14:19
mordredcorvus: ++14:19
mordredcorvus: also - did you see there's already a stow patch for dib?14:20
*** jamesmcarthur has joined #zuul14:20
mordredcorvus: https://review.opendev.org/#/c/713692/14:20
corvusor maybe we never get around to that if stow works better14:20
corvus+314:21
mnaserwoo, thanks corvus.  once this lands, i'll update vexxhost's base jobs and then try and see how it works in cherrypy/cheroot :)14:21
mordredcorvus: yeah - I think the stow thing is pretty exciting14:23
mordredfrom a CI-base node perspective - especially for unit tests - I thnk that allows building some really nice base images. obviously for functional tests you might not want to use them - but since stow, shrug - they're there if you want them and not if you don't14:24
mordredit also fits well with our longstanding tradition in zuul of using old tech that many people have forgotten about14:24
tristanCso using stow to bake binary files in the diskimage going to be the new recommended way for zuul-jobs?14:26
mnaseri wouldn't call it a recommended way14:27
mnaseri would call it an option14:27
mnaser(i think it's the best option, but not "the" option)14:28
*** jamesmcarthur has quit IRC14:29
mordredyeah - it really depends on what you're wanting to do14:30
mordredbut I do think that, for things like this, adding support to ensure roles to take advantage of pre-installed stuff in stow is a pattern we can certainly learn how to support14:31
openstackgerritJan Kubovy proposed zuul/zuul master: WIP: Separate connection registries in tests  https://review.opendev.org/71295814:31
*** jamesmcarthur has joined #zuul14:31
avassmnaser: yeah I found the error.. and it's stupid. For some reason we had a lot of roles in our config project and one of them was an old ensure-tox.14:39
avassthat's purged now14:39
mordredavass: that'll do it :)14:43
openstackgerritMerged zuul/zuul-jobs master: Add support for installing python with pyenv  https://review.opendev.org/70426614:52
mordredmnaser: ^^14:55
mnasermordred: yay, pushing change to our base jobs now14:55
AJaegerdo we want a conveinent log download script? See https://review.opendev.org/59234114:56
*** jamesmcarthur has quit IRC14:58
*** jamesmcarthur has joined #zuul15:01
corvusAJaeger, ianw: it might be worth thinking about using the zuul manifest for that15:09
corvusthat also looks pretty geared toward devstack15:10
corvusoh that's just the sample?15:11
AJaegercorvus: that'S the default AFAIU - but we need ianw for the discussion, hope he can followup15:12
mordredcorvus: would you thnik http://zuul.opendev.org/t/openstack/build/e809981cbc0547768a1bc5b9947c7af9/console#1/0/1/localhost would be just an ephemeral issue?15:19
mordredcorvus: (the gate job built and uploaded the image to the per-change tag but the promote job did not do its bits)15:20
corvusmordred: if it ever worked, then yes, that'd be my first guess15:20
mordredcorvus: k. I mean - promote has never worked, but gate did - so that's an "if it ever worked" right?15:21
corvusmordred: if it has not run before, then my first guess would be a newline encoded on the end of the password.15:21
corvusmordred: gate's using the same secret, right?15:21
mordredyeah15:21
corvusthen yeah.  you could try re-enqueing it15:21
*** mattw4 has joined #zuul15:22
mordredk. there's also another change I can land and see if it works the second time15:22
cloudnullping - has anyone seen failures in the pep8 / linter jobs recently?15:25
cloudnullI'm seeing - https://pasted.tech/pastes/a18b9a5156c5225bced6c4c9a6d3ec2795c0279e.raw15:25
cloudnullon jobs running both centos-8 and ubuntu bionic15:25
cloudnullhttps://0855d5b4c86f46cfcc5f-90d9162a406ee5dfb88e2296c83a0e71.ssl.cf5.rackcdn.com/713899/1/check/openstack-tox-linters/c9b8bdc/job-output.txt15:25
cloudnullhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_bce/713899/1/check/openstack-tox-pep8/bcebf24/job-output.txt15:25
cloudnulland sadly i can't reproduce that locally15:26
*** harrymichal has quit IRC15:26
cloudnullon either OS :'(15:26
mnaseri see https://github.com/pypa/virtualenv/issues/166315:27
mnaserreleased 6 hours ago15:27
zbrweird error but i suspect another surprise from virtualenv, lets try to pin it down, i already used this approach in the past in other repos.15:27
zbrmnaser: virtualenv keeps delivering, i wonder if openstack would be willing to add some testing jobs for them, read https://mail.rdoproject.org/list.html?dev@lists.rdoproject.org15:28
* cloudnull wonders where the virtualenv job definition is in zuul 15:28
*** jamesmcarthur has quit IRC15:28
*** rlandy is now known as rlandy|brb15:28
zbrcloudnull: let me try something....15:29
*** weshay|ruck has joined #zuul15:29
cloudnullw/ py3+ we can use `python -m venv` and get our of the business of having to deal with virtualenv.15:29
*** jamesmcarthur has joined #zuul15:29
cloudnullvenv is built-in15:29
mordredcloudnull: yeah - there's been work to use venv for some base python3 things in the opendev images - but its' ... complicated :)15:30
cloudnullmordred as with all good things :D15:31
clarkbnote that tox doesn't use venv by default though you can request it15:37
zbrcloudnull: in fact for tox is much easier, just installing tox-venv is enough15:37
clarkb(so even if we switch our images over jobs won't necessarily start using it autoamtically)15:37
cloudnullzbr?15:38
zbrmaybe reviewing https://review.opendev.org/#/c/690057/ would be a good idea, as it would allow us to request installation of tox-venv15:38
*** bhavikdbavishi has joined #zuul15:40
*** rlandy|brb is now known as rlandy15:50
*** chandankumar is now known as raukadah16:02
*** mattw4 has quit IRC16:04
*** mattw4 has joined #zuul16:04
*** harrymichal has joined #zuul16:14
*** erbarr has joined #zuul16:26
*** harrymichal has quit IRC16:35
openstackgerritJan Kubovy proposed zuul/zuul master: WIP: Separate connection registries in tests  https://review.opendev.org/71295816:37
*** mattw4 has quit IRC16:51
*** mattw4 has joined #zuul16:51
*** jamesmcarthur has quit IRC17:10
*** hashar is now known as hasharAway17:17
*** jamesmcarthur has joined #zuul17:18
*** evrardjp has quit IRC17:36
*** evrardjp has joined #zuul17:36
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: Support image uploads in 'info' CLI command  https://review.opendev.org/71277518:08
*** jamesmcarthur has quit IRC18:15
*** jpena is now known as jpena|off18:16
fungiooh, anybody seen this yet? https://developer.ibm.com/linuxonpower/2020/03/19/migrating-openstack-third-party-ci-from-zuul-2-to-zuul-3/18:21
Shrewshmm, published today. can't recall seeing the author's name before18:24
fungiyeah, not familiar to me either18:24
fungilooks like they chose to deploy with opendev/puppet-{nodepool,zuul}18:27
mordredgood to know - when we stop using those there is at least one other user18:30
fungialso with openstack hat on, i twitch at the suggestion that they're still running devstack on ubuntu-xenial, which hasn't been recommended for master for well over a year18:30
fungiat least they note that devstack-gate is deprecated18:30
clarkbfungi: aiui some of those storage systems don't work on newer platforms18:30
clarkbsomeone at hp was asking how to work around that18:30
fungialso they're hyperlinking to https://github.com/pypa/virtualenv/issues/166318:31
fungier, to https://docs.openstack.org/infra/manual/zuulv3.html i meant18:31
fungiwhich opendev has removed in recent days18:31
mordredyah - but - good to see docs on this topic :)18:32
*** harrymichal has joined #zuul18:41
*** armstrongs has joined #zuul18:43
*** jcapitao is now known as jcapitao_off18:47
fungii'll take that as a reminder that i need to get some of those bits reproposed elsewhere18:48
fungiit's on my to do list but keeps falling farther down the list as things pile on top of it18:49
fungimy to do list is more like a stack than a pipe18:49
mordredfungi: mine's more like a mound18:49
fungia shuffle?18:49
fungiheh18:50
fungiwould be fun if i could do that... just have some script randomly select the next task from the list18:50
clarkba heap18:51
fungithat18:52
fungimine definitely feels like a pile18:52
fungiwhat it feels like a pile of varies day by day18:53
*** bhavikdbavishi has quit IRC18:56
armstrongshey guys question. I am trying to boot a windows box on aws using zuul nodepool. I have turned off host key checking as the windows box uses a username and password. I am seeing nodepool booting the box and it just about instantly goes into in-use and pre-steps but then just dies. I wanted to try and understand what the zuul does when the log18:57
armstrongsstream starts and if i can do anything to wait for winrm to be ready on the windows box before running the pre-step playbooks18:57
*** harrymichal has quit IRC18:59
mordredmnaser, noonedeadpunk: don't hate me - but I just left a whole new feedback for you on the dib patch19:00
mordredarmstrongs: I think tobiash is the only one here with windows experience?19:01
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: Support image uploads in 'info' CLI command  https://review.opendev.org/71277519:01
mnasermordred: nice, that seems useful and cleans it up a little bit :)19:01
mordredmnaser: yah. sorry I didn't think to mention it the other day19:02
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: Support image uploads in 'info' CLI command  https://review.opendev.org/71277519:03
noonedeadpunkmordred: not really sure I got you right. SO I should jsut to create empty file source-repository-pyenv? Or including source-repositories is enough?19:07
mordredyou need to put source-repositories in the element-deps - and then you need a file in the root of the element that starts with source-repository and has that line as its content19:08
*** hasharAway is now known as hashar19:10
noonedeadpunkah, ok19:11
mordrednoonedeadpunk: https://opendev.org/openstack/project-config/src/branch/master/nodepool/elements/cache-devstack has some examples19:11
mordredhttps://opendev.org/openstack/project-config/src/branch/master/nodepool/elements/cache-devstack/source-repository-dstat_graph19:11
noonedeadpunkthanks19:12
*** jamesmcarthur has joined #zuul19:19
noonedeadpunkplaced update19:20
*** armstrongs has quit IRC19:26
*** jamesmcarthur has quit IRC19:28
*** jamesmcarthur has joined #zuul19:29
mordredwoot19:29
*** sshnaidm is now known as sshnaidm|off19:33
*** armstrongs has joined #zuul19:42
*** jcapitao_off has quit IRC19:42
openstackgerritJan Kubovy proposed zuul/zuul master: Separate connection registries in tests  https://review.opendev.org/71295819:51
*** jamesmcarthur has quit IRC20:03
*** jamesmcarthur has joined #zuul20:05
*** jamesmcarthur has quit IRC20:14
*** harrymichal has joined #zuul20:15
*** jamesmcarthur has joined #zuul20:16
*** jamesmcarthur has quit IRC20:22
*** armstrongs33 has joined #zuul20:32
*** armstrongs has quit IRC20:35
*** armstrongs33 has quit IRC20:39
*** jamesmcarthur has joined #zuul20:46
openstackgerritIan Wienand proposed zuul/nodepool master: DiskImage : alphabetise entries  https://review.opendev.org/71338120:55
openstackgerritIan Wienand proposed zuul/nodepool master: diskimage: make name primary key  https://review.opendev.org/71338220:55
openstackgerritIan Wienand proposed zuul/nodepool master: Add parent and abstract flags for diskimages  https://review.opendev.org/71315720:55
openstackgerritIan Wienand proposed zuul/nodepool master: Move config merge into DiskImage object  https://review.opendev.org/71355020:55
openstackgerritIan Wienand proposed zuul/zuul-jobs master: upload-logs-swift: Create a download script  https://review.opendev.org/59234121:11
openstackgerritIan Wienand proposed zuul/zuul-jobs master: upload-logs-swift: Add a unicode file  https://review.opendev.org/59285321:11
*** jamesmcarthur has quit IRC21:15
*** jamesmcarthur has joined #zuul21:16
*** harrymichal has quit IRC21:18
ianwAJaeger: ^ that adds the result as an artifact -- you're right to point out we already merged this into the test role and i never pushed for reviews on it one way or the other21:21
ianwi will update the test role and we can test the artifact return, and see if we either get enough +2's to go with it or if there's objections such that we should revert21:21
*** jamesmcarthur has quit IRC21:23
*** jamesmcarthur has joined #zuul21:23
openstackgerritIan Wienand proposed zuul/zuul-jobs master: upload-logs-swift: Create a download script  https://review.opendev.org/59234121:35
openstackgerritIan Wienand proposed zuul/zuul-jobs master: upload-logs-swift: Add a unicode file  https://review.opendev.org/59285321:35
*** jamesmcarthur has quit IRC21:40
*** jamesmcarthur has joined #zuul21:41
*** jamesmcarthur has quit IRC21:47
*** jamesmcarthur has joined #zuul21:47
*** jamesmcarthur has quit IRC21:54
*** jamesmcarthur has joined #zuul21:57
*** jamesmcarthur has quit IRC21:59
mnasercorvus: i am declaring bankruptcy on https://review.opendev.org/#/c/713469/ -- i don't know how to test that :(22:01
mnaseri know it's an issue, but i don't know how to actually test it at this point22:01
*** jamesmcarthur has joined #zuul22:02
*** jamesmcarthur has quit IRC22:05
*** jamesmcarthur has joined #zuul22:05
openstackgerritIan Wienand proposed zuul/zuul-jobs master: upload-logs-swift: Create a download script  https://review.opendev.org/59234122:11
openstackgerritIan Wienand proposed zuul/zuul-jobs master: upload-logs-swift: Add a unicode file  https://review.opendev.org/59285322:11
openstackgerritIan Wienand proposed zuul/zuul-jobs master: test-upload-logs-swift: add download script as an artifact  https://review.opendev.org/71399822:11
*** jamesmcarthur has quit IRC22:13
*** jamesmcarthur has joined #zuul22:17
openstackgerritIan Wienand proposed zuul/zuul-jobs master: test-upload-logs-swift: add download script as an artifact  https://review.opendev.org/71399822:21
openstackgerritIan Wienand proposed zuul/zuul-jobs master: Revert "upload-logs-swift: test bulk download script change"  https://review.opendev.org/71400022:21
corvusmnaser: the in-repo conf in that test overwrites the existing in-repo conf, which is quite extensive and is here: https://opendev.org/zuul/zuul/src/branch/master/tests/fixtures/config/pass-to-parent/git/org_project/zuul.yaml22:24
corvusmnaser: i guess you don't need any of the secret stuff, so you're probably just missing the project defn22:25
corvusmnaser: i left a suggestion inline22:26
mnasercorvus: oh, i see your point.  doh, sorry that was obvious22:26
corvusmnaser: np; it was buried in the log :)22:27
openstackgerritMohammed Naser proposed zuul/zuul master: Display clean error message for missing secret  https://review.opendev.org/71346922:28
mnaseri should get around finishing up https://review.opendev.org/#/c/708731/ too..22:28
*** jamesmcarthur has quit IRC22:36
*** jamesmcarthur has joined #zuul22:37
openstackgerritIan Wienand proposed zuul/zuul-jobs master: upload-logs-swift: Create a download script  https://review.opendev.org/59234122:37
openstackgerritIan Wienand proposed zuul/zuul-jobs master: upload-logs-swift: Add a unicode file  https://review.opendev.org/59285322:37
*** dpawlik has quit IRC22:38
*** hashar has quit IRC22:39
openstackgerritIan Wienand proposed zuul/zuul-jobs master: Revert "upload-logs-swift: test bulk download script change"  https://review.opendev.org/71400022:47
*** armstrongs has joined #zuul23:29
*** armstrongs has quit IRC23:38

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!