Tuesday, 2020-05-19

*** jamesmcarthur has joined #zuul00:09
*** EmilienM|off is now known as EmilienM00:46
*** evrardjp has quit IRC00:52
*** jhesketh has joined #zuul00:52
*** jamesmcarthur has quit IRC00:58
*** jamesmcarthur has joined #zuul01:23
*** swest has quit IRC01:39
*** yolanda has joined #zuul01:52
*** yolanda has quit IRC01:52
*** yolanda has joined #zuul01:53
*** swest has joined #zuul01:54
*** bhavikdbavishi has joined #zuul02:54
*** bhavikdbavishi1 has joined #zuul02:57
*** bhavikdbavishi has quit IRC02:58
*** bhavikdbavishi1 is now known as bhavikdbavishi02:58
*** jamesmcarthur has quit IRC03:09
*** jamesmcarthur has joined #zuul03:10
*** jamesmcarthur has quit IRC03:24
*** jamesmcarthur has joined #zuul03:26
*** jamesmcarthur has quit IRC03:27
*** jamesmcarthur has joined #zuul03:28
*** bhavikdbavishi has quit IRC03:38
*** bhavikdbavishi has joined #zuul03:50
*** cdearborn has quit IRC03:55
*** threestrands has quit IRC04:15
*** bhavikdbavishi has quit IRC04:33
*** ysandeep|away is now known as ysandeep05:46
*** dpawlik has joined #zuul06:02
openstackgerritSimon Westphahl proposed zuul/nodepool master: Expose image build requests in web UI and cli  https://review.opendev.org/72581006:19
*** kmalloc has quit IRC06:36
*** jamesmcarthur has quit IRC06:49
*** jamesmcarthur has joined #zuul06:50
*** rpittau|afk is now known as rpittau06:51
*** jamesmcarthur has quit IRC06:55
*** hashar has joined #zuul07:05
*** jcapitao has joined #zuul07:12
*** jamesmcarthur has joined #zuul07:14
*** jamesmcarthur has quit IRC07:16
*** jamesmcarthur has joined #zuul07:17
*** jamesmcarthur has quit IRC07:22
*** jamesmcarthur has joined #zuul07:23
*** adam_g has quit IRC07:24
*** adam_g has joined #zuul07:24
*** mnasiadka has quit IRC07:25
*** mnasiadka has joined #zuul07:27
*** fbo|off is now known as fbo|afk07:30
*** evrardjp has joined #zuul07:31
*** evrardjp has quit IRC07:32
*** evrardjp has joined #zuul07:34
*** bhavikdbavishi has joined #zuul07:34
*** bhavikdbavishi1 has joined #zuul07:37
*** bhavikdbavishi has quit IRC07:38
*** bhavikdbavishi1 is now known as bhavikdbavishi07:38
openstackgerritSimon Westphahl proposed zuul/nodepool master: Expose image build requests in web UI and cli  https://review.opendev.org/72581007:48
*** tosky has joined #zuul07:56
*** jpena|off is now known as jpena07:57
*** ysandeep is now known as ysandeep|lunch08:21
*** panda|off is now known as panda08:34
*** asaleh_ has joined #zuul08:34
*** jamesmcarthur has quit IRC08:35
swestianw: I noticed a problem with the diskimage-builder. jobs are failing now because the global openstack upper constraints require networkx 2.4, but diskimage-builder requires <2.3 because of Python 2 compatibility. Anything I can do about that? Maybe drop support for Python 2 as proposed by mordred :)09:08
openstackgerritMatthieu Huin proposed zuul/zuul master: [WIP] Builds: add "held" attribute  https://review.opendev.org/72899409:22
*** hashar is now known as hasharAway09:25
*** sshnaidm|afk is now known as sshnaidm09:40
*** ysandeep|lunch is now known as ysandeep09:51
mhuI keep forgetting what the use cases are for the "zuul promote" command in the CLI - can someone give me an example that I can shamelessly steal and add to the documentation? :)09:56
*** sgw has quit IRC10:07
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: DNM: test  https://review.opendev.org/72864010:11
ianwswest: yeah, i'll look tomorrow, i guess that just means the end of python2 for dib.  because it's branchless i've been holding off but seems there's probably no choice10:13
*** sugaar has quit IRC10:21
avasszuul-maint: I've found that a lot of users are confusing the executor with the remote worker nodes, I believe it's because they're not part of the diagram: https://zuul-ci.org/docs/zuul/discussion/components.html#overview10:22
avassshould we update that to show that the executors communicate with worker nodes as well?10:22
tobiash++10:23
zbrapparently ensure-docker got broken centos-8: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ee1/728640/2/check/zuul-jobs-test-ensure-docker-centos-8/ee118f9/job-output.txt10:24
*** asaleh_ has quit IRC10:26
*** jcapitao is now known as jcapitao_lunch10:27
*** sugaar has joined #zuul10:29
*** rpittau is now known as rpittau|bbl10:31
avasszbr: looks like it, how is easy would it be to get it working?10:31
zbri see a new release from them, but locally I was able to upgrade without any problems, so not sure what is wrong10:32
zbrwhat is weird is that the server installed is very old10:32
zbryep, that is the issue, cli is newer but the server is not.10:33
avasszbr: yeah, I don't have time to look into it at the moment, lots of local support oday and I've got a meeting in 30min10:33
*** bhavikdbavishi has quit IRC10:34
*** jamesmcarthur has joined #zuul10:36
*** jamesmcarthur has quit IRC10:40
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305310:57
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305311:05
zbrfunny, that patch was raised in january....11:06
*** fbo|afk is now known as fbo11:14
*** jpena is now known as jpena|lunch11:33
*** rfolco|rover|off has joined #zuul11:42
*** rfolco|rover|off is now known as rfolco|rover11:44
*** hasharAway is now known as hashar11:51
*** bhavikdbavishi has joined #zuul11:55
*** asaleh_ has joined #zuul11:58
*** jcapitao_lunch is now known as jcapitao12:01
*** armstrongs has quit IRC12:03
*** rpittau|bbl is now known as rpittau12:04
tristanCcorvus: is there a plan to tag a new zuul and nodepool version soon?12:23
*** rlandy has joined #zuul12:28
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Don't require tox_envlist  https://review.opendev.org/72682912:32
avassclarkb: how about that ^ ?12:33
*** jpena|lunch is now known as jpena12:33
openstackgerritMatthieu Huin proposed zuul/zuul master: Zuul CLI: add console-stream command  https://review.opendev.org/72923612:36
avasszbr: is 703053 re-implementing a previous workaround?12:37
*** ysandeep is now known as ysandeep|brb12:44
openstackgerritFabien Boucher proposed zuul/zuul master: Remove another shebang and remove useless exec bits  https://review.opendev.org/72924012:46
zbravass: yep, the workaround was known for long time, and i suspect the hack was implemented directly on the image.12:49
zbralso used on ansible zuul, see https://github.com/ansible/ansible-zuul-jobs/blob/09ceb6752b46fefa7ff54752febdfded12e87b5c/playbooks/ansible-tox-molecule/pre.yaml#L1612:50
zbrthere is something weird because the rpm should have being found anyway, see https://download.docker.com/linux/centos/7/x86_64/stable/Packages/12:51
*** sgw has joined #zuul13:05
*** Goneri has joined #zuul13:09
openstackgerritMatthieu Huin proposed zuul/zuul master: Builds: add "held" attribute  https://review.opendev.org/72899413:12
*** ysandeep|brb is now known as ysandeep13:22
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305313:37
*** cdearborn has joined #zuul13:40
*** bhavikdbavishi has quit IRC13:48
openstackgerritMatthieu Huin proposed zuul/zuul master: [WIP] Web UI: add "held" information, filtering in Builds page  https://review.opendev.org/72926513:53
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305313:57
openstackgerritMatthieu Huin proposed zuul/zuul master: Zuul CLI: add console-stream command  https://review.opendev.org/72923613:57
*** hashar has quit IRC13:58
openstackgerritOleksandr Kozachenko proposed zuul/zuul-jobs master: Add DaemonSet check for wait-for-pods role  https://review.opendev.org/72850314:00
openstackgerritMatthieu Huin proposed zuul/zuul master: Builds: add "held" attribute  https://review.opendev.org/72899414:13
*** newbie2020 has joined #zuul14:14
newbie2020Hi guys,14:14
newbie2020I have a situation where a periodic pipeline (one using the trigger driver) triggers a Zuul job executing a task in the PRE-RUN phase multiple times from *different* branches (e.g. @master and @branch_foo)14:16
newbie2020Any idea about what may be going on?14:16
fungiif you don't limit the job to specific branches, i believe the timer trigger will add a build for each branch in the repository14:17
newbie2020I added branches: master to the job, but probably that is not correct14:19
newbie2020also I was not expecting having one build execution with tasks executed multiple time... That is what really puzzles me14:19
fungioh, it's multiple playbook invocations in a single build? not different builds?14:22
fungijob inheritence is additive for pre-run and post-run phase playbooks, could the job have a parent/ancestry which is adding the extra pre-run playbooks?14:23
newbie2020it does not seem to be the case, but that sounds like a good idea about what to check...14:26
newbie2020they refer to different @branches14:26
newbie2020though14:26
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: WIP: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305314:26
fungiif you're archiving the zuul-info/inventory.yaml for your jobs you should be able to look at all the variables which went into it, like this: https://zuul.opendev.org/t/openstack/build/929f7c0817e14209bd6a971521197a94/log/zuul-info/inventory.yaml14:30
fungiin particular all.vars.zuul._inheritance_path shows the lineage from which it inherits14:30
fungiincluding project and branch14:31
fungiyou can see that example has 3 pre and 3 post playbooks inherited from its ancestor job definitions: https://zuul.opendev.org/t/openstack/build/929f7c0817e14209bd6a971521197a94/console14:33
*** jamesmcarthur has joined #zuul14:36
corvusnewbie2020: i can't be 100% sure without seeing the definitions, but from reading your conversation with fungi, it sounds like you may have put a "master" branch matcher on a job definition in branch "branch_foo" (ie, "branches: master"), which would mean that when zuul runs a job for the master branch, it applies the configuration from the foo branch.  you would be able to confirm that by looking at the14:38
corvusinheritance path as fungi suggests.14:38
corvusnewbie2020: normally you don't need to add branch matchers manually if they are on jobs in a repo with branches (they should only apply to the branches they are in).  if you only want the job to run for the master branch, then only add it to the project stanza in the master branch.14:40
fungiyeah, that seems like a plausible explanation14:40
corvustristanC: we were hoping to switch to using the zk tls stuff in opendev before doing a release, but that's taking longer than expected.  maybe if we haven't finished that up this week, we should go ahead and do a release next week regardless.14:41
*** zxiiro has joined #zuul14:42
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: WIP: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305315:01
newbie2020@corvus @fungi thanks for the suggestions, I will look into it !15:03
*** bhavikdbavishi has joined #zuul15:08
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: WIP: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305315:12
*** bhavikdbavishi has quit IRC15:23
*** bhavikdbavishi has joined #zuul15:39
*** ysandeep is now known as ysandeep|afk15:45
mnaserAJaeger: is https://review.opendev.org/#/c/728503/ satisfactory to you now? :)15:49
AJaegermnaser: there's nothing like a good commit message;) +2A15:51
openstackgerritMatthieu Huin proposed zuul/zuul master: [WIP] web UI: add Autoholds Requests page  https://review.opendev.org/72930715:51
zbri need advice on what to do about use of yum_repository inside configure mirrors, i need to add an option that is not supported by the module.15:52
zbr... one of the reasons why most people avoid this module15:52
zbranother one being that is not able to edit repos, only to rewrite them15:53
mordredzbr: I do not feel strongly that we should use it - especially if it's deficient. I think we have plenty of code that does not use apt_repository to install a new apt repository15:53
zbrhttps://zuul.opendev.org/t/zuul/build/c0803b7f2061452b95ec29197a3ed82115:53
mordredI think the best reason to use those modules is if they are easier to use / read - but if they aren't, then they are not worth it15:53
zbrour use of it is not very advanced, probably we could replace it with either ini_file (bit slow due to looping) or a jinja2 template.15:54
zbrthe template has downside of being ugly too, if we want to loop over received key/value arguments.15:55
zbror I can add one single custom ini_file command inside ensure-docker, in order to add the magic module_hotfixes=True15:55
mordredzbr: I don't see any issue with doing that15:56
zbrso which path to take?15:56
mordredzbr: you mean basically do yum_repository: blah then ini_file: module_hotfixes yeah?15:56
zbri would go for ini, could same be 3-4h15:56
zbrsave15:56
zbrmordred: thanks, back to patching it, i really need to fix it asap as it breaks all current jobs using docker on centos-8.15:57
mordredzbr: yah. I think whatever work here should be fine15:58
*** jcapitao has quit IRC16:02
openstackgerritMerged zuul/zuul-jobs master: Add DaemonSet check for wait-for-pods role  https://review.opendev.org/72850316:03
AJaegerclarkb, corvus, want to review again the tox-envlist change https://review.opendev.org/#/c/726829/ ?16:05
mhucorvus: regarding https://review.opendev.org/#/c/728118/ I've reworked the patch to ensure most endpoints can be tenant-scoped for whitelabeling16:06
mhuI've kept some unscoped paths to reflect the RPC but they all have a scoped equivalent16:07
mhuexcept for connection-specific endpoints16:07
clarkbAJaeger: avass done. I've not approved it since corvus may want to look too. Also that comment will hopefully prevent regressions in the future when we try to simplify :)16:07
*** yolanda has quit IRC16:07
clarkbthanks for the updated patchset there16:08
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: WIP: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305316:11
mhucan I get some eyes on https://review.opendev.org/728061 https://review.opendev.org/728073 and https://review.opendev.org/728098 please? They fix problems in the CLI when using the REST API and add some testing16:14
openstackgerritMatthieu Huin proposed zuul/zuul master: Builds: add "held" attribute  https://review.opendev.org/72899416:15
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: WIP: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305316:16
corvusAJaeger, clarkb, avass: ack +3 thx!16:17
AJaegerthanks16:17
*** hashar has joined #zuul16:18
corvusmhu: why do you want the unscoped versions?16:18
*** tumble has joined #zuul16:18
corvusmhu: i think the rule is that the zuul api should be tenant-scoped (with the exception of the /info and /tenants endpoints)16:18
corvusmhu: just like the web interface itself16:19
mhucorvus, well I can live without them :) but some of these actions do not require a tenant16:19
corvusmhu: a different way of looking at it is that some access scopes work for all tenants16:20
corvuswe worked really hard to keep everything separated across tenants, so i hesitate to start breaking down those barriers16:20
mhucorvus, understandable16:21
mhuwould it be okay to keep connections related endpoints unscoped?16:21
corvuswhat uses the connections endpoint?16:22
*** rpittau is now known as rpittau|afk16:22
tobiashcorvus: webhooks and I guess public keys16:22
mhutobiash, corvus GithubWebController for example16:23
corvushrm, so we made it so that you can't use github with a whitelabeled zuul install?16:23
mhucorvus, good question16:24
tobiashI thought the public keys are also available with tenant scope16:24
tobiashnot sure about the webhooks though16:24
corvustobiash: i'm pretty sure the keys are tenant-scoped16:25
mhutobiash, I don't think the webhooks are scoped, according to the way they're mounted in cherrypy16:25
corvus'/api/tenant/{tenant}/key/{project:.*}.pub'16:25
tobiashso it's just the webhooks16:25
mhutobiash, corvus yeah the webhooks are mounted under /api/connection/{connection_name}16:26
mhueverything else besides info & tenants can be tenant scoped16:27
mordredwe could also add a tenant-scoped api call for connections (so that whitelables work) that just works the same and ignores the tenant scope16:28
corvusyeah, and i think mhu has that in his change16:28
mordredah - cool16:28
tobiashyes, just the driver endpoints are not tenant scoped16:28
mhumordred, corvus just for connections16:28
corvusoh, the list, not the driver sub-mounts16:28
mhunot connection/{connection_name} though16:28
tobiashbasically only the payload mount16:28
corvusokay, well, easy enough to add too...16:29
mhualright, I'll have a go at it, thanks!16:33
corvusmhu, mordred, tobiash: there are tradeoffs here: having it not be tenant scoped makes it clear that, well, it's not tenant scoped.  but it does make it harder for someone running in a whitelabel setup -- it's not impossible, but we need to tell them to route /connection/ differently.  it's also entirely possible we might want to tenant-scope connections in the future (but then doing that might make it16:33
corvusdifficult to set up the webook in the first place -- should you configure the tenant-scoped url or the global one?)16:33
tobiashcorvus: does zuul-web know if it's whitelabeled?16:34
corvustobiash: i don't think so16:34
openstackgerritMerged zuul/zuul-jobs master: Don't require tox_envlist  https://review.opendev.org/72682916:35
tobiashcorvus: the connections are a global entity so I think it's correct that they're not scoped to tenants. However I see that this makes it impossible to deliver webhooks to whitelabeled deployments. What do you think about just duplicating the connections to also be available tenant scoped?16:36
corvusoh wow, we already documented the special configuration for api/connection16:36
corvushttps://zuul-ci.org/docs/zuul/howtos/installation.html#white-labeled-tenant16:37
tobiashor that...16:37
tobiash:)16:37
*** dpawlik has quit IRC16:37
corvusso i guess we already decided to just do that.  i'm okay leaving that the way it is; sorry i misremembered16:37
mhuahah, there you go :)16:37
*** bhavikdbavishi has quit IRC16:37
corvusmhu: so i think we can just drop anything related to connections from your patch16:37
mhuapi/connection or api/connections :)16:38
corvusboth :)16:38
corvusmhu: that leaves the autohold and authorizations....  let's examine authorizations first16:39
corvusmhu: it looks like right now, the authz path is /api/user/authorizations16:39
corvusso that is also global-only16:40
mhuit can be tenant scoped just fine, the endpoint will just tell you whether or not you're an "admin" on the tenant16:40
mhuI've made that change in the latest patchset16:40
corvusmhu: ok, i like that idea -- it makes sense to me that authz should always happen with a tenant scope16:41
mhuafter all, a client doesn't really need to know if you're an admin on other tenants16:41
corvusmhu: your latest patchset has api/tenant/{tenant}/authorizations as well as api/authorizations16:42
corvusmhu: do we still need the second one?16:42
mhucorvus, no, to my knowledge nothing uses it except my braindead UI patch for authz/authn16:42
mhuwhich needs to be reworked anyway16:42
*** ysandeep|afk is now known as ysandeep16:43
corvusmhu: ok, so we can drop that -- then i think having autohold be tenant-scoped makes sense too (yes, it's strictly not necessary, but it makes everything easier)16:43
mhucorvus, fair enough16:43
tobiash++16:43
corvusmhu: okay, cool, i think we have a way forward here, i'll jot some quick notes on the review.  thanks for your patience :)16:44
mhualright, thanks for clearing things up!16:44
mhuhey no worries, I needed the feedback!16:44
mhuthe whitelabel thing puzzled me at first but now it's clearer16:45
*** bhavikdbavishi has joined #zuul16:46
openstackgerritMatthieu Huin proposed zuul/zuul master: [WIP] web UI: add Autoholds Requests page  https://review.opendev.org/72930716:50
*** jpena is now known as jpena|off17:04
*** jamesmcarthur has quit IRC17:04
*** jamesmcarthur has joined #zuul17:09
*** asaleh_ has quit IRC17:23
*** jamesmcarthur has quit IRC17:24
*** newbie2020 has quit IRC17:27
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: WIP: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305317:28
*** evrardjp has quit IRC17:32
*** evrardjp has joined #zuul17:34
*** jamesmcarthur has joined #zuul17:50
*** bhavikdbavishi has quit IRC18:06
*** bhavikdbavishi has joined #zuul18:07
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305318:07
*** jamesmcarthur has quit IRC18:12
*** ysandeep is now known as ysandeep|away18:13
*** jamesmcarthur has joined #zuul18:14
*** jamesmcarthur has quit IRC18:17
*** jamesmcarthur has joined #zuul18:17
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305318:19
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Deprecate default tox_envlist: venv  https://review.opendev.org/72683018:23
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Remove unused tox_envlist in fetch-subunit-output  https://review.opendev.org/72934818:24
*** jamesmcarthur has quit IRC18:29
*** jamesmcarthur has joined #zuul18:30
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Deprecate default tox_envlist: venv  https://review.opendev.org/72683018:35
*** bhavikdbavishi has quit IRC18:37
*** chandankumar is now known as raukadah18:48
openstackgerritMatthieu Huin proposed zuul/zuul master: REST API: improve tenant scoping of autohold, authorizations  https://review.opendev.org/72811818:53
openstackgerritMatthieu Huin proposed zuul/zuul master: CLI: add autohold-info, autohold-delete via REST  https://review.opendev.org/72841018:54
openstackgerritMatthieu Huin proposed zuul/zuul master: REST API: add promote endpoint  https://review.opendev.org/72848918:54
openstackgerritMatthieu Huin proposed zuul/zuul master: CLI: support promote via the REST API  https://review.opendev.org/72890718:54
*** hashar has quit IRC18:59
zbrneed reviews on https://review.opendev.org/#/c/703053/ - to fix ensure-docker, thanks.19:02
openstackgerritMatthieu Huin proposed zuul/zuul master: Zuul CLI: add console-stream command  https://review.opendev.org/72923619:08
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: WIP: add simple test runner  https://review.opendev.org/72868419:09
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: WIP: add simple test runner  https://review.opendev.org/72868419:11
openstackgerritMatthieu Huin proposed zuul/zuul master: Zuul CLI: add console-stream command  https://review.opendev.org/72923619:16
openstackgerritMatthieu Huin proposed zuul/zuul master: [WIP] Web UI: add "held" information, filtering in Builds page  https://review.opendev.org/72926519:18
avasscorvus, mordred: can you take a look at: https://review.opendev.org/#/c/703053/16 ?19:26
mordredavass: lgtm19:29
mordredzbr: nice work - I think that's actually much cleaner than before too19:29
*** guillaumec has joined #zuul19:39
openstackgerritMerged zuul/zuul-jobs master: ensure-docker: workaround for centos-8 conflicts  https://review.opendev.org/70305319:55
mordredcorvus: sshnaidm tells me that multi-arch builder support will be in the next release of podman20:06
mordredcorvus: so depending on where we end up with figuring out what's going on with buildx and incorrect layers - that might also be a solution20:07
sshnaidmI think it'll be in v2, but don't beat me if it won't..20:07
mordredsshnaidm: is there any idea how far away that is?20:07
mordredlike - is that soon? or months from now?20:07
sshnaidmmordred, lemme find..20:07
mordred(because if I can't get buildx to behave completely properly, next step is to just use buildkitd directly)20:08
mordredsshnaidm: while you're asking ... does podman have (or will it get) ability to run a container with an arch override?20:08
sshnaidmApr 02 17:11:50 <baude> sshnaidm, the apis are done and the front-end is being worked on20:08
mordredlike "podman run --arch=arm64 foo"20:08
mordredsshnaidm: cool20:08
sshnaidmttps://podman.readthedocs.io/en/latest/_static/api.html#tag/manifests20:08
sshnaidmwell, this link worked then20:09
sshnaidmfast moving project (c)20:09
mordredheh20:09
sshnaidmmordred, not sure about overriding, I was asking about multi-arch manifests20:11
sshnaidmto push ppc containers20:11
sshnaidmor whatever20:11
mordredyeah20:11
mordredsshnaidm: I have 2 use cases I want to be able to do (they aren't 100% related) - one is, on an x86 host, use binfmt_misc support in the kernel to build a non-x86 container image (ppc or arm or whatever) - if I can do that, then making a manifest that references it is straightforward20:12
mordredsshnaidm: the other is, on an x86 host, I would like to use the same support to run a non-x86 container20:13
sshnaidmmordred, to run non-x86 arch on x-86?20:13
mordredsshnaidm: if I build a non-x86 container image and tag it (without using a manifest) - I can run it and things Just Work20:13
mordredyup20:13
mordredbut if I put it into a multi-arch manifest, then host arch is what is used to select which sub-image is used - which prevents doing that20:14
openstackgerritGuillaume Chauvel proposed zuul/zuul master: WIP: Add tutorial tests  https://review.opendev.org/72819420:14
mordredsshnaidm: (I told you can I exercise all of the edge cases here :) )20:14
sshnaidmmordred, I see :) although I'm hardly touched all that before20:15
mordredsshnaidm: me neither until a few weeks ago20:15
mordredsshnaidm: I have had to learn many things20:15
sshnaidmbut how do you run different arch w/o emulator? not sure I understand20:17
mordredsshnaidm: kernel has emulation built in20:18
* sshnaidm tried to run ppc on qemu, sucks20:18
mordredsshnaidm: # docker run --rm arm64v8/alpine uname -a20:18
mordredLinux c265cacf8200 4.15.0-96-generic #97-Ubuntu SMP Wed Apr 1 03:25:46 UTC 2020 aarch64 Linux20:18
mordredsshnaidm: that's on an x86 machine20:18
mordredsshnaidm: no qemu involved - this isn't running an emulated VM - this is having the kernel execute foreign arch - more like cross-compiling20:20
sshnaidmhmm.. standard_init_linux.go:211: exec user process caused "exec format error"20:20
mordredsshnaidm: you;ll want to do this first:20:20
mordreddocker run --rm --privileged docker/binfmt:a7996909642ee92942dcd6cff44b9b95f08dad6420:20
mordredwhich will write some entries into /proc/sys/fs/binfmt_misc/ for you20:21
openstackgerritGuillaume Chauvel proposed zuul/zuul master: WIP: Add tutorial tests  https://review.opendev.org/72819420:21
sshnaidma-ha!20:21
sshnaidmpodman run --rm arm64v8/alpine uname -a20:21
sshnaidmworked well20:21
mordredsshnaidm: so - in this case, the arm64v8/alpine image isn't a multi-arch image - it's just a plain arm64 image - so this works20:21
mordredbut what I'd like to be able to do is build a multi-arch manifest image - and then do the same thing without having to resort to tag tricks, instead beinga ble to say --arch=foo20:22
mordredif that won't work - I can totally just make an arm64 tag of course20:22
sshnaidmmordred, I see, so you need to run multi-arch with a "wrong" arch20:23
mordredsshnaidm: yes!20:23
mordredsince the _hard_ parts of this all work20:23
mordredit's just the ui doens't exist to let me tell the front end to pick the "wrong" backend architecture20:24
sshnaidmI think worth to open an rfe20:24
mordredsshnaidm: nod. I'll see if I can do that today20:24
sshnaidmpodman folks are pretty responsive20:25
mordredsame thing would be nice for podman build20:25
mordredif you could do that - then you could do podman build --arch=arm64 then podman manifest create and you wouldn't need any of the fancy crap docker buildx does for you20:25
sshnaidmyep20:27
sshnaidmbuildx seems like something new20:28
mordredit is20:32
mordredit's non-terrible except when it's terrible :)20:32
mordredbut it's also been helpful for learning about some of the possibilities20:33
*** Goneri has quit IRC21:03
openstackgerritMerged zuul/zuul-jobs master: Update flake8 ignore rules to match Zuul  https://review.opendev.org/72901021:09
openstackgerritMerged zuul/zuul-jobs master: Allow mapping additional hostvars in write-inventory  https://review.opendev.org/72895221:15
*** Goneri has joined #zuul21:20
*** jamesmcarthur has quit IRC21:20
*** jamesmcarthur has joined #zuul21:24
*** jamesmcarthur has quit IRC21:31
*** jamesmcarthur has joined #zuul21:32
*** jamesmcarthur has quit IRC21:34
*** jamesmcarthur has joined #zuul21:34
*** jamesmcarthur has quit IRC21:37
*** jamesmcarthur has joined #zuul21:39
*** jamesmcarthur has quit IRC21:41
*** jamesmcarthur has joined #zuul21:41
*** Goneri has quit IRC21:48
openstackgerritClark Boylan proposed zuul/zuul-jobs master: Add option to prefer https/ssl in configure-mirrors  https://review.opendev.org/72940721:58
clarkbI feel like ^ is probably wrong mechanically21:58
clarkbI'm hoping testing will confirm that for me and allow me to fix it up21:59
clarkbcorvus: mordred ^ also there is probably a better way to do it with the planned reorg of mirror things anyway?21:59
clarkbAJaeger: avass: corvus: https://zuul.opendev.org/t/openstack/build/64b57ff90ea34dc9b45d11f582dfe4cf I think that is a regression in the tox env change22:08
clarkbI don't quite understand it yet though22:08
clarkbpython2 + tox 3.8.6 does not have this issue. tox 3.15.0 + python3.8 does22:11
clarkbok its the unescaped % in the command22:14
clarkbdoubling up the % to escape it fixes things22:14
*** jamesmcarthur has quit IRC22:33
*** jamesmcarthur has joined #zuul22:33
*** jamesmcarthur_ has joined #zuul22:40
*** jamesmcarthur has quit IRC22:44
*** jamesmcarthur_ has quit IRC23:05
*** tumble has quit IRC23:09
*** armstrongs has joined #zuul23:10
*** jamesmcarthur has joined #zuul23:12
*** armstrongs has quit IRC23:19
openstackgerritMonty Taylor proposed zuul/zuul-preview master: Simplify build  https://review.opendev.org/72906623:46
openstackgerritMonty Taylor proposed zuul/zuul-preview master: Bump to c++17 and switch boost::optional to std::optional  https://review.opendev.org/72942823:46
*** jamesmcarthur has quit IRC23:56
*** jamesmcarthur has joined #zuul23:57

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!