| *** rlandy has quit IRC | 00:00 | |
| *** rfolco has quit IRC | 00:48 | |
| *** ysandeep|away is now known as ysandeep | 02:26 | |
| *** dsneddon has quit IRC | 03:06 | |
| *** jmasud_ has joined #oooq | 03:21 | |
| *** jmasud has quit IRC | 03:24 | |
| *** jmasud_ has quit IRC | 03:27 | |
| *** jmasud has joined #oooq | 03:28 | |
| *** skramaja has joined #oooq | 04:03 | |
| *** ykarel|away is now known as ykarel | 04:04 | |
| *** ratailor has joined #oooq | 04:56 | |
| *** udesale has joined #oooq | 05:35 | |
| *** pojadhav|afk is now known as pojadhav | 05:49 | |
| *** bhagyashris is now known as bhagyashris|brb | 05:50 | |
| *** jschlueter has quit IRC | 05:52 | |
| *** marios has joined #oooq | 06:01 | |
| *** bhagyashris|brb is now known as bhagyashris | 06:16 | |
| bhagyashris | Hi all, As per our discussion i have rename the integration pipelines and all the patches are up for review : https://review.rdoproject.org/r/#/c/28403/ https://review.rdoproject.org/r/#/c/28404/ https://review.rdoproject.org/r/#/c/28405/ request you to add in your review list. Thank you :) | 06:25 |
|---|---|---|
| bhagyashris | https://tree.taiga.io/project/tripleo-ci-board/task/1865?kanban-status=1447275 | 06:25 |
| bhagyashris | chandankumar, marios pojadhav ysandeep akahat weshay_ruck zbr ^^ | 06:26 |
| pojadhav | bhagyashris, ack | 06:27 |
| ysandeep | bhagyashris, sure | 06:27 |
| marios | bhagyashris: ack | 06:28 |
| bhagyashris | thank you all :) | 06:29 |
| *** jfrancoa has joined #oooq | 06:33 | |
| chandankumar | bhagyashris, since you are making changes on pipeline, you also need to submit a change here https://review.rdoproject.org/r/gitweb?p=rdo-infra/rdo-infra-playbooks.git;a=blob;f=contrib/prune_logserver.sh#l72 | 06:33 |
| bhagyashris | chandankumar, yes i saw that | 06:34 |
| chandankumar | bhagyashris, we can add a readme with the rdo-jobs zuul.d dir with new naming conventions | 06:34 |
| bhagyashris | even in https://review.rdoproject.org/codesearch/?q=openstack-periodic-master&i=nope&files=&repos= i saw | 06:34 |
| bhagyashris | lot many places the pipelines names are used | 06:35 |
| chandankumar | bhagyashris, we also need to fix cockpit | 06:35 |
| bhagyashris | but i was not sure about that | 06:35 |
| bhagyashris | so do i need to change there as well | 06:35 |
| chandankumar | bhagyashris, for cockpit sync with weshay_ruck and for prune server, send the patch, dpawlik2 will help there | 06:36 |
| bhagyashris | chandankumar, ack | 06:36 |
| bhagyashris | chandankumar, thank you :) | 06:36 |
| ysandeep | bhagyashris, just want to confirm - previously there was some discussion about segregating c7 train and c8 train jobs in different pipelines, but we are back to zuul.d/integration-pipeline-stable2.yaml for both c7/c8 train.. Is that segregation plan dropped now? | 06:48 |
| pojadhav | chandankumar, marios : please help to merge this https://review.opendev.org/#/c/738568/ | 06:50 |
| ysandeep | pojadhav, tripleo-ci-centos-8-standalone-on-multinode-ipa failed.. Should we wait till we get a green run there? | 06:51 |
| ysandeep | looks like its currently failing because of lack of containers - https://abf795b96ba14df61b38-6bdee08b27c25482e4dba43ccebb604b.ssl.cf2.rackcdn.com/738568/2/check/tripleo-ci-centos-8-standalone-on-multinode-ipa/8a40d15/logs/undercloud/home/zuul/standalone_deploy.log | 06:52 |
| bhagyashris | ysandeep, imo as per the new plan that should get drop | 06:53 |
| ysandeep | bhagyashris, okay , thanks! | 06:56 |
| bhagyashris | ysandeep, afaik why we decided to segregate both c7/c8 train because the openstack-periodic-24hr pipeline was getting flooded with (c7 train, c8 train and stein jobs) so now that's get resolved with new design | 06:58 |
| bhagyashris | ysandeep, otherwise will need new naming again and currently stable2 is train and that is the only release which runs on both c7 and c8 | 07:00 |
| bhagyashris | imo, better to keep in same pipeline and template :) | 07:02 |
| *** amoralej|off is now known as amoralej | 07:04 | |
| ysandeep | bhagyashris, yes I agree with that combine is much clean .. but i think we missed this point in yesterday's discussion and https://review.rdoproject.org/r/#/c/28403/3/zuul.d/integration-pipeline-stable2.yaml seems too many job but i will let other to comment there.. | 07:05 |
| bhagyashris | ysandeep, sure will wait for others opinion | 07:06 |
| marios | ack pojadhav | 07:07 |
| ysandeep | bhagyashris, left a comment on patch for other's reviewers too | 07:16 |
| *** dtantsur|afk is now known as dtantsur | 07:18 | |
| pojadhav | ysandeep, that job is non voting | 07:18 |
| *** pojadhav is now known as pojadhav|brb | 07:18 | |
| ysandeep | pojadhav|brb, okay good then, thanks! | 07:19 |
| bhagyashris | ysandeep, ack thank you :) | 07:22 |
| marios | bhagyashris: ack on https://review.rdoproject.org/r/#/c/28403/ & friends but IMO we don't need to rush that i think most of the team should at least +1 it... maybe start by bringing to community call today | 07:22 |
| *** rascasoft has joined #oooq | 07:24 | |
| *** ccamacho has joined #oooq | 07:25 | |
| bhagyashris | marios, ack thanks for your review :) yeah :D i have added all the team members in reviewers list :) | 07:26 |
| marios | bhagyashris: ack i think you'll find you will also need to harrass them at regular intervals ;) | 07:26 |
| bhagyashris | marios, exactly will do that :) | 07:33 |
| *** tosky has joined #oooq | 07:36 | |
| *** dsneddon has joined #oooq | 07:39 | |
| *** dsneddon has quit IRC | 07:44 | |
| *** saneax has joined #oooq | 07:47 | |
| *** derekh has joined #oooq | 08:30 | |
| *** ysandeep is now known as ysandeep|lunch | 08:34 | |
| zbr | panda: marios: please help me with https://review.rdoproject.org/r/#/c/28390/ -- should be quite easy | 09:14 |
| *** jfrancoa has quit IRC | 09:17 | |
| *** jfrancoa has joined #oooq | 09:27 | |
| *** jfrancoa has quit IRC | 09:27 | |
| *** jfrancoa has joined #oooq | 09:31 | |
| *** pojadhav|brb is now known as pojadhav | 09:34 | |
| arxcruz | marios: https://review.opendev.org/#/c/738788/ while zuul is happy :D | 09:37 |
| chandankumar | sshnaidm|ruck, arxcruz marios https://review.opendev.org/#/c/737727/32 good to go | 09:39 |
| arxcruz | chandankumar: https://review.opendev.org/#/c/738788/ also gtg | 09:41 |
| *** jfrancoa has quit IRC | 09:44 | |
| *** jfrancoa has joined #oooq | 09:45 | |
| *** holser has quit IRC | 09:48 | |
| *** ysandeep|lunch is now known as ysandeep | 09:48 | |
| marios | arxcruz: chandan beat me to it | 09:48 |
| marios | zbr: chandankumar: added to queue | 09:49 |
| arxcruz | sudo marios do it! | 09:51 |
| *** tosky has quit IRC | 10:00 | |
| *** tosky has joined #oooq | 10:01 | |
| panda | marios: zbr https://review.rdoproject.org/r/27626 is becoming urgent ... | 10:08 |
| zbr | panda: i cannot help you with changes that cannot be merged | 10:12 |
| panda | zbr: now it can, and you can help me anyway just telling me if there's anything else missing to do | 10:13 |
| panda | or something you don't like | 10:13 |
| zbr | pyyaml commenting is really weird, it is or it is not a requirement? | 10:14 |
| zbr | if it is, it should be in, even if you need to put different conditions for py27 | 10:14 |
| zbr | other than this, no. GTG from me. | 10:15 |
| panda | zbr: it's a requiremente, but I guess it's pulled automatically. If I make it explicit py27 breaks | 10:15 |
| *** holser has joined #oooq | 10:15 | |
| zbr | something is wrong, i am afraid we cannot just remove it. you can lower version only for py27. do you have link? | 10:16 |
| panda | zbr: a link of what ? | 10:17 |
| panda | zbr: I think it fails only locally | 10:17 |
| zbr | to the error caused when you keep it | 10:17 |
| panda | zbr: zuul tests pass | 10:17 |
| zbr | in that case, i do not care yet. | 10:17 |
| panda | ERROR: py27: could not install deps [pytest-cov, -r/workspace/repos/rdo-infra-ci-config/test-requirements.txt, -r/workspace/repos/rdo-infra-ci-config/ci-scripts/dlrnapi_promoter/requirements.txt, -r/workspace/repos/rdo-infra-ci-config/ci-scripts/dlrnapi_promoter/test-requirements.txt, -r/workspace/repos/rdo-infra-ci-config/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf/requirements.txt]; v = | 10:17 |
| panda | InvocationError('/workspace/repos/rdo-infra-ci-config/.tox/py27/bin/pip install -U pytest-cov -r/workspace/repos/rdo-infra-ci-config/test-requirements.txt -r/workspace/repos/rdo-infra-ci-config/ci-scripts/dlrnapi_promoter/requirements.txt -r/workspace/repos/rdo-infra-ci-config/ci-scripts/dlrnapi_promoter/test-requirements.txt | 10:17 |
| panda | -r/workspace/repos/rdo-infra-ci-config/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf/requirements.txt', 1) | 10:17 |
| zbr | ahh, I know whyt | 10:18 |
| zbr | remove it for now | 10:18 |
| zbr | you cannot specify requirements in multiple locations and include them in the same install command | 10:18 |
| zbr | conflicts | 10:18 |
| zbr | another reason why promoter should be role, so he would be able to own the deps install part | 10:19 |
| zbr | anyway, rebase and merge. | 10:19 |
| marios | panda: ack | 10:23 |
| *** bhagyashris is now known as bhagyashris|brb | 10:37 | |
| *** holser has quit IRC | 11:06 | |
| *** bhagyashris|brb is now known as bhagyashris | 11:12 | |
| weshay_ruck | panda, have you looked at http://promoter.rdoproject.org/centos8_train.log today? | 11:29 |
| weshay_ruck | https://review.opendev.org/#/c/739523/ merged | 11:29 |
| weshay_ruck | I see new errors | 11:29 |
| weshay_ruck | panda, containers and overcloud images failed | 11:30 |
| weshay_ruck | ysandeep, FYI.. still hitting some things w/ c8-train promotion | 11:30 |
| ysandeep | weshay_ruck, yes i saw | 11:31 |
| panda | weshay_ruck: it's trying to pull the ppc images | 11:32 |
| weshay_ruck | panda, so we just need to turn ppc off? | 11:33 |
| weshay_ruck | soniya29|rover, http://dashboard-ci.tripleo.org/d/QrkFP-zGz/upstream-and-rdo-promotions | 11:33 |
| panda | weshay_ruck: done now, we can restart and see | 11:33 |
| weshay_ruck | sshnaidm|ruck, soniya29|rover https://review.opendev.org/#/c/739637/ | 11:40 |
| sshnaidm|ruck | arxcruz, chandankumar any thoughts about this error? CRITICAL tempest [-] Unhandled error: tempest.lib.exceptions.UnexpectedContentType: Unexpected content type provided https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_add/737759/3/gate/tripleo-ci-centos-8-scenario001-standalone/add4f92/job-output.txt | 11:41 |
| *** ysandeep is now known as ysandeep|afk | 11:41 | |
| weshay_ruck | sshnaidm|ruck, soniya29|rover https://review.opendev.org/#/c/739135/ | 11:42 |
| arxcruz | sshnaidm|ruck: no, first time seeing it | 11:42 |
| arxcruz | sshnaidm|ruck: only happen this time, or is it happening all the time ? | 11:44 |
| sshnaidm|ruck | arxcruz, this specific error saw once in gate, but I'm checking 10 failures in gates now and all of them because of tempest failing.. | 11:45 |
| arxcruz | sshnaidm|ruck: with this error right ? | 11:45 |
| sshnaidm|ruck | arxcruz, no, this specific is once so far, continue looking in | 11:45 |
| arxcruz | ok | 11:45 |
| *** udesale_ has joined #oooq | 11:49 | |
| *** jfrancoa has quit IRC | 11:50 | |
| *** jfrancoa has joined #oooq | 11:50 | |
| *** derekh has quit IRC | 11:50 | |
| *** udesale has quit IRC | 11:52 | |
| chandankumar | weshay_ruck, https://review.opendev.org/737727 we are good to go and switch to new container build with native push | 11:52 |
| chandankumar | weshay_ruck, check my last comment | 11:52 |
| *** amoralej is now known as amoralej|lunch | 12:00 | |
| weshay_ruck | chandankumar, \0/ woot https://logserver.rdoproject.org/89/28389/3/check/periodic-tripleo-build-containers-ubi-8/cfa393b/logs/build.log and https://registry.rdoproject.org:8443/oapi/v1/namespaces/testingmaster/imagestreamtags/ | 12:01 |
| weshay_ruck | look good | 12:01 |
| weshay_ruck | 2020-07-07 07:40:26 | Pushing trunk.registry.rdoproject.org/testingmaster/centos-binary-tempest:a1a85c0578faa814647172f8ab62c311 image with: sudo buildah push --tls-verify=False trunk.registry.rdoproject.org/testingmaster/centos-binary-tempest:a1a85c0578faa814647172f8ab62c311 docker://trunk.registry.rdoproject.org/testingmaster/centos-binary-tempest:a1a85c0578faa814647172f8ab62c311 | 12:01 |
| weshay_ruck | very nice | 12:01 |
| chandankumar | weshay_ruck, merge it sir | 12:01 |
| chandankumar | weshay_ruck, rlandy on pto today? | 12:02 |
| weshay_ruck | chandankumar, aye captain | 12:02 |
| weshay_ruck | chandankumar, don't think so | 12:02 |
| chandankumar | weshay_ruck, ok, thanks! | 12:02 |
| weshay_ruck | chandankumar, bonus points for getting someone to fix | 12:03 |
| weshay_ruck | 2020-07-07 07:40:47 | ============= SUMMARY =============== | 12:03 |
| weshay_ruck | 2020-07-07 07:40:47 | Expected................... 110 | 12:04 |
| weshay_ruck | 2020-07-07 07:40:47 | Built...................... 109 | 12:04 |
| weshay_ruck | 2020-07-07 07:40:47 | ===================================== | 12:04 |
| *** rfolco has joined #oooq | 12:04 | |
| chandankumar | weshay_ruck, kevin knows about this issue | 12:04 |
| *** ysandeep|afk is now known as ysandeep | 12:06 | |
| ykarel | chandankumar, ^^ issue i mentioned | 12:09 |
| ykarel | duplicate designate_base | 12:09 |
| ykarel | in tripleo-common | 12:09 |
| ykarel | https://github.com/openstack/tripleo-common/blob/master/container-images/tripleo_containers.yaml | 12:10 |
| chandankumar | https://github.com/openstack/tripleo-common/blob/master/container-images/tripleo_containers.yaml#L49 | 12:11 |
| chandankumar | let me fix thatr | 12:11 |
| marios | ysandeep: have you seen an issue in periodic centos8 train jobs like "./logfile_02May2018.log:44:"reosolve issues " actually this is customer focus but the points identifed are basically what we do every time we have a customer case/bz. | 12:11 |
| ykarel | ack | 12:11 |
| marios | ysandeep: sorry wrong paste, that one ./logfile_03Apr2017.log:160:* calls: customer call (engineering field engagement) pneedle msutton sofer matbu morazi - lab minor update 2 issues, undercloud iface bonding issue, overcloud update failing. will file bz | 12:11 |
| marios | ./logfile_02May2018.log:44:"reosolve issues " actually this is customer focus but the points identifed are basically what we do every time we have a customer case/bz. | 12:11 |
| marios | oh come on :D | 12:11 |
| marios | ysandeep: sorry i ... this tripleo_common.image.image_uploader [ ] Error detected in auth headers: error insufficient_scope | 12:12 |
| marios | ysandeep: i am filing a bug and can't see it already in https://bugs.launchpad.net/tripleo | 12:12 |
| ysandeep | marios, can you please point me to complete logs, may be i recognizes them | 12:13 |
| marios | ysandeep: i saw it in train update and ussuri standalone-upgrade | 12:13 |
| marios | ysandeep: sure, sec | 12:13 |
| marios | ysandeep: https://2a4f7f67bcfb8d0b3cd4-f9c86595ee722ed5765b04c30efd2d71.ssl.cf1.rackcdn.com/739459/5/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/c1a2641/job-output.txt | 12:14 |
| ysandeep | looking | 12:14 |
| marios | ysandeep: ack, question is if you've filed a bug for that/if you've seen it already sounds like no | 12:14 |
| marios | ysandeep: thanks | 12:14 |
| ysandeep | marios, these are the one i aware you about last week.. its failing because of no containers here https://hub.docker.com/u/tripleotraincentos8 | 12:15 |
| marios | ysandeep: i see... do we have a bug for it? or is it tracked somewhere else | 12:16 |
| ysandeep | marios, no bz yet.. but weshay_ruck is trying to promote containers for c8 train | 12:16 |
| marios | ysandeep: are we doing something/... ok i see | 12:16 |
| marios | ysandeep: well there was a train promotion last night | 12:16 |
| marios | ysandeep: but it looks like it didn't fix it yet | 12:16 |
| panda | all aboard the promotion train | 12:16 |
| panda | whooo whoooo | 12:16 |
| ysandeep | marios, we got promotion.. :) | 12:17 |
| ysandeep | panda++ weshay_ruck++ | 12:17 |
| ysandeep | thank you guys! | 12:17 |
| * marios sees panda driving - pulls emergency brake & jumps | 12:17 | |
| panda | zbr: can you help me understand what are the plans with py27 ? | 12:17 |
| weshay_ruck | ysandeep, panda wait wait | 12:17 |
| marios | ysandeep: but the problem remains | 12:18 |
| weshay_ruck | c8-train did not promote | 12:18 |
| marios | ysandeep: those logs are from today | 12:18 |
| *** holser has joined #oooq | 12:18 | |
| marios | weshay_ruck: oh you just created previous manually or something? | 12:18 |
| weshay_ruck | marios, yes | 12:18 |
| marios | weshay_ruck: i thought it was a proper promotion | 12:18 |
| marios | weshay_ruck: ack ok i see sorry | 12:18 |
| zbr | panda: sure, remove them as soon as possible (can drop it in some places faster than in others) | 12:18 |
| marios | ysandeep: so we didn't get a promotion ^ weshay_ruck manually fixed the issue i had yesterday | 12:18 |
| weshay_ruck | marios, panda we need to turn off manifest creation | 12:18 |
| ysandeep | marios, aahhh | 12:18 |
| panda | weshay_ruck: I turned off manifest push ... | 12:18 |
| zbr | if we have a specific place where we need to keep py27 support, we can contain that, isolating from others. | 12:19 |
| panda | but it's not enough ... | 12:19 |
| marios | weshay_ruck: more problems with ppc manifests missing or somethign? | 12:19 |
| zbr | so changes made to one place do not break another | 12:19 |
| *** rlandy has joined #oooq | 12:19 | |
| panda | zbr: is it ok if I remove every trace of py27 from tox ? | 12:19 |
| zbr | likely not | 12:19 |
| panda | zbr: at this point I would need to fix the dependency | 12:20 |
| zbr | i do have a good example where it does not make sense | 12:20 |
| weshay_ruck | panda, do you have a vi session open on the promoter? | 12:20 |
| panda | zbr: and I'm not sure it's worth it. | 12:20 |
| rlandy | chandankumar: hey - https://code.engineering.redhat.com/gerrit/#/c/205466/ - you got the downstream node_failure fixed? | 12:20 |
| panda | weshay_ruck: yes, exited now | 12:20 |
| zbr | if we have an ansible module written in python, one that also needs to run on centos-7 | 12:20 |
| weshay_ruck | looks like master is promoting again | 12:20 |
| chandankumar | rlandy, yes boss | 12:20 |
| rlandy | chandankumar: yay - thank you | 12:21 |
| chandankumar | rlandy, few more patches | 12:21 |
| zbr | but if we can control where it runs, we can go py36 pure | 12:21 |
| chandankumar | rlandy, https://code.engineering.redhat.com/gerrit/203744 and https://code.engineering.redhat.com/gerrit/205474 | 12:21 |
| chandankumar | rlandy, container build is working fine now | 12:22 |
| rlandy | chandankumar: ok - working downstream as well ... except for ovn ... | 12:22 |
| * rlandy gets | 12:22 | |
| panda | weshay_ruck: there's a bug in the ppc part | 12:23 |
| panda | it's failing the playbook | 12:23 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/78/205378/4/check/tripleo-build-containers-ubi-8-internal-rhel-8-rhos-17/2ec1b1c/logs/build.log | 12:23 |
| panda | weshay_ruck: I'll try to fix it | 12:23 |
| weshay_ruck | panda, thanks | 12:23 |
| weshay_ruck | zbr, rfolco marios ci-config monitoring.. on the main cockpit page.. next time I launch an env.. I'll fix the legend for the graphs. http://dashboard-ci.tripleo.org/d/wb8HBhrWk/cockpit?orgId=1 | 12:24 |
| rlandy | No match for argument: python3-ovn-octavia-provider | 12:24 |
| rlandy | Error: Unable to find a match: python3-ovn-octavia-provider | 12:24 |
| weshay_ruck | scroll down to periodic jobs | 12:24 |
| rlandy | chandankumar: ^^ | 12:24 |
| ysandeep | rlandy, hey good morning o/ , please add these to your review list https://code.engineering.redhat.com/gerrit/#/c/205475/ and https://code.engineering.redhat.com/gerrit/#/c/205353/ | 12:25 |
| rlandy | must be missing that downstream python3-ovn-octavia-provider | 12:25 |
| rlandy | ysandeep: hi - https://code.engineering.redhat.com/gerrit/#/c/205475 looks ok to me but pls ask tristan or nhicher to confirm | 12:27 |
| ysandeep | rlandy, okay, thanks! | 12:27 |
| weshay_ruck | reviews please https://review.rdoproject.org/r/#/c/28403/ | 12:29 |
| weshay_ruck | https://review.rdoproject.org/r/#/c/28405/ | 12:29 |
| chandankumar | rlandy, looking | 12:29 |
| rlandy | https://code.engineering.redhat.com/gerrit/#/c/205353/ should be ok - must be taking that anyways | 12:30 |
| rlandy | chandankumar: are you all set with container push now? | 12:31 |
| chandankumar | rlandy, yes | 12:31 |
| rlandy | chandankumar: then can we meet for a few? | 12:31 |
| rlandy | I need the same playbook changes downstream | 12:31 |
| chandankumar | rlandy, yes sure | 12:32 |
| weshay_ruck | rlandy, https://review.rdoproject.org/r/#/c/28403/ | 12:33 |
| rlandy | looking | 12:33 |
| chandankumar | rlandy, https://meet.google.com/?hs=197&pli=1&authuser=0 | 12:34 |
| rlandy | chandankumar: will be there in a esc - just checking pipeline reviews | 12:34 |
| rlandy | weshay_ruck: one comment on https://review.rdoproject.org/r/#/c/28403/ | 12:37 |
| rlandy | otherwise good to go | 12:37 |
| rlandy | chandankumar: joining | 12:40 |
| chandankumar | rlandy, https://meet.google.com/mhq-bvmm-hwv?pli=1&authuser=0 | 12:41 |
| *** ratailor has quit IRC | 12:56 | |
| bhagyashris | rlandy, weshay_ruck i keep integration-pipeline-stable4-5.yaml instead of zuul.d/integration-pipeline-stable4-plus.yaml because we keep the queens and rocky jobs there ... otherwise if you want me to change it i will do that quickly np :) thank you :) | 12:58 |
| weshay_ruck | I think it's fine the way you have it | 12:59 |
| bhagyashris | weshay_ruck, ack thank you :) | 13:00 |
| *** rascasoft has quit IRC | 13:08 | |
| *** amoralej|lunch is now known as amoralej | 13:08 | |
| marios | weshay_ruck: nice thanks :D (sorry just saw the notification re ci-config periodic on grafana | 13:15 |
| weshay_ruck | :) | 13:16 |
| *** TrevorV has joined #oooq | 13:16 | |
| *** Goneri has joined #oooq | 13:18 | |
| *** derekh has joined #oooq | 13:19 | |
| chandankumar | rlandy, check the chatter on #rhos-delivery | 13:25 |
| rlandy | chandankumar: thanks - looking | 13:26 |
| rfolco | ping community meeting | 13:29 |
| rfolco | arxcruz, rfolco, zbr, panda, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankumar | 13:29 |
| rfolco | https://meet.google.com/bqx-xwht-wky?authuser=1 | 13:29 |
| rfolco | https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw?both | 13:29 |
| weshay_ruck | rfolco, I'm in a manager thang | 13:30 |
| weshay_ruck | carry on w/o me | 13:30 |
| rfolco | ack weshay_ruck | 13:30 |
| rlandy | chandankumar++ | 13:30 |
| rlandy | thanks for getting this sorted | 13:30 |
| *** Goneri has quit IRC | 13:33 | |
| mjturek | rfolco: any idea what causes this? Not sure what's supposed to generate this folder or what's looking for it https://logserver.rdoproject.org/ci.centos.org/tripleo-upstream-containers-build-master-ppc64le/2460/logs/logs/containers-build-errors.log | 13:39 |
| rfolco | mjturek, will look in a few after my current mtg | 13:40 |
| mjturek | thx, np | 13:40 |
| chandankumar | rlandy, marios weshay_ruck sshnaidm|ruck bhagyashris ysandeep https://review.rdoproject.org/r/#/c/28404/1/zuul.d/upstream.yaml@121 have a look when free | 13:56 |
| rlandy | will look after meeting | 13:56 |
| ysandeep | chandankumar, I agree with segregating if we are hitting resource crunch because of more number of jobs. i posted similiar question on this https://review.rdoproject.org/r/#/c/28403/3/zuul.d/integration-pipeline-stable2.yaml | 13:58 |
| *** Goneri has joined #oooq | 14:02 | |
| marios | ack chandankumar | 14:05 |
| bhagyashris | chandankumar, ack will do the changes soon :) thanks | 14:07 |
| ysandeep | rlandy, I was thinking if we should probably use rhel8.2 instead of 8.1 as base image here:- https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/sf-config.git;a=blob;f=nodepool/tripleo.yaml#l94 | 14:08 |
| rlandy | ysandeep: that's fine | 14:08 |
| rlandy | we run rhos-release 8.2 | 14:08 |
| rlandy | so we come out with 8.2 mostly | 14:09 |
| *** bhagyashris is now known as bhagyashris|dinn | 14:09 | |
| rlandy | but switching the node is fine | 14:09 |
| ysandeep | rlandy, you mean we perform a yum update after "rhos-release 8.2" | 14:09 |
| rlandy | if you look at yum.repos.d we will get 8.2 repos | 14:11 |
| rlandy | some test update | 14:11 |
| rlandy | depends' | 14:11 |
| rlandy | updating the node is good | 14:11 |
| ysandeep | rlandy, okay, I will prepare a patch for your review - to switch to 8.2 - I found a TODO to remove 8.1 image - https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/sf-config.git;a=blob;f=nodepool/nodepool.yaml#l73 | 14:13 |
| ysandeep | rlandy, thanks! | 14:14 |
| ysandeep | marios, rlandy chandankumar need reviews on "Multinode base job" https://code.engineering.redhat.com/gerrit/#/c/201375/ whenever time permits | 14:17 |
| marios | ack ysandeep | 14:17 |
| chandankumar | ysandeep, put this also https://code.engineering.redhat.com/gerrit/#/c/205474/3/zuul.d/standalone-jobs.yaml@24 in base job definitions | 14:19 |
| *** ccamacho has quit IRC | 14:19 | |
| ysandeep | chandankumar, ack updating | 14:20 |
| chandankumar | ysandeep, thanks! | 14:20 |
| soniya29|rover | weshay_ruck, sshnaidm|ruck, I see too many stein jobs with skipped result | 14:24 |
| weshay_ruck | soniya29|rover, did the containers build job fail? | 14:24 |
| soniya29|rover | weshay_ruck, nope, it is also skipped | 14:25 |
| sshnaidm|ruck | soniya29|rover, on a patch? | 14:25 |
| rfolco | mjturek, hmmm this happens here https://github.com/openstack/tripleo-ci/blob/16756e77b7fd21cec596d08fea3ca06755aea223/roles/build-containers/templates/build.sh.j2#L86 | 14:26 |
| soniya29|rover | sshnaidm|ruck, no logs, So no idea | 14:26 |
| sshnaidm|ruck | soniya29|rover, where do you see these jobs? | 14:26 |
| rfolco | mjturek, I don't know why /tmp/containers-* don't exist, but maybe its worth adding a || true like in https://github.com/openstack/tripleo-ci/blob/db711241b9265d83b1a20afe04ba6b294eb3512d/roles/build-containers/tasks/post.yaml#L20 | 14:26 |
| soniya29|rover | sshnaidm|ruck, https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-24hr# | 14:27 |
| rfolco | mjturek, let me check our buildah logs to compare | 14:27 |
| sshnaidm|ruck | soniya29|rover, that was yesterday | 14:27 |
| sshnaidm|ruck | soniya29|rover, because of failures on vexxhost, you can see node_failure there | 14:27 |
| mjturek | ahhh cool thanks rfolco | 14:27 |
| sshnaidm|ruck | soniya29|rover, periodic-tripleo-centos-7-stein-promote-consistent-to-tripleo-ci-testing is the job that starts all other jobs, if it fails - all the rest will be skipped | 14:28 |
| rfolco | mjturek, look this https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-master-containers-build-push/d69e3f5/logs/containers-build-errors.log | 14:28 |
| rfolco | mjturek, lol | 14:28 |
| mjturek | hahaha cool | 14:29 |
| mjturek | so fix needs to be in tripleo-ci? | 14:29 |
| ysandeep | chandankumar, i have updated https://code.engineering.redhat.com/gerrit/#/c/201375/ | 14:29 |
| rfolco | mjturek, hmmmm look this https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-master-containers-build-push/d69e3f5/logs/buildah-builds/ | 14:31 |
| mjturek | rfolco interesting.. we don't have that docker folder | 14:32 |
| rfolco | mjturek, container-builds is not under /tmp/, its under /tmp/buildah-builds | 14:32 |
| mjturek | hm we copy over the entire buildah-builds folder from what I remember but need to double check that | 14:34 |
| rfolco | mjturek, I am not 100% sure, but when building with buildah, temp build path is different from when building with docker... | 14:34 |
| soniya29|rover | sshnaidm|ruck, ack | 14:34 |
| *** holser has quit IRC | 14:35 | |
| *** holser has joined #oooq | 14:36 | |
| sshnaidm|ruck | panda, can we delete on tripleo-infra tenant: promoter-new | SHUTOFF | private=192.168.100.34, 38.145.33.174 | 14:37 |
| rfolco | mjturek, maybe /tmp/*/container-*/docker ? or /tmp/buildah-builds/container-*/ if buildah | 14:38 |
| rfolco | mjturek, but that error is not making the job to fail... is it ? | 14:38 |
| mjturek | I don't think it is, but it's the first time in awhile I've seen anything in the container-build-errors file | 14:39 |
| ysandeep | weshay_ruck, rlandy something is wrong here - https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=linters | 14:40 |
| ysandeep | linters failing with node failure | 14:40 |
| weshay_ruck | #rhos-ops | 14:40 |
| *** ccamacho has joined #oooq | 14:44 | |
| zbr | panda: weshay_ruck marios: zuul ui change: https://review.opendev.org/#/c/739559/ -- you know how to use dasboard jobs site-preview feature, right? | 14:44 |
| weshay_ruck | zbr, perhaps a link in the commit message w/ a screenshot would help? | 14:46 |
| zbr | weshay_ruck: https://sbarnea.com/ss/Screen-Shot-2020-07-07-15-46-54.50.png | 14:47 |
| zbr | ss are easy to make but they do not give good review ability. | 14:47 |
| zbr | mainly each reviewer needs to know how to browse zuul UI using site-preview | 14:47 |
| zbr | being able to test zuul ui changes without merging is so awesome! only downside is that these test links are not shareable. | 14:48 |
| zbr | basically this removes the top level frame container (not really removes but makes it not visible as a table) | 14:49 |
| zbr | reduces complexity a little, at some point I seen 4 nested tables... | 14:49 |
| *** saneax has quit IRC | 14:51 | |
| *** saneax has joined #oooq | 14:55 | |
| *** bhagyashris|dinn is now known as bhagyashris | 14:56 | |
| *** saneax has quit IRC | 14:56 | |
| *** saneax has joined #oooq | 14:57 | |
| *** saneax has quit IRC | 15:01 | |
| *** saneax has joined #oooq | 15:04 | |
| *** saneax has quit IRC | 15:05 | |
| bhagyashris | marios, weshay_ruck rlandy rfolco chandankumar ysandeep sshnaidm|ruck request you to please look into ysandeep comment on https://review.rdoproject.org/r/#/c/28404/ and would like your opinions on it. thank you :) | 15:09 |
| rlandy | bhagyashris: left my reply there to ysandeep comment | 15:11 |
| weshay_ruck | panda, think we'll get the train promotion this time? | 15:13 |
| panda | weshay_ruck: I looked at bit more, the entire ppc part should be skipped when manifest_push if false, so swe shjould not get the ppc error again | 15:14 |
| weshay_ruck | anybody need anything? | 15:14 |
| weshay_ruck | panda, rock on | 15:14 |
| panda | I need some water. | 15:15 |
| * weshay_ruck books flight.. water boy otw | 15:15 | |
| rlandy | sshnaidm|ruck: want to meet to discuss the work for reducing jobs on rdocloud? | 15:15 |
| weshay_ruck | https://images.app.goo.gl/eyNc4vtQ6jNCBWHZ7 | 15:15 |
| weshay_ruck | and removing some jobs against tripleo-ci again | 15:16 |
| sshnaidm|ruck | rlandy, https://meet.google.com/ejg-fnkg-nbb | 15:16 |
| rlandy | joining | 15:16 |
| *** pojadhav is now known as pojadhav|dinner | 15:22 | |
| weshay_ruck | sshnaidm|ruck, rlandy https://docs.google.com/document/d/1DgPbxqkW6nz9cXmtEz6WR61sHkQbRgbVDBtRzW2v72A/edit | 15:23 |
| bhagyashris | rlandy, ack thanks | 15:23 |
| *** bogdando has joined #oooq | 15:31 | |
| *** ysandeep is now known as ysandeep|away | 15:32 | |
| *** dtantsur is now known as dtantsur|brb | 15:49 | |
| *** ccamacho has quit IRC | 15:49 | |
| *** ykarel is now known as ykarel|away | 15:57 | |
| *** amoralej is now known as amoralej|off | 15:57 | |
| *** marios has quit IRC | 16:02 | |
| chandankumar | weshay_ruck, rlandy please merge this https://review.rdoproject.org/r/#/c/28369/ and https://review.rdoproject.org/r/#/c/28370/ once upstream review lands | 16:05 |
| chandankumar | related to new container build | 16:06 |
| chandankumar | and it will close new container build user story | 16:06 |
| rlandy | ack | 16:06 |
| weshay_ruck | nice | 16:07 |
| chandankumar | weshay_ruck, rlandy https://review.opendev.org/#/c/739415/ and this also | 16:07 |
| weshay_ruck | chandankumar, I have questions about https://review.opendev.org/#/c/739415/ | 16:07 |
| weshay_ruck | let me look at this again | 16:08 |
| chandankumar | weshay_ruck, sure | 16:08 |
| weshay_ruck | chandankumar, are you 100% the podman login does NOT leave the creds you need for buildah? | 16:08 |
| weshay_ruck | chandankumar, also this looks like we just login in w/ both | 16:08 |
| chandankumar | weshay_ruck, yes, | 16:08 |
| weshay_ruck | maybe we should chat for a sec | 16:09 |
| chandankumar | weshay_ruck, check the commit msg | 16:09 |
| weshay_ruck | ah I see | 16:09 |
| chandankumar | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-rdo-base/container-login.yaml#L55 | 16:09 |
| chandankumar | will be removed once upstream patch lands | 16:09 |
| weshay_ruck | chandankumar, ysandeep|away ok.. centos-8 train has been pushed to docker.io | 16:14 |
| weshay_ruck | full promotion there | 16:14 |
| weshay_ruck | https://trunk.rdoproject.org/centos8-train/ | 16:14 |
| weshay_ruck | panda++ | 16:14 |
| panda | finally ../. | 16:15 |
| *** skramaja has quit IRC | 16:20 | |
| *** ysandeep|away is now known as ysandeep | 16:21 | |
| ysandeep | weshay_ruck, panda thank you | 16:21 |
| rlandy | weshay_ruck: sshnaidm|ruck: shared google doc with you both on psiphx | 16:25 |
| rlandy | we can share that with infra once you review | 16:25 |
| *** udesale_ has quit IRC | 16:29 | |
| *** chandankumar is now known as raukadah | 16:38 | |
| panda | zbr: so is this still a problem with the mirror ? https://logserver.rdoproject.org/29/28429/3/check/molecule-container-push-delegated-centos-7/a6dc1e1/job-output.txt | 16:39 |
| *** bogdando has quit IRC | 16:40 | |
| *** dtantsur|brb is now known as dtantsur | 16:41 | |
| *** Trevor_V has joined #oooq | 16:52 | |
| *** TrevorV has quit IRC | 16:57 | |
| *** derekh has quit IRC | 17:27 | |
| *** pojadhav|dinner is now known as pojadhav | 17:34 | |
| *** dtantsur is now known as dtantsur|afk | 17:38 | |
| rfolco | zbr, are you planning to fix provision/default scenario ? let me know if need help... as the other scenarios include it | 17:55 |
| weshay_ruck | sshnaidm|ruck, heh.. you don't have to do this anymore :) but it's fine if you do | 18:43 |
| weshay_ruck | just ping me :) | 18:43 |
| rlandy | raukadah: ok - we're building container downstream with new changes ... https://sf.hosted.upshift.rdu2.redhat.com/logs/78/205378/5/check/tripleo-build-containers-ubi-8-internal-rhel-8-rhos-17/c8148dc/logs/build.log | 19:18 |
| rlandy | redhat-binary-nova-libvirt | 19:28 |
| rlandy | lol - we're back to the rhel redhat game | 19:28 |
| *** jfrancoa has quit IRC | 19:31 | |
| rlandy | weshay_ruck: sshnaidm|ruck: ok if I merge https://review.rdoproject.org/r/#/c/28370/ - it will change container push in master pipeline | 19:40 |
| sshnaidm|ruck | rlandy, ack | 19:42 |
| rlandy | sshnaidm|ruck: k - feel free to revert if it kill something | 19:44 |
| *** jfrancoa has joined #oooq | 19:48 | |
| *** Trevor_V has quit IRC | 20:22 | |
| *** TrevorV has joined #oooq | 20:25 | |
| *** TrevorV has quit IRC | 20:42 | |
| weshay_ruck | rlandy, can we merge bhagyashri's changes to the pipeline names? | 21:01 |
| weshay_ruck | shall we double check that? | 21:02 |
| weshay_ruck | rlandy, https://review.rdoproject.org/r/#/c/28403/ https://review.rdoproject.org/r/#/c/28405/ https://review.rdoproject.org/r/#/c/28404/ | 21:03 |
| rlandy | weshay_ruck: I did | 21:08 |
| rlandy | https://review.rdoproject.org/r/#/c/28403/ | 21:08 |
| rlandy | I didn't merge | 21:08 |
| rlandy | weshay_ruck: I merged the three patches chandan asked for | 21:09 |
| weshay_ruck | rlandy, aye.. so wdyt.. re: the renames? | 21:09 |
| rlandy | weshay_ruck: yeah | 21:10 |
| rlandy | I think everyone agreed | 21:10 |
| weshay_ruck | k.. please review / vote and if u like what you see I'll merge | 21:10 |
| rlandy | weshay_ruck: merging https://review.rdoproject.org/r/#/c/28403/ | 21:11 |
| rlandy | weshay_ruck: https://review.rdoproject.org/r/#/c/28405/ can't rebase | 21:12 |
| weshay_ruck | rlandy, https://review.rdoproject.org/r/#/c/28404/ | 21:12 |
| rlandy | weshay_ruck: voted on https://review.rdoproject.org/r/#/c/28404/ | 21:12 |
| rlandy | waiting to merge that on https://review.rdoproject.org/r/#/c/28403/ | 21:13 |
| weshay_ruck | thanks | 21:14 |
| rlandy | ugh I hate config | 21:15 |
| rlandy | weshay_ruck: all set now with merges? | 21:24 |
| weshay_ruck | think so | 21:28 |
| * weshay_ruck looks | 21:28 | |
| weshay_ruck | conflict on https://review.rdoproject.org/r/#/c/28405/ | 21:30 |
| weshay_ruck | no | 21:30 |
| weshay_ruck | meh.. tomorrow | 21:31 |
| weshay_ruck | config review is still getting checked by the rdo-registry test | 21:32 |
| rlandy | no big deal on https://review.rdoproject.org/r/#/c/28405/ - just clean up | 21:39 |
| *** jfrancoa has quit IRC | 21:53 | |
| *** rlandy is now known as rlandy|bbl | 22:08 | |
| *** dsneddon has joined #oooq | 22:25 | |
| *** jbadiapa has quit IRC | 22:28 | |
| *** johnsom has quit IRC | 22:51 | |
| *** zbr has quit IRC | 22:53 | |
| *** tosky has quit IRC | 23:01 | |
| *** rlandy|bbl is now known as rlandy | 23:21 | |
| *** Goneri has quit IRC | 23:25 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!
