| *** jmasud has quit IRC | 00:11 | |
| *** jmasud has joined #oooq | 00:14 | |
| *** rfolco has quit IRC | 01:44 | |
| *** Goneri has quit IRC | 02:34 | |
| *** openstackstatus has joined #oooq | 02:55 | |
| *** ChanServ sets mode: +v openstackstatus | 02:55 | |
| *** rlandy|bbl is now known as rlandy | 03:03 | |
| *** ykarel|away is now known as ykarel | 03:34 | |
| *** jmasud has quit IRC | 04:12 | |
| *** jmasud has joined #oooq | 04:14 | |
| *** udesale has joined #oooq | 04:20 | |
| *** rlandy has quit IRC | 04:41 | |
| *** saneax has joined #oooq | 05:01 | |
| *** ccamacho has quit IRC | 05:17 | |
| *** udesale_ has joined #oooq | 06:03 | |
| *** ratailor has joined #oooq | 06:04 | |
| *** ratailor has quit IRC | 06:05 | |
| *** udesale has quit IRC | 06:06 | |
| *** ratailor has joined #oooq | 06:07 | |
| *** marios|ruck has joined #oooq | 06:08 | |
| *** yolanda has joined #oooq | 06:22 | |
| *** jfrancoa has joined #oooq | 06:49 | |
| *** dpawlik has joined #oooq | 07:31 | |
| *** ratailor has quit IRC | 07:40 | |
| *** ratailor has joined #oooq | 07:41 | |
| *** jpena|off is now known as jpena | 07:51 | |
| *** jbadiapa has joined #oooq | 07:52 | |
| *** ykarel is now known as ykarel|lunch | 08:01 | |
| *** holser has joined #oooq | 08:02 | |
| *** tesseract has joined #oooq | 08:05 | |
| marios|ruck | chandankumar: what's the story on that one https://review.opendev.org/#/c/706817/ do we still need it? | 08:06 |
|---|---|---|
| marios|ruck | soniya29: https://review.opendev.org/#/c/702808/ and that one related ^ | 08:06 |
| marios|ruck | ah i see, you're working to fix the test so we can revert the skip | 08:06 |
| *** jmasud has quit IRC | 08:12 | |
| *** jmasud has joined #oooq | 08:14 | |
| *** tosky has joined #oooq | 08:29 | |
| *** ccamacho has joined #oooq | 08:32 | |
| dpawlik | marios|ruck, o/ | 08:32 |
| marios|ruck | o/ dpawlik | 08:32 |
| dpawlik | I have same issiue on executing the command https://review.rdoproject.org/r/#/c/24926 like you comment | 08:32 |
| dpawlik | but then I check that with -x and it works well | 08:32 |
| dpawlik | the key there is to be in really good path | 08:33 |
| marios|ruck | dpawlik: yeah i tried to recreate the paths as expected but maybe i got something wrong | 08:33 |
| marios|ruck | dpawlik: k well thanks for sanity check ... but strange why '-x' (debug?) will fix it | 08:34 |
| marios|ruck | dpawlik: i mean it seems wrong | 08:34 |
| *** bogdando has joined #oooq | 08:35 | |
| marios|ruck | but again dpawlik 10:33 < marios|ruck> dpawlik: yeah i tried to recreate the paths as expected but maybe i got something wrong | 08:35 |
| dpawlik | marios|ruck, I mean, I created exactly same tree like we have on images server locally, and on checking script with -x it was working correctly | 08:35 |
| marios|ruck | dpawlik: i can try again if you update for my other comment please | 08:35 |
| dpawlik | okey | 08:35 |
| *** tesseract has quit IRC | 08:38 | |
| *** tesseract has joined #oooq | 08:39 | |
| *** amoralej|off is now known as amoralej | 08:40 | |
| dpawlik | marios|ruck, do you have any symlink there :>? | 08:45 |
| marios|ruck | dpawlik: no just touched some foo bar baz files there | 08:46 |
| dpawlik | yeah, so thats why you have error | 08:46 |
| marios|ruck | dpawlik: k, but that should handle it i mean if there are no links the expression should not fail. and then set -x should not cover it. but i'll have another look when you update thanks for checking let's see what others think too. | 08:47 |
| dpawlik | marios|ruck, no, with the "-x" expresion I would like to say, that when I was debuging if the scripts goes correct it was doing its job | 08:48 |
| dpawlik | marios|ruck, ok, I will change a little bit | 08:49 |
| bogdando | hi folks. If I ran zuul reproducer on rdo cloud, shall it manage nodepool vms there for me? | 08:51 |
| bogdando | cuz it seems it doesnt | 08:51 |
| bogdando | also, which container in a pod/compose has nodepool CLI? | 08:53 |
| marios|ruck | bogdando: o/ | 08:54 |
| marios|ruck | bogdando: it should do at least i've run that in the long past but haven't tried it in a while now | 08:55 |
| marios|ruck | bogdando: sshnaidm|afk: is the most active there recently | 08:55 |
| marios|ruck | bogdando: but running on rdo cloud was definitely one of the use cases... are you hitting error/? | 08:55 |
| chandankumar | marios|ruck, checking | 08:55 |
| chandankumar | marios|ruck, the dependent patch is not merged yet, let me update the revert | 08:56 |
| chandankumar | marios|ruck, please have a look at this one https://review.rdoproject.org/r/#/c/24701/ | 09:00 |
| marios|ruck | chandankumar: yeah i saw re the depends-on | 09:05 |
| *** holser has quit IRC | 09:08 | |
| bogdando | marios|ruck: a job doesn't start. need to check logs etc... | 09:08 |
| *** holser has joined #oooq | 09:08 | |
| *** ykarel|lunch is now known as ykarel | 09:13 | |
| zbr | morning! | 09:15 |
| zbr | marios|ruck: chandankumar arxcruz: please help me merge https://review.opendev.org/#/c/708613/ - i need it in order to upgrade molecule. | 09:16 |
| marios|ruck | zbr: will add to queue but middle sthing right now | 09:17 |
| *** derekh has joined #oooq | 09:29 | |
| panda | bhagyashris: hi, I've seen you in the document for the modularized promoter, just wanted to point out the code the document refers to is not merged yet, it's a big review I plan to to document better and split, but the single review is in https://review.rdoproject.org/r/24818 | 09:40 |
| bhagyashris | panda, sure i will look into it | 09:42 |
| panda | bhagyashris: as it's really huge, it might be easier to just checkout the change locally, and review the code from there. The diff is really confusing. | 09:48 |
| bhagyashris | panda, yeah it's too huge i will check that way. | 09:50 |
| *** tesseract has quit IRC | 09:58 | |
| *** jaosorior has joined #oooq | 09:59 | |
| *** tesseract has joined #oooq | 10:11 | |
| *** udesale_ has quit IRC | 11:03 | |
| bogdando | marios|ruck: so it works now, reproducing a job on rdo cloud! :) | 11:11 |
| marios|ruck | bogdando: nice good to hear, haven't tried it in a while. yeah for me that was the best use case on rdo cloud | 11:12 |
| sshnaidm|afk | bogdando, should be always working :) | 11:23 |
| *** sshnaidm|afk is now known as sshnaidm | 11:23 | |
| *** ykarel is now known as ykarel|afk | 11:24 | |
| bogdando | sshnaidm: ofc, without a doubt! just was my first attempt | 11:24 |
| sshnaidm | bogdando, did you try multinode? Interesting if it works too | 11:25 |
| dpawlik | marios|ruck, https://review.rdoproject.org/r/#/c/24926/ => check it please in free time ;) | 11:25 |
| bogdando | sshnaidm: before that I was using it on libvirt locally, which required a slightly different set of pushed knobs :) | 11:27 |
| bogdando | sshnaidm: not yet, standalones | 11:27 |
| bogdando | and borgin centos7 | 11:28 |
| sshnaidm | bogdando, yeah, libvirt is tricky, but openstack driver is stable and simpler | 11:29 |
| bogdando | indeed | 11:29 |
| bogdando | rdo cloud gave my love back | 11:29 |
| bogdando | gained* :) | 11:30 |
| *** jaosorior has quit IRC | 11:30 | |
| *** dtantsur|afk is now known as dtantsur | 11:51 | |
| *** rfolco has joined #oooq | 11:52 | |
| *** jpena is now known as jpena|lunch | 12:00 | |
| *** amoralej is now known as amoralej|lunch | 12:01 | |
| weshay|ruck | marios|ruck, 0/ | 12:06 |
| marios|ruck | weshay|ruck: o/ | 12:07 |
| chandankumar | weshay|ruck, free, need to understand what is missing on c8 container build side? | 12:09 |
| weshay|ruck | chandankumar, https://meet.google.com/uis-qwia-rrd?authuser=1 | 12:10 |
| weshay|ruck | chandankumar, https://hackmd.io/5uYRmLaOTI2raTbHWsaiSQ#Spec-for-promoting-promoted-components--gt-tripleo-ci-testing | 12:13 |
| *** ccamacho has quit IRC | 12:14 | |
| chandankumar | weshay|ruck, https://review.rdoproject.org/r/#/c/25075/ | 12:16 |
| chandankumar | https://review.rdoproject.org/r/#/c/25069/ | 12:16 |
| chandankumar | weshay|ruck, https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-ci-base-promote-consistent-to-tripleo-ci-testing/run.yaml#L6 | 12:18 |
| *** ratailor has quit IRC | 12:26 | |
| weshay|ruck | chandankumar, is sandeep there? | 12:26 |
| chandankumar | weshay|ruck, yes | 12:26 |
| chandankumar | weshay|ruck, ysandeep is his irc nick | 12:26 |
| ysandeep | weshay|ruck, o/ | 12:26 |
| weshay|ruck | ysandeep, hey.. have you registered for the openstack exam? | 12:27 |
| ysandeep | weshay|ruck, yes my exam is on tuesday | 12:27 |
| weshay|ruck | ysandeep++ | 12:27 |
| ysandeep | weshay|ruck, i send a mail to you for approval.. plz approve that also :) | 12:28 |
| weshay|ruck | chandankumar, is the the rhel8 build for libpod fixed? | 12:28 |
| chandankumar | weshay|ruck, yes | 12:28 |
| weshay|ruck | chandankumar++ | 12:28 |
| chandankumar | weshay|ruck, check jobs are green | 12:28 |
| chandankumar | weshay|ruck, is someone monitoring ceph third party jobs? | 12:29 |
| weshay|ruck | a little bit, probably not ideal tbh | 12:30 |
| chandankumar | weshay|ruck, https://review.rdoproject.org/zuul/builds?project=containers%2Flibpod&pipeline=github-check | 12:30 |
| chandankumar | ok | 12:30 |
| weshay|ruck | http://dashboard-ci.tripleo.org/d/jiglzyLWk/third-party-dependency-check?orgId=1 | 12:30 |
| *** udesale has joined #oooq | 12:34 | |
| migi | weshay|ruck: I am stuck with rhel8 - got downstream job for standalone rhel8 and prepared upstream change to work-around ansible issue, but now dlr is failing to build local packages, before I go and investigate further maybe there is someone who could point me directly to the place where to fix | 12:34 |
| migi | weshay|ruck: logs https://sf.hosted.upshift.rdu2.redhat.com/logs/41/192341/6/check/tripleo-ci-rhel-8-standalone-rhos-17/b87bd21/job-output.txt | 12:34 |
| *** beagles is now known as beagles_pto | 12:35 | |
| migi | weshay|ruck: I have this system on-hold in SF | 12:35 |
| chandankumar | weshay|ruck, build test packages does not support downstream | 12:36 |
| chandankumar | sorry | 12:36 |
| chandankumar | migi, ^^ | 12:36 |
| weshay|ruck | migi, /me looks | 12:37 |
| migi | chandankumar: so what should be *next* steps to get this working? | 12:37 |
| chandankumar | let me check | 12:37 |
| weshay|ruck | migi, we could include arie's rh-pkg role and put in a switch | 12:37 |
| migi | weshay|ruck: there is already a role to build rpm and used in OSP version of SF | 12:38 |
| weshay|ruck | migi, but chandan is correct atm.. build-test-packages only supports changes w/ an upstream spec | 12:38 |
| weshay|ruck | migi, aye.. point that out for me | 12:38 |
| migi | weshay|ruck: checking | 12:38 |
| chandankumar | weshay|ruck, https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/build-test-packages/defaults/main.yml#L6 | 12:38 |
| weshay|ruck | chandankumar, aye.. I know | 12:38 |
| chandankumar | migi, let me find downstream rdoinfo and override that var | 12:38 |
| weshay|ruck | chandankumar, there is a VERY similar ansible role used internal to build from osp packages | 12:39 |
| weshay|ruck | we can include it.. in extra-requirements.. | 12:39 |
| weshay|ruck | and make the required changes | 12:39 |
| migi | weshay|ruck: https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/osp-jobs.git;a=blob;f=playbooks/rdopkg/build.yaml;h=7b91c38f145ce3df37bd583d527792f341f54191;hb=HEAD | 12:39 |
| migi | weshay|ruck: chandankumar: here is the last run of this job https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/osp/build/d8f3e0016e9340ea9d9ab10deaa856b5 | 12:40 |
| weshay|ruck | artg_change_list": [ | 12:40 |
| weshay|ruck | 2020-02-20 07:25:16.730384 | primary | { | 12:40 |
| weshay|ruck | 2020-02-20 07:25:16.730389 | primary | "branch": "master", | 12:40 |
| weshay|ruck | 2020-02-20 07:25:16.730399 | primary | "host": "https://review.opendev.org", | 12:40 |
| weshay|ruck | 2020-02-20 07:25:16.730410 | primary | "project": "openstack/tripleo-ci-internal-jobs", | 12:40 |
| weshay|ruck | 2020-02-20 07:25:16.730415 | primary | "refspec": "refs/changes/41/192341/6" | 12:40 |
| weshay|ruck | 2020-02-20 07:25:16.730418 | primary | }, | 12:40 |
| weshay|ruck | 2020-02-20 07:25:16.730432 | primary | { | 12:40 |
| weshay|ruck | 2020-02-20 07:25:16.730436 | primary | "branch": "master", | 12:40 |
| weshay|ruck | 2020-02-20 07:25:16.730440 | primary | "host": "https://review.opendev.org", | 12:40 |
| weshay|ruck | 2020-02-20 07:25:16.730444 | primary | "project": "tripleo-environments", | 12:40 |
| weshay|ruck | 2020-02-20 07:25:16.730448 | primary | "refspec": "refs/changes/86/192386/1" | 12:40 |
| weshay|ruck | 2020-02-20 07:25:16.730452 | primary | }, | 12:41 |
| weshay|ruck | 2020-02-20 07:25:16.730456 | primary | { | 12:41 |
| weshay|ruck | 2020-02-20 07:25:16.730460 | primary | "branch": "master", | 12:41 |
| weshay|ruck | 2020-02-20 07:25:16.730464 | primary | "host": "https://review.opendev.org", | 12:41 |
| weshay|ruck | 2020-02-20 07:25:16.730468 | primary | "project": "openstack/tripleo-ansible", | 12:41 |
| weshay|ruck | 2020-02-20 07:25:16.730473 | primary | "refspec": "refs/changes/56/708856/1" | 12:41 |
| weshay|ruck | migi, your changes were from upstream | 12:41 |
| weshay|ruck | are you forcing the internal spec file in some way atm? | 12:41 |
| migi | so my change actually is from upstream | 12:41 |
| weshay|ruck | ya | 12:42 |
| chandankumar | migi, https://code.engineering.redhat.com/gerrit/#/c/192337/ but here there is no depends-on | 12:43 |
| weshay|ruck | migi, I don't see the dlr log dir in this job https://sf.hosted.upshift.rdu2.redhat.com/logs/41/192341/6/check/tripleo-ci-rhel-8-standalone-rhos-17/b87bd21/logs/ | 12:43 |
| migi | weshay|ruck: [zuul@upstream-rhel-8-tripleo-ci-0000016085 DLRN]$ ls | 12:44 |
| migi | data projects.ini rdoinfo scripts | 12:44 |
| weshay|ruck | migi, you could just build a repo and pass in https://sf.hosted.upshift.rdu2.redhat.com/logs/37/192337/1/check/osp-rpm-build/d8f3e00/buildset/ | 12:44 |
| migi | weshay|ruck: but I am interested here o nthe rpms from upstream | 12:44 |
| migi | as my change is from opendev | 12:44 |
| chandankumar | migi, https://code.engineering.redhat.com/gerrit/gitweb?p=ospinfo.git;a=summary may be replacing this rdoinfo will work | 12:45 |
| migi | chandankumar: or maybe I should be proposing changes to https://code.engineering.redhat.com/gerrit/gitweb?p=tripleo-ansible.git;a=summary | 12:47 |
| migi | chandankumar: and then build rpm from downstream path ? | 12:48 |
| chandankumar | migi, yes | 12:48 |
| migi | weshay|ruck: ^^ ok but it's also worth noting we could potentially introduce upstream Depends-On for easy workflow upstream first | 12:49 |
| *** rlandy has joined #oooq | 12:51 | |
| chandankumar | migi, so the goal is put a depends-on on downstream review then , that upstream patch will be pulled localy and dlrn will build the package by checking source against downstream code and then fed it to deployment? | 12:51 |
| weshay|ruck | marios|ruck, looking at ur kolla patches | 12:51 |
| weshay|ruck | thank you | 12:51 |
| marios|ruck | chandankumar: https://review.opendev.org/#/c/708846/2/roles/build-containers/tasks/venv_setup.yml going with your suggestion commented there | 12:52 |
| marios|ruck | weshay|ruck: ^^ | 12:52 |
| marios|ruck | weshay|ruck: chandankumar: so lets merge that first then https://review.rdoproject.org/r/#/c/25083/ | 12:52 |
| weshay|ruck | migi, chat for 5min | 12:52 |
| weshay|ruck | ? | 12:52 |
| migi | weshay|ruck: sure | 12:52 |
| * weshay|ruck wants to get a better view | 12:52 | |
| weshay|ruck | migi, https://meet.google.com/fru-kscd-csv?authuser=1 | 12:52 |
| marios|ruck | chandankumar: https://review.rdoproject.org/r/#/c/25100/ | 12:53 |
| chandankumar | marios|ruck, let's first one merges, then I will +w second one | 12:53 |
| marios|ruck | chandankumar: thanks going to fix periodic job definition now | 12:53 |
| weshay|ruck | migi, Error: rhn-plugin: ERROR: can not find RHNS CA file: /usr/share/rhn/RHN-ORG-TRUSTED-SSL-CERT | 12:54 |
| weshay|ruck | https://sf.hosted.upshift.rdu2.redhat.com/logs/41/192341/6/check/tripleo-ci-rhel-8-standalone-rhos-17/b87bd21/logs/delorean_logs/dc/96/dc96ba42d4d288e78250403e51b59936f101acc6_dev/rpmbuild.log.txt.gz | 12:55 |
| weshay|ruck | # /usr/bin/yum --installroot /var/lib/mock/dlrn-rhel8-x86_64-1/root/ --releasever 8 install basesystem rpm-build python3-devel gcc make python3-sqlalchemy python3-sphinx python3-eventlet python3-six python3-pbr openstack-macros git python3-setuptools_scm | 12:55 |
| migi | weshay|ruck: https://review.opendev.org/#/c/708856/ | 12:56 |
| chandankumar | weshay|ruck, in downstream, we override the release file na for rhel8? | 12:56 |
| chandankumar | http://codesearch.openstack.org/?q=%2FRHN-ORG-TRUSTED-SSL-CERT&i=nope&files=&repos= | 12:56 |
| migi | weshay|ruck: http://pastebin.test.redhat.com/837918 | 12:58 |
| migi | weshay|ruck: here is the log https://sf.hosted.upshift.rdu2.redhat.com/logs/41/192341/5/check/tripleo-ci-rhel-8-standalone-rhos-17/9db8810/logs/undercloud/home/zuul/standalone_deploy.log | 13:00 |
| *** sshnaidm has quit IRC | 13:00 | |
| *** sshnaidm has joined #oooq | 13:01 | |
| weshay|ruck | chandankumar, mtg | 13:02 |
| weshay|ruck | zbr, mtg | 13:03 |
| chandankumar | weshay|ruck, coming sir | 13:03 |
| *** marios|ruck is now known as marios|ruck|call | 13:12 | |
| marios|ruck|call | chandankumar: and variable there remote: https://review.rdoproject.org/r/25101 Add buildcontainers_venv: false master centos7 container build | 13:12 |
| *** ysandeep is now known as ysandeep|away | 13:13 | |
| weshay|ruck | https://hackmd.io/5uYRmLaOTI2raTbHWsaiSQ#Spec-for-promoting-promoted-components--gt-tripleo-ci-testing | 13:15 |
| *** ccamacho has joined #oooq | 13:17 | |
| *** jpena|lunch is now known as jpena | 13:24 | |
| *** amoralej|lunch is now known as amoralej | 13:28 | |
| panda | promoter code for aggregate promotion https://review.rdoproject.org/r/#/c/24818/18/ci-scripts/dlrnapi_promoter/dlrn_interface.py@552 | 13:37 |
| weshay|ruck | rfolco, lolz | 13:48 |
| weshay|ruck | there's a faster way | 13:48 |
| marios|ruck|call | weshay|ruck: "review this stuff!" Plata O Plomo | 13:55 |
| zbr | weshay|ruck: re molecule work https://review.opendev.org/#/c/708613/ | 13:55 |
| *** Goneri has joined #oooq | 13:55 | |
| panda | next patch promoters: https://review.rdoproject.org/r/24678 overall promoter patch: https://review.rdoproject.org/r/24818 | 13:56 |
| marios|ruck|call | zbr: google writes your name like 'sauron' | 14:03 |
| marios|ruck|call | are you a black wizard zbr | 14:03 |
| sshnaidm | zbr, https://review.opendev.org/#/c/708808/ | 14:05 |
| weshay|ruck | chandankumar, in | 14:06 |
| *** marios|ruck|call is now known as marios|ruck | 14:06 | |
| zbr | marios|ruck: close enough, bug the color is octarine, not black. | 14:07 |
| rlandy | rfolco: meet about moving bash piece to use ansible? | 14:09 |
| rlandy | I have an idea but let's clear it first | 14:09 |
| *** ysandeep|away is now known as ysandeep | 14:09 | |
| rfolco | rlandy, ok | 14:11 |
| rlandy | rfolco: https://meet.google.com/zrz-ummp-erq | 14:12 |
| marios|ruck | brb | 14:13 |
| *** marios|ruck is now known as marios|ruck|afk | 14:13 | |
| chandankumar | marios|ruck|afk, https://review.rdoproject.org/r/25102 | 14:16 |
| weshay|ruck | marios|ruck|afk, no need to do this atm https://review.rdoproject.org/r/#/c/25049/ | 14:16 |
| weshay|ruck | waste of nodepool nodes | 14:17 |
| chandankumar | marios|ruck|afk, https://review.rdoproject.org/r/25102 | 14:17 |
| chandankumar | weshay|ruck, https://review.rdoproject.org/r/#/c/24835/ | 14:19 |
| *** ykarel|afk is now known as ykarel | 14:23 | |
| *** marios|ruck|afk is now known as marios|ruck | 14:25 | |
| weshay|ruck | sshnaidm, have a few minutes? | 14:25 |
| marios|ruck | 16:16 < weshay|ruck> marios|ruck|afk, no need to do this atm https://review.rdoproject.org/r/#/c/25049/ | 14:25 |
| weshay|ruck | https://meet.google.com/jfx-pwrz-meb?authuser=1 | 14:25 |
| marios|ruck | weshay|ruck: not doing it for promotion | 14:25 |
| sshnaidm | weshay|ruck, yep | 14:25 |
| marios|ruck | weshay|ruck: i think the job has a problem (timeout) | 14:26 |
| weshay|ruck | https://meet.google.com/jfx-pwrz-meb?authuser=1 | 14:26 |
| chandankumar | marios|ruck, if this one https://review.rdoproject.org/r/#/c/25102/ works, it will clear all contianer builds | 14:26 |
| * chandankumar headed home | 14:26 | |
| sshnaidm | weshay|ruck, joined | 14:26 |
| marios|ruck | chandankumar: you mean, instead of https://review.rdoproject.org/r/#/c/25101/ ? | 14:27 |
| marios|ruck | chandankumar: why? | 14:27 |
| marios|ruck | weshay|ruck: you joining? | 14:32 |
| *** jaosorior has joined #oooq | 14:34 | |
| *** sshnaidm is now known as sshnaidm|afk | 14:34 | |
| rlandy | panda: can you join us - we need your opinion ... https://meet.google.com/zrz-ummp-erq | 14:35 |
| panda | rlandy: coming | 14:35 |
| marios|ruck | https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master | 14:42 |
| *** marios|ruck is now known as marios|ruck|call | 14:42 | |
| weshay|ruck | marios|ruck|call, ya.. cockpit just went down | 14:48 |
| weshay|ruck | it will heal itself in a few | 14:48 |
| weshay|ruck | marios|ruck|call, https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/ | 14:49 |
| *** TrevorV has joined #oooq | 14:54 | |
| mjturek | rfolco: the x86_64 centos7 container build jobs are also seeing what we're seeing https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-master-containers-build-push/e2ac434/logs/build.log | 14:55 |
| rfolco | mjturek, so we are on the same boat | 14:55 |
| mjturek | so are centos7 containers getting dropped? | 14:55 |
| rfolco | weshay|ruck, marios|ruck|call ^ | 14:55 |
| rfolco | mjturek, don't know | 14:56 |
| mjturek | if we need to go to centos8 now, we're at a road block | 14:56 |
| weshay|ruck | mjturek, in ussuri when centos-8 is fully up yes.. if you have a need to continue on centos-7 given the situation w/ ci.centos / cico etc.. | 14:56 |
| weshay|ruck | I can raise that.. | 14:56 |
| mjturek | weshay|ruck: okay fair enough - raise it where exactly? | 14:57 |
| weshay|ruck | mjturek, we have these silly things called the prod-chain-council | 14:59 |
| mjturek | ooo sounds fancy | 14:59 |
| weshay|ruck | mjturek, can you please summarize your current fucked situation in an email or etherpad and share it with me | 14:59 |
| weshay|ruck | so I can represent your fun to the rest of the team | 15:00 |
| mjturek | absolutely weshay|ruck | 15:00 |
| chandankumar | marios|ruck|call, I was testing config changes there and tried for all branches | 15:01 |
| weshay|ruck | zbr, send me your patches :) | 15:09 |
| mjturek | weshay|ruck: sufficient? https://etherpad.openstack.org/p/ppc64le-container-build-situation | 15:11 |
| chandankumar | rfolco, rlandy weshay|ruck https://review.opendev.org/#/c/707338 ceph repo from storage sigs | 15:14 |
| mjturek | weshay|ruck: let me know if there are any meetings you'd like me to join | 15:14 |
| chandankumar | marios|ruck|call, it passed here https://review.rdoproject.org/r/#/c/25102/ | 15:17 |
| chandankumar | venv disable | 15:17 |
| zbr | weshay|ruck: i need https://review.opendev.org/#/c/708613/ | 15:17 |
| chandankumar | marios|ruck|call, let me know when to merge it https://review.rdoproject.org/r/25101 | 15:31 |
| *** marios|ruck|call is now known as marios|ruck | 15:40 | |
| marios|ruck | chandankumar: ack lets try to sell it for few mins | 15:41 |
| marios|ruck | weshay|ruck: panda: sshnaidm|afk: rlandy: rfolco: please vote there https://review.rdoproject.org/r/#/c/25101/ Add buildcontainers_venv: false master centos7 container build Related-Bug: https://bugs.launchpad.net/tripleo/+bug/1864018 | 15:41 |
| openstack | Launchpad bug 1864018 in tripleo "periodic master container build fails ImportError: No module named queue" [Critical,Triaged] | 15:41 |
| marios|ruck | chandankumar: hold on don't we ned that first https://review.rdoproject.org/r/#/c/25100/ | 15:42 |
| chandankumar | marios|ruck, it is not needed, as c8 already built python3 stuff which cannot be removed | 15:43 |
| chandankumar | marios|ruck, https://review.rdoproject.org/r/#/c/25114/ | 15:43 |
| chandankumar | revert is here | 15:43 |
| *** sshnaidm|afk is now known as sshnaidm | 15:43 | |
| *** jfrancoa has quit IRC | 15:44 | |
| marios|ruck | chandankumar: oook... so unblocking then https://review.rdoproject.org/r/#/c/25101/ | 15:46 |
| chandankumar | marios|ruck, commented on review also | 15:47 |
| chandankumar | please someone hit +w button also | 15:48 |
| marios|ruck | chandankumar: thanks | 15:48 |
| chandankumar | rlandy, https://review.rdoproject.org/r/#/c/25101/ +w it | 15:50 |
| rlandy | done | 15:50 |
| chandankumar | marios|ruck, next run will be happy | 15:51 |
| chandankumar | i mean container build | 15:51 |
| chandankumar | no idea about others | 15:51 |
| marios|ruck | thanks chandankumar ykarel | 15:51 |
| marios|ruck | chandankumar:++ thanks for your help on this today | 15:51 |
| marios|ruck | weshay|ruck: can we get extra rum for chandankumar please ^^ | 15:51 |
| chandankumar | marios|ruck, :-) | 15:52 |
| weshay|ruck | there's always rum for chandankumar | 15:54 |
| chandankumar | weshay|ruck, I am trying to avoid rum or beer for few months due to upcoming Ladakh trekk | 15:55 |
| marios|ruck | thanks rlandy merged | 15:55 |
| *** ratailor has joined #oooq | 15:56 | |
| *** bogdando has quit IRC | 15:57 | |
| panda | zbr: what's the safest release to use molecule at this moment ? | 15:57 |
| zbr | panda: 3.0.0 is working fine, https://github.com/ansible-community/molecule/issues/2560 | 15:58 |
| panda | ModuleNotFoundError: No module named 'molecule_containers.driver | 15:59 |
| marios|ruck | folks I will be out tomorrow morning from around 730 UTC for an appointment i'll email pcci in a sec (should be done about 1/1.5 hours) | 16:02 |
| marios|ruck | weshay|ruck: ^^ | 16:02 |
| *** TrevorV has quit IRC | 16:04 | |
| *** rfolco is now known as rfolco|doctor | 16:04 | |
| *** ykarel is now known as ykarel|afk | 16:05 | |
| *** jpena is now known as jpena|off | 16:07 | |
| rlandy | rfolco|doctor: https://review.rdoproject.org/r/#/c/25069/ updated | 16:08 |
| rlandy | pls ping when you get back so we can review | 16:08 |
| rlandy | panda: ^^ bash gone - modularized | 16:09 |
| * rlandy tests now | 16:09 | |
| panda | rlandy: \o/ working with folco for the local tests. | 16:10 |
| rlandy | panda: still a lot if testing to do here | 16:12 |
| panda | rlandy: yes | 16:20 |
| rlandy | I don't see any molecule tests run for get-hash | 16:21 |
| panda | rlandy: they are run atuomatically in rdo-tox-molecule | 16:22 |
| panda | rlandy: e.g. https://logserver.rdoproject.org/26/25026/13/check/rdo-tox-molecule/a626ed4/tox/reports.html | 16:22 |
| weshay|ruck | zbr, does molecule normally rev versions this quickly? | 16:23 |
| panda | rlandy: but yeah, there's work to do, hope rfolco|doctor will come back soon | 16:23 |
| zbr | weshay|ruck: is considerably less often than ansible itself, look at https://pypi.org/project/molecule/#history | 16:25 |
| zbr | previous release was in 2019-08 | 16:26 |
| *** jfrancoa has joined #oooq | 16:30 | |
| *** ccamacho has quit IRC | 16:32 | |
| panda | zbr: do you think it's bad to install ansible in the nodes that run tox jobs in zuul ? | 16:32 |
| weshay|ruck | zbr, sshnaidm as you can please review https://review.rdoproject.org/r/#/c/24678/ | 16:32 |
| chandankumar | rlandy, tomorrow I will lay down reviews for ovb jobs parenting with c8 | 16:32 |
| rlandy | chandankumar: cool - chat then | 16:33 |
| sshnaidm | weshay|ruck, ack | 16:33 |
| weshay|ruck | panda, this is coming in a later patch I guess | 16:34 |
| weshay|ruck | elif self.config.pipeline_type == "component": | 16:34 |
| weshay|ruck | self.log.error("Component pipeline ci votes information is not yet " | 16:34 |
| weshay|ruck | "available") | 16:34 |
| weshay|ruck | https://review.rdoproject.org/r/#/c/24678/28/ci-scripts/dlrnapi_promoter/dlrn_interface.py | 16:35 |
| panda | weshay|ruck: yes, but in a different form, maybe we should review the steps one more time, no surprises. | 16:36 |
| marios|ruck | weshay|ruck: starting shutdown sequence did you need something | 16:36 |
| weshay|ruck | panda, cool.. thank you | 16:37 |
| weshay|ruck | marios|ruck, anything to hand off re: container-build fails? | 16:37 |
| weshay|ruck | all in the pad I guess | 16:37 |
| marios|ruck | weshay|ruck: should be cleared after https://review.rdoproject.org/r/#/c/25101/ | 16:38 |
| weshay|ruck | marios|ruck, hrm.. which reviews are critical.. the 3 in the bug comment#4? | 16:38 |
| marios|ruck | weshay|ruck: ish let me update with another comment sec | 16:39 |
| weshay|ruck | marios|ruck, k.. please just make that clear in the etherpad for me | 16:39 |
| weshay|ruck | thanks | 16:39 |
| marios|ruck | weshay|ruck: yeah sure | 16:39 |
| weshay|ruck | zbr, you have any suggestions on https://review.opendev.org/#/c/708264/ /me is failing here.. could use ur eyes when you have a sec | 16:41 |
| weshay|ruck | queens issue | 16:41 |
| marios|ruck | chandankumar: why did we revert https://review.rdoproject.org/r/#/c/25114/ though? i though we still wanted to pin the package? | 16:41 |
| zbr | weshay|ruck: replied, i seen a missing sudo | 16:43 |
| chandankumar | marios|ruck, so that c8 dlrn will keep building the packages | 16:43 |
| weshay|ruck | zbr, in install deps? | 16:43 |
| marios|ruck | chandankumar: but then do we need to constrain the package version for centos7 some other way | 16:43 |
| weshay|ruck | zbr, look more closely at the error | 16:43 |
| zbr | yeah, but it may be ok there. | 16:43 |
| marios|ruck | chandankumar: like we are saying 'use package' but we dont constrain it now | 16:43 |
| marios|ruck | chandankumar: i mean if we revert the pin | 16:44 |
| zbr | weshay|ruck: I am not a big fun of we install pip there, there is a reason why there is a get-pip, https://pip.pypa.io/en/stable/installing/ | 16:45 |
| chandankumar | marios|ruck, same rdoinfo is shared for both c7 and c8 master, unpinning will help to keep building kolla packages, it will allow the flow for centos7 pipeline what is coming from tripleo-ci-testing repo | 16:45 |
| zbr | what I would do: "verify is missing or old" or use get-pip. | 16:45 |
| marios|ruck | chandankumar: weshay|ruck: https://bugs.launchpad.net/tripleo/+bug/1864018/comments/6 | 16:47 |
| openstack | Launchpad bug 1864018 in tripleo "periodic master container build fails ImportError: No module named queue" [Critical,Triaged] | 16:47 |
| weshay|ruck | zbr, in install deps? ya.. I don't see how install-deps is related to the queens isuse | 16:47 |
| weshay|ruck | it works in all builds but queens? | 16:47 |
| * weshay|ruck finds that suspect... | 16:47 | |
| zbr | haha! i know zipp fix | 16:48 |
| weshay|ruck | see.. I knew zbr would know | 16:48 |
| zbr | weshay|ruck: https://github.com/ansible-community/molecule/blob/master/tools/test-setup.sh#L11 | 16:49 |
| zbr | in fact it was pabelanger that showed m. | 16:49 |
| *** dtantsur is now known as dtantsur|afk | 16:51 | |
| *** TrevorV has joined #oooq | 16:51 | |
| *** jaosorior has quit IRC | 16:55 | |
| *** tesseract has quit IRC | 17:00 | |
| chandankumar | arxcruz, kopecmartin soniya29 I am shifting tempest meeting 30 mins earlier and reducing it to 30 mins? as it collides with other meetings | 17:03 |
| chandankumar | weshay|ruck, ^^ | 17:03 |
| weshay|ruck | k | 17:04 |
| * marios|ruck locks door 'yeah, well now you cant leave' | 17:04 | |
| soniya29 | chandankumar, sure | 17:04 |
| *** marios|ruck is now known as marios|out | 17:04 | |
| *** ratailor has quit IRC | 17:10 | |
| rlandy | rfolco|doctor: panda: ok - https://review.rdoproject.org/r/#/c/25069/ works for me now in local testing | 17:10 |
| rlandy | (env) [rlandy@localhost temp]$ ls | grep _hash_info.sh | 17:11 |
| rlandy | baremetal_hash_info.sh | 17:11 |
| rlandy | cinder_hash_info.sh | 17:11 |
| rlandy | clients_hash_info.sh | 17:11 |
| rlandy | cloudops_hash_info.sh | 17:11 |
| rlandy | common_hash_info.sh | 17:11 |
| rlandy | compute_hash_info.sh | 17:11 |
| rlandy | glance_hash_info.sh | 17:11 |
| rlandy | manila_hash_info.sh | 17:11 |
| * weshay|ruck likes it | 17:11 | |
| rlandy | network_hash_info.sh | 17:11 |
| rlandy | octavia_hash_info.sh | 17:11 |
| rlandy | security_hash_info.sh | 17:11 |
| rlandy | swift_hash_info.sh | 17:11 |
| rlandy | tempest_hash_info.sh | 17:11 |
| rlandy | tripleo_hash_info.sh | 17:11 |
| rlandy | ui_hash_info.sh | 17:11 |
| rlandy | oops | 17:11 |
| rlandy | no bash | 17:11 |
| *** chem has quit IRC | 17:21 | |
| *** marios|out has quit IRC | 17:25 | |
| *** jpena|off is now known as jpena | 17:27 | |
| *** chem has joined #oooq | 17:28 | |
| weshay|ruck | rlandy, should we give it a go? | 17:28 |
| weshay|ruck | merge / test party? | 17:28 |
| rlandy | weshay|ruck: https://review.rdoproject.org/r/#/c/25069/? | 17:28 |
| rlandy | waiting for rfolco|doctor | 17:28 |
| weshay|ruck | and https://review.rdoproject.org/r/#/c/25075/ | 17:28 |
| weshay|ruck | meh | 17:28 |
| weshay|ruck | rlandy, he's definatley going to die | 17:29 |
| rlandy | he's the main tester/approve on this | 17:29 |
| weshay|ruck | k | 17:29 |
| rlandy | die? how so? | 17:29 |
| weshay|ruck | well we all die ronelle. | 17:29 |
| rlandy | well, that is a true statement | 17:29 |
| rlandy | how about we waiting 30 mins - then merge? | 17:31 |
| *** jfrancoa has quit IRC | 17:31 | |
| *** udesale has quit IRC | 17:33 | |
| weshay|ruck | rlandy, let's go now | 17:42 |
| weshay|ruck | rlandy, read rdo-list then come back here | 17:42 |
| rlandy | reading | 17:43 |
| rlandy | weshay|ruck: back | 17:46 |
| rlandy | weshay|ruck: the tenant usage? | 17:46 |
| weshay|ruck | no | 17:46 |
| weshay|ruck | [rdo-dev] Status of RDO Trunk Ussuri on CentOS 7 and transition to CentOS 8 | 17:46 |
| rlandy | weshay|ruck: ok - we need to go | 17:48 |
| rlandy | weshay|ruck: merging - let's try this | 17:49 |
| rlandy | revert is always an option | 17:50 |
| weshay|ruck | yup | 17:50 |
| weshay|ruck | rlandy, ping me w/a testproject | 17:50 |
| weshay|ruck | oh wait | 17:50 |
| weshay|ruck | we have one | 17:50 |
| weshay|ruck | https://review.rdoproject.org/r/#/c/25064/ | 17:50 |
| rlandy | yo have containter build one | 17:50 |
| weshay|ruck | it has the promote in there too | 17:51 |
| weshay|ruck | rlandy, https://review.rdoproject.org/r/#/c/25064/4/.zuul.yaml | 17:51 |
| rlandy | weshay|ruck: sshnaidm -2'ed ( https://review.opendev.org/708735 ) | 17:51 |
| rlandy | it didn't work for me w/o that file | 17:52 |
| weshay|ruck | we'll see | 17:52 |
| rlandy | but hey - I can always add the vars to my job | 17:52 |
| rlandy | so I am not out of the water on it | 17:52 |
| * rlandy gets testproject with vars | 17:52 | |
| weshay|ruck | sshnaidm, ^ context on the -2 | 17:52 |
| sshnaidm | rlandy, weshay|ruck it should be loaded with ansible_os_family as "redhat" | 17:52 |
| weshay|ruck | maybe a softlink? | 17:53 |
| sshnaidm | for all redhat based machines | 17:53 |
| weshay|ruck | did it change to family | 17:53 |
| rlandy | https://review.rdoproject.org/r/#/c/24995/11/.zuul.yaml | 17:53 |
| rlandy | I needed those vars in my job | 17:53 |
| rlandy | ie; on centos8, it did not read them by default | 17:54 |
| rlandy | weshay|ruck: too soon on recheck https://review.rdoproject.org/r/#/c/25069/ not merged yet | 17:55 |
| weshay|ruck | bah | 17:55 |
| sshnaidm | it should be loaded in this step: https://github.com/openstack/tripleo-ansible/blob/master/tripleo_ansible/roles/tripleo_podman/tasks/main.yml#L31:L31 | 17:55 |
| sshnaidm | rlandy, do you have logs? | 17:55 |
| rlandy | sshnaidm: you get an error that login does not work ... https://logserver.rdoproject.org/95/24995/7/check/periodic-tripleo-ci-centos-8-standalone-security-master/23752ab/job-output.txt | 17:57 |
| rlandy | panda pointed that it relates to podman not being installed | 17:57 |
| rlandy | with the vars defined, works | 17:57 |
| sshnaidm | rlandy, with vars defined in job? | 17:59 |
| rlandy | yes | 17:59 |
| sshnaidm | rlandy, I don't think this patch would help you anyway | 17:59 |
| rlandy | https://review.rdoproject.org/r/#/c/25069/ merged | 17:59 |
| sshnaidm | rlandy, let's see playbooks/tripleo-rdo-base/container-login.yaml | 17:59 |
| rlandy | it includes the podman install now | 17:59 |
| sshnaidm | rlandy, here is the install: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-rdo-base/container-login.yaml#L34:L34 | 18:01 |
| sshnaidm | rlandy, and this is only file that runs: https://github.com/openstack/tripleo-ansible/blob/master/tripleo_ansible/roles/tripleo_podman/tasks/tripleo_podman_install.yml | 18:01 |
| sshnaidm | rlandy, loading vars is not included in this file | 18:01 |
| sshnaidm | rlandy, so this patch won't help | 18:02 |
| *** derekh has quit IRC | 18:02 | |
| sshnaidm | rlandy, you need to pass these vars to this including: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-rdo-base/container-login.yaml#L34:L34 | 18:02 |
| rlandy | sshnaidm: ok - so I can include vars or keep the vars in the patch | 18:03 |
| rlandy | in the job | 18:03 |
| sshnaidm | rlandy, either | 18:03 |
| sshnaidm | rlandy, maybe we can even pass them in the task itself, why not.. https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-rdo-base/container-login.yaml#L34:L34 | 18:04 |
| rlandy | weshay|ruck: ha .. periodic-tripleo-centos-8-master-promote-promoted-components-to-tripleo-ci-testing success | 18:05 |
| weshay|ruck | rlandy, look at that :) | 18:05 |
| rlandy | weshay|ruck: did it do the right thing?? | 18:05 |
| weshay|ruck | rlandy, https://trunk.rdoproject.org/centos8-master/ | 18:05 |
| rlandy | think so | 18:06 |
| weshay|ruck | rock on !!! | 18:06 |
| rlandy | lol | 18:06 |
| rlandy | shot in the dark | 18:06 |
| weshay|ruck | now.. next step.. the containers are built and tagged w/ the md5 build_id aggregated_hash | 18:06 |
| weshay|ruck | rlandy++ | 18:06 |
| weshay|ruck | I would call that a bullseye | 18:07 |
| rlandy | ugh - we have no log collection there | 18:07 |
| rlandy | we don;t pick up the component_hash_info.sh files | 18:07 |
| weshay|ruck | rlandy, you can probably steal the post from conatiners-build | 18:07 |
| weshay|ruck | just add the files you need | 18:07 |
| weshay|ruck | or overcloud-image build | 18:08 |
| rlandy | conatiners build hasn't finished yet | 18:08 |
| weshay|ruck | ya.. | 18:08 |
| weshay|ruck | I mean for hte promote promoted-comoponents -> tripleo-ci-testing to pick up the .sh files you want | 18:08 |
| rlandy | then we need to promote to current-tripleo | 18:09 |
| rlandy | yes | 18:09 |
| *** holser has quit IRC | 18:09 | |
| weshay|ruck | rlandy, /me thinks there's a pretty good chance container build will fail | 18:09 |
| weshay|ruck | on building the containers | 18:09 |
| weshay|ruck | new hash | 18:09 |
| weshay|ruck | a lot of new content | 18:09 |
| weshay|ruck | we'll have to debug and cix | 18:09 |
| rlandy | weshay|ruck: I want to see that the job at least gets the right hash | 18:10 |
| rlandy | ie: md5 sum | 18:10 |
| rlandy | and uses that | 18:10 |
| * weshay|ruck grabs food while this runs | 18:10 | |
| sshnaidm | arxcruz, is tempestmail machine used? | 18:11 |
| sshnaidm | rfolco|doctor, please collect all you need from tripleo-infra boxes like taigacli, etc | 18:11 |
| weshay|ruck | sshnaidm, no need to focus on that.. shouldn't fail jobs | 18:12 |
| sshnaidm | weshay|ruck, it's not me that focus om that :D | 18:12 |
| weshay|ruck | k ;) | 18:13 |
| chandankumar | see ya tomorrow | 18:14 |
| *** chandankumar is now known as raukadah | 18:14 | |
| rlandy | weshay|ruck: hmmm .. so containers build job also creates the component_hash_info files ... which may not be a bad thing - traceability | 18:17 |
| rlandy | we could switch case that | 18:18 |
| weshay|ruck | oh.. that's good | 18:20 |
| rlandy | weshay|ruck: yeah - it's unnecessary - can follow up patch to only run that on promotions | 18:21 |
| rlandy | ie: when promote_source is promoted_components etc. | 18:22 |
| rlandy | anyways - still going | 18:22 |
| weshay|ruck | you can also just see it in the console | 18:22 |
| weshay|ruck | rlandy, say a little prayer please | 18:23 |
| rlandy | weshay|ruck: three times a day | 18:23 |
| weshay|ruck | dam | 18:23 |
| rlandy | :( | 18:23 |
| weshay|ruck | hashem does not believe in containerized workloads | 18:24 |
| weshay|ruck | rlandy, we could revert to the last tripleo-ci-testing | 18:24 |
| rlandy | weshay|ruck; the last dlrn report is wrong | 18:24 |
| rlandy | let's chat | 18:25 |
| rlandy | it reported to the ui component | 18:25 |
| weshay|ruck | https://meet.google.com/enk-oqqd-fyp?authuser=1 | 18:25 |
| *** jpena is now known as jpena|off | 18:34 | |
| *** ykarel|afk is now known as ykarel|away | 18:34 | |
| *** amoralej is now known as amoralej|off | 18:36 | |
| weshay|ruck | rlandy, if we need to roll back.. I think this is the set http://paste.openstack.org/show/789809/ | 18:48 |
| rlandy | weshay|ruck: one sec - let me patch and we can rerun | 18:48 |
| weshay|ruck | rlandy, no need | 18:50 |
| weshay|ruck | unless to check the report status dlrn | 18:50 |
| rlandy | https://review.rdoproject.org/r/25119 Move component hash creation after main hash_info | 18:53 |
| rlandy | weshay|ruck: ^^ | 18:53 |
| rlandy | that should fix the hash_info.sh | 18:53 |
| rlandy | we still need to fix report to dlrn | 18:54 |
| rlandy | to take aggrigate | 18:54 |
| weshay|ruck | aye.. | 18:54 |
| *** saneax has quit IRC | 18:55 | |
| weshay|ruck | rlandy, hrm.. local build did not fail on | 18:56 |
| weshay|ruck | Stderr: 'error building at STEP "RUN dnf -y install ca-certificates curl findutils iproute iscsi-initiator-utils lvm2 ncurses procps-ng socat sudo tar which python3 util-linux-user cronie crudini dumb-init openstack-tripleo-common-container-base puppet-tripleo rsync iptables-services && dnf clean all && rm -rf /var/cache/dnf": error while running runtime: exit status 1\n' | 18:56 |
| weshay|ruck | same hashes etc. | 18:56 |
| rlandy | sec adding ag_hash | 18:57 |
| weshay|ruck | ya.. base container worked | 18:57 |
| weshay|ruck | so maybe that's a fluke fail | 18:57 |
| weshay|ruck | hash info is in https://logserver.rdoproject.org/64/25064/4/check/periodic-tripleo-centos-8-master-containers-build-push/3d73f20/logs/ | 19:02 |
| rlandy | weshay|ruck: ok - pls review https://review.rdoproject.org/r/#/c/25119/ | 19:09 |
| rlandy | weshay|ruck: something like https://review.rdoproject.org/r/25120 Allow dlrn reporting with arg hash | 19:14 |
| rlandy | need to chat with j parker for a few | 19:14 |
| rlandy | will fix | 19:14 |
| *** rlandy is now known as rlandy|mtg | 19:16 | |
| weshay|ruck | all eyes on http://zuul.openstack.org/builds?job_name=tripleo-build-containers-centos-8 | 19:21 |
| weshay|ruck | for build failures or new passes.. new hash in play | 19:22 |
| weshay|ruck | rlandy|mtg, we could change the job now to use current-tripleo in check | 19:22 |
| weshay|ruck | that would save the day | 19:22 |
| * weshay|ruck shuts up | 19:22 | |
| weshay|ruck | in mtg | 19:22 |
| weshay|ruck | 2020-02-20 19:27:01 | ============= SUMMARY =============== | 19:30 |
| weshay|ruck | 2020-02-20 19:27:01 | Expected................... 126 | 19:30 |
| weshay|ruck | 2020-02-20 19:27:01 | Built...................... 126 | 19:30 |
| weshay|ruck | 2020-02-20 19:27:01 | ===================================== | 19:30 |
| weshay|ruck | 2020-02-20 19:27:01 | | 19:30 |
| weshay|ruck | locally ^ | 19:30 |
| weshay|ruck | going to fix https://opendev.org/openstack/python-tripleoclient/src/branch/master/tripleoclient/v1/container_image.py#L197 | 19:30 |
| *** rlandy|mtg is now known as rlandy | 19:34 | |
| rlandy | weshay|ruck: back | 19:34 |
| rlandy | where are we now? | 19:34 |
| weshay|ruck | rlandy, hi.. so the build w/ these hashes worked locally | 19:35 |
| weshay|ruck | rlandy, so let's get ur changes in and retry | 19:35 |
| rlandy | weshay|ruck: k - merging https://review.rdoproject.org/r/#/c/25119/ | 19:35 |
| weshay|ruck | rlandy, also going to get better logging on this crap | 19:35 |
| weshay|ruck | talking to Evilien | 19:36 |
| weshay|ruck | rlandy, if the ci w/ these hashes is broken.. we'll see it here http://zuul.openstack.org/builds?job_name=tripleo-build-containers-centos-8 | 19:36 |
| * weshay|ruck notes the check jobs are running w/ tripleo-ci-testing | 19:36 | |
| rlandy | let me fix https://review.rdoproject.org/r/#/c/25120/ | 19:36 |
| weshay|ruck | which I'll go put up a change for | 19:36 |
| weshay|ruck | http://zuul.openstack.org/builds?job_name=tripleo-build-containers-centos-8 | 19:38 |
| weshay|ruck | oops | 19:38 |
| rlandy | actually maybe this is ok ... | 19:39 |
| weshay|ruck | http://zuul.openstack.org/builds?job_name=tripleo-build-containers-centos-8 | 19:39 |
| rlandy | weshay|ruck: pls review https://review.rdoproject.org/r/#/c/25120/ | 19:39 |
| weshay|ruck | errrr | 19:39 |
| weshay|ruck | https://review.opendev.org/708956 | 19:39 |
| weshay|ruck | trade u | 19:39 |
| rlandy | ok | 19:39 |
| weshay|ruck | rlandy, worth a shot | 19:39 |
| rlandy | weshay|ruck: k - let's try | 19:40 |
| weshay|ruck | rlandy, ready when you are to retrigger | 19:40 |
| rlandy | weshay|ruck: not yet - let them merge | 19:40 |
| weshay|ruck | stupid protected repos | 19:41 |
| weshay|ruck | I DON"T FEEL SAFE | 19:41 |
| rlandy | trigger happy?? | 19:41 |
| rlandy | it's all in your head | 19:41 |
| rlandy | the world is a perfectly safe place | 19:41 |
| rlandy | weshay|ruck: go, go | 19:43 |
| rlandy | you run away? | 19:47 |
| weshay|ruck | rlandy, oh | 19:49 |
| weshay|ruck | sorry .. other fires | 19:49 |
| weshay|ruck | rlandy, and we're off | 19:49 |
| rlandy | weshay|ruck: wait - get rid of depends-on | 19:50 |
| rlandy | guess it doesn't matter | 19:50 |
| rlandy | I abandoned it | 19:50 |
| rlandy | ok - here we go | 19:51 |
| weshay|ruck | rlandy, we may want to turn off all third party check jobs | 19:54 |
| weshay|ruck | to run the component pipeline based on that email | 19:55 |
| weshay|ruck | or else bugs are going to pile up | 19:55 |
| weshay|ruck | wdyt | 19:55 |
| rlandy | idk - let's see how far we get | 19:55 |
| weshay|ruck | k | 19:55 |
| rlandy | https://logserver.rdoproject.org/64/25064/5/check/periodic-tripleo-centos-8-master-promote-promoted-components-to-tripleo-ci-testing/e46c429/ | 19:56 |
| rlandy | we really need to collect files here | 19:56 |
| rlandy | here we go | 19:56 |
| rlandy | if things work out, we can run the component pipeline through the night | 19:57 |
| rlandy | ugh - fixing | 20:12 |
| *** jfrancoa has joined #oooq | 20:20 | |
| weshay|ruck | rlandy, 2020-02-20 20:09:59.242924 | primary | /home/zuul/src/review.rdoproject.org/config/ci-scripts/tripleo-upstream/dlrnapi_report.sh: line 8: conditional binary operator expected | 20:21 |
| weshay|ruck | rlandy, build also failed | 20:21 |
| rlandy | weshay|ruck: https://review.rdoproject.org/r/#/c/25122/1/ci-scripts/tripleo-upstream/dlrnapi_report.sh | 20:22 |
| rlandy | fixed | 20:22 |
| rlandy | echo --url https://trunk.rdoproject.org/api-centos8-master-uc report-result --agg-hash d15d61afc27948b715fc611aa20636dd --job-id --info-url / --timestamp 1582230111 --success true | 20:22 |
| weshay|ruck | rlandy, does that if statement work locally for you? | 20:22 |
| rlandy | ^^ pasted | 20:22 |
| rlandy | testing other hash - sec | 20:23 |
| weshay|ruck | ya.. worked for me locally | 20:23 |
| weshay|ruck | merged | 20:23 |
| rlandy | thanks | 20:26 |
| rlandy | weshay|ruck: what do you want to do about the build? | 20:26 |
| rlandy | hash is better now | 20:26 |
| weshay|ruck | not sure.. can't repro locally | 20:29 |
| weshay|ruck | I can show you what I'm doing to double check it | 20:29 |
| weshay|ruck | rlandy, still have a setup.. from https://hackmd.io/cv1483MkQlS8UsnteNyXqg | 20:29 |
| weshay|ruck | cleaned all images | 20:29 |
| weshay|ruck | re-ran pre.. | 20:29 |
| weshay|ruck | have the same yum repos | 20:29 |
| weshay|ruck | no failure | 20:30 |
| weshay|ruck | also updated all the src repos | 20:30 |
| rlandy | ok | 20:30 |
| rlandy | so push those? | 20:30 |
| rlandy | and tag current-tripleo? | 20:30 |
| weshay|ruck | I guess | 20:30 |
| weshay|ruck | would rather see the job working tbh | 20:31 |
| weshay|ruck | but yes | 20:31 |
| weshay|ruck | that's an option | 20:31 |
| weshay|ruck | I don't know how to push tbh | 20:31 |
| rlandy | k - going to kick standalone component . it will fail but I want to see it gets as far as it should | 20:31 |
| rlandy | weshay|ruck: can we do anything else in parallel? | 20:32 |
| weshay|ruck | rlandy, looks like rfolco|doctor died | 20:34 |
| weshay|ruck | so.. I guess we need to learn how to push | 20:34 |
| rlandy | well, let's learn how to do this | 20:35 |
| rlandy | poor rfolco|doctor doctor | 20:35 |
| * weshay|ruck pours a little out for a homie rfolco|doctor | 20:35 | |
| weshay|ruck | rlandy, u all merged? | 20:38 |
| weshay|ruck | need to recheck one more time to show some folks | 20:38 |
| rlandy | weshay|ruck: everything I have is in - minus working doing to stagger component pipeline | 20:39 |
| rlandy | 2020-02-20 20:43:16.223431 | primary | ERROR! Unable to retrieve file contents | 20:46 |
| rlandy | 2020-02-20 20:43:16.223458 | primary | Could not find or access '/home/zuul/workspace/.quickstart/config/release/tripleo-ci/CentOS-8/master.yml' on the Ansible Controller. | 20:46 |
| rlandy | weshay|ruck: ^^ | 20:46 |
| rlandy | I guess we know what's next | 20:46 |
| rlandy | https://logserver.rdoproject.org/95/24995/11/check/periodic-tripleo-ci-centos-8-standalone-security-master/bcff32c/ | 20:47 |
| rlandy | reports to dlrn correctly | 20:47 |
| * rlandy builds release files | 20:48 | |
| weshay|ruck | hrm | 20:57 |
| weshay|ruck | where? | 20:57 |
| weshay|ruck | https://review.rdoproject.org/zuul/stream/b2f419b9e8064babbc8f947042918650?logfile=console.log | 20:57 |
| weshay|ruck | OH | 20:58 |
| weshay|ruck | rlandy++ | 20:58 |
| weshay|ruck | oh that's the standalone job | 20:59 |
| weshay|ruck | ya | 20:59 |
| rlandy | weshay|ruck: for the md5 of the baseos image ... https://cloud.centos.org/centos/8/x86_64/images/ do we just download the image and run md5 or is there an official md5 | 21:02 |
| weshay|ruck | aye | 21:03 |
| weshay|ruck | baseos image | 21:03 |
| weshay|ruck | talking ovb? | 21:03 |
| *** TrevorV has quit IRC | 21:03 | |
| rlandy | baremetal | 21:04 |
| rlandy | in the release file | 21:04 |
| rlandy | nvm - calculated it | 21:05 |
| *** jfrancoa has quit IRC | 21:06 | |
| weshay|ruck | this works fine locally | 21:07 |
| weshay|ruck | Command: sudo buildah bud --format docker --tls-verify=False --logfile /tmp/kolla-cxf9jq_0/docker/base/base-build.log -t trunk.registry.rdoproject.org/tripleomaster/centos-binary-base:a1bd02d30481c514e0a16c6d6ce5ea458f7d1001_750cce02 /tmp/kolla-cxf9jq_0/docker/base | 21:07 |
| weshay|ruck | 2020-02-20 20:56:42 | Exit code: 1 | 21:07 |
| rlandy | will look in a few - just submitting release files | 21:08 |
| weshay|ruck | https://bugs.launchpad.net/tripleo/+bug/1864108 | 21:10 |
| openstack | Launchpad bug 1864108 in tripleo "centos-8 container builds fail in promotion on base container" [Critical,Triaged] | 21:10 |
| weshay|ruck | rlandy, trying w/ https://review.opendev.org/708967 | 21:15 |
| rlandy | https://review.opendev.org/708968 Add release file for master CentOS 8 | 21:19 |
| rlandy | weshay|ruck: ^^ will check these with raukadah tomorrow | 21:19 |
| rlandy | I am not sure about the repo links | 21:19 |
| weshay|ruck | k | 21:22 |
| rlandy | weshay|ruck: need help with container stuff? | 21:23 |
| *** Goneri has quit IRC | 21:25 | |
| *** jbadiapa has quit IRC | 21:31 | |
| weshay|ruck | rlandy, now I see the error https://logserver.rdoproject.org/64/25064/6/check/periodic-tripleo-centos-8-master-containers-build-push/3550d66/logs/buildah-builds/kolla-zyg2howw/docker/base/base-build.log | 21:42 |
| weshay|ruck | rlandy, for some reason the base container does not have the dlrn repos on it | 21:43 |
| * rlandy looks | 21:45 | |
| rlandy | weshay|ruck: how did that build before then? | 21:45 |
| weshay|ruck | rlandy, and continues to build http://zuul.openstack.org/builds?job_name=tripleo-build-containers-centos-8 | 21:48 |
| weshay|ruck | rlandy, we could bring back the centos-8 Dockerfile | 21:49 |
| weshay|ruck | https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/build-containers/templates/Dockerfile.j2 | 21:49 |
| rlandy | yep - all nice and green | 21:49 |
| rlandy | rhel-8 | 21:50 |
| weshay|ruck | rlandy, ya.. when we were toying w/ it before we also had one for centos-8 | 21:50 |
| rlandy | no longer | 21:50 |
| * weshay|ruck needs to lay down for a minute.. | 21:50 | |
| weshay|ruck | tired | 21:50 |
| rlandy | go ... | 21:51 |
| weshay|ruck | actually one more review | 21:51 |
| rlandy | I have to debug repo_steup | 21:51 |
| weshay|ruck | we have patches on this | 21:51 |
| rlandy | and finish with pipeline | 21:51 |
| rlandy | thought yatin fixed it all | 21:51 |
| weshay|ruck | don't need all this https://review.opendev.org/#/c/702993/24/roles/build-containers/templates/Dockerfile.centos8.j2 | 21:52 |
| weshay|ruck | but something similiar | 21:53 |
| weshay|ruck | https://review.opendev.org/#/c/702993/24/roles/build-containers/tasks/main.yaml | 21:53 |
| rlandy | weshay|ruck: we can pick this up later/tomorrow | 21:54 |
| rlandy | I am here for a while still today | 21:54 |
| *** jmasud has quit IRC | 22:15 | |
| *** dpawlik has quit IRC | 22:33 | |
| *** jmasud has joined #oooq | 22:44 | |
| *** sshnaidm is now known as sshnaidm|afk | 23:02 | |
| rlandy | https://review.rdoproject.org/r/#/c/25036/ | 23:21 |
| rlandy | weshay|ruck: raukadah: pls review - staggered pipelines | 23:21 |
| *** jmasud has quit IRC | 23:43 | |
| *** jmasud has joined #oooq | 23:46 | |
| *** jmasud has quit IRC | 23:50 | |
| *** jmasud has joined #oooq | 23:53 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!