*** tosky has quit IRC | 00:00 | |
*** ratailor has joined #oooq | 03:32 | |
*** ysandeep|away is now known as ysandeep | 04:14 | |
*** ykarel|away has joined #oooq | 04:42 | |
*** ykarel|away is now known as ykarel | 04:42 | |
ysandeep | Hello Guys, good morning, do you know what happened with https://bugs.launchpad.net/tripleo/+bug/1879766 ? | 05:10 |
---|---|---|
openstack | Launchpad bug 1879766 in tripleo "master ovb jobs failing on Destination directory /etc/pki/tls/private does not exist" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 05:10 |
ysandeep | We are hitting something similiar in downstream - "missing /var/lib/pcsd" and /etc/pki/tls/private", https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-rhel-8-buildimage-overcloud-full-rhos-16.2/49f5774/job-output.txt | 05:10 |
ysandeep | raukadah, ^^ incase you know | 05:11 |
raukadah | ysandeep: please add same kind of workaround https://review.rdoproject.org/r/#/c/28041/ downstream | 05:13 |
ysandeep | raukadah, looking | 05:14 |
ykarel | we reverted this ^ and moved to upstream jobs | 05:14 |
ykarel | https://review.rdoproject.org/r/#/c/28290/ | 05:14 |
ykarel | so good to check first if upstream patch is sufficient or not for downstream case | 05:16 |
raukadah | https://review.opendev.org/#/c/738469/ | 05:17 |
raukadah | ysandeep: ^^ will work | 05:17 |
raukadah | ykarel: thanks! | 05:17 |
ysandeep | ykarel raukadah , thank you, It looks like we are not inheriting from tripleo-ci job in downstream case, will try similiar workaround and see how it goes. | 05:21 |
ykarel | ack if it's not included then similar need to be added | 05:22 |
ysandeep | ack | 05:22 |
*** udesale has joined #oooq | 05:23 | |
akahat|rover | raukadah, ping | 05:28 |
akahat|rover | raukadah, https://review.opendev.org/#/c/744882/ i added this job for master release and it works fine. | 05:28 |
akahat|rover | raukadah, stable/train is failing.. adding another list item in the section for stable/train will skip the tests ? | 05:29 |
akahat|rover | i added this patch * | 05:29 |
akahat|rover | raukadah, https://review.opendev.org/#/c/747619/ | 05:33 |
*** skramaja has joined #oooq | 05:37 | |
*** raukadah is now known as chandankumar | 05:45 | |
chandankumar | akahat|rover: commented | 05:46 |
akahat|rover | chandankumar, i didn't opened bug for it... do i need to? | 05:47 |
chandankumar | akahat|rover: you can reuse the previous one | 05:48 |
chandankumar | akahat|rover: and just update the bug with more info there | 05:48 |
*** kopecmartin|pto is now known as kopecmartin | 05:48 | |
akahat|rover | chandankumar, okay | 05:48 |
*** jfrancoa has joined #oooq | 05:50 | |
*** jfrancoa has quit IRC | 05:50 | |
*** jfrancoa has joined #oooq | 06:04 | |
*** dtantsur|afk is now known as dtantsur | 06:35 | |
*** apetrich has joined #oooq | 06:45 | |
*** sshnaidm|afk is now known as sshnaidm | 07:03 | |
akahat|rover | ykarel, ysandeep chandankumar this job is continuously failing.. https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-scenario009-multinode-oooq-container | 07:09 |
akahat|rover | any what to do with it.. i mean deprecate, fix or just leave it as it is. | 07:10 |
ykarel | it depends on what that scenario tests | 07:11 |
ykarel | and just leave it as it is shouldn't be an option :) | 07:11 |
arxcruz|ruck | akahat|rover: morning | 07:11 |
ykarel | ohkk it's an openshift job, no sure it's relevant or not | 07:12 |
akahat|rover | arxcruz|ruck, morning | 07:12 |
chandankumar | ykarel: it is no longer tested | 07:12 |
ykarel | chandankumar, even in stable branches? | 07:12 |
chandankumar | ykarel: as per this https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-scenario009-multinode-oooq-container&result=SUCCESS# | 07:13 |
chandankumar | ykarel: it currently runs on stable/train, stein and in periodic | 07:14 |
chandankumar | akahat|rover: do a git blame, send the removal request in one of the branch | 07:14 |
ykarel | but as per ^^, it's been running but ffailing since couple of months | 07:15 |
arxcruz|ruck | akahat|rover: good news is rocky and steil promote | 07:15 |
chandankumar | and add as a reviewer who added the job | 07:15 |
arxcruz|ruck | bad news is master is failing | 07:15 |
chandankumar | akahat|rover: or even better open a bug and do a cix from there you will get the answer | 07:16 |
chandankumar | to remove it or not | 07:16 |
akahat|rover | arxcruz|ruck, that's not good. :| | 07:17 |
akahat|rover | chandankumar, ykarel opening cix issue would be a better option. | 07:18 |
arxcruz|ruck | akahat|rover: https://review.opendev.org/#/c/747619 needs a fix, let's do it then merge, there's an ovn issue as well | 07:19 |
akahat|rover | arxcruz|ruck, looking | 07:19 |
arxcruz|ruck | akahat|rover: did you open bug for this one? https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-ovn-provider-standalone-master/d3f9ad8/job-output.txt | 07:19 |
arxcruz|ruck | I can do it if you haven't | 07:19 |
*** tosky has joined #oooq | 07:20 | |
akahat|rover | arxcruz|ruck, okay. please go ahead.. | 07:21 |
arxcruz|ruck | https://bugs.launchpad.net/tripleo/+bug/1892682 | 07:27 |
openstack | Launchpad bug 1892682 in tripleo "Periodic Scenario 010 ovn provider job failing with ovn provider is not enabled" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 07:27 |
arxcruz|ruck | ykarel: hey man, do you have any idea what's this error https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master/6792995/logs/undercloud/home/zuul/build-err.log.txt.gz ? | 07:36 |
ykarel | arxcruz|ruck, i see | 07:37 |
ykarel | 2020-08-24 01:39:52.993 | error: Curl error (28): Timeout was reached for http://mirrorlist.centos.org/?release=8&arch=x86_64&repo=BaseOS&infra=genclo [Connection timed out after 30000 milliseconds] (http://mirrorlist.centos.org/?release=8&arch=x86_64&repo=BaseOS&infra=genclo). | 07:37 |
ykarel | 2020-08-24 01:39:53.004 | Error: Error downloading packages: | 07:37 |
ykarel | 2020-08-24 01:39:53.005 | Curl error (28): Timeout was reached for http://mirrorlist.centos.org/?release=8&arch=x86_64&repo=BaseOS&infra=genclo [Connection timed out after 30000 milliseconds] | 07:37 |
ykarel | in https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master/6792995/logs/undercloud/home/zuul/build.log.txt.gz | 07:37 |
ykarel | centos mirror shouldn't be used in these jobs, | 07:38 |
arxcruz|ruck | ykarel: thanks, didn't notice that | 07:38 |
ykarel | infra mirrors should be used | 07:38 |
arxcruz|ruck | ykarel: okay, let me see where this is set | 07:38 |
ykarel | ack | 07:39 |
arxcruz|ruck | ykarel: the repos are configured on diskimage_builder afaik | 07:41 |
arxcruz|ruck | hmmm | 07:42 |
arxcruz|ruck | hold on | 07:42 |
akahat|rover | arxcruz|ruck, chandankumar https://review.opendev.org/#/c/747619/ ready to merge. | 07:54 |
*** akahat|rover is now known as akahat|lunch | 07:58 | |
sshnaidm | do we have timeouts in all jobs now? | 08:00 |
sshnaidm | arxcruz|ruck, ^ | 08:00 |
arxcruz|ruck | sshnaidm: what you mean ? | 08:00 |
sshnaidm | arxcruz|ruck, I see a lot of jobs finishing with timeout in upstream | 08:03 |
sshnaidm | arxcruz|ruck, looks like a network problem, most of them fail to download from repos.. | 08:03 |
*** yolanda has quit IRC | 08:03 | |
arxcruz|ruck | sshnaidm: okay, i'm checking, was checking issues in the promoter job | 08:03 |
arxcruz|ruck | give me a few | 08:03 |
sshnaidm | arxcruz|ruck, for example https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_1c8/747129/14/check/tripleo-buildimage-overcloud-full-centos-8/1c8f306/build.log | 08:04 |
sshnaidm | maybe problem with mirrors.. | 08:04 |
sshnaidm | arxcruz|ruck, there is a problem with build images and build containers jobs, they update a host OS a lot.. do we have a new centos? | 08:21 |
sshnaidm | ykarel, ^ | 08:21 |
arxcruz|ruck | sshnaidm not that i am aware | 08:21 |
arxcruz|ruck | ykarel: Curl error (28): Timeout was reached for http://mirrorlist.centos.org/?release=8&arch=x86_64&repo=BaseOS&infra=genclo [Connection timed out after 30000 milliseconds] should not exist in that build-image | 08:22 |
arxcruz|ruck | all the repos is pointing to rdoproject mirror | 08:22 |
arxcruz|ruck | and the BaseOS repo as well | 08:22 |
*** ysandeep is now known as ysandeep|lunch | 08:23 | |
ykarel | sshnaidm, sorry what problem? | 08:25 |
ykarel | i don't see any recent update in centos repos | 08:26 |
ykarel | sshnaidm, the above job looks green as per https://zuul.openstack.org/builds?job_name=tripleo-buildimage-overcloud-full-centos-8 | 08:34 |
sshnaidm | ykarel, yeah, I saw, but latest run doesn't look good: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_1c8/747129/14/check/tripleo-buildimage-overcloud-full-centos-8/1c8f306/build.log | 08:35 |
sshnaidm | it takes a lot of time to install packages, maybe problem with disk.. | 08:35 |
ykarel | sshnaidm, just once ^ or seeing in multiple runs? | 08:36 |
arxcruz|ruck | chandankumar: akahat|lunch https://review.opendev.org/747643 | 08:37 |
*** derekh has joined #oooq | 08:43 | |
*** jbadiapa has joined #oooq | 08:44 | |
ykarel | sshnaidm, so i noticed those jobs are using centos mirrors, which should not be done, instead infra mirrors should be used | 08:48 |
ykarel | sorry, in this job infra mirrors configured so looks good https://90362f3ffcbc7d10f6d2-5cc3bfcb3bb487674a81482b8b9096bc.ssl.cf2.rackcdn.com/747589/2/check/tripleo-buildimage-overcloud-full-centos-8/e01ebfd/yum.repos.d/CentOS-Base.repo | 08:50 |
ykarel | i can recheck, let me know if it's consistent across multiple jobs | 08:53 |
arxcruz|ruck | cgoncalves: the skiplist is because these tests are failing, and it's a promotion blocker | 09:05 |
arxcruz|ruck | cgoncalves: if you know how to fix the error, it is also valid :) | 09:06 |
cgoncalves | arxcruz|ruck, remove scenario010-ovn from promotion? | 09:06 |
cgoncalves | arxcruz|ruck, OVN provider driver is under the Neutron/OVN team | 09:06 |
arxcruz|ruck | cgoncalves: i mean, add the tests on the skiplist | 09:06 |
cgoncalves | my stance is: tests should not be disabled in job A just because they are failing in job B | 09:07 |
*** ysandeep|lunch is now known as ysandeep | 09:12 | |
arxcruz|ruck | cgoncalves: these are the only tests running on scenario010? | 09:14 |
cgoncalves | arxcruz|ruck, there should be more | 09:15 |
cgoncalves | arxcruz|ruck, I see a "jobs" parameter. I'm not certain what it does but if I had to guess it allows to specify tests that should be skipped in that jobs list | 09:16 |
arxcruz|ruck | cgoncalves: not yet :/ | 09:16 |
arxcruz|ruck | sshnaidm: do you know what this tags here means? https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/standalone-jobs.yaml#L772 | 09:23 |
sshnaidm | arxcruz|ruck, I do | 09:23 |
arxcruz|ruck | i see the difference between periodic and non periodic is this tags | 09:23 |
arxcruz|ruck | sshnaidm: enlighten me then :D | 09:23 |
sshnaidm | arxcruz|ruck, it means which tagged tasks/roles we run | 09:24 |
arxcruz|ruck | i see | 09:24 |
sshnaidm | arxcruz|ruck, in periodic you don't need build | 09:24 |
arxcruz|ruck | sshnaidm: but need the other two right ? | 09:24 |
sshnaidm | arxcruz|ruck, all the rest should be the same | 09:24 |
sshnaidm | arxcruz|ruck, actually you can include build too, it just won't run | 09:25 |
sshnaidm | arxcruz|ruck, actually the whole job definition must be same, only release file is different | 09:25 |
sshnaidm | when you inherit it should inherit tags too | 09:26 |
zbr | sshnaidm: chandankumar: e-r change when you can https://review.opendev.org/#/c/746890/ tx | 09:27 |
arxcruz|ruck | sshnaidm: zbr https://review.opendev.org/#/c/747649/ | 09:38 |
arxcruz|ruck | cgoncalves: can you help me here? where ovn is enabled on scenario010 ? | 10:01 |
arxcruz|ruck | i'm checking the job definition and I can't find it | 10:01 |
arxcruz|ruck | the only difference between the periodic and the check job, is that check have ovn in the list of enabled drivers | 10:02 |
arxcruz|ruck | and periodic doesn't | 10:02 |
arxcruz|ruck | but where this is set, I don't know | 10:02 |
cgoncalves | arxcruz|ruck, OctaviaEnableDriverAgent: false disables the OVN provider driver | 10:02 |
cgoncalves | arxcruz|ruck, https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/ci/environments/scenario010-standalone.yaml#L36 | 10:03 |
arxcruz|ruck | cgoncalves: I see, so, both jobs have this ci/environments/scenario010-standalone.yaml file | 10:03 |
arxcruz|ruck | as you can see in https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/standalone-jobs.yaml#L767 | 10:04 |
arxcruz|ruck | and https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/standalone-jobs.yaml#L432 | 10:05 |
cgoncalves | arxcruz|ruck, correct. those ovn jobs need to set OctaviaEnableDriverAgent: true | 10:05 |
arxcruz|ruck | cgoncalves: where ? | 10:05 |
arxcruz|ruck | cgoncalves: because, both are the same | 10:05 |
arxcruz|ruck | but periodic doesn't have ovn on the list of enabled, and the check one does | 10:06 |
cgoncalves | arxcruz|ruck, override in the job definition | 10:06 |
cgoncalves | arxcruz|ruck, if promotion blocker, file a CIX card? | 10:13 |
arxcruz|ruck | cgoncalves: already did it | 10:13 |
cgoncalves | arxcruz|ruck, I didn't get an email on rhos-dev | 10:13 |
arxcruz|ruck | cgoncalves: it's in new/triage | 10:14 |
akahat|lunch | arxcruz|ruck, https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-standalone-scenario001-skipped-tempest-ussuri | 10:27 |
*** akahat|lunch is now known as akahat|rover | 10:27 | |
arxcruz|ruck | akahat|rover: you don't need to care about this job | 10:28 |
arxcruz|ruck | it's supposed to fail | 10:28 |
akahat|rover | oh.. like job failed successfully. :P | 10:29 |
arxcruz|ruck | yes | 10:32 |
arxcruz|ruck | sshnaidm: have you seen this error before? https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/3de1342/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 10:32 |
arxcruz|ruck | ykarel: ^ | 10:32 |
arxcruz|ruck | 2020-08-24 02:04:45 | "[2020/08/24 02:04:18 AM] [WARNING] Error in 'ip route add 0.0.0.0/0 via 10.0.0.1 dev br-ex', restarting br-ex:", | 10:33 |
*** udesale has quit IRC | 10:33 | |
ykarel | no ^ is not real issue | 10:34 |
ykarel | actual is FATAL | Gather podman infos | overcloud-controller-2 | error={"changed": false, "msg": "Unable to gather info for [ | 10:34 |
ykarel | i have seen this error some days back | 10:34 |
ykarel | too | 10:34 |
sshnaidm | arxcruz|ruck, yeah, it's not an error | 10:35 |
arxcruz|ruck | ykarel: sshnaidm ack, opening a bug | 10:36 |
ykarel | arxcruz|ruck, ack http://eavesdrop.openstack.org/irclogs/%23tripleo/%23tripleo.2020-08-18.log.html#t2020-08-18T12:58:48 for context | 10:37 |
sshnaidm | arxcruz|ruck, Error: error looking up container \"cceab9790805\": no container with name or ID cceab9790805 found: no such container | 10:37 |
chandankumar | ysandeep: does /tmp issue got resolved? | 10:37 |
ysandeep | chandankumar, I was not able to replicate the issue in testproject, looks like its a random issue. But i have posted a patch for it https://code.engineering.redhat.com/gerrit/#/c/208473/ | 10:38 |
arxcruz|ruck | ysandeep: thanks, i'll check with emilien | 10:39 |
ysandeep | arxcruz|ruck, ? | 10:39 |
arxcruz|ruck | ysandeep: sorry, it meant to be ykarel | 10:39 |
arxcruz|ruck | :D | 10:40 |
ysandeep | :) | 10:40 |
*** udesale has joined #oooq | 10:41 | |
akahat|rover | arxcruz|ruck, some time back sshnaidm was talking about timeout issue.. i think it is valid.. but it is not happening every time.. I've seen few jobs which are failed because of this error. | 10:42 |
akahat|rover | https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-ussuri/44ad824/job-output.txt | 10:42 |
akahat|rover | https://8442fc48a58b3d85474c-27618e467ab9b983fdfb7a89cc8b48ca.ssl.cf1.rackcdn.com/745327/1/gate/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/e702a56/job-output.txt | 10:43 |
sshnaidm | akahat|rover, omg, does it happen again? | 10:43 |
akahat|rover | RUN END RESULT_TIMED_OUT: | 10:43 |
akahat|rover | sshnaidm, not seen today.. yet !! | 10:43 |
sshnaidm | akahat|rover, again on tripleo-inventory : Ensure gather_facts has been run against localhost | 10:44 |
akahat|rover | sshnaidm, that task ment to skip.. https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-ussuri/59424a6/job-output.txt | 10:46 |
akahat|rover | but we don't know what happened. :P | 10:46 |
sshnaidm | yeah, so between it and next task.. | 10:47 |
akahat|rover | arxcruz|ruck, we not worry about all skipped-tempest-ussuri jobs? Or only few jobs? | 10:53 |
arxcruz|ruck | akahat|rover: exactly | 10:54 |
arxcruz|ruck | no need to worrk if it's skipped-tempest | 10:54 |
akahat|rover | arxcruz|ruck, okay. | 10:54 |
*** udesale has quit IRC | 10:55 | |
akahat|rover | sshnaidm, i found one job which failed today.. https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-ussuri/42b5bf5/job-output.txt | 10:56 |
sshnaidm | akahat|rover, I see.. what worth a bug, I think | 10:58 |
zbr | arxcruz|ruck: please include link to bug on https://review.opendev.org/#/c/747649/1 | 11:08 |
zbr | i am happy to approve it once I see an upstream bug related to the pinning | 11:09 |
arxcruz|ruck | zbr: https://github.com/pre-commit/pre-commit/issues/1578 | 11:10 |
*** pojadhav is now known as pojadhav|afk | 11:12 | |
*** udesale has joined #oooq | 11:15 | |
zbr | that is weird, i wonder if running "pip check" before pre-commit would indicate any issues | 11:16 |
akahat|rover | sshnaidm, https://643169a2915789dbd696-0cff35b3d101f5c13616cb96b9f1415f.ssl.cf5.rackcdn.com/746219/6/gate/tripleo-ci-centos-8-undercloud-containers/48539e2/job-output.txt | 11:17 |
zbr | arxcruz|ruck: and I was right: pre-commit 2.7.1 has requirement virtualenv>=20.0.8, but you have virtualenv 16.7.10. | 11:17 |
akahat|rover | sshnaidm, this is ansible.. but RUN END RESULT_TIMED_OUT is something different. | 11:17 |
zbr | basically I was correct to -2 the patch, and the upstream bug is incorrect. | 11:17 |
sshnaidm | akahat|rover, RUN END RESULT_TIMED_OUT is just a general job error, timeout can be caused by anything | 11:18 |
sshnaidm | akahat|rover, need to see what was the latest task | 11:18 |
arxcruz|ruck | zbr: okay, we can't use virtualenv>=20.0.8 right, I remember there were some issues | 11:18 |
akahat|rover | sshnaidm, we are seeing this issues since 21.. | 11:19 |
akahat|rover | chandankumar, have you seen this issues ^^ | 11:20 |
zbr | arxcruz|ruck: try it, there were many releases in between, also pinning down virtualenv withou a comment before it was another mistake | 11:21 |
zbr | pinning down is ok, but only when previous like contains a link to the bug that required it | 11:22 |
zbr | Also good idea to add a "pip check" command before running pre-commit. | 11:23 |
arxcruz|ruck | zbr: so you have there | 11:30 |
arxcruz|ruck | 54 virtualenv<20 # known to break things | 11:30 |
arxcruz|ruck | so... | 11:30 |
*** pojadhav|afk is now known as pojadhav | 11:36 | |
*** ysandeep is now known as ysandeep|brb | 11:40 | |
*** ysandeep|brb is now known as ysandeep | 11:54 | |
*** rlandy has joined #oooq | 12:00 | |
rlandy | ysandeep: hey - thanks for getting 17 rebuilt | 12:05 |
ysandeep | rlandy, my pleasure :) | 12:06 |
rlandy | ysandeep: periodic-tripleo-rhel-8-buildimage-overcloud-full-rhos-17 failing | 12:06 |
ysandeep | rlandy, after reverting back to older puppet version - container build worked | 12:06 |
rlandy | are you looking at that or should I investigate? | 12:06 |
ysandeep | rlandy, https://code.engineering.redhat.com/gerrit/#/c/208473/ should take care of this | 12:06 |
ysandeep | rlandy, i have rerun the job, awaiting vm from nodepool | 12:07 |
rlandy | ysandeep: ok rerun periodic-tripleo-rhel-8-buildimage-overcloud-full-rhos-17 with current tripleo-ci-testing hash? | 12:07 |
rlandy | because after this run, I'm going to edit the criteria to get a promotion | 12:08 |
rlandy | or we manually promote | 12:08 |
rlandy | ysandeep: I am sure we are all tired of so much red on 17 :) | 12:08 |
ysandeep | rlandy, for periodic-tripleo-rhel-8-buildimage-overcloud-full-rhos-17 i have not played with hash, so yes it will pick default hash | 12:09 |
rlandy | as long as it's force_periodic true, we're good | 12:10 |
rlandy | we just need all the jobs reporting with the same hash | 12:10 |
ysandeep | rlandy, https://code.engineering.redhat.com/gerrit/#/c/201382/23/.zuul.yaml | 12:10 |
ysandeep | i have added force_periodic to each job | 12:11 |
rlandy | ysandeep: perfect - thanks | 12:11 |
rlandy | chandankumar: sorry - didn;t get a chance to test your change on openstack- downstream because of failing builds - will do that today | 12:12 |
rlandy | ysandeep: and now 16.2 pipeline is starting to run | 12:13 |
rlandy | so we'll see all results | 12:13 |
rlandy | nice work! | 12:13 |
ysandeep | teamwork++ | 12:14 |
ysandeep | rlandy, https://code.engineering.redhat.com/gerrit/#/c/201382/ (17 integration pipeline jobs)is currently running, only image build failed so far- i triggered that with https://code.engineering.redhat.com/gerrit/#/c/200295/ , So we just get all results in ~1.5 hour or so, hopefully you don't have to play much with criteria to promote.. things are going green | 12:18 |
ysandeep | s/just/will/g | 12:18 |
rlandy | ysandeep: whatever fails, we | 12:19 |
rlandy | can fix afterwards | 12:19 |
rlandy | 17 is soooooooo far behind :( | 12:20 |
rlandy | I'll make a list of tests we need to fix | 12:20 |
ysandeep | okay | 12:20 |
rlandy | ysandeep: the ipa test might fail but I have a test fix for that if it does happen | 12:20 |
ysandeep | rlandy, okay :) | 12:22 |
rlandy | weshay|ruck: ysandeep: we're going to have to do a manual promotion of 16.2 and 17 this afternoon .... | 12:28 |
rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/82/201382/23/check/periodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-17/ad2d569/logs/containers-successfully-built.log | 12:28 |
rlandy | the current state of the internal promoter expects the missing neutron openstack-neutron-mlnx-agent | 12:29 |
arxcruz|ruck | akahat|rover: i'm in cix call | 12:29 |
akahat|rover | arxcruz|ruck, joining | 12:30 |
rlandy | - imagename: docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo | 12:30 |
rlandy | imagename: docker.io/tripleomaster/centos-binary-neutron-mlnx-agent:current-tripleo | 12:30 |
rlandy | but we are not building it in 17 | 12:31 |
weshay|ruck | rlandy, k | 12:31 |
weshay|ruck | arxcruz|ruck, akahat|rover otp.. please go to cix | 12:31 |
arxcruz|ruck | weshay|ruck: i'm there already | 12:31 |
akahat|rover | weshay|ruck, already in. | 12:31 |
*** rfolco has joined #oooq | 12:31 | |
rlandy | checking master | 12:32 |
weshay|ruck | thanks | 12:33 |
rlandy | https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-ubi-8-push/a1d7376/logs/containers-successfully-built.log | 12:33 |
rlandy | ^^ not there either so the RDO promoter must be dealing with that | 12:33 |
arxcruz|ruck | weshay|ruck: who was supposed to run the cix meeting today ? | 12:39 |
*** udesale_ has joined #oooq | 12:51 | |
*** udesale has quit IRC | 12:53 | |
ysandeep | rlandy, periodic-tripleo-rhel-8-buildimage-overcloud-full-rhos-17 https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/4fee49c6b53c4bb598aa0d46672d81d7 : SUCCESS in 38m 37s | 12:55 |
ysandeep | :) | 12:55 |
rlandy | ysandeep: yep - saw that - we're ago for promotion | 12:57 |
rlandy | will talk about it at scrum | 12:57 |
*** ratailor has quit IRC | 12:57 | |
ysandeep | yep | 12:57 |
rlandy | we promote 16.2 and 17 today | 12:58 |
rfolco | scrum time https://meet.google.com/oiv-geho-mai?authuser=1 | 13:00 |
rfolco | arxcruz, rfolco, zbr, sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, pojadhav, akahat, weshay, chandankumar | 13:01 |
rfolco | ping scrum ^ | 13:01 |
akahat|rover | weshay|ruck, https://643169a2915789dbd696-0cff35b3d101f5c13616cb96b9f1415f.ssl.cf5.rackcdn.com/746219/6/gate/tripleo-ci-centos-8-undercloud-containers/48539e2/job-output.txt | 13:06 |
*** owalsh has quit IRC | 13:15 | |
*** owalsh has joined #oooq | 13:16 | |
arxcruz|ruck | weshay|ruck: akahat|rover i'll be back in approx 2 hours | 13:23 |
weshay|ruck | arxcruz|ruck, aye | 13:23 |
akahat|rover | arxcruz|ruck, okay | 13:23 |
*** Goneri has joined #oooq | 13:25 | |
*** TrevorV has joined #oooq | 13:29 | |
*** ykarel is now known as ykarel|away | 13:30 | |
rfolco | arxcruz, rfolco, zbr, sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, pojadhav, akahat, weshay, chandankumar: if you have jira stories/tasks in kaban board (not in scrum board), please point me to the issue # so I can move to the sprint | 13:42 |
rlandy | rfolco: ysandeep and I have three ... | 13:42 |
rfolco | rlandy, gimme the numbers please | 13:43 |
rlandy | https://projects.engineering.redhat.com/secure/RapidBoard.jspa?rapidView=3806&projectKey=TRIPLEOCI&view=detail&selectedIssue=TRIPLEOCI-36 | 13:44 |
rlandy | rfolco: ^^ if that refer to 16.2? | 13:44 |
rlandy | https://projects.engineering.redhat.com/secure/RapidBoard.jspa?rapidView=3806&projectKey=TRIPLEOCI&view=detail&selectedIssue=TRIPLEOCI-5 | 13:44 |
rlandy | rfolco: again - if that his 16.2 specific - I don't know | 13:44 |
rlandy | and then the dependency one | 13:45 |
rlandy | rfolco: https://projects.engineering.redhat.com/secure/RapidBoard.jspa?rapidView=3806&projectKey=TRIPLEOCI&view=detail&selectedIssue=TRIPLEOCI-130 | 13:46 |
rlandy | ^^ already added a subtask | 13:46 |
rfolco | rlandy, no there is another epic for 16. | 13:51 |
rfolco | https://projects.engineering.redhat.com/browse/TRIPLEOCI-64 | 13:51 |
rlandy | ysandeep: wow - only one real failure on 17 | 13:52 |
rlandy | weshay|ruck: ^^ | 13:52 |
rlandy | promote, promote this!! | 13:52 |
rlandy | let | 13:52 |
rlandy | s clean the component mess | 13:53 |
weshay|ruck | chandankumar, I'll join late for the interview planning.. need to attend DF call | 13:55 |
chandankumar | weshay|ruck: ok | 13:55 |
*** mjturek has joined #oooq | 13:58 | |
rfolco | rlandy, epic >> story >> sub-task ... please use this hierarchy (do not create sub-tasks for an epic directly) | 14:00 |
chandankumar | arxcruz|ruck: sshnaidm rlandy interview prep meeting time | 14:01 |
rlandy | rfolco: ok - I didn't create those tasks on the kanban borad - they already existed | 14:01 |
rlandy | so we create more tasks on the epic | 14:01 |
rfolco | hmm I am adding a user story so you can create tasks under it | 14:02 |
rlandy | ok - we'll need two | 14:02 |
chandankumar | weshay|ruck: arxcruz|ruck we have added the interview program schedule on the doc itself, please have a look, weshay|ruck You are joining tomorrow na? Do you want to introduce the interview panle | 14:18 |
rfolco | rlandy, TRIPLEO-139 now is replaced by TRIPLEO-144, already in scrum board | 14:18 |
rfolco | rlandy, will delete 139 with your blessing | 14:18 |
rlandy | rfolco: sure - whatever works | 14:19 |
rfolco | rlandy, as for 16.2, create new stories here https://projects.engineering.redhat.com/browse/TRIPLEOCI-64 | 14:19 |
rlandy | ok | 14:20 |
rlandy | ysandeep: ^^ going to add some stories here | 14:20 |
rlandy | for setting up the pipelin | 14:20 |
rlandy | pipeline | 14:20 |
rlandy | and adding jobs | 14:20 |
ysandeep | rlandy, thanks! i will add tomorrow | 14:21 |
rlandy | rfolco: ok - I added TRIPLEOCI-145 on epic https://projects.engineering.redhat.com/browse/TRIPLEOCI-64 | 14:23 |
rlandy | how does that get to the scrum board? | 14:23 |
weshay|ruck | chandankumar, you guys done? | 14:24 |
rlandy | weshay|ruck: ack | 14:24 |
* weshay|ruck reviews doc | 14:24 | |
rfolco | rlandy, backlog screen, select the epic and you drag the story into the sprint | 14:24 |
rfolco | rlandy, here https://projects.engineering.redhat.com/secure/RapidBoard.jspa?rapidView=4285&projectKey=TRIPLEOCI&view=planning.nodetail&selectedIssue=TRIPLEOCI-143&epics=visible&selectedEpic=TRIPLEOCI-64 | 14:25 |
rfolco | rlandy, just drag the story up to the sprint, let me know if it worked | 14:25 |
*** ykarel|away has quit IRC | 14:25 | |
rlandy | rfolco: ok - I think I did that | 14:26 |
rfolco | rlandy, yes you did, thanks | 14:26 |
rlandy | adding sub tasks | 14:26 |
weshay|ruck | chandankumar, arxcruz|ruck rlandy sshnaidm questions are a little too easy for these candidates.. just FYI.. imho | 14:27 |
weshay|ruck | consider adding one difficult question each | 14:28 |
rlandy | weshay|ruck: sure - let's ask them how to work a JIRA kanban board | 14:28 |
rlandy | I can't get that right! | 14:28 |
weshay|ruck | lolz | 14:29 |
*** ysandeep is now known as ysandeep|dinner | 14:38 | |
sshnaidm | weshay|ruck, if they prove it's too easy for them, then it's fair enough :) | 14:39 |
weshay|ruck | k | 14:43 |
rlandy | rfolco: ysandeep|dinner: weshay|ruck: added more stories to the 16.2 epic: https://projects.engineering.redhat.com/secure/RapidBoard.jspa?rapidView=4285&projectKey=TRIPLEOCI&view=planning.nodetail&selectedIssue=TRIPLEOCI-149&epics=visible&selectedEpic=TRIPLEOCI-64 | 14:48 |
rlandy | ysandeep|dinner: I moved your story to add scenario jobs to the sprint - since you started on that | 14:48 |
rlandy | weshay|ruck: rfolco: from the original ask, I am moving the OVB job task to the sprint as well | 14:49 |
rlandy | to be put in the integration line for now | 14:49 |
rlandy | ok? | 14:49 |
rfolco | rlandy, fine by me | 14:51 |
rlandy | the alternative is real baremetal | 14:51 |
rlandy | but I think OVB is easier in this case | 14:51 |
chandankumar | see ya tomorrow | 14:52 |
*** chandankumar is now known as raukadah | 14:52 | |
weshay|ruck | sshnaidm, do we need to look at the upgrade jobs? https://d0e3fd572414115f797b-39524de8c5a1fb89d206195b6f692473.ssl.cf5.rackcdn.com/747129/14/check/tripleo-ci-centos-8-standalone-upgrade/6cb7b1a/logs/undercloud/var/log/tripleo-container-image-prepare.log | 14:53 |
weshay|ruck | regular jobs look awesome https://1568fca279f072231be5-44bdffb92b22ec3589bdf2facd70188b.ssl.cf5.rackcdn.com/747129/14/check/tripleo-ci-centos-8-standalone/20f0df6/logs/undercloud/var/log/tripleo-container-image-prepare.log | 14:54 |
weshay|ruck | sshnaidm, I would bet the upgrade jobs are deploying from the parent registry and upgrading from docker.io | 14:55 |
weshay|ruck | which may be just fine for now | 14:55 |
weshay|ruck | don't know if we want to incur the hit to build both releases in a parent | 14:56 |
sshnaidm | weshay|ruck, no, I just did for scenarios in first iteration | 14:56 |
rlandy | ysandeep|dinner: if any scenario jobs are ready for the integration line, we need those first before the component lines | 14:56 |
weshay|ruck | +1 | 14:56 |
sshnaidm | weshay|ruck, we can expand to other jobs and multinode in next iterations | 14:56 |
*** udesale__ has joined #oooq | 14:59 | |
*** udesale_ has quit IRC | 15:03 | |
*** jmasud_ has quit IRC | 15:03 | |
*** matbu has quit IRC | 15:03 | |
*** apetrich has quit IRC | 15:03 | |
*** zbr has quit IRC | 15:04 | |
*** zbr has joined #oooq | 15:05 | |
*** jmasud has joined #oooq | 15:08 | |
rlandy | raukadah: rfolco: testing openstack- container name change downstream https://code.engineering.redhat.com/gerrit/#/c/195884/ | 15:09 |
rfolco | weshay|ruck, this is what I meant by 'centos-binary' in so many places in ci-config: https://projects.engineering.redhat.com/browse/TRIPLEOCI-137 | 15:11 |
*** apetrich has joined #oooq | 15:17 | |
weshay|ruck | rfolco, sounds like we just need a param across all of those | 15:17 |
weshay|ruck | rfolco, /me notes... centos-binary will still be used in other releases | 15:17 |
weshay|ruck | so .. sounds like config_engine + promoter config change + tests | 15:17 |
weshay|ruck | sound right? | 15:17 |
rfolco | weshay|ruck, yes in multiple roles containers-promote, promoter, dlrnapi_promoter, everywhere | 15:18 |
*** ysandeep|dinner is now known as ysandeep | 15:27 | |
*** apetrich has quit IRC | 15:27 | |
*** weshay|ruck has quit IRC | 15:31 | |
*** weshay has joined #oooq | 15:32 | |
ysandeep | rlandy, >> ysandeep|dinner: if any scenario jobs are ready for the integration line, we need those first before the component lines | 15:33 |
ysandeep | how about if i add them in single patch - https://code.engineering.redhat.com/gerrit/#/c/209530/3 | 15:33 |
ysandeep | jobs in projects.yaml currently is just for testing* | 15:33 |
rlandy | ysandeep: that's fine if they all are ready to go at once | 15:33 |
rlandy | if you find you need to hold back on the component ones | 15:34 |
rlandy | let's not hold the integration ones | 15:34 |
ysandeep | rlandy, okay | 15:34 |
rlandy | also - pls check all jobs only have rhos-16.2-trunk-patches | 15:34 |
ysandeep | rlandy, Just want to confirm one point - override-checkout: can be inherited right? | 15:35 |
rlandy | ysandeep: ack | 15:35 |
ysandeep | rlandy, sry that was a query. :) | 15:36 |
ysandeep | we can include override-checkout: rhos-16.2-trunk-patches in parent job , and child jobs will have it right? | 15:36 |
rlandy | ysandeep: yes - you are correct, override-checkout is inherited | 15:36 |
ysandeep | rlandy, thanks! | 15:37 |
rlandy | awesome | 15:37 |
rlandy | ysandeep: our card is on the scrum board now | 15:37 |
rlandy | your card | 15:37 |
rlandy | I'll work on the OVB one | 15:37 |
ysandeep | rlandy, fyi.. sc1/02 is blocked because of missing panko_api container, we need merge of https://review.opendev.org/#/c/741228/ | 15:37 |
rlandy | there is also a multinode one and a real baremetal one | 15:37 |
rlandy | yep | 15:38 |
rlandy | pls add that to the card | 15:38 |
ysandeep | rlandy, will pick them up, one i sort these standalone one.. will probably start on baremetal job tomorrow parallely | 15:39 |
ysandeep | once* | 15:39 |
ysandeep | rlandy, taking multinode and baremetal cards | 15:41 |
rlandy | ysandeep: ok - sure | 15:42 |
ysandeep | rlandy, for now i will test on envA after 17 scheduled run | 15:42 |
*** skramaja has quit IRC | 15:56 | |
arxcruz|ruck | weshay: akahat|rover I'm back | 15:57 |
rlandy | arxcruz|ruck: I think weshay got bumped from irc | 15:57 |
rlandy | hist |ruck nick is gone | 15:58 |
rlandy | his | 15:58 |
weshay | rlandy, arxcruz|ruck trying to fix my znc | 16:00 |
weshay | arxcruz|ruck, remind me what we wanted to cover.. OH ovn | 16:04 |
weshay | arxcruz|ruck, 1 sec | 16:04 |
*** weshay has quit IRC | 16:05 | |
*** weshay has joined #oooq | 16:05 | |
weshay | arxcruz|ruck, k.. ready when you are | 16:06 |
arxcruz|ruck | weshay: i born ready | 16:14 |
ysandeep | rlandy, leaving for the day, first scenario job is ready for review - https://code.engineering.redhat.com/gerrit/#/c/209530/ , test runs are green. Sry you may have to wait for 17 check job to run compelety before merging it. | 16:15 |
arxcruz|ruck | weshay: do you mave a meeting id ? | 16:15 |
rfolco | rlandy, raukadah can I take over https://review.opendev.org/#/c/747259 again and make the prefix based on ci_branch ? | 16:16 |
ysandeep | see you guys tomorrow o/ | 16:16 |
*** ysandeep is now known as ysandeep|away | 16:16 | |
rlandy | ysandeep|away: bye - have a good night | 16:18 |
*** dtantsur is now known as dtantsur|afk | 16:19 | |
weshay | arxcruz|ruck, ah sorry | 16:20 |
weshay | starting | 16:20 |
weshay | arxcruz|ruck, https://meet.google.com/ocr-htpe-sew?authuser=1 | 16:21 |
*** tosky has quit IRC | 16:49 | |
weshay | arxcruz|ruck, CentOS-8-x86_64-GenericCloud.qcow2 | 16:49 |
weshay | rfolco, what's your dib test patch w/ fs002 | 16:57 |
rfolco | weshay, https://review.rdoproject.org/r/#/c/28948/ | 16:58 |
rfolco | weshay, downstream is this one https://code.engineering.redhat.com/gerrit/#/c/208524/ | 16:59 |
rfolco | weshay, and buildimage jobs testproject: https://review.rdoproject.org/r/#/c/28113/ | 17:00 |
*** jbadiapa has quit IRC | 17:00 | |
*** derekh has quit IRC | 17:02 | |
weshay | thanks | 17:04 |
weshay | rlandy, want help looking | 17:07 |
rlandy | weshay: waht are we talking about now? | 17:08 |
*** udesale__ has quit IRC | 17:10 | |
rlandy | weshay: why was https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-tripleo-train in criteria | 17:11 |
rlandy | it never passed | 17:11 |
weshay | I think it was meant to be a blocker.. when pooja opened it | 17:11 |
weshay | rlandy, I also think 16.1 was blocked on ipa integration issues at the time | 17:12 |
rlandy | ok | 17:12 |
weshay | rlandy, want help? | 17:34 |
rlandy | weshay: yeah - let's work on promotions if you have time now | 17:36 |
weshay | k.. I do | 17:37 |
weshay | rlandy, https://meet.google.com/mwg-vouu-azo?authuser=1 | 17:37 |
*** jtomasek has joined #oooq | 18:06 | |
*** jtomasek has quit IRC | 18:27 | |
*** jtomasek has joined #oooq | 18:37 | |
*** jtomasek has quit IRC | 18:48 | |
rlandy | weshay: turning dlrn-promoter service off in internal | 19:01 |
weshay | rlandy, +1 | 19:02 |
rfolco | rlandy, can you please explain how this could be right ? https://review.opendev.org/#/c/747259/5/roles/build-containers/defaults/main.yaml | 19:08 |
rfolco | {% if osp_branch is defined -%} | 19:08 |
rfolco | openstack | 19:08 |
rfolco | {%- else -%} | 19:08 |
rfolco | {{ ansible_distribution|lower }}-binary | 19:08 |
rfolco | {%- endif -%} | 19:08 |
rlandy | rfolco: chandan did that so we could test on internal | 19:09 |
rlandy | what's wrong with it? | 19:09 |
rfolco | this is the upstream patch, has nothing about downstream | 19:09 |
weshay | right.. so openstack- will now be both downstream and upstream | 19:10 |
rlandy | tripleo-ci is only upstream | 19:10 |
weshay | rfolco, originally it was an internal convention only | 19:10 |
rlandy | it's branchless | 19:10 |
weshay | rlandy, rfolco ... we're speaking about when to name the containers openstack- vs. centos-binary | 19:11 |
weshay | openstack- is now coming to upstream as well rlandy | 19:11 |
weshay | afaik | 19:11 |
rlandy | weshay: true | 19:11 |
rlandy | but it's a bigger problem to solve in upstream | 19:11 |
rfolco | yes, we cannot change that to osp_branch condition, it will break upstream | 19:12 |
weshay | so instead of if osp_branch | 19:12 |
weshay | we want to deliniate by release | 19:12 |
weshay | rfolco, if defined? | 19:12 |
weshay | would resolve as false | 19:12 |
rfolco | weshay, rlandy let me propose something that may apply for both downstream and upstream | 19:14 |
rlandy | rfolco: testing that patch here: https://code.engineering.redhat.com/gerrit/#/c/195884/ | 19:15 |
rlandy | woohoo 17 has started to clear | 20:12 |
weshay | nice | 20:14 |
weshay | tripleo train promoted | 20:14 |
rlandy | getting there | 20:15 |
rlandy | weshay: what should I do about the centos 8 CR line? | 20:15 |
rlandy | merge as is w/o the image build job? | 20:15 |
* rlandy thinks so | 20:15 | |
rlandy | fixing reviews to merge | 20:16 |
weshay | rlandy, ha.. was just about to ping you | 20:20 |
weshay | re: http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/ci-scripts/dlrnapi_promoter/config/RedHat-8/component/rhos-16.2.yaml | 20:20 |
weshay | rlandy, ya.. let's merge it | 20:20 |
weshay | I want to get an improvement visible there in monitoring | 20:20 |
weshay | rlandy, got the time since last build working | 20:21 |
weshay | http://dashboard-ci.tripleo.org/d/XIedIk4Mk/component-pipeline-train?orgId=1&fullscreen&panelId=465 | 20:21 |
rlandy | looking | 20:21 |
weshay | it's the date on consistent | 20:21 |
weshay | per componet or for the integrated build in another view.. works w/ either | 20:21 |
weshay | let me know if that doesn't make sense.. I need this to be understandable by those not versed | 20:22 |
rlandy | what's the diff between time since last build? | 20:22 |
rlandy | ie: it never changed? | 20:22 |
rlandy | so nothing to promote? | 20:22 |
rlandy | looks fine to me | 20:22 |
weshay | ya.. if there isn't a new build.. there's nothing to promote | 20:23 |
rlandy | yeah - good | 20:24 |
rlandy | shocker - I have a linter failure | 20:24 |
rlandy | https://logserver.rdoproject.org/40/29040/2/check/tox-linters/6d2e2bc/job-output.txt | 20:27 |
rlandy | weshay: ^^ that a genuine error? | 20:27 |
*** jfrancoa has quit IRC | 20:28 | |
rlandy | https://logserver.rdoproject.org/40/29040/2/check/tox-linters/6d2e2bc/tox/linters-1.log? | 20:29 |
rlandy | 2020-08-24 20:22:33.933209 | rdo-centos-8 | An unexpected error has occurred: AssertionError: BUG: expected environment for python to be healthy() immediately after install, please open an issue describing your environment | 20:30 |
rlandy | 2020-08-24 20:22:33.933620 | rdo-centos-8 | Check the log at /home/zuul/.cache/pre-commit/pre-commit.log | 20:30 |
rlandy | 2020-08-24 20:22:33.964668 | rdo-centos-8 | ERROR: InvocationError for command /home/zuul/src/review.rdoproject.org/rdo-jobs/.tox/linters/bin/python -m pre_commit run -a (exited with code 1) | 20:30 |
* weshay looks | 20:37 | |
weshay | rlandy, hrm.. looks like that job should migrate to centos8 or py3 | 20:39 |
rlandy | weshay: weird - this is the first review to catch that | 20:39 |
rlandy | localhost | Inventory Hostname: rdo-centos-8 | 20:40 |
rlandy | it is running on centos 8 | 20:41 |
weshay | rlandy, let's see what happens here https://review.rdoproject.org/r/29058 | 20:41 |
rlandy | k - thanks | 20:41 |
rlandy | linters, what did I ever do to you???? | 20:42 |
weshay | rlandy, i think that worked | 20:45 |
rlandy | weshay: awesome .. will rebase on that patch | 20:46 |
* weshay updated commit-msg | 20:46 | |
weshay | ok.. off to play Teacher, gym teacher that is | 20:49 |
weshay | 0/ | 20:49 |
weshay | rlandy, ^ | 20:49 |
rlandy | weshay: thanks for all the help today | 20:50 |
weshay | psshh.. thank you! | 20:50 |
rlandy | openstack-dependencies-centos8cr | 21:10 |
rlandy | pipeline added | 21:10 |
*** TrevorV has quit IRC | 21:29 | |
*** rlandy has quit IRC | 23:51 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!