| *** dsneddon has quit IRC | 00:48 | |
| *** jmasud has joined #oooq | 00:51 | |
| *** dsneddon has joined #oooq | 01:16 | |
| *** dsneddon has quit IRC | 01:20 | |
| *** dsneddon has joined #oooq | 01:39 | |
| *** ykarel|away is now known as ykarel | 03:55 | |
| *** raukadah is now known as chandankumar | 03:59 | |
| *** udesale has joined #oooq | 04:04 | |
| *** jmasud has quit IRC | 04:13 | |
| *** jmasud has joined #oooq | 04:15 | |
| *** ysandeep|away is now known as ysandeep | 04:19 | |
| *** skramaja has joined #oooq | 04:53 | |
| *** saneax has joined #oooq | 05:23 | |
| *** jmasud_ has joined #oooq | 05:32 | |
| *** jmasud has quit IRC | 05:33 | |
| *** ratailor has joined #oooq | 06:03 | |
| *** dpawlik has joined #oooq | 06:46 | |
| *** yolanda has joined #oooq | 06:47 | |
| *** jfrancoa has joined #oooq | 06:52 | |
| *** dpawlik has quit IRC | 06:57 | |
| *** dpawlik has joined #oooq | 07:08 | |
| *** saneax has quit IRC | 07:17 | |
| chandankumar | soniya29, https://review.opendev.org/#/c/706817/ is merged now, you can close the card and inform the same to marios when he comes online | 07:23 |
|---|---|---|
| soniya29 | chandankumar, sure | 07:24 |
| chandankumar | ykarel, https://logserver.rdoproject.org/32/25332/21/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/abbc810/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz | 07:32 |
| chandankumar | ykarel, something wrong in release file for ovb I think | 07:33 |
| ykarel | chandankumar, clients repos missing https://logserver.rdoproject.org/32/25332/21/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/abbc810/logs/undercloud/etc/yum.repos.d/delorean.repo.txt.gz | 07:34 |
| ykarel | and few others missing too | 07:34 |
| ykarel | i see 12 repos there, should be 15 | 07:34 |
| *** ykarel is now known as ykarel|lunch | 07:38 | |
| *** dsneddon has quit IRC | 07:43 | |
| *** chem has quit IRC | 07:50 | |
| *** tesseract has joined #oooq | 07:59 | |
| *** chem has joined #oooq | 08:04 | |
| *** ccamacho has joined #oooq | 08:13 | |
| *** dsneddon has joined #oooq | 08:14 | |
| *** jaosorior has joined #oooq | 08:16 | |
| *** tosky has joined #oooq | 08:23 | |
| *** dsneddon has quit IRC | 08:23 | |
| *** jpena|off is now known as jpena | 08:23 | |
| *** saneax has joined #oooq | 08:23 | |
| *** ykarel|lunch is now known as ykarel | 08:50 | |
| *** dsneddon has joined #oooq | 08:51 | |
| *** jmasud_ has quit IRC | 08:55 | |
| *** dsneddon has quit IRC | 08:56 | |
| *** jmasud has joined #oooq | 09:11 | |
| *** jbadiapa has joined #oooq | 09:13 | |
| *** bogdando has joined #oooq | 09:14 | |
| *** dmellado has quit IRC | 09:23 | |
| *** dmellado has joined #oooq | 09:26 | |
| *** dsneddon has joined #oooq | 09:28 | |
| *** apetrich has joined #oooq | 09:30 | |
| *** dsneddon has quit IRC | 09:33 | |
| *** dmellado has quit IRC | 09:33 | |
| *** dmellado has joined #oooq | 09:35 | |
| *** jaosorior has quit IRC | 09:35 | |
| *** derekh has joined #oooq | 09:43 | |
| *** sshnaidm is now known as sshnaidm|pto | 09:59 | |
| *** dsneddon has joined #oooq | 10:06 | |
| *** dtantsur|afk is now known as dtantsur | 10:08 | |
| *** dsneddon has quit IRC | 10:11 | |
| *** sshnaidm|pto has quit IRC | 10:26 | |
| *** sshnaidm has joined #oooq | 10:42 | |
| *** dsneddon has joined #oooq | 10:43 | |
| *** dsneddon has quit IRC | 10:47 | |
| chandankumar | ykarel, sshnaidm pyayml issue now fixed with image build https://logserver.rdoproject.org/97/24997/14/check/tripleo-centos-8-buildimage-ironic-python-agent/49afa9d/ | 10:54 |
| ykarel | chandankumar, ack | 10:55 |
| *** udesale has quit IRC | 10:57 | |
| *** whoami-rajat is now known as whoami-rajat|afk | 10:59 | |
| *** sshnaidm_ has joined #oooq | 11:12 | |
| *** sshnaidm has quit IRC | 11:12 | |
| *** sshnaidm_ is now known as sshnaidm|pto | 11:15 | |
| *** dsneddon has joined #oooq | 11:21 | |
| *** sshnaidm|pto has quit IRC | 11:23 | |
| *** sshnaidm has joined #oooq | 11:23 | |
| *** sshnaidm is now known as sshnaidm|pto | 11:24 | |
| *** dsneddon has quit IRC | 11:26 | |
| *** whoami-rajat|afk is now known as whoami-rajat | 11:29 | |
| chandankumar | ykarel, we changed the openvswitch package name for centos-8? | 11:50 |
| ykarel | chandankumar, context? | 11:52 |
| ykarel | we added a new package recently though rdo-openvswitch for centos8 which provides openvwitch and rhosp-openvswitch | 11:52 |
| chandankumar | ykarel, https://logserver.rdoproject.org/97/24997/14/check/tripleo-centos-8-buildimage-overcloud-full/380876b/overcloud-full.log | 11:52 |
| ykarel | chandankumar, i see 2020-03-02 10:56:14.657 | /usr/bin/env: 'python': No such file or directory error | 11:53 |
| chandankumar | Failed to enable unit, unit .service.service does not exist. | 11:53 |
| chandankumar | last time we fixed by installing correct package I think | 11:53 |
| ykarel | me not aware of last time | 11:54 |
| *** dsneddon has joined #oooq | 11:55 | |
| *** dsneddon has quit IRC | 12:02 | |
| *** yolanda has quit IRC | 12:10 | |
| *** yolanda has joined #oooq | 12:11 | |
| *** ChanServ sets mode: +o panda | 12:16 | |
| panda | "Docs: https://docs.openstack.org/tripleo-quickstart/latest/ || 2nd Mar promoter patch to review https://review.rdoproject.org/r/24715 || next promoter patch in the chain https://review.rdoproject.org/r/24716" | 12:17 |
| *** panda changes topic to ""Docs: https://docs.openstack.org/tripleo-quickstart/latest/ || 2nd Mar promoter patch to review https://review.rdoproject.org/r/24715 || next promoter patch in the chain https://review.rdoproject.org/r/24716"" | 12:18 | |
| *** panda sets mode: -o panda | 12:18 | |
| panda | grrrr | 12:18 |
| *** ratailor has quit IRC | 12:28 | |
| *** dsneddon has joined #oooq | 12:33 | |
| *** jpena is now known as jpena|lunch | 12:36 | |
| *** dsneddon has quit IRC | 12:38 | |
| chandankumar | weshay|ruck, image build got cleared | 12:43 |
| chandankumar | proposing final patch | 12:44 |
| chandankumar | brb back during standup | 12:49 |
| *** jmasud has quit IRC | 12:53 | |
| *** jmasud has joined #oooq | 12:56 | |
| *** udesale has joined #oooq | 12:56 | |
| *** rlandy has joined #oooq | 12:57 | |
| rlandy | chandankumar: arxcruz: zbr: panda: scrum | 13:00 |
| rlandy | panda: it's just you | 13:02 |
| *** jbadiapa has quit IRC | 13:03 | |
| *** dsneddon has joined #oooq | 13:05 | |
| *** dsneddon has quit IRC | 13:09 | |
| weshay|ruck | rlandy, https://review.opendev.org/#/c/710727/ | 13:13 |
| chandankumar | rlandy, https://bugs.launchpad.net/tripleo/+bug/1865459 | 13:14 |
| openstack | Launchpad bug 1865459 in tripleo "[CentOS8]tripleo modify images fail when gating-repo is not present" [High,Triaged] | 13:14 |
| chandankumar | rlandy, weshay|ruck https://review.opendev.org/#/c/710738/ | 13:15 |
| chandankumar | rlandy, https://review.rdoproject.org/r/#/c/25366/ | 13:16 |
| chandankumar | rlandy, https://review.rdoproject.org/zuul/builds?pipeline=openstack-promote-component%20 | 13:19 |
| rlandy | chandankumar: https://review.rdoproject.org/r/#/c/25584/ | 13:28 |
| chandankumar | rlandy, aye | 13:28 |
| weshay|ruck | https://hackmd.io/HrQd03c9SxOMtFPFrq50tg | 13:30 |
| *** jpena|lunch is now known as jpena | 13:32 | |
| rlandy | chandankumar: w+'ing https://review.opendev.org/#/c/710230 | 13:34 |
| rlandy | will add revert as it merges | 13:34 |
| chandankumar | rlandy, ate | 13:34 |
| chandankumar | aye | 13:34 |
| *** dsneddon has joined #oooq | 13:35 | |
| chandankumar | rlandy, weshay|ruck /me heading home, will back in 2 hours approx | 13:35 |
| rlandy | chandankumar: https://review.rdoproject.org/r/#/c/25584/ - all three component promotes passed | 13:36 |
| rlandy | do you want me to run a promote-to-tripleo-ci-testing? | 13:36 |
| chandankumar | rlandy, yup go ahead and container build also | 13:36 |
| rlandy | chandankumar: k - will run weshay|ruck's testproject | 13:36 |
| ykarel | weshay|ruck, wrt. ci.centos all releases green https://ci.centos.org/view/rdo/view/promotion-pipeline/ except master | 13:42 |
| ykarel | logs are not collected there, so some issue wrt to log collection is still there | 13:42 |
| *** dsneddon has quit IRC | 13:43 | |
| ykarel | master puppet-openstack-integration has issues though due to glance drop py2 ssl support | 13:44 |
| *** tosky_ has joined #oooq | 13:47 | |
| *** tosky has quit IRC | 13:47 | |
| *** tosky_ is now known as tosky | 13:47 | |
| weshay|ruck | ykarel, k.. I'll look at ci.centos later today and also give centos-8 a whirl there | 13:48 |
| weshay|ruck | ykarel++ | 13:48 |
| ykarel | weshay|ruck, ack Thanks | 13:48 |
| weshay|ruck | chandankumar, rlandy who created https://hackmd.io/HrQd03c9SxOMtFPFrq50tg | 13:50 |
| weshay|ruck | I need to be added as a collaborator | 13:50 |
| weshay|ruck | er. owner | 13:50 |
| rlandy | weshay|ruck: originally chandankumar | 13:51 |
| * weshay|ruck going to try and help clean this up a bit | 13:51 | |
| rlandy | just reused it | 13:51 |
| weshay|ruck | chandankumar, can you click the sharing settings and add me as an owner please | 13:51 |
| weshay|ruck | chandankumar, we also need to have a sprint planning meeting | 13:51 |
| weshay|ruck | chandankumar, let me know what day / time is ok for you | 13:51 |
| rlandy | weshay|ruck: ^^ want we to fill in for rfolco or not necessary? | 13:56 |
| weshay|ruck | rlandy, if you are comfortable with your time / work load.. sure | 13:57 |
| weshay|ruck | panda, you around? | 13:58 |
| panda | weshay|ruck: yes | 13:58 |
| weshay|ruck | panda, we should see a lot of current-tripleo -> current-tripleo-rdo promotions http://rhos-release.virt.bos.redhat.com:3030/rhosp | 13:59 |
| weshay|ruck | https://ci.centos.org/view/rdo/view/promotion-pipeline/ | 13:59 |
| weshay|ruck | all branches went green minus master.. | 13:59 |
| weshay|ruck | panda, just fyi.. we may see the promoter under load today / tomorrow | 14:00 |
| weshay|ruck | panda, I'll keep an eye on it | 14:00 |
| *** jbadiapa has joined #oooq | 14:01 | |
| panda | weshay|ruck: ok | 14:01 |
| weshay|ruck | panda, 2 left before new code? https://review.rdoproject.org/r/#/c/24716/ | 14:01 |
| weshay|ruck | panda, most tests passing cool on new code https://review.rdoproject.org/r/#/c/24774/ | 14:02 |
| weshay|ruck | "new code" bad term.. but you know what I mean | 14:02 |
| panda | weshay|ruck: https://review.opendev.org/710441 has passed single t4est, and I fixed the tox tests locally, uploaded new patch should be ok | 14:02 |
| weshay|ruck | ok good | 14:02 |
| panda | weshay|ruck: ah the integration test on new code is still failing, working on it | 14:03 |
| weshay|ruck | panda, let's sync w/ sagi when he's back w/ regards to clearing out branches from rdo and moving to vex | 14:03 |
| weshay|ruck | giving us space to test it live | 14:03 |
| weshay|ruck | panda, k.. still targeting this week to potentially merge.. let me know if you become uncomfortable w/ that | 14:04 |
| *** ykarel is now known as ykarel|away | 14:05 | |
| weshay|ruck | rlandy, think our goal for the the is to get periodic-tripleo-ci-centos-8-multinode-1ctlr-featureset010-master working | 14:06 |
| weshay|ruck | and in upstream if possible | 14:06 |
| rlandy | weshay|ruck: agreed | 14:08 |
| rlandy | hence the obsession with the hang debugging | 14:09 |
| rlandy | singlenode can go as well then | 14:09 |
| rlandy | fs027 | 14:09 |
| weshay|ruck | aye | 14:09 |
| weshay|ruck | so we just need to wait for https://review.opendev.org/#/c/710230/ | 14:10 |
| rlandy | I w'ed the container-prep patch | 14:10 |
| rlandy | so that should get rid of the current depends-on | 14:11 |
| weshay|ruck | aye.. | 14:11 |
| chandankumar | weshay|ruck, do we need a meeting today or tomorrow for pre sprint planning meeting? | 14:11 |
| weshay|ruck | chandankumar, you home already? | 14:11 |
| weshay|ruck | chandankumar, ya | 14:11 |
| chandankumar | weshay|ruck, yes | 14:12 |
| weshay|ruck | chandankumar, rlandy ugh.. tomorrow is full of f.. mtgs | 14:12 |
| weshay|ruck | rlandy, is 7:30am EST possible for you? | 14:12 |
| rlandy | weshay|ruck: ack | 14:13 |
| weshay|ruck | chandankumar, can you make me a co-owner of https://hackmd.io/HrQd03c9SxOMtFPFrq50tg | 14:13 |
| weshay|ruck | please | 14:13 |
| weshay|ruck | ok.. | 14:13 |
| weshay|ruck | chandankumar, you see how to do that in sharing settings? | 14:14 |
| chandankumar | weshay|ruck, invite sent | 14:14 |
| chandankumar | weshay|ruck, did you get? | 14:15 |
| *** Goneri has joined #oooq | 14:16 | |
| weshay|ruck | chandankumar, thanks.. :) | 14:16 |
| weshay|ruck | I'm good | 14:16 |
| chandankumar | weshay|ruck, cool, done for first time | 14:16 |
| rlandy | checking if we have periodic build-image jobs | 14:17 |
| rlandy | https://review.rdoproject.org/r/#/c/25411/ | 14:19 |
| rlandy | undercloud hang | 14:19 |
| rlandy | oh wait - undercloud install | 14:20 |
| weshay|ruck | hrm looking | 14:20 |
| rlandy | we are pushing new conatiners | 14:20 |
| chandankumar | weshay|ruck, we need to send invite for sprint retro and planning meeting | 14:20 |
| rlandy | oh I guess I'm supposed to do that | 14:21 |
| weshay|ruck | rlandy, I got it.. | 14:21 |
| weshay|ruck | rlandy, 2020-03-02 14:09:02.412 13822 ERROR tripleoclient.v1.tripleo_deploy.Deploy [ ] Exception: Not found image: docker://trunk.registry.rdoproject.org/tripleomaster/centos-binary-barbican-api:cdad9d9eee95d15f3aad115ec3d391b7 | 14:21 |
| rlandy | sorry - bad replacement :( | 14:22 |
| rlandy | weshay|ruck: we are pushing new containers | 14:22 |
| rlandy | it's ok | 14:22 |
| weshay|ruck | rlandy, in these test jobs.. we should use docker.io maybe and current-tripleo? | 14:22 |
| rlandy | no - we need to test periodic | 14:22 |
| weshay|ruck | rlandy, no worries re: mtgs.. I've been scheduling them | 14:22 |
| weshay|ruck | k | 14:22 |
| rlandy | just not at the same time we push containers | 14:22 |
| weshay|ruck | ah k | 14:22 |
| rlandy | I will recheck | 14:23 |
| panda | d | 14:26 |
| chandankumar | rlandy, weshay|ruck we need to revisit the component pipeline tempest tests | 14:31 |
| chandankumar | currently there we are running all tests i think there | 14:31 |
| weshay|ruck | chandankumar, more than just that.. | 14:32 |
| rlandy | yes | 14:32 |
| weshay|ruck | chandankumar, so the component pipeline could be an awesome defense.. when we unpin | 14:32 |
| weshay|ruck | chandankumar, we should think about adding scen01/04 to a few pipelines | 14:32 |
| weshay|ruck | we should think about adding fs001 to ironic | 14:32 |
| weshay|ruck | etc | 14:32 |
| chandankumar | weshay|ruck, yes, I am do the brainstorming part there | 14:33 |
| weshay|ruck | chandankumar, rlandy /me trying to make sure... rdo doesn't just unpin w/o notice | 14:34 |
| chandankumar | weshay|ruck, ykarel|away is going to do unpin on wednesday | 14:34 |
| weshay|ruck | chandankumar, no he's not | 14:35 |
| weshay|ruck | ykarel|away, ^ | 14:35 |
| chandankumar | and will do a test project run before merging | 14:35 |
| rlandy | really?? | 14:35 |
| rlandy | we need the pipeline together by then | 14:35 |
| weshay|ruck | chandankumar, rlandy /me getting Alan's attention | 14:36 |
| rlandy | chandankumar: commented on the image build review ... https://review.opendev.org/#/c/708599/ what do you think? | 14:41 |
| chandankumar | rlandy, I will go for c8 jobs | 14:41 |
| chandankumar | updating review | 14:41 |
| rlandy | chandankumar: cool - adding periodic image builds - don;t see them | 14:42 |
| rlandy | chandankumar: also updated containers are pushed | 14:42 |
| *** zbr is now known as zbr|pto | 14:43 | |
| chandankumar | weshay|ruck, by the way soniya29 cleared first CIX https://trello.com/c/OTMlQi2u/1272-cixlp1856723tripleociproa-periodic-tripleo-ci-centos-7-standalone-full-tempest-master-fails-during-tempest-run-imagestestjsontes | 14:43 |
| chandankumar | rlandy, aye | 14:44 |
| weshay|ruck | soniya29++ | 14:45 |
| weshay|ruck | well done | 14:45 |
| rlandy | chandankumar: we will have to watch those first three components in the component pipeline. I suspect we have a timing issue | 14:45 |
| rlandy | we may have to push the pipeline by three hours if this repeats | 14:45 |
| rlandy | hmmm ... https://review.rdoproject.org/r/#/c/24997/15/zuul.d/buildimage.yaml - is this the parenting we want to keep? off rhel-8? | 14:47 |
| chandankumar | rlandy, since we want to get rid of fs02 and rhel8 is also going away so we may need a new parenting | 14:48 |
| rlandy | chandankumar: so I -1'ed https://review.rdoproject.org/r/#/c/24997/ on that question | 14:49 |
| rlandy | I am not opposed to it atm - but it's just not what we agreed upon | 14:49 |
| rlandy | if you want to go with it atm - I'll remove my -1 | 14:49 |
| chandankumar | rlandy, nope, let's fix that | 14:50 |
| rlandy | chandankumar: if you need to go let me know, and I'll pick it up | 14:50 |
| weshay|ruck | rlandy, chandankumar unpinning will not happen on Wednesday | 14:50 |
| rlandy | lol | 14:50 |
| rlandy | breathe, breathe | 14:50 |
| chandankumar | rlandy, go ahead | 14:50 |
| chandankumar | weshay|ruck, it was from discussion during lunch with ykarel|away | 14:50 |
| weshay|ruck | ya.. chandankumar /me notes.. large changes should ALWAYS hit the prod-chain-council | 14:52 |
| weshay|ruck | this is a large change | 14:52 |
| chandankumar | weshay|ruck, I will coordinate with delivery team for smooth transition | 14:54 |
| weshay|ruck | chandankumar, no.. no you wont | 14:55 |
| weshay|ruck | chandankumar, come to the prod-chain-council mtg if you want to be part of the planning / discussion | 14:55 |
| weshay|ruck | chandankumar, we'll talk about it tomorrow in our planning | 14:55 |
| chandankumar | weshay|ruck, include me to the invite, I will be sycing with alan tomorrow | 14:55 |
| weshay|ruck | chandankumar, k.. ur on the invite list | 14:56 |
| weshay|ruck | now | 14:56 |
| weshay|ruck | chandankumar, thanks | 14:56 |
| weshay|ruck | rlandy, so tripleo-ci-testing failed to build containers | 15:00 |
| weshay|ruck | rlandy, so... now what re: testing multinode and fs027 | 15:00 |
| rlandy | it just passed? | 15:00 |
| rlandy | https://review.rdoproject.org/r/#/c/25064/ | 15:01 |
| rlandy | weshay|ruck: what are we talking about? | 15:01 |
| *** ykarel|away is now known as ykarel | 15:01 | |
| rlandy | did we clash with the pipeline? | 15:01 |
| ykarel | weshay|ruck, yes will not unpin without notice | 15:02 |
| weshay|ruck | rlandy, oh.. /me looks | 15:02 |
| weshay|ruck | ykarel, :)) | 15:02 |
| weshay|ruck | ykarel, we could bolster the component pipeline and save us all a lot of work | 15:03 |
| rlandy | weshay|ruck: either way, I would like to add fs027 and fs010 to the pipeline an d let them fail where everyone sees it | 15:03 |
| ykarel | weshay|ruck, i saw ur mail, and about the criteria for unpin | 15:03 |
| weshay|ruck | rlandy, ack.. was looking at the straight periodic | 15:03 |
| ykarel | one of them was tripleo meeting | 15:03 |
| ykarel | so /me will be there tomorrow | 15:03 |
| weshay|ruck | ykarel, ya.. for that kind of change.. best that we have rdo reps in #tripleo | 15:03 |
| weshay|ruck | ykarel++ | 15:03 |
| ykarel | yes /me agree | 15:04 |
| weshay|ruck | thanks | 15:04 |
| ykarel | weshay|ruck, didn'g get we could bolster the component pipeline and save us all a lot of work part | 15:04 |
| chandankumar | weshay|ruck, rlandy we reached to undercloud install failure on fs01 ovb https://logserver.rdoproject.org/32/25332/23/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/dbec4c6/logs/undercloud/home/zuul/undercloud_install.log.txt.gz | 15:04 |
| chandankumar | weshay|ruck, rlandy sshnaidm|pto is doing something in background | 15:05 |
| weshay|ruck | ykarel, ya.. I don't think we have a lot people in context of what the components and component pipeline does | 15:05 |
| rlandy | chandankumar: ack ... always | 15:05 |
| weshay|ruck | ykarel, happy to spread that knowledge 1-1 if you want | 15:05 |
| rlandy | weshay|ruck: we should road show that | 15:05 |
| weshay|ruck | ykarel, https://hackmd.io/5uYRmLaOTI2raTbHWsaiSQ | 15:05 |
| *** skramaja has quit IRC | 15:05 | |
| chandankumar | weshay|ruck, may be having a demo call in community meeting will save it | 15:05 |
| chandankumar | regarding components | 15:05 |
| rlandy | instead of explaining it to everyone separately | 15:06 |
| weshay|ruck | chandankumar, not sure if right now is the time | 15:06 |
| weshay|ruck | to prepare a demo | 15:06 |
| weshay|ruck | taking too much live fire | 15:06 |
| weshay|ruck | chandankumar, I would rather focus on adding jobs to the pipeline for a large diff | 15:06 |
| chandankumar | weshay|ruck, once we get the pipeline up then | 15:06 |
| weshay|ruck | chandankumar, it's up | 15:06 |
| chandankumar | whole c8 pipeline | 15:07 |
| ykarel | weshay|ruck, i think i know some of the parts of it, but will go through that hackmd to get everything | 15:07 |
| weshay|ruck | chandankumar, atm.. the important bit is the component pipeline.. which is up | 15:07 |
| chandankumar | weshay|ruck, aye | 15:07 |
| weshay|ruck | nothing like testing a theory with a d-day event | 15:07 |
| weshay|ruck | hrm.. | 15:12 |
| weshay|ruck | seen this twice now today | 15:12 |
| weshay|ruck | 'tripleo_keystone_resources_data_user': {'heat_stack_domain_admin': {'domain': 'heat_stack'}}, 'ansible_loop_var': 'tripleo_keystone_resources_data_user'}) => changed=false | 15:12 |
| weshay|ruck | 2020-03-02 14:55:31 | ansible_job_id: '137192272725.174220' | 15:12 |
| weshay|ruck | 2020-03-02 14:55:31 | ansible_loop_var: tripleo_keystone_resources_user_role_async_result_item | 15:12 |
| weshay|ruck | 2020-03-02 14:55:31 | attempts: 1 | 15:12 |
| weshay|ruck | 2020-03-02 14:55:31 | finished: 1 | 15:12 |
| weshay|ruck | 2020-03-02 14:55:31 | msg: Must specify either a domain or project | 15:12 |
| weshay|ruck | 2020-03-02 14:55:31 | tripleo_keystone_resources_user_role_async_result_item: | 15:12 |
| weshay|ruck | ykarel, just hit ur change | 15:12 |
| weshay|ruck | https://review.opendev.org/#/c/710727/ | 15:12 |
| ykarel | :( | 15:13 |
| chandankumar | ykarel, https://review.opendev.org/709959 might fix or might not fix it | 15:13 |
| ykarel | damn ansible-2.9.1-1.el8.ans.noarch is there | 15:13 |
| ykarel | so something wrong | 15:13 |
| ykarel | me checks on repo side | 15:14 |
| ykarel | omg repo reset | 15:14 |
| ykarel | https://trunk.rdoproject.org/centos8-master/delorean-deps.repo | 15:14 |
| ykarel | deps-new changed to deps | 15:14 |
| ykarel | we need to fix it | 15:14 |
| chandankumar | ykarel, ah it is going affect my image build also | 15:15 |
| ykarel | amoralej|off, jpena ^^ | 15:15 |
| weshay|ruck | rlandy, I think Alex is still working the issue | 15:16 |
| weshay|ruck | re: the hang | 15:16 |
| ykarel | chandankumar, nope https://review.opendev.org/#/c/709959/ should not fix that iirc different issue was hit with ansible-2.9 | 15:16 |
| ykarel | 'str' one | 15:16 |
| rlandy | weshay|ruck: is there a link or something I can follow? | 15:16 |
| jpena | ykarel, chandankumar: I've changed the delorean-deps.repo file again | 15:20 |
| jpena | not sure how it got reset | 15:20 |
| ykarel | jpena, may be due to trunk-centos8 was not changed? | 15:21 |
| ykarel | jpena, Thanks | 15:21 |
| chandankumar | jpena, thanks! | 15:21 |
| jpena | ykarel:hm, that could be related. I'll check it later today | 15:21 |
| ykarel | jpena, ack | 15:21 |
| *** dsneddon has joined #oooq | 15:23 | |
| *** dsneddon has quit IRC | 15:28 | |
| *** goneri_ has joined #oooq | 15:28 | |
| *** goneri_ has quit IRC | 15:28 | |
| chandankumar | rlandy, I will update the review tomorrow morning, logging out now | 15:35 |
| chandankumar | rlandy, weshay|ruck anything need drop me an email | 15:35 |
| rlandy | chandankumar: I'm on it .. | 15:35 |
| rlandy | will leave you a review | 15:36 |
| chandankumar | Have a nice day & night ahead | 15:36 |
| rlandy | goodnight | 15:36 |
| *** chandankumar is now known as raukadah | 15:36 | |
| raukadah | rlandy, thanks! | 15:36 |
| panda | lol, my check to check if code would leak passwords worked. :) | 15:38 |
| weshay|ruck | raukadah, thanks | 15:38 |
| weshay|ruck | panda, nice | 15:39 |
| *** sshnaidm|pto has quit IRC | 15:41 | |
| *** sshnaidm|pto has joined #oooq | 15:55 | |
| *** dmellado has quit IRC | 15:57 | |
| *** dmellado has joined #oooq | 16:00 | |
| *** dsneddon has joined #oooq | 16:00 | |
| *** dmellado has quit IRC | 16:18 | |
| *** dmellado has joined #oooq | 16:20 | |
| *** ykarel is now known as ykarel|away | 16:23 | |
| weshay|ruck | rlandy, hooo ray | 16:26 |
| weshay|ruck | multinode worked | 16:26 |
| weshay|ruck | and fs027 | 16:27 |
| weshay|ruck | nice | 16:27 |
| rlandy | weshay|ruck: it does sometimes | 16:27 |
| rlandy | running again | 16:27 |
| weshay|ruck | rlandy, let's get in check | 16:27 |
| weshay|ruck | non-voting | 16:27 |
| rlandy | trying to get consistent passing | 16:28 |
| rlandy | weshay|ruck: ack - agree ... waiting for one review to merge ... | 16:28 |
| rlandy | https://review.opendev.org/#/c/710230/ | 16:28 |
| * rlandy has review already to add to pipeline ... | 16:28 | |
| rlandy | https://review.rdoproject.org/r/25549 | 16:29 |
| rlandy | adding non-voting | 16:30 |
| weshay|ruck | rlandy, k.. periodic doesn't matter | 16:30 |
| weshay|ruck | rlandy, upstream check... non-voting is done in tripleo-ci | 16:31 |
| rlandy | weshay|ruck: ack - updating the tripleo-ci review | 16:31 |
| weshay|ruck | :) | 16:31 |
| rlandy | weshay|ruck: https://review.rdoproject.org/r/#/c/25414/ and https://review.rdoproject.org/r/#/c/25366/ can merge after https://review.opendev.org/710230 does | 16:37 |
| rlandy | and then https://review.rdoproject.org/r/#/c/25549/ | 16:38 |
| * weshay|ruck looks | 16:38 | |
| weshay|ruck | rlandy, we can merge into rdo for sure.. once dep patches merge | 16:40 |
| rlandy | weshay|ruck: ack | 16:40 |
| rlandy | while those run- updating image build for merge | 16:41 |
| *** dmellado has quit IRC | 16:46 | |
| rlandy | ykarel|away: when you get back ... could we get your sharp-review eyes on https://review.opendev.org/#/c/710179/? thanks | 16:47 |
| *** dmellado has joined #oooq | 16:49 | |
| rlandy | weshay|ruck: just fyi ... created a bit of a 'chicken and egg' situation ... merging https://review.rdoproject.org/r/#/c/25611/ to test the rdo-jobs reparenting | 16:51 |
| *** jmasud has quit IRC | 16:54 | |
| weshay|ruck | rlandy, need eyes? | 16:54 |
| rlandy | weshay|ruck: on https://review.opendev.org/#/c/710179/ pls | 16:55 |
| *** jmasud has joined #oooq | 16:55 | |
| weshay|ruck | rlandy, looks good in zuul for master | 16:56 |
| weshay|ruck | rlandy, best way to make sure it's doing what we want.. is to open a fake test patch on tht for train... w/ a depends-on https://review.opendev.org/#/c/710179/7/zuul.d/multinode-jobs.yaml | 16:57 |
| rlandy | train?? | 16:57 |
| rlandy | oh to test it doesn't kick | 16:57 |
| rlandy | yep | 16:57 |
| weshay|ruck | rlandy, right.. to make sure you see centos-7 in train and centos-8 in master | 16:57 |
| rlandy | will do | 16:57 |
| weshay|ruck | I see centos-8 in master atm | 16:57 |
| rlandy | that is right | 16:57 |
| weshay|ruck | k | 16:58 |
| rlandy | just putting in build-image test - then will check that | 16:59 |
| *** dmellado has quit IRC | 17:01 | |
| *** dsneddon has quit IRC | 17:03 | |
| rlandy | weshay|ruck: any issue with testing periodic-tripleo-centos-8-buildimage-overcloud-full-master - and have it upload the image? | 17:06 |
| weshay|ruck | rlandy, nope.. no ovb jobs afaik | 17:06 |
| weshay|ruck | go 4 it | 17:06 |
| rlandy | here goes | 17:07 |
| *** dmellado has joined #oooq | 17:07 | |
| jpena | ykarel|away: just confirmed it: the delorean-deps.repo issue was caused by the weekend rsync after purging. It was synced from trunk-centos8 (where it was not changed) to trunk. IIRC amoralej was planning to make the change permanent this week, so we won't have to worry about it again | 17:07 |
| *** tesseract has quit IRC | 17:16 | |
| *** dmellado has quit IRC | 17:19 | |
| ykarel|away | jpena, ack Thanks for checking and confirming, yes Alfredo will be changing that permanently on wednesday | 17:21 |
| *** udesale has quit IRC | 17:24 | |
| *** dmellado has joined #oooq | 17:25 | |
| *** matbu has quit IRC | 17:28 | |
| *** bogdando has quit IRC | 17:30 | |
| *** dsneddon has joined #oooq | 17:37 | |
| *** jpena is now known as jpena|off | 17:39 | |
| *** dsneddon has quit IRC | 17:42 | |
| rlandy | https://review.opendev.org/#/c/710230/ - failed gate | 17:49 |
| rlandy | :( | 17:49 |
| rlandy | tripleo-ci-centos-7-containers-multinode killing us | 17:50 |
| * weshay|ruck looks | 17:53 | |
| *** matbu has joined #oooq | 18:00 | |
| *** saneax has quit IRC | 18:03 | |
| *** derekh has quit IRC | 18:05 | |
| weshay|ruck | rlandy, ping me when you have a second | 18:07 |
| rlandy | weshay|ruck: ping | 18:07 |
| weshay|ruck | rlandy, https://meet.google.com/tyv-whnn-niw?authuser=1 | 18:07 |
| *** dsneddon has joined #oooq | 18:11 | |
| *** dsneddon has quit IRC | 18:16 | |
| rlandy | https://review.rdoproject.org/r/#/c/24995/ - all green on image-builds :) | 18:30 |
| weshay|ruck | rlandy, should be upstream though.. not third party | 18:42 |
| weshay|ruck | in tripleo-ci | 18:43 |
| rlandy | weshay|ruck: what part? | 18:43 |
| weshay|ruck | rlandy, https://review.rdoproject.org/r/#/c/24997/ | 18:43 |
| rlandy | weshay|ruck: here is the upstream job I am updating now ... https://review.opendev.org/#/c/708599 | 18:43 |
| rlandy | iiuc, we need both | 18:44 |
| weshay|ruck | rlandy, need periodic in rdo | 18:44 |
| weshay|ruck | but not check | 18:44 |
| *** dsneddon has joined #oooq | 18:44 | |
| weshay|ruck | check can be 100% upstream | 18:44 |
| rlandy | weshay|ruck: ok - I'll update after submitting upstream review | 18:45 |
| weshay|ruck | thanks | 18:45 |
| *** dsneddon has quit IRC | 18:49 | |
| rlandy | weshay|ruck: do buildimage jobs run on branches? | 18:52 |
| rlandy | iow - do we keep the centos-7 ones alive? | 18:52 |
| rlandy | https://review.opendev.org/#/c/708599/37/zuul.d/layout.yaml | 18:52 |
| rlandy | see comment here | 18:52 |
| rlandy | only for stein/train? | 18:53 |
| rlandy | or is thing an only master thing> | 18:53 |
| *** apetrich has quit IRC | 18:56 | |
| rlandy | all periodic are in https://review.rdoproject.org/r/#/c/25611/ and merged - so we can just abandon https://review.rdoproject.org/r/#/c/24997/ | 18:57 |
| weshay|ruck | rlandy, I think the same thing you did for multinode | 19:02 |
| weshay|ruck | on the job def.. define both.. limit branches | 19:02 |
| rlandy | weshay|ruck: when did we start image builds - stein and train? | 19:02 |
| rlandy | or include rocky etc. | 19:02 |
| weshay|ruck | stein sounds right | 19:03 |
| * weshay|ruck looks | 19:03 | |
| rlandy | right now it runs on all - repeating that | 19:03 |
| weshay|ruck | rlandy, https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/base.yaml#L532 | 19:04 |
| *** dtantsur is now known as dtantsur|afk | 19:04 | |
| weshay|ruck | rlandy, oh.. ya.. guess it can run on all | 19:04 |
| weshay|ruck | duh sorry | 19:04 |
| rlandy | no worries - done | 19:04 |
| *** apetrich has joined #oooq | 19:05 | |
| *** dsneddon has joined #oooq | 19:16 | |
| *** dsneddon has quit IRC | 19:21 | |
| rlandy | weshay|ruck: pls review https://review.opendev.org/#/c/708599/ - I abandoned https://review.rdoproject.org/r/#/c/24997/ - all the periodic jobs were merged in https://review.rdoproject.org/r/#/c/25611/ | 19:22 |
| weshay|ruck | trade ya https://review.opendev.org/710856 | 19:22 |
| * weshay|ruck looks | 19:23 | |
| rlandy | k | 19:23 |
| rlandy | weshay|ruck: https://review.opendev.org/#/c/710856 - see correction comment | 19:25 |
| weshay|ruck | ah doh | 19:26 |
| weshay|ruck | thanks | 19:26 |
| rlandy | weshay|ruck: one more - missing in the gate | 19:27 |
| rlandy | weshay|ruck: this scenario002 failure ... https://93a6318a5831867cd2d8-25456b362a22ad76281304acb8641637.ssl.cf5.rackcdn.com/710506/3/check/tripleo-ci-centos-8-scenario002-standalone/2b3750c/logs/undercloud/home/zuul/standalone_deploy.log - it's the same one you're investigating? | 19:45 |
| * weshay|ruck looks | 19:47 | |
| weshay|ruck | rlandy, ya.. 2020-03-02 14:36:34 | msg: Must specify either a domain or project | 19:47 |
| weshay|ruck | should be fixed as of 1.5hrs ago | 19:48 |
| rlandy | same one? | 19:48 |
| weshay|ruck | retrigger | 19:48 |
| weshay|ruck | ya | 19:48 |
| rlandy | only shows up on THT though | 19:48 |
| rlandy | he did | 19:48 |
| *** chem has quit IRC | 19:48 | |
| *** chem has joined #oooq | 19:51 | |
| *** dsneddon has joined #oooq | 19:56 | |
| *** dsneddon has quit IRC | 20:01 | |
| rlandy | weshay|ruck: so we're pretty much waiting on zuul now - what's next? | 20:05 |
| rlandy | looks like sshnaidm|pto is working on ovb in the background | 20:05 |
| rlandy | standalone tempest? | 20:05 |
| *** dsneddon has joined #oooq | 20:06 | |
| weshay|ruck | rlandy, the full tempest job? | 20:13 |
| *** derekh has joined #oooq | 20:14 | |
| rlandy | weshay|ruck: yeah | 20:15 |
| weshay|ruck | rlandy, there is also multinode-container-scenario000-updates | 20:15 |
| weshay|ruck | either is a good place to continue | 20:15 |
| *** jfrancoa has quit IRC | 20:15 | |
| * rlandy checks in on latest in ovb ... | 20:15 | |
| weshay|ruck | multinode job started upstream http://zuul.openstack.org/stream/082dad356e4049dba782287fc5ab7383?logfile=console.log | 20:16 |
| rlandy | weshay|ruck: checkout the latest failure in https://review.rdoproject.org/r/#/c/25332/ | 20:16 |
| * weshay|ruck watches | 20:16 | |
| rlandy | https://logserver.rdoproject.org/32/25332/23/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/1a9bf8e/logs/undercloud/home/zuul/undercloud_install.log.txt.gz | 20:16 |
| rlandy | infra | 20:16 |
| weshay|ruck | rlandy, ya Error message: Invalid local_interface specified. eth1 is not available. | 20:18 |
| weshay|ruck | I have that marked in the etherpad | 20:18 |
| weshay|ruck | rlandy, or heat template? | 20:18 |
| rlandy | weshay|ruck: kind of lost track of OVB - wil have to touch base with sshnaidm|pto and pcik that up tomorrow | 20:18 |
| rlandy | looks like he is active there | 20:18 |
| rlandy | I saw that error yesterday as well | 20:18 |
| *** derekh has quit IRC | 20:23 | |
| weshay|ruck | rlandy, well.. I guess the first thing would be to check the nics in the logs, then the heat call | 20:27 |
| rlandy | eth1 should be the control plane | 20:28 |
| weshay|ruck | rlandy, on the undercloud? | 20:28 |
| *** dsneddon_ has joined #oooq | 20:28 | |
| * weshay|ruck looks in a sec | 20:29 | |
| rlandy | weshay|ruck: I hate to say it - but it would be nice to reprovision a bm machine with centos -8 and work there | 20:29 |
| weshay|ruck | rlandy, ah ya | 20:29 |
| weshay|ruck | could do that too | 20:29 |
| rlandy | then the machine stays up | 20:29 |
| * rlandy shoots myself for saying so | 20:30 | |
| rlandy | but it's probably the easiest debug | 20:30 |
| weshay|ruck | I think so as well | 20:31 |
| weshay|ruck | rlandy, it's just the diff between centos-7 and 8 w/ nic names https://logserver.rdoproject.org/32/25332/23/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/1a9bf8e/logs/undercloud/var/log/extra/network.txt.gz | 20:35 |
| weshay|ruck | https://logserver.rdoproject.org/59/709959/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/e50534d/logs/undercloud/var/log/extra/network.txt.gz | 20:35 |
| weshay|ruck | rlandy, the centos-8 images could have | 20:36 |
| weshay|ruck | Look for GRUB_CMDLINE_LINUX and add the following net.ifnames=0. | 20:36 |
| weshay|ruck | https://www.itzgeek.com/how-tos/linux/centos-how-tos/how-to-change-network-interface-name-to-eth0-on-centos-8-rhel-8.html | 20:36 |
| weshay|ruck | then it would probably work fine | 20:37 |
| *** dsneddon_ has quit IRC | 20:48 | |
| *** dsneddon has quit IRC | 20:50 | |
| *** dsneddon has joined #oooq | 20:50 | |
| *** jmasud has quit IRC | 20:53 | |
| *** jmasud has joined #oooq | 20:55 | |
| rlandy | weshay|ruck: going to try update the bm undercloud box that runs master | 20:58 |
| rlandy | and run a job there | 20:58 |
| rlandy | if it's too much work, I'll punt it to nxt sprint | 20:58 |
| weshay|ruck | rlandy, you'll have to do the same thing on a centos box | 21:00 |
| weshay|ruck | centos-8 box | 21:00 |
| weshay|ruck | turn ifnames=0 | 21:00 |
| rlandy | oh really? | 21:00 |
| weshay|ruck | think so.. for the undercloud vm at least | 21:01 |
| rlandy | then we might as well just get this ight on ovb | 21:02 |
| *** Tengu has quit IRC | 21:13 | |
| *** Tengu has joined #oooq | 21:15 | |
| rlandy | periodic-tripleo-ci-centos-8-standalone-full-tempest-master exits | 21:24 |
| rlandy | let's test it | 21:24 |
| rlandy | https://review.rdoproject.org/r/#/c/25325/ - tempest testing ... added to hackmd | 21:31 |
| rlandy | weshay|ruck: ^^ | 21:31 |
| rlandy | starting updates | 21:31 |
| weshay|ruck | thanks | 21:33 |
| rlandy | what's the end story with ovb? did anyone changes DIB yet? - should we put in that review? | 21:40 |
| rlandy | weshay|ruck: ^^ | 21:40 |
| weshay|ruck | sec talking to ade | 21:40 |
| *** matbu has quit IRC | 22:05 | |
| *** matbu has joined #oooq | 22:06 | |
| rlandy | zuul needs a fast pass lane like the disney parks - for when you are desperate enough to pay to get your patch through | 22:12 |
| weshay|ruck | rlandy, heh | 22:17 |
| weshay|ruck | totally.. so we don't have any bugs on the undercloud hang right? | 22:18 |
| rlandy | weshay|ruck: no - we should though | 22:18 |
| rlandy | writing that up | 22:18 |
| weshay|ruck | k.. latest http://zuul.openstack.org/stream/082dad356e4049dba782287fc5ab7383?logfile=console.log | 22:19 |
| rlandy | yep - starting bug | 22:19 |
| *** jbadiapa has quit IRC | 22:37 | |
| weshay|ruck | rlandy, reference https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/8/html/configuring_and_managing_networking/consistent-network-interface-device-naming_configuring-and-managing-networking | 22:47 |
| *** Tengu has quit IRC | 23:35 | |
| *** Tengu has joined #oooq | 23:36 | |
| rlandy | weshay|ruck: rekicked https://review.rdoproject.org/r/#/c/25332/ with new depends=on | 23:41 |
| rlandy | lets' see how far that gets | 23:42 |
| *** tosky has quit IRC | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!