*** yamamoto has joined #oooq | 00:12 | |
*** jbadiapa has quit IRC | 00:21 | |
*** yamamoto has quit IRC | 00:28 | |
*** yamamoto has joined #oooq | 00:31 | |
*** jbadiapa has joined #oooq | 00:34 | |
*** yamamoto has quit IRC | 01:00 | |
*** yamamoto has joined #oooq | 01:01 | |
*** yamamoto has quit IRC | 01:01 | |
*** yamamoto has joined #oooq | 01:16 | |
*** yamamoto has quit IRC | 01:24 | |
*** yamamoto has joined #oooq | 01:50 | |
*** yamamoto has quit IRC | 02:09 | |
*** zbr has quit IRC | 02:22 | |
*** ysandeep has joined #oooq | 02:23 | |
*** zbr has joined #oooq | 02:34 | |
*** ysandeep has quit IRC | 02:41 | |
*** zbr is now known as Guest413 | 02:49 | |
*** zbr has joined #oooq | 02:49 | |
*** zbr is now known as Guest414 | 02:53 | |
*** zbr has joined #oooq | 02:53 | |
*** Guest413 has quit IRC | 02:53 | |
*** Guest414 has quit IRC | 02:57 | |
*** zbr has quit IRC | 03:01 | |
*** zbr has joined #oooq | 03:02 | |
*** yamamoto has joined #oooq | 04:11 | |
*** frenzy_friday has quit IRC | 04:25 | |
*** frenzy_friday has joined #oooq | 04:25 | |
*** ysandeep has joined #oooq | 04:46 | |
*** ysandeep is now known as ysandeep|ruck | 05:01 | |
*** marios has joined #oooq | 05:14 | |
*** slaweq has joined #oooq | 06:17 | |
*** bhagyashris has joined #oooq | 06:34 | |
*** bhagyashris has quit IRC | 06:35 | |
*** bhagyashris has joined #oooq | 06:35 | |
*** bhagyashris has quit IRC | 06:35 | |
*** bhagyashris has joined #oooq | 06:35 | |
*** bhagyashris_ has joined #oooq | 06:37 | |
*** bhagyashris has quit IRC | 06:37 | |
*** bhagyashris_ has quit IRC | 06:37 | |
*** bhagyashris has joined #oooq | 06:37 | |
*** jbadiapa has quit IRC | 07:02 | |
*** jbadiapa has joined #oooq | 07:02 | |
*** amoralej|off has joined #oooq | 07:16 | |
*** amoralej|off is now known as amoralej | 07:19 | |
*** jpena|off is now known as jpena | 07:26 | |
arxcruz | namaste ysandeep|ruck | 07:32 |
---|---|---|
*** arxcruz is now known as arxcruz|rover | 07:32 | |
ysandeep|ruck | arxcruz|rover, hello very good morning | 07:34 |
arxcruz|rover | ysandeep|ruck: so, my patrch did not work after all | 07:34 |
arxcruz|rover | just saw yours | 07:34 |
arxcruz|rover | i assume yours works right ? | 07:34 |
ysandeep|ruck | arxcruz|rover, yes it works.. tested in testproject: https://logserver.rdoproject.org/46/28446/41/check/periodic-tripleo-ci-build-containers-ubi-8-push-victoria/171f1d2/etc/yum.repos.d/CentOS-Stream-AppStream.repo | 07:35 |
arxcruz|rover | great, let's merge it asap | 07:35 |
ysandeep|ruck | We are hitting bug: https://bugs.launchpad.net/tripleo/+bug/1930327 | 07:35 |
opendevmeet | Launchpad bug 1930327 in tripleo "Container build is failing with error: /usr/share/ovn/scripts/ovndb-servers.ocf from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64" [Critical,Triaged] | 07:35 |
arxcruz|rover | marios: https://review.opendev.org/c/openstack/tripleo-ci/+/793815 i know you already +2 but would it be possible to +w even without a second core? we are in a hurry and it's blocking us | 07:35 |
ysandeep|ruck | worked that out ykarel.. we are awaiting for upstream mirror sync | 07:36 |
ysandeep|ruck | arxcruz|rover: we need to wait, we have -1 from zuul because of above bug | 07:36 |
arxcruz|rover | oh | 07:36 |
arxcruz|rover | :/ | 07:36 |
ysandeep|ruck | arxcruz|rover, comment#3 of bug have more details | 07:37 |
marios | arxcruz|rover: ack but zuul is -1 on that | 07:37 |
ysandeep|ruck | marios, thanks, yes we need to wait for upstream infra mirror sync. | 07:38 |
ysandeep|ruck | arxcruz|rover, fyi.. i noticed some interesting conversation around msr issue from last thursday's chat http://eavesdrop.openstack.org/irclogs/%23tripleo/%23tripleo.2021-05-27.log.html#t2021-05-27T15:51:10 | 07:41 |
ysandeep|ruck | arxcruz|rover: I am thinking about if we can virt-customize the overcloud-full image and set root password. | 07:43 |
ysandeep|ruck | And when issue appears, we take console access of overcloud node which failed and see why ping/ssh not working. | 07:43 |
*** ysandeep|ruck is now known as ysandeep|lunch | 07:47 | |
* ysandeep|lunch afk for lunch | 07:47 | |
*** tosky has joined #oooq | 07:48 | |
*** tosky has quit IRC | 07:48 | |
*** tosky has joined #oooq | 08:08 | |
*** derekh has joined #oooq | 08:14 | |
*** ysandeep|lunch has quit IRC | 08:16 | |
*** ysandeep|lunch has joined #oooq | 08:46 | |
*** ysandeep|lunch is now known as ysandeep|ruck | 08:46 | |
*** pojadhav has joined #oooq | 09:22 | |
zbr | what is the official channel of quay? | 09:27 |
zbr | (network) | 09:27 |
*** sshnaidm|off is now known as sshnaidm | 09:57 | |
*** sshnaidm has joined #oooq | 09:58 | |
*** yamamoto has quit IRC | 10:11 | |
*** yamamoto has joined #oooq | 10:28 | |
*** yamamoto has quit IRC | 10:52 | |
*** ykarel has joined #oooq | 11:04 | |
*** yamamoto has joined #oooq | 11:26 | |
*** bhagyashris_ has joined #oooq | 11:29 | |
*** jpena is now known as jpena|lunch | 11:32 | |
*** bhagyashris has quit IRC | 11:36 | |
*** yamamoto has quit IRC | 11:42 | |
*** rlandy_ has joined #oooq | 11:45 | |
*** yamamoto has joined #oooq | 11:49 | |
*** sshnaidm has quit IRC | 11:51 | |
*** dviroel has joined #oooq | 11:57 | |
*** sshnaidm has joined #oooq | 11:59 | |
*** jbadiapa has quit IRC | 12:07 | |
*** jbadiapa has joined #oooq | 12:09 | |
weshay|ruck | ysandeep|ruck, arxcruz|rover 0/ in a mtg.. but we should catch up before you folks disappear | 12:11 |
ysandeep|ruck | weshay|ruck, :) sure i am here for couple of hours.. | 12:11 |
arxcruz|rover | ysandeep|ruck: weshay|ruck when you guys want :) | 12:15 |
weshay|ruck | https://review.rdoproject.org/r/c/rdoinfo/+/33924 | 12:17 |
weshay|ruck | we need this now eh? | 12:17 |
arxcruz|rover | weshay|ruck: yes, and the fix on ubi8 push containers job | 12:18 |
ysandeep|ruck | weshay|ruck, we have removed ovn-2021 for now, mirror sync will solve that (next mirror sync ~1.30 hr) | 12:19 |
weshay|ruck | ++ | 12:20 |
*** rlandy_ is now known as rlandy | 12:22 | |
*** amoralej is now known as amoralej|lunch | 12:25 | |
*** yamamoto has quit IRC | 12:26 | |
*** jpena|lunch is now known as jpena | 12:29 | |
weshay|ruck | arxcruz|rover, ysandeep|ruck we'll need to engage Amol this week and promote some branches w/o ovb | 12:30 |
weshay|ruck | seems like master is alive again.. let's focus guns there | 12:30 |
rlandy | ysandeep|ruck: arxcruz|rover: https://review.opendev.org/c/openstack/tripleo-quickstart/+/792818 ... fyi | 12:31 |
rlandy | pls review | 12:31 |
ysandeep|ruck | weshay|ruck, ack o/ yesterday finally we solved fs39 issues.. | 12:33 |
ysandeep|ruck | weshay|ruck, Earlier tripleo-repos didn't fix t/u/v container build https://review.opendev.org/c/openstack/tripleo-repos/+/793157 didn't help, I have posted: https://review.opendev.org/c/openstack/tripleo-ci/+/793815 | 12:33 |
arxcruz|rover | rlandy: is this the reason we still seeing the edk2 | 12:33 |
ysandeep|ruck | rlandy: looking | 12:33 |
rlandy | arxcruz|rover: ^^ should only impact component jobs | 12:33 |
*** yamamoto has joined #oooq | 12:34 | |
ysandeep|ruck | rlandy, +1 | 12:34 |
rlandy | ysandeep|ruck: weshay|ruck: updated environment ... https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/242844 | 12:38 |
ysandeep|ruck | rlandy, ack, added in my review list | 12:39 |
rlandy | ysandeep|ruck: one more .. still cleaning up ... but we have the list of updated containers ... | 12:39 |
rlandy | https://logserver.rdoproject.org/53/18953/64/check/periodic-tripleo-ci-centos-8-standalone-network-master/4d812da/logs/undercloud/home/zuul/container_image_update_output.log.txt.gz | 12:40 |
rlandy | ysandeep|ruck: ^^ | 12:40 |
rlandy | so we can see if no containers get updated | 12:40 |
rlandy | https://review.opendev.org/c/openstack/ansible-role-tripleo-modify-image/+/793234/ | 12:40 |
rlandy | cleaning that up to make sure it's mergeable | 12:40 |
ysandeep|ruck | rlandy: nice | 12:41 |
rlandy | that should be all the reviews for container updates | 12:41 |
ysandeep|ruck | rlandy++ i really like the buildah mount idea there | 12:43 |
*** ysandeep|ruck is now known as ysandeep|brb | 12:43 | |
rlandy | ysandeep|ruck: yeah - tried a bunch of things - that was the only one that worked | 12:43 |
* ysandeep|brb brb in 10-15 mins | 12:43 | |
*** tbarron has quit IRC | 12:52 | |
*** amoralej|lunch is now known as amoralej | 12:57 | |
*** ysandeep|brb is now known as ysandeep|ruck | 12:57 | |
ysandeep|ruck | rlandy, weshay|ruck fyi.. downstream is in pretty bad shape.. tempest failure.. ssh to instance failing.. slaweq helped and we trying new ovn to see if it fix the issue .. https://code.engineering.redhat.com/gerrit/c/testproject/+/211643 | 12:58 |
rlandy | ysandeep|ruck: k- will pick that up | 12:58 |
ysandeep|ruck | weshay|ruck, 1:1 time if you are out of mtgs | 13:01 |
weshay|ruck | ya.. need 2 min | 13:02 |
*** tbarron has joined #oooq | 13:07 | |
bhagyashris_ | arxcruz|rover, , zbr, sshnaidm, rlandy, marios, ysandeep|ruck , bhagyashris, svyas, soniya29, pojadhav, akahat, weshay|ruck , chandankumar, frenzy_friday | 13:20 |
bhagyashris_ | TripleO CI Community Meeting | 13:20 |
bhagyashris_ | in 10 mins | 13:20 |
bhagyashris_ | feel free to add topics here https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2021-06-01-Community-call @line no 30 | 13:21 |
zbr | bhagyashris_: my calendar entry for community meeting still has bluejeans url, is this valid? | 13:22 |
*** bhagyashris_ is now known as bhagyashris | 13:22 | |
bhagyashris | zbr nop | 13:23 |
bhagyashris | nope | 13:23 |
bhagyashris | zbr see in the invite you declined the community meeting | 13:24 |
bhagyashris | i mean it's showing | 13:24 |
bhagyashris | Automatically declined due to event conflict | 13:24 |
bhagyashris | this is our gmeet url: https://meet.google.com/bqx-xwht-wky?authuser=0 | 13:26 |
rlandy | sshnaidm: when did we start running podman/buildah? train 8? | 13:33 |
sshnaidm | even in 7 I think | 13:34 |
* rlandy wants to check if we need the dnf/yum switch for container updates | 13:34 | |
sshnaidm | yum should be symlink to dnf in 8 I think? | 13:35 |
*** jlarriba has quit IRC | 13:37 | |
rlandy | https://review.opendev.org/c/openstack/ansible-role-tripleo-modify-image/+/793234/24/tasks/yum_update_buildah.yml#158 | 13:37 |
rlandy | sshnaidm: ^^ | 13:37 |
rlandy | using \$(command -v dnf || command -v yum) isn't working | 13:37 |
rlandy | for the bash -c | 13:37 |
rlandy | maybe using yum is safe | 13:37 |
rlandy | for all | 13:38 |
*** jlarriba has joined #oooq | 13:50 | |
weshay|ruck | arxcruz|rover, https://opendev.org/openstack/ansible-role-collect-logs/src/branch/master/roles/collect_logs/defaults/main.yml#L414 | 13:58 |
*** gouthamr_ has joined #oooq | 14:35 | |
*** gouthamr has joined #oooq | 14:47 | |
*** dviroel is now known as dviroel|lunch | 15:04 | |
*** ykarel is now known as ykarel|away | 15:09 | |
*** gouthamr_ has quit IRC | 15:12 | |
*** gouthamr has quit IRC | 15:13 | |
*** gouthamr has joined #oooq | 15:14 | |
*** gouthamr is now known as identify | 15:18 | |
*** gouthamr has joined #oooq | 15:20 | |
*** ykarel|away has quit IRC | 15:20 | |
*** identify has quit IRC | 15:20 | |
weshay|ruck | arxcruz|rover, got the same thing.. not bootable | 15:37 |
weshay|ruck | arxcruz|rover, I think you need to add the kernel from ipa image | 15:40 |
* weshay|ruck tries | 15:40 | |
arxcruz|rover | weshay|ruck: ok | 15:40 |
weshay|ruck | arxcruz|rover, that dumped me into emergency mode | 15:47 |
weshay|ruck | arxcruz|rover, nothing is easy right? | 15:47 |
arxcruz|rover | weshay|ruck: same here | 15:47 |
arxcruz|rover | with the initramfs from overcloud-full got emergency mode | 15:47 |
arxcruz|rover | with the ipa one i got kernel panic | 15:47 |
weshay|ruck | arxcruz|rover, I wonder if this would be easier.. if we uploaded the image to openstack and tried to boot that way | 15:49 |
weshay|ruck | but.. meh | 15:49 |
weshay|ruck | changing the passwd should be easy enough | 15:49 |
weshay|ruck | arxcruz|rover, let's short cut this | 15:50 |
arxcruz|rover | weshay|ruck: i did it! | 15:50 |
weshay|ruck | arxcruz|rover, you got it? | 15:50 |
arxcruz|rover | weshay|ruck: need to pass root=/dev/sda1 | 15:50 |
arxcruz|rover | in the kernel parameters | 15:50 |
* weshay|ruck tries | 15:50 | |
weshay|ruck | I wonder what the default is.. /dev/sdb | 15:51 |
* ysandeep|ruck reading email weshay|ruck talked about | 15:51 | |
weshay|ruck | arxcruz|rover, so you specified the kernel path, initd and kernel args? | 15:56 |
weshay|ruck | and got to a login? | 15:56 |
arxcruz|rover | weshay|ruck: yes, i got into the login, but isn't working | 15:56 |
arxcruz|rover | the password says it's incorrect | 15:57 |
weshay|ruck | ah.. k.. well.. glad the local boot is working to check | 15:57 |
ysandeep|ruck | i think we just need to virt-customize overcloud-full | 16:00 |
*** marios has quit IRC | 16:02 | |
arxcruz|rover | weshay|ruck: is the user root ? | 16:06 |
arxcruz|rover | ysandeep|ruck: i did the virt-customize on overcloud-full | 16:06 |
ysandeep|ruck | arxcruz|rover, ack o/ | 16:06 |
*** ysandeep|ruck is now known as ysandeep|dinner | 16:06 | |
*** ykarel|away has joined #oooq | 16:11 | |
*** dviroel|lunch is now known as dviroel | 16:11 | |
weshay|ruck | arxcruz|rover, ya.. we want root | 16:13 |
weshay|ruck | arxcruz|rover, can you INTERNALLY paste the virt customize the command http://pastebin.test.redhat.com/ | 16:14 |
arxcruz|rover | weshay|ruck: i'm using virt manager | 16:14 |
arxcruz|rover | you want me share my screen with you? | 16:14 |
arxcruz|rover | it's weird because the virt-cat is showing the root password changed | 16:14 |
weshay|ruck | sure | 16:17 |
weshay|ruck | arxcruz|rover, meet.google.com/kox-wmmr-axv | 16:18 |
weshay|ruck | arxcruz|rover, ysandeep|dinner we need to update the zuul config to launch a container build job from tripleo-repos https://review.opendev.org/c/openstack/tripleo-ci/+/793763 | 16:20 |
* weshay|ruck adds | 16:20 | |
*** ykarel|away has quit IRC | 16:26 | |
rlandy | arxcruz|rover: sorry to side track you ... question wrt https://opendev.org/openstack/ansible-role-python_venv_build/src/branch/master/tasks/python_venv_install.yml#L130 | 16:35 |
rlandy | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c53/792474/3/check/tripleo-ci-centos-8-standalone-on-multinode-ipa/c5353ad/job-output.txt | 16:35 |
rlandy | debugging that last ipa failure | 16:35 |
rlandy | would that step use https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c53/792474/3/check/tripleo-ci-centos-8-standalone-on-multinode-ipa/c5353ad/logs/undercloud/etc/pip.conf | 16:36 |
rlandy | not resolving the source to upgrade | 16:36 |
rlandy | 149.202.160.10 mirror.gra1.ovh.opendev.org is added to hosts | 16:37 |
rlandy | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c53/792474/3/check/tripleo-ci-centos-8-standalone-on-multinode-ipa/c5353ad/logs/undercloud/etc/hosts | 16:37 |
rlandy | oh nvm | 16:39 |
rlandy | releases.openstack.org | 16:39 |
rlandy | arxcruz|rover: ^^ sorry - figured it out | 16:40 |
*** jpena is now known as jpena|off | 16:47 | |
*** ysandeep|dinner is now known as ysandeep | 16:59 | |
ysandeep | weshay|ruck, https://review.opendev.org/c/openstack/tripleo-heat-templates/+/793968 this fixes sc03 temporarily.. | 17:00 |
*** derekh has quit IRC | 17:00 | |
ysandeep | weshay|ruck, rlandy looks like new ovn package fixes the issue: https://code.engineering.redhat.com/gerrit/c/testproject/+/211643 | 17:05 |
rlandy | ysandeep: nice | 17:06 |
ysandeep | weshay|ruck, rlandy: wondering if we can merge this as workaround for the meantime(till rel-del bring this via proper channel): https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/244293 .. i can include same workaround in 17 release files as well | 17:10 |
rlandy | ysandeep: weshay|ruck: hmmm ... working around repos is not ideal | 17:18 |
rlandy | we're covering up a real mismatch | 17:19 |
ysandeep | rlandy: yeah let's rel-del fix this properly via rhos-release update | 17:19 |
rlandy | ysandeep: will see when jason returns | 17:20 |
ysandeep | i will fire more jobs in testproject just to make sure i was not lucky and this really fixes the issue. | 17:20 |
rlandy | ok | 17:22 |
*** amoralej is now known as amoralej|off | 17:26 | |
ysandeep | i have updated the trello card to reflect current status | 17:32 |
weshay|ruck | arxcruz|rover, https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-buildimage-overcloud-full-master/b3ab4c0/build_images.sh | 17:45 |
ysandeep | https://review.opendev.org/c/openstack/tripleo-heat-templates/+/793968 - rechecked sc03 temp fix.. failed on random tempest.. badhostkey | 17:53 |
ysandeep | weshay|ruck, would appreciate some eyes on ^^ | 17:54 |
ysandeep | and this one as well https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/792904 | 17:54 |
weshay|ruck | ysandeep, k | 17:54 |
weshay|ruck | arxcruz|rover, https://logserver.rdoproject.org/68/793468/3/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/9808039/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 17:55 |
* ysandeep going to bed(almost mid night) see you tomorrow folks o/ | 17:56 | |
*** ysandeep is now known as ysandeep|away | 17:56 | |
weshay|ruck | ysandeep, that hit a tempest issue.. timeout | 17:56 |
* weshay|ruck rechecks | 17:56 | |
ysandeep|away | i have also posted recheck, few mins back.. :) | 17:57 |
*** ysandeep|away has quit IRC | 18:01 | |
rlandy | msg": "Failed to download metadata for repo 'RDO-CentOS8-deps': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", | 18:11 |
rlandy | ugh | 18:11 |
rlandy | how are we dong that downstream? | 18:11 |
rlandy | doing | 18:11 |
rlandy | weshay|ruck: you all set with the images? | 18:42 |
weshay|ruck | rlandy, ya.. we thought we were on to something, but we werent | 18:54 |
rlandy | weshay|ruck: k | 18:55 |
weshay|ruck | rlandy, ok.. think I'm caught up finally.. that was a morning | 19:14 |
rlandy | weshay|ruck: wow - sure was | 19:14 |
rlandy | weshay|ruck: are we desperate to promote 16.2? | 19:16 |
weshay|ruck | hrm.. | 19:18 |
* weshay|ruck looks | 19:18 | |
weshay|ruck | rlandy, was jjoyce fixing rhos-release? | 19:19 |
rlandy | weshay|ruck: we are discussing now on #rhos-delivery | 19:20 |
*** jlarriba has quit IRC | 20:07 | |
*** jlarriba has joined #oooq | 20:08 | |
*** rlandy has quit IRC | 21:17 | |
*** rlandy has joined #oooq | 21:18 | |
*** tosky has quit IRC | 23:11 | |
*** frenzy_friday has quit IRC | 23:42 | |
*** frenzy_friday has joined #oooq | 23:43 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!