| *** jmasud has quit IRC | 01:05 | |
| *** jmasud has joined #oooq | 01:08 | |
| *** apetrich has quit IRC | 02:10 | |
| *** jmasud has quit IRC | 02:46 | |
| *** sanjayu_ has quit IRC | 02:56 | |
| *** jmasud has joined #oooq | 03:03 | |
| *** jmasud has quit IRC | 03:04 | |
| *** jmasud has joined #oooq | 03:40 | |
| *** ykarel|away has joined #oooq | 03:43 | |
| *** skramaja has joined #oooq | 04:08 | |
| *** ysandeep|away is now known as ysandeep|dol | 04:43 | |
| *** ratailor has joined #oooq | 04:44 | |
| *** rlandy has quit IRC | 04:52 | |
| *** marios has joined #oooq | 05:18 | |
| *** jbadiapa has joined #oooq | 05:30 | |
| *** ykarel|away is now known as ykarel | 05:40 | |
| *** jfrancoa has joined #oooq | 05:43 | |
| *** udesale has joined #oooq | 05:44 | |
| jbadiapa | akahat|ruck, pojadhav|rover: could you take a look at https://zuul.opendev.org/t/openstack/build/30581b19c02d465e89f1e998ae515197/console ? There is an issue regarding tempest. | 05:47 |
|---|---|---|
| pojadhav|rover | jbadiapa, ack | 05:49 |
| jbadiapa | podjadhav|rover: http://paste.openstack.org/show/805531/ | 05:49 |
| jbadiapa | thx | 05:49 |
| jbadiapa | podjadhav|rover: https://zuul.opendev.org/t/openstack/build/30581b19c02d465e89f1e998ae515197/log/logs/undercloud/var/log/tempest/tempest_run.log#7 not sure whether this is the root cause | 05:52 |
| pojadhav|rover | this test is failing : https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_305/790495/2/gate/tripleo-ci-centos-8-containers-multinode/30581b1/logs/undercloud/var/log/tempest/stestr_results.html | 05:57 |
| frenzy_friday | weshay|ruck, I think entry in the .err file is missing. Readme link: https://opendev.org/openstack/tripleo-ci-health-queries/src/branch/master/README.md#adding-a-new-item-in-queries-yml | 05:57 |
| *** saneax has joined #oooq | 06:03 | |
| jbadiapa | podjadhav|rover: ok, thx, the question is the patch does not have anything to do with the error. that's why I asked about it. | 06:05 |
| *** jpodivin has joined #oooq | 06:06 | |
| *** ykarel has quit IRC | 06:09 | |
| pojadhav|rover | jbadiapa, try to recheck once, if its a glitch it will pass in next run.. if it again failed then will decide to skip that test or will ask tempest folks to look into it. | 06:09 |
| jbadiapa | pojadhav|rover: thx and sorry for the noise | 06:11 |
| pojadhav|rover | jbadiapa, its absolutely fine :) | 06:12 |
| ysandeep|dol | jbadiapa, hey o/ that's an intermittent issue hitting us lately.. we are investigating that here https://bugs.launchpad.net/tripleo/+bug/1928933 | 06:17 |
| openstack | Launchpad bug 1928933 in tripleo "wallaby : tripleo-ci-centos-8-containers-multinode-wallaby randomly failing tempest tests with paramiko.ssh_exception.BadHostKeyException" [Undecided,New] | 06:17 |
| ysandeep|dol | pojadhav|rover: looks like same paramiko.ssh_exception.BadHostKeyException: Host key for server '192.168.24.102' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPGlxQtDhpFCnt1MFE1U3tpW3yfFhQxChh4X/8rEdcrOuUsuMc7VqcWa+vXK/qNmKD0wI14wbIPqayfWGFUDWq8=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIEsAII5ghWUoP+S6IsgeBYKhH8dDoAiAtxFANC7NwKwU' | 06:18 |
| ysandeep|dol | 2021-05-20 22:29:28.408 156327 ERROR tempest.lib.common.ssh | 06:18 |
| pojadhav|rover | ysandeep|dol, I think though exception is same, but the error is different.. related to key | 06:18 |
| *** slaweq has joined #oooq | 06:18 | |
| pojadhav|rover | the bug reported is about authentication failed and ssh timedout.. right? | 06:19 |
| pojadhav|rover | sorry my bad | 06:19 |
| pojadhav|rover | it is the same issue we already reported :) | 06:20 |
| ysandeep|dol | pojadhav|rover, we can remove wallaby from description this is hitting multiple branches | 06:20 |
| pojadhav|rover | ack | 06:20 |
| ysandeep|dol | we can add a comment on bug with log this log: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_305/790495/2/gate/tripleo-ci-centos-8-containers-multinode/30581b1/logs/undercloud/var/log/tempest/stestr_results.html .. this job executed for master branch patch | 06:21 |
| ysandeep|dol | with this log* | 06:21 |
| pojadhav|rover | ysandeep|dol, adding | 06:21 |
| ysandeep|dol | pojadhav|rover++ thanks! | 06:22 |
| pojadhav|rover | ysandeep|dol, jbadiapa : https://bugs.launchpad.net/tripleo/+bug/1928933 | 06:23 |
| openstack | Launchpad bug 1928933 in tripleo "tripleo-ci-centos-8-containers-multinode randomly failing tempest tests with paramiko.ssh_exception.BadHostKeyException" [Undecided,New] | 06:23 |
| ysandeep|dol | ack o/ great! | 06:24 |
| *** ykarel has joined #oooq | 06:27 | |
| *** ratailor_ has joined #oooq | 06:32 | |
| *** ratailor has quit IRC | 06:34 | |
| *** ratailor_ has quit IRC | 06:35 | |
| *** slaweq has quit IRC | 06:39 | |
| *** ratailor has joined #oooq | 06:45 | |
| *** ratailor_ has joined #oooq | 06:49 | |
| *** jfrancoa has quit IRC | 06:49 | |
| *** saneax has quit IRC | 06:51 | |
| *** ratailor has quit IRC | 06:51 | |
| *** amoralej|off is now known as amoralej | 07:13 | |
| *** amoralej is now known as amoralej|off | 07:13 | |
| *** ysandeep|dol is now known as ysandeep|brb | 07:14 | |
| *** jfrancoa has joined #oooq | 07:15 | |
| *** saneax has joined #oooq | 07:25 | |
| *** ysandeep|brb is now known as ysandeep | 07:37 | |
| *** cgoncalves has quit IRC | 07:43 | |
| *** cgoncalves has joined #oooq | 07:44 | |
| *** jpena|off is now known as jpena | 07:53 | |
| *** tosky has joined #oooq | 07:59 | |
| *** amoralej|off is now known as amoralej | 07:59 | |
| *** ysandeep is now known as ysandeep|away | 08:09 | |
| *** jmasud has quit IRC | 08:11 | |
| *** derekh has joined #oooq | 08:12 | |
| *** ratailor_ has quit IRC | 08:15 | |
| *** apetrich has joined #oooq | 08:15 | |
| *** ykarel is now known as ykarel|lunch | 08:21 | |
| *** jlarriba has quit IRC | 08:27 | |
| *** jlarriba has joined #oooq | 08:27 | |
| *** ratailor has joined #oooq | 08:51 | |
| * ysandeep|away stepping out for few hours | 08:59 | |
| *** saneax has quit IRC | 09:09 | |
| *** ykarel|lunch is now known as ykarel | 09:12 | |
| *** jpodivin has quit IRC | 09:23 | |
| *** jpodivin has joined #oooq | 09:23 | |
| *** jpodivin has quit IRC | 09:27 | |
| *** apetrich has quit IRC | 09:36 | |
| *** saneax has joined #oooq | 09:52 | |
| *** jpodivin has joined #oooq | 10:03 | |
| *** jmasud has joined #oooq | 10:17 | |
| *** jmasud has quit IRC | 10:18 | |
| *** udesale has quit IRC | 10:47 | |
| *** udesale has joined #oooq | 10:47 | |
| *** ratailor_ has joined #oooq | 10:57 | |
| *** ratailor has quit IRC | 11:00 | |
| *** skramaja has quit IRC | 11:15 | |
| *** jpena is now known as jpena|lunch | 11:31 | |
| *** jfrancoa has quit IRC | 11:40 | |
| *** jfrancoa has joined #oooq | 11:40 | |
| * pojadhav|rover stepping out for sometime | 11:44 | |
| *** rlandy has joined #oooq | 11:47 | |
| *** apetrich has joined #oooq | 12:01 | |
| *** amoralej is now known as amoralej|lunch | 12:22 | |
| *** holser_ has quit IRC | 12:26 | |
| weshay|ruck | frenzy_friday, ah.. ur right.. thanks | 12:29 |
| *** jpena|lunch is now known as jpena | 12:29 | |
| rlandy | weshay|ruck: ysandeep|away: testing all the container update changes against rdo component jobs to check didn't break anything there and then we can merge | 12:36 |
| rlandy | weshay|ruck: also put https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/772571 back into mergeable state (ipa change) | 12:37 |
| rlandy | results are never perfect but better than before | 12:37 |
| rlandy | the jobs is still non-voting | 12:37 |
| rlandy | bit I'd like to merge this change and see if it helps the job stats | 12:37 |
| rlandy | either way, it fixes downstream | 12:37 |
| rlandy | and there is more debug added | 12:37 |
| rlandy | so better | 12:37 |
| *** ratailor_ has quit IRC | 12:39 | |
| rlandy | weshay|ruck: working on disabling the component repo from delorean | 12:43 |
| rlandy | seeing if it will fail md5 | 12:43 |
| weshay|ruck | few min.. in a mtg | 12:45 |
| *** apetrich has quit IRC | 13:02 | |
| *** amoralej|lunch is now known as amoralej | 13:07 | |
| zbr | weshay|ruck: meet? | 13:08 |
| weshay|ruck | zbr, ya.. 1 sec | 13:14 |
| weshay|ruck | sorry | 13:14 |
| weshay|ruck | zbr, sorry in | 13:25 |
| bhagyashris | weshay|ruck, promoter sync... | 13:30 |
| weshay|ruck | aye.. you'll have to roll w/o me | 13:30 |
| bhagyashris | weshay|ruck, ok | 13:30 |
| *** sshnaidm|pto has quit IRC | 13:49 | |
| *** ysandeep|away is now known as ysandeep | 14:15 | |
| *** saneax has quit IRC | 14:17 | |
| *** jfrancoa has quit IRC | 14:18 | |
| *** sshnaidm has joined #oooq | 14:50 | |
| *** sshnaidm is now known as sshnaidm|pto | 14:52 | |
| *** udesale has quit IRC | 14:56 | |
| ysandeep | weshay|ruck, rlandy: fyi.. 16.2 container build failing.. https://bugzilla.redhat.com/show_bug.cgi?id=1963150 reported and cixed. | 15:02 |
| openstack | bugzilla.redhat.com bug 1963150 in distribution "16.2 container build is failing for ovn-controller, "file /usr/share/ovn/scripts/ovn-ctl from install of ovn-2021-21.03.0-21.el8fdp.x86_64 conflicts with file from package ovn2.13-20.12.0-104.el8fdp.x86_64"" [Urgent,New] - Assigned to rhos-maint | 15:02 |
| ysandeep | reporting one more failure: ERROR! couldn't resolve module/action 'containers.podman.podman_container' | 15:02 |
| ysandeep | https://sf.hosted.upshift.rdu2.redhat.com/logs/88/242988/1/check/tripleo-ci-rhel-8-standalone-rhos-16.2/5d8ee4c/job-output.txt | 15:02 |
| ysandeep | I found a patch from sshnaidm|pto which may be related https://opendev.org/openstack/tripleo-quickstart-extras/commit/3381b5bee79358141f36d7eb7ae4cd13773bd2cc | 15:02 |
| sshnaidm|pto | ysandeep, it's because ansible podman collection isn't ported to 16.2 yet | 15:04 |
| *** ykarel is now known as ykarel|away | 15:05 | |
| *** jpodivin has quit IRC | 15:07 | |
| ysandeep | sshnaidm|pto: thanks! ack checking if we need to open a separate bug or if it can be traced with https://trello.com/c/ZajcOvEy/1947-cixbz1960407osp17rhel8rhos-17package-python3-tripleoclient-1611-020210513010801592faedel8osttrunknoarch-requires-openstack-tripl. | 15:08 |
| sshnaidm|pto | it's same | 15:08 |
| rlandy | k - thanks for the heads up | 15:09 |
| rlandy | ysandeep: working on the delorean repo disable | 15:10 |
| rlandy | testing md5 hit | 15:10 |
| weshay|ruck | ysandeep, ya.. I didn't get that repoclosure running on 16.2 but I will.. we'll see the same thing there | 15:11 |
| ysandeep | sshnaidm|pto: ack thanks i will not report a separate bug for " ERROR! couldn't resolve module/action 'containers.podman.podman_container" then. | 15:12 |
| ysandeep | weshay|ruck, ack thanks! yeah repoclosure jobs will definitely help on 16.2 as well | 15:13 |
| ysandeep | rlandy: thanks for working on it! | 15:13 |
| rlandy | np - now that we debugged the container updates in components | 15:13 |
| weshay|ruck | ysandeep, same issue in 17 https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-17/af90486/logs/container-builds/2792a775-5821-48a9-b77e-f150068f14c2/base/ovn-base/ovn-controller/ovn-controller-build.log | 15:14 |
| ysandeep | ack , I can add a comment on bug and cix card that this is hitting 17 as well. | 15:15 |
| *** ykarel|away has quit IRC | 15:17 | |
| *** jmasud has joined #oooq | 15:43 | |
| *** amoralej is now known as amoralej|off | 15:46 | |
| weshay|ruck | grr... code.eng | 15:54 |
| rlandy | lol | 15:55 |
| rlandy | such is life in code.eng land | 15:55 |
| *** ykarel|away has joined #oooq | 16:09 | |
| *** marios is now known as marios|out | 16:16 | |
| *** marios|out has quit IRC | 16:21 | |
| *** ykarel|away has quit IRC | 16:28 | |
| *** ykarel|away has joined #oooq | 16:38 | |
| *** ykarel|away has quit IRC | 16:43 | |
| rlandy | [delorean-component-network] | 16:53 |
| rlandy | name=delorean-openstack-neutron-8bd65385d1ff0ebf3b5e3103beb3eb4babf44fb7 | 16:53 |
| rlandy | baseurl=http://mirror.regionone.vexxhost-nodepool-tripleo.rdoproject.org:8080/rdo/centos8/component/network/8b/d6/8bd65385d1ff0ebf3b5e3103beb3eb4babf44fb7_181dc17f | 16:53 |
| rlandy | enabled=0 | 16:53 |
| rlandy | gpgcheck=0 | 16:53 |
| rlandy | priority=20 | 16:53 |
| rlandy | ^^ worked | 16:54 |
| *** derekh has quit IRC | 17:00 | |
| *** jpena is now known as jpena|off | 17:03 | |
| rlandy | weshay|ruck: ysandeep: ^^ first test look sok | 17:33 |
| rlandy | testing on an OVB and multinode job | 17:33 |
| rlandy | if that passes, I can duplicate the change | 17:33 |
| frenzy_friday | weshay|ruck, https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/788053 passes now | 17:35 |
| weshay|ruck | frenzy_friday, thanks | 17:39 |
| ysandeep | rlandy: great! | 17:44 |
| *** jmasud has quit IRC | 18:24 | |
| *** jmasud has joined #oooq | 18:42 | |
| *** ysandeep is now known as ysandeep|away | 18:44 | |
| *** jmasud has quit IRC | 19:08 | |
| rlandy | ugh - code eng | 19:19 |
| *** jbadiapa has quit IRC | 19:24 | |
| *** jmasud has joined #oooq | 20:09 | |
| *** jmasud has quit IRC | 21:01 | |
| *** rlandy has quit IRC | 21:05 | |
| *** tosky has quit IRC | 21:15 | |
| *** tosky has joined #oooq | 21:16 | |
| *** dviroel has quit IRC | 21:56 | |
| *** dviroel has joined #oooq | 21:59 | |
| *** jmasud has joined #oooq | 22:44 | |
| *** tosky has quit IRC | 23:03 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!