| *** bhagyashris_ has joined #oooq | 01:01 | |
| *** bhagyashris has quit IRC | 01:09 | |
| *** rlandy has quit IRC | 02:45 | |
| *** ykarel|away has joined #oooq | 03:48 | |
| *** ykarel_ has joined #oooq | 04:15 | |
| *** pojadhav has quit IRC | 04:16 | |
| *** ykarel|away has quit IRC | 04:21 | |
| *** ykarel_ is now known as ykarel | 04:25 | |
| *** marios has joined #oooq | 05:06 | |
| *** ysandeep has joined #oooq | 05:11 | |
| *** ysandeep is now known as ysandeep|ruck | 05:11 | |
| ysandeep|ruck | good morning folks o/ | 05:12 |
|---|---|---|
| *** jfrancoa has joined #oooq | 05:15 | |
| *** pojadhav has joined #oooq | 05:53 | |
| *** bhagyashris_ is now known as bhagyashris | 06:08 | |
| *** soniya29 has joined #oooq | 06:24 | |
| *** soniya has joined #oooq | 06:27 | |
| *** soniya29 has quit IRC | 06:33 | |
| ysandeep|ruck | arxcruz|rover, good morning o/ | 06:34 |
| ysandeep|ruck | when you are in could you plese check https://bugs.launchpad.net/tripleo/+bug/1931207 | 06:34 |
| opendevmeet | Launchpad bug 1931207 in tripleo "Wallaby -> Master Standalone upgrade job failing with Error: package python3-tripleoclient-16.2.1-0.20210603174615.c5b1e0c.el8.noarch requires openstack-heat-monolith >= 16.0.0" [Critical,Triaged] | 06:34 |
| ysandeep|ruck | or maybe https://review.rdoproject.org/r/c/openstack/tripleoclient-distgit/+/34024 fixes this as well.. let me ran a job to confirm | 06:36 |
| ysandeep|ruck | testing here: https://review.rdoproject.org/r/c/testproject/+/28446/48/.zuul.yaml | 06:49 |
| *** ykarel_ has joined #oooq | 07:01 | |
| *** ykarel has quit IRC | 07:03 | |
| *** pojadhav has quit IRC | 07:12 | |
| arxcruz|rover | ysandeep|ruck: hey | 07:15 |
| ysandeep|ruck | arxcruz|rover: very good morning, How are you today ? | 07:16 |
| arxcruz|rover | ysandeep|ruck: old :D | 07:16 |
| *** amoralej|off is now known as amoralej | 07:20 | |
| ysandeep|ruck | arxcruz|rover, too many node_failure in internal and vexx cloud, i have reached out on internal ops channel.. but no luck yet.. may be more folks will join in emea hours. | 07:21 |
| arxcruz|rover | ysandeep|ruck: ok, i'll ping them too | 07:21 |
| ysandeep|ruck | arxcruz|rover, i just pinged them again | 07:22 |
| sshnaidm | ysandeep|ruck, about failures in containers info task, there was a workaround in podman module to fix that, but we removed the module from tripleo ansible, so we need a new ansible collection RPM. I'll try to release it today. | 07:29 |
| *** jpena|off is now known as jpena | 07:31 | |
| ysandeep|ruck | sshnaidm++ ack thanks! | 07:32 |
| *** soniya29 has joined #oooq | 07:33 | |
| sshnaidm | ysandeep|ruck, this was the workaround: https://review.opendev.org/c/openstack/tripleo-ansible/+/789928 | 07:34 |
| ysandeep|ruck | sshnaidm: yes rabi commented about same patch in bug https://bugs.launchpad.net/tripleo/+bug/1931090/comments/3 | 07:36 |
| opendevmeet | Launchpad bug 1931090 in tripleo "Scenario001 master failing on standalone deploy with FATAL | Gather podman infos | standalone | error={"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}" [Critical,Triaged] | 07:36 |
| ysandeep|ruck | and looks like we removed podman* module here: https://review.opendev.org/c/openstack/tripleo-ansible/+/790502 | 07:38 |
| sshnaidm | yep | 07:38 |
| *** soniya has quit IRC | 07:39 | |
| *** soniya has joined #oooq | 07:42 | |
| *** soniya29 has quit IRC | 07:48 | |
| sshnaidm | ysandeep|ruck, actually podman 3.2.0 is supposed to fix that as well | 07:54 |
| sshnaidm | ykarel_, do you know any eta for podman 3.2.0? ^^ | 07:54 |
| ykarel_ | sshnaidm, no don't know about ETA | 07:59 |
| ykarel_ | i see builds are there in brew for el8.5 | 08:00 |
| ykarel_ | so those should come to c8-stream | 08:00 |
| ykarel_ | for podman-3.3.0 | 08:00 |
| *** ykarel_ is now known as ykarel | 08:00 | |
| ysandeep|ruck | sshnaidm: ack thanks! | 08:02 |
| *** ysandeep|ruck is now known as ysandeep|lunch | 08:03 | |
| ykarel | but those builds seems to be comming in rhel8 stream | 08:03 |
| sshnaidm | hmm, not in 3.0? | 08:03 |
| *** derekh has joined #oooq | 08:23 | |
| frenzy_friday | Hey zbr, dpawlik has a patch that will allow us to access rdo Elasticsearch from our health server - https://softwarefactory-project.io/r/c/software-factory/sf-infra/+/21989 | 08:39 |
| *** tosky has joined #oooq | 08:39 | |
| *** pojadhav has joined #oooq | 08:44 | |
| *** ysandeep|lunch has quit IRC | 08:52 | |
| *** ysandeep has joined #oooq | 08:55 | |
| *** ysandeep is now known as ysandeep|ruck | 09:02 | |
| zbr | frenzy_friday: i am attending ansible contributors summit today, not sure when it ends. | 09:35 |
| ysandeep|ruck | arxcruz|rover, fyi.. fs039 is red https://bugs.launchpad.net/tripleo/+bug/1931228 , posting a fix | 09:51 |
| opendevmeet | Launchpad bug 1931228 in tripleo "Featureset039 failing after java-1.8.0-openjdk-1.8.0.272* removed from mirror, Can not load RPM file: java-1.8.0-openjdk-1.8.0.272.b10-3.el8_3.x86_64.rpm" [Critical,Triaged] | 09:51 |
| ysandeep|ruck | arxcruz|rover, fyi.. https://bugs.launchpad.net/tripleo/+bug/1931226 ops opened a ticket with vexx | 09:52 |
| opendevmeet | Launchpad bug 1931226 in tripleo "RDO third party rdo jobs failing with NODE_FAILURE on Vexx cloud" [Critical,Triaged] | 09:52 |
| arxcruz|rover | ysandeep|ruck: ack | 09:53 |
| arxcruz|rover | ewww java | 09:53 |
| ysandeep|ruck | arxcruz|rover, https://review.rdoproject.org/r/c/testproject/+/28446/48/.zuul.yaml didn't fix.. i think upgrade job first deploy previous version.. we will need to use some other technique to test this one.. | 09:54 |
| ysandeep|ruck | for ^^ https://bugs.launchpad.net/tripleo/+bug/1931207 | 09:54 |
| opendevmeet | Launchpad bug 1931207 in tripleo "Wallaby -> Master Standalone upgrade job failing with Error: package python3-tripleoclient-16.2.1-0.20210603174615.c5b1e0c.el8.noarch requires openstack-heat-monolith >= 16.0.0" [Critical,Triaged] | 09:54 |
| arxcruz|rover | ysandeep|ruck: it fails with a different error | 09:57 |
| *** soniya29 has joined #oooq | 09:59 | |
| arxcruz|rover | ysandeep|ruck: nevermind, i was checking the scen001 instead of upgrade | 09:59 |
| ysandeep|ruck | nw :) | 09:59 |
| *** soniya has quit IRC | 10:03 | |
| arxcruz|rover | ysandeep|ruck: so, maybe the package isn't built yet ? | 10:05 |
| arxcruz|rover | also, the heat monolith is on exclude list | 10:05 |
| ysandeep|ruck | arxcruz|rover, mmm.. its failing during https://logserver.rdoproject.org/46/28446/48/check/periodic-tripleo-ci-centos-8-standalone-upgrade-tripleo-master/8c9738c/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz | 10:05 |
| ysandeep|ruck | before doing anything.. | 10:06 |
| arxcruz|rover | 2021-06-08 07:54:48 | - package openstack-heat-monolith-1:16.0.1-0.20210425080922.7b9ffc5.el8.noarch is filtered out by exclude filtering | 10:06 |
| ysandeep|ruck | arxcruz|rover, i mean before standalone install even.. standalone should be using W bits | 10:06 |
| ysandeep|ruck | then during upgrade it will start using Master bits | 10:07 |
| ysandeep|ruck | i am not sure why we are not hitting this is Wallaby standalone jobs | 10:07 |
| arxcruz|rover | ysandeep|ruck: we can blame marios | 10:12 |
| arxcruz|rover | :D | 10:12 |
| arxcruz|rover | marios: ^ any ideas ? | 10:12 |
| arxcruz|rover | since you have more experience with upgrade jobs | 10:12 |
| marios | arxcruz|rover: nope but the issue here doesn't seem to be about upgrades looks like packaging issue? | 10:15 |
| ysandeep|ruck | marios, true.. but that fact that why we are not hitting this in wallaby plain standalone deploy job is bit weird. | 10:16 |
| ysandeep|ruck | never mind i will debug that more myself first.. | 10:17 |
| ysandeep|ruck | arxcruz|rover, i think new upstream bug waiting for us.. https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f5d/795273/2/check/openstack-tox-linters/f5d355f/job-output.txt | 10:25 |
| ysandeep|ruck | let me recheck once to confirm its consistent | 10:26 |
| arxcruz|rover | ysandeep|ruck: this is upstream issue | 10:26 |
| arxcruz|rover | i mean, seems to be o-infra issue | 10:27 |
| arxcruz|rover | with tox | 10:27 |
| ysandeep|ruck | yeah.. just noticed some other jobs also hitting issue with infra https://d28efda77c4dcd7255de-ad135f72b22a132e11a904324fbc4e60.ssl.cf2.rackcdn.com/793383/9/gate/tripleo-ci-centos-8-containers-multinode/520ae4d/job-output.txt | 10:27 |
| ysandeep|ruck | Looking in indexes: https://mirror.kna1.airship-citycloud.opendev.org/pypi/simple, https://mirror.kna1.airship-citycloud.opendev.org/wheel/centos-8-x86_64 | 10:28 |
| ysandeep|ruck | 2021-06-08 10:12:16.447825 | primary | ERROR: Could not find a version that satisfies the requirement bindep (from versions: none) | 10:28 |
| ysandeep|ruck | 2021-06-08 10:12:16.447917 | primary | ERROR: No matching distribution found for bindep | 10:28 |
| * ysandeep|ruck pinging on #opendev | 10:31 | |
| *** yamamoto has joined #oooq | 10:32 | |
| ysandeep|ruck | arxcruz|rover: fastly cdn is having a gigantic outage at the moment which is certainly affecting pypi.org | 10:33 |
| ysandeep|ruck | \o/ | 10:33 |
| ysandeep|ruck | https://bugs.launchpad.net/tripleo/+bug/1931238 for tracking | 10:37 |
| opendevmeet | Launchpad bug 1931238 in tripleo "Tripleo jobs are failing while installing python requirements" [Critical,Triaged] | 10:37 |
| sshnaidm | afaik a lot of sites are down over the internet | 10:40 |
| ysandeep|ruck | yeah.. https://pypi.org/ is giving Error 503 Service Unavailable | 10:41 |
| sshnaidm | https://status.fastly.com/ | 10:42 |
| ysandeep|ruck | everything seems in Degraded Performance :) | 10:43 |
| sshnaidm | yay, internet is broken | 10:45 |
| *** pojadhav has quit IRC | 10:51 | |
| *** ysandeep|ruck is now known as ysandeep|afk | 11:02 | |
| *** ysandeep|afk is now known as ysandeep | 11:29 | |
| *** ysandeep is now known as ysandeep|ruck | 11:29 | |
| *** jpena is now known as jpena|lunch | 11:31 | |
| *** yamamoto has quit IRC | 11:34 | |
| *** pojadhav has joined #oooq | 11:36 | |
| *** rlandy has joined #oooq | 11:45 | |
| rlandy | ysandeep|ruck: hey - the node failures downstream - due to PSI outage announcement? | 11:48 |
| rlandy | before I ask on rhos-ops | 11:48 |
| ysandeep|ruck | rlandy, yes | 11:48 |
| rlandy | ok | 11:48 |
| rlandy | ugh - getting no where with 17 | 11:49 |
| arxcruz|rover | ysandeep|ruck: yeah, i saw the news | 12:05 |
| arxcruz|rover | ysandeep|ruck: sorry the delay, had to go to post service to leave my laptop for the third time | 12:06 |
| ysandeep|ruck | arxcruz|rover, nw, i see https://pypi.org/ is opening now, hopefully things get better soon. | 12:06 |
| arxcruz|rover | ysandeep|ruck: upstream jobs are also failing | 12:06 |
| arxcruz|rover | ysandeep|ruck: nice to finish our rr duty huh | 12:07 |
| ysandeep|ruck | :) | 12:09 |
| *** whayutin has joined #oooq | 12:09 | |
| *** whayutin is now known as weshay|ruck | 12:09 | |
| weshay|ruck | 0/ | 12:10 |
| weshay|ruck | infra is still down | 12:10 |
| rlandy | weshay|ruck: another day in paradise | 12:12 |
| rlandy | no nodes | 12:12 |
| rlandy | take a vacation | 12:12 |
| weshay|ruck | heh | 12:12 |
| soniya29 | weshay|ruck, meeting? | 12:13 |
| rlandy | arxcruz|rover: hey - have a minute to help me out with https://opendev.org/openstack/ansible-role-python_venv_build/src/branch/master/tasks/python_venv_install.yml#L130 | 12:13 |
| rlandy | arxcruz|rover: last of the IPA job failures ... | 12:13 |
| rlandy | https://e36203e60051d918bd96-b4b1a7d89013756684de846d3b70c9e9.ssl.cf2.rackcdn.com/791033/20/check/tripleo-ci-centos-8-standalone-on-multinode-ipa/946b9bc/job-output.txt | 12:14 |
| weshay|ruck | soniya29, I've been there | 12:14 |
| rlandy | so that line fails on some providers | 12:14 |
| rlandy | Name or service not known',)' | 12:14 |
| rlandy | fixed OVH with the same issue but that clearly went to releases.openstack.org | 12:14 |
| *** yamamoto has joined #oooq | 12:14 | |
| rlandy | how do I know what server it's after here? | 12:14 |
| rlandy | (host='opendev.org', | 12:15 |
| rlandy | Oh nvm | 12:15 |
| rlandy | I see it | 12:15 |
| arxcruz|rover | rlandy: there are an huge outage right now happening | 12:16 |
| arxcruz|rover | rlandy: internet is broken | 12:16 |
| rlandy | arxcruz|rover: not related to the outage | 12:16 |
| rlandy | it's an IPA thing | 12:16 |
| rlandy | I just missed one server to add to hosts | 12:17 |
| arxcruz|rover | ok | 12:18 |
| *** yamamoto has quit IRC | 12:28 | |
| *** jpena|lunch is now known as jpena | 12:31 | |
| *** yamamoto has joined #oooq | 12:32 | |
| rlandy | bhagyashris: hi - weshay|ruck and I have a meeting clash with community meeting today | 12:45 |
| weshay|ruck | aye.. so do I ysandeep|ruck want to 1-1 now? | 12:46 |
| weshay|ruck | or we can skip if you prefer.. we've been chatting a lot | 12:46 |
| ysandeep|ruck | weshay|ruck, I don't have agenda for 1:1...but I am okay if you want to sync for Ruck/rover | 12:47 |
| weshay|ruck | k.. arxcruz|rover you around? | 12:47 |
| arxcruz|rover | weshay|ruck: yes | 12:47 |
| weshay|ruck | https://meet.google.com/dkj-vuij-yup | 12:48 |
| *** soniya has joined #oooq | 12:48 | |
| *** soniya29 has quit IRC | 12:54 | |
| bhagyashris | rlandy, ack | 12:55 |
| *** amoralej is now known as amoralej|lunch | 13:00 | |
| bhagyashris | arxcruz|rover, , zbr, sshnaidm, rlandy, marios, ysandeep|ruck , bhagyashris, svyas, soniya29, pojadhav, akahat, weshay|ruck , chandankumar, frenzy_friday dviroel | 13:22 |
| bhagyashris | Community call in 8 mins | 13:22 |
| rlandy | in clashing meeting - sorry | 13:22 |
| bhagyashris | feel free to add the agenda here https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2021-06-08-Community-call | 13:22 |
| bhagyashris | rlandy, ack | 13:23 |
| bhagyashris | https://meet.google.com/bqx-xwht-wky?authuser=0 | 13:24 |
| rlandy | ysandeep|ruck: arxcruz|rover: requesting review https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/795327 | 13:36 |
| *** amoralej|lunch is now known as amoralej | 13:39 | |
| *** soniya has quit IRC | 14:36 | |
| *** yamamoto has quit IRC | 14:38 | |
| weshay|ruck | rlandy, do you have bandwidth to join the el9 mtg today? | 14:40 |
| weshay|ruck | we can ask about merging those patches | 14:40 |
| *** ykarel has quit IRC | 14:41 | |
| *** ykarel has joined #oooq | 14:42 | |
| *** ykarel has quit IRC | 14:46 | |
| rlandy | weshay|ruck: joining | 14:46 |
| rlandy | https://review.rdoproject.org/r/c/testproject/+/33878 patch | 14:47 |
| *** ykarel has joined #oooq | 14:47 | |
| *** ysandeep|ruck is now known as ysandeep|away | 15:12 | |
| *** yamamoto has joined #oooq | 15:14 | |
| *** yamamoto has quit IRC | 15:23 | |
| *** ysandeep|away has quit IRC | 15:33 | |
| *** ysandeep|away has joined #oooq | 15:34 | |
| rlandy | arxcruz|rover: weshay|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/795364 pls vote - we got flagged for old employee address | 15:51 |
| marios | o/ tripleo-ci please add to your reviews list https://review.opendev.org/c/openstack/tripleo-ci/+/791908 https://review.opendev.org/c/openstack/tripleo-repos/+/792126 https://review.opendev.org/c/openstack/tripleo-repos/+/795333 thank you | 15:55 |
| *** marios is now known as marios|out | 16:02 | |
| *** ykarel is now known as ykarel|away | 16:02 | |
| *** jbadiapa_ has joined #oooq | 16:09 | |
| *** ykarel|away has quit IRC | 16:13 | |
| *** jbadiapa has quit IRC | 16:15 | |
| ysandeep|away | weshay|ruck, testing jdk fixes here: https://review.rdoproject.org/r/c/testproject/+/32054 , if job passes please merge https://review.opendev.org/q/topic:%22workaround_java_issues_with_freeipa%22+(status:open%20OR%20status:merged) | 16:29 |
| weshay|ruck | ++ | 16:30 |
| *** jpena is now known as jpena|off | 16:33 | |
| *** whayutin has joined #oooq | 16:35 | |
| *** weshay|ruck has quit IRC | 16:35 | |
| *** whayutin is now known as weshay|ruck | 16:36 | |
| * ysandeep|away out | 16:37 | |
| *** ysandeep|away has quit IRC | 16:38 | |
| weshay|ruck | folks.. /me getting our promotion_blocker tooling back online | 16:38 |
| *** marios|out has quit IRC | 16:39 | |
| *** weshay|ruck has quit IRC | 16:49 | |
| *** whayutin has joined #oooq | 16:50 | |
| *** whayutin is now known as weshay|ruck | 16:50 | |
| *** ykarel|away has joined #oooq | 17:06 | |
| *** weshay|ruck has quit IRC | 17:11 | |
| *** whayutin has joined #oooq | 17:13 | |
| *** whayutin is now known as weshay|ruck | 17:13 | |
| *** amoralej is now known as amoralej|off | 17:30 | |
| *** ykarel|away has quit IRC | 17:43 | |
| rlandy | sshnaidm: hey - still around? | 20:13 |
| *** jlarriba has quit IRC | 20:21 | |
| *** jlarriba has joined #oooq | 20:23 | |
| *** derekh has quit IRC | 20:48 | |
| sshnaidm | rlandy, sort of | 20:48 |
| rlandy | sshnaidm: no worries - got an answer from kevin | 20:51 |
| *** derekh has joined #oooq | 21:01 | |
| *** jfrancoa has quit IRC | 21:09 | |
| *** jfrancoa has joined #oooq | 21:15 | |
| *** derekh has quit IRC | 21:25 | |
| *** yamamoto has joined #oooq | 22:30 | |
| *** yamamoto has quit IRC | 22:38 | |
| *** yamamoto has joined #oooq | 22:38 | |
| *** derekh has joined #oooq | 22:56 | |
| *** yamamoto has quit IRC | 22:59 | |
| *** tosky has quit IRC | 23:03 | |
| *** yamamoto has joined #oooq | 23:05 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!