*** jmasud has joined #oooq | 00:10 | |
*** dpawlik5 has quit IRC | 00:10 | |
*** dpawlik7 has joined #oooq | 00:11 | |
*** jmasud has quit IRC | 00:20 | |
*** jmasud has joined #oooq | 00:24 | |
*** jmasud has quit IRC | 00:56 | |
*** kopecmartin has quit IRC | 00:57 | |
*** dpawlik7 has quit IRC | 00:57 | |
*** kopecmartin has joined #oooq | 00:57 | |
*** dpawlik5 has joined #oooq | 00:57 | |
*** jmasud has joined #oooq | 01:03 | |
*** dpawlik2 has joined #oooq | 01:23 | |
*** dpawlik5 has quit IRC | 01:23 | |
*** dpawlik2 has quit IRC | 01:33 | |
*** dpawlik3 has joined #oooq | 01:36 | |
*** jmasud has quit IRC | 01:45 | |
*** jmasud has joined #oooq | 01:46 | |
*** jmasud_ has joined #oooq | 01:52 | |
*** jmasud_ has quit IRC | 01:52 | |
*** jmasud_ has joined #oooq | 01:54 | |
*** jmasud has quit IRC | 01:55 | |
*** jmasud_ has quit IRC | 02:32 | |
*** dpawlik9 has joined #oooq | 02:35 | |
*** dpawlik3 has quit IRC | 02:36 | |
*** jmasud has joined #oooq | 03:16 | |
*** ysandeep|away is now known as ysandeep | 03:44 | |
*** ykarel has joined #oooq | 03:51 | |
*** jmasud has quit IRC | 04:19 | |
*** dpawlik9 has quit IRC | 04:35 | |
*** dpawlik6 has joined #oooq | 04:35 | |
*** marios has joined #oooq | 05:02 | |
*** haleyb has quit IRC | 05:16 | |
*** haleyb has joined #oooq | 05:23 | |
*** dpawlik7 has joined #oooq | 05:34 | |
*** jmasud has joined #oooq | 05:35 | |
*** dpawlik6 has quit IRC | 05:35 | |
*** kopecmartin has quit IRC | 05:36 | |
*** ksambor has joined #oooq | 06:14 | |
*** saneax has joined #oooq | 06:14 | |
*** sanjayu_ has joined #oooq | 06:22 | |
*** saneax has quit IRC | 06:24 | |
*** dpawlik5 has joined #oooq | 06:42 | |
*** dpawlik7 has quit IRC | 06:42 | |
*** dpawlik5 has quit IRC | 06:52 | |
*** dpawlik07 has joined #oooq | 06:55 | |
*** jmasud has quit IRC | 06:57 | |
*** dpawlik07 has quit IRC | 06:57 | |
*** dpawlik5 has joined #oooq | 06:58 | |
*** sshnaidm is now known as sshnaidm|afk | 06:58 | |
*** dpawlik5 has quit IRC | 07:12 | |
*** dpawlik5 has joined #oooq | 07:13 | |
*** dpawlik5 is now known as dpawlik | 07:14 | |
*** amoralej|off is now known as amoralej | 07:15 | |
*** apetrich has joined #oooq | 07:19 | |
*** sanjayu_ has quit IRC | 07:23 | |
*** sanjayu_ has joined #oooq | 07:24 | |
*** dpawlik has quit IRC | 07:28 | |
*** dpawlik6 has joined #oooq | 07:28 | |
*** tosky has joined #oooq | 07:38 | |
bhagyashris | marios, hi, i have one question regarding remove val of rocky periodic jobs - so should i remove the definitions directly? or just remove the job names from template? | 07:39 |
---|---|---|
marios | bhagyashris: we want to remove everything, job definitions, layouts etc. probably you will need to update the job layouts first (i.e. remove the job names from template) and only after we can remove the definitions | 07:42 |
*** dpawlik6 has quit IRC | 07:43 | |
bhagyashris | marios, ack, thanks . i will first remove the jobs from templates and then in the follow up patch will remove the definition | 07:43 |
marios | bhagyashris: ack | 07:51 |
*** jpena|off is now known as jpena | 07:51 | |
marios | sshnaidm|afk: can you check comment there when you have time please https://review.opendev.org/c/openstack/tripleo-ci/+/784760/1#message-e10d9ab24f67002bb96a371e992cc437ab6ceb18 if there are no objections i am going to nuke it from orbit | 07:56 |
ysandeep | bhagyashris, do we have retrospective today? I don't see invite yet for retro/planning | 07:59 |
bhagyashris | ysandeep, retrospective meeting is owned by wes i will check with wes but yeah in case retro will be there then it will be on tomorrow | 08:03 |
ysandeep | ack o/ thanks! | 08:04 |
bhagyashris | ysandeep, and we have regular planning meeting on Thursday | 08:05 |
zbr | morning! | 08:06 |
*** ysandeep is now known as ysandeep|lunch | 08:21 | |
*** ykarel is now known as ykarel|lunch | 08:50 | |
chkumar|ruck | zbr: sshnaidm|afk: please merge this https://review.opendev.org/c/openstack/tripleo-ci/+/784057 and https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/782020 thanks! | 08:52 |
*** dsneddon has joined #oooq | 09:00 | |
*** jpodivin has joined #oooq | 09:01 | |
*** derekh has joined #oooq | 09:02 | |
arxcruz | akahat: chkumar|ruck https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/778157 | 09:04 |
arxcruz | when you have time | 09:04 |
*** ysandeep|lunch is now known as ysandeep | 09:04 | |
chkumar|ruck | zbr: marios sshnaidm|afk https://review.opendev.org/c/openstack/tripleo-quickstart/+/784323 and this also | 09:05 |
jpodivin | This might be an odd question. But how does zuul determine which python tox environment to use for check/gate jobs? Because I'm looking at the layout file and can't find anything of the sort. The only option would be the tripleo-ci-centos-8-content-provider job, but doesn't really seem like it. | 09:08 |
*** holser has joined #oooq | 09:30 | |
sshnaidm|afk | jpodivin, do you mean tox jobs? Like python and linters? | 09:31 |
jpodivin | yep. | 09:32 |
jpodivin | I kind of got an answer for that through different channel. The reason I was asking is that we had checks running that weren't explicitly declared in the layout. Turns out they were inherited from template. | 09:35 |
zbr | marios: a revote on https://review.opendev.org/c/openstack/tripleo-heat-templates/+/784800 ? (chandan updated msg) | 09:56 |
*** sshnaidm|afk has quit IRC | 10:09 | |
*** ykarel|lunch is now known as ykarel | 10:11 | |
*** sshnaidm has joined #oooq | 10:18 | |
*** kopecmartin has joined #oooq | 10:21 | |
*** jfrancoa has joined #oooq | 10:28 | |
*** ykarel_ has joined #oooq | 10:32 | |
*** ykarel has quit IRC | 10:34 | |
*** jfrancoa has quit IRC | 11:10 | |
*** ykarel_ is now known as ykarel | 11:13 | |
akahat | chkumar|ruck, arxcruz bhagyashris marios please take a look when you are free: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32058 | 11:28 |
*** jpena is now known as jpena|lunch | 11:31 | |
marios | ack akahat | 11:32 |
*** frenzy_friday has joined #oooq | 11:34 | |
*** beagles has joined #oooq | 11:49 | |
*** rlandy has joined #oooq | 11:50 | |
rlandy | ysandeep: hi - what happened with the bm hardware? | 11:55 |
ysandeep | rlandy, they were fixed.. last time i checked | 11:55 |
ysandeep | rlandy, you are facing some issue? | 11:56 |
ysandeep | rlandy, if you are reffering previous issue regarding console.. HP server were reseated which fixed the issue | 11:57 |
rlandy | ysandeep: no - just checking | 11:57 |
ysandeep | rlandy, regarding dell, fyi.. have raised a ticket.. to add those servers in beaker.. so in future we can easily provision them | 11:58 |
*** derekh has quit IRC | 12:00 | |
*** derekh has joined #oooq | 12:01 | |
rlandy | ysandeep: we should be able to add them to beaker ourselves | 12:01 |
rlandy | unless things have changed | 12:01 |
*** amoralej is now known as amoralej|lunch | 12:02 | |
ysandeep | rlandy, ack will check if we have any mojo doc - how to do that | 12:02 |
rlandy | ysandeep: I've done it before | 12:02 |
rlandy | ysandeep: do you want all the machines added or just the underclouds? | 12:03 |
ysandeep | rlandy, all will be great(because we have more than 4 servers in some env - may be we can reuse them somehow) but undercloud is must | 12:04 |
rlandy | ysandeep: k - np - will add those | 12:04 |
ysandeep | rlandy, could you please show me when you do it.. i can add some/rest of them.. | 12:05 |
rlandy | sure | 12:06 |
ysandeep | thanks! ++ | 12:06 |
chkumar|ruck | rlandy: sshnaidm marios https://review.opendev.org/c/openstack/tripleo-ci/+/784887 | 12:12 |
rlandy | chkumar|ruck: ^^ why not use DIB_DNF_MODULE_STREAMS or something like that? | 12:14 |
zbr | sshnaidm: you abandoned the revert that removed the broken molecule job, and now https://review.opendev.org/c/openstack/tripleo-ansible/+/778095 is at the gate --- running *without* a test. | 12:14 |
chkumar|ruck | rlandy: since yum repos config are mounted from the host itself so I didnot used that | 12:15 |
chkumar|ruck | rlandy: Does in downstream we do something different? | 12:16 |
rlandy | https://github.com/openstack/diskimage-builder/blob/master/diskimage_builder/elements/rhel-common/pre-install.d/01-module-configuration | 12:16 |
rlandy | we went through this for rhel | 12:16 |
chkumar|ruck | rlandy: ok then will switch to that in default | 12:17 |
rlandy | chkumar|ruck: that's a rhel setup only though | 12:18 |
rlandy | chkumar|ruck: need help with that? | 12:20 |
rlandy | I can put in the patch if you like | 12:20 |
chkumar|ruck | rlandy: sure | 12:20 |
chkumar|ruck | rlandy: feel free to update the patch | 12:20 |
rlandy | ok | 12:20 |
chkumar|ruck | rlandy: we can set this in dib_dnf_module_streams in defaults with ternary operator for c8 | 12:21 |
rlandy | chkumar|ruck: I think that element only gets called for rhel systems | 12:21 |
rlandy | so in dib, we would have to move it to redhat-common | 12:22 |
rlandy | and then add the dib_dnf_module_streams in the defaults of the tripleo-ci role | 12:22 |
zbr | chkumar|ruck: can you help me clarify something on with a fix on tripleo-ansible? | 12:22 |
rlandy | redhat-common | 12:22 |
rlandy | Image installation steps common to RHEL, CentOS, and Fedora | 12:22 |
rlandy | rhel is only rhel | 12:23 |
chkumar|ruck | rlandy: then for current, let https://review.opendev.org/c/openstack/tripleo-ci/+/784887/2/roles/oooci-build-images/templates/build-images.sh.j2 tweak for centos only? | 12:23 |
chkumar|ruck | zbr: yes,please | 12:24 |
rlandy | chkumar|ruck; how desperate are you for that patch to merge? blocked? | 12:24 |
zbr | i think we need to be sure we also workflow https://review.opendev.org/c/openstack/tripleo-ansible/+/784759/1 | 12:24 |
chkumar|ruck | rlandy: ovb jobs are blocked for all c8 branches | 12:24 |
rlandy | if yes, we can merge that and revert when we have the dib fix | 12:24 |
zbr | because w/o it the other change is not tested | 12:24 |
zbr | look at the chain | 12:24 |
rlandy | chkumar|ruck:so - I will remove my -1, let this merge and revert it with the dib change | 12:25 |
rlandy | chkumar|ruck: ^^ ok? | 12:25 |
chkumar|ruck | rlandy: yes | 12:25 |
zbr | running tripleo-ansible-centos-8-molecule-tripleo-modules is essential for testing the fix sshnaidm made, but his patch does not run that job (we had to disable it last week to unblock the gates) | 12:25 |
sshnaidm | zbr, https://review.opendev.org/c/openstack/tripleo-ansible/+/784759 | 12:26 |
zbr | i just want to be sure we merge both of them at once. | 12:26 |
zbr | already +2 it | 12:26 |
zbr | hoping to get the rest from chkumar|ruck | 12:26 |
weshay|ruck | chkumar|ruck, zbr can I tear you two away from whatever you're up to in a few min? | 12:27 |
zbr | yep | 12:27 |
*** jpena|lunch is now known as jpena | 12:27 | |
chkumar|ruck | ok | 12:28 |
weshay|ruck | zbr, chkumar|ruck ready now? | 12:30 |
* weshay|ruck drops in link | 12:30 | |
rlandy | marios: bhagyashris: ysandeep: pojadhav: wallaby sync? | 12:30 |
weshay|ruck | https://meet.google.com/gez-zxir-cpt | 12:31 |
ysandeep | joining | 12:31 |
marios | rlandy: yes | 12:31 |
bhagyashris | rlandy, joining | 12:31 |
chkumar|ruck | weshay|ruck: https://review.opendev.org/c/openstack/tripleo-ci/+/784887/2/roles/oooci-build-images/templates/build-images.sh.j2 | 12:32 |
weshay|ruck | chkumar|ruck, zbr https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario001-standalone-master/f16a90b/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 12:34 |
rlandy | marios: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32787 | 12:37 |
bhagyashris | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32787 | 12:37 |
weshay|ruck | chkumar|ruck, https://review.opendev.org/c/openstack/tripleo-ansible/+/778095 | 12:42 |
chkumar|ruck | weshay|ruck: zbr https://review.rdoproject.org/r/c/testproject/+/33121 | 12:43 |
chkumar|ruck | weshay|ruck: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/784800 | 12:44 |
weshay|ruck | sshnaidm, qq.. | 12:45 |
weshay|ruck | I see | 12:45 |
weshay|ruck | 2021-04-06 10:55:32.300044 | fa163e5b-4a45-45fe-2de6-0000000054af | FATAL | Gather podman infos | standalone | error={"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} | 12:45 |
weshay|ruck | https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario001-standalone-master/f16a90b/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 12:45 |
chkumar|ruck | zbr: https://bugzilla.redhat.com/show_bug.cgi?id=1927697 | 12:45 |
openstack | bugzilla.redhat.com bug 1927697 in Package Review "Review Request: ansible-collection-containers-podman - Ansible collection for Podman containers" [Medium,Assigned] - Assigned to panemade | 12:45 |
weshay|ruck | think your patch may fix that? https://review.opendev.org/c/openstack/tripleo-ansible/+/778095 | 12:46 |
sshnaidm | weshay|ruck, fix what? | 12:46 |
weshay|ruck | FATAL | Gather podman infos | 12:46 |
sshnaidm | weshay|ruck, I don't have a context | 12:46 |
weshay|ruck | ya.. /me trying to convey that | 12:46 |
weshay|ruck | sshnaidm, poke at this log for a sec | 12:47 |
weshay|ruck | https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario001-standalone-master/f16a90b/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 12:47 |
weshay|ruck | timestamp: 2021-04-06 10:55:32.300044 | 12:47 |
weshay|ruck | sshnaidm, 2021-04-06T10:54:55.007991200+00:00 stderr F ERROR:__main__:InvalidConfig: KOLLA_CONFIG_STRATEGY is not set properly | 12:48 |
weshay|ruck | https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario001-standalone-master/f16a90b/logs/undercloud/var/log/containers/stdouts/aodh_api_cron.log.txt.gz | 12:48 |
marios | frenzy_friday: https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/multinode-jobs.yaml | 12:48 |
weshay|ruck | sshnaidm, testing the theory https://review.rdoproject.org/r/c/testproject/+/33121 | 12:50 |
chkumar|ruck | weshay|ruck: https://review.opendev.org/c/openstack/tripleo-ci/+/784887 | 12:51 |
*** ykarel_ has joined #oooq | 12:53 | |
sshnaidm | weshay|ruck, does it happen more than once? | 12:54 |
weshay|ruck | sshnaidm, ya.. in master, wallaby, working in victoria | 12:55 |
sshnaidm | weshay|ruck, not sure my patch is related.. but we can enable debug there and switch off no_log | 12:55 |
*** ykarel has quit IRC | 12:56 | |
rlandy | bhagyashris: chkumar|ruck: is there a TC/UA sprint planning meeting? | 12:58 |
bhagyashris | rlandy, i will let you know soon | 12:59 |
rlandy | thanks | 12:59 |
bhagyashris | but not for today may be tomorrow we will have | 12:59 |
chkumar|ruck | rlandy: bhagyashris what about after community call? TC/UA sync | 13:00 |
rlandy | chkumar|ruck: ack | 13:00 |
rlandy | weshay|ruck: ^^? | 13:00 |
weshay|ruck | sshnaidm, ya.. | 13:03 |
bhagyashris | chkumar|ruck, i have just send invite for tomorrow | 13:06 |
chkumar|ruck | bhagyashris: can we do the sync today itself? | 13:06 |
bhagyashris | i am ok with after community call as well | 13:06 |
bhagyashris | chkumar|ruck, ok | 13:06 |
bhagyashris | i will change the time | 13:06 |
*** amoralej|lunch is now known as amoralej | 13:07 | |
bhagyashris | done | 13:07 |
bhagyashris | today after community call UA?TC?PM sync | 13:07 |
bhagyashris | s/?// | 13:07 |
weshay|ruck | chkumar|ruck, want to reset that test job w/ https://review.opendev.org/c/openstack/tripleo-ansible/+/784948 | 13:12 |
weshay|ruck | I've rebased that on top of https://review.opendev.org/c/openstack/tripleo-ansible/+/778095 | 13:12 |
chkumar|ruck | weshay|ruck: updating reviewi | 13:14 |
chkumar|ruck | weshay|ruck: https://review.rdoproject.org/r/c/testproject/+/33121 done cc sshnaidm | 13:16 |
sshnaidm | chkumar|ruck, ack | 13:17 |
bhagyashris | arxcruz, zbr, sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, weshay|ruck , chkumar|ruck frenzy_friday | 13:23 |
bhagyashris | Community call in 7 mins | 13:23 |
weshay|ruck | bhagyashris, rlandy and I have a conflict | 13:23 |
bhagyashris | feel free to add the agenda here https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2021-04-06-Community-call | 13:24 |
bhagyashris | https://meet.google.com/bqx-xwht-wky?authuser=1 | 13:24 |
bhagyashris | weshay|ruck, ack | 13:24 |
marios | bhagyashris: what is the nyan cat doing in the bottom of your screen ;) | 13:33 |
bhagyashris | marios, i just observer that not sure what is this | 13:34 |
*** ykarel_ is now known as ykarel | 13:36 | |
rlandy | ysandeep: can you access internal zuul? still does not resolve for me | 13:44 |
ysandeep | rlandy, nope | 13:45 |
ysandeep | sshnaidm++ thanks! | 13:54 |
sshnaidm | sure, np | 13:55 |
bhagyashris | sshnaidm, marios thanks :) | 13:55 |
bhagyashris | chkumar|ruck, ysandeep soniya29 rlandy weshay|ruck UA/TC/PM sync in 3 mins | 13:57 |
soniya29 | bhagyashris, ack | 13:57 |
*** jmasud has joined #oooq | 14:22 | |
chkumar|ruck | weshay|ruck: zbr https://review.rdoproject.org/r/c/testproject/+/33121 and https://logserver.rdoproject.org/21/33121/2/check/periodic-tripleo-ci-centos-8-scenario001-standalone-master/cf703d8/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 14:46 |
chkumar|ruck | Failed container(s): ['ceilometer_gnocchi_upgrade'], check logs in /var/log/containers/stdouts | 14:46 |
weshay|ruck | chkumar|ruck, we have a bug on that | 14:46 |
chkumar|ruck | as per this https://trello.com/c/xG38kCYe/1898-cixlp1922282tripleociproa-master-gnocchiclientexceptionsresourcetypenotfound-resource-type-image-does-not-exist-http-404 | 14:47 |
chkumar|ruck | need to revert this patch https://review.opendev.org/c/openstack/puppet-ceilometer/+/775730 | 14:47 |
weshay|ruck | chkumar|ruck, https://review.opendev.org/c/openstack/puppet-ceilometer/+/784854 | 14:48 |
weshay|ruck | ah u created that | 14:48 |
chkumar|ruck | weshay|ruck: updated testproject https://review.rdoproject.org/r/c/testproject/+/33121 | 14:50 |
chkumar|ruck | let;see how it goes | 14:50 |
weshay|ruck | chkumar|ruck++ well done! | 14:50 |
chkumar|ruck | I am logging out, see ya tomorrow | 14:50 |
weshay|ruck | bhagyashris, please set up the retrospective board for tomorrow https://trello.com/b/0VFswmht/pcci-retrospective?menu=filter&filter=label:UniSprint41 | 14:58 |
weshay|ruck | create a new label for sprint 42 | 14:58 |
chkumar|ruck | weshay|ruck: new fixes added https://review.rdoproject.org/r/c/testproject/+/33121 please keep an eye | 15:11 |
rlandy | weshay|ruck: promotion criteria for victoria seems very minimal: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config_environments/rdo/CentOS-8/victoria.yaml | 15:15 |
rlandy | weshay|ruck: wallaby file was copied from there | 15:16 |
rlandy | I am following your suggestion to add the failing tests as commented out elements in the list | 15:16 |
rlandy | there are a lot more files than what is included | 15:16 |
*** jpodivin has quit IRC | 15:25 | |
weshay|ruck | chkumar|ruck, I see.. they need to be rebased on top of each other | 15:27 |
weshay|ruck | zbr, any info on the post-failures in gate? | 15:47 |
weshay|ruck | 778089,2 | 15:47 |
weshay|ruck | for example | 15:47 |
weshay|ruck | 778024,7 | 15:47 |
weshay|ruck | 779920,3 | 15:47 |
weshay|ruck | [09:27:11] <yoctozepto> I meant it failed twice with no logs | 15:48 |
weshay|ruck | [09:27:13] <clarkb> I see it is failing with a POST_FAILURE and has no logs | 15:48 |
weshay|ruck | [09:27:19] <yoctozepto> yes, yes indeed | 15:48 |
weshay|ruck | [09:27:22] <clarkb> we can check the logs on the zuul executors to see what happened there | 15:48 |
weshay|ruck | [09:27:27] <clarkb> I'm in a meeting but can do that after | 15:48 |
weshay|ruck | [09:27:28] <yoctozepto> thanks! :-) | 15:48 |
weshay|ruck | [09:28:47] <clarkb> there are a number of post failures in the zuul status so likely not job specific | 15:48 |
weshay|ruck | [09:28:49] <clarkb> fungi: ^ fyi | 15:48 |
-openstackstatus- NOTICE: POST_FAILURE results between 14:00 and 15:50 UTC can be safely rechecked, and were due to authentication problems in one of our storage donor regions | 15:52 | |
marios | weshay|ruck: please vote when you get a sec at https://review.opendev.org/c/openstack/puppet-tripleo/+/784787 thank you | 15:53 |
rlandy | zbr; chkumar|ruck: do you have a ruck/rover hackmd - I see sprint 41 - can't see 42 | 15:59 |
rlandy | checking wallaby against master failures | 15:59 |
rlandy | looking ofr a list of master failures you are debugging for comparison | 15:59 |
rlandy | ysandeep: hey ... there is a failure provisioning overclud instances on wallaby ... was thsi similar to what you saw in 17? https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-wallaby/38b3e1e/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 16:04 |
rlandy | master is getting by that | 16:04 |
rlandy | https://logserver.rdoproject.org/openstack-component-baremetal/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-baremetal-wallaby/9981343/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz - als broken | 16:05 |
ysandeep | rlandy, sry afk.. yeah looks like wallaby integraion line is ahead of master | 16:11 |
*** ykarel has quit IRC | 16:11 | |
ysandeep | rlandy, i requested pojadhav to add component job in criteria.. so we avoid this | 16:12 |
ysandeep | for wallaby ^^ | 16:12 |
rlandy | ysandeep: yeah - it's juts promoting | 16:12 |
* rlandy checks master component line | 16:12 | |
rlandy | https://logserver.rdoproject.org/openstack-component-baremetal/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-baremetal-master/945dbe4/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 16:14 |
*** jmasud has quit IRC | 16:14 | |
rlandy | nah - master gets by the provision piece | 16:14 |
zbr | weshay|ruck: any action on swift upload? | 16:17 |
ysandeep | rlandy, earlier i reported a bug of wallaby - https://bugs.launchpad.net/tripleo/+bug/1921501 | 16:17 |
openstack | Launchpad bug 1921501 in tripleo "Wallaby: ovb job are failing at overcloud deploy during baremetal provisioning, ERROR neutron.agent.dhcp.agent TypeError: Object of type 'ValueError' is not JSON serializable" [Critical,Triaged] | 16:17 |
weshay|ruck | zbr, think they took care of it.. | 16:17 |
weshay|ruck | zbr, will just interrupt patches for a while as it works through the system | 16:18 |
ysandeep | rlandy, but error in same file have now changed : https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-wallaby/38b3e1e/logs/undercloud/var/log/containers/neutron/dhcp-agent.log.txt.gz | 16:18 |
rlandy | FileNotFoundError: [Errno 2] No such file or directory: 'dnsmasq-kill': 'dnsmasq-kill' | 16:19 |
*** jmasud has joined #oooq | 16:20 | |
ysandeep | rlandy, yup.. i can debug this further in my morning .. | 16:20 |
rlandy | ysandeep: np - I ma doing that now | 16:20 |
ysandeep | thank! ++, I am out now.. will pick up incase needed | 16:21 |
*** ysandeep is now known as ysandeep|away | 16:24 | |
*** marios is now known as marios|out | 16:25 | |
weshay|ruck | outtage for a bday lunch | 16:38 |
rlandy | weshay|ruck: happy birthday | 16:39 |
*** ysandeep|away is now known as ysandeep | 16:53 | |
ysandeep | weshay|ruck, haaaappppppppppyyyyyyyyyy Birthdayyyyyyy !!!! | 16:53 |
ysandeep | rlandy, thank you for reporting https://bugs.launchpad.net/tripleo/+bug/1922767 | 16:55 |
openstack | Launchpad bug 1922767 in tripleo "Wallaby: OVB jobs are failing to provision overcloud nodes: ""No such file or directory: 'dnsmasq-kill'"" [Critical,Triaged] | 16:55 |
*** jpena is now known as jpena|off | 16:58 | |
rlandy | ysandeep: np - going through all the wallaby failures now | 17:00 |
rlandy | will also add component criteria | 17:00 |
*** derekh has quit IRC | 17:01 | |
*** amoralej is now known as amoralej|off | 17:03 | |
*** sanjayu_ has quit IRC | 17:35 | |
*** marios|out has quit IRC | 17:43 | |
*** jmasud has quit IRC | 17:46 | |
*** saneax has joined #oooq | 17:50 | |
*** jmasud has joined #oooq | 17:55 | |
*** saneax has quit IRC | 17:55 | |
ysandeep | sshnaidm, hey 0/ i have updated my patch for infra cleanup to use openstacksdk , I am still polishing it but appreciate your reviews https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/31410 , If you think we need any more feature from this script.. please let me know. high level doc here https://hackmd.io/uWo589BRQfWm6ZL0LaYlgQ?view | 18:50 |
ysandeep | its a big patch.. for now appreciate reviews about more feature / any design flaw if noticed | 18:51 |
*** ysandeep is now known as ysandeep|away | 18:56 | |
weshay|ruck | rlandy, internal sf is back | 19:13 |
rlandy | yay | 19:13 |
rlandy | weshay|ruck: https://images.rdoproject.org/octavia/ ... | 19:25 |
rlandy | copying master to wallaby | 19:26 |
weshay|ruck | k | 19:26 |
rlandy | any objections ... speak now or forever hold ... | 19:26 |
rlandy | weshay|ruck: do you have access to https://trunk.rdoproject.org/centos8-wallaby/? | 19:53 |
rlandy | RuntimeError: Failed to retrieve repo file from http://mirror.regionone.vexxhost-nodepool-tripleo.rdoproject.org:8080/rdo/centos8-wallaby/previous-current-tripleo/delorean.repo.md5 after 20 retries | 19:53 |
weshay|ruck | oh.. hrm | 19:54 |
rlandy | need a symlink there | 19:54 |
weshay|ruck | rlandy, we just need to promote w/ previous_current_tripleo | 19:54 |
rlandy | looking for right hash | 19:55 |
weshay|ruck | rlandy, just use current-tripleo | 19:56 |
rlandy | current-tripleo/2021-03-29 11:20 | 19:56 |
weshay|ruck | doesn't matter | 19:56 |
rlandy | is the oldest hash | 19:56 |
weshay|ruck | doesn't matter | 19:56 |
* rlandy thought dlrn checks that logic | 19:56 | |
* rlandy gets on promoter | 19:58 | |
weshay|ruck | it's in the infra doc, updated for the test promoters | 20:01 |
weshay|ruck | I updated it | 20:02 |
rlandy | yeah - was expecting to be able to source dlrn secret etc. | 20:02 |
weshay|ruck | rlandy, ya.. run the promote cli from the promoter | 20:07 |
*** jmasud has quit IRC | 20:14 | |
*** jmasud has joined #oooq | 20:15 | |
rlandy | weshay|ruck: k - so I need some help with the promote cli ... | 20:19 |
weshay|ruck | rlandy, think it's also in the doc | 20:19 |
rlandy | the doc ... https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/README.md? | 20:24 |
rlandy | nvm - I'll ask bhagyashris tomorrow | 20:26 |
weshay|ruck | rlandy, let's go through it | 20:33 |
weshay|ruck | I have a question for you as well | 20:33 |
rlandy | weshay|ruck: I'm getting there | 20:33 |
weshay|ruck | rlandy, /me added a comment to the doc w/ ur name | 20:34 |
weshay|ruck | although you *should* be able to use agg hash | 20:35 |
rlandy | weshay|ruck: meet.google.com/kxg-bzcw-gpe | 20:35 |
*** jbadiapa has quit IRC | 20:43 | |
*** slaweq has quit IRC | 20:49 | |
*** slaweq has joined #oooq | 20:51 | |
*** slaweq has quit IRC | 20:57 | |
rlandy | weshay|ruck: no agg-hash on repo-promote | 21:00 |
rlandy | only on repo-status | 21:00 |
weshay|ruck | rlandy, what version of the client is on this box | 21:01 |
weshay|ruck | rlandy, 0.11.0? | 21:02 |
rlandy | dlrnapi-client (0.11.0) | 21:03 |
weshay|ruck | rlandy, do you see.. promote-batch? | 21:03 |
weshay|ruck | https://github.com/softwarefactory-project/dlrnapi_client/blob/master/dlrnapi_client/shell.py#L112 | 21:03 |
rlandy | repo-promote-batch | 21:03 |
rlandy | repo-promote-batch Promote multiple repositories at the same time, as an | 21:04 |
rlandy | atomic operation. | 21:04 |
weshay|ruck | ya.. that's it | 21:04 |
rlandy | weshay|ruck: ^^ that option | 21:04 |
rlandy | trying | 21:04 |
rlandy | --hash-pairs HASH_PAIRS | 21:04 |
rlandy | commit_hash+distro_hash of the repos to be promoted, | 21:04 |
rlandy | specified as a comma-separated list of commit_distro | 21:04 |
rlandy | hash pairs | 21:04 |
rlandy | no agg-hash | 21:05 |
weshay|ruck | ya.. that sucks | 21:05 |
rlandy | weshay|ruck: yep https://github.com/softwarefactory-project/dlrnapi_client/blob/master/dlrnapi_client/shell.py#L114 | 21:05 |
weshay|ruck | perhaps we need to speak to him again | 21:05 |
rlandy | still component by component realy | 21:05 |
rlandy | yep | 21:05 |
rlandy | going to chat with jpena again | 21:06 |
rlandy | leaving this for the moment | 21:06 |
rlandy | will comment out of criteria and finish the rest | 21:06 |
weshay|ruck | rlandy, aye.. ok.. thanks for checking | 21:07 |
*** jmasud has quit IRC | 21:11 | |
rlandy | https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/785028 | 21:15 |
rlandy | and | 21:15 |
rlandy | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/33132 | 21:16 |
rlandy | wallaby status | 21:16 |
*** jmasud has joined #oooq | 21:38 | |
weshay|ruck | rlandy, merging both | 21:40 |
weshay|ruck | thanks | 21:40 |
rlandy | weshay|ruck: thanks - one more coming up | 21:52 |
rlandy | the compoenent criteria file | 21:52 |
*** jmasud has quit IRC | 22:08 | |
rlandy | weshay|ruck: one more https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/33134 | 22:14 |
weshay|ruck | rlandy, k.. is this realistic at this time? | 22:18 |
weshay|ruck | like these jobs listed as criteria are not blood red? | 22:18 |
rlandy | weshay|ruck: I'd rather we had the jobs in and commented them out | 22:19 |
weshay|ruck | k | 22:19 |
rlandy | than a wide open flood gate | 22:19 |
rlandy | then we can't get integration going | 22:19 |
weshay|ruck | ++ | 22:19 |
rlandy | safer this way | 22:19 |
weshay|ruck | tru | 22:19 |
* rlandy has warehouse duty | 22:19 | |
rlandy | will try the batch promotion later | 22:20 |
*** rlandy is now known as rlandy|bbl | 22:20 | |
*** holser has quit IRC | 22:23 | |
*** jmasud has joined #oooq | 22:40 | |
*** jmasud has quit IRC | 23:13 | |
*** jmasud has joined #oooq | 23:45 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!