Tuesday, 2021-04-27

*** sshnaidm_ has joined #oooq00:00
*** sshnaidm|afk has quit IRC00:01
*** sshnaidm_ has quit IRC00:07
*** sshnaidm_ has joined #oooq00:08
*** jmasud has quit IRC01:16
*** jmasud has joined #oooq01:26
*** apetrich has quit IRC02:09
*** jmasud has quit IRC02:21
*** jmasud has joined #oooq02:23
*** jmasud has quit IRC03:00
*** jmasud has joined #oooq03:27
*** jmasud has quit IRC03:47
*** jmasud has joined #oooq04:00
*** jmasud has quit IRC04:27
*** ratailor has joined #oooq04:33
*** ykarel has joined #oooq04:35
*** saneax has joined #oooq04:54
*** jfrancoa has joined #oooq05:07
*** udesale has joined #oooq05:08
*** jmasud has joined #oooq05:22
*** slaweq has joined #oooq05:52
*** amoralej has joined #oooq06:03
*** ysandeep|away is now known as ysandeep06:06
*** jpodivin has joined #oooq06:06
*** marios has joined #oooq06:13
*** pojadhav is now known as pojadhav|dentist06:21
*** apetrich has joined #oooq06:49
*** ysandeep is now known as ysandeep|lunch07:28
*** tosky has joined #oooq07:41
*** jmasud has quit IRC07:48
*** ratailor_ has joined #oooq07:53
*** jpena|off has joined #oooq07:54
*** jpena|off is now known as jpena07:54
*** ratailor has quit IRC07:55
*** jfrancoa has quit IRC08:07
*** jfrancoa has joined #oooq08:07
*** ratailor__ has joined #oooq08:25
*** ratailor_ has quit IRC08:27
*** pojadhav|dentist is now known as pojadhav09:05
*** ykarel is now known as ykarel|lunch09:13
*** jfrancoa has quit IRC09:52
*** jfrancoa has joined #oooq09:55
*** sshnaidm_ is now known as sshnaidm10:00
*** ykarel|lunch is now known as ykarel10:13
ykarelsshnaidm, marios can u check https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3348510:27
ykarelThanks10:29
mariosack ykarel10:34
*** radez has joined #oooq10:35
*** dsneddon has quit IRC10:50
arxcruzysandeep|lunch: hey i fix the tempestconf for osp, when you have chance please test it10:56
*** ysandeep|lunch is now known as ysandeep10:56
ysandeeparxcruz, sure, do you have a patch or its already merged?10:56
arxcruzysandeep: https://review.opendev.org/c/osf/python-tempestconf/+/78797510:57
arxcruzysandeep: already merged10:57
arxcruzbut might require promotion10:57
ysandeeparxcruz++ I will test it10:57
*** jpena is now known as jpena|lunch11:34
*** rlandy has joined #oooq11:49
*** rlandy is now known as rlandy|rover11:49
rlandy|roverbhagyashris: hey - is the promoter still off?11:53
rlandy|roverjust checking11:53
rlandy|roverysandeep: hey - weshay|ruck was reporting issues with the rhos-17 ovb job overcloud networks11:54
rlandy|roverdid he touch base with you?11:54
rlandy|roverperiodic-tripleo-ci-rhel-8-ovb-1ctlr_2comp-featureset020-internal-rhos-16.2openstack/tripleo-cimasteropenstack-periodic-integration-rhos-16.23 hrs 51 mins 13 secs2021-04-27 02:29:40SUCCESS11:56
rlandy|roverwe had a 16.2 success11:56
rlandy|roverso it looks better to me11:56
bhagyashrisrlandy|rover, nope i have on the promoter server with "manifest_push: false" because we dont have ppc containers on https://trunk.registry.rdoproject.org:8443/oapi/v1/namespaces/tripleomaster/imagestreamtags so i cant test11:56
bhagyashrislooks like ppc container job is failing https://ci.centos.org/job/tripleo-upstream-containers-build-master-ppc64le/ that's why we dont have that container on source registry11:57
rlandy|roverbhagyashris: k - so we're promoting all releases now11:57
bhagyashrisyes11:57
bhagyashrisin stead of blocking the promotion i trun on the promoter11:57
anbanerj|ruckrlandy|rover, pattern is the string and it is used as it is while forming logstash query. Regex is optional - if you add regex it is used by sova, if not then the pattern string is escaped and converted to regex and used by sova11:57
bhagyashrisand rlandy|rover fyi i am just turning on and off the promoter for master branch11:58
rlandy|roverbhagyashris: and the stable branches?11:58
rlandy|roverthey remain on, right?11:58
ysandeeprlandy|rover, i haven't spoke with wes regarding this11:58
anbanerj|ruckhttps://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/788069 looks good to me but the entry in .err file is missing. But that should be detected by the check jobs - I'll check why it did not complain11:58
bhagyashrisrlandy|rover, yes11:58
rlandy|roverysandeep: np - will touhc base with him11:59
rlandy|roverwhen he comes on line11:59
rlandy|roverI think it's just a 17 thing11:59
rlandy|rover16 looks ok11:59
ysandeeprlandy|rover, yes, I saw email from him.. but 16.2 looks okay , 16.2 Bm failure is on tempest12:00
rlandy|roverysandeep: ack - BM is  alegit failure12:00
rlandy|roverwe have an open BZ to compute12:00
rlandy|roverysandeep: so yeah  - from what I can see 16.2 is fine now12:00
rlandy|roveranbanerj|ruck: thanks - weshay|ruck and I took a stab at adding queries12:01
rlandy|rovernot sure we got them right12:01
ysandeepweshay|ruck, rlandy|rover, we got a request from delivery for moving to rc repos: https://code.engineering.redhat.com/gerrit/#/c/237073/ I have tested all the standalone scenarios in check in patchset#2, we can't test ovb, multinode till we have content-provider(wip still)12:05
rlandy|roverysandeep: ack - it's the best we can do12:07
rlandy|roverif the current run passes, I'll +1 it12:07
rlandy|roverwill have more time to get back to this all after I get off upstream12:07
*** rlandy|rover is now known as rlandy|rover|mtg12:07
*** ysandeep is now known as ysandeep|brb12:09
arxcruzakahat: did you had chance to test the manifest on promoter?12:19
bhagyashrisarxcruz, hey we on the manifest_push for master branch and we are facing the issue and that is fixed in this patch https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/33486/312:21
arxcruzbhagyashris: so, manifests are working on promoter, jut depending on this patch to work properly right ?12:22
arxcruzI'll start my tests on copy-quay then12:22
bhagyashriswe want to test that fix but we dont have ppc container pushed on the source registry because of ppc container push job is failing https://ci.centos.org/job/tripleo-upstream-containers-build-master-ppc64le/12:22
arxcruzi see12:24
bhagyashrisarxcruz, that patch is not tested yet12:24
bhagyashrisarxcruz, i have mentioned the issue here https://projects.engineering.redhat.com/browse/TRIPLEOCI-36812:25
*** ysandeep|brb is now known as ysandeep12:28
zbranbanerj|ruck: i was finally able to convert the queries to table format, check the new sheet inside ruck/rover12:30
rlandy|rover|mtgweshay|ruck: meeting?12:31
*** jpena|lunch is now known as jpena12:33
*** amoralej is now known as amoralej|lunch12:34
zbr@oooq: apparently nobody added notes to https://hackmd.io/@rh-openstack-ci/molecule/edit which is on today's agenda12:39
zbranbanerj|ruck: weshay|ruck: i do want to consult with you regarding cleaning existing queries, i got 3 different ones that look duplicates to me.12:41
zbrlines 44, 54, 55 inside the sheet12:41
anbanerj|ruckzbr, could you pls send me the spreadsheet link once more?12:44
zbrthe ruck rover document has two extra tabs in addition to alert one12:44
mariossshnaidm: please add to your list for revote - just added pydoc since your last +2 thanks https://review.opendev.org/c/openstack/tripleo-ci/+/784392/20..2112:47
mariosrlandy|rover|mtg: o/13:01
mariosrlandy|rover|mtg: branching time13:01
mariosor you have conflict?13:01
rlandy|rover|mtgmarios: coming - just leaving current meeting13:01
mariosrlandy|rover|mtg: ack13:02
*** ratailor__ has quit IRC13:09
anbanerj|ruckrlandy|rover|mtg, marios Reverts -  https://review.opendev.org/c/openstack/tripleo-ci/+/788257 and https://review.opendev.org/c/openstack/tripleo-ci/+/78825813:12
*** amoralej|lunch is now known as amoralej13:18
*** jlarriba has quit IRC13:18
bhagyashrisarxcruz, zbr, sshnaidm, rlandy|rover, anbanerj|ruck , marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, weshay|ruck , chandankumar13:20
bhagyashrisCommunity meeting in 10 mins13:20
weshay|rucksoniya29, can you please add context and links in the description here: https://projects.engineering.redhat.com/browse/TRIPLEOCI-43813:20
bhagyashrisfeel free to add the agenda https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2021-04-27-Community-call13:21
*** rlandy|rover|mtg is now known as rlandy|rover13:25
anbanerj|ruckrlandy|rover|mtg, I tried to rebase https://review.opendev.org/c/openstack/tripleo-ci/+/788258 on https://review.opendev.org/c/openstack/tripleo-ci/+/788257 Does that work?13:25
rlandy|roverweshay|ruck: ovb worked on 16.213:25
rlandy|roverso introspection thing is 17-related?13:25
anbanerj|ruckhttps://review.opendev.org/c/openstack/tripleo-ci/+/788257/1/zuul.d/content-provider.yaml - makes wallaby contentprovider back to voting13:26
rlandy|roveranbanerj|ruck: sorry about that  - my confusion13:26
anbanerj|ruckhttps://review.opendev.org/c/openstack/tripleo-ci/+/788258 - makes other wallaby + viictoria content provider voting13:26
bhagyashrismjturek, hi13:27
weshay|ruckzbr, you avail for community call?13:28
weshay|rucksshnaidm, can you join the ci community call for centos-stream-8 + moleculre13:28
weshay|ruckmolecule even13:28
zbryeah.13:28
sshnaidmweshay|ruck, I have gss call now, ruck/rovering :)13:28
weshay|rucksshnaidm, ah.. ya.. that's more important13:29
weshay|ruckhave fun :)13:29
weshay|rucksshnaidm, anything you want to relay?13:29
sshnaidmweshay|ruck, can we discuss after a call?13:29
weshay|ruckya.. ping me13:30
zbrweshay|ruck: i am bit confused about the meetings, i see now the tripleo meeting in my calendar, but video link and #openstack-meeting is also silent.13:30
zbrand in half and hour the community one with BJ link13:30
weshay|ruckzbr, re: the tripleo irc mtg.. or community call?13:30
weshay|ruckzbr, the community call is on rhos-team-meetings13:31
weshay|ruckperhaps you have a local copy that should be nuked13:31
zbrthat explains it, somehow that view got excluded...13:32
marioszbr: join us molecule talk on comunity call13:33
soniya29weshay|ruck, sure13:41
*** jlarriba has joined #oooq13:57
*** jlarriba has quit IRC13:59
*** jlarriba has joined #oooq14:00
bhagyashrismjturek, hey Good morning !14:11
bhagyashrismjturek, i see ppc container push job is failing https://ci.centos.org/job/tripleo-upstream-containers-build-master-ppc64le/ and due to this ppc containers are available on source registry here https://trunk.registry.rdoproject.org:8443/oapi/v1/namespaces/tripleomaster/imagestreamtags14:13
mjturekhey bhagyashris yeaaah started failing over the weekend14:14
mjturekI assume you mean they aren't available?14:14
bhagyashrismjturek, i mean if we see here https://trunk.registry.rdoproject.org:8443/oapi/v1/namespaces/tripleomaster/imagestreamtags i dont see the ppc one14:15
mjturekahhh right that;s expected14:15
mjturekis that breaking anything on the x86 side?14:16
bhagyashrismainly our promoter server pull the conatiner from here https://trunk.registry.rdoproject.org:8443/oapi/v1/namespaces/tripleomaster/imagestreamtags and pushed to docker.io14:16
bhagyashrisno it's not breaking on _x86 but i want the ppc one for testing our code14:16
mjturekcool - bhagyashris I will try to get the job restored today14:16
mjtureksorry for the trouble14:17
bhagyashrismjturek, no problem thanks :)14:17
bhagyashrismjturek, thanks! it would be great :)14:17
ysandeepweshay|ruck, 1:114:32
rlandy|roverhmmm ... our gate queue just got popular again14:35
rlandy|rover2021-04-27 11:05:34.446949 | fa163e4a-f377-9252-5e66-00000000647a |      FATAL | Gather podman infos | standalone | error={"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}14:36
rlandy|roverpossible scenario001 issue again ... tesrproject rerunning14:36
rlandy|roverweshay|ruck: ^^ fyi (in case you see that)14:37
rlandy|roveranbanerj|ruck: how are we looking on the skiplist cards? need anything merged?14:38
rlandy|roverarxcruz, : got the skiplist review for downstream in testproject testing now14:38
*** sshnaidm has quit IRC14:38
arxcruz rlandy|rover ack14:39
*** sshnaidm has joined #oooq14:40
bhagyashrisakahat, ^14:44
rlandy|roverysandeep: weshay|ruck: reported the node outages on downstream14:48
rlandy|roverysandeep: where was the review you wanted look at yesterday?14:51
*** ykarel has quit IRC14:57
ysandeeprlandy|rover, sry was in a 1:1 mtg, I am good with that change.. weshay|ruck merged that15:03
rlandy|rovercool15:03
akahatbhagyashris, noted.15:03
*** amoralej is now known as amoralej|off15:18
*** dsneddon has joined #oooq15:20
*** ysandeep is now known as ysandeep|away15:24
*** dsneddon has quit IRC15:25
*** jpodivin has quit IRC15:31
*** holser has quit IRC15:44
*** holser has joined #oooq15:45
*** ykarel has joined #oooq15:51
*** jmasud has joined #oooq15:51
rlandy|roverscenario010 on usuri is having issues- looking into that15:58
weshay|ruckrlandy|rover, /me updated program call doc, but can not attend tomorrow15:59
*** dviroel is now known as dviroel|lunch15:59
*** ykarel has quit IRC16:00
rlandy|roverweshay|ruck: np - I will attend16:01
rlandy|roverthanks for the updates16:01
rlandy|roverlunch - brb16:02
*** jmasud has quit IRC16:10
*** marios is now known as marios|out16:13
weshay|ruckrlandy|rover, do we specify the cirros version in internal zuul or anywhere internal?16:30
weshay|ruckrlandy|rover, context: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/785575/16:30
* rlandy|rover looks16:31
rlandy|roverweshay|ruck: we have some internal overrides of that16:32
weshay|ruckrlandy|rover, k.. let's keep it consistent16:32
rlandy|roverhttp://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-jobs.git/tree/zuul.d/standalone-jobs.yaml#n268\16:33
rlandy|roverweshay|ruck: ^^ like that16:33
rlandy|rover image.image_path: 'http://images.rdoproject.org/cirros/cirros-0.4.0-x86_64-disk.img'16:33
*** marios|out has quit IRC16:36
anbanerj|ruckrlandy|rover, I removed WF on https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/786249 - for card https://trello.com/c/CwsEzqwz/1894-cixlp1921918tripleociproa-train-fails-on-neutrontempestpluginscenarioadmintestfloatingipfloatingiptestcasesadmintesttwovmsfips16:44
rlandy|roverchecking16:44
rlandy|roveranbanerj|ruck: k- https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/786249 can merge?16:45
anbanerj|ruckyes, this passed https://review.rdoproject.org/r/c/testproject/+/33326. Lemme add that to comments16:46
anbanerj|ruckoh, you have done already, thanks16:47
rlandy|roveranbanerj|ruck: cool  -closing out bug and card16:47
rlandy|roverthanks16:47
*** udesale has quit IRC16:49
rlandy|roverweshay|ruck: https://trello.com/c/7TS5q3Fb/1798-cixlp1910107tripleociproa-master-wallaby-undercloud-install-failure-unable-to-start-network-service - still keeping this open?16:50
rlandy|roveranbanerj|ruck: k - so there are two cards left before we check out of ruck/rover :)16:52
rlandy|roverneed help resolving those?16:52
weshay|ruckrlandy|rover, ya.. keep it open16:52
rlandy|roverweshay|ruck: k - np16:52
weshay|ruckalmost there16:52
weshay|ruckjust need another promotion across the c8 branches to clear it16:53
weshay|ruckso the image has the fix16:53
*** dviroel|lunch is now known as dviroel16:53
rlandy|roveranbanerj|ruck: looks good ... https://review.rdoproject.org/r/c/testproject/+/3317516:53
anbanerj|ruckyes, not sure where I saw periodic-tripleo-ci-centos-8-standalone-upgrade-ussuri had failed16:54
anbanerj|ruckrlandy|rover, so this can merge https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/78551216:54
rlandy|rover tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern [166.495350s] ... ok16:56
rlandy|roverlooks good16:56
anbanerj|ruckhttps://trello.com/c/PQgy05Ai/1906-cixlp1923194tripleociproa-master-promotion-tempestscenariotestminimumbasictestminimumbasicscenariotestminimumbasicscenario-is-fa - this should be rebased on which patch?16:56
rlandy|roveranbanerj|ruck: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/785512 merging that16:57
rlandy|roverhttps://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/78624216:58
weshay|ruckrlandy|rover, we can run bm w/ testproject ya?16:58
rlandy|roveranbanerj|ruck: ^^ merge conflict16:58
rlandy|roverweshay|ruck: sure16:59
weshay|ruckk.. thanks16:59
rlandy|roverweshay|ruck: I have one in testproject16:59
rlandy|roverwhich one are you rerunning?16:59
weshay|ruckrlandy|rover, periodic-tripleo-ci-rhel-8-bm_envA-3ctlr_1comp-featureset035-rhos-1716:59
rlandy|roverweshay|ruck: k- np - rerunning the 16.2 one17:00
weshay|ruckoh I see17:00
*** jpena is now known as jpena|off17:01
rlandy|roverhttps://sf.hosted.upshift.rdu2.redhat.com/logs/10/207510/117/check/periodic-tripleo-ci-rhel-8-standalone-full-tempest-api-rhos-16.2/10d26dd/logs/undercloud/var/log/tempest/stestr_results.html17:04
rlandy|roverarxcruz++17:04
rlandy|roverit worked17:04
rlandy|roverweshay|ruck: ^^ skiplist downstream17:04
rlandy|roverarxcruz: anbanerj|ruck: weshay|ruck: would like to merge this ... https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/78800217:06
rlandy|roverpls vote17:06
*** saneax has quit IRC17:14
anbanerj|ruckhey rlandy|rover if you have some time - need a little help with the rebase17:21
weshay|ruckanbanerj|ruck, we put up patches yesterday adding a query17:22
weshay|ruckI have one w/o adding anything to the .err file17:22
weshay|ruckshouldn't the test fail?17:22
weshay|ruckanbanerj|ruck, https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/78805317:23
rlandy|roveranbanerj|ruck: k - np - will take a look17:26
anbanerj|ruckweshay|ruck, yes, both 788053 and 788069 should have failed. Checking why they didnt17:28
weshay|ruckanbanerj|ruck, thanks17:28
weshay|ruckrlandy|rover, can you try wf+ for me on this https://review.opendev.org/c/openstack/tripleo-image-elements/+/78761517:31
rlandy|roverweshay|ruck: it is w+'ed17:32
weshay|ruckyes.. I know17:32
weshay|ruckit's not kicking into the gate17:32
rlandy|roverweshay|ruck: done17:32
rlandy|roveranbanerj|ruck: k .. rebased https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/78624217:45
rlandy|roverreckicked testprojected17:45
rlandy|roverreckicked testproject17:45
rlandy|rovertrying again ... pretty pls https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/78624217:47
*** jmasud has joined #oooq18:10
*** anbanerj|ruck has quit IRC18:19
*** anbanerj|ruck has joined #oooq18:20
*** valleedelisle has joined #oooq18:22
*** _dvd has quit IRC18:29
*** openstackstatus has quit IRC18:31
*** openstackstatus has joined #oooq18:32
*** ChanServ sets mode: +v openstackstatus18:32
anbanerj|ruckweshay|ruck, looks like sova detected only overcloud_create_failed java_io_exception_remote_call ReadTimeoutError_HTTPConnectionPool - these 3 and ignored everything else. Checking why18:33
weshay|ruckk18:33
*** jmasud has quit IRC18:42
*** jmasud has joined #oooq18:51
*** jmasud has quit IRC19:50
*** dviroel is now known as dviroel|afk20:05
rlandy|roveranbanerj|ruck: I think this is the only revert we need ... https://review.opendev.org/c/openstack/tripleo-ci/+/78825820:22
rlandy|roverwill touch base with marios tomorrow20:22
*** jmasud has joined #oooq20:27
*** jmasud has quit IRC21:21
*** slaweq has quit IRC21:22
*** rlandy|rover is now known as rlandy|rover|bia21:41
*** jmasud has joined #oooq22:04
*** jmasud has quit IRC22:06
*** jmasud has joined #oooq22:11
*** jmasud has quit IRC22:19
*** jmasud has joined #oooq22:20
*** jmasud has quit IRC22:24
*** tosky has quit IRC23:08
*** jmasud has joined #oooq23:10
*** rlandy|rover|bia is now known as rlandy|rover23:19
*** jmasud has quit IRC23:27
*** jmasud has joined #oooq23:30
*** jmasud has quit IRC23:32
*** rlandy|rover has quit IRC23:45

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!