Wednesday, 2020-05-13

rlandyweshay|ruck: https://review.rdoproject.org/r/2745400:04
*** rfolco|rover|off has quit IRC00:25
*** Goneri has quit IRC00:41
*** jmasud has quit IRC01:44
weshay|ruckrlandy, +2wf01:53
rlandyweshay|ruck: thanks01:54
weshay|ruckwhat in the world.. https://review.opendev.org/#/c/724266/01:54
weshay|ruckcheck it out in https://zuul.openstack.org/status01:54
rlandylooking01:55
weshay|ruckrlandy, these jobs keep skipping01:55
rlandyhow does happen?01:55
rlandyskipped01:55
weshay|ruckopenstack-tox-linters OH01:55
weshay|ruckthat's why01:55
weshay|ruckthat should be fixed now /me looks01:56
weshay|ruckman.. you can look at something over and over and not see what you need to01:56
weshay|ruck:(01:56
rlandyhttps://zuul.openstack.org/builds?result=skipped01:56
rlandyweshay|ruck: that's when we need to log off and go to sleep01:56
weshay|ruckrlandy, :)01:57
weshay|ruckthis may fix it.. but ya.. you should get out of here :)01:57
rlandyI'm out01:58
*** rlandy has quit IRC01:58
*** jmasud has joined #oooq02:56
*** skramaja has joined #oooq03:30
*** sanjayu_ has joined #oooq03:49
*** ratailor has joined #oooq04:09
*** jmasud has quit IRC04:11
*** jmasud has joined #oooq04:22
*** ykarel|away is now known as ykarel04:26
*** dmellado has quit IRC04:45
*** jmasud has quit IRC04:49
*** jmasud has joined #oooq04:54
*** dpawlik has quit IRC05:04
*** udesale has joined #oooq05:36
*** jbadiapa has joined #oooq05:36
*** jmasud has quit IRC05:46
*** ysandeep|away is now known as ysandeep05:50
*** ccamacho has joined #oooq06:00
*** jmasud has joined #oooq06:01
*** jfrancoa has joined #oooq06:08
*** marios has joined #oooq06:16
*** jmasud has quit IRC06:18
*** jmasud has joined #oooq06:19
*** dpawlik has joined #oooq06:25
*** jmasud has quit IRC06:49
*** jmasud has joined #oooq07:03
*** apetrich has quit IRC07:11
*** yolanda has joined #oooq07:21
*** jmasud has quit IRC07:30
*** holser has joined #oooq07:33
*** amoralej|off is now known as amoralej07:34
*** tosky has joined #oooq07:35
*** dmellado has joined #oooq07:37
*** apetrich has joined #oooq07:45
*** apetrich has quit IRC07:45
*** apetrich has joined #oooq07:46
*** jpena|off is now known as jpena07:56
chandankumarmarios, https://review.rdoproject.org/r/#/c/26909/ please +w it , thanks!08:14
marioschandankumar: checking08:14
*** ykarel is now known as ykarel|lunch08:30
*** matbu has quit IRC08:53
*** Tengu has quit IRC08:57
*** Tengu has joined #oooq08:58
chandankumarjpena, Hello08:59
jpenao/08:59
chandankumarjpena, can you take a look at this review https://review.opendev.org/727200 , I am kind of stuck at this part https://review.opendev.org/#/c/727200/8/roles/build-test-packages/tasks/main.yml@20809:00
jpenasure, I'll have a look09:00
jpenachandankumar: I think it's just a missing blank before "zuul_repo_changes"09:02
jpenait's only 1 extra blank instead of 2 below set_fact09:02
jpenachandankumar: btw, when iterating on the zuul items, I use zuul['items'] instead of zuul.items09:05
jpenamaybe that will fix it09:05
*** jfrancoa has quit IRC09:06
chandankumarjpena, let me try that09:08
jpenaI added a comment to the review, just in case09:08
chandankumarjpena, yes thanks!09:11
*** dtantsur|afk is now known as dtantsur09:13
*** matbu has joined #oooq09:20
*** jfrancoa has joined #oooq09:22
*** ykarel|lunch is now known as ykarel09:24
*** holser has quit IRC09:41
*** holser has joined #oooq09:42
*** ysandeep is now known as ysandeep|lunch10:09
*** derekh has joined #oooq10:20
*** dpawlik has quit IRC10:21
*** holser has quit IRC10:24
*** holser has joined #oooq10:25
*** udesale_ has joined #oooq10:36
*** udesale has quit IRC10:38
chandankumarjpena, can you verify other changes related to project.ini file https://review.opendev.org/#/c/727200/ here10:52
jpenachandankumar: I see no changes to projects.ini in that commit10:53
chandankumarjpena, https://review.opendev.org/#/c/727200/12/roles/build-test-packages/defaults/main.yml10:54
*** ysandeep|lunch is now known as ysandeep10:55
chandankumarjpena, does dlrn_target would be redhat-local?10:55
chandankumarjpena, it is getting skipped at this part https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/build-test-packages/tasks/main.yml#L23210:56
jpenachandankumar: got in a meeting, will check later10:56
chandankumarjpena, sure11:01
jpenachandankumar: let's wait for the current PS result, I'll check the logs and see if I find anything interesting11:24
chandankumarjpena, sure11:24
*** dpawlik has joined #oooq11:32
*** jpena is now known as jpena|lunch11:34
chandankumarjpena|lunch, here is the logs of current run https://sf.hosted.upshift.rdu2.redhat.com/logs/84/200084/6/check/periodic-tripleo-ci-rhel-8-standalone-rhos-17/5ec40ea/job-output.txt11:46
*** amoralej is now known as amoralej|lunch11:58
*** holser has quit IRC12:03
*** holser has joined #oooq12:04
*** rfolco has joined #oooq12:04
*** rfolco is now known as rfolco|rover12:05
*** rlandy has joined #oooq12:09
rlandymarios: hey12:12
rlandyhow's it going this morning?12:12
rlandymarios: ok to w+ https://review.opendev.org/#/c/727438/?12:13
mariosrlandy: o/12:14
mariosrlandy: sec dciabrin had a test going12:14
mariosrlandy: no sorry confusing things yes lets merge it12:14
rlandymarios: I can't - you can :)12:14
mariosrlandy: yeah done12:14
mariosrlandy: and parent12:15
rlandymarios++12:15
mariosrlandy: :/ just clickd a button ;)12:15
rlandymarios: yes - but you earned the honor of clicking that button12:16
mariosrlandy: so standalone has same issue/i know/saw chandankumar chasing the fix here with the build packages ... i am trying consistent at https://code.engineering.redhat.com/gerrit/#/c/20005012:16
sshnaidm|afkchandankumar, wrt build images, I think there is a problem with "gating-repo": https://logserver.rdoproject.org/63/27463/1/check/tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-upload/2ec560b/logs/undercloud/home/zuul/build.log.txt.gz12:16
*** sshnaidm|afk is now known as sshnaidm12:16
mariosrlandy: we can jump on phone after the sync call if you like12:16
chandankumarsshnaidm, yes, saw the same on fs039 testproject change12:16
mariosrlandy: posted the criteria files, looking at the image build stuff now12:16
rlandymarios: ok - I'm going to work on promote-to-promoted-components12:16
*** ysandeep is now known as ysandeep|brb12:17
rlandysure - we can touch base after call12:17
mariosrlandy: according to ykarel should be fixed in consistent they updated it yesterday (you can see http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17/component/tripleo/86/fc/86fc1740c405e73c094012e8d341cf9d1e71e347_3e9ef843_707aa5c1/ * puppet-mysql-10.4.0-0.20200512181921.fff2c82.el8ost.noarch.rpm2020-05-12 14:2812:17
rlandymarios: looks like consistent still failed?12:18
mariosrlandy: already? checking12:19
* rlandy gets tea ... brb12:19
mariosrlandy: no still running12:19
mariosrlandy: https://code.engineering.redhat.com/gerrit/#/c/200050/12:19
mariosrlandy: ah i see it failed in console didn't report yet ack12:20
bhagyashris|ruckweshay|ruck, rfolco|rover o/ regarding https://bugs.launchpad.net/tripleo/+bug/1877031 Alan comment on bug comment #212:22
openstackLaunchpad bug 1877031 in tripleo "queens tripleo-ci-centos-7-undercloud-upgrades broken for ansible version" [High,Triaged] - Assigned to Rafael Folco (rafaelfolco)12:22
bhagyashris|ruckso should we deprecate this job?12:22
rlandymarios: criteria files look good to me12:29
rlandyexcept we use a different username12:29
rlandycommenting - and then we can merge12:29
chandankumarrfolco|rover, want to do a catchup on ussuri pipeline today when free?12:29
weshay|ruckbhagyashris|ruck, check the review :)12:29
rfolco|roverchandankumar, under gun atm, not sure I survive from this12:30
rfolco|roverchandankumar, ttyl12:30
bhagyashris|ruckweshay|ruck, ah ok thanks :)12:31
chandankumarrfolco|rover, ok, you will survive man12:32
sshnaidmchandankumar, I think need to run install_built_repo role to get this gating_repo up..12:38
*** jpena|lunch is now known as jpena12:40
chandankumarweshay|ruck, marios rlandy https://review.rdoproject.org/r/#/q/topic:centos8train+(status:open+OR+status:merged)12:50
chandankumarweshay|ruck, https://review.opendev.org/#/c/724266/12:54
rlandysshnaidm: hi ... https://sf.hosted.upshift.rdu2.redhat.com/logs/periodic/code.engineering.redhat.com/openstack/tripleo-ci-internal-jobs/master/periodic-tripleo-ci-centos-7-bm_envC-1ctlr_1comp-featureset001-train/2ab1a2b/job-output.txt shoudl have run with your change12:55
sshnaidmrlandy, can we run it with https://review.opendev.org/#/c/727688/ ?12:59
sshnaidmrlandy, it should work in train12:59
rlandysshnaidm: no - it ran with the one that merged ...12:59
sshnaidmrlandy, I mean can we run it again with that patch ^13:00
*** amoralej|lunch is now known as amoralej13:00
rlandysshnaidm: yep - doing that now13:00
sshnaidmrlandy, great, thanks!13:00
chandankumarsshnaidm, we might need to hook this part in the build-images itself https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/playbooks/baremetal-prep-virthost.yml#L156 ?13:02
*** ratailor has quit IRC13:04
pandasshnaidm: do you know if we have any cleanup scripts in downstream tenant ?13:07
sshnaidmpanda, not that I'm aware of13:08
pandasshnaidm: ok, thanks13:08
*** ykarel is now known as ykarel|afk13:09
rlandysshnaidm: https://code.engineering.redhat.com/gerrit/200295 Test train BM13:13
chandankumarjpena, re updated with release https://code.engineering.redhat.com/gerrit/200084 var13:13
*** chem has quit IRC13:13
*** chem has joined #oooq13:15
chandankumarweshay|ruck, rlandy https://review.rdoproject.org/r/#/c/27461/13:17
akahatmarios, o/13:25
akahatany updates on this: https://review.opendev.org/#/c/725465/13:25
akahator should i abandon it?13:25
mariosakahat: no don't abandon it could be needed ... honestly i didn't get chance to revisit but did you test it with testproject? if so try and get a few runs with it. if all good then we can consider merging13:29
mariosakahat: needs a few runs because the problem was inconsistent :/ so we can only increase confidence in the fix by running a bunch of times13:30
akahatmarios, i didn't tried with testproject. I'll try.13:30
akahatmarios, okay. :)13:31
mariosakahat: yeah try getting the periodic fs39 running with that and see if it helps13:31
akahatmarios, on it.13:31
*** ysandeep has joined #oooq13:34
rlandymarios:  pls review - https://code.engineering.redhat.com/gerrit/200304 Use current for tripleo component in rhos-17 release files.13:37
mariosrlandy: ack checking13:38
mariosrlandy: ack i only have +1 there but i tried to +A i think you need to submit13:39
rlandymarios: thanks - merged13:40
rlandymarios: updating standalone job names now13:41
*** TrevorV has joined #oooq13:42
pandarlandy: can you join openstack-pcci ?13:50
rlandypanda: joined13:51
pojadhavx13:58
rlandymarios:  https://code.engineering.redhat.com/gerrit/200310 Use shorter names for the component standalone jobs.13:58
rlandy^^ I think that is all that is needed.13:58
rlandypls check me13:58
ysandeeprlandy, can you please share link for internal zuul?13:59
*** ykarel|afk is now known as ykarel13:59
mariosrlandy: ack will do in couple mins13:59
rlandyysandeep: sharing in pvt13:59
rlandymarios: https://code.engineering.redhat.com/gerrit/#/c/200262/2/ci-scripts/dlrnapi_promoter/config/RedHat-8/component/rhos-17.yaml will need update - sorry14:00
ysandeeprlandy, thanks!14:00
mariosrlandy: ack yeah i was waiting for your review and will update mine for the names np14:01
mariosas discussed14:01
rlandymarios: since we moved all definitions out of config, I think that should do it14:01
mariosrlandy: k lets merge?14:01
rlandymarios: sure - we're living on the edge these days14:02
rlandymarios: we'll see in 7 minutes if the right job kicks in octavia14:07
mariosrlandy: so the standalone job was still using the 'old' puppet-mysql https://sf.hosted.upshift.rdu2.redhat.com/logs/50/200050/6/check/periodic-tripleo-ci-rhel-8-standalone-rhos-17/eb6d2e1/logs/undercloud/var/log/dnf.log * 2020-05-13T11:52:15Z DEBUG ---> Package puppet-mysql.noarch 10.4.0-0.20200430143737.39b7bde.el8ost will be installed14:11
rlandyweird - why?14:11
mariosrlandy: so we can't yet claim it dind't work... latest one we should be using (aparently) is puppet-mysql-10.4.0-0.2020051218192114:11
rlandymarios: can we kick again since we updated the release file to use current?14:12
mariosrlandy: i don't know i'm digging at job logs.. afaics the repo setup/environments is correct... however a) we don't have puppet-mysql under include packages in deloren -current14:12
rlandymarios: maybe we should?14:12
mariosrlandy: but delorean-current still points to the old version @ http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17/component/tripleo/94/d9/94d95030b06a998c67c83e67611bfdc73590238c_dbbbbc96_9f85432c/14:12
mariosrlandy: via https://sf.hosted.upshift.rdu2.redhat.com/logs/50/200050/6/check/periodic-tripleo-ci-rhel-8-standalone-rhos-17/eb6d2e1/logs/undercloud/etc/yum.repos.d/ repos i mean14:12
rlandymarios: how come current is behind consistent?14:13
rlandythey just updated consistent and not current?14:13
mariosrlandy: well it wasn't using current cos you only just merged that14:13
mariosrlandy: but no current & consistent have same14:14
rlandybut as you point out  puppet-mysql is not in the list14:14
mariosrlandy: in fact current /consistent have the right version, we're just not  picking it up         * http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17/component/tripleo/current/         * puppet-mysql-10.4.0-0.20200512181921.fff2c82.el8ost.noarch.rpm2020-05-12 14:2814:14
rlandymarios: how about this?14:15
marios        * http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17/component/tripleo/consistent/         * puppet-mysql-10.4.0-0.20200512181921.fff2c82.el8ost.noarch.rpm2020-05-12 14:2814:15
rlandymarios: we make a DNM review14:15
rlandythat adds puppet-mysql to the ist of files we takes from current14:15
rlandyand rerun14:15
rlandyie: we update the release file14:15
mariosrlandy: ack on environments ok will try it14:15
rlandyand add a depends-on change14:15
mariosrlandy: i'll add it as dependency on the test14:16
rlandycorrect14:16
rlandyone last try14:16
rlandyI'm testing out promote-to-promoted-components14:16
mariosrlandy: but i wonder why thye aren't including that upstream ... anyway lets see if it helps... but anyway this isn't something we'll need to merge its just to get a green run on standalone... the fixes will appear in next day /so once upstream merges14:17
rlandymarios: no idea how they chose that list14:17
rlandybut yeah - just a check to see if it goes green14:17
zbrchandankumar: hi14:19
mariosrlandy: https://code.engineering.redhat.com/gerrit/#/c/200050/14:20
*** Goneri has joined #oooq14:20
pandaarxcruz: help14:23
rlandymarios: here's hoping that works !!14:24
rlandy"msg": "file not found: /home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/ci-scripts/dlrnapi_promoter/config/RedHat-8/component/rhos-17.yaml"14:27
rlandymarios: ^^ ugh - it's not picking up the override - will change to make another change in review.rdoproject.org/config14:27
chandankumarzbr, hello14:32
mariosrlandy: :/ k ... going to update the criteria for the names now14:33
rlandymarios: thanks14:33
*** ysandeep is now known as ysandeep|compute14:37
*** ysandeep|compute is now known as ysandeep|server14:37
*** ysandeep|brb is now known as ysandeep14:38
chandankumarweshay|ruck, rlandy I will be not around for upcoming 2 hours14:40
chandankumarsummer is going crazy here14:40
rlandychandankumar: k - will touch base when you ge tback14:42
arxcruzpanda: i need somebody help!14:45
pandaarxcruz: not just anybody, help!14:46
arxcruzpanda: whats up ?14:46
pandaarxcruz: nyou know I need someone , heeeeeeelp14:46
arxcruzpanda: :D what can i do for ya ?14:46
pandaarxcruz: this quick fix is not quick at all  https://review.opendev.org/72267714:46
pandaarxcruz: so the correct configuration path is api_settings.enabled_provider_drivers it seems14:47
arxcruzovn:ovn ?14:47
pandaarxcruz: do I add that just like this or do I have to use loadbalancer.api_settings.14:47
arxcruzwasn't just ovn ?14:47
arxcruzloadbalancer.api_settings.enabled_provider14:48
pandaarxcruz: unfortunately not https://docs.openstack.org/octavia/latest/configuration/configref.html14:48
arxcruzpanda: hmmmm usually, is section.value14:48
pandait needs a list of dictionary driver:description14:48
pandaarxcruz: hence ovn:ovn14:49
cgoncalvesamphora:best provider driver ever,ovn:openflow-based bla bla,[...]14:49
pandaarxcruz: but the INI file wants [api_setting] enabled_proiver_dirvers = 'ovn:ovn'14:49
arxcruzpanda: not according octavia tempest plugin14:49
pandacgoncalves: yes, ovn:ovn should work14:49
arxcruzpanda: https://github.com/openstack/octavia-tempest-plugin/blob/master/octavia_tempest_plugin/config.py#L34-L10414:50
pandaarxcruz: then I have no idea, it's still failing with the same error, provider ovn is not found14:50
arxcruzpanda: should be load_balance.enabled_provider_drivers14:50
pandamaybe tempest plugin needs update ?14:50
pandaarxcruz: tempest fails with the same error "provider ovn was not found14:51
arxcruzpanda: so, it's not tempest fault i guess, maybe the ovn provider isn't configured properly on octavia side ?14:51
cgoncalvesarxcruz, I have not been following the conversation. mind sharing a tl;dr?14:52
arxcruzcgoncalves: tl;dr is, we are trying to configure tempest to run octavia tests14:52
arxcruzit's failing because ovn driver isn't found14:52
cgoncalvesthe OVN provider driver is not available in tripleo ussuri/master yet14:52
* panda facepalm14:53
pandaI thought it was14:53
cgoncalvesRDO RPM completed some days ago. team has not yet updated it in kolla14:53
cgoncalvesmaybe ping haleyb and mjozefcz14:53
jfrancoaweshay|ruck: I might be the 1000th person asking this, but what is it with the:  500 Server Error: Proxy Error for url: http://mirror.ord.rax.opendev.org:8082/v2/ error?14:54
arxcruzpanda: lessons learned: almost never is tempest fault :)14:54
rlandymarios: is the .gitignore change intended in https://code.engineering.redhat.com/gerrit/#/c/200262/?14:55
cgoncalvesarxcruz, do you want to test ovn or amphora is good enough?14:55
cgoncalvesarxcruz, https://review.opendev.org/#/c/713960/14:55
arxcruzcgoncalves: ovn14:55
arxcruzcgoncalves: are you brazilian by any chance?14:56
arxcruzlol14:56
cgoncalvesarxcruz, portuguese14:56
pandacgoncalves: we are trying to configure the end to end tripleo integration test for ovn provider14:56
pandacgoncalves: it's not for us, it's a tripleo job, but if it's not ready, it's not ready.14:57
cgoncalveswe have non-voting tripleo-ci-centos-7-scenario010-ovn-provider-standalone14:57
rlandymarios: https://code.engineering.redhat.com/gerrit/#/c/200262/4 ... one question on review14:57
pandacgoncalves: can you updated https://bugs.launchpad.net/tripleo/+bug/1877971 with this info ?14:58
openstackLaunchpad bug 1877971 in tripleo "ovn-provider-standalone jobs failing tempest tests with "Provider 'ovn' is not enabled."" [High,In progress] - Assigned to Gabriele Cerami (gcerami)14:58
pandacgoncalves: yes, that exactly what we wre trying to fix14:58
pandacgoncalves: we thought it was a problem with tempest configuration, and maybe it was anyway, so at least my patch is not for nothing14:59
cgoncalvesnop, need to update package name to new one in ussuri+14:59
cgoncalveshttps://opendev.org/openstack/tripleo-common/src/branch/master/container-images/tripleo_kolla_template_overrides.j2#L34614:59
cgoncalveshttps://review.rdoproject.org/r/#/c/25972/15:00
mariosrlandy: thanks done15:00
pandacgoncalves: ok, but after the package is updated, tempest plugin must be configured with those values in the patch, right ? otherwise will just try to use amphora ?15:00
cgoncalvespanda, no changes required in the tripleo 010-ovn job15:01
pandacgoncalves: what will configure tempest to make it use ovn provider then ?15:02
rlandymarios: merging - we can adjust afterwards if needed15:03
mariosrlandy: thanks15:03
rlandymarios: no luck on the standalone deploy?15:06
rlandy2020-05-13T14:53:18.386019159+00:00 stderr F <13>May 13 14:53:18 puppet-user: Error: Evaluation Error: Unknown function: 'mysql_password'.15:06
mariosrlandy: ah yeah it finished few mins ago failed again :/15:07
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/50/200050/7/check/periodic-tripleo-ci-rhel-8-standalone-rhos-17/440d3c3/logs/undercloud/etc/yum.repos.d/delorean-current.repo15:07
cgoncalvespanda, https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/standalone-jobs.yaml#L82415:07
cgoncalvespanda, OVN provider is auto-enabled in Octavia on OVN ML2 deployments15:07
mariosrlandy: that repo has the 'right' version sec15:08
marios rlandy: checking dnf log15:08
rlandypuppet-mysql.noarch                           10.4.0-0.20200430143737.39b7bde.el8ost          @delorean-component-tripleo15:08
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/50/200050/7/check/periodic-tripleo-ci-rhel-8-standalone-rhos-17/440d3c3/logs/undercloud/var/log/extra/package-list-installed.txt15:08
rlandymarios: ^^15:08
mariosrlandy: hmm no that's the old one15:08
mariosrlandy: yeah :/15:08
rlandymarios: why are we getting the old one?15:09
mariosrlandy: don't know i mean see dnf.log 2020-05-13T14:30:24Z DEBUG Includes in repo delorean-current: ansible-config_template, ansible-role-container-registry, ansible-role-tripleo*, ansible-tripleo-ipsec, instack, instack-undercloud, openstack-tripleo-*, os-apply-config, os-collect-config, os-net-config, os-refresh-config, paunch-services, puppet-cinder, puppet-glance, puppet-heat, puppet-horizon,15:09
mariospuppet-ironic, puppet-keystone, puppet-mistral, puppet-mysql, puppet-neutron, puppet-nova, puppet-openstacklib, puppet-swift, puppet-tripleo, puppet-zaqar, python*-paunch*, python*-tripleo*, tripleo-ansible15:09
mariosrlandy: puppet-mysql is there15:09
ykarelmarios, rlandy because of repo priority15:10
mariosykarel: ah i was just wondering about that... but its the same as upstream i mean we copy/pasted that... checking15:10
ykareldelorean-component-tripleo priority is higher than delorean-current15:10
rlandyhttp://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17/component/tripleo/86/fc/86fc1740c405e73c094012e8d341cf9d1e71e347_3e9ef843_707aa5c115:10
pandacgoncalves: all right15:10
rlandy[delorean-component-tripleo] priority=115:11
rlandy[delorean-current] priority=1015:11
mariosrlandy: ykarel: delorean-current has priority 1015:11
ykarelyes because of ^15:11
ykarel1 is highest15:12
mariosykarel: ah ok15:12
ykarelif upstream also has this then this needs to be fixed15:12
ykarelcurrent should have high priority than promoted ones15:12
mariosykarel: we should also add puppet-mysql there too right it isn't upstream15:12
rlandychecking  upstream15:12
mariosrlandy: ykarel: https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/tripleo-ci/CentOS-8/promotion-testing-hash-master.yml#L6615:13
rlandysame15:13
mariosrlandy: i'll test with https://code.engineering.redhat.com/gerrit/#/c/200312/ sec updating15:13
rlandy[delorean-component-tripleo]15:14
rlandyname=delorean-openstack-tripleo-heat-templates-12bdcf666a8fb2587c80e91cb7f4512525882e6315:14
rlandybaseurl=http://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos8/component/tripleo/12/bd/12bdcf666a8fb2587c80e91cb7f4512525882e63_76ebc46515:14
rlandyenabled=115:14
rlandygpgcheck=015:14
rlandypriority=2015:14
weshay|ruckbhagyashris|ruck, can you go through this.. and perhaps organize it into sections please.. and maybe provide a little more context per link https://hackmd.io/07z0xroHTFi2IbX93P5ZfQ?both15:14
rlandymarios: upstream is different15:14
rlandymarios: hold on15:14
weshay|ruckbhagyashris|ruck, ping w/ any questions15:14
rlandymarios: we need another change15:15
bhagyashris|ruckweshay|ruck, ack15:15
rlandysec15:15
weshay|ruckthanks15:15
ykarelmarios, as puppet-mysql is not gated with tripleo jobs it's not in that list15:15
mariosykarel: ok using it there just for testing for now https://code.engineering.redhat.com/gerrit/#/c/200312/2/config/release/promotion-testing-hash-rhos-17.yml15:16
mariosykarel: until we get the change d/stream merging today hopefully upstream15:16
*** jmasud has joined #oooq15:17
mariosrlandy: ack updated that DNM https://code.engineering.redhat.com/gerrit/#/c/200312/ and rechecked there https://code.engineering.redhat.com/gerrit/#/c/200050/ - but you might want to add another depends-on if we need something else15:17
rlandymarios: hold - putting in change15:17
mariosrlandy: i am going to leav in a bit15:17
mariosrlandy: ack no worries i can just cancel the run and add whatever you post in depends15:17
ykarelmarios, ack should work15:18
ykarelmarios, should fix upstream too https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-8/master.yml#L5315:19
mariosykarel: ack will do15:20
rlandymarios: ykarel: https://code.engineering.redhat.com/gerrit/200319 Lower priority of component repos in delorean.15:21
* rlandy needs to drop - interest reset15:21
ykarelmarios, okk in upstream it's fine, being handled differently https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-8/master.yml#L13815:22
mariosrlandy: ack we can merge that way but https://code.engineering.redhat.com/gerrit/#/c/200312/2/config/release/promotion-testing-hash-rhos-17.yml shoudl do the trick for the test?15:22
mariosykarel: yeah looks like what rlandy just posted15:22
ykarelmarios, ohhk, hmm that's same15:23
*** rlandy_ has joined #oooq15:23
rlandy_marios: ykarel: sorry - back - merging  https://code.engineering.redhat.com/gerrit/#/c/200319/15:25
*** rlandy has quit IRC15:25
ykarelack15:25
mariosrlandy_: ack15:25
*** rlandy_ is now known as rlandy15:25
rlandymatios: ok - let's try your testproject job again15:27
*** sshnaidm is now known as sshnaidm|afk15:28
mariosrlandy: sure... should be same but feel free to update15:28
rlandywe need to update the patch15:28
mariosrlandy: i mean i added priority @ https://code.engineering.redhat.com/gerrit/#/c/200312/2/config/release/promotion-testing-hash-rhos-17.yml15:28
mariosrlandy: just to test15:28
*** skramaja has quit IRC15:31
mariosrlandy: starting shutdown sequence, feel free to update test @ https://code.engineering.redhat.com/gerrit/#/c/20005015:32
*** ykarel is now known as ykarel|away15:35
*** dtantsur is now known as dtantsur|afk15:36
mariosrlandy: need sthing before i go?15:41
mariosrlandy: will catchup on your latest in the morning and take it from there15:42
chandankumarzbr, panda https://review.rdoproject.org/r/#/c/27528/ please merge it15:45
*** marios is now known as marios|out15:45
rlandymarios: nope - will leave you notes15:45
rlandythanks15:45
marios|outrlandy: ack15:45
*** marios|out has quit IRC15:47
*** holser has quit IRC15:53
*** holser has joined #oooq15:56
chandankumarrlandy, https://review.rdoproject.org/r/#/c/27528/16:02
rlandychandankumar: looks ok to me +216:03
chandankumarplease merge that16:03
rlandyugh - vars16:03
rlandywhy don;t you override???16:04
rlandychandankumar: done16:04
chandankumarrlandy, where?16:04
rlandychandankumar, https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/promote-hash/tasks/check-promotion-criteria.yaml#L1516:05
*** jmasud has quit IRC16:06
chandankumarrlandy, more confused, which patch?16:06
rlandyhttps://code.engineering.redhat.com/gerrit/#/c/199982/15/.zuul.yaml16:07
rlandychandankumar: here's another question ...16:08
chandankumarrlandy, seeing right now16:08
rlandysudo sed -i -e "s|priority=1|priority=20|g" /etc/yum.repos.d/delorean.repo16:08
rlandyI copied that line directly from https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-8/master.yml#L13816:09
chandankumarok16:09
rlandyhttp://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/config/release/promotion-testing-hash-rhos-17.yml#n10316:10
rlandychandankumar: ^^ to there16:10
rlandychandankumar, and it gives me priority=216:11
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/50/200050/7/check/periodic-tripleo-ci-rhel-8-standalone-rhos-17/bf2ad8c/logs/undercloud/etc/yum.repos.d/delorean.repo16:11
rlandychandankumar: am I crazy??16:11
chandankumarrlandy, what was the initial priority?16:11
weshay|ruckzbr, https://wiki.openstack.org/wiki/Rpm-packaging16:12
rlandypriority=116:12
*** rf0lc0 has joined #oooq16:20
*** rfolco|rover has quit IRC16:23
*** jmasud has joined #oooq16:31
*** udesale_ has quit IRC16:33
rlandyrf0lc0: objections? https://review.rdoproject.org/r/#/c/27529/16:34
rlandyhttps://code.engineering.redhat.com/gerrit/#/c/199982/15/.zuul.yaml override didn't work16:39
*** ysandeep|server has quit IRC16:40
*** jmasud has quit IRC16:42
rlandyweshay|ruck: ^^ overrides are not working ... ok to move to defaults? https://review.rdoproject.org/r/#/c/27529/16:54
weshay|ruckrlandy, that's fine.. I would have thought we just need to override rdo_infra_ci_config16:55
weshay|ruckoops16:55
rlandyweshay|ruck: the criteria location dir16:56
*** rf0lc0 is now known as rfolco|rover16:56
rlandyI couldn't override  rdo_infra_ci_config16:56
bhagyashris|ruckweshay|ruck, i see you mark this bug : https://bugs.launchpad.net/tripleo/+bug/1878190 as Invalid i think i should change the tittle. Because this is little undescriptive if anything other than that please let me know.16:58
openstackLaunchpad bug 1878190 in tripleo "periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master job is consistently failing because of some tesmpest test are failing" [Medium,Invalid] - Assigned to Bhagyashri Shewale (bhagyashri-shewale)16:58
bhagyashris|ruckweshay|ruck, Otherwise this is valid issue that the Tempest test tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration and tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_resize are failing consistently on fs020 master16:58
bhagyashris|ruckhttps://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master&job_name=periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master16:58
bhagyashris|ruckweshay|ruck, with error: Request timed out https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master/a60cfb9/logs/undercloud/var/log/tempest/stestr_results.html.gz16:59
rlandyrfolco|rover: ok if I merge https://review.rdoproject.org/r/#/c/27529/?17:00
rfolco|roverrlandy, don't spot any potential breakages there17:01
rfolco|roverrlandy, go ahead17:01
rlandyrfolco|rover: thanks - revert if need be17:01
bhagyashris|ruckweshay|ruck, that's why as of now we decided to move those two tempest test cases to skip list17:01
chandankumarbhagyashris|ruck, do you have more info why it is failing?17:02
chandankumaron fs020 master we have more test failure17:03
*** jmasud has joined #oooq17:03
bhagyashris|ruckchandankumar, as of now i see those two failures only and consistently17:03
*** derekh has quit IRC17:03
bhagyashris|ruckchandankumar,  i am not sure about recent failure but yes till yesterday those two test were failing consistently17:05
chandankumarrlandy, does this line https://review.opendev.org/#/c/727200/14/roles/build-test-packages/tasks/main.yml@237 ok?17:05
rlandytryig to decipher this17:06
rlandytrying17:06
chandankumarrlandy, we need check rhos-17 patches branch there17:06
chandankumarzbr, https://review.rdoproject.org/r/#/c/27527/ still not helping17:07
rlandychandankumar: I think so17:08
rlandynot sure about rhos_release_version but  trust you17:08
chandankumar"osp_release": "rhos-17", may be using this will help17:10
*** jpena is now known as jpena|off17:11
chandankumartrying that17:12
*** ysandeep is now known as ysandeep|away17:12
*** amoralej is now known as amoralej|off17:18
*** jmasud has quit IRC17:22
rlandychandankumar: holy cow - we passed standalone17:24
rlandywell, we're on tempest17:24
* rlandy should not say victory yet17:24
*** jmasud has joined #oooq17:25
weshay|ruckrlandy, osp-17?17:31
rlandyweshay|ruck: yep17:31
* weshay|ruck watches17:32
weshay|ruckpops popcorn17:32
weshay|ruckrlandy, 1-1?17:32
rlandyweshay|ruck: yep17:32
weshay|ruckI've popped extra for you17:32
rlandythanks17:32
*** dpawlik has quit IRC17:36
*** jmasud has quit IRC17:59
*** rlandy is now known as rlandy|lunch18:10
*** jmasud has joined #oooq18:15
*** rlandy|lunch is now known as rlandy18:39
rfolco|roverweshay|ruck, reproducer works well, kudos to sshnaidm|afk18:41
rfolco|roverno hacks, it just works18:41
rfolco|roversshnaidm|afk++18:41
weshay|ruckFUCK YA!!! MERICA.. vrmm.. vrrm..18:45
weshay|ruckosp-17 is passing too18:46
chandankumararxcruz, when around please have a look at this series https://review.opendev.org/#/q/topic:octavia_ostempest+(status:open+OR+status:merged)18:50
*** jmasud has quit IRC18:53
rlandyrfolco|rover: weshay|ruck: one more ... https://review.rdoproject.org/r/27532 Allow crieria file to be named after osp_release19:13
*** jmasud has joined #oooq19:13
rlandythank you19:13
rlandywe're getting there19:13
rlandyweshay|ruck: unsure about the logger timeout in dlrn reporting - may not be consistent ... 2020-05-13 17:37:31.847940 | TASK [dlrn-report : Report results to dlrn for the tested hash]19:15
rlandy2020-05-13 17:37:36.889102 | Timeout exception waiting for the logger. Please check connectivity to [10.0.109.202:19885]19:15
rlandywe'll see19:15
rlandyweshay|ruck: lastly ... to get damian's fix we're going to have to promote consistent up the chain  .... the passing job had this hack change  https://code.engineering.redhat.com/gerrit/#/c/200312/11/config/release/promotion-testing-hash-rhos-17.yml19:16
rlandyI can do those promotions shortly19:17
rlandywith container push19:17
*** jmasud has quit IRC19:35
*** jbadiapa has quit IRC19:37
*** jfrancoa has quit IRC19:38
zbrchandankumar: ping me tomorrow, now we have multiple failes so we cannot merge individual fixes, better to make them nv19:41
*** jmasud has joined #oooq19:47
chandankumarweshay|ruck, rlandy https://review.opendev.org/#/c/727817/ merge it when zuul +1 it20:00
rlandyweshay|ruck: openstack-promote-component is enabled now20:01
rlandywe have a full stage pipeline20:01
rlandychandankumar: ok20:01
*** jmasud has quit IRC20:07
rlandy2020-05-13 19:59:37.021850 |20:07
rlandy2020-05-13 19:59:37.022165 | TASK [Check script existence]20:07
rlandy2020-05-13 19:59:41.914156 | Timeout exception waiting for the logger. Please check connectivity to [10.0.109.108:19885]20:07
rlandy2020-05-13 19:59:41.916199 | primary | ok20:07
rlandy2020-05-13 19:59:41.958351 |20:07
rlandy2020-05-13 19:59:41.958548 | TASK [Run ansible playbook to collect logs]20:07
rlandy2020-05-13 19:59:46.998089 | Timeout exception waiting for the logger. Please check connectivity to [10.0.109.108:19885]20:07
rlandyweird timeout exception on dlrn and log20:07
weshay|ruckhrm20:24
weshay|rucklink?20:24
rlandyweshay|ruck: I think it's ok20:33
rlandyit still reports20:33
rlandythe role just doesn't show the output20:33
rlandyweshay|ruck: looks ok20:34
rlandywe had our first passing component test20:34
rlandyperiodic-tripleo-ci-rhel-8-standalone-tempest-rhos-17openstack/tripleo-cimasteropenstack-component-tempestmaster47322020-05-13T19:04:51SUCCESS20:34
rlandyand promote to promoted components is running20:34
rlandyso tonight we should expect a container push run20:35
rlandyand then we can promote to current-tripleo20:35
weshay|ruckNICE20:39
weshay|ruckok.. rlandy /me builds out monitoring20:39
rlandyweshay|ruck: ok - now I'll do the happy dance20:40
* weshay|ruck doesn't believe you20:40
* rlandy digs out ballet shoes20:40
*** ccamacho has quit IRC20:54
*** rfolco|rover has quit IRC21:16
weshay|ruck:)21:39
weshay|ruckrlandy, well done21:39
rlandyweshay|ruck: you mean the dancing I presume21:40
weshay|ruckha kol21:40
rlandyweshay|ruck: group effort :)21:41
rlandyk .. renaming image jobs to rhos-1721:41
*** Goneri has quit IRC22:07
*** Goneri has joined #oooq22:10
rlandyweshay|ruck: do you want a new taiga story for adding additional jobs to the integration/component line or just add cards to the story we have?22:13
* rlandy adds cards in the mean time 22:13
weshay|ruckya.. I was supposed to do that.. will be good for sandeep22:13
weshay|ruckyes please22:13
rlandyweshay|ruck: ok - done - two new stories22:22
rlandyone for more jobs in the integration line22:22
weshay|ruckthanks22:22
rlandysecond for more jobs in component lines22:22
rlandyoh it's a beautiful thing ... mysql fix just moved from consistent -> component-ci-testing to promote-components - all via zuul jobs22:26
rlandythen integration line should pick it up22:27
rlandyweshay|ruck: I'm w+ https://review.opendev.org/#/c/727817/ per chandankumar's request22:28
rlandyunless objections22:28
rlandysshnaidm|afk: fyi .. you have a node_import failure on BM ... https://sf.hosted.upshift.rdu2.redhat.com/logs/95/200295/1/check/periodic-tripleo-ci-centos-7-bm_envC-1ctlr_1comp-featureset001-train/a8c4360/job-output.txt22:31
* rlandy emails22:31
*** TrevorV has quit IRC22:42
*** jmasud has joined #oooq22:48
*** jmasud has quit IRC22:52
*** holser has quit IRC23:00
*** tosky has quit IRC23:06
*** rlandy has quit IRC23:33

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!