Tuesday, 2021-08-10

*** beagles is now known as eagles00:27
weshay|ruckwoot.. bm 16.2 in tempest :)01:57
weshay|ruckcrap... timed out02:42
*** ykarel|away is now known as ykarel04:46
*** pojadhav- is now known as pojadhav04:47
*** marios is now known as marios|ruck05:15
marios|rucko/05:15
marios|ruck\o/05:15
marios|ruckwooo05:15
*** jpena|off is now known as jpena07:37
marios|rucksoniya29|rover: o/ hey can you help me dig a bit there https://bugs.launchpad.net/tripleo/+bug/1939023/comments/4 maybe you can spot something. the tempest tests are taking 2x as long as they used to and it causes frequent timeout for fs35 wallaby it is an ongoing cix 09:50
marios|rucksoniya29|rover: back in a bit getting some food thanks11:03
chandankumarsshnaidm: please have a look at this https://review.opendev.org/c/openstack/tripleo-ci/+/803919 and https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/790926 when free, thanks :-) It will close out the tripleo-operator-ansible removal11:15
sshnaidmchandankumar, to merge 803919 ?11:25
*** jpena is now known as jpena|lunch11:25
chandankumarsshnaidm: yes11:25
sshnaidmdone11:25
*** dviroel|out is now known as dviroel11:26
chandankumarsshnaidm: marios|ruck thank you for all the help on this :-)11:26
sshnaidmchandankumar, thanks for working on that11:27
*** rlandy is now known as rlandy|ruck11:32
rlandy|ruckchandankumar: https://review.opendev.org/c/openstack/tripleo-quickstart/+/803924 worked - thanks11:32
rlandy|ruckw+11:32
chandankumarrlandy|ruck: awesome :-)11:33
rlandy|ruckmarios|ruck: soniya29|rover: hi - everything going ok in ruck/rover land?11:37
rlandy|ruckneed help with anything?11:37
rlandy|ruckchased the master and wallaby promotions yesterday11:37
rlandy|ruckhttps://ci.centos.org/view/rdo/view/promotion-pipeline/ looks green11:38
marios|ruckrlandy|ruck: o/ 11:38
weshay|rucksoniya29|rover, fyi.. three tasks for you in https://mail.google.com/mail/u/1/#chat/space/AAAAxzEp6XY11:38
marios|ruckrlandy|ruck: thanks for chasing the master i saw updates for fs39 on my testproject it also promoted again today :)11:38
rlandy|ruckcool11:39
marios|ruckrlandy|ruck: nothing urgent happening at the moment just watching the things chasing some more ussuri and train 11:39
rlandy|ruckcool11:39
rlandy|ruckmarios|ruck: the upgrades tests in gate11:39
rlandy|ruckhave ou been seeing more failures?11:40
rlandy|rucknoticed a few11:40
marios|ruckrlandy|ruck: yeah cos of the promotion and the mirror sync 11:40
rlandy|ruckok11:40
marios|ruckrlandy|ruck: no it always happens when we promote11:40
rlandy|ruckmakes sense11:40
marios|ruckrlandy|ruck: maybe we need to look more into that but yeah the jobs appear healthy in builds 11:40
rlandy|ruckmarios|ruck: noticed the same - just checking we are ok there11:40
rlandy|ruckmarios|ruck: we could slow down promotions :)11:41
marios|ruckNEVER /me chains self to promoter11:41
marios|ruckhell no we wont go11:41
rlandy|ruckmarios|ruck: train - no issues with ovb right?11:48
rlandy|ruck16.2 tripleo - ovb disaster11:49
marios|ruckrlandy|ruck: not aware of something... expecting train to promote in a bit after green run there https://review.rdoproject.org/r/c/testproject/+/34901 fs39 ovb11:50
rlandy|ruckk - checking train tripleo line11:50
rlandy|ruckperiodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-tripleo-train fine11:50
soniya29|rovermarios|ruck, sure11:53
soniya29|roverweshay|ruck, ack11:54
weshay|ruckthanks11:55
arxcruzjpena|lunch: hey, is https://trunk.rdoproject.org/api-centos-stein not up ? 11:56
rlandy|ruckarxcruz++ https://quay.io/repository/tripleomaster/openstack-novajoin-notifier?tab=tags see current-tripleo-rdo12:01
rlandy|ruckthanks!!12:01
arxcruzrlandy|ruck: the api endpoint for stein is missing, not sure if we still use it i'm checking what's wrong 12:02
rlandy|ruckok12:02
rlandy|rucksshnaidm: hey ... I am looking at the 16.2 tripleo component lie - where OVB has failed consistently since 07/31 ... always 'no valid host'. so while we usually think of that as a infra error - this seems way too consistent ...12:12
rlandy|ruckhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-tripleo/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-tripleo-rhos-16.2/daa70ad/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz12:12
rlandy|rucktrain has no issues in its tripleo component line12:13
rlandy|ruckand integration line OVB is fine12:13
rlandy|ruckovercloud image requirements change?12:13
zbrmarios|ruck: do you have few minutes to help me with something related to tripleo.repos installation?12:16
marios|ruckzbr: o/ whatsup12:16
zbrtake a look at failure from https://zuul.opendev.org/t/openstack/build/0d696373732044709cc9eb70d5cb747b12:16
zbris cause by verification I added on https://review.opendev.org/c/openstack/tripleo-quickstart/+/801776/12/install-deps.sh#27012:17
zbrmy impression is that this galaxy install does not really installs version 0.0.2 and installs 0.0.1 instead12:17
zbrtested locally and with 0.0.2 installed, that errors does not happen and module call returns valid result (a real hash)12:18
sshnaidmrlandy|ruck, looking12:18
zbrit really makes no sense, 2nd line should never fail it galaxy does what it was supposed to12:19
marios|ruckzbr: failed for localhost where are you installing the module /me checks that verification 12:19
marios|ruck2021-08-10 09:01:07.100844 | primary | |Installing 'tripleo.repos:0.0.2' to '/home/zuul/.ansible/collections/ansible_collections/tripleo/repos'12:20
zbrwhich means galaxy did install it in the correct/expected location, but when we run it, it did run something else (0.0.2 does not give that module error). You can easily run it locally and see ther results.12:21
zbronly 0.0.1 would generate "No module named 'tripleo_repos'12:21
rlandy|ruck2021-08-09 19:43:10.434 7 DEBUG nova.virt.ironic.driver [req-44f8cdc3-92a2-463b-bdd7-3bac842d91f6 - - - - -] Node 152cab7a-be25-4590-9e4a-09ff639e8e6e is not ready for a deployment, reporting resources as reserved for it. Node's provision state is error, power state is power off and maintenance is False. update_provider_tree /usr/lib/python3.6/site-packages/nova/virt/ironic/driver.py:94412:22
zbrto check version installed you can do `cat /home/zuul/.ansible/collections/ansible_collections/tripleo/repos/MANIFEST.json`12:23
sshnaidmrlandy|ruck, seems like it's ironic-neutron problem12:24
rlandy|rucksshnaidm: so I have two options, I can promote up this line (we need another fix in there) and see if updated ironic component fixes it12:25
rlandy|ruckor hold the line and try fix it here12:25
sshnaidmrlandy|ruck, if we have an updated ironic component, maybe worth to try?12:27
*** jpena|lunch is now known as jpena12:27
* rlandy|ruck check ironic component rpms12:27
jpenaarxcruz: the stein endpoint has been decommissioned, just like the centos-stein builder. Is it still in use somewhere?12:28
sshnaidmrlandy|ruck, and all other ovb jobs running on that infra pass?12:28
arxcruzjpena: nah, it's fine, i was just checking the tagging on quay 12:28
arxcruzrlandy|ruck: ^12:28
arxcruzi'll keep copying stein, but tagging won't work 12:28
rlandy|rucksshnaidm: yeah12:28
rlandy|rucksshnaidm: http://pastebin.test.redhat.com/98583712:29
rlandy|ruckcomponent baremetal ^^12:29
rlandy|ruckpromote up and try12:29
rlandy|ruckcan only hose 16,2 integration line12:30
rlandy|ruckweshay|ruck: ^^ fyi ... going to force promote tripleo component in 16.2 (with OVB failure)12:30
rlandy|ruckmay hose 16.2 line12:30
weshay|ruckk12:30
weshay|ruckrlandy|ruck, due to that tempest timeout?12:31
sshnaidmwell, then something is screwed in ironic-neutron12:31
rlandy|ruckbut right now scenario010 fix is stuck there12:31
weshay|ruckah12:31
rlandy|ruckweshay|ruck: no - no valis host12:31
rlandy|ruckvalid12:31
weshay|ruckI saw your bm test project timed out in tempest for 16.212:31
rlandy|ruckweshay|ruck: that was BM12:31
rlandy|ruckwhich I w+'ed chandankumar's patch12:31
rlandy|ruckgets past the role not found error12:32
weshay|ruck++12:32
rlandy|rucksshnaidm: k - thanks  - force promoting - let's see what damage we have then12:32
rlandy|ruckhttps://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?pipeline=openstack-component-baremetal12:34
rlandy|ruck16.2 baremetal looks good12:34
rlandy|ruckwill promote both12:34
rlandy|ruckand see what we get12:34
chandankumarrlandy|ruck: weshay|ruck https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/790926 is good to go,12:34
rlandy|ruckchandankumar: ^^ need testing downstream?12:35
rlandy|rucklooks ok from the test results you posted12:36
chandankumarrlandy|ruck: I donot think so12:36
chandankumarrlandy|ruck: if something comes up, will fix it12:36
rlandy|rucksigh - we will find out12:36
weshay|ruckchandankumar, this is intersting.. never seen current land in dlrn repos https://fa66a4d347b291f594e0-a902ad727e7b582f9b0c349db2905b1c.ssl.cf2.rackcdn.com/801296/3/check/tripleo-ci-centos-8-content-provider/fd990e8/logs/undercloud/home/zuul/DLRN/data/repos/component/tripleo/index.html12:39
weshay|rucknot bad.. just fyi.. and /me poking again12:39
soniya29|rovermarios|ruck, weshay|ruck, https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/80407812:47
marios|rucksoniya29|rover: thanks12:49
rlandy|ruckweshay|ruck: soniya29|rover: TC/UA/PM sync meeting13:01
chandankumarweshay|ruck: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/34688 good to go13:05
rlandy|ruckdviroel: arxcruz: community call13:32
rlandy|ruckfrenzy_friday: ^^13:32
*** slaweq_ is now known as slaweq14:01
weshay|ruckrlandy|ruck, the api changed for rdo swf14:09
rlandy|ruckweshay|ruck: to do what?14:10
weshay|ruckrlandy|ruck, re: the dep pipeline not logging14:10
weshay|ruckwe're getting no builds from rdo atm..14:10
weshay|ruckshould be an easy fix.. but trying to figure out the new url14:11
rlandy|ruckweshay|ruck: only the dep line is being hit?14:11
weshay|ruckno.. all of the rdo jobs... the component and intergration lines now use dlrn api to get builds14:12
weshay|ruckhttps://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/telegraf.d/zuulv3_job_builds.conf#L614:12
weshay|ruckhrm.. maybe not so easy fix14:15
pojadhavchandankumar, weshay|ruck : please help me to merge this long pending stuff https://review.rdoproject.org/r/q/topic:%22refactor_job_names%22+(status:open)14:17
rlandyweshay|ruck: sorry irc crashed14:18
*** rlandy is now known as rlandy|ruck14:18
weshay|ruckpojadhav, any order?14:18
pojadhavweshay|ruck, rdo-jobs patches got merged.. no order imo14:19
pojadhavonly ci-config promotion criteria patches are pending to merge14:19
rlandy|ruckpojadhav: looking at those reviews14:19
rlandy|ruckI +2'ed most of them14:19
rlandy|ruckthat were mergeable14:19
rlandy|ruckweshay|ruck: ^^14:19
pojadhavrlandy|ruck, yup :)14:19
weshay|ruckpojadhav, can you please create a task.. to fix mol-tripleo_common_integrationFAILURE 11m 05s (non-voting) in the ruck/rover task list.. not for you.. but to track14:20
pojadhavweshay|ruck, sure14:20
rlandy|ruckhttps://review.rdoproject.org/zuul/build/c57264de05804bafb9ae17bd91ac43c014:22
rlandy|ruckcan w+14:22
rlandy|ruckhttps://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-stable4-centos714:23
rlandy|ruckpojadhav:^^ both jobs are there'14:23
rlandy|ruckperiodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-train periodic-tripleo-ci-centos-7-containers-multinode-train14:24
pojadhavrlandy|ruck, looking14:25
pojadhavweshay|ruck, done above task !14:25
rlandy|ruckpojadhav: actually14:25
weshay|ruckrlandy|ruck, pojadhav sshnaidm fix for rdo job builds https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3490614:25
rlandy|ruckone was 08/04 ad one 08/0714:25
rlandy|ruckdone14:27
sshnaidmweshay|ruck, hmm, doesn't it work for rdo zuul?14:27
weshay|rucksshnaidm, stopped working a few weeks ago14:27
pojadhavrlandy|ruck, this is something weird.. I can here I have replaced all occurances https://github.com/rdo-infra/rdo-jobs/commit/ef2110ce1fd45f2ba85a8ff948c5261669834060 and here i can old job name https://review.rdoproject.org/codesearch/?q=periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-train&i=nope&files=&repos=14:30
pojadhavsee*14:31
rlandy|ruckpojadhav: I think it's fine14:32
rlandy|ruckthere were two different runs14:32
rlandy|ruckI  w+'ed14:32
pojadhavokay14:32
zbrmarios|ruck: did you manage why get_hash does not work?14:35
dviroelfolks, already receive some review from amol and chandan here https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3461214:45
dviroelwill be great to have more eyes on this one :)14:45
marios|ruckzbr: didn't dig there after the ping earlier sorin will hopefully do that tomorrow or maybe even thursday if it isn't quiet 14:46
zbrmaybe someone else can have a look, only basic knowledge is required and a good eye.15:01
*** owalsh_ is now known as owalsh15:31
*** jpena is now known as jpena|off15:37
marios|ruckweshay|ruck: rlandy|ruck: going in few need sthing before i do15:53
rlandy|ruckmarios|ruck: should be fine - wll check notes if there is anything to follow15:53
*** ykarel is now known as ykarel|away15:54
marios|ruckrlandy|ruck: thanks my train/ussuri chasers reported already and promoted, wallaby one there wallaby b6498bb46d002218830f82c45e36f4d0 https://review.rdoproject.org/r/c/testproject/+/34907 hoping to get lucky on the fs35 timeout but maybe check if you have time later thanks15:54
rlandy|rucksure - will do15:55
marios|ruckrlandy|ruck: except wallaby everything else promoted today 15:55
marios|ruckrlandy|ruck: k thanks15:55
*** marios|ruck is now known as marios|out16:01
soniya29|roverweshay|ruck, leaving out for today16:45
weshay|ruckrlandy|ruck, ok.. it's working again17:12
weshay|ruckhttp://dashboard-ci.tripleo.org/d/jwDYSidGz/rpm-dependency-pipeline?orgId=117:12
rlandy|ruckcool- thanks17:12
*** njohnston_ is now known as njohnston17:58
weshay|ruckrlandy|ruck, when you have a sec.. https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/80412418:06
rlandy|ruckvoted  thanks'18:06
weshay|ruck55 changes merged in the last 24 hours18:26
rlandy|ruckhappiness is18:26
rlandy|ruck17 is doing pretty well- promoted this morning18:27
rlandy|ruck16.2 still running18:27
rlandy|ruckweshay|ruck: ^^ I'll update the program call doc for upstream/downstream before my EoD18:28
weshay|ruckOH NICE18:31
weshay|ruckand you already have the test projects18:31
weshay|ruck++18:31
*** dviroel is now known as dviroel|brb18:41
rlandy|ruckgetting components in shape18:51
rlandy|ruckonly BM is out of time18:51
*** dviroel|brb is now known as dviroel19:00
rlandy|ruckweshay|ruck: fyi http://pastebin.test.redhat.com/98600419:15
rlandy|ruckwork with 16-219:16
rlandy|ruckpython3 roles/rrcockpit/files/telegraf_py3/ruck_rover.py --release osp16-2 --component baremetal19:16
rlandy|ruck^^ fine19:16
weshay|ruckrlandy|ruck, are you on head?19:23
weshay|ruckI have a patch up.. as well.19:23
rlandy|ruckwill repull19:23
weshay|ruckI think when I tried head.. it was working.. but I can close out https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/34576 soon19:24
weshay|ruckand get you back to good19:24
weshay|ruckrlandy|ruck, I'll get it by EOD.. and ping you tomorrow19:25
weshay|ruckwe had $var_plosion19:25
rlandy|ruckk - no major rush19:25
weshay|ruckrlandy|ruck, for now.. go into the last dir19:28
weshay|ruckrlandy|ruck, http://pastebin.test.redhat.com/98601019:28
weshay|ruckrlandy|ruck, "error" please set the distro option on the cli19:28
weshay|ruckrlandy|ruck, osp-17 can be rhel-8 or 9 19:28
weshay|ruckI'll get this MORE usable19:29
weshay|ruckbut that's what ur hitting atm19:29
rlandy|ruckn- np19:30
rlandy|ruckweshay|ruck: so ... deploy question I should know, but anyways ... 20:09
rlandy|ruck tripleoclient.v1.20:09
rlandy|ruckwhere is our control to switch to v2?20:09
rlandy|ruckhttps://sf.hosted.upshift.rdu2.redhat.com/logs/95/200295/159/check/periodic-tripleo-ci-rhel-8-bm_envA-3ctlr_1comp-featureset001-baremetal-rhos-17/81e5cca/logs/undercloud/home/zuul/overcloud_deploy.log20:09
rlandy|ruckto fix ^^20:09
*** ssamal is now known as NewNickName20:13
*** NewNickName is now known as ssamal|afk20:14
weshay|ruckrlandy|ruck, sorry was afk.. looking20:35
rlandy|rucknp - python-tripleoclient20:35
rlandy|ruckinstalled dlrn-component-tripleo20:36
weshay|ruckrlandy|ruck, https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/overcloud-deploy/templates/overcloud-deploy.sh.j2#L6820:38
weshay|ruckis that getting you on 17?20:38
rlandy|ruckyeah20:38
rlandy|ruckbaremetal component line20:38
rlandy|ruckso alex pointed out that I need to now pass the overcloud-vips-deployed.yaml20:39
rlandy|ruckwhich I see20:39
weshay|ruck--heat-type pod20:39
weshay|ruckhttps://sf.hosted.upshift.rdu2.redhat.com/logs/95/200295/159/check/periodic-tripleo-ci-rhel-8-bm_envA-3ctlr_1comp-featureset001-baremetal-rhos-17/81e5cca/logs/undercloud/home/zuul/overcloud-deploy.sh20:39
rlandy|ruckbut I didn't know how we were choosing the version of tripleoclient20:39
rlandy|rucklast lagging component20:39
rlandy|ruckgoing to promote 16.2 when QE jobs return20:40
weshay|ruckgreat!20:40
weshay|ruckI don't think we switch on tripleoclient v1 v2.. 20:40
rlandy|ruckso then I am stil running with v120:41
rlandy|ruckbut it should be v220:41
rlandy|ruckhttps://review.opendev.org/c/openstack/tripleo-quickstart/+/803924 merged20:41
rlandy|ruckgood20:41
rlandy|ruckshould clear some of baremetal20:42
rlandy|rucklucky gate is having good days20:42
rlandy|ruckpoo poo poo20:42
rlandy|ruckfollowing up on wallaby failures20:42
weshay|ruckfs001 has  --heat-type pod20:44
weshay|ruckfs035 has installed20:44
weshay|ruckhttps://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/5376d83/logs/undercloud/home/zuul/overcloud-deploy.sh.txt.gz20:44
weshay|ruckhttps://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-master/39224ea/logs/undercloud/home/zuul/overcloud-deploy.sh.txt.gz20:44
rlandy|ruckfs035 failing for a while 001 is tempest20:46
weshay|ruck35 is missing20:46
weshay|ruckephemeral_heat: "{{ (release not in ['train','ussuri','victoria']) | bool }}"20:46
weshay|ruckephemeral_heat_args: "{{ '--heat-type pod' if ephemeral_heat|bool else '' }}"20:46
weshay|ruckbrb.. plumber is here20:47
rlandy|ruckOH20:49
* rlandy|ruck adds20:50
*** dviroel is now known as dviroel|out20:52
weshay|ruckrlandy|ruck, slight tagent on the failure ur hitting in 001 though20:59
weshay|ruckah.. this is it.. --skip-nodes-and-networks20:59
rlandy|ruckyeah20:59
weshay|ruck{% if network_provision|bool %}--skip-nodes-and-networks{% endif %} \21:00
weshay|ruckI'm telling you.. ur going write a diff tool for upstream / downstream21:01
weshay|ruckconfig21:01
rlandy|ruckconfused ...21:02
rlandy|ruckthe 17 failure21:02
rlandy|rucknot the wallaby failure21:02
weshay|ruckhttps://sf.hosted.upshift.rdu2.redhat.com/logs/95/200295/159/check/periodic-tripleo-ci-rhel-8-bm_envA-3ctlr_1comp-featureset001-baremetal-rhos-17/81e5cca/logs/undercloud/home/zuul/overcloud_deploy.log21:02
weshay|ruckrlandy|ruck, ok.. better comparison21:04
weshay|ruckhttps://logserver.rdoproject.org/07/34907/1/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-wallaby/6b0b7dc/logs/undercloud/home/zuul/overcloud-deploy.sh.txt.gz21:04
weshay|ruckwallaby has   --skip-nodes-and-networks \21:04
weshay|ruckso 17 == wallaby so far21:04
rlandy|ruckhttps://review.opendev.org/c/openstack/tripleo-quickstart/+/804142 Add ephemeral_heat settings to to fs03521:04
rlandy|ruckovb vs baremetal21:05
rlandy|ruckweshay|ruck: ^^21:06
weshay|ruckaye.. .. /me not drawing conclusions.. just pointing out21:06
weshay|ruckbm has -e ~/network-environment.yaml 21:06
rlandy|ruckso we have to add that file to the deploy21:07
weshay|ruckit's in the 17 bm atm21:07
rlandy|ruck<mwhahaha> you didn't provide overcloud-vips-deployed.yaml to the deployment21:07
weshay|ruckwhich we write that don't we?21:07
weshay|ruck-e /usr/share/openstack-tripleo-heat-templates/ci/environments/network/multiple-nics/network-environment.yaml21:07
rlandy|ruckwe write that21:07
rlandy|ruckbut it produces overcloud-vips-deployed.yaml 21:07
rlandy|ruck^^ need to pass21:07
weshay|ruckah k21:07
weshay|ruckwhich looks like https://logserver.rdoproject.org/07/34907/1/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-wallaby/6b0b7dc/logs/undercloud/home/zuul/overcloud-vips-deployed.yaml.txt.gz21:08
rlandy|ruckbut we still have the v1 v2 issue21:08
weshay|ruckhttps://sf.hosted.upshift.rdu2.redhat.com/logs/95/200295/159/check/periodic-tripleo-ci-rhel-8-bm_envA-3ctlr_1comp-featureset001-baremetal-rhos-17/81e5cca/logs/undercloud/home/zuul/overcloud-vips-deployed.yaml21:08
* rlandy|ruck tried fs035 with change21:08
rlandy|ruckwallaby21:08
weshay|ruckrlandy|ruck, I that's tripleo just defaulting to some undefined shit21:09
rlandy|rucksorry - still looking at wallaby second failure21:14
rlandy|ruckthen back to bm21:14
*** ssamal|afk is now known as ssamal21:32
rlandy|ruckhow green and pretty https://ci.centos.org/view/rdo/view/promotion-pipeline/22:05
rlandy|rucksigh - tempest timeouts22:07
rlandy|ruckhttps://logserver.rdoproject.org/95/24995/78/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-wallaby/7b8218b/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz23:28
rlandy|ruck^^ error23:28
rlandy|ruckin fs03523:28

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!