Friday, 2021-04-30

« Thursday, 2021-04-29 Index Saturday, 2021-05-01 »
*** rlandy|rover has quit IRC00:01
*** jmasud has joined #oooq00:22
*** jmasud has quit IRC00:47
*** jmasud has joined #oooq00:47
*** jmasud has quit IRC00:49
*** jmasud has joined #oooq00:55
*** jmasud has quit IRC00:56
*** jmasud has joined #oooq01:50
*** jmasud has quit IRC02:03
*** apetrich has quit IRC02:09
*** jmasud has joined #oooq02:14
*** jmasud has quit IRC02:23
*** pojadhav|away is now known as pojadhav|rover04:22
*** radez has joined #oooq04:23
*** ratailor has joined #oooq04:33
*** jmasud has joined #oooq04:55
*** ysandeep|away is now known as ysandeep05:30
*** saneax has joined #oooq05:43
*** jpodivin has joined #oooq05:47
*** slaweq has joined #oooq06:00
*** apetrich has joined #oooq06:26
akahat|ruckarxcruz, o/06:48
*** jmasud has quit IRC07:11
*** jpena has joined #oooq07:35
*** amoralej|off has quit IRC07:44
*** amoralej has joined #oooq07:45
*** tosky has joined #oooq08:21
*** derekh has joined #oooq08:22
jbadiapagm08:22
jbadiapanow that the tripleo-ansible has the train molecule jobs migrated to centos-8-stream08:24
jbadiapacan we added back the backup_and_restore molecule tests to the gate, please, https://review.opendev.org/c/openstack/tripleo-ansible/+/786408 ?08:24
akahat|ruckarxcruz, ping around?08:38
akahat|ruckchandankumar, ping08:52
chandankumarakahat|ruck: pong08:52
akahat|ruckchandankumar, do you have patch link where cirros version is updated.08:53
chandankumarakahat|ruck: yes, https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/785575/08:53
akahat|ruckI've few periodic-victoria jobs which are failing because of cirros image update08:54
akahat|ruckchandankumar, https://review.rdoproject.org/zuul/builds?job_name=cloudsig-victoria-release-centos-8-scenario001-standalone08:54
akahat|ruckhttps://logserver.rdoproject.org/periodic/review.rdoproject.org/rdoinfo/master/cloudsig-victoria-release-centos-8-scenario001-standalone/fa891a7/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz08:55
akahat|rucknot able to ssh in cirros08:55
*** saneax has quit IRC08:59
chandankumarakahat|ruck:  [    3.935485] ---[ end Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,0) ]---09:01
chandankumarakahat|ruck:  Does sc1 victoria is passing in integration line?09:01
akahat|ruckthat is another test09:01
akahat|ruckoh.. no same tests.09:02
chandankumarsorry I didnot get it09:03
akahat|ruckchandankumar, i looked in to the logs.. i thought that was another test which is failing..09:04
akahat|ruckand sc01 is passing in integration line.09:04
akahat|ruckchandankumar, looks like this bug is here since 5.1 https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/73802509:12
akahat|ruckand in recent cirros update we are directly jumping from 0.4.0 to 0.5.209:13
chandankumarakahat|ruck: can you open a bug for the same?09:14
akahat|ruckchandankumar, already on it.09:14
akahat|ruckchandankumar, pojadhav|rover fyi: https://bugs.launchpad.net/tripleo/+bug/192673409:22
openstackLaunchpad bug 1926734 in tripleo "Tempest: cirros-0.5.2 image kernel panic" [Critical,Triaged]09:22
pojadhav|roverakahat|ruck, ack09:43
*** chem has quit IRC10:34
*** chem has joined #oooq10:39
zbrchandankumar: see if you can review the extra doc added on https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/78878510:46
*** chem has quit IRC10:53
*** chem has joined #oooq10:55
akahat|ruckchandankumar, pojadhav|rover zbr ysandeep bhagyashris please take a look when you are free: https://review.rdoproject.org/r/c/rdo-jobs/+/3351911:02
chandankumarzbr: sure11:03
*** dviroel is now known as dviroel|away11:20
zbrtoday i will be out for few hours, i got my 1st vax booking, in another city!11:22
frenzy_fridayzbr, congrats for getting an appointment!11:23
zbralso please look for any reviews where you need me, as I will return on May 12th11:23
zbrfrenzy_friday: thanks, I was waiting for this for very long.11:24
zbrUK was very restrictive on how to allow people to book for it, but at least it feels correct.11:25
frenzy_fridayzbr, if you have some time before you leave, or later, pls - https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/788692 - test for sova queries11:27
pojadhav|roverakahat|ruck, https://review.rdoproject.org/zuul/build/19dac6d08da94ef4b4fae0b69708f888/log/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz11:27
pojadhav|roverhave you seen this issue till now?11:28
*** jpena is now known as jpena|lunch11:30
pojadhav|roverakahat|ruck, fyi : https://bugs.launchpad.net/tripleo/+bug/192675811:32
openstackLaunchpad bug 1926758 in tripleo "periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-master failing consistently with connect: network is unreachable\nError: Error initializing source docker://quay.io/tripleomaster/openstack-cinder-volume:current-tripleo: error pinging docker registry quay.io" [Undecided,Triaged]11:32
pojadhav|roverweshay|ruck, "periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-master" job is added twice in the criteria.. https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config_environments/rdo/CentOS-8/master.yaml11:34
*** rlandy has joined #oooq11:42
zbrsocial survey: https://twitter.com/sbarnea/status/1388031501170790401?s=20 :p11:43
frenzy_fridaywhy are you called zbr though? Is there a fullform?11:45
zbrit all started when our team folks were misquoting me and sshnaidm as both nicks start with "ss", so I ended up looking for a new nick to use on irc11:46
zbr(is was the newer one joining the team)11:46
frenzy_fridaylol!11:47
zbrand I used that "zbr" because its mainly related to the spelling of my family name.11:47
zbralso short nicks are cool11:47
frenzy_fridayyeah, I need to look for a shorter nick11:47
zbri even got an email alias zbr @ redhat :D11:47
rlandyakahat|ruck: pojadhav|rover: hey - need any help with ruck/rover stuff?11:48
zbrfrenzy_friday: in romanian "zbr" has the same meaning as vroom (sound of an engine revving up)11:49
zbrmy dirt bike had it as numberplate :D11:50
frenzy_fridayhaha!!11:50
pojadhav|roverrlandy, https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-master11:56
pojadhav|roverwhat action needs to be taken against this.. do you have any idea11:57
rlandyFileNotFoundError: [Errno 2] No such file or directory: '/home/zuul/tripleo-heat-installer-templates/environments/services/undercloud-keepalived.yaml'11:57
rlandyhttps://github.com/openstack/tripleo-heat-templates/commit/acafd67c391c53f59901cb5f70dc4d7425f6403a11:57
rlandypojadhav|rover: the fs039 error look sporadic11:58
pojadhav|rovermeans11:58
pojadhav|roverI didnt get11:58
rlandypojadhav|rover: does it reproduce in testproject rerun now?11:59
pojadhav|roverrlandy, I havent checked using testproject..11:59
pojadhav|roverwill do it now11:59
*** sshnaidm is now known as sshnaidm|off11:59
rlandypojadhav|rover: pls check it and we will see if you still have the error12:00
pojadhav|roverrlandy, sure12:00
rlandyit happened three times12:00
rlandywhich is a possible concern12:00
rlandybut the periodic is passing12:00
rlandyso let's see if it reproduces12:01
rlandypojadhav|rover: looks like there is a bigger issue  on wallaby12:01
rlandyunless you are already tracking that12:01
pojadhav|roveri am tracking integration main line only till now12:02
pojadhav|roveronce testproject for fs39 done, will check for wallaby12:02
rlandypojadhav|rover: left you  a link above12:02
rlandywhen you are done - you can review12:03
rlandyweshay|ruck: when you are in ... component-ui on RDO looks stuck12:03
rlandydo you have powers to rekick that?12:03
rlandy183 hr 4 min12:04
rlandypojadhav|rover: https://bugs.launchpad.net/tripleo/+bug/192676412:11
openstackLaunchpad bug 1926764 in tripleo "Wallaby promotion: OVB jobs are failing to install the undercloud - No such file or directory: '/home/zuul/tripleo-heat-installer-templates/environments/services/undercloud-keepalived.yaml'" [Critical,Triaged]12:11
rlandylogged bug12:11
pojadhav|roverrlandy, thanks!12:12
pojadhav|roverrlandy,  "periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-master" job is added twice in the criteria.. https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config_environments/rdo/CentOS-8/master.yaml12:12
rlandypojadhav|rover: ok - pls put in a patch to remove the duplicate12:13
rlandyon the promoter, it's probably fine12:13
rlandyie: the file is probably fixed there12:14
pojadhav|roverrlandy, sure..12:15
*** amoralej is now known as amoralej|lunch12:19
pojadhav|roverweshay|ruck, rlandy : removed duplicate entry - https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3353212:21
rlandypojadhav|rover: voted12:21
akahat|ruckrlandy, o/ if there are some failures in the tempest side those are because of the cirros-0.5.2 image.12:24
akahat|ruckrlandy, https://bugs.launchpad.net/tripleo/+bug/192673412:25
openstackLaunchpad bug 1926734 in tripleo "Tempest: cirros-0.5.2 image kernel panic" [Critical,Triaged]12:25
rlandyakahat|ruck: checking12:25
rlandykernel panic - wow12:26
rlandyakahat|ruck: how consistent are those tempest errors?12:28
rlandy Merged openstack/tripleo-upgrade master: Bump Cirros to 0.5.2  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78853612:28
rlandy^^ just merged12:28
pojadhav|roverakahat|ruck, have you already added this tests to skiplist ?? https://review.rdoproject.org/zuul/build/b3fce6910437493ebe00547026159543/log/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz12:29
pojadhav|roverakahat|ruck, weshay|ruck, rlandy : https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-master&pipeline=openstack-periodic-integration-main12:30
akahat|ruckrlandy, those are consistent we have seen those in sc10 and 01 job12:30
akahat|ruckpojadhav|rover, yes. i've added to the skiplist12:31
akahat|ruckpojadhav|rover, few misn12:31
rlandyhttps://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-scenario001-standalone-master not too bad12:33
rlandyscenario010 kvm has been failing forevere12:33
akahat|ruckpojadhav|rover, rlandy chandankumar arxcruz https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/78894212:33
rlandychandankumar was working on it12:33
akahat|ruckrlandy, yes.. today i've saw that.. added in the review ^^12:34
*** jpena|lunch is now known as jpena12:34
*** ratailor has quit IRC12:35
akahat|ruckrlandy, https://review.rdoproject.org/zuul/builds?job_name=cloudsig-victoria-release-centos-8-scenario001-standalone12:35
rlandyakahat|ruck: https://bugs.launchpad.net/tripleo/+bug/1883687 - we should get some status on this12:35
openstackLaunchpad bug 1883687 in tripleo "test_traffic_ops octavia tempest tests are failing with Connection to the 192.168.24.149 via SSH timed out." [High,Triaged]12:35
weshay|rucksec.. will be with you folks in a bit12:35
rlandywe closed out one ssh timeout failure at CIX on Wed12:35
rlandyas it was very old12:35
rlandyakahat|ruck: maybe we need to bring this back to CIX12:36
akahat|ruckoh.. i was not aware about it.12:36
rlandysc10 expectations are not clear to me12:36
chandankumarakahat|ruck: pojadhav|rover regarding sc10 kvm https://trello.com/c/PzfiqBWr/1797-cixlp1909574tripleociproa-periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-octavia-master-victoria-ussuri-failing-on-temp12:38
pojadhav|roverchandankumar, ack12:38
chandankumarakahat|ruck: pojadhav|rover please donot put them under skip list for sc10, please work with octavia team to get it fixed, we had lot of work there to make it green for sc1012:38
rlandyok - good the card is still there12:39
akahat|ruckchandankumar, okay. let me remove this job from skip list.12:39
rlandyakahat|ruck: we should watch the new cirros image  but unclear that we have anything dircetly related12:40
akahat|ruckrlandy, agreed :)12:42
rlandyakahat|ruck: just FYI https://bugs.launchpad.net/tripleo/+bug/1926764 logged for the wallaby failures12:47
openstackLaunchpad bug 1926764 in tripleo "Wallaby promotion: OVB jobs are failing to install the undercloud - No such file or directory: '/home/zuul/tripleo-heat-installer-templates/environments/services/undercloud-keepalived.yaml'" [Critical,Triaged]12:47
chandankumarakahat|ruck: do you have the error log somewhere?12:47
chandankumarfor sc1012:48
*** dviroel|away is now known as dviroel12:54
akahat|ruckchandankumar, yes12:55
akahat|ruckchandankumar, https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-victoria12:55
akahat|ruckchandankumar, https://review.rdoproject.org/zuul/builds?job_name=%09periodic-tripleo-ci-centos-8-scenario010-standalone-victoria12:56
chandankumarakahat|ruck: https://logserver.rdoproject.org/openstack-periodic-integration-stable2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-standalone-victoria/f2b2939/logs/undercloud/var/log/extra/errors.txt.txt.gz13:00
chandankumarakahat|ruck: Server-side error: "Provider 'octavia' does not support a requested option: Amphora provider does not support SOURCE_IP_PORT algorithm.". Detail:13:00
chandankumarakahat|ruck: there might be some missing backport, open a bug check with octavia team13:00
akahat|ruckchandankumar, okay. on it.13:01
weshay|ruckbhagyashris, https://catalog.redhat.com/software/containers/explore13:04
weshay|ruckbhagyashris, akahat|ruck https://catalog.redhat.com/software/containers/rhosp-rhel8/openstack-base/5de6adcc5a13461646f8f475?container-tabs=gti&gti-tabs=red-hat-login13:06
weshay|ruckbhagyashris, akahat|ruck openstack-base available in both x86 and ppc here13:06
weshay|ruckplease pull that container for your testing and experiments13:06
akahat|ruckweshay|ruck, okay13:06
*** amoralej|lunch is now known as amoralej13:07
weshay|ruckakahat|ruck, bhagyashris or alternatively13:08
weshay|ruckhttps://hub.docker.com/r/ppc64le/wordpress13:08
weshay|ruckhttps://hub.docker.com/_/wordpress13:08
*** ysandeep is now known as ysandeep|away13:11
akahat|ruckchandankumar, rlandy weshay|ruck fyi: https://bugs.launchpad.net/tripleo/+bug/192676813:19
openstackLaunchpad bug 1926768 in tripleo "Amphora driver does not support SOURCE_IP_PORT algorithm" [Critical,Triaged]13:19
chandankumarcgoncalves: https://bugs.launchpad.net/tripleo/+bug/1926768 please have a look when free, thanks!13:24
openstackLaunchpad bug 1926768 in tripleo "Amphora driver does not support SOURCE_IP_PORT algorithm" [Critical,Triaged]13:24
chandankumarrlandy: weshay|ruck did you get a chance to look at downstream extended hash promotion email?13:25
rlandychandankumar: looking at it now13:25
rlandywill complete after promoter sync13:25
chandankumarrlandy: sure13:25
akahat|ruckweshay|ruck, chandankumar promoter sync.13:31
cgoncalveschandankumar, done. the report title was very misleading13:39
chandankumarcgoncalves: thanks!13:39
*** owalsh has quit IRC13:54
arxcruzmjturek: around ?14:05
*** owalsh has joined #oooq14:13
*** jpodivin has quit IRC14:22
weshay|ruckakahat|ruck, note Carlos's update in https://bugs.launchpad.net/tripleo/+bug/192676814:31
openstackLaunchpad bug 1926768 in tripleo "Amphora driver does not support SOURCE_IP_PORT algorithm" [Critical,Triaged]14:31
* bhagyashris out14:36
rlandychandankumar: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32273 +2 - looked at the results - looks right now - thank you14:57
*** jmasud has joined #oooq15:17
weshay|ruckarxcruz, are we going to see the tempest html fix in periodic ever?15:21
weshay|ruckwhat's the issue there again?15:21
chandankumarrlandy: will try to get the tests issue fix soon15:46
rlandychandankumar++15:46
*** jpodivin has joined #oooq15:54
*** jpodivin has quit IRC16:16
*** jpena is now known as jpena|off16:38
*** jbadiapa has quit IRC16:49
*** rlandy is now known as rlandy|training16:55
mjturekarxcruz: heyo sorry17:07
mjturekwhat's up??17:07
mjturekarxcruz: ppc64le job is broken on this https://lists.centos.org/pipermail/centos-devel/2021-April/076754.html17:11
arxcruzmjturek: hey, thanks, did you saw my email? can you join us on monday to discuss ?17:12
mjturekabsolutely17:12
mjturekI will be there17:12
mjturekrlandy|training arxcruz thanks for the invite17:13
*** jmasud has quit IRC17:18
*** jmasud has joined #oooq17:38
*** jmasud has quit IRC17:43
*** jmasud has joined #oooq17:50
weshay|ruckrlandy|training, sorry to bug you.. can you think of any reason why we would need to run integration tests against a python setup.cfg file?17:54
weshay|ruckhttps://review.opendev.org/c/openstack/tripleo-ci/+/78899017:54
weshay|ruckI can't17:54
rlandy|trainingsure - will be done here in 5 mins - will look17:55
*** rlandy|training is now known as rlandy18:01
rlandyweshay|ruck: k ... to confirm ... you're looking at patch https://review.opendev.org/c/openstack/tripleo-ci/+/788990?18:01
rlandyhttps://zuul.openstack.org/status#78899018:02
rlandyno error on this patch18:03
weshay|ruckya18:03
weshay|ruckfixing https://review.opendev.org/c/openstack/os-net-config/+/78889518:04
*** owalsh has quit IRC18:04
*** apetrich has quit IRC18:04
*** jlarriba has quit IRC18:04
*** akahat|ruck has quit IRC18:04
rlandyweshay|ruck: think that is safe enough18:04
rlandyI +2'ed18:04
weshay|ruckthanks18:04
*** jmasud has quit IRC18:05
*** owalsh has joined #oooq18:07
*** apetrich has joined #oooq18:07
*** jlarriba has joined #oooq18:07
*** akahat|ruck has joined #oooq18:07
*** jmasud has joined #oooq18:08
*** gouthamr has quit IRC18:08
*** gouthamr has joined #oooq18:10
weshay|ruckshit18:21
weshay|rucktripleo overcloud is pulling from quay18:21
weshay|ruckand not the undercloud18:21
*** jmasud has quit IRC18:46
rlandyweshay|ruck: https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=periodic-tripleo-ci-rhel-8-standalone-on-multinode-ipa-security-rhos-17 - just FYI - we have a fix for IPA job18:57
rlandyqualifying upstream over the weekend18:57
rlandywill fix the downstream failure18:57
weshay|ruckk18:57
rlandyweshay|ruck: ^^ where is the overcloud pulling from quay?18:57
rlandyand not the undercloud18:58
weshay|ruckrlandy, all the jobs w/ an overcloud19:05
weshay|ruckrlandy, https://bugs.launchpad.net/tripleo/+bug/1926764 what do you want to do w/ this one?  sit on it until we branch?19:06
openstackLaunchpad bug 1926764 in tripleo "Wallaby promotion: OVB jobs are failing to install the undercloud - No such file or directory: '/home/zuul/tripleo-heat-installer-templates/environments/services/undercloud-keepalived.yaml'" [Critical,Triaged]19:06
rlandyweshay|ruck: a backport was posted19:07
rlandywhether we merge that or not19:07
rlandyidk19:07
rlandymarios was holding those branches19:08
rlandyweshay|ruck: it will sink our wallaby line though19:09
*** slaweq has quit IRC19:18
weshay|ruckrlandy, not a bad way to train folks.. see if you can think of anything else https://review.opendev.org/c/openstack/tripleo-ci/+/78901719:18
rlandyweshay|ruck: that review is fine but I think too much here and people will just ignore it19:20
rlandybalance19:20
rlandyugh - how I love upstream clouds, let me count the ways19:20
rlandyhow do they all have quirks??19:20
weshay|ruckheh19:21
weshay|ruckrlandy, I think ci.centos is finally coming back to life https://ci.centos.org/job/tripleo-quickstart-promote-ussuri-current-tripleo-delorean-minimal/173/console19:47
weshay|ruckwas failing on the pulling of containers in the undercloud19:47
weshay|ruck\0/19:47
rlandyweshay|ruck: wow - tehiyat ha matim19:48
rlandyweshay|ruck++ nice19:48
rlandydid zuul die?19:48
rlandyhttps://zuul.openstack.org/status19:49
weshay|ruckya19:50
weshay|ruckprobably just restarting the front end19:50
weshay|ruckthey do that on friday19:50
rlandyright when we are qualifying jobs19:51
*** dviroel is now known as dviroel|afk19:55
rlandyhttps://code.engineering.redhat.com/gerrit/#/c/236343/7/zuul.d/projects.yaml didn't even run he puppet job20:05
rlandyit didn't complain20:05
rlandyit just ignored it20:05
*** jfrancoa has quit IRC20:22
*** derekh has quit IRC21:44
*** jmasud has joined #oooq21:45
*** rlandy has quit IRC21:47
*** derekh has joined #oooq23:16
*** derekh has quit IRC23:17
*** tosky has quit IRC23:31
« Thursday, 2021-04-29 Index Saturday, 2021-05-01 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!