Wednesday, 2020-06-03

*** jmasud has joined #oooq00:34
*** jmasud has quit IRC01:26
*** ysandeep|away is now known as ysandeep01:38
*** jmasud has joined #oooq01:41
*** apetrich has quit IRC02:11
*** sshnaidm has quit IRC02:34
*** rlandy has quit IRC02:43
*** rfolco|rover has quit IRC02:57
*** jmasud has quit IRC03:13
*** jmasud has joined #oooq03:31
*** sshnaidm has joined #oooq03:33
*** jmasud has quit IRC03:43
*** jmasud has joined #oooq03:46
*** dmellado has quit IRC04:16
*** ykarel|away is now known as ykarel04:31
ykarelweshay|ruck, for running python3 on centos7 i tried https://review.opendev.org/#/c/699555/7 in past and it worked for container build but was abandoned with centos804:35
ykarelsimilar should work for build image04:35
ykarelpython3 package is available in centos704:36
ykarelother option can be to use pinned version of diskimage builder for py204:37
*** ccamacho has quit IRC04:41
*** sshnaidm_ has joined #oooq04:43
*** sshnaidm has quit IRC04:45
*** saneax has joined #oooq04:49
ykareljust checked the code, and seems it's not just installing python3 packages will help, others too needed04:57
ykarelso just using 2.38.0 tag for diskimage builder in centos7 should work05:01
*** jmasud has quit IRC05:06
*** jmasud has joined #oooq05:09
ykarelpip install git+file:///home/centos/diskimage-builder@2.38.0 works for me locally on py205:11
ykarelso just hacking default should work https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/oooci-build-images/defaults/main.yaml#L1105:11
ykarelpojadhav|ruck, in case u want to try out ^05:11
pojadhav|ruckykarel, ok05:12
*** skramaja has joined #oooq05:12
*** udesale has joined #oooq05:18
*** dmellado has joined #oooq05:31
*** jmasud has quit IRC05:35
*** sanjayu_ has joined #oooq05:40
*** saneax has quit IRC05:41
*** marios has joined #oooq05:49
*** jfrancoa has joined #oooq06:00
*** dtantsur|afk is now known as dtantsur06:43
*** apetrich has joined #oooq07:10
*** tosky has joined #oooq07:24
*** amoralej|off is now known as amoralej07:33
*** jpena|off is now known as jpena07:53
*** yolanda has joined #oooq08:02
*** jaosorior has joined #oooq08:17
*** marios has quit IRC08:31
*** ysandeep is now known as ysandeep|lunch08:39
*** ccamacho has joined #oooq08:50
*** marios has joined #oooq09:27
*** ysandeep|lunch is now known as ysandeep09:33
*** jmasud has joined #oooq09:46
*** udesale_ has joined #oooq09:53
*** udesale has quit IRC09:56
*** jtomasek has joined #oooq09:58
*** udesale_ has quit IRC10:00
akahatysandeep, o/10:04
akahatysandeep, need your help to debug https://0d75bf7243b1eb991fa8-2e6a6555105a36f9039b265d28b06b84.ssl.cf5.rackcdn.com/723876/13/check/tripleo-ci-centos-8-scenario012-standalone/bb55826/logs/undercloud/var/log/extra/errors.txt.txt10:05
akahat(No valid host found)10:05
ysandeepakahat, ack o/ will look in sometime10:09
akahatysandeep, okay10:10
ysandeepakahat, Can you point please where you are trying to create instance.10:11
chandankumarmarios, please have a look https://review.opendev.org/731703 and https://review.rdoproject.org/r/#/c/27587/ when free10:17
marioschandankumar: k10:17
ysandeepakahat, http://paste.openstack.org/show/794293/10:41
ysandeepin scenario 12 we don't want nova based instances, ironic should provision the instances..10:42
akahatysandeep, looking.11:28
*** jpena is now known as jpena|lunch11:31
akahatysandeep, actually i'm creating baremetal node: https://review.opendev.org/#/c/720705/15/tasks/tempest_ironic_node_create.yml11:32
ysandeepakahat, do we have a local reproducer?11:34
akahatysandeep, i think no :(11:34
ysandeepakahat, can you please try to repoduce locally - otherwise i don't think logs can help us much.11:35
akahatysandeep, okay.11:35
*** saneax has joined #oooq11:39
*** sanjayu_ has quit IRC11:40
*** rfolco|rover has joined #oooq11:42
pandamarios: https://tree.taiga.io/project/tripleo-ci-board/task/1745 was created after you already did it, by creating the RHOS-16 configuration file.11:43
mariospanda: ok.. :/ sorry i don't recall that11:47
weshay|ruckykarel++ was wondering how c7 is setup in nodepool w/ py3.. looking at ur patch. Thanks for the ping :)11:47
weshay|ruckcoffee11:47
pojadhav|ruckchandankumar, pls have a look https://review.opendev.org/#/c/733114/11:53
weshay|ruckpojadhav|ruck, ah.. this is a good idea https://review.opendev.org/#/c/733114/211:54
weshay|ruckpojadhav|ruck, I'll watch that patch through.. did it fix the issue?11:54
pojadhav|ruckweshay|ruck, didnt tested.. posting test patch as well11:55
weshay|ruckpojadhav|ruck, thanks11:55
weshay|ruckrfolco|rover, ^11:55
weshay|ruckmarios, ping when you can11:55
weshay|ruckrfolco|rover, scen010 is non-voting... train is promting now.. you can say.. tripleo is red, but promoting now so we'll be green11:56
rfolco|roverack11:57
*** amoralej is now known as amoralej|lunch11:58
pojadhav|ruckweshay|ruck, pls check https://review.rdoproject.org/r/#/c/27914/1/.zuul.yaml12:01
mariosweshay|ruck: pong12:01
*** ysandeep is now known as ysandeep|afk12:06
*** pojadhav|ruck is now known as pojadhav|batery-12:07
*** pojadhav|batery- is now known as pooja|batery-die12:08
rfolco|roverchandankumar, when you get a chance, pls look at scen10 fs062, consistently failing on tempest test https://logserver.rdoproject.org/02/27902/2/check/periodic-tripleo-ci-centos-7-scenario010-standalone-train/39f1f84/logs/undercloud/var/log/tempest/stestr_results.html.gz12:11
*** rlandy has joined #oooq12:32
rlandyysandeep|afk: hello - https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-compute/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-full-tempest-scenario-compute-rhos-17/884dcb0/logs/undercloud/var/log/tempest/stestr_results.html12:34
rlandywe have a failure - is that new?12:34
*** jpena|lunch is now known as jpena12:39
*** Goneri has joined #oooq12:45
rfolco|roverrlandy, master is failing on ipv6 and ussuri is green for tempest full scenario12:46
rfolco|roverrlandy, if that helps12:46
rfolco|roverhttps://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-ussuri&job_name=periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-master12:46
rfolco|roverhttps://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-master/342fed5/logs/undercloud/var/log/tempest/stestr_results.html.gz12:46
*** skramaja has quit IRC12:48
rfolco|roverweshay|ruck, chandankumar pooja|batery-die: https://review.opendev.org/#/c/732618/ is ready (centos7-rt)12:49
rlandyrfolco|rover: will compare - thanks12:49
rlandyrfolco|rover: how are things in general? scenario 001, 004?12:49
rlandypassing now12:49
rfolco|roverhave to check, did not have time to check yet.... the fix was about to merge12:50
rfolco|roverrlandy, fixed on master, cherry pick in progress for ussuri12:51
*** amoralej|lunch is now known as amoralej12:54
*** ysandeep|afk is now known as ysandeep12:55
ysandeeprlandy, periodic-tripleo-ci-rhel-8-standalone-full-tempest-scenario-compute-rhos-17 - only one run failed. If you want i can run a test project and see if it consistent failure.12:58
rlandyysandeep: no worries- I can review it - I just wanted to to confirm it was passing when we merged it12:58
ysandeeprlandy, yes it was green when we merged - https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=periodic-tripleo-ci-rhel-8-standalone-full-tempest-scenario-compute-rhos-1712:59
rlandyysandeep: that's fine - then I have a comparison12:59
weshay|ruckPTG13:00
weshay|ruckPTG13:00
weshay|ruckPTG13:00
*** pooja|batery-die is now known as pojadhav|ruck13:03
ysandeeprlandy, your last ovb ran failed with error - Failed to reserve a node: Allocation <uuid> failed: Failed to process allocation a468f0c5-9566-45e0-a1de-e313230484c0: none of the requested nodes are available and match the resource class baremetal.13:04
ysandeeprlandy, I hit this error^^ too intermittently, but last run failed at much later step(failed to ssh after os-net-config ran) -  https://sf.hosted.upshift.rdu2.redhat.com/logs/74/200674/6/check/periodic-tripleo-ci-centos-8-bm_envA-3ctlr_1comp-featureset001-ussuri/4557118/logs/undercloud/home/zuul/overcloud_deploy.log13:04
ysandeepI am trying to customize overcloud-full image to set a password - to check naming convention.. I doubt it failed due to wrong naming vs os-net-config info.13:05
rlandyysandeep: k - will look after PTG13:06
weshay|ruckchandankumar, ykarel ysandeep, bhagyashris, pojadhav|ruck soniya29 akahat be safe... log off as needed13:10
ysandeepweshay|ruck, cyclone?13:11
weshay|ruckaye13:11
ysandeepweshay|ruck, thanks! things are getting better since evening. but we have power outage in many places.13:12
pojadhav|ruckweshay|ruck, yup.. too much power issues facing from last couple of days :(13:12
rlandyysandeep: your last failure is a timeout13:13
rlandyyou would need to increase the job time13:13
rlandywhich may be at the limit of the tenant timeout at the moment13:13
rlandyI'd need to check13:14
rlandyI'll kick the env D job to compare13:14
rlandythat one seems to run13:15
rlandyrhel may have some other fun going on13:15
ysandeeprlandy, oops, wrong link copy paste - last run - I am here - https://sf.hosted.upshift.rdu2.redhat.com/logs/30/201630/5/check/periodic-tripleo-ci-rhel-8-bm_envA-3ctlr_1comp-featureset001-rhos-17/4fdfe3e/logs/undercloud/home/zuul/overcloud_deploy.log13:16
*** TrevorV has joined #oooq13:31
*** jmasud has quit IRC13:59
ykarelThanks weshay|ruck14:25
ykareli am in my hometown, and here cyclone don't have an impact yet14:25
*** dmellado has quit IRC15:18
*** dmellado has joined #oooq15:20
*** derekh has joined #oooq15:54
ysandeeprlandy, :) good news , inconsistent naming interface due to net.ifnames=0 parameter in overcloud-full image is causing issue - https://hackmd.io/YXJPze4eSt-Sp9oRFGOY0Q?both15:57
ysandeepussuri job you successfully deployed earlier don't have net.ifnames=0 in image, that's it worked earlier.. i think we should remove net.ifnames=0 from overcloud-full image in downstream15:59
ysandeepthat's why* it worked15:59
*** Goneri has quit IRC16:00
*** ykarel is now known as ykarel|away16:07
*** dtantsur is now known as dtantsur|afk16:13
ysandeeprlandy, customized image locally without net.ifnames=0, rerunning deployment on envA16:25
rlandyysandeep: k - I'm only getting back to bm later toady16:27
rlandyalso we should be building images not downloading them16:27
rlandyI assume you took my hack to download due to the build error16:27
rlandywe need to address the build error16:28
rlandyneed to speak with chandankumar about that - there is an assumption of the node - which is different in bm16:28
ysandeeprlandy, ack o/16:30
*** ysandeep is now known as ysandeep|away16:33
*** jpena is now known as jpena|off17:04
*** marios has quit IRC17:04
*** amoralej is now known as amoralej|off17:06
*** ysandeep|away is now known as ysandeep17:20
*** jmasud has joined #oooq17:26
ysandeeprlandy, whenever you have time.. please review  https://code.engineering.redhat.com/gerrit/#/c/202269/  ipa and full-tempest jobs in integration pipeline.17:38
rlandysshnaidm_: hi - have time to look at ovb in downstream?17:48
sshnaidm_rlandy, yeah, but later today, will ping you17:49
rlandysure17:49
ysandeep:) rhos-17 baremetal deployment successfull18:01
*** ysandeep is now known as ysandeep|away18:01
*** derekh has quit IRC18:19
*** chem has quit IRC18:22
*** yolanda has quit IRC18:23
*** chem has joined #oooq18:24
*** jmasud has quit IRC18:25
*** jmasud has joined #oooq18:28
holserdelorean failed in ussuri - https://zuul.opendev.org/t/openstack/build/031d3e369c494868b355cc96c2f9abb618:54
holserAre any known issues?18:54
rfolco|roverholser, not quite sure, but seems an intermittent issue on dlrn mirrors... DEBUG: Error: Failed to download metadata for repo 'delorean-component-baremetal'19:18
rfolco|roverhttps://41e7dfec863f98f4e0a9-0b8a0191044946f21d7cb4bda508eed5.ssl.cf5.rackcdn.com/732844/3/check/tripleo-ci-centos-8-scenario001-standalone/031d3e3/logs/delorean_logs/component/tripleo/45/d5/45d53d207689c9c82a141fc6e6581360f350667d_dev/rpmbuild.log.txt.gz19:18
holserrfolco|rover looks like merge conflict19:18
holserso I resolved conflict and rebased19:18
sshnaidm_rlandy, hey19:19
*** sshnaidm_ is now known as sshnaidm19:19
rfolco|roveroh ok19:19
holserrfolco|rover so delorean should assemble a package19:19
sshnaidmrlandy, let's take a look at ovb?19:20
rlandysshnaidm: sure19:21
rlandysshnaidm: we've got the undercloud node held19:21
rlandysshnaidm: 10.0.110.1119:22
rlandyalso the stack is still there19:22
rlandyafaict, we have no ipmi access19:22
sshnaidmrlandy, I'm in19:23
rlandysshnaidm: I set selinux to permissive afterwards but idk if it would have had an impact on setup19:24
rlandyI uploaded the same bmc-template from rdocloud19:24
sshnaidmrlandy, zoom?19:25
rlandysshnaidm: lol - what happened to google hangout?19:25
sshnaidmrlandy, zoom if more merficul to my cpu19:25
rlandysshnaidm: sure - whatever works19:26
*** jmasud has quit IRC19:30
*** jmasud has joined #oooq19:41
*** jmasud has quit IRC19:59
*** jmasud has joined #oooq20:09
*** ccamacho has quit IRC21:15
*** jfrancoa has quit IRC21:48
*** jmasud has quit IRC21:53
*** holser has quit IRC22:05
*** holser has joined #oooq22:05
*** jmasud has joined #oooq22:43
*** jmasud has quit IRC22:54
*** jmasud has joined #oooq23:00
*** TrevorV has quit IRC23:49
*** tosky has quit IRC23:50

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!