Friday, 2021-02-12

*** frenzy_friday has quit IRC00:12
*** frenzy_friday has joined #oooq00:13
*** tosky has quit IRC00:36
*** jmasud has joined #oooq02:19
*** jmasud has quit IRC02:30
*** jmasud has joined #oooq02:32
*** jmasud has quit IRC02:38
*** ysandeep|out is now known as ysandeep|rover02:42
*** jmasud has joined #oooq02:46
*** jmasud has quit IRC02:48
*** jmasud has joined #oooq02:51
*** jmasud has quit IRC02:55
*** jmasud has joined #oooq02:57
*** jmasud has quit IRC03:04
*** udesale has joined #oooq03:25
ysandeep|roverarxcruz|ruck, fyi.. https://bugs.launchpad.net/tripleo/+bug/191548704:05
openstackLaunchpad bug 1915487 in tripleo "Issue with Upstream Mirror - error: Status code: 403 " [Critical,Triaged]04:05
ysandeep|roverI am working with infra on opendev04:07
*** skramaja has joined #oooq04:20
*** ykarel_ has joined #oooq04:51
*** jmasud has joined #oooq05:02
*** udesale_ has joined #oooq05:09
*** udesale has quit IRC05:11
*** udesale_ has quit IRC05:14
*** ykarel_ is now known as ykarel05:59
*** marios has joined #oooq06:20
*** jpodivin has joined #oooq07:05
*** slaweq has joined #oooq07:11
*** apetrich has joined #oooq07:15
*** ykarel_ has joined #oooq07:47
*** ykarel has quit IRC07:50
*** ysandeep|rover is now known as ysandeep|lunch07:56
*** amoralej|off is now known as amoralej08:19
*** jbadiapa has joined #oooq08:21
*** tosky has joined #oooq08:24
*** gchamoul has quit IRC08:35
*** gchamoul has joined #oooq08:35
*** saneax has joined #oooq08:47
*** jpena|off is now known as jpena08:56
*** ysandeep|lunch is now known as ysandeep|rover08:59
*** jmasud has quit IRC09:04
*** derekh has joined #oooq09:32
*** apetrich has quit IRC10:32
*** apetrich has joined #oooq10:36
*** ykarel_ is now known as ykarel10:37
*** jmasud has joined #oooq10:55
akahatarxcruz|ruck, o/10:58
arxcruz|ruckakahat: yo10:58
akahatarxcruz|ruck, do we have any issue with virutlenv ?10:59
akahatjobs got stuck on virutlenv creation10:59
akahathttps://review.rdoproject.org/r/#/c/31914/10:59
akahatmost of the jobs got TIMED_OUT at the same task.10:59
akahatbhagyashris, ^^10:59
arxcruz|ruckakahat: i wasn't aware11:01
arxcruz|ruckakahat: let me check11:01
arxcruz|ruckmaybe zbr knows something11:01
bhagyashrisarxcruz|ruck, it's relate to cryptography version11:01
bhagyashristhat we discussed yesterday11:01
arxcruz|ruckbhagyashris: akahat https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/install_skiplist/tasks/main.yaml#L9-L1211:02
zbrbuilding cryptography from source requires huge resources due to rust11:02
arxcruz|ruckdo something like this11:02
akahatarxcruz|ruck, okay let me try it11:02
zbrbut afaik, it is already build for most common arch11:03
bhagyashrisarxcruz|ruck, thank you :)11:05
*** ysandeep|rover is now known as ysandeep|afk11:18
pojadhavarxcruz|ruck, 0/11:28
pojadhavarxcruz|ruck, I am again facing issue while running rdocloud and vexcloud scipts. It is not returning any data. :(11:30
arxcruz|ruckpojadhav: vexx host was offline11:30
pojadhavis it up now?11:30
arxcruz|ruckysandeep|afk: do you know if rdo ended the maintenance?11:31
*** sshnaidm|afk has quit IRC11:41
*** dtantsur|afk is now known as dtantsur11:41
*** jmasud has quit IRC11:42
*** ysandeep|afk is now known as ysandeep|rover11:42
ysandeep|roverarxcruz|ruck, yes there was an email notification 14 hours ago that they have completed the maintenance.11:43
arxcruz|ruckpojadhav: what's the issue?11:45
arxcruz|ruckcan you point me the lgos ?11:45
ysandeep|roverfolks o/ can i please get some reviews on https://review.opendev.org/c/openstack/tripleo-ci/+/77407811:46
pojadhavarxcruz|ruck, I an running this command : https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/telegraf.d/rdocloud.conf#L311:47
pojadhavit is not returning any data related to rdocloud, some days back when you and sagi worked on it, it started returning data.11:48
arxcruz|ruckpojadhav: the container was stopped11:49
arxcruz|ruckpojadhav: try now11:49
*** sshnaidm|afk has joined #oooq11:49
pojadhavok11:50
pojadhavits working.. thanks arxcruz|ruck :)11:50
*** sshnaidm|afk is now known as sshnaidm|off11:50
zbrdoes any know what Destination directory /etc/docker does not exist11:56
zbr means? (rdo)11:56
zbrhttps://review.rdoproject.org/zuul/builds?job_name=tox-py36-ci-config&project=rdo-infra/ci-config11:56
zbrysandeep|rover: ^ looks like infra issue with rdo, right?11:57
* ysandeep|rover checking11:58
ysandeep|roverzbr, hmm, update-json-file role was not triggered in last good run https://logserver.rdoproject.org/14/31914/10/check/tox-py36-ci-config/ed7dda4/job-output.txt12:08
*** skramaja has quit IRC12:11
ysandeep|roverzbr, There were some discussion ongoing on ops channel around mtu after maintenance.. checking with them12:13
ysandeep|roverLooks when we have a condition here to only trigger that role based on mtu - https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-docker/tasks/docker-setup.yaml#L3012:14
zbrouch now the ui is not loading12:15
zbrCannot read property 'tenant' of undefined (Unable to fetch URL, check your network connectivity, browser plugins, ad-blockers, or try to refresh this page)12:15
*** jpena is now known as jpena|lunch12:31
zbrci-config job failure with docker should be fixed by https://review.opendev.org/c/zuul/zuul-jobs/+/77537312:35
*** rlandy has joined #oooq12:38
rlandyysandeep|rover: hey - did we miss promoting 16.2?12:40
rlandyit just kicked again ;(12:40
ysandeep|roverrlandy, luckily not hash is same for today's run12:40
rlandyysandeep|rover: not hash?12:40
ysandeep|roverrlandy, hash is same for today's run12:41
ysandeep|roverwe can promote if we want12:41
rlandybf170ef12c94b12e0d920073c3272be012:41
rlandybf170ef12c94b12e0d920073c3272be012:42
rlandyok12:42
ysandeep|roverrlandy, morning run had same hash - https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-rhos-16.2/1eee013/logs/undercloud/home/zuul/containers-prepare-parameters.yaml12:42
ysandeep|roveryep12:42
rlandyysandeep|rover: did you check attila's job?12:42
rlandyis that one good?12:42
arxcruz|ruckysandeep|rover: i need to leave for 1 - 2 hours12:42
ysandeep|roverarxcruz|ruck, o/ aye12:42
rlandyysandeep|rover: look sgood12:43
rlandy#9​112:43
rlandyFeb 11, 2021 2:53 PM12:43
rlandy xselinux_problems_found: 1412:43
rlandyoom_killer_problems_found: 1012:43
rlandysegfault_problems_found: 1012:43
ysandeep|roverrlandy, yes.. that hash was tested in attila's job last night12:43
rlandyrepo_baseid: bf170ef12c94b12e0d920073c3272be012:43
rlandyshark912:43
marios /query rfolco12:44
rlandyysandeep|rover: merged your fs035 patch12:44
ysandeep|roverrlandy, fyi.. we had wrong triggers for component line for infrared jobs, I have dropped an email to you and weshay|ruck as fyi..12:45
ysandeep|roverwe added missing octavia infrared job as well..12:45
rlandyysandeep|rover: k - looking at email12:45
rlandyysandeep|rover: so all fixed - no merge needed anywhere?12:46
rlandyweshay|ruck: hey ...12:47
rlandyysandeep|rover: k - let's promote12:47
rlandyjoin me on the internal promoter pls12:47
weshay|ruckhey12:47
rlandyweshay|ruck: ysandeep|rover reported good results for 16.212:48
weshay|rucklast 16.2 does look good12:48
rlandyall passed expect 001 which timed out12:48
rlandyattila's job is a go12:48
rlandylet's promote12:48
weshay|ruckaye12:48
ysandeep|roverrlandy, joining12:48
rlandyysandeep|rover: weshay|ruck: on the tmux12:49
rlandyon internal promoter12:49
ysandeep|roveri am there12:50
rlandyysandeep|rover: pls watch with me ... here we go12:50
ysandeep|roveryes12:50
rlandyysandeep|rover: k - checking images and dockerfiles12:54
rlandylooks good12:55
rlandyysandeep|rover++12:55
rlandywhat did we change? or we just caught the cloud on a better day?12:55
ysandeep|roverrlandy, not 100% sure - may be cloud, but some component were promoted yesterday including security ..12:56
rlandyysandeep|rover: either way - thanks for seeing this through - awesome stuff12:57
ysandeep|rover:)12:58
ysandeep|roverrlandy, have you seen the component trigger email from me?12:59
ysandeep|roverI think we may need some more work12:59
rlandyok12:59
ysandeep|roverhttps://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/job/pipeline_component-compute-pcci-16.2_dlrn-rhel-8.3-virthost-3cont_2comp_3ceph-ipv4-geneve-ceph/ still didn't trigger yet12:59
ysandeep|rovercompute/component-ci-testing/ is 2 days old, we corrected the url today.. checking with attila13:00
weshay|ruckysandeep|rover, is arxcruz|ruck here?13:02
ysandeep|roverweshay|ruck, he just went on a break for ~1 to 2 hours13:02
weshay|ruckk13:03
ysandeep|roverweshay|ruck, rlandy could you please review https://review.opendev.org/c/openstack/tripleo-ci/+/774078 , it will fix sc10-ovn upstream check/gate13:07
rlandyin a few13:07
weshay|ruckzbr, we may have a bunch of things to talk about today.. check ur email :)13:22
weshay|ruckbhagyashris, akahat have you two reprovisioned and setup a new promoter?13:23
arxcruz|ruckweshay|ruck: i'm back13:23
arxcruz|ruckysandeep|rover: ^13:23
zbrweshay|ruck: i know, i am still working on a blocker bug on ci-config, one that popped over the night.13:23
ysandeep|roverarxcruz|ruck, o/13:24
ysandeep|roverweshay|ruck, Could you please retrigger zuul pipeline=openstack-periodic-integration-stable2 / ussuri is now 1 week old , sc10 issues are fixed now.. Today's run got skipped due to a node failure.13:25
bhagyashrisweshay|ruck, i am doing that13:25
weshay|ruckysandeep|rover, roger that13:25
ysandeep|roverweshay++ thanks!13:25
bhagyashrisweshay|ruck, just created vm ssh centos@10.0.150.37 and working on promoter setup13:26
*** amoralej is now known as amoralej|lunch13:29
*** jpena|lunch is now known as jpena13:30
*** ysandeep|rover is now known as ysandeep|mtg13:32
*** ysandeep|mtg is now known as ysandeep14:05
ysandeeparxcruz|ruck, leaving for the day! see you next week :) happy weekend o/14:06
arxcruz|ruckysandeep: cya14:06
*** ysandeep is now known as ysandeep|away14:07
*** rlandy has quit IRC14:07
*** rlandy has joined #oooq14:07
*** amoralej|lunch is now known as amoralej14:29
ykarelarxcruz|ruck, weshay|ruck reported https://bugs.launchpad.net/tripleo/+bug/191551914:38
openstackLaunchpad bug 1915519 in tripleo "[Train][CentOS7][scenario004] Failing with Error: 'ip-192.168.24.3' already exists. Too many tries"" [Critical,Triaged]14:38
ykarelscenario010 is also failing which is in promotion criteria https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-scenario010-standalone-train14:42
ykareli know some fixes are going on for 010 already, please check if that covers ^ too14:43
weshay|ruckykarel, thank you14:43
ykarelweshay|ruck, ok that job is missing in skip list for same test https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/validate-tempest/vars/tempest_skip.yml#L107014:45
rlandyhttps://review.opendev.org/c/openstack/tripleo-ci/+/77407814:51
rlandyok to go?14:51
bhagyashrisweshay|ruck, here is the one more new promoter server ssh centos@10.0.148.74 which is under rhos-dev-stage project15:35
bhagyashrisweshay|ruck, tmux session: tmux a15:38
mariosweshay|ruck: fyi http://lists.openstack.org/pipermail/openstack-discuss/2021-February/020454.html15:39
*** ykarel has quit IRC15:42
*** ykarel has joined #oooq15:42
*** marios is now known as marios|call16:08
weshay|ruckrlandy, please ping w/ patches when you have them re: the container build job registries config16:21
*** rlandy is now known as rlandy|mtg16:22
rlandy|mtgsure16:22
rlandy|mtgweshay|ruck: https://code.engineering.redhat.com/gerrit/#/c/225518/ - will ping after meeting16:23
*** marios|call is now known as marios16:42
*** ykarel is now known as ykarel|away16:54
*** jpodivin has quit IRC16:54
*** ykarel|away has quit IRC17:06
*** marios is now known as marios|out17:07
*** jmasud has joined #oooq17:08
*** rlandy|mtg is now known as rlandy17:12
*** jpena is now known as jpena|brb17:13
rlandyweshay|ruck: hey17:14
weshay|ruckin an interview .. what's up17:14
rlandyweshay|ruck: pls ping when you have a moment - need a pointer to finish up the 8.4 reviews17:14
*** marios|out has quit IRC17:18
weshay|ruckrlandy, 0/17:36
weshay|ruckrlandy, https://hackmd.io/WlFvuBB7TReVVyMuULvcLg?view17:37
weshay|ruckoops17:37
weshay|ruckhttps://meet.google.com/xjk-gzna-hij17:37
rlandyjoining17:39
*** derekh has quit IRC18:00
*** jpena|brb is now known as jpena18:03
rlandyweshay|ruck: h a- seem 8.4 does not have a default resolv.conf ... went through this with the node creation ... http://git.app.eng.bos.redhat.com/git/openstack/sf-config.git/commit/?id=b245619449a21f0f535de902eda27c001617e6fe18:28
rlandydiskimage-builder patch18:28
*** dtantsur is now known as dtantsur|afk18:39
weshay|ruckrlandy, nice18:57
*** jpena is now known as jpena|off18:58
*** jmasud has quit IRC19:22
*** jmasud has joined #oooq19:36
*** jmasud has quit IRC20:20
*** jmasud has joined #oooq20:22
rlandyweshay|ruck: pls review https://code.engineering.redhat.com/gerrit/#/q/topic:public_push_registry+(status:open+OR+status:merged)20:30
rlandyseparate from the 8.4 patches20:30
rlandywill make 8.4 dependent on that20:31
* weshay|ruck looks20:35
weshay|ruckrlandy, https://code.engineering.redhat.com/gerrit/#/c/227734/2/playbooks/tripleo-ci-periodic-base/tag.yaml20:37
weshay|ruckI don't see the public registry in the tag command20:37
weshay|ruckI think that's going to break20:38
weshay|ruckthe image will be localhost/openstack-base:23243220:38
weshay|ruckand we need to retag as20:38
weshay|ruckregistry/openstack-base:23243220:39
weshay|ruckthen push20:39
weshay|ruckrlandy, try it locally ..20:39
weshay|ruckyou'll see what I mean20:39
rlandywill relook20:42
*** jmasud has quit IRC20:44
*** jmasud has joined #oooq20:47
rlandyweshay|ruck: afaict, there is only a tag command on the arch20:59
rlandyhttps://code.engineering.redhat.com/gerrit/#/c/227734/2/playbooks/tripleo-ci-periodic-base/push.yaml21:00
weshay|ruckrlandy, meet.google.com/irx-iviw-skr21:00
*** slaweq has quit IRC21:00
rlandyweshay|ruck: https://code.engineering.redhat.com/gerrit/#/c/227734/2/playbooks/tripleo-ci-periodic-base/push.yaml21:04
rlandyweshay|ruck: updated https://code.engineering.redhat.com/gerrit/#/c/227734/21:24
weshay|ruckrlandy,  - >21:26
weshay|ruckline 1021:26
weshay|ruckhttps://code.engineering.redhat.com/gerrit/#/c/227734/3/playbooks/tripleo-ci-periodic-base/push.yaml21:26
weshay|ruckmah zeh?21:26
rlandyweshay|ruck: see the tag playbook21:27
rlandyI copied that21:27
rlandyweshay|ruck: same as tag that I assume has been working21:29
*** rlandy has quit IRC22:05

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!