Tuesday, 2022-02-22

*** rlandy|ruck|bbl is now known as rlandy|ruck00:35
*** rlandy|ruck is now known as rlandy|out00:44
*** pojadhav- is now known as pojadhav|ruck02:53
*** ysandeep|out is now known as ysandeep04:47
ysandeepbhagyashris: good morning, welcome back from your PTOs!05:49
frenzyfriday|roverhey ysandeep, do you know in which file are the dependencies/package requirements for thi stask specified https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/run-test/tasks/main.yaml#L121?07:07
ysandeepfrenzyfriday|rover: Could you please share more context/what issue you are facing?07:11
frenzyfriday|roverysandeep, https://bugs.launchpad.net/tripleo/+bug/1961736 I am trying to install python3-dev before we run toci_gate_test.sh I saw some dependencies are mentioned like this https://review.opendev.org/c/zuul/zuul-jobs/+/72870807:12
frenzyfriday|roverIs there a similar file in tripleo-ci? Or should I just dnf install python3-dev in the cmd itself?07:13
ysandeepfrenzyfriday|rover: ack, will try to check in sometime, in middle for something.07:14
frenzyfriday|rovercool, thanks07:14
mariosfrenzyfriday|rover: o/ thanks for filing the bug i will also poke there today 07:16
frenzyfriday|rovermarios, thanks. I added what I found in the comments07:16
mariosfrenzyfriday|rover: ack thanks nice find on the comment #3 might be related i was looking for something like that yesterday 07:17
mariosfrenzyfriday|rover: we must be installing it somewhere already for master 07:17
frenzyfriday|roverI think it needs python3-dev somewhere, but not sure where to add it07:17
mariosfrenzyfriday|rover: yes agree this is what is missing07:17
pojadhav|rucksshnaidm, hello.. do we still need this : https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=tripleo-ci-rhel-8-containers-multinode-rhos-16.2-osa ??07:23
* pojadhav|ruck lunch 07:33
*** amoralej|off is now known as amoralej07:34
*** ysandeep is now known as ysandeep|lunch07:58
*** jpena|off is now known as jpena08:33
*** ysandeep|lunch is now known as ysandeep08:41
arxcruzhey guys, i'll take my daughter to take the second shot, not sure how long i'll be out, but shouldn't be too long 09:57
frenzyfriday|roverarxcruz, ack, all the best :)10:04
sshnaidmpojadhav|ruck, hi, nope, you can delete it10:27
pojadhav|rucksshnaidm, thanks :)10:28
* ysandeep out for couple of hours due to docs appointment, Will try to come before community call(If I can't you know why).10:57
*** ysandeep is now known as ysandeep|dr_appt10:59
mariospojadhav|ruck: o/ fyi the test there is green because the test that was failing is skipped https://bugs.launchpad.net/tripleo/+bug/1959014/comments/14 11:01
pojadhav|ruckmarios, ohh okay :D thank you !!11:05
pojadhav|ruckI missed that 11:06
mariospojadhav|ruck: np I have definitely done it before... in case you were going to close that ;) "it is now green"  it isn't yet you can see the fail in my test which has the skip revert11:07
pojadhav|ruckmarios, yep... thanks for alert :)11:08
* pojadhav|ruck need a break....11:10
*** rlandy|out is now known as rlandy|ruck11:15
mariosfood biab11:19
rlandy|ruckfrenzyfriday|rover: pojadhav|ruck: how are things?11:20
rlandy|ruckfrenzyfriday|rover: pojadhav|ruck: let's sync in 30 mins11:20
rlandy|ruckchandankumar: hello 11:20
chandankumarrlandy|ruck: hello11:20
rlandy|ruckchandankumar: need to sync with you re: c9 audit11:20
frenzyfriday|roverrlandy|ruck, ack11:21
rlandy|ruckwill ping after meetings11:21
chandankumarrlandy|ruck: sure11:21
*** dviroel|out is now known as dviroel11:21
rlandy|ruckfrenzyfriday|rover: marios: ysandeep|dr_appt: chandankumar: ok if I w+ https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39424?11:24
rlandy|ruckcockpit change11:24
chandankumarrlandy|ruck: yes11:24
rlandy|ruckok  - here we go11:26
rlandy|ruckchandankumar: pls review https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3794611:26
rlandy|ruckchandankumar: https://review.rdoproject.org/r/c/rdo-jobs/+/39546/ merge conflict here11:29
rlandy|ruckpls rebase11:29
chandankumarrlandy|ruck: done!11:30
mariosrlandy|ruck: yeah couldn't spot something (sorry was getting food since no review time ;))11:46
chandankumardviroel: thank you for the review, please have a look https://review.rdoproject.org/r/c/rdo-jobs/+/39546 thanks!11:59
rlandy|ruckfrenzyfriday|rover: pojadhav|ruck: let's sync https://meet.google.com/fby-nmsg-nhu?pli=1&authuser=012:02
dviroelchandankumar: hi, you didn't send a new patch set12:03
chandankumardviroel: sorry sent now12:04
dviroel:)12:04
rlandy|ruckysandeep|dr_appt: hey - what is the status of downstream cockpit - still looks like no new data12:04
rlandy|ruckpojadhav|ruck: ^^12:04
pojadhav|ruckrlandy|ruck, https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/31297312:06
dviroelchandankumar: added a question in your patch12:13
rlandy|ruckdviroel: https://trello.com/c/F00VnyBm/2336-cixlp1956475tripleociproa-centos9-nova-migration-breaks-because-sftp-server-is-not-part-of-the-migration-wrapper - we got a merge there - can you recheck and comment?12:14
chandankumardviroel: thanks, Good question12:17
chandankumarmarios: hello, \o noob question related to upgrade job12:18
dviroelchandankumar: thats why I didn't add those before12:18
chandankumarI am working on adding cs9 standalone upgrade wallaby job https://review.rdoproject.org/r/c/rdo-jobs/+/39546/4#message-f4df82e98d68af88def8528f87aff8fa57d5517c12:18
chandankumarSince there is no cs9-victoria job? Do we need to this job for wallaby?12:18
chandankumardviroel: yes, good point, make sense12:19
marioschandankumar: hmmm not sure we want to add that 12:20
marioschandankumar: i mean, we could but i don't htink we should12:20
marioschandankumar: because V on 9 isn't something e.g. the upgrades folks would be interested in 12:20
dviroelrlandy|ruck: ack, added a comment with rdoinfo change that is needed now (last one for master)12:20
rlandy|ruckdviroel: thank you12:21
marioschandankumar: for wallaby probably we will only have the minor update job on 9 , and then the ffu job on 8 train to 8 wallaby 12:21
marios(when it is ready)12:21
chandankumarmarios: yes, correct that make sense. 12:22
chandankumarI will abandon my patch12:22
marioschandankumar: i think better to focus on master? 12:22
marioschandankumar: i mean we still need the undercloud upgrade for w to master 912:22
rlandy|ruckfrenzyfriday|rover: pls prep patch to remove ussuri fs039 from criteria12:23
rlandy|ruckwe will merge if needed12:23
rlandy|ruckand abandon if not12:23
rlandy|ruckthanks12:23
chandankumarmarios: yes focusing on master sure12:23
rlandy|ruckchandankumar: ok to sync now?12:23
chandankumarmarios: dviroel please have a look https://review.rdoproject.org/r/c/rdo-jobs/+/39553/12:23
chandankumarrlandy|ruck:  sure12:23
rlandy|ruckhttps://meet.google.com/qoh-buup-cjo?pli=1&authuser=012:23
rlandy|ruckchandankumar: ^^12:24
marioschandankumar: k adding to list12:24
frenzyfriday|roverrlandy|ruck, ack - https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3968412:26
arxcruzand i'm back 12:38
* pojadhav|ruck cooking.. will be back in half an hr12:49
rlandy|ruckfrenzyfriday|rover++ thanks12:51
*** ysandeep|dr_appt is now known as ysandeep13:02
*** rlandy|ruck is now known as rlandy|ruck|mtg13:04
ysandeeprlandy|ruck, In my first half I got involved in ovb - testing steve latest patches + working around ways to pull latest container-selinux in overcloud-images, I have some cycles now to look at downstream cockpit, checking..13:04
*** amoralej is now known as amoralej|lunch13:08
rlandy|ruck|mtgchandankumar: ysandeep: I am on staff call13:09
rlandy|ruck|mtgchandankumar: ysandeep: bhagyashris_ is out?13:09
chandankumarrlandy|ruck|mtg: yes13:09
rlandy|ruck|mtgchandankumar: ysandeep: pls send out prep for community call13:09
ysandeepyes, sick leave.. I will run cix 13:09
ysandeepsry  community call13:09
rlandy|ruck|mtgchandankumar: ysandeep: will need you guys to run that call13:09
rlandy|ruck|mtgif I can't join13:10
* ysandeep need coffee 13:10
ysandeeprlandy|ruck|mtg, ack for community call13:10
rlandy|ruck|mtgysandeep: thank you13:10
chandankumarysandeep: thanks!13:11
ysandeep#oooq folks o/ Community call in 20 mins, Please add your agenda(if any): https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg 13:12
ysandeeparxcruz, sshnaidm, rlandy, rlandy|ruck, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, anbanerj,  dviroel, rcastillo, dasm, jm1, community call in 2 mins13:28
ysandeepplease add your agenda here: https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg13:28
chandankumarthank you ysandeep :-)14:02
marioswell done ysandeep 14:02
dviroelysandeep++14:03
pojadhav|ruckysandeep, briefly explained ;)14:03
ysandeepthank you everyone!14:08
chandankumarbrb for an hour!14:08
*** amoralej|lunch is now known as amoralej14:13
rlandy|ruck|mtgrcastillo: hey - your release file patch merged14:21
rlandy|ruck|mtgcan you recheck the ci.centos job for master14:21
rlandy|ruck|mtgrcastillo: we'll also need a wallaby c9 job there :)14:21
*** rlandy|ruck|mtg is now known as rlandy|ruck14:23
rlandy|ruckfrenzyfriday|rover: how's ussuri looking?14:23
rlandy|ruckmerge the fs039 exclude or it's ok now?14:23
rlandy|ruckhttps://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-ussuri14:24
rcastillorlandy|ruck: might need some help with this new centos ci failure https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/job/tripleo-quickstart-promote-master-centos9-current-tripleo-delorean-minimal/26/console14:25
frenzyfriday|roverrlandy|ruck, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39684 is failing check, not sure why14:27
rlandy|ruck2022-02-22 14:16:49.644793 | rdo-centos-stream | FAILED ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/tests/test_gerrit_changes.py::TestGerritChanges::test_gerrit_changes14:29
rlandy|ruck2022-02-22 14:16:49.644802 | rdo-centos-stream | FAILED roles/rrcockpit/files/telegraf_py3/tests/test_gerrit_changes.py::TestGerritChanges::test_gerrit_changes14:29
rlandy|ruckfrenzyfriday|rover: ^^ cockpit changes?14:29
rlandy|ruckhttp://dashboard-ci.tripleo.org/d/HkOLImOMk/upstream-and-rdo-promotions?orgId=1- old data14:30
frenzyfriday|roverrlandy|ruck, where is this log from?14:37
frenzyfriday|roverdoes the patch get pulled in automatically in cockpit?14:38
*** ysandeep is now known as ysandeep|dinner14:39
rlandy|ruckfrenzyfriday|rover: it should after it merges14:40
rlandy|ruckwe should have pull enabled14:41
frenzyfriday|roverrlandy|ruck, where is the cockpit running? I can ssh and check14:43
rlandy|ruckfrenzyfriday|rover: ssh to the dashboard-ci.tripleo.org14:45
frenzyfriday|roverrlandy|ruck, user is centos?14:46
dviroelade_lee: https://af7ec07546851be794e6-41e6d6e3469e76a197a78f7d5cb77442.ssl.cf2.rackcdn.com/824479/10/check/tripleo-ci-centos-9-undercloud-containers/973e30c/logs/undercloud/home/zuul/tripleo-deploy/undercloud/install-undercloud.log14:48
rlandy|ruckdoesn't look like we are pulling the latest14:49
rlandy|rucksshnaidm: jm1: ^^ promoter14:49
rlandy|ruckare we still pulling latest?14:49
rlandy|ruckci-config14:49
rlandy|ruckto get frenzyfriday|rover's changes14:49
rlandy|ruckgit log shows old commits14:49
rlandy|rucksorry14:50
rlandy|ruckcockpit14:50
rlandy|rucknot promoter14:50
dviroelade_lee: https://7c707e251010747ef94d-bec54d16a61aa5f20ffda38305883724.ssl.cf5.rackcdn.com/824479/10/check/tripleo-ci-centos-9-scenario007-multinode-oooq-container/7fce918/logs/undercloud/var/log/tempest/stestr_results.html14:51
sshnaidmrlandy|ruck, will check14:51
dviroelade_lee: https://44b39d3bf3288120c117-a0541882d2023eca9a1cc07087449de0.ssl.cf5.rackcdn.com/824479/10/check/tripleo-ci-centos-9-standalone/55a5834/logs/undercloud/home/zuul/standalone_deploy.log14:54
dviroelade_lee: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_80b/824479/10/check/tripleo-ci-centos-9-scenario004-standalone/80b0d89/logs/undercloud/var/log/tempest/stestr_results.html14:56
dviroelade_lee: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_aab/824479/10/check/tripleo-ci-centos-9-standalone-on-multinode-ipa/aab45c7/logs/173.231.255.251/var/log/ipaserver-install.log14:58
*** pojadhav|ruck is now known as pojadhav|dinner14:58
rlandy|ruckfrenzyfriday|rover: that log is from the failing tox test for the ussuri criteria change15:00
dviroelade_lee: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e12/824479/10/check/tripleo-buildimage-overcloud-full-centos-9/e12d8d3/overcloud-full.log15:02
frenzyfriday|roverrlandy|ruck, need some help with https://logserver.rdoproject.org/84/39684/2/check/tox-py36-ci-config/0b46604/job-output.txt I just removed one line from the criteria. I cant understand where it is failing15:04
rlandy|ruck2022-02-22 14:16:49.644793 | rdo-centos-stream | FAILED ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/tests/test_gerrit_changes.py::TestGerritChanges::test_gerrit_changes15:06
rlandy|ruck2022-02-22 14:16:49.644802 | rdo-centos-stream | FAILED roles/rrcockpit/files/telegraf_py3/tests/test_gerrit_changes.py::TestGerritChanges::test_gerrit_changes15:06
rlandy|ruckfailed15:06
rlandy|ruckif you scroll up15:06
rlandy|ruck2022-02-22 14:16:49.641589 | rdo-centos-stream | >       [94massert[39;49;00m expected_keys.issubset(actual_keys)15:06
rlandy|ruck2022-02-22 14:16:49.641599 | rdo-centos-stream | [1m[31mE       AssertionError: assert False[0m15:06
rlandy|ruck2022-02-22 14:16:49.641608 | rdo-centos-stream | [1m[31mE        +  where False = <built-in method issubset of set object at 0x7f20a2136f28>({'_more_changes', '_number', 'attention_set', 'branch', 'change_id', 'cherry_pick_of_change', ...})[0m15:06
dviroelade_lee: https://logserver.rdoproject.org/79/824479/10/openstack-check/tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001/0a1a7c3/job-output.txt15:07
rlandy|ruckhttps://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/tests/test_gerrit_changes.py15:07
rlandy|ruckfrenzyfriday|rover: ^^ failing there15:07
rlandy|ruckpojadhav|dinner: ^^ added those tests15:09
*** ysandeep|dinner is now known as ysandeep15:10
*** dviroel is now known as dviroel|lunch15:11
frenzyfriday|roverI cant understand how this ^ is related to a criteria file change. Lemme ask Pooja15:11
rlandy|ruckhttps://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/tests/data/gerrit-test-data.json15:13
rlandy|ruckfrenzyfriday|rover: it's not related15:13
rlandy|ruckdviroel|lunch changed this recently15:13
* rlandy|ruck looking through this test and the data15:14
rlandy|ruckmaybe this was change to collections?15:14
rlandy|ruckfrenzyfriday|rover: ^^15:14
rlandy|rucknot your patch15:14
rlandy|ruck        with open(full_path + '/data/gerrit-test-data.json') as f:15:17
rlandy|ruck            self.data = json.load(f)15:17
rlandy|ruckdata15:17
rlandy|ruckrunning test locally to check15:24
*** pojadhav|dinner is now known as pojadhav|ruck15:33
pojadhav|ruckrlandy|ruck, frenzyfriday|rover : looking15:34
sshnaidmrlandy|ruck, on cockpit: "msg": "Failed to download remote objects and refs:  fatal: unable to access 'https://github.com/rdo-infra/ci-config.git/': Could not resolve host: github.com; Unknown error\n"15:42
sshnaidmrlandy|ruck, remember this problem when resolve dns on machine was 192.168.100.*? Happened again15:43
sshnaidmrlandy|ruck, alex complained about that as well a long ago15:43
frenzyfriday|rovertripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-wallaby is failing in node provisioning. I am creating a bug15:57
rlandy|rucksshnaidm: vaguely16:03
pojadhav|ruckrlandy|ruck, frenzyfriday|rover : https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3970116:15
*** dviroel|lunch is now known as dviroel16:15
dviroelrlandy|ruck: o/16:15
dviroelrlandy|ruck: oh no, that test failing again - hate that one16:15
rlandy|ruckdviroel: yeah16:15
dviroelrlandy|ruck: i can fix it 16:15
rlandy|ruckthat one again16:16
rlandy|ruckdviroel: looking into that16:16
dviroelrlandy|ruck: i can try a more permanent fix 16:16
rlandy|ruckcollections 16:16
dviroelcollections?16:16
rlandy|ruckdviroel: let's talk about a better test after the all hands16:16
rlandy|ruckdviroel: rather than another fix16:16
rlandy|rucklet's rethink this one16:17
frenzyfriday|roverrlandy|ruck, pojadhav|ruck thanks. Updated https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3968416:17
dviroeloh all hands16:17
pojadhav|ruckrlandy|ruck, dviroel : if you talking about gerrit test ??  https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3970116:17
rlandy|ruckpojadhav|ruck: ack - that test keeps breaking16:17
pojadhav|ruckI removed playing with code of keys..16:17
dviroelyes, that one16:18
rlandy|ruckwe need to think about the value of that test16:18
rlandy|rucklet's chat after the all hnds16:18
rlandy|ruckall important meetiing16:18
rlandy|ruckpojadhav|ruck: pls testproject recheck the failing jobs in 16.216:20
rlandy|ruckso we can try promote16:20
pojadhav|ruckrlandy|ruck, yepp16:21
rlandy|ruckfrenzyfriday|rover: I'll work on that test16:22
frenzyfriday|roverrlandy|ruck, thanks16:22
rlandy|ruckack - will chat with dviroel after all hands16:23
rlandy|ruckI want to rework that16:23
frenzyfriday|roverrlandy|ruck, I will leave for the day in ~40 mins. If there is a new patch to fix the tests I'll recheck https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39684 tomorrow morning16:24
rlandy|ruckok16:24
rlandy|ruckrcastillo: sorry - will review your ping later16:26
rcastillorlandy|ruck: no worries16:27
rlandy|ruckcraziness as usual :(16:27
chandankumarfrenzyfriday|rover: regarding this https://bugs.launchpad.net/tripleo/+bug/1961811 https://review.opendev.org/q/topic:bootloader-nopart series might fix it16:27
frenzyfriday|roverchandankumar, thanks16:28
* frenzyfriday|rover adds note to check ^ tomorrow morning16:28
pojadhav|ruckrlandy|ruck, testrun of 16.2 jobs : https://code.engineering.redhat.com/gerrit/c/testproject/+/27623016:31
ysandeepchandankumar, rlandy|ruck I think it would be a good idea to add an ovb third party check job against diskimage-builder repo, would avoid them breaking us.16:33
chandankumarysandeep: I think I have added that16:33
chandankumarBut i think it is not reporting back16:34
rlandy|ruckthey probably ignore it16:34
chandankumarlet me check rdo side16:34
ysandeepchandankumar, yeah i was looking at https://review.opendev.org/c/openstack/diskimage-builder/+/828617 , I don't see rdo reporting here16:34
chandankumarysandeep: https://review.rdoproject.org/zuul/builds?project=openstack%2Fdiskimage-builder16:35
chandankumarhttps://review.rdoproject.org/zuul/builds?project=openstack%2Fdiskimage-builder&change=82861716:35
chandankumarso the votes not getting reported upstream16:36
ysandeepchandankumar, by chance do you know why we are not reporting back.. looks like we are wasting resources if we don't report back.16:36
chandankumarysandeep: I need to check that part16:37
chandankumarmay be tomorrow, I will take a look16:37
ysandeepsure.. probably worth following up.. if we have other repos where we test but don't report back16:38
chandankumarasked on #rdo currently16:38
ysandeepchandankumar++ thanks!16:39
frenzyfriday|roverrlandy|ruck, pojadhav|ruck /me leaving for the day16:58
rlandy|ruckfrenzyfriday|rover: have a good night16:58
frenzyfriday|roverhttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39684 this is the only urgent patch to watch16:59
pojadhav|ruckfrenzyfriday|rover, good night :)16:59
*** marios is now known as marios|out17:03
* pojadhav|ruck out17:04
*** pojadhav|ruck is now known as pojadhav|out17:05
dviroelrlandy|ruck: looking into code - so we are using gerrit_changes only to retrieve ansible-collections-openstack changes - which I don't know where is being presented17:09
rlandy|ruckdviroel: one sec17:10
rlandy|ruckwill ping17:10
rlandy|ruckdviroel: sorry - https://meet.google.com/vpb-mfxf-xpb?pli=1&authuser=017:15
*** ysandeep is now known as ysandeep|out17:16
rlandy|rucklunch - brb17:37
*** jpena is now known as jpena|off17:42
*** amoralej is now known as amoralej|off17:45
rlandy|ruckussuri promoting17:59
dviroel\o/18:00
ysandeep|outrlandy|ruck, hey o/ okay so the issue with downstream cockpit is in our telegraf_py3 container, we don't share cert with hosts.. Our container don't have correct certs.18:43
rlandy|ruckrcastillo: looking at https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/job/tripleo-quickstart-promote-master-centos9-current-tripleo-delorean-minimal/27/console18:43
ysandeep|outrlandy|ruck, quick way to resolve this is we disable cert checking18:43
rlandy|ruckSSL_VERIFY=0?18:43
ysandeep|outrlandy|ruck, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39711 18:43
rlandy|ruckysandeep|out: ok for now18:43
rlandy|ruckysandeep|out: which containers would need the cert?18:44
rlandy|rucktelegraf?18:45
ysandeep|outrlandy|ruck, i think telegraf_py3 18:45
rlandy|ruckyeah18:45
ysandeep|outas ruck_rover.py is client side tool, i think disabling ssl verify is okay18:45
rlandy|ruckysandeep|out: let's go for this for now - pls add to review list18:46
ysandeep|outrlandy|ruck: ack, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39711 will also resolve the virtualenv issue you were facing, no need to do export explicility in cli.18:46
rlandy|ruckbut we shoulf try cert install on telegraf container18:47
rlandy|ruckif I have three minutes will try look at that18:47
rlandy|ruckafter fixing failing test18:47
ysandeep|outaddin in review list, can take a look at adding correct certs, but posted this as we want cockpit up soon..18:48
rlandy|ruckysandeep|out: ack18:49
rlandy|ruckwe have review time in 10 mins18:49
rlandy|ruckthen can look at adding a cert to container18:49
rlandy|ruckysandeep|out: late for you18:49
rlandy|ruckhave a good night18:50
ysandeep|outyeah.. 00:20 am here..  Got busy with downstream in my day, just got chance to look at cockpit.18:51
ysandeep|outanyway.. i am out now.. see you tomorrow o/18:51
rlandy|ruckrcastillo: here is the failing line: https://github.com/openstack/tripleo-quickstart/blob/master/roles/libvirt/setup/undercloud/tasks/main.yml#L40018:54
rlandy|ruckThe error was: NoneType: None18:55
rlandy|ruckhttps://github.com/openstack/tripleo-quickstart/blob/master/roles/libvirt/setup/undercloud/files/get-undercloud-ip.sh18:56
rlandy|ruckscript that is run18:56
rlandy|ruckhttps://github.com/openstack/tripleo-quickstart/blob/master/roles/libvirt/setup/undercloud/files/get-undercloud-ip.sh#L2118:57
rlandy|ruck    echo "undercloud ip is not available" >&218:57
rlandy|ruckip=$(ip neigh | grep $mac | awk '{print $1;}') returns empty18:58
rlandy|ruckrcastillo: want to join review time?19:01
jm1rlandy|ruck: cockpit works again. Issue was that the vm lost its dns nameservers in /etc/resolv.conf. Reason for this was that this VM is connected to a OpenStack network on vexxhost which has an invalid dns config. Once in a while the VM reconfigures its net devs with dhclient which will then overwrite /etc/resolv.conf with invalid data. The fix is easy: We added the right dns servers to the OpenStack subnet, reconfigured the network (which reruns 19:17
jm1dhclient), restarted docker and containers. Will submit a patch for ci-config repo later.19:17
rlandy|ruckthat happens19:18
rlandy|ruckthank you19:18
sshnaidmcan we proceed with https://review.opendev.org/c/openstack/tripleo-ci/+/829737 ?19:36
rlandy|ruckdviroel: rcastillo: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/31293219:37
*** tbarron is now known as Guest25219:40
rlandy|ruckdviroel: rcastillo: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3970119:41
dviroelrcastillo: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39701 - please add your vote and thoughts :)20:04
rcastillodviroel: +1'd. I agree with your comment20:06
dviroelthanks, mergind20:07
rlandy|ruckdviroel: rcastillo: thanks for joining review time - if you have suggestions on how to make the process better, open to hearing20:11
dviroelrlandy|ruck: +1 collab review is always good to learn new things - rcastillo you are free to stop and ask anything20:18
dviroelrlandy|ruck: want to merge https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39711 - or wait?21:12
rcastillolunch brb21:12
rlandy|ruckdviroel: I think we can merge it21:15
dviroelok21:15
rlandy|ruck(Pdb) print(expected_keys)21:17
rlandy|ruck{'total_comment_count', 'submission_id', 'requirements', 'attention_set', 'subject', 'submitted', 'project', 'owner', 'submitter', 'deletions', 'meta_rev_id', 'topic', 'submit_type', 'has_review_started', '_more_changes', 'hashtags', 'insertions', 'id', 'change_id', 'assignee', 'branch', 'unresolved_comment_count', '_number', 'updated', 'created', 'status'}21:17
rlandy|ruck(Pdb) print(actual_keys)21:17
rlandy|ruck{'total_comment_count', 'submission_id', 'requirements', 'attention_set', 'subject', 'submitted', 'project', 'owner', 'submitter', 'deletions', 'meta_rev_id', 'submit_type', 'topic', 'has_review_started', '_more_changes', 'hashtags', 'cherry_pick_of_change', 'insertions', 'id', 'change_id', 'cherry_pick_of_patch_set', 'branch', 'unresolved_comment_count', '_number', 'updated', 'created', 'status'}21:17
rlandy|ruckdviroel: ^^21:17
rlandy|ruckhence the failure21:17
rlandy|ruckcherry_pick 21:17
rlandy|ruckfor gerrit21:17
rlandy|ruckdebugging the output21:17
rlandy|ruckdviroel: so actual is not a subset21:17
dviroelrlandy|ruck: ack, we should only validate that we have our minimun set of keys there, imho21:18
dviroelrlandy|ruck: voted in https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3971121:22
rlandy|ruckmerging21:22
dviroelack 21:22
*** dviroel is now known as dviroel|brb21:23
rlandy|ruckdviroel|brb: rcastillo: thoughts? https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3971921:36
rlandy|rucknow looking at cert in container21:36
*** dviroel|brb is now known as dviroel21:40
rlandy|ruckhmmm .. test failed22:20
rlandy|ruckhttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39719 passed now22:39
dviroelyey22:40
dviroelyep, i think that coverage failed because another patch merged while test was running, not sure22:40
dviroelcoverage compares current commit with the previous one22:40
dviroelit is a guess22:41
*** rlandy|ruck is now known as rlandy|out23:57

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!