Monday, 2022-11-21

*** rlandy is now known as rlandy|out00:25
*** yadnesh|away is now known as yadnesh04:10
*** ysandeep|out is now known as ysandeep04:59
*** ysandeep is now known as ysandeep|ruck04:59
marioso/06:07
ysandeep|ruckmarios, good morning o/06:10
marios\o06:11
*** yadnesh is now known as yadnesh|afk07:43
*** amoralej|off is now known as amoralej07:59
mariosysandeep|ruck: o/ did you already post tests for that https://review.opendev.org/c/openstack/tripleo-quickstart/+/864690/6#message-0b153481a5b43c7ad6dfa9c052a9a55b5f5f60da (can we please check if we didn't already? like 1 master 1 zed job?)08:07
ysandeep|ruckmarios, hey o/ will check back shortly08:09
mariosysandeep|ruck: thx08:12
ysandeep|ruckmarios: hey o/ Container build are busted for all the releases currently(which I am debugging currently), but I can trigger tests using last known good hash using above tq patch as depends-on, Reading https://bugs.launchpad.net/tripleo/+bug/1996482 looks like container-multinode was one of the affected job, Is it okay to trigger that as a test?08:28
mariosysandeep|ruck: ah ok... well it can also wait i mean obv the container build issue you are debugging now has priority (and maybe testing with old hash isn't ideal anyway )(08:30
ysandeep|ruckcontainer-multinode job is already tested in check for both zed/master against the above tq patch, But I think you want to be sure that all okay with periodic ones too.08:30
mariosysandeep|ruck: yea the issue was seen in periodic first (see bug description) so would be good to test before we unpin08:31
ysandeep|ruckmarios, ack, will rerun container-multinode periodic version for master/zed once container-build job is back.08:32
*** yadnesh|afk is now known as yadnesh08:34
jm1o/08:35
*** jpena|off is now known as jpena08:36
mariosysandeep|ruck: fyi https://review.rdoproject.org/r/c/testproject/+/46157 posted it there 08:47
ysandeep|ruckmarios, thanks! It will fail currently due to missing containers08:48
mariosysandeep|ruck: ok (standalones should do added comment there) we can recheck once you resolve that 08:49
ysandeep|ruckack, sounds good08:49
mariosysandeep|ruck: want to talk about container? Or rather let me know if you do 08:50
ysandeep|ruckmarios, yes we can talk about container build, let me grab by earphones08:51
ysandeep|ruckmy*08:51
marios10:50 < marios> ysandeep|ruck: want to talk about container? Or rather let me know if you do 08:52
marios10:51 < ysandeep|ruck> marios, yes we can talk about container build, let me grab by earphones08:52
mariossry bad paste 08:52
marioshttps://meet.google.com/tak-gakg-eqr ysandeep|ruck 08:53
frenzy_fridayjm1, hey. If we do not face the nginx issue anymore I am marking the nginx patch as dnm and moving it to abandoned later. Maybe it was a temporary issue? I didnt see it anywhere except our dev env09:05
jm1frenzy_friday: we still have issues with nginx, so maybe we both see different issues in our envs?09:06
jm1frenzy_friday: for example, if you open our staging env rrcockpit, then it will show you a default nginx page, not our grafana dashboards09:07
jm1frenzy_friday: so i am wondering what might be different between your instance and my staging env09:08
frenzy_fridayoh, so you are not getting any errors related to volume mount? Then you dont need this fix. /me Checking 09:09
frenzy_fridaycould you pls ping me the IP of the staging cockpit once again?09:10
frenzy_fridayjm1, I think you are faing this issue: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/nginx.conf.local#L36 here it defines a specific servername (which is the domain name of the prod cockpit) So the requests to :80 on the server are not routed to 8080 by nginx because the servername does not match (or something like that)09:18
frenzy_fridayIn the dev vm we changed https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/nginx.conf.local#L36  server_name <IP_of_dev_server> as a work around. Ideally We should maybe inject the domain name into the .conf file for each of the env.09:20
jm1frenzy_friday: ah right, server_name! so lets add default_server parameter to listen and then it should work. want to test it?09:24
jm1frenzy_friday: https://nginx.org/en/docs/http/ngx_http_core_module.html#listen09:24
* jm1 brb09:25
frenzy_fridaylike this: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46158 ? /me testing on the dev vm09:28
*** ysandeep|ruck is now known as ysandeep|ruck|lunch09:46
jm1frenzy_friday: we need those server_name directives to be able to redirect users. default_server has to be added to the listen directive: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4615909:57
frenzy_fridayjm1, ah, got it now!10:05
frenzy_fridayjm1, I did not get the todo part. Your patch looks complete to me. Adding default server and setting server name as a jinja variable it should be all we need, right?10:07
jm1frenzy_friday: i tried to address your question in the latest comment here: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4615910:12
* pojadhav afk for half hour10:22
*** pojadhav is now known as pojadhav|afk10:22
marioschandankumar: ysandeep|ruck|lunch: dviroel|out: bhagyashris: rlandy|out: please add to your review queue https://review.rdoproject.org/r/c/rdo-jobs/+/46119 10:23
*** ysandeep|ruck|lunch is now known as ysandeep|ruck10:26
ysandeep|ruckjm1 marios rlandy|out Is tool box accessible?10:39
jm1ysandeep|ruck: looks like no vm on vexxhost is accessible10:44
jm1ysandeep|ruck: all machines up, but cannot connect to them. no route to host10:46
mariosysandeep|ruck: cant get onto promoter as jm1 said ^^^ didn't try toolbox but seems general issue10:47
* marios food biab10:47
ysandeep|ruckjm1, marios thanks for checking, I will report to vexx10:48
ysandeep|ruckfrenzy_friday, hey o/ Is tripleo-health-temp accessible, otherwise I will include that in my ticket as well10:55
frenzy_fridayysandeep|ruck, nope, same with the health vm  connect to host 38.102.83.141 port 22: No route to host10:57
ysandeep|ruckfrenzy_friday, ack thanks for checking10:57
*** gthiemon1e is now known as gthiemonge11:00
* ysandeep|ruck filed a vexxhost ticket11:04
*** rlandy|out is now known as rlandy|rover11:06
rlandy|roverysandeep|ruck: hi ...11:08
rlandy|rovercan't access any vexx infra11:08
rlandy|roverysandeep|ruck: downstream works for me11:08
ysandeep|ruckrlandy|rover, thanks!11:08
ysandeep|ruckI have filed a vexx ticket11:08
rlandy|roverysandeep|ruck: I pinged guilhermesp on vexx - pls ping him with the ticket number11:09
rlandy|roverysandeep|ruck: have time to chat? 11:10
ysandeep|ruckrlandy|rover, I have already pinged the ticket number on #vexxhost11:10
ysandeep|ruckrlandy|rover, sure11:10
rlandy|roverhttps://meet.google.com/vkh-yhid-smp?pli=1&authuser=011:10
ysandeep|ruckrlandy|rover, cat build.log | grep -i "Exit code: 1"11:22
*** dviroel|out is now known as dviroel11:23
* dviroel o/11:23
ysandeep|ruckmarios, https://review.rdoproject.org/r/c/testproject/+/36859/6#message-25303029ca90e97de4b613e62867ca2bdda376e711:30
mariosysandeep|ruck: thx11:30
*** pojadhav- is now known as pojadhav11:44
ysandeep|ruckrlandy|rover, https://be08be4bca8d9efed097-90b48a3106a793a661c7495bcec7bb56.ssl.cf2.rackcdn.com/periodic/opendev.org/openstack/tripleo-heat-templates/stable/zed/tripleo-ci-centos-9-content-provider/2250069/logs/container-builds/eec9cd34-ebfd-4135-b418-bdd9331afc9d/base/ovn-bgp-agent/ovn-bgp-agent-build.log11:45
ysandeep|ruckhttps://c6e907431413b276a63b-23a7172f5dc1e58445390ec61883d218.ssl.cf2.rackcdn.com/864994/8/gate/tripleo-ci-centos-9-content-provider/9d99392/logs/container-builds/522fec05-8e3f-4cc7-8901-45f0ca049eed/base/os/horizon/horizon-build.log11:46
rlandy|roverysandeep|ruck: marios; ibm cloud node job kicked11:59
mariosthx rlandy|rover link/testproject? 11:59
rlandy|roverhttps://review.rdoproject.org/r/c/testproject/+/4535911:59
mariosthanks11:59
*** ysandeep|ruck is now known as ysandeep|ruck|brb12:00
rlandy|rovermarios: ysandeep|ruck: we didn;t raise anything to openstack-discuss yet, right?12:00
rlandy|roverI can email out about that - intermittent gate failures12:00
rlandy|roverdone12:06
mariosrlandy|rover: ack 12:07
*** dviroel_ is now known as dviroel12:12
dviroelchandankumar: around?12:12
*** ysandeep|ruck|brb is now known as ysandeep|ruck12:12
pojadhavdviroel, chandankumar is on PTO today12:12
pojadhavdviroel, today and tomorrow12:13
rlandy|roverdviroel: something I can help with?12:13
dviroelpojadhav: ack, thanks12:14
dviroelrlandy|rover: i was about to ask some help with ovb on bm312:14
dviroelgot a cert error12:15
dviroelactually, cert not found, but i was expecting it there, since it follows the same tasks in ibm bm212:16
dviroelrlandy|rover: i will continue to investigate12:17
rlandy|roverdviroel: ok - if you are still having issues, we can look at it in the afternoon12:17
dviroelrlandy|rover: ack, tks12:18
* bhagyashris stepping out for bit12:19
rlandy|roverysandeep|ruck; scrum and CIX clash ...12:20
rlandy|roverlooking at CIX cards now12:20
rlandy|roverysandeep|ruck: can you comment on whether we should keep or close: https://trello.com/c/pWE18lEp/2787-cixlp1996874tripleociproa-buld-containers-quay-push-libselinux-python-arent-installed12:20
ysandeep|ruckrlandy|rover, updated and moved to done12:21
rlandy|roverysandeep|ruck: thanks - I ma updating the card in triage12:22
rlandy|roverysandeep|ruck: pojadhav is going to be out - so I need to run scrum (until dasm|off is in). Pls will you cover CIX call - thank you12:27
ysandeep|ruckrlandy|rover, sure12:29
rlandy|roverfrenzy_friday: hello ... can you update the cards for 9.1?12:35
rlandy|roveron jira board12:35
rlandy|roverbhagyashris: hi - pls ping when you are back12:36
rlandy|roverysandeep|ruck: since master is 6 days out, I am going to do a internal zuul run of fs064 from the hash we were chasing12:45
rlandy|roverif it passes we can use that in criteria12:45
ysandeep|ruckrlandy|rover: ack, also should I file a bug for fs064?12:48
rlandy|roverysandeep|ruck: I think we can rev=move auto-reverse12:48
rlandy|roverI removed it for ds12:48
rlandy|roverI'll have to test that out when vexxhost comes back12:49
rlandy|roverright now, DNS is hard to debug12:49
ysandeep|ruckyeah .. 12:49
rlandy|roverdviroel: can I borrow your yaml experise?12:54
dviroelrlandy|rover: how can I help? 12:56
rlandy|roverdviroel: I need to use if /else yaml condition but have the result interpreted as a list - not string ...12:58
rlandy|roverdviroel: not do this mess up again ... https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/43556012:59
rlandy|roverI can think of two options12:59
rlandy|roverwill adding [] work?12:59
rlandy|roverie: get that interpreted as a list?12:59
rlandy|roverotherwise I can define the list in another var13:00
rlandy|roverbut that seems clunky13:00
* dviroel looking13:01
mariosgrumble... cant post to rdo/gerrit now ysandeep|ruck must still be upgrading13:04
mariosPlease make sure you have the correct access rights13:04
mariosand the repository exists.13:04
marioserror: could not fetch gerrit13:04
* marios fetches coffee 13:04
rlandy|rovermarios: make it a large cup13:04
marios;)13:04
rlandy|roverdviroel: looking into using |13:07
rlandy|roverto retain spacing13:07
rlandy|roverbut that may still get interpreted as a string13:07
dviroelrlandy|rover: freeipa_internal_ip is always a string?13:09
bhagyashrisrlandy|rover, hey i am back13:09
rlandy|roverdviroel: yeah - one value13:09
ysandeep|ruckmarios, rlandy|rover fyi.. I am chatting with infra folks on #opendev to discuss upstream issue.13:09
rlandy|roverbhagyashris: sec13:09
dviroelrlandy|rover: maybe "|list" solves that, let me try here13:09
rlandy|roverdviroel: hmmm ... interesting idea13:10
rlandy|roverysandeep|ruck: not to jinx it, but gate looks cleaner now13:10
*** amoralej is now known as amoralej|lunch13:10
rlandy|roverat least from content provider issues13:10
ysandeep|ruckrlandy|rover, fungi is of opinion that we should use local resolver, Tengu was of same opinion as well.13:12
rlandy|roverysandeep|ruck: that makes sense13:12
bhagyashrisack13:13
rlandy|roverdviroel: going with other var w/o atm - but still need a resolution for this13:23
dviroelrlandy|rover: ack, trying that locally in a test file13:24
rlandy|roverthanks13:24
rlandy|roverhttp://promoter.rdoproject.org/promoter_logs/centos9_wallaby.log13:29
rlandy|roverpromoter error13:29
rlandy|roverThe server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.13:29
rlandy|roverysandeep|ruck: ^^13:29
rlandy|roverfyi13:30
rlandy|roverbhagyashris: ^^ can you help put here?13:30
rlandy|roveron the promoter now13:30
rlandy|roverservice restart?13:31
rlandy|rover Exception while fetching promotions from API endpoint13:31
bhagyashrisrlandy|rover, ack13:32
rlandy|roveridk - maybe looking for gerrit13:32
rlandy|roverthat is still down13:32
Tenguysandeep|ruck, rlandy|rover note that I'll come tomorrow in the CI meeting (time changed apparently) with some proposal for caching.13:32
TenguI've already pushed content to the agenda13:33
rlandy|roverpojadhav: ^^ pls schedule Tengu's topic13:33
rlandy|roverthanks13:33
rlandy|roverok13:33
Tenguthere's a handy solution with networkmanager + dnsmasq - unbound support in networkmanager is deprecated.13:33
Tenguso basically, install one package, add 2 lines in the nm config, reload, and you're done.13:34
bhagyashrislooks like after restart promoter is working fine13:39
rlandy|roverbhagyashris: yep - we're good now13:40
rlandy|roverysandeep|ruck: master line is rekicked13:41
rlandy|roverlet's see how that goes13:41
rlandy|roverwallaby c8 is promoting now13:41
rlandy|roverhopefull c9 goes after that13:41
rlandy|roverI'll try fs064 master w/o auto-reverse13:42
ysandeep|ruckTengu, unbound support is deprecated - Oh that's a news for me13:43
Tenguysandeep|ruck: its direct from NetworkManager.conf manpage13:43
Tenguok. nm+dnsmasq: checked. Have to dig into squid+TLS13:44
rlandy|roverakahat: arxcruz: bhagyashris: pojadhav: dasm|off: rcastillo: dviroel: marios: chandankumar: soniya: ysandeep|ruck: frenzy_friday: jm1: reminder: scrum in 4 mins13:56
soniyarlandy|rover, ack13:57
ysandeep|ruckTengu, you are checking NetworkManager.conf on RHEL9/ latest fedora? I am on a RHEL9 machine and don't see any deprecation msg.13:58
*** amoralej|lunch is now known as amoralej13:58
Tenguysandeep|ruck: manpage on cs913:59
Tenguand latest fedora13:59
Tengunot in the file itself13:59
ysandeep|ruckyes `man NetworkManager.conf`14:00
Tenguoh, fun.14:00
ysandeep|ruckprobably version difference14:00
ysandeep|ruck$ NetworkManager --version14:00
ysandeep|ruck1.41.4-2.el914:00
Tenguso. fc-35 mentions "deprecated" - cs9 doesn't even talk about unbound anymore14:01
mariosrdo gerrit back now btw14:01
ysandeep|ruckTengu, yes no mention of ubound in my version as well14:01
rlandy|roversoniya: scrum time14:01
Tengu(df checkpoint, sorry)14:02
jm1frenzy_friday: did you test this patch? i had no time yet 🙈 https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4615914:19
Tengupojadhav: I don't know how long my topic will take, but I expect to get some interesting discussions.14:24
Tengupojadhav: if there are other topics, we can maybe split mine, and do "dns" today, and "non-rpm content" tomorrow.14:25
Tenguerro. next week14:25
frenzy_fridayjm1, commenting on the patch14:25
Tengu... s/today/tomorrow/ s/tomorrow/next week/ :)14:25
jm1frenzy_friday: ok cool :)14:26
frenzy_fridayjm1, added a long comment :D14:31
rlandy|roverysandeep|ruck: woohoo wallaby c9 is promoting 14:31
ysandeep|ruckrlandy|rover, wohoo and container build is looking faster this time on the master line 14:31
rlandy|roverysandeep|ruck: wallaby c8 promoted14:32
rlandy|rovertrain should as well14:32
rlandy|roverrunning master fs06414:32
rlandy|roverysandeep|ruck: rekicking zed when master container build completes14:33
jm1frenzy_friday: thanks for testing this out! actually it should work the other way around?!?! lets talk later, need a break now :D14:34
ysandeep|ruckrlandy|rover, sounds good14:34
rlandy|roverdasm|off: hello14:44
rlandy|roverdasm|off: you're here?14:44
rlandy|roverdasm|off: can you give https://trello.com/c/IryyjbGs/2344-cixlp1960355tripleociproa-tempest-tests-testoauth1tokensoauth1tokenstest-are-failing-on-tripleo-ci-centos-9-ovb-3ctlr1comp-featu a try now14:44
rlandy|roverskip list revert14:44
mariosrlandy|rover: dasm|off: we spoke a bit about this on friday .... dasm fix should be available now in 'regular' stream repos see apevec last comment... just need to rebase the skiplist revert and retry the testproject14:48
*** dasm|off is now known as dasm14:48
rlandy|roveryep - what marios says14:48
jm1frenzy_friday: do you play with rhos_dev_stage_2 or is it free to be changed?14:48
dasmrlandy|rover  marios  i can respin revert14:48
dasmi'll give it a try in a bit14:49
rlandy|roverdasm++ thanks for keeping that alive14:50
rlandy|roverwoohoo container build success14:58
rlandy|rovermarios: ysandeep|ruck: ^^14:59
mariosgreat thx rlandy|rover 14:59
rlandy|roverrekciking zed14:59
dasmmarios: rlandy|rover fyi, OAUTHToken job: https://review.rdoproject.org/r/c/testproject/+/3995515:00
ysandeep|ruckrlandy|rover, other one is still running, 1.15 mtg already.. but lets seee15:00
ysandeep|ruckmins*15:00
mariosdasm: thanks15:00
ysandeep|ruckrlandy|rover, something just happened with zuul15:01
ysandeep|ruck503 service unavailable15:01
rlandy|roveryep15:01
rlandy|roverjust saw that15:01
rlandy|roverrekick bailed15:01
rlandy|rovermanager meeting time15:02
dasmmarios: i must've missed that during our Friday's conversation: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/865052/1/zuul.d/layout.yaml#1215:03
dasmbut yes, we need to have periodic as wel15:03
dasmwell15:04
mariosdasm: also undercloud-upgrade or will you do that in different patch? 15:04
dasmmarios: i thought that what i did was everything :/ lemme check that one more time15:05
dasmmarios: probably i'm gonna add undercloud-upgrade to the patch i started work on15:05
mariosdasm: yeah need to add undercloud-upgrade here https://review.opendev.org/c/openstack/tripleo-ci/+/865050/1/zuul.d/upgrades-jobs-templates.yaml 15:06
dasmmarios: similar to https://review.opendev.org/c/openstack/tripleo-ci/+/865050/1/zuul.d/upgrades-jobs-templates.yaml#57 i presume?15:06
ysandeep|ruckrlandy|rover, hey o/ container build latest green run took 1hr 14 min15:09
ysandeep|ruckhttps://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-build-containers-ubi-9-quay-push-master&skip=015:09
ysandeep|ruckearlier it was faster ~ 40 - 50 mins on average15:10
ysandeep|ruckbut lets monitor more runs for a day or two15:10
*** ysandeep|ruck is now known as ysandeep|ruck|dinner15:11
rlandy|roverysandeep|ruck|dinner: ack - zed kicked now15:13
rlandy|roverso we can see the results15:14
rlandy|roverthere15:14
* dviroel lunch15:14
*** dviroel is now known as dviroel|lunch15:14
*** yadnesh is now known as yadnesh|away15:18
mariosdasm: yeah 15:21
frenzy_fridayjm1, yeah you can change it. I am not using it15:26
rlandy|roverjpodivin_: hello ... pls see gate failures on tripleo-validations - thank you15:30
jpodivin_rlandy|rover: ok, is there a bug filed?  15:31
rlandy|roverjpodivin_: not yet - I will if it's consistent15:32
jpodivin_rlandy|rover: do you have a link? 15:34
jpodivin_to logs I mean15:34
*** jpodivin_ is now known as jpodivin15:34
rlandy|roverah15:34
rlandy|roverhttps://fd0004da6e060ff5fe10-49f052783357ad0fd943fff0bdadddcf.ssl.cf2.rackcdn.com/864854/4/gate/openstack-tox-docs/d2228c8/15:34
rlandy|roverhttps://zuul.opendev.org/t/openstack/build/30d347112d1e4dec895c4a4d6bcd0e5215:35
jpodivinrlandy|rover: thank you15:35
rlandy|roverjpodivin; if it's a once off - np - just wanted to alert your team15:35
dasmmarios: ack. i'll update the initial patch15:35
jpodivinrlandy|rover: this may have something to do with the node update to new ubuntu15:36
rlandy|roverjpodivin: ok - want a LP bug for it?15:36
jpodivinrlandy|rover: I'm goint to retry with one of my patches, this should happen in both check and gate if I'm right?15:37
jpodivinand if so I'll file the bug15:37
rlandy|roveryep15:38
rlandy|roverit should 15:38
rlandy|roverwe just don;t track all check job as closely as gate15:38
dasmmarios: fyi, i'm moving CI: Zed branching to done, but I added outstanding task for "upstream upgrade jobs" to OSP board. This way ours task is going to be closed, but the original one will stay active15:43
mariosdasm: but why are you moving CI:Zed brancing to done? why not use it to track the ugprades work as we currently have it?15:46
mariosdasm: oh other way around, you're closign the OSP one15:47
mariosdasm: k 15:47
jpodivinbug confirmed and filed https://bugs.launchpad.net/tripleo/+bug/199725615:47
mariosbhagyashris: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/435848 https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/435847  - what i mentioned earlier for cleanup please add to your review list? 15:49
jpodivinrlandy|rover: fix proposed, we'll see how it works in a minute15:49
rlandy|roverjpodivin++ 15:50
rlandy|rovergreat15:50
dasmmarios: i closed TripleO-CI but kept OSP for our overloards for proper tracking15:54
mariosdasm: but why close our one then 15:54
dasmmarios: i added missing upgrades task to osp board. 15:54
dasmsimilar to what dviroel|lunch did with podified task15:55
mariosdasm: ok i saw it 15:55
mariosdasm: ack 15:55
dasmthe task is still there, just under different umbrella15:55
dasms/overloards/overlords15:56
dasmheh15:56
*** ysandeep|ruck|dinner is now known as ysandeep|ruck16:13
ysandeep|ruckrlandy|rover: I am out soon, We only had that container build and fs064 issue issue today16:16
*** dviroel|lunch is now known as dviroel16:18
ysandeep|ruckLooks like container build is still longer than usual16:19
ysandeep|ruckhttps://review.rdoproject.org/zuul/stream/af5a8d9e0a3a44858ab6365cbde82817?logfile=console.log running for 1hr 18 min already16:20
ysandeep|ruckI will check further on local dns resolver tomorrow, Need to do some reading about unbound, and more recent networkmanager + dnsmasq16:22
marios:/16:22
ysandeep|ruckrlandy|rover, need anything before I leave?16:22
rlandy|roverysandeep|ruck: not really16:22
rlandy|roverwill follow promotions16:23
rlandy|roverfor master and zed16:23
rlandy|roverwill leave you notes16:23
ysandeep|ruckthanks, see you tomorrow o/16:23
rlandy|roversee you then16:23
*** ysandeep|ruck is now known as ysandeep|out16:23
mariosrlandy|rover: o/ need something before i go?16:50
*** marios is now known as marios|out16:57
rlandy|rovermarios|out: shoudl be fine 16:59
rlandy|roverhave a good night16:59
rlandy|roverthanks16:59
marios|out \o16:59
marios|outhttps://www.theregister.com/2022/11/18/openstack_thriving_survey/17:22
*** jpena is now known as jpena|off17:36
*** amoralej is now known as amoralej|off18:01
rlandy|roverrcastillo: hi - you around?18:37
rlandy|rovermoved you 1-118:37
rlandy|roverholiday here in USA on friday18:37
dviroelrlandy|rover: hey, so now, bmc is hitting this error: https://logserver.rdoproject.org/46/46046/6/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-train-bm3/b485f34/logs/bmc_6_36697-console.log19:23
dviroelrlandy|rover: don't know what it is yet19:23
* rlandy|rover looks19:23
rlandy|roverdviroel: let's chat19:30
rlandy|roverdviroel: https://meet.google.com/amp-ewqb-wvb?pli=1&authuser=019:31
dviroelrlandy|rover: one sec19:33
* jm1 out for today, have a nice evening UTC<0 folks :D20:45
dasmjm1[m]: o/21:07
rlandy|roverdviroel: any luck with ibm 3?21:15
dviroelrlandy|rover: no, i was looking stack resources, private-network resource is ok21:32
rlandy|roverdviroel: can you shh to the undercloud node21:33
rlandy|roverssh21:33
dviroelrlandy|rover: i can hold a node and ssh to the instance, but I can't avoid stack deletion21:36
dviroelor at least, I don't know how to avoid stack delete21:36
rlandy|roverdviroel: getting21:37
rlandy|roverdviroel: remove_ovb_after_job21:42
rlandy|roverhttps://github.com/rdo-infra/review.rdoproject.org-config/blob/fe9f93c33596a1423571dbcba4a3ed4a6cf909ca/playbooks/tripleo-rdo-base/post-ovb-cleanup.yaml#L1721:42
rlandy|roverset that to false21:42
dviroelrlandy|rover: ack, tks21:43
rlandy|roverdviroel: clean up script might still get you 21:43
rlandy|roverif that runs on ibm cloud21:44
rlandy|roverguessing not on node 3 yet21:44
dviroelrlandy|rover: didn't merge yet - cleanup script updates21:44
* dasm => offline22:01
dasmtake care Team!22:01
*** dasm is now known as dasm|off22:01
rlandy|rovergood night22:03
*** rlandy|rover is now known as rlandy|rover|biab22:07
dviroelrlandy|rover|biab: FYI, we can set "remove_ovb_after_job" or hold the node, that will avoid stack deletion, but we can avoid stack deletion when we have a CREATE_FAILED stack22:11
dviroelhttps://github.com/rdo-infra/review.rdoproject.org-config/blob/fe9f93c33596a1423571dbcba4a3ed4a6cf909ca/roles/ovb-manage/tasks/ovb-create-stack.yml#L151-L15622:11
* dviroel going afk22:45
*** dviroel is now known as dviroel|afk22:45

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!