Wednesday, 2021-02-17

*** zbr has quit IRC00:33
*** jmasud has joined #oooq00:38
*** jmasud has quit IRC00:42
*** zbr has joined #oooq00:45
*** rlandy has quit IRC01:24
*** jmasud has joined #oooq01:50
*** jmasud has quit IRC01:57
*** jmasud has joined #oooq01:58
*** jmasud has quit IRC02:20
*** jmasud has joined #oooq02:21
*** zbr7 has joined #oooq02:23
*** zbr has quit IRC02:23
*** zbr7 is now known as zbr02:23
*** jmasud has quit IRC02:23
*** jmasud has joined #oooq02:38
*** jmasud has quit IRC02:58
*** jmasud has joined #oooq03:32
*** jmasud has quit IRC03:35
*** saneax has joined #oooq03:36
*** skramaja has joined #oooq03:51
*** udesale has joined #oooq04:08
*** saneax has quit IRC04:29
*** ratailor has joined #oooq04:37
*** saneax has joined #oooq04:48
*** marios has joined #oooq06:00
*** zbr has quit IRC06:13
*** zbr has joined #oooq06:14
*** ksambor has quit IRC07:05
*** slaweq has joined #oooq07:07
*** ksambor has joined #oooq07:11
*** jpodivin has joined #oooq07:15
*** jpodivin has quit IRC07:16
*** jpodivin has joined #oooq07:16
*** amoralej|off is now known as amoralej08:07
*** ratailor has quit IRC08:33
*** ratailor has joined #oooq08:34
*** jbadiapa has joined #oooq08:46
*** ysandeep|away is now known as ysandeep|ruck08:50
*** jpena|off is now known as jpena08:59
*** arxcruz has joined #oooq09:09
arxcruzomg, i was offline09:09
arxcruzysandeep|ruck: namaste09:10
*** ChanServ sets mode: +o arxcruz09:10
*** tosky has joined #oooq09:14
*** udesale_ has joined #oooq09:16
*** udesale has quit IRC09:20
*** tosky_ has joined #oooq09:20
*** tosky has quit IRC09:24
*** udesale__ has joined #oooq09:25
*** tosky_ is now known as tosky09:25
ysandeep|ruckarxcruz, hello o/09:27
*** udesale_ has quit IRC09:27
ysandeep|rucknamaste /\09:27
arxcruzysandeep|ruck: today can you report status? should be fine since we are green, i think i have an itnerview at the same time09:27
ysandeep|ruckarxcruz, yes i will cover program call09:28
*** jbadiapa has quit IRC09:29
*** derekh has joined #oooq09:39
*** udesale_ has joined #oooq09:46
*** udesale__ has quit IRC09:49
*** udesale__ has joined #oooq09:51
*** udesale_ has quit IRC09:54
*** chem has joined #oooq10:01
*** dtantsur|afk is now known as dtantsur10:01
soniya29arxcruz, kopecmartin, Do you have anything to discuss in today's tempest meeting?10:05
arxcruzsoniya29: not really tbh10:07
ysandeep|ruckarxcruz, good news all c8 integration lines promoted today10:08
arxcruzysandeep|ruck: that deserves a beer :D10:08
ysandeep|ruckyeah, i don't drink beer, I will take a soft drink :)10:09
arxcruzysandeep|ruck: WHAT?!10:12
arxcruzchandankumar: ^10:12
arxcruzhow is that possible?10:12
arxcruzysandeep|ruck:--10:12
ysandeep|ruckarxcruz, yeah, infact i have never tasted beer :)10:12
arxcruzysandeep|ruck: you still have time :)10:13
chandankumararxcruz: :-)10:13
ysandeep|ruckarxcruz, :) i usually get this reaction - https://www.pinterest.com/pin/461407924297597251/10:15
kopecmartinsoniya29: nothing special10:27
arxcruzysandeep|ruck: https://i.ytimg.com/vi/bChA8SaiKBw/maxresdefault.jpg10:29
soniya29chandankumar, arxcruz, kopecmartin, so let's cancel today's tempest meeting10:31
arxcruzsoniya29: ack10:31
ysandeep|ruck:D lol!10:33
kopecmartinsoniya29: ok10:33
*** saneax has quit IRC10:36
ysandeep|ruckfrenzy_friday, hey could you please share with me your public ssh keys10:50
sshnaidmysandeep|ruck, yeah, worth to add also all new folks10:58
mariosarxcruz: ysandeep|ruck: are you aware of issue with c7 stein? https://review.opendev.org/c/openstack/paunch/+/774581/2//COMMIT_MSG#910:58
ysandeep|ruckmarios, no, checking, thanks for informing11:00
mariosysandeep|ruck: thanks11:00
frenzy_fridayHey ysandeep|ruck , https://github.com/frenzyfriday/ssh-keys/blob/main/public_keys11:01
ysandeep|ruckfrenzy_friday, i see 2 keys there, which one you want ?11:02
ysandeep|ruckfrenzy_friday, fyi.. i will add here https://review.rdoproject.org/r/#/c/32009/11:02
*** saneax has joined #oooq11:02
frenzy_fridaythe first one is preferred but if it needs to be 1024 then 2nd one11:03
ysandeep|ruckpojadhav, your key is missing as well, could you please ping me your key11:07
pojadhavysandeep|ruck, yup11:08
*** sshnaidm has quit IRC11:15
*** sshnaidm has joined #oooq11:18
ysandeep|ruckmarios, arxcruz https://bugs.launchpad.net/tripleo/+bug/191592111:33
openstackLaunchpad bug 1915921 in tripleo "Stein branch check/Gate jobs are failing because of missing container images, Error - ImageNotFoundException" [Critical,Triaged]11:33
mariosthank you ysandeep|ruck11:34
ysandeep|ruckthis hash was promoted on 13th, checking if there was issue in container push to quay..11:34
ysandeep|ruckhmm, http://38.102.83.109/promoter_logs/centos7_stein.log-20210213 - "Check if images were pushed" failed - You have reached your pull rate limit11:43
mariosysandeep|ruck: sounds like a winner :D11:45
marios:/11:45
mariosysandeep|ruck: so either need another promotion or manual push of those i guess11:45
ysandeep|ruckmarios, arxcruz, ^^ Looks like we i.e need to manually repush or find a hash to promote soon11:45
ysandeep|ruck:D11:46
mariosysandeep|ruck: ack :D11:46
ysandeep|rucksame msg :D11:46
mariosysandeep|ruck:++11:46
* ysandeep|ruck checking when this line triggers and current status, will trigger the line if it don't trigger today11:47
* ysandeep|ruck thinks promoter should handle this kind of error in a better way11:48
arxcruzysandeep|ruck: i don't know how to manually promote12:04
ysandeep|ruckarxcruz, new hash not available to promote - tripleo-ci-testing and current-tripleo is same :(12:05
ysandeep|ruckarxcruz, ack, may be chandankumar marios sshnaidm have an idea about how we can manually repush containers for stein.12:06
ysandeep|ruckarxcruz, oh good news, consisent have a new hash - https://trunk.rdoproject.org/centos7-stein/consistent/delorean.repo .. i will trigger whole line including periodic-tripleo-centos-7-stein-promote-consistent-to-tripleo-ci-testing job.12:08
arxcruzysandeep|ruck: ack12:09
arxcruzysandeep|ruck: +12:09
arxcruzonly + because of beer12:09
ysandeep|ruckhahaha12:09
mariosarxcruz: ysandeep|ruck: if i recall we had some scripts on the promoters to do that12:17
mariosysandeep|ruck: arxcruz: but likely none of us has access right now12:18
mariosysandeep|ruck: but better if there is a newer hash instead :)12:18
ysandeep|ruckmarios, arxcruz seems we are in luck.. scheduled run for stein was 15 mins ago.. running right now12:19
arxcruz]o/12:19
ysandeep|rucki will monitor how openstack-periodic-integration-stable4-5 pipeline goes12:19
chandankumarysandeep|ruck: we generally push the container manually, wes has some script which push all the containers12:19
ysandeep|ruckmarios, chandankumar thanks for informing about script.. if new hash is not good to promote.. i will get in touch..12:21
chandankumarI think this was the script https://gist.github.com/weshayutin/692c80f2d4179dcf2108265bd9218bc912:23
ysandeep|ruckack, we will need some modifying in script based on release..12:25
ysandeep|ruckbut lets try to promote new hash first..12:25
*** jpena is now known as jpena|lunch12:30
*** rlandy has joined #oooq12:31
marioschandankumar: thanks for checking https://review.opendev.org/c/openstack/tripleo-ci/+/774575/3/zuul.d/deprecated-jobs.yaml#22512:34
arxcruzrlandy: i don't get the meeting in my calendar, can you tell me how many time left from now ?12:34
rlandyarxcruz: 2pm UTC12:35
rlandypm'ing you the link12:35
rlandyso like an hour and a half from now12:35
rlandyysandeep|ruck: updated the program call doc wrt rhel 8.412:38
ysandeep|ruckrlandy, checking12:38
ysandeep|ruckrlandy, looks good, thanks!12:39
weshay|ruck0/12:46
rlandyweshay|ruck: hey there12:47
rlandywelcome back12:47
weshay|rucka hoy!12:47
weshay|ruckeveryone staying warm?12:47
rlandyuntil thursday when the next snow disaster hits12:48
*** jbadiapa has joined #oooq12:49
*** jbadiapa has quit IRC12:50
*** jbadiapa has joined #oooq12:51
chandankumarrlandy: weshay|ruck hello, the current c8 promoter server runs on rdocloud, apevec was asking syncing / backuping up the content of promoter server to vexxhost, as on rdocloud only this promoter vm is left12:52
weshay|ruckchandankumar, he told me they were going to migrate the vm12:53
rlandychandankumar: ack - was under discussion last week12:53
chandankumarweshay|ruck: rlandy I added apevec pub key on promoter server, the existing kernel is also very old and full of cves12:54
weshay|ruckchandankumar, let's chat12:54
weshay|ruckchandankumar, https://meet.google.com/meu-mksh-hyg12:55
*** ratailor has quit IRC13:04
*** amoralej is now known as amoralej|lunch13:04
*** frenzy_friday is now known as frenzy_friday|br13:05
*** frenzy_friday|br is now known as frenzyfriday13:07
*** frenzyfriday is now known as frenzy_friday13:07
*** jpena|lunch is now known as jpena13:23
rlandyysandeep|ruck++13:30
weshay|ruckakahat, 1-113:32
akahatweshay|ruck, yes. joining.13:32
*** skramaja has quit IRC13:34
ysandeep|ruckarxcruz, fyi.. stein line failed.. https://logserver.rdoproject.org/openstack-periodic-integration-stable4-5/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-stein/349bae1/job-output.txt13:41
ysandeep|ruckOpening a bug for ^^13:42
weshay|ruckbhagyashris, hey you avail to chat w/ akahat and I?13:45
bhagyashrisweshay|ruck, yes13:46
weshay|ruckbhagyashris, https://meet.google.com/fju-oamg-mec13:47
weshay|ruckbhagyashris, akahat periodic-tripleo-ci-centos-8-standalone-ussuri13:52
weshay|ruckhttps://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-stable2#13:52
ysandeep|ruckarxcruz, https://bugs.launchpad.net/tripleo/+bug/191593213:53
openstackLaunchpad bug 1915932 in tripleo "Centos7 Stein Jobs failed with error - sudo: pip3: command not found" [Critical,Triaged]13:53
arxcruzhmmmm centos7 should use pip instead of pip313:55
akahatweshay|ruck, https://logserver.rdoproject.org/07/32007/1/check/mol-container_push/17682bf/job-output.txt13:57
akahatsearch for "Generate list of containers to push"13:57
*** amoralej|lunch is now known as amoralej14:00
akahatweshay|ruck, bhagyashris https://review.rdoproject.org/r/#/c/31612/3/.zuul.yaml14:00
*** ysandeep|ruck is now known as ysandeep|mtg14:01
*** saneax has quit IRC14:08
chandankumararxcruz: can I take over the tripleo common tempest container removal patch and submit rest of the patches to remove it?14:33
arxcruzchandankumar: sure i guess14:34
arxcruz:D14:34
chandankumararxcruz: thanks!14:35
*** slaweq has quit IRC15:00
*** slaweq has joined #oooq15:04
weshay|ruckarxcruz, marios rlandy sshnaidm soniya29 do we need to sync for 15min before tomorrows interview?15:13
mariosweshay|ruck: we had a call on monday - we have divided sections/questions.15:13
mariosweshay|ruck: if you want to sync fine for me15:13
weshay|ruckarxcruz, marios rlandy sshnaidm soniya29 if you all feel prepared, I'm fine w/ not syncing15:14
weshay|ruckraise concerns today though :)15:14
mariosweshay|ruck: works for me up to others too but it wasn't rlandy it was arxcruz15:15
mariosweshay|ruck: me arxcruz sshnaidm and soniya2915:15
arxcruzthat's fine for me15:15
arxcruzeither way15:15
arxcruzsyncing or not15:15
sshnaidmfine with me too15:17
weshay|ruckok.. most of you are very experienced.. so I'm not concerned :)15:17
weshay|ruckjust wanted to check in15:17
weshay|ruckthanks all15:17
rlandyweshay|ruck: k - to sync15:18
weshay|ruckrlandy, did the build-push container jobs get fixed up to build local and push to $reg ok?15:19
weshay|ruckI see 16.2 working15:19
rlandyweshay|ruck: I reverted all those patches15:19
weshay|ruckok... and we're still working it?15:19
rlandyweshay|ruck: sec - I was not on the interview call on monday15:20
rlandychceking sections15:20
rlandyweshay|ruck: but we definitely need to touch base about 8.415:20
rlandywe are behind schedule on that15:20
weshay|ruckrlandy, k.. we have a 1-1 later15:21
rlandyack15:21
weshay|ruckysandeep|mtg, have you reached out to sshnaidm re: https://bugs.launchpad.net/tripleo/+bug/191592115:26
openstackLaunchpad bug 1915921 in tripleo "Stein branch check/Gate jobs are failing because of missing container images, Error - ImageNotFoundException" [Critical,Triaged]15:26
weshay|rucksorry.. not sshnaidm ... arxcruz15:27
ysandeep|mtgweshay|ruck, we have a new hash, we are trying to get a green run on that to get a promotion with new hash.15:27
weshay|ruckk..15:28
ysandeep|mtgweshay|ruck, but we hit another issue.. https://bugs.launchpad.net/tripleo/+bug/1915932 just opened before we jumped on interview15:28
openstackLaunchpad bug 1915932 in tripleo "Centos7 Stein Jobs failed with error - sudo: pip3: command not found" [Critical,Triaged]15:28
weshay|ruckFYI.. I think sshnaidm found that vexxhost upstream jobs were still failing at a higher clip.. the symptom is containers getting pulled from the content provider I beleive15:28
weshay|ruckysandeep|mtg, aye..15:29
sshnaidmakahat, hi, are you currently working on https://bugs.launchpad.net/tripleo/+bug/1914265 ?15:42
openstackLaunchpad bug 1914265 in tripleo "CI: Content provider jobs should have dstat statistics" [High,Triaged] - Assigned to Amol Kahat (amolkahat)15:42
ysandeep|mtgarxcruz, fyi.. https://bugs.launchpad.net/tripleo/+bug/1915932 is affecting other c7 branches as well15:44
openstackLaunchpad bug 1915932 in tripleo "Centos7 Jobs failed with error - sudo: pip3: command not found" [Critical,Triaged]15:44
*** ysandeep|mtg is now known as ysandeep|ruck15:44
weshay|ruckysandeep|ruck, arxcruz you two need any help?15:44
weshay|ruckarxcruz, nic?15:44
ysandeep|ruckweshay|ruck, all good, except c7 branches which are failing with https://bugs.launchpad.net/tripleo/+bug/1915932 .. poking if i can fix this quickly before i leave for the day.15:46
openstackLaunchpad bug 1915932 in tripleo "Centos7 Jobs failed with error - sudo: pip3: command not found" [Critical,Triaged]15:46
weshay|ruckysandeep|ruck, thank you sir15:47
weshay|ruckakahat, hey.. /me looking at https://review.rdoproject.org/r/#/c/32007/15:51
weshay|ruckakahat, which job can I see the test promotion? tripleo-ci-promotion-staging-single-pipeline-centos-8SUCCESS in 6m 20s15:51
weshay|rucktripleo-ci-promotion-staging-integration-pipeline-centos-815:51
weshay|ruckboth of thoese jobs have no logs15:51
mariosweshay|ruck: check https://review.opendev.org/q/topic:tripleo-ci-reduce when you have time updated some of your patches there today15:52
mariosweshay|ruck: added comments in each case on the reviews explaining15:52
weshay|ruck++15:52
weshay|ruckbhagyashris, akahat need help reviewing https://review.rdoproject.org/r/#/c/32007/15:53
weshay|rucke.g. https://logserver.rdoproject.org/07/32007/1/check/tripleo-ci-promotion-staging-single-pipeline-centos-8/316eb14/logs/15:53
weshay|ruckis empty15:53
*** saneax has joined #oooq15:54
weshay|ruckmarios, see your +1 on https://review.rdoproject.org/r/#/c/31659/16:06
weshay|ruckaren't we supposed to see stage promotions in tripleo-ci-promotion-staging-integration-pipeline-centos-816:07
weshay|ruckand tripleo-ci-promotion-staging-single-pipeline-centos-816:07
weshay|ruckor am I misremembering how these test jobs work16:07
mariosweshay|ruck: o/ what's the question?16:08
weshay|ruckoh.. maybe it's all in the console16:08
mariosweshay|ruck: if those jobs do stage promotions? yes16:08
*** ysandeep|ruck is now known as ysandeep|dinner16:08
weshay|ruckthe logs/ dir is empty16:08
mariosweshay|ruck: ack maybe something wrong there then the patch is about the logfile16:09
weshay|ruckya.. sorry I see it now in the console16:09
weshay|rucksorry to bother you16:09
*** jpodivin has quit IRC16:10
mariosweshay|ruck: hmmm maybe not to do with that patch but wider issue i see same there too https://logserver.rdoproject.org/07/32007/1/check/tripleo-ci-promotion-staging-single-pipeline-centos-8/316eb14/logs/16:10
weshay|ruckrlandy, you will probably be interested in https://review.rdoproject.org/r/#/c/32007/16:14
rlandyweshay|ruck: can you join https://meet.google.com/xpe-qffw-xda?authuser=0 - discussing release file and stream16:20
rlandyquestion on your ask for centos node and stream repo16:21
*** udesale__ has quit IRC16:21
sshnaidmchandankumar, fixed issues in https://bugzilla.redhat.com/show_bug.cgi?id=192769716:34
openstackbugzilla.redhat.com bug 1927697 in Package Review "Review Request: ansible-collection-containers-podman - Ansible collection for Podman containers" [Medium,Assigned] - Assigned to panemade16:34
sshnaidmchandankumar, if you can ping Parag, would be great16:34
chandankumarsshnaidm: sure16:38
chandankumarsshnaidm: regarding other package review any help you need there for getting sponsered as a packager16:42
*** slaweq has quit IRC16:53
*** jmasud has joined #oooq16:53
weshay|rucksshnaidm++16:59
*** jpena is now known as jpena|brb17:14
akahatsshnaidm, hi.. regarding https://bugs.launchpad.net/tripleo/+bug/191426 dstat statistics already there in content provider https://82db9fd1692ee7ba0ff3-1265f2e9e3a0fcf75a00d1718ae30bb8.ssl.cf5.rackcdn.com/774117/1/check/tripleo-ci-centos-8-content-provider/f4da7b7/logs/undercloud/var/log/extra/dstat.html17:15
openstackLaunchpad bug 191426 in evolution (Ubuntu) "Firefox corrupts URLs in Netflix emails" [Low,Fix released] - Assigned to Ubuntu Desktop Bugs (desktop-bugs)17:15
akahatright LP: https://bugs.launchpad.net/tripleo/+bug/191426517:16
openstackLaunchpad bug 1914265 in tripleo "CI: Content provider jobs should have dstat statistics" [High,Triaged] - Assigned to Amol Kahat (amolkahat)17:16
akahatdo you want some improvements there?17:16
*** dtantsur is now known as dtantsur|afk17:17
*** amoralej is now known as amoralej|off17:17
akahatweshay|ruck, https://logserver.rdoproject.org/07/32007/1/check/mol-container_push/17682bf/job-output.txt check here.. search for "Generate list of container push" it redirect all the logs of container inspect in the file17:21
akahatthis is old log: https://logserver.rdoproject.org/periodic/review.rdoproject.org/rdo-infra/ci-config/master/mol-container_push/4e540b5/job-output.txt17:21
sshnaidmakahat, yeah, I commented now in the bug17:22
* akahat looking17:22
sshnaidmit's great we have a log, just need a few improvements there17:22
weshay|ruckakahat, aye.. finally got it .. sorry it's been a while17:23
weshay|ruckakahat, hey .. so on that patch I -1..17:24
weshay|ruckthe if statement isn't doing anything17:24
weshay|ruckthat's what needs to be fixed17:24
mariosweshay|ruck: fyi got it working OK http://lists.openstack.org/pipermail/openstack-discuss/2021-February/020541.html17:25
weshay|ruck:)17:25
weshay|ruckmarios, launchpad token sucks right?17:26
akahatweshay|ruck, okay.. i'll fix that.17:26
mariosweshay|ruck: mainly the api i had to dig for examples17:26
weshay|ruckya.. the lp api doc also sucks17:26
weshay|ruckand the data format..17:26
weshay|ruckwhy can't they just use dicts17:26
weshay|ruckfkrs17:26
sshnaidm"this is a test hello from python"? :)17:26
mariosweshay|ruck: got the comment update code from there for example http://bazaar.launchpad.net/~lazr-developers/launchpadlib/trunk/annotate/head%3A/contrib/close_bugs_from_commits.py17:26
mariosweshay|ruck: but thank you for https://review.opendev.org/c/openstack/tripleo-ci/+/776232 i would NOT want to start without that from scratch!17:27
marios!17:27
mariossshnaidm: :) yeah17:29
mariossshnaidm: i was in pdb.set_trace() and trying it17:29
*** ysandeep|dinner is now known as ysandeep|ruck17:29
mariossshnaidm: the final released version was like that https://bugs.launchpad.net/tripleo/+bug/1768596/comments/3 ;)17:30
openstackLaunchpad bug 1768596 in tripleo "Deploy_plan workflow should skip create_swift_rings_backup_plan task unless swift service is deployed" [High,Incomplete]17:30
sshnaidmmarios, ok, it encouraged me to go and close all my stale bugs :)17:30
mariossshnaidm: ;)17:30
*** marios is now known as marios|out17:35
*** jpena|brb is now known as jpena17:36
*** jmasud has quit IRC17:39
*** ysandeep|ruck is now known as ysandeep|away18:10
*** derekh has quit IRC18:11
*** jpena is now known as jpena|off18:12
*** jmasud has joined #oooq18:17
*** slaweq has joined #oooq18:23
*** marios|out has quit IRC18:48
soniya29weshay|ruck, i am okay with either way19:07
*** slaweq has quit IRC19:20
*** jmasud has quit IRC19:31
*** jmasud has joined #oooq19:37
*** jmasud has quit IRC20:35
*** slaweq has joined #oooq20:46
*** jmasud has joined #oooq20:53
*** jmasud has quit IRC21:10
*** jmasud has joined #oooq21:14
*** jmasud has quit IRC21:40
*** jmasud has joined #oooq21:55
*** slaweq has quit IRC22:02
*** jmasud has quit IRC22:38
*** jmasud has joined #oooq23:04
*** rlandy is now known as rlandy|bbl23:11

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!