| *** yadnesh|away is now known as yadnesh | 04:36 | |
| *** ysandeep is now known as ysandeep|ruck | 04:48 | |
| ysandeep|ruck | morning folks o/ | 04:48 |
|---|---|---|
| *** pojadhav- is now known as pojadhav | 04:56 | |
| akahat | o/ | 06:01 |
| akahat | hello team, review request, please review: https://review.rdoproject.org/r/c/rdo-jobs/+/46183 Thanks! | 06:01 |
| pojadhav | hello folks, is https://code.engineering.redhat.com/gerrit/ down ?? I am facing issues from yesterday | 06:04 |
| ysandeep|ruck | akahat, ack | 06:05 |
| ysandeep|ruck | pojadhav, checking | 06:05 |
| akahat | pojadhav, It's working for me. | 06:05 |
| ysandeep|ruck | slight slow but works for me | 06:06 |
| pojadhav | ysandeep|ruck, yeah yesterday it was too slow for me.. let me try again | 06:06 |
| pojadhav | finally working but its slow.. | 06:08 |
| pojadhav | akahat, ysandeep|ruck : thanks for confirming :) | 06:08 |
| jm1 | o/ | 07:35 |
| *** anbanerj is now known as frenzy_friday | 07:38 | |
| ysandeep|ruck | jm1, o/ | 07:50 |
| *** ysandeep|ruck is now known as ysandeep|ruck|lunch | 07:50 | |
| marios | akahat: o/ sent invite for call at usual time please check inbox | 08:02 |
| akahat | marios, Thanks! accepted. | 08:03 |
| akahat | marios, please review when you are free, thanks! https://review.rdoproject.org/r/c/rdo-jobs/+/46183 | 08:03 |
| *** ysandeep|ruck|lunch is now known as ysandeep|ruck | 08:09 | |
| marios | akahat: ack | 08:10 |
| Tengu | hello there! | 08:24 |
| Tengu | chandankumar, marios: I have a small thought/question: what would you think of pre-building molecule images and register them in some registry so that we can, for selected jobs, use them and hopefully get a faster molecule testing? | 08:24 |
| Tengu | here, I'm mostly thinking about collectd molecule: they install a fair amount of packages in the "prepare", and it takes a really huge amount of time just for that. | 08:25 |
| Tengu | what would be the work to get something like a pre-built ubi9/tripleo-collectd image, allowing then the molecule to just update it? | 08:26 |
| Tengu | also, is it something acceptable alltogether? | 08:26 |
| *** jpena|off is now known as jpena | 08:26 | |
| Tengu | (erf, brb, have to help my wife moving some furnitures) | 08:27 |
| marios | Tengu: like current-tripleo for molecule images? | 08:28 |
| marios | Tengu: we'd need a pipeline for that in the same way we qualify everything else - something something to work out updating the bit under test. do able sure? | 08:30 |
| marios | Tengu: by who and when tbd ;) | 08:31 |
| chandankumar | Tengu: seems to be a good idea, we need to maintain a custom dockerfile with in tripleo-ansible collectd molecule to build all the packages. | 08:33 |
| chandankumar | We need someone to watch it | 08:33 |
| chandankumar | but we also need to see how much time we are actually saving from downloading the new image from registry | 08:34 |
| *** yadnesh is now known as yadnesh|afk | 08:38 | |
| Tengu | (back - for a while) | 08:38 |
| Tengu | marios: might be CloudOps (with some help to bootstrap)? I'm just throwing an idea against the wall and see if it sticks or not :D | 08:39 |
| Tengu | chandankumar: yeah - comes from a discussion I got with Chris over the night. | 08:39 |
| ysandeep|ruck | marios, chandankumar review request when time permits: https://review.rdoproject.org/r/c/config/+/46197 for promotion blocker: https://bugs.launchpad.net/tripleo/+bug/1997670 , Need your reviews as changes are in config repo | 08:45 |
| reviewbot | Do you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks. | 08:45 |
| chandankumar | ysandeep|ruck: commented back | 08:45 |
| ysandeep|ruck | reviewbot, yes please add to review list: https://review.rdoproject.org/r/c/config/+/46197 | 08:46 |
| reviewbot | I have added your review to the Review list | 08:46 |
| chandankumar | Tengu: sounds good then, we can rebuild the image via periodic job and tag it like current-tripleo as marios's suggested | 08:48 |
| ysandeep|ruck | chandankumar, thanks looks like takashi already proposed a new patch while you are reviewing | 08:48 |
| ysandeep|ruck | patchset* | 08:49 |
| Tengu | chandankumar: yeah, that sounds like a good thing. I'll check with Chris if this may be something that can interest CloudOps, and make hime check with you (CI team) as to "how", "where" and the like. | 08:49 |
| Tengu | chandankumar: if if it works fine, we may want to roam in tripleo-ansible molecule tests and see what jobs install packages, and analyze the amount, time and so on. | 08:50 |
| Tengu | in collectd case, using a pre-built image *will* make things faster, I'm pretty sure of that. | 08:50 |
| chandankumar | Tengu: sounds like a plan :-) | 08:53 |
| Tengu | perfect. | 08:53 |
| Tengu | so, I'll make a mail. That's better. | 08:54 |
| marios | ysandeep|ruck: will check in a bit after call sorry missed it earlier | 08:58 |
| chandankumar | ysandeep|ruck: added a small suggestion https://review.rdoproject.org/r/c/config/+/46197/2#message-e916f7084222f7e6cc226c4780628b2b987d0946 | 08:58 |
| ysandeep|ruck | marios, chandankumar thanks! | 09:00 |
| *** yadnesh|afk is now known as yadnesh | 09:03 | |
| ysandeep|ruck | chandankumar, https://paste.openstack.org/show/b4Vn26eTdhsFRMTQToG1/ | 09:07 |
| ysandeep|ruck | omit is adding additional unneccesary prefix, see ^^ | 09:07 |
| ysandeep|ruck | vs https://paste.openstack.org/show/bf6q8t2HKUZoEA2BrlpK/ | 09:07 |
| chandankumar | ysandeep|ruck: sorry my bad, thank you for testing it. | 09:10 |
| ysandeep|ruck | let me run some container build jobs to make sure we didn't hosed anything. | 09:12 |
| ysandeep|ruck | chandankumar++ np, thanks for reviewing it | 09:12 |
| marios | chandankumar: do you have 5 minutes please to join me and akahat ? | 09:12 |
| chandankumar | marios: yes sure | 09:13 |
| marios | chandankumar: https://meet.google.com/zwb-dbng-hdj | 09:13 |
| marios | chandankumar: thanks | 09:13 |
| chandankumar | marios: akahat hello | 09:24 |
| chandankumar | marios: akahat based on this https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleoci.yaml#L166 and | 09:25 |
| chandankumar | https://logserver.rdoproject.org/openstack-periodic-integration-stable1-cs8/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-centos-8-quay-push-wallaby/67dac6c/logs/container-builds/4ed9c9de-4dbc-4d9d-919b-8d1227859ffc/base/Dockerfile | 09:25 |
| chandankumar | FROM ubi8:8.2 | 09:25 |
| chandankumar | in centos-8 based container build jobs are building containers from ubi8 itself | 09:25 |
| chandankumar | we are not using centos8 image in these jobs | 09:25 |
| *** amoralej|off is now known as amoralej | 09:26 | |
| chandankumar | we have added centos-8 in the job names and moved the container base to ubi8 but never bothered to change the name i think | 09:27 |
| chandankumar | may be we can remove the cs8 based job and keep quay one there | 09:28 |
| marios | chandankumar: we're going to keep the centos-8 jobs for now and focus on removing the ones that push to trunk.registry | 09:30 |
| marios | chandankumar: akahat: can change the name after this | 09:30 |
| marios | chandankumar: good to know its just the name | 09:30 |
| marios | chandankumar: thanks for checking | 09:30 |
| *** ysandeep|ruck is now known as ysandeep|afk | 10:13 | |
| akahat | marios, chandankumar ysandeep please review when free, thanks! https://review.rdoproject.org/r/c/rdo-jobs/+/46183 | 11:12 |
| marios | k will do | 11:14 |
| *** ysandeep|afk is now known as ysandeep|ruck | 11:21 | |
| *** yadnesh is now known as yadnesh|afk | 11:24 | |
| ysandeep|ruck | hey akahat o/ ack but can check tomorrow's morning once I am off ruck/rover | 11:25 |
| akahat | ysandeep|ruck, sure. np. Thanks! | 11:25 |
| *** dviroel|afk is now known as dviroel | 11:27 | |
| dviroel | o/ | 11:27 |
| ysandeep|ruck | dviroel: good morning o/ | 11:29 |
| ysandeep|ruck | chandankumar: what happened to our irc bouncer? | 11:29 |
| chandankumar | dviroel: great job on getting ovb jobs running on IBM3 node | 11:34 |
| chandankumar | dviroel: Do we want to move some cs8 wallaby line on IBM 3 to have some real testing | 11:35 |
| chandankumar | or we can go via this route also https://review.rdoproject.org/r/c/testproject/+/44388 | 11:35 |
| chandankumar | to find out how much jobs we can run | 11:36 |
| dviroel | chandankumar: hi, yeah, the next step would be that | 11:36 |
| marios | chandankumar: when you next have time please check https://review.opendev.org/c/openstack/tripleo-quickstart/+/864726 & https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46148 | 11:36 |
| marios | in your own time thanks | 11:36 |
| chandankumar | sure! | 11:37 |
| chandankumar | dviroel: ysandeep|ruck https://github.com/openshift/release/pull/34299 and https://github.com/openstack-k8s-operators/ansibleee-operator/pull/17 when free, thank you :-) | 11:40 |
| ysandeep|ruck | chandankumar: ack o/ first thing in my morning, sry sorting some ruck/rover stuff before handover. | 11:41 |
| bhagyashris | marios, hey mixed 9-8 centos job result looks good on testproject patch https://review.rdoproject.org/r/c/testproject/+/44234/13#message-2b2bb2604efa45208267bacfb930c174bcdee136 | 11:50 |
| ysandeep|ruck | reviewbot: please add to review list: https://review.opendev.org/c/openstack/tripleo-ci/+/865502 | 11:50 |
| reviewbot | I have added your review to the Review list | 11:50 |
| ysandeep|ruck | chandankumar, ^^ fyi.. fix for container build with venv, incase we want to go back to venv. | 11:51 |
| marios | bhagyashris: its from 22nd. i wanted to see latest run (from today i mean ) in the periodic line after we merged the cleanup but i think we're done there | 11:52 |
| marios | bhagyashris: have to sort out something for d/stream components & reporting still but for the jira task its done i think | 11:53 |
| marios | bhagyashris: ah... you're talking about upstream, i'm talking about downstream | 11:55 |
| marios | bhagyashris: yes we are good for upstream to merge those patches | 11:55 |
| dviroel | chandankumar: hi, we will need this https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46061 - Also, need to add cloud.yaml for ibm the instance that runs that script. Can you help me with that? | 12:00 |
| bhagyashris | marios, yes i am talking about upstream :) | 12:02 |
| *** yadnesh|afk is now known as yadnesh | 12:22 | |
| *** amoralej is now known as amoralej|lunch | 12:33 | |
| marios | bhagyashris: akahat: ysandeep|ruck: chandankumar: please check when you have some time https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/436196 | 12:40 |
| akahat | ack | 12:41 |
| dviroel | pojadhav: hi | 12:44 |
| dviroel | chandankumar: https://review.rdoproject.org/zuul/status#46207 | 12:46 |
| chandankumar | dviroel: cool, thank you :-) | 12:46 |
| bhagyashris | ack | 12:50 |
| *** rlandy|out is now known as rlandy|holiday | 12:51 | |
| pojadhav | dviroel, hello | 12:55 |
| dviroel | pojadhav: hi, i won't be able to join scrum today, need to take my dad to a dr appt | 12:56 |
| pojadhav | dviroel, ack | 12:56 |
| dviroel | pojadhav: the only update that I have is regarding IBM 3 cloud, which now is under stress test. OVB jobs are passing now there. | 12:57 |
| pojadhav | dviroel, okay.. thanks for update ! | 12:57 |
| pojadhav | dviroel, hope your dad feel better soon :) | 12:57 |
| dviroel | pojadhav: thanks :) | 12:58 |
| dviroel | @team, we have Brazil x Serbia today, wish us lucky | 13:29 |
| *** amoralej|lunch is now known as amoralej | 13:43 | |
| ysandeep|ruck | marios, https://review.opendev.org/c/openstack/tripleo-ci/+/865540 | 13:44 |
| *** dviroel is now known as dviroel|dr_appt | 13:49 | |
| chandankumar | ysandeep|ruck: dviroel|dr_appt I am adding a sub task here for tracking ansiblee-operator linting jobs | 13:58 |
| chandankumar | https://issues.redhat.com/browse/OSP-20311 | 13:58 |
| ysandeep|ruck | chandankumar, ack | 13:58 |
| pojadhav | dasm|off, akahat, chandankumar, rcastillo, soniya29 : scrum time | 14:02 |
| jm1 | frenzy_friday: hello :) could you figure out what the issue was with kkula's dashboard? | 14:09 |
| jm1 | #oooq one of our fastest ci meetings :D | 14:11 |
| frenzy_friday | jm1, hey, sorry forgot about that. Lemme take a look now | 14:12 |
| jm1 | frenzy_friday: cool, thank you :) | 14:12 |
| kkula | jm1, frenzy_friday: thanks:) | 14:12 |
| jm1 | frenzy_friday, kkula: you could use our cockpit in staging env to play around. it should be very close to the production env | 14:14 |
| frenzy_friday | yep, I dont see the puppet dashboard on our dev cockpit. CHecking on the staging one | 14:15 |
| jm1 | frenzy_friday, kkula: 10.0.11.209 | 14:15 |
| kkula | jm1: yes, I did all the deployment on my own stage one and there was no such problem | 14:15 |
| frenzy_friday | hm.. the data is missing here as well: http://10.0.11.209/d/vBQivbd4z/puppet-promotion-pipelines?orgId=1 | 14:16 |
| jm1 | frenzy_friday: so 10.0.11.209 is proper clone of our prod cockpit :D | 14:16 |
| * pojadhav stepping out | 14:17 | |
| frenzy_friday | hmm the datasourse is messed up. Checking why | 14:18 |
| ysandeep|ruck | arxcruz, sry got busy with rr, looking at your collect-logs review now | 14:18 |
| arxcruz | ysandeep|ruck: <3 | 14:19 |
| arxcruz | gonna grab my daugther at school in 10 min, brb in 20 | 14:19 |
| * jm1 bbl | 14:20 | |
| ysandeep|ruck | gziped file is 1.4 M, not too big | 14:20 |
| kkula | jm1, frenzy_friday : http://10.0.78.203:8080/d/NMjoM2v4k/puppet-promotion-pipelines?orgId=1&from=now-30d&to=now its my stage env | 14:20 |
| ysandeep|ruck | arxcruz, 14M Nov 24 01:26 testrepository.subunit | 14:21 |
| frenzy_friday | kkula, thanks. Commented: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46047/5/ci-scripts/infra-setup/roles/rrcockpit/files/grafana/puppet-promotion-pipelines.dashboard.json#9 | 14:22 |
| arxcruz | ysandeep: yup, working as expected | 14:26 |
| arxcruz | unfortunatelly testrepository.subunity can't be gzipped | 14:26 |
| ysandeep|ruck | arxcruz, ack I will it have that functionality but will add another 15-20MB on log storage for each job | 14:29 |
| ysandeep|ruck | I wish* | 14:29 |
| arxcruz | ysandeep|ruck: we are working to add gzipped file in the log scrapper | 14:30 |
| arxcruz | but for now it doesn't | 14:30 |
| ysandeep|ruck | Nice, +w the patch.. good to hear that | 14:30 |
| ysandeep|ruck | arxcruz, +wed https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/859401/9#message-ad756310a134e0650bb2e9de505da5ca4b9fc494 | 14:31 |
| ysandeep|ruck | marios: +wed https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/436196 | 14:35 |
| marios | ysandeep|ruck: thx | 14:37 |
| ysandeep|ruck | chandankumar, hey o/ around want to talk about https://github.com/openshift/release/pull/34299/files | 14:37 |
| chandankumar | ysandeep|ruck: yes | 14:37 |
| ysandeep|ruck | chandankumar, meet.google.com/bxn-akvs-oic | 14:38 |
| frenzy_friday | kkula, I changed the datasource manually to telegraf and added query: SELECT "job_name", "result", "duration", "pipeline", "log_url" FROM "build" WHERE ("project" = 'rdoinfo' AND "job_name" =~ /weirdo-antelope-promote-*/) - Now I see the data on our staging server. I think if you update the json it should work | 14:40 |
| kkula | frenzy_friday: to be clear - datasource should be back to "-- Grafana --"? because I was suggested by change https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46079 | 14:43 |
| kkula | amoralej ^^ | 14:43 |
| frenzy_friday | checking | 14:44 |
| kkula | frenzy_friday see https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46047/3..5/ci-scripts/infra-setup/roles/rrcockpit/files/grafana/puppet-promotion-pipelines.dashboard.json#b9 | 14:45 |
| frenzy_friday | kkula, ah ok, the datasource change is due to https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46079! Then it is fine. We updated the grafana and telegraf versions recently - that caused some issues with the datasources. | 14:47 |
| ysandeep|ruck | chandankumar++ | 14:53 |
| ysandeep|ruck | pojadhav, frenzy_friday fyi.. closed this bug as well: https://bugs.launchpad.net/tripleo/+bug/1997670 as container build job passed in testproject. | 14:56 |
| chandankumar | ysandeep|ruck: thank you :-) | 14:56 |
| frenzy_friday | jm1 , where is the ci-config repo cloned in the staging server? Under /tmp? | 14:58 |
| *** yadnesh is now known as yadnesh|away | 15:04 | |
| ysandeep|ruck | dviroel|dr_appt, rcastillo could you please +w https://review.opendev.org/c/openstack/tripleo-ci/+/865540 and keep an eye on this later in your day once ci reports, rlandy|holiday have a public holiday today. | 15:05 |
| rlandy|holiday | ysandeep|ruck: thanks | 15:11 |
| * ysandeep|ruck out, see everyone tomorrow/next week(who are on PTO tomorrow) | 15:14 | |
| *** ysandeep|ruck is now known as ysandeep|out | 15:14 | |
| *** ykarel is now known as ykarel|away | 15:23 | |
| rcastillo | jnhmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm | 15:36 |
| jm1 | frenzy_friday: in /var/lib/ansible/local, like prod server | 15:57 |
| marios | bhagyashris: o/ can you please check the line tomorrow https://review.rdoproject.org/r/c/rdo-jobs/+/46119 merged ... sanity check like we did downstream ? | 15:59 |
| jm1 | rcastillo: ?!? :D | 15:59 |
| jm1 | rcastillo: dont let your cats touch your keyboard :D | 16:00 |
| *** marios is now known as marios|out | 16:14 | |
| *** jpena is now known as jpena|off | 17:25 | |
| *** amoralej is now known as amoralej|off | 17:51 | |
| *** dviroel|dr_appt is now known as dviroel | 18:09 | |
| dviroel | ysandeep: ack - i can take a look after it merges | 18:12 |
| * dviroel will be afk for some hours, i will be back later to check everything o/ | 18:23 | |
| *** dviroel is now known as dviroel|afk | 18:23 | |
| * jm1 out until tuesday, have a nice evening folks :) | 20:43 | |
| *** dviroel|afk is now known as dviroel | 22:16 | |
| dviroel | we won \o/ | 22:17 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!