| *** jmasud has quit IRC | 00:01 | |
| *** jmasud has joined #oooq | 00:06 | |
| *** jmasud has quit IRC | 00:07 | |
| *** jmasud has joined #oooq | 00:18 | |
| *** matbu has quit IRC | 00:19 | |
| *** matbu has joined #oooq | 00:19 | |
| *** jmasud has quit IRC | 00:27 | |
| *** jmasud has joined #oooq | 00:30 | |
| *** jmasud has quit IRC | 01:26 | |
| *** jmasud has joined #oooq | 01:27 | |
| *** jmasud has quit IRC | 01:41 | |
| *** jmasud has joined #oooq | 01:46 | |
| *** jmasud has quit IRC | 02:02 | |
| *** jmasud has joined #oooq | 02:13 | |
| *** jmasud has quit IRC | 02:16 | |
| *** Goneri has quit IRC | 02:31 | |
| *** udesale has joined #oooq | 03:29 | |
| *** jmasud has joined #oooq | 04:06 | |
| *** ykarel|away has joined #oooq | 05:01 | |
| *** ykarel|away is now known as ykarel | 05:02 | |
| *** ratailor has joined #oooq | 06:04 | |
| *** ysandeep|away is now known as ysandeep|ruck | 06:53 | |
| ysandeep|ruck | Hey folks, Anyone recall what this error in ovb was about "Quota exceeded, too many key pairs." , Was it a infra problem? I recall some chatter about this error on channel in the past but i am unable to find older bug. | 06:54 |
|---|---|---|
| ysandeep|ruck | hitting this on fs039 https://logserver.rdoproject.org/openstack-component-security/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-security-train/ea938c1/job-output.txt | 06:54 |
| bhagyashris | ysandeep|ruck, yes | 06:55 |
| bhagyashris | will need to delete the keypair manually | 06:56 |
| bhagyashris | from promoter sever | 06:56 |
| ysandeep|ruck | bhagyashris, thanks but what's the relation b/w promoter server and this job. | 06:57 |
| bhagyashris | ysandeep|ruck, not sure but i if we check openstack keypair list on promoter server then we see the list of keypairs there | 07:08 |
| bhagyashris | ysandeep|ruck, arxcruz submitted patch to delete those let me check if i found that | 07:09 |
| *** Tengu has joined #oooq | 07:09 | |
| ysandeep|ruck | bhagyashris, thanks! :) | 07:10 |
| ysandeep|ruck | bhagyashris, https://review.rdoproject.org/r/#/c/29167/ this one ? | 07:11 |
| bhagyashris | ysandeep|ruck, yes correct this one | 07:11 |
| *** Tengu has quit IRC | 07:12 | |
| ysandeep|ruck | bhagyashris: thank you, they added that cleanup script in cron job.. we need to see what happened with that cron job - if its running currently or not.. I don't have access to promoter, will check with weshay|ruck once he is in. | 07:14 |
| bhagyashris | ysandeep|ruck, sure | 07:15 |
| *** Tengu has joined #oooq | 07:22 | |
| ykarel | ysandeep|ruck, can u try moving keypair delete post stack delete https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/ovb-manage/tasks/ovb-delete-stack.yml#L103-L107 | 07:29 |
| ykarel | likely due to that only keypairs are not cleaned up for tls job | 07:29 |
| ysandeep|ruck | ykarel: ack thanks for pointer | 07:30 |
| *** jmasud has quit IRC | 07:44 | |
| ykarel | ysandeep|ruck, i might be wrong in ^, so to confirm need to find a job log for which keys were not deleted | 07:45 |
| ykarel | and why the extra cleanup script is not working, that should also do the cleanup | 07:45 |
| ysandeep|ruck | ykarel, bhagyashris and me just check.. that script was not in cron | 07:46 |
| ykarel | ideally those should be deleted in job itself, cleanup script mainly needed for cases where it's missed in job | 07:46 |
| ysandeep|ruck | ykarel, we ran that script for now manually | 07:46 |
| ykarel | ok | 07:46 |
| ysandeep|ruck | ykarel, i will check with weshay|ruck and add that script in cron | 07:47 |
| ykarel | ack | 07:47 |
| ysandeep|ruck | ideally those should be deleted in job itself, cleanup script mainly needed for cases where it's missed in job >> agree | 07:47 |
| ykarel | also would be good to find why job cleanup not working | 07:47 |
| ykarel | sagi has raised that too in that patch | 07:47 |
| ysandeep|ruck | ykarel: thanks! i will try to investigate on why job cleanup not working | 07:50 |
| *** chem has quit IRC | 07:50 | |
| *** chem has joined #oooq | 07:52 | |
| *** amoralej|off is now known as amoralej | 07:52 | |
| *** ysandeep|ruck is now known as ysandeep|lunch | 08:07 | |
| *** dtantsur|afk is now known as dtantsur | 08:42 | |
| *** jpena|off is now known as jpena | 08:57 | |
| *** derekh has joined #oooq | 09:40 | |
| *** jfrancoa has joined #oooq | 09:40 | |
| *** ysandeep|lunch is now known as ysandeep|ruck | 09:45 | |
| *** dtantsur is now known as dtantsur|bbl | 11:13 | |
| *** udesale_ has joined #oooq | 11:26 | |
| *** udesale has quit IRC | 11:28 | |
| *** ysandeep|ruck is now known as ysandeep|afk | 11:30 | |
| *** rfolco has joined #oooq | 12:06 | |
| *** ysandeep|afk is now known as ysandeep | 12:25 | |
| *** ratailor has quit IRC | 12:30 | |
| chandankumar | rfolco: content provider meeting? | 12:33 |
| rfolco | chandankumar, was there and dropped, no show | 12:34 |
| rfolco | chandankumar, marios is out, do you have anything to discuss ? | 12:34 |
| chandankumar | rfolco: please have a look at this one http://lists.openstack.org/pipermail/openstack-discuss/2020-November/018526.html | 12:34 |
| chandankumar | rfolco: Can you take a look at these patches also https://review.opendev.org/#/q/topic:new-ci-job+project:%255Eopenstack/puppet.*+status:open+branch:stable/train | 12:35 |
| chandankumar | standalone is not getting triggered | 12:35 |
| *** jpena is now known as jpena|lunch | 12:36 | |
| *** ykarel has quit IRC | 12:40 | |
| *** ykarel has joined #oooq | 12:41 | |
| rfolco | chandankumar, anyone ever tried setting build_container_images: true on consumer jobs directly to remove the need of provider ones ? | 12:41 |
| rfolco | ykarel, ^ | 12:41 |
| ykarel | rfolco, before provider/consumer build_container_images: true was running in tripleo-common patches | 12:42 |
| ykarel | in standalone jobs | 12:42 |
| ykarel | also python-tripleoclient iirc | 12:42 |
| rfolco | ykarel, ok, so this applies for repos with one single consumer job ? | 12:42 |
| rfolco | ykarel, when we get 2 consumer jobs, we add provider one ? and when we get only one consumer, we switch the build var ? | 12:43 |
| ykarel | rfolco, when there is single consumer job using build_container_images: true instead of provider/consumer has it's advantage | 12:43 |
| ykarel | rfolco, yes right | 12:43 |
| rfolco | ykarel, ok, now I get your point on the patch, thanks | 12:44 |
| ykarel | in puppet projects only 1 job is running, so atleast there should get rid of provider/consumer | 12:44 |
| ykarel | it will help a lot | 12:44 |
| weshay|ruck | ykarel, ysandeep ya.. kieren asked us to do some double delete, dance w/ the stuck instances.. in rdo | 12:44 |
| ykarel | and save CI resoures | 12:44 |
| weshay|ruck | haven't gotten to it yet | 12:45 |
| weshay|ruck | 1) find failed resource (in this case a VM) | 12:45 |
| weshay|ruck | 2) reset state to active | 12:45 |
| weshay|ruck | 3) re-run stack delete 2+ times | 12:45 |
| weshay|ruck | 4) stack deleted successfully | 12:45 |
| weshay|ruck | so that process needs to be added to the clean up scripts | 12:45 |
| ykarel | weshay|ruck, ack, so stack are stuck in deleting? | 12:46 |
| weshay|ruck | what ever | 12:46 |
| *** ysandeep is now known as ysandeep|ruck | 12:48 | |
| ysandeep|ruck | weshay|ruck, my laptop died in between your pings - Do we need this script in cron https://review.rdoproject.org/r/#/c/29167/ ? | 12:50 |
| ysandeep|ruck | today we manually ran the cleanup-keys.sh | 12:51 |
| weshay|ruck | ysandeep|ruck, ya.. doesn't matter if it runs via cron or if you do it manually | 12:53 |
| weshay|ruck | shit's stuck | 12:53 |
| rfolco | ykarel, like this ? https://review.opendev.org/#/c/760420/ | 12:55 |
| ysandeep|ruck | ack, we need to socialize this for future ruck/rover till this happens. | 12:55 |
| ykarel | rfolco, https://review.opendev.org/#/c/760420/2/.zuul.yaml | 12:56 |
| *** pojadhav is now known as pojadhav|afk | 13:05 | |
| ysandeep|ruck | weshay|ruck, Are we okay to drop https://bugs.launchpad.net/tripleo/+bug/1902846 from cix escalation, as patches to pin ubi8 is merged? | 13:06 |
| openstack | Launchpad bug 1902846 in tripleo "Container build job: periodic-tripleo-ci-build-containers-ubi-8-push is failing with dependencies issues cannot install crypto-policies/cyrus-sasl-lib and cyrus-sasl-lib" [Critical,In progress] - Assigned to yatin (yatinkarel) | 13:06 |
| *** tosky has joined #oooq | 13:07 | |
| weshay|ruck | ysandeep|ruck, have you debugged any of the network components on 16.2? | 13:08 |
| *** rh-jelabarre has joined #oooq | 13:09 | |
| weshay|ruck | ysandeep|ruck, looks like the force promotion on a few did not work | 13:10 |
| * weshay|ruck tries again | 13:10 | |
| weshay|ruck | - Status code: 404 for http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/component/cloudops/d7/7a/d77ad494ba5a2d75fa2e2b00a8a34c4df9f07fc2_26d16a3d_1708fba6/repodata/repomd.xml (IP: 10.0.76.79) | 13:10 |
| weshay|ruck | 2020-11-05 08:13:47.416299 | primary | 2020-11-05 08:13:47 | Error: Failed to download metadata for repo 'delorean-component-cloudops': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried | 13:10 |
| ysandeep|ruck | weshay|ruck, no, i didn't get a chain to work on downstream this week | 13:11 |
| ysandeep|ruck | weshay|ruck, i have some b.w now.. looking at 16.2 | 13:11 |
| weshay|ruck | https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?pipeline=openstack-component-network%20 | 13:12 |
| weshay|ruck | ysandeep|ruck, looks like they broke dlrn again | 13:13 |
| weshay|ruck | oh wait.. .. sorry.. seeing 17 and 16.2 | 13:13 |
| weshay|ruck | ya.. let me try to push those again | 13:13 |
| *** rh-jelabarre has quit IRC | 13:13 | |
| *** rh-jelabarre has joined #oooq | 13:14 | |
| weshay|ruck | ysandeep|ruck, ykarel we need something to merge in train cloudops | 13:15 |
| weshay|ruck | to rev current/consistent | 13:15 |
| weshay|ruck | http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/component/cloudops/ | 13:15 |
| weshay|ruck | ysandeep|ruck, want to go put up a doc change or something in one of those repos? | 13:16 |
| weshay|ruck | to fix | 13:17 |
| weshay|ruck | Status code: 404 for http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/component/cloudops/d7/7a/d77ad494ba5a2d75fa2e2b00a8a34c4df9f07fc2_26d16a3d_1708fba6/repodata/repomd.xml (IP: 10.0.76.79) | 13:17 |
| ysandeep|ruck | weshay|ruck, trying to understand what's going there.. | 13:17 |
| weshay|ruck | ysandeep|ruck, they rebuilt the packages internaly.. it broke dlrn | 13:17 |
| ysandeep|ruck | weshay|ruck, yesterday baremetal component failed with ^^ error , but not today | 13:17 |
| weshay|ruck | we need a new hash at the very top | 13:18 |
| ysandeep|ruck | and network components run is pending for today | 13:18 |
| *** TrevorV has joined #oooq | 13:19 | |
| ysandeep|ruck | weshay|ruck, want to chat for few mins meet.google.com/sxt-iewa-bnb | 13:20 |
| weshay|ruck | ysandeep|ruck, ah.. maybe it will work | 13:21 |
| weshay|ruck | http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/component-ci-testing/delorean.repo | 13:21 |
| weshay|ruck | [delorean-component-cloudops] | 13:21 |
| weshay|ruck | name=delorean-openstack-ceilometer-d77ad494ba5a2d75fa2e2b00a8a34c4df9f07fc2 | 13:21 |
| weshay|ruck | baseurl=http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/component/cloudops/d7/7a/d77ad494ba5a2d75fa2e2b00a8a34c4df9f07fc2_26d16a3d_0166213b | 13:21 |
| weshay|ruck | enabled=1 | 13:21 |
| weshay|ruck | gpgcheck=0 | 13:21 |
| weshay|ruck | priority=1 | 13:21 |
| weshay|ruck | http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/component/cloudops/d7/7a/d77ad494ba5a2d75fa2e2b00a8a34c4df9f07fc2_26d16a3d_0166213b | 13:21 |
| weshay|ruck | is not a 404 | 13:21 |
| weshay|ruck | ysandeep|ruck, ya.. need a hand off before you go | 13:21 |
| ysandeep|ruck | ack i am on meet.google.com/sxt-iewa-bnb whenever you are free | 13:23 |
| *** jpena|lunch is now known as jpena | 13:32 | |
| ysandeep|ruck | dropping, let me know when you are free | 13:33 |
| ysandeep|ruck | network component triggered.. we will know in few mins | 13:45 |
| *** ysandeep|ruck is now known as ysandeep|brb | 13:53 | |
| zbr | any one willing to experiment with er container? currently running from my hw at https://er.sbarnea.com | 14:12 |
| weshay|ruck | zbr, how can we add queries? | 14:17 |
| zbr | you rebuild it with other queries. optionally we could keep them inside the data volume. | 14:19 |
| zbr | in fact very easily we could create another repository and load queries from there, doing a git pull every 10 mins or so. | 14:20 |
| *** dtantsur|bbl is now known as dtantsur | 14:20 | |
| zbr | but in current form it includes the original queries. | 14:20 |
| zbr | weshay|ruck: give a custom one you want to include it in the POC change. | 14:25 |
| weshay|ruck | zbr, let's start w/ container build errors | 14:25 |
| weshay|ruck | talking to chandan atm. .will be slow to respond | 14:26 |
| zbr | post the query here and I will do it, sure. | 14:26 |
| weshay|ruck | zbr, should see a git repo w/ queries associated though | 14:26 |
| *** amoralej is now known as amoralej|lunch | 14:29 | |
| weshay|ruck | frenzy_friday, https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/centosci/train-current-tripleo.yml is the train version you want | 14:41 |
| weshay|ruck | frenzy_friday, ykarel https://review.opendev.org/#/c/761750/ | 14:41 |
| weshay|ruck | ykarel, can you double check my math there | 14:42 |
| weshay|ruck | zbr, shall we chat? | 14:42 |
| ykarel | weshay|ruck, ack looking | 14:42 |
| zbr | joining | 14:43 |
| *** Goneri has joined #oooq | 14:46 | |
| weshay|ruck | ysandeep|brb, ok.. so 16.2 network component is passing deployment on fs010.. so that bodes well | 14:54 |
| weshay|ruck | ysandeep|brb, probably will be fine | 14:54 |
| *** ysandeep|brb is now known as ysandeep|ruck | 15:00 | |
| *** amoralej|lunch is now known as amoralej | 15:00 | |
| *** jmasud has joined #oooq | 15:02 | |
| ysandeep|ruck | weshay|ruck, looks good now | 15:03 |
| ysandeep|ruck | i will keep an eye on monday | 15:04 |
| *** ysandeep|ruck is now known as ysandeep|away | 15:15 | |
| *** jbadiapa has quit IRC | 15:16 | |
| ysandeep|away | weshay|ruck, I am out now, not much to hand off, from my side just see if we can merge https://review.opendev.org/#/c/760994/ soon (currently in queue) | 15:18 |
| ysandeep|away | Happy weekend :) | 15:18 |
| weshay|ruck | k.. thanks man | 15:20 |
| *** dsneddon has quit IRC | 16:01 | |
| *** sshnaidm_ has joined #oooq | 16:12 | |
| *** sshnaidm|afk has quit IRC | 16:13 | |
| *** sshnaidm_ is now known as sshnaidm|afk | 16:21 | |
| *** udesale_ has quit IRC | 16:25 | |
| *** amoralej is now known as amoralej|off | 16:41 | |
| *** jmasud has quit IRC | 17:00 | |
| *** ykarel has quit IRC | 17:05 | |
| *** ykarel_ has joined #oooq | 17:05 | |
| *** dtantsur is now known as dtantsur|afk | 17:13 | |
| *** ykarel_ has quit IRC | 17:19 | |
| *** jmasud has joined #oooq | 17:34 | |
| *** derekh has quit IRC | 17:38 | |
| *** jmasud has quit IRC | 18:00 | |
| *** jpena is now known as jpena|off | 18:02 | |
| weshay|ruck | is there anybody out there | 18:10 |
| weshay|ruck | can anybody hear me | 18:10 |
| weshay|ruck | ahhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh | 18:10 |
| weshay|ruck | hello hello hello | 18:10 |
| weshay|ruck | TEACHERS! | 18:10 |
| *** Tengu has quit IRC | 18:22 | |
| *** Tengu has joined #oooq | 18:22 | |
| rfolco | o/ weshay|ruck | 19:19 |
| rfolco | just focused on something here, did not mean to ignore your ping | 19:20 |
| rfolco | whats up? | 19:20 |
| weshay|ruck | rfolco, not pinging you :) | 20:09 |
| weshay|ruck | just talking to myself | 20:09 |
| weshay|ruck | singing in fact | 20:09 |
| weshay|ruck | I do that sometimes when it's empty here | 20:09 |
| rfolco | weshay|ruck, I must have get used to this by this stage | 20:09 |
| weshay|ruck | lolz | 20:09 |
| rfolco | :) | 20:09 |
| rfolco | why can't trump go to white house anymore? ??? Because it's for biden. | 20:12 |
| weshay|ruck | rfolco, stick to programming man :) | 20:24 |
| weshay|ruck | lolz | 20:24 |
| weshay|ruck | if that's like a knock knock joke | 20:24 |
| weshay|ruck | lolz | 20:24 |
| weshay|ruck | YOU CAN DO BETTER | 20:24 |
| rfolco | :'-( | 20:33 |
| *** dsneddon has joined #oooq | 20:39 | |
| *** dsneddon has quit IRC | 20:44 | |
| *** jfrancoa has quit IRC | 20:58 | |
| *** jmasud has joined #oooq | 21:08 | |
| *** jmasud has quit IRC | 21:44 | |
| *** rfolco has quit IRC | 22:14 | |
| *** rh-jelabarre has quit IRC | 22:21 | |
| *** jmasud has joined #oooq | 22:25 | |
| *** jmasud has quit IRC | 22:34 | |
| *** jmasud has joined #oooq | 23:07 | |
| *** jmasud has quit IRC | 23:10 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!