| opendevreview | XuQi proposed openstack/cinder master: Fujitsu Driver: Add parameter fujitsu_use_cli_copy https://review.opendev.org/c/openstack/cinder/+/904967 | 03:35 |
|---|---|---|
| opendevreview | Raghavendra Tilay proposed openstack/cinder master: WIP - HPE 3par - PP - Return LUN ids from both arrays https://review.opendev.org/c/openstack/cinder/+/901588 | 07:09 |
| *** geguileo is now known as Guest13579 | 09:19 | |
| opendevreview | XuQi proposed openstack/cinder master: Fujitsu Driver: Add support for revert to snapshot https://review.opendev.org/c/openstack/cinder/+/904971 | 10:08 |
| *** chuanm9 is now known as chuanm | 10:50 | |
| opendevreview | Merged openstack/cinder-tempest-plugin master: Update stable jobs on master gate https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/885669 | 10:58 |
| wncslln | hi, morning, cinder o/ | 13:33 |
| wncslln | about https://bugs.launchpad.net/cinder/+bug/2008043 is there a way to know if qemu is really installed or not? | 13:33 |
| wncslln | considering that function raises an exception even when its present | 13:33 |
| whoami-rajat | clarkb, rosmaita i think we did debug the memory issues during PTG and in one job there were 14 qemu processes running killing mysql eventually | 13:42 |
| whoami-rajat | also based on the performance data in the gate job, cinder processes doesn't seem to be consuming too much memory | 13:42 |
| whoami-rajat | https://wiki.openstack.org/wiki/CinderCaracalPTGSummary#Gate_Issues | 13:43 |
| whoami-rajat | https://wiki.openstack.org/wiki/CinderCaracalPTGSummary#Gate_Issues_2 | 13:43 |
| rosmaita | wncslln: you may need to parse the stdout/stderr from the call; i think all the errors coming from an installed qemu-img will begin with 'qemu-img:' | 13:46 |
| wncslln | rosmaita: so a possible solution is to parse and use that infos to improve log message? | 13:55 |
| whoami-rajat | Cinder meeting in #openstack-meeting-alt at 1400 UTC | 14:00 |
| whoami-rajat | jungleboyj rosmaita smcginnis tosky whoami-rajat m5z e0ne geguileo eharney jbernard hemna fabiooliveira yuval tobias-urdin adiare happystacker dosaboy hillpd msaravan sp-bmilanov | 14:00 |
| rosmaita | wncslln: i think so | 14:00 |
| sp-bmilanov | o/ | 14:04 |
| *** Guest13579 is now known as geguileo | 14:08 | |
| opendevreview | Merged openstack/os-brick master: NVME-oF: Fix to support new "address" in sysfs https://review.opendev.org/c/openstack/os-brick/+/895194 | 14:09 |
| opendevreview | Merged openstack/os-brick master: NVMe-oF: Support nvme cli v2 https://review.opendev.org/c/openstack/os-brick/+/895195 | 14:12 |
| opendevreview | Merged openstack/cinder-specs master: Remove placeholder for 2024.1 https://review.opendev.org/c/openstack/cinder-specs/+/903127 | 14:48 |
| opendevreview | Gorka Eguileor proposed openstack/os-brick stable/2023.2: NVMe-oF: Fix generation of hostnqn file https://review.opendev.org/c/openstack/os-brick/+/905228 | 14:50 |
| opendevreview | Gorka Eguileor proposed openstack/os-brick stable/2023.2: NVMe-oF: Improve hostnqn creation https://review.opendev.org/c/openstack/os-brick/+/905229 | 14:50 |
| opendevreview | Gorka Eguileor proposed openstack/os-brick stable/2023.2: NVMe-oF: Fix attach when reconnecting https://review.opendev.org/c/openstack/os-brick/+/905230 | 14:50 |
| opendevreview | Gorka Eguileor proposed openstack/os-brick stable/2023.2: NVME-oF: Fix to support new "address" in sysfs https://review.opendev.org/c/openstack/os-brick/+/905231 | 14:50 |
| opendevreview | Gorka Eguileor proposed openstack/os-brick stable/2023.2: NVMe-oF: Support nvme cli v2 https://review.opendev.org/c/openstack/os-brick/+/905232 | 14:50 |
| sp-bmilanov | zaitcev: Hi! trying to follow up on your comment here: https://review.opendev.org/c/openstack/os-brick/+/887576 we discussed this last month ( https://etherpad.opendev.org/p/cinder-caracal-midcycles ) and the consensus is that throwing in __init__() in this context was not an issue | 15:04 |
| zaitcev | sp-bmilanov: let me take a look | 15:05 |
| sp-bmilanov | thanks | 15:09 |
| opendevreview | Brian Rosmaita proposed openstack/cinder-specs master: Reorganize specs table of contents https://review.opendev.org/c/openstack/cinder-specs/+/905239 | 15:24 |
| clarkb | whoami-rajat: ya with as many services as openstack runs it often isn't your specific service at fault. But cinder is part of a larger entity and can work within openstack to imrpove things generally too | 16:15 |
| clarkb | historically cinder backup was one of the worst services for memory consumption fwiw. I believe that did get addressed though | 16:15 |
| rosmaita | clarkb: it still uses a lot of memory, but it releases it faster | 16:16 |
| whoami-rajat | clarkb, yes, i wasn't trying to pin point the issue in other projects, was just trying to mention that we did take a look at the memory consumption issue, found few things and even discussed with the nova team about it | 16:31 |
| whoami-rajat | maybe i didn't phrase it correctly | 16:31 |
| whoami-rajat | we sure want to improve any issue that arises from the cinder services | 16:32 |
| clarkb | my main concern is that I believe io load generated by swap usage in our jobs acts as a major part of noisy neighbor problems in the clouds we have for CI resources | 16:32 |
| clarkb | my hunch is that the more rely on swap the worse our general unexplained job failures and timeouts problem becomes | 16:33 |
| hemna- | so FYI, I know this isn't our issue directly here in cinder, but this has affected my actual cinder deployment. | 20:26 |
| hemna- | https://github.com/openstack4j/openstack4j/issues/224 | 20:26 |
| hemna- | we have an internal team that has some automations using that openstack4j client library and this has caused us to have inconsistent volume attachments, because that openstack4j java client exposes a nova <---> cinder api to try to attach a volume. | 20:28 |
| hemna- | they used this, which boils down to an 'os-attach' call. That simply created an attachment record and marked the volume 'in-use' and an attachment record as attached, with actually doesn't do anything else. | 20:31 |
| hemna- | Then someone called nova to attach the volume, which used the v3 protocol for attachment, (attachment_create, etc.) | 20:31 |
| hemna- | and because of this code in cinder: https://github.com/openstack/cinder/blob/master/cinder/volume/api.py#L2407-L2414 | 20:32 |
| hemna- | we ended up with 2 active volume attachments. | 20:33 |
| hemna- | with the first (from the direct os-attach call) completely empty and bogus. | 20:33 |
| hemna- | I think the old pre-v3 api attach calls should be deprecated and eventually removed. | 20:34 |
| hemna- | volume inconsistencies are some of our biggest headaches. | 20:34 |
| hemna- | volume attachment inconsistencies that is | 20:34 |
| opendevreview | Bryan Neumann proposed openstack/cinder master: Dell EMC: PowerMax - Configurable SRDF snapshots https://review.opendev.org/c/openstack/cinder/+/899051 | 22:33 |
| *** jph4 is now known as jph | 23:48 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!