| dansmith | tempest fix merged so nova patches can be rechecked now | 00:44 |
|---|---|---|
| opendevreview | Takashi Kajinami proposed openstack/nova master: Fix missing oslo.versionedobjects library option https://review.opendev.org/c/openstack/nova/+/890718 | 06:07 |
| frickler | so this says that the workaround is to be removed when the followup blueprint is completed. the latter has happened, but the removal seems to have been missed? https://opendev.org/openstack/nova/commit/267a40663cd8d0b94bbc5ebda4ece55a45753b64#diff-efaf3dbc9a92a63307e9ffdc70a6c3ebbbd4bb7d | 07:23 |
| dvo-plv | Hello, maybe you will have a time to make new review for our patch https://review.opendev.org/c/openstack/nova/+/876075 | 10:14 |
| opendevreview | sean mooney proposed openstack/nova master: use disk caching to hide slow cinder performance https://review.opendev.org/c/openstack/nova/+/889383 | 15:52 |
| opendevreview | sean mooney proposed openstack/nova master: use disk caching to hide slow cinder performance https://review.opendev.org/c/openstack/nova/+/889383 | 15:53 |
| sean-k-mooney | dansmith: just an fyi ^ now has a depend on against my zram change so we can see if zram + sysctl tuning + ksm + qemu disk caching will actully spead things up | 15:55 |
| dansmith | sean-k-mooney: so my concern with that is that it will increase memory pressure | 16:04 |
| sean-k-mooney | the disk caching in qemu | 16:05 |
| sean-k-mooney | it may yes we could also use cache mode node instead of writeback to explcitly disabel the page cache | 16:06 |
| sean-k-mooney | the way i have it configred it only cached block devs so cinder voluems but perhaps the caching is not needed with the vfat change | 16:07 |
| dansmith | yeah | 16:07 |
| sean-k-mooney | has that merged by the way | 16:08 |
| dansmith | yes | 16:08 |
| sean-k-mooney | cool hopefully that test will fail less | 16:08 |
| sean-k-mooney | dansmith: the zswap change is within the noise of the ci varaiance but its either neutral or slightly better. | 18:13 |
| dansmith | ack | 18:14 |
| sean-k-mooney | the same seams to be true for addign caching that is about to finish | 18:14 |
| sean-k-mooney | i dont really see any indeication fo increase memory pressure | 18:14 |
| dansmith | the variance is much larger these days than it used to be so I don't think we can really know without enabling it on a job or two and monitor it longer term | 18:14 |
| sean-k-mooney | ya | 18:14 |
| sean-k-mooney | most of the jobs i looked at didnt seam to be swappign that hard and then ones that were actully seamed to have more overall free memory then i expected | 18:16 |
| dansmith | the ceph job is usually pretty deep into swap, although not enough to cause problems | 18:16 |
| dansmith | it rarely ooms lately | 18:16 |
| sean-k-mooney | ya i looked at ceph multi store | 18:17 |
| sean-k-mooney | https://zuul.opendev.org/t/openstack/build/66029a86e4bd49d0935021197991a1db/log/controller/logs/screen-memory_tracker.txt | 18:17 |
| dansmith | ack | 18:17 |
| sean-k-mooney | low_point: 244568 | 18:18 |
| sean-k-mooney | its usinbg about half the swap with 4125888 free of 8GB | 18:18 |
| sean-k-mooney | that ran for 1 hr 36 mins 12 secs | 18:19 |
| sean-k-mooney | which is on the lower end of normal https://zuul.opendev.org/t/openstack/builds?job_name=nova-ceph-multistore&project=openstack%2Fnova | 18:19 |
| sean-k-mooney | but the job ranges form about 1:30 to 2 hours | 18:19 |
| dansmith | gmann: I've seen timeouts in pep8 and cover today: https://zuul.opendev.org/t/openstack/build/0c92c74e8734426fb3fd05ff67893f60 | 18:26 |
| dansmith | I'm sure those have to be related to the node right? | 18:26 |
| gmann | its ovh provider this time, not 100% sure if it is slow node | 18:27 |
| dansmith | welp... | 18:27 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!