opendevreview | Jianjian Huo proposed openstack/swift master: Container-server: add container namespaces GET https://review.opendev.org/c/openstack/swift/+/890470 | 04:37 |
---|---|---|
opendevreview | Jianjian Huo proposed openstack/swift master: WIP: Proxy: Use shard-format for auto cont GETs and updating https://review.opendev.org/c/openstack/swift/+/895602 | 05:06 |
opendevreview | Alistair Coles proposed openstack/swift master: proxy-server: add replicated GET path tests https://review.opendev.org/c/openstack/swift/+/895802 | 13:22 |
opendevreview | Alistair Coles proposed openstack/swift master: proxy-server: de-duplicate _get_next_response_part method https://review.opendev.org/c/openstack/swift/+/890919 | 13:22 |
opendevreview | Alistair Coles proposed openstack/swift master: proxy-server: init GetterBase resource_type with server type https://review.opendev.org/c/openstack/swift/+/896098 | 13:22 |
opendevreview | Alistair Coles proposed openstack/swift master: proxy-server: de-duplicate _get_next_response_part method https://review.opendev.org/c/openstack/swift/+/890919 | 15:16 |
opendevreview | Alistair Coles proposed openstack/swift master: proxy-server: init GetterBase resource_type with server type https://review.opendev.org/c/openstack/swift/+/896098 | 15:16 |
-opendevstatus- NOTICE: The lists.openinfra.dev and lists.starlingx.io sites will be offline briefly for migration to a new server | 15:32 | |
acoles | timburke: sorry I missed them meeting again - hopefully I'll be more regular once the clocks change and it shifts a little earlier | 15:50 |
opendevreview | ASHWIN A NAIR proposed openstack/swift master: s3api: Support GET/HEAD request with PartNumber https://review.opendev.org/c/openstack/swift/+/894580 | 16:47 |
opendevreview | Tim Burke proposed openstack/swift master: proxy: Emit counter metrics when a node is skipped due to error-limiting https://review.opendev.org/c/openstack/swift/+/895976 | 17:00 |
klamath | Has anyone hit this error before? | 17:17 |
klamath | Sep 21 17:14:43 node container-sharder: Unhandled exception while dumping progress for /srv/node/d455/containers/53872/a60/d2702ecdf65a5632477eb0fc60402a60/DB.db: max() arg is an empty sequence: #012Traceback (most recent call last):#012 File "/usr/local/openstack/lib/python3.6/site-packages/swift/container/sharder.py", line 1905, in _one_shard_cycle#012 self._record_sharding_progress(broker, node, error)#012 File "/usr/local/open | 17:17 |
klamath | stack/lib/python3.6/site-packages/swift/container/sharder.py", line 657, in _record_sharding_progress#012 CleavingContext.load_all(broker)]) or None#012ValueError: max() arg is an empty sequence | 17:17 |
opendevreview | kim woo seok proposed openstack/swift master: Add unittest of swift-recon-cron https://review.opendev.org/c/openstack/swift/+/896152 | 18:00 |
opendevreview | kim woo seok proposed openstack/swift master: Add unittest of swift-recon-cron https://review.opendev.org/c/openstack/swift/+/896152 | 18:03 |
opendevreview | ASHWIN A NAIR proposed openstack/swift master: s3api: Support GET/HEAD request with PartNumber https://review.opendev.org/c/openstack/swift/+/894580 | 18:06 |
timburke | klamath, looks like it should be fixed in 2.28.0 (and later), by https://github.com/openstack/swift/commit/e53c82cd32e99513dba00a28c29953cadcc9bd87 | 18:28 |
timburke | apparently i wrote the fix, but i really don't remember it :P | 18:30 |
klamath | @timburke is this a soft error? we are in the middle of a deploy and hit this error on the first node | 18:30 |
timburke | yeah, fairly certain -- we've got some very broad exception handling around dumping progress, and it goes back to when we first implemented sharding: https://github.com/openstack/swift/blob/2.32.0/swift/container/sharder.py#L2505-L2509 | 18:33 |
klamath | ok, we caught this error and started to deep dive on the error, if we can hold off on bumping the version from wallaby to xena id like to | 18:37 |
opendevreview | Tim Burke proposed openstack/swift stable/wallaby: sharder: Prevent ValueError when no cleaving contexts https://review.opendev.org/c/openstack/swift/+/896117 | 18:40 |
timburke | looks like the patch should apply cleanly to wallaby, for what it's worth. hit a conflict trying to cherry-pick to victoria, but i expect it won't be *so* bad to resolve | 18:42 |
klamath | Do you know how long this will take to merge? | 18:43 |
timburke | should merge later today. how do you usually get your releases? | 18:53 |
klamath | we have a pipeline that grabs master | 18:54 |
klamath | Thanks for backporting this, been tearing my hair out the last hour doing a diff between our swift versions | 18:56 |
timburke | happy to help! yeah, looks like the _record_sharding_progress function was subtly broken when it was introduced in 2.27.0: https://github.com/openstack/swift/commit/1de98348167f9923710d1a6d634ef6d8008eea5d | 19:01 |
timburke | which would also explain the merge conflict trying to go back before wallaby | 19:01 |
opendevreview | Clay Gerrard proposed openstack/swift master: slo: refactor GET/HEAD response handling https://review.opendev.org/c/openstack/swift/+/893578 | 20:46 |
opendevreview | Jianjian Huo proposed openstack/swift master: WIP: Proxy: Use shard-format for auto cont GETs and updating https://review.opendev.org/c/openstack/swift/+/895602 | 21:14 |
opendevreview | Tim Burke proposed openstack/swift master: Drop py2 support https://review.opendev.org/c/openstack/swift/+/853590 | 23:29 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!