Friday, 2020-12-18

*** brinzhang0 has quit IRC00:02
*** brinzhang has joined #openstack-oslo00:43
*** hamalq_ has quit IRC02:50
*** rcernin has quit IRC04:12
*** rcernin has joined #openstack-oslo04:18
*** larainema has joined #openstack-oslo04:19
*** zzzeek has quit IRC06:45
*** zzzeek has joined #openstack-oslo06:46
*** zzzeek has quit IRC07:51
*** zzzeek has joined #openstack-oslo07:53
*** hberaud has quit IRC07:59
*** hberaud has joined #openstack-oslo08:00
*** ralonsoh has joined #openstack-oslo08:02
*** rcernin has quit IRC08:07
*** sboyron has joined #openstack-oslo08:13
*** rpittau|afk is now known as rpittau08:30
*** sboyron has quit IRC08:38
*** rcernin has joined #openstack-oslo08:43
*** elod is now known as elod_pto09:04
*** rcernin_ has joined #openstack-oslo09:25
*** rcernin has quit IRC09:25
*** rcernin_ has quit IRC10:36
*** raildo has joined #openstack-oslo11:22
*** zzzeek has quit IRC11:28
*** rcernin_ has joined #openstack-oslo11:29
*** zzzeek has joined #openstack-oslo11:29
*** rcernin_ has quit IRC11:53
*** rcernin_ has joined #openstack-oslo11:53
*** brinzhang has quit IRC12:08
*** sboyron has joined #openstack-oslo12:10
ttxHi team, oslo-messaging (and I suspect other libs) are currently failing the lower-constraints job (even for changes that do not alter the lower-constraints), with:12:18
ttxERROR: No matching distribution found for bandit<1.7.0,>=1.6.012:18
ttxIt's a bit unclear to me why it would not find bandit 1.6.212:19
ttxExample fail at https://review.opendev.org/c/openstack/oslo.messaging/+/72778712:20
ttx /cc fungi12:20
ttx(it's on master branch fwiw)12:22
ttxI can't reproduce the same error locally12:31
*** sboyron has quit IRC12:33
hberaudttx: yep I started to submit patches to fix that unfortunatelly it's easy to fall in the dependency hell with this topic12:38
hberaudttx: a lot of oslo project still need fix12:38
hberaudttx: the method I used to reproduce that is 1. "tox -r -e venv -- pip install -U pip" 2. tox -e venv -- pip install -c lower-constraints.txt -r test-requirements.txt -r requirements.txt12:40
hberaudIIUC concerning bandit the issue is that bandit in lower-constraints and in test-requirements are not aligned12:41
hberaudor not enough aligned to allow the new pip resolver to resolve things correctly12:42
hberaudanother big issue with oslo is the number of layers in requirements between oslo project, by example oslo.messaaaging depends on oslo.log wich depends on oslo.config etc... etc... so to fix one thing we need to start fixing at the right place first12:44
*** zzzeek has quit IRC12:54
*** zzzeek has joined #openstack-oslo12:58
*** tosky has joined #openstack-oslo12:58
ttxThere were two suggestions in a recent thread: drop lower-constraints entirely (which some projects seem to have done), and move test-requirements to pre-venv tox.ini entries13:05
ttxper-venv*13:05
ttxLooks like the first one would "fix" this13:06
ttxI'm all for simplification... We have built something that is great on paper, but hard to keep in good shape and that only a limited number of people actually understand13:07
ttxSure it was a great service as long as it lasted, but now it may be time to push that lower-bounds validation back in distroland. It's hard enough to keep up with the higher-bound as dependencies get updated13:09
toskyon the other hand, don't you think that once this big disruption coming from a one-time change of the pip resolver is fixed, the future maintenance will be easier?13:12
hberaudttx: so it seems that the shortest way is to drop LC13:13
ttxtosky: imho lower-constraints is not facilitating anything but the case of people wanting to build a distro on old deps13:18
ttxCurrently they can take our lower-constraints set and run with it. Tomorrow they will have to determine a set and run tests13:19
ttxI'm not sure keeping them around is making future maintenance of "openstack" easier.13:20
ttxMaintaining Lower constraints does not help is keeping track of new deps13:20
hberaudyes I don't expect that similar issue will happen so early, AFAIK the pip resolver topic is an old file... However I agree with ttx a simplification can't hurt. I saw divergence between upstream LC and version really available downstream, so it don't seems really respect outside upstream.13:20
ttxhelp in*13:20
hberauds/respect/respected/13:21
*** zzzeek has quit IRC13:21
ttxDistros have to test with their deps anyway13:21
hberaudso I'm not sure of benefit to continue with LC13:22
ttxBut we'll likely need a TC decision to really drop them13:22
hberaudmake sense13:23
ttxhberaud: I'd say there is still some fringe benefit (always was), but not enough to justify the complexity and recurring pain13:23
hberaud+113:23
ttxWhen we had dozens of people understanding and maintaining it, it was still a good tarde-off. Today not so much13:24
hberaudI see13:24
*** zzzeek has joined #openstack-oslo13:25
*** zzzeek has quit IRC13:29
*** zzzeek has joined #openstack-oslo13:31
openstackgerritHervé Beraud proposed openstack/openstack-doc-tools master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/openstack-doc-tools/+/76772314:04
openstackgerritHervé Beraud proposed openstack/pbr master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/pbr/+/76772414:04
openstackgerritHervé Beraud proposed openstack/automaton master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/automaton/+/76772514:05
openstackgerritHervé Beraud proposed openstack/debtcollector master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/debtcollector/+/76772714:06
openstackgerritHervé Beraud proposed openstack/futurist master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/futurist/+/76772814:06
openstackgerritHervé Beraud proposed openstack/oslo.cache master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.cache/+/76772914:07
openstackgerritHervé Beraud proposed openstack/oslo.concurrency master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.concurrency/+/76773014:07
openstackgerritHervé Beraud proposed openstack/oslo.context master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.context/+/76773114:07
openstackgerritHervé Beraud proposed openstack/oslo.db master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.db/+/76773214:08
openstackgerritHervé Beraud proposed openstack/oslo.i18n master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.i18n/+/76773314:08
openstackgerritHervé Beraud proposed openstack/oslo.limit master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.limit/+/76773414:09
openstackgerritHervé Beraud proposed openstack/oslo.log master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.log/+/76773514:09
openstackgerritHervé Beraud proposed openstack/oslo.messaging master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.messaging/+/76773614:09
openstackgerritHervé Beraud proposed openstack/oslo.metrics master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.metrics/+/76773714:10
openstackgerritHervé Beraud proposed openstack/oslo.middleware master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.middleware/+/76773914:10
openstackgerritHervé Beraud proposed openstack/oslo.policy master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.policy/+/76774014:10
openstackgerritHervé Beraud proposed openstack/oslo.privsep master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.privsep/+/76774114:11
openstackgerritHervé Beraud proposed openstack/oslo.reports master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.reports/+/76774214:11
openstackgerritHervé Beraud proposed openstack/oslo.rootwrap master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.rootwrap/+/76774314:12
openstackgerritHervé Beraud proposed openstack/oslo.serialization master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.serialization/+/76774414:12
openstackgerritHervé Beraud proposed openstack/oslo.service master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.service/+/76774514:12
openstackgerritHervé Beraud proposed openstack/oslo.upgradecheck master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.upgradecheck/+/76774614:13
openstackgerritHervé Beraud proposed openstack/oslo.utils master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.utils/+/76774714:13
openstackgerritHervé Beraud proposed openstack/oslo.versionedobjects master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.versionedobjects/+/76774814:14
openstackgerritHervé Beraud proposed openstack/oslo.vmware master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslo.vmware/+/76774914:14
openstackgerritHervé Beraud proposed openstack/oslotest master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/oslotest/+/76775014:14
openstackgerritHervé Beraud proposed openstack/osprofiler master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/osprofiler/+/76775114:15
openstackgerritHervé Beraud proposed openstack/stevedore master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/stevedore/+/76775214:15
openstackgerritHervé Beraud proposed openstack/taskflow master: Dropping lower constraints testing  https://review.opendev.org/c/openstack/taskflow/+/76775314:16
hberaudttx: normally all oslo's LC tests are dropped by ^ (c.f => https://review.opendev.org/q/topic:"oslo_lc_drop")14:18
ttxoh, that was fast14:20
ttxI think we should wait for the TC to bless that dropping lower-constraints is a good idea14:20
hberaudsure np,,, patches are ready, we just have to push the right button (+W or abandon)14:21
ttxI might start making my patches depend on those ones though :P14:28
hberaudttx: If that can reassure you, now I have to rebase all mine too :)14:32
*** iurygregory has joined #openstack-oslo14:38
*** rcernin_ has quit IRC15:05
fungittx: thanks for the example, and yeah the lower-constraints.txt files in most projects were not actually describing consistent satisfiable sets of dependency versions. i expected this was the case all along (and its part of why i repeatedly argued against adding lower-constraints jobs that way in the first place), but the new and more complete dep solver in pip 20.3 has made it clear to lots more15:07
fungipeople that they have always been thoroughly broken15:07
fungithe jobs used to "succeed" but they didn't actually test with the versions of packages which were being requested15:09
funginor with the versions of packages other packages claimed were suitable for them15:09
hberaudyep15:11
*** rcernin_ has joined #openstack-oslo15:22
*** rpittau is now known as rpittau|afk15:38
*** rcernin_ has quit IRC15:42
*** rcernin_ has joined #openstack-oslo15:44
bnemec:-(16:04
bnemeclower-contraints might not have been doing exactly what it said, but it did catch a few lower bounds issues in my patches over the years.16:04
bnemecIt's unlikely I'm going to fix the jobs though, so I guess that's the way it goes.16:05
*** rcernin_ has quit IRC16:07
*** gibi is now known as gibi_pto16:35
hberaudbnemec: things are not set in stone yet, there is still time to debate :)16:52
gmannhberaud: we can drop  the lower-constraints.txt file and tox env also.17:12
hberaudgmann: ack17:13
*** hamalq has joined #openstack-oslo17:19
*** hamalq_ has joined #openstack-oslo17:21
*** hamalq has quit IRC17:24
*** dave-mccowan has quit IRC17:42
*** dave-mccowan has joined #openstack-oslo17:47
*** ralonsoh has quit IRC17:57
openstackgerritThierry Carrez proposed openstack/oslo.messaging master: Add Support For oslo.metrics  https://review.opendev.org/c/openstack/oslo.messaging/+/76184818:16
*** dave-mccowan has quit IRC19:37
*** rcernin_ has joined #openstack-oslo20:42
*** raildo has quit IRC21:07
*** rcernin_ has quit IRC21:51
*** rcernin_ has joined #openstack-oslo22:29
*** rcernin_ has quit IRC22:34
*** rcernin has joined #openstack-oslo22:35
*** zzzeek has quit IRC23:27
*** zzzeek has joined #openstack-oslo23:28
*** zzzeek has quit IRC23:51
*** zzzeek has joined #openstack-oslo23:53
*** zzzeek has quit IRC23:58
*** zzzeek has joined #openstack-oslo23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!