Monday, 2015-04-13

*** jamielennox|away is now known as jamielennox00:06
prometheanfire+requests>=2.1.0,!=2.4.0,<=2.2.101:21
prometheanfireLOL01:21
*** takedakn has joined #openstack-stable01:59
*** takedakn1 has joined #openstack-stable02:16
*** takedakn has quit IRC02:17
*** takedakn1 has quit IRC02:29
*** takedakn has joined #openstack-stable02:29
*** takedakn has quit IRC02:37
tchaypoprometheanfire: that makes perfect sense *nods*03:03
prometheanfire:P03:04
prometheanfireI commented on the review for this commit https://review.openstack.org/#/c/147451/03:04
*** mrunge has joined #openstack-stable06:13
*** mrunge has quit IRC06:16
*** mrunge has joined #openstack-stable06:17
*** mrunge has quit IRC06:17
*** rwsu has joined #openstack-stable06:34
*** e0ne has joined #openstack-stable06:41
*** e0ne has quit IRC06:42
*** mrunge has joined #openstack-stable06:46
ttxprometheanfire: actually those are the requirements for stable branch testing. The <= is set to correspond to the current version when the cap is set06:47
ttx(or at least that's my understanding)06:47
prometheanfireya, just read through it some more06:48
ttxBefore we let the dependency range open, but that broke every week06:48
prometheanfireat this point I'm ignoring the caps that were put on06:48
ttxyes, that's basically what we did until now06:48
prometheanfirecommented on https://review.openstack.org/#/c/147451/06:48
ttx(consider that everything works even if they don't)06:48
ttxOK, I'll read that. Just catching up06:48
prometheanfirewere any of the distros notified?06:48
prometheanfirealso, those automated deps are hard to read06:49
prometheanfiresome of them are funny06:49
prometheanfireBabel>=1.3,<=1.306:49
prometheanfirerequests>=2.1.0,!=2.4.0,<=2.2.106:49
ttxThat capping was discussed extensively at the last summit in Paris and in the ML at the beginning of the cycle. The thing is, we could not apply strict capping like this for our libraries since that would break them06:50
prometheanfireI'll likely be fine with this for kilo, but it was a surprise to me06:50
ttxso for our libs we force them to prperly use semver and do >=x.y.z <x.y+1.006:50
prometheanfireesp since we already removed some older versions that were pinned back06:51
ttxthe problem being, other python libraries do not properly use semver06:51
ttxso for thoise we strictly cap.06:51
prometheanfireya06:51
prometheanfirethat's a pain06:51
prometheanfireI'm still probably gonna work on getting gentoo support into os-ansible, then drop the packages06:52
ttxyeah, I'd agree that the trade-off is not distro-friendly06:52
prometheanfiregetting tired of all these shenanegins06:52
ttxbasically we can keep open dep reanges on master, but not on 3 stable branches without the help of the packagers06:53
prometheanfirewhat type of help?06:53
ttxStable branches were always a collaboration between upstream and packagers... and yet we struggled06:53
ttxfixing the stabel gate when it's broken06:54
ttxa new dep comes out and is not backward-compatible, breaks stable/juno. What now06:54
ttxsomeone has to debug the situation06:54
prometheanfirethat specific dep need pinning back06:54
ttxsure. But someone has to care06:55
ttxDevs care about master and only tolerate stable branches06:55
prometheanfireya :(06:55
ttxBut then, gate maintainers are a rare resources06:56
ttxand if they spend all their time on stable branches, they burn out06:56
prometheanfirethe lib update breakage could be somewhat automated06:56
prometheanfiredo a pip freeze on every run and compare/diff between runs06:56
prometheanfirecompare to known good06:57
ttxOn our libraries, the switch to maintaining stable branches for all of them should be beneficial to all06:57
prometheanfirewhat's the update mechanism for updating the freeze on the stable branches?06:57
ttxBut I agree that the "rest of the world" libraries are more difficult, and pinning is not great for distros which use system-wide stuff06:57
prometheanfireya, gentoo already only just gets by with openstack06:58
ttxBeing discussed: https://review.openstack.org/#/c/161047/06:58
prometheanfireroute2 for instance, some have updated it and are confused why openstack doesn't merge06:58
ttxBasically still discussing the bestsolution here06:59
ttxFeel free to jump in the discussion there06:59
prometheanfireI will :P06:59
prometheanfirewe don't downgrade packages if a new version is already installed, so the os-ansible solution is better in any case07:00
prometheanfireand can work across distros07:01
prometheanfirethanks for the link, gonna comment on https://review.openstack.org/#/c/161047/ in the morning07:03
prometheanfireand trolling started07:08
prometheanfirettx: anyway, nn thanks for the pointers07:08
*** jamielennox is now known as jamielennox|away07:11
*** ihrachyshka has joined #openstack-stable07:22
*** ihrachyshka has quit IRC07:28
*** ihrachyshka has joined #openstack-stable07:30
*** pixelb has joined #openstack-stable07:52
tchaypoprometheanfire: ttx: There was a discussion related to this in -infra this morning - triggered by a mailing list post "[openstack-dev] [all][pbr] splitting our deployment vs install dependencies” and culminating in https://etherpad.openstack.org/p/stable-omg-deps08:07
tchaypoit’s not precisely about what the caps should be - more about the fact that the data we currently put in requirements.txt is used for >1 purpose and we need different sets of data for different purposes08:08
*** e0ne has joined #openstack-stable08:08
*** e0ne has quit IRC08:10
*** e0ne has joined #openstack-stable08:14
ttxtchaypo: right. What we run in tests is slightly disjoint from what range actually works08:14
*** ihrachyshka has quit IRC08:15
tchaypobut there are people who want to install the known-working thing, and there are other people who need to match dependencies with other packages and would prefer to just get a probably-working range, a known-bad blacklist, and tools for testing to make sure the combination they pick works08:16
ttxtchaypo: ++08:16
ttxThere are multiple ways to protect the stable branches from direct dependency breakage that do not involve screwing up distributions completely :)08:17
*** e0ne has quit IRC08:19
*** derekh has joined #openstack-stable08:32
*** jamielennox|away is now known as jamielennox09:02
*** ihrachyshka has joined #openstack-stable09:07
*** andymaier has joined #openstack-stable09:17
*** apevec has joined #openstack-stable09:49
*** apevec has joined #openstack-stable09:49
*** e0ne has joined #openstack-stable09:55
*** e0ne has quit IRC09:56
*** e0ne has joined #openstack-stable10:17
*** e0ne has quit IRC10:35
*** e0ne has joined #openstack-stable10:37
*** e0ne has quit IRC10:41
*** ttx has quit IRC11:48
*** ttx has joined #openstack-stable11:48
*** ttx has quit IRC11:49
*** ttx has joined #openstack-stable11:49
*** apevec has quit IRC12:02
*** jamielennox is now known as jamielennox|away12:12
*** ttx has quit IRC12:45
*** ttx has joined #openstack-stable12:45
*** ttx has quit IRC12:46
*** ttx has joined #openstack-stable12:46
*** eharney has joined #openstack-stable12:50
zulthe release announcement for 2014.2.3 isnt out yet is it?13:12
ttxzul: no, I think adam delayed to include trove13:35
zulttx: okie dokie13:39
*** apevec has joined #openstack-stable13:41
*** ihrachyshka has quit IRC13:42
*** ihrachyshka has joined #openstack-stable13:47
prometheanfiretchaypo: thanks for that link14:36
*** xaeth_afk is now known as xaeth14:44
prometheanfiretchaypo: it still looks like no one is thinking of the packagers14:48
ihrachyshkaprometheanfire, if there are no packagers that are actually involved in upstream stable maintainance, then it's not surprising that there is 'little thinking'14:50
prometheanfiredo packagers know to be involved with that?14:50
prometheanfirefor all other things that I package upstream is somewhat responsible14:50
prometheanfirenot the case with openstack though14:50
ihrachyshkaI don't know, I haven't seen any packagers other than from redhat or ubuntu side to be involved in any stable activities14:51
ihrachyshkanot sure what responsible is here. there is a balance, openstack is different since it has gate, and there is shortage of resources to fix gate failures in time, hence the solution.14:52
prometheanfireopenstack's deps move too fast14:52
prometheanfireor more correctly, what openstack deps on changes too much14:52
ihrachyshkabecause openstack is the largest and most active pythonic project in the world14:52
prometheanfirethat's fine, just makes it near impossible to package fir14:53
prometheanfirefor14:53
ihrachyshkafor one man army, yes14:53
*** rwsu has quit IRC14:54
prometheanfireand I'm honestly fine with the dep caps, I worry that they hide actual problems though14:54
ihrachyshkaspeaking of capped deps... ideally, we would gate against min and max versions capped, plus have a bot that moves the deps forward after new pypi releases.14:54
*** rwsu has joined #openstack-stable14:54
prometheanfireya, that bot is essential14:55
ihrachyshkaprometheanfire, which problems? I could miss some comments14:55
prometheanfireif the deps are not moved forward14:55
prometheanfireif you attempt to move the deps forward automaticly, how do you diferentiate between a dep that was capped proactivly vs one that was capped because of a known problem?14:56
prometheanfirerecording the known problems caps seperately could help maybe14:56
ihrachyshkathose deps are just contract between upstream and users. what those caps say is that 'we tested the code against those versions, atm we don't have capacity to test with all versions, or newer ones, so that's all we are able to provide you; if you use other versions, you're in unsafe mode'14:56
ihrachyshkaprometheanfire, we could mark entries with a tag14:57
prometheanfirethose caps hide actual dep problems14:58
ihrachyshkathere is no problem IF you use those versions, is it?14:58
prometheanfirenot arguing that14:59
prometheanfireconsider this scenario14:59
prometheanfiremy distro doesn't have sphinx < 1.314:59
prometheanfirethe requirements require <1.314:59
ihrachyshkaprometheanfire, you can actually propose raising the cap if you feel like it15:00
prometheanfirehow am I suposed to know if that was capped because of protectionism or if it's a cap because of an actual problem15:00
prometheanfireihrachyshka: let me finish...15:00
prometheanfirewe have the caps for two diferent activities15:00
prometheanfireone is protection, which is fine15:00
prometheanfirethe other is actual known problems15:01
prometheanfirepackagers will want to package off the second one (at least I will)15:01
prometheanfireif only because it has the required flexibility for distros15:02
ihrachyshkaprometheanfire, yeah, tags or two separate lists of deps could be useful. but note that to avoid issues, it's not enough to package the thing, you still need to run integration tests, unit tests, etc.15:02
ihrachyshkayou're packaging for gentoo, right?15:02
prometheanfireyep15:02
prometheanfireI'd like two child lists that are merged into one requrements.txt (or test-reqs)15:03
prometheanfirethat'd solve both problems maybe15:03
ihrachyshkathose caps can be worth for you since you're rolling15:03
ihrachyshka*worse15:03
prometheanfireI'd also standardize to overwriting the provided requirements with '' so that distros won't complain15:04
ihrachyshkafor redhat, we just cap versions each release, and then don't move stuff forward unless there is huge need15:04
prometheanfireya15:04
prometheanfirethough I think the caps are still fine15:04
prometheanfirewe can still roll forward and keep the old versions around15:04
prometheanfire[I] dev-python/requests Available versions:  2.3.0^t{tbz2} ~2.4.1^t ~2.4.3^t ~2.5.0-r1^t ~2.5.1^t ~2.5.3^t ~2.6.0^t {PYTHON_TARGETS="pypy pypy3 python2_7 python3_3 python3_4"}15:05
prometheanfirefor instance :P15:05
prometheanfireso those caps are probably fine15:05
prometheanfirethey were a surprise to me and that was painful15:06
ihrachyshkaI see. so yeah, I agree that some distro voice is not heard, but I also think that people should be involved in stable maintainance, at least when it comes to ML discussions, because project lacks other's perspective (I haven't thought out how painful it can be for rolling releases)15:06
prometheanfireI still think two seperate lists are needed to track actual problems vs protection15:06
prometheanfirewhich mailing lists?15:06
ihrachyshkaopenstack-dev specifically15:06
ihrachyshkaall decisions are done there15:06
prometheanfirethe busy one, of course :P15:07
ihrachyshkacaps were discussed for weeks15:07
prometheanfireI've tried to avoid that one because of traffic, guess I shouldn't have15:07
ihrachyshkaand they came out mostly because we had an alternative of dropping stable branches15:07
ihrachyshkadue to lack of human resources15:07
prometheanfireya, I could have been prepared for it at that point :P15:07
ihrachyshkabecause gate was broken each week by ever new release of libX on pypi15:08
prometheanfireI get that15:08
prometheanfireand like I said, it was the surprise that was the worst part15:08
prometheanfirewhy doesn't openstack have some sort of -packagers list where we can git notified of things like this?15:09
ihrachyshkathe usual way of doing it in openstack world is having a separate [tag] in email subject in openstack-dev@15:09
ihrachyshkaI actaully started one lately - [packaging]15:10
prometheanfire<315:10
prometheanfireopenstack-dev+subscribe@lists.openstack.org ?15:10
ihrachyshkaso you subscribe and then set filters to mark everything except interesting stuff read/move to trasj15:10
ihrachyshka*trash15:10
ihrachyshkayeah, that one I guess15:10
ihrachyshkahttp://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev15:10
ihrachyshkaprometheanfire, here is the first (and so far only) thread with the tag: http://lists.openstack.org/pipermail/openstack-dev/2015-March/059078.html15:11
prometheanfiremeeting time15:12
prometheanfirelol @ web form to subscribe, but done :P15:22
prometheanfireihrachyshka: and gots :D15:31
ihrachyshkaprometheanfire, come on, don't be that 90s! email is for sissies!15:32
prometheanfireI'm already on about 20-30 mailing lists15:32
prometheanfiremuch bikeshedding15:32
prometheanfirelittle time15:32
prometheanfirehttp://phk.freebsd.dk/_images/bikeshed.png15:33
prometheanfireI kinda want that as my logo now15:33
prometheanfiredoes --config-dir go into child dirs?15:34
ihrachyshkaafaik nope15:35
ihrachyshkabut why15:35
prometheanfirejust curious, I'm glad it doesn't15:35
ihrachyshkaI can't be sure!15:36
ihrachyshkaprometheanfire, https://github.com/openstack/oslo.config/blob/master/oslo_config/cfg.py#L126215:37
prometheanfire:D15:38
prometheanfirethat should be one dir only15:38
*** ttx has quit IRC15:57
*** ttx has joined #openstack-stable15:57
*** ttx has quit IRC16:05
*** ttx has joined #openstack-stable16:05
*** derekh has quit IRC16:57
*** ihrachyshka has quit IRC17:00
*** andymaier has quit IRC17:06
*** pixelb has quit IRC17:13
*** SlickNik has joined #openstack-stable17:22
*** pixelb has joined #openstack-stable17:33
*** mgagne_ is now known as mgagne17:58
*** tlbr has quit IRC18:22
*** SlickNik has quit IRC18:31
*** SlickNik has joined #openstack-stable18:31
*** apevec has quit IRC18:50
*** mrunge has quit IRC19:04
*** e0ne has joined #openstack-stable19:04
*** e0ne has quit IRC19:14
*** e0ne has joined #openstack-stable19:17
*** e0ne has quit IRC20:08
*** tlbr has joined #openstack-stable20:14
*** e0ne has joined #openstack-stable20:41
*** pixelb has quit IRC20:53
*** e0ne has quit IRC21:43
*** xaeth is now known as xaeth_afk21:48
tchaypoprometheanfire: the conversation yesterday was focussed on pbr22:35
tchaypoand I’m told that means downstream packagers don’t need to be considered because they don’t use pbr22:35
*** jamielennox|away is now known as jamielennox23:22
*** SergeyLukjanov has quit IRC23:39
*** SergeyLukjanov has joined #openstack-stable23:40
prometheanfiretchaypo: I use pbr23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!