Friday, 2018-11-30

*** openstackgerrit has joined #openstack-loci01:25
openstackgerritArun Kant proposed openstack/loci master: Updating binaries depenencies names for building suse images  https://review.openstack.org/62105101:25
*** e0ne has joined #openstack-loci06:32
*** e0ne has quit IRC07:31
evrardjphello08:24
evrardjpI've seen a post_failure in a failed patch: https://review.openstack.org/#/c/621051/1 , which probably led to the developer to believe it was a gate failure. Maybe we should continue the removal of the async things (which would then fail), or mark them as failed_when: false. Opinion?08:25
openstackgerritJean-Philippe Evrard proposed openstack/loci master: Updating binaries depenencies names for building suse images  https://review.openstack.org/62105108:29
*** e0ne has joined #openstack-loci09:27
*** e0ne has quit IRC12:54
*** e0ne has joined #openstack-loci13:37
evrardjpo/14:58
hogepodge#startmeeting loci15:00
openstackMeeting started Fri Nov 30 15:00:40 2018 UTC and is due to finish in 60 minutes.  The chair is hogepodge. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: loci)"15:00
openstackThe meeting name has been set to 'loci'15:00
hogepodge#link https://etherpad.openstack.org/p/loci-meeting agenda15:00
hogepodgeLet's give folks (ping portdirect ) a few moments to arrive15:01
evrardjpo/15:02
hogepodgeLooks like it's just us again.15:04
* portdirect downs coffee15:04
hogepodge#topic Release versioning15:04
*** openstack changes topic to "Release versioning (Meeting topic: loci)"15:04
hogepodge#link http://lists.openstack.org/pipermail/openstack-discuss/2018-November/000332.html thread on releases15:05
hogepodge#link http://lists.openstack.org/pipermail/openstack-discuss/2018-November/000365.html15:05
hogepodgeI've been getting quite a bit of pressure to manage releases of Loci rather than do continuous development like we have in the past.15:06
evrardjpI don't know _your side of the pond_ (as I am relatively new), but I expected this to happen, that's why I brought the idea of branching in loci.15:07
evrardjp(gates I mean)15:07
evrardjpwhich mean we could technically have deliverable that have still the same tag, but are really different branches (example 1.0-queens 1.0-rocky)15:08
hogepodge#link https://review.openstack.org/#/c/609616/ branching patch15:08
portdirectfrom what you are saying hogepodge i take it that there is limited appetite for `release-management:none` or `release-management:external` ?15:08
hogepodgerelease-management:none is an option and we'll be tagged with that, but it seems like people aren't really happy with it15:09
hogepodgeI could see a situation where as part of an auditing process you want to know what version built a set of containers15:10
portdirecton a slight tangent, some consumers of loci label the build artifact with the git commit of the loci repo that built the image15:10
portdirectwhich i think satisfies the above quite well15:10
portdirectATT uses this along with image schema for example15:11
evrardjpI myself don't see the point of tagging if we are not publishing "definitive" images.15:11
evrardjpbut I recall some patches asking for building in different branches, and therefore it was meant for "consuming LOCI directly" which we never encouraged.15:12
evrardjpIs that a path we are taking?15:12
hogepodgeMe neither. The main value I would see is in identifying major and minor API changes.15:12
portdirecti hope not15:12
portdirecti feel this is less of a technical issue, but more one of signifying both the maturity and stability of the project15:13
portdirecthogepodge: have you any thoughts on a path forward?15:13
hogepodgeI don't completely understand the building in other branches. Do you mean building released versions of OS? We support that by pulling tagged repositories in the build.15:13
hogepodgeMy proposal is to not do release management. If a consumer comes along and demands it (and we do want to support growth in the community) I would propose following semver, just because a six month release cycle is a bit silly for us and it communicates directly how the software changes.15:14
portdirectmy gut is aligned with your thoughts here15:15
evrardjpWhat I meant was "I saw a demand of people to have our published images, for different openstack branch, not only master". As we provide the ability to build (but do not publish those different branch images) I was wondering what's the _future_ intended consumption model. If no change happens, then no release management makes sense.15:15
evrardjpso yes, I am aligned with you.15:16
portdirectpersonally i think the above, and an explanation of the rationalle at the 1st thing that someone sees when they hit the loci dos/repo would suffice?15:16
evrardjpI am wondering if we are doing ourselves a misfavor by publishing :p15:17
hogepodgeI've been strongly waved off of producing consumable images. You then become responsible for a whole bunch of things like managing security, and that whole idea quickly can turn into an NPM situation15:17
portdirectin which case we could cut a 1.0.0 release pretty much anytime, and increment along with the api15:17
evrardjp(which could be the cause of ppl think that release-management:external exists)15:17
evrardjps/exists/would be used/15:17
evrardjphogepodge: I agree with you15:17
portdirectevrardjp: they are really useful (published images), but need to come with a *ONLY FOR DEV AND DEMO PURPOSES* warning on them15:18
evrardjpportdirect: I am wondering what's the value of this 1.0.015:18
hogepodgeThe biggest value I would see is in signaling the addition of new major features. "loci now does package builds in 1.1.0!"15:19
hogepodgeTo me it sounds like the consensus is to go forward as we are right now15:19
evrardjpI believe at the end the release-management: none makes sense until someone writes a spec for the semver, with a real use case. In that case, we can still change the model15:19
hogepodge+115:20
portdirectwfm15:20
evrardjpgreat!15:20
hogepodgeok! on to the next topic15:20
hogepodge#topic gate failures15:20
*** openstack changes topic to "gate failures (Meeting topic: loci)"15:20
hogepodgeThe gate is in pretty bad shape right now.15:21
hogepodgewith a failure rate of at least 10%, statistically no jobs will merge (because we have about 10)15:21
evrardjpdo we want to bake-in the repos of infra inside the images?15:22
evrardjpif we do we'll probably be more stable15:22
hogepodgehave a meta requirements?15:23
hogepodgeRight off hand, there are a few options to pursue that are easy15:23
hogepodgeRemove async builds because we can't debug it15:23
hogepodge#link https://review.openstack.org/#/c/616337/15:23
evrardjpI vote for the removal of async15:23
hogepodgeMake most jobs non-voting so we can easily ignore infra failures15:24
evrardjpcurrently the fact that a failure in the job could be masked by a post_failure of async is sending a bad message15:24
hogepodgeI'm not happy with how our jobs are structured anyway, one voting job for every openstack project feels like we're spinning wheels. I haven't thought of how to articulate more useful jobs though.15:25
evrardjphogepodge: also it's one job for multiple distro per project15:25
evrardjpI have no opinion on the jobs structure tbh.15:26
hogepodgeyeah, which is also unsatisfying. Loci does a giant matrix of builds and no matter how you do it you have a O(nm) complexity problem with the possibility of infra failure at every enumeration15:26
evrardjpWe can definitely refactor this to be simpler, and be one job per distro. We could only have one distro as voting, the others as -nv.15:27
evrardjpreduces the risks there15:27
portdirectthat sounds good to me15:28
evrardjpOSA has seen a far improved success rate when moving towards infra mirror tbh,so that's why I said it as first item.15:28
hogepodgeI think all three distros should vote, but only have two components, like say requirements and nova vote15:28
hogepodgehow does that work?15:28
portdirectyou know, i'd be ok with both of your suggestions in combination15:29
portdirectbut thats proabably too lax15:29
portdirectthe attractiveness of hogepodge's suggestion is that we ensure multi-distro support to some extent15:30
hogepodgeI meant how does the infra mirror work15:30
evrardjpI think nova is a bad example, as it has some code path different than let's say keystone.15:30
portdirectlol - sry15:30
hogepodgeasync irc :-)15:30
evrardjphogepodge: oh we'd simply use the infra mirrors for all our packages, instead of being upstream mirrors. So basically changing the urls of the apt/yum repos, likewise for git repos.15:31
hogepodgeIt's frustrating that the network in the gate is flaky, but that's just the nature of the beast for now.15:31
evrardjpalmost (if not all) the timeouts we had vanished with that.15:31
hogepodgeThat seems easy enough to do. I was worried we'd have to manage a mirror which sounded like nofun15:31
evrardjpI think some of the dockerfiles allow override right now15:32
hogepodgeshould be easy enough15:32
evrardjpit could be that we provide said overrides for all distros, and in the cleanup step, but back the "default" ones.15:32
evrardjpput back*15:32
evrardjpit should bring stability and keep re-use for everyone15:33
hogepodgeOh, I didn't think about the repos being unusable in the published images on dockerhub.15:34
hogepodgeIf we point to the infra mirrors15:34
hogepodgeOk, so I see four actionable items15:36
hogepodge* remove async15:36
hogepodge* make jobs non-voting to un-wedge the gate15:36
hogepodge* refactor jobs to reduce load and split distros15:36
hogepodge* use infra mirrors15:36
evrardjplgtm15:37
hogepodgeThose all seem like things we can do in the next week or so.15:37
evrardjpthat's ambitious :)15:39
evrardjpthe first 2 are easy to do15:39
evrardjpthe 3-4 might require more time :)15:39
evrardjp(it's easy to miss things in step 4 for example)15:39
evrardjpbut yeah I agree it shouldn't be _that_ hard15:40
hogepodgeWe should definitely do one and two15:40
hogepodgewe're stuck without them15:40
hogepodgeOk, anything else on this topic?15:42
hogepodge#topic documentation15:43
*** openstack changes topic to "documentation (Meeting topic: loci)"15:43
evrardjpnothing else15:43
hogepodgeA few comments on documentation.15:43
hogepodgeWe should have some contributor docs, just to set expectations on the sort of patches we'll accept.15:44
hogepodgeAlso some inline script documentation to help understand what magic is going on in some of those lines. :-)15:44
hogepodgeAnd possibly a users guide that isn't just a readme that we can publish on docs.openstack.org15:45
hogepodgeI can start squeezing that work into my spare time.15:45
evrardjpsounds good15:46
evrardjpI think, without going that far as releasing, adding release notes on the project would be valuable.15:46
evrardjpI consider this part of the documentation :)15:46
hrwo/15:46
hrwsorry, forgot about meeting15:47
hogepodgehi hrw :-) we're pretty close to wrapping up, talking about docs now15:48
evrardjpnothing to add15:49
hogepodgeevrardjp: if we do that, I'd just ask that notes be added as part of feature patches so that nobody has to go through a git log to chase changes down15:49
evrardjpprecisely :)15:49
hogepodgeI don't have much else to add15:50
hogepodge#topic open discussion15:51
*** openstack changes topic to "open discussion (Meeting topic: loci)"15:51
hogepodgeanything else before we call it a meeting?15:51
*** munimeha1 has joined #openstack-loci15:51
evrardjpthat's all for me :)15:53
evrardjpthanks for the meeting hogepodge !15:53
hogepodgethanks everybody! see you next week15:53
hogepodge#endmeeting15:53
*** openstack changes topic to "Build image -- `docker build https://github.com/openstack/loci.git --build-arg PROJECT=keystone` || Review patches -- https://review.openstack.org/#/q/projects:openstack/loci+status:open"15:53
openstackMeeting ended Fri Nov 30 15:53:40 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:53
openstackMinutes:        http://eavesdrop.openstack.org/meetings/loci/2018/loci.2018-11-30-15.00.html15:53
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/loci/2018/loci.2018-11-30-15.00.txt15:53
openstackLog:            http://eavesdrop.openstack.org/meetings/loci/2018/loci.2018-11-30-15.00.log.html15:53
*** lemko has joined #openstack-loci16:24
*** e0ne has quit IRC17:45
*** openstackgerrit has quit IRC17:51
*** munimeha1 has quit IRC18:02
*** lemko has quit IRC18:49
*** pbourke has quit IRC23:47
*** pbourke has joined #openstack-loci23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!