Thursday, 2018-10-25

*** gyee has quit IRC00:14
*** lixiaoy1 has joined #openstack-glance00:30
*** Liang__ has joined #openstack-glance01:00
*** bhagyashris has joined #openstack-glance01:08
*** brinzhang has joined #openstack-glance01:13
*** Liang__ is now known as LiangFang01:30
*** mhen has quit IRC01:40
*** mhen has joined #openstack-glance01:45
*** MattMan_ has quit IRC01:47
*** MattMan_ has joined #openstack-glance01:48
*** itlinux has quit IRC03:17
*** aniketh has joined #openstack-glance03:21
*** lbragstad has quit IRC04:00
*** udesale has joined #openstack-glance04:27
*** brinzh has joined #openstack-glance04:33
*** brinzhang has quit IRC04:36
*** abhishekk has joined #openstack-glance04:43
*** ratailor has joined #openstack-glance04:58
*** kushalAgrawal has joined #openstack-glance05:31
*** brinzhang has joined #openstack-glance05:43
*** brinzh has quit IRC05:45
*** pdeore has joined #openstack-glance05:56
*** Luzi has joined #openstack-glance06:00
*** rcernin has quit IRC07:00
*** pcaruana has joined #openstack-glance07:04
*** mosulica has joined #openstack-glance07:27
*** ratailor_ has joined #openstack-glance07:56
*** ratailor has quit IRC07:57
*** lixiaoy1 has quit IRC08:54
*** ratailor has joined #openstack-glance09:22
*** ratailor_ has quit IRC09:23
*** KeithMnemonic has joined #openstack-glance09:40
*** LiangFang has quit IRC09:42
*** ratailor_ has joined #openstack-glance09:43
*** ratailor has quit IRC09:46
*** bhagyashris has quit IRC10:04
*** aniketh has quit IRC10:10
*** KeithMnemonic has quit IRC10:16
*** KeithMnemonic has joined #openstack-glance10:28
*** udesale has quit IRC10:36
*** KeithMnemonic has quit IRC10:42
*** KeithMnemonic has joined #openstack-glance10:42
*** KeithMnemonic has quit IRC11:01
*** KeithMnemonic has joined #openstack-glance11:07
*** abhishekk has quit IRC11:23
*** aniketh has joined #openstack-glance11:40
*** pdeore has quit IRC11:40
*** openstackgerrit has joined #openstack-glance11:44
openstackgerritwanghui proposed openstack/glance-specs master: Update tox minversion to 2.0  https://review.openstack.org/61328411:44
*** ratailor_ has quit IRC12:01
*** jistr_ is now known as jistr12:14
*** KeithMnemonic has quit IRC12:19
*** zul has joined #openstack-glance12:19
*** rosmaita has joined #openstack-glance12:25
*** pcaruana has quit IRC12:26
*** pcaruana has joined #openstack-glance12:39
*** brinzhang has quit IRC12:53
*** kushalAgrawal has quit IRC13:00
*** pdeore has joined #openstack-glance13:14
pdeoreCan I get some review on this spec-lite? https://review.openstack.org/#/c/609331/ please ?13:16
*** abhishekk has joined #openstack-glance13:17
pdeorejokke_, rosmaita, smcginnis ^^13:17
smcginnispdeore: Looking...13:19
pdeoresmcginnis, Thanks!!13:19
rosmaitapdeore: got a revision request, see the review13:20
pdeorerosmaita, ack13:21
*** jistr is now known as jistr|call13:29
*** d0ugal has quit IRC13:33
*** lbragstad has joined #openstack-glance13:33
*** d0ugal has joined #openstack-glance13:34
*** pcaruana has quit IRC13:37
*** Liang__ has joined #openstack-glance13:48
*** d0ugal has quit IRC13:49
*** Liang__ is now known as LiangFang13:49
*** Luzi has quit IRC13:57
*** rosmaita has quit IRC14:00
*** rosmaita has joined #openstack-glance14:01
*** pdeore has quit IRC14:01
-openstackstatus- NOTICE: Zuul and Nodepool services are being restarted to migrate them to a new Zookeeper cluster. THis brings us an HA database running on newer servers.14:39
*** jistr|call is now known as jistr14:50
jokke_rosmaita: abhishekk smcginnis15:00
rosmaitao/15:01
abhishekko/15:01
smcginniso/15:01
jokke_ok ... so15:01
rosmaitajokke_: smcginnis: need you two to approve https://review.openstack.org/#/c/612706/15:01
*** Luzi has joined #openstack-glance15:01
jokke_I think, like I wrote down to meeting channel, we need to backport, cut stable, then cut master15:02
rosmaitajokke_: need you to approve https://review.openstack.org/#/c/613074/15:02
rosmaitathose will finally turn off the periodic jobs in stable/rocky15:02
abhishekkdo I need to be around, if yes I will head back and will be back within 3 hours from now15:03
smcginnisrosmaita: And the reason we weren't just removing those was just consistency that going forward we won't have to remember to do that every time a branch is cut?15:03
rosmaitaabhishekk: no, i think we will be ok15:03
rosmaitasmcginnis: correct15:03
smcginnisabhishekk: Getting late there!15:03
abhishekkrosmaita, smcginnis yes15:04
abhishekkbut I can be online, if required drop me a mail15:04
smcginnisThanks abhishekk15:04
jokke_thanks abhishekk get home safe15:05
abhishekkyep, have a nice time ahead15:05
*** abhishekk has quit IRC15:05
rosmaitajokke_: smcginnis: backport of multihash-download-validation to stable/rocky glanceclient: https://review.openstack.org/#/c/613350/15:05
rosmaitasmcginnis: do we need to do a glanceclient release from master for s-1?15:06
smcginnisrosmaita: We can block that patch. Or we can update it to bump up the feature number to have the room in rocky.15:07
smcginnisWe will be generating release proposals every milestone for all cycle-with-intermediary libraries, so might be better to get it raised up and released now.15:08
rosmaitaok, that's really what i was asking15:08
rosmaitaso: (1) we will backport to stable/rocky and release 2.13.0 from there; (2) we will update smcginnis patch to release 2.14.0 from master on nov 115:09
smcginnis++, good plan to me.15:11
jokke_sounds good to me15:11
rosmaitasmcginnis: so the glanceclient doesn't have to be released today, just before nov 1 ?15:11
jokke_smcginnis: glance Stein-1 release patch is up15:11
smcginnisjokke_: Do we need that milestone release for openstack/glance for someone?15:11
smcginnisJust making sure you saw http://lists.openstack.org/pipermail/openstack-dev/2018-September/135088.html15:11
jokke_oh I'm pretty sure I did not15:12
rosmaitai definitely did not15:12
smcginnis:)15:13
jokke_smcginnis: ohh15:13
rosmaitaso we do not have to do an S-1 today15:13
jokke_I'll abandone it15:13
jokke_rosmaita: ever15:13
smcginnisHopefully it means less work.15:13
rosmaitait already has!15:13
smcginnisALways nice to have a deadline to keep things moving, but we hope to get rid of busy work if no one is actually consuming these milestone releases.15:14
jokke_rosmaita: what I'm reading from that mail is that the cycle-with-milestones release model is actually cycle-without-milestones15:14
rosmaita:)15:14
smcginnisWe can still do them, but we shouldn't do them if it's just because someone arbitrarily said it's time to do so.15:14
rosmaitai thnk smcginnis calls it "cycle-with-rc"15:14
smcginnisYep, I have a set of patches up to change the name.15:15
*** mosulica has quit IRC15:15
jokke_I have mixed feelings about that15:17
jokke_but I wasn't there to argue about the decision15:17
jokke_this would have made sense 2+years ago when most of the release stuff was still manual work tbh :D15:17
rosmaitasmcginnis: did you have a release patch up for glance store? i thought i saw one15:20
smcginnisrosmaita: Yes, let me find that.15:21
rosmaitathanks!15:21
smcginnishttps://review.openstack.org/#/c/612838/15:21
smcginnisjokke_: Honestly, I wasn't entirely for it initially either. But I think once we started talking through it some more, I started liking it more and more.15:22
jokke_ok, I need coffee ... brb15:22
rosmaitai thnk let's get abhishek's change to the config files in there before we release it15:22
smcginnisjokke_: You can still respond with any concerns there. Nothings ever set in stone.15:22
smcginnisrosmaita: OK, if you can -1 that and update it with the new hash, we can hold off. We have time.15:22
rosmaitagreat, will do15:23
jokke_smcginnis: For me it actually helped last cycle to see what was done. When Launchpad helps you track stuff based on tags15:23
jokke_also I know there's companies who uses those for tracking/planning their internal work15:24
jokke_specially as doing release is literally 1min job to throw the patch up15:24
rosmaitawe need to make sure abhishek sees http://lists.openstack.org/pipermail/openstack-dev/2018-September/135088.html15:25
*** Luzi has quit IRC15:26
rosmaitajust sent him an email15:26
-openstackstatus- NOTICE: The Zuul and Nodepool database transition is complete. Changes updated during the Zuul outage may need to be rechecked.15:30
openstackgerritLiang Fang proposed openstack/glance-specs master: Spec Lite: Show Store Info  https://review.openstack.org/61223615:38
*** LiangFang has quit IRC15:46
*** itlinux has joined #openstack-glance16:06
*** gyee has joined #openstack-glance16:16
*** jiaopengju has quit IRC16:18
imacdonnrosmaita: I just noticed a major error in my last rev of the spec-lite .. I'm not sure if you missed it, or read the error literally - I had "checksum will not be optional" ... I had changed it to "not required" then meant to change it to "optional", but neglected to remove the "not" :(16:19
*** jiaopengju has joined #openstack-glance16:21
rosmaitaoh, i thought you said "not optional" on purpose16:24
rosmaitai was wondering why you didn't just say "required", but decided not to nit pick16:24
rosmaitaso i read it as "all 3 are required"16:25
rosmaitaimacdonn: ^^16:25
*** mnaser has quit IRC16:26
rosmaitai thought we agreed yesterday that all 3 would be required ... or did i stop paying attention at some point?16:26
imacdonnrosmaita: OK, so we still need to reach agreement on that :/16:26
*** mnaser has joined #openstack-glance16:26
rosmaitaok,just read through yesterday's discussion.  looks like i agreed with myself that we should require all 316:29
imacdonnI think it's horrible to force people to implement a legacy mechanism that will never be of any value (if cinder implements multihash in Stein)16:32
imacdonnI think your argument is that images should look the same, whether created this way or via the "normal" methods16:32
imacdonnif that's the case, we should be mandating validation_data ... otherwise we can have to some images with none at all16:33
rosmaitawe need to provide the checksum as a fallback in case the algo is not available to the client16:34
rosmaitaplus, anyone using older clouds will have tooling built around the checksum16:34
imacdonnwhat sort of "client" do you have in mind here ?16:34
jokke_well that's why we stuck with the one configured algo16:35
jokke_so that the deployer knows what checksums it will get16:35
rosmaitayes, but if the deployer picks a weird one, no guarantee the client will have access to it16:36
imacdonnme interpretation was that multihash is based on hashlib, so any client is expected to either use hashlib or some equivalent that supports the same algorithms16:37
jokke_are you talking about client as in client used by nova and cinder or client as in client used by end user16:37
rosmaitaany consumer16:37
jokke_rosmaita: may I render you point invalid. One cannot set them at all if we mandate all 3 and the user doesn't have access to the algo the deployment is using16:38
rosmaitathat doesn't affect the consumer, though16:39
jokke_if deployer compiles openssl with different algos between glance and cinder/nova nodes, they can only blame themselves16:39
rosmaitai dont' see how this is at all controversial.  we have the md5sum as a fallback, let's use it16:39
jokke_and uses algo in glance that their conder/nova nodes doesn't support16:39
jokke_cinder16:39
imacdonnwe're conflating two separate issues here16:40
jokke_imacdonn: I do agree16:40
imacdonnone is forcing a specific algo for multihash, and the other is whether or not checksum is forced/required16:40
imacdonnpersonally, I hate it when software tells me whats best for me16:41
rosmaitawell, you will really hate this, because (1) the deployer picks the multihash algo, and (2) you must include md5sum as a backup for consumers who want to use it16:42
*** imacdonn has quit IRC16:42
jokke_rosmaita: the 2 was never agreed when the multihash spec was agreed on16:43
rosmaitaguess he really hated it!16:43
rosmaitajokke_: what do you mean?16:43
*** imacdonn has joined #openstack-glance16:43
imacdonngrr, stupid proxy server .. disconnects me every 24 hours :(16:43
imacdonnanyway ... if this didn't make it through: I *did* include checksum, but I don't want to make it *required*16:43
rosmaitain the spec: "We will leave MD5 calculations and checksums for backwards compatibility."16:44
jokke_rosmaita: the spec clearly states that the fallback for checksum is there for the cases multihash is not populated, not for "consumers who wants to use it"16:44
imacdonnI wonder if config options could provide a way around this .... could add smth like acceptable_hashing_algorithms and checksum_required16:44
rosmaitajokke_: i don't see that at all16:45
rosmaitaif that were the case, we wouldn't do md5 on new images16:45
imacdonnyou have to, though, if glance is calculating it ... either that, or you have to provide some way to make the decision about whether to calculate it or not16:46
imacdonnbased on either the request from the client, or maybe some config option (enable_checksum)16:46
imacdonnwithout something like that, you have to assume that it might be needed... and since you have the image contents already, it's "cheap" to calculate it16:50
jokke_rosmaita: as said yesterday we shouldn't anymore after we get the consuming services upgraded to version that actually consumes the hashes. On the work items there is clear mention of "fallback to checksum field when not present", that's for those old images that never got the multihash populated. the only point when one might end up to problem where no verification is done is during upgrade if gl16:51
jokke_ance is upgraded first and nova+cinder is not running supported client16:51
imacdonnwhereas in the "locations" case, the consumer can make the decision about whether or not the legacy checksum is needed ... and they may NOT have the image content at-hand16:51
rosmaitajokke_: read the problem description16:52
rosmaitait mentions "broader" coverage, not replacement coverage16:52
rosmaitaalso, "adding a new image will set all of checksum, os_hash_algo and os_hash_value fields" in the proposed change16:53
jokke_rosmaita: in that case we need to change the client to verify both16:53
jokke_because that's not what our implementaion does ;)16:53
jokke_as it stands in the current client implementation, the multihash replaced md5 operations with only fallback to md5 if multihash is not populated16:54
rosmaitaok, so you can file a bug16:55
rosmaitai still don't understand what the problem is with requiring all 316:55
rosmaitajokke_: i think https://review.openstack.org/#/c/613350/ got caught in the zuul restart ... if i do 'recheck' will that be enough to get it picked up?16:57
rosmaitaat least i don't see it on http://zuul.openstack.org/status16:58
jokke_rosmaita: because the md5 sum is redundant and not provided anymore by majority of image providers. Requiring all three is literally just making users life difficult without any good reason so far as it's not used as soon as multihash is present and the deployment is running supported configuration of software (as of Stein release when this will be available)16:58
jokke_rosmaita: recheck should do the trick on those16:59
rosmaitausers -- who?  someone who uses multiple openstack clouds and whose tooling is built around checksum?16:59
jokke_rosmaita: and that user can populate it in16:59
jokke_there is nothing in the proposal preventing providing the checksum17:00
imacdonnthe problem is that it places a pointless burden on ... someone .. either the image publisher or the end-user ... to download the image (some of our images are 50-80GB) and calculate a checksum that wil never actually be used for anything17:00
jokke_^^17:00
jokke_and for someone who is in panic "We need to get this updated image up there now!" that cycle is easily the difference of leaving the all the checksums out because that will just work17:01
jokke_which is promoting less secure behavior17:02
*** pcaruana has joined #openstack-glance17:03
jokke_we do not have anything in the code that enforces any of the checksums being there. Cinder will create volume and Nova will try to boot intance without any complaints if none of the fields are populated17:05
rosmaitayes, and that's too bad17:05
rosmaitayou can outvote me on the spec.  i think for this particular spec, we should require all 3.17:07
openstackgerritiain MacDonnell proposed openstack/glance-specs master: spec-lite: Embed validation data in locations  https://review.openstack.org/59764817:13
openstackgerritMerged openstack/glance_store master: Provision to add new config options in sample config file  https://review.openstack.org/60333117:19
*** mvkr has quit IRC17:50
*** zzzeek_ has joined #openstack-glance17:59
*** itlinux has quit IRC18:52
*** itlinux has joined #openstack-glance19:03
*** aniketh has quit IRC19:38
*** lbragstad has quit IRC19:43
*** lbragstad has joined #openstack-glance19:43
*** NostawRm has quit IRC19:45
*** irclogbot_1 has joined #openstack-glance20:00
*** irclogbot_1 has quit IRC20:22
*** imacdonn has quit IRC20:31
*** imacdonn has joined #openstack-glance20:32
*** jcosmao has quit IRC20:35
*** irclogbot_1 has joined #openstack-glance21:14
*** itlinux has quit IRC21:52
*** mvkr has joined #openstack-glance22:35
*** brinzhang has joined #openstack-glance23:52
*** gyee has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!