Friday, 2020-02-07

*** Dinesh_Bhor has quit IRC02:21
*** Dinesh_Bhor has joined #openstack-oslo06:08
*** dkehn has quit IRC07:03
*** lpetrut has joined #openstack-oslo07:29
*** lpetrut has quit IRC07:30
*** lpetrut has joined #openstack-oslo07:31
*** rpittau|afk is now known as rpittau08:10
*** tkajinam has quit IRC08:12
*** iurygregory has joined #openstack-oslo08:19
*** tesseract has joined #openstack-oslo08:36
*** ralonsoh has joined #openstack-oslo08:41
*** tosky has joined #openstack-oslo08:48
AJaegerstephenfin, hberaud, here's a py27 cleanup for openstackdocstheme, could you review this, please? https://review.opendev.org/70608208:55
hberaudAJaeger: o/ ack08:55
hberaudomw08:55
AJaegerthanks!09:00
hberaudAJaeger: done09:02
openstackgerritMerged openstack/openstackdocstheme master: [ussuri][goal] Drop python 2.7 support and testing  https://review.opendev.org/70608209:06
*** obondarev has joined #openstack-oslo09:09
obondarevharlowja: hi, could you please check https://bugs.launchpad.net/neutron/+bug/1862315/comments/2 ?09:10
openstackLaunchpad bug 1862315 in neutron "Sometimes VMs can't get IP when spawned concurrently" [High,New] - Assigned to Oleg Bondarev (obondarev)09:10
obondarevharlowja: it’s a question about read_lock from the fasteners lib09:11
openstackgerritHervé Beraud proposed openstack/oslo.db master: Ignore releasenote artifacts files.  https://review.opendev.org/70548609:12
openstackgerritHervé Beraud proposed openstack/oslo.db master: reword releasenote for py27 support dropping  https://review.opendev.org/70644809:12
openstackgerritHervé Beraud proposed openstack/oslo.db master: reword releasenote for py27 support dropping  https://review.opendev.org/70620609:14
*** AJaeger has left #openstack-oslo09:16
hberaudobondarev: harlowja isn't really active on oslo/openstack nowaday09:18
obondarevhberaud: I see.. thanks. Do you by any chance know how to contact him?09:19
hberaudobondarev: you might try directly on https://github.com/harlowja/fasteners/ ... maybe by chance09:20
obondarevhberaud: got it, thanks!09:23
hberaudobondarev: you're welcome09:23
hberaudobondarev: what's your needs?09:26
obondarevhberaud: I think there might be a bug in the lib, described in https://bugs.launchpad.net/neutron/+bug/1862315/comments/209:27
openstackLaunchpad bug 1862315 in neutron "Sometimes VMs can't get IP when spawned concurrently" [High,New] - Assigned to Oleg Bondarev (obondarev)09:27
hberaudobondarev: are you using oslo.concurrency?09:27
hberaudobondarev: or directly fasteners?09:27
obondarevhberaud: yes, neutron uses oslo.concurrency09:28
hberaudobondarev: https://github.com/openstack/oslo.concurrency/blob/master/oslo_concurrency/lockutils.py09:28
hberaudobondarev: ok09:28
obondarevhberaud: here https://github.com/openstack/oslo.concurrency/blob/master/oslo_concurrency/lockutils.py#L8309:29
* hberaud look09:29
hberaudif I understand your case correctly you spawn 2 different process who needs to lock on ressource (the IP)? I'm right?09:31
hberaudobondarev: ^^09:31
obondarevhberaud: let me try to explain it..09:32
hberaudobondarev: go wild09:32
obondarevhberaud: neutron dhcp agent has a “resync” thread which takes a write lock from ReaderWriterLock. Also it spawns many threads to process regular events (resource changes) - these threads are taking read locks from the same ReaderWriterLock09:33
hberaudobondarev: ok got it09:34
obondarevhberaud: “resync” thread is supposed to be of highest priority and block all other threads09:34
obondarevbut it seems that many “reader” threads can actually block “writer” thread, because not checking for pending writers09:36
hberaudoh ok09:36
hberaudobondarev: then yes it's fasteners's internal mechanisms here as you already pointed out in your LP, I'll try to keep an eye on this topic too and try to do some local tests09:41
obondarevhberaud: great, thank you!09:41
hberaudobondarev: if I get some info I'll forward to you09:41
obondarevhberaud: cool!09:42
*** purplerbot has quit IRC10:50
*** purplerbot has joined #openstack-oslo10:51
*** rpittau is now known as rpittau|bbl11:18
openstackgerritStephen Finucane proposed openstack/oslo.versionedobjects master: [ussuri][goal] Drop python 2.7 support and testing  https://review.opendev.org/70572511:45
openstackgerritStephen Finucane proposed openstack/oslo.versionedobjects master: Switch from inspect.getargspec to inspect.getfullargspec  https://review.opendev.org/70050911:45
openstackgerritStephen Finucane proposed openstack/oslo.versionedobjects master: Drop use of six  https://review.opendev.org/70647611:45
openstackgerritStephen Finucane proposed openstack/oslo.versionedobjects master: Bump to hacking 2.x  https://review.opendev.org/70647711:45
openstackgerritMerged openstack/oslo.rootwrap master: Remove universal wheel configuration  https://review.opendev.org/70633611:48
*** raildo has joined #openstack-oslo12:02
openstackgerritMerged openstack/oslo.versionedobjects master: gitignore: Ignore reno artefacts  https://review.opendev.org/70396913:05
*** rpittau|bbl is now known as rpittau13:14
*** Luzi has joined #openstack-oslo13:16
*** ansmith has quit IRC13:32
*** ansmith has joined #openstack-oslo13:32
*** gmann_ has joined #openstack-oslo13:40
*** gmann_ is now known as gmann13:40
*** gmann has quit IRC13:40
*** gmann has joined #openstack-oslo13:41
*** yan0s has joined #openstack-oslo14:00
*** lbragstad has quit IRC14:17
*** tesseract-RH has joined #openstack-oslo14:19
*** lbragstad has joined #openstack-oslo14:19
*** tesseract has quit IRC14:21
*** tesseract has joined #openstack-oslo14:34
*** tesseract has quit IRC14:43
*** tesseract-RH has quit IRC14:43
*** tesseract has joined #openstack-oslo14:44
*** Luzi has quit IRC14:45
dansmithstephenfin: so, have you thought about or considered trying to recreate the getargspec output from the getfullargspec so that our hashes won't change?14:49
stephenfindansmith: I have, but the issue is that getargspec is apparently buggy and doesn't handle "function annotations and keyword-only parameters."14:51
stephenfinFrom https://docs.python.org/3/library/inspect.html#inspect.getargspec14:51
dansmithI know that it doesn't14:51
dansmithbecause it existed before those things14:51
dansmithwe don't have those things in nova at least, which would mean we should be able to generate the same fingerprint I would think14:52
dansmithand if we can know whether or not those things are used, we could use the old or new method depending on whether or not we have those, because once someone adds a kw-only param to something the fingerprint would change anyway14:53
dansmithI'm not even sure about the rpc impact of using one, so I'd have to think about that anyway14:53
dansmithI guess I will try to put up a parallel patch and see how it goes14:57
openstackgerritCyril Roelandt proposed openstack/oslo.log master: Switch to hacking 2.x  https://review.opendev.org/70653815:00
*** rpittau is now known as rpittau|brb15:04
*** lpetrut has quit IRC15:08
*** rpittau|brb is now known as rpittau15:20
openstackgerritDan Smith proposed openstack/oslo.versionedobjects master: Provide stable getargspec() behavior for method fingerprinting  https://review.opendev.org/70654815:43
dansmithstephenfin: ^ so that won't pass our own fast8 test because that runs on py2 and I can't define a method in the test to test the newer spec format without failing pep815:43
dansmithalso that made me think that maybe just "try: getargspec() except ValueError: getfullargspec()" would be plenty of compat without my namedtuple that I add there15:44
dansmithit would generate the deprecation warning, which i assume is like the worst possible thing you can imagine15:45
dansmithbut Ieft it in there from my debugging because I can't run pep8 anyway15:45
dansmithbut, point is, generating a compatible spec is possible15:46
stephenfindansmith: I don't care about the DeprecationWarning (except for it blowing up subunit :/), so much as what it indicates15:46
stephenfinJust replied but tl;dr: my reasoning was take the hit now to avoid further pain down the line15:47
dansmiththat we're a mature product and don't break users unless there's a major reason to? :)15:47
stephenfin"This feature is being entirely removed from Python" seems pretty major :)15:48
stephenfinbut lemme check that solution. If it works, why not15:48
dansmithwhen that happens, then sure, but your reply just now sounds like actually removing it was not very popular15:49
dansmithtake away the first try..except for debugging and it generates the same spec for methods that don't need the full one, even without calling the deprecated method15:50
stephenfinremoving getfullargspec (not getargspec) was not, because it provides a mostly compatible bridge for Py2-Py3 compatible code15:50
stephenfinas for the pep8 issues, I suspect you want https://review.opendev.org/#/c/706477/15:50
dansmithoh I see15:50
dansmithah yeah15:50
dansmithwell, I can reorder that whole series if you want, with the pep8 thing under my fix, cleaned up and ready15:51
dansmithif you're happy with that soluton15:51
stephenfinYeah, looks pretty good to me. Just so I'm clear, there's no reason to keep the try-except if we don't have to support Python 2, right?15:54
stephenfini.e. if it's rebased onto the "remove py27" patch15:54
dansmiththere's no reason to keep it at all in that code15:54
dansmithit was just for debugging, you see spec is never used15:54
stephenfinAh, I understand now15:54
stephenfinSweet. Yeah, wfm15:55
dansmithokay, will reorder that whole stack and clean this up15:55
stephenfinSweet. Thanks for looking at that15:55
*** bnemec has quit IRC15:55
*** bnemec has joined #openstack-oslo15:56
dansmithstephenfin: er, that hacking patch doesn't seem to make pep8 run on python315:59
dansmithif you can point me at a patch to do that for some other project I can add it in here16:00
dansmither, actually maybe I need to rebuild my pep8 venv16:00
smcginnisIs basepython=python3 actually supposed to be under [testenv] instead of [tox]?16:00
smcginnisOtherwise it looks like it should work.16:01
dansmithyeah, still fails after rebuild16:01
stephenfindansmith: it should. Wanna push it up anyway and I'll take a look?16:01
dansmithmoving to testenv makes it work16:02
smcginnisThat hacking patch's pep8 job ran with python3.6.16:02
dansmithsmcginnis: when I run it here I get all the py2.7 deprecation messages and failure to install o.vo because of the py3 requirement16:03
smcginnisHuh, odd.16:03
dansmithstephenfin: I'm not sure what's up with that sys import removal either16:04
smcginnisdansmith: pep8 for your patch works for me.16:04
smcginnis./oslo_versionedobjects/fixture.py:221:9: F841 local variable 'spec' is assigned to but never used16:05
dansmithsmcginnis: weird, I don't get it16:05
dansmithif I move it to testenv it works fine, move it back, it runs in py216:05
openstackgerritDan Smith proposed openstack/oslo.versionedobjects master: [ussuri][goal] Drop python 2.7 support and testing  https://review.opendev.org/70572516:06
openstackgerritDan Smith proposed openstack/oslo.versionedobjects master: Drop use of six  https://review.opendev.org/70647616:06
openstackgerritDan Smith proposed openstack/oslo.versionedobjects master: Bump to hacking 2.x  https://review.opendev.org/70647716:06
smcginnisNot sure what the difference would be in environment, but I've always set that under testenv, so that may be the "more correct" way to do it.16:06
openstackgerritDan Smith proposed openstack/oslo.versionedobjects master: Provide stable getargspec() behavior for method fingerprinting  https://review.opendev.org/70654816:06
dansmithwell, here it is ^16:06
dansmithstephenfin also randomly removed a sys import from exception in his getargspec patch, but I'm not sure why that wasn't failing before, so I figure it probably belongs in some other patch -- maybe the flake8 one16:07
*** tesseract has quit IRC16:38
*** yan0s has quit IRC16:43
*** tesseract has joined #openstack-oslo16:57
*** rpittau is now known as rpittau|afk17:02
openstackgerritStephen Finucane proposed openstack/oslo.versionedobjects master: Drop use of six  https://review.opendev.org/70647617:07
openstackgerritStephen Finucane proposed openstack/oslo.versionedobjects master: Bump to hacking 2.x  https://review.opendev.org/70647717:07
openstackgerritStephen Finucane proposed openstack/oslo.versionedobjects master: Provide stable getargspec() behavior for method fingerprinting  https://review.opendev.org/70654817:07
*** tesseract has quit IRC17:36
*** tosky has quit IRC17:40
*** obondarev has quit IRC17:40
openstackgerritDan Smith proposed openstack/oslo.versionedobjects master: Drop use of six  https://review.opendev.org/70647618:37
openstackgerritDan Smith proposed openstack/oslo.versionedobjects master: Bump to hacking 2.x  https://review.opendev.org/70647718:37
openstackgerritDan Smith proposed openstack/oslo.versionedobjects master: Provide stable getargspec() behavior for method fingerprinting  https://review.opendev.org/70654818:37
*** mmethot has joined #openstack-oslo20:07
*** mmethot_ has quit IRC20:09
*** lbragstad has quit IRC20:48
*** raildo_ has joined #openstack-oslo21:34
*** raildo has quit IRC21:37
*** raildo_ has quit IRC21:53
*** iurygregory has quit IRC22:29
*** tosky has joined #openstack-oslo22:31
*** camelCaser has quit IRC22:57
*** camelCaser has joined #openstack-oslo22:58
*** ralonsoh has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!