Wednesday, 2015-07-01

*** tsekiyam_ has joined #openstack-oslo00:12
openstackgerritJoshua Harlow proposed openstack/taskflow: Use encodeutils for exception -> string function  https://review.openstack.org/19245800:14
*** mtanino has quit IRC00:15
*** tsekiyama has quit IRC00:16
*** tsekiyam_ has quit IRC00:17
*** manishg has joined #openstack-oslo00:20
*** sputnik1_ has quit IRC00:21
*** manishg has quit IRC00:21
*** manishg has joined #openstack-oslo00:25
*** ViswaV has quit IRC00:26
*** peterstac has quit IRC00:27
*** ViswaV has joined #openstack-oslo00:28
*** sirushti has quit IRC00:28
*** sdake has quit IRC00:29
*** ViswaV has quit IRC00:32
openstackgerritBrant Knudson proposed openstack/oslo.cache: Docs for configure()  https://review.openstack.org/19738200:32
*** dims has joined #openstack-oslo00:32
*** ViswaV has joined #openstack-oslo00:33
openstackgerritBrant Knudson proposed openstack/oslo.cache: Fix docs for get_memoization_decorator  https://review.openstack.org/19738300:33
*** sirushti has joined #openstack-oslo00:33
openstackgerritBrant Knudson proposed openstack/oslo.cache: Remove useless docs from private functions  https://review.openstack.org/19738400:33
*** peterstac has joined #openstack-oslo00:34
openstackgerritBrant Knudson proposed openstack/oslo.cache: Fix docstring for configure_cache_region  https://review.openstack.org/19738500:34
openstackgerritBrant Knudson proposed openstack/oslo.cache: Make DebugProxy private  https://review.openstack.org/19738600:35
*** dims_ has joined #openstack-oslo00:35
openstackgerritMerged openstack/oslo.config: fix fixture tests for fixtures 1.3.x  https://review.openstack.org/19729900:36
krotschecklifeless: Tell ya what. You go work on the speed at which it takes to actually land code, and remove some of the barriers which force any meaningful work to take months to land, and I'll promise that it'll free up enough time for me to handle that change you want :)00:37
*** manishg has quit IRC00:37
* krotscheck has already lost weeks in rechecks.00:38
krotscheckNot to mention spec revisions.00:38
*** dims has quit IRC00:39
lifelesskrotscheck: that is what I'm trying to accomplish00:49
lifelesskrotscheck: the first cab off the rank is reducing gate wedges which break and stall everyone00:50
*** ViswaV has quit IRC00:51
*** crc32 has quit IRC00:55
*** sigmavirus24 is now known as sigmavirus24_awa00:58
*** boris-42 has quit IRC01:02
*** stevemar has joined #openstack-oslo01:02
*** Rockyg has joined #openstack-oslo01:03
stevemardims_: bknudson ughhhh we privatized one thing too many01:09
dims_ha :)01:09
stevemardims_: ugh, give me a minute to fix this01:12
openstackgerritBrant Knudson proposed openstack/oslo.cache: Don't use global conf  https://review.openstack.org/19738901:13
openstackgerritSteve Martinelli proposed openstack/oslo.cache: make REGION public  https://review.openstack.org/19739101:17
*** manishg has joined #openstack-oslo01:23
*** zzzeek has quit IRC01:23
*** Rockyg has quit IRC01:28
*** sputnik13 has joined #openstack-oslo01:30
*** sputnik13 has quit IRC01:31
*** sputnik13 has joined #openstack-oslo01:32
*** sputnik13 has quit IRC01:33
*** sputnik1_ has joined #openstack-oslo01:33
*** rjaiswal has quit IRC01:34
openstackgerritMerged openstack/oslo.service: Track created thread and disallow more than one start being active  https://review.openstack.org/19535801:34
*** edleafe has quit IRC01:35
*** edleafe has joined #openstack-oslo01:37
*** sputnik1_ has quit IRC01:37
stevemari wonder what bknudson is trying to say in his comment...01:40
*** sputnik13 has joined #openstack-oslo01:41
*** sputnik13 has quit IRC01:41
*** yamahata has quit IRC02:05
*** ajo has quit IRC02:08
openstackgerritSteve Martinelli proposed openstack/oslo.cache: make REGION public  https://review.openstack.org/19739102:09
*** sdake has joined #openstack-oslo02:11
*** ajo has joined #openstack-oslo02:11
*** mriedem has quit IRC02:16
openstackgerritMerged openstack/oslo.cache: Fix docs for get_memoization_decorator  https://review.openstack.org/19738302:22
openstackgerritMerged openstack/oslo.cache: Docs for configure()  https://review.openstack.org/19738202:23
openstackgerritMerged openstack/oslo.cache: make REGION public  https://review.openstack.org/19739102:25
openstackgerritBrant Knudson proposed openstack/oslo.cache: Don't use global conf  https://review.openstack.org/19738902:25
openstackgerritMerged openstack/oslo.cache: Fix docstring for configure_cache_region  https://review.openstack.org/19738502:26
openstackgerritBrant Knudson proposed openstack/oslo.cache: Don't use global conf  https://review.openstack.org/19738902:28
*** tobe has joined #openstack-oslo02:29
*** manishg has quit IRC02:32
openstackgerritBrant Knudson proposed openstack/oslo.cache: Make DebugProxy private  https://review.openstack.org/19738602:32
*** Kennan has quit IRC02:38
openstackgerritMerged openstack/oslo.config: Fixes example for cfg  https://review.openstack.org/19553602:38
*** Kennan has joined #openstack-oslo02:38
openstackgerritMerged openstack/oslo.cache: Make DebugProxy private  https://review.openstack.org/19738602:51
openstackgerritMerged openstack/oslo.cache: Remove useless docs from private functions  https://review.openstack.org/19738402:52
openstackgerritSteve Martinelli proposed openstack/oslo.cache: Don't use global conf  https://review.openstack.org/19738902:56
stevemardims_: last one ^02:57
dims_oops pep8 failure02:58
dims_stevemar: ^^02:59
stevemargah02:59
stevemarffs02:59
openstackgerritSteve Martinelli proposed openstack/oslo.cache: Don't use global conf  https://review.openstack.org/19738903:00
stevemardims_: ^03:00
stevemargod damn, i need to update the keystone code now03:01
stevemarsince we'll be taking conf objects03:01
* stevemar shakes fist at brant03:01
openstackgerritMerged openstack/oslo.cache: Don't use global conf  https://review.openstack.org/19738903:10
stevemarhmmm, we should swap the order on one function03:11
openstackgerritSteve Martinelli proposed openstack/oslo.cache: swap the order of conf for a function  https://review.openstack.org/19740303:13
stevemardims_: brant ^03:13
openstackgerritSteve Martinelli proposed openstack/oslo.cache: swap the order of conf for a function  https://review.openstack.org/19740303:18
*** zzzeek has joined #openstack-oslo03:26
*** zzzeek has quit IRC03:26
openstackgerritSteve Martinelli proposed openstack/oslo.cache: swap the order of conf for a function  https://review.openstack.org/19740303:33
*** harlowja_at_home has joined #openstack-oslo03:40
*** jecarey has joined #openstack-oslo03:43
*** stevemar has quit IRC04:00
*** stevemar has joined #openstack-oslo04:01
*** dims_ has quit IRC04:03
*** harlowja_at_home has quit IRC04:15
*** achanda has joined #openstack-oslo04:19
*** jecarey has quit IRC04:21
*** morganfainberg is now known as caerbannograbbit04:24
*** caerbannograbbit is now known as CaerbannogRabbit04:24
openstackgerritJoshua Harlow proposed openstack/oslo.service: Ensure we set the event and wait on the timer in the test  https://review.openstack.org/19741504:25
*** tobe has quit IRC04:26
*** kzaitsev_mb has joined #openstack-oslo04:32
*** achanda has quit IRC04:38
*** browne1 has joined #openstack-oslo04:40
*** browne has quit IRC04:40
*** nkrinner has joined #openstack-oslo04:41
*** kzaitsev_mb has quit IRC04:46
openstackgerritSteve Martinelli proposed openstack/oslo.utils: Add fileutils to oslo_utils  https://review.openstack.org/15497504:46
*** rpodolyaka1 has joined #openstack-oslo04:47
*** eezhova has joined #openstack-oslo05:02
*** sreshetnyak has joined #openstack-oslo05:05
*** dims has joined #openstack-oslo05:07
*** exploreshaifali has joined #openstack-oslo05:10
*** dims has quit IRC05:12
*** arnaud____ has joined #openstack-oslo05:17
*** arnaud____ has quit IRC05:22
*** tobe has joined #openstack-oslo05:26
openstackgerritSteve Martinelli proposed openstack/oslo.policy: Move fileutils functions to oslo.policy  https://review.openstack.org/19742005:27
openstackgerritMerged openstack/taskflow: Updated from global requirements  https://review.openstack.org/19483605:30
*** rjaiswal has joined #openstack-oslo05:32
openstackgerritMerged openstack/futurist: Updated from global requirements  https://review.openstack.org/19626205:37
*** jgrimm is now known as zz_jgrimm05:55
*** rpodolyaka1 has quit IRC05:57
*** tobe has quit IRC05:59
*** e0ne has joined #openstack-oslo05:59
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.i18n: Imported Translations from Transifex  https://review.openstack.org/19742706:01
openstackgerritJoshua Harlow proposed openstack/taskflow: Add support for conditional execution  https://review.openstack.org/16492206:04
openstackgerritJoshua Harlow proposed openstack/taskflow: Add ability to reset an engine via a `reset` method  https://review.openstack.org/18623906:04
*** e0ne has quit IRC06:11
*** browne1 has quit IRC06:21
*** stevemar has quit IRC06:28
*** stevemar has joined #openstack-oslo06:28
*** stevemar has quit IRC06:31
*** rpodolyaka1 has joined #openstack-oslo06:34
openstackgerritJoshua Harlow proposed openstack/futurist: Ensure we check callback '_is_periodic' on add  https://review.openstack.org/19645706:36
*** yamahata has joined #openstack-oslo06:39
*** ViswaV has joined #openstack-oslo06:44
*** ViswaV_ has joined #openstack-oslo06:48
*** ViswaV has quit IRC06:48
*** tobe has joined #openstack-oslo06:53
*** sreshetnyak has quit IRC06:57
*** ndipanov has quit IRC06:57
*** sreshetnyak has joined #openstack-oslo06:57
openstackgerritPeng Wu proposed openstack/oslo.i18n: Support contextual and plural form of gettext functions  https://review.openstack.org/13485006:58
*** kzaitsev_mb has joined #openstack-oslo07:19
*** subscope has quit IRC07:24
*** ihrachyshka has joined #openstack-oslo07:28
*** sputnik13 has joined #openstack-oslo07:30
*** zz_jgrimm has quit IRC07:31
*** zz_jgrimm has joined #openstack-oslo07:33
*** kzaitsev_mb has quit IRC07:33
*** haypo has joined #openstack-oslo07:34
*** kzaitsev_mb has joined #openstack-oslo07:34
*** subscope has joined #openstack-oslo07:37
*** kzaitsev_mb has left #openstack-oslo07:39
*** rpodolyaka1 has quit IRC07:49
*** shardy has joined #openstack-oslo07:50
*** e0ne has joined #openstack-oslo07:56
*** shardy has quit IRC08:00
*** shardy has joined #openstack-oslo08:00
openstackgerritMerged openstack/oslo.db: Updated from global requirements  https://review.openstack.org/19726308:17
*** arnaud____ has joined #openstack-oslo08:23
*** ViswaV_ has quit IRC08:25
*** rpodolyaka1 has joined #openstack-oslo08:25
*** yamahata has quit IRC08:26
*** arnaud____ has quit IRC08:28
*** stevemar has joined #openstack-oslo08:30
*** stevemar has quit IRC08:34
*** exploreshaifali has quit IRC08:35
*** yassine__ has joined #openstack-oslo08:36
*** e0ne is now known as e0ne_08:36
*** e0ne_ is now known as e0ne08:38
*** dguitarbite has quit IRC08:40
*** e0ne has quit IRC08:41
*** rjaiswal has quit IRC08:44
*** rpodolyaka1 has quit IRC08:49
*** pblaho has joined #openstack-oslo08:51
openstackgerritKairat Kushaev proposed openstack/oslo.config: Add allowed_length restriction fot StrOpt  https://review.openstack.org/19747709:04
*** viktors1 has joined #openstack-oslo09:05
*** viktors1 is now known as viktors|wfh09:06
*** exploreshaifali has joined #openstack-oslo09:06
*** rpodolyaka1 has joined #openstack-oslo09:07
*** dims has joined #openstack-oslo09:08
*** dims has quit IRC09:14
openstackgerritMerged openstack/oslo.middleware: Support PasteDeploy  https://review.openstack.org/19123809:19
*** katyafervent is now known as katyafervent_awa09:19
*** katyafervent_awa is now known as katyafervent09:20
*** ozamiatin has joined #openstack-oslo09:23
openstackgerritMerged openstack/oslo.config: Add set_default() method to fixture  https://review.openstack.org/19730009:25
*** ihrachyshka has quit IRC09:30
*** e0ne has joined #openstack-oslo09:35
openstackgerritMerged openstack/oslo.db: Add legacy get_sessionmaker() method  https://review.openstack.org/19688509:39
*** sdake has quit IRC09:46
*** ozamiatin has quit IRC09:49
*** ozamiatin has joined #openstack-oslo09:52
*** dims has joined #openstack-oslo09:59
*** ihrachyshka has joined #openstack-oslo09:59
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.config: Updated from global requirements  https://review.openstack.org/19726210:01
haypojd__: seen in nova: now = timeutils.parse_isotime(timeutils.strtime())10:01
jd__haypo: I know, I know…10:01
haypohaha10:02
haypojd__: did you propose a patch to replace strtime with .isoformat()? i'm asking because i'm writing such patch :)10:02
dimsviktors: rpodolyaka: can you please take a peek at https://review.openstack.org/#/c/195578/ (oslo.db change in support of a nova test)10:03
haypojd__: oh. timeutils.parse_isotime(timeutils.strtime()) creates an aware datetime object using the UTC timezone10:04
hayporeplacing it with timeutils.utcnow() is not enough10:04
*** rpodolyaka1 has quit IRC10:05
haypojd__: we should start to use ".. versionchanged::" in doc, i don't remember which oslo.utils version introduced the with_timezone parameter to oslo_utils.timeutils.utcnow()10:06
hayposo, it was introduced in oslo.utils 1.610:08
haypoand now master requires oslo.utils >= 1.6, good :)10:11
*** stevemar has joined #openstack-oslo10:19
*** stevemar has quit IRC10:22
openstackgerritFlorian Wilhelm proposed openstack-dev/pbr: Fix retrieval of commit data and most recent tag.  https://review.openstack.org/19750810:34
*** ndipanov has joined #openstack-oslo10:36
openstackgerritFlorian Wilhelm proposed openstack-dev/pbr: Fix retrieval of commit data and most recent tag.  https://review.openstack.org/19495410:38
*** exploreshaifali has quit IRC10:39
*** e0ne is now known as e0ne_10:39
*** e0ne_ is now known as e0ne10:39
haypo      File "/home/haypo/prog/openstack/nova/.tox/py27/lib/python2.7/site-packages/oslo_utils/timeutils.py", line 108, in parse_strtime10:40
haypo        return datetime.datetime.strptime(timestr, fmt)10:40
haypo    ValueError: time data '2015-07-01T10:35:15' does not match format '%Y-%m-%dT%H:%M:%S.%f'10:40
haypojd__: ^^ too bad10:40
haypo(i will investigate that later)10:40
*** amrith is now known as _amrith_10:43
*** rpodolyaka1 has joined #openstack-oslo10:56
rpodolyaka1dims: sorry, was afk. I'll tweak the unit test a bit and +211:04
dimsrpodolyaka1: no worries11:05
*** e0ne is now known as e0ne_11:24
*** e0ne_ is now known as e0ne11:24
*** pradk has joined #openstack-oslo11:34
*** prad has quit IRC11:36
*** pradk has quit IRC11:40
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Remove qpid-config call  https://review.openstack.org/19472311:46
*** tobe has quit IRC11:46
*** ozamiatin has quit IRC11:52
*** ozamiatin has joined #openstack-oslo11:52
*** ozamiatin has joined #openstack-oslo11:53
openstackgerritVipin Balachandran proposed openstack/oslo.vmware: Update log level of session re-creation logs  https://review.openstack.org/19753611:56
*** jaosorior has joined #openstack-oslo11:56
openstackgerritRoman Podoliaka proposed openstack/oslo.db: Allow projects that use test_models_sync to filter some changes  https://review.openstack.org/19557811:57
openstackgerritVipin Balachandran proposed openstack/oslo.vmware: Update log level of session related logs  https://review.openstack.org/19753612:00
haypojd__: so in short, it's not possible to replace timeutils.strtime(ts) with ts.isoformat() without breaking backward compatibility (with applications using timeutils.parse_strtime()) :-(12:09
*** marcusvrn has left #openstack-oslo12:13
jd__haypo: I've changed many app to use parse_isotime instead12:18
jd__haypo: in many place we can probably do that as parse_isotime() is a superset of parse_strtime()12:18
haypojd__: oh good to know12:18
haypojd__: but is it possible to upgrade one service (ex: nova-compute) and then the others?12:19
*** _amrith_ is now known as amrith12:19
haypoi mean, the new nova-compute may create timestamp that old services may be unable to parse?12:19
*** rpodolyaka1 has quit IRC12:19
*** rpodolyaka1 has joined #openstack-oslo12:20
*** shardy has quit IRC12:27
*** zigo has quit IRC12:28
*** zigo has joined #openstack-oslo12:29
*** shardy has joined #openstack-oslo12:31
*** ozamiatin has quit IRC12:31
*** ozamiatin has joined #openstack-oslo12:32
jd__haypo: yeah you need to upgrade the parse_strtime to parse_isotime first12:36
jd__haypo: I did that for nova/context a while back12:36
dimsjd__: haypo: one of you please bless this? https://review.openstack.org/#/c/181980/12:40
haypodims: oh, i was checking oslo.utils in OpenStack :)12:41
*** e0ne is now known as e0ne_12:41
dimshaypo: aha12:41
haypodims: +2a12:42
*** e0ne_ is now known as e0ne12:42
haypodims: see https://review.openstack.org/197546 for oslo.utils in nova12:42
dimshaypo: ack will do in a little bit12:43
haypojd__: oh wait, parse_isotime() is not a drop in replacement. it also adds a timezone, UTC by default12:44
haypojd__: handling time is much complex than what i expected /o\ (again)12:44
*** bknudson has joined #openstack-oslo12:45
jd__haypo: yeah but you can normalize_time()12:45
haypojd__: parse_isodate(ts).replace(tz=None)? :-D12:46
jd__haypo: NO12:49
jd__haypo: timeutils.normalize_time :)12:49
*** exploreshaifali has joined #openstack-oslo12:50
haypolol12:51
openstackgerritMerged openstack/oslo.cache: swap the order of conf for a function  https://review.openstack.org/19740312:53
*** e0ne is now known as e0ne_12:53
*** rpodolyaka1 has quit IRC12:55
*** e0ne_ is now known as e0ne12:57
*** rpodolyaka1 has joined #openstack-oslo12:58
*** kairat_kushaev has joined #openstack-oslo12:59
*** jecarey has joined #openstack-oslo13:00
*** shardy has quit IRC13:01
*** shardy has joined #openstack-oslo13:01
kairat_kushaevHi guys, I noticed that oslo_cache released recently. I have a question.13:03
*** kbyrne has quit IRC13:03
kairat_kushaevWhat is the difference between Noop backend and null backend available in dogpile cache 0.5.13:03
kairat_kushaev*0.5.413:04
*** ihrachyshka_ has joined #openstack-oslo13:07
*** ihrachyshka has quit IRC13:08
kairat_kushaevDon't we need to get rid of NoOp backend in oslo.cache?13:08
*** stpierre has joined #openstack-oslo13:08
*** stevemar has joined #openstack-oslo13:12
openstackgerritSergey Vilgelm proposed openstack/oslo.messaging: Use ServiceBase from oslo.service as a parent class  https://review.openstack.org/19757413:15
*** kbyrne has joined #openstack-oslo13:22
openstackgerritMerged openstack/oslo.i18n: Add tox target to find missing requirements  https://review.openstack.org/19584513:22
*** mriedem has joined #openstack-oslo13:27
*** stevemar has quit IRC13:27
*** browne has joined #openstack-oslo13:28
openstackgerritMerged openstack/oslo.log: Add tox target to find missing requirements  https://review.openstack.org/19584413:35
haypoi hate mox. probably since i know that mock exists :)13:35
openstackgerritMerged openstack/oslo.i18n: Imported Translations from Transifex  https://review.openstack.org/19742713:36
haypohow can I write mock.ANY with mox?13:36
haypo        timeutils.parse_isotime(self.mox.ANY)13:36
haypo^^ i need to insert somewhere that parse_isotime was called13:37
openstackgerritMerged openstack/oslo.serialization: Remove oslo namespace package  https://review.openstack.org/18198013:38
openstackgerritMerged openstack/oslo.serialization: Add tox target to find missing requirements  https://review.openstack.org/19583813:38
openstackgerritMerged openstack/oslo.utils: Add tox target to find missing requirements  https://review.openstack.org/19583713:42
dimsviktors: rpodolyaka: can you check if you see a problem with cinder + latest oslo.db? i think i am seeing a unit test failure13:45
dimsviktors: rpodolyaka: {7} cinder.tests.unit.test_migrations.TestSqliteMigrations.test_walk_versions [60.571445s] ... FAILED13:45
*** dbite has quit IRC13:46
*** pradk has joined #openstack-oslo13:46
openstackgerritMerged openstack/oslo.config: Updated from global requirements  https://review.openstack.org/19726213:47
rpodolyaka1dims: will do13:49
*** ozamiatin has quit IRC13:56
*** zzzeek has joined #openstack-oslo13:56
*** dims has quit IRC13:59
rpodolyaka1dims: works for me locally… will try the whole test suite14:00
*** dims has joined #openstack-oslo14:00
dimsrpodolyaka: thanks14:01
*** mtanino has joined #openstack-oslo14:02
openstackgerritBrant Knudson proposed openstack/oslo.cache: Use "group" rather than "section"  https://review.openstack.org/19759714:02
*** manishg has joined #openstack-oslo14:02
*** subscope has quit IRC14:03
*** exploreshaifali has quit IRC14:03
*** e0ne is now known as e0ne_14:08
*** amrith is now known as _amrith_14:11
*** sigmavirus24_awa is now known as sigmavirus2414:12
*** ozamiatin has joined #openstack-oslo14:15
viktors|wfhdims: works for me locally. Where did you seen this error?14:15
haypojd__: my "giant" patch replacing parse_strtime() with parse_isotime() in nova: https://review.openstack.org/#/c/197601/14:16
openstackgerritMerged openstack/oslo.db: Allow projects that use test_models_sync to filter some changes  https://review.openstack.org/19557814:17
dimsviktors|wfh: looks like it timed out for me - https://s3.amazonaws.com/archive.travis-ci.org/jobs/69113049/log.txt14:18
dimsviktors|wfh: could be the environment i am running in. don't worry about it, i'll try tweaking a few things there14:19
jd__haypo: congrats14:19
haypojd__: it was more complex than my first command sed -i -e 's,timeutils\.parse_strtime,timeutils.parse_isotime,g' $(find nova -name "*.py")14:19
haypojd__: please wait until the patch is merged to congrat me :)14:20
viktors|wfhdims: ok14:20
*** manishg has quit IRC14:21
openstackgerritMerged openstack/automaton: When a state has no transitions show its own `on_exit` and `on_enter`  https://review.openstack.org/19148214:22
openstackgerritMerged openstack/oslo.config: Add tox target to find missing requirements  https://review.openstack.org/19584914:22
haypojd__: it's strange. i didn't get any error related to unaware/aware datetime objects yet14:23
*** rpodolyaka1 has quit IRC14:23
openstackgerritMerged openstack/automaton: Add and use a callback name fetching utility function  https://review.openstack.org/19649514:24
*** shardy has quit IRC14:24
*** shardy has joined #openstack-oslo14:24
*** _amrith_ is now known as amrith14:27
*** stevemar has joined #openstack-oslo14:28
*** stevemar has quit IRC14:32
*** zz_jgrimm is now known as jgrimm14:32
*** pblaho has quit IRC14:34
*** pblaho has joined #openstack-oslo14:34
*** yamahata has joined #openstack-oslo14:37
*** rpodolyaka1 has joined #openstack-oslo14:40
*** kgiusti has joined #openstack-oslo14:41
openstackgerritMerged openstack-dev/pbr: Updated from global requirements  https://review.openstack.org/19724914:41
*** gordc_af1 has joined #openstack-oslo14:41
*** Nakato_ has joined #openstack-oslo14:41
*** nikhil_k1away has joined #openstack-oslo14:42
openstackgerritMerged openstack/oslo.i18n: clarify translation policy  https://review.openstack.org/19733914:42
*** sputnik13 has quit IRC14:43
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo-incubator: prints --insecure if verify=False and debug=True  https://review.openstack.org/14417614:44
*** mtreinish_ has joined #openstack-oslo14:45
*** EmilienM_ has joined #openstack-oslo14:45
*** katyafervent_ has joined #openstack-oslo14:46
*** mtreinish has quit IRC14:46
*** rushiagr_away has quit IRC14:46
*** gordc_afk has quit IRC14:46
*** EmilienM has quit IRC14:46
*** rpodolyaka has quit IRC14:46
*** xylan_kong has quit IRC14:46
*** tchaypo has quit IRC14:46
*** kun_huang has quit IRC14:46
*** flaper87 has quit IRC14:46
*** Nakato has quit IRC14:46
*** katyafervent has quit IRC14:46
*** fungi has quit IRC14:46
*** nikhil_k-away has quit IRC14:46
*** ativelkov has quit IRC14:46
*** EmilienM_ is now known as EmilienM14:46
*** mtreinish_ is now known as mtreinish14:46
*** nkrinner has quit IRC14:47
*** rpodolyaka has joined #openstack-oslo14:47
*** ativelkov has joined #openstack-oslo14:47
*** flaper87 has joined #openstack-oslo14:49
*** flaper87 has quit IRC14:49
*** flaper87 has joined #openstack-oslo14:49
*** shardy has quit IRC14:49
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo-incubator: Remove quota module  https://review.openstack.org/18462614:50
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo-incubator: Crypto.Random.atfork before fetching random bytes  https://review.openstack.org/19158114:51
*** yassine__ has quit IRC14:51
*** fungi has joined #openstack-oslo14:54
*** xylan_kong has joined #openstack-oslo14:56
*** shardy has joined #openstack-oslo14:56
*** subscope has joined #openstack-oslo14:57
haypodims: for https://review.openstack.org/#/c/191581/ we should use os.urandom() instead (see my comment there)14:58
rpodolyaka1dims: gave the cinder issue another try - works just fine. must be something wrong with the env14:58
dimshaypo: see sean's comment before :) my first patch did have urandom :)14:58
dimsrpodolyaka1: thanks will do14:58
*** kun_huang has joined #openstack-oslo14:59
*** rpodolyaka1 has quit IRC14:59
dimshaypo: normal use yes, for keys, no was the gist of it15:00
openstackgerritMerged openstack/oslo-incubator: Add tools to clean up namespace package use  https://review.openstack.org/19526315:00
haypodims: see http://sockpuppet.org/blog/2014/02/25/safely-generate-random-numbers/15:01
*** rpodolyaka1 has joined #openstack-oslo15:01
dimshaypo: i know :)15:01
dimshaypo: you need to convince sdague :)15:02
haypodims: ah? so why did you replace os.urandom() with user-space CSPRNG with a known fork bug?15:02
openstackgerritSergey Nikitin proposed openstack/oslo.cache: Register backends in a cycle  https://review.openstack.org/19761915:03
*** manishg has joined #openstack-oslo15:03
dimshaypo: not sure what you mean, code in oslo-incubator has "from Crypto import Random"15:03
dimsand the patch is to make it work slightly better under forking15:04
*** rpodolyaka1 has quit IRC15:04
*** rpodolyaka3 has joined #openstack-oslo15:04
haypodims: your patch may make things worse15:04
dimshttps://review.openstack.org/#/c/191581/5/openstack/common/crypto/utils.py,cm15:04
haypodims: it's common that trying to fix a bug related to security introduce a new bug :)15:04
haypoPHP has at least two funny examples15:04
dimshaypo: all i am doing is calling re-initialize again15:05
dims"Crypto_Random.atfork()"15:05
dimsthe diff above does not have any os.urandom in it15:06
*** tchaypo has joined #openstack-oslo15:06
*** rpodolyaka3 has quit IRC15:07
*** e0ne_ is now known as e0ne15:07
haypodims: i'm not sure that it's correct to "re-initialize" a RNG15:07
*** rpodolyaka1 has joined #openstack-oslo15:08
haypodims: my collection of bugs in RNG, https://bitbucket.org/haypo/hasard/src/tip/doc/real_world.rst15:08
*** rpodolyaka1 has quit IRC15:08
haypo(Aug 2003) rand() & mt_rand() seed RNG at each call (call srand()/mt_srand()). http://bugs.php.net/bug.php?id=25007 http://svn.php.net/viewvc?view=revision&revision=13729415:08
dimshaypo: sdague is out this week, so next week let's raise it when he is here. FWIW, the current code fails for heat and needs fixing somehow. but let's debate with sean as you and he have a difference of opinion and i am just the middle man15:10
haypodims: "i am just the middle man" i know :) i just replied to sean's comment15:10
dimsthanks!15:10
dimshaypo: i know you are passionate so i don't take it personally, but please be gentle :)15:12
openstackgerritMerged openstack/oslo-incubator: prints --insecure if verify=False and debug=True  https://review.openstack.org/14417615:14
haypodims: oh, my comment was not kind?15:15
*** rpodolyaka1 has joined #openstack-oslo15:15
*** amrith is now known as _amrith_15:18
*** e0ne is now known as e0ne_15:19
haypodhellmann: you can unblock https://review.openstack.org/#/c/181984/ all dependencies have been merged, great job!15:19
haypodims: oh in fact, dhellmann already wrote a patch to drop the oslo namespace in oslo.utils. coolness15:20
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo.vmware: Add tox target to find missing requirements  https://review.openstack.org/19582415:20
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo.vmware: Updated from global requirements  https://review.openstack.org/19726815:20
*** e0ne_ is now known as e0ne15:20
*** rjaiswal has joined #openstack-oslo15:21
dimsy should try to get all the namespaces out soon15:21
dimsback in a bit getting on a call15:21
*** manishg has quit IRC15:27
openstackgerritLianhao Lu proposed openstack-dev/pbr: Use io.open() to open metadata files  https://review.openstack.org/19762615:29
*** rpodolyaka1 has quit IRC15:30
*** CaerbannogRabbit is now known as morganfainberg15:30
*** rpodolyaka1 has joined #openstack-oslo15:31
*** rpodolyaka1 has quit IRC15:35
*** tsekiyama has joined #openstack-oslo15:36
*** jaypipes has quit IRC15:37
*** manishg has joined #openstack-oslo15:38
*** pblaho has quit IRC15:39
*** pblaho has joined #openstack-oslo15:39
*** ashleighfarnham has joined #openstack-oslo15:42
*** pblaho has quit IRC15:50
*** pblaho has joined #openstack-oslo15:50
*** ashleighfarnham has quit IRC15:51
openstackgerritMerged openstack/futurist: Add periodics to doc features section  https://review.openstack.org/19585915:54
*** pblaho has quit IRC15:56
*** pblaho has joined #openstack-oslo15:58
*** stpierre has quit IRC16:02
*** rpodolyaka1 has joined #openstack-oslo16:12
*** harlowja_at_home has joined #openstack-oslo16:20
*** sputnik13 has joined #openstack-oslo16:22
*** manishg has quit IRC16:23
*** manishg has joined #openstack-oslo16:24
*** sdake has joined #openstack-oslo16:24
*** rushiagr_away has joined #openstack-oslo16:26
*** stpierre has joined #openstack-oslo16:30
*** tsbot_ has joined #openstack-oslo16:31
*** vilobhmm has joined #openstack-oslo16:35
*** harlowja_at_home has quit IRC16:37
*** manishg has quit IRC16:40
dimsativelkov: did you figure out how to fix the revert we did on o.vo?16:41
*** manishg has joined #openstack-oslo16:41
*** ashleighfarnham has joined #openstack-oslo16:59
*** browne has quit IRC17:02
*** ashleighfarnham has quit IRC17:02
*** ViswaV has joined #openstack-oslo17:03
*** sigmavirus24 is now known as sigmavirus24_awa17:04
*** yamahata has quit IRC17:07
*** ashleighfarnham has joined #openstack-oslo17:08
*** ViswaV has quit IRC17:08
*** ViswaV has joined #openstack-oslo17:09
*** vilobhmm has quit IRC17:10
*** vilobhmm has joined #openstack-oslo17:10
ativelkovdims: yep, at least it properly passed the unittests for nova and cinder. Will submit a patch today17:14
dimsativelkov: thanks!17:18
*** sdake_ has joined #openstack-oslo17:18
*** e0ne is now known as e0ne_17:19
openstackgerritMerged openstack/oslo.messaging: Remove qpid-config call  https://review.openstack.org/19472317:19
*** e0ne_ is now known as e0ne17:20
*** sdake has quit IRC17:21
*** ihrachyshka_ has quit IRC17:22
*** jaypipes has joined #openstack-oslo17:22
*** rpodolyaka1 has quit IRC17:22
*** ozamiatin has quit IRC17:23
*** achanda has joined #openstack-oslo17:23
*** stpierre has quit IRC17:24
*** e0ne is now known as e0ne_17:29
*** e0ne_ is now known as e0ne17:32
*** rjaiswal has quit IRC17:34
*** e0ne has quit IRC17:35
*** sdake_ is now known as sdake17:39
*** ndipanov has quit IRC17:41
*** sdake has quit IRC17:44
*** browne has joined #openstack-oslo17:45
*** rjaiswal has joined #openstack-oslo17:46
*** rjaiswal has quit IRC17:46
*** rjaiswal has joined #openstack-oslo17:46
*** sdake has joined #openstack-oslo17:46
*** exploreshaifali has joined #openstack-oslo17:46
*** vilobhmm has quit IRC17:47
*** sdake has quit IRC17:48
*** sdake has joined #openstack-oslo17:50
openstackgerritMerged openstack/oslo.context: Add tox target to find missing requirements  https://review.openstack.org/19584817:51
*** shardy has quit IRC17:53
*** shardy has joined #openstack-oslo17:54
*** browne has quit IRC18:01
*** browne has joined #openstack-oslo18:02
*** Kennan has quit IRC18:04
*** Kennan has joined #openstack-oslo18:05
*** sigmavirus24_awa is now known as sigmavirus2418:06
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.messaging: Updated from global requirements  https://review.openstack.org/19238218:12
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.vmware: Updated from global requirements  https://review.openstack.org/19726818:12
openstackgerritAlexander Tivelkov proposed openstack/oslo.versionedobjects: Compound fields now coerce their elements' values  https://review.openstack.org/19768818:16
ativelkovdims here it is: https://review.openstack.org/#/c/197688/18:16
*** e0ne has joined #openstack-oslo18:23
*** e0ne is now known as e0ne_18:23
*** stpierre has joined #openstack-oslo18:23
*** e0ne_ is now known as e0ne18:23
*** e0ne has quit IRC18:23
dimsativelkov: i was half expecting a test that does a deepcopy...is that possible?18:24
*** e0ne has joined #openstack-oslo18:24
*** kairat_kushaev has quit IRC18:29
*** kairat_kushaev has joined #openstack-oslo18:30
*** sreshetnyak has quit IRC18:33
*** e0ne is now known as e0ne_18:34
*** sreshetnyak has joined #openstack-oslo18:34
*** jaosorior has quit IRC18:36
*** e0ne_ is now known as e0ne18:37
*** sdake has quit IRC18:38
*** sdake has joined #openstack-oslo18:38
*** rlrossit has joined #openstack-oslo18:39
*** sdake_ has joined #openstack-oslo18:41
*** Rockyg has joined #openstack-oslo18:41
openstackgerritMorgan Fainberg proposed openstack/oslo.db: Disable utf-8 sanity check by default  https://review.openstack.org/19769218:44
*** sdake has quit IRC18:44
openstackgerritMorgan Fainberg proposed openstack/oslo.db: No longer support db schema downgrades  https://review.openstack.org/19769718:48
morganfainbergdhellmann: ^^ as promised yesterday18:48
morganfainbergdhellmann: i expect that second one to cause errors somewhere and might need extra deprecation/warning logic.18:48
*** stpierre has left #openstack-oslo18:49
openstackgerritBrant Knudson proposed openstack/oslo.cache: Fix up option help  https://review.openstack.org/19770018:50
openstackgerritBrant Knudson proposed openstack/oslo.cache: Usage docs  https://review.openstack.org/19770118:50
openstackgerritBrant Knudson proposed openstack/oslo.cache: Remove unused _on_arguments  https://review.openstack.org/19770218:50
dhellmannmorganfainberg: ack18:50
openstackgerritBrant Knudson proposed openstack/oslo.cache: Document the backends  https://review.openstack.org/19770318:51
*** sputnik13 has quit IRC18:51
*** sputnik13 has joined #openstack-oslo18:51
*** shardy has quit IRC18:55
*** shardy has joined #openstack-oslo18:55
*** sputnik13 has quit IRC18:56
morganfainbergbknudson: lots of oslo.cache +2s for you18:56
bknudsonmorganfainberg: I think oslo.cache is just about ready18:57
morganfainbergbknudson: i would agree with that assessment18:58
bknudsonmorganfainberg: although it could use someone who's been more involved to check the docs are complete18:58
bknudsonand correct18:58
morganfainbergi'd like to get a pymemcache backend in there18:58
morganfainbergas the default "memcache" backend for it instead18:58
morganfainbergbut...18:58
bknudsonmorganfainberg: but what?18:58
morganfainbergor memcached-client18:58
openstackgerritMerged openstack/oslo.cache: Register backends in a cycle  https://review.openstack.org/19761918:58
harlowjapymemcache please :-P18:59
morganfainbergthere are big gaps in pymemcache18:59
morganfainbergharlowja: pymemcache is missing massive functionality18:59
bknudsonstore and get?18:59
morganfainbergharlowja: so what happens is you lose the ability to handle multiple memcache servers at all18:59
harlowjaya, u want hashing support18:59
morganfainbergharlowja: which python-memcache supports.18:59
*** _amrith_ is now known as amrith18:59
morganfainbergit's one of those "really? you didn't even try did you"18:59
morganfainbergwhich makes it a hard sell for compat at all with python-memcache19:00
morganfainbergharlowja: i like it way way better, but it's just... well it's a lot of code to add hashing on top of it.19:00
morganfainbergharlowja: it made me sad :(19:00
harlowjahttps://github.com/pinterest/pymemcache/pull/59 ?19:00
morganfainbergalso the fallback code to another server bit looked suspect19:00
* harlowja would just rather not continue to have 2 memcache clients being used19:01
*** viktors|wfh has quit IRC19:01
morganfainbergharlowja: we are likely stuck with 2 of them for  aloooooong time19:01
harlowjaonly as long as we want to be19:01
morganfainbergharlowja: because lots of things we use support it19:01
morganfainbergand default to it19:01
morganfainbergso we can override, but doesn't mean the baseline isn't the bad choice19:01
morganfainberg(also pymemcache rocks for the no-thread.local explicitness)19:02
harlowjaya i guess its a shitty situation all around then (2 clients nobody can decide on), lol19:03
*** sputnik13 has joined #openstack-oslo19:03
harlowjaso u have both used depending on how people feel :-P19:04
morganfainbergharlowja: yeah :(19:04
harlowjabut the sharding and hashing support for pymecache appear to be getting better19:04
harlowjahttps://github.com/pinterest/pymemcache/pull/59 (another one)19:04
harlowjaoops, meant https://github.com/pinterest/pymemcache/pull/4419:04
morganfainbergyeah i think that'll make pymemcache closer to the clear winner19:04
morganfainbergbut until that is released....19:04
morganfainbergpymemcache is lacking in a large way19:05
harlowjathe oslo team might be biasd though :-P19:05
harlowjahttps://github.com/pinterest/pymemcache#credits ha19:05
morganfainbergoncd the sharding stuff is solid19:05
harlowjahmmm, how'd harlowja and jd__ get in there :-P19:05
openstackgerritMerged openstack/oslo.cache: Use "group" rather than "section"  https://review.openstack.org/19759719:06
morganfainbergi think i can convince zzzeek that we should make pymemcache the default memcache provider for dogpile19:06
morganfainbergit'll eliminate at least one layer of thread.local ick19:06
harlowjaya19:06
zzzeekmorganfainberg: there is no “default” memcache backend...19:06
morganfainbergzzzeek: there is. the one you call "memcache" that uses python-memcache19:07
morganfainbergthat is the "default" when you read it... semanitcally19:07
morganfainbergnot so much in implementation19:07
zzzeekmorganfainberg: so why wouldnt one for “pymemcache” be called….”pymemcache” ?19:07
morganfainbergzzzeek: so we can drop python-memcache on the floor where it belongs :P19:07
morganfainbergseriously.19:07
zzzeekmorganfainberg: just dont use it.  changing defaults around == surprises for ppl who i then have to assist19:08
morganfainbergs/seriiously/in all seriousness...19:08
morganfainbergi would say we should rename the "memcache" one to python-memcache [and deprecate the old one] then19:08
*** crc32 has joined #openstack-oslo19:08
morganfainbergand then add pymemcache19:08
harlowjawhat u guys storing in memcache anyway :-P19:09
harlowjatoken stuff?19:09
morganfainbergpylibmc and uhmm the otherone i can't ever remember, are clearly named.19:09
morganfainbergbut the default for python for a long time was python-memcache19:09
jd__harlowja: we're everywhere19:09
morganfainbergwhich is my point of why that one reads as the default for dogpile19:09
harlowjajd__ lol19:09
morganfainbergit is named the same as the technology [is all]19:09
morganfainbergwhere as the package is sortof-kindof-not19:10
morganfainbergharlowja: we are memoizing things in keystone as well19:10
*** crc32 has quit IRC19:10
morganfainbergharlowja: some of the more expensive lookups19:10
*** crc32 has joined #openstack-oslo19:10
zzzeekmorganfainberg: how about. once a google search for “python memcached” turns up pymemcache and not python-memcached, then we know python-memcached is still not what people expect19:10
harlowjak, u ok with memcached flapping19:10
morganfainbergharlowja: that is the more important thing that dogpile is buying us19:10
zzzeekmorganfainberg: “memcached”, which is the name, has for years meant “python-memcached” and i dont see how it helps anyone to change it19:11
morganfainbergzzzeek: if you don't mind being not py3 compatible as well.19:11
* harlowja always thinks of memcached flapping experiences with memcached19:11
zzzeekmorganfainberg: you can use dogpile + memcache server + py3k, just not that driver19:11
zzzeekmorganfainberg: the name is not very important19:11
zzzeekmorganfainberg: its the driver name19:11
harlowjaserver X gets network disconnect, clients switch to new hashed server Y, start saving things there, server X comes back up, old-data found (?)19:12
morganfainbergzzzeek: annnnnnnnnnnnnnnnnnnnnyway not worth the conversation at this point because pymemcache isn't usable in the same context today as python-memcache19:12
morganfainbergzzzeek: i honestly hope python-memcache shutters the project.19:12
zzzeekmorganfainberg: my experience is, none of these dead projects *ever* shutter their project, nor do they ever respond to emails about it19:13
morganfainbergzzzeek: and lets the other better libs take over.19:13
harlowja* server X gets network disconnect, clients switch to new hashed server Y, start saving things there, server X comes back up, clients eventually switch back to using X, old-data found (?), all stuff on Y in who knows where land...19:13
harlowjagood ole caches, fun fun, ha19:13
morganfainbergzzzeek: shutter = dead/unmaintained in this context19:13
zzzeekmorganfainberg: we ahve:  python-memcached, PIL, MySQL-Python, etc, all dead crap whose maintainers just refuse to answer any queries19:13
morganfainbergzzzeek: m2crypto19:13
morganfainbergdon't forget that one19:13
zzzeekmorganfainberg: i actually had to use that a few yuears ago it supports some things that nobody else does19:13
*** boris-42 has joined #openstack-oslo19:13
morganfainbergit does19:13
morganfainbergsadly it's way way unmaintained19:14
morganfainbergin fact you can't even built it on modern ubuntu19:14
morganfainbergor debians19:14
zzzeekmorganfainberg: and the author is dead silent to any qiuestions, right?19:14
zzzeekmorganfainberg: thats always the main part19:14
morganfainbergbecause openssl doesn't support the symbols19:14
zzzeekmorganfainberg: that they dont respond, “yeah, sorry i dont have time to update it"19:14
zzzeekmorganfainberg: they dont put up an announcement19:14
zzzeekmorganfainberg: nothing19:14
morganfainbergzzzeek: at some point we [as maintainers] do need to be opinionated and drop support for dead projects19:14
morganfainbergbut i'm more aggressive in that view than some OSS folks19:15
zzzeekmorganfainberg: absoutely but we need to *SAY IT* publicly19:15
zzzeekmorganfainberg: “I am no longer maintaining XYZ”19:15
zzzeekmorganfainberg: the reason they dont is, they dont want anyone taking it over19:15
openstackgerritBrant Knudson proposed openstack/oslo.cache: Usage docs  https://review.openstack.org/19770119:15
morganfainbergzzzeek: i meant we need ot say that about dependant libs too19:15
harlowjalifeless tchaypo  u have a sec, wondering why https://review.openstack.org/#/c/197691/ failed, its almost like it didn't get selectively installed :-/19:15
morganfainbergzzzeek: so maybe i can convince you once pymemcache is solid to deprecate and say python-memecche is a poor choice and will be removed as an option in the future?19:16
morganfainbergzzzeek: ;)19:16
harlowjalifeless tchaypo nm, seems differnt19:16
morganfainbergzzzeek: when we are confident in pymemcache's support of needed features :)19:16
zzzeekmorganfainberg: i dont see why we arent adding a pymemcache backend right now at least19:16
zzzeekmorganfainberg: dogpile ahs no “default” driver, theres’ no issue here.  we also have support for some dead thing called “bmemcache” too19:17
morganfainbergzzzeek: because it's missing some base features that those linked pull requests would prevent a ton of extra code19:17
zzzeekmorganfainberg: ill gladly put a doc note19:17
morganfainbergzzzeek: simply you get exactly 1 server ever19:17
morganfainbergno hashing, etc19:17
morganfainbergso i think i'll wait until those land (looks close) and then a lot less "but we don't support X, or Y with pymemcache" and/or a lot less code19:18
morganfainbergzzzeek: i also still owe you a respin on a pull request for locks in memcache19:18
harlowjalocks in memcache :-/19:18
* morganfainberg is way behind on non-openstack things :(19:18
zzzeekmorganfainberg: i look at dogpile like, never :)19:18
morganfainbergzzzeek: i know. ;) thankfully it really does mostly "just work"19:19
morganfainbergzzzeek: which is both a good and bad thing19:19
zzzeekmorganfainberg: yeah i tried to write it that way :)19:19
morganfainbergzzzeek: i have some general enhancements for UX i'd like to propose, but it'll take a large context swithc from keystone19:19
morganfainbergand i don't have the energy for that at the moment19:19
zzzeekmorganfainberg: basically, mako + dogpile are the replacements for all the garbage in beaker (the pylons project)19:19
morganfainbergyeah19:20
morganfainbergif we could un-tie the memoization decorators [in a clean way] from the region object, the developer ux would improve a lot19:20
morganfainbergbut i want something that is equally clean to read19:20
morganfainbergso i figure it's some real sit down and examine the options before making a case to change it19:21
morganfainbergwhich is why i havne't tossed something at the wall yet :)19:21
*** sdake has joined #openstack-oslo19:21
morganfainbergalso jd__ stop being everywhere i see your name *everywhere* :P19:22
morganfainberg;)19:22
jd__:D19:22
*** sdake has quit IRC19:23
*** sdake has joined #openstack-oslo19:23
*** rpodolyaka1 has joined #openstack-oslo19:25
*** sdake_ has quit IRC19:25
harlowjalol19:27
*** dansmith has quit IRC19:30
*** dansmith has joined #openstack-oslo19:30
openstackgerritMerged openstack/oslo.vmware: Fix exception to string in py34  https://review.openstack.org/19640819:33
harlowjajd__ and i are 007 and 00819:33
harlowjalol19:33
jd__licensed to kill?19:34
harlowjaapache license to kill19:35
harlowjalol19:35
harlowja*apache licensed to kill19:35
*** Rockyg has quit IRC19:35
*** e0ne has quit IRC19:38
*** ozamiatin has joined #openstack-oslo19:38
*** nkrinner has joined #openstack-oslo19:40
harlowjadims https://review.openstack.org/#/c/197668/ (added my 2 cents there, about not creating another state-machine-mini-lib)19:41
harlowjaif u want to add anything (or others to) feel free :-P19:41
* harlowja very much likes the idea, but not having to fix more code to use a common-lib later...19:45
harlowja*very much likes the idea, but does not like having to fix more code to use a common-lib later...19:45
ativelkovdims: there is such a test at def test_compound_clone(self) - it does obj.obj_clone()) which is a deepcopy19:50
*** Rockyg has joined #openstack-oslo19:52
*** yamahata has joined #openstack-oslo19:55
openstackgerritYuriy Taraday proposed openstack/oslo.rootwrap: Remove test-requirements-py3.txt  https://review.openstack.org/19771820:00
*** shardy_ has joined #openstack-oslo20:01
*** achanda has quit IRC20:03
openstackgerritYuriy Taraday proposed openstack/oslo.rootwrap: Updated from global requirements  https://review.openstack.org/19726620:07
*** achanda has joined #openstack-oslo20:07
*** achanda has quit IRC20:09
openstackgerritJoshua Harlow proposed openstack/automaton: Allow providing and using a 'nested_start_state_fetcher'  https://review.openstack.org/19735120:11
dimsLOL apache licensed to kill20:18
*** e0ne has joined #openstack-oslo20:18
dimsativelkov: thanks20:18
openstackgerritMerged openstack/oslo.policy: Move fileutils functions to oslo.policy  https://review.openstack.org/19742020:18
dimslifeless: https://review.openstack.org/#/c/192382/ wont merge requirements job fails, but nothing in the log. you may have a fix for this in progress already?20:19
*** cburgess_ has quit IRC20:23
*** cburgess has joined #openstack-oslo20:23
*** rpodolyaka1 has quit IRC20:26
*** jgrimm is now known as zz_jgrimm20:29
*** openstackgerrit has quit IRC20:37
*** openstackgerrit has joined #openstack-oslo20:37
*** nkrinner has quit IRC20:44
lifelessdims: thats running on an old image. fungi was prepping new ones20:47
*** ihrachyshka has joined #openstack-oslo20:47
fungiyep, the last missing image update is just wrapping up now20:48
fungiwaiting for the nova snapshot call to complete20:48
*** mriedem has quit IRC20:49
dimsthanks fungi lifeless20:50
*** shardy_ has quit IRC21:01
*** otherwiseguy has quit IRC21:04
*** sdake_ has joined #openstack-oslo21:07
*** e0ne has quit IRC21:08
*** sdake has quit IRC21:09
*** exploreshaifali has quit IRC21:21
*** rlrossit has left #openstack-oslo21:21
*** kgiusti has quit IRC21:29
*** bknudson has quit IRC21:51
haypolifeless: hi. do you know the old issue of .testrepository/times.dbm database not readable by Python 3 if created by Python 2?22:00
haypolifeless: is there a plan to fix it in testrepository?22:00
haypolifeless: hemna (walter) hitted this issue. but also the opposite issue (python 2 unable to read DB created by python 3!) because of a missing dependency on his setup: https://review.openstack.org/#/c/197624/1/tox.ini22:01
haypolifeless: because of these two reasons, he prefers to run tests using testtools instead of testr22:02
mtreinishhaypo: I've been planning to add a subunit2sql repository type to testrepository which will remove the dependence on using dbm which is causing that issue22:08
*** manishg_ has joined #openstack-oslo22:08
mtreinishthe only blocker for that right now is making things work with sqlite (a couple migrations don't run on sqlite)22:08
mtreinishwell I guess it's not 100% a blocker because you could use it without sqlite, but then it would require a mysql or postgres db to run testr, which seems a bit heavyweight22:11
*** manishg has quit IRC22:11
haypomtreinish: which kind of DB will be used *by default*?22:11
haypoi'm not sure that dbm is the best choice to share a DB between python 2 and python 3, since both versions look to use incompatible dbm formats22:12
mtreinishhaypo: well I was under the impression when the subunit2sql repository was ready and tested well enough it would become the default22:12
mtreinishso then it would be a local sqlite db22:12
hayposqlite is maybe a better choice. or something even simpler, than pickle, or plain text :)22:12
haypoi don't know the content of .testrepository/times.dbm22:12
mtreinishhaypo: it's key value22:13
mtreinishtest_id: run_time22:13
haypomtreinish: i don't know subunit2sql. what is it?22:13
haypomtreinish: we need a DB to store a few numbers?22:13
mtreinishhaypo: it's a project I've been working on to store data from all the gate runs in a db and perform analysis on it22:14
mtreinishhttp://git.openstack.org/cgit/openstack-infra/subunit2sql22:14
*** pradk has quit IRC22:14
mtreinishhttp://docs.openstack.org/developer/subunit2sql/22:14
mtreinishhttp://docs.openstack.org/infra/system-config/logstash.html#subunit2sql22:14
haypohum, is "test_id" the testr run identifier like 1, 2, 3, ... or something like nova.tests.unit.test_api?22:15
mtreinishhaypo: well it's only a few numbers right now, but if you use it for a bit more it can be a bit more powerful22:15
mtreinishhaypo: the latter22:15
mtreinishit's the identifier for each test22:15
haypo"the latter" oh ok22:15
haypomtreinish: i don't know to install MySQL or whatever to run a dummy unit test22:15
haypooops22:15
haypomtreinish: i don't want to install MySQL or whatever to run a dummy unit test22:16
mtreinishhaypo: it would be sqlite22:16
haypothe default should be something more convenient like dbm or sqlite22:16
mtreinishmysql would be an optional config for testr22:16
haypomtreinish: ah, sqlite can be used with subunit2sql? ok22:16
*** sdake_ is now known as sdake22:17
mtreinishhaypo: well that's the plan, right now sqlite support is the blocker for using it in testrepository22:17
mtreinishthe last time I tried to run with sqlite a couple of the alembic migrations didn't work on a sqlite db22:17
mtreinishand I haven't had time to revisit it again (that was quite some time ago)22:17
*** dims_ has joined #openstack-oslo22:17
haypofor my usage, testr is too complex. i learnt how to use testtools.run directly, it saved me hours of work :)22:18
haypotestr startup is very long and the default output is not very useful :-(22:18
haypomany projects started to write a layer on top of testr to have a better output22:18
haypowell, i have many complains but no motivation to enhance it :)22:19
mtreinishhaypo: do you mean: http://git.openstack.org/cgit/openstack/os-testr ?22:19
mtreinishor the pretty_tox stuff?22:19
mtreinishI kinda did both of those... :)22:19
haypomtreinish: these two things, yes22:19
haypomtreinish: why not contributing to testr directly?22:20
haypowhen i started to develop on testr, i was shocked that tox doesn't say anything by default and there is no "verbose mode" :-/22:20
*** dims has quit IRC22:21
haypolater i found: testr --parallel --subunit|subunit2pyunit22:21
mtreinishhaypo: that's the long term goal. I did os-testr as a quick hack to get away from having divergent local copy and pasted bash scripts in ever projects repo with a deceptive name22:21
haypoit's a little bit better, but it still have a serious issue: it only shows when a test completed, not when a test started22:21
mtreinishI fully plan to contribute some of the ui elements back into testr22:21
hayposo we have no information when a test hangs22:21
haypowhich is painful since testr is distributed (--parallel) :6/22:21
haypo:-/22:21
mtreinishthe output filter, subunit-trace, was started in tempest to solve that output problem22:21
mtreinishwe probably could package it back into python-subunit pretty easily22:22
mtreinishalthough it does some things which are probably fairly specific to what openstack wants22:22
haypomtreinish: it's very cool to hear that some people are motivated than me and actively fix my issues. thanks!22:22
mtreinishthat's the real reason in the short term these things are a layer on top22:22
haypomtreinish: i'm not sure that testr is widely used outside OpenStack22:23
mtreinishbecause they're not really general solutions because subunit and friends are meant to be consumed by other things too22:23
lifelesshaypo: there's a bug open on it22:23
mtreinishhaypo: that's what I've always thought, but lifeless has told me otherwise22:23
lifelesshaypo: there isn't a compatible dbm impleemntation across all current supported pythons on all reasonable platforms22:23
haypo(well, i have no idea. but testr looks very complex compared to all other test runners like py.test, nose, unittest, etc.)22:23
lifelesshaypo: its terrible.22:23
lifelesshaypo: (the dbm thing)22:24
lifelesshaypo: I wrote testr long before openstack22:24
haypolifeless: mtreinish was telling me that testr will move to sqlite. good. sqlite is probably the exception of things that work well to exchange data between python 2 and python 3 :)22:24
lifelesshaypo: I don't know how widely its used elsewhere, I don't particularly care :)22:24
mtreinishhaypo: well long term I want to move that way22:25
mtreinishbut it'll take time as I'm still basically the only contributor the subunit2sql stuff22:25
haypoi started to copy/paste runtests.py of asyncio. it's ~300 lines of code and no dependency: https://github.com/python/asyncio/blob/master/runtests.py22:26
haypoit's enough for my small projects. usually, running all tests takes less than 5 minutes, more likely 60 seconds22:26
hayposo parallel execution doesn't matter22:26
hayposince tests are written with unittest, any other test runner can be used ;)22:27
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.rootwrap: Updated from global requirements  https://review.openstack.org/19726622:27
haypoi like the raw unittest module, no canddiers like testtools or testscenarios which require a specific test runner and are harder to replay22:27
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.vmware: Updated from global requirements  https://review.openstack.org/19726822:27
lifelesshaypo: so just use 'unit2' ?22:28
lifelesshaypo: thats why I backport the whole testing stack ...22:28
haypolifeless: what? stop using python 2, it's dead! :)22:29
lifelesshaypo: unittest2 is not about python222:29
haypolifeless: use unittest, the regular unittest module, of python 322:29
lifelesshaypo: its a backport from 3.6 to everything else.22:29
*** sdake is now known as sdake_22:29
lifelesshaypo: so if you support 3.4, then unittest2 (and traceback2 and linecache2) are useful.22:29
lifelesshaypo: unless you're only going to support unreleased pythons.22:30
haypolifeless: i don't think that i'm using features more advanced than new assert methods of python 2.7 :)22:30
lifelesshaypo: properly loader support for instance, added about a year back to the stdlib22:30
lifelesshaypo: not present in 3.4,3.3,3.2,2.722:30
*** amrith is now known as _amrith_22:30
haypolifeless: what is a loader?22:30
lifelesshaypo: TestLoader22:31
lifelesshaypo: the underglue of discover22:31
haypolifeless: i don't think that i'm using discover or any loader. as i wrote, i'm using https://github.com/python/asyncio/blob/master/runtests.py which search for test_*.py, load them and search for test cases22:33
lifelesssure22:33
haypolifeless: i guess that loader+discover avoids this script22:33
lifelessright22:33
lifelessanyhow my point is22:34
lifelessunittest2 is not abou tpython222:34
lifelessits just backports22:34
haypolifeless: cool :) but i need to support 3.3+22:34
lifelessit supports jython pypy and every supported cpython22:34
haypolifeless: and i don't want a ton of dependencies22:34
lifeless[+ 2.6 and 3.2 atm]22:34
haypo3.2 is dying with the new debian stable which switchs from 3.2 to 3.4!22:34
lifelesshaypo: unittest2 only depends on traceback2, which is the same thing but the traceback module22:34
haypolifeless: so it adds two dependencies :)22:35
haypolifeless: i'm running my tests on windows, freebsd, windows, solaris, openbsd22:35
haypodependencies are annoying22:35
hayposlowly, i'm moving to tox which handles dependencies for me ;)22:36
*** droyal has joined #openstack-oslo22:36
lifelesshaypo: sure via pip22:36
lifelesshaypo: and pip installs all these things easily across the board22:36
lifelesshaypo: anyhow, no skin off my nose :)22:37
haypoensurepip helped me a lot22:37
haypoit really was a pain to bootstrap all this shit. setuptools, pip, etc. it was a real nightware. it's better nowadays22:38
haypolifeless: hum, can you please take a look at http://logs.openstack.org/14/186114/34/check/gate-glance-requirements/539f11b/console.html ? gate-glance-requirements failed in https://review.openstack.org/#/c/186114/ ("Updated from global requirements")22:40
haypoi don't see an obvious error message in this output22:41
haypomaybe "Requirement sphinx present in multiple files" is the error22:41
haypo(there are a ton of such message)22:41
mtreinishhaypo: I believe it is, I think that's probably because of the changes eliminating the need for separate *-py3.txt requirements file22:42
mtreinishso it's complaining that each requirement is present in multiple files22:42
*** browne has quit IRC22:43
haypomtreinish: should i propose my own patch based on this one?22:43
haypoi guess that the bot is too stupid to fix such corner case22:44
mtreinishhaypo: yeah I think you have todo it manually22:44
mtreinishI think lifeless sent something to the ML about this22:44
* mtreinish checks22:44
haypomtreinish: i noticed that lifeless tries to flood my mailing box, right :-p22:46
lifelesshaypo: that was an old image, fungi has fixed it now - do a recheck22:47
mtreinishI found, http://lists.openstack.org/pipermail/openstack-dev/2015-June/068193.html so I guess that'll come in the future22:48
haypolifeless: ok, let's do a recheck22:49
haypoi feel stupid when i schedule a blind recheck22:49
haypoit's common that i don't read the logs, i just recheck before that i know that the CI is unable and that i may be more lucky in the next try...22:50
haypoi already thaught of writing a bot to write a "recheck" comment on my reviews if a CI failed :-p22:50
mtreinishhaypo: please don't do that it'll just introduce more bugs in the long run...22:51
haypomtreinish: introduce bugs? what do you mean?22:52
lifelessit will allow races through22:52
lifelessby persistence22:53
mtreinishhaypo: the unrelated issues that often cause failures are just the exposure of a race bug. If you just hammer away at rechecking it'll just allow more races through22:53
mtreinishheh, what lifeless said :)22:53
*** sdake_ has quit IRC22:54
haypoi'm not planning to flood the infra with recheck. maybe only retry once if the CI failed22:54
haypowell, it's just a project, just to share my feedback on the CI :)22:54
haypothe theory is that everybody is responsible of the CI22:54
haypothe practice is that most people hate the CI and don't want to fix it :)22:55
haypo(well, that's my guess in fact, i have no statistics :)22:55
mtreinishhaypo: yep that's pretty accurate, which is why we gave this talk at summit: https://www.youtube.com/watch?v=sa67J6yMYZ022:55
mtreinishto try and change that22:55
tsekiyamalifeless: gate-glance-requirements is still failing. I hope https://review.openstack.org/#/c/197753/ will fix the issue..22:56
haypomtreinish: oh, i missed this talk. i will watch the video22:57
*** jecarey has quit IRC22:57
haypotsekiyama: ah? i just scheduled a recheck, there is no result yet. https://review.openstack.org/#/c/186114/22:59
haypotsekiyama: or do you mean that this check fails on any glance patch?22:59
lifelesstsekiyama: do you have a current glance bug?22:59
lifelesstsekiyama: the one you linked 40422:59
lifelesss22:59
tsekiyamalifeless: sorry please remove "/" at URL tail23:00
lifelesstsekiyama: so yes, that needs fixing23:00
lifelesstsekiyama: let me prepare a patch for glance23:00
tsekiyamahaypo: I mean that review. It is displayed "failed" at http://status.openstack.org/zuul/23:00
tsekiyamalifeless: thanks!23:01
haypomtreinish: i'm working on cpython. we have a lot of tests which are unstable23:01
haypomtreinish: IMHO it would be better to skip the test on most buildbots rather than asking developers to fix the CI23:02
haypomtreinish: almost everybody ignore buildbots. it's different than in openstack, tests are run after the merge. so after the merge, the author goes away and don't care :)23:03
lifelesshaypo: so- just incase23:03
lifelesshaypo: please don't add [test-]requirements-py3.txt to any more projects.23:03
lifelesshaypo: you probably can't, but even if you can, please don't. markers are fully usable now within the openstack master branches23:03
haypomtreinish: so i think that it would be more efficient to identify unstable tests, to first get stable buildbots23:03
haypolifeless: i still think that requiring a specific version of pip, setuptools, pbr, etc. is crazy23:04
haypolifeless: but you are probably more brave than me :)23:04
lifelesshaypo: We want stable buildbots23:04
mtreinishhaypo: so have you looked at elastic-recheck?23:04
haypolifeless: i didn't add any new -py3 file recently23:04
mtreinishhaypo: but we do skip tempest tests when a failure rate is too high, but it's not something we want to do23:04
lifelesshaypo: our number 1 systematic stability problem is project releases23:05
lifelesshaypo: e766b9e4 (Victor Stinner 2015-06-19 14:16:38 +0200 31)23:05
mtreinishbecause it means something is fundamentaly broken23:05
lifelesshaypo: that might not count as recent for you :)23:05
haypolifeless: ah? in which project? glancE?23:05
lifelessyeah23:05
haypolifeless: ah. i'm producing too much code, i'm unable to remember what i did yesterday23:06
haypolifeless: i did that before you started your huge project of using env markers23:06
haypolifeless: it looks like it was a reasonable choice between i saw a lot of issues related to env markers recently :)23:07
lifelesswhat is glance doing, sadface.23:07
lifeless-e ....23:07
haypomtreinish: "so have you looked at elastic-recheck?" for which issue?23:07
lifelesshaypo: why is -e git+https://github.com/openstack/glance_store.git#egg=glance_store23:08
haypomtreinish: i'm reading http://logs.openstack.org/72/197072/1/check/check-tempest-dsvm-full-ceph/948642f/console.html for https://review.openstack.org/#/c/197072/ and it's a timeout. i don't feel able to dig deeper23:08
lifelesshaypo: there ?23:08
haypolifeless: yeah, the -e is funny. i'm suprised that it was accepted23:08
haypolifeless: it was more an experimental patch to unblock glance port to python 323:08
lifelesshaypo: infra didn't check requirements-py3.txt at all23:08
lifelesshaypo: until recently23:08
mtreinishhaypo: you mentioned it would be more efficient to identify unstable tests23:08
lifelesshaypo: so its basically you could put anything in there and it wouldn't complain23:08
haypolifeless: it's supposed to be temporary. you know temporary as "it will stay until 2020"23:08
lifelesshaypo: has glance-store done a python3 ready release ?23:09
mtreinishthat's what elastic-recheck is there for to classify and track bugs that are popping up in the gate23:09
haypomtreinish: ah. i was talking about CPython which have a very minimal testing infra compared to the amazing openstack infra23:09
haypolifeless: glance-store is one of the slowest project to get a project23:10
lifelesshaypo: is that no ?23:10
haypolifeless: the 3 slowest are: swift, glance-store and stackforge/sqlalchemy-migrate23:10
haypolifeless: i still have 3 patches under review for glance-store23:10
lifelesshaypo: ah so glance py3 stuff isn't gating yet?23:11
mtreinishhaypo: oh, ok23:11
haypolifeless: i don't know if they released anything recently. i would prefer to have a full python 3 support before a release23:11
lifelesshaypo: so here's the problem23:11
mtreinishhaypo: I thought you meant generally :)23:11
lifelesshaypo: I can't fix the requirements stuff to merge23:11
lifelesshaypo: until we remove this -e line23:11
lifelesshaypo: I mean, I'm going to try, but I'm fairly sure the automation is going to reject me23:11
haypolifeless: i added a non-voting py34 check job to glance, and quickly made it voting23:12
haypolifeless: i'm using https://wiki.openstack.org/wiki/Python3#OpenStack_applications to check the py34 gate of each application23:12
lifelesshaypo: does that depend on the -e line ?23:12
mtreinishhaypo: so that failure is actually interesting, it's being caused because that test took >500 sec23:12
haypolifeless: sure. glance explodes using the releases23:12
mtreinishwhich is too long so we killed it at 500 sec23:12
lifelesshaypo: ok, so we're probbly going to have to unwind that23:13
mtreinishhaypo: you can see the timeout exception is being raised by the timeout fixture23:13
lifelesshaypo: I'll try using the -e first.23:13
mtreinishhaypo: http://logs.openstack.org/72/197072/1/check/check-tempest-dsvm-full-ceph/948642f/console.html#_2015-07-01_01_46_14_87323:13
haypomtreinish: 500 sec is probably a bug. probably a race condition.23:13
mtreinishhaypo: well that or we got a bad/slow vm in whatever cloud the slave was spun up in23:13
mtreinishthe joy of using public clouds23:14
lifelesstsekiyama: https://review.openstack.org/19776623:15
haypolifeless: i read again the -py3.txt. so yes, i expect a release of glance-store shortly, which will fix this mess23:15
haypomtreinish: we have to fix the cloud!23:15
haypomtreinish: recently i heard that the cloud is vulnerable to hardware issues. i'm surprised. the hardware is not virtualized? hum, wait...23:15
haypo;)23:16
haypolifeless: can't you use the git branch on python 3, and the stable release on python 2, for glance_store?23:16
haypolifeless: using the funny env markers23:17
*** sputnik13 has quit IRC23:18
*** sputnik13 has joined #openstack-oslo23:18
*** ihrachyshka has quit IRC23:19
*** sputnik13 has quit IRC23:19
*** sputnik13 has joined #openstack-oslo23:19
*** Nakato_ is now known as Nakato23:19
lifelesshaypo: we could, but thats not the issue. the issue is whether -e will be accepted at all.23:20
mtreinishhaypo: well looking at the dstat for the run it doesn't look like it's spinning on io or anything: http://logs.openstack.org/72/197072/1/check/check-tempest-dsvm-full-ceph/948642f/logs/screen-dstat.txt.gz23:20
mtreinishwhich is often an indicator of something wrong with the node23:20
haypolifeless: ah23:21
haypomtreinish: i never opened the dstat file23:21
haypomtreinish: good to know23:22
*** sputnik13 has quit IRC23:29
*** sputnik13 has joined #openstack-oslo23:29
*** stevemar has joined #openstack-oslo23:32
*** stevemar has quit IRC23:35
*** manishg_ has quit IRC23:39
*** browne has joined #openstack-oslo23:39
*** manishg has joined #openstack-oslo23:51
*** manishg has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!