Wednesday, 2016-08-17

*** code-R has joined #openstack-oslo00:01
*** spzala has joined #openstack-oslo00:02
*** snizar_ has quit IRC00:02
*** snizar has quit IRC00:02
*** code-R_ has joined #openstack-oslo00:03
*** code-R has quit IRC00:06
*** spzala has quit IRC00:07
*** mtanino has quit IRC00:18
*** hockeynut has joined #openstack-oslo00:22
*** thumpba_ has quit IRC00:39
*** thumpba has joined #openstack-oslo00:39
*** thumpba has quit IRC00:44
*** ihrachys has quit IRC00:50
*** ihrachys has joined #openstack-oslo00:51
*** hockeynut has quit IRC01:02
*** hockeynut has joined #openstack-oslo01:02
*** spzala has joined #openstack-oslo01:04
*** ihrachys has quit IRC01:04
*** dimtruck is now known as zz_dimtruck01:08
*** spzala has quit IRC01:09
*** code-R_ has quit IRC01:42
*** zz_dimtruck is now known as dimtruck01:49
*** yamahata has quit IRC02:20
openstackgerritHaifeng Yan proposed openstack/oslo.vmware: Fix TypeError:six.StringIO(resp.content) must be str or None, not bytes.  https://review.openstack.org/35160102:28
*** spzala has joined #openstack-oslo02:29
*** spzala has quit IRC02:30
*** spzala has joined #openstack-oslo02:30
*** spzala has quit IRC02:44
*** spzala has joined #openstack-oslo02:44
*** spzala has quit IRC02:48
*** thumpba has joined #openstack-oslo03:19
*** jeckersb is now known as jeckersb_gone03:49
*** links has joined #openstack-oslo03:54
*** ozamiatin has joined #openstack-oslo04:00
*** hockeynut has quit IRC04:03
*** ozamiatin has quit IRC04:08
*** dimtruck is now known as zz_dimtruck04:10
*** zz_dimtruck is now known as dimtruck04:10
*** dimtruck is now known as zz_dimtruck04:19
*** amotoki has joined #openstack-oslo04:38
*** davidlenwell has quit IRC04:42
*** code-R has joined #openstack-oslo04:44
*** code-R_ has joined #openstack-oslo04:49
*** code-R has quit IRC04:52
*** davidlenwell has joined #openstack-oslo04:55
*** ozamiatin has joined #openstack-oslo05:00
*** itisha has quit IRC05:20
*** eezhova has joined #openstack-oslo05:22
*** code-R_ has quit IRC05:24
*** code-R has joined #openstack-oslo05:24
*** ihrachys has joined #openstack-oslo05:30
*** code-R has quit IRC05:30
*** gcb_ has joined #openstack-oslo05:35
*** thumpba has quit IRC05:40
*** rcernin has joined #openstack-oslo05:46
*** eezhova has quit IRC05:50
*** thumpba has joined #openstack-oslo05:51
*** thumpba has quit IRC05:56
*** ihrachys has quit IRC06:15
*** e0ne has joined #openstack-oslo06:30
*** code-R has joined #openstack-oslo06:38
*** eezhova has joined #openstack-oslo06:42
*** code-R has quit IRC06:43
*** amotoki has quit IRC06:50
*** code-R has joined #openstack-oslo06:51
*** thumpba has joined #openstack-oslo06:52
*** dtardivel has joined #openstack-oslo06:53
*** thumpba has quit IRC06:56
*** tesseract- has joined #openstack-oslo07:00
*** mhickey has joined #openstack-oslo07:01
*** lpetrut has joined #openstack-oslo07:04
*** code-R has quit IRC07:07
*** andymaier has joined #openstack-oslo07:26
*** lpetrut has quit IRC07:29
*** yamahata has joined #openstack-oslo07:29
*** jamielennox is now known as jamielennox|away07:45
*** e0ne has quit IRC07:51
*** thumpba has joined #openstack-oslo07:52
*** thumpba has quit IRC07:57
*** zzzeek has quit IRC08:00
*** thumpba has joined #openstack-oslo08:01
*** zzzeek has joined #openstack-oslo08:01
*** amotoki has joined #openstack-oslo08:02
*** amotoki has quit IRC08:02
*** amotoki has joined #openstack-oslo08:03
*** ihrachys has joined #openstack-oslo08:05
*** thumpba has quit IRC08:06
*** amotoki_ has joined #openstack-oslo08:08
*** amotoki has quit IRC08:08
openstackgerritChangBo Guo(gcb) proposed openstack/oslo.log: Default use_stderr to False  https://review.openstack.org/35128308:11
*** lucas-dinner is now known as lucasagomes08:17
openstackgerritMerged openstack/oslo.log: Fixes unit tests on Windows  https://review.openstack.org/34949808:17
*** e0ne has joined #openstack-oslo08:19
*** ihrachys has quit IRC08:29
*** dkehn has quit IRC08:32
*** dkehn_ has quit IRC08:32
*** ihrachys has joined #openstack-oslo08:34
*** Jaison has joined #openstack-oslo08:35
*** links has quit IRC08:37
*** dkehn has joined #openstack-oslo08:38
*** eezhova has quit IRC08:44
*** jamielennox|away is now known as jamielennox08:50
*** dkehn_ has joined #openstack-oslo08:52
*** ozamiatin has quit IRC08:55
*** ihrachys has quit IRC08:57
*** thumpba has joined #openstack-oslo09:02
*** ihrachys has joined #openstack-oslo09:03
*** thumpba has quit IRC09:08
*** ihrachys has quit IRC09:11
*** ihrachys has joined #openstack-oslo09:11
*** gus has quit IRC09:22
*** andymaier has quit IRC09:23
*** yamahata has quit IRC09:24
*** sambetts|afk is now known as sambetts09:26
*** lpetrut has joined #openstack-oslo09:27
*** ihrachys has quit IRC09:28
*** ihrachys has joined #openstack-oslo09:30
*** code-R has joined #openstack-oslo09:30
*** ozamiatin has joined #openstack-oslo09:37
*** jamielennox is now known as jamielennox|away09:43
*** spzala has joined #openstack-oslo09:45
*** spzala has quit IRC09:49
*** andymaier has joined #openstack-oslo09:53
openstackgerritQiming Teng proposed openstack/oslo.messaging: Trivial: fix notify filter when data item is None  https://review.openstack.org/32975409:53
*** lpetrut1 has joined #openstack-oslo09:57
*** openstack has joined #openstack-oslo10:16
*** dkehn has joined #openstack-oslo10:17
*** e0ne has quit IRC10:18
*** dkehn_ has joined #openstack-oslo10:22
*** sdague has joined #openstack-oslo10:27
*** boden has joined #openstack-oslo10:28
*** ihrachys has quit IRC10:30
openstackgerritOleksii Zamiatin proposed openstack/oslo.messaging: [zmq] Make zmq_immediate configurable  https://review.openstack.org/35637010:40
*** ociuhandu has quit IRC10:50
*** yamamoto has joined #openstack-oslo10:50
*** yamamoto has quit IRC10:56
*** yamamoto has joined #openstack-oslo10:57
*** andymaier has quit IRC11:00
*** yamamoto has quit IRC11:02
*** yamamoto has joined #openstack-oslo11:03
*** yamamoto has quit IRC11:07
*** yamamoto has joined #openstack-oslo11:07
*** yamamoto has quit IRC11:09
*** yamamoto has joined #openstack-oslo11:09
*** cdent has joined #openstack-oslo11:14
*** andymaier has joined #openstack-oslo11:19
*** ihrachys has joined #openstack-oslo11:22
*** eezhova has joined #openstack-oslo11:23
*** lucasagomes is now known as lucas-hungry11:23
*** ociuhandu has joined #openstack-oslo11:28
openstackgerritGevorg Davoian proposed openstack/oslo.messaging: [zmq] Implement retries for unacknowledged CALLs  https://review.openstack.org/35352911:29
*** ihrachys has quit IRC11:32
*** yamamoto has quit IRC11:40
*** yamamoto has joined #openstack-oslo11:46
*** ansmith has joined #openstack-oslo11:49
*** boden has quit IRC11:52
*** boden has joined #openstack-oslo11:58
*** kgiusti has joined #openstack-oslo12:02
*** andymaier has quit IRC12:02
*** code-R_ has joined #openstack-oslo12:03
*** sheeprine has quit IRC12:03
*** sheeprine has joined #openstack-oslo12:06
*** code-R has quit IRC12:06
*** mtanino has joined #openstack-oslo12:07
*** jamielennox|away is now known as jamielennox12:11
*** amotoki_ has quit IRC12:13
*** andymaier has joined #openstack-oslo12:14
*** jpena is now known as jpena|lunch12:15
*** yamamoto has quit IRC12:15
*** amotoki has joined #openstack-oslo12:19
*** lucas-hungry is now known as lucasagomes12:26
*** yamamoto has joined #openstack-oslo12:28
*** e0ne has joined #openstack-oslo12:28
openstackgerritOleksii Zamiatin proposed openstack/oslo.messaging: [zmq] Make zmq_immediate configurable  https://review.openstack.org/35637012:31
*** yamamoto has quit IRC12:32
*** gcb_ has quit IRC12:33
*** jecarey has quit IRC12:39
*** gcb_ has joined #openstack-oslo12:46
*** mtanino has quit IRC12:49
kgiustiozamiatin: hey, just fyi those jenkins failures are caused by issues with the osic cloud servers - https://bugs.launchpad.net/openstack-gate/+bug/161374912:51
openstackLaunchpad bug 1613749 in OpenStack-Gate "Timeouts when requesting a glance image created with a remote image from git.o.o" [Undecided,New]12:51
kgiustiozamiatin: infra was working on it yesterday - apparently not fixed yet.12:51
ozamiatinkgiusti: thanks! the problem is not on our side then :))12:53
*** jecarey has joined #openstack-oslo12:55
kgiustiozamiatin: nope.  Likely due to a network connectivity issue.  Hint: if you see traceroute failures in the console output (and it's an osic host) you're hitting the bug.  See: http://logs.openstack.org/67/352667/1/check/gate-oslo.messaging-src-dsvm-full-zmq/c2f8b97/console.html#_2016-08-17_11_00_25_65786012:55
*** yamamoto has joined #openstack-oslo12:55
ozamiatinkgiusti: aha, got it12:56
kgiustiozamiatin: we can either just keep rechecking in hope that we avoid an osic system, or disable voting in all the tempest-related checks (that's risky IMHO).12:57
ozamiatinkgiusti: hope they will fix the infra soon12:58
ozamiatinkgiusti: switching tempest off is not a good idea, I was wrong proposing this https://review.openstack.org/#/c/355919/12:59
patchbotozamiatin: patch 355919 - openstack-infra/project-config - Remove n-net related gates (ABANDONED)12:59
kgiustiozamiatin: yeah - agreed.12:59
*** rlrossit has joined #openstack-oslo12:59
*** spzala_ has joined #openstack-oslo13:01
kgiustiozamiatin: http://lists.openstack.org/pipermail/openstack-dev/2016-August/101811.html13:02
*** gordc has joined #openstack-oslo13:05
*** pradk has quit IRC13:06
openstackgerritOleksii Zamiatin proposed openstack/oslo.messaging: [zmq] Host name and target in socket identity  https://review.openstack.org/35645113:07
*** jpena|lunch is now known as jpena13:18
*** yamamoto has quit IRC13:29
*** eandersson_ has joined #openstack-oslo13:30
*** yamamoto has joined #openstack-oslo13:30
*** edmondsw has joined #openstack-oslo13:37
*** mtanino has joined #openstack-oslo13:37
kgiustiansmith: ping - I'm going to update the amqp1 feature branch to bring it up-to-date with master before we start the merge13:38
kgiustiansmith: that may affect this https://review.openstack.org/#/c/348009/2 as it's against the feature branch13:40
patchbotkgiusti: patch 348009 - oslo.messaging (feature/amqp-dispatch-router) - [AMQP 1.0] Environment setup to support dispatch r...13:40
ansmithkgiusti: ok, thanks13:40
kgiustiansmith: you'll likely need to re-issue the patch on master (if we get the branch merged first)13:40
*** jeckersb_gone is now known as jeckersb13:44
*** Jaison has quit IRC13:46
*** thumpba has joined #openstack-oslo13:52
*** cdent has quit IRC13:53
*** ociuhandu has quit IRC14:01
*** amotoki has quit IRC14:05
*** Rockyg has joined #openstack-oslo14:07
*** pradk has joined #openstack-oslo14:08
*** tonytan4ever has joined #openstack-oslo14:10
*** amotoki has joined #openstack-oslo14:12
*** ociuhandu has joined #openstack-oslo14:12
*** ihrachys has joined #openstack-oslo14:14
*** spzala_ has quit IRC14:14
*** spzala has joined #openstack-oslo14:14
*** mpotdar_ has joined #openstack-oslo14:14
*** spzala has quit IRC14:17
*** spzala has joined #openstack-oslo14:17
*** jeckersb is now known as jeckersb_gone14:17
*** zz_dimtruck is now known as dimtruck14:19
*** jeckersb_gone is now known as jeckersb14:20
*** hockeynut has joined #openstack-oslo14:20
*** ihrachys has quit IRC14:21
*** ihrachys has joined #openstack-oslo14:21
*** ihrachys has quit IRC14:23
*** ihrachys has joined #openstack-oslo14:24
*** cfriesen has quit IRC14:24
*** hemanthm|afk is now known as hemanthm14:27
*** yamamoto has quit IRC14:27
*** yamahata has joined #openstack-oslo14:27
*** yamamoto has joined #openstack-oslo14:29
*** itisha has joined #openstack-oslo14:30
*** yamamoto has quit IRC14:34
openstackgerritJavier Peña proposed openstack/oslo.vmware: Make the mock call in MemoryCacheTest forward-compatible  https://review.openstack.org/35585114:40
*** ihrachys has quit IRC14:47
*** ihrachys has joined #openstack-oslo14:49
*** ihrachys has quit IRC14:50
*** ihrachys has joined #openstack-oslo14:51
*** siva_krishnan has left #openstack-oslo14:55
*** openstackgerrit has quit IRC15:03
*** openstackgerrit has joined #openstack-oslo15:04
*** ozamiatin has quit IRC15:07
*** ihrachys has quit IRC15:08
*** ihrachys has joined #openstack-oslo15:09
*** amotoki has quit IRC15:10
*** ihrachys has quit IRC15:11
*** ihrachys has joined #openstack-oslo15:12
*** ihrachys has quit IRC15:16
*** ihrachys has joined #openstack-oslo15:16
*** ihrachys has quit IRC15:26
*** ihrachys has joined #openstack-oslo15:26
*** sdake_ has joined #openstack-oslo15:27
sdake_hey folks15:27
sdake_dhellmann sent me this direction - looking for a little coaching on using pbr properly in openstack projects15:27
sdake_if we install via pip, pbr shows the installed version, even if working out of the git repo15:28
sdake_what we want is even if a version is installed via pip, the git version will be used instead of the system-wide installed version15:28
sdake_all our code is correct in terms of using the right set of python code, ansible code, and docker code depending on these two circumstances15:29
sdake_it seems like pbr is unable to prioritize git repos ahead of the systemwide settings15:29
sdake_(or maybe it can and we don't know how to do so)15:29
*** ihrachys has quit IRC15:30
*** ihrachys has joined #openstack-oslo15:30
*** yamamoto has joined #openstack-oslo15:32
*** ihrachys has quit IRC15:32
*** yamamoto has quit IRC15:37
*** mpotdar_ has quit IRC15:37
*** mpotdar_ has joined #openstack-oslo15:38
*** ihrachys has joined #openstack-oslo15:42
*** ozamiatin has joined #openstack-oslo15:43
*** thumpba has quit IRC15:44
*** ihrachys has quit IRC15:48
*** ihrachys has joined #openstack-oslo15:49
*** code-R_ has quit IRC15:49
*** ihrachys has quit IRC15:51
*** mhickey has quit IRC15:53
*** ihrachys has joined #openstack-oslo15:53
*** amotoki has joined #openstack-oslo15:56
*** ozamiatin has quit IRC15:57
*** rcernin has quit IRC15:58
*** sdake_ is now known as sdake16:00
*** sdake is now known as sdake_16:00
*** snizar_ has joined #openstack-oslo16:03
*** snizar has joined #openstack-oslo16:03
*** andymaier has quit IRC16:03
*** dmellado is now known as dmellado|off16:05
*** ihrachys has quit IRC16:12
jrollsdake_: to clarify, you want "pip install ." (in a git repo) to be used instead of the already-installed system package e.g. apt-get install nova?16:12
sdake_jroll meeting  atm, can i get back with you?16:13
sdake_kolla team meeting in openstack-meeting-416:13
jrollsdake_: of course, disclaimer I'm not an expert :)16:13
*** code-R has joined #openstack-oslo16:13
dhellmannsdake_ : IIRC, pbr is going to use the setuptools metadata for a package if that's present, and it would be after you pip install. What issue is that causing for you?16:21
sdake_dhellmann - team meeting atm - finishes in 40 mins - can I get back to you?16:21
dhellmannsdake_ : yes, I was just leaving my question here for you16:22
*** ihrachys has joined #openstack-oslo16:25
*** ihrachys has quit IRC16:28
*** cdent has joined #openstack-oslo16:39
dhellmannharlowja : it would be good to get https://review.openstack.org/#/c/353029/ into next week's releases if we can16:40
patchbotdhellmann: patch 353029 - stevedore - do not emit warnings for missing hooks16:40
dhellmannjd__ : ^^16:40
*** ihrachys has joined #openstack-oslo16:41
*** spzala has quit IRC16:41
*** spzala has joined #openstack-oslo16:42
*** ihrachys has quit IRC16:44
*** ihrachys has joined #openstack-oslo16:46
*** spzala has quit IRC16:46
*** ihrachys has quit IRC16:49
*** ihrachys has joined #openstack-oslo16:49
*** mpotdar_ has quit IRC16:51
*** lpetrut has quit IRC16:52
*** sambetts is now known as sambetts|afk16:56
sdake_dhellmann ya its using the setuptools metadata - but the problem is this leads to a version inconsistency when we work from within git16:56
sdake_if master is installed for example, and i am working on the stable branch in git, our code does the wrong thing wrt tagging images16:57
sdake_it uses the pbr version from teh system rather then git16:57
sdake_what I was curious about is if there is a  mechanism to override that, or if that is just how it is and need to learn to love it ;)16:57
*** yamahata has quit IRC16:58
sdake_my expectation would be that if pbr finds git, it uses git tags, if it doesn't find git, it doesn't use git tags16:58
sdake_but I don't know how it works under the hood16:58
sdake_jroll ^^16:58
jrolldon't have two things installed side-by-side, would be my recommendation :)16:59
sdake_jroll well we only hve one thing installed and another from git16:59
sdake_jroll but ya i get the intent of  the message - dont have anything installed16:59
sdake_is that the only solution?17:00
dhellmannsdake_ : is this a case of using the same working dir with multiple branches?17:00
jrollsdake_: is the thing from git installed?17:00
sdake_jroll it is not installed17:00
*** lucasagomes is now known as lucas-dinner17:00
jrollsdake_: can I see your pbr code?17:00
*** tesseract- has quit IRC17:00
sdake_dhellmann - the reproducer for us is pip instlal kolla=2.0.2 - git clone kolla - git checkout stable/mitaka17:01
sdake_dhellmann then from within git dir, pbr produces the answer 3.0.0 intead of 2.0.217:01
dhellmannif the git directory isn't the installed version, then yeah the package metadata is going to be used17:01
sdake_sorry pip install master17:01
sdake_messed that reproducer up17:01
sdake_jroll moment let me hunt it down17:02
jrollright, if you import pbr and use it to find a version, I believe it only uses the installed version17:02
sdake_https://github.com/openstack/kolla/blob/master/kolla/version.py#L1517:02
sdake_if there is no installed version it uses the git tags to make a version determination17:02
jrollright17:03
sdake_i guess what I want is the order of precdence reversed17:03
sdake_current order: if any version installed -> that version is used next ignore git17:04
sdake_desired order: if any version installed -> if git present use git, otherwise use system version17:05
sdake_no such capacity in pbr?17:05
*** e0ne has quit IRC17:05
jrollnot that I know of, but I'm nowhere near an expert17:05
sdake_jroll cool thanks for helping brainstorm atleast17:05
dhellmannit's hard-coded to use git as a fallback17:05
sdake_jroll i hardly understand this stuff17:05
sdake_dhellmann got it hard coded17:06
sdake_so answer is no way to override precedence17:06
jrollsdake_: magic!17:06
dhellmannand to use pkg_resources to look at the metadata if it's found17:06
dhellmannis there any reason the git version can't just be installed?17:06
sdake_dhellmann they change - meaning have to git install each time - pip install -e works here, but not for everyone's environment17:07
dhellmannyeah17:07
jrollso one suggestion, without knowing what the task is (building images?)17:07
sdake_for some distros pip -e install is busted completely - dont know why17:07
jrollmaybe have a tox job for building those when running from git checkouts17:07
dhellmannyou're not using pip from system packages, I hope17:07
jrollthen it'll always be the current git tree version, because virtualenvs17:07
sdake_dhellmann no pip upgrade is our first step17:08
dhellmannk17:08
sdake_or one of them anyway17:08
sdake_dhellmann - sysstem packages of pip - that is something  i never debug with people17:09
sdake_dhellmann that may make pip install -e work on all distros17:10
dhellmannsdake_ : one way your suggestion would break things is that pbr assumes any git repo is the package for which it's being asked a version, because it assumes the only reason the metadata isn't present is that you're running in a test configuration of some sort. so if we change the precedence order, and you're in a random git directory, you'll get the version for that for every package you ask about (unless we make the17:10
dhellmann git logic smarter somehow)17:10
dhellmannIOW, the git logic makes a lot of assumptions17:10
sdake_dhellmann roger - I think I can work something out that involves a workflow for devs vs a workflow for eval/deploy17:11
sdake_which is "dont install the system packages"17:11
dhellmannyeah, I think that's going to be your most reliable way forward17:11
sdake_rather don't install the kolla package ia pip17:11
jrollsdake_: I think tox targets would work really well here17:11
sdake_jroll interestingly tox I think worked for someone (the virtualenv part)17:12
jrollright, it's intended to :)17:12
dhellmanntox may be another good option, if you set up a tox environment to run the services then you'll always get what's in the current repo17:12
sdake_but that is relaly hard to work with as an eval type person17:12
sdake_our cmds take options17:12
dhellmannI'm not sure what an "eval type person" is17:12
sdake_don't want to confuse peopel with multliple commands and usign tox17:12
sdake_dhellmann - someone consuming the software17:12
sdake_vs developing or it17:13
sdake_for it17:13
dhellmannah17:13
jrollright, tox is for devs17:13
sdake_ya - devs can handle whatever we throw at em :)17:13
sdake_this is about making it easy on the operators17:13
dhellmannyeah, I mean you can do stuff like "tox -e venv -- command -w ith args" but that's not great as an eval tool17:13
jrolldo operators work out of git repos, generally?17:13
sdake_dhellmann right - diffeerent set of cmds then what they would typically use17:13
sdake_jroll our instructions recommend it - there is a review up to change that to pip install kolla (from pypi)17:14
sdake_but it has a version pin ==2.0.2 to get mitaka for eg17:14
sdake_and people don't like that in the review17:14
jrollah17:15
sdake_(because we have to maintain a list of pins to use.. in the docs)17:15
sdake_cool well folks thanks for the brainstorm session17:15
sdake_it was fantasitc to have17:15
openstackgerritGevorg Davoian proposed openstack/oslo.messaging: [zmq] Implement retries for unacknowledged CALLs  https://review.openstack.org/35352917:15
*** lpetrut has joined #openstack-oslo17:15
sdake_i have to do some thinking - but  think I have enough to work with17:15
jrollawesome :)17:16
sdake_jroll dhellmann ++!17:16
dhellmannsdake_ : good!17:17
openstackgerritGevorg Davoian proposed openstack/oslo.messaging: [zmq] Implement retries for unacknowledged CALLs  https://review.openstack.org/35352917:19
*** amotoki has quit IRC17:24
*** ihrachys has quit IRC17:25
*** amotoki has joined #openstack-oslo17:25
*** tonytan4ever has quit IRC17:25
*** rcernin has joined #openstack-oslo17:26
*** lpetrut has quit IRC17:27
*** amotoki has quit IRC17:28
*** Rockyg has quit IRC17:32
*** yamamoto has joined #openstack-oslo17:34
openstackgerritMerged openstack/oslo.context: Manually specify from_dict parameters  https://review.openstack.org/34125017:36
*** yamamoto has quit IRC17:38
dansmithharlowja: dims: this should really make it in for newton, is that plausible? https://review.openstack.org/#/c/355981/317:38
patchbotdansmith: patch 355981 - oslo.versionedobjects - Fix remotable object change tracking17:38
dansmithwiating on a project config change to fix a broken job before we can land17:38
*** yamahata has joined #openstack-oslo17:40
*** stevemar_ has joined #openstack-oslo17:43
*** stevemar_ has quit IRC17:43
*** hockeynut has quit IRC17:48
*** jdandrea has joined #openstack-oslo17:52
*** spzala has joined #openstack-oslo17:53
*** jdandrea_ has quit IRC17:55
*** spzala has quit IRC17:58
*** hockeynut has joined #openstack-oslo17:59
*** code-R has quit IRC18:00
*** spzala has joined #openstack-oslo18:00
harlowjadansmith sure, let's try to get it18:02
dansmithokay18:03
openstackgerritMerged openstack/oslo.messaging: Add docstring for get_notification_transport  https://review.openstack.org/35505318:07
*** dkehn has quit IRC18:07
*** dkehn_ has quit IRC18:08
openstackgerritMerged openstack/stevedore: do not emit warnings for missing hooks  https://review.openstack.org/35302918:12
*** mtanino has quit IRC18:13
*** ozamiatin has joined #openstack-oslo18:15
*** dkehn has joined #openstack-oslo18:15
*** dkehn_ has joined #openstack-oslo18:20
*** ociuhandu has quit IRC18:24
*** tonytan4ever has joined #openstack-oslo18:26
amrithharlowja, quick question. what's your take on https://review.openstack.org/#/c/339787/? do you think it's going to make it in time for newton? I'm guessing no but want to make sure. thx18:28
patchbotamrith: patch 339787 - oslo.config - Add Range type18:28
*** mpotdar_ has joined #openstack-oslo18:29
*** mpotdar_ has quit IRC18:29
harlowjaamrith seems like it could18:30
harlowjaif it merges soon :-P18:30
*** mpotdar_ has joined #openstack-oslo18:30
amriththx harlowja18:31
*** tonytan4ever has quit IRC18:31
*** rlrossit_ has joined #openstack-oslo18:38
*** rlrossit has quit IRC18:41
*** hoonetorg has quit IRC18:53
*** lpetrut has joined #openstack-oslo18:57
harlowjaamrith ok, some comments added, small things that i'd like before that one merges19:03
*** thumpba has joined #openstack-oslo19:05
*** jamielennox has quit IRC19:06
*** hoonetorg has joined #openstack-oslo19:06
*** jamielennox has joined #openstack-oslo19:09
*** jeckersb is now known as jeckersb_gone19:11
*** snizar_ has quit IRC19:13
*** snizar has quit IRC19:13
*** spzala has quit IRC19:18
*** spzala has joined #openstack-oslo19:19
*** spzala_ has joined #openstack-oslo19:22
*** spzala has quit IRC19:23
*** ociuhandu has joined #openstack-oslo19:25
bknudsongot an issue with oslo.db live db testing -- looks like the database doesn't get cleaned up after the TestCase finishes and therefor the next TestCase fails.19:26
*** spzala_ has quit IRC19:26
bknudsonso things were working fine when we had a single TestCase using "FIXTURE = test_base.MySQLOpportunisticFixture", but now we've got 2 and the tests are failing.19:26
bknudsonhttps://review.openstack.org/#/c/349939/22/keystone/tests/unit/test_sql_upgrade.py19:26
patchbotbknudson: patch 349939 - keystone - Add expand, data migration and contract logic to k...19:26
*** edmondsw has quit IRC19:28
*** jeckersb_gone is now known as jeckersb19:34
*** eandersson_ has quit IRC19:36
harlowjazzzeek andytime to look into that ^19:38
harlowja*anytime19:38
zzzeekbknudson: did someting change that is suddenly causing this19:39
harlowjak19:39
bknudsonzzzeek: it's a new review, so the review is making the change.19:39
zzzeekbknudson: ok...19:40
bknudsonthe live testing has been working great for several months19:40
*** dimtruck is now known as zz_dimtruck19:43
bknudsoninteresting fact -- the failures are not consistent. First time I ran it locally saw 2 failures, now not seeing any, and CI only got 1 failure.19:44
zzzeekbknudson: that's not unusual assuming you're working w/ multi-process testing19:44
zzzeekbknudson: it's likely these tests nver cleaned up within the schema19:44
bknudsonoh, right, will switch to single-threaded.19:44
zzzeekbknudson: however...the current fixtures normally would set up and tear down the whole DB for each test unless you're using the optimizing function at the package level19:45
*** spzala has joined #openstack-oslo19:45
zzzeekin which case it shoudl do a drop all19:45
*** code-R has joined #openstack-oslo19:45
-openstackstatus- NOTICE: The volume for logs.openstack.org filled up rather suddenly, causing a number of jobs to fail with a POST_FAILURE result and no logs; we're manually expiring some logs now to buy breathing room, but any changes which hit that in the past few minutes will need to be rechecked and/or approved again19:45
bknudsonzzzeek: I never did figure out how to use the optimizing loader... on my todo list.19:45
bknudsonmaybe it's time.19:46
zzzeekbknudson: well it's broke anyway so wait til harlowja and others can get aroud to reviewing my patches I mention everyday on IRC here :)19:46
bknudson:)19:46
bknudsonmaybe that's why I didn't do it from the beginning19:46
harlowjayes boss19:46
zzzeekbknudson: it would work at the package level though ...19:46
*** code-R_ has joined #openstack-oslo19:49
zzzeekbknudson: um.  anyway you can make sure the error reproduces in pure single-threaded and perhaps you can use pdb to see what the DB state is doing ?  it should be in a differently-named database for every test.  e.g. DROP DATABASE when a test ends, brand new CREATE DATABASE for new test19:49
*** spzala has quit IRC19:49
bknudsonwill give it a shot.19:49
zzzeekbknudson: unless!  your test is not actaully hitting mysql / Posgresql and is accidentally using sqlite19:49
zzzeekbknudson: ah.  this might be.19:49
zzzeekbecause neutron had the same problem19:49
bknudsonthe live tests are pretty slow19:50
*** spzala has joined #openstack-oslo19:50
zzzeekbknudson: hm19:50
bknudsonmuch slower than the sqlite live tests19:50
zzzeekbknudson: when I see: with sql.session_for_write() as session:  , how is session_for_write() getting a hold of "self.engine" from the test case?19:51
bknudsonzzzeek: you're right to be worried about this... I had to do some trickery... let me see if I can find it.19:52
zzzeekbknudson: seems like using the enginefacade is new in this patch?19:52
*** code-R has quit IRC19:52
zzzeekbknudson: so, the current whole test_base thing doesn't have much of a system for that, except it writes to the *global* enginefacade, which nobody seems to use19:52
zzzeekhence all the patches I have in review19:52
bknudsonthere were uses of sql.session_for_write() before, so not a new thing: http://git.openstack.org/cgit/openstack/keystone/tree/keystone/tests/unit/test_sql_upgrade.py#n29619:56
zzzeekbknudson: any chance that's using sqlite and not the mysql / PG db19:58
zzzeekbknudson: neutron had this problem19:58
bknudsonI'm going to try the breakpoint thing and see if I can catch the db create / teardown.19:59
zzzeekbknudson: easy test, "with sql.session_for_write() as session: session.execute("select * from mysql.user")"19:59
zzzeekor seothuing that will crash on sqlie19:59
bknudsonzzzeek: ok, added a test to verify it's mysql and that worked as expected.20:02
zzzeekbknudson: weird.  where is sql.session_for_Write() getting plugged in ?20:02
zzzeekbknudson: oh.  you;re using the global enginefacade :)20:03
zzzeekin tests, at least.20:03
bknudsonI'm trying to find the test code that sets up the global facade...20:04
bknudsonbecause I'm pretty sure I needed to do some odd stuff.20:04
redrobotohai oslo friends20:07
bknudsonzzzeek: https://review.openstack.org/#/c/294246/9/keystone/common/sql/core.py20:07
patchbotbknudson: patch 294246 - keystone - Switch migration tests to oslo.db DbTestCase (MERGED)20:07
redrobotI have a question about oslo.config20:07
zzzeekbknudson: yeah found that20:08
redrobotdoes oslo.config support adding config sections in the way that tox does its ini config20:08
redrobotfor example [testenv] and then [testenv:foo] [testenv:bar] etc20:09
bknudsonzzzeek: I *think* that was to support sqlite in-memory db (since the same engine must always be used)20:09
zzzeekbknudson: well needed for the opportunistic DBs also.  anyway, i dont see anthing that woudl interfere w/ the DROP DB on every test20:10
*** mpotdar_ has quit IRC20:14
bknudsonok, working on pdb20:17
*** mpotdar_ has joined #openstack-oslo20:18
*** e0ne has joined #openstack-oslo20:20
*** Jokke_ has quit IRC20:35
*** Jokke_ has joined #openstack-oslo20:37
bknudsonaccording to pdb the database is dropped on every test (not TestCase)20:37
bknudsonmight explain why it takes so long to run the tests.20:39
bknudsondoesn't explain why it looks like not cleaning up.20:40
*** rcernin has quit IRC20:40
*** snizar has joined #openstack-oslo20:42
*** snizar_ has joined #openstack-oslo20:42
*** ansmith has quit IRC20:47
bknudsonzzzeek: put a print statement in the drop db -- http://paste.openstack.org/show/559095/ happens on every test...20:50
zzzeekbknudson: looking20:54
zzzeekbknudson: k so the next thing is, go in your tests, pdb, do a "select database()", make sure its the name you expect.  do "show tables",  make sure there are none of them.20:56
zzzeekbknudson: you can do it in process w/ session.execute("show tables").fetchall()20:56
bknudsonhere's a bit of info -- it's actually the sqlite "live" test that's failing.20:56
zzzeekbknudson: that changes everything :)20:57
bknudsony, I'm wondering if there isn't an assumption about that db cleaning itself.20:57
zzzeekbknudson: so...if you take all the Mysql/PG opportunistic stuff out of the module entirely, or similar, just test at the sqlite level20:57
bknudsonrun in this order, the sqlite one fails: keystone.tests.unit.test_sql_upgrade.PostgreSQLOpportunisticContractSchemaUpgradeTestCase.test_001_created_at_made_non_nullable keystone.tests.unit.test_sql_upgrade.SqlContractSchemaUpgradeTests.test_001_created_at_made_non_nullable20:57
zzzeekbknudson: confirmed it's dependent on the PG and/or MySQL test being run ?20:58
*** edmondsw has joined #openstack-oslo20:58
*** e0ne has quit IRC21:00
bknudsoncommented out the mysql & postgresql TetsCases, no failure.21:00
bodenharlowja jd__ : tenacity is very cool. I have 1 question: https://github.com/jd/tenacity/issues/11    best I can tell it suits all my use cases already21:05
harlowjaboden cools21:05
*** sdague has quit IRC21:06
harlowjajd__  might be able to answer that i think21:06
bodenwhy isn’t it in global requirements yet!! ; )21:06
harlowjalol21:06
*** snizar_ has quit IRC21:06
*** snizar has quit IRC21:06
openstackgerritMerged openstack/oslo.db: Link enginefacade to test database provisioning  https://review.openstack.org/35252021:07
*** zz_dimtruck is now known as dimtruck21:07
jd__boden: I didn't release it but I will soon :)21:07
jd__boden: I replied on GitHub :)21:08
*** gordc has quit IRC21:08
bodennice work… minimal but very functional21:08
harlowjajd__  aims to please21:10
harlowjalol21:10
bodenjd__ do we still think “marked wait” (https://github.com/rholder/retrying/pull/51) should live outside of the repo?21:11
zzzeekbknudson: k, next pdb is, get into the sqlite test there and see whats in the DB21:12
jd__boden: you can send a PR with that function implemented :)21:12
jd__it's modular now so we don't need to refactor __init__ or whatever21:13
bodenjd__ will do21:13
*** snizar has joined #openstack-oslo21:13
*** snizar_ has joined #openstack-oslo21:13
jd__if you think it's worth it – I'm more into wait_functions that computes times automatically than tuples, but whatever :)21:13
bodenI’m trying to solve some actual uses in openstack, I’m not into tuples or anything ; )21:14
bknudsonzzzeek: see this : http://paste.openstack.org/show/559100/ -- everything looks fine except the column value is off.21:14
bknudsonthis is wackier than I imagined it would be.21:14
harlowjawhats this about tuples21:16
*** jeckersb is now known as jeckersb_gone21:16
*** spzala has quit IRC21:17
*** spzala has joined #openstack-oslo21:18
bknudsonzzzeek: if I change the order of the tests now it's postgres that fails: http://paste.openstack.org/show/559101/21:18
zzzeekbknudson: any cahnce you can config and/or hardcode connection_debug=50 for your oslo.db create_engine and start looking in the SQL output ?21:19
*** kgiusti has left #openstack-oslo21:20
bknudsonI'm going to make a quick check with another pdb when the col is created / updated and then try connection_debug=50.21:20
bknudsonmight have something to do with the migrate version tables...21:22
*** spzala has quit IRC21:22
*** rlrossit_ has quit IRC21:22
*** cdent has quit IRC21:23
*** pradk has quit IRC21:29
*** boden has quit IRC21:29
bknudsonwe've got 3 repos now, and for some reason it's running the contract migration when a function was called to run the expand migrations21:30
openstackgerritMerged openstack/oslo.messaging: Clean outdated docstring and comment  https://review.openstack.org/35325321:31
*** lpetrut has quit IRC21:44
*** mpotdar_ has quit IRC21:44
*** dtardivel has quit IRC21:47
*** sdake_ has quit IRC22:06
*** amotoki has joined #openstack-oslo22:09
*** amotoki_ has joined #openstack-oslo22:10
*** amotoki has quit IRC22:14
*** spzala has joined #openstack-oslo22:17
*** spzala has quit IRC22:17
*** spzala has joined #openstack-oslo22:17
*** sdake has joined #openstack-oslo22:21
*** ozamiatin has quit IRC22:22
*** hockeynut has quit IRC22:22
*** lucas-dinner has quit IRC22:23
*** eeiden has quit IRC22:25
*** syjulian has quit IRC22:25
*** jeckersb_gone has quit IRC22:25
*** yamamoto has joined #openstack-oslo22:30
*** jeckersb_gone has joined #openstack-oslo22:30
*** lucasagomes has joined #openstack-oslo22:30
*** abashmak has joined #openstack-oslo22:34
abashmakHello, anybody on this channel?22:35
*** sdake has quit IRC22:38
harlowjaabashmak hello22:42
abashmakHi harlowja22:42
abashmakI have a question22:42
*** syjulian has joined #openstack-oslo22:43
abashmakI'm trying to override a config option using set_override, the option has a defined list of choices specified, but there is a test that provides a different value that's not in the list22:43
abashmakI thought I could use set_override to change the choices list temporarily, then clear_override afterwards22:44
abashmakPerhaps I misunderstand the purpose of set_override22:45
harlowjaya, i don't think set_override means change the option all together22:46
harlowjai think it just means override the values (from set of valid values)22:46
harlowjawhere that set is still valid22:47
harlowjaseems like if22:47
harlowja'different value that's not in the list' is a valid value, then it should be in the 'ok' set?22:47
abashmakit's a test value22:47
abashmakso we don't want it in the ok list22:48
harlowjaso u are testing oslo.config?22:49
*** eeiden has joined #openstack-oslo22:49
*** amotoki_ has quit IRC22:50
abashmakNo22:50
abashmakat least I don't believe so :)22:50
harlowjaya, i think i get what u are trying to do22:51
harlowjahave u tried turning off the `enforce_type` to set_override22:52
harlowjaat least https://github.com/openstack/oslo.config/blob/master/oslo_config/fixture.py#L51 seems like that may help22:52
abashmakYeah, tried that, the set_override call goes through, but later the test option is still rejected22:54
harlowjahmmmm22:55
abashmakin fact I had it set to False from the start, when I changed to enforce=True, it actually barfed on the set_override call22:55
harlowjapart that i can't seem to get out of my mind is that it seems like it should be getting rejected :-P22:55
harlowjabecause it really isn't valid, even if u just want to bypass that during a test22:55
abashmakI actually had the same question as you, but being new thought the test devs knew better. Looking back, I should've clarified it from the start22:56
abashmakLet me pose that as an existential question to the experts on my project22:57
harlowjadhellmann do u know the best way to do that (is it even possible) ^22:57
harlowjadhellmann  knows oslo.config better than mysel22:57
harlowja*myself22:57
*** spzala has quit IRC22:58
*** spzala has joined #openstack-oslo22:58
dhellmannabashmak : what is your test trying to do?22:58
dhellmannthat is, are you testing the option class or are you trying to set an option to a "bad" value and test your code somehow?22:59
abashmakThis is in Glance, it's testing the images API. We have several options for communicating with the DAL (database abstraction layer): including SQLAlchemy or an optional Registry service. These are specified as choices in the 'data_api' config. The test is testing using the Registry. But instead of providing a valid value, it's setting a mock value. The only reason that I can think of, being that the Registry is a separate service and perhaps23:01
abashmaknot running in the functional test environment23:01
*** spzala has quit IRC23:03
dhellmannabashmak: do you have a link to the code? I'm still not understanding the issue.23:04
abashmakone sec23:05
abashmakdhellmann: https://github.com/openstack/glance/blob/master/glance/tests/functional/v2/test_images.py#L290623:06
abashmakand here's where the valid choices are being set: https://review.openstack.org/#/c/354332/7/glance/common/config.py23:07
patchbotabashmak: patch 354332 - glance - Improving help text for data access API option23:07
*** amotoki has joined #openstack-oslo23:08
dhellmannabashmak : ok, so the test is setting the data api module name but the patch you linked there is trying to restrict the valid set of names that can be used in that option, right?23:08
abashmakthat's right23:09
dhellmannhow does the api_server object load the registry API, where is that code?23:09
abashmakLooking...23:10
*** amotoki has quit IRC23:13
abashmakIt's not obvious to me23:13
dhellmannnormally the way I'd do this is mock out the function that instantiates the data_api thing so it returns a value without looking at the config at all, but I don't know if that's abstracted enough23:13
dhellmannthe other way to do it is to use stevedore to load the plugins, and to use a test manager instead of a real manager, since you can inject whatever plugins you want that way23:13
dhellmannI don't know if glance is using stevedore, though, because if it was I wouldn't expect to see these long module names23:14
abashmakSounds like I need to dig into and learn more about the code and change the test in one of the ways you suggest23:16
dhellmannyeah23:16
abashmakOK, thank you for your help dhellmann, harlowja23:17
dhellmannabashmak : have a look at glance/db/__init__.py -- I think the get_api() function in that module is the one you would need to mock23:18
dhellmannabashmak : http://paste.openstack.org/show/559757/23:18
abashmakI see it.23:19
abashmakthanks!23:20
dhellmannabashmak : sure, I hope that helps!23:20
*** amotoki has joined #openstack-oslo23:35
*** amotoki has quit IRC23:41
bknudsonzzzeek: sqlalchemy-migrate keeps a cache of objects & looks up when you create something, so here's from pdb: http://paste.openstack.org/show/560282/23:44
bknudsonsomehow the PythonScript object for key '/opt/stack/keystone/keystone/common/sql/expand_repo/versions/001_make_password_create_at_non_nullable.py' is '/opt/stack/keystone/keystone/common/sql/contract_repo/versions/001_make_password_create_at_non_nullable.pyc'23:45
bknudsonwhen it should be '/opt/stack/keystone/keystone/common/sql/expand_repo/versions/001_make_password_create_at_non_nullable.pyc'23:45

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!