Friday, 2018-10-19

*** s10 has quit IRC00:06
*** s10 has joined #openstack-placement00:06
*** s10 has quit IRC00:07
*** s10 has joined #openstack-placement00:07
*** s10 has quit IRC00:08
*** s10 has joined #openstack-placement00:08
*** s10 has quit IRC00:08
*** s10 has joined #openstack-placement00:09
*** s10 has quit IRC00:09
*** s10 has joined #openstack-placement00:10
*** s10 has quit IRC00:10
*** s10 has joined #openstack-placement00:10
*** s10 has quit IRC00:11
*** s10 has joined #openstack-placement00:11
*** s10 has quit IRC00:12
*** takashin has joined #openstack-placement00:12
*** s10 has joined #openstack-placement00:12
*** s10 has quit IRC00:12
*** s10 has joined #openstack-placement00:13
*** s10 has quit IRC00:13
*** s10 has joined #openstack-placement00:13
*** s10 has quit IRC00:14
*** s10 has joined #openstack-placement00:14
*** s10 has quit IRC00:15
*** s10 has joined #openstack-placement00:15
*** s10 has quit IRC00:15
*** s10 has joined #openstack-placement00:16
*** s10 has quit IRC00:16
*** s10 has joined #openstack-placement00:17
*** s10 has quit IRC00:17
*** s10 has joined #openstack-placement00:17
*** s10 has quit IRC00:18
*** s10 has joined #openstack-placement00:18
*** s10 has quit IRC00:18
*** s10 has joined #openstack-placement00:19
*** s10 has quit IRC00:19
*** s10 has joined #openstack-placement00:20
*** s10 has quit IRC00:20
*** s10 has joined #openstack-placement00:20
*** s10 has quit IRC00:21
*** s10 has joined #openstack-placement00:21
*** s10 has quit IRC00:22
*** s10 has joined #openstack-placement00:22
*** s10 has quit IRC00:22
*** s10 has joined #openstack-placement00:23
*** s10 has quit IRC00:23
*** s10 has joined #openstack-placement00:23
*** s10 has quit IRC00:24
*** s10 has joined #openstack-placement00:24
*** s10 has quit IRC00:25
*** s10 has joined #openstack-placement00:25
*** s10 has quit IRC00:25
*** s10 has joined #openstack-placement00:26
*** s10 has quit IRC00:26
*** s10 has joined #openstack-placement00:27
*** s10 has quit IRC00:27
*** s10 has joined #openstack-placement00:27
*** s10 has quit IRC00:28
*** s10 has joined #openstack-placement00:28
*** s10 has quit IRC00:29
*** s10 has joined #openstack-placement00:29
*** s10 has quit IRC00:29
*** s10 has joined #openstack-placement00:30
*** s10 has quit IRC00:30
*** s10 has joined #openstack-placement00:30
*** s10 has quit IRC00:31
*** s10 has joined #openstack-placement00:31
*** s10 has quit IRC00:32
*** s10 has joined #openstack-placement00:32
*** s10 has quit IRC00:32
*** s10 has joined #openstack-placement00:33
*** s10 has quit IRC00:33
*** s10 has joined #openstack-placement00:34
*** s10 has quit IRC00:34
*** s10 has joined #openstack-placement00:34
*** s10 has quit IRC00:35
*** s10 has joined #openstack-placement00:35
*** s10 has quit IRC00:36
*** s10 has joined #openstack-placement00:36
*** s10 has quit IRC00:36
*** s10 has joined #openstack-placement00:37
*** s10 has quit IRC00:37
*** s10 has joined #openstack-placement00:37
*** s10 has quit IRC00:38
*** s10 has joined #openstack-placement00:38
*** s10 has quit IRC00:39
*** s10 has joined #openstack-placement00:39
*** s10 has quit IRC00:39
*** s10 has joined #openstack-placement00:40
*** s10 has quit IRC00:40
*** s10 has joined #openstack-placement00:41
*** s10 has quit IRC00:41
*** s10 has joined #openstack-placement00:41
*** s10 has quit IRC00:42
*** s10 has joined #openstack-placement00:42
*** s10 has quit IRC00:42
*** s10 has joined #openstack-placement00:43
*** s10 has quit IRC00:43
*** s10 has joined #openstack-placement00:44
*** s10 has quit IRC00:44
*** s10 has joined #openstack-placement00:44
*** s10 has quit IRC00:45
*** s10 has joined #openstack-placement00:45
*** s10 has quit IRC00:46
*** s10 has joined #openstack-placement00:46
*** s10 has quit IRC00:46
*** s10 has joined #openstack-placement00:47
*** s10 has quit IRC00:47
*** s10 has joined #openstack-placement00:47
*** s10 has quit IRC00:48
*** s10 has joined #openstack-placement00:48
*** s10 has quit IRC00:49
*** tetsuro has joined #openstack-placement01:37
*** lei-zh has joined #openstack-placement02:06
*** lei-zh has quit IRC02:31
*** lei-zh has joined #openstack-placement02:31
*** tetsuro has quit IRC02:59
*** tetsuro has joined #openstack-placement03:02
*** lei-zh has quit IRC03:32
*** tetsuro has quit IRC04:03
*** tetsuro has joined #openstack-placement04:05
*** tetsuro has quit IRC04:33
*** s10 has joined #openstack-placement05:18
*** s10 has quit IRC06:19
*** lei-zh has joined #openstack-placement06:20
*** e0ne has joined #openstack-placement06:37
openstackgerritZhenyu Zheng proposed openstack/nova-specs master: Detach and attach boot volumes - Stein  https://review.openstack.org/60062807:17
*** helenafm has joined #openstack-placement07:33
*** tssurya has joined #openstack-placement07:49
*** rubasov has quit IRC07:55
*** rubasov has joined #openstack-placement07:55
*** takashin has left #openstack-placement08:00
*** e0ne has quit IRC08:03
*** tetsuro has joined #openstack-placement08:27
*** s10 has joined #openstack-placement08:34
*** lei-zh has quit IRC08:58
*** helenafm has quit IRC09:01
*** e0ne has joined #openstack-placement09:09
*** ttsiouts has joined #openstack-placement09:12
*** s10 has quit IRC09:15
*** helenafm has joined #openstack-placement09:21
openstackgerritChris Dent proposed openstack/placement master: Clean up and clarify tox.ini  https://review.openstack.org/61171909:39
*** s10 has joined #openstack-placement09:50
openstackgerritTetsuro Nakamura proposed openstack/nova-specs master: Spec: Support filtering by forbidden aggregate  https://review.openstack.org/60335210:13
*** tetsuro has quit IRC10:20
*** helenafm has quit IRC10:23
*** tetsuro has joined #openstack-placement10:31
*** cdent has joined #openstack-placement10:35
*** helenafm has joined #openstack-placement10:45
*** tetsuro has quit IRC10:58
*** e0ne has quit IRC11:01
*** e0ne has joined #openstack-placement11:52
*** mriedem has joined #openstack-placement12:19
*** cdent has quit IRC12:24
*** dansmith is now known as SteelyDan12:45
*** mdbooth has joined #openstack-placement12:49
*** stephenfin is now known as finucannot12:57
finucannotI'm trying to run the tests for osc-placement but everything's failing with 'Missing value auth-url required for auth plugin password'. What do I need to do?13:32
*** rubasov has quit IRC14:05
*** mriedem has quit IRC14:06
*** mriedem has joined #openstack-placement14:09
*** s10 has quit IRC14:15
openstackgerritStephen Finucane proposed openstack/osc-placement master: Enforce key-value'ness for 'allocation candidate list --resource'  https://review.openstack.org/61188314:18
openstackgerritStephen Finucane proposed openstack/osc-placement master: tox: Hide deprecation warnings from stdlib  https://review.openstack.org/61188414:18
*** s10 has joined #openstack-placement14:21
*** efried is now known as efried_pto14:26
*** ttsiouts has quit IRC14:50
*** e0ne has quit IRC14:52
sean-k-mooneyfinucannot: have you sourced your openrc file in devstack?14:55
sean-k-mooneyby the way do people know if cdent has left for the weekend or just for lunch?14:56
*** s10 has quit IRC15:01
*** ttsiouts has joined #openstack-placement15:01
finucannotsean-k-mooney: Do I need DevStack deployed? They're functional tests, no integration tests15:03
finucannot*not15:03
sean-k-mooneyfinucannot: well if they are fucntional test osc-placement is not going to help15:03
finucannotsean-k-mooney: I just want to run the tests I added above in https://review.openstack.org/#/c/611883/15:04
finucannotbut 'tox -e functional osc_placement.tests.functional.test_allocation_candidate' moans with that error15:04
sean-k-mooneyoh ok15:04
finucannotSo I'm obviously doing _something_ wrong but it's not documented what15:04
*** helenafm has quit IRC15:05
sean-k-mooneylet me try and run that locally15:05
finucannotsean-k-mooney: No rush. It's in the CI now so it's either good or I'll either have to rework based on that results15:06
finucannot*the15:06
sean-k-mooneyi get the same error15:08
finucannotYeah, we must have to do something so that's not documented15:09
* finucannot looks as zuul config15:09
sean-k-mooneysame issue on master too15:09
finucannotYeah, the functional tests are using DevStack15:09
finucannotMeaning these are actually integration tests. Lovely.15:10
sean-k-mooneyfinucannot: right so they are like the neutron ones15:10
finucannotYup, and not like the nova ones15:10
finucannotAight, I'm leaving that to that gate so :)15:10
sean-k-mooneyfinucannot: not exactly they are only testing placement so they are not full integration testes they are still functional15:10
sean-k-mooneyam i think cdent has a docker container he uses or a gabby server for placement testing15:11
*** tssurya has quit IRC15:11
sean-k-mooneynot sure if the osc-plugin expects those15:11
finucannotMy understanding of functional tests was that they should test interactions between various sub-services of that same service15:11
finucannotMocking out all external dependencies15:11
*** ttsiouts has quit IRC15:12
finucannotBut I know we've differed there in the past :) (libvirt stuff)15:12
sean-k-mooneyfinucannot: yes but useing the placement api would be resonably for the placement api client15:12
finucannotNot if all I want to test is the CLI parsing15:12
sean-k-mooneyneutron has openvswithc functional test the require openvswtich to be installed15:12
finucannotYou could still stub out openvswitch15:13
sean-k-mooneyfinucannot: then use unit test not fuctional tests15:13
sean-k-mooneyfinucannot: i think they have a fake api servece somewhere however that you can use15:13
finucannotEh, the test I've written should work. I just can't run it locally atm15:13
finucannotGood enough for me15:13
sean-k-mooneyfinucannot: this was the dev enve thing i was refering too that cdent created https://github.com/cdent/placedock15:18
*** mriedem is now known as mriedem_afk15:27
sean-k-mooneyfinucannot: https://github.com/openstack/python-openstackclient/blob/master/doc/source/contributor/developing.rst#running-functional-tests so the osc docs mention that they functional tests expect a devstack env just like neutrons dsvm-functional jobs15:34
finucannotsean-k-mooney: Indeed. Good spot. I guess we should add that doc to osc-placement too15:35
finucannotOr at least link to it15:35
sean-k-mooneyya probably a good idea.15:36
*** ttsiouts has joined #openstack-placement15:37
*** openstackgerrit has quit IRC16:24
*** ttsiouts has quit IRC16:30
*** e0ne has joined #openstack-placement16:35
*** e0ne has quit IRC16:37
*** mdbooth has quit IRC17:06
*** cdent has joined #openstack-placement17:20
*** e0ne has joined #openstack-placement17:53
*** openstackgerrit has joined #openstack-placement17:55
openstackgerritChris Dent proposed openstack/placement master: Use gabbi-tempest job from gabbi-tempest plugin  https://review.openstack.org/60750817:56
cdentefried_pto, finucannot : sorry for rushing that tox change without checking it properly. made some adjustments and doing that checking now17:57
*** e0ne has quit IRC18:00
openstackgerritChris Dent proposed openstack/placement master: Fix genpolicy tox job  https://review.openstack.org/61192718:01
openstackgerritChris Dent proposed openstack/placement master: Clean up and clarify tox.ini  https://review.openstack.org/61171918:06
*** e0ne has joined #openstack-placement18:08
*** gibi is now known as gibi_off18:12
*** mriedem_afk is now known as mriedem18:41
cdentsean-k-mooney: lemme find the thing18:53
sean-k-mooneycdent: ya jay mentioned you were fixing some things in this area18:53
cdentah, I guess this is a new one, becuse it was lee who fixed the first one: "so we've worked past one issue and are now hitting another"18:54
sean-k-mooneyyes18:55
sean-k-mooneylee is on PTO so he asked me to contiue working on it18:55
sean-k-mooneyso the issue as far as i can tell is that since the placement_context_manager = enginefacade.transaction_context()18:56
sean-k-mooneyis initalised when we first load the module. if we reload the wsgi app due to a failure it gets loaded back into the same python interperater process and its not reinitallised18:56
sean-k-mooneyspecificlally https://github.com/openstack/placement/blob/master/placement/db_api.py#L2118:57
sean-k-mooneyso intailly i was going to catch the exception and skip the configeration the second tiem but mdbooth suggestion just recreating the transation_context in the configure function18:58
cdentyou're running under mod_wsgi, yeah?18:59
cdenti suppose it would be unfair to say "don't do that" :) ?18:59
cdentalso, you're seeing these problems in placement, there's some chance you'll get the same problem with running nova-api under mod wsgi, if you do that19:00
cdentanyway, reading the code19:00
sean-k-mooneyam im not sure i would have to check what tripplo does. there two questions i wanted to ask. 1 do you have a perference/other suggestion and second what is the process for submiting patchs to both nova and neutron.19:00
melwitthm, that looks similar to what we have in nova, so do we have the same problem in nova too? https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L8019:01
melwittwhich I now see cdent has already said19:01
cdentsean-k-mooney: do you mean both nova and placement?19:02
sean-k-mooneythat is a good question. so this is partly being uncovered because there is a race in how tripplo starts nova and placement. and how trippleo doe the db sync/migration of the same19:02
sean-k-mooneycdent: yes i ment nova and placement19:02
sean-k-mooneycdent: i belive both patches should have the same change id19:03
sean-k-mooneycdent: is there an odering i should follow?19:03
cdentwe haven't really established a pattern. it would certainly be nice to have the same change id. Since they won't really be a cherry-pick I don't it matters what order you use.19:03
cdentWhen mriedem recently did something similar for the consumer_id grouping bug, the code started in nova and went to placement.19:04
cdentI'd prefer it go the other way, but I don't think it actively matters _now_. Later it will.19:04
melwitt+1 change-id should be the same for both nova and placement, that's how we've been doing it19:04
sean-k-mooneyok that is quite simple to do19:05
sean-k-mooneyas for will this happen with nova api i guess its possible19:05
cdentby the way, the change-id for lee's earlier change is at I41b5c7990d4d62a3a397f1686261f3fb7dc1a0be19:07
sean-k-mooneycdent: so yes it looks like the docker contaienr command is httpd so mod_wsgi https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/nova-placement.yaml#L10719:07
cdentthat's what I thought. mod-wsgi and uwsgi have different approaches to how they deal with a wsgi application that has an exception during initialization19:07
sean-k-mooneyya so it looks like the code is not expecting for the apllication to be reloaded inside the same interperter  process on failure19:09
sean-k-mooneywhich is what i assume mod-wsgi is doing19:09
cdentyes19:10
sean-k-mooneyand for uwsgi i assume if it reloads the app it receretate the python iterperter19:10
cdentyup19:10
sean-k-mooneyya that is a pain19:10
sean-k-mooneyso do you have a perference.19:11
sean-k-mooneyi can recreate the context in configure or i can catch the excpetion19:11
sean-k-mooneyboth would work but we likely need to make the same change in the nova-api in that case19:11
sean-k-mooneymelwitt: cdent by the way should i also associate this with lee's bug https://bugs.launchpad.net/tripleo/+bug/1784155 or open a new one?19:12
openstackLaunchpad bug 1784155 in tripleo "nova_placement service start not coordinated with api db sync on multiple controllers" [High,Triaged] - Assigned to Martin Schuppert (mschuppert)19:12
sean-k-mooneyfrom a down stream perspecive its all related to the same issue but its technically a different failure19:13
melwittsean-k-mooney: normally you would just add a project to the existing bug but that one already shows a Fix Released for nova. is it that there was a fix but it didn't solve the problem?19:14
melwittif so, maybe just open a new bug to describe the current situation and use that19:14
cdentsean-k-mooney: I think this is pretty much a second issue, so agree with melwitt19:14
sean-k-mooneycool19:14
sean-k-mooneymelwitt: the first fix exposed a second issue19:15
melwittaye19:15
cdentI think I'd prefer the context in configure fix, but that might lead to needing to do some more cleanups elsewhere, I'm leaving some comments about that on the review.19:15
sean-k-mooneycdent: ok cool. ill make whatever changes are asked for on monday and file the bug ectra19:16
sean-k-mooneycdent: i dont hink anything shoudl have been using the context directly form the module import19:16
cdentprobably not, but that's the pattern that's been established in nova for a long long time19:17
sean-k-mooneyya the placemnet change im not expecting to break anything(partly because of the lack of any unit tests for that file) if i don the same transformaion in the nova api im less certin19:18
sean-k-mooneycdent: anyway thanks. its getting late for both of us so have a nice weekend. thanks for weighing in on what to do to adress this19:20
cdentif you were to straight up remove the module-level context, all the functional tests will fail19:20
cdentit needs to exist. but it doesn't need to be initialized at import time19:20
sean-k-mooneycdent: right i was going to set it to non but initalsed it in configure19:20
sean-k-mooney*None19:20
cdentyeah, exactly, said the sqme thing in my comments that I'm nearly done with19:21
sean-k-mooneycool that was mdbooth  suggestion too.19:21
sean-k-mooneymelwitt: it would be a different patch obviously but would you like me to look at doing a similar change for the nova api19:22
cdentmy comments are submitted now19:22
sean-k-mooneycdent: thanks :)19:23
melwittsean-k-mooney: it's up to you. if you could just add nova to the new launchpad bug so we don't lose track of it, that is good enough19:23
sean-k-mooneymelwitt: sure. i need to submit a patch to both placemnet and nova in both cases so ill add both projects19:25
melwittsean-k-mooney: coolness, thanks19:25
cdentplacement doesn't have a project in launchpad yet (last I checked), still a tag in nova19:26
cdentoperational bugs are the best kind of bugs19:26
sean-k-mooneyoh ok ill just file the bug against nova so and add the placement tag19:28
sean-k-mooneyill also mention the triplo bug as a related bug so that can track it too.19:28
* sean-k-mooney somtimes i feel like i spend more times tracking work then doing it19:29
*** e0ne has quit IRC19:34
*** e0ne has joined #openstack-placement19:34
*** e0ne has quit IRC19:36
* cdent waves goodnight20:12
*** cdent has quit IRC20:12
*** e0ne has joined #openstack-placement20:28
*** e0ne has quit IRC20:33
*** e0ne has joined #openstack-placement20:44
*** e0ne has quit IRC20:48
*** mriedem has quit IRC21:40
*** sean-k-mooney has quit IRC22:03

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!