Monday, 2015-11-16

*** serverascode has quit IRC01:32
*** davidlenwell has quit IRC01:33
*** eglute has quit IRC01:33
*** davidlenwell has joined #refstack01:34
*** ChanServ sets mode: +o davidlenwell01:34
*** serverascode has joined #refstack01:37
*** eglute has joined #refstack01:38
*** davidlenwell_ has joined #refstack07:10
*** davidlenwell has quit IRC07:15
*** openstackgerrit has quit IRC10:16
*** openstackgerrit has joined #refstack10:17
*** esker has joined #refstack10:18
*** esker has quit IRC10:28
*** openstack has joined #refstack12:50
*** edmondsw has joined #refstack13:28
*** esker has joined #refstack14:33
*** esker has quit IRC14:38
*** resker has joined #refstack14:42
*** resker has quit IRC14:43
*** esker has joined #refstack14:43
*** esker has quit IRC14:54
*** sslypushenko has quit IRC16:52
*** sslypushenko has joined #refstack16:52
*** davidlenwell_ is now known as davidlenwell17:15
*** ChanServ sets mode: +o davidlenwell17:15
*** dwalleck has joined #refstack17:51
*** catherineD has joined #refstack18:10
*** pvaneck has joined #refstack18:45
hogepodgecatherineD: I wasn't able to get tempest locking accounts to work with the installed version of tempest. When I use master the failures I was hitting went away.20:01
catherineDhogepodge:  what is the error?20:01
hogepodgecatherineD: no configured accounts20:01
hogepodgewhen I'm using accounts.yaml20:01
hogepodgecatherineD: it could be user error, though.20:01
hogepodgecatherineD: another problem I hit is resource starvation after a number of runs.20:02
mtreinishhogepodge: the configuration shouldn't have changed20:02
mtreinishhogepodge: are we leaking accounts?20:02
hogepodgetempest doesn't clean up after itself, and I think we should provide or run cleanup scripts after refstack-client runs to delete ports, security groups, vms, volumes, and so on.20:02
catherineDhave notice something last night when I working with this bug https://bugs.launchpad.net/refstack/+bug/151645820:03
openstackLaunchpad bug 1516458 in refstack "refstack-client test failure with test-list option" [Undecided,New] - Assigned to Catherine Diep (cdiep)20:03
hogepodgemtreinish: refstack-client installs an older version of tempest. I know that I get the most success in running from master20:03
mtreinishhogepodge: tempest should cleanup anything it makes... :(20:03
mtreinishoh, ok20:03
hogepodgemtreinish: I agree, I was running into the most trouble with security groups and ports20:03
mtreinishbah, network tests20:04
catherineDwe have run many tests with the current installed tempest version with locking accounts ...20:04
hogepodgecatherineD: I may have configured it wrong20:04
hogepodgemtreinish: I'm also wondering if we might be able to expand the configuration guide to include more networking information. I was doing a lot of "search" configuration figuring out how to get a floating ip installation tested. I worked it out, but I am sure that some config options are just silly for what I actually wanted (there was a mix of cloud misconfiguration and just figuring stuff on the tempest side and fi20:06
hogepodgending and cleaning up resource leaks)20:06
catherineDone thing I notice is that "testr list-tests" in the past all we need is to have a tempest.conf file in the ./etc directory the tempest.conf could be a copy of the tempest..conf.sample.... but with the recent run I need to use a valid tempest.conf not just a copy of the sample20:06
catherineDthat is with the same tempest version20:06
mtreinishhogepodge: fwiw, there was a patch at one point to fix the cleanup script packaged in tempest to handle test accounts properly20:06
mtreinishalthough I think it's out of date and never landed20:07
mtreinishcatherineD: you shouldnt need a tempest.conf at all20:07
catherineDmtreinish: yup ..20:07
catherineDbut not sure why I needed it now ...20:07
hogepodgemtreinish: you can see what I'm configuring here https://github.com/hogepodge/defcore-tools/blob/hogepodge/puppetlabs-openstack/ansible/playbooks/cloudconfig.yml and here https://github.com/hogepodge/defcore-tools/blob/hogepodge/puppetlabs-openstack/ansible/playbooks/templates/tempest.conf.j2 (I set run_validation to true, but haven't pushed that change yet)20:07
mtreinishthere is 1 test module that requires a tempest.conf at import, which is a longstanding bug (but without a proposed workaround) that can cause errors during import if the conf file is invalid20:08
hogepodgemtreinish: I'm using accounts.yaml, so the tenants/users aren't destroyed after failed runs.20:08
mtreinishbut that's been there since like grizzly20:08
hogepodgemtreinish: I'm trying to replicate testing against public clouds20:08
hogepodgemtreinish: I was definitely leaking security groups and network ports20:08
mtreinishhogepodge: you're using ansible!20:08
catherineDhere is a bug that I open for refstack to deal with the situation where testr list-tests need a tempest.conf  https://bugs.launchpad.net/refstack/+bug/151645820:08
openstackLaunchpad bug 1516458 in refstack "refstack-client test failure with test-list option" [Undecided,New] - Assigned to Catherine Diep (cdiep)20:08
mtreinishcatherineD: why is that a refstack bug?20:09
hogepodgemtreinish: and puppet. https://github.com/hogepodge/puppetlabs-openstack20:09
hogepodgemtreinish: whatever gets the job done20:09
mtreinishhogepodge: heh, I'm just giving you a hard time about not being a puppet purist :)20:09
catherineDbecause if refstack-client initialize the env variable "TEMPEST_CONFIG_DIR" and "TEMPEST_CONFIG"  then tempest would be able to identty the correct tempest,conf for testr list-tests20:10
mtreinishcatherineD: you shouldn't need to have a tempest.conf at all set to run a list-tests20:11
catherineDmtreinish: still I am not quite sure why testr list-tests need a tempest,conf ... this is testing with the same tempest version but installed yesterday .. the differences are the library20:11
catherineDmtreinish: exactly ... that is how we have been running until maybe a week ago ...20:11
mtreinishcatherineD: which sounds like a tempest bug...20:11
catherineDI feel like someting in oslo lib but not sure ... will dig in more20:12
mtreinishlike I said there is 1 module which tries to use the conf file at import time (which is all test discovery does, import the tests) but we fast path around that case if the file isn't defined20:13
mtreinishwell 1 that uses it for real (there are others that aren't critical)20:13
mtreinishhogepodge: that looks reasonable (well assuming you're running serially)20:15
mtreinishhogepodge: you're running against a keystone v3 cloud?20:15
mtreinishcatherineD: the other thing I just remembered is we do have a unit test to ensure that tempest can always run a list test without config: https://github.com/openstack/tempest/blob/master/tempest/tests/test_list_tests.py20:22
catherineDmtreinish: great this will be helpful ...  thx for the link20:28
*** dwalleck has quit IRC20:33
*** sarob_ has joined #refstack20:59
hogepodgemtreinish: v2/v321:11
hogepodgemtreinish: I've deployed both21:11
mtreinishhogepodge: ok cool, I guess v3 is more common place now than like a year ago21:21
*** sarob_ has quit IRC22:05
*** sslypushenko has quit IRC22:54
*** sslypushenko has joined #refstack22:54
*** edmondsw has quit IRC23:06
*** lifeless has quit IRC23:06
*** lifeless has joined #refstack23:09
*** edmondsw has joined #refstack23:13

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!