| openstackgerrit | zhangyanxian proposed openstack/ceilometer-powervm master: Optimize the link address for fetching git code https://review.openstack.org/447339 | 01:53 |
|---|---|---|
| *** tjakobs has joined #openstack-powervm | 05:39 | |
| *** tjakobs has quit IRC | 05:51 | |
| *** k0da has joined #openstack-powervm | 08:30 | |
| *** openstackgerrit has quit IRC | 09:02 | |
| *** a1fisher has quit IRC | 09:52 | |
| *** a1fisher has joined #openstack-powervm | 09:53 | |
| *** smatzek has joined #openstack-powervm | 11:17 | |
| *** kylek3h has quit IRC | 11:55 | |
| *** svenkat has joined #openstack-powervm | 12:04 | |
| *** edmondsw has joined #openstack-powervm | 12:14 | |
| *** kylek3h has joined #openstack-powervm | 12:37 | |
| *** mdrabe has joined #openstack-powervm | 12:50 | |
| *** a1fisher has left #openstack-powervm | 13:08 | |
| *** jpasqualetto has joined #openstack-powervm | 13:13 | |
| *** tblakes has joined #openstack-powervm | 13:18 | |
| *** tblakes has quit IRC | 13:19 | |
| *** tblakes has joined #openstack-powervm | 13:19 | |
| *** smatzek has quit IRC | 13:32 | |
| *** tjakobs has joined #openstack-powervm | 13:46 | |
| *** kriskend has joined #openstack-powervm | 13:53 | |
| *** tblakes has quit IRC | 13:57 | |
| *** kriskend_ has joined #openstack-powervm | 13:58 | |
| *** kriskend_ has quit IRC | 13:59 | |
| *** smatzek has joined #openstack-powervm | 14:00 | |
| *** kriskend has quit IRC | 14:00 | |
| *** esberglu has joined #openstack-powervm | 14:00 | |
| *** a1fisher has joined #openstack-powervm | 14:00 | |
| *** jpasqualetto has quit IRC | 14:09 | |
| *** tblakes has joined #openstack-powervm | 14:15 | |
| esberglu | PowerVM CI is currently experiencing issues. It appears to be related to issues with the network. | 14:20 |
| esberglu | CI runs may fail and will require a recheck once the network issues are resolved | 14:21 |
| *** jpasqualetto has joined #openstack-powervm | 14:22 | |
| *** burgerk has joined #openstack-powervm | 14:23 | |
| efried | boo. Thanks for the heads up. | 14:24 |
| *** apearson has joined #openstack-powervm | 14:24 | |
| esberglu | Can't get on to the systems to look at what is impacted atm | 14:25 |
| adreznec | Yeah | 14:25 |
| adreznec | I think there's a ticket open for lab network issues | 14:25 |
| efried | yuh | 14:25 |
| esberglu | Yep | 14:25 |
| adreznec | So we'll be in rough shape for a while until that's resolved | 14:25 |
| efried | The only thing I was really concerned about was https://review.openstack.org/443956 | 14:26 |
| *** tjakobs has quit IRC | 14:26 | |
| efried | That guy has been in flight for a while. It's not urgent. But was ready to get it closed out. | 14:27 |
| efried | So no big deal. | 14:27 |
| *** efried has quit IRC | 14:39 | |
| *** jpasqualetto has quit IRC | 14:49 | |
| *** tjakobs has joined #openstack-powervm | 14:51 | |
| *** jpasqualetto has joined #openstack-powervm | 15:11 | |
| *** jpasqualetto has quit IRC | 15:28 | |
| *** efried has joined #openstack-powervm | 15:35 | |
| *** jpasqualetto has joined #openstack-powervm | 15:51 | |
| *** a1fisher has quit IRC | 16:22 | |
| *** openstackgerrit has joined #openstack-powervm | 16:22 | |
| openstackgerrit | Matt Rabe proposed openstack/nova-powervm master: Don't let dlt_vopt exceptions bubble up in CreateAndConnectCfgDrive reversion https://review.openstack.org/447579 | 16:22 |
| esberglu | CI is up and running again | 16:32 |
| esberglu | efried: Kicked off another run on the change you linked above | 16:33 |
| efried | Thanks. | 16:34 |
| *** k0da has quit IRC | 17:03 | |
| *** a1fisher has joined #openstack-powervm | 17:36 | |
| *** antonym has joined #openstack-powervm | 17:41 | |
| *** a1fisher has quit IRC | 17:47 | |
| *** jpasqualetto has quit IRC | 17:47 | |
| *** jpasqualetto has joined #openstack-powervm | 17:59 | |
| svenkat | efried: I seek your attention for an issue around rescheduling VM and allocation of network resouces around it. When a VM reschedule fails, network allocation is not released and new network resource is allocated for second attempt. If both attempts fail, both resources are released. If second attempt succeeds, first allocation stays in ‘unbound’ state until it is cleaned up. I found a fix for this. In nova/compute/manager - ComputeManager | 18:15 |
| svenkat | class - _do_build_and_run_instance method, there is a call for self.driver.deallocate_networks_on_reschedule(instance). If this method returns True for specific driver, network is cleanedup if reschedule fails. (when _build_and_run_instance fails and throws RescheduledException). Since nova_powervm driver does not override deallocate_networks_on_reschedule and default implementation in nova/virt/driver returns False, for Novalink based VM | 18:15 |
| svenkat | reschedules, network resources are not cleaned up. I will put together a patchset for nova_powervm with an override that returns True. ( i see it is done already in community ironic nova driver). | 18:15 |
| svenkat | let me know if there are concerns and need discussions here. | 18:19 |
| *** a1fisher has joined #openstack-powervm | 19:02 | |
| *** jayasankar_ has joined #openstack-powervm | 19:19 | |
| jayasankar_ | efried: I ran the current tempest whitelist with Intree driver change set https://review.openstack.org/#/c/409402/23 and ended up with 29 failures out of Total tests: 805 | 19:22 |
| jayasankar_ | do we have to fix all those failures on the changeset 409402 ? or have to run them or the first changeset https://review.openstack.org/#/c/438119/5 ? | 19:23 |
| *** k0da has joined #openstack-powervm | 19:25 | |
| efried | svenkat Good deal, thank you. If there is not already a launchpad bug, please open one, and subscribe me & thorst | 19:30 |
| efried | jayasankar_ We have to investigate those failures. I'd like you to work with esberglu, as we don't expect to have any failures, because you're using the same config and whitelist as the CI environment. | 19:31 |
| svenkat | efried: sure. I will do. | 19:31 |
| efried | I'm guessing you're seeing failures that the CI env avoids by configuring default networks just so. | 19:31 |
| esberglu | jayansankar_: I'm looking at your results right now | 19:38 |
| esberglu | Invalid input for field/attribute imageRef. Value: -04-01_2g_id. u'-04-01_2g_id' is not valid under any of the given schemas | 19:39 |
| esberglu | Looks like you don't have the correct image_ref set in tempest.conf | 19:39 |
| esberglu | Did you set that yourself? Or did you try to use the os_ci_tempest.sh script to set that? | 19:40 |
| jayasankar_ | I used os_ci_tempest in which I gave the correct image location | 19:41 |
| esberglu | As I've said before, the os_ci_tempest.sh script is tailored specifically for the CI environment | 19:45 |
| esberglu | So I'm suspecting that it is probably not working correctly out-of-the box | 19:45 |
| esberglu | I'm looking at the script right now to see where it might be going wrong | 19:45 |
| *** smatzek has quit IRC | 19:47 | |
| esberglu | Yep. If you look in your tempest.conf file | 19:47 |
| esberglu | /opt/stack/powervm-ci/tempest | 19:47 |
| esberglu | /opt/stack/powervm-ci/tempest/tempest.conf | 19:47 |
| esberglu | You will see that image_ref, image_ref_alt, flavor_ref, flavor_ref_alt | 19:48 |
| esberglu | are not set | 19:48 |
| adreznec | jayasankar_ is there a reason you're trying to use os_ci_tempest instead of just following the standard tempest config process? That script is super-specific to our exact CI environment, which means it won't work for anything else without manual work or effort from esberglu and/or efried to make it more generic | 19:48 |
| adreznec | Which, to be frank, doesn't seem worth the effort | 19:49 |
| efried | adreznec Not sure I agree that it's super specific to our CI env. | 19:49 |
| esberglu | adreznec: Yes I agree, I think there may have been some confusion between me and jayasankar_ | 19:49 |
| efried | Any confusion would have been my doing. I definitely suggested that jayasankar_ use os_ci_tempest.sh as a jumping off point. | 19:50 |
| efried | If those values aren't getting set by os_ci_tempest.sh, it's going to be because of an issue with os_ci_tempest.conf | 19:51 |
| esberglu | jayasankar_: The tempest.conf file found in the powervm-ci repo should have nearly everything set for you | 19:51 |
| esberglu | Except for a few sections | 19:51 |
| adreznec | efried: Super-specific might be a bit of an exaggeration, but the conf it generates isn't going to be generically compatible for non-CI tempest environments | 19:51 |
| esberglu | Look for the comments about vars being set dynamically | 19:51 |
| adreznec | Which means that jayasankar_ is going to have to do manual config work either way | 19:51 |
| efried | adreznec in what way(s)? | 19:52 |
| esberglu | Those are the ones you will have to set yourself | 19:52 |
| efried | Regardless of whether we're CIing or not, jayasankar_'s env is going to have to have similar tweaks in terms of default networks etc. in order to function properly. | 19:52 |
| efried | But other than that, os_ci_tempest.sh is *specifically* designed to set up all the right flavors, images, etc. to make tempest run without a lot of manual work. | 19:53 |
| efried | It was written to help the CI out, but there's nothing CI-specific about it. | 19:53 |
| efried | (name notwithstanding) | 19:53 |
| esberglu | jayasankar_: Did you set the IMGFILE variable in os_ci_tempest_intree.conf? | 20:00 |
| jayasankar_ | Yeah | 20:00 |
| adreznec | efried: Sorry, had to switch locations for a meeting. I thought there was stuff in there specific to using SSP, configuring the specific private network range, etc, which are things that jayasankar_ certainly could have his environment configured to use, but wouldn't necessarily be true since the goal of this was to test out things outside our standard CI config. | 20:01 |
| efried | adreznec Testing things outside our standard CI config is a fair point. But yeah, jayasankar_ has SSP etc., so there's really nothing I would expect not to work. | 20:02 |
| adreznec | Not saying he couldn't start with it, but being able to manually change the tempest config is going to be a requirement to drive the different test configs here | 20:02 |
| efried | adreznec Definitely. | 20:03 |
| adreznec | As long as jayasankar_ understands what the os_ci_tempest scripting is actually doing to set up the environment then you guys can definitely help him to get it working | 20:04 |
| adreznec | Just don't want to spend time spinning on something that is only a short-term solution | 20:05 |
| esberglu | jayasankar_: Have you looked through that script at all? | 20:05 |
| efried | adreznec Yeah, okay. jayasankar_ the point of you using os_ci_tempest.sh is to get your environment set up so that you can run tempest. It'll set up flavors, images, etc., and then set up your tempest.conf. After that, you should probably just run tempest manually. (You can look at how os_ci_tempest.sh does that as an example.) | 20:06 |
| esberglu | jayasankar_: os_si_tempest.sh has an option to just do the prep work and not actually run tempest | 20:09 |
| esberglu | So to do what efried said above you can use that | 20:09 |
| esberglu | jayasankar_: Questions about any of that? | 20:11 |
| jayasankar_ | both are one and the same right ? triggering the scripts manually using the same command over os_ci_tempest.sh triggering the script? | 20:11 |
| esberglu | Yeah | 20:12 |
| jayasankar_ | setting the environment or (using the os_ci_tempest script) is temporary for intree at the moment ? | 20:12 |
| esberglu | Not sure I understand your question fully. But no it is not temporary, it is going to continue to be used for both in and out-of-tree CI | 20:14 |
| jayasankar_ | ah okay..as I understood that the current white list was developed for the first change set, still it is supposed to pass on any of the latest change set right ? | 20:16 |
| esberglu | Yes | 20:16 |
| esberglu | You aren't failing because of problems with the driver right now. You are failing because your configuration is not correct for some reason | 20:17 |
| esberglu | It thinks that the imageRef is "-04-01_2g_id" | 20:17 |
| esberglu | which is incorrect | 20:17 |
| efried | It may be a matter of special characters being interpreted by the shell. | 20:18 |
| *** mdrabe_ has joined #openstack-powervm | 20:18 | |
| esberglu | What do you have IMGFILE set to in os_ci_tempest_intree.conf | 20:18 |
| efried | IMGFILE=/home/neo/IMG/Ubuntu_16-04-01_2g.img | 20:19 |
| efried | I know wtf is happening. | 20:20 |
| efried | os_ci_tempest.sh constructs names of stuff using underscores. | 20:21 |
| efried | there's evals all over the place. | 20:22 |
| *** burgerk has quit IRC | 20:27 | |
| *** apearson has quit IRC | 20:28 | |
| *** tblakes has quit IRC | 20:29 | |
| *** mdrabe has quit IRC | 20:29 | |
| esberglu | efried: We can just rename the image to get around that right | 20:32 |
| efried | yeah | 20:32 |
| esberglu | jayasankar_: ^^ remove the underscores from the image name and update the conf accordingly | 20:33 |
| *** apearson has joined #openstack-powervm | 20:33 | |
| efried | I'd remove the hyphens too. Just call it Ubuntu2g.img or something. | 20:36 |
| jayasankar_ | Instead of Ubuntu_16-04-01_2g, Ubuntu-16-04-01-2g | 20:36 |
| jayasankar_ | ? | 20:36 |
| efried | I'd remove the hyphens too. Just call it Ubuntu2g.img or something. | 20:37 |
| jayasankar_ | ah okay | 20:37 |
| efried | I'm not sure if I'm delimiting anything with hyphens in there. This should be safe, though. | 20:37 |
| jayasankar_ | updated the conf, triggering the os_ci_tempest.sh again.. | 20:43 |
| *** tblakes has joined #openstack-powervm | 20:43 | |
| *** a1fisher has quit IRC | 20:45 | |
| *** apearson has quit IRC | 20:52 | |
| *** kjw3 has joined #openstack-powervm | 20:52 | |
| jayasankar_ | This time also Failed tests:29, but got the error [Errno 17] File exists: '/opt/stack/tempest/.testrepository' in between | 20:57 |
| jayasankar_ | am looking at the failed cases.. should we delete .testrepository every time before we trigger ? | 20:58 |
| *** apearson has joined #openstack-powervm | 20:59 | |
| openstackgerrit | Merged openstack/nova-powervm master: Don't let dlt_vopt exceptions bubble up in CreateAndConnectCfgDrive reversion https://review.openstack.org/447579 | 20:59 |
| *** svenkat has quit IRC | 21:01 | |
| efried | mdrabe_ ocata backport? ^^ | 21:14 |
| *** mdrabe_ is now known as mdrabe | 21:14 | |
| mdrabe | yes please is that okay? | 21:14 |
| efried | Fine by me. | 21:14 |
| mdrabe | thnx | 21:14 |
| *** tblakes has quit IRC | 21:22 | |
| *** kylek3h has quit IRC | 21:58 | |
| *** jpasqualetto has quit IRC | 22:01 | |
| *** esberglu has quit IRC | 22:05 | |
| *** esberglu has joined #openstack-powervm | 22:06 | |
| *** esberglu has quit IRC | 22:10 | |
| *** mdrabe has quit IRC | 22:17 | |
| *** efried has quit IRC | 22:24 | |
| *** apearson has quit IRC | 22:25 | |
| *** tjakobs has quit IRC | 22:25 | |
| *** edmondsw has quit IRC | 22:26 | |
| *** esberglu has joined #openstack-powervm | 22:56 | |
| *** esberglu has quit IRC | 23:01 | |
| *** k0da has quit IRC | 23:45 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!