| TheJulia | Oh, I bet I know what it is, nova-compute halts hard on startup and won't register it's self because it can't talk to ironic.... because ironic has not started yet. | 00:06 |
|---|---|---|
| *** rpioso has quit IRC | 00:08 | |
| *** ijw has joined #openstack-ironic | 00:10 | |
| *** Nisha_ has quit IRC | 00:12 | |
| TheJulia | http://logs.openstack.org/46/487246/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/bec38d6/logs/screen-n-cpu.txt.gz#_Jul_26_11_55_01_950490 | 00:21 |
| TheJulia | rloo: jlvillal ^^^ | 00:22 |
| *** rama_y_ has quit IRC | 00:28 | |
| *** masber has joined #openstack-ironic | 00:35 | |
| openstackgerrit | Peter Piela proposed openstack/ironic-ui master: Adds support for editing portgroups https://review.openstack.org/487867 | 00:46 |
| *** boris-42_____ has joined #openstack-ironic | 00:54 | |
| *** boris-42_____ is now known as boris_42 | 00:54 | |
| *** masber has quit IRC | 00:54 | |
| *** litao__ has joined #openstack-ironic | 00:57 | |
| *** hw_wutianwei has joined #openstack-ironic | 01:00 | |
| *** phuongnh has joined #openstack-ironic | 01:03 | |
| *** masber has joined #openstack-ironic | 01:08 | |
| *** harlowja has quit IRC | 01:10 | |
| openstackgerrit | Dao Cong Tien proposed openstack/ironic master: Tempest scenario test for boot-from-volume https://review.openstack.org/472740 | 01:15 |
| jlvillal | Revert landed. Hopefully the gate will be working again: https://review.openstack.org/488201 | 01:15 |
| patchbot | patch 488201 - openstack-dev/devstack - Revert "Wait for compute service to check in" (MERGED) | 01:15 |
| *** baoli has quit IRC | 01:27 | |
| *** baoli has joined #openstack-ironic | 01:28 | |
| *** penick has quit IRC | 01:30 | |
| *** ijw has quit IRC | 01:32 | |
| *** zhangfei has joined #openstack-ironic | 01:39 | |
| *** masber has quit IRC | 01:50 | |
| *** masber has joined #openstack-ironic | 01:52 | |
| *** rama_y has joined #openstack-ironic | 02:12 | |
| *** phuongnh has quit IRC | 02:19 | |
| *** penick has joined #openstack-ironic | 02:25 | |
| *** penick has quit IRC | 02:40 | |
| *** penick has joined #openstack-ironic | 02:41 | |
| *** ricardoas has quit IRC | 02:46 | |
| *** rama_y has quit IRC | 02:46 | |
| *** ricardoas has joined #openstack-ironic | 02:47 | |
| *** makowals has quit IRC | 02:55 | |
| *** phuongnh has joined #openstack-ironic | 02:58 | |
| *** mtanino has joined #openstack-ironic | 03:06 | |
| *** rloo has quit IRC | 03:11 | |
| *** makowals has joined #openstack-ironic | 03:11 | |
| *** masber has quit IRC | 03:13 | |
| *** baoli has quit IRC | 03:18 | |
| openstackgerrit | Ruby Loo proposed openstack/ironic master: Add 'GET /nodes/<node>/cleaning/steps' API request https://review.openstack.org/278566 | 03:28 |
| *** Nisha_Agarwal has joined #openstack-ironic | 03:34 | |
| *** mtanino has quit IRC | 03:37 | |
| *** udesale has joined #openstack-ironic | 03:38 | |
| *** rama_y has joined #openstack-ironic | 03:42 | |
| *** boris_42 has quit IRC | 03:43 | |
| *** masber has joined #openstack-ironic | 03:48 | |
| *** tiendc has joined #openstack-ironic | 03:50 | |
| masber | hi all, my node goes up to clean wait status and then fails (I am guessing because of timeout) the nodes restarts but it boots form local disk. I can't see the deploy logs so I ma guessing this is an issue with pxe boot? I can see this on the inspector logs http://paste.openstack.org/show/616807/ | 03:54 |
| masber | any idea? | 03:54 |
| masber | this may be more useful http://paste.openstack.org/show/616808/ | 03:56 |
| *** makowals has quit IRC | 04:02 | |
| *** makowals has joined #openstack-ironic | 04:11 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic master: Updated from global requirements https://review.openstack.org/488002 | 04:15 |
| *** links has joined #openstack-ironic | 04:20 | |
| *** vishwana_ has joined #openstack-ironic | 04:23 | |
| *** makowals has quit IRC | 04:25 | |
| *** vishwanathj has quit IRC | 04:26 | |
| *** yuanying has quit IRC | 04:28 | |
| *** makowals has joined #openstack-ironic | 04:30 | |
| *** harlowja has joined #openstack-ironic | 04:32 | |
| *** amarao has joined #openstack-ironic | 04:34 | |
| *** sasha2 has quit IRC | 04:41 | |
| *** yuanying has joined #openstack-ironic | 04:42 | |
| *** makowals has quit IRC | 04:43 | |
| *** jaianshu has joined #openstack-ironic | 04:48 | |
| *** vmud213 has joined #openstack-ironic | 04:48 | |
| *** stendulker has joined #openstack-ironic | 04:49 | |
| *** makowals has joined #openstack-ironic | 05:01 | |
| *** hshiina has joined #openstack-ironic | 05:11 | |
| *** vishwana_ has quit IRC | 05:16 | |
| *** vishwanathj has joined #openstack-ironic | 05:17 | |
| *** marios has joined #openstack-ironic | 05:18 | |
| openstackgerrit | John L. Villalovos proposed openstack/ironic master: grenade: Use test_with_retry to check if route is up https://review.openstack.org/487960 | 05:27 |
| *** harlowja has quit IRC | 05:28 | |
| *** vishwana_ has joined #openstack-ironic | 05:31 | |
| *** vishwanathj has quit IRC | 05:34 | |
| *** harlowja has joined #openstack-ironic | 05:41 | |
| *** penick has quit IRC | 05:42 | |
| *** mjura has joined #openstack-ironic | 05:49 | |
| *** karthiks has joined #openstack-ironic | 05:55 | |
| openstackgerrit | D G Lee proposed openstack/ironic master: ironic-conductor can't report heartbeat to database https://review.openstack.org/475210 | 06:00 |
| *** oomichi has quit IRC | 06:05 | |
| *** yuanying has quit IRC | 06:05 | |
| *** oomichi has joined #openstack-ironic | 06:06 | |
| *** yuanying has joined #openstack-ironic | 06:06 | |
| *** yuanying_ has joined #openstack-ironic | 06:07 | |
| *** yuanying has quit IRC | 06:10 | |
| *** oomichi has quit IRC | 06:10 | |
| *** oomichi has joined #openstack-ironic | 06:11 | |
| *** rcernin has joined #openstack-ironic | 06:15 | |
| openstackgerrit | Ankit Kumar proposed openstack/ironic master: Test cases for iLO drivers in standalone ironic https://review.openstack.org/460034 | 06:15 |
| *** jjung has joined #openstack-ironic | 06:28 | |
| *** samodid has joined #openstack-ironic | 06:30 | |
| *** jaganathan has joined #openstack-ironic | 06:32 | |
| *** amarao1 has joined #openstack-ironic | 06:32 | |
| *** phuongnh has quit IRC | 06:32 | |
| *** phuongnh has joined #openstack-ironic | 06:33 | |
| *** jaganathan has quit IRC | 06:40 | |
| *** harlowja has quit IRC | 06:48 | |
| *** dtantsur|afk is now known as dtantsur | 06:51 | |
| *** jaganathan has joined #openstack-ironic | 06:52 | |
| *** jtomasek has joined #openstack-ironic | 06:54 | |
| *** ccamacho has joined #openstack-ironic | 07:03 | |
| *** oomichi has quit IRC | 07:05 | |
| *** oomichi has joined #openstack-ironic | 07:06 | |
| *** adisky__ has quit IRC | 07:06 | |
| *** masber has quit IRC | 07:13 | |
| * pas-ha is back from PTO :) | 07:16 | |
| pas-ha | good morning ironic! :) | 07:16 |
| dtantsur | hey, morning pas-ha! | 07:17 |
| dtantsur | pas-ha: have you seen mordred's messages from yesterday? | 07:17 |
| pas-ha | morning dtantsur :) | 07:17 |
| pas-ha | yep, will start picking up where I've left those patches | 07:18 |
| pas-ha | also, my patch for 'none' auth has landed in ksa, so this can be used now instead of various 'auth_strategy' options in config | 07:19 |
| vdrok | morning ironic! dtantsur and pas-ha | 07:20 |
| *** masber has joined #openstack-ironic | 07:20 | |
| dtantsur | pas-ha: awesome! | 07:21 |
| *** phuongnh has quit IRC | 07:22 | |
| openstackgerrit | Merged openstack/bifrost master: Updated from global requirements https://review.openstack.org/487984 | 07:32 |
| *** masber has quit IRC | 07:38 | |
| *** mgoddard has joined #openstack-ironic | 07:42 | |
| *** ralonsoh has joined #openstack-ironic | 07:44 | |
| dtantsur | mgoddard: morning! the CI is down still, no much use rechecking :( | 07:49 |
| dtantsur | we need https://review.openstack.org/#/c/487458/ and https://review.openstack.org/#/c/487960/ to merge | 07:50 |
| patchbot | patch 487458 - ironic - Don't use multicell setup for any ironic jobs | 07:50 |
| patchbot | patch 487960 - ironic - grenade: Use test_with_retry to check if route is up | 07:50 |
| *** yufei has joined #openstack-ironic | 07:51 | |
| mgoddard | dtantsur: morning. Thanks, I'll stop prodding it then :) | 07:59 |
| *** ralonsoh has quit IRC | 07:59 | |
| *** ralonsoh has joined #openstack-ironic | 08:00 | |
| *** pester has quit IRC | 08:01 | |
| *** strigazi_ is now known as strigazi | 08:04 | |
| *** fxpester has joined #openstack-ironic | 08:05 | |
| etingof | morning everyone ;) | 08:06 |
| dtantsur | hi etingof | 08:07 |
| *** e0ne has joined #openstack-ironic | 08:13 | |
| mrunge | hey good morning, I currently have an issue with ovb. is this the right channel for virtual baremetal? | 08:13 |
| *** adisky__ has joined #openstack-ironic | 08:13 | |
| *** Nisha_ has joined #openstack-ironic | 08:15 | |
| *** Nisha_Agarwal has quit IRC | 08:17 | |
| dtantsur | mrunge: hi, nope. I guess #tripleo will work better | 08:18 |
| *** openstackgerrit has quit IRC | 08:18 | |
| dtantsur | mrunge: (there are two "kinds" of virtual baremetal: we're only responsible for virtualbmc, which is not used with ovb) | 08:18 |
| mrunge | dtantsur, aha. it's not? would you still have a quick look at this bug? https://bugs.launchpad.net/tripleo/+bug/1706585 | 08:19 |
| openstack | Launchpad bug 1706585 in tripleo "oooq with ovb fails with "instackenv.json did not validate"" [Medium,Triaged] | 08:19 |
| mrunge | it is filed on tripleo, I have it with ovb, Lee has it without ovb, it's a bit strange | 08:20 |
| mrunge | and I'd think there was a change quite low in the stack | 08:20 |
| *** derekh has joined #openstack-ironic | 08:20 | |
| dtantsur | mrunge: I think bnemec is your guy. Dunno about the ipmi-validate play, where does it come from? | 08:22 |
| mrunge | that is called by oooq | 08:23 |
| *** openstackgerrit has joined #openstack-ironic | 08:23 | |
| openstackgerrit | Merged openstack/sushy master: Add DELETE method to connector https://review.openstack.org/487231 | 08:23 |
| *** sambetts|afk is now known as sambetts | 08:23 | |
| mrunge | you can skip it, ipmi never succeeds anyways | 08:23 |
| *** e0ne has quit IRC | 08:23 | |
| dtantsur | lol, nice | 08:23 |
| mrunge | that'd be this bug: https://bugs.launchpad.net/tripleo/+bug/1706577 | 08:24 |
| openstack | Launchpad bug 1706577 in tripleo "oooq with ovb fails to launch compute node or controller" [Medium,Triaged] | 08:24 |
| mrunge | not sure if it's really ovb related. | 08:24 |
| *** kzaitsev_ws has joined #openstack-ironic | 08:24 | |
| *** lucas-afk is now known as lucasagomes | 08:25 | |
| dtantsur | mrunge: oh, yeah, https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-ipmi/templates/validate-overcloud-ipmi-connection.sh.j2 is old af, and won't work in some cases | 08:25 |
| kzaitsev_ws | hi. I'm getting 'No VIFs found for node when attempting to update DHCP BOOT options' Which logs/configs should I check/fix for errors? | 08:26 |
| dtantsur | mrunge: hard to tell anything about this bug with only the error message.. probably the nodes are not ready for deployment (maintenance, not available or anything). | 08:26 |
| dtantsur | kzaitsev_ws: sambetts may know | 08:26 |
| * dtantsur never remembers why it happens | 08:27 | |
| dtantsur | kzaitsev_ws: well, are you sure you have at least one port for each node? | 08:27 |
| mrunge | dtantsur, thank you | 08:27 |
| kzaitsev_ws | dtantsur: do I need to manually create a neutron port on the network I'm going to use? or ironic-port? (I'm not yet sure how the two should relate) | 08:28 |
| dtantsur | kzaitsev_ws: an ironic port. a neutron port is usually created by nova. | 08:28 |
| kzaitsev_ws | dtantsur: yeah, sure. I have an ironic port, with node's mac, attached to ironic node. (I only have one at the time so it's easy to check =)) | 08:30 |
| sambetts | kzaitsev_ws: an Ironic port == a physical NIC On the server, neutron ports get mapped onto ironic ports (and therefore the physical NICs) so that the server can talk on the neutron network | 08:31 |
| sambetts | kzaitsev_ws: if you nova boot --nic net-id=<neutron network id> then neutron will create a neutron port in the network for you | 08:31 |
| sambetts | kzaitsev_ws: or you can create a port yourself in the network and pass it into nova using nova boot --nic port-id=<nuetron port id> | 08:32 |
| sambetts | kzaitsev_ws: during the deploy process the neutorn port will be mapped onto the ironic port and ironic will update the mac address in neutron to match the physical mac address so that the networking works | 08:33 |
| kzaitsev_ws | sambetts: i'm going for `--nic net-id` and getting 'No VIFs found ... to update DHCP BOOT options'. Where should I look for more error messages/misconfigurations? | 08:34 |
| *** yuanying_ has quit IRC | 08:35 | |
| *** yuanying has joined #openstack-ironic | 08:35 | |
| *** yuanying has quit IRC | 08:35 | |
| vdrok | kzaitsev_ws: hrm, I suppose that attachment failed | 08:36 |
| *** yuanying has joined #openstack-ironic | 08:36 | |
| vdrok | kzaitsev_ws: what's the release you're using? | 08:36 |
| sambetts | or you have no pxe_enabled ports or something ? | 08:36 |
| vdrok | yeah also worth checking the ironic --ironic-api-version latest port-show | 08:37 |
| *** ccamacho has quit IRC | 08:38 | |
| *** ccamacho has joined #openstack-ironic | 08:38 | |
| kzaitsev_ws | ironic is from ocata rdo packages. most of the rest of OS is neuton though | 08:40 |
| kzaitsev_ws | pxe_enabled is True on the port btw | 08:41 |
| vdrok | kzaitsev_ws: hrm, so nova in newton? there might be troubles with that | 08:44 |
| vdrok | oh, wait | 08:44 |
| vdrok | no, it should be fine | 08:44 |
| sambetts | yeah that should be fine | 08:44 |
| *** tuanluong has joined #openstack-ironic | 08:45 | |
| vdrok | kzaitsev_ws: in newton nova, we did set extra/vif_port_id field on ironic port to indicate the attachment of neutron port to ironic port | 08:45 |
| vdrok | https://github.com/openstack/nova/blob/stable/newton/nova/virt/ironic/driver.py#L1096-L1098 | 08:46 |
| vdrok | and booting instance with --nic port-id didn't work yet in newton on nova side I suppose | 08:47 |
| vdrok | kzaitsev_ws: here is a list of things we check to determine if a vif is attached or not https://github.com/openstack/ironic/blob/94c1cabf09ebe8da3feb7b15611b9c9ea8d34960/ironic/drivers/modules/network/common.py#L576-L579 | 08:50 |
| vdrok | kzaitsev_ws: that port is not a part of a portgroup right? | 08:56 |
| vdrok | (portgroup_uuid empty) | 08:56 |
| *** etingof has quit IRC | 09:06 | |
| kzaitsev_ws | vdrok: right, `portgroup_uuid is None`. | 09:14 |
| kzaitsev_ws | thanks for the pointers, looking through the code now | 09:14 |
| *** etingof has joined #openstack-ironic | 09:19 | |
| vdrok | if the port update call setting the extra/vif_port_id passes fine, then we might have some bug in our update_dhcp_opts code? tho it looks fine | 09:20 |
| *** ChubYann has quit IRC | 09:34 | |
| dtantsur | anyone doing something about the neutron problem? it seems that the current fixes are not enough | 09:36 |
| dtantsur | is this related http://logs.openstack.org/58/487458/6/check/gate-grenade-dsvm-ironic-ubuntu-xenial/d8f187e/logs/new/screen-q-svc.txt.gz?level=INFO#_2017-07-28_09_28_19_804 ? | 09:37 |
| dtantsur | vsaienk0, vdrok, sambetts ^^^ | 09:37 |
| *** Ng has left #openstack-ironic | 09:37 | |
| sambetts | dtantsur: that error is ignorable and will be fixed by the networking-baremtal ml2 driver | 09:38 |
| sambetts | dtantsur: it doesn't break anything today | 09:38 |
| sambetts | just messes up the logs | 09:38 |
| dtantsur | okay.. so it's not clear why neutron does not work | 09:38 |
| vsaienk0 | dtantsur: complaints about failed to bind port in vxlan network with vnic_type is ok now, as we don't have driver that can perform binding, to resolve this we need to switch to VLAN network. sambetts already have patches for that | 09:39 |
| vdrok | dtantsur: yup, I've seen router not found pops up randomly, subnet is something nrew | 09:39 |
| * dtantsur expects a lot of complaints about error messages in production | 09:39 | |
| vdrok | dtantsur: it's been like that for several releases :) | 09:39 |
| vdrok | the patches to networking-baremetal seem to work fine so we can merge them and switch some of our jobs to using it | 09:40 |
| sambetts | I think the router not found error might be to do with https://github.com/openstack/ironic/blob/master/devstack/upgrade/resources.sh#L64 and https://github.com/openstack/ironic/blob/master/devstack/upgrade/resources.sh#L123 | 09:40 |
| sambetts | their names don't match up | 09:40 |
| sambetts | vdrok: ^ | 09:40 |
| sambetts | what do you think? | 09:40 |
| vdrok | hrm, need to look into grenade logs | 09:41 |
| vsaienk0 | sambetts: I doubt that networking-baremetal will fix problem with vxlan network as it handles only flat | 09:43 |
| sambetts | vsaienk0: we need to change the network type to flat too | 09:43 |
| vsaienk0 | yeah, we need to land your patches for thatt | 09:43 |
| dtantsur | I'm surprised that it's an API test that fails.. | 09:44 |
| dtantsur | anyone tried talking to neutron folks about it? | 09:44 |
| sambetts | thats why I think it might have something to do with a temp resource being left behind or something | 09:44 |
| dtantsur | right | 09:44 |
| sambetts | or that our resource.sh is deleting neutron's resources by mistake instead of our own | 09:45 |
| vdrok | sambetts: looking at https://github.com/openstack/ironic/blob/master/devstack/upgrade/resources.sh#L116-L124 it should be fine | 09:45 |
| sambetts | vdrok: why are we deleting neutron's resources there? | 09:46 |
| vdrok | sambetts: iiuc the comment, neutron deletes resources created by ironic because we substituted the ids in the file that has all the resources listed. and neutron resources still left hanging around so we delete them | 09:47 |
| vdrok | we do substitution here http://logs.openstack.org/58/487458/6/check/gate-grenade-dsvm-ironic-ubuntu-xenial/d8f187e/logs/grenade.sh.txt.gz#_2017-07-28_08_40_12_902 | 09:48 |
| sambetts | :/ oh ... | 09:49 |
| vsaienk0 | dtantsur: sambetts vdrok can we land this https://review.openstack.org/#/c/448157/ and I will add networking-baremetal to our jobs | 09:50 |
| patchbot | patch 448157 - networking-baremetal - Add devstack plugin to install networking_baremetal | 09:50 |
| vdrok | fuck. this subnet could not be found seems to persist in grenade | 09:51 |
| sambetts | yeah... I can't actually find a request in the neutron logs that ever created a subnet with that UUID | 09:52 |
| openstackgerrit | Madhuri Kumari proposed openstack/ironic master: [doc-migration] Add configuration folder for documentation https://review.openstack.org/486934 | 09:52 |
| openstackgerrit | Aparna proposed openstack/ironic-python-agent master: Rescue extension for CoreOS with DHCP tenant networks https://review.openstack.org/423521 | 09:53 |
| *** gcb has quit IRC | 09:53 | |
| sambetts | :( they don't log the UUIDs they create :/ | 09:55 |
| sambetts | / there aren't any debug logs in the neutron logs | 09:55 |
| vdrok | sambetts: I think we can enable debug in some test patch, it should be showing the request bodies iirc | 09:56 |
| vdrok | tho it seems like some kind of race | 09:56 |
| *** Nisha_ has quit IRC | 09:57 | |
| sambetts | yeah I think it is a race, because its the test thats failing that is creating that subnet | 09:58 |
| sambetts | so something is deleteing the subnet in neutron before the test that created it tries to delete it | 09:59 |
| vdrok | filing a bug to neutron | 10:00 |
| sambetts | I wish all the tempest tests output their request logs not just the ones that fail :/ | 10:02 |
| dtantsur | vdrok: could you please also stop by #openstack-neutron to get their attention? | 10:05 |
| dtantsur | we cannot wait weeks more :( | 10:05 |
| vdrok | dtantsur: yup will do | 10:05 |
| dtantsur | thanks! | 10:05 |
| *** Nisha_Agarwal has joined #openstack-ironic | 10:07 | |
| Nisha_Agarwal | dtantsur, hi | 10:07 |
| dtantsur | hi Nisha_Agarwal | 10:08 |
| Nisha_Agarwal | dtantsur, wrt to py35 do we want to enable all gates for py35 in pike? or that target is in queens? | 10:08 |
| Nisha_Agarwal | ironic gates i mean | 10:08 |
| dtantsur | Nisha_Agarwal: (side note: there are no "gates", the gate is singular. you mean "gate jobs" or "CI jobs") | 10:09 |
| dtantsur | Nisha_Agarwal: I suggest targeting ironic CI for Pike, inspector (and IPA?) for Queens | 10:09 |
| Nisha_Agarwal | dtantsur, if we want to enable that in pike i can post a patch in infra to convert the existing gates to use python3 | 10:09 |
| Nisha_Agarwal | yes | 10:09 |
| dtantsur | Nisha_Agarwal: we cannot convert anything, until we have a non-voting job running successfully at least for some time | 10:10 |
| dtantsur | currently, it's still experimental | 10:10 |
| Nisha_Agarwal | dtantsur, all the ironic gate jobs? | 10:10 |
| Nisha_Agarwal | dtantsur, yes | 10:10 |
| dtantsur | let's start with the job you have now | 10:11 |
| sambetts | dtantsur, vdrok: I think failure is still related to the AMQP errors we were seeing before | 10:11 |
| Nisha_Agarwal | dtantsur, thats why i asked should i go ahead and post the patch to convert all the CI gates to become py3 enabled? | 10:11 |
| dtantsur | Nisha_Agarwal: I don't think we should convert most jobs to Python 3 in the near future, as actual production deployments still use python 2 | 10:11 |
| dtantsur | Nisha_Agarwal: we need only one job voting per service, that's our goal | 10:11 |
| *** Nisha_Agarwal has quit IRC | 10:12 | |
| dtantsur | Nisha_Agarwal: so, the plan is 1. fix the experimental job, 2. promote it to check non-voting, 3. if it is stable, remove it and convert one existing job (e.g. redfish-based) | 10:12 |
| sambetts | dtantsur, vdrok: looking at the neutron logs the not found resource seems to be the exchange not the subnet, and later on in the logs when AMQP manages to reconnect the delete for the subnet happens successfully | 10:12 |
| vdrok | sambetts: might be. I see the deletion happening before the api request comes in, but have no idea who triggers it | 10:12 |
| dtantsur | Oo | 10:12 |
| sambetts | delete here happens sucessfully: http://logs.openstack.org/58/487458/6/check/gate-grenade-dsvm-ironic-ubuntu-xenial/d8f187e/logs/new/screen-q-svc.txt.gz?level=INFO#_2017-07-28_09_17_28_457 | 10:13 |
| vdrok | what I was looking at -- deletion happens http://logs.openstack.org/58/487458/6/check/gate-grenade-dsvm-ironic-ubuntu-xenial/d8f187e/logs/new/screen-q-svc.txt.gz#_2017-07-28_09_15_51_588 before api request -- http://logs.openstack.org/58/487458/6/check/gate-grenade-dsvm-ironic-ubuntu-xenial/d8f187e/logs/new/screen-q-svc.txt.gz#_2017-07-28_09_16_51_507 | 10:13 |
| *** Nisha_Agarwal has joined #openstack-ironic | 10:14 | |
| Nisha_Agarwal | dtantsur, sorry got disconnected | 10:14 |
| dtantsur | Nisha_Agarwal: so, the plan is 1. fix the experimental job, 2. promote it to check non-voting, 3. if it is stable, remove it and convert one existing job (e.g. redfish-based) | 10:14 |
| Nisha_Agarwal | dtantsur, ok then i will propose nonvoting job | 10:14 |
| dtantsur | my message while you were out ^^^ | 10:14 |
| Nisha_Agarwal | dtantsur, thanks | 10:14 |
| Nisha_Agarwal | ok so the experimental gate is passing now | 10:14 |
| Nisha_Agarwal | with jlvillal's fix | 10:15 |
| Nisha_Agarwal | so i will promote it to non voting | 10:15 |
| Nisha_Agarwal | dtantsur, ^^^ | 10:15 |
| sambetts | vdrok: I think this is the AMQP thing still causing issues, even though we're ignoring the exception | 10:16 |
| vdrok | oh | 10:17 |
| vdrok | I might see this | 10:17 |
| sambetts | because the AMQP thing is "Not Found", but its the exchange that is not found, not the subnet | 10:18 |
| vdrok | http://logs.openstack.org/58/487458/6/check/gate-grenade-dsvm-ironic-ubuntu-xenial/d8f187e/logs/new/screen-q-svc.txt.gz#_2017-07-28_09_15_53_901, then http://logs.openstack.org/58/487458/6/check/gate-grenade-dsvm-ironic-ubuntu-xenial/d8f187e/logs/new/screen-q-svc.txt.gz#_2017-07-28_09_16_51_507, then | 10:19 |
| vdrok | http://logs.openstack.org/58/487458/6/check/gate-grenade-dsvm-ironic-ubuntu-xenial/d8f187e/logs/new/screen-q-svc.txt.gz#_2017-07-28_09_16_51_507, then http://logs.openstack.org/58/487458/6/check/gate-grenade-dsvm-ironic-ubuntu-xenial/d8f187e/logs/new/screen-q-svc.txt.gz#_2017-07-28_09_17_28_452 then | 10:19 |
| vdrok | http://logs.openstack.org/58/487458/6/check/gate-grenade-dsvm-ironic-ubuntu-xenial/d8f187e/logs/new/screen-q-svc.txt.gz#_2017-07-28_09_17_28_452 | 10:19 |
| vdrok | yeah this seems to be the issue with amqp | 10:19 |
| dtantsur | daaaaaamn | 10:21 |
| dtantsur | then we certainly need to involve neutron folks | 10:21 |
| sambetts | seems like ignoring the exception in neutron didn't fix the issue :( | 10:21 |
| dtantsur | sambetts, vdrok: let's move the discussion to their channel? | 10:22 |
| sambetts | can do although I don't know if anyone will be around :/ | 10:22 |
| dtantsur | sambetts: I've pinged the redhatter I know, he's in Brno | 10:23 |
| *** ccamacho is now known as ccamacho|brb | 10:23 | |
| sambetts | awesome :D | 10:23 |
| *** tiendc has quit IRC | 10:29 | |
| *** tuanluong has quit IRC | 10:31 | |
| *** jkilpatr has quit IRC | 10:34 | |
| *** stendulker has quit IRC | 10:39 | |
| *** e0ne has joined #openstack-ironic | 10:39 | |
| *** hw_wutianwei has quit IRC | 10:47 | |
| *** karthiks has quit IRC | 10:49 | |
| openstackgerrit | Vladyslav Drok proposed openstack/ironic master: [DNM] Test https://review.openstack.org/488371 | 10:49 |
| *** jkilpatr has joined #openstack-ironic | 10:53 | |
| *** sdague has joined #openstack-ironic | 10:55 | |
| *** fxpester has quit IRC | 10:58 | |
| *** ccamacho|brb is now known as ccamacho | 10:59 | |
| *** fxpester has joined #openstack-ironic | 11:00 | |
| *** aolwas has quit IRC | 11:02 | |
| *** aolwas has joined #openstack-ironic | 11:03 | |
| *** xavierr has joined #openstack-ironic | 11:04 | |
| *** yufei has quit IRC | 11:04 | |
| *** masber has joined #openstack-ironic | 11:04 | |
| xavierr | #pixiesay -m rnr hey everyone | 11:12 |
| PixieBoots | \m/Ê•>á´¥<Ê”\m/: hey everyone | 11:12 |
| *** Nisha_Agarwal has quit IRC | 11:13 | |
| *** udesale has quit IRC | 11:14 | |
| *** jaianshu has quit IRC | 11:15 | |
| vdrok | good morning xavierr | 11:16 |
| *** rama_y has quit IRC | 11:18 | |
| *** jjung has quit IRC | 11:21 | |
| nicodemos | morning vdrok, xavierr, ironic. :) | 11:25 |
| vdrok | morning nicodemos :) | 11:30 |
| *** jjung has joined #openstack-ironic | 11:37 | |
| openstackgerrit | Vasyl Saienko proposed openstack/ironic-specs master: Actualize dynamic portgroup spec https://review.openstack.org/488382 | 11:38 |
| *** zhangfei has quit IRC | 11:40 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 11:40 | |
| *** zhangfei has joined #openstack-ironic | 11:41 | |
| *** zhangfei has quit IRC | 11:45 | |
| *** AlexeyAbashkin has quit IRC | 11:47 | |
| *** lucasagomes is now known as lucas-hungry | 11:54 | |
| *** rcernin has quit IRC | 11:55 | |
| *** marios has quit IRC | 11:58 | |
| *** litao__ has quit IRC | 11:59 | |
| *** marios has joined #openstack-ironic | 11:59 | |
| *** Dinesh_Bhor is now known as Dinesh_Bhor|afk | 12:01 | |
| *** Dinesh_Bhor|afk is now known as Dinesh_Bhor | 12:02 | |
| *** trown|outtypewww is now known as trown | 12:10 | |
| *** rcernin has joined #openstack-ironic | 12:16 | |
| *** strigazi is now known as strigazi_AFK | 12:20 | |
| *** jcoufal has joined #openstack-ironic | 12:20 | |
| *** jaypipes has joined #openstack-ironic | 12:23 | |
| *** jaypipes is now known as leakypipes | 12:23 | |
| openstackgerrit | Fellype Cavalcante proposed openstack/ironic master: Add a flag to always peform persistent boot on PXE interface https://review.openstack.org/483430 | 12:32 |
| *** goldyfruit has joined #openstack-ironic | 12:35 | |
| *** cdearborn has joined #openstack-ironic | 12:39 | |
| *** vmud213 has quit IRC | 12:44 | |
| *** jaganathan has quit IRC | 12:51 | |
| TheJulia | good morning everyone | 12:51 |
| dtantsur | morning TheJulia | 12:54 |
| TheJulia | sdague: by chance did you look at the log from last night and see my comments? | 12:54 |
| sdague | no, I have not | 12:55 |
| TheJulia | sdague: tl;dr ironic had not started yet, nova-compute was hung trying to connect to ironic | 12:57 |
| TheJulia | the check in the script locked the entire process not accounting for later services that had to be installed for nova-compute to operate | 12:57 |
| vdrok | morning TheJulia | 13:00 |
| vdrok | dtantsur: so, bumping http_timeout seems to work https://review.openstack.org/488371 | 13:00 |
| patchbot | patch 488371 - ironic - [DNM] Test | 13:00 |
| vdrok | I'll recheck once again | 13:01 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sushy master: Updated from global requirements https://review.openstack.org/488144 | 13:01 |
| dtantsur | yeah, let's try a few times | 13:01 |
| *** sasha2 has joined #openstack-ironic | 13:02 | |
| vdrok | dtantsur: if it does, should we add that to tempest conf in our devstack plugin? | 13:03 |
| *** lucas-hungry is now known as lucasagomes | 13:03 | |
| dtantsur | vdrok: I guess so? I just struggle to understand why only ironic CI hits it | 13:03 |
| *** SerenaFe_ has joined #openstack-ironic | 13:03 | |
| *** jaosorior has quit IRC | 13:04 | |
| vdrok | yeah. also this is the job not using n-g-s, so it should not differ much from other projects grenade setups | 13:04 |
| sdague | TheJulia: ok, so, when nova-compute starts with ironic backend it doesn't check in until the ironic API is up? | 13:05 |
| TheJulia | sdague: apparently so, i checked the n-cpu logs and it was just spinning in the background trying to connect to ironic | 13:05 |
| TheJulia | which makes sense, it is not truly operating yet. | 13:06 |
| sdague | yeh, it does however seem like that could make for some weird situations | 13:07 |
| sdague | that's at least good info | 13:07 |
| xavierr | morning TheJulia dtantsur sdague | 13:07 |
| *** fellypefca has joined #openstack-ironic | 13:09 | |
| TheJulia | sdague: yeah, afaik we have no way of getting ironic installed before nova, so we're kind of stuck for the time being | 13:10 |
| fellypefca | Good morning, Ironic :) | 13:10 |
| *** links has quit IRC | 13:16 | |
| *** rbartal has joined #openstack-ironic | 13:18 | |
| *** jcoufal_ has joined #openstack-ironic | 13:20 | |
| openstackgerrit | Vasyl Saienko proposed openstack/ironic master: DNR try to increase http timetout for clients https://review.openstack.org/488415 | 13:22 |
| openstackgerrit | Hironori Shiina proposed openstack/ironic master: Add supported_power_states field to node APIs https://review.openstack.org/382194 | 13:22 |
| *** Goneri has joined #openstack-ironic | 13:22 | |
| *** jcoufal has quit IRC | 13:23 | |
| *** e0ne has quit IRC | 13:23 | |
| *** hjensas has joined #openstack-ironic | 13:25 | |
| *** rama_y has joined #openstack-ironic | 13:27 | |
| *** baoli has joined #openstack-ironic | 13:34 | |
| *** jaganathan has joined #openstack-ironic | 13:34 | |
| *** baoli has quit IRC | 13:34 | |
| *** baoli has joined #openstack-ironic | 13:35 | |
| *** jaganathan has quit IRC | 13:35 | |
| vdrok | morning fellypefca | 13:36 |
| openstackgerrit | Hironori Shiina proposed openstack/ironic master: Add supported_power_states field to api-ref https://review.openstack.org/427000 | 13:37 |
| fellypefca | vdrok o/ | 13:37 |
| *** rcernin has quit IRC | 13:38 | |
| *** e0ne has joined #openstack-ironic | 13:39 | |
| *** jistr is now known as jistr|mtg | 13:45 | |
| *** dansmith is now known as superdan | 13:45 | |
| *** jjung has quit IRC | 13:47 | |
| *** mgoddard has quit IRC | 13:48 | |
| *** weshay is now known as weshay_interview | 13:54 | |
| *** strigazi_AFK is now known as strigazi_OFF | 13:58 | |
| *** fellypefca has quit IRC | 13:59 | |
| *** rcernin has joined #openstack-ironic | 14:00 | |
| *** kzaitsev_ws has quit IRC | 14:02 | |
| *** hshiina has quit IRC | 14:04 | |
| *** xavierr has quit IRC | 14:04 | |
| *** mjura has quit IRC | 14:06 | |
| *** crushil has joined #openstack-ironic | 14:10 | |
| *** vishwana_ has quit IRC | 14:13 | |
| *** vishwanathj has joined #openstack-ironic | 14:13 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 14:18 | |
| *** mjturek has joined #openstack-ironic | 14:20 | |
| *** mtanino has joined #openstack-ironic | 14:22 | |
| *** SerenaFe_ has quit IRC | 14:27 | |
| dtantsur | pas-ha: the devstack-gate patch has merged? ready to remove the ssh drivers now? :) | 14:32 |
| *** kjw3 has quit IRC | 14:32 | |
| pas-ha | dtantsur: yep :) | 14:32 |
| dtantsur | \o/ | 14:32 |
| pas-ha | except for our current multiple grenade jobs issues :( | 14:32 |
| *** baoli has quit IRC | 14:33 | |
| *** jcoufal has joined #openstack-ironic | 14:33 | |
| *** jcoufal_ has quit IRC | 14:34 | |
| *** efried is now known as fried_rice | 14:36 | |
| dtantsur | yeah.. | 14:36 |
| *** edleafe is now known as figleaf | 14:37 | |
| *** crushil has quit IRC | 14:42 | |
| *** crushil has joined #openstack-ironic | 14:43 | |
| *** jistr|mtg is now known as jistr | 14:46 | |
| *** Dinesh_Bhor has quit IRC | 14:46 | |
| *** masber has quit IRC | 14:46 | |
| *** harlowja has joined #openstack-ironic | 14:51 | |
| *** sdague has quit IRC | 14:53 | |
| *** aarefiev is now known as aarefiev_afk | 14:55 | |
| *** ijw has joined #openstack-ironic | 14:57 | |
| openstackgerrit | Vladyslav Drok proposed openstack/ironic master: try to increase http timetout for clients https://review.openstack.org/488446 | 14:59 |
| pas-ha | dtantsur: btw, if/when you have spare time please take a look at moving staging-drivers to hw types (and deprecating the classic drivers in staging) https://review.openstack.org/#/q/topic:hwtypes+is:open+project:openstack/ironic-staging-drivers | 15:00 |
| openstackgerrit | Eric Fried proposed openstack/ironic master: DNM: Test nova.utils.get_endpoint_data https://review.openstack.org/488177 | 15:01 |
| *** etingof has quit IRC | 15:01 | |
| *** rbartal has quit IRC | 15:03 | |
| openstackgerrit | Vladyslav Drok proposed openstack/ironic master: try to increase http timetout for clients https://review.openstack.org/488446 | 15:03 |
| vdrok | dtantsur: ok, second pass there with http_timeout 120. now need to think how to do this without having to backport anything to ocata | 15:05 |
| sambetts | still the AMQP errors are concerning post upgrade | 15:06 |
| sambetts | I'd like to know why they are happening | 15:06 |
| vdrok | sambetts: sure I get that. I just want to get our gate working | 15:07 |
| sambetts | ++ | 15:07 |
| *** crushil has quit IRC | 15:07 | |
| rama_y | Hi sambetts, ran into this error "Refusing to bind due to unsupported vnic_type: baremetal" yesterday: http://paste.openstack.org/show/616872/ | 15:09 |
| sambetts | rama_y: that is an expected and ignorable error, when networking-baremetal's mech driver is ready that will remove that error | 15:10 |
| *** e0ne has quit IRC | 15:10 | |
| *** baoli has joined #openstack-ironic | 15:11 | |
| rama_y | sambetts, but I am unable to boot the physical node | 15:11 |
| sambetts | rama_y: it doesn't actually affect the operation of the baremetal nodes in a flat network because they are already statically bound by the operator | 15:11 |
| *** rpioso has joined #openstack-ironic | 15:11 | |
| sambetts | or should be | 15:11 |
| sambetts | rama_y: are your baremetal nodes configured to talk on the flat network you've created in neutron | 15:12 |
| sambetts | ? | 15:12 |
| rama_y | Yes | 15:12 |
| openstackgerrit | Vladyslav Drok proposed openstack/ironic master: try to increase http timetout for clients https://review.openstack.org/488446 | 15:12 |
| openstackgerrit | Vladyslav Drok proposed openstack/ironic master: try to increase http timetout for clients https://review.openstack.org/488446 | 15:13 |
| sambetts | rama_y: what error are you seeing? is the baremetal node unable to PXE boot? | 15:13 |
| *** rcernin has quit IRC | 15:13 | |
| rama_y | neutron dhcp is serving ip-address to the node; but it gets ARP timeout | 15:13 |
| rama_y | in neutron logs, I see the error http://paste.openstack.org/show/616872/ | 15:13 |
| sambetts | rama_y: if neutron is serving the DHCP that means neutron is working correctly, which IP address is it unable to ARP? the tftp server? | 15:14 |
| rama_y | Yes | 15:14 |
| sambetts | rama_y: what is the network path you've setup for the baremetal node to talk to the tftp server? | 15:15 |
| *** weshay_interview is now known as weshay | 15:15 | |
| *** etingof has joined #openstack-ironic | 15:15 | |
| *** MattMan has quit IRC | 15:15 | |
| *** MattMan has joined #openstack-ironic | 15:15 | |
| rama_y | I did not specify path to tftp server | 15:16 |
| rama_y | Not sure how/where to specify it | 15:16 |
| *** crushil has joined #openstack-ironic | 15:16 | |
| sambetts | is the IP address of your tftp server in the flat network subnet or is it somewhere else (the openstack control plane) ? | 15:17 |
| sambetts | if its outside of the flat network's subnet then you'll need to provide a route to that IP address using a neutorn router | 15:17 |
| sambetts | or a physical router | 15:18 |
| rama_y | I need to check that; not connected right now | 15:18 |
| *** mrtenio has quit IRC | 15:18 | |
| rama_y | Ok, so I need to provide a route to the tftp server | 15:19 |
| *** penick has joined #openstack-ironic | 15:19 | |
| *** Goneri has quit IRC | 15:20 | |
| *** samodid has quit IRC | 15:20 | |
| rama_y | I was thinking because of the port binding issue; tried the networking-baremetal plugin with https://review.openstack.org/#/c/456235/ | 15:20 |
| patchbot | patch 456235 - networking-baremetal - [WIP] Add baremetal neutron agent | 15:20 |
| sambetts | that baremetal agent is no where near ready and is only for neutron L3 network support | 15:21 |
| sambetts | that baremetal agent is no where near ready and is only for neutron L3 (multi-segment) network support | 15:21 |
| sambetts | the ml2 driver in that repo should remove the error from the neutron logs if you load it in ml2 | 15:22 |
| rama_y | with networking-baremetal and [ml2] ovs,baremetal ? | 15:22 |
| sambetts | yeah that should remove the error | 15:23 |
| rama_y | ok got it | 15:23 |
| rama_y | sambetts, any pointers on adding the route to the tftpserver? haven't done it before | 15:24 |
| *** links has joined #openstack-ironic | 15:24 | |
| rama_y | In the logs or somewhere? | 15:24 |
| dtantsur | vdrok: nice! but I really wonder if it's a sign of a real bug.. | 15:24 |
| sambetts | rama_y: in the logs, the error itself is just because we havn't got anything in place at the moment to catch the case when your using baremetal + a flat network which means neutron does actually have to do anything to bind the port | 15:25 |
| sambetts | rama_y: the baremetal ml2 driver recognises that scenario and marks it bounds for us | 15:26 |
| sambetts | rama_y: the flat network will need routes to the ironic-api and the tftp server, and the ironic-conductor will need a route to talk to the baremetal node to write the image, so there are a couple of options, provide a static no-NAT route from your OpenStack control plane into the flat network or directly connect your control plane servers into the flat network with static IPs (and remove those | 15:27 |
| sambetts | IPs from the neutron allocation range) | 15:27 |
| openstackgerrit | Vladyslav Drok proposed openstack/ironic master: Add nodes tagging support - RPC objects https://review.openstack.org/233357 | 15:28 |
| rama_y | sambetts, ok, thanks for the suggestion. Will try that. | 15:29 |
| *** dyasny has quit IRC | 15:37 | |
| *** amarao1 has quit IRC | 15:37 | |
| *** dyasny has joined #openstack-ironic | 15:37 | |
| NobodyCam | Good Morning Ironic'ers... and (ofc) ..... | 15:38 |
| NobodyCam | TGIF | 15:38 |
| *** rama_y has quit IRC | 15:38 | |
| sambetts | o/ NobodyCam | 15:39 |
| *** penick has quit IRC | 15:40 | |
| NobodyCam | hey hey sambetts :) | 15:40 |
| vdrok | good morning NobodyCam | 15:40 |
| NobodyCam | hey hey Good Morning vdrok :) | 15:41 |
| *** Goneri has joined #openstack-ironic | 15:42 | |
| *** etingof has quit IRC | 15:42 | |
| *** amarao has quit IRC | 15:47 | |
| *** dyasny has quit IRC | 15:47 | |
| *** dyasny has joined #openstack-ironic | 15:48 | |
| *** dyasny_ has joined #openstack-ironic | 15:50 | |
| *** mtanin___ has joined #openstack-ironic | 15:50 | |
| *** jjung has joined #openstack-ironic | 15:50 | |
| *** harlowja has quit IRC | 15:51 | |
| *** mtanino has quit IRC | 15:51 | |
| *** dyasny_ has quit IRC | 15:51 | |
| *** dyasny_ has joined #openstack-ironic | 15:51 | |
| openstackgerrit | Vladyslav Drok proposed openstack/ironic master: Add nodes tagging support - RPC objects https://review.openstack.org/233357 | 15:52 |
| *** dyasny has quit IRC | 15:53 | |
| openstackgerrit | Vladyslav Drok proposed openstack/ironic master: Add DB layer support for node tags filters https://review.openstack.org/272624 | 15:53 |
| *** dyasny_ has quit IRC | 15:54 | |
| *** dyasny_ has joined #openstack-ironic | 15:54 | |
| *** etingof has joined #openstack-ironic | 15:55 | |
| *** trown is now known as trown|lunch | 15:59 | |
| *** etingof has quit IRC | 16:00 | |
| *** ralonsoh has quit IRC | 16:01 | |
| *** dyasny_ is now known as dyasny | 16:01 | |
| *** marios has quit IRC | 16:03 | |
| *** lucasagomes is now known as lucas-afk | 16:06 | |
| *** sdague has joined #openstack-ironic | 16:12 | |
| *** rpioso has quit IRC | 16:15 | |
| *** rpioso has joined #openstack-ironic | 16:16 | |
| jlvillal | vdrok: sambetts: I was reading some (not all) of the back-scroll. Did you figure out the neutron issue? | 16:16 |
| *** rama_y has joined #openstack-ironic | 16:17 | |
| vdrok | jlvillal: I'm leaving now. here is a workaround https://review.openstack.org/488446. if it passes the gate, it needs to be squashed into https://review.openstack.org/487458 | 16:18 |
| patchbot | patch 488446 - ironic - try to increase http timetout for clients | 16:18 |
| patchbot | patch 487458 - ironic - Don't use multicell setup for any ironic jobs | 16:18 |
| vdrok | morning :) | 16:18 |
| jlvillal | vdrok: Thanks, I will watch it | 16:18 |
| sambetts | jlvillal: seems like the amqp issue has come back to haunt us :( | 16:18 |
| jlvillal | sambetts: :( | 16:18 |
| vdrok | jlvillal: but yeah, actual fix is to be done somewhere in neutron, no idea where | 16:19 |
| vdrok | good night everyone! | 16:19 |
| sambetts | o/ vdrok | 16:19 |
| jlvillal | vdrok: Are any neutron folks looking at it? | 16:19 |
| jlvillal | vdrok: paka paka! | 16:19 |
| vdrok | jlvillal: you can read the irc log from the morning in neutron channel :) (channel is almost empty, so you can easily find it) hopefully yes | 16:20 |
| jlvillal | vdrok: Thanks! | 16:20 |
| sambetts | I did some digging myself into the neutron code, and I think the problem is that even though the exception is being caught and ignored some sort of callback system is resulting the amqp 404 still being processed somewhere | 16:20 |
| rpioso | TheJulia, dtantsur: I have a few questions revolving around https://review.openstack.org/#/c/481318 | 16:20 |
| patchbot | patch 481318 - ironic - Revert "Wait until iDRAC is ready before out-of-ba... | 16:20 |
| TheJulia | rpioso: on the review? | 16:21 |
| * TheJulia tries to context load | 16:21 | |
| jlvillal | TheJulia: FYI: It might be up to you and I to approve the gate fix later on today. | 16:22 |
| TheJulia | jlvillal: squash the two patches? | 16:23 |
| TheJulia | and force it through? | 16:23 |
| openstackgerrit | Vladyslav Drok proposed openstack/ironic master: Add nodes tagging support - API https://review.openstack.org/250478 | 16:23 |
| jlvillal | TheJulia: Yeah. That will be the plan if it fixes the issue. | 16:23 |
| TheJulia | 10-4 | 16:23 |
| rpioso | TheJulia: Not exactly. More about how I should proceed. And there's a new consideration that dawned on me. | 16:23 |
| jlvillal | TheJulia: Waiting for test run to see what happens. | 16:23 |
| *** ijw has quit IRC | 16:23 | |
| *** e0ne has joined #openstack-ironic | 16:23 | |
| rpioso | TheJulia: That -2ed change updates ironic's dependency on python-dracclient. | 16:24 |
| TheJulia | jlvillal: before I go looking, do we have it all documented that is the plan or should I just paste the link to the irc log if I just have to force it through? | 16:24 |
| *** ijw has joined #openstack-ironic | 16:24 | |
| TheJulia | rpioso: yeah, and I don't see a new python-dracclient release :\ | 16:24 |
| jlvillal | TheJulia: 2nd option seems reasonable. | 16:24 |
| rpioso | TheJulia: Correct. | 16:25 |
| TheJulia | jlvillal: works for me. I'll be in a car for like 5-6 hours tonight, so plenty of time to push things through | 16:25 |
| rpioso | TheJulia: I want to update you on my thoughts about the dependent ironic patch. I'm thinking of splitting it into two (2) changes. | 16:25 |
| jlvillal | TheJulia: Thanks! | 16:25 |
| TheJulia | jlvillal: are you leaving for the day soon? | 16:26 |
| rpioso | TheJulia: The first would only update driver-requirements.txt. | 16:26 |
| rpioso | TheJulia: That way, it could be backported to prior releases of ironic. | 16:27 |
| rpioso | TheJulia: Recall that the dependency is a significant bug fix to python-dracclient. | 16:27 |
| jlvillal | TheJulia: I'm here all day | 16:27 |
| TheJulia | This feels like a conversation dtantsur should be involved with because of bumping our driver-reqs | 16:28 |
| * dtantsur shows up | 16:28 | |
| *** e0ne has quit IRC | 16:28 | |
| TheJulia | cloaking devices | 16:28 |
| dtantsur | so, what exactly is the question? how to proceed with this patch? | 16:29 |
| TheJulia | yes | 16:29 |
| dtantsur | we need a dracclient release, then we can land the patch with bumping the requirements | 16:29 |
| dtantsur | such change is almost certainly not backportable | 16:29 |
| *** etingof has joined #openstack-ironic | 16:30 | |
| *** e0ne has joined #openstack-ironic | 16:30 | |
| dtantsur | we essentially never bump any requirements on stable branches, unless they were wrong from the beginning | 16:30 |
| dtantsur | rpioso: ^^ | 16:30 |
| rpioso | dtantsur: I was interrupted by my boss :) | 16:32 |
| rpioso | dtantsur: But, but, but, ... How could we get the prior release(s) to benefit from the fix to the significant python-draccleint bug fix? | 16:33 |
| dtantsur | rpioso: we assume that the operators update their packages to the bug fix releases | 16:33 |
| dtantsur | requirements are usually not bumped for it, only for features | 16:33 |
| dtantsur | it's a different story if e.g. we figure our that ironic Ocata cannot work with dracclient 0.1.0 (the current mininum) at all | 16:35 |
| rpioso | dtantsur: To ensure I'm clear on that, ... Then if an operator chooses to use an older release, they must manually update the python-dracclient package that contains a significant bug fix? | 16:35 |
| rpioso | dtantsur: It works, well, until it doesn't :) | 16:35 |
| dtantsur | rpioso: yep, in the same fashion as with any python dependency | 16:35 |
| sambetts | this is why requirements are normally set as a range | 16:36 |
| rpioso | dtantsur: Again, it's a significant bug fix. Actually, fundamental. | 16:36 |
| dtantsur | I know what you're trying to say :) but keep in mind that bumping requirements is a very serious thing. this way you're saying "there is no way ironic will work with versions before this" | 16:36 |
| dtantsur | rpioso: which exactly patch are we talking about? | 16:36 |
| rpioso | dtantsur: The series you just completed reviewing. | 16:36 |
| sambetts | e.g. >=4.0.0 && <5.0.0 , ranges work because nothing *should* break between major version s | 16:37 |
| dtantsur | rpioso: bumping the requirement from 0.1.0 to 1.3.0 pulls in a lot of feature-level changes.. | 16:37 |
| * TheJulia reads the backscroll because she got a phone call | 16:37 | |
| rpioso | dtantsur: Fixes bug https://launchpad.net/bugs/1697558 | 16:37 |
| openstack | Launchpad bug 1697558 in python-dracclient "WS-Man operations fail when iDRAC is not ready" [Undecided,Fix released] - Assigned to Richard G. Pioso (richard.pioso) | 16:37 |
| dtantsur | rpioso: I see. you can try asking the release team (#openstack-release) about such cases. they'll have to agree with it, when they review the next ironic stable release request. | 16:38 |
| dtantsur | such bump is usually out of question, because it requires all downstreams to urgently upgrade to a version with a lot of unrelated changes | 16:39 |
| dtantsur | so I guess the question is how broken ironic is without this patch | 16:39 |
| rpioso | dtantsur: You make it good point that the new python-dracclient release will contain new features. However, I believe Ocata ironic doesn't utilize them. | 16:39 |
| dtantsur | rpioso: right. but in nonetheless can have side effects on existing features (at least in theory, I haven't reviewed the diff) | 16:40 |
| sambetts | yeah, I think the "correct" way to do this would have been to back port this fix into a 0.1.1 release right? | 16:40 |
| sambetts | but I know that is a PITA thing to handle | 16:41 |
| rpioso | dtantsur: The risk is greatest during provisioning and deployment. Once deployed and stable, the node should stay that way, since the BMC is no longer performing config changes. | 16:41 |
| TheJulia | sambetts: That would be the most correct way to handle it | 16:41 |
| *** openstackstatus has quit IRC | 16:41 | |
| *** openstack has joined #openstack-ironic | 16:44 | |
| dtantsur | another option is to simply issue a release note saying "versions before 1.3.0 suffer from <BUG ID>, causing occasional failures, it is recommended to upgrade to 1.3.0" | 16:44 |
| sambetts | plus its just a PITA for because any other minor releases between 0.1.0 and 1.3.0 would also need it backported | 16:44 |
| sambetts | otherwise inconsistency | 16:45 |
| dtantsur | this won't require code change or any sign-off by the release team, and this can be backported | 16:45 |
| rpioso | dtantsur: I'm not familiar with what would need to be done to get a new 0.1.0 version uploaded to pypi. | 16:45 |
| *** Nisha_Agarwal has joined #openstack-ironic | 16:45 | |
| sambetts | rpioso: branch and then backport and then new tag on that commit | 16:45 |
| dtantsur | rpioso: a release is a matter of pushing a git tag; I still wonder if doing a release note only is the best way to handle it.. | 16:45 |
| dtantsur | sambetts: the diff between 0.1 and 1.3 is HUUUUGE, the backport may not be fun.. | 16:46 |
| TheJulia | I kind of like the reno approach, let operators make the decision, that is if they actually read the notes | 16:46 |
| rpioso | dtantsur, sambetts: Let me discuss it with my downstream teammates. | 16:47 |
| sambetts | dtantsur: thats the other PITA for backporting so long after the other release :( | 16:47 |
| rpioso | dtantsur: The change is fairly granular, tho. Famous last words :) | 16:47 |
| dtantsur | hehe | 16:48 |
| dtantsur | I'd start with a email to openstack-dev with [ironic] [release] tags, outlining the situation and the 3 options: 1. bump the requirement to 1.3 everywhere, 2. make a bug-fix only 0.1.1 release, 3. create a release note to all supported branches. | 16:49 |
| dtantsur | rpioso: ^^^ there may be more good ideas from other people | 16:49 |
| rpioso | dtantsur, TheJulia, sambetts: Sounds like the backport/release note decision doesn't have a bearing on the current ironic patch targeted at Pike. | 16:50 |
| dtantsur | rpioso: the pike patch is fine, I guess (I haven't seen it though) | 16:50 |
| rpioso | TheJulia: ^^^ | 16:50 |
| *** jjung has quit IRC | 16:50 | |
| rpioso | TheJulia: Do you agree? (You looked at it a while back.) | 16:50 |
| TheJulia | rpioso: I remember thinking it was okay, just missing the 1.3.0 release | 16:51 |
| rpioso | TheJulia: Cool! | 16:51 |
| TheJulia | because I seem to remember it changing driver-reqs to a version that didn't exist yet | 16:51 |
| rpioso | TheJulia: That's correct. | 16:52 |
| * rpioso wished his memory was so sharp Friday afternoons | 16:52 | |
| *** jcoufal has quit IRC | 16:53 | |
| rpioso | dtantsur: ty for the ML suggestion. | 16:53 |
| dtantsur | np | 16:53 |
| *** jcoufal has joined #openstack-ironic | 16:53 | |
| TheJulia | rpioso: I just had a latte about an hour ago, so my brain is running at a decent speed | 16:54 |
| TheJulia | Maybe 4th gear | 16:54 |
| rpioso | dtantsur, sambetts, TheJulia: Thank you so much! I'll discuss it with my downstream friends. | 16:54 |
| rpioso | TheJulia: lol | 16:54 |
| dtantsur | :D | 16:54 |
| *** harlowja has joined #openstack-ironic | 16:54 | |
| *** crushil has quit IRC | 16:54 | |
| *** derekh has quit IRC | 16:55 | |
| *** harlowja_ has joined #openstack-ironic | 16:55 | |
| dtantsur | okay, I guess it's time for me to call it a day | 16:57 |
| dtantsur | see you on Monday | 16:57 |
| *** dtantsur is now known as dtantsur|afk | 16:57 | |
| rpioso | dtantsur|afk: Enjoy! o/ | 16:58 |
| *** harlowja has quit IRC | 16:59 | |
| *** crushil has joined #openstack-ironic | 17:01 | |
| * sambetts also calling it a day here | 17:03 | |
| sambetts | o/ cya'll Monday | 17:03 |
| *** sambetts is now known as sambetts|afk | 17:03 | |
| openstackgerrit | John L. Villalovos proposed openstack/ironic master: Don't use multicell setup for ironic & increase timeout https://review.openstack.org/487458 | 17:05 |
| jlvillal | TheJulia: ^^ Squashed patch | 17:05 |
| TheJulia | jlvillal: awesome, thanks! | 17:05 |
| jlvillal | TheJulia: https://review.openstack.org/488446 passed gate | 17:05 |
| patchbot | patch 488446 - ironic - try to increase http timetout for clients | 17:05 |
| openstackgerrit | Merged openstack/ironic-ui master: Adds support for editing portgroups https://review.openstack.org/487867 | 17:11 |
| *** ijw has quit IRC | 17:12 | |
| TheJulia | jlvillal: awesome | 17:12 |
| *** trown|lunch is now known as trown | 17:12 | |
| -openstackstatus- NOTICE: The Gerrit service on review.openstack.org is being taken offline for roughly 5 minutes to perform a database backup and reconfiguration | 17:12 | |
| *** Nisha_Agarwal has quit IRC | 17:13 | |
| *** junbo has quit IRC | 17:15 | |
| *** mrtenio has joined #openstack-ironic | 17:30 | |
| *** openstackgerrit has quit IRC | 17:33 | |
| *** Goneri has quit IRC | 17:46 | |
| *** jcoufal_ has joined #openstack-ironic | 17:51 | |
| *** jcoufal has quit IRC | 17:53 | |
| *** ChubYann has joined #openstack-ironic | 17:53 | |
| *** e0ne has quit IRC | 18:01 | |
| *** crushil has quit IRC | 18:01 | |
| *** openstackgerrit has joined #openstack-ironic | 18:07 | |
| openstackgerrit | Merged openstack/sushy master: Updated from global requirements https://review.openstack.org/488144 | 18:07 |
| *** ijw has joined #openstack-ironic | 18:08 | |
| *** crushil has joined #openstack-ironic | 18:09 | |
| *** openstackstatus has quit IRC | 18:11 | |
| *** openstack has joined #openstack-ironic | 18:14 | |
| *** mjturek has joined #openstack-ironic | 18:16 | |
| *** ricardoas has quit IRC | 18:16 | |
| *** Joseph has joined #openstack-ironic | 18:20 | |
| *** Joseph has quit IRC | 18:20 | |
| *** amotoki is now known as amotoki__ | 18:28 | |
| *** ijw has quit IRC | 18:29 | |
| *** jkilpatr has quit IRC | 18:32 | |
| *** ijw has joined #openstack-ironic | 18:35 | |
| *** ijw has quit IRC | 18:36 | |
| *** ijw has joined #openstack-ironic | 18:37 | |
| *** openstackstatus has quit IRC | 18:42 | |
| *** openstack has joined #openstack-ironic | 18:44 | |
| *** jkilpatr has joined #openstack-ironic | 18:49 | |
| openstackgerrit | Merged openstack/virtualbmc master: Updated from global requirements https://review.openstack.org/488150 | 18:55 |
| TheJulia | jlvillal: looks like I get to drive for a few hours instead of ride as I anticipated. That patch is like " " <-- that close | 19:01 |
| TheJulia | I'll try to check again in a couple hours and before I go to sleep. | 19:02 |
| *** crushil has quit IRC | 19:11 | |
| openstackgerrit | Eric Fried proposed openstack/ironic master: DNM: Test nova.utils.get_endpoint_data https://review.openstack.org/488177 | 19:17 |
| *** crushil has joined #openstack-ironic | 19:18 | |
| *** jtomasek has quit IRC | 19:30 | |
| *** jtomasek has joined #openstack-ironic | 19:30 | |
| *** jtomasek has quit IRC | 19:34 | |
| *** rama_y has quit IRC | 19:38 | |
| *** rama_y has joined #openstack-ironic | 19:45 | |
| *** Goneri has joined #openstack-ironic | 19:52 | |
| jlvillal | TheJulia: I don't think any need to worry. I am watching it. It passed the first step. Now in the merging gate | 19:53 |
| *** mrtenio is now known as mrtenio|afk | 20:04 | |
| *** e0ne has joined #openstack-ironic | 20:09 | |
| *** e0ne has quit IRC | 20:14 | |
| *** boris_42 has joined #openstack-ironic | 20:20 | |
| *** penick has joined #openstack-ironic | 20:36 | |
| *** leakypipes has quit IRC | 20:36 | |
| *** baoli has quit IRC | 20:37 | |
| *** sdague has quit IRC | 20:37 | |
| *** exodusftw has quit IRC | 20:40 | |
| *** crushil has quit IRC | 20:44 | |
| *** exodusftw has joined #openstack-ironic | 20:46 | |
| *** weshay is now known as weshay_pto | 20:53 | |
| *** trown is now known as trown_pto | 20:54 | |
| openstackgerrit | Peter Piela proposed openstack/ironic-ui master: Add unit tests for creating and editing ports https://review.openstack.org/487585 | 21:00 |
| openstackgerrit | OpenStack Release Bot proposed openstack/ironic-lib stable/pike: Update .gitreview for stable/pike https://review.openstack.org/488637 | 21:03 |
| openstackgerrit | OpenStack Release Bot proposed openstack/ironic-lib stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike https://review.openstack.org/488638 | 21:03 |
| openstackgerrit | OpenStack Release Bot proposed openstack/python-ironic-inspector-client stable/pike: Update .gitreview for stable/pike https://review.openstack.org/488772 | 21:06 |
| openstackgerrit | OpenStack Release Bot proposed openstack/python-ironic-inspector-client stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike https://review.openstack.org/488773 | 21:06 |
| openstackgerrit | OpenStack Release Bot proposed openstack/python-ironic-inspector-client master: Update reno for stable/pike https://review.openstack.org/488774 | 21:07 |
| openstackgerrit | OpenStack Release Bot proposed openstack/python-ironicclient stable/pike: Update .gitreview for stable/pike https://review.openstack.org/488775 | 21:07 |
| openstackgerrit | OpenStack Release Bot proposed openstack/python-ironicclient stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike https://review.openstack.org/488776 | 21:07 |
| openstackgerrit | OpenStack Release Bot proposed openstack/python-ironicclient master: Update reno for stable/pike https://review.openstack.org/488777 | 21:07 |
| openstackgerrit | OpenStack Release Bot proposed openstack/sushy stable/pike: Update .gitreview for stable/pike https://review.openstack.org/488835 | 21:08 |
| openstackgerrit | OpenStack Release Bot proposed openstack/sushy stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike https://review.openstack.org/488836 | 21:08 |
| openstackgerrit | OpenStack Release Bot proposed openstack/sushy master: Update reno for stable/pike https://review.openstack.org/488837 | 21:08 |
| *** vishwanathj has quit IRC | 21:15 | |
| openstackgerrit | Ilya Etingof proposed openstack/virtualbmc master: WIP: threading server, socket-based management cli tool https://review.openstack.org/488874 | 21:52 |
| *** Goneri has quit IRC | 22:02 | |
| *** jcoufal has joined #openstack-ironic | 22:09 | |
| TheJulia | jlvillal: ugh, failed the gate :( | 22:09 |
| jlvillal | TheJulia: Yeah :( | 22:09 |
| jlvillal | TheJulia: I was working on a little recheck bot ;) | 22:10 |
| jlvillal | TheJulia: So I don't have to babysit it over the weekend | 22:10 |
| *** jcoufal_ has quit IRC | 22:11 | |
| *** jcoufal has quit IRC | 22:18 | |
| *** jcoufal has joined #openstack-ironic | 22:18 | |
| *** jcoufal has quit IRC | 22:24 | |
| *** cdearborn has quit IRC | 22:26 | |
| *** mjturek has quit IRC | 22:31 | |
| *** fried_rice is now known as efried_zzz | 22:36 | |
| *** figleaf is now known as edleafe | 22:37 | |
| *** jcoufal has joined #openstack-ironic | 22:48 | |
| *** goldyfruit has quit IRC | 22:49 | |
| jlvillal | TheJulia: I did a recheck on it. I'll keep watching it | 22:50 |
| *** rpioso has quit IRC | 23:01 | |
| TheJulia | jlvillal: ok, I just stopped driving, so if needed I'll prod it | 23:16 |
| *** ptx0_ is now known as ptx0 | 23:16 | |
| jlvillal | TheJulia: Thanks | 23:17 |
| *** jcoufal has quit IRC | 23:17 | |
| *** srart has quit IRC | 23:22 | |
| *** mtanin___ has quit IRC | 23:39 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!