| *** csmart has joined #openstack-ironic | 00:07 | |
| *** dgautam has quit IRC | 00:07 | |
| *** affie_ has joined #openstack-ironic | 00:15 | |
| *** yangyapeng has quit IRC | 00:21 | |
| *** SerenaFeng has quit IRC | 00:22 | |
| *** SerenaFeng has joined #openstack-ironic | 00:24 | |
| *** mjturek has quit IRC | 00:32 | |
| *** mat128 has quit IRC | 00:38 | |
| *** akhilaki has joined #openstack-ironic | 00:44 | |
| *** akhilaki_ has joined #openstack-ironic | 00:44 | |
| *** akhilaki__ has joined #openstack-ironic | 00:44 | |
| *** linkmark has quit IRC | 00:45 | |
| *** mat128 has joined #openstack-ironic | 00:48 | |
| *** mkrai has joined #openstack-ironic | 00:48 | |
| *** retr0h has joined #openstack-ironic | 00:48 | |
| *** SerenaFeng has quit IRC | 00:57 | |
| *** phuongnh has joined #openstack-ironic | 01:01 | |
| *** yangyapeng has joined #openstack-ironic | 01:12 | |
| *** affie_ has quit IRC | 01:15 | |
| openstackgerrit | Anup Navare proposed openstack/ironic-ui master: Added support for injecting non-maskable interrupts https://review.openstack.org/516144 | 01:25 |
|---|---|---|
| *** rama_y has quit IRC | 01:27 | |
| *** akhilaki has quit IRC | 01:40 | |
| *** akhilaki__ has quit IRC | 01:40 | |
| *** akhilaki_ has quit IRC | 01:40 | |
| *** zhangfei has joined #openstack-ironic | 01:40 | |
| *** Grenth has quit IRC | 02:10 | |
| *** rcernin has quit IRC | 02:12 | |
| *** trungnv has quit IRC | 02:12 | |
| *** Grenth has joined #openstack-ironic | 02:15 | |
| *** rcernin has joined #openstack-ironic | 02:20 | |
| *** harlowja has quit IRC | 02:22 | |
| *** fragatina has quit IRC | 02:42 | |
| *** fragatina has joined #openstack-ironic | 02:43 | |
| *** fragatina has quit IRC | 02:47 | |
| *** fragatina has joined #openstack-ironic | 02:48 | |
| *** fragatina has quit IRC | 02:50 | |
| *** rbudden has quit IRC | 02:59 | |
| *** fragatina has joined #openstack-ironic | 03:00 | |
| *** fragatina has quit IRC | 03:00 | |
| openstackgerrit | Dao Cong Tien proposed openstack/ironic master: devstack: add support for setting rescue interface https://review.openstack.org/524118 | 03:04 |
| *** mat128 has quit IRC | 03:04 | |
| *** MattMan has quit IRC | 03:10 | |
| *** MattMan has joined #openstack-ironic | 03:11 | |
| *** mat128 has joined #openstack-ironic | 03:14 | |
| *** mat128 has quit IRC | 03:18 | |
| *** zshi has joined #openstack-ironic | 03:20 | |
| *** mat128 has joined #openstack-ironic | 03:26 | |
| *** rama_y_ has joined #openstack-ironic | 03:29 | |
| *** qsyqian has joined #openstack-ironic | 03:39 | |
| *** zhangfei has quit IRC | 03:47 | |
| *** zhangfei has joined #openstack-ironic | 03:51 | |
| *** threestrands has joined #openstack-ironic | 03:52 | |
| *** threestrands has quit IRC | 03:52 | |
| *** threestrands has joined #openstack-ironic | 03:52 | |
| *** udesale has joined #openstack-ironic | 04:01 | |
| *** pmannidi has quit IRC | 04:05 | |
| *** rama_y_ has quit IRC | 04:14 | |
| *** adisky_ has joined #openstack-ironic | 04:21 | |
| *** pmannidi has joined #openstack-ironic | 04:22 | |
| *** links has joined #openstack-ironic | 04:26 | |
| *** dpawar has joined #openstack-ironic | 04:29 | |
| *** vishwanathj has quit IRC | 04:31 | |
| *** harlowja has joined #openstack-ironic | 04:39 | |
| *** pmannidi has quit IRC | 04:40 | |
| *** sasha2 has quit IRC | 04:44 | |
| *** stendulker has joined #openstack-ironic | 04:48 | |
| *** Nisha_Agarwal has joined #openstack-ironic | 04:51 | |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Adds rescue_interface to base driver class https://review.openstack.org/509335 | 04:51 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Adds RPC calls for rescue interface https://review.openstack.org/509336 | 04:51 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add rescue related methods to network interface https://review.openstack.org/509342 | 04:51 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add rescuewait timeout periodic task https://review.openstack.org/353156 | 04:51 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Agent rescue implementation https://review.openstack.org/400437 | 04:51 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add API methods for [un]rescue https://review.openstack.org/350831 | 04:51 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add a data migration to fill node.rescue_interface https://review.openstack.org/522808 | 04:51 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add rescue interface field to node-related notifications https://review.openstack.org/502889 | 04:51 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Update description for config params of 'rescue' interface https://review.openstack.org/517919 | 04:51 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add documentation for rescue interface https://review.openstack.org/419606 | 04:52 |
| *** pmannidi has joined #openstack-ironic | 04:57 | |
| *** jaganathan has joined #openstack-ironic | 05:00 | |
| *** tzumainn has quit IRC | 05:24 | |
| *** harlowja has quit IRC | 05:30 | |
| *** fragatina has joined #openstack-ironic | 05:33 | |
| *** fragatina has quit IRC | 06:06 | |
| *** gcb has quit IRC | 06:08 | |
| *** gcb has joined #openstack-ironic | 06:10 | |
| *** trungnv has joined #openstack-ironic | 06:12 | |
| *** 07EAALF06 has joined #openstack-ironic | 06:12 | |
| *** 07EAALF06 has quit IRC | 06:13 | |
| *** fragatina has joined #openstack-ironic | 06:13 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 06:15 | |
| *** mat128 has quit IRC | 06:17 | |
| *** jaganathan has quit IRC | 06:23 | |
| *** AlexeyAbashkin has quit IRC | 06:26 | |
| *** Nisha_Agarwal has quit IRC | 06:31 | |
| *** threestrands has quit IRC | 06:32 | |
| *** marios has joined #openstack-ironic | 06:33 | |
| *** Nisha_Agarwal has joined #openstack-ironic | 06:35 | |
| *** fragatina has quit IRC | 06:37 | |
| *** jaganathan has joined #openstack-ironic | 06:37 | |
| *** karthiks has quit IRC | 06:41 | |
| *** e0ne has joined #openstack-ironic | 06:41 | |
| *** rwsu has joined #openstack-ironic | 06:44 | |
| *** e0ne has quit IRC | 06:46 | |
| *** Nisha_Agarwal has quit IRC | 06:51 | |
| *** karthiks has joined #openstack-ironic | 06:54 | |
| *** karthiks has quit IRC | 07:04 | |
| *** Nisha_Agarwal has joined #openstack-ironic | 07:07 | |
| *** rcernin has quit IRC | 07:11 | |
| *** pmannidi has quit IRC | 07:11 | |
| openstackgerrit | paresh sao proposed openstack/ironic master: Implementation for UEFI iSCSI boot for ILO https://review.openstack.org/468288 | 07:12 |
| *** ccamacho has quit IRC | 07:13 | |
| openstackgerrit | Merged openstack/ironic master: Pin API version during rolling upgrade https://review.openstack.org/518411 | 07:13 |
| pas-ha | morning ironic :) | 07:14 |
| *** karthiks has joined #openstack-ironic | 07:17 | |
| *** Nisha_Agarwal has quit IRC | 07:26 | |
| *** zhangfei has quit IRC | 07:29 | |
| *** charcol has quit IRC | 07:29 | |
| *** hjensas has joined #openstack-ironic | 07:39 | |
| *** zhangfei has joined #openstack-ironic | 07:41 | |
| *** jtomasek has joined #openstack-ironic | 07:44 | |
| *** rbartal has joined #openstack-ironic | 07:47 | |
| *** karthiks has quit IRC | 07:59 | |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic master: Use adapters for neutronclient https://review.openstack.org/476170 | 08:02 |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic master: Finalize migration to keystoneauth adapters https://review.openstack.org/478825 | 08:02 |
| *** jaianshu has joined #openstack-ironic | 08:05 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 08:07 | |
| pas-ha | hey ironic cores, could someone go thru https://review.openstack.org/#/q/project:openstack/ironic+is:open+path:%255Eironic_tempest_plugin.* and -2 all of it? those have to be re-proposed to the new repo eventually | 08:10 |
| *** karthiks has joined #openstack-ironic | 08:12 | |
| *** ccamacho has joined #openstack-ironic | 08:15 | |
| *** tesseract has joined #openstack-ironic | 08:15 | |
| *** rcernin has joined #openstack-ironic | 08:19 | |
| *** phuongnh has quit IRC | 08:25 | |
| *** charcol has joined #openstack-ironic | 08:25 | |
| *** phuongnh has joined #openstack-ironic | 08:25 | |
| *** Nisha_Agarwal has joined #openstack-ironic | 08:37 | |
| *** e0ne has joined #openstack-ironic | 08:42 | |
| *** dpawar has quit IRC | 08:48 | |
| *** SerenaFeng has joined #openstack-ironic | 08:48 | |
| *** Nisha_Agarwal has quit IRC | 08:49 | |
| *** dpawar has joined #openstack-ironic | 09:03 | |
| *** mgoddard has joined #openstack-ironic | 09:06 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/bifrost master: Test OPNFV CI verify job. Please ignore. https://review.openstack.org/367608 | 09:08 |
| *** racedo has joined #openstack-ironic | 09:09 | |
| *** jaianshu has quit IRC | 09:19 | |
| *** mrch has joined #openstack-ironic | 09:21 | |
| *** linkmark has joined #openstack-ironic | 09:23 | |
| *** amarao has joined #openstack-ironic | 09:25 | |
| *** SerenaFeng has quit IRC | 09:25 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/bifrost master: scripts: install-deps.sh: Ensure distros have package metadata available https://review.openstack.org/526324 | 09:29 |
| *** lucas-afk is now known as lucasagomes | 09:35 | |
| *** derekh has joined #openstack-ironic | 09:36 | |
| *** yee37930 has joined #openstack-ironic | 09:37 | |
| *** TuanLA has joined #openstack-ironic | 09:37 | |
| *** yee379 has quit IRC | 09:40 | |
| *** athomas has joined #openstack-ironic | 09:46 | |
| *** affie has joined #openstack-ironic | 09:55 | |
| *** affie_ has joined #openstack-ironic | 09:56 | |
| *** affie has quit IRC | 10:00 | |
| *** TuanLA has quit IRC | 10:18 | |
| *** rcernin has quit IRC | 10:21 | |
| *** alex_xu has quit IRC | 10:24 | |
| *** alex_xu has joined #openstack-ironic | 10:25 | |
| *** gcb has quit IRC | 10:29 | |
| *** marios has quit IRC | 10:30 | |
| *** dtantsur|afk is now known as dtantsur | 10:32 | |
| dtantsur | morning ironic | 10:32 |
| dtantsur | pas-ha: I think we're freezing stuff on Monday, no? | 10:33 |
| *** qsyqian has quit IRC | 10:34 | |
| *** milan has joined #openstack-ironic | 10:41 | |
| *** phuongnh has quit IRC | 10:48 | |
| *** phuongnh has joined #openstack-ironic | 10:49 | |
| *** trungnv has quit IRC | 10:50 | |
| *** trungnv has joined #openstack-ironic | 10:50 | |
| *** alex_xu has quit IRC | 10:50 | |
| *** qsyqian has joined #openstack-ironic | 10:51 | |
| *** alex_xu has joined #openstack-ironic | 10:51 | |
| *** SerenaFeng has joined #openstack-ironic | 10:51 | |
| *** zhangfei has quit IRC | 10:52 | |
| *** SerenaFeng has quit IRC | 10:53 | |
| openstackgerrit | Merged openstack/ironic master: Update docs to include API version pinning https://review.openstack.org/518648 | 11:01 |
| *** sambetts|afk is now known as sambetts | 11:02 | |
| sambetts | Morning all | 11:02 |
| dtantsur | hey sambetts | 11:02 |
| *** jaganathan has quit IRC | 11:09 | |
| *** zhangfei has joined #openstack-ironic | 11:09 | |
| hjensas | noon everyone. :) | 11:10 |
| *** qsyqian has quit IRC | 11:11 | |
| *** jkilpatr has quit IRC | 11:12 | |
| dtantsur | hi hjensas | 11:12 |
| sambetts | o/ dtantsur, hjensas | 11:13 |
| *** srart has quit IRC | 11:15 | |
| *** marios has joined #openstack-ironic | 11:15 | |
| *** marios has quit IRC | 11:18 | |
| *** marios has joined #openstack-ironic | 11:18 | |
| *** srart has joined #openstack-ironic | 11:18 | |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Return node validation results based on requested API version https://review.openstack.org/526343 | 11:19 |
| *** stendulker has quit IRC | 11:20 | |
| *** zhangfei has quit IRC | 11:21 | |
| *** qsyqian has joined #openstack-ironic | 11:23 | |
| *** racedo has quit IRC | 11:24 | |
| *** jesusaur has quit IRC | 11:25 | |
| *** jesusaur has joined #openstack-ironic | 11:28 | |
| *** qsyqian has quit IRC | 11:28 | |
| *** udesale has quit IRC | 11:28 | |
| *** jesusaur has quit IRC | 11:31 | |
| *** jesusaur has joined #openstack-ironic | 11:33 | |
| *** dpawar has quit IRC | 11:38 | |
| *** qsyqian has joined #openstack-ironic | 11:41 | |
| *** jkilpatr has joined #openstack-ironic | 11:47 | |
| *** dpawar has joined #openstack-ironic | 11:51 | |
| openstackgerrit | Sam Betts proposed openstack/ironic master: Add detail=[True, False] query string to API list endpoints https://review.openstack.org/431497 | 11:52 |
| *** racedo has joined #openstack-ironic | 11:59 | |
| openstackgerrit | Sam Betts proposed openstack/ironic master: Receive and store agent version on heartbeat https://review.openstack.org/364861 | 12:00 |
| *** qsyqian has quit IRC | 12:01 | |
| openstackgerrit | Sam Betts proposed openstack/ironic-python-agent master: Include IPA Version during heartbeat https://review.openstack.org/364834 | 12:16 |
| TheJulia | good morning everyone | 12:34 |
| *** dprince has joined #openstack-ironic | 12:34 | |
| dtantsur | morning TheJulia | 12:37 |
| dtantsur | pas-ha: I'm seeing ERROR ansible.plugins.callback.ironic_log [-] Ansible task configure : unmount dirs for chroot failed on node e53bd252-c45d-4ab7-95fc-f01ceb062643: {\'msg\': u\'All items completed\', \'failed\': True, \'changed\': True}\n' on one of my nodes with the ansible deploy | 12:37 |
| dtantsur | to you have any clue where this comes from? | 12:37 |
| dtantsur | TheJulia: if you have experience with ansible deploy ^^ | 12:39 |
| TheJulia | no, any chance we can turn up the verbosity that ansible executes at? | 12:40 |
| dtantsur | I think it's quite verbose already.. no idea why there is no error message | 12:42 |
| TheJulia | can you drop a section of the logs into paste? | 12:42 |
| *** hw_wutianwei has quit IRC | 12:42 | |
| dtantsur | TheJulia: it's absoltely unreadable.. essentially a huge JSON from ansible ending with this | 12:43 |
| dtantsur | previous tasks seem to succeed | 12:43 |
| TheJulia | dtantsur: it is actually readable if your used to it :) | 12:44 |
| *** lucasagomes is now known as lucas-hungry | 12:47 | |
| dtantsur | TheJulia: anyway, I've found the relevant bit: umount: /tmp/rootfs/sys: target is busy. | 12:48 |
| TheJulia | yeah, I was going to say that is most likely something like it | 12:48 |
| dtantsur | so this blows up https://github.com/openstack/ironic/blob/52f20d156544d7e4c6d1473bc8fd35732b28d21c/ironic/drivers/modules/ansible/playbooks/roles/configure/tasks/grub.yaml#L73-L79 | 12:48 |
| TheJulia | yup | 12:48 |
| dtantsur | is it possible to make ansible retry this with a delay? | 12:49 |
| TheJulia | you can insert a delay... | 12:49 |
| TheJulia | first thing would be to identify why the tmp_bind_mount/sys is still in use | 12:50 |
| TheJulia | I would put a command in to do lsof -n |grep tmp_bind_mount so the logs record what is going on | 12:50 |
| dtantsur | I suspect we're just doing unmount too quickly, but dunno | 12:51 |
| TheJulia | well, it would be shell | 12:51 |
| TheJulia | yeah, very likely, but the prior step shouldn't be exiting until done, so something is actually lingering | 12:51 |
| dtantsur | I think we have retries all over the place, because a lot of these disk actions are semi-async | 12:52 |
| pas-ha | dtantsur: TheJulia will take a look | 12:53 |
| TheJulia | dtantsur: except if the file handler is closed by the process, then the kernel should allow an unmount | 12:54 |
| TheJulia | because the writes would have been committed to buffer cache to be written to disk | 12:54 |
| * dtantsur has no idea.. | 12:54 | |
| dtantsur | but in the worst case we can do https://coderwall.com/p/ww4dxw/ansible-retry-task | 12:54 |
| TheJulia | yeah, we would just need to make sure mount doesn't return an error if already unmounted | 12:56 |
| TheJulia | sadly | 12:57 |
| TheJulia | it does return 1 | 12:57 |
| dtantsur | sigh | 12:58 |
| TheJulia | stdout can be evaluated... | 12:58 |
| TheJulia | or it can be broken into 3 separate tasks | 12:58 |
| dtantsur | TheJulia: anyway, just fired another 'overcloud deploy' with 'lsof' inserted | 12:59 |
| dtantsur | I hope we do have lsof on the image.. | 12:59 |
| TheJulia | dtantsur: okay, with that, I'm going to go get some coffee | 13:00 |
| *** phuongnh has quit IRC | 13:04 | |
| fellypefca | Good morning everyone. :) | 13:12 |
| *** jlabarre has joined #openstack-ironic | 13:15 | |
| *** yangyapeng has quit IRC | 13:16 | |
| *** yangyapeng has joined #openstack-ironic | 13:17 | |
| dtantsur | TheJulia: this time the deployment succeeded for both nodes Oo | 13:18 |
| *** yangyapeng has quit IRC | 13:21 | |
| TheJulia | dtantsur: was it just lsof or lsof -n? | 13:22 |
| *** mat128 has joined #openstack-ironic | 13:23 | |
| TheJulia | Without -n would have blocked on name lookups | 13:23 |
| dtantsur | TheJulia: with -n | 13:24 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic master: Updated from global requirements https://review.openstack.org/526375 | 13:24 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-inspector master: Updated from global requirements https://review.openstack.org/526376 | 13:24 |
| *** tzumainn has joined #openstack-ironic | 13:25 | |
| *** bfournie has quit IRC | 13:25 | |
| *** bfournie has joined #openstack-ironic | 13:25 | |
| TheJulia | funky | 13:26 |
| openstackgerrit | Milan Kováčik proposed openstack/ironic-inspector master: Make discovery use dnsmasq dhcp filter https://review.openstack.org/525685 | 13:26 |
| * TheJulia wonders if a sleep for a second would just fix everything | 13:27 | |
| milan | morning Ironic! :) | 13:27 |
| TheJulia | good morning milan | 13:27 |
| * milan <3 shell debugging :D | 13:27 | |
| milan | morning TheJulia! :) | 13:27 |
| *** athomas has quit IRC | 13:28 | |
| *** lucas-hungry is now known as lucasagomes | 13:29 | |
| *** bfournie has quit IRC | 13:30 | |
| dtantsur | morning milan | 13:33 |
| dtantsur | TheJulia: this is why I'm thinking about retries... | 13:33 |
| dtantsur | Stack overcloud CREATE_COMPLETE | 13:34 |
| dtantsur | pas-ha, TheJulia, a simple tripleo overcloud deployed with the ansible interface :) | 13:34 |
| sambetts | \o/ | 13:35 |
| dtantsur | now I wonder how transient is the unmount failure.. | 13:35 |
| pas-ha | YAY! :) | 13:35 |
| milan | morning dtantsur! :) | 13:35 |
| fellypefca | dtantsur, TheJulia Could you take a look when you have some time? It's the new first patch of our migration. :) https://review.openstack.org/#/c/523943/ | 13:36 |
| patchbot | patch 523943 - ironic - Introduce hpOneView and ilorest to OneView | 13:36 |
| TheJulia | fellypefca: sure, would be happy to look a little later | 13:37 |
| *** jkilpatr has quit IRC | 13:38 | |
| TheJulia | dtantsur: in that case, I would say break into three separate tasks and let each have a retry | 13:38 |
| fellypefca | TheJulia thanks :D :D | 13:38 |
| *** amarao has quit IRC | 13:43 | |
| *** yangyapeng has joined #openstack-ironic | 13:45 | |
| *** amarao has joined #openstack-ironic | 13:46 | |
| *** jkilpatr has joined #openstack-ironic | 13:51 | |
| dtantsur | TheJulia, pas-ha, https://review.openstack.org/#/c/526402/ | 13:55 |
| patchbot | patch 526402 - ironic - ansible: retry umounting for 10 seconds | 13:55 |
| *** zhangfei has joined #openstack-ironic | 13:55 | |
| TheJulia | dtantsur: have you deployed with ^^^ | 13:58 |
| *** bfournie has joined #openstack-ironic | 13:58 | |
| dtantsur | TheJulia: trying right now | 13:58 |
| dtantsur | also bumping to 4 nodes | 13:58 |
| TheJulia | ack | 13:58 |
| *** sasha2 has joined #openstack-ironic | 14:00 | |
| *** links has quit IRC | 14:01 | |
| *** rloo has joined #openstack-ironic | 14:03 | |
| TheJulia | good morning rloo | 14:11 |
| rloo | hey, good morning TheJulia. Early good morning? :) | 14:11 |
| *** rbudden has joined #openstack-ironic | 14:12 | |
| TheJulia | rloo: I'm on the east coast until Saturday | 14:12 |
| rloo | and good Thursday morning to everyone else! | 14:12 |
| rloo | TheJulia: wow, you get around ;) | 14:12 |
| *** AlexeyAbashkin has quit IRC | 14:12 | |
| * TheJulia may or may not be unintentionally reaching the next level of status on her favorite airline around the holidays. | 14:13 | |
| dtantsur | TheJulia: huh, it still fails for the same node.. weird? I'm not sure retries even work, no idea why | 14:14 |
| TheJulia | dtantsur: no conditional ? | 14:14 |
| dtantsur | sorry? I don't see it actually retrying, just giving up instantly | 14:15 |
| TheJulia | I'm not sure retires work with iterators either, fwiw | 14:15 |
| * dtantsur double-checks | 14:15 | |
| dtantsur | well, work locally for me | 14:15 |
| sambetts | ansible versions match? | 14:16 |
| TheJulia | dtantsur: yeah, this goes back to why I was suggesting 3 separate tasks, your mixing iterators, retries is an iterator in ansible as is the with_items | 14:17 |
| dtantsur | TheJulia: it does work. just not when I need it.. | 14:17 |
| TheJulia | ahh | 14:17 |
| * TheJulia remembers it not really working for a time... but it was a long long time ago in a galaxy far far away | 14:18 | |
| dtantsur | TheJulia: oops, I think I missed one bit in my patch | 14:21 |
| dtantsur | which I have locally | 14:21 |
| TheJulia | :) | 14:22 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: ansible: retry umounting for 10 seconds https://review.openstack.org/526402 | 14:23 |
| dtantsur | TheJulia: ^^^ | 14:23 |
| dtantsur | what I don't understand is why, once a node starts failing, it keeps failing forever | 14:24 |
| TheJulia | I'm sure it is some sort of open file handler | 14:25 |
| *** dprince has quit IRC | 14:25 | |
| rloo | TheJulia: what concerns did you have with https://review.openstack.org/#/c/364861/ ? | 14:25 |
| patchbot | patch 364861 - ironic - Receive and store agent version on heartbeat | 14:25 |
| TheJulia | dtantsur: got logs handy of it failing? | 14:26 |
| *** Goneri has joined #openstack-ironic | 14:26 | |
| TheJulia | rloo: lockin | 14:26 |
| dtantsur | TheJulia: really nothing interesting except for this message.. | 14:26 |
| dtantsur | TheJulia: aaand, while I was complaining, Nth retry of deployment by Nova succeeded Oo | 14:27 |
| TheJulia | it _really_ should but the version of the agent, but the version of the agent api that is being spoken, but... *shrugs* | 14:27 |
| TheJulia | err, really should not be the version of the agent | 14:27 |
| rloo | TheJulia: yeah, didn't we discuss that in the spec? | 14:27 |
| TheJulia | rloo: at this point, I just don't remember. new job + loosing perfect home has taken a toll on me this week | 14:28 |
| rloo | TheJulia: i forgot why we went with the version. maybe cuz there is no IPA API version and we figured it would take even longer to do | 14:28 |
| rloo | TheJulia: :-( I will look at the spec, i know we discussed it... | 14:28 |
| TheJulia | rloo: realistically, it is not a big deal, it is just something sitting in the back of my head going "hmm" | 14:29 |
| *** dpawar has quit IRC | 14:31 | |
| *** dpawar has joined #openstack-ironic | 14:31 | |
| sambetts | rloo, TheJulia: we activily decided to choose the version of the agent not the version of the agent API, because the available features and the behaviour of those features is tied to the version of the agent installed not its API | 14:32 |
| TheJulia | it is true, unless someone has their own implementation of the agent... :) | 14:32 |
| TheJulia | which I think is low risk | 14:32 |
| rloo | sambetts: thx for clarifying/reminding. | 14:34 |
| sambetts | if their agent is compatible with agent v3.1.0 then they should report 3.1.0 as their version and everything will be awsome (although I get thats a bit weird ) | 14:34 |
| sambetts | rloo: no probs :) | 14:34 |
| * sambetts got a new japanese tea thermos and keeps being surprised each time he tries to drink and gets burnt ... | 14:35 | |
| *** dpawar has quit IRC | 14:36 | |
| rloo | sambetts: guess it works well :) what kind is it? | 14:36 |
| *** yangyapeng has quit IRC | 14:48 | |
| *** jesusaur has quit IRC | 14:48 | |
| *** yee37930 has quit IRC | 14:48 | |
| *** openstackgerrit has quit IRC | 14:48 | |
| *** sai has quit IRC | 14:48 | |
| *** dyasny_ has quit IRC | 14:48 | |
| *** UForgotten has quit IRC | 14:48 | |
| *** pc_m has quit IRC | 14:48 | |
| *** lifeless has quit IRC | 14:48 | |
| *** leifmadsen has quit IRC | 14:48 | |
| *** jralph has quit IRC | 14:48 | |
| *** afazekas has quit IRC | 14:48 | |
| *** antonym has quit IRC | 14:48 | |
| *** pshige_________ has quit IRC | 14:48 | |
| *** jtomasek has quit IRC | 14:48 | |
| *** adisky_ has quit IRC | 14:48 | |
| *** Grenth has quit IRC | 14:48 | |
| *** chandankumar has quit IRC | 14:48 | |
| *** amotoki has quit IRC | 14:48 | |
| *** betherly has quit IRC | 14:48 | |
| *** fungi has quit IRC | 14:48 | |
| *** johnsom has quit IRC | 14:48 | |
| *** pas-ha has quit IRC | 14:48 | |
| *** TheJulia has quit IRC | 14:48 | |
| *** robcresswell has quit IRC | 14:48 | |
| *** fdegir has quit IRC | 14:48 | |
| *** logan- has quit IRC | 14:48 | |
| *** rpioso has quit IRC | 14:48 | |
| *** johnthetubaguy has quit IRC | 14:48 | |
| *** portdirect has quit IRC | 14:48 | |
| *** mrch has quit IRC | 14:48 | |
| *** sasha2 has quit IRC | 14:48 | |
| *** mkrai has quit IRC | 14:48 | |
| *** BadCub has quit IRC | 14:48 | |
| *** dsneddon has quit IRC | 14:48 | |
| *** kiseok7 has quit IRC | 14:48 | |
| *** alineb has quit IRC | 14:48 | |
| *** ltomasbo has quit IRC | 14:48 | |
| *** mariojv has quit IRC | 14:48 | |
| *** rloo has quit IRC | 14:48 | |
| *** tzumainn has quit IRC | 14:48 | |
| *** affie_ has quit IRC | 14:48 | |
| *** csmart has quit IRC | 14:48 | |
| *** natorious has quit IRC | 14:48 | |
| *** zshi has quit IRC | 14:48 | |
| *** ricardoas has quit IRC | 14:48 | |
| *** nicodemos has quit IRC | 14:48 | |
| *** jrist has quit IRC | 14:48 | |
| *** masber has quit IRC | 14:48 | |
| *** yuanying has quit IRC | 14:48 | |
| *** hoonetorg has quit IRC | 14:48 | |
| *** ianw has quit IRC | 14:48 | |
| *** actatux has quit IRC | 14:48 | |
| *** zigo has quit IRC | 14:48 | |
| *** anupn has quit IRC | 14:48 | |
| *** vsaienk0 has quit IRC | 14:48 | |
| *** bcornec has quit IRC | 14:48 | |
| *** retr0h has quit IRC | 14:48 | |
| *** jhesketh has quit IRC | 14:48 | |
| *** rbudden has quit IRC | 14:48 | |
| *** jlabarre has quit IRC | 14:48 | |
| *** marios has quit IRC | 14:48 | |
| *** rbartal has quit IRC | 14:48 | |
| *** mikal has quit IRC | 14:48 | |
| *** hamzy has quit IRC | 14:48 | |
| *** mgkwill_ has quit IRC | 14:48 | |
| *** v12aml has quit IRC | 14:48 | |
| *** oanson has quit IRC | 14:48 | |
| *** jaypipes has quit IRC | 14:48 | |
| *** trown has quit IRC | 14:48 | |
| *** mgoddard has quit IRC | 14:48 | |
| *** fbouliane has quit IRC | 14:48 | |
| *** serverascode has quit IRC | 14:48 | |
| *** persia has quit IRC | 14:48 | |
| *** melwitt has quit IRC | 14:48 | |
| *** kencjohnston has quit IRC | 14:48 | |
| *** oomichi_afk has quit IRC | 14:48 | |
| *** keekz has quit IRC | 14:48 | |
| *** jkilpatr has quit IRC | 14:48 | |
| *** mat128 has quit IRC | 14:48 | |
| *** racedo has quit IRC | 14:48 | |
| *** alex_xu has quit IRC | 14:48 | |
| *** milan has quit IRC | 14:48 | |
| *** mcarden has quit IRC | 14:48 | |
| *** sambetts has quit IRC | 14:48 | |
| *** lennyb has quit IRC | 14:48 | |
| *** srart has quit IRC | 14:48 | |
| *** charcol has quit IRC | 14:48 | |
| *** EmilienM has quit IRC | 14:48 | |
| *** tonyb has quit IRC | 14:48 | |
| *** strigazi has quit IRC | 14:48 | |
| *** chihhsin has quit IRC | 14:48 | |
| *** SpamapS has quit IRC | 14:48 | |
| *** lhinds has quit IRC | 14:48 | |
| *** homegrown has quit IRC | 14:48 | |
| *** bl0m1 has quit IRC | 14:48 | |
| *** rybridges has quit IRC | 14:48 | |
| *** ddurst has quit IRC | 14:48 | |
| *** Bico_Fino has quit IRC | 14:48 | |
| *** aignatov has quit IRC | 14:48 | |
| *** SerenaFeng has joined #openstack-ironic | 14:53 | |
| *** adisky_ has joined #openstack-ironic | 14:54 | |
| *** Grenth has joined #openstack-ironic | 14:54 | |
| *** chandankumar has joined #openstack-ironic | 14:54 | |
| *** amotoki has joined #openstack-ironic | 14:54 | |
| *** betherly has joined #openstack-ironic | 14:54 | |
| *** fungi has joined #openstack-ironic | 14:54 | |
| *** johnsom has joined #openstack-ironic | 14:54 | |
| *** TheJulia has joined #openstack-ironic | 14:54 | |
| *** pas-ha has joined #openstack-ironic | 14:54 | |
| *** robcresswell has joined #openstack-ironic | 14:54 | |
| *** fdegir has joined #openstack-ironic | 14:54 | |
| *** logan- has joined #openstack-ironic | 14:54 | |
| *** rpioso has joined #openstack-ironic | 14:54 | |
| *** johnthetubaguy has joined #openstack-ironic | 14:54 | |
| *** portdirect has joined #openstack-ironic | 14:54 | |
| *** sasha2 has joined #openstack-ironic | 14:54 | |
| *** BadCub has joined #openstack-ironic | 14:54 | |
| *** dsneddon has joined #openstack-ironic | 14:54 | |
| *** ltomasbo has joined #openstack-ironic | 14:54 | |
| *** kiseok7 has joined #openstack-ironic | 14:54 | |
| *** alineb has joined #openstack-ironic | 14:54 | |
| *** mariojv has joined #openstack-ironic | 14:54 | |
| *** d0ugal has quit IRC | 14:54 | |
| *** SerenaFeng has quit IRC | 14:54 | |
| *** rloo has joined #openstack-ironic | 14:54 | |
| *** pshige_________ has joined #openstack-ironic | 14:54 | |
| *** antonym has joined #openstack-ironic | 14:54 | |
| *** afazekas has joined #openstack-ironic | 14:54 | |
| *** jralph has joined #openstack-ironic | 14:54 | |
| *** leifmadsen has joined #openstack-ironic | 14:54 | |
| *** lifeless has joined #openstack-ironic | 14:54 | |
| *** pc_m has joined #openstack-ironic | 14:54 | |
| *** UForgotten has joined #openstack-ironic | 14:54 | |
| *** dyasny_ has joined #openstack-ironic | 14:54 | |
| *** sai has joined #openstack-ironic | 14:54 | |
| *** openstackgerrit has joined #openstack-ironic | 14:54 | |
| *** yee37930 has joined #openstack-ironic | 14:54 | |
| *** jesusaur has joined #openstack-ironic | 14:54 | |
| *** yangyapeng has joined #openstack-ironic | 14:54 | |
| *** rbudden has joined #openstack-ironic | 14:54 | |
| *** jkilpatr has joined #openstack-ironic | 14:54 | |
| *** tzumainn has joined #openstack-ironic | 14:54 | |
| *** mat128 has joined #openstack-ironic | 14:54 | |
| *** jlabarre has joined #openstack-ironic | 14:54 | |
| *** racedo has joined #openstack-ironic | 14:54 | |
| *** srart has joined #openstack-ironic | 14:54 | |
| *** marios has joined #openstack-ironic | 14:54 | |
| *** alex_xu has joined #openstack-ironic | 14:54 | |
| *** milan has joined #openstack-ironic | 14:54 | |
| *** affie_ has joined #openstack-ironic | 14:54 | |
| *** mgoddard has joined #openstack-ironic | 14:54 | |
| *** charcol has joined #openstack-ironic | 14:54 | |
| *** rbartal has joined #openstack-ironic | 14:54 | |
| *** zshi has joined #openstack-ironic | 14:54 | |
| *** mikal has joined #openstack-ironic | 14:54 | |
| *** hamzy has joined #openstack-ironic | 14:54 | |
| *** ricardoas has joined #openstack-ironic | 14:54 | |
| *** nicodemos has joined #openstack-ironic | 14:54 | |
| *** mgkwill_ has joined #openstack-ironic | 14:54 | |
| *** v12aml has joined #openstack-ironic | 14:54 | |
| *** oanson has joined #openstack-ironic | 14:54 | |
| *** jrist has joined #openstack-ironic | 14:54 | |
| *** masber has joined #openstack-ironic | 14:54 | |
| *** jaypipes has joined #openstack-ironic | 14:54 | |
| *** trown has joined #openstack-ironic | 14:54 | |
| *** yuanying has joined #openstack-ironic | 14:54 | |
| *** hoonetorg has joined #openstack-ironic | 14:54 | |
| *** ianw has joined #openstack-ironic | 14:54 | |
| *** actatux has joined #openstack-ironic | 14:54 | |
| *** bcornec has joined #openstack-ironic | 14:54 | |
| *** vsaienk0 has joined #openstack-ironic | 14:54 | |
| *** anupn has joined #openstack-ironic | 14:54 | |
| *** zigo has joined #openstack-ironic | 14:54 | |
| *** EmilienM has joined #openstack-ironic | 14:54 | |
| *** mcarden has joined #openstack-ironic | 14:54 | |
| *** natorious has joined #openstack-ironic | 14:54 | |
| *** sambetts has joined #openstack-ironic | 14:54 | |
| *** tonyb has joined #openstack-ironic | 14:54 | |
| *** jhesketh has joined #openstack-ironic | 14:54 | |
| *** homegrown has joined #openstack-ironic | 14:54 | |
| *** strigazi has joined #openstack-ironic | 14:54 | |
| *** lennyb has joined #openstack-ironic | 14:54 | |
| *** fbouliane has joined #openstack-ironic | 14:54 | |
| *** chihhsin has joined #openstack-ironic | 14:54 | |
| *** serverascode has joined #openstack-ironic | 14:54 | |
| *** SpamapS has joined #openstack-ironic | 14:54 | |
| *** lhinds has joined #openstack-ironic | 14:54 | |
| *** persia has joined #openstack-ironic | 14:54 | |
| *** bl0m1 has joined #openstack-ironic | 14:54 | |
| *** rybridges has joined #openstack-ironic | 14:54 | |
| *** melwitt has joined #openstack-ironic | 14:54 | |
| *** kencjohnston has joined #openstack-ironic | 14:54 | |
| *** oomichi_afk has joined #openstack-ironic | 14:54 | |
| *** ddurst has joined #openstack-ironic | 14:54 | |
| *** Bico_Fino has joined #openstack-ironic | 14:54 | |
| *** aignatov has joined #openstack-ironic | 14:54 | |
| *** keekz has joined #openstack-ironic | 14:54 | |
| *** tzumainn has quit IRC | 14:55 | |
| *** d0ugal has joined #openstack-ironic | 14:55 | |
| *** tzumainn has joined #openstack-ironic | 14:55 | |
| *** mtreinish has quit IRC | 14:55 | |
| *** jkilpatr has quit IRC | 14:55 | |
| *** tzumainn has quit IRC | 14:55 | |
| *** tzumainn has joined #openstack-ironic | 14:56 | |
| *** jkilpatr has joined #openstack-ironic | 14:56 | |
| *** mtreinish has joined #openstack-ironic | 14:58 | |
| *** rbartal has quit IRC | 14:59 | |
| TheJulia | Netsplits are fun! | 14:59 |
| dtantsur | pas-ha: do you have a patch to make CONF.glance.swift_endpoint_url load from keystone? | 15:00 |
| *** mjturek has joined #openstack-ironic | 15:00 | |
| pas-ha | nope, not yet | 15:00 |
| dtantsur | pas-ha: do you plan on it? that would be handy for both direct and ansible deploy.. | 15:01 |
| dtantsur | I'm also figuring out how to detect CONF.glance.swift_account | 15:01 |
| pas-ha | kind of related to it https://bugs.dogfood.paddev.net/ironic/+bug/1521197 | 15:01 |
| pas-ha | dtantsur: you can't | 15:01 |
| dtantsur | pas-ha: why? its AUTH_ + tenant ID of "service", which is CONF.glance.project_name | 15:02 |
| dtantsur | maybe it's not always the case, but it feels a safe assumption to me | 15:02 |
| dtantsur | by default | 15:02 |
| pas-ha | not necessarily | 15:02 |
| pas-ha | that's the project under which the glance service user goes to swift to store the data | 15:02 |
| dtantsur | maybe, but it's the case in both devstack in tripleo.. it can make a good default | 15:03 |
| pas-ha | it may be completely different than the user ironic uses to talk to glance | 15:03 |
| rloo | inspector folks milan, aarefiev, dtantsur, sambetts ? looks like stable/pike is not happy: https://review.openstack.org/#/c/517403/ | 15:03 |
| patchbot | patch 517403 - ironic-inspector (stable/pike) - Test. Please. Ignore. | 15:03 |
| dtantsur | ugh | 15:03 |
| * dtantsur is overloaded | 15:03 | |
| milan | rloo, /me looks | 15:03 |
| rloo | milan: thx. | 15:03 |
| rloo | milan: looks like timeouts but not sure if expected/normal | 15:04 |
| pas-ha | it is basically a copy of what's inside /etc/glance/grance-swift-store.conf | 15:04 |
| * milan hopes his patches to devstack didn't land by accident ;) | 15:04 | |
| rloo | milan: fwiw, this stable/pike patch was also failing: https://review.openstack.org/#/c/523446/ | 15:04 |
| patchbot | patch 523446 - ironic-inspector (stable/pike) - zuul: Clean up zuul files | 15:04 |
| dtantsur | pas-ha: this configuration file does not seem to have account, it's probably inferred from tenant ID | 15:06 |
| dtantsur | pas-ha: also, if a different tenant is used for putting images to swift, we won't be able to read them anyway | 15:06 |
| milan | rloo, no logs in http://logs.openstack.org/03/517403/2/check/ironic-inspector-grenade-dsvm/e9b7c83/logs/old/screen-ironic-inspector-dhcp.txt.gz something's wrong indeed | 15:07 |
| * milan ENOCOFFEE | 15:07 | |
| rloo | milan: good thing you're inspectin' it :D | 15:07 |
| milan | lol | 15:07 |
| * milan coffee and back | 15:08 | |
| rloo | pas-ha: you ok if I kill (abandon) this? I suspect it'll overwrite what is there now, which already has the changes: https://review.openstack.org/#/c/526068/ | 15:08 |
| patchbot | patch 526068 - ironic - Update config sample | 15:08 |
| *** zhangfei has quit IRC | 15:09 | |
| pas-ha | rloo: go ahead | 15:09 |
| pas-ha | rloo: it just sored my eyes when making some other patch, tired of staging by hunks in git :) | 15:10 |
| dtantsur | so, I suspect the tenant glance uses to access swift has to match the tenant we use to access swift.. | 15:10 |
| rloo | pas-ha: understandable! it was the right thing to do but... | 15:10 |
| *** dprince has joined #openstack-ironic | 15:17 | |
| *** d0ugal is now known as Guest27460 | 15:20 | |
| *** Guest27460 has quit IRC | 15:23 | |
| *** d0ugal has joined #openstack-ironic | 15:23 | |
| *** d0ugal has quit IRC | 15:23 | |
| *** d0ugal has joined #openstack-ironic | 15:23 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: [WIP] Auto-detect default for [glance]swift_account https://review.openstack.org/526429 | 15:24 |
| dtantsur | pas-ha: I'm thinking of something like ^^^ | 15:24 |
| *** links has joined #openstack-ironic | 15:25 | |
| rloo | dtantsur: wrt node validation, did we ever discuss whether it should show validations for interfaces that are not avail in the specified API version? https://review.openstack.org/#/c/526343/ | 15:26 |
| patchbot | patch 526343 - ironic - Return node validation results based on requested ... | 15:26 |
| dtantsur | I don't rememeber discussing it | 15:26 |
| dtantsur | it's an good idea for sure, though I guess we cannot fix it for interfaces we already released.. | 15:26 |
| rloo | dtantsur: cuz i think the problem is more than just storage inteface, all the other interfaces that we added too? network? raid? | 15:26 |
| dtantsur | yeah | 15:27 |
| dtantsur | well, the problem with microversioning is that you have to be really careful to not screw it up.... | 15:27 |
| rloo | dtantsur: oh, so we cannot remove those interfaces from the response now, cuz they are already there? | 15:27 |
| dtantsur | yep, it's going to be breaking | 15:28 |
| rloo | dtantsur: $#@% but for the new rescue, we don't want to show it? which might be confusing... | 15:29 |
| *** tzumainn has quit IRC | 15:29 | |
| pas-ha | dtantsur: in fact that's not going to work even on DevStack - the required user is "service:glance-swift" and not "ironic" | 15:29 |
| dtantsur | pas-ha: this is about projects, not users | 15:29 |
| dtantsur | we're using project_id for 'service' | 15:29 |
| *** tzumainn has joined #openstack-ironic | 15:29 | |
| dtantsur | but let's see | 15:29 |
| pas-ha | well yes... in this case this might work | 15:30 |
| pas-ha | dtantsur: I remembered, Galyna started to work on smth in this regard https://review.openstack.org/#/c/410764/ | 15:32 |
| patchbot | patch 410764 - ironic - Ability to use SwiftAPI for temporary url in glance | 15:32 |
| *** amarao has quit IRC | 15:32 | |
| *** amarao1 has joined #openstack-ironic | 15:32 | |
| dtantsur | yeah, but it does not detect the account.. still pity she hasn't finished it | 15:33 |
| *** amarao1 has quit IRC | 15:33 | |
| TheJulia | rloo: I _feel_ like adding another field is fine, anyone calling validate has to explicitly look for what they want in the results anyway, so they need to be aware. They can't just iter through polling boolean True or string as the values on keys. The entire call does not fail if a single interface is unhappy, because some of those replies are state dependent in the state machine. | 15:34 |
| rloo | TheJulia: i think if we had removed them before, that'd be the right thing to do, cuz the response/info for eg 'node show' doesn't include those interfaces | 15:35 |
| rloo | TheJulia: but at this point, if we cannot remove them cuz they are there already, it seems more consistent to show all the interfaces, even new ones. | 15:35 |
| dtantsur | oh, neat: https://github.com/openstack/puppet-ironic/commit/5736ebba4cb2c7782ce1a1cd9112f754080bf8a6#diff-7a34fb02aabf787d80fc8212599e0387 | 15:36 |
| rloo | TheJulia: that's how I can rationalize it given the situation :) | 15:36 |
| pas-ha | dtantsur: that's vsaienk0 's patch ^) | 15:37 |
| dtantsur | yep, just found it :) | 15:37 |
| pas-ha | from the times when we intergrated ironic to Fuel | 15:37 |
| *** mkrai has joined #openstack-ironic | 15:37 | |
| TheJulia | rloo: absolutely agree | 15:37 |
| rloo | TheJulia: I'm going to comment in the bug (which was my fault, I noticed this when I reviewed the rescue code that was removing the rescue interface from node-validate...) | 15:38 |
| rloo | thx TheJulia and dtantsur, for your opinions :) | 15:38 |
| TheJulia | rloo: there are no faults with such things :) | 15:41 |
| rloo | TheJulia: heh | 15:42 |
| * TheJulia might have had a delicious mocha and may be in a very happy place at the moment | 15:42 | |
| rloo | TheJulia: i was just about to go drown my sorrows, thx for that :D | 15:42 |
| *** yangyapeng has quit IRC | 15:42 | |
| *** yangyapeng has joined #openstack-ironic | 15:43 | |
| milan | rloo nothing seems to work in there; i.e. http://logs.openstack.org/03/517403/2/check/ironic-inspector-grenade-dsvm/e9b7c83/logs/old/screen-ir-cond.txt.gz?#_2017-12-06_20_57_52_255 has errors on all the nodes; all the bm console logs read no boot device (although the virtualbmc log seems sound) | 15:47 |
| rloo | milan: ugh. | 15:47 |
| * milan unsure what's broken yet | 15:47 | |
| rloo | milan: is it inspector related, or do you think ironic? let me see when we last did an ironic patch on stable/pike... | 15:48 |
| *** yangyapeng has quit IRC | 15:48 | |
| milan | rloo, I wouldn't say it's inspector-related actually | 15:48 |
| rloo | milan: this one failed yesterday: https://review.openstack.org/#/c/520010/ | 15:49 |
| patchbot | patch 520010 - ironic (stable/pike) - Add no-vendor interface to the idrac hardware types | 15:49 |
| rloo | milan: wonder if it is the same issue | 15:49 |
| * milan checks | 15:49 | |
| rloo | milan: and now, wondering if it is the same issue as with our stable/ocata failures :-( | 15:49 |
| milan | rloo http://logs.openstack.org/10/520010/1/check/ironic-grenade-dsvm/7f8e0f4/logs/old/ironic-bm-logs/node-1_no_ansi_2017-12-06-11:19:16.txt.gz | 15:50 |
| rloo | milan: yuck | 15:50 |
| milan | seems the same http://logs.openstack.org/10/520010/1/check/ironic-grenade-dsvm/7f8e0f4/logs/old/screen-ir-cond.txt.gz?level=INFO | 15:50 |
| milan | timeouts | 15:50 |
| milan | /o\ | 15:51 |
| rloo | milan: i think the same as ocata. vdrok mentioned something yesterday. looking... | 15:51 |
| rloo | milan: this is what vdrok mentioned yesterday: http://logs.openstack.org/13/525713/1/check/ironic-tempest-dsvm-ipa-partition-uefi-pxe_ipmitool-tinyipa/b98dcf8/logs/ironic-bm-logs/node-0_no_ansi_2017-12-05-18:18:38.txt.gz | 15:52 |
| *** rama_y has joined #openstack-ironic | 15:53 | |
| * milan thinking out loud; if virtualbmc sets the correct boot device (network) yet we see no boot device in the virt bms | 15:53 | |
| milan | is possible neutron not working? | 15:53 |
| rloo | sambetts: ^^ if you have a few min | 15:54 |
| rloo | sambetts: or a lot of min :-( | 15:54 |
| TheJulia | milan: well, define no boot device in virt bms | 15:56 |
| *** dpawar has joined #openstack-ironic | 15:56 | |
| rloo | i could have swore that stable/pike jobs were passing when I saw stable/ocata jobs failing but maybe I was wrong... | 15:56 |
| sambetts | we manually set up the network interfaces for the VMs simulating BMs, they aren't under neutron's control | 15:57 |
| TheJulia | milan: yeah, that log looks like the net interface is there, so plumbing under the hood :( | 15:57 |
| milan | hmmm | 15:58 |
| TheJulia | any interface counters anywhere? :) | 15:58 |
| rloo | we/ironic didn't change anything in devstack recently, did we? | 15:58 |
| *** links has quit IRC | 15:59 | |
| sambetts | not that I'm aware of | 15:59 |
| TheJulia | worlddump has them | 15:59 |
| TheJulia | or at least, has some network info | 15:59 |
| * milan checks worlddump | 16:00 | |
| *** charcol has quit IRC | 16:01 | |
| * milan no expert but http://logs.openstack.org/10/520010/1/check/ironic-grenade-dsvm/7f8e0f4/logs/worlddump-2017-12-06-114831.txt.gz lgtm | 16:01 | |
| TheJulia | anyone want to talk about BFV? | 16:02 |
| TheJulia | of course, no bot it seems | 16:02 |
| dtantsur | TheJulia: I can stop by, but I don't reallly have anythign to discuss | 16:02 |
| TheJulia | looks like meeting issues again :( | 16:04 |
| TheJulia | dtantsur: I updated the etherpad and managed to check the data model \o/ | 16:04 |
| TheJulia | (of course, data model is easy, need to think through our use of the data and cinder's behavior.... | 16:05 |
| TheJulia | ) | 16:05 |
| dtantsur | fwiw if we move the main meeting here, it makes some sense to move the bFV meeting too.. | 16:05 |
| TheJulia | agreed | 16:06 |
| openstackgerrit | Ruby Loo proposed openstack/ironic stable/pike: DNM Testing CI for stable/pike https://review.openstack.org/526442 | 16:06 |
| TheJulia | mjturek: o/ | 16:06 |
| rloo | not sure i agree about moving the bfv meeting here | 16:07 |
| mjturek | hey TheJulia! | 16:07 |
| rloo | the main meeting is for all ironic | 16:07 |
| rloo | the bfv is for those interested in bfv? | 16:07 |
| TheJulia | mjturek: want to chat about bfv today? | 16:07 |
| dtantsur | c'mon, that's one of our recent cool features, EVERYONE is interested :D | 16:07 |
| sambetts | moving it here might make people more aware about whats going on though | 16:07 |
| TheJulia | mjturek: oh, I see you joined | 16:07 |
| rloo | i'm not opposed to the bfv meeting being here, i just think it might be difficult to separate the meeting vs other stuff going on/chatter | 16:07 |
| mjturek | yep I'm in :) | 16:08 |
| rloo | dtantsur: yup, everyone is interested! | 16:08 |
| rloo | dtantsur: in fact, we have meetings here 24/7! | 16:08 |
| TheJulia | rloo: so true.... | 16:12 |
| TheJulia | and they are all logged | 16:12 |
| rloo | TheJulia: ;) enjoy your meeting! | 16:12 |
| rloo | milan: i was just comparing against a 'good' one. the bad one doesn't have any IP | 16:13 |
| milan | ouch | 16:14 |
| *** dpawar has quit IRC | 16:15 | |
| rloo | milan: to be clear, net0 here doesn't show any IP: http://logs.openstack.org/10/520010/1/check/ironic-grenade-dsvm/7f8e0f4/logs/old/ironic-bm-logs/node-1_no_ansi_2017-12-06-11:19:16.txt.gz | 16:16 |
| rloo | milan: whereas this one does (and test passes): http://logs.openstack.org/61/364861/20/check/ironic-grenade-dsvm/32a4feb/logs/old/ironic-bm-logs/node-1_no_ansi_2017-12-07-13:08:47.txt.gz | 16:16 |
| * rloo needs a tutorial on our CI and how they differ between branches... | 16:17 | |
| milan | rloo, means there was no PXE answer I guess | 16:17 |
| milan | * DHCP | 16:17 |
| milan | strange | 16:17 |
| * milan checks devstack git log | 16:17 | |
| rloo | milan: yeah, i'm thinking dhcp but i am not familiar enough to know where to look... | 16:18 |
| * milan neither | 16:19 | |
| milan | no suspicious activity in grenade git log | 16:19 |
| *** rbudden has quit IRC | 16:19 | |
| rloo | vsaienk0, vdrok: ^^ if you have some time/thoughts on what the problem might be | 16:19 |
| milan | nothing suspicious in devstack either | 16:21 |
| *** AlexeyAbashkin has joined #openstack-ironic | 16:24 | |
| milan | sieving thru devstack.log with MAC of node-1 nothing suspicious 52:54:00:09:71:d7 | 16:25 |
| milan | e.g port seems created in ironic | 16:26 |
| milan | port has a reasonable ip http://logs.openstack.org/10/520010/1/check/ironic-grenade-dsvm/7f8e0f4/logs/old/screen-q-dhcp.txt.gz#_2017-12-06_10_42_26_214 | 16:29 |
| *** marios has quit IRC | 16:29 | |
| rloo | milan: so it is odd. i checked the jobs in stable/ocata, the few i looked have a similar issue to the inspector one in stable/pike | 16:30 |
| rloo | milan: but in the ironic stable/pike, not all the dsvm jobs failed. | 16:30 |
| rloo | milan: hmm, and in the inspector one, only the grenade job failed, not all dsvm. | 16:31 |
| *** AlexeyAbashkin has quit IRC | 16:31 | |
| rloo | grenade uses dsvm, but not all dsvm jobs fail. and it doesn't seem random. | 16:32 |
| rloo | or stable/pike's grenade jobs fail, cuz the 'old' is using ocata code and that is why in stable/pike, only grenade jobs fail, whereas in stable/ocata, all dsvm jobs fail! | 16:34 |
| *** rama_y has quit IRC | 16:34 | |
| rloo | milan: ^^ something with stable/ocata setup... | 16:34 |
| milan | #pixiesay -msad rloo makes sense | 16:34 |
| PixieBoots | ʕ•͡ᴥ•ʔ: rloo makes sense | 16:34 |
| rloo | thx PixieBoots! | 16:35 |
| *** akhilaki_ has joined #openstack-ironic | 16:35 | |
| *** akhilaki has joined #openstack-ironic | 16:35 | |
| *** akhilaki__ has joined #openstack-ironic | 16:35 | |
| NobodyCam | Good Morning Ironic'ers | 16:38 |
| mjturek | gm NobodyCam :) | 16:38 |
| NobodyCam | morning mjturek :) | 16:38 |
| TheJulia | milan: looking at http://logs.openstack.org/10/520010/1/check/ironic-grenade-dsvm/7f8e0f4/logs/worlddump-2017-12-06-114827.txt.gz it looks like OVS is considering the interface to the tap where dhcp runs is not up... | 16:39 |
| TheJulia | good morning NobodyCam | 16:39 |
| *** ccamacho has quit IRC | 16:39 | |
| NobodyCam | hey hey TheJulia :) good morning :) | 16:39 |
| *** mkrai has quit IRC | 16:39 | |
| dtantsur | morning NobodyCam | 16:40 |
| milan | morning NobodyCam! :) | 16:40 |
| NobodyCam | hey hey dtantsur :) | 16:40 |
| NobodyCam | hey hey milan :) | 16:40 |
| milan | TheJulia, interesting | 16:40 |
| NobodyCam | it's almost friday | 16:40 |
| TheJulia | milan: of course, NONE of the interfaces to taps are showing up in that.... | 16:40 |
| milan | OK | 16:41 |
| milan | so now the question: why? :D | 16:41 |
| *** yangyapeng has joined #openstack-ironic | 16:43 | |
| TheJulia | milan: otoh, it looks like the bridge to the vm is not active, but I believe that might just because it is down | 16:43 |
| * TheJulia is not sure exactly how ovs knows/asserts that | 16:44 | |
| * milan .knowledge(ovs magic) -> 0 | 16:44 | |
| milan | has to be some config | 16:44 |
| *** rloo_ has joined #openstack-ironic | 16:45 | |
| *** akhilaki__ has quit IRC | 16:46 | |
| *** anupn has quit IRC | 16:46 | |
| *** akhilaki__ has joined #openstack-ironic | 16:47 | |
| *** akhilaki has quit IRC | 16:47 | |
| *** akhilaki_ has quit IRC | 16:48 | |
| *** yangyapeng has quit IRC | 16:48 | |
| *** akhilaki_ has joined #openstack-ironic | 16:48 | |
| *** akhilaki has joined #openstack-ironic | 16:48 | |
| *** rloo has quit IRC | 16:48 | |
| *** anupn has joined #openstack-ironic | 16:51 | |
| TheJulia | milan: does the time of this line up with anything else you've seen? http://logs.openstack.org/10/520010/1/check/ironic-grenade-dsvm/7f8e0f4/logs/old/screen-q-dhcp.txt.gz?#_2017-12-06_11_04_35_167 | 16:52 |
| *** fragatina has joined #openstack-ironic | 16:54 | |
| milan | TheJulia, http://logs.openstack.org/10/520010/1/check/ironic-grenade-dsvm/7f8e0f4/logs/old/screen-ir-cond.txt.gz#_2017-12-06_11_04_31_091 nothings suspicious here at that ime | 16:55 |
| milan | * imo | 16:55 |
| milan | TheJulia, what's your theory? | 16:55 |
| *** yangyapeng has joined #openstack-ironic | 16:56 | |
| *** fragatina has quit IRC | 16:56 | |
| *** fragatina has joined #openstack-ironic | 16:57 | |
| TheJulia | milan: I don't have a theory yet, still trying to figure out the picture | 16:57 |
| milan | There's an error http://logs.openstack.org/10/520010/1/check/ironic-grenade-dsvm/7f8e0f4/logs/old/screen-q-dhcp.txt.gz?#_2017-12-06_11_04_35_185 | 16:57 |
| jroll | morning ironic | 16:58 |
| dtantsur | hey jroll | 16:59 |
| milan | morning jroll! :) | 16:59 |
| * milan wonders: no match between port and subnet? | 16:59 | |
| *** yangyapeng has quit IRC | 17:00 | |
| TheJulia | milan: except I _think_ is when everything was still getting setup, the deploy was not attempted to be started until sometime during 11:07 | 17:04 |
| TheJulia | at least going by the conductor log | 17:04 |
| *** dgautam has joined #openstack-ironic | 17:05 | |
| milan | so the port should not have been plumbed yet at the time of the error I'm seeing i.e it's unrelated | 17:06 |
| * milan scrolling q-dhcp to 11:07 | 17:07 | |
| TheJulia | well | 17:07 |
| TheJulia | two different ports, that was the dhcp port that was in q-dhcp | 17:07 |
| TheJulia | but the same req-id didn't error a little later | 17:07 |
| *** harlowja has joined #openstack-ironic | 17:08 | |
| TheJulia | although..... | 17:09 |
| TheJulia | that port seems to never be touched again | 17:09 |
| *** karthiks has quit IRC | 17:11 | |
| TheJulia | milan: http://logs.openstack.org/10/520010/1/check/ironic-grenade-dsvm/7f8e0f4/logs/old/screen-q-svc.txt.gz#_2017-12-06_11_04_35_108 | 17:13 |
| TheJulia | A jedi walked by and said "These are not the ports your looking for..." | 17:13 |
| milan | yeah | 17:15 |
| milan | seems its some other tempest test case | 17:15 |
| *** dtantsur is now known as dtantsur|afk | 17:15 | |
| dtantsur|afk | o/ | 17:15 |
| milan | for instance http://logs.openstack.org/10/520010/1/check/ironic-grenade-dsvm/7f8e0f4/logs/old/screen-q-dhcp.txt.gz?#_2017-12-06_11_07_49_885 is where some ipxe is set | 17:16 |
| milan | so should have received 10.1.0.8, node-1 | 17:16 |
| milan | not in here http://logs.openstack.org/10/520010/1/check/ironic-grenade-dsvm/7f8e0f4/logs/old/ironic-bm-logs/node-1_no_ansi_2017-12-06-11:19:16.txt.gz | 17:17 |
| milan | too bad there's no timestamp in the console | 17:17 |
| * milan insufficient brains | 17:19 | |
| * milan -> relocate bbl maybe O:-) | 17:19 | |
| TheJulia | I should go grab some lunch | 17:21 |
| *** rama_y has joined #openstack-ironic | 17:21 | |
| milan | TheJulia, ++ I'm quite hungry too | 17:21 |
| TheJulia | milan: i kind of want logs from dnsmasq at this point | 17:21 |
| TheJulia | or raw packet counters, but we don't seem to get or preserve either. | 17:22 |
| milan | :-/ | 17:22 |
| milan | on the other patch, not even inspector's dhcp received any requests | 17:22 |
| milan | but may be unrelated | 17:22 |
| milan | or firewall :D | 17:22 |
| * milan gone for real | 17:23 | |
| milan | o/ | 17:23 |
| *** milan has quit IRC | 17:23 | |
| *** jaganathan has joined #openstack-ironic | 17:23 | |
| *** e0ne has quit IRC | 17:29 | |
| TheJulia | that is a good point... | 17:32 |
| TheJulia | oh, he left | 17:32 |
| TheJulia | :( | 17:32 |
| TheJulia | For anyone following along, nothing in the syslog output as to packets being dropped, iptables rules look correct | 17:33 |
| *** ccamacho has joined #openstack-ironic | 17:36 | |
| *** ccamacho has quit IRC | 17:39 | |
| *** athomas has joined #openstack-ironic | 17:46 | |
| openstackgerrit | Fellype Cavalcante proposed openstack/ironic master: Migrate oneview hardware type to use python-hpOneView https://review.openstack.org/524310 | 17:46 |
| *** penick has joined #openstack-ironic | 17:50 | |
| *** lucasagomes is now known as lucas-afk | 17:52 | |
| *** derekh has quit IRC | 17:54 | |
| *** penick has quit IRC | 17:54 | |
| * TheJulia noms | 17:55 | |
| *** mkrai has joined #openstack-ironic | 17:56 | |
| *** penick has joined #openstack-ironic | 17:57 | |
| *** akhilaki_ has quit IRC | 17:58 | |
| *** akhilaki has quit IRC | 17:58 | |
| *** akhilaki__ has quit IRC | 17:58 | |
| *** SerenaFeng has joined #openstack-ironic | 17:58 | |
| *** fellypefca has quit IRC | 17:59 | |
| *** penick has quit IRC | 17:59 | |
| *** penick has joined #openstack-ironic | 18:02 | |
| *** mgoddard has quit IRC | 18:03 | |
| *** mkrai has quit IRC | 18:05 | |
| *** yangyapeng has joined #openstack-ironic | 18:05 | |
| *** penick has quit IRC | 18:05 | |
| * sambetts --> home | 18:09 | |
| sambetts | Night all | 18:09 |
| *** sambetts is now known as sambetts|afk | 18:09 | |
| *** yangyapeng has quit IRC | 18:09 | |
| *** tesseract has quit IRC | 18:13 | |
| *** trown is now known as trown|lunch | 18:18 | |
| *** racedo has quit IRC | 18:19 | |
| *** racedo has joined #openstack-ironic | 18:19 | |
| *** racedo has quit IRC | 18:20 | |
| *** racedo has joined #openstack-ironic | 18:20 | |
| *** racedo has quit IRC | 18:20 | |
| *** racedo has joined #openstack-ironic | 18:21 | |
| *** racedo has quit IRC | 18:21 | |
| *** racedo has joined #openstack-ironic | 18:22 | |
| *** jaganathan has quit IRC | 18:22 | |
| *** racedo has quit IRC | 18:22 | |
| *** racedo has joined #openstack-ironic | 18:22 | |
| *** e0ne has joined #openstack-ironic | 18:23 | |
| *** racedo has quit IRC | 18:23 | |
| *** racedo has joined #openstack-ironic | 18:23 | |
| *** racedo has quit IRC | 18:24 | |
| *** athomas has quit IRC | 18:25 | |
| *** dprince has quit IRC | 18:36 | |
| *** penick has joined #openstack-ironic | 18:36 | |
| *** penick has quit IRC | 18:37 | |
| *** fragatina has quit IRC | 18:38 | |
| *** mkrai has joined #openstack-ironic | 18:39 | |
| *** affie__ has joined #openstack-ironic | 18:42 | |
| *** mgoddard has joined #openstack-ironic | 18:44 | |
| *** affie_ has quit IRC | 18:44 | |
| *** affie__ has quit IRC | 18:47 | |
| openstackgerrit | Ruby Loo proposed openstack/ironic stable/ocata: Testing https://review.openstack.org/526478 | 18:51 |
| *** jkilpatr has quit IRC | 18:52 | |
| *** phuongnh has joined #openstack-ironic | 19:00 | |
| *** dprince has joined #openstack-ironic | 19:02 | |
| *** chandankumar has quit IRC | 19:04 | |
| *** phuongnh has quit IRC | 19:04 | |
| *** fragatina has joined #openstack-ironic | 19:06 | |
| *** baoli has joined #openstack-ironic | 19:07 | |
| *** rbudden has joined #openstack-ironic | 19:09 | |
| *** adisky_ has quit IRC | 19:10 | |
| *** snasir has joined #openstack-ironic | 19:11 | |
| *** trown|lunch is now known as trown | 19:11 | |
| *** penick has joined #openstack-ironic | 19:11 | |
| *** jkilpatr has joined #openstack-ironic | 19:13 | |
| *** Goneri has quit IRC | 19:14 | |
| *** jkilpatr has quit IRC | 19:18 | |
| *** jkilpatr has joined #openstack-ironic | 19:19 | |
| *** harlowja has quit IRC | 19:21 | |
| *** akhilaki_ has joined #openstack-ironic | 19:32 | |
| *** akhilaki has joined #openstack-ironic | 19:32 | |
| *** akhilaki__ has joined #openstack-ironic | 19:32 | |
| *** nicodemos has quit IRC | 19:32 | |
| *** mkrai has quit IRC | 19:33 | |
| rloo_ | TheJulia, jlvillal, sambetts|afk: this backport worked in ocata: https://review.openstack.org/#/c/526478/ | 19:33 |
| patchbot | patch 526478 - ironic (stable/ocata) - Testing | 19:33 |
| rloo_ | the cool thing -- I changed it to only run one of the dsvm jobs :) | 19:34 |
| jlvillal | rloo_: Nice! | 19:34 |
| rloo_ | now to do the right cherry-pick patch... | 19:34 |
| jlvillal | rloo_: That's the solution, disable all of the dsvm jobs :) | 19:34 |
| jlvillal | heh | 19:34 |
| rloo_ | jlvillal: hopefully someone knows why it broke/why this fixed it | 19:34 |
| rloo_ | jlvillal: yeah, we have control. seriously, i've been thinking about making the multinode jobs non-voting :-( | 19:34 |
| jlvillal | rloo_: I can understand... It is nice that we do have easy control on it. | 19:35 |
| *** rbudden has quit IRC | 19:35 | |
| *** pc_m has quit IRC | 19:36 | |
| TheJulia | rloo_: sweet! | 19:36 |
| *** rbudden has joined #openstack-ironic | 19:36 | |
| *** e0ne has quit IRC | 19:36 | |
| *** mgoddard has quit IRC | 19:38 | |
| *** pc_m has joined #openstack-ironic | 19:38 | |
| *** mrtenio has quit IRC | 19:38 | |
| *** e0ne has joined #openstack-ironic | 19:40 | |
| rloo_ | #@#$@ could one of you try to cherry-pick this to ocata? it isn't working for me: https://review.openstack.org/#/c/453541/ | 19:41 |
| patchbot | patch 453541 - ironic - [Devstack] Rework VMs connection logic (MERGED) | 19:41 |
| rloo_ | jlvillal, TheJulia ^^ ? I mean, i just did a test patch with it and now I dunno... | 19:41 |
| * rloo_ ate too much starch for lunch, not thinking that clearly... | 19:42 | |
| *** rloo_ is now known as rloo | 19:42 | |
| rloo | jlvillal, TheJulia; forget it. I figured it out. there was already a patch: https://review.openstack.org/#/c/458007/ | 19:52 |
| patchbot | patch 458007 - ironic (stable/ocata) - [Devstack] Rework VMs connection logic | 19:52 |
| rloo | sometimes it is smarter than I realize... it had been abandoned; I restored it. | 19:52 |
| jlvillal | rloo: Thanks | 19:52 |
| rloo | vsaienk0: ^^ do you remember why you abandoned it? | 19:53 |
| rloo | jlvillal: if it takes too long and I leave, can I trust you to keep an eye on it? | 19:54 |
| rloo | jlvillal: oh, but you can't +2. | 19:54 |
| rloo | jlvillal: i'll keep an eye on it then, and bug the other ones with power... | 19:54 |
| jlvillal | rloo: You can +2 and then TheJulia could keep an eye on it? | 19:54 |
| jlvillal | I can keep an eye on it and see if it passes and such | 19:54 |
| * TheJulia pull sit up | 19:54 | |
| TheJulia | pulls | 19:54 |
| rloo | jlvillal: yeah, i can +2 if it finishes in time, but I'll check later tonight/tomorrow if i have to. | 19:55 |
| jlvillal | rloo: Thanks. Sounds good. | 19:55 |
| *** mikal_ has joined #openstack-ironic | 19:55 | |
| rloo | TheJulia: we're hoping this ocata patch will fix the world: https://review.openstack.org/#/c/458007/ | 19:55 |
| patchbot | patch 458007 - ironic (stable/ocata) - [Devstack] Rework VMs connection logic | 19:55 |
| *** e0ne has quit IRC | 19:55 | |
| *** crushil has joined #openstack-ironic | 19:55 | |
| *** crushil_ has joined #openstack-ironic | 19:55 | |
| TheJulia | realistically, if tests pass, it should be good to go as-is if it is the same basic thing rloo backported for the test to run | 19:55 |
| TheJulia | of course, we _should_ wait for 3rd party CI results before approving to land | 19:56 |
| jlvillal | TheJulia: I would back you if you solo approved it if the tests pass, based on the IRC conversation here. | 19:56 |
| rloo | TheJulia: right, we need two +2s though. | 19:56 |
| TheJulia | indeed | 19:56 |
| rloo | TheJulia: oh. i always forget about them :-( | 19:56 |
| * TheJulia sicks her brain back into the cinder interaction code for a little bit | 19:57 | |
| rloo | ha ha, freudian slip TheJulia. 'sicks'... | 19:57 |
| *** mikal has quit IRC | 19:57 | |
| *** mikal has joined #openstack-ironic | 20:00 | |
| *** mikal_ has quit IRC | 20:01 | |
| *** jkilpatr has quit IRC | 20:08 | |
| openstackgerrit | Merged openstack/ironic master: Apply pep8 check to app.wsgi https://review.openstack.org/523337 | 20:17 |
| *** SerenaFeng has quit IRC | 20:19 | |
| *** jkilpatr has joined #openstack-ironic | 20:24 | |
| openstackgerrit | Merged openstack/python-ironicclient master: Use assertRegex instead of assertRegexpMatches https://review.openstack.org/523695 | 20:28 |
| *** baoli has quit IRC | 20:32 | |
| *** jkilpatr has quit IRC | 20:32 | |
| *** dmellado has quit IRC | 20:37 | |
| TheJulia | I _think_ I accounted for multiattach sufficiently | 20:38 |
| TheJulia | it is a mental rabbit hole, that is for sure | 20:38 |
| *** Goneri has joined #openstack-ironic | 20:43 | |
| *** dmellado has joined #openstack-ironic | 20:50 | |
| *** akhilaki has quit IRC | 20:52 | |
| *** akhilaki__ has quit IRC | 20:52 | |
| *** akhilaki_ has quit IRC | 20:52 | |
| *** jkilpatr has joined #openstack-ironic | 21:07 | |
| *** chandankumar has joined #openstack-ironic | 21:12 | |
| *** ppiela has joined #openstack-ironic | 21:17 | |
| *** linkmark has quit IRC | 21:18 | |
| *** akhilaki_ has joined #openstack-ironic | 21:25 | |
| *** akhilaki has joined #openstack-ironic | 21:25 | |
| *** akhilaki__ has joined #openstack-ironic | 21:25 | |
| *** sambetts|afk has quit IRC | 21:29 | |
| *** penick has quit IRC | 21:31 | |
| *** sambetts_ has joined #openstack-ironic | 21:32 | |
| *** akhilaki has quit IRC | 21:35 | |
| *** akhilaki__ has quit IRC | 21:35 | |
| *** akhilaki_ has quit IRC | 21:35 | |
| *** akhilaki_ has joined #openstack-ironic | 21:36 | |
| *** akhilaki has joined #openstack-ironic | 21:36 | |
| *** akhilaki__ has joined #openstack-ironic | 21:36 | |
| *** akhilaki__ has quit IRC | 21:43 | |
| *** akhilaki_ has quit IRC | 21:43 | |
| *** akhilaki has quit IRC | 21:43 | |
| *** sambetts_ has quit IRC | 21:43 | |
| *** chandankumar has quit IRC | 21:43 | |
| *** dgautam has quit IRC | 21:43 | |
| *** rloo has quit IRC | 21:43 | |
| *** sasha2 has quit IRC | 21:43 | |
| *** BadCub has quit IRC | 21:43 | |
| *** dsneddon has quit IRC | 21:43 | |
| *** kiseok7 has quit IRC | 21:43 | |
| *** alineb has quit IRC | 21:43 | |
| *** ltomasbo has quit IRC | 21:43 | |
| *** mariojv has quit IRC | 21:43 | |
| *** crushil_ has quit IRC | 21:43 | |
| *** crushil has quit IRC | 21:43 | |
| *** akhilaki__ has joined #openstack-ironic | 21:48 | |
| *** akhilaki has joined #openstack-ironic | 21:48 | |
| *** akhilaki_ has joined #openstack-ironic | 21:48 | |
| *** sambetts_ has joined #openstack-ironic | 21:48 | |
| *** chandankumar has joined #openstack-ironic | 21:48 | |
| *** dgautam has joined #openstack-ironic | 21:48 | |
| *** rloo has joined #openstack-ironic | 21:48 | |
| *** sasha2 has joined #openstack-ironic | 21:48 | |
| *** BadCub has joined #openstack-ironic | 21:48 | |
| *** dsneddon has joined #openstack-ironic | 21:48 | |
| *** ltomasbo has joined #openstack-ironic | 21:48 | |
| *** kiseok7 has joined #openstack-ironic | 21:48 | |
| *** alineb has joined #openstack-ironic | 21:48 | |
| *** mariojv has joined #openstack-ironic | 21:48 | |
| *** openstackgerrit has quit IRC | 21:48 | |
| *** openstackgerrit has joined #openstack-ironic | 21:53 | |
| openstackgerrit | Ruby Loo proposed openstack/ironic stable/ocata: [Devstack] Rework VMs connection logic https://review.openstack.org/458007 | 21:53 |
| *** jkilpatr has quit IRC | 21:53 | |
| rloo | jlvillal: most of the ocata tests passed, but 3 failed :-( I tried rebasing just-in-case (and cuz I don't know what else to do)... | 21:57 |
| *** baoli has joined #openstack-ironic | 21:57 | |
| *** yangyapeng has joined #openstack-ironic | 21:57 | |
| jlvillal | rloo: Okay. Thanks for the heads up. | 21:57 |
| *** penick has joined #openstack-ironic | 21:58 | |
| jlvillal | rloo: So only grenade failed. As far as voting jobs. Correct? | 21:58 |
| rloo | jlvillal: yup, the other two were nonvoting. i looked at one, and it was a nova timeout. and i forgot what i saw for the second :-( | 21:59 |
| rloo | jlvillal: as far as the grenade job though, that failed with a similar 'signature' to the failures we've been seeing. | 21:59 |
| rloo | jlvillal: but the dsvm jobs passed | 21:59 |
| *** SerenaFeng has joined #openstack-ironic | 22:00 | |
| rloo | jlvillal: oh, is that grenade job testing neutron -> ocata? | 22:00 |
| jlvillal | rloo: Ugh. I wonder if that means we have to backport it to newton... | 22:00 |
| jlvillal | rloo: Before we can backport it to ocata?? | 22:00 |
| rloo | jlvillal: can't we turn off the grenade job if newton is EOL? | 22:00 |
| jlvillal | rloo: Is there still a newton? | 22:00 |
| jlvillal | rloo: That is what I'm thinking... | 22:00 |
| jlvillal | rloo: I thought newton was going to be deleted. | 22:01 |
| rloo | jlvillal: it has been eol'd but there is/was a discussion about keeping some of these branches longer if people will maintain them. i don't know if it has been decided. | 22:02 |
| jlvillal | Maybe tonyb knows? | 22:02 |
| *** baoli has quit IRC | 22:02 | |
| rloo | jlvillal: we never 'delete' the code from git. i forgot what it is we do when eol'd :) | 22:02 |
| *** yangyapeng has quit IRC | 22:02 | |
| jlvillal | rloo: I think the branch tag is deleted. But I'm not sure. | 22:02 |
| jlvillal | rloo: So when I look at: https://github.com/openstack/ironic | 22:03 |
| jlvillal | rloo: On the branch pull down. It only goes back to newton. So 'mitaka' has been deleted | 22:03 |
| jlvillal | rloo: There is a 'mitaka-eol' tag available. | 22:03 |
| rloo | jlvillal: newton is still there. i must be wrong | 22:04 |
| jlvillal | rloo: But basically, yeah I think we could get rid of grenade for the ocata job. | 22:04 |
| *** threestrands has joined #openstack-ironic | 22:04 | |
| *** threestrands has quit IRC | 22:04 | |
| *** threestrands has joined #openstack-ironic | 22:04 | |
| *** baoli has joined #openstack-ironic | 22:04 | |
| jlvillal | rloo: Since newton is EOL | 22:04 |
| jlvillal | rloo: So other projects have already deleted the newton branch. Like Neutron and Glance. | 22:06 |
| *** penick has quit IRC | 22:06 | |
| jlvillal | rloo: They set a tag 'newton-eol' and then deleted the branch. | 22:06 |
| *** trown is now known as trown|outtypewww | 22:06 | |
| jlvillal | We probably should do the same. | 22:06 |
| *** mat128 has quit IRC | 22:06 | |
| jlvillal | dtantsur|afk: ^^^^^ About getting rid of newton branch and removing grenade job from ocata | 22:06 |
| rloo | jlvillal: so i looked at nova's ocata patches, and they don't run grenade jobs: https://review.openstack.org/#/c/525666/ | 22:09 |
| *** rcernin has joined #openstack-ironic | 22:09 | |
| *** rcernin has quit IRC | 22:09 | |
| *** rcernin has joined #openstack-ironic | 22:09 | |
| patchbot | patch 525666 - nova (stable/ocata) - Get original image_id from volume for volume-backe... | 22:09 |
| rloo | jlvillal: whereas they do run them on pike: https://review.openstack.org/#/c/523214/ | 22:09 |
| patchbot | patch 523214 - nova (stable/pike) - Fix doubling allocations on rebuild | 22:09 |
| jlvillal | rloo: Makes sense. We should do the same, IMHO | 22:09 |
| rloo | jlvillal: i find this interesting though, here's a patch for newton: https://review.openstack.org/#/c/526427/ | 22:09 |
| patchbot | patch 526427 - nova (stable/newton) - Fix 'force' parameter in os-quota-sets PUT schema | 22:09 |
| jlvillal | rloo: I also noticed they haven't done any zuul v3 stuff. At least that I could tell. | 22:09 |
| rloo | jlvillal: yeah, they haven't migrated their legacy stuff yet | 22:10 |
| rloo | jlvillal: they're doing "real" work! :D | 22:10 |
| jlvillal | rloo: heh | 22:10 |
| rloo | jlvillal: we have a chicken/egg, unless we combine deleting the grenade job with that backport patch. | 22:10 |
| jlvillal | rloo: I guess mriedmann is still supporting newton | 22:10 |
| rloo | jlvillal: i'll update the whiteboard with this and leave it for you/others to deal with | 22:11 |
| jlvillal | rloo: That would seem the best way to me. | 22:11 |
| jlvillal | rloo: If you want I could update the patch to do that. | 22:11 |
| jlvillal | rloo: That way you can review it later | 22:11 |
| *** snasir has quit IRC | 22:11 | |
| rloo | jlvillal: i think it might be best to check with dmitry first | 22:12 |
| jlvillal | rloo: Okay. I won't change the patch then. Thanks. | 22:12 |
| rloo | jlvillal: or... if you do what i did for my test thing, you can cherry-pick + make another change and 'squash' them. that'd be a separate patch then :) | 22:13 |
| jlvillal | I'm confused at the "squash" point... | 22:14 |
| *** penick has joined #openstack-ironic | 22:15 | |
| rloo | jlvillal: https://releases.openstack.org/ | 22:15 |
| rloo | jlvillal: newton is supposed to be eol'd but either that page wasn't updated or ... ? | 22:15 |
| rloo | jlvillal: when i did that test thing, i cherry-picked, and then when i updated the project.yaml file, it said it was a new commit when i tried to submit them. or maybe i did something wrong. | 22:16 |
| rloo | jlvillal: well, you can try it and see what happens :) | 22:16 |
| jlvillal | rloo: I will create a test patch on top of the backport. Just to test. | 22:17 |
| jlvillal | rloo: In the future can squash it on to it. If we go that way. | 22:17 |
| rloo | jlvillal: ok, if that works. i am not used to squashing... | 22:18 |
| jlvillal | rloo: git rebase --interactive HEAD^^ | 22:18 |
| jlvillal | Something like that | 22:18 |
| rloo | jlvillal: do we have CI for newton? we could also try backporting to that :) | 22:19 |
| *** dprince has quit IRC | 22:19 | |
| openstackgerrit | John L. Villalovos proposed openstack/ironic stable/ocata: zuul: Remove grenade job as Newton is EOL https://review.openstack.org/526523 | 22:19 |
| rloo | jlvillal: although maybe that won't work cuz we migrated the legacy stuff from zuul v3... | 22:20 |
| jlvillal | rloo: ^^^ Grenade removal | 22:20 |
| jlvillal | rloo: I don't think we migrated newton stuff. Not that I recall | 22:20 |
| rloo | jlvillal: we didn't but i thought we did something that would cause it not to work. well, let me try and see what happens, what's the worse that could happen... | 22:21 |
| jlvillal | rloo: Of course that patch can't land. We will have to squash it into the backport. | 22:21 |
| rloo | jlvillal: right | 22:21 |
| *** weshay is now known as weshay|ruck | 22:23 | |
| rloo | jlvillal: i think i did something wrong by rebasing: https://review.openstack.org/#/c/458007/ | 22:24 |
| patchbot | patch 458007 - ironic (stable/ocata) - [Devstack] Rework VMs connection logic | 22:24 |
| *** penick has quit IRC | 22:24 | |
| rloo | jlvillal: how'd it go from patch set 1 to patch set 4? | 22:24 |
| jlvillal | rloo: Uh. Your rebase??? | 22:26 |
| jlvillal | But not sure why it didn't go to 2 | 22:26 |
| jlvillal | Gerrit strangeness | 22:26 |
| *** penick has joined #openstack-ironic | 22:26 | |
| *** penick has quit IRC | 22:29 | |
| tonyb | rloo, jlvillal: newton is EOL but there are some "issues" preventing me from compleeting that task. Th elonger branbches *may* start with Ocata | 22:29 |
| *** bfournie has quit IRC | 22:30 | |
| *** ianychoi has quit IRC | 22:30 | |
| jlvillal | tonyb: Thanks | 22:32 |
| *** ianychoi has joined #openstack-ironic | 22:33 | |
| *** crushil_ has joined #openstack-ironic | 22:34 | |
| *** crushil has joined #openstack-ironic | 22:34 | |
| *** dgautam has quit IRC | 22:35 | |
| *** akhilaki__ has quit IRC | 22:36 | |
| *** akhilaki has quit IRC | 22:36 | |
| *** akhilaki_ has quit IRC | 22:36 | |
| *** rcernin has quit IRC | 22:36 | |
| *** sambetts_ has quit IRC | 22:36 | |
| *** chandankumar has quit IRC | 22:36 | |
| *** rloo has quit IRC | 22:36 | |
| *** sasha2 has quit IRC | 22:36 | |
| *** BadCub has quit IRC | 22:36 | |
| *** dsneddon has quit IRC | 22:36 | |
| *** kiseok7 has quit IRC | 22:36 | |
| *** alineb has quit IRC | 22:36 | |
| *** ltomasbo has quit IRC | 22:36 | |
| *** mariojv has quit IRC | 22:36 | |
| *** akhilaki has joined #openstack-ironic | 22:37 | |
| *** akhilaki_ has joined #openstack-ironic | 22:37 | |
| *** akhilaki__ has joined #openstack-ironic | 22:37 | |
| *** penick has joined #openstack-ironic | 22:39 | |
| *** leifmadsen has quit IRC | 22:39 | |
| *** penick has quit IRC | 22:39 | |
| *** crushil_ has quit IRC | 22:40 | |
| *** crushil has quit IRC | 22:40 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Add documentation covering storage multi-attach https://review.openstack.org/526531 | 22:40 |
| *** rcernin has joined #openstack-ironic | 22:42 | |
| *** sambetts_ has joined #openstack-ironic | 22:42 | |
| *** chandankumar has joined #openstack-ironic | 22:42 | |
| *** rloo has joined #openstack-ironic | 22:42 | |
| *** sasha2 has joined #openstack-ironic | 22:42 | |
| *** BadCub has joined #openstack-ironic | 22:42 | |
| *** dsneddon has joined #openstack-ironic | 22:42 | |
| *** ltomasbo has joined #openstack-ironic | 22:42 | |
| *** kiseok7 has joined #openstack-ironic | 22:42 | |
| *** alineb has joined #openstack-ironic | 22:42 | |
| *** mariojv has joined #openstack-ironic | 22:42 | |
| *** leifmadsen has joined #openstack-ironic | 22:42 | |
| *** leifmadsen has quit IRC | 22:42 | |
| *** leifmadsen has joined #openstack-ironic | 22:42 | |
| openstackgerrit | Julia Kreger proposed openstack/python-ironicclient master: Remove RBD examples https://review.openstack.org/526533 | 22:46 |
| *** jaypipes has quit IRC | 22:47 | |
| * TheJulia bangs her head against the wall. | 22:47 | |
| * TheJulia runs into town | 22:48 | |
| *** penick has joined #openstack-ironic | 22:54 | |
| *** pmannidi has joined #openstack-ironic | 22:58 | |
| *** xnox has quit IRC | 23:04 | |
| *** xnox has joined #openstack-ironic | 23:06 | |
| *** xnox has quit IRC | 23:06 | |
| *** xnox has joined #openstack-ironic | 23:06 | |
| *** harlowja has joined #openstack-ironic | 23:07 | |
| *** yangyapeng has joined #openstack-ironic | 23:07 | |
| *** akhilaki__ has quit IRC | 23:09 | |
| *** akhilaki_ has quit IRC | 23:09 | |
| *** akhilaki has quit IRC | 23:09 | |
| *** akhilaki has joined #openstack-ironic | 23:10 | |
| *** akhilaki_ has joined #openstack-ironic | 23:10 | |
| *** akhilaki__ has joined #openstack-ironic | 23:10 | |
| *** yangyapeng has quit IRC | 23:11 | |
| *** ElCoyote_ has joined #openstack-ironic | 23:19 | |
| *** dgautam has joined #openstack-ironic | 23:28 | |
| *** akhilaki_ has quit IRC | 23:35 | |
| *** akhilaki has quit IRC | 23:35 | |
| *** akhilaki__ has quit IRC | 23:35 | |
| *** akhilaki has joined #openstack-ironic | 23:35 | |
| *** akhilaki_ has joined #openstack-ironic | 23:35 | |
| *** akhilaki__ has joined #openstack-ironic | 23:35 | |
| *** penick has quit IRC | 23:40 | |
| *** jkilpatr has joined #openstack-ironic | 23:41 | |
| *** charcol has joined #openstack-ironic | 23:46 | |
| *** yangyapeng has joined #openstack-ironic | 23:47 | |
| *** mat128 has joined #openstack-ironic | 23:50 | |
| *** yangyapeng has quit IRC | 23:51 | |
| *** bfournie has joined #openstack-ironic | 23:52 | |
| jlvillal | TheJulia: Reverse those two statements and it makes more sense to me ;) | 23:55 |
| *** threestrands has quit IRC | 23:55 | |
| *** mat128 has quit IRC | 23:59 | |
| *** mat128 has joined #openstack-ironic | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!