| *** ociuhandu has joined #openstack-ironic | 00:30 | |
| *** ociuhandu has quit IRC | 00:35 | |
| *** betherly has joined #openstack-ironic | 00:35 | |
| *** betherly has quit IRC | 00:39 | |
| *** gregoryo has joined #openstack-ironic | 00:49 | |
| *** gyee has quit IRC | 00:49 | |
| *** _mmethot_ has joined #openstack-ironic | 01:02 | |
| *** ricolin has joined #openstack-ironic | 01:03 | |
| *** mmethot_ has quit IRC | 01:07 | |
| *** betherly has joined #openstack-ironic | 01:30 | |
| *** betherly has quit IRC | 01:35 | |
| openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: [TEST] Run inspector services in non-standalone mode https://review.opendev.org/675030 | 01:51 |
|---|---|---|
| *** jhesketh has quit IRC | 01:53 | |
| *** rh-jelabarre has quit IRC | 02:00 | |
| *** betherly has joined #openstack-ironic | 02:01 | |
| *** betherly has quit IRC | 02:05 | |
| *** henriqueof has joined #openstack-ironic | 02:17 | |
| *** henriqueof has quit IRC | 02:21 | |
| *** jhesketh has joined #openstack-ironic | 02:22 | |
| *** early has quit IRC | 02:37 | |
| *** early has joined #openstack-ironic | 02:39 | |
| *** betherly has joined #openstack-ironic | 02:40 | |
| openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: [TEST] Run inspector services in non-standalone mode https://review.opendev.org/675030 | 02:50 |
| *** betherly has quit IRC | 02:53 | |
| *** early has quit IRC | 02:56 | |
| *** early has joined #openstack-ironic | 02:57 | |
| *** betherly has joined #openstack-ironic | 03:08 | |
| *** whoami-rajat has joined #openstack-ironic | 03:12 | |
| *** igordc has joined #openstack-ironic | 03:16 | |
| *** betherly has quit IRC | 03:21 | |
| *** iurygregory has quit IRC | 03:22 | |
| *** qhpc has quit IRC | 03:22 | |
| *** jhesketh has quit IRC | 03:29 | |
| *** gkadam has joined #openstack-ironic | 03:31 | |
| *** jhesketh has joined #openstack-ironic | 03:36 | |
| *** betherly has joined #openstack-ironic | 03:39 | |
| *** gkadam has quit IRC | 03:40 | |
| *** betherly has quit IRC | 03:44 | |
| *** mkrai has joined #openstack-ironic | 04:19 | |
| *** betherly has joined #openstack-ironic | 04:38 | |
| *** betherly has quit IRC | 04:42 | |
| *** henriqueof has joined #openstack-ironic | 04:56 | |
| *** lennyb has quit IRC | 05:26 | |
| *** betherly has joined #openstack-ironic | 05:29 | |
| *** betherly has quit IRC | 05:37 | |
| openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: [TEST] Run inspector services in non-standalone mode https://review.opendev.org/675030 | 05:40 |
| *** verma-varsha has joined #openstack-ironic | 05:41 | |
| *** yaawang has quit IRC | 05:43 | |
| *** yaawang has joined #openstack-ironic | 05:44 | |
| *** igordc has quit IRC | 05:59 | |
| *** betherly has joined #openstack-ironic | 06:01 | |
| *** betherly has quit IRC | 06:06 | |
| *** mkrai has quit IRC | 06:13 | |
| *** mkrai has joined #openstack-ironic | 06:15 | |
| *** rcernin has quit IRC | 06:18 | |
| openstackgerrit | Merged openstack/ironic master: Clean up RAID documentation https://review.opendev.org/675145 | 06:21 |
| *** lennyb has joined #openstack-ironic | 06:26 | |
| *** betherly has joined #openstack-ironic | 07:00 | |
| *** ianychoi has quit IRC | 07:01 | |
| *** ianychoi has joined #openstack-ironic | 07:01 | |
| *** jtomasek has joined #openstack-ironic | 07:01 | |
| *** betherly has quit IRC | 07:05 | |
| *** devx has quit IRC | 07:07 | |
| *** devx has joined #openstack-ironic | 07:09 | |
| openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: [TEST] Run inspector services in non-standalone mode https://review.opendev.org/675030 | 07:12 |
| *** betherly has joined #openstack-ironic | 07:20 | |
| *** iurygregory has joined #openstack-ironic | 07:22 | |
| iurygregory | good morning Ironic | 07:22 |
| *** tssurya has joined #openstack-ironic | 07:23 | |
| *** ianychoi has quit IRC | 07:24 | |
| *** betherly has quit IRC | 07:25 | |
| *** ianychoi has joined #openstack-ironic | 07:25 | |
| xXraphXx | arne_wiebalck: sure, my pleasure. Softraid in the agent works well and is well designed overall. | 07:26 |
| *** tesseract has joined #openstack-ironic | 07:31 | |
| *** dtantsur|afk is now known as dtantsur | 07:43 | |
| dtantsur | morning | 07:44 |
| *** verma-varsha has quit IRC | 07:48 | |
| arne_wiebalck | xXraphXx: cool, thx! | 07:50 |
| dtantsur | xXraphXx: could you fix two small things in the release note, and I can approve the patch: https://review.opendev.org/#/c/674803/3/releasenotes/notes/softraid-msdos-gpt-alternative.yaml | 07:55 |
| patchbot | patch 674803 - ironic-python-agent - Software raid: mbr/gpt partition table alternative. - 3 patch sets | 07:55 |
| *** lucasagomes has joined #openstack-ironic | 07:56 | |
| *** ociuhandu has joined #openstack-ironic | 07:56 | |
| *** rpittau|afk is now known as rpittau | 08:04 | |
| rpittau | good morning ironic! o/ | 08:04 |
| tssurya | dtantsur: good morning, I have tried to address you comments in https://review.opendev.org/#/c/664842/ , could you take a look when you have time ? If the ironic side is ok I can try to get the nova side patch in | 08:09 |
| patchbot | patch 664842 - ironic - Support power state change callbacks to nova using... - 11 patch sets | 08:09 |
| dtantsur | tssurya: I'm literally reviewing it right now :) | 08:09 |
| tssurya | thanks a lot ! :) | 08:09 |
| *** dougsz has joined #openstack-ironic | 08:11 | |
| dtantsur | done | 08:13 |
| iurygregory | morning dtantsur rpittau o/ | 08:17 |
| rpittau | hey iurygregory :) | 08:17 |
| *** betherly has joined #openstack-ironic | 08:22 | |
| xXraphXx | dtantsur, hi, sorry for the lag. I saw you approved it, I could have updated the release note :) | 08:24 |
| dtantsur | xXraphXx: please propose a follow-up patch with an update | 08:24 |
| *** verma-varsha has joined #openstack-ironic | 08:24 | |
| openstackgerrit | raphael.glon proposed openstack/ironic-python-agent master: Release note update https://review.opendev.org/675271 | 08:30 |
| *** derekh has joined #openstack-ironic | 08:30 | |
| *** Lucas_Gray has joined #openstack-ironic | 08:34 | |
| *** alexmcleod has joined #openstack-ironic | 08:39 | |
| xXraphXx | dtantsur, I'm not so confident anymore about this pull request (the gpt/mbr alternative). my doubts are about the fact that this changes the default partition table type based on the boot mode. works well for me but i do not know the root efi app capabilities of all users. so it might be relevant to keep the msdos by default, unless explicitely specified otherwise. | 08:41 |
| *** verma-varsha has quit IRC | 08:41 | |
| xXraphXx | this way we are sure to control the impact | 08:41 |
| xXraphXx | (by root efi app, i mean the one supposed to find the grub efi app and chain on it) | 08:43 |
| arne_wiebalck | xXraphXx: dtantsur: I can test if that still works for us, but not before some time next week when I'm back in the office. | 08:43 |
| *** verma-varsha has joined #openstack-ironic | 08:44 | |
| openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: [TEST] Run inspector services in non-standalone mode https://review.opendev.org/675030 | 08:48 |
| xXraphXx | dtantsur, arne_wiebalck: I put the workflow to -1, I prefer we wait till next week then | 08:49 |
| dtantsur | xXraphXx: hmm, okay. let's plan on the safe side and keep msdos by default? we can always add the detection logic later. | 08:49 |
| dtantsur | i.e. let's split this patch into a safe and risky part | 08:49 |
| xXraphXx | sure sounds better | 08:49 |
| xXraphXx | doing | 08:50 |
| *** iurygregory has quit IRC | 08:58 | |
| *** Lucas_Gray has quit IRC | 09:00 | |
| *** gregoryo has quit IRC | 09:02 | |
| *** iurygregory has joined #openstack-ironic | 09:03 | |
| openstackgerrit | Merged openstack/ironic-prometheus-exporter master: Release note for timestamp metric https://review.opendev.org/674844 | 09:04 |
| *** e0ne has joined #openstack-ironic | 09:04 | |
| *** verma-varsha has quit IRC | 09:05 | |
| openstackgerrit | raphael.glon proposed openstack/ironic-python-agent master: Software raid: mbr/gpt partition table alternative. https://review.opendev.org/675275 | 09:10 |
| openstackgerrit | CHENGLEI proposed openstack/python-ironicclient master: add a hello.txt https://review.opendev.org/675278 | 09:16 |
| iurygregory | hello.txt? | 09:18 |
| iurygregory | o.o | 09:18 |
| iurygregory | oh new contributor =D | 09:19 |
| openstackgerrit | raphael.glon proposed openstack/ironic-python-agent master: Software raid: partition table type default change. https://review.opendev.org/674803 | 09:20 |
| xXraphXx | fixing i made a mistake on rebase | 09:26 |
| *** henriqueof has quit IRC | 09:28 | |
| *** Lucas_Gray has joined #openstack-ironic | 09:28 | |
| openstackgerrit | raphael.glon proposed openstack/ironic-python-agent master: Software raid: default partition table type change. https://review.opendev.org/674803 | 09:29 |
| openstackgerrit | Merged openstack/virtualbmc master: CI: clean up required projects https://review.opendev.org/673445 | 09:33 |
| *** etingof has joined #openstack-ironic | 09:35 | |
| *** Lucas_Gray has quit IRC | 09:35 | |
| *** verma-varsha has joined #openstack-ironic | 09:37 | |
| *** Lucas_Gray has joined #openstack-ironic | 09:39 | |
| verma-varsha | Hey etingof! Could you please find some time to review the Storage emulation patches that I submitted for sushy-tools? :) | 09:41 |
| *** diga has joined #openstack-ironic | 09:41 | |
| openstackgerrit | raphael.glon proposed openstack/ironic-python-agent master: Software raid: mbr/gpt partition table alternative https://review.opendev.org/675275 | 09:44 |
| openstackgerrit | Merged openstack/ironic-prometheus-exporter master: Release note for ipmi Voltage metrics https://review.opendev.org/674823 | 09:51 |
| *** dmellado has quit IRC | 09:53 | |
| *** dmellado has joined #openstack-ironic | 09:55 | |
| *** dsneddon has quit IRC | 09:55 | |
| openstackgerrit | Madhuri Kumari proposed openstack/ironic-specs master: Add support for manual deploy steps https://review.opendev.org/672252 | 09:58 |
| *** Lucas_Gray has quit IRC | 10:01 | |
| openstackgerrit | raphael.glon proposed openstack/ironic-python-agent master: Softraid: refactor partitioning https://review.opendev.org/674819 | 10:02 |
| mkrai | Hi mgoddard Can you please review the manual deployment spec whenever you've time https://review.opendev.org/672252 ? | 10:02 |
| patchbot | patch 672252 - ironic-specs - Add support for manual deploy steps - 4 patch sets | 10:02 |
| mgoddard | mkrai: hi, it is on my TODO list. I've been away for 3 weeks, so still catching up :) | 10:07 |
| mkrai | mgoddard, Thanks :) | 10:12 |
| mkrai | mgoddard, Hope you had a wonderful vacation :) | 10:13 |
| openstackgerrit | Pradip Kadam proposed openstack/ironic master: DRAC : Fix issue for RAID-0 creation for multiple disks for PERC H740P https://review.opendev.org/674765 | 10:13 |
| mgoddard | mkrai: thanks | 10:13 |
| *** verma-varsha has quit IRC | 10:16 | |
| *** ociuhandu has quit IRC | 10:26 | |
| *** Lucas_Gray has joined #openstack-ironic | 10:30 | |
| *** iurygregory has quit IRC | 10:43 | |
| *** ociuhandu has joined #openstack-ironic | 10:47 | |
| *** mkrai has quit IRC | 10:49 | |
| openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: [TEST] Run inspector services in non-standalone mode https://review.opendev.org/675030 | 10:53 |
| *** verma-varsha has joined #openstack-ironic | 11:06 | |
| *** yaawang has quit IRC | 11:08 | |
| *** yaawang has joined #openstack-ironic | 11:09 | |
| TheJulia | Okay, hello.txt is... interesting | 11:23 |
| * TheJulia senses the next few weeks are going to be review heavy | 11:23 | |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-inspector master: [WIP] use openstacksdk for ironic module https://review.opendev.org/672179 | 11:49 |
| *** tssurya has quit IRC | 11:50 | |
| *** tssurya has joined #openstack-ironic | 11:50 | |
| *** dsneddon has joined #openstack-ironic | 11:51 | |
| *** rh-jelabarre has joined #openstack-ironic | 11:53 | |
| *** verma-varsha has quit IRC | 11:55 | |
| *** verma-varsha has joined #openstack-ironic | 11:57 | |
| *** ricolin_ has joined #openstack-ironic | 12:05 | |
| *** cdearborn has joined #openstack-ironic | 12:05 | |
| *** ricolin has quit IRC | 12:07 | |
| *** verma-varsha has quit IRC | 12:09 | |
| *** bfournie has joined #openstack-ironic | 12:12 | |
| openstackgerrit | raphael.glon proposed openstack/ironic-python-agent master: List block devices: fixes related to md arrays and partitions https://review.opendev.org/675309 | 12:25 |
| *** iurygregory has joined #openstack-ironic | 12:36 | |
| *** jcoufal has joined #openstack-ironic | 12:54 | |
| *** Lucas_Gray has quit IRC | 12:57 | |
| *** mrtmr has joined #openstack-ironic | 12:58 | |
| *** Lucas_Gray has joined #openstack-ironic | 12:58 | |
| *** jcoufal has quit IRC | 13:02 | |
| *** Lucas_Gray has quit IRC | 13:03 | |
| *** jcoufal has joined #openstack-ironic | 13:06 | |
| openstackgerrit | Ilya Etingof proposed openstack/ironic master: Add Redfish Virtual Media Boot support https://review.opendev.org/638453 | 13:11 |
| openstackgerrit | Merged openstack/ironic-python-agent master: Software raid: mbr/gpt partition table alternative https://review.opendev.org/675275 | 13:13 |
| mrtmr | Hi everyone, in bifrost we can pass network_data.json file to cloud-init with configdrive, yes. Today I tried to pass a user_data file and I succeed it with biforst-configdrive-dynamic role, but there is a problem with cloud.cfg file I must to add resolv_conf module to in it otherwise my user_data is not working at boot time. in my user data there | 13:13 |
| mrtmr | is a basic expamle for configure /etc/resolv.conf file do you have any idea how to i re-write cloud.cfg file | 13:13 |
| *** Lucas_Gray has joined #openstack-ironic | 13:17 | |
| mnaser | is it possible to use "flat" network model but with 2 nics on a server? | 13:24 |
| mnaser | one for the provisioning/cleaning network, one for the actual network where the instances live on? | 13:25 |
| dtantsur | mnaser: if you're fine with the fact that all NICs will still be connected to the physical network - yes | 13:26 |
| mnaser | dtantsur: well in this ase, 1 nic is connected to provisioning/cleaning network, and the other is connected to 'public' network | 13:29 |
| mnaser | and i dont really want the instances to spin up on the provisioning/cleaning network | 13:30 |
| dtantsur | mnaser: you may have issues around which neutron port will land on which physical NIC. it's kinda random. | 13:30 |
| mnaser | well i was thinking for provisioning/cleaning, the machine will keep trying to pxe boot till it hits that port and boots up | 13:31 |
| mnaser | and then by the time its provisioned, the other port is gone, so dhcp stops responding for the cleaning network nic, and when the instance boots, dhcp will be there on the 'public' network | 13:31 |
| dtantsur | mnaser: how do you intend to create the instance? --port <port1> --port <port2> ? | 13:32 |
| dtantsur | I sense a problem in your approach, I cannot really put it in words | 13:33 |
| mnaser | dtantsur: nope, i dont want anything on port2, just 1 port connected to the public network | 13:33 |
| openstackgerrit | raphael.glon proposed openstack/ironic-python-agent master: image extension, make_bootable improvements https://review.opendev.org/674879 | 13:33 |
| mnaser | so nic2 used for provisioning/cleaning, nic1 used for 'public' flat network | 13:33 |
| dtantsur | mnaser: aha. well, ironic will prefer the NIC that has PXE capability. | 13:33 |
| mnaser | so naturally when doing 1 port, itll do the one that is doing the pxe boot | 13:33 |
| dtantsur | so if you provide one port, it will probably get connected to the provisioning NIC | 13:33 |
| mnaser | ah | 13:33 |
| * dtantsur thinks | 13:34 | |
| mnaser | it seems too simple to get neutron involved | 13:34 |
| mnaser | :< | 13:34 |
| dtantsur | mnaser: you may be fine if you use different neutron physical networks AND assign port.physical_network accordingly in ironic | 13:34 |
| mnaser | there is two neutron physical networks | 13:35 |
| dtantsur | but i don't think you can avoid having a VIF for the provisioning network (even without DHCP) | 13:35 |
| mnaser | does this mean moving to the 'neutron' driver isntead of 'flat? | 13:35 |
| dtantsur | using the physical_network field doesn't require ^^ | 13:35 |
| jroll | flat still uses neutron, fwiw | 13:36 |
| mnaser | yeah but i think neutron expects i run some sort of networking agent that does magic on switches | 13:36 |
| jroll | right right, ok | 13:37 |
| dtantsur | mnaser: not an agent, it expects an ML2 plugin that can do "baremetal" vnic_type binding by changing VLANs on switches | 13:37 |
| dtantsur | which depends on a switch model | 13:37 |
| * mnaser will one day use the right term 'agent' vs 'plugin' | 13:37 | |
| mnaser | but yeah | 13:37 |
| mnaser | i was hoping avoiding that for this little poc-y thing | 13:37 |
| jroll | I thought you were trying to avoid running neutron at all, I'll shut up now :) | 13:37 |
| mnaser | oh nono, neutron is still being used, right now i can provision instances all on the same flat network, but would like to split it | 13:38 |
| dtantsur | mnaser: if your switch is supported by networking-generic-switch, you can use it for POC | 13:38 |
| mnaser | yeah i was hoping to avoid that because it means a whole lot more work =P | 13:38 |
| dtantsur | heh | 13:38 |
| mnaser | just because we have to ansible-ify all of the bits to make it work | 13:38 |
| dtantsur | right | 13:38 |
| dtantsur | mnaser: then I'd suggest you to try two ports approach | 13:39 |
| mnaser | so two ports on each machine in ironic, map 'physical_network' to the appropriate one from neutron on each | 13:39 |
| dtantsur | yep | 13:43 |
| * dtantsur tries to make his brain work | 13:43 | |
| mnaser | dtantsur: ok so we'll try that, also i see `pxe_enabled` as a value too for ports | 13:43 |
| dtantsur | yep, this has to be correctly populated | 13:43 |
| mnaser | so we're going to try to set that to false for the one where `physical_network` is the external network | 13:43 |
| mnaser | so that it picks the right pxe boot thingamajig. | 13:44 |
| dtantsur | you have to, otherwise ironic may try to boot from it | 13:44 |
| * mnaser hopes things go well | 13:45 | |
| *** dsneddon has quit IRC | 13:50 | |
| *** ricolin_ is now known as ricolin | 13:55 | |
| *** jcoufal has quit IRC | 13:55 | |
| *** yaawang has quit IRC | 14:02 | |
| *** yaawang has joined #openstack-ironic | 14:03 | |
| *** dsneddon has joined #openstack-ironic | 14:11 | |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-prometheus-exporter master: [WIP] Support for metrics description https://review.opendev.org/675345 | 14:14 |
| *** dsneddon has quit IRC | 14:16 | |
| openstackgerrit | raphael.glon proposed openstack/ironic-python-agent master: Softraid: refactor partitioning https://review.opendev.org/674819 | 14:23 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-inspector master: [WIP] use openstacksdk for ironic module https://review.opendev.org/672179 | 14:24 |
| openstackgerrit | raphael.glon proposed openstack/ironic-python-agent master: Software raid: default partition table type change https://review.opendev.org/674803 | 14:24 |
| openstackgerrit | Nisha Brahmankar proposed openstack/ironic master: Uses IPA-B to build in addition to CoreOS https://review.opendev.org/673834 | 14:30 |
| *** ociuhandu has quit IRC | 14:30 | |
| *** dsneddon has joined #openstack-ironic | 14:30 | |
| *** ociuhandu has joined #openstack-ironic | 14:31 | |
| *** jcoufal has joined #openstack-ironic | 14:35 | |
| *** ociuhandu has quit IRC | 14:35 | |
| *** dsneddon has quit IRC | 14:35 | |
| openstackgerrit | Surya Seetharaman proposed openstack/ironic master: Support power state change callbacks to nova using ksa_adapter https://review.opendev.org/664842 | 14:58 |
| *** ociuhandu has joined #openstack-ironic | 15:04 | |
| *** dsneddon has joined #openstack-ironic | 15:08 | |
| *** verma-varsha has joined #openstack-ironic | 15:09 | |
| *** jmelvin has joined #openstack-ironic | 15:12 | |
| jmelvin | ping mjturek, do you know how to get introspection to work using ipmi for power pc system? | 15:13 |
| guilhermesp | dtantsur: we have created two ports, one poiting to the pxe network and another pointing to external network ( with pxe-disabled). But when we create an instance using the external network, seems that it is trying to use that external network to reach dhcp/tftp server and do the cleaning | 15:14 |
| dtantsur | guilhermesp: how do you create an instance? do you provide two ports? | 15:16 |
| dtantsur | or one port? | 15:16 |
| guilhermesp | only one port | 15:16 |
| guilhermesp | that is the external network | 15:16 |
| dtantsur | wait, I'm asking irrelevant questions probably.. have you configured hardware with the correct NIC boot order? | 15:16 |
| dtantsur | or rather: enable PXE only on the relevant NIC? | 15:17 |
| guilhermesp | yeah, it is booting from nic1, which is the nic connected to the ipmi network and yeah, nic has pxe-enabled | 15:17 |
| guilhermesp | and physical_network property poiting to external network | 15:17 |
| guilhermesp | the nic2 is with pxe disabled and poiting to the ipmi network in physical_network property | 15:18 |
| dtantsur | so, which one is enabled? and what do you mean by "ipmi network"? | 15:19 |
| dtantsur | is nic1 the correct or not? you said it's pxe-enabled. | 15:20 |
| guilhermesp | ok so nic1 is the network that has pxe enabled. Nic2 is the nic intended to boot the external network for end users | 15:21 |
| dtantsur | and in both BIOS and ironic you have PXE enabled for NIC1 and disabled for NIC2? | 15:22 |
| openstackgerrit | Surya Seetharaman proposed openstack/ironic master: Support power state change callbacks to nova using ksa_adapter https://review.opendev.org/664842 | 15:25 |
| *** Lucas_Gray has quit IRC | 15:27 | |
| *** verma-varsha1 has joined #openstack-ironic | 15:28 | |
| *** mriedem has joined #openstack-ironic | 15:28 | |
| *** verma-varsha1 has quit IRC | 15:28 | |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-inspector master: [WIP] use openstacksdk for ironic module https://review.opendev.org/672179 | 15:29 |
| *** verma-varsha has quit IRC | 15:29 | |
| mriedem | TheJulia: jroll: looking at https://review.opendev.org/#/c/523559/ i'm going to fix it up, but was wondering if we have any tempest ci testing with ironic + rebuild operations? | 15:30 |
| patchbot | patch 523559 - nova - Fix rebuild of baremetal instance when vm_state is... - 7 patch sets | 15:30 |
| mriedem | like, i don't see test_rebuild_server_in_error_state in https://logs.opendev.org/18/675218/1/check/ironic-tempest-ipa-wholedisk-bios-agent_ipmitool-tinyipa/8d3c1a0/job-output.txt.gz | 15:30 |
| mriedem | looks like that job only runs https://opendev.org/openstack/ironic/src/branch/master/zuul.d/ironic-jobs.yaml#L27 | 15:31 |
| mriedem | oops | 15:31 |
| mriedem | tempest_test_regex: ironic_tempest_plugin.tests.scenario | 15:31 |
| mriedem | i see https://github.com/openstack/ironic-tempest-plugin/blob/2ebfc15bf4424bf9fa32f5cfeb641b384c76b6c9/ironic_tempest_plugin/tests/scenario/test_baremetal_basic_ops.py#L78 but nothing calls it | 15:32 |
| dtantsur | mriedem: we have a job that does rebuild, but a standalone one (without nova, so not running on nova) | 15:34 |
| mriedem | so i guess https://github.com/openstack/ironic-tempest-plugin/blob/2ebfc15bf4424bf9fa32f5cfeb641b384c76b6c9/ironic_tempest_plugin/tests/scenario/test_baremetal_basic_ops.py#L42 is a lie | 15:34 |
| mriedem | dtantsur: ok that doesn't help me on the nova side :) | 15:34 |
| dtantsur | sorry :) | 15:34 |
| mriedem | are there any issues with enabling rebuild in that scenario test? | 15:34 |
| mriedem | the docstring says it does it, so presumably it was removed/disabled at some point | 15:34 |
| dtantsur | I think we removed rebuild because it increase the probability of random PXE failures | 15:34 |
| dtantsur | which keep haunting us, especially on slow nodes | 15:35 |
| mriedem | there is a thing in tempest now which allows you to run tests without them failing the overall run | 15:35 |
| dtantsur | good call | 15:35 |
| mriedem | https://github.com/openstack/tempest/blob/master/tempest/lib/decorators.py#L159 | 15:36 |
| dtantsur | yeah, we can probably create a separate test and mark it as unstable | 15:36 |
| mriedem | ok just opened https://storyboard.openstack.org/#!/story/2006380 for now | 15:39 |
| dtantsur | thx! | 15:40 |
| *** tssurya has quit IRC | 15:43 | |
| *** gyee has joined #openstack-ironic | 15:43 | |
| *** ricolin_ has joined #openstack-ironic | 15:43 | |
| *** ricolin_ has quit IRC | 15:45 | |
| *** ricolin has quit IRC | 15:46 | |
| *** ricolin_ has joined #openstack-ironic | 15:46 | |
| *** ricolin_ is now known as ricolin | 15:47 | |
| *** sthussey has joined #openstack-ironic | 15:47 | |
| mbuil | guys, I have just tried vbmc with python3. When using ipmitool to change the bootdev to pxe, I get a weird error (Set Chassis Boot Parameter 5 failed: Unspecified error). Any idea? | 15:49 |
| mbuil | same error when running ironic-inspect-node : Execute node introspection - noauth_mode | 15:49 |
| dtantsur | jroll: hey, do you remember why https://review.opendev.org/#/c/602127/ wasn't backported to queens? | 15:56 |
| patchbot | patch 602127 - nova - ironic: stop hammering ironic API in power sync loop (MERGED) - 2 patch sets | 15:56 |
| *** diga has quit IRC | 15:57 | |
| jroll | dtantsur: not sure, either I didn't think to, or it was a regression in rocky | 15:58 |
| mriedem | dtantsur: will see if this works https://review.opendev.org/#/c/675391/2 | 15:59 |
| patchbot | patch 675391 - nova - WIP: run test_rebuild_server_in_error_state in iro... - 2 patch sets | 15:59 |
| dtantsur | jroll: ok, I'm suggesting our folks to try applying it and seeing if it improves anything | 16:00 |
| dtantsur | mriedem: thx! | 16:00 |
| *** lucasagomes has quit IRC | 16:03 | |
| *** verma-varsha has joined #openstack-ironic | 16:04 | |
| *** Lucas_Gray has joined #openstack-ironic | 16:06 | |
| *** iurygregory has quit IRC | 16:08 | |
| *** beekneemech has joined #openstack-ironic | 16:16 | |
| *** e0ne has quit IRC | 16:16 | |
| *** beekneemech has quit IRC | 16:16 | |
| *** verma-varsha has quit IRC | 16:21 | |
| TheJulia | mbuil: it could be that your version pyghmi is oldish? | 16:21 |
| *** mriedem has left #openstack-ironic | 16:29 | |
| *** verma-varsha has joined #openstack-ironic | 16:31 | |
| rpittau | goodnight all! o/ | 16:36 |
| *** rpittau is now known as rpittau|afk | 16:36 | |
| rpioso | Good morning | 16:37 |
| *** verma-varsha has quit IRC | 16:38 | |
| openstackgerrit | Bill Dodd proposed openstack/sushy master: Add Task Monitor support for async operations https://review.opendev.org/670360 | 16:42 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-inspector master: [WIP] use openstacksdk for ironic module https://review.opendev.org/672179 | 16:43 |
| *** Lucas_Gray has quit IRC | 16:51 | |
| *** Lucas_Gray has joined #openstack-ironic | 16:51 | |
| *** brandor5 has joined #openstack-ironic | 16:56 | |
| *** dtantsur is now known as dtantsur|afk | 16:57 | |
| dtantsur|afk | c u | 16:57 |
| brandor5 | hello everyone: can someone point me to the code that ironic calls to power on/off and set boot mode, please? | 16:57 |
| *** dougsz has quit IRC | 16:59 | |
| brandor5 | specifically i need the ipmi commands ironic is sending | 17:00 |
| *** derekh has quit IRC | 17:00 | |
| mnaser | so going back to the discussion this morning | 17:01 |
| mnaser | setup provisioning/cleaning net to be a specific network | 17:01 |
| mnaser | and then the network the instance lives on is different | 17:02 |
| mnaser | but it seems like it's creating a port on the 'public' network instead of 'provisioning' network when deploying | 17:02 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-inspector master: [WIP] use openstacksdk for ironic module https://review.opendev.org/672179 | 17:03 |
| rpioso | brandor5: Take a look at https://opendev.org/openstack/ironic/src/commit/b8db11279e8ac7db7858cdbe0d1c728237ba8071/ironic/drivers/modules/ipmitool.py#L871 | 17:04 |
| brandor5 | rpioso: thanks | 17:04 |
| rpioso | brandor5: yw | 17:05 |
| *** Lucas_Gray has quit IRC | 17:05 | |
| *** e0ne has joined #openstack-ironic | 17:05 | |
| mnaser | ok so looking at the code | 17:06 |
| mnaser | https://github.com/openstack/ironic/blob/3f2c04079da334b723e3c0cdb33be205f30b5c85/ironic/drivers/modules/network/flat.py#L96-L109 | 17:06 |
| mnaser | vs | 17:06 |
| mnaser | https://github.com/openstack/ironic/blob/3f2c04079da334b723e3c0cdb33be205f30b5c85/ironic/drivers/modules/network/flat.py#L111-L127 | 17:06 |
| mnaser | so in this case, it isnt using the provisioning net ? | 17:07 |
| *** igordc has joined #openstack-ironic | 17:13 | |
| *** ociuhandu has quit IRC | 17:14 | |
| *** ricolin_ has joined #openstack-ironic | 17:16 | |
| *** ricolin has quit IRC | 17:19 | |
| *** tesseract has quit IRC | 17:27 | |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-inspector master: [WIP] use openstacksdk for ironic module https://review.opendev.org/672179 | 17:28 |
| *** brandor5 has left #openstack-ironic | 17:28 | |
| *** ricolin_ is now known as ricolin | 17:32 | |
| *** e0ne has quit IRC | 17:35 | |
| *** ociuhandu has joined #openstack-ironic | 17:36 | |
| *** ociuhandu has quit IRC | 17:40 | |
| *** ianychoi has quit IRC | 17:43 | |
| *** ianychoi has joined #openstack-ironic | 17:47 | |
| *** verma-varsha has joined #openstack-ironic | 17:48 | |
| openstackgerrit | Nisha Brahmankar proposed openstack/ironic-python-agent-builder master: Updates the build file in DIB https://review.opendev.org/675427 | 17:49 |
| *** ianychoi_ has joined #openstack-ironic | 17:54 | |
| *** ianychoi_ has quit IRC | 17:55 | |
| *** ianychoi_ has joined #openstack-ironic | 17:55 | |
| *** ianychoi has quit IRC | 17:58 | |
| *** verma-varsha1 has joined #openstack-ironic | 18:08 | |
| *** verma-varsha has quit IRC | 18:11 | |
| *** verma-varsha1 is now known as verma-varsha | 18:11 | |
| *** cmurphy has joined #openstack-ironic | 18:13 | |
| gyee | TheJulia, dtantsur, I ran into this error recently nova.virt.ironic.driver [req-0bed2d87-bf43-4768-a4ac-81053c419d91 None None] An unknown error has occurred when trying to get the list of nodes from the Ironic inventory. Error: StrictVersion instance has no attribute 'version' | 18:15 |
| *** verma-varsha has quit IRC | 18:15 | |
| gyee | problem occurred during version negotiation here https://github.com/openstack/python-ironicclient/blob/master/ironicclient/common/http.py#L165 | 18:17 |
| TheJulia | gyee: it will go away once a connection is made | 18:17 |
| TheJulia | gyee: its not fatal | 18:17 |
| gyee | it appears that max_version is None | 18:17 |
| gyee | problem is caused by ironicclient doing case-sensitive parsing of the version headers https://github.com/openstack/python-ironicclient/blob/master/ironicclient/common/http.py#L256 | 18:18 |
| TheJulia | gyee: are you saying nova virt halts on that error? | 18:18 |
| gyee | seem like something changed lately either in keystoneauth or python-requests which camelcased the HTTP headers | 18:19 |
| gyee | TheJulia, with that error, the node didn't show up in Nova hypervisor list | 18:19 |
| TheJulia | gyee: even after 2 minutes? | 18:19 |
| TheJulia | gyee: and you can absolutely confirm that the ironic endpoint is up and running? | 18:19 |
| gyee | yeah, I keep seeing that error repeated in nova-compute log | 18:20 |
| gyee | yes, ironic is running, node is in "available" state | 18:20 |
| TheJulia | can you confirm connectivity, i.e. curl ironic's api from the host running nova-compute? | 18:21 |
| gyee | yes | 18:22 |
| gyee | < HTTP/1.1 200 OK | 18:22 |
| gyee | < X-Openstack-Ironic-Api-Minimum-Version: 1.1 | 18:22 |
| gyee | < X-Openstack-Ironic-Api-Maximum-Version: 1.46 | 18:22 |
| gyee | that's what I am getting back for those headers | 18:22 |
| gyee | this is stable/rocky btw | 18:22 |
| TheJulia | hmm | 18:23 |
| TheJulia | are your nova version is also stable rocky? along iwth python-ironicclient? | 18:23 |
| gyee | yes | 18:23 |
| gyee | this is our latest snapshot build, our GA build works fine | 18:24 |
| gyee | so something has changed either in ironicclient, keystoneauth, or python-requests | 18:24 |
| gyee | I haven't been able to pinpoint where the headers got camelcased | 18:25 |
| TheJulia | what version of keystoneauth/ | 18:25 |
| gyee | keystoneauth1-3.10.0 | 18:26 |
| gyee | TheJulia, but regardless, shouldn't ironicclient be doing case-insensitive normalization of the headers first? | 18:26 |
| gyee | per my understanding, the HTTP headers are supposed to be case-insensitive | 18:26 |
| *** igordc has quit IRC | 18:28 | |
| *** verma-varsha has joined #openstack-ironic | 18:28 | |
| gyee | looks like someone else also ran into this https://bugs.launchpad.net/nova/+bug/1793766 | 18:29 |
| openstack | Launchpad bug 1793766 in OpenStack Compute (nova) "An unknown error has occurred when trying to get the list of nodes from the Ironic inventory. Error: StrictVersion instance has no attribute 'version'" [Low,Confirmed] | 18:29 |
| TheJulia | gyee: no, because they are explicitly cased | 18:30 |
| TheJulia | I've personally neve seen anything mandating headers be insensitive | 18:30 |
| TheJulia | yeah, that is what I think your hitting and once ironic is up, the error goes away | 18:31 |
| gyee | for me, the node never got registered as a hyperisor | 18:32 |
| gyee | aside from that error, I am not seeing any other errors in nova-compute logs | 18:34 |
| TheJulia | gyee: what version of python-requests do you have? | 18:34 |
| gyee | requests-2.19.1 | 18:35 |
| TheJulia | can we get a few more lines around the error, and any exception being reported? | 18:36 |
| gyee | no other exceptions, just a couple of deprecation warnings | 18:38 |
| *** trandles has joined #openstack-ironic | 18:39 | |
| TheJulia | gyee: python-ironicclient 2.5.3? | 18:39 |
| gyee | TheJulia: python_ironicclient-2.5.2 | 18:40 |
| *** verma-varsha has quit IRC | 18:40 | |
| gyee | should we be using 2.5.3 instead? | 18:40 |
| *** verma-varsha has joined #openstack-ironic | 18:42 | |
| TheJulia | perhaps... are you using an endpoint_override? | 18:44 |
| TheJulia | 2.5.3 was released june 3rd | 18:45 |
| gyee | yes | 18:46 |
| TheJulia | and does touch the endpoint override code in that there was a backport, and I think you had a prior patch as well, so... maybe that might just resolve it | 18:46 |
| gyee | TheJulia: so looks like if get_node_list failed, nova will treat it as driver not ready https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L639 | 18:46 |
| TheJulia | gyee: indeed | 18:46 |
| TheJulia | by design | 18:47 |
| gyee | TheJulia, I still think we need to fix ironicclient to normalize the header names first | 18:47 |
| gyee | otherwise, I can't see how version negotiation will ever going to work | 18:47 |
| TheJulia | It has worked for years | 18:48 |
| gyee | till a underlying component camelcased them names for ya :-) | 18:48 |
| TheJulia | seemingly, do you have an example of what is being receieved back to python-ironicclient? | 18:49 |
| gyee | let me add a logging statement in the code, give me a few minutes | 18:49 |
| TheJulia | thanks | 18:49 |
| *** jmelvin has quit IRC | 19:02 | |
| *** dsneddon has quit IRC | 19:11 | |
| *** e0ne has joined #openstack-ironic | 19:16 | |
| gyee | TheJulia, looks like the problem is with the endpoint override | 19:19 |
| gyee | turns out we have a versioned endpoint in endpoint override, and version negotiation blindly append '/v1' to it | 19:20 |
| gyee | so it was talking to https://host:6385/v1/v1 which yield HTTP 404, but ironicclient never check for it | 19:20 |
| gyee | and still proceed to look for the version headers | 19:21 |
| TheJulia | gyee: sounds like the bug dmitry fixed in 2.5.3 | 19:21 |
| gyee | after removing the versioned endpoint and making it versionless, now the node showed up nova hypervisor list | 19:21 |
| gyee | yeah | 19:22 |
| gyee | time to update our playbook | 19:22 |
| TheJulia | \o/ | 19:22 |
| gyee | TheJulia, thanks for the help! | 19:22 |
| gyee | though there may still be room for improvement in ironicclient, like checking for the HTTP code and make it a bit more robust | 19:23 |
| TheJulia | There is always room for improvement, the key question though is if we can backport it :) | 19:23 |
| gyee | yeah, release management is hard | 19:24 |
| *** jcoufal has quit IRC | 19:40 | |
| *** bfournie has quit IRC | 19:53 | |
| *** dsneddon has joined #openstack-ironic | 19:55 | |
| *** betherly has quit IRC | 20:27 | |
| *** verma-varsha has quit IRC | 20:29 | |
| *** jtomasek has quit IRC | 20:31 | |
| *** e0ne has quit IRC | 20:37 | |
| *** betherly has joined #openstack-ironic | 20:48 | |
| *** betherly has quit IRC | 20:52 | |
| *** jcoufal has joined #openstack-ironic | 20:53 | |
| *** whoami-rajat has quit IRC | 21:01 | |
| *** betherly has joined #openstack-ironic | 21:08 | |
| *** betherly has quit IRC | 21:12 | |
| *** igordc has joined #openstack-ironic | 21:13 | |
| *** dsneddon has quit IRC | 21:20 | |
| *** betherly has joined #openstack-ironic | 21:28 | |
| *** dsneddon has joined #openstack-ironic | 21:28 | |
| *** betherly has quit IRC | 21:33 | |
| *** betherly has joined #openstack-ironic | 21:36 | |
| *** jtomasek has joined #openstack-ironic | 21:36 | |
| *** dsneddon has quit IRC | 21:39 | |
| *** betherly has quit IRC | 21:40 | |
| *** dsneddon has joined #openstack-ironic | 21:48 | |
| *** betherly has joined #openstack-ironic | 21:57 | |
| *** betherly has quit IRC | 22:01 | |
| *** jcoufal has quit IRC | 22:02 | |
| *** dsneddon has quit IRC | 22:03 | |
| *** betherly has joined #openstack-ironic | 22:18 | |
| *** betherly has quit IRC | 22:23 | |
| *** dsneddon has joined #openstack-ironic | 22:23 | |
| *** whoami-rajat has joined #openstack-ironic | 22:24 | |
| *** dsneddon has quit IRC | 22:29 | |
| *** ociuhandu has joined #openstack-ironic | 22:30 | |
| *** trandles has quit IRC | 22:35 | |
| *** ociuhandu has quit IRC | 22:35 | |
| *** dsneddon has joined #openstack-ironic | 22:51 | |
| *** rcernin has joined #openstack-ironic | 22:53 | |
| openstackgerrit | Steve Baker proposed openstack/metalsmith master: Set useful port name when hostname is provided https://review.opendev.org/675495 | 23:00 |
| *** betherly has joined #openstack-ironic | 23:01 | |
| *** ricolin_ has joined #openstack-ironic | 23:02 | |
| *** ricolin has quit IRC | 23:05 | |
| *** betherly has quit IRC | 23:06 | |
| *** alexmcleod has quit IRC | 23:09 | |
| *** cdearborn has quit IRC | 23:19 | |
| *** etingof has quit IRC | 23:22 | |
| *** betherly has joined #openstack-ironic | 23:54 | |
| *** sthussey has quit IRC | 23:57 | |
| *** betherly has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!