*** ociuhandu has quit IRC | 00:02 | |
*** yaawang has quit IRC | 00:44 | |
*** TxGirlGeek has quit IRC | 00:52 | |
*** yaawang has joined #openstack-ironic | 00:57 | |
*** goldyfruit_ has joined #openstack-ironic | 01:07 | |
*** bobmel has joined #openstack-ironic | 01:13 | |
*** bobmel has quit IRC | 01:18 | |
*** ociuhandu has joined #openstack-ironic | 01:22 | |
*** kaifeng|afk is now known as kaifeng | 01:24 | |
kaifeng | TheJulia: yep, i expected if the whole building process doesn't involve arch binaries, then it would be possible, but apparently no magic happens | 01:25 |
---|---|---|
kaifeng | now i have to setup a vm without hardware acceleration, enjoying the days back to 286/386 period :) | 01:27 |
*** ociuhandu has quit IRC | 01:34 | |
*** lifeless has quit IRC | 01:34 | |
*** rloo has quit IRC | 01:49 | |
*** lifeless has joined #openstack-ironic | 01:49 | |
*** goldyfruit_ has quit IRC | 01:58 | |
*** lifeless has quit IRC | 02:12 | |
*** igordc has quit IRC | 02:18 | |
*** lifeless has joined #openstack-ironic | 02:24 | |
*** ociuhandu has joined #openstack-ironic | 02:35 | |
*** ociuhandu has quit IRC | 02:39 | |
*** mkrai has joined #openstack-ironic | 02:40 | |
TheJulia | kaifeng: it is more like a Pentium 100Mhz ;) | 02:48 |
TheJulia | kaifeng: not too horrible, tbh. I have done it a couple times as one-offs :) | 02:49 |
*** gyee has quit IRC | 02:53 | |
*** HagunKim has joined #openstack-ironic | 02:54 | |
kaifeng | TheJulia: yeah, actually cpu ticks is more trustworthy than network traffic :( | 03:13 |
*** bobmel has joined #openstack-ironic | 03:15 | |
TheJulia | Oh yeah, the network performance out of those VMs us not great :( | 03:16 |
*** bobmel has quit IRC | 03:19 | |
*** goldyfruit_ has joined #openstack-ironic | 03:28 | |
*** mkrai has quit IRC | 03:42 | |
*** mkrai_ has joined #openstack-ironic | 03:42 | |
*** ricolin has joined #openstack-ironic | 03:43 | |
*** stendulker has joined #openstack-ironic | 03:51 | |
*** goldyfruit_ has quit IRC | 05:00 | |
openstackgerrit | Merged openstack/ironic master: Ensure `isolinux.bin` is present and configured in devstack https://review.opendev.org/693211 | 05:06 |
*** rh-jelabarre has quit IRC | 05:07 | |
*** pcaruana has joined #openstack-ironic | 05:25 | |
*** Lucas_Gray has joined #openstack-ironic | 05:28 | |
*** ociuhandu has joined #openstack-ironic | 05:31 | |
*** bdodd has quit IRC | 05:32 | |
*** ociuhandu has quit IRC | 05:35 | |
*** bdodd has joined #openstack-ironic | 05:36 | |
*** bdodd has quit IRC | 05:41 | |
*** Lucas_Gray has quit IRC | 05:45 | |
*** bdodd has joined #openstack-ironic | 05:46 | |
*** zaneb has joined #openstack-ironic | 05:52 | |
*** tzumainn has quit IRC | 05:56 | |
openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: Drop python2 functional job https://review.opendev.org/695133 | 06:04 |
*** dsneddon_ has quit IRC | 06:23 | |
*** stendulker has quit IRC | 06:26 | |
*** rachit7 has joined #openstack-ironic | 06:51 | |
*** dsneddon_ has joined #openstack-ironic | 06:55 | |
arne_wiebalck | Good morning, ironic! | 07:21 |
kaifeng | hey arne_wiebalck o/ | 07:22 |
arne_wiebalck | Good morning, kaifeng o/ | 07:22 |
* etingof would appreciate that L3 thing reviews indeed | 07:23 | |
etingof | arne_wiebalck, kaifeng o/ | 07:23 |
arne_wiebalck | Hey etingof o/ | 07:23 |
kaifeng | hi etingof :) | 07:25 |
kaifeng | etingof: it seems the discussion on the spec is how the network config would be passed and which tool will be used to apply that config | 07:27 |
etingof | kaifeng, that's perhaps the hottest topic there! | 07:27 |
kaifeng | etingof: while i am not insisting on where the config should be placed, i think put it in port also make sense to me. | 07:28 |
kaifeng | have we decided yet? because latest comments seems to presume we use cloudinit aready, at least i feel so. | 07:29 |
etingof | kaifeng, i think the trade-off is like this: pro-port: better consistency, pro-node: no need to merge port-specific configs into one to burn into image | 07:30 |
kaifeng | yep, i think that's why dtantsur needs an example in the spec :) | 07:31 |
etingof | kaifeng, not sure if it's decided yet. the nuisance with cloud-init is that there seems to be no way to pass data source search path to cloud-init via kernel cmdline | 07:33 |
etingof | that means that one can't just reuse their cloud-init images for dhcpless booting | 07:34 |
etingof | they'd need to add smth conceptually like `mount /dev/cdrom /config-2` | 07:35 |
etingof | to their systemd | 07:35 |
etingof | I think I added two-port example jsons | 07:37 |
kaifeng | if memory serves, cloudinit reads /dev/disk-by-label/config-2 | 07:38 |
*** priteau has quit IRC | 07:38 | |
kaifeng | unless we have a custom datasource backend | 07:38 |
etingof | yes, the fs needs to be mounted and labeled prior to cloud-init does its thing | 07:38 |
etingof | I think the nuisance with custom datasource is that it needs to be burnt into the image in advance. You can't just pass it via kernel cmdline whenever needed... | 07:40 |
*** mkrai_ has quit IRC | 07:45 | |
*** mkrai_ has joined #openstack-ironic | 07:45 | |
*** zaneb has quit IRC | 07:46 | |
kaifeng | oh, the datasource i mean is the cloudinit datasource backend, we surely can read cmdline if it's handmade, but that's normally not a good solution | 07:46 |
etingof | right, so I thought the best outcome of this work would be that any generic cloud-init enabled image one can download from the internet could be passed L3 config and thus boot it dhcp-less | 07:48 |
etingof | however that does not seem to be possible with stock cloud-init and ISO-based image | 07:50 |
kaifeng | is floppy available in this case? | 07:50 |
*** dsneddon_ has quit IRC | 07:52 | |
etingof | floppy can potentially be available, depending on the BMC | 07:52 |
etingof | and floppy driver in Linux kernel | 07:52 |
etingof | can we point cloud-init to floppy without repacking/customizing generic image? | 07:53 |
kaifeng | probably not, i think cloudinit finds partition by labels, as long as the vfloppy is auto-mounted it might work. | 07:55 |
etingof | that's what I've found as well... | 07:56 |
kaifeng | if the mount /config-2 stuff is required, it sounds like we can make ipa do it for us, but it must start up before cloud init | 07:56 |
etingof | in my mind, it would be great if cloud-init would take custom datasource from kernel cmdline... | 07:57 |
etingof | with ramdisk it's easy! we do mount /dev/cdrom there and we do not run cloud-init at all | 07:57 |
*** tesseract has joined #openstack-ironic | 07:58 | |
kaifeng | well, the version of cloudinit differs with distro, the compatibility issue would be a headache. | 07:58 |
etingof | perhaps config compatibility issue could be solved within cloudinit - it's its data | 07:58 |
kaifeng | i mean the custom data source, different base image may ship with different versions. | 07:59 |
etingof | right, but that can be solved one way or the other I think | 07:59 |
kaifeng | in case we have implemented a custom datasource that reads cmdline | 07:59 |
etingof | it's not a new problem, right? many programs have come up with versioned configs | 08:00 |
openstackgerrit | Merged openstack/ironic master: Drop [agent]heartbeat_timeout https://review.opendev.org/694726 | 08:01 |
etingof | still, if *we* implement a custom datasource that needs to be pre-configured into the image, that undermines the goal of booting generic/unmodified images... | 08:01 |
etingof | well, not the goal exactly, but my desire ;) | 08:01 |
kaifeng | we can make it into upstream :) | 08:02 |
etingof | yes! that would be the best outcome I think | 08:02 |
kaifeng | and i think instead of building a custom backend, a little extension on current configdrive datasource would be suffice | 08:03 |
etingof | probably, however the other approach could be to teach cloud-init looking up for custom datasources in cmdline as well | 08:04 |
kaifeng | but returning to the original question, do we have concensus on picking cloudinit? it was considered heavy | 08:04 |
etingof | cloud-init already has a search path for that | 08:04 |
etingof | I am not sure if we reached the consensus. Just note that we are not exactly picking up cloud-init here, but its config file format... | 08:05 |
etingof | well, not its config format, but one of the formats cloud-init readily understands | 08:06 |
*** ociuhandu has joined #openstack-ironic | 08:09 | |
etingof | the other important thing that came up in reviews is whether of not we should have separate network configs for ramdisk and user image... and how to implement that, if so | 08:09 |
etingof | that's the case of neutron-less setup | 08:10 |
*** rachit7 has quit IRC | 08:12 | |
kaifeng | if we have separate network config, then where we place the network config for user image? | 08:12 |
kaifeng | https://github.com/canonical/cloud-init/blob/master/cloudinit/sources/DataSourceConfigDrive.py | 08:14 |
etingof | I can think of (1) another field on node/port object or (2) some sort of container structure where the user would place two separate network_data.json for ramdisk and user image | 08:14 |
kaifeng | looking the code, feel like we just need to add something similar with PROBE_OPTICAL | 08:15 |
etingof | in the latter case ironic would have to be aware of that structure to pull the right one | 08:15 |
kaifeng | i don't feel it's an issue, ironic knows node states and pull the correct config, as long as we have determined the structure. | 08:19 |
*** ociuhandu has quit IRC | 08:19 | |
*** dsneddon_ has joined #openstack-ironic | 08:20 | |
etingof | hm, I do not see if they probe /dev/cdrom, only /dev/cdN | 08:21 |
etingof | other than that, if we label our entire boot ISO as 'config-2' and put our custom datasource into its root, that might work... | 08:22 |
kaifeng | etingof: yeah, that might work, it will just copy data to the ?/var/cloudinit? and reads there | 08:25 |
*** dsneddon_ has quit IRC | 08:25 | |
kaifeng | TheJulia: finally reach the end of stage and get this error, do you have any idea on what's missing? http://paste.openstack.org/show/786383 | 08:26 |
etingof | makes sense to me, I will update the spec accordingly. thank you, kaifeng! | 08:27 |
kaifeng | etingof: no problem :) | 08:31 |
*** bobmel has joined #openstack-ironic | 08:40 | |
*** bobmel has quit IRC | 08:40 | |
*** bobmel has joined #openstack-ironic | 08:40 | |
*** rpittau|afk is now known as rpittau | 08:53 | |
rpittau | good morning ironic! o/ | 08:53 |
kaifeng | hi rpittau o/ | 08:54 |
rpittau | hey kaifeng :) | 08:54 |
*** ociuhandu has joined #openstack-ironic | 08:55 | |
*** dsneddon_ has joined #openstack-ironic | 08:57 | |
*** rachit7 has joined #openstack-ironic | 08:57 | |
*** ociuhandu has quit IRC | 08:59 | |
*** ociuhandu has joined #openstack-ironic | 09:00 | |
*** lucasagomes has joined #openstack-ironic | 09:01 | |
*** dsneddon_ has quit IRC | 09:01 | |
*** ociuhandu has quit IRC | 09:03 | |
*** jawad_axd has joined #openstack-ironic | 09:03 | |
openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: Drop python2 functional job https://review.opendev.org/695133 | 09:03 |
*** ociuhandu has joined #openstack-ironic | 09:04 | |
openstackgerrit | Jerry Wang proposed openstack/ironic master: [PATCH] Add support for replacing WSME https://review.opendev.org/675853 | 09:06 |
*** ociuhandu has quit IRC | 09:11 | |
*** ociuhandu has joined #openstack-ironic | 09:11 | |
*** ociuhandu has quit IRC | 09:13 | |
*** ociuhandu has joined #openstack-ironic | 09:14 | |
*** ociuhandu has quit IRC | 09:15 | |
*** ociuhandu has joined #openstack-ironic | 09:16 | |
*** dougsz has joined #openstack-ironic | 09:17 | |
*** ociuhandu has quit IRC | 09:17 | |
*** ociuhandu has joined #openstack-ironic | 09:18 | |
*** ociuhandu has quit IRC | 09:19 | |
*** ociuhandu has joined #openstack-ironic | 09:20 | |
*** Lucas_Gray has joined #openstack-ironic | 09:22 | |
*** ociuhandu has quit IRC | 09:26 | |
*** ociuhandu has joined #openstack-ironic | 09:27 | |
*** ociuhandu has quit IRC | 09:29 | |
*** ociuhandu has joined #openstack-ironic | 09:29 | |
*** ociuhandu has quit IRC | 09:32 | |
*** ociuhandu has joined #openstack-ironic | 09:32 | |
openstackgerrit | Merged openstack/ironic master: Remove old online migration codes https://review.opendev.org/694718 | 09:33 |
*** alexmcleod has joined #openstack-ironic | 09:33 | |
*** ociuhandu has quit IRC | 09:34 | |
*** ociuhandu has joined #openstack-ironic | 09:35 | |
*** ociuhandu has quit IRC | 09:37 | |
*** iurygregory has joined #openstack-ironic | 09:37 | |
iurygregory | good morning | 09:37 |
*** ociuhandu has joined #openstack-ironic | 09:37 | |
rpittau | hey iurygregory :) | 09:37 |
iurygregory | rpittau, o/ | 09:38 |
*** ociuhandu has quit IRC | 09:39 | |
*** ociuhandu has joined #openstack-ironic | 09:40 | |
*** ociuhandu has quit IRC | 09:43 | |
*** ociuhandu has joined #openstack-ironic | 09:43 | |
*** ociuhandu has quit IRC | 09:45 | |
*** ociuhandu has joined #openstack-ironic | 09:46 | |
*** rcernin has quit IRC | 09:46 | |
*** Wryhder has joined #openstack-ironic | 09:46 | |
*** derekh has joined #openstack-ironic | 09:47 | |
arne_wiebalck | good morning, iurygregory rpittau o/ | 09:47 |
rpittau | hey arne_wiebalck :) | 09:48 |
*** ociuhandu has quit IRC | 09:48 | |
*** Lucas_Gray has quit IRC | 09:48 | |
*** ociuhandu has joined #openstack-ironic | 09:49 | |
*** Wryhder is now known as Lucas_Gray | 09:49 | |
*** mkrai_ has quit IRC | 09:49 | |
iurygregory | arne_wiebalck, o/ | 09:50 |
*** ociuhandu has quit IRC | 09:50 | |
*** mkrai has joined #openstack-ironic | 09:50 | |
*** ociuhandu has joined #openstack-ironic | 09:51 | |
*** priteau has joined #openstack-ironic | 09:52 | |
*** ociuhandu has quit IRC | 09:52 | |
*** ociuhandu has joined #openstack-ironic | 09:53 | |
*** ociuhandu has quit IRC | 09:56 | |
*** ociuhandu has joined #openstack-ironic | 09:57 | |
*** ociuhandu has quit IRC | 09:58 | |
*** ociuhandu has joined #openstack-ironic | 09:58 | |
iurygregory | rpittau, do you know why we need another `export DEVSTACK_GATE_USE_PYTHON3=True` https://review.opendev.org/#/c/695085/ https://github.com/openstack/ironic/blob/6582471c0559bcfd6940083090cae6f02e621f4a/playbooks/legacy/grenade-dsvm-ironic/run.yaml#L39 ? | 10:01 |
patchbot | patch 695085 - ironic - Migrate grenade jobs to py3 - 2 patch sets | 10:01 |
iurygregory | oh probably because I added to the ironic-extra-vars right? | 10:03 |
kaifeng | good morning iurygregory and good night folks o/ | 10:05 |
*** kaifeng is now known as kaifeng|afk | 10:05 | |
rpittau | iurygregory: it's probably because of that | 10:06 |
rpittau | good night kaifeng|afk :) | 10:06 |
iurygregory | rpittau, we do the source so it should be fine I would say =) | 10:06 |
*** priteau has quit IRC | 10:06 | |
rpittau | iurygregory: yeah, mmm, I'm a bit confused now, I don't see the L39 in the patch with the export | 10:07 |
iurygregory | but its on the repo already =) | 10:07 |
iurygregory | he didn't push the latest commit to rebase | 10:07 |
rpittau | iurygregory: yep | 10:08 |
iurygregory | I just don't know if it would be necessary =) | 10:08 |
rpittau | iurygregory: thanks, I added a comment | 10:09 |
iurygregory | rpittau, same for the inspector patch =) | 10:09 |
iurygregory | https://review.opendev.org/#/c/695087/ | 10:09 |
patchbot | patch 695087 - ironic-inspector - Migrate grenade jobs to py3 - 1 patch set | 10:09 |
rpittau | yeah | 10:10 |
*** mkrai has quit IRC | 10:20 | |
*** mkrai has joined #openstack-ironic | 10:23 | |
*** dtantsur|afk is now known as dtantsur | 10:27 | |
dtantsur | morning ironic | 10:27 |
*** ricolin has quit IRC | 10:32 | |
iurygregory | morning dtantsur | 10:32 |
rpittau | hey dtantsur :) | 10:32 |
*** HagunKim has quit IRC | 10:33 | |
iurygregory | dtantsur, hey any idea what was the comment from TheJulia "ramdisk state will be the state of the running machine after reboot." I'm not sure if I understood .-. | 10:42 |
dtantsur | TheJulia: I'm completely out of context, sorry | 10:43 |
*** mkrai has quit IRC | 10:43 | |
dtantsur | ooops, it was for iurygregory | 10:46 |
iurygregory | dtantsur, oh XD | 10:46 |
iurygregory | this was what she said after my idea to use mokutil .-. but I don't get how the reboot would be a problem | 10:47 |
dtantsur | TheJulia: I assume she meant that whatever mokutil shows in IPA does not necessary reflect what will happen in the final instance. | 10:48 |
dtantsur | damn, why am I tagging the wrong person again? :( iurygregory ^^^ | 10:48 |
* dtantsur some ikeaing, brb | 10:48 | |
*** dtantsur is now known as dtantsur|brb | 10:48 | |
iurygregory | dtantsur|brb, ok | 10:49 |
* iurygregory needs to think and understand more why this would happen .-. it looks like witchcraft | 10:50 | |
*** rachit7 has quit IRC | 10:51 | |
*** dsneddon_ has joined #openstack-ironic | 10:57 | |
*** michchap has joined #openstack-ironic | 11:00 | |
*** dsneddon_ has quit IRC | 11:02 | |
*** PrinzElvis has quit IRC | 11:08 | |
*** bobmel has quit IRC | 11:15 | |
*** ociuhandu has quit IRC | 11:21 | |
openstackgerrit | Merged openstack/ironic master: Pass correct flags during PXE cleanup in iPXEBoot https://review.opendev.org/694990 | 11:26 |
openstackgerrit | Vladyslav Drok proposed openstack/ironic stable/train: Pass correct flags during PXE cleanup in iPXEBoot https://review.opendev.org/695178 | 11:31 |
openstackgerrit | Vladyslav Drok proposed openstack/ironic stable/stein: Pass correct flags during PXE cleanup in iPXEBoot https://review.opendev.org/695179 | 11:31 |
openstackgerrit | Vladyslav Drok proposed openstack/ironic stable/stein: Pass correct flags during PXE cleanup in iPXEBoot https://review.opendev.org/695179 | 11:32 |
*** mkrai has joined #openstack-ironic | 11:34 | |
*** Lucas_Gray has quit IRC | 11:47 | |
*** dsneddon_ has joined #openstack-ironic | 11:50 | |
*** ociuhandu has joined #openstack-ironic | 11:51 | |
*** dsneddon_ has quit IRC | 11:55 | |
*** PrinzElvis has joined #openstack-ironic | 12:15 | |
*** mkrai has quit IRC | 12:17 | |
*** pcaruana has quit IRC | 12:24 | |
*** mkrai has joined #openstack-ironic | 12:36 | |
openstackgerrit | Arne Wiebalck proposed openstack/ironic-python-agent master: Software RAID: Use UUID to find root fs https://review.opendev.org/686585 | 12:42 |
*** pcaruana has joined #openstack-ironic | 12:50 | |
arne_wiebalck | TheJulia: if you have a moment, could we pick up https://review.opendev.org/#/c/686580/ again? | 12:50 |
patchbot | patch 686580 - ironic - Software RAID: Identify the root fs via its UUID f... - 4 patch sets | 12:50 |
arne_wiebalck | TheJulia: https://review.opendev.org/686585 is related. | 12:50 |
patchbot | patch 686585 - ironic-python-agent - Software RAID: Use UUID to find root fs - 5 patch sets | 12:50 |
*** derekh has quit IRC | 12:55 | |
*** ociuhandu has quit IRC | 12:58 | |
*** goldyfruit_ has joined #openstack-ironic | 12:59 | |
*** mkrai has quit IRC | 12:59 | |
*** dsneddon_ has joined #openstack-ironic | 13:00 | |
*** Lucas_Gray has joined #openstack-ironic | 13:01 | |
*** derekh has joined #openstack-ironic | 13:02 | |
*** priteau has joined #openstack-ironic | 13:05 | |
etingof | what could be wrong if tempest fails to ssh into the deployed instance? the reason seems to be failed public key auth | 13:05 |
*** ricolin has joined #openstack-ironic | 13:07 | |
*** Lucas_Gray has quit IRC | 13:11 | |
*** Lucas_Gray has joined #openstack-ironic | 13:11 | |
*** goldyfruit_ has quit IRC | 13:16 | |
*** rloo has joined #openstack-ironic | 13:20 | |
*** rloo has quit IRC | 13:20 | |
*** rloo has joined #openstack-ironic | 13:21 | |
rpittau | etingof: wrong user ? | 13:22 |
etingof | cirros can't be wrong | 13:22 |
openstackgerrit | Merged openstack/ironic master: Ensure text-only console in devstack https://review.opendev.org/695016 | 13:22 |
*** iurygregory has quit IRC | 13:31 | |
openstackgerrit | Michael Chapman proposed openstack/ironic master: Don't install syslinux-nonlinux on rhel7 https://review.opendev.org/695195 | 13:31 |
*** iurygregory has joined #openstack-ironic | 13:32 | |
*** iurygregory has quit IRC | 13:36 | |
*** iurygregory has joined #openstack-ironic | 13:37 | |
*** ociuhandu has joined #openstack-ironic | 13:44 | |
*** ociuhandu has quit IRC | 13:48 | |
*** dsneddon_ has quit IRC | 14:05 | |
*** priteau has quit IRC | 14:11 | |
*** priteau has joined #openstack-ironic | 14:12 | |
*** priteau has quit IRC | 14:13 | |
*** bobmel has joined #openstack-ironic | 14:16 | |
*** Lucas_Gray has quit IRC | 14:21 | |
openstackgerrit | Michael Chapman proposed openstack/ironic master: Don't install syslinux-nonlinux on rhel7 https://review.opendev.org/695195 | 14:24 |
*** mmethot has quit IRC | 14:34 | |
*** mmethot has joined #openstack-ironic | 14:35 | |
*** PrinzElvis has quit IRC | 14:38 | |
*** goldyfruit_ has joined #openstack-ironic | 14:43 | |
openstackgerrit | Vladyslav Drok proposed openstack/ironic master: Mock out the correct greenthread sleep method https://review.opendev.org/695208 | 14:45 |
*** jawad_axd has quit IRC | 14:45 | |
*** jawad_axd has joined #openstack-ironic | 14:46 | |
*** jawad_ax_ has joined #openstack-ironic | 14:49 | |
*** jawad_axd has quit IRC | 14:50 | |
*** jawad_axd has joined #openstack-ironic | 14:51 | |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic master: Drop python 2.7 support and testing https://review.opendev.org/695213 | 14:53 |
*** jawad_ax_ has quit IRC | 14:53 | |
*** jawad_axd has quit IRC | 14:55 | |
*** rh-jelabarre has joined #openstack-ironic | 14:58 | |
*** dtantsur|brb is now known as dtantsur | 15:00 | |
rpioso | etingof: I'm encountering strange issues while using devstack to integration test the hybrid idrac HW type against real bare metal. | 15:02 |
rpioso | etingof: Interested? | 15:03 |
*** tzumainn has joined #openstack-ironic | 15:03 | |
etingof | rpioso, o/ that does not sound like something extraordinary to me - I'm debugging a devstack problem for a couple of days already... | 15:05 |
iurygregory | dtantsur, we don't build coreos on ipa anymore right? | 15:06 |
dtantsur | nope | 15:06 |
dtantsur | deprecated and removed | 15:07 |
iurygregory | we forgot 1 job XD | 15:07 |
iurygregory | I just found while removign py2 jobs | 15:07 |
rpioso | etingof: 1. The conductor's soft reset of the agent following the writing of the instance image fails. 2. The IPA's log output isn't displayed on the console, which makes it more difficult to follow and debug what's occurring. 3. At the end, it doesn't appear the disk is set as the boot device; the server continues to try to PXE boot first. When that fails, it boots from the instance OS. | 15:08 |
iurygregory | https://github.com/openstack/ironic-lib/blob/master/zuul.d/project.yaml#L30 its ok to remove right? | 15:08 |
*** johnthetubaguy has joined #openstack-ironic | 15:09 | |
rpioso | etingof: 4. The disk isn't listed as a boot source by BIOS setup. 5. ironic marks the node as active. 6. Sometimes the node remains powered on and the instance OS login prompt is displayed and other times it is powered off. | 15:10 |
iurygregory | and I just found a typo on "ironic-python-agent-buildimage-tinyipa" XD | 15:10 |
rpittau | iurygregory: you can remove that | 15:11 |
iurygregory | rpittau, pushing a patch to remove and to fix the typo on tinyipa job name | 15:11 |
rpioso | etingof: I deployed devstack about 3-4 weeks ago. | 15:11 |
* rpioso will brb | 15:11 | |
rpittau | iurygregory: yup, curious about the typo :) | 15:11 |
iurygregory | rpittau, ironic-python-agent-buildimage-tinyipa doesn't exist it's ironic-python-agent-build-image-tinyipa | 15:12 |
rpittau | ah damn dash! | 15:12 |
iurygregory | yeah! | 15:12 |
*** ociuhandu has joined #openstack-ironic | 15:13 | |
rpittau | well, seems like removing python 2 has multiple advantages not strictly related to python 2 :P | 15:13 |
iurygregory | truth! | 15:13 |
*** dsneddon_ has joined #openstack-ironic | 15:14 | |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-lib master: Fix Jobs https://review.opendev.org/695218 | 15:17 |
*** ociuhandu has quit IRC | 15:19 | |
*** dsneddon_ has quit IRC | 15:20 | |
*** bobmel has quit IRC | 15:23 | |
etingof | rpioso, what's "soft reset of the agent"? node reboot? no clues what exactly fails? | 15:24 |
*** bobmel has joined #openstack-ironic | 15:24 | |
etingof | no IPA logging - that's curious. I've never seen quiet IPA | 15:25 |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic master: Drop python 2.7 support and testing https://review.opendev.org/695213 | 15:25 |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-lib master: Drop python 2.7 support and testing https://review.opendev.org/695219 | 15:27 |
*** bobmel has quit IRC | 15:27 | |
*** TxGirlGeek has joined #openstack-ironic | 15:29 | |
* rpioso is back :-) | 15:30 | |
rpioso | etingof: http://paste.openstack.org/show/786429/ | 15:33 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-lib master: mdns: support IPv6 addresses https://review.opendev.org/693026 | 15:34 |
etingof | rpioso, I'd enable ironic debugging to observe Redfish exchange | 15:34 |
rpioso | etingof: I added the command that preceded the failure -- http://paste.openstack.org/show/786431/ | 15:37 |
etingof | rpioso, ah, it's not redfish poweroff, but IPA poweroff | 15:39 |
rpioso | etingof: Yeah, it's strange that the IPA's logging isn't displayed on the console. | 15:39 |
rpioso | Exactly! | 15:39 |
rpioso | It's not OOB power off. | 15:39 |
*** bobmel has joined #openstack-ironic | 15:39 | |
*** bobmel has quit IRC | 15:40 | |
rpioso | I tried extending the conductor's patience by tripling the # of retries, but that didn't fix it either. | 15:40 |
*** bobmel has joined #openstack-ironic | 15:40 | |
etingof | rpioso, I'd put the node in "maintenance" mode right upon deployment, then examine live ramdisk | 15:41 |
etingof | in part of IPA and system logging configuration | 15:41 |
etingof | I am curious if the kernel on that machine somehow considers some other serial port as system console...? | 15:42 |
* TheJulia yawns | 15:42 | |
rpioso | etingof: I'd have to be able to log into the IPA, which is another challenge :-( If I understand correctly, cdearborn encountered a networking issue that precludes that. | 15:43 |
etingof | rpioso, can you access console? | 15:43 |
*** bobmel has quit IRC | 15:43 | |
rpioso | etingof: We're using "openstack baremetal node deploy ...". No nova. | 15:43 |
etingof | good morning, TheJulia o/ | 15:43 |
rpioso | etingof: Yes, but I can't log in at the virtual console and reportedly ssh won't work either. | 15:44 |
rpioso | TheJulia: Good morning! | 15:44 |
etingof | rpioso, well, BMC console access might be irrelevant to devstack/ironic problems | 15:45 |
* rpioso woke up at ~4:15 am EST. What! | 15:45 | |
*** bobmel has joined #openstack-ironic | 15:45 | |
etingof | rpioso, if you think you experience conductor<->ipa connectivity issues, that could explain soft reboot failure | 15:46 |
rpioso | etingof: It's the system console virtualized. | 15:46 |
* etingof is not sure what virtualized console means now days | 15:47 | |
rpioso | etingof: Hrm ... But the command exchanges which precede the soft reset seem to succeed. | 15:47 |
*** bobmel has quit IRC | 15:47 | |
rpioso | etingof: iDRAC web GUI has a virtual console feature which displays the system console via Java, HTML5, etc. | 15:48 |
etingof | rpioso, the first thing I would do is to establish proper IPA logging to understand what's going on there... | 15:48 |
rpioso | etingof: I can see the server PXE boot and the IPA log in prompt is displayed for a time. | 15:49 |
rpioso | etingof: My thought exactly! | 15:49 |
rpioso | etingof: Are the IPA logs captured by the conductor and stored somewhere? | 15:49 |
etingof | I think so | 15:49 |
* TheJulia needs to go find breakfast | 15:50 | |
TheJulia | rpioso: waking up crazy early should be over in a few more days for you :) | 15:50 |
etingof | but that requires working conductor<->ipa communication | 15:50 |
rpioso | etingof: Perhaps it's working sufficiently for that. Where can I find those logs? Do I need to turn some knobs to make them available to the conductor? | 15:51 |
rpioso | TheJulia: Woot! | 15:51 |
etingof | rpioso ~stack/ironic-bm-logs/deploy_logs | 15:52 |
etingof | rpioso, I am not sure the logs are captured on cleaning though | 15:52 |
rpioso | etingof: I have auto cleaning disabled :-) | 15:53 |
*** dsneddon_ has joined #openstack-ironic | 15:53 | |
*** bobmel has joined #openstack-ironic | 15:56 | |
*** ociuhandu has joined #openstack-ironic | 15:56 | |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/networking-generic-switch master: Drop python 2.7 support and testing https://review.opendev.org/695228 | 15:58 |
rpioso | etingof: I see a zipped tarball for the deployment referenced by the pastebin. A few of the files appear to be binary. | 15:58 |
*** dsneddon_ has quit IRC | 15:58 | |
rpioso | Which one should have the IPA logs, and what do I need to do to get at them? | 15:59 |
etingof | rpioso, I'd expect to find var/log/ironic-python-agent.log in that tarball | 16:01 |
rpioso | etingof: Not there :-( | 16:01 |
*** ociuhandu has quit IRC | 16:01 | |
etingof | rpioso, I'd try to get on the console then | 16:02 |
*** bobmel has quit IRC | 16:05 | |
*** bobmel has joined #openstack-ironic | 16:07 | |
*** whoami-rajat_ has joined #openstack-ironic | 16:08 | |
* iurygregory gtg bbl | 16:10 | |
*** iurygregory has quit IRC | 16:12 | |
openstackgerrit | Ilya Etingof proposed openstack/ironic master: Add a CI job to legacy boot over Redfish virtual media https://review.opendev.org/693017 | 16:14 |
*** gyee has joined #openstack-ironic | 16:16 | |
openstackgerrit | Vladyslav Drok proposed openstack/ironic master: Mock out the correct greenthread sleep method https://review.opendev.org/695208 | 16:20 |
*** bobmel has quit IRC | 16:21 | |
*** ricolin has quit IRC | 16:24 | |
*** naved001 has quit IRC | 16:27 | |
*** naved001 has joined #openstack-ironic | 16:28 | |
*** jawad_axd has joined #openstack-ironic | 16:29 | |
*** dsneddon_ has joined #openstack-ironic | 16:30 | |
*** ociuhandu has joined #openstack-ironic | 16:33 | |
*** jawad_axd has quit IRC | 16:34 | |
*** dougsz has quit IRC | 16:38 | |
*** ociuhandu has quit IRC | 16:38 | |
*** ociuhandu has joined #openstack-ironic | 16:38 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent master: [VERY EARLY WIP] Replace WSME and Pecan with Flask https://review.opendev.org/695041 | 16:47 |
openstackgerrit | Vladyslav Drok proposed openstack/ironic master: Mock out the correct greenthread sleep method https://review.opendev.org/695208 | 16:52 |
*** dougsz has joined #openstack-ironic | 16:53 | |
*** goldyfruit___ has joined #openstack-ironic | 16:53 | |
*** goldyfruit___ is now known as goldyfruit | 16:54 | |
arne_wiebalck | bye everyone o/ | 16:56 |
*** goldyfruit_ has quit IRC | 16:56 | |
*** lucasagomes has quit IRC | 16:57 | |
*** dsneddon_ has quit IRC | 17:15 | |
rpittau | good night! o/ | 17:18 |
*** rpittau is now known as rpittau|afk | 17:18 | |
*** dsneddon_ has joined #openstack-ironic | 17:19 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-lib master: mdns: support IPv6 addresses https://review.opendev.org/693026 | 17:22 |
*** dsneddon_ has quit IRC | 17:25 | |
*** dsneddon_ has joined #openstack-ironic | 17:26 | |
*** jawad_axd has joined #openstack-ironic | 17:26 | |
*** goldyfruit has quit IRC | 17:27 | |
*** goldyfruit has joined #openstack-ironic | 17:30 | |
*** jawad_axd has quit IRC | 17:31 | |
*** goldyfruit has quit IRC | 17:31 | |
*** goldyfruit has joined #openstack-ironic | 17:34 | |
*** goldyfruit has quit IRC | 17:34 | |
*** goldyfruit has joined #openstack-ironic | 17:35 | |
*** jawad_axd has joined #openstack-ironic | 17:47 | |
*** dsneddon_ is now known as dsneddon | 17:49 | |
*** jawad_axd has quit IRC | 17:52 | |
*** whoami-rajat_ is now known as whoami-rajat | 17:53 | |
*** igordc has joined #openstack-ironic | 18:00 | |
*** dougsz has quit IRC | 18:00 | |
*** derekh has quit IRC | 18:01 | |
*** tesseract has quit IRC | 18:18 | |
openstackgerrit | Tzu-Mainn Chen proposed openstack/ironic master: Allow node owners to administer associated ports https://review.opendev.org/695255 | 18:31 |
*** ociuhandu has quit IRC | 18:57 | |
NobodyCam | Good Morning Ironic'ers | 18:57 |
*** ociuhandu has joined #openstack-ironic | 18:59 | |
*** ociuhandu has quit IRC | 19:03 | |
*** tzumainn has quit IRC | 19:12 | |
dtantsur | morning NobodyCam | 19:13 |
NobodyCam | O/ morning dtantsur | 19:14 |
*** goldyfruit has quit IRC | 19:18 | |
*** goldyfruit has joined #openstack-ironic | 19:18 | |
*** goldyfruit has quit IRC | 19:20 | |
*** goldyfruit has joined #openstack-ironic | 19:20 | |
*** ociuhandu has joined #openstack-ironic | 19:35 | |
openstackgerrit | Merged openstack/ironic stable/train: Pass correct flags during PXE cleanup in iPXEBoot https://review.opendev.org/695178 | 19:40 |
*** ociuhandu has quit IRC | 19:46 | |
*** ociuhandu has joined #openstack-ironic | 19:47 | |
*** iurygregory has joined #openstack-ironic | 19:48 | |
*** ociuhandu has quit IRC | 19:53 | |
*** ociuhandu has joined #openstack-ironic | 19:57 | |
*** ociuhandu has quit IRC | 20:05 | |
*** whoami-rajat has quit IRC | 20:08 | |
*** alexmcleod has quit IRC | 20:09 | |
*** ociuhandu has joined #openstack-ironic | 20:36 | |
*** iurygregory has quit IRC | 20:42 | |
*** ociuhandu has quit IRC | 20:51 | |
*** ociuhandu has joined #openstack-ironic | 20:53 | |
openstackgerrit | Merged openstack/ironic-tempest-plugin master: Enable boot_option to be specified https://review.opendev.org/678633 | 21:01 |
*** ociuhandu has quit IRC | 21:06 | |
*** tzumainn has joined #openstack-ironic | 21:29 | |
*** dtantsur is now known as dtantsur|afk | 21:32 | |
*** pcaruana has quit IRC | 21:42 | |
*** ociuhandu has joined #openstack-ironic | 21:59 | |
*** ociuhandu has quit IRC | 22:07 | |
*** rcernin has joined #openstack-ironic | 22:31 | |
rpioso | TheJulia: Do you have any familiarity with the devstack integration testing issues I shared with etingof earlier today? | 23:07 |
*** tzumainn has quit IRC | 23:33 | |
*** goldyfruit has quit IRC | 23:48 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!