Saturday, 2020-02-08

*** gyee has quit IRC01:10
*** Lucas_Gray has quit IRC01:11
*** bobmel has joined #openstack-ironic01:55
*** bobmel has quit IRC01:59
*** Goneri has quit IRC02:36
*** bobmel has joined #openstack-ironic03:37
*** bobmel has quit IRC03:42
*** tzumainn has quit IRC03:51
*** dsneddon has quit IRC04:01
*** dsneddon has joined #openstack-ironic04:29
*** dsneddon has quit IRC04:49
TheJuliarpioso: ugh, it is what I feared re the log. I'll put up a patch tomorrow04:55
*** dsneddon has joined #openstack-ironic05:19
*** dsneddon has quit IRC05:24
rpiosoTheJulia: Sounds encouraging :) Please keep me looped in. I’d be glad to give it a test drive. Thanks, again!05:41
*** dsneddon has joined #openstack-ironic05:56
*** dsneddon has quit IRC06:01
*** dsneddon has joined #openstack-ironic06:28
*** dsneddon has quit IRC06:33
*** ociuhandu has joined #openstack-ironic06:34
*** ociuhandu has quit IRC06:39
*** Lucas_Gray has joined #openstack-ironic06:52
*** k_mouza has joined #openstack-ironic06:53
*** k_mouza has quit IRC06:58
*** dsneddon has joined #openstack-ironic06:59
*** dsneddon has quit IRC07:04
*** dsneddon has joined #openstack-ironic07:32
*** dsneddon has quit IRC07:37
*** bobmel has joined #openstack-ironic07:52
*** ociuhandu has joined #openstack-ironic08:00
*** dsneddon has joined #openstack-ironic08:04
*** ociuhandu has quit IRC08:05
*** dsneddon has quit IRC08:09
*** Lucas_Gray has quit IRC08:20
*** Lucas_Gray has joined #openstack-ironic08:23
*** Lucas_Gray has quit IRC08:32
*** Lucas_Gray has joined #openstack-ironic08:40
*** dsneddon has joined #openstack-ironic08:41
*** dsneddon has quit IRC08:46
*** naved001 has quit IRC09:02
*** mbeierl has quit IRC09:03
*** mbeierl has joined #openstack-ironic09:04
*** dsneddon has joined #openstack-ironic09:12
*** dsneddon has quit IRC09:17
*** dsneddon has joined #openstack-ironic09:48
*** dsneddon has quit IRC09:53
*** ociuhandu has joined #openstack-ironic10:26
*** dsneddon has joined #openstack-ironic10:26
*** aedc has joined #openstack-ironic10:30
*** ociuhandu has quit IRC10:31
*** dsneddon has quit IRC10:31
*** ociuhandu has joined #openstack-ironic10:32
*** ociuhandu has quit IRC10:38
*** ociuhandu has joined #openstack-ironic10:40
*** bobmel has quit IRC10:42
*** bobmel has joined #openstack-ironic10:46
*** bobmel has quit IRC10:50
*** bobmel has joined #openstack-ironic10:51
*** ociuhandu has quit IRC10:53
*** ociuhandu has joined #openstack-ironic10:55
*** ociuhandu has quit IRC10:57
*** dsneddon has joined #openstack-ironic11:06
*** dsneddon has quit IRC11:10
*** bobmel has quit IRC11:42
*** dsneddon has joined #openstack-ironic11:45
*** dsneddon has quit IRC11:50
*** bobmel has joined #openstack-ironic11:51
*** bobmel has quit IRC11:51
*** Lucas_Gray has quit IRC11:57
*** Lucas_Gray has joined #openstack-ironic11:59
*** vesper11 has joined #openstack-ironic12:08
*** vesper has quit IRC12:08
*** dsneddon has joined #openstack-ironic12:24
*** Lucas_Gray has quit IRC12:26
*** yolanda has joined #openstack-ironic12:26
*** dsneddon has quit IRC12:29
*** Lucas_Gray has joined #openstack-ironic12:47
*** dsneddon has joined #openstack-ironic12:57
*** dsneddon has quit IRC13:02
*** dsneddon has joined #openstack-ironic13:15
*** jerrywang1 has joined #openstack-ironic13:32
*** Lucas_Gray has quit IRC13:33
*** Lucas_Gray has joined #openstack-ironic13:33
*** Lucas_Gray has quit IRC13:57
*** Lucas_Gray has joined #openstack-ironic13:58
*** dsneddon has quit IRC14:18
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Rescan after restarting the md device  https://review.opendev.org/70663214:46
*** dsneddon has joined #openstack-ironic14:50
*** dsneddon has quit IRC14:55
*** vesper11 has quit IRC15:09
*** vesper11 has joined #openstack-ironic15:11
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Rescan devices before performing uefi checks  https://review.opendev.org/70666715:22
TheJuliarpioso: ^^^ That patch should fix things15:24
*** dsneddon has joined #openstack-ironic15:29
*** dsneddon has quit IRC15:35
*** Lucas_Gray has quit IRC15:43
rpiosoTheJulia: Ack. I’ll do my best to give it a spin sometime today.16:04
TheJuliarpioso:  thanks16:04
rpiosoTheJulia: Of course :-) Thank you!16:05
*** dsneddon has joined #openstack-ironic16:08
*** dsneddon has quit IRC16:14
rpiosoTheJulia: Won’t a new ramdisk need to be built with that change? Or could the existing tinyipa be cracked open and patched?16:18
* rpioso is low on caffeine16:19
*** jerrywang1 has quit IRC16:37
*** dsneddon has joined #openstack-ironic16:47
*** dsneddon has quit IRC16:52
*** Lucas_Gray has joined #openstack-ironic16:57
*** ianychoi has quit IRC16:57
*** ianychoi has joined #openstack-ironic16:58
TheJuliarpioso: it can be cracked open and patched17:03
*** Lucas_Gray has quit IRC17:04
* rpioso is on his phone17:10
*** dsneddon has joined #openstack-ironic17:16
*** Lucas_Gray has joined #openstack-ironic17:19
*** dsneddon has quit IRC17:22
*** Lucas_Gray has quit IRC17:50
*** Lucas_Gray has joined #openstack-ironic17:51
*** dsneddon has joined #openstack-ironic17:51
*** dsneddon has quit IRC17:56
*** jtomasek has joined #openstack-ironic17:56
rpiosoTheJulia: Is this an up-to-date recipe -- https://www.redhat.com/en/blog/repacking-red-hat-openstack-platform-director-or-tripleo-ipa-images ?18:04
*** Lucas_Gray has quit IRC18:13
*** dsneddon has joined #openstack-ironic18:31
*** dsneddon has quit IRC18:35
rpiosoTheJulia: Making progress ... I've extracted the content of the ramdisk. There was an error output at the end, "pax: Hard EOF on input, first EOF block is missing at -1." Is that a thing?18:41
rpiosoTheJulia: Also, I found image.pyc. May I replace it with the new image.py, without compiling it?18:42
*** Goneri has joined #openstack-ironic19:00
*** dsneddon has joined #openstack-ironic19:05
*** dsneddon has quit IRC19:10
*** bdodd has quit IRC19:22
* rpioso kicks off deployment with TheJulia's IPA patch19:24
*** bobmel has joined #openstack-ironic19:30
*** bobmel has quit IRC19:35
TheJuliarpioso: yeah, you should have been able to rm the .pyc file19:40
TheJuliasorry, was running errands19:40
*** dsneddon has joined #openstack-ironic19:41
rpiosoTheJulia: No worries at all.19:41
rpiosoIs only that one change needed? I see you posted another change to IPA last nite.19:41
TheJuliarpioso: that is a thing we're seeing in CI with software raid failing19:43
rpiosoTheJulia: I patched in only the change you put up this morning, https://review.opendev.org/706632, and kicked off a deployment.19:44
patchbotpatch 706632 - ironic-python-agent - Rescan after restarting the md device - 2 patch sets19:44
TheJuliathat was the one from last night19:44
TheJuliahttps://review.opendev.org/#/c/706667/19:45
patchbotpatch 706667 - ironic-python-agent - Rescan devices before performing uefi checks - 1 patch set19:45
rpiosoTheJulia: Ugh! Copy&paste challenges! I meant only https://review.opendev.org/70666719:45
patchbotpatch 706667 - ironic-python-agent - Rescan devices before performing uefi checks - 1 patch set19:45
*** dsneddon has quit IRC19:45
rpiosoimage.py rescans19:46
rpiosoTheJulia: The good news is that the result was different. The bad news is that it failed -- 'message': 'Command execution failed', 'details': 'Installing GRUB2 boot loader to device /dev/sda failed with Unexpected error while running command.\nCommand: mount /dev/sda2 /tmp/tmphc1rs3he\nExit code: 32\nStdout: \'\'\nStderr: "mount: /tmp/tmphc1rs3he: unknown filesystem type \'xfs\'.\\n".'19:46
rpiosoTheJulia: I confirmed the patch was executed by adding a debug log in _rescan() that outputs my last name. It's in the deployment log.19:49
*** Goneri has quit IRC19:58
TheJuliarpioso: fun!20:01
TheJuliarpioso: just to confirm this was an upstream partition image and ramdisk image?20:02
TheJuliaif so, can you provide the links, I think I'm going to need to take both apart20:02
rpiosoTheJulia: Yes, it's the RDO overcloud partition image.20:04
rpiosoTheJulia: The link is IMAGE_URLS="file:///opt/stack/devstack/files/overcloud-full.tar.gz"20:05
rpiosoOops20:05
rpiosoI fetched that local copy from https://images.rdoproject.org/master/rdo_trunk/current-tripleo/overcloud-full.tar20:06
* rpioso is still low on caffeine20:06
rpiosoTheJulia: The ramdisk is also from upstream. It's the Tiny Core-based one which the ironic devstack plugin fetches when IRONIC_RAMDISK_TYPE=tinyipa in local.conf.20:11
*** dsneddon has joined #openstack-ironic20:14
rpiosoTheJulia: The local copy of the RDO overcloud partition image has been cached locally the past several weeks. It has been successfully deployed with all boot_mode and boot_option combinations, except uefi / local.20:14
*** bobmel has joined #openstack-ironic20:14
*** goldyfruit has quit IRC20:17
*** goldyfruit has joined #openstack-ironic20:18
*** goldyfruit has quit IRC20:18
*** dsneddon has quit IRC20:18
*** bdodd has joined #openstack-ironic20:18
*** goldyfruit has joined #openstack-ironic20:19
*** goldyfruit has quit IRC20:20
*** goldyfruit has joined #openstack-ironic20:20
TheJuliarpioso: that is why you got that error then20:41
TheJuliarpioso: you need to use a fully fledged ramdisk, tinycore doesn't know about xfs because its use is purely intended for CI.20:41
*** jtomasek has quit IRC20:41
rpiosoTheJulia: I haven’t found a fully fledged ramdisk which works for Redfish vmedia boot and uefi / local / partition.20:45
TheJuliaI believe some elaboration is required20:45
rpiosoTheJulia: Recall RDO’s hasn’t worked for me. It has for derekh.20:46
TheJuliaWhat exactly have you been encoutering with other images20:46
TheJuliais this the kernel crash upon boot?20:46
rpiosoTheJulia: TheJulia: y20:46
* rpioso is on phone in a parking lot.20:47
TheJuliaokay20:47
TheJuliadid devstack build the ESP image?20:48
rpiosoTheJulia: Yes, I believe it did. I did not do so directly.20:52
*** dsneddon has joined #openstack-ironic20:53
TheJulialooks like it should be fine20:54
TheJuliabut it is going to build based upon your host OS20:54
TheJuliawhat OS are you using for devstack?20:54
rpiosoTheJulia: Ubuntu bionic20:54
* TheJulia wonders if bionic's bootloader won't boot centos20:55
*** dsneddon has quit IRC20:58
rpiosoTheJulia: Recall an initrd too big error is displayed on the system console. Perhaps that’s a red herring.20:59
openstackgerritJulia Kreger proposed openstack/ironic-python-agent-builder master: Add extra filesystem support  https://review.opendev.org/70667521:02
TheJuliarpioso: nice21:02
TheJuliarpioso: if you pull down ironic-python-agent-builder, apply that patch and give it a spin from the image built using that tool... it will hopefully then grok XFS21:03
TheJuliaas for the too big error, yeah, more info is required21:03
*** goldyfruit has quit IRC21:07
*** ociuhandu has joined #openstack-ironic21:13
*** bobmel has quit IRC21:20
*** bobmel has joined #openstack-ironic21:20
*** bobmel has quit IRC21:26
*** dsneddon has joined #openstack-ironic21:27
*** dsneddon has quit IRC21:32
rpiosoTheJulia: Should I keep IRONIC_RAMDISK_TYPE=tinyipa?21:33
TheJuliayour going to have to replace the built files on disk, so no real reason to restack at the moment21:35
TheJuliathat would at least give you an idea and hopefully the ramdisk will grok xfs21:35
* rpioso is unclear on how to get to “image built using that tool”.21:36
rpiosoTheJulia: I haven’t directly used the disk image builder.21:37
TheJuliahttps://docs.openstack.org/ironic-python-agent-builder/latest/admin/tinyipa.html21:38
TheJuliajust pull in the patch before you build it but after you clone it21:38
TheJuliaand then21:38
TheJuliareplace agent kernel/ramdisk in ?glance?21:38
*** Goneri has joined #openstack-ironic21:44
*** ociuhandu has quit IRC21:49
*** ociuhandu has joined #openstack-ironic21:52
*** ociuhandu has quit IRC21:52
*** dsneddon has joined #openstack-ironic22:05
*** dsneddon has quit IRC22:11
rpiosoTheJulia: Thanks, again!22:29
*** dsneddon has joined #openstack-ironic22:44
*** dsneddon has quit IRC22:48
rpiosoTheJulia: Does the operating system running on the system where the IPA ramdisk is built matter? My devstack is Ubuntu bionic and development system is Fedora 28. Earlier, I built the IPA ramdisk containing https://review.opendev.org/706667 on my development system. Of course, my development system has more tools installed.23:03
patchbotpatch 706667 - ironic-python-agent - Rescan devices before performing uefi checks - 1 patch set23:03
TheJuliarpioso: really shouldn't23:03
TheJuliaat least in terms of results23:04
rpiosoTheJulia: Cool23:07
*** dsneddon has joined #openstack-ironic23:24
*** dsneddon has quit IRC23:29
*** goldyfruit has joined #openstack-ironic23:46
*** ociuhandu has joined #openstack-ironic23:53
*** dsneddon has joined #openstack-ironic23:56
*** ociuhandu has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!