Friday, 2019-11-29

*** ociuhandu has joined #openstack-ironic00:38
*** ociuhandu has quit IRC00:43
*** goldyfruit___ has joined #openstack-ironic00:54
kaifeng|afkgoldyfruit___: there is no way to get uuid from discovery, all we have at ironic-inspector side is the introspected data, which doesn't have the concept of uuid00:59
kaifeng|afkgoldyfruit___: however, if ironic-inspector will search node cache which is synced with ironic for the existing node using known information like ipmi address, mac address.01:00
kaifeng|afkif node not found hook is enabled, inspector will enroll a node to ironic, uuid is generated by ironic.01:01
*** ociuhandu has joined #openstack-ironic01:17
*** kaifeng|afk is now known as kaifeng01:18
*** goldyfruit___ has quit IRC01:20
*** ociuhandu has quit IRC01:26
*** ociuhandu has joined #openstack-ironic01:31
*** ociuhandu has quit IRC01:36
*** ociuhandu has joined #openstack-ironic02:44
*** ociuhandu has quit IRC02:51
*** rloo has quit IRC03:01
*** ociuhandu has joined #openstack-ironic03:04
*** ociuhandu has quit IRC03:08
*** ociuhandu has joined #openstack-ironic03:09
*** ociuhandu has quit IRC03:14
*** ociuhandu has joined #openstack-ironic03:32
*** michchap has joined #openstack-ironic03:39
*** ociuhandu has quit IRC03:46
*** ricolin has joined #openstack-ironic03:49
*** ricolin has quit IRC03:51
*** ricolin has joined #openstack-ironic04:09
*** adrianc has joined #openstack-ironic05:25
*** ociuhandu has joined #openstack-ironic05:30
*** ociuhandu has quit IRC05:35
openstackgerritIlya Etingof proposed openstack/ironic master: Add a CI job to UEFI boot over Redfish virtual media  https://review.opendev.org/69386705:43
*** jtomasek has joined #openstack-ironic05:53
*** yaawang has quit IRC06:04
*** yaawang has joined #openstack-ironic06:04
*** adrianc has quit IRC06:13
*** khansa has joined #openstack-ironic06:38
*** adrianc has joined #openstack-ironic06:39
*** rcernin has quit IRC07:24
*** ijw has quit IRC07:45
*** rpittau|afk is now known as rpittau08:04
rpittaugood morning ironic! Happy Friday! o/08:05
kaifenghey rpittau o/08:06
rpittauhey kaifeng :)08:06
rpiosoGood morning, kaifeng and rpittau \o08:06
rpittauhey rpioso :)08:06
khansaGood morning o/08:07
rpiosorpittau: I believe I may have found the source of my devstack challenge ^^^08:07
kaifengmorning rpittau o/08:07
kaifengand khansa o/08:07
etingofhappy Black Friday o/08:07
kaifengeh, rpioso o/08:07
etingofrpioso, what was it?08:07
rpittauhey khansa :)08:07
rpiosokhansa: Good morning!08:07
rpiosoetingof: ^^^08:07
* rpittau still stealing rpioso pings :D08:08
rpiosoetingof: Do you have the backscroll?08:08
etingofpoweroff is missing?08:08
rpiosoetingof: The ramdisk IPA doesn't appear to have the 'poweroff' command. What!?08:08
rpiosoetingof: Yep08:08
rpittaurpioso: oic08:08
rpittauwell that's interesting08:09
etingofrpioso, poweroff seems to work too well for me lately08:09
rpittaulol08:09
kaifengpath issue?08:09
rpiosorpittau: :-)08:09
etingofrpioso, how about unzipping ramdisk to see what's there?08:09
etingofrpioso, may be it's a search path problem?08:10
rpittauthat is really weird, we do issue poweroff in CI08:18
* rpioso needs to know where it can be found08:19
rpiosorpittau: Yeah. It's issued in ours, but fails. However, the node appears to have been successfully deployed. It's active and there's no last error.08:20
rpiosorpittau: I found the failure by looking in the conductor log.08:21
rpiosorpittau: I looked, because I saw other unexpected behavior while the instance booted post-deploy.08:22
*** bobmel has quit IRC08:22
*** ociuhandu has joined #openstack-ironic08:22
kaifengif ipa poweroff failed, there is oob power off followed08:22
*** ociuhandu has quit IRC08:22
rpiosoetingof: Where can I find the ramdisk?08:23
etingofopenstack image list08:23
etingofopenstack image save --file ...08:23
*** ociuhandu has joined #openstack-ironic08:23
rpiosoetingof: My poweroff and poweron still seem to be off.08:23
*** tesseract has joined #openstack-ironic08:24
*** khansa has quit IRC08:25
rpiosokaifeng: True08:26
*** ociuhandu has quit IRC08:28
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent master: Stop using six library  https://review.opendev.org/69660908:36
*** iurygregory has joined #openstack-ironic08:37
openstackgerritKaifeng Wang proposed openstack/ironic master: Start removing ipxe support from the pxe interface  https://review.opendev.org/69666608:37
iurygregorygood morning o/08:38
rpiosoetingof: It appears the node's boot device is not set to disk after the image has been laid down. Is boot_option:local required?08:39
kaifengiurygregory o/08:39
etingofrpioso, yes, if you want local boot08:40
iurygregorykaifeng, o/08:40
etingofrpioso, otherwise the node will boot off pxe/vmedia, then pivot to local disk08:40
rpiosoetingof: And that's exactly what I've been observing.08:41
rpiosoetingof: Hrm ... That didn't fix it.08:50
rpiosoetingof: It still boots off pxe and then pivots to local disk.08:50
rpiosoetingof: And the iDRAC reports it's been requested to PXE boot.08:50
rpiosoetingof: The node is using the redfish hw type.08:52
* rpioso has seen this with idrac WS-Man, too.08:52
rpiosoiurygregory: Good morning!08:53
iurygregorymorning rpioso o/08:53
etingofrpioso, I'd check out ironic logs to make sure it sets node to boot from disk when booting the instance08:53
openstackgerritRiccardo Pittau proposed openstack/ironic-lib master: Updating testing doc to py3  https://review.opendev.org/69659308:53
openstackgerritRiccardo Pittau proposed openstack/ironic-lib master: Updating testing doc to py3  https://review.opendev.org/69659308:54
rpittauhey iurygregory :)08:54
*** trident has quit IRC08:55
*** trident has joined #openstack-ironic08:56
rpiosoetingof: I see a PATCH in the conductor log at the end of deployment -- "body: {'Boot': {'BootSourceOverrideTarget': 'Pxe', 'BootSourceOverrideEnabled': 'Continuous'}}". Looks fishy ;-)09:01
etingofrpioso, I'd grep for all PATCH'es like this - this can be some intermediate thing... otherwise let's see what ironic says prior to this ^09:02
*** mbeierl has quit IRC09:02
rpiosoetingof: I did. The prior one was similar, except s/Continuous/Once/.09:03
rpiosoNo others follow the one above.09:04
etingofrpioso, this is where it should happen -- https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/redfish/boot.py#L76709:05
*** mbeierl has joined #openstack-ironic09:06
iurygregoryrpittau, o/09:06
rpiosoetingof: You're ahead of me. I'm using boot_inteface pxe and deploy_interface iscsi.09:07
openstackgerritIlya Etingof proposed openstack/ironic master: Fix UEFI NVRAM collision in devstack  https://review.opendev.org/69666809:07
etingofrpioso, ah, you referred to redfish so I thought it's redfish all the way09:07
* rpioso is trying to get there :-)09:08
*** S4r3n has joined #openstack-ironic09:08
*** alexmcleod has joined #openstack-ironic09:11
etingofblack Friday night miracle - one of vmedia boot CI jobs passed \o/09:12
etingofmust be a devstack glitch09:12
*** dougsz has joined #openstack-ironic09:13
openstackgerritRiccardo Pittau proposed openstack/ironic master: [WIP] Stop using six library  https://review.opendev.org/69666909:17
openstackgerritRiccardo Pittau proposed openstack/ironic-inspector master: Stop using six library  https://review.opendev.org/69661709:18
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent master: Stop using six library  https://review.opendev.org/69660909:18
*** ricolin has quit IRC09:18
rpiosoetingof: \o/09:19
rpiosoetingof: Did you get a deal?09:19
rpiosoetingof: I believe I may have found it. boot_option is in capabilities, instead of instance_info :(09:19
rpiosoMakes sense?09:19
*** ociuhandu has joined #openstack-ironic09:22
* rpioso crosses his fingers and kicks off another deployment 09:22
*** S4r3n has quit IRC09:26
*** derekh has joined #openstack-ironic09:28
*** ociuhandu has quit IRC09:28
*** ociuhandu has joined #openstack-ironic09:31
kaifengboot option can be both in capabilities and instance_info, and the latter takes precedence if memory serves09:33
*** ociuhandu has quit IRC09:35
*** ociuhandu has joined #openstack-ironic09:36
*** ociuhandu has quit IRC09:37
*** ociuhandu has joined #openstack-ironic09:38
etingofiurygregory, discovered a prayer that works on Zuul lately09:40
iurygregoryit works some times =)09:40
*** ociuhandu has quit IRC09:40
*** ociuhandu has joined #openstack-ironic09:41
openstackgerritIlya Etingof proposed openstack/ironic master: Add a CI job to legacy boot over Redfish virtual media  https://review.opendev.org/69301709:46
openstackgerritIlya Etingof proposed openstack/ironic master: Add a CI job to UEFI boot over Redfish virtual media  https://review.opendev.org/69386709:47
rpiosokaifeng:  Thank you09:50
*** ociuhandu has quit IRC09:55
*** ociuhandu has joined #openstack-ironic09:56
*** tssurya has joined #openstack-ironic10:14
*** ociuhandu has quit IRC10:19
*** ociuhandu has joined #openstack-ironic10:20
*** ociuhandu has quit IRC10:21
rpiosoIt tried to local boot and encountered the next error -- http://paste.openstack.org/show/786902/10:21
*** ociuhandu has joined #openstack-ironic10:22
*** ociuhandu has quit IRC10:24
*** ociuhandu has joined #openstack-ironic10:24
*** ociuhandu has quit IRC10:26
*** ociuhandu has joined #openstack-ironic10:27
* rpioso wonders if boot_mode needs to be set in instance_info, too10:30
*** rcernin has joined #openstack-ironic10:31
*** ociuhandu has quit IRC10:34
*** pcaruana has joined #openstack-ironic10:36
rpiosokaifeng: Do you have any insights into the iSCSI deploy failure -- http://paste.openstack.org/show/786902/ ? The hardware's boot mode is UEFI.10:40
iurygregoryis just me or the HP 3rd Party CI is with a lot of POST_FAILURE? .-.10:42
*** rcernin has quit IRC10:49
*** lennyb has joined #openstack-ironic10:51
*** iurygregory has quit IRC11:06
*** bobmel has joined #openstack-ironic11:29
*** dsneddon has quit IRC11:30
*** tzumainn has joined #openstack-ironic11:39
openstackgerritRiccardo Pittau proposed openstack/ironic master: [WIP] Stop using six library  https://review.opendev.org/69666911:40
*** ociuhandu has joined #openstack-ironic11:41
*** bobmel has quit IRC11:41
*** ociuhandu has quit IRC11:42
*** bobmel has joined #openstack-ironic11:52
*** chenhaw has quit IRC11:54
*** ociuhandu has joined #openstack-ironic11:57
*** iurygregory has joined #openstack-ironic12:01
*** lennyb has quit IRC12:07
*** lennyb has joined #openstack-ironic12:12
*** ociuhandu has quit IRC12:21
*** lennyb has quit IRC12:25
*** rcernin has joined #openstack-ironic12:30
*** lennyb has joined #openstack-ironic12:31
*** Blinkiz has joined #openstack-ironic12:36
*** lennyb has quit IRC12:41
*** dtantsur|afk is now known as dtantsur12:43
dtantsurmorning/afternoon ironic12:43
*** goldyfruit___ has joined #openstack-ironic12:43
iurygregorymorning dtantsur12:47
*** bobmel has quit IRC12:52
*** ociuhandu has joined #openstack-ironic12:57
*** bobmel has joined #openstack-ironic13:02
*** kaifeng_ has joined #openstack-ironic13:26
kaifeng_rpioso: i feel like i saw some patch mention such issue, but i am not sure if it is this one: https://review.opendev.org/#/c/67933313:27
patchbotpatch 679333 - ironic-python-agent - Don't try to put a bootloader in place when bootable (MERGED) - 15 patch sets13:27
*** Goneri has quit IRC13:27
*** rloo has joined #openstack-ironic13:30
*** bobmel has quit IRC13:30
*** Goneri has joined #openstack-ironic13:40
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent-builder master: DNM try Restart=on-failure for dhcp-all-interfaces  https://review.opendev.org/69653013:40
*** ociuhandu has quit IRC14:07
*** ociuhandu has joined #openstack-ironic14:08
*** ociuhandu has quit IRC14:13
*** ociuhandu has joined #openstack-ironic14:29
openstackgerritTzu-Mainn Chen proposed openstack/ironic master: Add owner to allocations and create relevant policies  https://review.opendev.org/69670714:33
*** ociuhandu has quit IRC15:13
*** ociuhandu has joined #openstack-ironic15:14
*** ociuhandu has quit IRC15:19
*** kaifeng_ has quit IRC15:20
rpiosokaifeng: Thank you. That one describes not UEFI, so not sure if it applies.15:31
rpiosoGood morning redux, ironicers15:32
rpiosodtantsur: I made more progress. IPA output is displayed on the console and IPA attempts to config the instance to boot from local disk. The issue I was seeing re: soft power off failure appears to be due to a missing 'poweroff' command. I haven't unzipped the ramdisk, yet.15:35
rpiosodtantsur: Config to boot from local disk fails -- http://paste.openstack.org/show/786902/15:36
rpiosoAny insights?15:37
dtantsurcheck if something had failed before that point? I'm not sure why the directory wouldn't exist15:37
openstackgerritRiccardo Pittau proposed openstack/ironic master: [WIP] Stop using six library  https://review.opendev.org/69666915:47
rpiosodtantsur: I don't see any failure before. Is cirros supported for local boot deployments?15:54
iurygregoryrpioso, best topic15:56
iurygregoryops rpittau15:56
iurygregory=)15:56
rpiosoIt's back!15:56
rpittaurpioso: this stealing pings is out of control! :D15:57
rpiosorpittau: lol15:57
iurygregoryLOL15:57
*** ociuhandu has joined #openstack-ironic16:02
dtantsurrpioso: nope. it does not have grub2.16:04
*** tssurya has quit IRC16:08
*** ociuhandu has quit IRC16:08
rpiosodtantsur: I've been using cirros :(16:12
iurygregorybrb going home o/16:12
*** tssurya has joined #openstack-ironic16:13
rpiosodtantsur: What do I need to change in my devstack to deploy local boot?16:13
dtantsurrpioso: IRONIC_DEFAULT_BOOT_OPTION={netboot,local}16:14
dtantsurthe default is netboot. local requires a *user* image (not IPA) that has grub216:14
rpiosodtantsur: So, place that setting in local.conf and redeploy devstack, right?16:15
dtantsurrpioso: yep (you can it manually on nodes as well)16:16
* rpioso thinks he's missing the needed user images.16:17
*** iurygregory has quit IRC16:17
* rpioso believes he understands what needs to change on the node object prior to kicking off deployment.16:17
dtantsurhjensas: restarts don't seem to help DIB https://de19e57dd79c29d6fa65-9c39e1b31aead2b89889cdc7bed43508.ssl.cf2.rackcdn.com/696530/5/check/ipa-tempest-wholedisk-bios-ipmi-direct-dib-src/9594460/controller/logs/ironic-bm-logs/node-0_no_ansi_2019-11-29-14%3A37%3A19_log.txt.gz16:24
dtantsuralso it seems that removing "retry" option doesn't disable it; the man page states a default of 5 mins16:29
*** tssurya has quit IRC16:29
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent-builder master: DNM try Restart=on-failure for dhcp-all-interfaces  https://review.opendev.org/69653016:31
openstackgerritRiccardo Pittau proposed openstack/ironic master: [WIP] Stop using six library  https://review.opendev.org/69666916:36
*** iurygregory has joined #openstack-ironic16:44
iurygregoryback o/16:46
*** jtomasek has quit IRC16:48
*** jtomasek has joined #openstack-ironic16:54
*** jtomasek has quit IRC16:56
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Bring libvirt domain down prior to any change  https://review.opendev.org/69662016:58
*** dtantsur is now known as dtantsur|afk17:04
dtantsur|afkhave a great weekend!17:04
iurygregoryyou too dtantsur|afk o/17:04
*** tzumainn has quit IRC17:05
openstackgerritRiccardo Pittau proposed openstack/ironic master: [WIP] Stop using six library  https://review.opendev.org/69666917:24
rpittaubye all have a great weekend! o/17:25
*** rpittau is now known as rpittau|afk17:25
*** ociuhandu has joined #openstack-ironic17:33
*** ociuhandu has quit IRC17:38
*** ociuhandu has joined #openstack-ironic17:43
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Retain boot device selection upon boot image change  https://review.opendev.org/69675217:44
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Always log via Flask application  https://review.opendev.org/69363917:45
*** alexmcleod has quit IRC17:56
*** dougsz has quit IRC17:58
*** iurygregory has quit IRC18:29
*** ociuhandu has quit IRC18:31
*** derekh has quit IRC18:59
*** ociuhandu has joined #openstack-ironic19:09
*** ociuhandu has quit IRC19:15
*** Blinkiz has quit IRC19:51
*** tesseract has quit IRC20:00
*** Goneri has quit IRC20:13
*** Blinkiz has joined #openstack-ironic20:28
*** jtomasek has joined #openstack-ironic20:35
*** hwoarang has quit IRC20:49
*** ociuhandu has joined #openstack-ironic20:50
*** hwoarang has joined #openstack-ironic20:50
*** ociuhandu has quit IRC20:55
rpiosoTheJulia: I set IRONIC_DEFAULT_BOOT_OPTION=local in local.conf and redeployed devstack as suggested above. The same error occurs during deployment.21:14
rpiosoTheJulia: And it looks like cirros was still uploaded into glance, so ... Any suggestion on how to get images which are local boot compatible?21:23
*** jtomasek_ has joined #openstack-ironic21:28
*** jtomasek has quit IRC21:32
*** pcaruana has quit IRC22:03
openstackgerritMerged openstack/ironic stable/train: Add timeout when querying agent's command statuses  https://review.opendev.org/69645822:24
*** ociuhandu has joined #openstack-ironic23:09
*** ociuhandu has quit IRC23:14
*** rcernin has quit IRC23:18

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!