Wednesday, 2021-11-10

opendevreviewZhouHao proposed openstack/ironic master: [iRMC] Convert the type of irmc_port to int  https://review.opendev.org/c/openstack/ironic/+/81715401:08
opendevreviewJacob Anders proposed openstack/sushy master: Changing boot device string for vmedia on SuperMicro  https://review.opendev.org/c/openstack/sushy/+/81713706:17
opendevreviewZhouHao proposed openstack/ironic master: [iRMC] Convert the type of irmc_port to int  https://review.opendev.org/c/openstack/ironic/+/81715406:51
iurygregorygood morning Ironic o/06:53
arne_wiebalckGood morning iurygregory and Ironic!07:04
iurygregorymorning arne_wiebalck o/07:04
* iurygregory needs more coffee07:05
arne_wiebalck+107:05
rpittaugood morning ironic! o/08:13
iurygregorygood morning rpittau o/08:14
rpittauhey iurygregory :)08:14
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent master: Move rescan device function to general utils  https://review.opendev.org/c/openstack/ironic-python-agent/+/81691608:29
*** akahat|rover is now known as akahat|lunch08:44
dtantsurmorning ironic08:53
iurygregorymorning dtantsur o/08:55
*** akahat|lunch is now known as akahat|rover09:13
*** melwitt is now known as Guest550810:12
opendevreviewJacob Anders proposed openstack/sushy master: Changing boot device string for vmedia on SuperMicro  https://review.opendev.org/c/openstack/sushy/+/81713710:32
opendevreviewJacob Anders proposed openstack/sushy master: Changing boot device string for vmedia on SuperMicro  https://review.opendev.org/c/openstack/sushy/+/81713710:40
*** dviroel|out is now known as dviroel11:16
opendevreviewDmitry Tantsur proposed openstack/ironic master: Stop relying on explicit values of Redfish constants  https://review.opendev.org/c/openstack/ironic/+/81738611:28
dtantsurcould I get a 2nd +2 on https://review.opendev.org/c/openstack/sushy-tools/+/806253 please?11:39
iurygregorydtantsur, I will take a look later today =)13:25
dtantsurthx!13:32
opendevreviewBernd Mueller proposed openstack/ironic-python-agent-builder master: add element-deps for element burn-in  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/81740813:42
opendevreviewBernd Mueller proposed openstack/ironic-python-agent-builder master: more details where to find the iso-image-create script  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/81743013:49
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent master: Move rescan device function to general utils  https://review.opendev.org/c/openstack/ironic-python-agent/+/81691614:34
opendevreviewDmitry Tantsur proposed openstack/sushy master: WIP certificate collection  https://review.opendev.org/c/openstack/sushy/+/81547914:43
rpittauehm... is https://zuul.openstack.org/status working for anyone ?14:58
rpittauooook looking at the opendev channel seems there is an actual issue, all good15:02
opendevreviewBernd Mueller proposed openstack/ironic-python-agent-builder master: add element-deps for element burn-in  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/81740815:21
iurygregoryI really don't get why gerrit wants to set attention for the owner of the patch when we add +2 and/or +W LOL15:38
dtantsuryeah, I'm puzzled just as well15:57
dtantsursee you tomorrow folks15:57
iurygregorybye dtantsur o/15:57
*** akahat|rover is now known as akahat|lunch16:03
*** akahat|lunch is now known as akahat|dinner16:03
rpittaubye everyone, see you on monday! o/16:31
opendevreviewMerged openstack/sushy-tools master: Support uploading certificates for virtual media  https://review.opendev.org/c/openstack/sushy-tools/+/80625316:45
*** akahat|dinner is now known as akahat|rover16:52
arne_wiebalckbye everyone, see you tomorrow o/17:05
TheJuliaNobodyCam: you around?17:09
NobodyCamno ;p17:09
NobodyCamhehehehe17:09
NobodyCamGood Morning Ironic Folks!17:09
NobodyCamI feel I am more rectangle then round17:10
NobodyCamI am actually here17:15
TheJuliaI mean, I guess one can be square17:15
TheJuliawe don't judge people here ;)17:15
NobodyCamLOL17:15
NobodyCamhow are you this morning?17:15
TheJuliaNext, we'll find out NobodyCam is alternating between being a greaser and then a square17:16
NobodyCamhehehehe17:16
TheJuliaSo, I'm working on this nova patch17:17
TheJulia... and you mentioned to me you had compute nodes just disappear rippling out from a rebalance right?17:18
NobodyCamyes!17:19
NobodyCamoh I see https://review.opendev.org/c/openstack/nova/+/813263 merged :happy_dance:17:19
NobodyCamsay one has three conductors (1,2,3) each with it's own nova-compute running on the conductor. restart nova-compute on say 2 and see what nodes are missing17:21
TheJuliajust a restart, and... oh17:25
NobodyCamonly way I know ti ensure all nodes make it back, is to shut down all the ironic nova-compute services and restart one by one letting each instance reach active state before moving on to the next17:25
TheJuliaoh, ouch17:26
NobodyCams/ti/to/17:26
TheJuliayeah17:26
TheJuliabecause the hash ring rebalance says otherwise17:26
TheJuliaso yeah. ouch17:26
NobodyCam813263 will make a massive improvement in amount of time it takes17:27
NobodyCamif there was a node reregister function that would force recreate the missing hypervisor record that would help a bunch, as the only other option I know of to recover the hypervisor record is to delete and reenroll the node17:29
TheJuliaNobodyCam: https://github.com/openstack/nova/blob/fded762f4df26ff5706438a66da33ff966f833c6/nova/compute/manager.py#L10024 right?17:32
TheJuliaoh gawd17:35
NobodyCamI see 12 occurrences of that in the last 24 hours17:36
TheJuliaif the hash ring calculates it out but the record in the db it should be on the host17:36
TheJuliait deletes it17:36
TheJuliaso basically, node x gets moved to compute y17:36
NobodyCamthis is what I see:17:40
NobodyCamhttps://www.irccloud.com/pastebin/6AY0a17B/17:40
TheJuliaany evidence of a rebalance in the logs?17:42
NobodyCamthat region listed 4 occurrences of Deleting orphan compute node in the last 24 hours17:43
TheJuliabingo17:43
TheJuliawell17:44
TheJuliasemi-bingo17:44
TheJuliaNobodyCam: is there already a bug filed for this that your aware of?17:56
NobodyCamI thought so17:58
NobodyCamhttps://bugs.launchpad.net/nova/+bug/182587618:01
NobodyCammaybe18:01
TheJuliakind of yeah18:05
TheJuliainstance goes invisible in the list, I think they meant nova-compute service in their thing18:05
TheJuliaanyway, yeah18:05
TheJuliathat would trigger that case18:05
* TheJulia awaits git review to return18:13
TheJuliaNobodyCam: https://review.opendev.org/c/openstack/nova/+/81389718:18
TheJuliaarne_wiebalck: ^18:18
* NobodyCam clicks the link18:18
TheJuliaNobodyCam: https://review.opendev.org/c/openstack/nova/+/817467 might be what you really need in the end18:43
TheJuliawhich should fully prevent orphaned nodes, and the logic changes... I think... should prevent the need for all of the computes to be bounced18:44
opendevreviewJulia Kreger proposed openstack/ironic master: Test nova-compute fix  https://review.opendev.org/c/openstack/ironic/+/81326418:59
opendevreviewJulia Kreger proposed openstack/ironic-python-agent bugfix/8.1: Output verbose info from efibootmgr  https://review.opendev.org/c/openstack/ironic-python-agent/+/81746819:06
opendevreviewJulia Kreger proposed openstack/ironic-python-agent bugfix/8.1: Delete EFI boot entry duplicate labels first  https://review.opendev.org/c/openstack/ironic-python-agent/+/81746919:06
opendevreviewJulia Kreger proposed openstack/ironic-python-agent bugfix/8.1: Fix UEFI record regex  https://review.opendev.org/c/openstack/ironic-python-agent/+/81747019:06
opendevreviewMerged openstack/ironic-python-agent master: Re-read the partition table with partx -a, part 2  https://review.opendev.org/c/openstack/ironic-python-agent/+/81719719:19
opendevreviewJulia Kreger proposed openstack/ironic-python-agent master: Remove metalsmith centos7 job  https://review.opendev.org/c/openstack/ironic-python-agent/+/81747219:30
opendevreviewJulia Kreger proposed openstack/metalsmith master: CI: remove old centos7 job  https://review.opendev.org/c/openstack/metalsmith/+/81324919:36
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent stable/xena: Re-read the partition table with partx -a, part 2  https://review.opendev.org/c/openstack/ironic-python-agent/+/81741919:53
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent bugfix/8.1: Re-read the partition table with partx -a, part 2  https://review.opendev.org/c/openstack/ironic-python-agent/+/81742019:53
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent stable/wallaby: Re-read the partition table with partx -a, part 2  https://review.opendev.org/c/openstack/ironic-python-agent/+/81742119:53
TheJuliarpittau: should those partition table read changes be back ported further?20:19
opendevreviewVerification of a change to openstack/ironic bugfix/18.1 failed: Fix idrac-wsman deploy with existing non-BIOS jobs  https://review.opendev.org/c/openstack/ironic/+/81710720:53
*** dviroel is now known as dviroel|out21:15
jandersgood morning Ironic o/22:17
TheJuliagood morning janders 22:44
TheJuliaso quesiton for folks, are we aware older builds of tinyipa are broken?22:44
jandershey TheJulia22:53
opendevreviewJacob Anders proposed openstack/sushy master: Changing boot device string for vmedia on SuperMicro  https://review.opendev.org/c/openstack/sushy/+/81713723:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!