Tuesday, 2021-11-30

opendevreviewSteve Baker proposed openstack/bifrost master: Use distro conf loader_file_paths to copy ipxe/grub files  https://review.opendev.org/c/openstack/bifrost/+/81870901:20
opendevreviewSteve Baker proposed openstack/bifrost master: WIP support grub network boot  https://review.opendev.org/c/openstack/bifrost/+/80722001:20
opendevreviewHarald Jensås proposed openstack/metalsmith master: Set binding:host_id on VIFs  https://review.opendev.org/c/openstack/metalsmith/+/81974301:20
opendevreviewHarald Jensås proposed openstack/metalsmith master: Set binding:host_id on VIFs  https://review.opendev.org/c/openstack/metalsmith/+/81974301:21
opendevreviewHarald Jensås proposed openstack/metalsmith master: Set binding:host_id on VIFs  https://review.opendev.org/c/openstack/metalsmith/+/81974301:23
hgy_Good morning, Ironic!01:31
opendevreviewSteve Baker proposed openstack/bifrost master: WIP support grub network boot  https://review.opendev.org/c/openstack/bifrost/+/80722004:34
hgyGood afternoon, ironic!07:14
arne_wiebalckGood morning hgy and Ironic!07:27
hgyGood morning arne_wiebalck!07:31
muellerbegood morning arne_wiebalck o/07:31
arne_wiebalckhey hgy and muellerbe o/07:31
jandershey hgy arne_wiebalck muellerbe and Ironic o/07:41
muellerbehey janders o/07:41
rpittaugood morning ironic! o/07:53
muellerbegood morning rpittau o/07:54
rpittauhey muellerbe :)07:57
opendevreviewRiccardo Pittau proposed openstack/ironic bugfix/18.1: Clarify driver load error message  https://review.opendev.org/c/openstack/ironic/+/81967808:12
opendevreviewRiccardo Pittau proposed openstack/ironic master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/ironic/+/81976408:44
opendevreviewRiccardo Pittau proposed openstack/ironic master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/ironic/+/81976408:58
dtantsurgood morning folks08:59
dtantsurwe may need to make ironic-tox-unit-with-driver-libs, there seems to be a breakage in proliantutils09:25
dtantsurstendulker: FYI ^^^09:25
dtantsurhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_3cc/819729/1/check/ironic-tox-unit-with-driver-libs/3cc5240/testr_results.html09:25
dtantsur* make <job> non-voting I mean09:25
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/bifrost/+/81978009:41
opendevreviewRiccardo Pittau proposed openstack/ironic-inspector master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/ironic-inspector/+/81978109:43
opendevreviewRiccardo Pittau proposed openstack/ironic-lib master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/ironic-lib/+/81978209:44
opendevreviewRiccardo Pittau proposed openstack/ironic-prometheus-exporter master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/81978309:46
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/ironic-python-agent/+/81978409:47
opendevreviewPiotr Parczewski proposed openstack/bifrost master: Add support for root filesystem UUID customisation  https://review.opendev.org/c/openstack/bifrost/+/81978509:48
opendevreviewMerged openstack/ironic stable/wallaby: Clarify driver load error message  https://review.opendev.org/c/openstack/ironic/+/81958809:51
opendevreviewRiccardo Pittau proposed openstack/metalsmith master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/metalsmith/+/81978609:51
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/ironic-python-agent/+/81978409:53
opendevreviewRiccardo Pittau proposed openstack/ironic-lib master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/ironic-lib/+/81978209:54
dtantsurproliantutils fix is https://review.opendev.org/c/x/proliantutils/+/81978709:55
dtantsurdo we still want to make the job temporary non-voting?09:55
rpittaulet's give it some time ? unless we have something urgent to merge09:59
opendevreviewRiccardo Pittau proposed openstack/networking-baremetal master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/networking-baremetal/+/81979210:02
opendevreviewRiccardo Pittau proposed openstack/networking-generic-switch master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/networking-generic-switch/+/81979310:04
opendevreviewRiccardo Pittau proposed openstack/python-ironicclient master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/python-ironicclient/+/81979410:05
opendevreviewRiccardo Pittau proposed openstack/python-ironic-inspector-client master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/81979610:07
opendevreviewRiccardo Pittau proposed openstack/sushy master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/sushy/+/81979710:08
opendevreviewRiccardo Pittau proposed openstack/virtualbmc master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/virtualbmc/+/81979810:09
mnasiadkaGood morning10:15
ajyadtantsur: about idrac virtual media boot - during integration testing found that issue is still there for AMD systems :(. Checking with firmware team and based on that will see if need to wait for the fix to proceed with the patch.10:26
arne_wiebalckhey janders o/10:27
dtantsurajya: :(10:29
opendevreviewMerged openstack/ironic stable/xena: Clarify driver load error message  https://review.opendev.org/c/openstack/ironic/+/81958711:43
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Stop exposing JSON RPC to the whole network  https://review.opendev.org/c/openstack/bifrost/+/81964912:09
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Terminate TLS on Nginx  https://review.opendev.org/c/openstack/bifrost/+/81964012:10
iurygregorygood morning Ironic o/12:12
dtantsurhey-hey iurygregory! how is Brazil?12:13
iurygregoryhey dtantsur o/, well very hot... =X12:13
dtantsuras expected :D12:13
iurygregory28 feels like 32 :D12:13
iurygregoryyeah12:13
iurygregorywell it will be worst in January :D12:13
dtantsurit's not going to perfect in January here either :)12:27
iurygregoryyeah, anything urgent that needs attention today? (I'm on PTO today, but tomorrow and Thursday I will be working :D)12:33
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Stop exposing JSON RPC to the whole network  https://review.opendev.org/c/openstack/bifrost/+/81964912:41
dtantsuriurygregory: don't work on PTO :)12:42
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Terminate TLS on Nginx  https://review.opendev.org/c/openstack/bifrost/+/81964012:42
iurygregory:D12:49
opendevreviewDmitry Tantsur proposed openstack/ironic master: [WIP] All-in-one Ironic service with a local RPC bus  https://review.opendev.org/c/openstack/ironic/+/81962013:19
*** sshnaidm|afk is now known as sshnaidm13:29
opendevreviewMerged x/sushy-oem-idrac master: Fix moved tests  https://review.opendev.org/c/x/sushy-oem-idrac/+/81664113:44
opendevreviewMerged openstack/metalsmith master: Set binding:host_id on VIFs  https://review.opendev.org/c/openstack/metalsmith/+/81974313:53
opendevreviewRiccardo Pittau proposed x/sushy-oem-idrac master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/x/sushy-oem-idrac/+/81988314:10
TheJuliagood morning14:12
opendevreviewAija Jauntēva proposed x/sushy-oem-idrac master: Add destructive field flag to export configuration  https://review.opendev.org/c/x/sushy-oem-idrac/+/81681514:16
rpittaugood morning TheJulia :)14:20
TheJuliamy brain doesn't want to wake up today14:29
opendevreviewHarald Jensås proposed openstack/metalsmith stable/xena: Set binding:host_id on VIFs  https://review.opendev.org/c/openstack/metalsmith/+/81983114:51
opendevreviewHarald Jensås proposed openstack/metalsmith stable/wallaby: Set binding:host_id on VIFs  https://review.opendev.org/c/openstack/metalsmith/+/81983214:51
dtantsurmorning TheJulia 15:20
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Terminate TLS on Nginx  https://review.opendev.org/c/openstack/bifrost/+/81964015:26
dtantsuroslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID15:40
dtantsuris caused by my all-in-one patch, even though it doesn't change anything on this code path15:40
dtantsurI don't even...15:41
dtantsurand of course it cannot be reproduced locally15:41
dtantsurrpittau: a thought: if adding Stream 9 support to Bifrost is not crazily complex, we need to backport it to Xena. Then if Yoga breaks Stream 8, we still have an upgrade path.15:58
rpittaudtantsur: it doesn't look too crazy, it installs and run fine, just need to understand what's failing and why :/16:00
dtantsur"what's failing and why" is sometimes the key question :)16:01
rpittauI expressed myself poorly, I know what's failing, I don't know why! :D16:05
rpittaubut I'll remove the WIP from the patch because it seems good on installation and configuration16:05
rpittauwell, ok, I'll leave WIP until the job is passing to avoid rerunnig the entire CI16:14
opendevreviewRiccardo Pittau proposed openstack/bifrost master: [WIP] Run bifrost on CentOS Stream 9  https://review.opendev.org/c/openstack/bifrost/+/81905816:14
opendevreviewDmitry Tantsur proposed openstack/ironic master: [WIP] All-in-one Ironic service with a local RPC bus  https://review.opendev.org/c/openstack/ironic/+/81962016:51
opendevreviewDmitry Tantsur proposed openstack/ironic master: DNM try to repair RPC  https://review.opendev.org/c/openstack/ironic/+/81990316:51
rpittaugood night! o/17:09
dtantsurfolks, especially TheJulia, the whiteboard now has draft Yoga themes: https://etherpad.opendev.org/p/IronicWhiteBoard17:09
NobodyCamTop of the Not Monday Morning Ironic'ers17:12
dtantsurNot So Much Monday :)17:13
dtantsurgood morning NobodyCam :)17:13
NobodyCamHey hey dtantsur :) 17:13
NobodyCamarne_wiebalck would love to see what your thoughts on https://review.opendev.org/c/openstack/nova/+/813897 are..17:24
opendevreviewMerged openstack/ironic-prometheus-exporter master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/81978317:35
opendevreviewMerged openstack/sushy master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/sushy/+/81979718:06
opendevreviewMerged openstack/metalsmith master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/metalsmith/+/81978618:19
dtantsuro/18:21
opendevreviewMerged openstack/ironic-python-agent master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/ironic-python-agent/+/81978418:24
opendevreviewMerged openstack/ironic-tempest-plugin master: Update jobs for yoga cycle  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/81932118:24
opendevreviewMerged openstack/python-ironicclient master: Test python 3.6 for distributions compatibility  https://review.opendev.org/c/openstack/python-ironicclient/+/81979418:24
TheJuliablarg drain18:47
TheJuliaerr, brain18:47
stevebaker[m]morning19:42
jandersgood morning Ironic o/21:04
arne_wiebalckNobodyCam: this issues has hit us as well, to a level where we removed all that rebalance logic from our deployment a while ago21:07
arne_wiebalckNobodyCam: TheJulia: the hash ring rebalancing is a tricky area and I would not trust my review without testing it IRL tbh21:15
arne_wiebalckNobodyCam: TheJulia: testing it, however, is not that obvious either (in our deployment)21:16
NobodyCamoh interesting approach 21:16
NobodyCamthat was my concern I was thinking about a logic flag that could switch between old and new logic, but that could make it much more complicated 21:18
arne_wiebalckNobodyCam: TheJulia: at the moment we're quite ok with the 1 n-c per conductor group setup, but I talked to Belmiro about it today, actually, and we will have a look if we can test it somehow ... 21:18
TheJuliao'rly removed it all21:18
arne_wiebalckNobodyCam: TheJulia: I will leave a comment supporting the comments already made by you, Chris, and Arun confirming that this is an issue21:19
arne_wiebalckTheJulia: yes, caused too many issues21:19
TheJuliaYeah, I think we can all agree it is a pain point, just wanting to make sure we don't make things worse21:19
TheJuliasounds like things were pretty bad for you all at cern21:19
arne_wiebalckTheJulia: but, IIRC, this was before conductor groups21:19
TheJuliato excise it out...21:19
arne_wiebalckwell, I think Belmiro had to clean up database a couple of times, and at some point we had to take a decision :)21:20
arne_wiebalckwith a few thousand nodes it becomes painful21:21
TheJuliayeah, the manual db is what we want to avoid21:21
* NobodyCam agrees 21:21
TheJuliawe have a client that had to do it because they did some other work and ended up "migrating" to new controllers whilst also upgrading21:21
NobodyCamexplode-y-head emoji21:22
arne_wiebalckthe problem to test for us is to backport this to Stein/Train, then have a conductor group with a few hundred (prod?) instances, and then switch n-c on and off ... sounds like asking for trouble :)21:30
arne_wiebalckwhile the instances will probably be safe, we may need to clean up in the db if things do not work out 21:31
TheJuliaabsolutely does sound like trouble21:37
TheJuliayeah21:38
TheJuliaWell, it is all data points21:38
arne_wiebalckright ... we'll have a look at what we can do!21:53
opendevreviewSteve Baker proposed openstack/bifrost master: WIP support grub network boot  https://review.opendev.org/c/openstack/bifrost/+/80722022:29
opendevreviewJulia Kreger proposed openstack/python-ironicclient master: WIP: node history support  https://review.opendev.org/c/openstack/python-ironicclient/+/81992923:11
*** pmannidi is now known as pmannidi|AFK23:19

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!