Monday, 2022-04-11

rpittaugood morning ironic! o/06:38
jandershey rpittau o/06:38
rpittauhey janders :)06:38
arne_wiebalckGood morning, Ironic!06:54
rpittauhey arne_wiebalck :)06:54
arne_wiebalckhey rpittau o/07:12
arne_wiebalckhey janders o/07:12
jandershey arne_wiebalck o/07:32
iurygregorygood morning Ironic09:36
arne_wiebalckhey iurygregory, good morning!10:16
iurygregoryo/10:24
dtantsurhappy Monday ironic11:47
dtantsuradmiyo: re ImportError, I wonder if it's some requirements mismatch11:47
EmilienMhello there, who else could give a +2 on https://review.opendev.org/c/x/pyghmi/+/836911 ? I'm tried sending an email to Jarrod but he didn't reply yet13:43
dtantsurEmilienM: I'm afraid only Jarrod13:44
EmilienMgreat13:49
rpittauunfortunately we don't have any control over that :/13:49
iurygregoryyeah, looking by the patches in the repo he would be the only one that can approve things13:50
* iurygregory is back o/13:50
opendevreviewEbbex proposed openstack/bifrost master: DNM: Is bindep the thing causing problems?  https://review.opendev.org/c/openstack/bifrost/+/83734814:25
rpittauebbex: not sure full explicit support for rocky and almalinux could be a thing in bifrost to be honest, I think that needs to be discussed with the community14:32
admiyoIs there an Ironic Stand-alone-ish option that gives a neutron setup?  Bifrost docs only talk about adding TLS or Keystone.  But we need some way to expose the BM nodes to the public networks.  Right now they only have network cards on the private side.  We can rewire if we have to, just want to confirm that we need to.14:32
admiyodtantsur, I'll take a look14:33
admiyodtantsur, if I cat /opt/stack/ironic-python-agent/requirements.txt I can see that Werkzeug>=1.0.1 which looks fairly recent14:36
admiyoBut pip has it up to 2.1.114:37
rpittauadmiyo: are you using a custom ipa ramdisk ?14:37
mallikI am trying to do anaconda based provisioning, when I do node validate, it fails for boot and deploy interfaces with an error Image <Glance Image ID> can not be found. 14:40
mallikI checked and the Image with the same ID is present in the Glance.14:40
malliknode is enrolled with redfish driver, deploy interface is set to anaconda and boot interface is set to pxe14:40
iurygregoryrpittau, do you want to add the topic rocky and almalinux support in bifrost for discussion in the meeting today?14:40
rpittauebbex: if you want to bring the topic to our weekly meeting, as iurygregory mentioned, it's in 20 minutes14:42
ameya49Hi iurygregory! Good Morning14:43
iurygregoryHi ameya49 o/14:44
iurygregorygood morning =)14:44
ameya49iurygregory : Did you got a chance to look at the traceback provided?14:44
iurygregoryI did on friday, but couldn't find anything yet .-.14:45
ameya49ohk. Let me know if more details needed or we can over a call sometime this week if feasible :)14:47
iurygregorymaybe we can share things in the upstream meeting in open discussion and see if people have more ideias14:48
iurygregorywdyt?14:50
ameya49yes, would be goo14:58
ameya49good*14:58
iurygregoryack 14:59
iurygregoryin open discussion we will talk about it14:59
iurygregory#startmeeting ironic15:00
opendevmeetMeeting started Mon Apr 11 15:00:00 2022 UTC and is due to finish in 60 minutes.  The chair is iurygregory. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'ironic'15:00
ameya49sure :) Thanks :iurygregory15:00
iurygregoryHello ironicers o/ welcome to our weekly meeting!15:00
iurygregorythe agenda for our meeting can be found in the wiki15:00
ajyao/15:00
iurygregory#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting15:00
rpittauo/15:00
stendulkero/15:00
kamlesh6808co/15:00
ameya49o/15:00
rpioso\o15:01
dtantsuro/15:01
iurygregoryok, let's start o/15:01
iurygregory#topic Announcements / Reminder15:01
iurygregoryReminder from the PTG =)15:01
iurygregory#info Check if you have any action items in the ptg etherpad =)15:02
iurygregoryso we don't miss anything important =)15:03
iurygregory#info Iury will be sending a summary of the PTG the list til wednesday15:04
iurygregorydoes anyone have anything else to add for announcements/reminder?15:04
iurygregoryok, moving on15:06
iurygregoryskipping the next two topics (since we will have subteam after we have the priorities for Zed)15:07
iurygregory#topic Deciding on priorities for the coming week15:07
iurygregory#link https://review.opendev.org/q/status:open+hashtag:ironic-week-prio15:07
iurygregoryDoes anyone have any patches that needs review?15:07
ameya49https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/82664615:08
ameya49can we please review above patch15:08
dtantsurI don't think I have anything new.. all downstream nowadays. but may produce a couple of patches later this week.15:09
iurygregoryameya49, ack I will check this one this week15:09
iurygregorydtantsur, ok15:09
ameya49iurygregory : Thanks15:09
iurygregoryI will add a patch later today for the Zed Priorities (FYI)15:10
dtantsur\o/15:10
iurygregoryok, moving on since we have topics for discussion today =)15:12
iurygregory#topic Open discussion15:12
iurygregoryameya49, feel free to give context and share some links related to your issue15:12
ameya49iurygregory : Yes, Thanks15:12
ameya49While running test_introspection_basic, once it verifies the introspected data and tries to boot_instance, it raises an error with nova quota values exceeded15:14
ameya49where if we see values of introspected data which are greater than default values of nova quota set15:14
ameya49thw workaround I tried by setting default nova quota values equal to introspected values for which it went ahead15:15
ameya49So, how can we go further with same approach, updating default quota values while test case is running?15:15
dtantsurwhich resources are you hitting the quota with?15:16
ameya49cores and ram15:17
dtantsurhmm.. ironic instances should not consume these any more. are you configuring the flavor correctly?15:17
opendevreviewEbbex proposed openstack/bifrost master: DNM: Is bindep the thing causing problems?  https://review.opendev.org/c/openstack/bifrost/+/83734815:17
iurygregoryhumm good point15:18
ameya49using default flavor (baremetal) which is getting created while devstack setup15:19
iurygregoryif is using the default flavor it will complain15:19
iurygregoryyou will need to override the configs from the flavor (we have some variables that you can set in local.conf I think)15:19
ameya49so do you suggest to create a new flavor while running? 15:19
dtantsurI think it's worth asking nova folks15:20
dtantsurwhy with resources:MEMORY_MB=0 it still consumes the quota15:20
dtantsurarne_wiebalck: do you have any experience ^^?15:20
iurygregoryArne is a bit busy today (he might not answer now)15:21
dtantsurah15:21
dtantsurI have little recent experience with nova, but it sounds like a bug on their side to me15:21
ameya49dtantsur : Do you suggest to raise a bug for same?15:22
dtantsurameya49: maybe ask on #openstack-nova first?15:23
dtantsurit's possible that we misunderstand something15:23
iurygregoryhttps://github.com/openstack/ironic/blob/7ac480412626c38fa3493088dbf49e29303491b6/devstack/lib/ironic#L2606-L261215:23
dtantsurshow them your flavor and your quotas15:23
iurygregorybecause of this right?15:23
ameya49dtantsur : sure. 15:23
dtantsurameya49: yeah. in my view, a flavor configured this way should only consume the (non-existing yet?) custom resource quota15:23
dtantsurbut I remember arne_wiebalck complained a lot about nova quota applied to ironic :)15:24
ameya49iurygregory : Yes15:24
* dtantsur is wondering if dansmith is by chance around15:24
dansmithin a meeting15:25
dtantsurk no worries15:25
rpiosodtantsur: Do you expect changing those to be non-zero would work around the issue?15:25
dtantsurrpioso: I would expect changing those to non-zero to break everything :)15:26
dtantsurit's possible that I don't understand how quota work. but I would expect the stuff set to zero to not count against the quota.15:26
dtantsurbut please do talk to someone from nova who understands these matters15:26
iurygregoryif IRONIC_VM_SPECS is 4GB the flavor only has 4GB in the flavor... I would expect nova to complain since the node will have more than 4GB...15:27
iurygregorysame would go for vcpu IRONIC_VM_SPECS_CPU15:27
dtantsurwhen it comes to scheduling, this stuff is overridden by resources15:28
dtantsurdunno about quota15:28
iurygregoryyup15:28
rpiosoPlease remind me ... Isn't introspection part of our gate?15:28
dtantsurit is15:28
iurygregoryyes15:28
dansmithnot totally following here, but nova's quota comes from the actual things in the flavor, and not the resource overrides15:29
ameya49to check default nova quota I was running "nova quota-show" which displays table of resources with its default values15:29
dtantsurdansmith: I guess this answers our question. is there a reason why?15:29
ameya49for cores default value is 2015:29
dansmithbecause the quota stuff comes from looong before the resource stuff15:30
dtantsurso, "nobody has changed that"?15:30
dansmithnot really, the flavor things are for presentation to the user and the resource stuff is more like instruction to the backends (i.e. placement)15:30
dtantsurdansmith: mmm, I see. this does not play too well with bare metal.15:31
dansmithit would be confusing to a user to see a flavor require X memory and Y be charged against their quota15:31
dansmithdtantsur: does anything in nova? :)15:31
dtantsurhaha :D15:31
dansmithbut yeah, let's talk about options later when I can focus15:31
dtantsurokie, thanks dansmith!15:31
iurygregoryty15:31
JayFrloo and zer0c00l likely have input to upstream quota discussions, so I'm pinging them15:32
dtantsurameya49: so, yeah, the values in the flavor do count against the quota.15:32
JayFI know they put in quite a bit of work to get quotas working, but I don't think the end result looks/acts very upstream15:32
dtantsurameya49: the immediate fix for you is to either increase the quota or decrease the values in the flavor15:32
iurygregoryso one way to workaround their issue is to set IRONIC_VM_SPECS IRONIC_VM_SPECS_CPU in their local.conf with other values15:32
ameya49datansur, iurygregory : Thanks. Will check those. 15:33
iurygregoryok, I think this is everything we have for Open Discussion, shall we move on?15:34
iurygregory#topic Baremetal SIG15:35
iurygregory#info  SIG meeting tomorrow with Manuel Holtgrewe on "Bare Metal for Health - Using OpenStack Ironic for HPC at Berlin Institute of Health" 14:00 UTC (2pm UTC) 15:35
* dtantsur would really love to hear that15:36
iurygregory#link https://etherpad.opendev.org/p/bare-metal-sig15:36
iurygregoryyou can find the details to join the meeting tomorrow in the etherpad above15:36
iurygregory#info arne_wiebalck requested a Forum slot for the Baremetal SIG15:36
iurygregory\o/15:36
iurygregory#topic RFE review15:37
iurygregoryDoes anyone have any RFE that we should discuss?15:38
iurygregoryok, moving on15:39
iurygregory#topic Who is going to run the next meeting?15:39
iurygregorydo we have any volunteers?15:39
dtantsurI'll be out - public holiday15:40
* iurygregory is wondering if is holiday in more places...15:41
rpittaualso on PTO15:41
rpiosoiurygregory: It is not a US national holiday.15:42
iurygregoryok, I will run the meeting o/15:42
iurygregoryin case we don't have quorum we can skip =)15:43
iurygregoryThanks everyone!15:43
iurygregory#endmeeting15:43
opendevmeetMeeting ended Mon Apr 11 15:43:43 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:43
opendevmeetMinutes:        https://meetings.opendev.org/meetings/ironic/2022/ironic.2022-04-11-15.00.html15:43
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/ironic/2022/ironic.2022-04-11-15.00.txt15:43
opendevmeetLog:            https://meetings.opendev.org/meetings/ironic/2022/ironic.2022-04-11-15.00.log.html15:43
arne_wiebalckdtantsur ameya re quotas, I just checked our flavors and they have resources:MEMORY_MB=0 etc set, but quota is not based on the values from the properties fields, but the "real" fields (vcpus, ram, disk), at least in our deployment15:50
dtantsurle sigh15:50
arne_wiebalckdtantsur ameya, so whenever we hand out nodes, these need to set on the project15:50
dtantsurarne_wiebalck: is it on purpose or because of the lack of custom resource quotas?15:51
arne_wiebalckthis is why I am bringing up per flavor quotas at every occasion (like now :-D)15:51
arne_wiebalckdtantsur: the lack of 15:51
dtantsurI see15:51
arne_wiebalckthe problem I have with resource class based quotas is that they do not mean much to users, but are rather sth in addition (but it would be better than what we have now)15:52
arne_wiebalckiurygregory: thanks for stepping, sorry I missed the meeting!15:52
opendevreviewEbbex proposed openstack/bifrost master: Add support for almalinux and rocky  https://review.opendev.org/c/openstack/bifrost/+/83723515:55
arne_wiebalck*stepping in16:01
dtantsurfolks, an opportunity for some bike shedding. I'd like to update driver_info[kernel_append_params] to be able to not completely overwrite [???]kernel_append_params, but append to it16:05
dtantsurI'm thinking about syntax like "%default% extra_arg=42 extra_arg2"16:05
dtantsurI could go for "$default ..." but it seems like $ is a valid and popular value in kernel params (% is mostly used after numbers)16:06
dtantsurthoughts?16:06
dtantsuralso $default is less shell-friendly16:08
rpittauI would exclude $default, too dangerous and conflicting16:13
rpittau%default% sounds ok, I can't think anything better honestly :)16:13
dtantsuryeah, I'll go with it16:14
rpittaugood night! o/16:22
iurygregorybye rpittau o/16:27
opendevreviewDmitry Tantsur proposed openstack/ironic master: Allow reusing defaults in per-node kernel_append_params  https://review.opendev.org/c/openstack/ironic/+/83737916:57
dtantsurhere goes!16:57
dtantsurgood night folks o/17:17
ebbexIs there a place/channel where opendev/bindep bugs reported/handled?17:21
admiyorpittau, yeah, I need to build the ramdisk for my deploy as I am on aarch6417:25
erbarrhello, Dell third party CI is broken on Train. Basically issues with tempest not installing properly with devstack. I can hack at at it to either do what tempest does outside of tempest and not deal with that issue, not a big deal. Just wondering if third party CI needs to be healthy in Extended Maintenance branches. Thanks!19:58
*** dmellado_ is now known as dmellado21:59

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!