Monday, 2019-04-08

*** hwoarang has quit IRC00:00
*** hwoarang has joined #openstack-ironic00:07
*** hwoarang has quit IRC00:20
*** hwoarang has joined #openstack-ironic00:22
*** hwoarang has quit IRC00:28
*** hwoarang has joined #openstack-ironic00:29
*** yaawang has quit IRC00:56
*** yaawang has joined #openstack-ironic00:58
*** whoami-rajat has joined #openstack-ironic01:19
*** tiendc has joined #openstack-ironic01:31
*** irclogbot_1 has quit IRC01:44
*** edleafe has quit IRC01:48
*** hwoarang has quit IRC02:02
*** hwoarang has joined #openstack-ironic02:03
*** yaawang has quit IRC02:28
*** yaawang has joined #openstack-ironic02:30
openstackgerritKaifeng Wang proposed openstack/ironic-inspector master: Support reapply with supplied introspection data  https://review.openstack.org/63903903:10
*** pcaruana has joined #openstack-ironic04:49
*** mkrai has joined #openstack-ironic04:50
*** pcaruana has quit IRC04:55
*** hwoarang has quit IRC05:21
*** hwoarang has joined #openstack-ironic05:23
*** e0ne has joined #openstack-ironic05:31
*** e0ne has quit IRC05:39
*** e0ne has joined #openstack-ironic05:56
*** e0ne has quit IRC06:04
*** ltomasbo has joined #openstack-ironic06:07
*** ltomasbo has left #openstack-ironic06:08
*** jtomasek has joined #openstack-ironic06:20
*** jtomasek has quit IRC06:22
*** jtomasek has joined #openstack-ironic06:23
*** pcaruana has joined #openstack-ironic06:30
arne_wiebalckgood morning, ironic!06:33
*** jtomasek has quit IRC06:49
*** jtomasek has joined #openstack-ironic06:49
*** jtomasek has quit IRC06:51
*** jtomasek has joined #openstack-ironic06:51
*** jtomasek has quit IRC06:59
*** jtomasek has joined #openstack-ironic07:00
arne_wiebalckdtantsur|afk: rpittau|afk: the reason for nodes going down when cleaning fails is here: https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/agent_base_vendor.py#L548 (this needs a parameter set I think)07:07
arne_wiebalckWhat I'm not clear on is the relation to the error handling in the manager, in particular this: https://github.com/openstack/ironic/blob/master/ironic/conductor/manager.py#L143007:07
arne_wiebalckCan you shed some light?07:07
*** e0ne has joined #openstack-ironic07:24
*** andrein has joined #openstack-ironic07:29
*** rpittau|afk is now known as rpittau07:48
rpittaugood morning ironic! o/07:48
*** dsneddon has joined #openstack-ironic07:52
*** yolanda_ has joined #openstack-ironic07:52
*** e0ne has quit IRC07:52
*** andrein has quit IRC07:53
*** lucasagomes has joined #openstack-ironic07:54
rpittauarne_wiebalck: yeah, the cleaning_error_handler called like that will cause a chain up to tear_down_inband_cleaning that powers off the node07:57
rpittauarne_wiebalck: the parameter is tear_down_cleaning itself07:57
*** dsneddon has quit IRC07:57
arne_wiebalckrpittau. yes, I verified: changing the param lets the node stay up07:57
arne_wiebalckrpittau: just not sure how the manager interacts here07:58
rpittaumy browser just crashed... monday \o/07:59
*** tssurya has joined #openstack-ironic07:59
rpittauarne_wiebalck: it seems the manager does basically the same in case of error08:02
rpittauit calls tear_down and powers off the node08:02
*** iurygregory has joined #openstack-ironic08:02
iurygregorygood morning all08:02
rpittauhi iurygregory :)08:02
iurygregoryo/08:03
openstackgerritraphael.glon proposed openstack/ironic master: Ansible module: fix clean error handling  https://review.openstack.org/64966508:07
*** dougsz has joined #openstack-ironic08:11
*** yolanda_ has quit IRC08:11
*** yolanda_ has joined #openstack-ironic08:11
arne_wiebalckrpittau: yes, but I'm not clear on when that would be called08:19
*** rcernin has quit IRC08:19
arne_wiebalckrpittau: I verified that agent_base_vendor seems to do the error handling and is shutting the node off in my case08:21
rpittauarne_wiebalck: in that specific case, the clean step can bring the node to 2 states, clean_wait or None (if it's completed). If the state is not one of those two, then it calls teh cleaning_error_handler08:21
arne_wiebalckrpittau: yes, but is the difference an exception vs the return code being not empty?08:21
arne_wiebalckrpittau: the difference on who is handling a cleaning error, I mean08:22
openstackgerritKaifeng Wang proposed openstack/ironic-inspector-specs master: WIP etcd coordination  https://review.openstack.org/65063008:22
arne_wiebalckrpittau: so, if the cleaning raises an exception the driver will handle it while if there is a non-empty return code the manager handles it?08:22
arne_wiebalckrpittau: I'm trying to figure out is the manager code needs some patching as well08:23
arne_wiebalcks/is/if/08:23
rpittauarne_wiebalck: it seems like the manager in both cases08:26
rpittauarne_wiebalck: actually it start from the manager but it always ends up in the hands of the driver, since what does the dirty job is tear_down_cleaning08:28
*** andrein has joined #openstack-ironic08:30
*** dsneddon has joined #openstack-ironic08:32
arne_wiebalckyes ... but cleaning_error_handler is the one that decides on the shutdown and this one seems to be called from multiple places08:32
arne_wiebalckif the general idea is that upon failure a node  in cleaning should not be switched off, it should apply in both scenarios08:33
*** derekh has joined #openstack-ironic08:33
arne_wiebalckscenarios: exception and non-zero return code08:34
arne_wiebalckanyway, I prepare a patch and we'll take it from there08:35
arne_wiebalckthx rpittau !08:35
*** dtantsur|afk is now known as dtantsur08:35
*** e0ne has joined #openstack-ironic08:36
dtantsurmorning ironic08:36
rpittauarne_wiebalck: for those scenarios probably calling the cleaning_error_handler with tear_down_cleaning to False should do the trick, or look like it's done for the fast_track08:37
rpittauarne_wiebalck: no problem08:38
arne_wiebalckrpittau: I tried already in qa08:38
arne_wiebalckrpittau: it does08:38
arne_wiebalckrpittau: the node stays up when I trigger an exception during cleaning08:38
*** mkrai has quit IRC08:38
arne_wiebalckrpittau: but I only changed the driver, not the manager and was wondering if that needs to be changed as well08:39
*** zigo_ has joined #openstack-ironic08:45
*** zigo_ is now known as zigo08:50
openstackgerritraphael.glon proposed openstack/ironic master: Ansible module: fix partition_configdrive.sh file  https://review.openstack.org/64966308:57
openstackgerritraphael.glon proposed openstack/ironic master: Ansible module: fix partition_configdrive.sh file  https://review.openstack.org/64966309:06
openstackgerritArne Wiebalck proposed openstack/ironic master: [Trivial] Fix typo in agent_base_vendor unit test  https://review.openstack.org/65063709:07
*** yolanda_ has quit IRC09:09
openstackgerritraphael.glon proposed openstack/ironic master: Ansible module: fix clean error handling  https://review.openstack.org/64966509:10
openstackgerritRiccardo Pittau proposed openstack/bifrost master: Collect all conf files under /etc  https://review.openstack.org/65030809:23
openstackgerritKaifeng Wang proposed openstack/ironic-inspector master: Remove deprecated ssl options  https://review.openstack.org/65082409:24
*** e0ne has quit IRC09:27
*** e0ne has joined #openstack-ironic09:34
openstackgerritRiccardo Pittau proposed openstack/bifrost master: Improve iptables test info collection  https://review.openstack.org/64994609:43
openstackgerritraphael.glon proposed openstack/ironic master: Ansible module: fix partition_configdrive.sh file  https://review.openstack.org/64966309:47
openstackgerritraphael.glon proposed openstack/ironic master: Ansible module: fix partition_configdrive.sh file  https://review.openstack.org/64966309:48
openstackgerritUros Orozel proposed openstack/ironic master: Can we recheck this?  https://review.openstack.org/65083209:48
openstackgerritKaifeng Wang proposed openstack/ironic-inspector master: Remove deprecated store_data_location  https://review.openstack.org/65083309:48
*** e0ne has quit IRC10:06
*** yolanda_ has joined #openstack-ironic10:11
openstackgerritRiccardo Pittau proposed openstack/bifrost master: Collect conf files under /etc  https://review.openstack.org/65030810:12
*** e0ne has joined #openstack-ironic10:13
*** Lucas_Gray has joined #openstack-ironic10:17
*** livelace has joined #openstack-ironic10:17
openstackgerritArkady Shtempler proposed openstack/ironic-tempest-plugin master: Single tenant tests: BM to BM and BM to VM  https://review.openstack.org/65083910:24
*** andrein has quit IRC10:25
openstackgerritNikolay Fedotov proposed openstack/ironic-python-agent master: Discover IPv6 BMC address  https://review.openstack.org/64079510:31
*** priteau has joined #openstack-ironic10:32
*** mbuil has quit IRC10:33
*** andrein has joined #openstack-ironic10:35
*** yolanda_ has quit IRC10:38
*** andrein has quit IRC10:41
*** andrein has joined #openstack-ironic10:44
*** hwoarang has quit IRC10:45
*** hwoarang has joined #openstack-ironic10:45
*** yolanda_ has joined #openstack-ironic10:48
*** hwoarang has quit IRC10:53
*** hwoarang_ has joined #openstack-ironic10:53
*** tiendc has quit IRC10:55
*** e0ne has quit IRC11:02
*** andrein has quit IRC11:04
*** e0ne has joined #openstack-ironic11:09
*** Lucas_Gray has quit IRC11:18
* dtantsur -> short walk11:20
*** dtantsur is now known as dtantsur|brb11:20
*** Lucas_Gray has joined #openstack-ironic11:22
openstackgerritMerged openstack/ironic stable/rocky: ipmi: Ignore sensor debug data  https://review.openstack.org/65010911:22
openstackgerritMerged openstack/ironic stable/queens: ipmi: Ignore sensor debug data  https://review.openstack.org/65011011:22
openstackgerritMerged openstack/ironic master: [Trivial] Fix typo in agent_base_vendor unit test  https://review.openstack.org/65063711:22
*** andrein has joined #openstack-ironic11:27
*** Lucas_Gray has quit IRC11:27
*** e0ne has quit IRC11:46
*** pcaruana has quit IRC11:47
*** bfournie has quit IRC11:50
*** e0ne has joined #openstack-ironic11:51
*** e0ne has quit IRC11:53
*** derekh has quit IRC11:58
*** priteau has quit IRC12:01
*** rh-jelabarre has joined #openstack-ironic12:02
jrollmorning all12:18
rpittauhey jroll :)12:20
*** bfournie has joined #openstack-ironic12:23
openstackgerritMerged openstack/ironic-ui stable/stein: Imported Translations from Zanata  https://review.openstack.org/65056412:24
*** pcaruana has joined #openstack-ironic12:38
*** michchap has joined #openstack-ironic12:43
*** edleafe has joined #openstack-ironic12:44
*** jcoufal has joined #openstack-ironic12:45
*** mmethot has joined #openstack-ironic12:45
*** dtantsur|brb is now known as dtantsur12:47
dtantsurmorning jroll12:48
needssleepgood morning12:48
dtantsurmorning needssleep :)12:48
needssleepI still need sleep12:49
*** needssleep is now known as TheJulia12:49
*** derekh has joined #openstack-ironic12:50
*** jroll has quit IRC12:50
* TheJulia sisp coffee12:50
*** jroll has joined #openstack-ironic12:50
*** brandor5 has joined #openstack-ironic12:52
brandor5tonyb: you around today? :)12:54
dtantsurTheJulia, rpittau, fun problem with mdns: you cannot register the same name from different conductors :-/12:55
*** macintoshme has joined #openstack-ironic12:55
TheJuliaI thought you could announce srv record data12:56
dtantsurTheJulia: right, but what happens if you try to announce the same thing several times?12:56
dtantsurthe library I use blows up :(12:56
openstackgerritNikolay Fedotov proposed openstack/ironic-python-agent master: Discover IPv6 BMC address  https://review.openstack.org/64079512:58
*** mjturek has joined #openstack-ironic13:00
michchaphey folks, I copied the standalone upstream job and with some small changes have it running locally. Since it has no nova services I can't set a flavor - is there another way to boot baremetal instances without a baremetal flavor or an aggregate?13:02
*** mjturek has quit IRC13:04
dtantsurmichchap: https://docs.openstack.org/ironic/latest/install/standalone.html scroll down13:06
michchapdtantsur: ty13:07
michchapdtantsur: will that still create the port in neutron, or is that skipped when doing a deploy using that method?13:10
michchapdtantsur: (for ansible-ml2 testing)13:10
dtantsurmichchap: you can do it, but nothing will happen magically13:10
dtantsurmichchap: you can try https://docs.openstack.org/metalsmith/latest/ I'm using it for all my local testing13:10
dtantsurdisclaimer: I wrote it :)13:10
michchapdtantsur: that looks nice, I'll give it a go. Cheers13:11
openstackgerritRiccardo Pittau proposed openstack/bifrost master: Collect conf files under /etc  https://review.openstack.org/65030813:13
*** mjturek has joined #openstack-ironic13:14
*** rloo has joined #openstack-ironic13:20
*** whoami-rajat has quit IRC13:28
*** pcaruana has quit IRC13:31
*** pcaruana has joined #openstack-ironic13:36
*** whoami-rajat has joined #openstack-ironic13:38
openstackgerritChristopher Dearborn proposed openstack/ironic-specs master: Add firmware update spec for Dell EMC hardware  https://review.openstack.org/60213213:40
*** Goneri has joined #openstack-ironic13:49
*** baha has joined #openstack-ironic14:16
openstackgerritVarsha Verma proposed openstack/ironic master: Removes `hash_distribution_replicas` configuration option  https://review.openstack.org/65091214:21
openstackgerritVarsha Verma proposed openstack/ironic master: Removes `hash_distribution_replicas` configuration option  https://review.openstack.org/65091214:26
*** spotz has joined #openstack-ironic14:27
openstackgerritChristopher Dearborn proposed openstack/ironic-specs master: Add firmware update spec for Dell EMC hardware  https://review.openstack.org/60213214:33
*** cdearborn has joined #openstack-ironic14:40
*** etingof is now known as etingof|afk14:41
*** diga has joined #openstack-ironic14:52
*** dnuka has joined #openstack-ironic14:58
*** kaifeng has joined #openstack-ironic14:59
TheJuliaI need lots of coffee today :)14:59
cdearborn+++ I hear that!15:00
iurygregorywe all do15:00
TheJulia#startmeeting ironic15:00
openstackMeeting started Mon Apr  8 15:00:17 2019 UTC and is due to finish in 60 minutes.  The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
TheJuliao/15:00
*** openstack changes topic to " (Meeting topic: ironic)"15:00
rpioso\o15:00
openstackThe meeting name has been set to 'ironic'15:00
rpittauo/15:00
iurygregoryo/15:00
bdoddo/15:00
cdearborno/15:00
TheJuliaFour meetings this morniing... :(15:00
TheJuliaAnyway, time for yet another ironic weekly meeting!15:00
mjtureko/15:00
rajiniro/15:00
arne_wiebalcko/15:00
dnukao/15:00
bahao/15:00
rlooo/15:01
TheJuliaI'm hoping this one is fairly quick today because we do need to assess people's interest in PTG topics for those that will and will not be there if there are things that are important to them as well.15:01
*** sthussey has joined #openstack-ironic15:01
TheJulia#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting15:01
TheJulia#topic Announcements / Reminders15:01
*** openstack changes topic to "Announcements / Reminders (Meeting topic: ironic)"15:01
mgoddardo/15:02
kaifengo/15:02
jroll\o15:02
TheJuliaAs discussed, the PTG discussion etherpad for the Train cycle can be found in the agenda, and I'll put the link in the meeting.15:02
TheJulia#link https://etherpad.openstack.org/p/DEN-train-ironic-brainstorming15:02
TheJuliaDoes anyone have any announcements or reminders?15:03
*** stendulker has joined #openstack-ironic15:03
stendulkero/15:03
dtantsur\o15:03
TheJuliaI'll take that as a No, so we can move on :)15:04
TheJulia#topic Review action items from previous meeting15:04
*** openstack changes topic to "Review action items from previous meeting (Meeting topic: ironic)"15:04
TheJulia#link http://eavesdrop.openstack.org/meetings/ironic/2019/ironic.2019-04-01-15.00.log.html15:04
TheJuliaI didn't get to my action items15:04
TheJulia#action TheJulia to get links for fast track posted and follow-up re-smartnics.15:04
TheJuliaSo carrying those forward this week.15:05
TheJuliaThere were no other items that I'm aware of or saw.15:05
TheJuliaMoving on!15:05
TheJulia#topic Review subteam status reports15:05
*** openstack changes topic to "Review subteam status reports (Meeting topic: ironic)"15:05
TheJulia#link https://etherpad.openstack.org/p/IronicWhiteBoard15:05
TheJuliaLine 23815:05
TheJuliaI wouldn't expect much to have changed over the last week. Largely it seems we had numerous sporadic failures impact us this past week in CI.15:06
dtantsuryeah15:07
TheJuliaLooking at the log, it actually looks like it impacted us heavily this past week. I know we've posted a couple minor fixes, so it looks like just the multinode job seems suspect at this point15:08
TheJuliaIs anyone looking at the multinode job?15:09
rlooI'm going to delete the Python3 first section (L242). If someone wants it as a topic for changes in Train -- add to the Train wishlist etherpad.15:09
TheJuliaWFM15:10
rlooTheJulia: wrt UEFI First, there's one thing left there. L246. I'm not sure what the next steps are for that.15:10
TheJuliarloo: additional testing15:11
rlooTheJulia: so needs reviews?15:11
rloono, looks like still needs work.15:11
TheJuliaI think we can drop it and if there is interest then we can carry forth what the community feels it needs for the Train cycle15:12
rlooTheJulia: ok, deleting that UEFI First section then.15:12
TheJuliaI think we can drop conductor roll splitting from our etherpad list15:12
TheJuliaAny objections?15:12
dtantsurnope15:13
*** e0ne has joined #openstack-ironic15:14
openstackgerritMark Goddard proposed openstack/bifrost master: Pin proliantutils version  https://review.openstack.org/64819315:14
TheJuliamgoddard: still WIP for the raid invocation wip?15:14
mgoddardTheJulia: yeah, for now15:14
*** Lucas_Gray has joined #openstack-ironic15:15
TheJuliaetingof|afk: still redfish vmedia'ing?15:15
TheJuliaI did just take care of an action item, I pinged neutron people re smartnics15:17
TheJulia\o/15:17
*** dnuka has quit IRC15:17
TheJuliaIf there is nothing else, I'm good with proceeding to discussion of the PTG and topics15:17
dtantsurI do think etingof|afk is still vmedia'ing15:17
TheJuliaack15:18
dtantsurthere is also a contentious chain of sushy-tools patches for that15:18
TheJuliaThanks!15:18
TheJulia\o/15:18
*** dnuka has joined #openstack-ironic15:18
TheJulia#topic Deciding on priorities for the coming week15:19
*** openstack changes topic to "Deciding on priorities for the coming week (Meeting topic: ironic)"15:19
TheJuliaI think we should keep this as-is for this week. Naturally removing the merged items from the list.15:20
TheJuliaAny objections?15:20
TheJulia#link https://etherpad.openstack.org/p/IronicWhiteBoard15:20
mgoddardI added one for bifrost if that's ok15:20
TheJuliaLine 12515:20
*** gyee has joined #openstack-ironic15:20
TheJuliamgoddard: sure15:20
mgoddardrocky is currently broken without it15:20
TheJulia:(15:21
TheJuliaNobodyCam: could you look at bifrost reviews when you have a chance? :)15:21
NobodyCamWill do :)15:22
TheJuliaThanks15:22
TheJuliaI've removed merged15:22
NobodyCam:)15:22
TheJuliaIs everyone good with the list for the week? If so I think we can proceed to discusison15:23
rloo++15:23
TheJulia#topic Discussion15:23
*** openstack changes topic to "Discussion (Meeting topic: ironic)"15:23
TheJuliaI'd like us to take a few minutes to go through the denver etherpad. Discuss any items that people wish to ask for questions with, and add +'s to items that people feel are important.15:24
TheJulia#link https://etherpad.openstack.org/p/DEN-train-ironic-brainstorming15:24
TheJuliaMaybe "+1" ?15:24
rloowrt the first one, standalone ironic -- rpioso asks a question. i'm guessing it'll be discussed in both forum and ptg?15:27
TheJuliaI think so yes15:27
TheJuliaForum is much more information collection/larger community context acquisition15:27
rpiosorloo, TheJulia: ty15:28
dtantsurI also think both15:28
rpiosodtantsur: u, too :)15:28
rloooh, TheJulia, to be clear, 'is submitting this as a forum topic...' (L12). Do we know if it is a topic? I thought the forum sched came out but i don't recall the details.15:29
TheJuliaThe ones I submitted did make it t hrough15:29
rlooTheJulia: thx, i updated :)15:29
TheJulialarsks: will you be at the OpenStack Forum/PTG?15:33
TheJuliai guess next steps will be to try and determine a schedule, but I'd like to see more people express interest on various topics15:33
dtantsuranother Forum/PTG question: do we want to plan a get-together?15:34
TheJuliaThat is another good question.15:35
rloowhat's a PTG without a get-together? :)15:35
TheJuliaI can try and figure something out but I'll also need a head count by Friday15:35
rloothx TheJulia!15:35
TheJuliaAnyway, I guess people can take a little more time to comment on the topics15:36
TheJuliabut end of day I'll try to begin forming a list together for the actual PTG and begin to try and co-ordinate schedules15:36
TheJulia#action TheJulia to make a doodle for an evening gathering15:36
TheJuliaI guess we're good to proceed to Open Discussion15:37
rlooTheJulia: is L147 the same as L160?15:37
rlooor maybe not...15:37
TheJuliadefinite overlap15:37
TheJuliaI can nuke 16015:37
rloowell, L150 seems to ask the same question15:37
TheJulia160 has been nuked15:38
TheJulia#topic Open Discussion15:38
*** openstack changes topic to "Open Discussion (Meeting topic: ironic)"15:38
TheJuliaDoes anyone have anything to discuss today?15:39
TheJulia(anything else)15:39
* dtantsur has nothing15:40
rloocrickets15:41
*** brandor5 has quit IRC15:43
TheJuliaOkay everyone! Thanks!15:43
TheJuliaHave a wonderful week!15:43
rlooThanks TheJulia!15:43
TheJulia#endmeeting15:43
*** openstack changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/ironic/ | Bugs: https://storyboard.openstack.org/#!/project_group/75 | Contributors are generally present between 6 AM and 12 AM UTC, If we do not answer, please feel free to pose questions to openstack-dev mailing list."15:43
openstackMeeting ended Mon Apr  8 15:43:57 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:43
openstackMinutes:        http://eavesdrop.openstack.org/meetings/ironic/2019/ironic.2019-04-08-15.00.html15:43
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/ironic/2019/ironic.2019-04-08-15.00.txt15:44
openstackLog:            http://eavesdrop.openstack.org/meetings/ironic/2019/ironic.2019-04-08-15.00.log.html15:44
*** dnuka has quit IRC15:44
*** Sundar has joined #openstack-ironic15:44
*** kaifeng has quit IRC15:52
openstackgerritMerged openstack/bifrost master: Disable RabbitMQ by default  https://review.openstack.org/64509315:52
openstackgerritArne Wiebalck proposed openstack/ironic master: Do not tear down node upon cleaning failure  https://review.openstack.org/65094215:57
mgoddardHas anyone tried switching from one inspector PXE filter to another?15:58
mgoddardIt seems switching from iptables to another filter can leave the iptables rules in place15:58
*** tssurya has quit IRC15:59
arne_wiebalckTheJulia: For this one ^, I'm not clear on whether conductor/manager.py needs to be patched as well ... maybe with your  recent fast track work you'll be able to tell immediately.15:59
dtantsurmgoddard: I think hjensas has some experience with that16:00
*** mjturek has quit IRC16:00
*** e0ne has quit IRC16:02
mgoddarddtantsur: I think I'll put something in kolla-ansible for now but I think it ought to go in inspector16:02
*** mjturek has joined #openstack-ironic16:02
dtantsurpossibly16:02
*** lucasagomes has quit IRC16:02
hjensasmgoddard: in TripleO I belive there is some cleanup of iptable rules as an upgrade task. (Or we changed the config to flush tables on stop/start)16:03
mgoddardthanks hjensas16:04
*** e0ne has joined #openstack-ironic16:05
*** brandor5 has joined #openstack-ironic16:07
brandor5hello everyone: I'm looking for the file 'bootppc64' to provision some ppc64le hosts... (using the directions found at https://docs.openstack.org/ironic/pike/install/configure-pxe.html) can anyone tell me where I can find it?16:08
brandor5`yum provides "*/bootppc64" fails to return anything16:08
*** Sundar has quit IRC16:09
*** stendulker has quit IRC16:09
hjensasmgoddard: there is some ansible purging the chain on the upgrade when we switch to dnsmasq filter - https://github.com/openstack/tripleo-heat-templates/blob/stable/rocky/puppet/services/ironic-inspector.yaml#L29416:10
mgoddardhjensas: nice, just wrote exactly the same task :)16:10
hjensasmgoddard: took me longer to find the code in ooo *urk*16:11
TheJuliaarne_wiebalck: I'll take a look in a little bit. I just got off from 3 hours of continious meetings so I need to eat breakfast, have coffee, etc.16:11
arne_wiebalckOh, sure, absolutely no rush! Thx!16:12
arne_wiebalckBon appetit ;)16:12
mgoddardhjensas: well I almost got it right - used ironic_inspector rather than ironic-inspector. I think this uncovered a bug though - ansible barfs if the chain doesn't exist, so it's not idempotent16:15
*** e0ne has quit IRC16:17
dtantsurbrandor5: maybe tonyb or mjturek know16:20
*** dtantsur is now known as dtantsur|afk16:27
dtantsur|afko/16:27
TheJuliaarne_wiebalck: Yeah, I think that is all you need to do. We'll need to backport that btw16:29
arne_wiebalckTheJulia:  That was a fast breakfast ...16:29
TheJuliaI only just finished making my coffee :)16:30
arne_wiebalckTheJulia: What about the return code and excpetion handling in the manager? Why does that not need changes?16:30
* arne_wiebalck is digging out a link16:31
arne_wiebalckhttps://github.com/openstack/ironic/blob/master/ironic/conductor/manager.py#L141016:32
arne_wiebalckor16:32
arne_wiebalckhttps://github.com/openstack/ironic/blob/master/ironic/conductor/manager.py#L143016:32
*** etingof|afk is now known as etingof16:33
TheJuliacleaning error handing is all over the place sadly16:33
TheJuliaLikely all of them need to be changed16:33
arne_wiebalckmy patch seems to do it16:34
* arne_wiebalck works in a lab that does experiemtns16:34
arne_wiebalckbut I am not clear when the manager would handle cleaning erros16:34
arne_wiebalcks/erros/errors16:35
TheJuliathe first manager one could just be a transient failure really16:36
TheJuliathe second is a general failure leaning towards IPA incompatibility or someone doing highly custom things16:36
arne_wiebalckdoesn't seem there is any retry logic, is there?16:39
rpittaugood night! o/16:39
TheJuliaa human I guess16:39
TheJuliagoodnight rpioso16:39
TheJuliaerr16:39
TheJuliarpioso:16:39
TheJuliadoh!16:39
TheJuliarpittau:16:39
rpittauxD16:40
*** rpittau is now known as rpittau|afk16:40
*** Lucas_Gray has quit IRC16:40
arne_wiebalckTheJulia: the human will need to redo cleaning as we switch the node off after this transient error16:40
TheJuliaarne_wiebalck: I guess with fast track engaged, the node will continue heartbeating, the records will be there, we'll skip starting a new ramdisk16:40
TheJuliait should them immediately retry the task...16:40
*** Lucas_Gray has joined #openstack-ironic16:40
* arne_wiebalck needs to look at TheJulia's fast track patch set16:41
TheJuliaarne_wiebalck: if we don't and we don't actually chnage the state, then it would retry on next heartbeat16:41
arne_wiebalckTheJulia: But this is for fast track. ATM, if we hit this code, the node would also go off, no? Due to the lines I posted above, I mean.16:42
TheJuliayes, they would presently be off16:43
TheJuliaI'm thinking "if we don't turn them off"16:43
arne_wiebalckah16:43
arne_wiebalckright16:43
arne_wiebalckbut if I understand the code correctly, a clean step that returns a non-empty return code (for instance to signal an erorr) would switch off the node16:44
* arne_wiebalck cannot type error today16:44
TheJuliait returning unknown error seems more risky to me, I dunno16:45
*** e0ne has joined #openstack-ironic16:46
arne_wiebalckok, so my patch seems to cover an exception in a cleaning step, but there may be other situations where we switch a node while we advertise we would not16:46
arne_wiebalckdoesn't seem to be a big issue in practice, though16:47
arne_wiebalck:)16:47
TheJuliayeah, both of those seem to be more of the catches for edge cases16:47
*** Lucas_Gray has quit IRC16:47
*** Lucas_Gray has joined #openstack-ironic16:49
arne_wiebalckThx, TheJulia!16:50
arne_wiebalckbye, everyone o/16:52
*** derekh has quit IRC16:58
*** dougsz has quit IRC17:02
*** e0ne has quit IRC17:16
*** andrein has quit IRC17:17
* TheJulia begins the sift through all of the emails17:29
*** diablo_rojo has joined #openstack-ironic17:29
diablo_rojoTheJulia, as I am helping the marketing folks get together the Press Release stuff and wanting to give Ironic some spotlight. Was wondering if you/someone else here could help me with a screenshot or two showing off the deployment templates for standalone users?17:30
diablo_rojoFor context, we have screenshots of some JSON responses from the placement stuff and screenshots of creating/listing network segements in Neutron.17:31
diablo_rojoBasically need them today if we are going to get them into the PR in time. I know its tight :/17:32
*** jcoufal has quit IRC17:33
diablo_rojoalso totally didnt need to capitalize 'Press Release' in that first sentence lol. This is why I am not in marketing.17:33
TheJuliadiablo_rojo: eek, give me a efw to context switch over and see what we can do today17:38
diablo_rojoTheJulia, awesome. Take your time. I'll be here all day :)17:38
*** Lucas_Gray has quit IRC17:38
openstackgerritVarsha Verma proposed openstack/ironic master: Removes `hash_distribution_replicas` configuration option  https://review.openstack.org/65091217:42
brandor5mjturek: you around?17:47
*** andrein has joined #openstack-ironic17:53
mjturekyep hey brandor517:58
brandor5mjturek: hiya, i'm working on provisioning ppc64le systems with ironic, do you have a few minutes for some questions?17:59
mjtureksure!18:00
brandor5mjturek: cool, thanks. Mind if I take it to DMs to avoid annoying people? or would you rather leave it in channel?18:00
mjturekI don't mind in channel, we can move to pvt if it gets noisy in here!18:01
openstackgerritChristopher Dearborn proposed openstack/ironic-specs master: Add firmware update spec for Dell EMC hardware  https://review.openstack.org/60213218:01
brandor5ok thanks!18:02
brandor5mjturek: so first off, we're on an old version... newton (I'm sorry)18:02
mjturekshould be okay18:02
brandor5mjturek: currently our idea is to manually hack ironic config to hand out the ppc64 pxe image, is that what should be expected?18:03
brandor5instead of the normal undionly.kpxe i mean18:03
mjturekbrandor5: are you familiar with how ppc64* handles pxe? it's a little differnt18:04
mjturekyou don't use pxelinux.018:05
brandor5mjturek: not really and I'm afraid that's part of our problem :|18:05
mjturekno worries!18:05
mjturekbrandor5: this article is very helpful https://docs.oracle.com/cd/E24628_01/em.121/e27046/appdx_pxeboot.htm#EMLCM1219918:05
mjturekactually not exactly what I thought it was, one sec18:06
brandor5np :)18:06
mjturekbrandor5: http://jk.ozlabs.org/blog/post/158/netbooting-petitboot/18:06
mjturekthis will help you understanding the underlying netbooting process18:06
brandor5yep, we found that earlier :)18:07
mjturekbrandor5: here is the patch that enabled pxe for ironic18:08
mjturekhttps://review.openstack.org/#/c/185987/1318:08
patchbotpatch 185987 - ironic - Enable PXE for systems using petitboot (MERGED) - 13 patch sets18:08
mjturekbasically, using the pxe hardware type for ppc64* should be functionally identical to using the x86_64 one18:09
mjturekI forget if this patch merged in time for newton though18:09
mjturekso you may need to backport it18:10
mjturek(though I think it is in newton)18:10
brandor5ok, we'll look through those docs closer and see what we can come up with18:12
brandor5one more questions18:12
mjtureksure!18:12
brandor5we've been playing around with petitboot inside the nodes and have it pulling a kernel and initrd and booting into the ipa18:12
brandor5the problem is that we don't know what info we need to pass into the ipa to make it work... it just sits there :)18:13
brandor5is ipa-api-url sufficient?18:13
mjturekhmmm I've unfortunately never set those manually18:14
mjtureklet me check something18:14
brandor5ok18:14
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Use HTTP code 307 for redirects  https://review.openstack.org/65007418:15
*** nuclearasaurus has joined #openstack-ironic18:15
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Include all libvirt domains in Systems  https://review.openstack.org/64870018:16
*** diga has quit IRC18:16
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Ensure non-empty libvirt <loader/> tag  https://review.openstack.org/64272818:17
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Create libvirt boot loader element if needed  https://review.openstack.org/64258118:18
mjturekbrandor5: hmmm yeah it seems like it should just be the ipa-api-url you need18:19
mjtureklet me grab the file18:19
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Add docs on UEFI boot libvirt-based emulation  https://review.openstack.org/64283018:19
mjturekhttps://github.com/openstack/ironic/blob/master/ironic/drivers/modules/agent_config.template#L518:19
mjturekbrandor5: we don't use anything fancy param wise, just this ^18:20
*** johnsom has quit IRC18:20
*** fyx has quit IRC18:20
*** PrinzElvis has quit IRC18:20
brandor5cool, thanks! is there an easy way to find out what is getting passed there? I can probably figure it out, but would be quicker if I knew where that was stored18:21
*** fyx has joined #openstack-ironic18:21
*** PrinzElvis has joined #openstack-ironic18:21
*** johnsom has joined #openstack-ironic18:21
brandor5i think it's just going to be our default api url... `https://something:6385` correct?18:23
TheJuliadiablo_rojo: I'm standing up a fresh standalone env at the moment18:30
TheJuliadiablo_rojo: I'm kind of worried that a screen shot might not reveal that much, but part of that feeling may be because I was not directly invovled with its development18:32
*** e0ne has joined #openstack-ironic18:33
diablo_rojoTheJulia, for reference, the Rocky ones didnt show a ton either really: https://www.openstack.org/software/rocky/18:35
diablo_rojoThe screen shots are 1/3 of the way down18:35
TheJuliaoh, heh18:37
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Add docs on UEFI boot libvirt-based emulation  https://review.openstack.org/64283018:39
diablo_rojoTheJulia, see? Low bar lol so don't make yourself too crazy. If you want to see the other screenshots we are pulling from I can send them over.18:42
TheJuliatrying not to, just getting a clean up to date env up is always easier said than done. things are installing now18:43
etingofthere are a handful of +2'ed patches against ironic and sushy-tools awaiting a bored core to +4 them, eventually...18:43
diablo_rojoTheJulia, definitely not the cakewalk it should be.18:44
TheJuliacomplex software is complex18:50
*** nuclearasaurus has left #openstack-ironic18:51
*** e0ne has quit IRC18:55
*** eandersson_ is now known as eandersson18:57
mjturekbrandor5 - also, if you ever need to shoot me any configs or logs, I'd be more than happy to take a  look18:59
brandor5mjturek: thanks!18:59
mjturekoooh just saw your questions I believe you're correct. let me see if I can resolve it19:00
brandor5mjturek: that seems to be right19:17
brandor5but now I'm getting an error inside the IPA19:17
brandor5https://pastebin.com/QUZnJ8y019:18
brandor5I'm using the IPA from RHOSP14...  i wouldn't think that would matter, but I'm probably wrong19:18
brandor5mjturek: ^^19:24
mjturekbrandor5: hmm yeah that's a connection issue. Seems like it can't  reach the ironic api client19:27
brandor5i'm wondering if it's because of ssl19:27
mjturekbrandor5: are you sure that the machine can reach that IP? I would start there19:28
brandor5definitely can19:28
*** jcoufal has joined #openstack-ironic19:28
mjturekcool cool19:28
TheJuliabrandor5: that looks like a general connectivity issue19:50
TheJuliaport 13385 *blink*19:50
brandor5TheJulia: redhat ;)19:50
* TheJulia puts on her fedora and shakes her head19:52
*** jaypipes has quit IRC20:07
*** jaypipes has joined #openstack-ironic20:07
*** whoami-rajat has quit IRC20:08
*** jaypipes_ has joined #openstack-ironic20:08
*** jaypipes has quit IRC20:12
*** Lucas_Gray has joined #openstack-ironic20:14
*** andrein has quit IRC20:25
*** pcaruana has quit IRC20:25
TheJuliaSomehow I'm not surprised we don't want to have any sort of retrospective :)20:38
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Include all libvirt domains in Systems  https://review.openstack.org/64870020:40
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Ensure non-empty libvirt <loader/> tag  https://review.openstack.org/64272820:40
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Create libvirt boot loader element if needed  https://review.openstack.org/64258120:40
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Use HTTP code 307 for redirects  https://review.openstack.org/65007420:40
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Add docs on UEFI boot libvirt-based emulation  https://review.openstack.org/64283020:40
TheJuliayay for patches? :)20:40
* etingof is combining bugs in a compatible way20:41
TheJulia:)20:41
* TheJulia goes back to combining sujects into a schedule20:41
* etingof goes to his cloudy dreams20:42
TheJuliagoodnight20:42
etingofo/20:42
tonybbrandor5: I've never heard oif that file20:45
tonybbrandor5: a power8 running OPAL shoudln't need a chain loader s the firmare itself parses the syslinux config and boots the right thing20:46
tonybbrandor5: so all you really need to do is verify that ironic/inspector send the right path in tftp and you're good to go20:47
tonybbrandor5: I've only tested it in >= queens and I suspect that pike wont work20:47
openstackgerritRichard G. Pioso proposed openstack/ironic stable/rocky: Revert "Fix OOB introspection to use pxe_enabled flag in idrac driver"  https://review.openstack.org/65011620:49
brandor5tonyb: thanks, i think we're going to be able to work around it with petitboot for now... luckily we only have a handful of systems to provision and we are the ones who will be using them :)20:49
*** jaypipes_ is now known as jaypipes20:51
tonybbrandor5: Well using petitboot is the right thing to do so less of a work around and more of a 'do the right thing'20:55
brandor5tonyb: workaround in that we're manually entering petitboot entries :D20:56
*** mjturek has quit IRC20:57
tonybbrandor5: Ahh okay yeah that'd be terrible but shoudl work20:58
brandor5hehe yeah20:58
tonybbrandor5: any chnace you're going to be at the OpenInfra summit?20:59
brandor5yep, i sure am20:59
tonybbrandor5: cool.  We shoudl find a few minutes to chat21:02
tonybdtantsur|afk: When you're workign again can you take a few minutes to look over: https://github.com/redhat-cip/hardware/pull/81 to see if you're okay with that direction21:03
tonybdtantsur|afk: there is stuff still to fix but I think it's better than my first attempt and even works on aarch64 'for free' ;P21:03
brandor5tonyb: sure thing :) i'll dm my email to you21:04
tonybbrandor5: cool!21:04
*** bfournie has quit IRC21:07
*** brandor5 has quit IRC21:12
*** Goneri has quit IRC21:14
*** baha has quit IRC21:34
*** jcoufal has quit IRC21:35
*** whoami-rajat has joined #openstack-ironic21:45
*** andrein has joined #openstack-ironic22:00
openstackgerritRichard G. Pioso proposed openstack/ironic stable/queens: Revert "Fix OOB introspection to use pxe_enabled flag in idrac driver"  https://review.openstack.org/65013422:11
*** rcernin has joined #openstack-ironic22:14
rpiosoTheJulia: I cleaned up the cleanup.22:19
TheJuliarpioso: thanks22:20
rpiosoTheJulia: You're welcome. I look forward to your reviews :)22:21
TheJuliaI'll try to look before I step away to make dinner. Tying to work out schedule details22:27
*** persia has quit IRC22:30
*** persia has joined #openstack-ironic22:31
rpiosoSuper! Appreciate it.22:35
*** ijw has joined #openstack-ironic22:46
lifelessTheJulia: retrospectives are good, no?23:03
*** rloo has quit IRC23:03
TheJuliaretrospecting is powerful, the actual act as a group.... maybe not quite as effective with an everchanging group23:05
*** livelace has quit IRC23:08
TheJuliarpioso: Seems like tomorrow, I'm going to call it a night soon23:13
rpiosoTheJulia: Sounds good. Have a great evening.23:13
TheJuliayou too23:13
*** mgoddard has quit IRC23:14
*** mgoddard has joined #openstack-ironic23:15
rpiosoThank you23:15
openstackgerritMerged openstack/bifrost master: Improving test vm data collection  https://review.openstack.org/65030623:18
*** Lucas_Gray has quit IRC23:28
*** w14161_1 has joined #openstack-ironic23:58
*** whoami-rajat has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!