Monday, 2020-02-10

*** Wryhder has joined #openstack-ironic00:00
*** ccstone has quit IRC00:00
*** Lucas_Gray has quit IRC00:00
*** ccstone4 is now known as ccstone00:01
*** dsneddon has quit IRC00:01
*** Wryhder is now known as Lucas_Gray00:01
*** goldyfruit has quit IRC00:42
*** goldyfruit has joined #openstack-ironic00:44
*** dsneddon_ has quit IRC00:49
*** openstackstatus has joined #openstack-ironic01:16
*** ChanServ sets mode: +v openstackstatus01:16
*** dsneddon_ has joined #openstack-ironic01:21
*** dsneddon_ has quit IRC01:26
*** Lucas_Gray has quit IRC01:50
*** dsneddon_ has joined #openstack-ironic01:53
*** dsneddon_ has quit IRC01:58
openstackgerritMerged openstack/ironic master: tell reno to ignore the kilo branch  https://review.opendev.org/70662602:20
*** dsneddon_ has joined #openstack-ironic02:27
*** jdandrea has joined #openstack-ironic02:31
*** hoonetorg has quit IRC02:35
*** dsneddon_ has quit IRC02:35
*** hoonetorg has joined #openstack-ironic02:48
*** dsneddon_ has joined #openstack-ironic03:03
*** dsneddon_ has quit IRC03:09
openstackgerritKaifeng Wang proposed openstack/ironic stable/train: Fix ipxe interface to perform ipxe boot without ipxe_enabled enabled  https://review.opendev.org/70672803:19
*** dsneddon_ has joined #openstack-ironic03:35
*** dsneddon_ has quit IRC03:40
openstackgerritKaifeng Wang proposed openstack/ironic master: Remove the [pxe]ipxe_enabled configuration option  https://review.opendev.org/69681004:03
openstackgerritKaifeng Wang proposed openstack/ironic master: Start removing ipxe support from the pxe interface  https://review.opendev.org/69666604:06
openstackgerritKaifeng Wang proposed openstack/ironic master: Finalize removal of ipxe_enabled option  https://review.opendev.org/69835204:08
*** dsneddon_ has joined #openstack-ironic04:13
*** mkrai has joined #openstack-ironic04:14
*** dsneddon_ has quit IRC04:18
*** ricolin has joined #openstack-ironic04:33
*** jdandrea has quit IRC04:48
*** dsneddon_ has joined #openstack-ironic04:54
*** dsneddon_ has quit IRC04:59
*** dsneddon_ has joined #openstack-ironic05:32
*** etingof has joined #openstack-ironic05:36
*** dsneddon_ has quit IRC05:37
*** dsneddon_ has joined #openstack-ironic05:41
*** dsneddon_ has quit IRC05:46
openstackgerritM V P Nitesh proposed openstack/ironic-lib stable/stein: Returns disk_identifier for UEFI boot mode nodes  https://review.opendev.org/66729805:52
*** yedongcan has joined #openstack-ironic06:09
openstackgerritM V P Nitesh proposed openstack/ironic master: UEFI PXE Provisioning for wholedisk images  https://review.opendev.org/66486406:13
openstackgerritM V P Nitesh proposed openstack/ironic-lib stable/rocky: Returns disk_identifier for UEFI boot mode nodes  https://review.opendev.org/66729906:14
openstackgerritM V P Nitesh proposed openstack/ironic-lib master: Returns root_uuid and efi_sys_partuuid for UEFI boot mode nodes  https://review.opendev.org/66983006:14
*** dsneddon_ has joined #openstack-ironic06:17
*** dsneddon_ has quit IRC06:22
*** dsneddon_ has joined #openstack-ironic06:57
*** dsneddon_ has quit IRC07:02
*** jtomasek has joined #openstack-ironic07:08
*** jtomasek_ has joined #openstack-ironic07:09
*** jtomasek has quit IRC07:12
*** mkrai has quit IRC07:27
*** dsneddon_ has joined #openstack-ironic07:31
*** yaawang has joined #openstack-ironic07:35
*** dsneddon_ has quit IRC07:36
*** yaawang has quit IRC07:39
*** ociuhandu has joined #openstack-ironic07:47
openstackgerritM V P Nitesh proposed openstack/ironic-python-agent master: Creates and Reorders the Boot Entry  https://review.opendev.org/66983208:02
*** mkrai has joined #openstack-ironic08:05
*** ociuhandu has quit IRC08:07
*** ociuhandu has joined #openstack-ironic08:08
openstackgerritMerged openstack/ironic-python-agent master: Tidy up relese notes for 6.0.0  https://review.opendev.org/70656108:09
*** jerrywang1 has joined #openstack-ironic08:09
*** iurygregory has joined #openstack-ironic08:10
iurygregorygood morning o/08:10
*** dsneddon_ has joined #openstack-ironic08:10
jerrywang1morning everyone o/08:11
openstackgerritKaifeng Wang proposed openstack/ironic master: Automatic port allocation for the serial console  https://review.opendev.org/70644508:11
*** ociuhandu has quit IRC08:14
jerrywang1Hi, all, as we know, introspection data contains hardware infos like network interfaces, cpu, memory, raid and so on, now I did a exercise to add "aep" which just contains size and enable at introspection data at IPA code, see detail at paste.openstack.org/show/789350, anything missed let me know. Thx08:14
*** dsneddon_ has quit IRC08:16
openstackgerritVerification of a change to openstack/ironic-python-agent-builder failed: Add extra filesystem support  https://review.opendev.org/70667508:27
*** tesseract has joined #openstack-ironic08:30
*** bobmel has quit IRC08:37
*** amoralej|off is now known as amoralej08:38
*** rpittau|afk is now known as rpittau08:41
rpittaugood morning ironic! o/08:41
*** alexmcleod has joined #openstack-ironic08:42
*** dsneddon_ has joined #openstack-ironic08:46
etingofgood, peaceful Monday o/08:49
*** dsneddon_ has quit IRC08:51
*** dougsz has joined #openstack-ironic08:59
*** lucasagomes has joined #openstack-ironic09:00
*** dtantsur|afk is now known as dtantsur09:01
dtantsurgood stormy morning, ironic :)09:01
dtantsurTheJulia: they're in a merge conflict again :( I hope I'm not to blame this time! :D09:03
*** mbeierl has quit IRC09:04
*** mbeierl has joined #openstack-ironic09:04
* dtantsur has received a report that ironic-ui no longer works :(09:13
iurygregory^ ouch09:14
*** k_mouza has joined #openstack-ironic09:17
*** k_mouza has quit IRC09:22
openstackgerritDmitry Tantsur proposed openstack/ironic-ui master: Repair creating an ironicclient instance  https://review.opendev.org/70676409:22
*** dsneddon_ has joined #openstack-ironic09:23
dtantsurmgoddard: morning! I think we can also release python-ironicclient from master to accompany the new API.09:26
*** dsneddon_ has quit IRC09:27
*** mkrai has quit IRC09:30
* dtantsur has received a confirmation from another person that yes, ironic-ui has broken09:36
*** derekh has joined #openstack-ironic09:38
*** ociuhandu has joined #openstack-ironic09:42
openstackgerritKaifeng Wang proposed openstack/ironic stable/train: Fix ipxe interface to perform ipxe boot without ipxe_enabled enabled  https://review.opendev.org/70672809:46
*** ociuhandu has quit IRC09:47
mgoddarddtantsur: morning. I'll do that. What about inspector client?09:49
dtantsurmgoddard: I doubt that it's had any changes09:50
*** k_mouza has joined #openstack-ironic09:50
mgoddarddtantsur: py2 drop. should we get that out?09:53
dtantsurmgoddard: absolutely09:53
mgoddardhmm. are there others we should release for the same reason?09:54
*** ociuhandu has joined #openstack-ironic09:54
mgoddardI would say bifrost but don't think it's ready09:54
*** ociuhandu has quit IRC09:55
openstackgerritRiccardo Pittau proposed openstack/ironic-inspector master: Stop supporting Flask < 1.0  https://review.opendev.org/70670209:58
openstackgerritRiccardo Pittau proposed openstack/ironic-inspector master: Stop supporting Flask < 1.0  https://review.opendev.org/70670209:59
*** dsneddon_ has joined #openstack-ironic10:03
openstackgerritRiccardo Pittau proposed openstack/ironic-inspector master: Use openstacksdk for ironic module  https://review.opendev.org/67217910:04
dtantsurmgoddard: bifrost is not, otherwise not sure10:05
openstackgerritDmitry Tantsur proposed openstack/python-ironicclient master: Provide a clear error message when using client.Client without a session  https://review.opendev.org/70677610:07
dtantsurmgoddard: maybe we should get ^^^ in first10:07
mgoddarddtantsur: ok I'llw-110:08
*** dsneddon_ has quit IRC10:08
openstackgerritMark Goddard proposed openstack/ironic master: Update release mappings for Ussuri  https://review.opendev.org/70656510:11
*** dsneddon_ has joined #openstack-ironic10:15
*** mkrai has joined #openstack-ironic10:21
openstackgerritDmitry Tantsur proposed openstack/ironic-ui stable/train: Repair creating an ironicclient instance  https://review.opendev.org/70678310:25
*** ociuhandu has joined #openstack-ironic10:27
*** ociuhandu has quit IRC10:32
openstackgerritMark Goddard proposed openstack/ironic stable/train: tell reno to ignore the kilo branch  https://review.opendev.org/70678410:36
openstackgerritMark Goddard proposed openstack/ironic stable/stein: tell reno to ignore the kilo branch  https://review.opendev.org/70678510:36
openstackgerritMark Goddard proposed openstack/ironic stable/rocky: tell reno to ignore the kilo branch  https://review.opendev.org/70678610:37
mgoddard^ should allow us to release ironic stable branches10:37
*** mkrai has quit IRC10:51
dtantsurmgoddard: +A10:52
mgoddardthanks10:52
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Workaround for Python virtualenv  https://review.opendev.org/70506010:53
rpittaudtantsur: for the jobs in ipa-B, I saw your comments, in this case do we want to keep only the centos jobs voting then ?10:56
dtantsurrpittau: until somebody steps up to maintain other flavours: yes10:57
dtantsurotherwise we risk constant breakages without anybody to own them10:58
dtantsur(we already have enough troubles with centos, to be honest)10:58
rpittaudtantsur: I agree, ok, I'll keep them non-voting but keeping an eye on them10:59
dtantsur++10:59
*** ociuhandu has joined #openstack-ironic10:59
*** yedongcan has left #openstack-ironic11:01
*** ociuhandu has quit IRC11:03
*** ociuhandu has joined #openstack-ironic11:03
openstackgerritMerged openstack/sushy-cli master: Add power management command  https://review.opendev.org/70254611:07
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Force DIB_PYTHON_VERSION to 3 for Debian  https://review.opendev.org/70577311:10
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Workaround for Python virtualenv  https://review.opendev.org/70506011:12
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Make Ubuntu Bionic job green again  https://review.opendev.org/70562711:12
rpittauhehhhh wrong rebase.....11:13
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Workaround for Python virtualenv  https://review.opendev.org/70506011:14
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Use train branch for centos7 job  https://review.opendev.org/70629211:14
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Make Ubuntu Bionic job green again  https://review.opendev.org/70562711:14
*** Lucas_Gray has joined #openstack-ironic11:17
*** dsneddon_ has quit IRC11:18
*** ociuhandu has quit IRC11:32
*** ociuhandu has joined #openstack-ironic11:32
*** ociuhandu has quit IRC11:38
*** ociuhandu has joined #openstack-ironic11:41
*** dsneddon_ has joined #openstack-ironic11:49
openstackgerritMerged openstack/bifrost stable/train: Revise the testing environment documentation  https://review.opendev.org/70597011:52
*** dsneddon_ has quit IRC11:54
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: DNM try breaking the CI  https://review.opendev.org/70680612:00
*** rpittau is now known as rpittau|bbl12:08
*** ociuhandu has quit IRC12:10
*** ociuhandu has joined #openstack-ironic12:11
dtantsurmgoddard: it seems that https://docs.openstack.org/kolla-ansible/train/reference/bare-metal/ironic-guide.html still refers to coreos images :(12:12
mgoddardgood spot dtantsur. someone attached to both teams should have spotted that :)12:14
dtantsurhehe12:14
dtantsurI'm helping a person debugging "No valid host found" after following this doc12:14
dtantsurSeems to be PXE related though12:14
*** ociuhandu has quit IRC12:15
dtantsurmgoddard: more importantly, the flavor is created incorrectly, it misses opting-out DISK/CPU/MEMORY resources12:16
mgoddarddtantsur: you are correct. That's bad12:19
mgoddardI'll fix it up12:19
dtantsurmgoddard: I suggest just linking to our docs instead of trying to keep it up-to-date12:20
*** dsneddon_ has joined #openstack-ironic12:24
*** dsneddon_ has quit IRC12:29
*** bfournie has quit IRC12:47
*** ociuhandu has joined #openstack-ironic12:48
openstackgerritMerged openstack/ironic-python-agent-builder master: Add extra filesystem support  https://review.opendev.org/70667512:53
*** ociuhandu has quit IRC12:53
openstackgerritMerged openstack/python-ironicclient master: Provide a clear error message when using client.Client without a session  https://review.opendev.org/70677612:58
openstackgerritDmitry Tantsur proposed openstack/python-ironicclient stable/train: Provide a clear error message when using client.Client without a session  https://review.opendev.org/70681912:58
*** dsneddon_ has joined #openstack-ironic13:03
*** dsneddon_ has quit IRC13:08
*** amoralej is now known as amoralej|lunch13:10
*** rpittau|bbl is now known as rpittau13:12
*** vesper11 has quit IRC13:15
*** vesper has joined #openstack-ironic13:15
*** rh-jelabarre has joined #openstack-ironic13:17
*** aedc_ has joined #openstack-ironic13:20
yolandai am having a problem with a node, being deployed via redfish+virtualmedia. I didn't disable the automated_clean this time, and seems it's just stuck on clean wait now.13:20
yolandaWhen i enter into the console i see it didn't boot with ipa image, but with the older image it had on disk13:20
yolandais cleaning supposed to work in the case of redfish+virtualmedia, or shall i disable it?13:22
*** aedc has quit IRC13:23
*** aedc_ has quit IRC13:30
yolandamm i looked and i see automated_clean=false on ironic.conf... i wonder why is still trying to cleanup13:30
etingofyolanda, cleaning should work, it worked for me on enroll13:32
yolandamy node just enters into clean, but doesn't try to boot anything from virtualmedia, just gets the old image that sits on disk13:32
*** aedc_ has joined #openstack-ironic13:33
*** Lucas_Gray has quit IRC13:34
openstackgerritRiccardo Pittau proposed openstack/sushy-cli master: Update commands to generate docs, renos and pdf  https://review.opendev.org/70682613:34
openstackgerritRiccardo Pittau proposed openstack/sushy-cli master: Update commands to generate docs, renos and pdf  https://review.opendev.org/70682613:34
*** Lucas_Gray has joined #openstack-ironic13:35
*** bfournie has joined #openstack-ironic13:36
etingofyolanda, check out conductor log... you should have it setting boot device to CD13:37
yolandapermanently? i think the boot device for this machine is hard disk first13:38
yolandadoesn't ironic automate it?13:38
*** dougsz has quit IRC13:38
openstackgerritRiccardo Pittau proposed openstack/sushy-cli master: Update commands to generate docs, renos and pdf  https://review.opendev.org/70682613:39
yolandai have usb - hpe smart array (hard disk) - pxe - cdrom13:39
yolandacd is the last13:39
*** dsneddon_ has joined #openstack-ironic13:43
etingofyolanda, iirc, ironic should have set the node to boot from CD once in the course of booting cleaning IPA. it should be noted in conductor log13:43
*** dsneddon_ has quit IRC13:48
*** priteau has joined #openstack-ironic13:50
TheJuliagood morning13:51
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Upgrade to tinycore 10.x  https://review.opendev.org/70570813:56
*** dougsz has joined #openstack-ironic14:02
*** Lucas_Gray has quit IRC14:03
*** Lucas_Gray has joined #openstack-ironic14:08
openstackgerritMerged openstack/ironic-specs master: Create node lessee field  https://review.opendev.org/70106114:11
*** amoralej|lunch is now known as amoralej14:12
yolandaok etingof i'll redeploy and take a look at logs14:13
*** dsneddon_ has joined #openstack-ironic14:16
*** Lucas_Gray has quit IRC14:17
*** dsneddon_ has quit IRC14:21
*** rloo has joined #openstack-ironic14:22
etingofso give me a ping so we'll debug it14:22
*** bobmel has joined #openstack-ironic14:23
*** aedc_ has quit IRC14:24
*** mkrai has joined #openstack-ironic14:24
yolandasure, going for lunch while i deploy it14:28
*** ociuhandu has joined #openstack-ironic14:34
*** Goneri has joined #openstack-ironic14:35
*** tzumainn has joined #openstack-ironic14:35
TheJuliaif I keep ignoring my work laptop while I prepare for today's ironic meeting, does that mean the messages go away?14:41
dtantsurTheJulia: not really, but it's still a helpful exercise when you need to concentrate14:41
*** kaifeng has joined #openstack-ironic14:42
TheJuliathe screen keeps turning on... it is kind of disturbing14:42
etingofwhy can't you turn it upside down...14:43
dtantsurTheJulia: this needs your eyes https://review.opendev.org/#/c/706764/ I haven't tested it, but a person who reported the issue has.14:43
patchbotpatch 706764 - ironic-ui - Repair creating an ironicclient instance - 1 patch set14:43
*** cdearborn has joined #openstack-ironic14:43
dtantsuroh heck, the DIB jobs don't actually test patches on IPA14:43
TheJuliadtantsur: just approved those14:44
dtantsurah, thx!14:44
dtantsurgood news: people use ironic-ui :)14:44
TheJulia\o/14:44
TheJuliarpioso: fyi, your vendor priority on the whiteboard is out of date.14:45
openstackgerritIlya Etingof proposed openstack/sushy-cli master: Rebase cliff commands onto common `Command` and `Lister` bases  https://review.opendev.org/70454414:45
openstackgerritIlya Etingof proposed openstack/sushy-cli master: Improve docstrings and README  https://review.opendev.org/70461014:47
openstackgerritIlya Etingof proposed openstack/sushy-cli master: Add system/manager/chassis inventory show command  https://review.opendev.org/70600514:47
openstackgerritIlya Etingof proposed openstack/sushy-cli master: Add systems, managers and chassis listing commands  https://review.opendev.org/70646114:47
TheJuliaHmm, my fix to fix software raid over iscsi seems to have irked software raid with direct :(14:48
openstackgerritDmitry Tantsur proposed openstack/ironic master: Actually use ironic-python-agent from source in source builds  https://review.opendev.org/70686314:49
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: DNM try breaking the CI  https://review.opendev.org/70680614:50
openstackgerritTzu-Mainn Chen proposed openstack/ironic master: Add node lessee field  https://review.opendev.org/70686414:50
dtantsurtzumainn: admit it, you have been waiting with a patch already ready :)14:52
* TheJulia concurs14:54
TheJulia:)14:54
*** dsneddon_ has joined #openstack-ironic14:54
openstackgerritIlya Etingof proposed openstack/sushy-cli master: Add system boot device/mode commands  https://review.opendev.org/70639214:54
openstackgerritMerged openstack/python-ironicclient stable/train: Provide a clear error message when using client.Client without a session  https://review.opendev.org/70681914:57
dtantsurmgoddard: I think we're ready to proceed with the ironicclient release btw14:58
*** stendulker has joined #openstack-ironic14:58
*** dsneddon_ has quit IRC14:59
openstackgerritMerged openstack/ironic-ui master: Repair creating an ironicclient instance  https://review.opendev.org/70676415:00
openstackgerritMerged openstack/ironic-ui stable/train: Repair creating an ironicclient instance  https://review.opendev.org/70678315:00
TheJuliawe likely need to release ^^^ soon15:00
dtantsur++15:00
TheJuliaAnyway!15:00
TheJulia#startmeeting ironic15:00
openstackMeeting started Mon Feb 10 15:00:42 2020 UTC and is due to finish in 60 minutes.  The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
TheJuliao/15:00
*** openstack changes topic to " (Meeting topic: ironic)"15:00
TheJulia\o15:00
openstackThe meeting name has been set to 'ironic'15:00
TheJuliaGood morning everyone!15:00
cdearborno/15:00
rpiosoo/15:00
dtantsuro/15:01
kaifengo/15:01
stendulkero/15:01
etingof\o15:01
TheJuliaOur agenda this morning can be found on the wiki - https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting15:01
TheJulia#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting15:01
rlooo/15:01
rpittauo/15:01
jerrywang1o/15:01
TheJulia#topic Announcements / Reminders15:01
*** openstack changes topic to "Announcements / Reminders (Meeting topic: ironic)"15:01
TheJuliaIt seems like the mid-cycle is definitely on!15:02
TheJulia#info OpenStack Ironic Mid-cycle Meetup, 25-26 February 2020, CERN, Geneva, Switzerland15:02
TheJulia#link https://etherpad.openstack.org/p/ironic-ussuri-midcycle15:02
dtantsurplease tell arne_wiebalck if you're coming and provide the necessary information ASAP!15:02
TheJuliaArne messaged me to let me know he closed registrations yesterday. If anyone is still interested in attending arne_wiebalck needs to know ASAP15:03
* dtantsur wonders how many people do come in the end15:03
* rpittau will be there15:03
dtantsurrpittau: w00t!15:03
rpittaume and my wife actually :D15:03
dtantsurditto :)15:03
rpittau:)15:03
TheJuliaHe also indicated the tour is full based upon registrations, so if your registered and will not be joining us, arne_wiebalck needs to know.15:03
TheJuliatriple!15:03
dtantsurlovely :)15:04
*** dougsz has quit IRC15:04
TheJulia#info Opendev + PTG Vancouver, Dates: Mon, Jun 8, 2020 - Thu, Jun 11, 202015:04
dtantsurTheJulia: have you told the foundation anything about our presence?15:04
TheJuliaThey are looking for track chairs and hardware automation is something they are interested in. If anyone is interested in helping out, please feel free to reach out to me.15:05
dtantsurI'd not mind helping, but I don't know if I'm coming (and won't know soon)15:05
TheJuliadtantsur: I have not, but I would assume that they wouldn't be unaware as some of the staffers do join the channel occassionally for our meetings15:05
*** dsneddon_ has joined #openstack-ironic15:05
* rpittau wouldn't mind helping and definitely wouldn't mind some maple syrup15:06
TheJuliaAlso, if anyone is in the eastern US, there is a conference that is looking for topics15:06
* TheJulia looks for the link15:06
TheJulia#info 2020 Open Cloud Workshop - March 2-315:07
dtantsurping me if you need an ironic talk in the Central Europe :)15:07
TheJulia#link https://docs.google.com/forms/d/e/1FAIpQLSen4GUE_9MkJIomYazU933k8lRnNpdJgU-cwbpC1DVZn2upsQ/viewform15:07
TheJuliaThat closes in just a few days15:07
TheJuliaAnyway, Does anyone have anything else to announce or remind us of this morning?15:07
etingofdtantsur, pycon in Ostrava? ;)15:08
dtantsurOstrava, oh my :D15:08
TheJuliadtantsur: I feel like maybe we should somehow demo kexec in Berlin :)15:08
etingof(very much Central Europe, as you wish!)15:08
dtantsurTheJulia: mmmmm :)15:08
TheJuliaof course, patches merge conflicted long ago15:08
TheJuliaand not yet tested15:08
dtantsurkexec + fast-forward, going to be hot!15:09
TheJuliaWe had no action items last week, so it seems like we can skip past that15:09
dtantsurmmmm, fast-track15:09
TheJuliaAdd in the ability for an instance to be redeployed from a running instance and the supercomputer folks will drool15:09
dtantsurthat sounds much trickier though15:09
TheJuliaLess than you'd think, but we can discuss it in a few weeks15:10
dtantsursure15:10
TheJuliaAnyway, moving on15:10
dtantsurdamn, we should have requested 3 days in CERN15:10
TheJulia#topic Review subteam status reports15:10
*** openstack changes topic to "Review subteam status reports (Meeting topic: ironic)"15:10
TheJuliadtantsur: doh!15:10
dtantsurwhat about a follow-up hiking with technical discussions? :D15:10
TheJuliaOh, one annoucement, I'm taking the rest of the week off after the midcycle15:10
dtantsurditto ^^^15:11
yolandaetingof, why is node starting cleaning if i have automated_clean=false on ironic conductor?15:11
TheJuliaThe following week I may also be busy, unsure yet15:11
yolandai see that on log:  Entering new state 'cleaning' in response to event 'provide' on_enter /usr/lib/python3.6/site-packages/ironic/common/states.py:300ESC[00m15:11
TheJuliaAnyway!15:11
TheJulia#link https://etherpad.openstack.org/p/IronicWhiteBoard15:11
TheJuliaStarting at line 16015:12
TheJuliaerr15:12
dtantsuryolanda: it always walks the state machine, I think. even if cleaning is no-op.15:12
TheJuliano, starting at 28115:12
TheJuliaI'm really worried about the deploy steps stuff landing super late int he cycle15:14
TheJuliaI think it would be good if we could get some folks to at least perform a review of the PoC patches?15:14
TheJuliathoughts?15:14
TheJuliaI'm sure mgoddard would be happy15:14
dtantsurI should have done it long ago15:14
* dtantsur is sorry15:15
TheJuliac'est la vie15:15
* TheJulia needs to work on her very minimal french15:15
TheJuliawsme/flask/etc, does anyone have an update?15:16
jerrywang1no update at my side, no one review my code change yet15:16
jerrywang1for wsme15:16
TheJulia675853?15:16
jerrywang1yes15:17
rloodidn't we talk about wsme last week? I forgot how it ended...15:17
rpittauTheJulia: for Flask, there was not a mutual understanding that we were going that direction btw15:17
jerrywang1My change was for json schema15:17
TheJuliaoh, okay, I was hopful there15:17
dtantsurwasn't there? I think it has been decided many times15:17
rpittauor what the exact plan is15:17
jerrywang1Last week was others15:17
* TheJulia feels like she has opened a "can of worms"15:17
dtantsurworms, yummy!15:17
TheJulialol15:18
rpittaudtantsur: yeah, but I remember the last discussion where the execution was not clear for someone15:18
rpittaugummy worms ?15:18
dtantsurwell, one thing is clear: we need to get off wsme15:18
dtantsurpecan is painful to use, but we can probably stay on it15:18
TheJuliaIt feels like we explicitly need to have an explicit plan gotten together since we've let it be nebulous to try and encourage progress as opposed to try design it forever15:18
* dtantsur assumes pecan is not dead15:18
TheJuliaUmm...15:19
* TheJulia gets a parrot out15:19
TheJuliaOr would Doctor Mccoy work?15:19
dtantsurlast commit in August: https://github.com/pecan/pecan15:19
* dtantsur as usual misses the references :)15:19
TheJuliaWell that is good15:19
TheJuliadtantsur: go watch the original star trek and look for "its dead jim"15:19
rpittauoh gosh :D15:20
TheJuliaanyway we're off topic15:20
* dtantsur won't admit he hasn't watched star trek for $insert_silly_reasons15:20
rpittaudo we want to get that to the mid-cycle instead ?15:20
dtantsurrpittau: the schedule is packed and we won't have a quorum anyway15:20
TheJuliaDHCP-less has had good discussions, I feel like we just need to focus it a little bit more and everyone will be happy15:20
rpittaummmm right15:20
dtantsur++15:20
* etingof is focusing on that15:21
TheJuliaLooks like uefi software raid is starting to get some review traction15:21
TheJuliaand activity which is awesome15:21
TheJuliaNode retirement is done, at least in ironic. I wonder if there is anything besides openstacksdk?15:21
TheJuliaor do we consider that out of scope?15:21
TheJuliaWell, I take that bcak15:22
TheJuliathe osc commands have not merged https://review.opendev.org/#/c/70398215:22
patchbotpatch 703982 - python-ironicclient - Add support for retired{_reason} fields. (MERGED) - 5 patch sets15:22
dtantsurI've been slowly poking people towards starting to take openstacksdk in scope15:22
dtantsurnote that, being an SDK core, I'm clearly biased15:22
* TheJulia adds the OSC patch to the retirement support list under priorities since the other two have merged15:23
rlooi had some questions about the client part of the retired * stuff (but i commented in the PR, after it merged though.)15:23
rlooi thnk we should add that all the ironic API stuff ought to be avail in the openstacksdk.15:23
dtantsurrloo: I'll respond to your comments15:24
TheJuliaThat kind of seems I concur, it seems reasonable to me, as long as we're able to time/committment wise15:24
TheJuliaAnyway, I think we're good to move on?15:24
rloo(wonder if we should update our spec template to mention that, if it hasn't been updated already)15:24
rloothx dtantsur15:24
TheJuliarloo: good point15:24
TheJuliaafaik, it has not been updated15:24
rlooTheJulia: i'll offer to do that :D15:24
TheJuliarloo: thanks!15:25
TheJuliaMoving on!15:25
TheJulia#topic Deciding on priorities for the coming week!15:25
*** openstack changes topic to "Deciding on priorities for the coming week! (Meeting topic: ironic)"15:25
TheJulia#link https://etherpad.openstack.org/p/IronicWhiteBoard15:25
TheJuliaStarting at 16015:26
dtantsurrloo: tl;dr what we did with maintenance was bad and I feel bad for not preventing it :(15:26
* TheJulia starts by removing merged things which is a number of things15:26
rloodtantsur: OH. (talk later)15:26
dtantsurI can offer anyone a good rant with my API SIG hat on :)15:26
TheJuliaAny objection to removing the reconfiguration spec from the list of things to review?15:27
dtantsurnot from me15:27
openstackgerritIlya Etingof proposed openstack/sushy master: Fix 'None' field value processing  https://review.opendev.org/70365215:27
rloo+1 on removing reconfiguration spec from list15:28
TheJuliaiurygregory: looks like you've got a few things you need reviewed :)15:28
iurygregoryTheJulia, yeah XD15:29
openstackgerritIlya Etingof proposed openstack/sushy master: Relax required Redfish fields handling  https://review.opendev.org/70382515:29
* iurygregory finally got redfish CI job working =D15:29
dtantsurTheJulia: I've checked the agent_token stuff as promised. It seems to need another rebase :(15:29
* iurygregory the i-p-e =)15:29
TheJuliatzumainn: any node ownership stuff needed?15:29
rlooare we preparing to do some releases? I see some PRs related to that. if so, should they go in this week's list?15:30
TheJuliadtantsur: I'll rebase it either during the next meeting or after15:30
TheJuliarloo: already on the list15:30
dtantsurI'll need review on https://review.opendev.org/#/c/706863/ once I'm done testing it. It's quite serious, the DIB-IPA jobs don't test IPA.15:30
patchbotpatch 706863 - ironic - Actually use ironic-python-agent from source in so... - 1 patch set15:30
TheJuliain the wrong place of course15:30
* TheJulia shuffles the list15:30
rlooTheJulia: ah, that explains it, cuz I stared a bit more and didn't see !15:31
rpittaudtantsur: I'll add it to my list15:31
dtantsurthx15:31
tzumainnTheJulia, hi! just the lessee implementation patch15:31
TheJuliatzumainn: do you have the link handy15:31
tzumainnah, yep! one sec15:31
tzumainnhttps://review.opendev.org/#/c/706864/15:32
patchbotpatch 706864 - ironic - Add node lessee field - 1 patch set15:32
TheJuliaI think the list is good15:32
tzumainnI also put it on the whiteboard somewhere, maybe in the wrong place15:32
TheJuliaThe ipa bugs I found this week seem to relate to our standalone test failure rate, I'll try and get that patch fixed and then some of the approved stuff may have more luck getting past the raid tests15:32
TheJuliaDoes anyone have anything to add to the list?15:33
kaifenghttps://review.opendev.org/706445 can use some reviews15:33
patchbotpatch 706445 - ironic - Automatic port allocation for the serial console - 2 patch sets15:33
TheJuliakaifeng: already added  :)15:34
TheJuliaThanks for that by the way!15:34
kaifengTheJulia: thanks :D15:34
* TheJulia takes silence as agreement with the list and to proceed15:34
dtantsur++15:35
TheJulia#topic Discussion15:35
*** openstack changes topic to "Discussion (Meeting topic: ironic)"15:35
TheJuliaWe have three topics15:35
TheJulia(Which is why I'm trying to move us through the meeting quickly)15:35
TheJuliaTopic #1, do we cancel the IRC meeting the week of the midcycle?15:35
dtantsurat least the two of us will be travelling, right?15:35
rpittauthat's probably a good idea15:35
rlooyes15:35
TheJuliaI think my train arrives in geneva around 4 PM local, so i may still be on the move to the hotel15:36
rpittauwe might be on the same train :)15:36
TheJuliaAny objections to canceling?15:36
* TheJulia gives a chance for objections before moving along15:37
TheJuliarpittau: Gare de Lyon departure?15:38
rpittauyeah15:38
TheJuliavery likely then!15:38
* dtantsur flies in15:38
iurygregory++ to cancel =)15:38
TheJuliaOkay, moving on!15:38
* iurygregory arrives at 5PM15:38
TheJulia#2, PTG in Vancouver? Is anyone interested in attending?15:38
* rpittau very15:38
rpittau(maple syrup)15:38
TheJuliaThey are polling for project space and I likely need to respond (soon)15:39
TheJuliaheh15:39
dtantsurI'm interested, not sure about budget and visa stuff15:39
TheJuliaThat is fair15:39
rpittausame for the budget :/15:39
TheJuliaI planned for ~12 people to appear in Shanghai and 15 joined us, so I'm thinking slightly more seats15:40
rpiosoInterested. It will likely depend on travel budget.15:40
dtantsuryeah, a much higher NA presence15:40
TheJuliaYeah15:40
TheJuliaOkay, I'll respond to the foundation15:40
TheJuliaTopic #3! That ye olde bug about users being able to orphan vifs in neutron that prevent the node from being deployed/reused/etc due to duplicate mac addresses15:41
TheJulia#link https://review.opendev.org/66583515:41
patchbotpatch 665835 - ironic - Block port deletions where vif is present - 8 patch sets15:41
mgoddard \o15:42
mgoddardsorry, been in an intervie15:42
TheJuliaDoes anyone actually care about this bug? Because there has been some back and forth on requirements and the intent was to guard against humans doing silly things and as a result perceptions have differed and it has been slightly frustrating15:43
TheJuliaIf at least one person cares, I'll try and clarify things further and see if I can make reviewers happy and operators have suffient guards/information15:43
* rpioso wishes mgoddard good luck ;-)15:43
kaifengTheJulia: do you aware the reasons why the vif is not removed?15:44
mgoddardrpioso: luck would be better directed at the candidate :)15:44
TheJuliaI suspect that guarding deletions becomes more important with multitenant access15:44
TheJuliakaifeng: node put in maintenance state and ports and or the node itself removed.15:44
rlooit seems like a valid bug and i think we ought to address it.15:44
*** dougsz has joined #openstack-ironic15:45
TheJuliaupon removal, if there is any sort of vif, even an internal vif for ironic, that port is orphaned in neutron15:45
TheJulias/that port/ the neutron vif/port/15:46
TheJuliaI think we found it downstream when someone decided that they were just going to delete everything due to being frustrated and then couldn't ever deploy again15:46
TheJuliaAnyway, I'll go ahead and carry it forward15:47
rloobased on my last comment, I think I'm good with the idea. Just that, if I recall, this adds a new method to our NetworkInterface API, so I wanted that to be somewhat 'solid'.15:47
TheJuliasolid as in we're not going to change its behavior after adding?15:48
TheJuliaI suspect if I just rename the method people might become happy15:48
TheJuliatruthfully15:48
rlooi wasn't thinking that but solid wrt description etc so if someone subclasses with their own network, they know what that method should do15:48
TheJuliaRegarding moving on, It doesn't look like we have anything to visit for the Bare Metal SIG or RFEs, so I'll move us to Open Discussion.15:49
rlooie, what does 'get_current_vif_with_tag()' mean/do? Not that clear to me. I'm fine if that is clear to others.15:49
TheJuliahmm15:49
rloo(it is possibly more than one vif)15:49
kaifengTheJulia: i am thinking in cases ironic failed to remove vif from neutron, it seems we have no other ways to remove it from ironic governance15:49
TheJuliarloo: thank you, I think I understand your feedback now.15:49
rlooTheJulia: :) Sorry if it wasn't clear.15:50
TheJuliarloo:  you likely were and I just didn't read it right15:50
rlooTheJulia: no worries, glad you asked! :)15:50
TheJuliakaifeng: Yeah, if someone short circuits processes.. .we can search by mac and possibly replace ports but unique macs may not always be... unique.15:51
TheJulia#topic Open Discussion15:51
*** openstack changes topic to "Open Discussion (Meeting topic: ironic)"15:51
* TheJulia feels trying to auto-resolve things may be better eventually15:51
TheJuliawith a giant "this may do undesirable things" warning15:51
dtantsura periodic task to clean up orphaned VIFs? :)15:52
TheJuliaAnyone have anything to discuss today?15:52
tzumainnhi! quick question - has anyone ever tried non-admin deployments upon a node using standalone Ironic? I tried it for a bit and ran into the issue of having to create Neutron ports, which required admin API access15:52
dtantsurehmmm, creating ports shouldn't require admin15:52
TheJuliadtantsur: reconciling our ports versus neutron's ports seems like it could be... slightly complex.15:52
dtantsurTheJulia: since when are we afraid of complexity? :D15:53
tzumainnI think the part that required admin was associating a neutron port with a mac address15:53
dtantsuroh wow15:53
TheJuliadtantsur: I'm more worried about interaction latency, we've seen how data syncs with neutron can be painful15:53
TheJuliayes, adding a mac is an admin action15:53
kaifengmaybe it's not a shared network15:53
dtantsurouch15:53
rpiosoAre folks open to adding the driver for the Intel I350 NIC to the Tiny Core IPA ramdisk?15:54
TheJuliaIt always has been... We likely need to revisit our neutron code then15:54
dtantsurrpioso: only if it doesn't change the resulting size substantially IMO15:54
rpittaurpioso: how big is that ?15:54
TheJuliarpioso: I am not since it is for VM testing and  and I looked for other drivers and it doesn't seem to really have much of a selection for network drivers15:54
dtantsurTheJulia, tzumainn, then we may need to use an admin token for this particular operation15:54
TheJuliadtantsur: indeed, I think we did originally but session code changes likely caused us to change it to re-using the nova request token15:55
dtantsuryeah, essentially what TheJulia said. we need to invest into DIB images as our hardware solution.15:55
dtantsurtzumainn: okay, so it's probably a bug. let's start with collecting the details and filing it.15:55
TheJuliadtantsur: ++ on both items15:55
tzumainndtantsur, okay, can I ask you a few more questions post-meeting?15:56
rpiosoTheJulia: It has the driver for Intel X710 10/40 Gbps NIC. The I350 is a 1 Gbps port.15:56
dtantsurtzumainn: sure thing15:56
rpiosoTheJulia: Dell EMC's lab equipment has an I350 connected to the provisioning network.15:56
dtantsurrpioso: do you envision any problems with using DIB images?15:57
TheJuliarpioso: I'm afraid the drivers just don't exist for tinycore as far as I've seen15:57
iurygregoryTheJulia, I'm wondering if the fixes in ironic-prometheus-exporter would be ok to backport to stable/train =)15:57
TheJulia3 minute warning15:57
dtantsurby the way, TinyCore 11 is out :)15:57
TheJuliadtantsur: ohhh15:57
TheJuliaiurygregory: should be fine15:57
dtantsuriurygregory: "fixed" usually are15:57
rpiosodtantsur: I have had probs using it and RDO's IPA ramdisk to Redfish vmedia boot with the UEFI / local / partition image workflow.15:58
rpiosodtantsur: tinyipa appears to be close to working.15:58
iurygregorydtantsur, also the redfish job (not a fix but a real testing job) XD15:58
rpiosodtantsur: For at least RDO's IPA ramdisk, the kernel crashes.15:59
dtantsurrpioso: well, it should be fixed. that's what the customers will be using.15:59
TheJuliaiurygregory: if it fixes issues or makes operational use better/more reasonable on that branch, It should be fine when it comes to releasing it15:59
dtantsuriurygregory: any CI changes can be backported with a reasonable motivation.15:59
dtantsurthe policies only affect the actual code we ship15:59
iurygregoryawesome =)15:59
rpiosodtantsur: We hope to explore that at Geneva. Meanwhile, it would be helpful to have something we can inform operators works.16:00
rpiosodtantsur: So far, nothing has worked for UEFI / local / partition image.16:00
dtantsurwe, as ironic upstream, don't really support using tinyIPA in production16:00
TheJuliaThe policies are also slightly flexible when operators are kept in mind and we can do appropriate versioning16:00
dtantsurrpioso: we have been doing this for a while in TripleO..16:01
rpiosodtantsur: Which do we support?16:01
dtantsurDIB images are now official for production16:01
rpiosodtantsur: Who is "we"?16:01
dtantsurrpioso: "in TripleO" so ~ Red Hat16:01
TheJuliadtantsur: what rpioso indicated is that his grub, which coems from his ubuntu devstack host is spitting out an error about the ramdisk being too being, apparently before crashing. I suspect the ramdisk is getting truncated on his machine and I bet the kernel crashes.16:01
TheJuliaWe're at time, Thanks everyone!16:01
rpiosodtantsur: With Redfish vmedia boot?16:01
dtantsurrpioso: that's the bit you didn't mention :) worth asking yolanda16:02
rloothx TheJulia!16:02
TheJulia#endmeeting16:02
*** openstack changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/ironic/ | Bugs: https://storyboard.openstack.org/#!/project_group/75 | Contributors are generally present between 6 AM and 12 AM UTC, If we do not answer, please feel free to pose questions to openstack-discuss mailing list."16:02
openstackMeeting ended Mon Feb 10 16:02:16 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:02
openstackMinutes:        http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-02-10-15.00.html16:02
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-02-10-15.00.txt16:02
openstackLog:            http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-02-10-15.00.log.html16:02
rpiosodtantsur: Thank you!16:02
rpiosoTheJulia: Thanks, again :-)16:02
dtantsurrpioso: I think derekh and/or yolanda have tested virtual media with RDO images and I *think* (not sure) they used UEFI16:02
dtantsurin any case, a crash there is a big problem that people will (or at least should) be inclined to figure out16:03
TheJuliadtantsur: afaik it was uefi16:03
rpiosodtantsur: derekh did use RDO IPA ramdisk. He hasn't encountered the crash. We've chatted in this channel about it.16:04
dtantsurrpioso: then which IPA did derekh use? Oo16:04
dtantsurit must be either RH OSP or RDO images16:04
rpiosodtantsur: RDO, I believe.16:04
dtantsurah "did use". sorry, read "did not use" for some reason16:04
derekhit was RDO16:04
dtantsuryeah, sorry, my bad16:05
rpiosoderekh: o/16:05
yolandayep, i always tested with uefi16:05
dtantsurrpioso: I suggest you bring this crash to the Red Hat kernel team. It may be something hardware-specific, in which case they should investigate.16:05
rpiosoyolanda: Did you test UEFI / boot_option=local / partition disk image?16:05
rpiosodtantsur: Thx for that suggestion :-)16:06
dtantsurI suspect it was whole disk images16:06
dtantsurcrashing is not expected in any case :)16:06
*** ociuhandu has quit IRC16:07
rpiosoRight! Could someone try partition disk image. Perhaps that's orthogonal. Not sure.16:07
yolandawhole disk yep16:07
*** ociuhandu has joined #openstack-ironic16:08
*** kaifeng has quit IRC16:08
rpiosodtantsur: Is there any doc which states DIB images are officially supported for production?16:09
tzumainndtantsur, hi! so I tried non-admin deployments with both metalsmith and without, and the command that causes issues is essentially "openstack port create --network provisioning --mac-address <mac>  <port name>"; setting the mac address of a port seems to be heavily restricted16:11
*** stendulker has quit IRC16:12
etingofrpioso, o/ have you pushed the patches for vmedia deploy bugs you've encountered in the past?16:12
*** ociuhandu has quit IRC16:12
rpiosoetingof: They're coming this week, perhaps starting tomorrow. I tripped over three (3).16:13
*** khansa has joined #openstack-ironic16:14
rpiosoetingof: Two are related to directory and file perms in the ironic Redfish vmedia boot interface implementation. The other is in sushy-oem-idrac re: a missing Location header.16:14
TheJuliarpioso: It would help for us to know which ones we need to backport16:15
etingofrpioso, I have a feeling that yolanda is hitting the same issues...16:15
rpiosoetingof: TheJulia and I are working on a couple of things in IPA and disk image builder.16:15
rpiosoTheJulia: All three will need to be backported to Train.16:15
rpiosoTheJulia: They're bugs.16:16
yolandai started to have some problem on cleaning, seems it's not getting the iso. But i deployed successfully a pair of weeks ago...16:16
rpiosoyolanda: \o/16:16
*** ociuhandu has joined #openstack-ironic16:17
* rpioso will be back shortly16:17
TheJuliayolanda: details on the cleaning issue you encountered?16:17
*** gyee has joined #openstack-ironic16:18
etingofthose cleaning problems of yolanda now look very similar to rpioso's back then16:18
etingofwrong redfish dir perms, wrong vmedia boot URL path...16:19
TheJuliaok16:19
yolandai am seeing 7-416e9b6705eb (will copy it over): [Errno 18] Invalid cross-device link: '/tmp/tmp9m4q2z7z.iso' -> '/shared/html/redfish/boot-a75ee30a-0b3f-4325-8ac7-416e9b6705eb' _publish_image /usr/lib/python3.6/site-packages/ironic/drivers/modules/redfish/boot.py:29016:19
yolandaand actually that iso image is not found anywhere16:19
etingofnote that optimistic message in parenthesis ^16:19
yolandayep... but then i cannot see anything on that /shared/html/redfish directory16:20
TheJuliaoh! wow,16:20
*** ociuhandu has quit IRC16:21
etingofmay be that file gets removed by ironic16:21
yolandaand then, i see some logs about virtualmedia trying to boot an iso, from an url that doesn't exist16:21
etingofbefore yolanda notices ;)16:21
yolandai cleaned all possible caches and redeployed16:21
*** ociuhandu has joined #openstack-ironic16:22
etingoflet's make sure that your ironic code has this patch applied -- https://review.opendev.org/#/c/698734/16:22
patchbotpatch 698734 - ironic - Fix use of urlparse.urljoin (MERGED) - 2 patch sets16:22
etingofbecause the way how boot URL appears, this patch it not applied16:23
dtantsurtzumainn: did you issue this command explicitly?16:24
dtantsurI'm trying to understand where the --mac-address bit is coming from16:25
yolandait's rebuilding all my ironic images now16:25
tzumainndtantsur, metalsmith does it16:26
dtantsurdoes it? Oo16:26
tzumainnI think so! let me try and dig it up16:26
*** rh-jelabarre has quit IRC16:26
dtantsurtzumainn: yes please. I was under impression it did not.16:27
*** TxGirlGeek has joined #openstack-ironic16:27
*** etingof has quit IRC16:28
tzumainndtantsur, I think it's here: https://opendev.org/openstack/metalsmith/src/branch/master/metalsmith/_nics.py#L7616:28
dtantsurtzumainn: yeah, but the arguments we generate are network_id and fixed_ips or subnet_id16:29
dtantsurI don't think we ever generate a request with a MAC address16:30
tzumainndtantsur, that's weird, I could have sworn it tried to do so when I ran metalsmith16:30
tzumainnlet me get some more data and get back to you16:30
dtantsuryeah, let's dive into it with more data16:31
*** rh-jelabarre has joined #openstack-ironic16:32
tzumainndtantsur, so with metalsmith, the error I get is: Unable to attach VIF 3321e4c0-8de5-4416-83eb-e376d358c2ac because Ironic can not update Neutron port 3321e4c0-8de5-4416-83eb-e376d358c2ac MAC address to match physical MAC address b8:2a:72:4f:a3:ea16:33
tzumainnbut you're right, metalsmith itself doesn't seem to do anything with mac addresses16:33
tzumainnso I guess it's happening somewhere in ironic code?16:33
TheJuliaironic does16:33
TheJuliain the port vif binding code16:34
dtantsuryep, the initial diagnosis was correct.16:34
TheJuliaperhaps we should have two steps, update the mac using admin privs, and then perform port profile updates as a user16:34
TheJuliasince the user should have binding rights16:34
dtantsuror the other way around (to make neutron check the ACL first)16:34
TheJuliadtantsur: /me goes and asks about mac addresses16:35
dtantsurhonestly, maybe we shouldn't update the MAC address until we deploy/clean/whatever16:35
dtantsur++16:35
*** etingof has joined #openstack-ironic16:37
TheJuliaI just asked in the neutron channel16:38
TheJuliato at least collect their thoughts16:38
TheJuliais it just  me, or does today seem to have lots of positive energy?16:38
* etingof has connectivity problems - strong wind is flowing away electromagnetic radiation 16:39
etingofyolanda, any new failure so far?16:40
yolandaetingof, yakshaving.... as my setup is a disconnected install, now i'm having trouble getting ipa initramfs16:40
yolandalots of moving pieces, and the risks of consuming master...16:40
etingofperhaps rpioso will concur with yolanda ;)16:41
yolanda* Failed to connect to images.rdoproject.org port 443: Network is unreachable16:41
yolanda* Closing connection 016:41
yolandacurl: (7) Failed to connect to images.rdoproject.org port 443: Network is unreachable16:41
yolandaso no images16:41
*** jdandrea has joined #openstack-ironic16:42
etingofhurricane is apparently harmful to the cloud16:42
yolandaah, my pr didn't land yet... https://github.com/metal3-io/ironic-ipa-downloader/pull/1416:46
yolandai saw the approved comment so i thought it landed16:47
dtantsurTheJulia: quite positive actually!16:47
* dtantsur even wasn't asleep during his morning German lesson :D16:47
yolandagoing to have a local copy with my pr and retry :(16:47
* rpioso enthusiastically concurs with yolanda16:49
etingofrpioso, please ping yolanda once the wrong-redfish-dir-perms patch is up - I think it's good to deploy with it in place16:52
yolandai did a hotfix of the directory manually and i still was hitting problems...16:53
rpiosoetingof: +116:56
*** priteau has quit IRC16:56
TheJuliaNeutron question is on their friday morning agenda16:58
TheJuliaetingof: time for moar underground fiber cable?16:59
*** ociuhandu has quit IRC17:00
*** lucasagomes has quit IRC17:01
yolandaetingof, didn't the redfish patch land? i get 2020-02-10 16:57:33.157 1 ERROR ironic.conductor.manager [req-03f57176-d4ae-4237-97a1-d791276353d4 - - - - -] Failed to get power state for node cdd9d760-ed03-4353-81d8-7d78361afbd9. Error: The attribute Messages/Description is missing from the resource /redfish/v1/RegistryStore/registries/en/iLO.json17:03
yolanda ... again17:03
yolandamaybe the upstream container images do not have latest source code?17:03
TheJuliaI think the patches were revised thismorning17:04
etingofyolanda, this patch is still being reviewed -- https://review.opendev.org/#/c/703825/17:04
patchbotpatch 703825 - sushy - Relax required Redfish fields handling - 5 patch sets17:04
yolandaah ok. I need a local copy then17:04
yolandai cleaned too much stuff :)17:05
TheJuliaetingof: +217:05
etingof\o/17:05
rpittauetingof: +A17:07
rpittauand I guess I'm done for today17:07
rpittaugood night! o/17:07
TheJuliaetingof: upgraded my review on the child change17:07
TheJuliato a +2 as well17:07
*** rpittau is now known as rpittau|afk17:07
etingofawesome, thank you!17:07
openstackgerritMark Goddard proposed openstack/ironic master: Fix up release notes for 14.0.0  https://review.opendev.org/70656017:08
*** ociuhandu has joined #openstack-ironic17:08
yolandaneed to leave, i'll give a try with sushy fork later17:08
TheJuliaokay17:10
* TheJulia needs to go find something to eat 17:11
dtantsurhttps://review.opendev.org/#/c/706863/ seems to work, please check it17:12
patchbotpatch 706863 - ironic - Actually use ironic-python-agent from source in so... - 1 patch set17:12
openstackgerritIlya Etingof proposed openstack/sushy master: Relax required Redfish fields handling  https://review.opendev.org/70382517:14
openstackgerritMerged openstack/ironic-inspector master: Stop supporting Flask < 1.0  https://review.opendev.org/70670217:14
*** khansa has quit IRC17:15
*** mkrai has quit IRC17:21
* etingof expects Mary Poppins to fly by every minute17:23
dtantsuretingof: still stormy there? :)17:27
etingofyeah17:27
dtantsursigh, that's crazy17:28
*** ociuhandu has quit IRC17:31
*** dtantsur is now known as dtantsur|afk17:34
dtantsur|afkg'night!17:34
*** ociuhandu has joined #openstack-ironic17:36
TheJuliagoodnight17:36
*** k_mouza has quit IRC17:39
*** ociuhandu has quit IRC17:41
*** jerrywang1 has quit IRC17:50
*** tesseract has quit IRC17:52
*** openstackstatus has quit IRC17:57
*** openstack has joined #openstack-ironic17:59
*** ChanServ sets mode: +o openstack17:59
*** derekh has quit IRC18:00
openstackgerritMerged openstack/sushy master: Fix 'None' field value processing  https://review.opendev.org/70365218:03
*** jdandrea has quit IRC18:07
*** alexmcleod has quit IRC18:27
*** hwoarang has quit IRC18:49
openstackgerritJulia Kreger proposed openstack/ironic-tempest-plugin master: [trivial] fix legacy driver reference  https://review.opendev.org/70695518:50
*** hwoarang has joined #openstack-ironic18:52
openstackgerritRuby Loo proposed openstack/ironic-specs master: Update the CLI section  https://review.opendev.org/70695618:59
*** jdandrea has joined #openstack-ironic19:01
*** amoralej is now known as amoralej|off19:04
*** amoralej|off is now known as amoralej19:04
openstackgerritMerged openstack/ironic stable/train: Fix bash comparisons for grenade multinode switch  https://review.opendev.org/70588819:07
*** amoralej is now known as amoralej|off19:07
antonymi'm trying to do the clean steps on a idrac to create a raid one, and after the delete configuration happens, it shows this in the logs and seems to just stop the process: Feb 10 19:12:42 ubuntu ironic-python-agent[1245]: 2020-02-10 19:12:42.483 1245 INFO root [-] Error formatting log line msg='Command *(name)s completed: *(result)s' err=TypeError('first argument must be callable or None',)#033[00m19:19
openstackgerritJulia Kreger proposed openstack/ironic-tempest-plugin master: SW RAID: Delete root device hint  https://review.opendev.org/70696019:22
openstackgerritJulia Kreger proposed openstack/ironic-tempest-plugin master: Remove the SW RAID configuration  https://review.opendev.org/70696119:22
openstackgerritkhansa proposed openstack/sushy-cli master: Add system boot device/mode commands  https://review.opendev.org/70639219:23
TheJuliaantonym: software or hardware?19:24
antonymhardware raid, kicking off the delete_configuration and create_configuration steps for a raid 119:25
antonymseems to delete the config according to drac logs, but then just stops there19:25
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Rescan devices before performing uefi checks  https://review.opendev.org/70666719:26
TheJuliarpioso: cdearborn: ^^^ Any of this sounding familiar?19:31
TheJuliaantonym: can you confirm your raid_interface value on the node object, and version of ironic/ironic-python-agent ?19:31
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Rescan after restarting the md device  https://review.opendev.org/70663219:32
*** khansa has joined #openstack-ironic19:32
TheJuliadtantsur|afk: rpittau|afk: the last few patches across ironic-tempest-plugin and ironic-python-agent hopefully would make our standalone tests much happier19:33
*** igordc has joined #openstack-ironic19:35
antonymTheJulia: raid interface is idrac-wsman, there a way to query the version from ipa?19:35
antonymi used the ipa-builder last week i believe, not sure if there's a git sha recorded somewhere19:36
antonymhttps://gist.github.com/antonym/c62bcaae55437934901f6c2d6aa1e175 but that's my raid config/logs19:36
antonymit's already deleted the disk which is why it couldn't find it, this is another pass with the virtual disk not created19:37
*** khansa has quit IRC19:37
*** stevebaker has joined #openstack-ironic19:39
*** jdandrea has quit IRC19:51
rpiosoantonym, TheJulia: It's not familiar to me. However, it's been quite some time since I played with the RAID clean steps, before they were changed to also be deploy steps. I'll check around with my teammates, including cdearborn.19:53
*** jdandrea has joined #openstack-ironic19:53
*** igordc has quit IRC19:53
TheJuliaantonym: so basically master branch code for ironic as well as ipa?19:55
*** Lucas_Gray has joined #openstack-ironic20:10
*** bobmel has quit IRC20:23
antonymTheJulia: yeah, i'm doing master for everything so i figure if you don't specify a REF then it should just use master20:33
antonymon the ipa build20:33
TheJuliayeah, that is how it works20:33
antonymk, good20:33
*** Lucas_Gray has quit IRC20:36
antonymis the ansible deploy interface still a valid deploy method or has it fallen behind in support?  i thought it might be useful for automating cleaning/firmware steps by platform but the deploy interface didn't seem to lay down an uefi image correctly.  i have a number of playbooks that could be adapted for hardware support so i was wondering if it's worth going that route20:41
*** mbeierl has quit IRC20:43
TheJuliaantonym:  Still present, we've fixed bugs when they've been visible or reported, but typically community members have fixed them. w/r/t uefi, it might just not have the concepts required though, since to do it right with secure boot it is not a bootloader install, it is a nvram update. :(21:03
antonymah, ok, guess i need to go read into that then... i have the ansible code path running all the way through and flipping the server to active, it just doesn't appear to be booting off the drive after completion21:04
antonymbut i figured if i could get that running i could go chase down the logic for cleaning/system prep in playbooks21:05
*** jtomasek_ has quit IRC21:15
openstackgerritJulia Kreger proposed openstack/ironic master: Pre-shared agent token  https://review.opendev.org/69260921:24
*** bfournie has quit IRC21:27
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Agent token support  https://review.opendev.org/69261421:30
*** TxGirlGeek has quit IRC21:43
*** Goneri has quit IRC21:46
openstackgerritJulia Kreger proposed openstack/ironic master: Enable agent_token for virtual media boot  https://review.opendev.org/69758421:48
openstackgerritJulia Kreger proposed openstack/ironic master: Send our token back to the agent  https://review.opendev.org/69758521:48
openstackgerritJulia Kreger proposed openstack/ironic master: Signal agent token is required  https://review.opendev.org/69930421:48
*** cdearborn has quit IRC21:53
*** dking_desktop has joined #openstack-ironic21:59
*** k_mouza has joined #openstack-ironic22:16
*** bfournie has joined #openstack-ironic22:19
*** k_mouza has quit IRC22:20
*** TxGirlGeek has joined #openstack-ironic22:20
*** TxGirlGeek has quit IRC22:22
*** bobmel has joined #openstack-ironic22:23
*** bobmel has quit IRC22:29
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Rescan after restarting the md device  https://review.opendev.org/70663222:30
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Ignore pyudev errors about device number  https://review.opendev.org/70699322:30
TheJuliaOkay,, I'm hoping that takes care of the udev/software raid/headaches22:32
TheJuliarpioso: did that patch you tried ever work for you with regards to the bootloader install error not completing on an iscsi deploy?22:33
rpiosoTheJulia: I tried to build it on Saturday. It churned away only to find mksquashfs not found. I believe that tool might not be installed on my dev VM. I thought I confirmed it was before kicking off the build :( It’s definitely on my devstack VM. Gotta get back to it, hopefully, today. Will keep you looped in.22:37
TheJuliafor building a tinyipa image, definitely required :(22:39
*** openstackgerrit has quit IRC22:46
*** openstackgerrit has joined #openstack-ironic22:47
openstackgerritJulia Kreger proposed openstack/ironic master: Add indicators REST API endpoints  https://review.opendev.org/65178522:47
dking_desktopI'm attempting to boot a new baremetal node. It downloads the kernel and begins to boot, but fails with "Failed to send READY=1 notification message: transport endpoint is not connected" What would be the most likely cause, and how would I troubleshoot that?22:57
TheJuliadking_desktop: That sounds.. odd23:00
dking_desktopWell, maybe that's why I'm not finding anything related to it.23:01
TheJuliadking_desktop: could it be that the kernel and ramdisk are mismatched?23:01
dking_desktopI suppose that anything is possible. I downloaded them at the same time, but I can try downloading them again to be sure.23:01
TheJuliaSome things seem to suggest that it might be systemd starting up23:02
dking_desktopThe error is from systemd-journald.23:03
TheJuliawhat image is that your downloading?23:03
dking_desktopI can only see the line above it, from dracut-cmdline, which is confirming the kernel command line parameters. They look correct to me, but I don't know what I'm looking for.23:04
dking_desktopOne moment and I'll get the URLs.23:04
dking_desktophttps://tarballs.openstack.org/ironic-python-agent/coreos/files/coreos_production_pxe.vmlinuz and https://tarballs.openstack.org/ironic-python-agent/coreos/files/coreos_production_pxe_image-oem.cpio.gz for .kernal and .initramfs, respectively.23:05
TheJuliaoh.. heh23:05
TheJuliayeah, don't use the coreos images anymore23:05
TheJuliafungi: what would it take to get old images deleted from tarballs?23:06
dking_desktopOkay. I picked those up out of the kolla-ansible documentation somewhere.23:06
TheJulialovely23:06
dking_desktopDo you know what URLs I should be using?23:06
TheJuliaideally make your own IPA image using ironic-python-agent-builder23:06
fungiTheJulia: an infra-root sysadmin can manually delete them. which ones?23:07
fungithe coreos images i guess?23:07
openstackgerritVerification of a change to openstack/ironic failed: [Trivial] Remove redundant brackets  https://review.opendev.org/70651323:08
fungiso the entire https://tarballs.openstack.org/ironic-python-agent/coreos tree?23:08
clarkbshould we be careful pulling the rug out from under people that may be using those?23:08
fungithey seem to be current up as far as stein23:09
fungibut i guess there were also some not marked "stable"23:09
TheJuliafungi: Yeah, but it looks like we built some in Steptember which makes me hesitate a lot23:09
TheJuliaI thought I ripped all that stuff out like a year ago23:09
fungiwell, there were stable/stein images published as recently as november too23:10
TheJuliaclarkb: we should be very careful, lets hold off23:10
TheJuliayeah, lets hold off, I'll make a note to hunt down known references first23:10
TheJuliasince some document somewhere points to them :(23:10
fungilet us know when you're ready and we can take them down but make backups or something23:10
TheJuliafungi: thanks! <323:11
fungiso that if a reference gets missed somewhere they can be put back easily as well23:11
clarkbwe could also maybe move them to coreos_deprecated or similar so that people have to see that in order to keep using them23:11
dking_desktopI'm trying to figure out where I found those URLs now. It's been interesting trying to get Ironic working with Kolla-ansible. I feel like I've been trying to piece together a few outdated instructions. Maybe once I have some idea what I'm doing, I could try to update the documentation somewhere.23:13
*** jdandrea has quit IRC23:13
TheJuliadking_desktop: that would be greatly appreciated. I'm sure codesearch.openstack.org may reveal where you found the links, but I'm not looking right now because I'm basically at the point where I should stop working for the day unless the world is on fire23:15
* TheJulia notes, the world is not on fire today23:15
dking_desktopThen, it's a good day. Thanks for the tip, though. I'm going to try to find the correct images and give them a try.23:16
TheJulialast week the fires were hot :(23:16
TheJuliadking_desktop: seriously, build your own, if your using VMs and in a pinch, you can use the tinyipa images, but they are purely for testing (and on a plus side, have a really small memory footprint)23:16
dking_desktopI want to have the least number of places for me to break something, so if there's something out there that's already working, I'd like to start with that. But I suppose that I could build images, too.23:18
TheJuliaagain, if your using vms and just doing testing, they generally work. Things get a little difficult if your trying to use it on physical hardware23:19
dking_desktopWell, I am trying to work with physical hardware, so I'll keep that in mind. I believe I see the documentation for it now that I know where to look.23:21
TheJuliadking_desktop: yeah, you will really want to build your own images then. :(23:21
* TheJulia goes and exercises23:28
*** ociuhandu has joined #openstack-ironic23:30
*** ociuhandu has quit IRC23:35
*** rh-jelabarre has quit IRC23:37

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!