Monday, 2020-08-24

openstackgerritJacob Anders proposed openstack/ironic master: Generic way to configure clean step priorites  https://review.opendev.org/74411700:18
*** jamesdenton has quit IRC01:46
*** jamesden_ has joined #openstack-ironic01:47
jandershas anyone recently observed instance deployment issues on bifrost related to 403 errors from Nginx while attempting to fetch images?01:58
jandersI think I remember dtantsur|afk mentioning something along SELinux lines (can't find it in IRC history ATM though) so I first thought it was that, but it might have been just permissions: http://paste.openstack.org/show/797074/02:02
jandersI haven't hit this for a while as my bifrost "uninstaller" wasn't deleting /httpboot which I will add now for better coverage :)02:02
*** Lucas_Gray has joined #openstack-ironic02:37
*** uzumaki has joined #openstack-ironic02:57
*** tkajinam has quit IRC04:03
*** tkajinam has joined #openstack-ironic04:03
*** abdysn has joined #openstack-ironic05:02
*** hjensas_ has joined #openstack-ironic05:18
*** Lucas_Gray has quit IRC05:21
*** chenhaw has quit IRC06:04
arne_wiebalckGood morning, ironic!06:12
*** mnasiadka has quit IRC06:16
*** mnasiadka has joined #openstack-ironic06:19
*** rcernin has quit IRC06:23
*** seongsoocho has quit IRC06:24
*** seongsoocho has joined #openstack-ironic06:25
*** rcernin has joined #openstack-ironic06:32
*** dtantsur|afk is now known as dtantsur06:35
dtantsurmorning ironic, happy Monday06:35
*** rcernin has quit IRC06:36
*** rcernin has joined #openstack-ironic06:36
dtantsurjanders: it feels like "just" permissions (and why on earth aren't we fixing them??)06:38
dtantsura patch is welcome06:38
*** jhesketh_ has quit IRC06:39
*** jhesketh has joined #openstack-ironic06:41
*** hjensas__ has joined #openstack-ironic06:48
iurygregorygood morning janders arne_wiebalck dtantsur and Ironic o/06:49
*** hjensas_ has quit IRC06:51
arne_wiebalckhey iurygregory dtantsur o/06:52
*** mkrai has joined #openstack-ironic06:54
*** chenhaw has joined #openstack-ironic06:55
*** SuiongNg|ITRI_TW has joined #openstack-ironic06:58
*** sshnaidm|afk is now known as sshnaidm07:03
openstackgerritMerged openstack/ironic master: Documentation update for ilo hardware type  https://review.opendev.org/74645307:06
*** Qianbiao has joined #openstack-ironic07:09
rpittaugood morning ironic! o/07:12
dtantsurfolks, please review https://review.opendev.org/747437 it fixes a pretty serious bug07:19
patchbotpatch 747437 - bifrost - Explicitly enable DHCP services on baremetal CentO... - 2 patch sets07:19
rpittaudtantsur, TheJulia, sorry I didn't have IRC connection on Friday afternoon/evening, I saw the "chicken-n-egg" issue later, but seems all good now07:20
dtantsuryeah, TheJulia has solved it in the end07:22
dtantsurrpittau: I wonder if we need the RAM bump backported..07:22
rpittaudtantsur: I was considering that, we probably do07:23
rpittaudtantsur: TheJulia already backport to 15.2, but I think we should do it for ussuri too07:24
rpittausame for ironic-python-agent07:25
iurygregorymorning rpittau o/07:25
rpittauhey iurygregory :)07:25
dtantsuralso looking for reviews on this bug fix https://review.opendev.org/#/c/747389/07:28
patchbotpatch 747389 - ironic - Ensure in-band deploy steps are present in time fo... - 3 patch sets07:28
dtantsurand on https://review.opendev.org/#/c/747413/07:28
patchbotpatch 747413 - metalsmith - CI: use the direct deploy by default - 2 patch sets07:28
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: [PoC] A deploy step to update /etc/default/grub  https://review.opendev.org/74377107:30
openstackgerritRiccardo Pittau proposed openstack/ironic stable/ussuri: Increase memory of tinyipa vms  https://review.opendev.org/74763307:33
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent stable/ussuri: Increase memory for tinyipa jobs  https://review.opendev.org/74763407:38
openstackgerritMerged openstack/ironic stable/rocky: Retries and timeout for IPA command  https://review.opendev.org/74726507:51
*** lucasagomes has joined #openstack-ironic07:58
*** akahat|rover is now known as akahat|lunch07:58
openstackgerritvinay kumar muddu proposed openstack/ironic master: [WIP]: Adds ilo-uefi-https boot interface to ilo5  https://review.opendev.org/74550108:03
*** yolanda has quit IRC08:03
*** dougsz has joined #openstack-ironic08:04
*** livelace has joined #openstack-ironic08:05
openstackgerritvinay kumar muddu proposed openstack/ironic master: [WIP]: Adds ilo-uefi-https boot interface to ilo5  https://review.opendev.org/74550108:11
Qianbiaohello ironic.08:16
QianbiaoHi, when combine ironic with openstack-services, should dhcp still be provided by ironic in provisioning network?08:17
Qianbiaoshould i still install a dnsmasq to provide dhcp for first pxe network08:17
openstackgerritDmitry Tantsur proposed openstack/ironic-lib master: Move some generic functions from IPA  https://review.opendev.org/74764108:26
openstackgerritMerged openstack/bifrost master: Explicitly enable DHCP services on baremetal CentOS/RHEL  https://review.opendev.org/74743708:26
dtantsurQianbiao: when using ironic with neutron, dhcp is usually provided by neutron-dhcp-agent08:27
Qianbiaodtantsur hmm, should provisioning network be a subnet created by neutron?08:31
Qianbiaoin our test env, our nodes are connected directly(including SDN device)08:32
dtantsurQianbiao: usually the provisioning network is handled by neutron, yes. Your case may be different, of course.08:35
openstackgerritDmitry Tantsur proposed openstack/bifrost bugfix/8.3: Explicitly enable DHCP services on baremetal CentOS/RHEL  https://review.opendev.org/74764408:35
*** livelace has quit IRC08:36
Qianbiaook thanks dtantsur08:36
openstackgerritDmitry Tantsur proposed openstack/bifrost stable/ussuri: Use firewalld to open ports on CentOS and RHEL.  https://review.opendev.org/74764508:36
openstackgerritDmitry Tantsur proposed openstack/bifrost stable/ussuri: Explicitly enable DHCP services on baremetal CentOS/RHEL  https://review.opendev.org/74764608:37
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Leave kbd installed  https://review.opendev.org/74764708:38
*** derekh has joined #openstack-ironic08:43
jandersg'day arne_wiebalck dtantsur iurygregory rpittau o/08:51
rpittauhey janders :)08:51
iurygregoryo/08:52
jandersdtantsur noted regarding permissions, happy to look into that when I'm done with the initial part of the FIPS work08:52
arne_wiebalckhey janders o/08:52
*** k_mouza has joined #openstack-ironic08:52
*** rcernin has quit IRC09:03
openstackgerritDmitry Tantsur proposed openstack/ironic-lib master: Move some generic functions from IPA  https://review.opendev.org/74764109:12
rpittauhey arne_wiebalck, welcome back :)09:24
arne_wiebalckhey rpittau o/ thanks!09:24
*** priteau has joined #openstack-ironic09:24
*** mkrai has quit IRC09:31
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Remove env-vars  https://review.opendev.org/74766809:39
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Remove support for non-venv deployments  https://review.opendev.org/74743409:40
jandersdtantsur looks like the image-creation playbook already does the right thing with permissions: https://opendev.org/openstack/bifrost/src/branch/master/playbooks/roles/bifrost-create-dib-image/tasks/main.yml#L167 the only question remains why didn't it work for me... I'll raze my bifrost install, start fresh and see if I hit this issue again09:52
jandersthe only thing that comes to mind is some weird race condition... maybe the node is still traumatised after the dev-scripts driven IO starvation episode on Friday LOL (I'm now using it for bifrost)09:54
*** livelace has joined #openstack-ironic09:55
*** Qianbiao has quit IRC09:55
*** Qianbiao has joined #openstack-ironic09:58
openstackgerritMerged openstack/bifrost bugfix/8.3: Explicitly enable DHCP services on baremetal CentOS/RHEL  https://review.opendev.org/74764409:59
openstackgerritMerged openstack/bifrost stable/ussuri: Use firewalld to open ports on CentOS and RHEL.  https://review.opendev.org/74764509:59
openstackgerritMerged openstack/bifrost stable/ussuri: Explicitly enable DHCP services on baremetal CentOS/RHEL  https://review.opendev.org/74764609:59
dtantsurjanders: if running with --testenv, your image is a cirros image downloaded from the internet, not DIB-built10:01
*** mkrai has joined #openstack-ironic10:01
jandersaha! will look into that codepath, too. Thanks heaps dtantsur!10:01
dtantsurjanders: https://opendev.org/openstack/bifrost/src/branch/master/playbooks/roles/bifrost-ironic-install/tasks/bootstrap.yml#L33010:02
jandersdtantsur I see how things might get wrong there10:02
dtantsurjanders: the reason it suddenly stopped working is https://github.com/ansible/ansible/issues/7120010:02
dtantsuri.e. an upstream defaults change10:02
dtantsurI do think we should be explicit about ownership and ACL for all downloaded/built files10:03
dtantsurso a patch is welcome :)10:03
jandersdtantsur very well spotted, I haven't hit this elsewhere yet10:04
jandersdtantsur will do10:04
dtantsurjanders: get_url seems to have a mode/owner, so it must be an easy fix10:14
*** rcernin has joined #openstack-ironic10:17
* dtantsur is looking into running ansible-lint on bifrost10:17
*** rcernin has quit IRC10:22
*** ijw has joined #openstack-ironic10:23
*** ijw has quit IRC10:27
*** akahat|lunch is now known as akahat|rover10:27
openstackgerritvinay kumar muddu proposed openstack/ironic master: Decouple the ISO creation logic from redfish  https://review.opendev.org/73917410:36
jandersdtantsur exactly my plan. Do you think we should parameterise  permissions or is hardcoding okay? (I see a fair bit of hardcoded 644s around the code)10:38
*** Lucas_Gray has joined #openstack-ironic10:41
openstackgerritvinay kumar muddu proposed openstack/ironic master: Allow HttpImageService to accept custom certificate  https://review.opendev.org/74293610:50
*** rh-jelabarre has joined #openstack-ironic10:53
openstackgerritDmitry Tantsur proposed openstack/bifrost master: [WIP] Add a CI job with ansible-lint  https://review.opendev.org/74768611:07
dtantsurjanders: hardcoding is pretty okay11:07
jandersdtantsur ACK, thank you11:08
janderswrapping up for the day, see you tomorrow Ironic o/11:08
janderswill finish up and submit that patch first thing in the morning11:09
iurygregorybye janders11:09
janderscheers iurygregory11:09
dtantsurg'night janders11:11
*** mkrai has quit IRC11:13
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Add a CI job with ansible-lint  https://review.opendev.org/74768611:14
dtantsurrpittau gotta like ^^^ probably :)11:14
* dtantsur will fix a few errors in a new patch11:14
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Add a CI job with ansible-lint  https://review.opendev.org/74768611:15
* iurygregory brb lunch11:25
openstackgerritDmitry Tantsur proposed openstack/bifrost master: ansible-lint: fix error 204 (Lines should be no longer than 160 chars)  https://review.opendev.org/74769211:42
*** hjensas__ is now known as hjensas|lunch11:57
rpittaudtantsur: you were faster than me as usual, I was actually looking at that :)12:06
dtantsurrpittau: oh sorry. what exactly are you looking at?12:06
dtantsurI'm trying to fix 3xx atm12:06
rpittaudtantsur:  the ansible-lint :)12:06
* dtantsur should have asked, sorry again12:06
rpittaudtantsur: no worries! :)12:07
openstackgerritDmitry Tantsur proposed openstack/bifrost master: ansible-lint: fix errors 303, 305, 306  https://review.opendev.org/74769412:07
openstackgerritKaifeng Wang proposed openstack/ironic-specs master: Snapshot support  https://review.opendev.org/74693512:07
dtantsurI'll stop fixing lints for today after ^^^12:07
dtantsurany remaining are up for taking12:07
rpittau:D12:07
rpittauok!12:07
*** mkrai__ has joined #openstack-ironic12:08
*** mkrai__ has quit IRC12:08
*** livelace has quit IRC12:13
Qianbiaohello dtantsur12:18
Qianbiaowhen deploy interface is ramdisk, bm will pxe twice right?12:18
openstackgerritDmitry Tantsur proposed openstack/metalsmith master: CI: use the direct deploy by default  https://review.opendev.org/74741312:19
dtantsurQianbiao: no, I think only once12:19
Qianbiaodeploy directly? without coreos loading>12:19
Qianbiaothen when will network changes from provision network to tenant network.12:20
Qianbiaowhen pxe happen, server is in provisioning network or tenant12:20
*** mkrai has joined #openstack-ironic12:21
dtantsurQianbiao: unless I'm mistaken, the first and only boot happens on the tenant network12:21
rpittaudtantsur: what's the reason of limiting ansible-lint to <5 ?12:22
dtantsurrpittau: I assume the next major version will have more lints by default12:22
dtantsurbreaking us12:22
rpittauok, I see, makes sense, thanks12:22
Qianbiaodtantsur got thanks.12:23
Qianbiaoit there any method can void the pxe expose security issue.12:24
dtantsurQianbiao: if your hardware supports virtual media, you can use it12:27
dtantsurotherwise, I'm afraid, it's unavoidable with the ramdisk deploy12:27
Qianbiao<dtantsur> yes we support it.12:27
Qianbiaoshould i add virtual media implementation12:27
dtantsurthat would be really good12:28
dtantsurTheJulia: https://review.opendev.org/#/c/743771/ works, do you think it's worth turning into a real optional feature?12:32
patchbotpatch 743771 - ironic-python-agent - [PoC] A deploy step to update /etc/default/grub - 4 patch sets12:32
dtantsur(there should be more work around whole-disk images)12:32
dtantsurother opinions also welcome ^^^12:32
*** livelace has joined #openstack-ironic12:33
openstackgerritMerged openstack/bifrost master: Add a CI job with ansible-lint  https://review.opendev.org/74768612:59
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: documentation: clean up and expand the landing page  https://review.opendev.org/74772313:12
*** bnemec has joined #openstack-ironic13:22
*** tosky has joined #openstack-ironic13:22
*** Goneri has joined #openstack-ironic13:25
TheJuliagood morning everyone13:26
rpittaugood morning TheJulia :)13:26
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: Refactor and fix documentation  https://review.opendev.org/74772313:27
openstackgerritMerged openstack/ironic-python-agent master: Clarify connection error on heartbeats  https://review.opendev.org/74721013:29
dtantsurmorning TheJulia13:29
*** rloo has joined #openstack-ironic13:32
TheJuliaWhat is the assessment of the gate status this morning?13:34
TheJulialine 55 from the etherpad seems really out of date13:34
rpittaubetter than Friday :)13:34
rpittautinyipa jobs are fixed13:34
TheJulia\o/13:35
rpittauTheJulia: I can add a couple of lines there to ezplain13:35
rpittauor explain even13:35
*** tzumainn has joined #openstack-ironic13:37
rpittauTheJulia: btw, if you have a minute, we should pin pip version https://review.opendev.org/74721813:41
patchbotpatch 747218 - ironic-python-agent-builder - Pin pip version to install in tinyipa images - 2 patch sets13:41
TheJuliaHey, stable cores, can I get quick review on https://review.opendev.org/#/c/744053/ ?13:43
patchbotpatch 744053 - ironic-python-agent (stable/rocky) - improve error messages during node lookup failures - 1 patch set13:43
TheJuliaIt is blocking another fix from merging13:43
rpittaudone13:43
openstackgerritAija Jaunteva proposed openstack/ironic-specs master: System configuration within whole clean or deploy step  https://review.opendev.org/74072113:44
openstackgerritJulia Kreger proposed openstack/ironic bugfix/15.2: Ansible deploy - Ignore invalid devices  https://review.opendev.org/74772913:47
openstackgerritJulia Kreger proposed openstack/ironic bugfix/15.1: Ansible deploy - Ignore invalid devices  https://review.opendev.org/74773013:47
dtantsurTheJulia: oh, by the way, this Monday is sponsored by https://github.com/ansible/ansible/issues/7120013:51
dtantsur(that's the cause of one of the bifrost issues trandles experienced)13:51
TheJuliano wonder13:52
TheJuliajeeze13:53
* TheJulia wonders who is the current pinkish-purple on the etherpad this morning13:53
rpittauI think they reverted the change ?13:53
rpittauTheJulia: maybe me ? on line 56 ?13:54
TheJuliayes!13:54
dtantsurthey did revert it. but there is also an ansible-lint for missing mode, so we'll have to fix it anyway :)13:54
rpittauah snap13:54
*** abdysn has quit IRC13:55
*** mjturek has joined #openstack-ironic13:58
TheJuliastevebaker: For when your up, what is the deal with https://review.opendev.org/#/c/742795/7 ?14:07
patchbotpatch 742795 - ironic - New argument validate decorator - 7 patch sets14:07
openstackgerritMerged openstack/ironic master: Ensure in-band deploy steps are present in time for fast-track deployments  https://review.opendev.org/74738914:09
openstackgerritDmitry Tantsur proposed openstack/ironic bugfix/15.2: Ensure in-band deploy steps are present in time for fast-track deployments  https://review.opendev.org/74773714:10
dtantsurTheJulia: I think we can release 15.2.1 after this ^^ and the ansible fix14:11
TheJulia++14:11
TheJuliawe likely need to do a release of some of the older branches too14:12
*** hjensas|lunch is now known as hjensas14:13
TheJuliaI wonder if someone needs to revise https://review.opendev.org/#/c/557051/14:14
patchbotpatch 557051 - networking-generic-switch - Support multiple links in link_local_information d... - 12 patch sets14:14
JayFWhat's the deal with lower constraints? What determines them, are are the flexible?14:19
JayF> eventlet==0.18.214:19
TheJulialower-constraints.txt and yes they can be changed14:19
JayFis scary old and buggy -- I'm amazed we have that old of a version there14:19
TheJuliaminimum versions things _should_ work with14:19
JayFmy what determines them is more philosophical, I know about the file14:19
JayFe.g. are there certain use cases targetted14:20
TheJuliahumans do, so they can be out of date14:20
JayFcompatability with something, etx14:20
JayFOK, so if the answer to IPA eventlet patch failures is "update lower-constraints", we're OK with that? Especially in IPA?14:20
TheJuliait is fine to increment the minimum version upward on master branch14:20
JayF(since IPA is not co-installed)14:20
JayFack; that'll likely be the action I take for my PR14:21
TheJuliak14:21
JayFI've read over 9000 bugs in old eventlet around wsgi+ssl; I don't think even if unit tests passed I'd be willing to suggest someone run on eventlet that old :D14:21
*** Lucas_Gray has quit IRC14:22
dtantsurJayF: please read my comments on your patch, updating eventlet won't simply help14:29
dtantsur(at least it does not help when tried locally)14:29
JayF0.25.1 is what we run against in master?14:29
JayFthat was the missing piece for me14:29
dtantsuryep, tried that14:29
JayFack; I'm sure I can track it down14:30
JayF[knocks on wood]14:30
JayFDid you see my replies abuot moving the __init__.py stuff around?14:30
dtantsurprobably not yet14:30
JayFIf we're OK with breaking mod_wsgi support,  I'm happy to move it around14:30
JayFbut I wanted to make sure you read the commit and were making that suggestion with the explicit knowledge it breaks mod_wsgi14:30
JayFalthough TBH, it's likely it didn't work under mod_wsgi anyway b/c of how we handle heartbeats14:31
dtantsurJayF: I don't see how it would break mod_wsgi14:33
dtantsurwithout actually calling eventlet, the environment variable won't affect anything, will it?14:33
JayFsee https://review.opendev.org/#/c/440292/14:33
patchbotpatch 440292 - ironic - Move eventlet monkey patch code (MERGED) - 2 patch sets14:33
dtantsurwell, ignoring the fact that IPA is unlikely to work under mod_wsgi :)14:33
dtantsurTheJulia: we need to get used to updating the CI of bugfix branches every time after the release14:34
*** mkrai has quit IRC14:34
JayFyeah; I'll re-centralize it and add to my release notes that it absolutely will not worj14:35
JayF*work14:35
dtantsurJayF: not because of your patch14:36
dtantsurnote that https://review.opendev.org/#/c/440292/2/ironic/__init__.py actually had monkey_patch in __init__ unlike IPA14:36
patchbotpatch 440292 - ironic - Move eventlet monkey patch code (MERGED) - 2 patch sets14:36
dtantsurI agree that it's bad14:37
JayFYeah; which is why I moved it to cmd/ when I added the monkey_patch14:37
JayFbut I still think it's exceedingly unlikely that, for instance, ussuri IPA works under mod_wsgi14:37
JayFso just take the guaranteed hard breakage, document it, and move on14:37
openstackgerritwu.chunyang proposed openstack/python-ironicclient master: Remove Babel requirement  https://review.opendev.org/74758114:37
JayFthat's what reverse proxying is for :D14:37
dtantsurit's an option, although that's not exactly what I asked for14:37
dtantsur(I was only pointing out a copy-paste of the environment code)14:38
JayFOoooh! I got it, you want the environment stuff at root level, the monkey patch at cmd/ level14:38
dtantsurbut yeah, I don't see how IPA would work under any WSGI server. half of its initialization is in agent.py which hardcodes using oslo.service14:38
JayFAll my previous comments are still valid though, because I don't think ^^^ exactly14:38
JayFSo I'm going to just move it all to the base level __init__.py, and document it won't work with it14:39
dtantsurwfm14:39
JayF*IPA won't work with mod_wsgi14:39
JayFand then play requirements-bingo until I get CI to pass under lower-constraints :|14:39
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Update the cache if we don't have a root device hint  https://review.opendev.org/74707214:41
*** mkrai has joined #openstack-ironic14:42
dtantsurJayF: could you please read https://storyboard.openstack.org/#!/story/2007214 before the meeting to make sure I'm not saying anything contradicting your plans?14:43
JayFlooking14:44
dtantsurThis RFE now tries to cover both static and automatic TLS configuration14:44
openstackgerritMerged openstack/ironic-python-agent stable/rocky: improve error messages during node lookup failures  https://review.opendev.org/74405314:44
JayFThe option as I have it written is ``listen_ssl``, you have it listed as ``listel_tls`` -- I don't mind tls vs ssl, we should just be consistent14:45
dtantsurJayF: is it too late to change the option to tls in your code?14:45
dtantsurssl is an ancient thing14:45
JayFthe other thing, you may want to be specific it's ssl.cert_file / ssl.key_file not default.{}14:45
JayFabsolutely, I can change it14:45
*** cdearborn has joined #openstack-ironic14:46
JayF[agent]api_key_file is not required for client cert verification.14:46
JayFYou only need the CA file.14:47
brtknrhey folks, after adding a new conductor, how do i rebalance the nodes across the conductors?14:47
JayFOh, you're talking about the other side, in the ironic.conf?14:47
dtantsuryep14:47
JayFThat section 2.1 I think is missing something?14:47
brtknri have tried restarting the conductors but that doesnt seem to be enough14:47
JayFOh, nevermind, this is a little confusing, I keep losing track of who the client and who the server is14:48
JayFdtantsur: LGTM. I'll make my config variable compatible, and edited your RFE just now to fix a typo14:48
*** kaifeng has joined #openstack-ironic14:49
dtantsurJayF: we might have had an editing collision, could you check again please?14:50
JayFmy typo fix (``listel_tls`` -> ``listen_tls``) still appears in the change14:50
dtantsurand of course storyboard takes forever to refresh..14:51
dtantsurJayF: I don't see it anymore, could you also refresh?14:52
* dtantsur shakes fist at storyboard14:52
JayFlgtm after refresh?14:52
brtknrhow do you rebalance nodes across conductor groups in general?14:56
brtknri have seen it happen when a conductor fails14:56
brtknris there a way to trigger rebalance on demand?14:56
JayFI believe a rolling restart should do it.14:56
openstackgerritMerged openstack/ironic-python-agent stable/rocky: Fix TypeError on agent lookup failure  https://review.opendev.org/74542614:57
brtknri dont want to resort to assigning nodes to conductor groups14:57
brtknrJayF: is that in response to my questions?14:57
brtknri tried restarting14:57
brtknrdidnt help14:57
dtantsurI believe the nodes balance out automatically, but not when they have instances already14:59
JayFYeah, that's the only way I know to do it. This is a little bit of an X/Y question -- you shouldn't need to worry about what nodes are managed by what conductor in general usage14:59
dtantsurbut that's a bit of an untested area, to be honest14:59
*** tkajinam_ has joined #openstack-ironic14:59
JayFSo I'm wondering what the symptoms are you're trying to resolve14:59
TheJuliaThey should balance out evenly, the conundrum is it can still be weighted on one side14:59
TheJuliaor on to a node14:59
TheJuliaArne had some graphs a while back that showed an extra 200-400 nodes on one conductor for some reason15:00
TheJuliaAnyway, it is meeting time!15:00
TheJulia#startmeeting ironic15:00
openstackMeeting started Mon Aug 24 15:00:17 2020 UTC and is due to finish in 60 minutes.  The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
TheJuliao/15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: ironic)"15:00
*** another_larsks is now known as larsks15:00
rpittauo/15:00
openstackThe meeting name has been set to 'ironic'15:00
JayFo/15:00
rajiniro/15:00
rpioso\o15:00
kaifengo/15:00
ajyao/15:00
TheJuliaGood morning ironic!15:00
erbarro/15:00
bfournieo/15:00
bdoddo/15:00
arne_wiebalcko/15:00
brtknro/15:00
iurygregoryo/15:01
*** seongsoocho_ has joined #openstack-ironic15:01
TheJuliaOur agenda can be found on the wiki, as always.15:01
TheJulia#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting15:01
cdearborno/15:01
TheJulia#topic Annoucements/Reminders15:01
*** openstack changes topic to "Annoucements/Reminders (Meeting topic: ironic)"15:01
TheJuliaA midcycle topic etherpad has been setup15:01
TheJulia#link https://etherpad.opendev.org/p/Ironic-Victoria-midcycle15:01
TheJuliaI believe September 2nd and 3rd are the best looking dates when I last glanced at the doodle15:02
dtantsuro/15:02
TheJuliarpittau: when are we closing that out?15:02
rpittauTheJulia: on wednesday15:02
rpittauwanted to give some more time as I know some people were on vacation until today15:02
TheJuliaAdditionally: If there is any update required for non-client libraries, we need to have it in before next week to meet the OpenStack release schedule15:03
*** stendulker has joined #openstack-ironic15:03
TheJulia#link https://releases.openstack.org/victoria/schedule.html15:03
*** seongsoocho has quit IRC15:03
stendulkero/15:03
*** uzumaki has quit IRC15:03
*** tkajinam has quit IRC15:03
rloomeeting?15:03
*** dougsz has quit IRC15:03
*** seongsoocho_ is now known as seongsoocho15:03
TheJulia#link https://doodle.com/poll/pi4x3kuxamf4nnpu15:03
TheJuliaIs the link for the doodle15:03
TheJuliaDoes anyone have anything else to announce or remind us of?15:04
*** SuiongNg|ITRI_TW has quit IRC15:04
* TheJulia expects one day for someone to announce a gif of pixie boots on the moon or something15:04
dtantsurthe PTG registration has opened, I think15:04
TheJuliaLooks like we had no action items last week, so we should be able skip that part of the meeting.15:05
TheJuliaOh!15:05
*** ildikov has quit IRC15:06
TheJuliaIt is Forum brainstorming time! If there are items to be dsicussed or items that shoudl be held as forum topics, please add them to the victoria midcycle etherpad and we can further refine and bring those forward.15:06
TheJuliaI guess we'll be there as a team, the PTG that is?15:07
* TheJulia assumes yes15:08
TheJuliaAnyway! Onward!15:08
*** ildikov has joined #openstack-ironic15:09
dtantsuryep15:09
iurygregory++15:09
rpittauyeah15:09
TheJuliaMoving to subteam status reports15:09
TheJulia#topic Review subteam status reports15:09
*** openstack changes topic to "Review subteam status reports (Meeting topic: ironic)"15:09
TheJulia#link https://etherpad.openstack.org/p/IronicWhiteBoard15:09
TheJuliaStarting at line 32715:10
TheJuliadtantsur: you mentioned bug fix branch changes, can you write down something under breaking the cycle so we know to do it?15:10
TheJuliaI'm also not entirely sure what you were saying, so more $words is likely better15:11
TheJuliaiurygregory: any luck with grenade?15:11
*** chenhaw has quit IRC15:11
dtantsurTheJulia: I'll probably propose a documentation patch instead15:11
iurygregoryTheJulia, nope =( -P didn't help15:11
*** chenhaw has joined #openstack-ironic15:11
TheJuliadtantsur: awesome15:11
iurygregorymaybe worth to discuss during the next midcycle15:12
TheJuliaiurygregory: sounds like a great topic for the etherpad!15:12
*** johnhaan has quit IRC15:12
*** johnhaan_ has joined #openstack-ironic15:12
iurygregoryTheJulia, yeah I will add15:12
iurygregoryand we would probably need to merge broken so we would switch to zuulv315:13
iurygregoryand help the goal15:13
TheJulia*sigh*15:14
TheJuliawell, on the plus side it would help more people see what is going on15:15
iurygregoryyeah15:15
iurygregorycompared to before, we can see some problems..15:15
TheJuliaiurygregory: any news on privsep?15:15
TheJuliabeing able to see the problems is a much better situation!15:15
iurygregoryI was able to chat with ralonsoh today (he was on PTO)15:16
iurygregorythe failure we see only in one job is a bit weird, since ironic should have access to all folders we are running the os.link15:16
rpittauiurygregory: for privsep I think adding some more logging on the permissions of the dirs/files might help, at least for debugging15:16
iurygregoryrpittau, yeah15:16
TheJuliaTo me, it seems likely that privsep will slip to next cycle? Any thoughts/concerns around this?15:17
rpittauno concerns15:17
TheJuliarpioso: thanks for the update on the redfish compatability profile stuffs15:17
TheJuliaarne_wiebalck: I guess we should talk about next steps for the sig. That could also be a midcycle topic I guess?15:17
iurygregoryno concerns also, but I will keep updating =)15:17
arne_wiebalckTheJulia: yes15:18
arne_wiebalckTheJulia: I need to pick this up15:18
rpiosoTheJulia: You're welcome. And done :)15:18
arne_wiebalckTheJulia:  I think we wanted to send out a mail re SIG meetings15:18
TheJuliaYeah, I think that was the consensus before you went on PTO15:19
arne_wiebalckTheJulia: And a first topic would be what to focus on after the white paper15:19
arne_wiebalckTheJulia: There was some input from the opendev event15:19
arne_wiebalckTheJulia: I will send out the mail to find a regular slot15:19
TheJuliaIndeed!15:19
TheJuliaAwesome!15:19
*** gyee has joined #openstack-ironic15:20
TheJuliaWell, is everyone good to proceed to reviewing priorities for the coming week?15:20
rpittaulet's15:20
TheJulia#topic Deciding priorities for the coming week15:20
*** openstack changes topic to "Deciding priorities for the coming week (Meeting topic: ironic)"15:20
TheJulia#link https://etherpad.openstack.org/p/IronicWhiteBoard15:20
TheJuliaStarting at line 15615:20
TheJuliaAny thoughts on droppign the WSME removal changes/refactoring patches for now, they are blocked and we don't have clarity15:21
TheJuliadropping them from the list for the next week or two, that is15:21
rpittausounds good, they need revision/rebase anyway15:21
*** rloo has quit IRC15:22
TheJuliaOkay, removing merged items15:22
*** zaneb has quit IRC15:22
*** andrein has quit IRC15:22
*** donnyd has quit IRC15:22
*** priteau has quit IRC15:22
*** buhman has quit IRC15:22
*** vkmc has quit IRC15:22
*** mnaser has quit IRC15:22
*** guilhermesp has quit IRC15:22
TheJuliajust what we need during our weekly meeting, a netsplit15:23
dtantsur\o/15:23
rpittauyay15:23
TheJuliaLooks like it was a small one anyway15:23
TheJuliaOkay, new items staring at line 230, any objection to adding these?15:24
iurygregoryI've updated the dhcp-less section15:25
TheJuliaOh, that is awesome15:25
iurygregorygood thing is that we won't need changes on ipa etc15:25
iurygregoryglean just works15:25
TheJuliaimpressive15:25
* TheJulia hears the lack of objections as agreement to add all the items after line 23015:26
iurygregorythe only fix we needed is merged https://review.opendev.org/#/c/747144/ (Vinay did some tests and reported this issue)15:26
patchbotpatch 747144 - ironic - Fix network_data path for dhcpless deployments (MERGED) - 1 patch set15:26
TheJuliaOkay list updated, Does that work for everyone?15:29
rpittauyep15:30
stendulkerhttps://review.opendev.org/#/c/742936/15:30
patchbotpatch 742936 - ironic - Allow HttpImageService to accept custom certificate - 6 patch sets15:30
TheJuliaWell, then I think it is time to move forward to discussion15:30
stendulkerCan this be added?15:30
TheJuliastendulker: already in the list15:30
TheJulialine 18915:30
stendulkerTheJulia: oh, ok, Thanks15:31
TheJuliaNo worries!15:31
*** weshay|ruck has quit IRC15:31
TheJulia#topic Discussion15:32
*** openstack changes topic to "Discussion (Meeting topic: ironic)"15:32
*** weshay has joined #openstack-ironic15:32
TheJuliaWe have one discussion topic this morning.15:32
*** rloo has joined #openstack-ironic15:32
*** tepper.freenode.net changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/ironic/ | Bugs: https://storyboard.openstack.org/#!/project_group/75 | Contributors are generally present between 6 AM and 12 AM UTC, If we do not answer, please feel free to pose questions to openstack-discuss mailing list."15:32
TheJuliadtantsur: would you like the microphone?15:32
dtantsuryep15:32
dtantsur#link http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016681.html15:32
dtantsurthis is a proposal to deprecate and eventually remove the iscsi deploy interface15:32
dtantsurwith the introduction of the image_download_source option we no longer seem to have use cases that are covered by iscsi but not by direct15:33
dtantsurwhen working on deploy steps, the presence of a similar but not quite same interface implementation was a huge impediment15:33
*** zaneb has joined #openstack-ironic15:33
*** donnyd has joined #openstack-ironic15:33
*** andrein has joined #openstack-ironic15:33
TheJuliaI can second the pain of the similar but fundamentally different interfaces causing headaches.15:34
dtantsurwith a goal of reducing the code base and substantially reducing the testing matrix, I'd like to remove it15:34
*** priteau has joined #openstack-ironic15:34
*** buhman has joined #openstack-ironic15:34
*** guilhermesp has joined #openstack-ironic15:34
*** vkmc has joined #openstack-ironic15:34
*** mnaser has joined #openstack-ironic15:34
TheJuliaI'm pretty much for this proposal, I'm wondering if anyone is really objecting?15:35
* arne_wiebalck thinks that image_download_source=http for direct should be called indirect 15:35
kaifenghow about moving it to x-stagging-drivers after removal from ironic?15:35
JayFNo objection from me. Maybe even a minor squeal of gleeful victory for the agent :D15:35
TheJuliaarne_wiebalck: propose a patch? :)15:35
iurygregoryarne_wiebalck, ++15:35
TheJuliaI actually like that idea and deprecating/removing iscsi does open the door to that15:36
TheJuliaAnd it wouldn't need to be a separate interface, just an option15:36
dtantsurarne_wiebalck: indirect is how we call it in the CI :)15:36
TheJuliawell, a separate interface of code15:36
TheJuliaSo I'm not hearing objections, maybe we bring up one more time at the midcycle and if nobody screams by then go ahead and approve the deprecation?15:37
arne_wiebalckI think this provides a very smooth transition for iscsi deployments15:37
arne_wiebalckWe should just be clear it does not address scalability issues15:37
TheJuliait might be even easier for it to be an optional upgrade step or logic in the ugprade checker15:37
TheJuliatime for RFE Review?!?15:38
TheJuliaarne_wiebalck: ++15:38
openstackgerritAnkit Kumar proposed openstack/ironic master: Enhance certificate verification for ilo harware type  https://review.opendev.org/74349015:39
TheJulia#topic RFE Review15:40
*** openstack changes topic to "RFE Review (Meeting topic: ironic)"15:40
TheJuliadtantsur: are these all yours? :)15:40
dtantsurat least added by me :)15:40
TheJuliaI need to step away for a moment, if you wouldn't mind :)15:40
dtantsur#link https://storyboard.openstack.org/#!/story/2007214 Pass TLS certificate file from ironic to IPA via virtual media15:40
dtantsuroops, I scared TheJulia :)15:40
iurygregoryhahaha15:40
dtantsuranyway, the first one addresses the well known problem of TLS between ironic and the agent15:40
dtantsurJayF helped me shape it so that it covers both static and automatic TLS15:41
dtantsur(thanks!)15:41
JayFOne thing that on further consideration I wonder if you wanna add to that RFE15:41
dtantsurmy personal goal is to have the TLS pretty much automatically set up and enabled15:41
JayFis the Ironic conductor presenting a client certificate to IPA15:41
*** k_mouza has quit IRC15:42
JayFand using the same mechanism for passing cert/key to IPA to also pass a ca file through to IPA15:42
dtantsuryep, I haven't thought about this bit yet15:42
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: Document in-band deploy steps and add more docs for custom steps  https://review.opendev.org/74775315:42
* TheJulia returns15:43
dtantsurJayF: should be easy to add, even later on15:43
JayF++15:43
dtantsurany thoughts on the overall RFE? especially if anybody understands TLS better than me?15:44
JayFMy only concern is that by design, sending a private key over to the agent over and over makes it unlikely to remain secure15:44
JayFI think in a perfect world, we'd have Ironic generate a fresh, rapidly-expiring cert/key that's signed by a longer-lived cert15:45
dtantsurJayF: I don't think we send the private key, do we?15:45
JayFbut there's nothing that would prevent that from being done as a later step15:45
TheJuliaas long as it seems like nothing blocks us in from doign that later, I'm good with it.15:45
dtantsurthe current proposal offers to generate the key on the agent side and send ironic its public part15:45
JayF2.1 bullet #2: If these are provided, embed them into the virtual media ISO and populate the oslo.service [ssl]cert_file and [ssl]key_file option in /etc/ironic-python-agent/ironic-python-agent.conf.15:45
dtantsurah, the client certificate part15:46
dtantsurJayF: what if we split away the client certificates into a new RFE?15:46
dtantsurthe number of combinations here already gives me a headache15:46
JayFbut again, it can be a later enhancement so I don't view it as a  blocker. It just makes it difficult to see deployers with strong preexisting certificate infrastructure being wiling to ship around private keys like that.15:46
JayFdtantsur: +++15:47
TheJuliaI like that idea15:47
TheJulia(split them into two rfes15:47
TheJulia)15:47
dtantsurokay, I'll split 2.1 and further improvements into a new RFE15:47
TheJuliaawesome15:47
TheJulianext!15:47
dtantsurhow is everything else looking?15:47
* dtantsur gives people 1 more minute to add their comments15:47
TheJuliaI already approved 200804315:47
TheJuliaGiven it was always the intent for us to support that case15:48
dtantsurokay, good :)15:48
TheJuliait is just a logical progression at this point15:48
dtantsurI'd not mind to have a volunteer for that15:48
dtantsur#link https://storyboard.openstack.org/#!/story/2008043 (deploy steps via API) is looking for a volunteer since dtantsur is pretty busy15:48
TheJulia++15:49
dtantsurokay, moving to the last one (which is not mind, but I've put it here)15:49
dtantsurs/mind/mine/15:49
dtantsur#link https://storyboard.openstack.org/#!/story/2008047 Add a feature discovery API to Ironic15:49
dtantsuridea by dhellmann based on metal3 experience with ironic15:49
* dtantsur gives people time to read the text15:49
openstackgerritMerged openstack/python-ironicclient master: Allow to pass global request id for remaining objects  https://review.opendev.org/72594115:50
TheJuliaI generally like the idea, but that seems like it could sprawl into a lot of ocde15:51
openstackgerritMerged openstack/python-ironicclient master: Add release note regarding global_request_id  https://review.opendev.org/73259015:51
TheJuliacode15:51
dtantsuryep. I suspect this is something that would require a spec15:51
JayFThat API seems like it would be great. It also seems like it would be incredibly complex and a large amount of maintenance.15:51
*** Qianbiao has quit IRC15:51
TheJuliabecause it comes down to providing a concrete answer to the capability matrix of a driver, which means some of that has to be coded in with a union of what can be identified about the node15:51
JayFI also suspect there are some capabilities which might be driver-capable but not environment-capable in a way Ironic can't identify15:52
TheJuliadtantsur: I concur, JayF: I'm thinking the same15:52
dtantsurwell, to the best of our knowledge :)15:52
dhellmannyou could definitely build it incrementally15:52
dtantsurdhellmann: o/15:52
dhellmannit doesn't have to be able to answer every possible question before it would be useful15:53
TheJuliadhellmann: We love incrementalism here in ironic :)15:53
TheJuliaI'd love a spec that details basic mechanics, maybe an idea of how we would wire the basic internals together, and what the api response should be15:53
dhellmannit also doesn't have to give perfect answers, if there are things ironic can't figure out15:53
*** k_mouza has joined #openstack-ironic15:53
dhellmannI could work with someone on that, but couldn't commit to doing the whole thing15:54
JayFHaving an oracle that's only sometimes-correct can be worse than having no answer at all. I'm not sure I agree this is a useful item to do incrementally.15:54
dtantsurdhellmann: if it ends up being what we want downstream, somebody from our team will pair with you15:54
dhellmannJayF: what features could we not answer definitively?15:54
dhellmanndtantsur : ++15:55
dtantsur(it may be even me, given my experience with adding large stuff to ironic)15:55
JayFdhellmann: that'd be something I'd need to think more on, but I think the matrix gets quite a few dimensions around some features15:55
dtantsurJayF: agreed about sometimes, but there are things that we can figure out but currently don't15:55
dtantsurlike, we can look at a node and see if it has any chances of supporting virtual media at all15:56
dhellmannI would wait to add features like that to the response set, then.15:56
TheJuliaYeah, it could easily become a 3d matrix :\15:56
dtantsurby going to its redfish endpoint and seeing if the VirtualMedia resource is there15:56
dtantsurand supports a Cd type15:56
dtantsurand Manager-to-System mapping is 1-to-115:56
TheJuliawell, then there likely also needs otbe license checking15:56
TheJulia"it is present" "And it is licensed" and "we can map it properly"15:56
dtantsurif it can be checked - awesome!15:56
TheJuliayeah15:57
dtantsurthen we go from "it may or may not support it" to "it's very likely to support it"15:57
TheJulialets focus on a single slice15:57
TheJuliaat least in terms of a spec and then see how that can be iterated upon in other areas15:57
dhellmannsure. a first version may respond based on what ironic supports. a later version might add the license check15:57
* dtantsur adds needs-spec tag15:57
TheJuliaWell, we seem to only have two minutes left and didn't get to Open Dsicussion15:58
TheJulia#topic Open Discussion15:58
*** openstack changes topic to "Open Discussion (Meeting topic: ironic)"15:58
TheJuliaAre there any other items to be discussed/raised?15:59
JayFI wanted to toss out if we'd ever considered having an interface specifically for in-band cleaning.15:59
dtantsurnot sure I get it15:59
JayFWe have a few drivers which mix-in AgentBase to get agent cleaning support, even if agent isn't used for deployment. Just wondering if that's a good pattern to continue or if there'd be interest in making that a more clean split.15:59
dtantsurthat makes some sense at first glance; it also gives me a huge headache16:00
JayFRight now, DeployInterface handles both deployment and cleaning. There are drivers, such as ramdisk driver, which mix-in agent for cleaning, along with another method for deployment16:00
TheJuliaJayF: is the thought to be able to have drivers that don't support cleaning?16:00
TheJuliaor nodes in configurations?16:00
*** ijw has joined #openstack-ironic16:00
JayFTheJulia: I'm thinking stuff like ramdisk driver, a potential future anaconda/kickstart driver, not having to worry about cleaning at all, but just handle the deployment half16:00
rloo(also, soon-to-present rfe for an anaconda deploy driver -- not for cleaning...)16:01
TheJuliahmm16:01
rloo(yeah, what JayF said :))16:01
JayFTheJulia: since they mainly are about alternative ways to deploy, and are mostly ambivalent about cleaning -- although today that's implemented as mixing in AgentBase to get agent cleaning16:01
TheJuliaThere is a knob over cleaning on the node16:01
JayFI could see someone even wanting to, for instance, use a ramdisk driver with ansible cleaning, perhqps.16:01
TheJuliaAnd a long time ago there was discussion of splitting it, but in multitanant environments I suspect it would always be needed, so I'm not sure where the happy medium is at this moment16:02
dtantsurwe don't need to have no-clean implementation16:02
JayFI just can't figure out why in our model deployment and cleaning should be unified.16:02
JayFdtantsur: ++16:02
TheJuliaJayF: I could see that case16:02
dtantsurwe can have a data migration that'll populate the new field based on the current deploy_interface16:02
*** lucasagomes has quit IRC16:02
JayFI'm not even proposing it for sure right now, I'm just curious if it passes the smell test.16:02
dtantsurI fully agree, I wonder who can dedicate so much time to make it work16:02
JayFSeems like it might be time for it, though.16:02
JayFdtantsur: /me would try to volunteer zer0c00l to do it as part of the anaconda work16:03
JayFlol16:03
TheJuliaseems like one of those 50/50 items. It might pass the smell test16:03
dtantsurpoor zer0c00l16:03
dtantsuras somebody who's recently dived into the guts of our agent code...16:03
TheJuliaheh16:03
dtantsur... I don't want to do it again for such a big refactoring16:03
dtantsur:)16:03
* TheJulia lives in that code...16:03
rlooit is ok to volunteeer zer0c00l with JayF as backup :D16:03
JayFOh no! A reversal!16:03
dtantsura well detailed RFE would be a good first step16:04
TheJulia++16:04
TheJuliaAnyway, I guess we're done for today. Thanks everyone!16:04
JayFack; just wanted to make sure the answer wasn't "absolutely not" before taking more effort than a conversation16:04
JayFo/16:04
dtantsurthanks!16:04
TheJulia#endmeeting16:05
*** openstack changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/ironic/ | Bugs: https://storyboard.openstack.org/#!/project_group/75 | Contributors are generally present between 6 AM and 12 AM UTC, If we do not answer, please feel free to pose questions to openstack-discuss mailing list."16:05
*** ijw has quit IRC16:05
openstackMeeting ended Mon Aug 24 16:05:10 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:05
openstackMinutes:        http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-08-24-15.00.html16:05
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-08-24-15.00.txt16:05
openstackLog:            http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-08-24-15.00.log.html16:05
dtantsursomething that did not fit into the meeting: what do you all think about developing https://review.opendev.org/#/c/743771/ into a new feature (an optional deploy step)?16:05
patchbotpatch 743771 - ironic-python-agent - [PoC] A deploy step to update /etc/default/grub - 4 patch sets16:05
*** weshay has quit IRC16:05
*** weshay has joined #openstack-ironic16:05
rpittaudtantsur: I think it makes sense16:07
TheJuliadtantsur: feasible, will we be mounting/unmounting the same image multiple times16:07
dtantsurseems to16:07
TheJuliaalso, what about running grub config with whole disk images16:07
dtantsurrun grub-install, no way around it16:07
TheJuliawell, that invalidates signed files16:08
dtantsurassume that people who enable this step know what they are doing16:08
TheJuliaI've been thinking about doing something similar for /etc/fstab16:08
TheJuliaso I think it is reasonable16:08
JayFI'm not super familiar with that code in particular16:08
JayFbut how does that work with Windows images?16:08
JayFpriority: 0 means it's non-default, so you just don't run that step, right?16:08
TheJuliait would likely need to identify and run only on linux machines16:09
dtantsuryep (the PoC has it enabled for CI testing purposes)16:09
TheJuliawe likely need a qualification helper16:09
* JayF puts on windows hat16:09
dtantsurit will be enabled via a deploy template, so don't use this template if your image does not support it?16:09
JayFwould we accept a similar step in the future to modify boot.ini for $windowsReasons?16:09
dtantsurno objections from me16:10
TheJuliaJayF: I suspect so if we do it for linux16:10
dtantsuras long as I'm not the one who writes and supports it :)16:10
JayFAck, WFM then :D I thought it'd be good just playing the advocate16:10
JayFlol16:10
TheJuliaZero objections here... and I'm with dtantsur on that one16:10
* JayF imagines the horror of a dib element to install ntfs support into an ipa ramdisk16:10
TheJuliafile should be able to tell us if it is ntfs16:10
TheJuliaor ext[x] or xfs or jfs or whatever16:11
TheJuliaand file is a requirement16:11
dtantsursomebody HAS asked me about software RAID for windows16:12
dtantsurJayF: one day we may want to support btrfs as a partitioning schema :)16:12
TheJuliaI mean... if someone has the code ready I'd be happy to review and merge it if it is doable16:12
JayFdtantsur:  I don't want to take responsibility for users who want to subject their data to ritual sacrifice :D16:13
dtantsurthey say btrfs is better (heh) these days16:13
dtantsurfedora wants to switch to it by default for desktops16:13
TheJuliaseriously?16:13
TheJuliaagain?!?16:13
dtantsurnot sure about again, but for F33 :)16:14
TheJuliaJayF: would that be a ritual sacrafice of a stick of butter?16:14
JayFyou butter believe it16:14
dtantsurhttps://fedoraproject.org/wiki/Changes/BtrfsByDefault16:14
TheJuliaAnd would that actually be more like butter being melted in a blisteringly hot cast iron pan?16:14
* TheJulia feels the need to cook with a whole stick of butter soon16:14
* TheJulia should have a camera ready16:15
* TheJulia goes and finds something to nom16:16
dtantsurI had an early start today, so bailing out now. c u16:16
JayFo/16:17
*** iurygregory has quit IRC16:18
*** dtantsur is now known as dtantsur|afk16:19
*** stendulker has quit IRC16:23
openstackgerritRiccardo Pittau proposed openstack/ironic master: Enforce autospec in common tests  https://review.opendev.org/74776716:24
rpittaugoodnight o/16:24
*** iurygregory has joined #openstack-ironic16:27
*** ijw has joined #openstack-ironic16:39
*** ijw_ has joined #openstack-ironic16:42
*** k_mouza has quit IRC16:43
*** ijw has quit IRC16:44
*** ijw has joined #openstack-ironic16:48
*** tosky has quit IRC16:49
*** ijw_ has quit IRC16:51
*** derekh has quit IRC17:02
*** mkrai has quit IRC17:10
*** k_mouza has joined #openstack-ironic17:18
*** k_mouza has quit IRC17:23
*** thiagop has joined #openstack-ironic17:36
*** livelace has quit IRC17:44
*** dking has joined #openstack-ironic17:56
*** jtomasek has joined #openstack-ironic18:07
*** kaifeng has quit IRC18:08
*** thiagop is now known as outbrito18:25
*** jtomasek has quit IRC18:27
guilhermesphey there! im looking for a way to build my own initrd and kernel with a custom ironic-python-agent, so our user can set up those images to the nodes and have their own inspection parameters ... which would be the best way to do it?18:29
guilhermespin other words, we would like to customize the inspection, which i believe we can achieve that by build our ironic python agent18:32
*** outbrito is now known as thiagop18:34
TheJuliaSo you can do that. You can use ironic-python-agent-builder and set a environment variable to the appropriate path. I believe it is documented (if not, I can help you figure it out)18:37
*** jtomasek has joined #openstack-ironic18:37
*** jtomasek has quit IRC18:48
guilhermespTheJulia: hiiii thanks for the reply. I guess you mentioned https://docs.openstack.org/ironic-python-agent-builder/latest/ ... yeah i have a customer that is trying to create those images and run their own inspection process... im trying to figure out/understand what they did that resulted in a bad image, which breaks as soon as ironic loads it19:02
guilhermespand their steps was like19:02
guilhermesphttps://www.irccloud.com/pastebin/gRRn6fuF/19:02
iurygregoryany logs you can share?19:08
*** lmcgann__ has joined #openstack-ironic19:11
guilhermespnope unfortunately... actually it seems that the image is breaking somehow, im getting a screenshot o the console lol19:11
guilhermesphttps://usercontent.irccloud-cdn.com/file/GY1C38mZ/Untitled.png19:12
guilhermespthat could mean a lot of stuff, but as im not seeing any issues in ironic logs, i believe that somehow their process to create those custom images is missing something19:13
* TheJulia files rebooting desktop under bad idea19:22
*** priteau has quit IRC19:31
*** jamesden_ has quit IRC20:02
*** uzumaki has joined #openstack-ironic20:08
*** dking has quit IRC20:08
*** jamesdenton has joined #openstack-ironic20:09
TheJuliaokay, and I'm back :(20:37
stevebakerTheJulia: regarding https://review.opendev.org/#/c/742795 I'll refresh the series some time today regardless of where I'm at with node.py20:50
patchbotpatch 742795 - ironic - New argument validate decorator - 7 patch sets20:50
TheJuliastevebaker: thanks20:50
*** lmcgann__ has quit IRC20:52
*** livelace has joined #openstack-ironic21:14
*** janders has quit IRC21:39
openstackgerritJay Faulkner proposed openstack/ironic-python-agent master: Eventlet should be monkey patched as early as possible  https://review.opendev.org/74677421:44
*** thiagop has quit IRC21:47
*** bnemec has quit IRC21:50
JayFTheJulia: if you have a sec -- re: lower-constraints; is that held in a separate repo, e.g. openstack/requirements, or do I just edit it directly in our repo22:08
JayFfor IPA specifically22:08
JayFhttps://gist.github.com/jayofdoom/c0fbf31bcd0964ed4b73aa0ad15b7d6a is the lower-constraints changes that appears to fix tests22:09
JayFalthough I haven't version-bisected yet, the tests run with only those changes22:10
TheJuliaJayF: edit the one in our repo22:12
JayFthat sounds ezpz then. I'll find the maximally minimal change and commit it in \o/22:13
JayFIDK, I think I'll actually keep the changes as-is. It makes sense to depend on newer oslo.service22:13
JayFnewer oslo, newer eventlet22:14
openstackgerritJay Faulkner proposed openstack/ironic-python-agent master: Eventlet should be monkey patched as early as possible  https://review.opendev.org/74677422:15
openstackgerritJay Faulkner proposed openstack/ironic-python-agent master: If listen_tls is true, enable TLS on wsgi server  https://review.opendev.org/74719322:20
*** bfournie has quit IRC22:24
openstackgerritJay Faulkner proposed openstack/ironic-python-agent master: Eventlet should be monkey patched as early as possible  https://review.opendev.org/74677422:24
*** ijw has quit IRC22:25
*** k_mouza has joined #openstack-ironic22:42
*** ijw has joined #openstack-ironic22:46
*** k_mouza has quit IRC22:47
*** rloo has quit IRC22:48
*** ijw has quit IRC22:51
openstackgerritJay Faulkner proposed openstack/ironic-python-agent-builder master: Add element to configure IPA with TLS, use configdir  https://review.opendev.org/74730923:07
*** ijw has joined #openstack-ironic23:08
*** uzumaki has quit IRC23:09
*** janders has joined #openstack-ironic23:18
*** iurygregory has quit IRC23:21
jandersgood morning Ironic o/23:32
*** rcernin has joined #openstack-ironic23:37
TheJuliagood morning janders23:42

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!