Thursday, 2021-03-11

« Wednesday, 2021-03-10 Index Friday, 2021-03-12 »
*** k_mouza has quit IRC00:03
openstackgerritJulia Kreger proposed openstack/ironic master: Allocation support for project scoped RBAC  https://review.opendev.org/c/openstack/ironic/+/77834000:17
openstackgerritJulia Kreger proposed openstack/ironic master: [doc] Add initial system-scoped text to secure-rbac  https://review.opendev.org/c/openstack/ironic/+/77804400:21
*** tosky has quit IRC00:26
openstackgerritJulia Kreger proposed openstack/ironic master: Remove extra/vif_port_id  https://review.opendev.org/c/openstack/ironic/+/76743200:27
openstackgerritJulia Kreger proposed openstack/ironic master: WIP: Scoped RBAC testing  https://review.opendev.org/c/openstack/ironic/+/77895700:37
TheJulia\o/ allocations seems to be working00:42
* TheJulia calls it a day00:42
*** rloo has quit IRC00:58
stevebaker\o01:15
*** jamesdenton has quit IRC01:26
*** jamesden_ has joined #openstack-ironic01:26
openstackgerritRotan proposed openstack/ironic-inspector master: [WIP]Support AEP, sst at introspection data  https://review.opendev.org/c/openstack/ironic-inspector/+/76813801:37
*** ociuhandu has joined #openstack-ironic01:45
*** ociuhandu has quit IRC01:50
*** rcernin has quit IRC02:01
*** rcernin has joined #openstack-ironic02:05
*** rcernin has quit IRC02:39
openstackgerritVerification of a change to openstack/ironic failed: Allow users to configure priority for {create,delete}_configuration  https://review.opendev.org/c/openstack/ironic/+/77814502:39
*** rcernin has joined #openstack-ironic02:42
*** rcernin has quit IRC02:51
*** tzumainn has quit IRC02:54
*** zzzeek has quit IRC02:55
*** zzzeek has joined #openstack-ironic02:56
*** rcernin has joined #openstack-ironic03:05
*** rcernin has quit IRC03:12
*** zzzeek has quit IRC03:15
*** zzzeek has joined #openstack-ironic03:20
*** rcernin has joined #openstack-ironic03:23
*** rcernin has quit IRC03:24
*** rcernin has joined #openstack-ironic03:24
*** openstackgerrit has quit IRC03:25
*** zzzeek has quit IRC03:48
*** zzzeek has joined #openstack-ironic03:51
*** rh-jelabarre has quit IRC04:10
*** jamesden_ has quit IRC04:36
*** jamesdenton has joined #openstack-ironic04:36
*** ociuhandu has joined #openstack-ironic05:22
*** ociuhandu has quit IRC05:26
*** anuradha1904 has joined #openstack-ironic05:47
*** gyee has quit IRC05:52
*** jamesdenton has quit IRC06:21
*** jamesden_ has joined #openstack-ironic06:21
*** openstackgerrit has joined #openstack-ironic06:47
openstackgerritVerification of a change to openstack/ironic failed: Allow users to configure priority for {create,delete}_configuration  https://review.opendev.org/c/openstack/ironic/+/77814506:47
*** ociuhandu has joined #openstack-ironic07:02
*** ociuhandu has quit IRC07:06
*** ociuhandu has joined #openstack-ironic07:08
*** ociuhandu has quit IRC07:12
*** rcernin has quit IRC07:40
arne_wiebalckGood morning, ironic!07:43
*** rcernin has joined #openstack-ironic07:47
*** rcernin has quit IRC08:06
*** ociuhandu has joined #openstack-ironic08:11
*** ociuhandu has quit IRC08:11
*** rcernin has joined #openstack-ironic08:17
jandersgood morning arne_wiebalck o/08:27
*** tosky has joined #openstack-ironic08:33
arne_wiebalckhey janders, good morning o/08:34
*** ociuhandu has joined #openstack-ironic08:38
*** ociuhandu has quit IRC08:42
*** jamesden_ has quit IRC08:44
*** jamesdenton has joined #openstack-ironic08:46
*** tosky_ has joined #openstack-ironic08:52
*** tosky is now known as Guest8681408:53
*** tosky_ is now known as tosky08:53
*** Guest86814 has quit IRC08:55
*** ociuhandu has joined #openstack-ironic08:57
*** rcernin has quit IRC09:01
*** lucasagomes has joined #openstack-ironic09:06
*** derekh has joined #openstack-ironic09:15
*** rcernin has joined #openstack-ironic09:28
*** buhman has quit IRC09:31
*** buhman has joined #openstack-ironic09:31
*** zzzeek has quit IRC09:43
*** zzzeek has joined #openstack-ironic09:46
*** rcernin has quit IRC09:47
*** ociuhandu has quit IRC10:01
*** ociuhandu has joined #openstack-ironic10:02
*** rcernin has joined #openstack-ironic10:04
*** zzzeek has quit IRC10:11
*** ociuhandu has quit IRC10:11
*** zzzeek has joined #openstack-ironic10:15
*** ociuhandu has joined #openstack-ironic10:16
*** dtantsur|afk is now known as dtantsur10:17
dtantsurmorning ironic10:17
dtantsurrpittau|afk: morning! this looks concerning: https://zuul.opendev.org/t/openstack/build/311f7a8351584aa78f0e3466fdc910eb/log/controller/logs/screen-ir-cond.txt?severity=3#157810:19
*** rcernin has quit IRC10:20
* dtantsur fixes10:22
*** ociuhandu has quit IRC10:25
*** k_mouza has joined #openstack-ironic10:26
openstackgerritDmitry Tantsur proposed openstack/ironic master: Don't try to use attempts=None with tenacity  https://review.opendev.org/c/openstack/ironic/+/77996110:29
*** k_mouza has quit IRC10:31
openstackgerritAija Jauntēva proposed x/sushy-oem-idrac master: Update export system configuration  https://review.opendev.org/c/x/sushy-oem-idrac/+/75942510:40
jandersgood morning dtantsur10:41
*** ociuhandu has joined #openstack-ironic10:46
*** zzzeek has quit IRC11:03
*** rcernin has joined #openstack-ironic11:07
*** zzzeek has joined #openstack-ironic11:08
*** cp- has quit IRC11:11
*** k_mouza has joined #openstack-ironic11:11
*** cp- has joined #openstack-ironic11:11
*** jawad_axd has joined #openstack-ironic11:17
*** k_mouza has quit IRC11:18
*** k_mouza has joined #openstack-ironic11:18
*** cp- has quit IRC11:21
*** cp- has joined #openstack-ironic11:22
*** cp- has quit IRC11:22
*** cp- has joined #openstack-ironic11:23
*** cp- has quit IRC11:24
*** cp- has joined #openstack-ironic11:41
iurygregorygood morning dtantsur janders and Ironic o/11:45
jandersgood morning iurygregory o/11:46
*** ociuhandu has quit IRC11:51
*** rcernin has quit IRC11:58
*** jamesdenton has quit IRC12:13
*** jamesdenton has joined #openstack-ironic12:15
*** rcernin has joined #openstack-ironic12:23
*** emmadavis has joined #openstack-ironic12:26
*** emmadavis has quit IRC12:28
*** emmadavis has joined #openstack-ironic12:28
*** rcernin has quit IRC12:29
*** rcernin has joined #openstack-ironic12:41
*** rcernin has quit IRC12:46
*** rcernin has joined #openstack-ironic12:52
*** rcernin has quit IRC12:57
*** rcernin has joined #openstack-ironic12:58
*** openstack has joined #openstack-ironic13:17
*** ChanServ sets mode: +o openstack13:17
dtantsurfolks, please review https://review.opendev.org/c/openstack/ironic/+/779961 it fixes an occasional CI failure13:17
*** Qianbiao has joined #openstack-ironic13:17
iurygregorydtantsur, looking now13:27
iurygregory+W since it's a simple change to unblock CI13:34
*** rh-jelabarre has joined #openstack-ironic13:39
*** ociuhandu has joined #openstack-ironic13:44
*** mjturek has joined #openstack-ironic13:47
dtantsurthx!13:50
*** cp- has quit IRC13:54
*** cp- has joined #openstack-ironic13:55
iurygregoryyw =)14:00
*** rloo has joined #openstack-ironic14:09
TheJuliagood morninng14:15
*** tzumainn has joined #openstack-ironic14:44
dtantsurmorning TheJulia14:46
*** k_mouza_ has joined #openstack-ironic14:50
openstackgerritJulia Kreger proposed openstack/ironic master: Allocation support for project scoped RBAC  https://review.opendev.org/c/openstack/ironic/+/77834014:51
*** k_mouza has quit IRC14:54
openstackgerritJulia Kreger proposed openstack/ironic master: WIP: Scoped RBAC testing  https://review.opendev.org/c/openstack/ironic/+/77895714:58
TheJuliaI would think clouds.yaml would properly cast things...14:59
*** rcernin has joined #openstack-ironic14:59
dtantsurmostly. where exactly do you have a problem?14:59
*** derekh has quit IRC15:01
*** derekh has joined #openstack-ironic15:01
dtantsurhas anyone made multi-conductor ironic work without neutron? arne_wiebalck?15:02
*** derekh has quit IRC15:02
dtantsurI'm getting questions via private messages, and I cannot figure out myself15:02
dtantsuris syncing /httpboot via e.g. NFS the only way here?15:03
*** rcernin has quit IRC15:04
*** Qianbiao has quit IRC15:06
*** derekh has joined #openstack-ironic15:08
*** spotz has joined #openstack-ironic15:10
arne_wiebalckdtantsur: we have a multi-conductor setup without neutron, but we do rely on an external PXE infra (so we do not need to sync the conductors ... if I got your question right?)15:10
dtantsurarne_wiebalck: so you don't rely on ironic providing PXE configuration at all?15:11
arne_wiebalckdtantsur: correct15:11
dtantsurwhat's your PXE infra? is it some open-source project?15:12
arne_wiebalckdtantsur: we had a PXE service before Ironic, and when we started we decided to use it rather than having two15:12
arne_wiebalckdtantsur: home-grown15:12
arne_wiebalckdtantsur: dates back many years15:12
dtantsurI see. So, this is a clear gap in standalone functionality for us.15:13
arne_wiebalckdtantsur: we have considered to replace it with some open-source alternative, or let Ironic do it, but for now we still use it :)15:13
arne_wiebalckdtantsur: yes15:13
arne_wiebalckdtantsur: if I had to do it now, I would probably simply use a shared filesystem15:15
*** k_mouza_ has quit IRC15:15
arne_wiebalckdtantsur: do == set it up15:15
*** k_mouza has joined #openstack-ironic15:15
arne_wiebalckdtantsur: if Ironic would sync somehow, even better :-D15:15
*** ociuhandu has quit IRC15:16
*** ociuhandu has joined #openstack-ironic15:17
* dtantsur encourages the author of the question to join IRC15:17
dtantsurarne_wiebalck: thanks, I've put it as a topic to the PTG etherpad15:17
arne_wiebalckdtantsur: ++15:18
*** ociuhandu has quit IRC15:22
*** AndreyK has joined #openstack-ironic15:22
openstackgerritMerged openstack/ironic master: Don't try to use attempts=None with tenacity  https://review.opendev.org/c/openstack/ironic/+/77996115:23
AndreyKHi guys. Can someone help me with my problem with ironic with multiple conductors without neutron?15:25
AndreyKCan i do this setup?15:25
AndreyKActually the problem is that if i enable filter DNSmasq on my installation15:27
*** ociuhandu has joined #openstack-ironic15:28
AndreyKThe bare metal node could not boot to the ipa image to get OS installed because of files with ignore mac options15:28
AndreyKat /etc/dnsmasq/dhcp-hostsdir/*15:29
AndreyK24:6e:96:31:bd:e0,ignore15:29
AndreyK24:6e:96:31:bd:e2,ignore15:29
AndreyK24:6e:96:31:bd:e4,ignore15:29
AndreyK24:6e:96:31:bd:e5,ignore15:29
AndreyKIf I turn off the dnsmasq filter, then I got inconsistent configuration of (ironic-ipxe), where one node have configuration, but other nodes not15:30
AndreyK -la /httpboot/15:31
AndreyKlrwxrwxrwx 1 ironic ironic        43 Mar 10 15:58 94:40:c9:72:32:b4.conf -> e8b220a2-9bf2-49f0-acca-ff8f3ffeccd6/config15:31
AndreyKI'am talking about this thing15:31
AndreyKeach three nodes of ironic have diffeerent config15:31
AndreyKSorry for my english15:32
*** ociuhandu has quit IRC15:34
dtantsurarne_wiebalck: that's what we discussed ^^15:41
openstackgerritVerification of a change to openstack/ironic failed: Allow users to configure priority for {create,delete}_configuration  https://review.opendev.org/c/openstack/ironic/+/77814515:45
*** alexmcleod_ has quit IRC15:46
*** ociuhandu has joined #openstack-ironic15:48
*** alexmcleod has joined #openstack-ironic15:50
arne_wiebalckHey AndreyK, welcome o/15:52
AndreyKHey!15:52
arne_wiebalckAndreyK: As mentioned to dtantsur, we do run without Neutron, but we do not use the PXE configuration provided by Ironic.15:52
arne_wiebalckAndreyK: We have our own, home-grown PXE infra.15:53
AndreyKI see, Dmitry said me15:53
arne_wiebalckAndreyK: That's also why I am not too familiar with how dnsmasq/inspector are supposed to populated the dhcp directories.15:54
AndreyKWhat is the quick solution that we can make? We want to have something very simple and lightweight for out "undercloud"15:54
dtantsurI suggested sharing /httpboot over NFS, does anyone have better ideas?15:55
arne_wiebalckAndreyK: How about using a shared dir, would that be an option?15:55
AndreyKYes, but in new DC we do not want to use such technologies like smb,nfs,metro - only cloud like solutions15:56
*** rloo has quit IRC15:56
AndreyKThat is why we like ironic15:56
*** rloo has joined #openstack-ironic15:56
*** ociuhandu has quit IRC15:57
TheJuliabrraaaains15:57
*** ociuhandu has joined #openstack-ironic15:57
TheJuliaOn a plus side, I think I only have one more meeting today15:57
AndreyKthe aim is to get cloud deployed with "undercloud ironic" like in trippleo but without any neutron, nova15:57
dtantsurit's a bit of a side question, but I wonder why you even need several conductors15:58
AndreyKTheJulia, keep calm)15:58
arne_wiebalckdtantsur: AndreyK: are there 2 issues here, or only 1? Like, with dnsmasq the files are wrongm but without they are not synced?15:58
dtantsuryes, and the root cause is that ironic-inspector only cares about inspection, not deploy/cleaning15:59
TheJuliaI do wonder if the pxe handling is over-engineered with the dnsmasq configuration in metal3, but somehow there doe have to be networking delineation or common management somehow15:59
dtantsurI'm asking about several conductors because you mentioned tripleo, and it only uses 1 conductor15:59
dtantsurseveral conductors are great for HA, but may be useless for one-shot operations16:00
dtantsur(deploy the cloud and forget)16:00
AndreyKarne_wiebalck, actually 2: 1 - inconsistent dnsmasq configuration(one L2, random nodes get leases), 2 - Is inconsistent configuration of IPXE, because of first thing16:00
arne_wiebalckAndreyK: how many physical nodes will you manage?16:00
* arne_wiebalck is following dtantsur's lead of a simpler setup16:01
TheJuliainconsistent ipxe can be solved with a shared common filesystem16:01
AndreyKdtantsur, but not in our case. We want to have about 10-15 regions with about 500 hw nodes in each16:01
TheJuliaPossibly the largest ironic deployment in the world (that I know of) actually does that16:01
AndreyKeach region should be manged by spare undercloud installation16:02
dtantsurThis calls for a potential decoupling between PXE management and node management16:02
dtantsurAndreyK: an undercloud per region? you mean, and independent undercloud?16:02
dtantsurs/and/an/16:02
AndreyKyes16:02
arne_wiebalckAndreyK: We have single conductors managing ~500 nodes.16:03
dtantsurso, 500 nodes per ironic? this does not require several conductors16:03
dtantsurtripleo was tested with up to 70016:03
AndreyKindependent at all, to have smallest failure domain as possible16:03
TheJuliacould we replace undercloud in this discussion?16:03
TheJuliaI mean use of the word specifically16:03
dtantsurwell, it's a good metaphor16:03
AndreyKTheJulia, yes sorry16:03
TheJuliaI think it is awful16:03
TheJuliapersonally16:03
dtantsurit's because you're related to tripleo nowadays :D16:04
* dtantsur evil laughter16:04
AndreyKlet's call it "lower ironic"16:04
TheJuliadtantsur: uhh, been there done that all the way back at HP16:04
*** MapspaM is now known as SpamapS16:04
dtantsurah, right16:04
dtantsurbut okay, a cloud management node using ironic16:04
TheJuliao/ SpamapS16:04
SpamapSo/16:04
arne_wiebalckAndreyK: if the conductor breaks, only the control plane breaks, we use 1 conductor per 500 nodes and a similar approach for our Nova cells (only a single controller)16:04
dtantsurright. if you don't need 5-nines reliability for ironic *itself*, you can do with one controller and have much fewer problems16:05
dtantsurwhile we'll think what we can do to address such cases in the future :)16:05
AndreyKarne_wiebalck, i am always reading your posts on CERN blog16:05
dtantsurTheJulia: FYI I've put this on the PTG etherpad16:05
* TheJulia looks16:06
*** diurnalist has joined #openstack-ironic16:06
arne_wiebalckAndreyK: :)16:06
AndreyKactually I have DC with 500 racks at 13kWt power16:06
AndreyKi need it somehow to automate16:07
AndreyKOne approach was to use MAAS, the simplest one, but without any integrations with cloud16:08
dtantsurAndreyK: something TheJulia proposed on the above mentioned etherpad: you can statically build an environment that looks like ironic's16:08
dtantsurso ignore whatever files ironic is generated and build your own environment that boots our ramdisk16:08
dtantsur(especially if you don't need different ramdisks per node)16:09
dtantsurit may be what metal3 does, I need to check16:09
TheJulia13kW ?16:10
TheJuliaor 1300kW?16:10
dtantsurbut yeah, you can replace your primary ipxe boot file with something like https://github.com/metal3-io/ironic-image/blob/master/config/inspector.ipxe.j2. the downside is that it will always run inspection.16:11
AndreyK13kW per Rack16:11
TheJuliadtantsur: That is kind of what bifrost did and I know some people did end up using bifrost to run >1 conductors and it worked just fine until they wanted to do specific network booting16:11
TheJuliajust taking the disk image and always local booting path brings much more happiness and all the simplicy together16:12
dtantsurTheJulia: always running inspection has its own implications, especially if discovery is enabled16:12
TheJuliadtantsur: it can run from the same exact config16:12
dtantsurbut it can be another quick solution16:12
dtantsurTheJulia: right, that's the problem :)16:12
TheJuliadtantsur: we don't need to model it after what tripleo did with the separate configs and ignore rules16:12
AndreyKIn our setup we want to have 1500 nodes per region in 3 cells, so we need at least 3 conductors to manage nodes16:12
dtantsurlet's ignore the ignore rules, they're not for standalone16:12
TheJuliaAndreyK: ipmi or other protocol?16:13
AndreyKILO, IDRAC16:13
AndreyKof course we would like to use another ironic setup in our cloud, to provide users with BM16:14
dtantsurAndreyK: the two options we see right now (without addition to ironic): 1) NFS, 2) make a static PXE configuration (by hand) that says "go boot this ramdisk" using similar parameters to what ironic generates.16:14
TheJuliaokay, one of the big 500 nodes thing is due to execution of ipmitool. If you don't have to use ipmi, your much better off.16:14
AndreyKThis ironic don't know anything about lower ironic16:15
dtantsurand no nova/neutron as well in the "upper" ironic?16:15
dtantsur(see, over/undercloud terminology is not so bad..)16:15
* TheJulia sighs16:15
AndreyKdtantsur, yes16:15
AndreyK=))16:16
TheJuliaso how do you plan to manage networking in all of this?16:16
TheJuliabecause the instant you want to separate ones, you need IPAM and dhcp management16:16
dtantsurso you would like the users to use ironic API directly?16:16
dtantsur(same question as Julia, essentially)16:17
AndreyKat the lower - there should be static config with bunch of vlans, managed by cloud-init on OS side16:17
AndreyKAt the higher ironic - there will be full openstack installation, may be with contrail or cisco AIC to manage HW switches16:18
TheJuliaIt seems like maybe there needs to be dhcp server integration specifically that is not neutron16:18
TheJuliaso at the higher level you'll have neutron then16:18
AndreyKdtantsur so you would like the users to use ironic API directly? >> Keystone is the smallest thing in this setup, it works.16:18
dtantsurAndreyK: okay, so upper ironic *with* neutron/nova?16:19
dtantsurlower - without?16:19
AndreyKdtantsur, yes without in lower, and with on top16:19
dtantsurgotcha. so the upper ironic is easier. what's the scale for the lower ironic? 500 nodes per region? or 1500?16:20
AndreyK~1500 computes16:20
AndreyKok, let's say it more than 100016:21
TheJuliaSo back when NobodyCam was building out a huge deployment on the west coast of the US, he was talking similar things, except his focus was the lower layer and a hook into dhcp directly from ironic to trigger the configuration so it could inform of *where* and then there was a discovery fallback address if memory serves. I think he told me he used hooks on the dhcp server to also try and reconcile things when16:21
TheJuliathe inventory from the factory was wrong or soemthing liek that16:21
dtantsurmy suggestions would be static configuration (#2 above) + fast-track (so that there is no reboot between inspection and deploy)16:21
TheJulia++16:22
AndreyKdtantsur, i will try it16:22
TheJuliaor custom integration code which could be painful to maintain.16:22
dtantsurpain--16:22
dtantsurbut we as a community should figure something out, so that e.g. multi-node bifrost can become a reality16:23
TheJulia++16:23
AndreyKSure)16:23
TheJuliaI really like some other ipam integration idea16:23
TheJuliaso we can do the signaling directly and we don't end up in complex configs and things can get somewhat load balanced16:23
AndreyKWe want to use custom integration with netbox16:23
dtantsurthen we should find some easy to use IPAM16:24
TheJuliaI was about to consider if you'd use isc's next generation dhcp server16:24
TheJulias/consider/ask/16:24
TheJuliadtantsur: I hear really good things about the isc stuff. Uses a rest api to configure the dhcp cluster16:24
dtantsuroh, srsly? this is really nice! maybe we can even solve our inspector problems?16:25
TheJuliathat cluster an operate in a distributed fashion with the same base physical networks from what I understand16:25
dtantsurany reference to read about it?16:25
TheJuliadiscussions with nobodycam + some of the isc docs16:25
TheJuliahttps://www.isc.org/kea/16:26
AndreyKThank you!!!16:27
dtantsuryou're welcome. feel free to ask again, we'll be happy to help as much as we can.16:28
arne_wiebalckkea, I think this is what our networking colleagues are looking into as well atm16:28
dtantsurhmm, maybe we need an ironic/inspector driver for that?16:28
TheJuliaI'm starting to feel like our ptg topics now require 4 days16:29
dtantsursame16:29
TheJuliadtantsur: ++16:29
TheJuliadtantsur: added an explicit item to discuss other dhcp integrations16:35
TheJuliasince... multi-conductor standalone is one thing, but dhcp integrations is a different topic that the first feeds into16:35
TheJuliaand we should likely have an explicit higher level discussion16:35
dtantsuragreed16:41
TheJuliawow: https://review.opendev.org/c/openstack/ironic/+/77834016:47
TheJuliait completely passed all check jobs16:47
TheJuliaSHIP IT!16:48
dtantsur\o/16:49
dtantsurKea looks promising16:49
TheJuliaYeah, we've had a few people ask about it in the past16:49
TheJuliamore than people asking about S3 instead of Swift...16:49
dtantsurheh16:50
openstackgerritDmitry Tantsur proposed openstack/ironic master: [WIP] API to force manual cleaning without booting IPA  https://review.opendev.org/c/openstack/ironic/+/76979316:50
TheJuliaa specific API?16:51
TheJuliaahh i see16:51
arne_wiebalckspeaking about swift ... re-inspecting a node will overwrite the object in swift with a new object, right? there is no history.16:51
TheJuliadtantsur: I kind of like that more than the overly complex thing we were talking about a long time ago16:52
dtantsurarne_wiebalck: correct16:52
arne_wiebalckdtantsur: thanks16:52
TheJuliamakes it more "the operator has to know" and less to guess which is a tradeoff16:53
dtantsurTheJulia: re clean steps?16:53
dtantsurit's only one part of https://storyboard.openstack.org/#!/story/2008491 but maybe the most useful part16:54
TheJuliaahh, okay16:54
* TheJulia goes back to poking devstack plugin16:54
openstackgerritJulia Kreger proposed openstack/ironic master: WIP: Scoped RBAC testing  https://review.opendev.org/c/openstack/ironic/+/77895716:57
*** rcernin has joined #openstack-ironic17:00
* dtantsur really needs to fix sushy-tools to stop losing its database17:00
*** lucasagomes has quit IRC17:00
openstackgerritVerification of a change to openstack/networking-generic-switch failed: Remove grenade jobs from old stable branches  https://review.opendev.org/c/openstack/networking-generic-switch/+/77333517:04
dtantsurfolks, does anyone know if it's even possible to write an out-of-band clean steps on the deploy interface?17:15
dtantsuranswering myself: no, only in-band17:16
*** jamesdenton has quit IRC17:16
*** jamesdenton has joined #openstack-ironic17:16
*** rcernin has quit IRC17:16
arne_wiebalckbye everyone o/17:19
openstackgerritDmitry Tantsur proposed openstack/ironic master: [WIP] API to force manual cleaning without booting IPA  https://review.opendev.org/c/openstack/ironic/+/76979317:24
*** anuradha1904 has quit IRC17:25
*** gyee has joined #openstack-ironic17:35
openstackgerritDmitry Tantsur proposed openstack/ironic master: [WIP] API to force manual cleaning without booting IPA  https://review.opendev.org/c/openstack/ironic/+/76979317:36
dtantsurthis ^^ seems to work pretty well, now I need to write/fix a ton of tests17:38
openstackgerritJulia Kreger proposed openstack/ironic master: WIP: Scoped RBAC testing  https://review.opendev.org/c/openstack/ironic/+/77895717:53
TheJuliastupid human mistake in that, It *should* actually get past standing up devstack this time17:54
TheJuliabut will detonate on tempest tests17:54
TheJuliaWhich is to be expected since they are going to need scope context17:54
TheJuliaanyone remember does anyone actively remember what the deal is with ussuri stable branch ci?17:57
erbarrhi, for UEFI, how can I dib a wholedisk ubuntu image?18:01
*** derekh has quit IRC18:01
dtantsurerbarr: example #3 https://docs.openstack.org/ironic/latest/install/creating-images.html#disk-image-builder18:01
erbarrdtantsur, ahhh thanks!18:03
openstackgerritJulia Kreger proposed openstack/ironic stable/ussuri: Stable-CI: Disable ansible testing on ussuri  https://review.opendev.org/c/openstack/ironic/+/78006218:29
TheJuliaNew phrase "Least evil, most impactful"18:29
*** ociuhandu has quit IRC18:32
*** k_mouza has quit IRC18:33
*** k_mouza has joined #openstack-ironic18:37
*** dtantsur is now known as dtantsur|afk18:39
dtantsur|afko/18:39
*** diurnalist has quit IRC18:42
*** bburns_ has joined #openstack-ironic18:43
TheJuliagoodnight18:43
*** bburns has quit IRC18:45
*** k_mouza has quit IRC18:53
TheJulialbragstad: well, good news. It works. We made it all the way through devstack in an enforced mode up until it was time to restart nova. https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_6e5/778957/11/check/ironic-inspector-tempest-secure-rbac/6e55d7b/controller/logs/screen-n-cpu.txt :(18:56
lbragstadnice!18:57
TheJulia An unknown error has occurred when trying to get the list of nodes from the Ironic inventory. Error: The baremetal service for 10.209.37.89:RegionOne exists but does not have any supported versions.: openstack.exceptions.NotSupported: The baremetal service for 10.209.37.89:RegionOne exists but does not have any supported versions.18:57
lbragstadahh - is the endpoint in the service catalog?18:58
*** diurnalist has joined #openstack-ironic18:59
TheJulialooks like it19:00
TheJuliait is not loading up an override19:00
*** _gryf has joined #openstack-ironic19:01
TheJulialooks like nova is trying to use project scope auth of course19:02
lbragstadand ironic is enforcing scope19:02
lbragstadright?19:02
TheJuliayup19:02
lbragstadyeah - nice, that's a good sign19:02
TheJuliaindeed19:02
lbragstadi guess we're to the point where we need to start updating those areas19:02
lbragstadwhich is cool19:02
TheJuliaThe nova error is super vague, but it looks like it might not even getting into the API logging at all19:03
TheJuliathe apache log says it returned a 200...19:05
TheJuliahmm yeah, apparently returned 200s19:07
TheJuliathats not right19:07
*** ociuhandu has joined #openstack-ironic19:07
TheJuliaoh19:08
TheJuliait would be an empty list19:08
TheJuliagenerated 13 bytes19:08
TheJuliayup, the empty list json response would be exactly 13 bytes19:09
TheJuliawhich means work in nova to at least not freak out as horribly19:10
TheJuliaokay, that was actually before ironic's api was up because of how devstack works19:13
*** ociuhandu has quit IRC19:15
*** ociuhandu has joined #openstack-ironic19:18
*** jawad_axd has quit IRC19:18
*** ociuhandu has quit IRC19:25
openstackgerritJulia Kreger proposed openstack/ironic master: WIP: Scoped RBAC testing  https://review.opendev.org/c/openstack/ironic/+/77895719:34
TheJulialbragstad:  https://review.opendev.org/c/openstack/devstack/+/780073  and ^^^ hopefuly will work together and we'll see magic19:35
lbragstadok - cool19:35
lbragstadcurious to see how that pans out19:35
TheJuliame too19:36
TheJuliaI may update it again to enable a hybrid mode out of the gate19:36
TheJuliabut maybe later19:36
TheJuliaone thing at a time is best19:36
lbragstadagreed19:36
TheJuliahttps://zuul.opendev.org/t/openstack/stream/e51e5cd298f14958b6b3c1d07fb978c9?logfile=console.log19:39
*** ociuhandu has joined #openstack-ironic19:40
*** diurnalist has quit IRC19:40
*** dsneddon_ has joined #openstack-ironic19:42
*** rh-jelabarre has quit IRC19:47
*** ociuhandu has quit IRC19:51
*** rh-jelabarre has joined #openstack-ironic19:52
*** diurnalist has joined #openstack-ironic19:57
*** rcernin has joined #openstack-ironic20:00
*** k_mouza has joined #openstack-ironic20:28
*** k_mouza has quit IRC20:33
TheJuliahmm, looks like it didn't load it in :\20:44
*** dking has joined #openstack-ironic20:47
*** jamesdenton has quit IRC20:53
TheJulialbragstad: doh, put it backwards20:53
*** jamesdenton has joined #openstack-ironic20:53
*** k_mouza has joined #openstack-ironic20:54
*** ociuhandu has joined #openstack-ironic20:56
*** k_mouza has quit IRC20:59
*** michall has joined #openstack-ironic21:03
*** michall has left #openstack-ironic21:03
*** rcernin has quit IRC21:04
*** ociuhandu has quit IRC21:04
*** rcernin has joined #openstack-ironic21:35
TheJuliaajya: w/r/t the configuration molds patches, it looks like they need to be rebased. Also, fwiw, regarding 768428 you only need to have a dependency on the later patch. That pulls in both automatically as it represents the history of the prior patch in the chain as well. You can't take two independent histories in the same repo and expect the CI infra to reconcile it when they are from the same repository.21:41
*** rcernin has quit IRC21:51
*** rcernin has joined #openstack-ironic21:54
*** bfournie has quit IRC21:58
lbragstadTheJulia are you doing any testing locally with devstack?21:59
TheJulialbragstad: no, my stack blew up on networking issues last week22:00
TheJuliawell, last friday22:00
*** rcernin has quit IRC22:00
lbragstadok22:00
TheJuliawhy?22:00
*** rcernin has joined #openstack-ironic22:00
openstackgerritVerification of a change to openstack/ironic failed: Allow users to configure priority for {create,delete}_configuration  https://review.opendev.org/c/openstack/ironic/+/77814522:02
lbragstadthe existing devstack personas are the legacy ones22:03
lbragstad(e.g., devstack, devstack-admin, etc.)22:03
mnaserok, am i REALLY unlucky or whats goin on22:03
lbragstadi'm adding to those https://review.opendev.org/c/openstack/devstack/+/780033/322:03
mnaserhttps://review.opendev.org/c/openstack/ironic/+/77814522:03
mnaserironic-tempest-ipa-wholedisk-direct-tinyipa-multinode  failed this time22:03
mnaser:'(22:03
jandersgood morning Ironic o/22:08
iurygregorymorning janders o/22:20
iurygregorymnaser, I need to agree that you are unlucky =(22:20
iurygregorydid you offer a cookie to zuul?22:21
openstackgerritVerification of a change to openstack/ironic failed: Allow users to configure priority for {create,delete}_configuration  https://review.opendev.org/c/openstack/ironic/+/77814522:23
iurygregorywait22:25
iurygregoryWHAT?!22:25
iurygregorythe bot is drunk?22:25
TheJulialbragstad: okay, for now I just care about system-admin which is already present22:32
lbragstadyeah- that makes sense22:33
TheJuliamnaser: looks like we've just got too  many VMs for the limited number of machines we can deploy on those hosts22:36
TheJuliaI think we need to just turn off basic ops since the other jobs run on multitenancy22:37
*** ociuhandu has joined #openstack-ironic22:45
*** ociuhandu has quit IRC22:51
*** fdegir has quit IRC23:10
*** fdegir has joined #openstack-ironic23:10
*** jamesdenton has quit IRC23:23
*** jamesdenton has joined #openstack-ironic23:24
« Wednesday, 2021-03-10 Index Friday, 2021-03-12 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!