Tuesday, 2022-02-08

arne_wiebalckGood morning, Ironic!07:36
arne_wiebalckTheJulia: for the inspector issue? no, too many other issues I am struggling with at the moment ... 07:37
rpittaugood morning ironic! o/07:43
MahnoorAsgharo/07:43
dtantsurmorning folks07:59
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Update /etc/keystone ownership on upgrade from Xena  https://review.opendev.org/c/openstack/bifrost/+/82822708:05
opendevreviewDmitry Tantsur proposed openstack/bifrost master: CI: properly report failures in the upgrade job  https://review.opendev.org/c/openstack/bifrost/+/82768708:06
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Only remove old services after they are stopped  https://review.opendev.org/c/openstack/bifrost/+/82825208:45
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Only remove old services after they are stopped  https://review.opendev.org/c/openstack/bifrost/+/82825208:47
opendevreviewMerged openstack/bifrost stable/xena: Revert "Install libvirt-python from source instead of a wheel"  https://review.opendev.org/c/openstack/bifrost/+/82817808:47
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Only remove old services after they are stopped  https://review.opendev.org/c/openstack/bifrost/+/82825209:17
opendevreviewDmitry Tantsur proposed openstack/bifrost master: CI: properly report failures in the upgrade job  https://review.opendev.org/c/openstack/bifrost/+/82768709:17
opendevreviewMerged openstack/metalsmith stable/wallaby: Avoid non-Stream CentOS 8, it is EOL; make one job non-voting  https://review.opendev.org/c/openstack/metalsmith/+/82723409:23
*** lifeless_ is now known as lifeless09:24
dtantsurthe outcome of a local testing: a (significantly larger) ubuntu image works, both debian and debian-minimal images do not...09:40
parasiti1hi, i have one small question: i'm wondering what the 'my_ip' conf var is used for. My conductor is behind a FIP, so the conductor & horizon are sending me back the "wrong" URL for the ipmi console because it's built with the 'my_ip' conf var. Can i safely set the my_ip var to an "external ip" or is it important that it's kept to an internal network ip? thanks09:47
dtantsurparasiti1: I think it's also used for something in PXE09:48
dtantsurparasiti1: hmm, not, it's my_ipv6. anyway, there also an option [console]socat_address09:49
opendevreviewDmitry Tantsur proposed openstack/ironic master: CI: use a custom centos partition image instead of cirros  https://review.opendev.org/c/openstack/ironic/+/82788210:02
opendevreviewRiccardo Pittau proposed openstack/bifrost master: [WIP] Fix dib ipa jobs  https://review.opendev.org/c/openstack/bifrost/+/82729310:02
opendevreviewDmitry Tantsur proposed openstack/ironic master: [DNM] Testing the CI  https://review.opendev.org/c/openstack/ironic/+/82750010:02
rpittauseems like debian is causing some trouble for us :/10:03
parasiti1dtantsur: i'm using the shellinbox, which only sends back a url with my_ip. i'll try to switch to socat, but i have issues: it tells me it cant allocate ports..10:12
parasiti1dtantsur: with socat i hit this error: Error enabling the console on node 70daf724-4028-4e81-8abf-462651b2e857. Reason: Unable to allocate a free port on host localhost for IPMI terminal, not enough free ports.: ironic.common.exception.NoFreeIPMITerminalPorts: Unable to allocate a free port on host localhost for IPMI terminal, not enough free ports10:23
parasiti1dtantsur: ok i think i know why, the conductor is a docker container with a pod IP, not the host Ip, and the socat impl checks that it can bind the port on the "my_ip" which is not set to the container ip, but to the host ip10:31
parasiti1dtantsur: maybe i can use this socat_address and set it to the pod ip (or even  try 0.0.0.0 :)10:33
opendevreviewMark Goddard proposed openstack/tenks master: docs: linux bridge, supported OS distros  https://review.opendev.org/c/openstack/tenks/+/82827810:57
opendevreviewMark Goddard proposed openstack/tenks master: Support UEFI boot mode  https://review.opendev.org/c/openstack/tenks/+/82747911:16
opendevreviewMark Goddard proposed openstack/tenks master: Change default boot mode to UEFI  https://review.opendev.org/c/openstack/tenks/+/82755311:16
iurygregorygood morning Ironic o/11:36
jandershey iurygregory o/11:36
TheJuliagood morning ironic13:04
iurygregorygood morning TheJulia =)13:04
rpittaugood morning TheJulia iurygregory :)13:05
iurygregoryhey rpittau o/13:05
dmelladoping dtantsur around? 13:21
* TheJulia tries to wake up13:24
iurygregoryanyone got this type of error with gerrit before: https://paste.opendev.org/show/812583/ ?13:36
iurygregoryfunny that  complains about merge conflict (I've cloned the repo, created a new branch so it should match what master has LOL)13:38
TheJuliaiurygregory: have you updated git-review?13:40
iurygregoryTheJulia, nope, the F35 install is new (from January) all I did was install the git-review 13:42
opendevreviewMerged openstack/ironic-python-agent stable/xena: Make the standalone job voting again  https://review.opendev.org/c/openstack/ironic-python-agent/+/82728813:46
TheJuliadunno, maybe there is a compatability bug which hasn't been identified yet13:46
TheJulia?13:46
iurygregorymaybe .-. going to try a few more things to see if it helps 13:47
dtantsurdmellado: around now13:50
dtantsurgood morning TheJulia 13:50
rpittauiurygregory: that's due to an old version of git-review13:51
dtantsurteam, https://review.opendev.org/c/openstack/bifrost/+/828227/ https://review.opendev.org/c/openstack/bifrost/+/828252/ and https://review.opendev.org/c/openstack/bifrost/+/827687 are needed to fix the bifrost upgrade jobs. please review.13:51
rpittauiurygregory: you should install version 2.2.0 or newer13:51
iurygregoryrpittau, oh13:51
iurygregoryok let me check the version I have13:51
dtantsuriurygregory: https://bugzilla.redhat.com/show_bug.cgi?id=203922413:51
iurygregoryjesus 1.28.013:52
dtantsurthere is a patch in bz that you can apply locally13:53
rpittauor just install git-review per user :)13:53
iurygregoryyeah, git is 2.34.1 ...13:53
iurygregorytks!13:53
rpittauwell I fixed the issue with the dhcp all interfaces, although now we have a new one! \o/13:54
dtantsursweeet13:54
rpittauEFI ftw -> https://paste.openstack.org/show/812585/13:55
arne_wiebalckBare Metal SIG meeting in 5 mins!13:55
iurygregorytks for the reminder arne_wiebalck o/13:56
dtantsurrpittau: if this is a whole disk image, there is an element to add for UEFI support13:56
dtantsurrpittau: block-device-efi13:56
* dtantsur will need to watch the meeting in recording..13:57
rpittaummm I'll check that13:58
rpittauthanks13:58
opendevreviewRiccardo Pittau proposed openstack/bifrost master: [WIP] Fix dib ipa jobs  https://review.opendev.org/c/openstack/bifrost/+/82729314:09
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic master: [DNM] Testing CI  https://review.opendev.org/c/openstack/ironic/+/82833814:09
iurygregory\o/ pip ++ <314:10
arne_wiebalckThanks TheJulia, this was a great session!14:51
TheJuliaThanks!14:52
*** akaha|rover is now known as akahat|dinner14:55
NobodyCamI concur arne_wiebalck 14:58
TheJuliaI was surprised how long that ran15:03
dtantsuriurygregory: wanna hear the explanation of the magical behavior yesterday? when my feature worked depending on the moon phase?15:09
iurygregorydtantsur, yes15:10
iurygregory:D15:10
dtantsurthe key is https://review.opendev.org/c/openstack/bifrost/+/82825215:10
TheJuliamoon phasing features... sound awesome15:11
dtantsurI made a mistake in bifrost upgrade that resulted in the old ironic-api and ironic-conductor COEXISTING with the new ironic service15:11
iurygregoryoh wow15:11
dtantsurso, depending on the random movements of the atoms, I ether got the old or the new conductor handling my deployment15:11
dtantsurI nearly lost the rest of my sanity on this issue :)15:11
iurygregoryand how the starts are aligned =D15:12
TheJuliadtantsur: where did you get more sanity?!?15:12
TheJuliaI need to order some15:12
dtantsurspeaking of which, these patches are blocking bifrost release: https://review.opendev.org/c/openstack/bifrost/+/828227/ https://review.opendev.org/c/openstack/bifrost/+/828252/ and https://review.opendev.org/c/openstack/bifrost/+/827687 15:12
dtantsurTheJulia: welll... I found some on the desk, not sure how put it there15:12
dtantsurless fun stuff: I cannot build a working debian partition image. Ubuntu and CentOS seem to work, Debian does not :(15:13
iurygregorydtantsur, maybe zigo has some ideas? 15:14
zigoo/15:14
zigoAbout what?15:14
dtantsurmaybe, but it's probably something DIB does rather than a Debian issue15:14
dtantsurzigo: so, in case you have ideas. I was building an image for Ironic with $ disk-image-create debian-minimal baremetal dhcp-all-interfaces cloud-init grub215:15
dtantsurthe resulting partition (= only root) image can be deployed by ironic, but does not boot beyond grub (it drops in the shell)15:15
dtantsurdo you have any ideas at least where to dig?15:15
zigoDid you try the grub-cloud variant?15:16
zigogrub-cloud-amd6415:16
* TheJulia wonders if the base image is whole disk vs partition15:16
dtantsurzigo: mmm? what's the difference?15:16
dtantsurTheJulia: all base images are whole disk ones.15:16
zigoIt has support for BOTH uefi AND bios.15:17
zigoNot sure if your issue is UEFI / BIOS related ...15:17
dtantsurzigo: okay, interesting, I'll give it a spin15:17
TheJuliadtantsur: so... according to stevebaker, base image extraction only actually works for partition source images15:17
dtantsurTheJulia: this cannot be true. I don't think we've ever had any partition source images except for cirros.15:17
TheJuliaHe metioned it to me yesterday and that he was going to talk to Ian before proceeding15:17
dtantsurI tested CentOS this morning.15:17
TheJuliaLast centos image I pulled down was single partition in a whole disk image15:18
TheJuliamaybe that is what he was talking about15:18
zigodtantsur: Let me know how it goes, I may have more ideas. Also, make sure your setup really has GRUB_TERMINAL="console serial" so that Grub output to both.15:18
dtantsurTheJulia: this does not match my experience, lemme check the image DIB downloaded15:18
TheJuliadtantsur: ++15:18
dtantsurTheJulia: okay, it's one partition, but it's still a whole disk image. Note the difference: https://paste.opendev.org/show/812592/15:21
dtantsur(also "thank you" CentOS for not making a UEFI-compatible image in year 2022)15:22
TheJuliaI think it was just disks with multiple partitions, tbh15:22
dtantsurso, this works; I suspect that Debian is built using debootstrap instead15:23
TheJuliais there a debian-minimal vs debian difference?15:23
dtantsurI tried both, the size difference was a few megabytes15:23
dtantsurzigo: so, grub-cloud-amd64, is it a package or a DIB element? I cannot find it in DIB15:24
zigoA package.15:24
dtantsurah, hmm15:25
dtantsurzigo: this is what DIB installs: https://opendev.org/openstack/diskimage-builder/src/branch/master/diskimage_builder/elements/grub2/pkg-map#L3-L815:25
dtantsuralso note that grub does actually start for me. it just drops in the shell.15:26
rpittausuccess!!! \o/ https://review.opendev.org/c/openstack/bifrost/+/82729315:26
dtantsurw00t!15:26
rpittausorry :D15:26
rpittauI had that in troubleshooting since mid december15:27
zigodtantsur: That's a list that would work for Ubuntu, grub-cloud-amd64 only exists in Debian, so if you wish to switch to it, you'd need to differentiate.15:27
zigohttps://packages.ubuntu.com/search?keywords=grub-cloud-amd64 <--- Gives no result ...15:27
zigodtantsur: Does grub give you any clue of what's going on?15:28
zigoNo error message or something?15:28
dtantsurnothing15:28
dtantsurplease don't tell me we hardcode username "cirros" somewhere.....15:29
dmelladoI hope it wasn't the case xD15:31
dmelladook, so after all my fight and work with bifrost, I submitted a session for the summit15:32
parasiti1hi again, i'm getting deeper into my comprehension of ironic+neutron integration. there seems to be one step i've completely missed. when ironic tries to plug in the tenant port, it seems that it has to deal with VIFs objects. (as described in ironic/ironic/drivers/modules/network/common.py:235)15:33
parasiti1but i really dont now what VIFs objects are related to.15:33
TheJuliavifs are just neutron ports15:34
parasiti1TheJulia: you mean i have to pre create a neutron port related to my ironic port ?15:34
TheJuliafor standalone ironic+neutron, yes15:35
TheJuliaif your nova integrated, nova has a bunch of cases where it will create VIFs automatically15:35
parasiti1Ok. How my neutron port should be created so that it maps my ironic port ? by setting the same MAC ?15:37
TheJuliaIronic will reset the mac for you15:40
TheJuliarealistically just a port on a network so an address is assigned and all15:40
TheJuliaand provided to the node post-deployment15:40
parasiti1ok thanks15:41
parasiti1should i see the neutron ports i manually created when i run the "baremetal node vif list" command ?15:42
parasiti1or does it list only "attached" vifs ?15:43
TheJuliaparasiti1: only if they have been "attached" to the node15:44
opendevreviewDmitry Tantsur proposed openstack/ironic master: CI: use a custom centos partition image instead of cirros  https://review.opendev.org/c/openstack/ironic/+/82788215:44
TheJuliaparasiti1: if not needed, they should be removed generally. You can't have more vifs than ports or portgroups as well.15:45
parasiti1TheJulia: i don't get it :) i tried to follow the "ironic/doc/source/admin/multitenancy.rst" doc. if i got what you said right, i should "openstack port create..." ports after "baremetal port create" but before deploying the node (with metalsmith for instance) ?15:49
TheJuliabut ports I believe metalsmith will record the port attachment15:50
parasiti1TheJulia: Oh, so i shall : 1. baremetal port create, 2. openstack port create, 3. baremetal node vif attach "neutron-port-id", 4. metalsmith deploy ?15:53
TheJuliaparasiti1: I'm unsure because I don't know the internals or interaction with metalsmith15:54
ameya49TheJulia : Morning, with reference to this document : https://docs.openstack.org/ironic/latest/install/configure-nova-flavors.html   Question : Is cpu_arch used for scheduling?16:20
TheJuliaameya49: two places, nova instance scheduling by cpu type *and* it is used if you have to do pxe loaders by architecture16:27
NobodyCamGood Morning OpenStack folks 16:31
NobodyCamNow that I am actually awake16:31
dtantsurand that's still only Tuesday - impressive job NobodyCam :D16:33
* dtantsur hopes to become awake around tomorrow16:33
NobodyCamhehehehe16:34
NobodyCamo/ Morning dtantsur 16:34
arne_wiebalckTheJulia: ameya49: isn't the scheduling based on resource classes (and traits) ?16:42
TheJuliait is, but CPU aiui is still required16:42
parasiti1TheJulia: effectively, , i didnt have to create any neutron port when using metalsmith. just add the 'metalsmith deploy --network NETWORK' option, and metalsmith creates the neutron ports and 'vif attach' them automatically. thanks for the info16:44
TheJuliaparasiti1: ack, thanks16:44
arne_wiebalckTheJulia: setting the number of CPUs may be needed (but not for scheduling), yes, but cpu_arch? ameya49: where do you use cpu_arch?16:46
dtantsurI think cpu_arch is matched as part of extra specs16:47
dtantsurbut my nova knowledge is pretty rusty nowadays16:47
TheJuliait is populated into extra specs16:47
arne_wiebalckwe do not have this in our flavors ... and my understanding was all but resource classes (and traits) is irrelevant for scheduling16:48
dtantsurCPU/memory/disk are irrelevant, but cpu_arch (and other extra specs) may still be used16:48
TheJuliahttps://github.com/openstack/nova/blob/e537d90d6fc0977742f7126c3f8cfef6bf8b2a15/nova/virt/ironic/driver.py#L37116:48
dtantsursomebody should check the nova code :)16:48
dtantsuryeah, exactly16:48
TheJulia:)16:48
arne_wiebalckand we're sure this is not a left-over which is ignored?16:50
arne_wiebalckit is just that anything but RCs is used would be total news to me16:51
arne_wiebalckwhich does not mean it is not the case ofc :-D16:52
ameya49TheJulia: introspection basic test case is using it for verifying the introspection data with flavor 17:01
*** akahat|dinner is now known as akahat|rover17:05
*** sshnaidm is now known as sshnaidm|afk17:18
rpittaugood night! o/17:32
arne_wiebalckbye everyone, see you tomorrow o/17:47
opendevreviewMahnoor Asghar proposed openstack/ironic master: [WIP] Create API documentation from docstrings  https://review.opendev.org/c/openstack/ironic/+/82720017:54
opendevreviewRuby Loo proposed openstack/ironic master: More fixes for anaconda deploy interface  https://review.opendev.org/c/openstack/ironic/+/82792417:55
opendevreviewRuby Loo proposed openstack/ironic master: Anaconda deploy handles configdrive correctly  https://review.opendev.org/c/openstack/ironic/+/82793317:58
dtantsursee you tomorrow folks o/18:20
TheJuliao/18:28
opendevreviewJulia Kreger proposed openstack/ironic stable/queens: Remove legacy experimental jobs  https://review.opendev.org/c/openstack/ironic/+/82771318:40
stevebaker[m]good morning19:09
stevebaker[m]ah I have a video to edit :)19:33
opendevreviewVerification of a change to openstack/ironic stable/xena failed: ImageCache: respect Cache-Control: no-store  https://review.opendev.org/c/openstack/ironic/+/82637019:54
opendevreviewJulia Kreger proposed openstack/ironic stable/train: Remove redfish cache entry upon errors  https://review.opendev.org/c/openstack/ironic/+/82093720:28
opendevreviewJulia Kreger proposed openstack/ironic master: Auto-populate lessee for deployments  https://review.opendev.org/c/openstack/ironic/+/81864120:32
TheJuliagood morning stevebaker[m] 20:33
stevebaker[m]gah20:33
opendevreviewmitya-eremeev-2 proposed openstack/ironic master: Delete resource provider after node deletion.  https://review.opendev.org/c/openstack/ironic/+/82729520:38
opendevreviewMerged openstack/bifrost master: Update /etc/keystone ownership on upgrade from Xena  https://review.opendev.org/c/openstack/bifrost/+/82822720:47
opendevreviewmitya-eremeev-2 proposed openstack/ironic master: Delete resource provider after node deletion.  https://review.opendev.org/c/openstack/ironic/+/82729520:48
*** osmanlicilegi is now known as Guest120:56
opendevreviewMerged openstack/bifrost master: Only remove old services after they are stopped  https://review.opendev.org/c/openstack/bifrost/+/82825221:10
opendevreviewMerged openstack/bifrost master: CI: properly report failures in the upgrade job  https://review.opendev.org/c/openstack/bifrost/+/82768721:29
opendevreviewVerification of a change to openstack/ironic stable/queens failed: Remove legacy experimental jobs  https://review.opendev.org/c/openstack/ironic/+/82771321:58

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!