Monday, 2023-09-04

opendevreviewMaksim Malchuk proposed openstack/kolla-ansible master: Add forgotten release note for 886747  https://review.opendev.org/c/openstack/kolla-ansible/+/89348208:24
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible stable/2023.1: Use better default bind address for ironic-tftp  https://review.opendev.org/c/openstack/kolla-ansible/+/89338508:30
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible stable/zed: Use better default bind address for ironic-tftp  https://review.opendev.org/c/openstack/kolla-ansible/+/89338608:31
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible stable/xena: Use better default bind address for ironic-tftp  https://review.opendev.org/c/openstack/kolla-ansible/+/89342208:32
opendevreviewMerged openstack/kayobe stable/2023.1: Fix firewalld configuration for monitoring hosts  https://review.opendev.org/c/openstack/kayobe/+/89325208:34
opendevreviewMerged openstack/kayobe stable/zed: Fix firewalld configuration for monitoring hosts  https://review.opendev.org/c/openstack/kayobe/+/89325308:34
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible stable/yoga: Use better default bind address for ironic-tftp  https://review.opendev.org/c/openstack/kolla-ansible/+/89342108:34
sahido/08:38
sahidstill in my desire to override upper-contrainsts, I'm not able to achieve it for some reason08:39
sahidwe are agree that the process is downloading tarball from here https://github.com/openstack/kolla/blob/ussuri-eol/kolla/common/config.py#L29208:39
sahidthen use https://github.com/openstack/kolla/blob/ussuri-eol/docker/kolla-toolbox/Dockerfile.j2#L6608:39
sahidto override the constraints?08:40
sahidis there a way to facilitate debugging, I 'm not able to identify that block "kolla_toolbox_upper_constaints" executed when building image08:41
hrwsahid: ussuri is EOL.08:46
sahidhrw: yes thank you for the heads-up ;-)08:46
mnasiadkasahid: that basically means you're mostly on your own :)08:47
sahidI think this part of the process did not really chnged08:47
hrwsahid: it was the other way of asking "are you aware that no one cares"08:47
hrwsahid: if your setup is on kolla/ussuri then upgrade it. At least to Zed if not 2023.108:48
sahidis thqt better if I shqre those link with you? 08:49
sahidhttps://github.com/openstack/kolla/blob/master/docker/kolla-toolbox/Dockerfile.j2#L5708:49
sahidhttps://github.com/openstack/kolla/blob/master/kolla/common/sources.py#L1708:50
sahidIf it was so easy to upgrade 500 nodes I would have done that for sure :-)08:51
sahidwe are planing to upgrae on victoria (which is also eol, I know ;) and then move on again08:52
sahidbut currently we are trying to find a was to pin a version of a package used by a service08:52
hrwsahid: change those two to point to your copies, rebuild images, update08:53
hrwsahid: https://review.opendev.org/c/openstack/kolla/+/878649 may be useful for you08:54
sahidhrw: I would like to ensure I understand the whole process, so we use the tarball as a base and then we do override the file upper-constraints, rights?08:56
sahidIf I can just change one of that two points that could be helpful08:57
hrwsahid: you can also backport macro and use it to change single entries08:58
sahidthank for the review regarding the macro, the issue is I need to change the version used for that package for all the services08:58
hrwall services use u-c from openstack-base image...08:58
opendevreviewBartosz Bezak proposed openstack/kolla-ansible stable/zed: Added precheck for OpenSearch migration  https://review.opendev.org/c/openstack/kolla-ansible/+/89345308:59
opendevreviewMerged openstack/kolla-ansible master: Configure OVN to emit "need to frag" packets in case of MTU mismatch  https://review.opendev.org/c/openstack/kolla-ansible/+/89277708:59
opendevreviewMerged openstack/kolla-ansible master: Add forgotten release note for 886747  https://review.opendev.org/c/openstack/kolla-ansible/+/89348209:00
sahidhrw: so back to that point: https://review.opendev.org/c/openstack/kolla/+/87864909:02
sahidhttps://github.com/openstack/kolla/blob/master/docker/kolla-toolbox/Dockerfile.j2#L5709:02
sahid(wrong link))09:02
sahidthis block looks to override the u-c file, right?09:02
hrwsahid: it fetches u-c09:03
hrwsahid: kolla-toolbox bases on base so has to handle u-c on it's own09:03
hrwthere were attempts in past to rebase kolla-toolbox on top of openstack-base09:03
opendevreviewMichal Arbet proposed openstack/kolla master: [DNM] Test kolla-toolbox permissions  https://review.opendev.org/c/openstack/kolla/+/89360509:04
sahidhum I'm not sure to catch that whole part but at least I do understand that they are unrelated, right?09:06
hrwsahid: if you want to alter u-c for services then you need to do in in openstack-base09:09
sahidhrw: Ok thank you, is this something that kolla community would be interested to have and discuss for a correct impl or should I just consider to build a downstream-only patch?09:13
hrwsahid: template overrides are for it. maybe it would be nice to get that part in openstack-base enclosed in block09:16
hrwas now it is not made as a block == cannot be overriden09:16
sahidhum but wait, if I do override openstack_base_header and set from here the ovveride of the version09:20
sahidthis will affect all services, right?09:20
hrwno. it will be too soon09:21
hrwyou would rather need footer09:21
hrwbut it will be too late09:21
sahidso which part you are reffering that needs a block?09:22
hrwRUN ln -s openstack-base-source/* /requirements \ 09:22
sahids/reffering/referring09:22
hrwa way to override this command09:22
sahidoh I see09:23
hrwor add a block after it and use it to edit u-c09:23
hrw{% block openstack_base_override_upper_constraints %}{% endblock %}09:24
hrwmaybe with NOTE(): please think three times do you really need this block09:24
hrw;'D09:24
sahidahah :D09:25
sahidok gives me a moment to do some tests and I will share a patch to the community09:25
sahidthanks a lot for your help hrw 09:25
hrwsahid: yw09:26
hrwsahid: the key for dealing with EOL branches: how to get what I need in current master so I can backport it09:26
opendevreviewJan Gutter proposed openstack/kolla-ansible master: etcd: Add support for more scenarios  https://review.opendev.org/c/openstack/kolla-ansible/+/88801209:29
opendevreviewJan Gutter proposed openstack/kolla-ansible master: etcd: deduplicate environments for containers  https://review.opendev.org/c/openstack/kolla-ansible/+/89020809:29
opendevreviewJan Gutter proposed openstack/kolla-ansible master: etcd: update to v3.4  https://review.opendev.org/c/openstack/kolla-ansible/+/89046509:29
sahidhrw: ack thanks for sharing that09:30
opendevreviewJan Gutter proposed openstack/kolla-ansible master: WIP debug kolla-ansible-ubuntu-upgrade-cephadm  https://review.opendev.org/c/openstack/kolla-ansible/+/89082209:33
opendevreviewSahid Orentino Ferdjaoui proposed openstack/kolla master: openstack-base: add block for overriding global upper constraints  https://review.opendev.org/c/openstack/kolla/+/89360809:43
sahidhrw: ^ I'm not sure that we need UT for such change, but perhaps a reno note?09:44
hrwI forgot does kolla still uses renos or not09:45
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Just test something  https://review.opendev.org/c/openstack/kolla-ansible/+/89360909:46
SvenKieskeyes we do :P09:47
sahidSvenKieske: do you think thqt I should provde q reno note for q chqnge thqt is adding a block?10:01
SvenKieskeit would be nice, so users know about it and can actually use it. one small sentence would be enough I guess10:04
sahidsure that makes sense, give me a moment I will update the change thank you !10:04
opendevreviewSahid Orentino Ferdjaoui proposed openstack/kolla master: openstack-base: add block for overriding global upper constraints  https://review.opendev.org/c/openstack/kolla/+/89360810:06
hrwsahid: +1 and lets see what Zuul says10:15
hrwand what cores will say ;D10:15
jangutterARA logging fans: https://review.opendev.org/c/openstack/kolla-ansible/+/891097 (add #ara to your commit message to enable, #ara_verbose to render to html)10:39
jangutter(I normally dislike adding testing instructions in the git commit, but turns out describing the instructions also triggers the output :-p )10:42
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Just test something  https://review.opendev.org/c/openstack/kolla-ansible/+/89360911:09
opendevreviewMartin Hiner proposed openstack/kolla-ansible master: Add support of podman deployment  https://review.opendev.org/c/openstack/kolla-ansible/+/79922911:09
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Just test something  https://review.opendev.org/c/openstack/kolla-ansible/+/89360911:25
opendevreviewMerged openstack/kayobe stable/2023.1: Speed up calls to Bifrost  https://review.opendev.org/c/openstack/kayobe/+/89320111:26
opendevreviewMerged openstack/kayobe stable/zed: Speed up calls to Bifrost  https://review.opendev.org/c/openstack/kayobe/+/89320211:26
opendevreviewMerged openstack/kayobe stable/xena: Speed up calls to Bifrost  https://review.opendev.org/c/openstack/kayobe/+/89320411:26
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Revert "CI: retry smoke tests and instance creation"  https://review.opendev.org/c/openstack/kolla-ansible/+/89355011:39
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Just test something  https://review.opendev.org/c/openstack/kolla-ansible/+/89360911:39
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Revert "CI: retry smoke tests and instance creation"  https://review.opendev.org/c/openstack/kolla-ansible/+/89355011:56
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Revert "CI: retry smoke tests and instance creation"  https://review.opendev.org/c/openstack/kolla-ansible/+/89355011:57
opendevreviewMerged openstack/kayobe stable/yoga: Speed up calls to Bifrost  https://review.opendev.org/c/openstack/kayobe/+/89320312:05
opendevreviewJan Gutter proposed openstack/kolla-ansible master: WIP debug kolla-ansible-ubuntu-upgrade-cephadm  https://review.opendev.org/c/openstack/kolla-ansible/+/89082212:15
opendevreviewJan Gutter proposed openstack/kolla-ansible master: WIP debug kolla-ansible-ubuntu-upgrade-cephadm  https://review.opendev.org/c/openstack/kolla-ansible/+/89082212:23
TK_Hello Team ... Has anyone faced this error on compute nodes of the same cpu ? forexample Broadwell-noTSX-IBRS12:25
TK_Failed to live migrate instance to host "compute2". Details  Migration pre-check error: Unacceptable CPU info: CPU doesn't have compatibility12:25
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Just test something  https://review.opendev.org/c/openstack/kolla-ansible/+/89360912:31
TK_I have also confirmed that the servers processors have some flags difference specifically hwp hwp_act_window hwp_pkg_req 12:50
SvenKieskethere was recently a posting on the mailing list where live migration also didn't work, but I think the processor used there was never mentioned.12:51
SvenKieskeTK_ ah I guess that posting was you, no?12:54
TK_Was there a solution to it ?12:54
SvenKieskehttps://lists.openstack.org/pipermail/openstack-discuss/2023-September/034944.html12:55
opendevreviewMartin Hiner proposed openstack/kolla-ansible master: Add support of podman deployment  https://review.opendev.org/c/openstack/kolla-ansible/+/79922913:08
TK_@SvenKieske Its actually me that initiated but there is still no solution upto now 13:12
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Fix podman logs  https://review.opendev.org/c/openstack/kolla-ansible/+/89318713:51
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Add support of podman deployment  https://review.opendev.org/c/openstack/kolla-ansible/+/79922913:51
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Just test something  https://review.opendev.org/c/openstack/kolla-ansible/+/89360913:51
jangutterTK_ from https://lists.openstack.org/pipermail/openstack-discuss/2023-September/034962.html I think it might mean that it somehow was active on the source machine but not the target machine.13:56
jangutterTK_ if you absolutely cannot stop the instance, then you need to try to make the target match the source. You might need to enable p-state on the target and reboot, and that might allow you to migrate to the target.13:59
SvenKieskethe people in #openstack-nova might also be more knowledgeable in this area.14:08
fricklerTK_: didn't we establish last week that different kernel versions were the cause? any new info about this?14:10
jangutterTo be honest, there's a million different things that can inhibit live migration if the CPU profile is the same as the host, and preventing that kind of config drift is non-trivial.14:31
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Just test something  https://review.opendev.org/c/openstack/kolla-ansible/+/89360914:34
mnasiadkaTK_: it's rather a #openstack-nova topic, we're only humble deployers ;-)14:42
TK_Let me use on older kernel and see 14:58
opendevreviewPedro Henrique Pereira Martins proposed openstack/kolla-ansible master: Fix the docker container dimensions comparison for short notation  https://review.opendev.org/c/openstack/kolla-ansible/+/88650019:18
-opendevstatus- NOTICE: Some Gerrit changes that update Zuul configuration may fail with no response from Zuul. A fix is in progress.20:05
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/zed: Pass through kolla inventories as is  https://review.opendev.org/c/openstack/kayobe/+/89368820:07
*** mmalchuk_ is now known as mmalchuk20:13
simondodsleyDoes a kolla deployment install nvme kernel modules, or do we have to do that within a special configuration file. I'm thinking of the `nvme-cli` package and also the kernel modules `nvme-fabrics` and `nvme-rdma`22:20
-opendevstatus- NOTICE: Gerrit changes with updates to Zuul's configuration should now be handled correctly. Recheck any changes to Zuul configuration which did not report results.22:37

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!