Monday, 2022-01-24

opendevreviewlikui proposed openstack/kolla-ansible stable/victoria: update the default value of node_custom_config  https://review.opendev.org/c/openstack/kolla-ansible/+/82594001:27
opendevreviewlikui proposed openstack/kolla-ansible stable/wallaby: update the default value of node_custom_config  https://review.opendev.org/c/openstack/kolla-ansible/+/82594101:27
opendevreviewlikui proposed openstack/kolla-ansible stable/xena: update the default value of node_custom_config  https://review.opendev.org/c/openstack/kolla-ansible/+/82594201:27
fricklerwow, someone translated this to ... turkish? https://etherpad.opendev.org/p/kolla-ansible-letsencrypt-https05:51
fricklerrestoring via copy&paste didn't work too well, so I guess I'll need to use the API, does everyone agree that https://etherpad.opendev.org/p/kolla-ansible-letsencrypt-https/timeslider#3594 would be the last reasonable version?06:13
yoctozeptofrickler: oh lol08:50
yoctozepto3594 looks like the last one before the translation happened08:51
yoctozeptoand it's from January 27 2021 so it makes sense08:51
mnasiadkaanyway, looking at the content, we should probably update it or discuss it again - I understand supervisor is not needed anymore.08:55
hrwmorgen08:57
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/train: [baremetal]: Use $releasever in docker-ce repo  https://review.opendev.org/c/openstack/kolla-ansible/+/82594508:59
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/train: [baremetal]: Use $releasever in docker-ce repo  https://review.opendev.org/c/openstack/kolla-ansible/+/82594509:00
mnasiadkaSo, looking at frickler's message from 10:53 - what are we doing with CentOS Train CI jobs? they look like failing :-)09:00
yoctozeptomnasiadka: ah, 10:53 from yesterday09:03
yoctozeptoI was wondering if tz changed09:03
yoctozeptofrickler: re: weekly: we had to use weekly without quay09:05
yoctozeptonow daily seems better as it is what we used to do before dockerhub apocalypse09:05
frickleryoctozepto: ah, o.k., I was thinking stable images would profit from being more stable and thus happening only weekly, but I'm fine with that argument09:07
yoctozeptoregarding train and broken centos jobs - I guess they should be fixed until we eol train09:07
hrwtrain and c7 or train and c8?09:10
yoctozeptoc709:11
yoctozeptoc8 is out09:11
mnasiadkaboth c7 and c8 seem to have some pip issue09:11
yoctozeptomnasiadka: did not we drop c8?09:12
yoctozeptothen we simply forgot09:12
yoctozeptoor well09:12
yoctozeptoI think I preferred to switch distro09:12
hrwis it kolla or k-a?09:12
yoctozeptoso maybe they both run on c709:12
yoctozeptohrw: kolla09:12
yoctozeptobuild/publish09:12
hrwok09:12
hrwlet me run a build09:13
yoctozeptohrw: https://zuul.openstack.org/builds?project=openstack%2Fkolla&branch=stable%2Ftrain&pipeline=periodic-weekly&skip=009:13
hrwthx09:13
yoctozeptohrw, mnasiadka, frickler: yeah, I switched both to c709:13
yoctozeptoso it's a problem with pip installation on c709:13
yoctozeptowhich is not that surprising09:13
yoctozeptoprobably need to pin a bit here and there09:13
hrwah.09:14
hrwah. now the problem with git review ;D09:17
yoctozeptoah. oh. eh. uh.09:18
hrwhttps://paste.centos.org/view/f57193ee - can someone upload it?09:18
yoctozeptohrw: sure, give me a moment to boot my env09:18
hrwthx09:19
hrwit should solve the problem09:19
hrwok, let me retry09:20
mnasiadkamaybe remove my NOTE :D09:22
hrwtrue09:23
hrwhttps://paste.centos.org/view/7cea027a09:23
opendevreviewRadosÅ‚aw Piliszek proposed openstack/kolla stable/train: CI: limit pip to 20.x  https://review.opendev.org/c/openstack/kolla/+/82603309:24
yoctozeptomnasiadka, hrw: imho the comment still holds09:24
hrw2022-01-24 09:28:41.943809 | TASK [Upgrade pip to latest version]09:30
hrw2022-01-24 09:28:42.855247 | primary | Collecting pip==20.*09:30
hrw2022-01-24 09:28:43.019376 | primary |   Downloading https://mirror.iad3.inmotion.opendev.org/pypifiles/packages/27/79/8a850fe3496446ff0d584327ae44e7500daf6764ca1a382d2d02789accf7/pip-20.3.4-py2.py3-none-any.whl (1.5MB)09:30
hrw2022-01-24 09:28:43.165185 | primary | Installing collected packages: pip09:30
hrw2022-01-24 09:28:43.165330 | primary |   Found existing installation: pip 8.1.209:30
hrw2022-01-24 09:28:43.171186 | primary |     Uninstalling pip-8.1.2:09:30
hrw2022-01-24 09:28:43.171288 | primary |       Successfully uninstalled pip-8.1.209:30
hrw2022-01-24 09:28:44.326546 | primary | Successfully installed pip-20.3.409:30
hrw2022-01-24 09:28:44.563848 | primary | ok: Runtime: 0:00:02.01343309:30
hrwone problem solved09:30
hrw2022-01-24 09:30:06.196468 | primary | ERROR: Could not install packages due to an EnvironmentError: HTTPSConnectionPool(host='releases.openstack.org', port=443): Max retries exceeded with url: /constraints/upper/train (Caused by SSLError(SSLError(1, u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:618)'),))09:31
hrwthat's another09:31
hrwLE again09:32
hrwok. we need to install ca-certificates package09:32
hrwhttps://paste.centos.org/view/f989caf609:38
hrwI need to sort out my gerrit accounts. one dya09:38
hrwor no. I will merge it to previous patch09:39
hrwwe need both changes09:39
rockeytraditional monday git problems? :)09:40
opendevreviewMarcin Juszkiewicz proposed openstack/kolla stable/train: CI: make it work again  https://review.opendev.org/c/openstack/kolla/+/82603309:40
hrwrockey: it's more complicated09:41
rockeyjust reflecting on "sort out my gerrit accounts"09:43
rockeysince i have myself one "how the fsck does git work now again" moment :P09:43
hrwrockey: when launchpad enabled 2FA support for everyone my account there got locked. So I created new one, then new on review.opendev. Day later turned out that I got hit by LP bug, chatted with admin on video call to make sure it is me, got account back. still two accounts on gerrit are problem09:45
hrwrockey: very short version09:45
rockeyhehe check :)09:45
rockeygood you got it back09:46
hrwfsck. still failed same way09:47
opendevreviewMark Goddard proposed openstack/kolla stable/xena: Mitigate two Log4j vulnerabilities in Apache Storm  https://review.opendev.org/c/openstack/kolla/+/82594809:49
opendevreviewMark Goddard proposed openstack/kolla stable/wallaby: Mitigate two Log4j vulnerabilities in Apache Storm  https://review.opendev.org/c/openstack/kolla/+/82594909:49
opendevreviewMark Goddard proposed openstack/kolla stable/victoria: Mitigate two Log4j vulnerabilities in Apache Storm  https://review.opendev.org/c/openstack/kolla/+/82605009:50
opendevreviewMark Goddard proposed openstack/kolla stable/ussuri: Mitigate two Log4j vulnerabilities in Apache Storm  https://review.opendev.org/c/openstack/kolla/+/82605109:50
opendevreviewMarcin Juszkiewicz proposed openstack/kolla stable/train: CI: make it work again  https://review.opendev.org/c/openstack/kolla/+/82603309:58
hrwhacky, but 'whatever works'09:59
opendevreviewMark Goddard proposed openstack/kolla-ansible master: CI: enable libvirt TLS in TLS jobs  https://review.opendev.org/c/openstack/kolla-ansible/+/82584510:03
hrwAnd Kolla build started under CentOS 7 :D10:06
hrw      # NOTE(hrw) REQUESTS_CA_BUNDLE is to get Let's Encrypt certificates trusted10:06
hrwops10:06
hrw2022-01-24 10:06:04.734530 | primary | INFO:kolla.common.utils.base:Step 1/39 : FROM centos:710:06
hrwok, broke other distros at same time10:07
hrwanyway, know why ;D10:07
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Add Rocky Linux support as Host OS  https://review.opendev.org/c/openstack/kolla-ansible/+/81510410:09
opendevreviewMarcin Juszkiewicz proposed openstack/kolla stable/train: CI: make it work again  https://review.opendev.org/c/openstack/kolla/+/82603310:09
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Add Rocky Linux support as Host OS  https://review.opendev.org/c/openstack/kolla-ansible/+/81510410:09
hrwmnasiadka: commented10:11
mnasiadkahrw: makes sense, thanks10:11
hrwyw10:11
opendevreviewMerged openstack/kolla stable/victoria: magnum: fix issue with keystone auth default policy  https://review.opendev.org/c/openstack/kolla/+/82545610:12
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Add Rocky Linux support as Host OS  https://review.opendev.org/c/openstack/kolla-ansible/+/81510410:12
yoctozeptoError EINVAL: Can not automatically resolve ip address of host where active mgr is running. Please explicitly provide the address.10:14
yoctozeptoduh, cephadm jobs b0rken10:14
mnasiadkahuh, that means something really went wrong ;-)10:18
opendevreviewMerged openstack/kolla stable/wallaby: magnum: fix issue with keystone auth default policy  https://review.opendev.org/c/openstack/kolla/+/82545510:19
opendevreviewMerged openstack/kolla stable/xena: magnum: fix issue with keystone auth default policy  https://review.opendev.org/c/openstack/kolla/+/82545410:19
opendevreviewMarcin Juszkiewicz proposed openstack/kolla stable/train: CI: make it work again  https://review.opendev.org/c/openstack/kolla/+/82603310:21
mnasiadkaactually bootstrap-servers is failing10:21
hrwpep8 this time10:21
mnasiadka"msg": "Depsolve Error occured: \n Problem: conflicting requests\n  - nothing provides libtcmalloc.so.4()(64bit) needed by ceph-common-2:16.2.7-0.el8.x86_64\n  - nothing provides libleveldb.so.1()(64bit) needed by ceph-common-2:16.2.7-0.el8.x86_64\n  - nothing provides liboath.so.0()(64bit) needed by ceph-common-2:16.2.7-0.el8.x86_64\n  - nothing provides liboath.so.0(LIBOATH_1.10.0)(64bit) needed by 10:21
mnasiadkaceph-common-2:16.2.7-0.el8.x86_64\n  - nothing provides liboath.so.0(LIBOATH_1.2.0)(64bit) needed by ceph-common-2:16.2.7-0.el8.x86_64",10:21
mnasiadka    "rc": 1,10:21
hrwmnasiadka: rocky?10:21
mnasiadkano, cephadm jobs on centos10:22
hrws/rocky/rockylinux/?10:22
hrwok. train passes existing bugs. let this build check for new ones10:23
hrwmnasiadka: el8 suggests centos 8 repos.10:25
hrw2:16.2.7-1.el8s is in centos 8 stream repos10:25
rockeythank god i deleted hilights on "rocky" a few years back, ever since someone decided to make an os out of it10:27
hrwrockey: ;)10:28
hrw2022-01-24 10:36:58.718678 | primary | CRITICAL:tests.test_build:>>> Expected image 'monasca-grafana' to succeed!10:43
hrw2022-01-24 10:36:58.718859 | primary | CRITICAL:tests.test_build:>>> Expected image 'openstack-base' to succeed!10:43
hrwcentos8/train fails10:43
hrwopenstack-base due to anyjson10:44
hrwmonasca-grafana due being crap10:44
hrwwe may want to backport https://review.opendev.org/c/openstack/kolla/+/81477910:50
hrwINFO:kolla.common.utils.openstack-base:    oslo-vmware 2.34.1 depends on suds-jurko>=0.610:56
hrwINFO:kolla.common.utils.openstack-base:    The user requested (constraint) suds-jurko===0.610:56
hrwtrain is pain10:56
opendevreviewMarcin Juszkiewicz proposed openstack/kolla stable/wallaby: openstack-base: drop anyjson  https://review.opendev.org/c/openstack/kolla/+/82605211:00
opendevreviewMarcin Juszkiewicz proposed openstack/kolla stable/victoria: openstack-base: drop anyjson  https://review.opendev.org/c/openstack/kolla/+/82605311:00
opendevreviewMarcin Juszkiewicz proposed openstack/kolla stable/ussuri: openstack-base: drop anyjson  https://review.opendev.org/c/openstack/kolla/+/82605411:00
hrwfor train I will merge it into CI fixes11:00
opendevreviewMarcin Juszkiewicz proposed openstack/kolla stable/train: CI: make it work again  https://review.opendev.org/c/openstack/kolla/+/82603311:03
hrwmnasiadka: how important for us is to have train running again?11:04
mnasiadkaI'm open for input, for me not that really, but again it's a transition point from C7 to python3 world, so maybe some people are still on it11:05
mnasiadkamgoddard, yoctozepto: very important or meh important?11:05
mgoddardmnasiadka: medium11:06
mgoddardnice to have, not urgent11:06
hrwif we are fine with dropping oslo.vmware from openstack-base and marking monasca-grafana as unbuildable then I probably can get it pass11:06
mnasiadka+111:07
hrwlocal build in progress11:07
opendevreviewMerged openstack/kolla-ansible stable/xena: Continue to run all actions if one action failed in curator  https://review.opendev.org/c/openstack/kolla-ansible/+/82545711:11
opendevreviewMerged openstack/kolla-ansible stable/wallaby: Continue to run all actions if one action failed in curator  https://review.opendev.org/c/openstack/kolla-ansible/+/82545811:14
opendevreviewMark Goddard proposed openstack/kayobe master: Refactor host configure commands to use a single playbook  https://review.opendev.org/c/openstack/kayobe/+/81828911:15
hrwok. oslo-vmware requires openstack/requirements fix 11:17
hrwanyjson is in more places11:18
hrwsetuptools 2to3 thing is there too11:18
opendevreviewMerged openstack/kolla-ansible stable/victoria: Continue to run all actions if one action failed in curator  https://review.opendev.org/c/openstack/kolla-ansible/+/82545911:18
opendevreviewMerged openstack/kolla-ansible stable/wallaby: Use Docker healthchecks for ironic-neutron-agent services  https://review.opendev.org/c/openstack/kolla-ansible/+/82546211:18
opendevreviewMerged openstack/kolla-ansible stable/xena: Use Docker healthchecks for ironic-neutron-agent services  https://review.opendev.org/c/openstack/kolla-ansible/+/82585111:18
hrwnope. oslo is same 2to3 bug11:19
opendevreviewMerged openstack/kolla-ansible stable/xena: Add logrotate to libvirt service  https://review.opendev.org/c/openstack/kolla-ansible/+/82472811:23
opendevreviewMerged openstack/kolla-ansible stable/victoria: Use Docker healthchecks for ironic-neutron-agent services  https://review.opendev.org/c/openstack/kolla-ansible/+/82546111:23
opendevreviewMerged openstack/kolla-ansible stable/train: [baremetal]: Use $releasever in docker-ce repo  https://review.opendev.org/c/openstack/kolla-ansible/+/82594511:25
opendevreviewDoug Szumski proposed openstack/kolla-ansible master: WIP: Remove queue mirroring for internal RabbitMQ  https://review.opendev.org/c/openstack/kolla-ansible/+/82499411:36
yoctozeptomnasiadka: re cephadm, I meant more:11:48
yoctozeptoError EINVAL: Can not automatically resolve ip address of host where active mgr is running. Please explicitly provide the address.11:48
yoctozeptohttps://zuul.opendev.org/t/openstack/build/14c32484fe3742ceac314841737540c411:48
mnasiadkayoctozepto: that's on Ubuntu, I've seen that, does it happen every time, or is just one off?11:48
opendevreviewMark Goddard proposed openstack/kolla-ansible master: CI: enable libvirt TLS in TLS jobs  https://review.opendev.org/c/openstack/kolla-ansible/+/82584511:58
yoctozeptomnasiadka: happened twice in a row, assumed it's perma but could be wrong11:58
opendevreviewMark Goddard proposed openstack/kolla-ansible master: CI: enable libvirt TLS in TLS jobs  https://review.opendev.org/c/openstack/kolla-ansible/+/82584511:59
mnasiadkaOk, I'll have a look into it later - we should also bump version to pacific11:59
hrwuf. turned out that we do not constraint setuptools12:04
yoctozeptoand thankfully we can drop train soon12:10
yoctozeptojust migrate your customers before then12:10
hrwlet the build finish and I will publish new ver to test12:12
jingvarhi!12:15
jingvarwhat about new ovncontroller for rpm based distros? https://bugzilla.redhat.com/show_bug.cgi?id=195554512:15
jingvarwe faced with the issue on xena+centos8, there are'nt updated ovn in Centos Stream (it present for Ubuntu)12:17
hrwjingvar: you work for RH?12:18
jingvarno12:18
jingvarwe try to use OVN12:19
hrwjust curious as this bug looks like no info at all12:19
jingvarwe runned rally and have simalar to https://bugzilla.redhat.com/show_bug.cgi?id=194626212:20
opendevreviewMarcin Juszkiewicz proposed openstack/kolla stable/train: CI: make it work again  https://review.opendev.org/c/openstack/kolla/+/82603312:21
opendevreviewMarcin Juszkiewicz proposed openstack/kolla stable/train: CI: make it work again  https://review.opendev.org/c/openstack/kolla/+/82603312:21
hrwjingvar: can you tell me version of python-ovsdbapp package?12:25
mnasiadkajingvar: source or binary?12:34
jingvarVersion      : 1.12.012:35
jingvarsource12:35
jingvaropenstack.kolla/centos-source-ovn-controller          xena      e13256c4ba8a12:36
jingvarthe same for openstack.kolla/centos-source-ovn-controller                  xena      b18263623df12:40
hrwjingvar: version of package not image12:41
mnasiadkadocker exec ovn_controller rpm -vqa | grep ovn12:41
jingvarName         : python3-ovsdbapp  Version      : 1.12.0 Release      : 1.el812:42
jingvarrdo-ovn-2021-2.el8.noarch12:42
jingvarovn-2021-host-21.06.0-29.el8s.x86_6412:42
jingvarovn-2021-21.06.0-29.el8s.x86_6412:42
jingvarrdo-ovn-host-2021-2.el8.noarch12:43
mnasiadkaovn version looks ok, ovsdbapp is a Neutron component, version looks quite ok - I'm pretty sure it's not the same problem as you've mentioned - because bugzilla claims it's for Train, not Xena.12:58
jingvarbut we have same errors, let me get it13:01
hrwI think that train CI fix patch will get some notes added and 'whoever needs train, here is a patch to finish' note13:03
hrwDebian builds, Ubuntu builds, CentOS 8 binary builds, CentOS 8 source and CentOS 7 fail13:04
opendevreviewMerged openstack/ansible-collection-kolla master: Initialise Ansible collection  https://review.opendev.org/c/openstack/ansible-collection-kolla/+/82016513:05
opendevreviewMerged openstack/ansible-collection-kolla master: CI: run ansible-test sanity checks  https://review.opendev.org/c/openstack/ansible-collection-kolla/+/82090213:05
opendevreviewMerged openstack/ansible-collection-kolla master: CI: add ansible-lint to linters job  https://review.opendev.org/c/openstack/ansible-collection-kolla/+/82120013:05
opendevreviewMerged openstack/ansible-collection-kolla master: Import baremetal role from kolla-ansible  https://review.opendev.org/c/openstack/ansible-collection-kolla/+/82016813:05
hrw5th fix added ;(13:12
hrwyoctozepto: https://555e3f75fde67e9f9187-31bf408f42c27b0363a3847bc2706cfc.ssl.cf2.rackcdn.com/826033/8/check/kolla-build-centos8-source/c3e8b3e/kolla/build/000_FAILED_masakari-monitors.log - you know masakari iirc13:12
hrwyoctozepto: we have code to force use of libvirt-python 6.10.0 for masakari-monitors. 7.10.0 works13:16
hrwah, I see that it is common problem there13:17
hrwand sensu-client...13:21
opendevreviewMarcin Juszkiewicz proposed openstack/kolla stable/train: CI: make it work again  https://review.opendev.org/c/openstack/kolla/+/82603313:23
hrw6 fixes so far13:23
jingvarovercloud host configure - ModuleNotFoundError: No module named 'docker' - , try to install ipi docker under user stack -  Permission denied: '/usr/local/lib/python3.6,  manualy install under root, - host configure OK13:28
jingvarlog for OVN issue https://paste.opendev.org/show/812325/13:39
opendevreviewMerged openstack/kolla-ansible stable/xena: Revert "[CI] [to-revert] Avoid upgrades on CentOS Stream 8"  https://review.opendev.org/c/openstack/kolla-ansible/+/82545113:51
yoctozeptohrw: w/ masakari we later switched to installing the distro-provided python-libvirt and not installing that req from sources14:06
mnasiadkajingvar: that's rather something else, check neutron logs.14:09
opendevreviewBuddhika Sanjeewa proposed openstack/kolla-ansible master: Deploy Zun with Cinder Ceph support  https://review.opendev.org/c/openstack/kolla-ansible/+/82472214:13
hrwyoctozepto: o!14:13
opendevreviewMerged openstack/kolla-ansible stable/wallaby: Revert "[CI] [to-revert] Avoid upgrades on CentOS Stream 8"  https://review.opendev.org/c/openstack/kolla-ansible/+/82545214:18
jhcsHello all, I have a question. I want to add my compute hosts with Bifrost. The moment I try to provision the nodes no IP address is picked from our ranges. (We set both allocation_pool and inspection_allocation_pool). Am I doing something wrong? I sadly cannot find a solution within the documentation: https://docs.openstack.org/kayobe/latest/configuration/reference/network.html14:41
jhcsWithin the group_vars of Bifrost everything is set expect for the ip (`/etc/kolla/bifrost/inventory/host_vars`)14:43
opendevreviewBuddhika Sanjeewa proposed openstack/kolla-ansible master: Deploy Zun with Cinder Ceph support  https://review.opendev.org/c/openstack/kolla-ansible/+/82472215:16
hrwyoctozepto: centos8 has python3-libvirt. centos7 has no such15:26
opendevreviewMark Goddard proposed openstack/kolla-ansible master: libvirt: make it possible to run libvirt on the host  https://review.opendev.org/c/openstack/kolla-ansible/+/82535715:26
opendevreviewMarcin Juszkiewicz proposed openstack/kolla stable/train: CI: make it work again  https://review.opendev.org/c/openstack/kolla/+/82603315:26
hrw10th try15:27
jingvarmnasiadka: thanks15:31
jingvarjhcs: Do you have nodes into baremetal node output?15:43
jingvarjhcs: what do yo have in  /etc/kolla/bifrost/inventory/host_vars/ - there must be files corresppoded to node manes15:47
jingvarname15:47
mgoddardjhcs: during provisioning the node IPs are dynamically allocated15:50
mgoddardjhcs: after provisioning it should get a config drive which tells it the correct static IP to use15:51
jhcs@jingvar The nodes are available within Bifrost and are also put in the correct group on the ansible control host. I have put an screenshot of the created host_vars file https://jhcsmedia.com/?f=2022-01-24-ZXNUBCZjAijcEENM.png15:52
jhcsWithin the drive on the host the IP is also not set.15:54
mgoddardjhcs: are there IPs in etc/kayobe/network-allocations.yml ?16:20
mgoddardjhcs: that is where the ipv4_address IP comes from - the host's IP on the admin_oc network16:21
mgoddardjhcs: network-allocations.yml should get generated when you run 'kayobe overcloud inventory discover'16:22
jhcs@mgoddard, is see the file is generated but it is located at the root of the kayobe-config directory: kayobe-config/network-allocation.yml. I indeed see the hosts within this file, when emptied, it get filled again with hosts.16:40
frickleryoctozepto: mgoddard: mnasiadka: I've restored https://etherpad.opendev.org/p/kolla-ansible-letsencrypt-https now, but if there's still some discussion needed on the spec, maybe drop your RP+1's from https://review.opendev.org/q/topic:%22bp%252Fletsencrypt-https%22+(status:open%20OR%20status:merged) for now?16:45
jingvarconfig drive  is generated by bifrost playbook16:48
jingvarbifrost/playbooks/deploy-dynamic.yaml16:49
mgoddardjhcs: sounds like you have KAYOBE_CONFIG_PATH set to kayobe-config root16:49
mgoddardjhcs: try sourcing the 'kayobe-env' file16:49
jingvarmgoddard: why kayobe does'nt translate additional host groputs into kolla?16:53
jingvarI have 2 compute types of computes, but all computes in one kolla compute group16:53
mgoddardjingvar: you probably need to set kolla_overcloud_inventory_top_level_group_map16:54
jingvarMy expectation was it itself maps one to one from kayobe to kolla16:55
mgoddardjingvar: not quite16:56
jingvarok16:57
jingvarI faced with strange behaviour, host configure works ok with few computes, but with 20 computes, it fails on random task, or hung16:59
jingvarstrace show ansible wait a python process16:59
jingvarall compute nodes is blades17:02
jingvar  "msg": "Missing sudo password"17:02
jingvar3 ok, 21 with the error17:02
mgoddardhow many forks?17:07
jingvarby default17:08
jhcs@mgoddard and @jingvar, Thank you very much, I will check it out the last suggestion tomorrow or on wednesday. Thanks for all you're support so far!17:13
opendevreviewDoug Szumski proposed openstack/kolla-ansible master: WIP: Remove queue mirroring for internal RabbitMQ  https://review.opendev.org/c/openstack/kolla-ansible/+/82499417:45
opendevreviewMerged openstack/kayobe stable/victoria: ipa: Use openstack_branch instead of master  https://review.opendev.org/c/openstack/kayobe/+/82335619:05
opendevreviewRadosÅ‚aw Piliszek proposed openstack/kolla-ansible master: [DNM] [CI] Test Zun with Ceph  https://review.opendev.org/c/openstack/kolla-ansible/+/82552020:09
opendevreviewBuddhika Sanjeewa proposed openstack/kolla-ansible master: Deploy Zun with Cinder Ceph support  https://review.opendev.org/c/openstack/kolla-ansible/+/82472220:51
-opendevstatus- NOTICE: review.opendev.org will have a few short outages over the next few hours (beginning 22:00 UTC) while we rename projects and then upgrade to Gerrit 3.4. See https://lists.opendev.org/pipermail/service-announce/2022-January/000030.html for details.21:04
-opendevstatus- NOTICE: The review.opendev.org maintenance work is beginning now. Expect Gerrit outages over the next couple of hours. See https://lists.opendev.org/pipermail/service-announce/2022-January/000030.html for details.22:01
opendevreviewMerged openstack/kayobe stable/victoria: Fix seed VM configdrive when admin network is a VLAN  https://review.opendev.org/c/openstack/kayobe/+/82376622:08

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!