Monday, 2022-08-29

congntHi mnasiadka, I want to ask when kolla update version pypi to 14.3.1? Version 14.3.0 has error because docker upgrade version to 6.0.006:53
mnasiadkaWe'll request a release for stable branches soon, but in the meantime just install from git repository (that's what we recommend)07:02
congntmnasiadka: Thanks you, I try build image from git repo but got an error. Build with command (kolla-build --openstack-release yoga --tag yoga -n openstack -t source --registry registry.test.com-b ubuntu --image-name-prefix ubuntu-source-)07:10
congntNeutron-base fail with error (neutron-base:ERROR: Cannot install neutron 20.2.1.dev25 (from /neutron) because these package versions have conflicting dependencies)07:11
congnthttps://imgur.com/vFxs0du07:12
congntDo you hit this error when build image from master branch of kolla?07:13
congntI installed kolla by command (pip install git+https://opendev.org/openstack/kolla) from virtual env07:13
mnasiadkayou shouldn't be using master branch :)07:15
congntmnasiadka: Can you tell me why? Because code fixed error docker 6.0.0 only exist on master branch. 07:18
congntShould I Cherry pick to stable/yoga and install from that branch?07:18
mnasiadkafrickler: I guess we need to backport https://review.opendev.org/c/openstack/kolla/+/853953 then?07:25
fricklermnasiadka: I'm not sure we can bump min reqs in stable branches. might need to cap docker-py instead?07:38
mnasiadkafrickler: Yeah, I was just thinking about that07:46
mnasiadkaand do a release afterwards07:46
congntDo we have a best practice for building image openstack in yoga release for now?07:48
fricklercongnt: install docker<6 in your venv07:54
congntAnd I should install kolla from stable branch yoga, right?07:55
congntshouldn't use master branch07:56
fricklerthat's what mnasiadka already said. always use the same kolla version as the openstack version you are trying to build07:58
congntfrickler, mnasiadka: Thank you all07:59
opendevreviewMerged openstack/kolla-ansible master: [CI] Drop bindep  https://review.opendev.org/c/openstack/kolla-ansible/+/84727309:26
admin1hi all .. does anyone know about this error:  nova-compute Connection to libvirt failed: authentication failed: authentication failed: libvirt.libvirtError: authentication failed: authentication failed 09:27
admin1new install, yoga branch09:27
opendevreviewPierre Riteau proposed openstack/kolla-ansible master: Support configuring HAProxy services as active/passive  https://review.opendev.org/c/openstack/kolla-ansible/+/85497709:33
*** brinzhang0 is now known as brinzhang09:33
hrwcongnt: and then use same branch of kolla-ansible to deploy them09:46
congntYes, I know it because docs of kolla-ansible very clear :D Thank you 09:47
hrw;)09:48
rockeyadmin1: looks more like a nova-compute error than kolla, how about asking over in #openstack-nova?09:50
mnasiadkaadmin1: old image?09:55
admin1i checkout out yoga branch 09:56
admin1so i am not sure on the image age 09:56
fricklermight be sasl-related hostname mismatch issue. I never got round to fully debugging that one09:56
mnasiadkaadmin1: docker images | grep libvirt09:57
admin1quay.io/openstack.kolla/ubuntu-source-nova-libvirt    yoga      9fe7282d7dbe   2 days ago     996MB09:58
mnasiadkaseems fresh09:59
mnasiadkasurely a sasl related problem, but what's the cause - I have no clue09:59
fricklersetup creates user for short hostname, libvirt uses long hostname when trying to login10:01
opendevreviewPierre Riteau proposed openstack/kolla-ansible master: Support configuring HAProxy services as active/passive  https://review.opendev.org/c/openstack/kolla-ansible/+/85497710:01
mnasiadkaadmin1: using fqdn hostname or short one?10:03
admin1short one10:03
admin1hostname and hostname -f both give out the same short name (without fqdn ) 10:04
admin1i will retry with adding fqdn 10:04
admin1and see if it fixes it 10:04
admin1frickler, so it should be fqdn everywhere ? 10:05
admin1i checked the wrong server ..      hostname ( h1) ,  hostname -f ( h1.domain.com ) 10:05
admin1so the hostname and fqdn is correct 10:05
admin1unless hostname should also return   fqdn as a requirement10:06
frickleradmin1: try to run "echo libvirt_sasl_password | docker exec -it -u root nova_libvirt saslpasswd2 -c -p -a libvirt -u h1.domain.com nova" on the host with your real pw of course10:11
admin1frickler, sorry for the n00b question .. where can I find the real pw ? 10:12
fricklerin your secrets.yaml hopefully10:13
admin1the input device is not a TTY is what i gegt10:17
admin1#openstack-nova says to disable sasl 10:17
admin1frickler, i got the result back: the input device is not a TTY10:18
opendevreviewRadosław Piliszek proposed openstack/ansible-collection-kolla master: Do not create kolla_user by default  https://review.opendev.org/c/openstack/ansible-collection-kolla/+/85498510:25
yoctozeptohave you noticed that in master (Zed) we are getting a ton of ERRORs from keystone in CI? either the ansible client started requesting crap or the logging has increased beyond reasonability11:00
yoctozepto(I am also notifying cores on some old changes of mine that deserve merging ;-) )11:07
frickleryoctozepto: seems that that was a warning in yoga, now promoted to error with a nice juicy stacktrace. IMO that's a bug in keystone. I'd even question the warning classification. 11:37
yoctozeptoyeah11:40
opendevreviewLin PeiWen proposed openstack/kolla-ansible master: keystone: Remove redundant 'when'  https://review.opendev.org/c/openstack/kolla-ansible/+/85273911:41
yoctozeptootoh, the client should not try using names as UUIDs for crying out loud11:41
yoctozeptoas usual, it takes more than one bug to get things nasty11:41
fricklerare you sure that this comes from OSC? I was just about to ask where this was coming from11:42
opendevreviewLin PeiWen proposed openstack/kolla-ansible master: keystone: Remove redundant 'when'  https://review.opendev.org/c/openstack/kolla-ansible/+/85273911:42
yoctozeptofrickler: this is from kolla-toolbox and the client in ansible there11:42
yoctozeptoI mean, the requests11:42
yoctozeptothe logs are from the api of course ;p11:43
frickleryes. also doesn't seem to be restricted to kolla. 11:44
fricklerhttps://opensearch.logs.openstack.org/_dashboards/app/discover?security_tenant=global#/?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-14d,to:now))&_a=(columns:!(_source),filters:!(),index:'94869730-aea8-11ec-9e6a-83741af3fdcd',interval:auto,query:(language:kuery,query:'message:%20%22keystone.exception.ProjectNotFound%22'),sort:!())11:44
yoctozeptowhat are the credentials to it?11:45
frickleropenstack/openstack11:45
yoctozeptothankx11:45
fricklerhttps://governance.openstack.org/sigs/tact-sig.html#opensearch11:45
yoctozeptospammy as duck11:45
rockeyit is? 1.5m hits in 14 days, no biggie :))11:46
yoctozeptofor such a useless line11:54
opendevreviewRadosław Piliszek proposed openstack/kolla-ansible master: [CI] Do not use the kolla user  https://review.opendev.org/c/openstack/kolla-ansible/+/85501712:15
opendevreviewRadosław Piliszek proposed openstack/ansible-collection-kolla master: Do not create kolla_user by default  https://review.opendev.org/c/openstack/ansible-collection-kolla/+/85498512:16
rockeycan someone explain the relation between ansible kolla_toolbox module, which invokes modules inside kolla-toolbox container with arguments etc12:22
rockeyhow do i know which modules is installed within the kolla-toolbox container?12:23
opendevreviewPierre Riteau proposed openstack/kolla-ansible master: Use active_passive parameter for existing services  https://review.opendev.org/c/openstack/kolla-ansible/+/85501912:40
opendevreviewPierre Riteau proposed openstack/kolla-ansible master: Switch Prometheus Alertmanager to active/passive  https://review.opendev.org/c/openstack/kolla-ansible/+/85481612:45
hrwmorning13:23
hrwmnasiadka, yoctozepto: any of you know how to fix aarch64 node?13:23
hrw2022-08-16 16:31:33 openstack.exceptions.BadRequestException: BadRequestException: 400: Client Error for url: https://192.0.2.10:9696/v2.0/subnets, Invalid input for operation: Requested subnet with cidr: 10.0.0.0/24 for network: a7786b4c-1cd9-4fee-9cfa-a5b0eacd7090 overlaps with another subnet.13:23
hrwhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_a33/836664/54/check/kolla-ansible-centos9s-source/a33907d/primary/logs/ansible/init-runonce13:23
fricklerwhy would the use of cidrs be different only for arm?13:35
opendevreviewPierre Riteau proposed openstack/kayobe master: Remove stale configuration files in sub-directories  https://review.opendev.org/c/openstack/kayobe/+/83907713:38
yoctozeptofrickler, hrw: maybe some lib failed to do le/be properly13:52
opendevreviewMerged openstack/kayobe master: Fix IP allocation limit in overcloud inventory discover  https://review.opendev.org/c/openstack/kayobe/+/85459514:37
fricklercould it be that prometheus-efk got broken by the proxysql stack? Access denied for user 'root_shard_0'@'primary'15:16
frickleralso I guess we can drop all the c8 jobs from experimental now, too?15:17
mnasiadkalet's drop them15:21
mnasiadkaand yes, I saw that prometheus-efk is failing due to that15:21
fricklermnasiadka: are you doing a patch or should I? (for experimental, pefk we can discuss in the meeting if needed)15:27
opendevreviewPierre Riteau proposed openstack/kolla-ansible master: Switch Prometheus Alertmanager to active/passive  https://review.opendev.org/c/openstack/kolla-ansible/+/85481616:26
opendevreviewRadosław Piliszek proposed openstack/kolla-ansible master: Fix haproxy prechecks after deployment  https://review.opendev.org/c/openstack/kolla-ansible/+/85507116:45
opendevreviewRadosław Piliszek proposed openstack/kolla-ansible master: [CI] Do not use the kolla user  https://review.opendev.org/c/openstack/kolla-ansible/+/85501716:46
opendevreviewRadosław Piliszek proposed openstack/kolla-ansible master: [DNM] Test all jobs  https://review.opendev.org/c/openstack/kolla-ansible/+/85507216:49
opendevreviewRadosław Piliszek proposed openstack/kolla master: [WIP] Fix  https://review.opendev.org/c/openstack/kolla/+/72210218:14

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!