| opendevreview | wu.chunyang proposed openstack/kolla master: Bump prometheus services to latest version https://review.opendev.org/c/openstack/kolla/+/854347 | 02:59 |
|---|---|---|
| *** mat_fechner is now known as matfechner | 04:39 | |
| opendevreview | wu.chunyang proposed openstack/kolla master: Bump prometheus services to latest version https://review.opendev.org/c/openstack/kolla/+/854347 | 05:51 |
| opendevreview | Mathias Fechner proposed openstack/kolla master: prometheus: Add OVN exporter https://review.opendev.org/c/openstack/kolla/+/762986 | 06:26 |
| opendevreview | Mathias Fechner proposed openstack/kolla master: prometheus: Add OVN exporter https://review.opendev.org/c/openstack/kolla/+/762986 | 06:28 |
| opendevreview | Mathias Fechner proposed openstack/kolla master: prometheus: Add OVN exporter https://review.opendev.org/c/openstack/kolla/+/762986 | 07:44 |
| opendevreview | Mathias Fechner proposed openstack/kolla master: prometheus: Add OVN exporter https://review.opendev.org/c/openstack/kolla/+/762986 | 07:49 |
| opendevreview | Martin Hiner proposed openstack/kolla-ansible master: Add systemd container control https://review.opendev.org/c/openstack/kolla-ansible/+/816724 | 08:29 |
| opendevreview | Martin Hiner proposed openstack/kolla-ansible master: Add systemd container control https://review.opendev.org/c/openstack/kolla-ansible/+/816724 | 08:31 |
| frickler | seems something broke CI again https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_aeb/762986/16/check/kolla-ansible-debian-source/aebbd37/primary/logs/kolla/keystone/keystone.txt | 08:42 |
| wuchunyang | I hit this error too. | 08:53 |
| frickler | likely the new oslo.cache release is broken/missing reqs | 08:54 |
| yoctozepto | duh | 08:57 |
| wuchunyang | maybe it caused by this ps https://review.opendev.org/c/openstack/requirements/+/854381/1/upper-constraints.txt ? | 08:59 |
| yoctozepto | yeah, but I wonder why nothing else caught this issue | 09:00 |
| frickler | because oslo.cache has that module in test-reqs. I've started a set of keystone jobs to crosscheck | 09:05 |
| yoctozepto | frickler: argh, and devstack installs test-reqs? or avoids memcache? (not remembering) | 09:06 |
| frickler | no idea, maybe devstack is broken now, too | 09:07 |
| wuchunyang | refer to this doc: https://docs.openstack.org/keystone/latest/admin/configuration.html#caching-layer Do we need 'python-binary-memcached' lib? | 09:08 |
| yoctozepto | frickler: well, the jobs passed on reqs repo | 09:08 |
| frickler | that only runs very limited testing | 09:09 |
| yoctozepto | wuchunyang: yeah, but it should have been installed | 09:09 |
| frickler | and we shouldn't be broken without changing anything | 09:09 |
| yoctozepto | frickler: tempest-full-py3 is limited? ;p | 09:09 |
| wuchunyang | yoctozepto: in my deployment, keystone just installed python-memcached but not python-binary-memcached. not sure their differents. | 09:15 |
| yoctozepto | wuchunyang: well, the second one provides bmemcached which seems to be required now | 09:18 |
| wuchunyang | yes, should we try to add this packages to keystone base image or openstack-base? | 09:24 |
| wuchunyang | python-memcached is installed in openstack-base. | 09:24 |
| opendevreview | Mark Goddard proposed openstack/kayobe master: Fix IP allocation limit in overcloud inventory discover https://review.opendev.org/c/openstack/kayobe/+/854595 | 09:25 |
| yoctozepto | wuchunyang: yes, please propose, it makes sense to preinstall anyways despite it's not our bug | 09:27 |
| wuchunyang | ok, I try it in my dev deployment first. | 09:29 |
| wuchunyang | yoctozepto: it looks passed in my test. should I submit a new patch ? or append to my prometheus patch ? | 09:34 |
| yoctozepto | wuchunyang: new patch pretty please | 09:35 |
| yoctozepto | thanks in advance | 09:36 |
| wuchunyang | No problem. | 09:36 |
| opendevreview | wu.chunyang proposed openstack/kolla master: Add python-binary-memcached to openstack-base https://review.opendev.org/c/openstack/kolla/+/854597 | 09:41 |
| opendevreview | Mathias Fechner proposed openstack/kolla master: prometheus: Add OVN exporter https://review.opendev.org/c/openstack/kolla/+/762986 | 09:42 |
| wuchunyang | yoctozepto: hi, i have a question. Is the vm we created in CI able to access public network ? | 09:44 |
| yoctozepto | wuchunyang: if you mean if it's able to access the Internet, I think the answer is no because I don't remember setting up the required NAT towards the Internet | 09:45 |
| yoctozepto | if you mean the public network in CI's OpenStack instance, then yes, it is | 09:46 |
| wuchunyang | I mean is Internet . ok, i see , thanks. | 09:46 |
| yoctozepto | :-) | 09:47 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible master: [docs] Fix OVS link https://review.opendev.org/c/openstack/kolla-ansible/+/854600 | 09:52 |
| opendevreview | Radosław Piliszek proposed openstack/kolla master: [docs] Fix OVS link https://review.opendev.org/c/openstack/kolla/+/854601 | 09:55 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Support authentication in Bifrost https://review.opendev.org/c/openstack/kayobe/+/851839 | 09:56 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible master: [docs] Align IPA images urls https://review.opendev.org/c/openstack/kolla-ansible/+/854604 | 10:12 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible master: [docs] Update IPA images urls https://review.opendev.org/c/openstack/kolla-ansible/+/854605 | 10:13 |
| yoctozepto | nice docs fixes for ironic ^^^ merging welcome | 10:39 |
| hrw | ok, let me check rmq limit patch | 10:42 |
| yoctozepto | hrw: kolla gate unblocker: https://review.opendev.org/c/openstack/kolla/+/854597 | 11:03 |
| yoctozepto | (kolla ansible will get fixed tomorrow with the new image set) | 11:03 |
| hrw | I just added same locally ;D | 11:03 |
| yoctozepto | ;D | 11:04 |
| hrw | redeploying again | 11:07 |
| hrw | (rabbitmq)[root@kolla-cs9 /]# rabbitmq-diagnostics memory_breakdown | 11:10 |
| hrw | Reporting memory breakdown on node rabbit@kolla-cs9... | 11:10 |
| hrw | reserved_unallocated: 0.0904 gb (65.55%) | 11:10 |
| hrw | code: 0.0348 gb (25.2%) | 11:10 |
| hrw | other_proc: 0.0182 gb (13.2%) | 11:10 |
| hrw | other_system: 0.0145 gb (10.49%) | 11:10 |
| hrw | no more 1.6GB | 11:11 |
| opendevreview | Marcin Juszkiewicz proposed openstack/kolla master: rabbitmq: limit amount of ports/file descriptors https://review.opendev.org/c/openstack/kolla/+/854610 | 11:13 |
| hrw | (kolla) 13:23marcin@puchatek:kolla-ansible$ ./tools/init-runonce | 11:24 |
| hrw | /etc/openstack/clouds.yaml is missing. | 11:24 |
| hrw | hm. | 11:24 |
| hrw | it should honour --config-dir | 11:26 |
| hrw | it should honour --configdir | 11:26 |
| hrw | as now it depends on me having passwordless sudo or split of testing scripts ;( | 11:28 |
| hrw | yoctozepto: thanks for link in rmq patch | 11:42 |
| opendevreview | Merged openstack/kolla master: Add python-binary-memcached to openstack-base https://review.opendev.org/c/openstack/kolla/+/854597 | 12:24 |
| frickler | I don't understand ^^ where do we configure the dogpile.cache.bmemcached backend? IMO it is a bug in either keystone or oslo.cache to have that dependency and not declare it. We can have that patch as quick workaround, but not permanently. Also if it is really only needed for keystone, why does it need to be in every container? | 12:33 |
| mnasiadka | hrw: now we can change nofiles ulimit to ERL_MAX_PORTS env var - I didn't know there is an env var for this ;-) | 12:37 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Add basic CentOS Stream 9 / Rocky Linux 9 support https://review.opendev.org/c/openstack/kolla-ansible/+/839715 | 12:53 |
| hrw | mnasiadka: if your version works then I do see a need to duplicate | 13:15 |
| hrw | s/do/do not/ | 13:16 |
| mnasiadka | yup | 13:20 |
| mnasiadka | yoctozepto, mgoddard: any idea why this galera cluster doesn't get synced https://2550a0f555886af4d8e1-ed261b666f7c7396241487a0ff71a89a.ssl.cf1.rackcdn.com/839715/34/check/kolla-ansible-rocky9-source-mariadb/e0bcb89/primary/logs/kolla/mariadb/mariadb.txt ? | 13:21 |
| mnasiadka | (rocky9) | 13:21 |
| opendevreview | Mathias Fechner proposed openstack/kolla master: prometheus: Add OVN exporter https://review.opendev.org/c/openstack/kolla/+/762986 | 13:26 |
| yoctozepto | mnasiadka: hmm, it never reached more than one synced node ->members = 1/3 (joined/total), | 13:29 |
| yoctozepto | no quick ideas | 13:29 |
| yoctozepto | frickler: well, it's for keystonemiddleware so it's relevant for all containers; it's good to use in the end (for SASL) so I don't mind including this by ourselves regardless of upstream | 13:29 |
| priteau | frickler: I noticed that Kayobe CI started breaking due to bmemcached, but only when using Zed+Ubuntu. Not sure why it doesn't affect CentOS. | 13:34 |
| priteau | OK, I see this was merged just recently: https://review.opendev.org/c/openstack/oslo.cache/+/742060 | 13:39 |
| priteau | And released yesterday | 13:40 |
| priteau | https://pypi.org/project/oslo.cache/3.1.0/ | 13:40 |
| priteau | But a previous version dropped support for py3.6, so I guess why it isn't used by centos images | 13:41 |
| priteau | I am thinking we should be installing oslo.cache[dogpile] in base (I've submitted a patch to add bmemcached to oslo.cache), rather than specific memcached libraries. | 14:00 |
| opendevreview | wu.chunyang proposed openstack/kolla master: Bump prometheus services to latest version https://review.opendev.org/c/openstack/kolla/+/854347 | 14:12 |
| spatel | Folks, i am trying to deploy registry but somehow its not listening on port 4000 - https://docs.openstack.org/kolla-ansible/latest/user/multinode.html | 14:41 |
| spatel | I get on to container and did netstat but nothing listening | 14:41 |
| spatel | did i missing anything? | 14:41 |
| spatel | oh wait i can see 5000 is listening now but not map with 4000 using docker link | 14:43 |
| wuchunyang | spatel: hi, how did you run docker registry ? | 15:07 |
| spatel | I used this command - https://docs.openstack.org/kolla-ansible/latest/user/multinode.html | 15:08 |
| spatel | I meant - https://paste.opendev.org/show/bDTUBzqulfrrL4DEFYOe/ | 15:08 |
| wuchunyang | kolla-ansible disabled docker bridge network mode by default, but that command using bridge mode, you should run docker registry with host net. | 15:11 |
| wuchunyang | try this command, docker run -d --network host e REGISTRY_HTTP_ADDR=0.0.0.0:4000 --restart=always --name registry registry:2 | 15:12 |
| spatel | Trying.. that | 15:12 |
| wuchunyang | sorry. docker run -d --name registry --network host --restart=always -v registry:/var/lib/registry -e REGISTRY_HTTP_ADDR=0.0.0.0:4000 registry:2 | 15:12 |
| spatel | k | 15:13 |
| spatel | that works | 15:14 |
| spatel | tcp6 0 0 :::4000 :::* LISTEN 2041616/registry | 15:14 |
| spatel | shouldn't we change that in Doc so people don't get confused? | 15:14 |
| spatel | now should i following this dock to build images using source? - https://docs.openstack.org/kolla/latest/admin/image-building.html | 15:15 |
| wuchunya_ | spatel: yes i will fix the doc soon , thanks. | 15:18 |
| spatel | +1 | 15:19 |
| opendevreview | wu.chunyang proposed openstack/kolla-ansible master: [doc] Run docker registry with host network https://review.opendev.org/c/openstack/kolla-ansible/+/854637 | 15:19 |
| spatel | wuchunya_ it would be great if you put reference link in registry section so people can directly go from here to building kolla images | 15:20 |
| wuchunya_ | sorry, i don't understand, where is the the 'registry section'? | 15:22 |
| spatel | In same page where doc saying deploy registry service for container, how about if we out small reference link to saying click here to build kolla images to push to registry - https://docs.openstack.org/kolla/latest/admin/image-building.html | 15:24 |
| spatel | s/out/put | 15:25 |
| wuchunya_ | good idea, i will do it tomorrow. good night. | 15:27 |
| yoctozepto | good night, wuchunya_ | 15:28 |
| spatel | Any idea what is this error about for precheck ? - https://paste.opendev.org/show/b5l433di9rcaqScnGAXj/ | 18:33 |
| spatel | This is yoga release i am trying to install | 18:33 |
| spatel | yoctozepto ^ | 18:39 |
| spatel | nevermind.. i found my issue | 19:55 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!