| Elnz | salam | 05:45 |
|---|---|---|
| Elnz | Please have a look at: https://paste.ubuntu.ir/xwrjp | 05:51 |
| jrosser | good morning | 09:36 |
| noonedeadpunk | mornings. I'm semi-around today | 10:36 |
| noonedeadpunk | admin1: Network is unreachable reminds me about dead lxc-dnsmasq as its outbound connection that is made | 10:39 |
| noonedeadpunk | No idea if you've already sorted this out or not though... | 10:39 |
| noonedeadpunk | so connections goes through lxcbr0 and eth0 | 10:39 |
| admin1 | noonedeadpunk, wget/curl works there fine .. just via the python it fails | 10:55 |
| noonedeadpunk | um... I have no idea how that's technically possible to be frank. If it was url certs that's untrusted - I could explain that but not network unreachable.... | 11:05 |
| noonedeadpunk | And curl works from exact repo container that task was delegated to? | 11:06 |
| noonedeadpunk | As my guess was that just one of them can't reach network.... | 11:06 |
| jrosser | admin1: can you paste the actual output when it fails? | 11:33 |
| admin1 | jrosser, https://gist.githubusercontent.com/a1git/d10b72f0305d32e4d780e20a7c42dd04/raw/902a053dc6fc185cb9d86142eab06fb5b3f41a28/gistfile1.txt | 11:46 |
| admin1 | i see the issue | 11:47 |
| admin1 | <c1_repo_container-4cfcc286> Task is delegated to localhost. .. my localhost is not resolving DNS .. | 11:47 |
| admin1 | localhost a.k.a deploy container | 11:47 |
| admin1 | it works now .. | 11:51 |
| opendevreview | Merged openstack/openstack-ansible-openstack_hosts master: Return centos jobs to voting https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/873273 | 12:03 |
| opendevreview | Merged openstack/openstack-ansible-os_nova master: Add authentication for [cinder] section of nova.conf https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/872279 | 12:22 |
| opendevreview | Merged openstack/openstack-ansible-os_nova master: Use SSL database connections with nova-manage https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/528837 | 12:22 |
| *** priteau_ is now known as priteau | 12:25 | |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_nova stable/zed: Use SSL database connections with nova-manage https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/873466 | 14:25 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_nova stable/yoga: Use SSL database connections with nova-manage https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/873467 | 14:25 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_nova stable/xena: Use SSL database connections with nova-manage https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/873468 | 14:26 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_nova stable/zed: Add authentication for [cinder] section of nova.conf https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/873469 | 14:26 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_nova stable/yoga: Add authentication for [cinder] section of nova.conf https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/873570 | 14:26 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_nova stable/xena: Add authentication for [cinder] section of nova.conf https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/873571 | 14:26 |
| jrosser | i dont see why the lxc rocky9 distro job here is not n-v https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/873287 | 14:30 |
| Elnaz | Salam | 15:10 |
| noonedeadpunk | o/ | 15:10 |
| noonedeadpunk | jrosser: it's distro job that's failing | 15:11 |
| Elnaz | Do you know why I get such error: `fatal: [infra1_horizon_container-4c31534e -> infra1_repo_container-6b72e9f1(172.17.236.47)]: FAILED! => {"changed": false, "msg": "file not found: /var/www/repo/os-releases/26.0.1/ubuntu-22.04-x86_64/requirements/horizon-26.0.1-constraints.txt"}` | 15:11 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-openstack_hosts stable/yoga: Install curl by defining binary that is provided https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/873287 | 15:11 |
| jrosser | hi Elnaz - did you fix any of the trouble you had before? | 15:12 |
| noonedeadpunk | Elnaz: I assume that wheels or venv build could fail for horizon at some prior run | 15:12 |
| Elnaz | I checked and horizon-26.0.1-constraints.txt is not there! | 15:12 |
| Elnaz | jrosser: NO, they solved by themselves! I rerun the scripts repeatedly and it finally reached to the Horizon step. | 15:13 |
| jrosser | hmm that sounds odd | 15:13 |
| jrosser | and thats not how it should be :) | 15:14 |
| Elnaz | I had issue on keyston and. I run os-keystone-install 3 or 4 times that finally succeded. | 15:15 |
| Elnaz | noonedeadpunk: Ok, I run setup-openstack again to see what would be the result | 15:16 |
| jrosser | it is probably worth double checking that you can `git clone https://opendev.org/openstack/keystone` manually to see if you get the same error, or if it completes in a "reasonable" time | 15:17 |
| jrosser | Elnaz: take a look inside the setup-openstack playbook - https://github.com/openstack/openstack-ansible/blob/master/playbooks/setup-openstack.yml | 15:19 |
| jrosser | see that it is just calling others, so you can do any of them as you need individually | 15:20 |
| noonedeadpunk | Elnaz: nah. that won't gonna help | 15:20 |
| Elnaz | jrosser: `Receiving objects: 20% (24126/120627), 5.66 MiB | 36.00 KiB/s` | 15:20 |
| noonedeadpunk | simply re-running won't recover from that state | 15:21 |
| jrosser | Elnaz: so it is very slow? | 15:21 |
| Elnaz | depending the size; I think so | 15:21 |
| jrosser | Elnaz: ultimately this will cause the pip command doing the build to fail i think if there is some network problem between you and `opendev.org` | 15:23 |
| Elnaz | You mean it's an internet issue? | 15:23 |
| jrosser | i get `Receiving objects: 100% (120627/120627), 32.09 MiB | 1.74 MiB/s, done` | 15:23 |
| jrosser | Elnaz: can you try `git clone https://github.com/openstack/keystone` instead? | 15:25 |
| Elnaz | jrosser: `Receiving objects: 100% (120627/120627), 50.66 MiB | 4.23 MiB/s, done.` | 15:27 |
| Elnaz | O_o | 15:27 |
| jrosser | hmm ok so that means its slow to opendev.org but OK to github | 15:27 |
| jrosser | fungi: ^ looks like another data point for poor connectivity to opendev.org here | 15:27 |
| Elnaz | Then I'll be looking for a proxy or something to see what would be the speed test to opendev | 15:28 |
| jrosser | if you are able to do a `mtr opendev.org` there might be some useful info there | 15:29 |
| Elnaz | Yours: (120627/120627), 32.09 MiB | 15:30 |
| Elnaz | Mine: (120627/120627), 50.66 MiB - GitHub | 15:30 |
| Elnaz | Why two different size of downlod for the same repos? | 15:30 |
| Elnaz | How cool is `mtr`! | 15:31 |
| jrosser | when it's resolved most of the names of the intermediate hops you can put the output at paste.opendev.org | 15:32 |
| fungi | happy to take a look, yep | 15:34 |
| admin1 | does using ovn only in octavia also require using vtep hacks like before ? | 15:54 |
| admin1 | sorry .. is it possible to use osa + octavia with ovn only backend | 15:54 |
| jrosser | as far as i know you can use it just like before with a vlan network | 15:57 |
| jrosser | "vtep hack" probably means bringing a vxlan neutron network to the controller? | 15:57 |
| admin1 | yeah | 15:57 |
| jrosser | that sounds hard | 15:57 |
| admin1 | ovn does its own LB , so i think those hacks are not required .. but i am not sure how to enable just that one | 15:58 |
| admin1 | without the lbaas ip address that we use to configure | 15:59 |
| jrosser | admin1: oh well thats different then - you'll perhaps be wanting this https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/868462 | 16:02 |
| noonedeadpunk | It seems it's time to switch our HA queues to quorum, as https://review.opendev.org/c/openstack/oslo.messaging/+/831058 is around since Zed | 16:03 |
| noonedeadpunk | I was kind of waiting for it, but obviously missed :( | 16:04 |
| admin1 | jrosser, yes :) | 16:11 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible-haproxy_server master: Prepare haproxy role for separated haproxy config https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/871188 | 16:28 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Replace HA policies for RabbitMQ with quorum https://review.opendev.org/c/openstack/openstack-ansible/+/873618 | 16:52 |
| *** jamesdenton_ is now known as jamesdenton | 16:56 | |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Replace HA policies for RabbitMQ with quorum https://review.opendev.org/c/openstack/openstack-ansible/+/873618 | 16:59 |
| spatel | How do i transer openstack vm from one stack to totally different stack? | 17:11 |
| spatel | transfer* | 17:11 |
| spatel | can i export VM or it has to be via snapshot ? | 17:13 |
| admin1 | spatel, image and then using image | 17:14 |
| admin1 | snapshot | 17:14 |
| spatel | image and then using image???? | 17:14 |
| admin1 | or if you have hypervisor access, cp the backing disk and the qcow2 and then import in | 17:14 |
| spatel | can you explain? | 17:15 |
| spatel | I am admin in both cloud | 17:15 |
| spatel | with root access | 17:15 |
| admin1 | rsync if you are admin in both :D | 17:15 |
| spatel | one cloud is non-ceph and second one has ceph | 17:15 |
| spatel | do i export snapshot and import that snapshot in new cloud with glance? | 17:16 |
| admin1 | yep | 17:16 |
| admin1 | and then use that as glance image to boot a new copy of it | 17:16 |
| admin1 | not sure what the vm is... make sure to setup a root pass | 17:16 |
| admin1 | so that in case networking etc does not work due to static being set, u can login as root and fix it | 17:17 |
| fungi | or boot a rescue image, or embed a small repair-style ramdisk image in the vm image's bootloader config | 17:19 |
| admin1 | anyone using latest fedora to boot up k8s using magnum | 17:28 |
| admin1 | looking for tips | 17:28 |
| noonedeadpunk | admin1: well, magnum does support only specific match of fedora to k8s, I won't expect anything latest to work with any stable magnum | 17:31 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: Add quorum support for glance https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/873632 | 17:37 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-haproxy_server master: Use let's encrypt standalone flag only for http-01 https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/873633 | 18:02 |
| jrosser | ^ ahha interesting noonedeadpunk i was never sure if anything more needed to be added for dns-01 | 18:06 |
| jrosser | the one place i do something with dns-01 and haproxy_server in tcp rather than http mode so the certs are all done on the backends | 18:07 |
| noonedeadpunk | well... I'm not sure either if we need to supprot dns-01 better, but looking quickly through it - there're quite a lot options | 18:07 |
| jrosser | i'm sure i have some ansible for it, but it kind of gets pretty specific pretty quick about what dns you've got | 18:07 |
| noonedeadpunk | we don't or can't use let's encrypt due to complience, so I wasn't really digging too much to be frank | 18:08 |
| jrosser | for example i might have some things for certbot + bind9 | 18:08 |
| noonedeadpunk | 0 | 18:08 |
| jrosser | ah right ok, but i think the patch is good anyway | 18:08 |
| jrosser | i tried (and never made work) bucket-name-as-hostname in ceph rgw which needed a wildcard - thats were we looked at dns-01 | 18:09 |
| noonedeadpunk | we're kind of allowed to use zerossl, but I find their terms of services quite cumbersome to use | 18:09 |
| noonedeadpunk | Oh, our storage folks made it work I believe... At least in POC | 18:10 |
| jrosser | interesting | 18:10 |
| noonedeadpunk | I didn't followed on that, but can ask them. They don't use osa haproxy role though for $reasons (that I don't fully understand) | 18:10 |
| noonedeadpunk | And they used zerossl iirc, but I need to double check with them | 18:11 |
| *** jgwentworth is now known as melwitt | 18:33 | |
| jrosser | damiandabrowski: have you seen that you can set `vars:` on an `include_tasks:`....... | 18:45 |
| jrosser | then there would be no need at all to have new things in the haproxy role like `haproxy_preconfigured_services` | 18:46 |
| damiandabrowski | (i need to leave in 3 min) | 18:46 |
| damiandabrowski | but i'm sure we'll need to have it | 18:47 |
| damiandabrowski | let me show you something | 18:47 |
| jrosser | you could just set `haproxy_services` on each `include_tasks` to be the vars you want for that playbook | 18:47 |
| jrosser | not sure why we have to build all that into the haproxy_server role | 18:47 |
| damiandabrowski | ah i get it, i think i created 2 separate variables just for clarity | 18:51 |
| admin1 | noonedeadpunk, do you know of the latest compatibiltiy matrix link | 18:51 |
| admin1 | the one i found is https://wiki.openstack.org/wiki/Magnum#Compatibility_Matrix | 18:52 |
| damiandabrowski | so that "preconfigured" services are configured on initial haproxy playbook execution | 18:52 |
| damiandabrowski | but tomorrow i can evaluate if we can stick only with "haproxy_services" | 18:52 |
| jrosser | ok we can look tomorrow | 18:52 |
| noonedeadpunk | admin1: I usually reffer to https://docs.openstack.org/magnum/latest/user/index.html#supported-versions | 18:53 |
| noonedeadpunk | My assumption - they didn't change anything from Yoga to Zed | 18:53 |
| damiandabrowski | please note that currently haproxy_preconfigured_services and haproxy_services are handled by 2 different files and i have not idea how they can share a single file | 18:53 |
| damiandabrowski | https://opendev.org/openstack/openstack-ansible-haproxy_server/src/commit/dec3906447655fb6c604bf07a77d4910fbfe04b6/tasks/haproxy_preconfigured_service_config.yml | 18:53 |
| damiandabrowski | https://opendev.org/openstack/openstack-ansible-haproxy_server/src/commit/dec3906447655fb6c604bf07a77d4910fbfe04b6/tasks/haproxy_service_config.yml | 18:53 |
| noonedeadpunk | oh, whaaat, gerrit SHAs are a valid thing in gitea? | 18:54 |
| noonedeadpunk | how does that work given they should be in different refs... | 18:55 |
| noonedeadpunk | Um, I'm not sure I get how they're different though.... | 18:59 |
| noonedeadpunk | Defining `haproxy_services` to a different value for each group_var is very confusing for me personally... It's defenitely not that easy to read to be frank | 19:06 |
| noonedeadpunk | I think you've discussed that already, but is there any reason why indeed haproxy_server can't be included from inside of the roles? | 19:09 |
| noonedeadpunk | As we already have things like `_cinder_is_first_api_play_host` which way better condition comparing to https://review.opendev.org/c/openstack/openstack-ansible/+/871189/7/playbooks/common-tasks/haproxy-service-config.yml#18 | 19:11 |
| noonedeadpunk | or we need/want to add service before running haproxy-endpoint-manage.yml ? | 19:13 |
| noonedeadpunk | ok, let's discuss that tomorrow during meeting :) | 19:14 |
| noonedeadpunk | I bet our operations won't be happy about changes as they're trying to avoid running haproxy role whenever possible not to accidentally trigger any changes that will lead to VIP failover :D | 19:15 |
| noonedeadpunk | (it's completely different topic for motivation part though) | 19:15 |
| noonedeadpunk | (and not sure how it's valid at all) | 19:16 |
| *** dviroel is now known as dviroel|out | 19:26 | |
| jrosser | having `vars: haproxy_services: "{{ glance_haproxy_services }}"` is clearer on some include_<whatever>: | 19:32 |
| noonedeadpunk | +1 ^ | 19:39 |
| admin1 | anyone has a workable magnum coe template ? | 20:11 |
| admin1 | for k8s | 20:11 |
| jrosser | admin1: welcome to magnum :) i can't help you with and real experience there but there is this https://docs.openstack.org/openstack-ansible-os_magnum/latest/ | 20:15 |
| jrosser | but you'd have to look at the commit history to see how old that doc is as it's not kept up to date | 20:16 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_glance master: Add quorum support for glance https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/873632 | 20:35 |
| admin1 | someone recommended me https://github.com/kubernetes-sigs/cluster-api-provider-openstack .. anyone using this one ? | 20:38 |
| admin1 | kleini_ | 21:21 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible-haproxy_server master: Prepare haproxy role for separated haproxy config https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/871188 | 22:08 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible master: Prepare service roles for separated haproxy config https://review.opendev.org/c/openstack/openstack-ansible/+/871189 | 22:54 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible-os_glance master: Add TLS support to glance backends https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/821011 | 23:01 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible-os_neutron master: Add TLS support to neutron_server backends https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/873654 | 23:02 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!