opendevreview | Merged openstack/ansible-role-python_venv_build master: Drop empty elements from constraint/requirement files https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/873208 | 00:05 |
---|---|---|
opendevreview | Merged openstack/ansible-role-python_venv_build master: Always build wheels by default https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/872987 | 02:47 |
Mohaa | Do you install HAProxy on controllers themselves or do you have some separate nodes for HAProxy? | 05:36 |
noonedeadpunk | Mohaa: thanks for reporting back on network_hosts! | 08:01 |
noonedeadpunk | Mohaa: we install it on controllers by default but you can use separate group of hosts easily | 08:02 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server stable/zed: Allow maridbcheck socket to FreeBind https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/874732 | 08:07 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server stable/yoga: Allow maridbcheck socket to FreeBind https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/874733 | 08:07 |
noonedeadpunk | I need 1 more vote on https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/873286 and it's backport to Yoga as well to unblock gates | 08:10 |
noonedeadpunk | unblock gates for stable branches | 08:19 |
opendevreview | Jonathan Rosser proposed openstack/ansible-role-python_venv_build stable/zed: Drop empty elements from constraint/requirement files https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/874734 | 08:27 |
opendevreview | Jonathan Rosser proposed openstack/ansible-role-python_venv_build stable/yoga: Drop empty elements from constraint/requirement files https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/874735 | 08:27 |
opendevreview | Jonathan Rosser proposed openstack/ansible-role-python_venv_build stable/xena: Drop empty elements from constraint/requirement files https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/874736 | 08:28 |
jrosser | damiandabrowski: I tried to review the haproxy patches again but I am still really having a tough time with it | 09:58 |
jrosser | imho it is still far too much change in one patch - rearranging group vars, taking “service” out of the data structures and moving where the role is called all gets changed together | 10:00 |
jrosser | you should take a look at one of the “patch series” that gets merged to something like nova, many small changes in a sequence with each one easy to understand | 10:01 |
jrosser | I also think we should be able to do something better regarding handlers in the haproxy role | 10:03 |
opendevreview | Merged openstack/openstack-ansible-openstack_hosts stable/zed: Install curl by defining binary that is provided https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/873286 | 10:06 |
opendevreview | Merged openstack/openstack-ansible-openstack_hosts stable/yoga: Install curl by defining binary that is provided https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/873287 | 10:06 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/yoga: Install curl by defining binary that is provided https://review.opendev.org/c/openstack/openstack-ansible/+/873289 | 10:11 |
opendevreview | Merged openstack/openstack-ansible-os_neutron master: Fix typo in ansible_facts['pkg_mgr'] https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/874687 | 10:31 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron stable/zed: Fix typo in ansible_facts['pkg_mgr'] https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/874742 | 10:39 |
harun | hey all, I am trying to install OpenStack, but I have an issue, the utility container can not access MySQL, so the database was not able to be created in os-keystone-install. Therefore, the installation failed. The problem is likely in haproxy because galera containers work very well. | 10:39 |
harun | user variables: (https://paste.openstack.org/show/bOQ5w0vVxEeimdqQqTi4/) | 10:39 |
harun | openstack user conf: (https://paste.openstack.org/show/bnb5EohXfUUYRpj8jyC1/) | 10:39 |
harun | mysql error in utility container: (https://paste.openstack.org/show/bl6KSLEZLxgLB4Tlt177/) | 10:40 |
noonedeadpunk | harun: hey there | 10:42 |
noonedeadpunk | I think that issue you have is that haproxy don't have online backends for mariadb | 10:42 |
noonedeadpunk | That can be if haproxy trying to reach socket from IP that is not expected | 10:43 |
noonedeadpunk | harun: what do you have as an output of `echo 'show stat' | nc -U /run/haproxy.stat | grep galera`? | 10:48 |
noonedeadpunk | harun: you can also try to place that to user_variables `galera_monitoring_allowed_source: 10.13.15.0/20` and re-run galera-install.yml | 10:51 |
noonedeadpunk | I do wonder why ppl having issues with our default though.... | 10:55 |
harun | this is the output: https://paste.openstack.org/show/bB94s2w0uv9Fe0QMsmDA/ | 10:55 |
harun | i will add it and rerun | 10:56 |
noonedeadpunk | It's actually interesting from which IP your haproxy is coming to galera then | 11:01 |
harun | it worked thanks to `galera_monitoring_allowed_source: 10.13.15.0/20`. it is interesting. what is the cause of this problem? | 11:05 |
noonedeadpunk | So. By default we allow access only IPs that are set as `ansible_host` for galera containers and haproxy_hosts. So in case your SSH address != mgmt address or for some reason haproxy reach galera from some unexpected IP - access will be refused | 11:07 |
noonedeadpunk | You can some dummy debug playbook to print out result of these to see default https://opendev.org/openstack/openstack-ansible/src/branch/master/inventory/group_vars/galera_all.yml#L34-L39 | 11:08 |
harun | okey, thank you so much, should i add another config to the user variables? | 11:13 |
noonedeadpunk | It highly depends on results you want to get :D | 11:19 |
noonedeadpunk | I would tried to find out what the problem with defaults though. | 11:19 |
noonedeadpunk | But maybe we have weird defaults after all.. | 11:19 |
harun | thank you, it is going very well for now, if I have a problem, I might need your help. | 11:23 |
damiandabrowski | i have a question: nova compute/metadata api service does not work without uwsgi because it doesn't have execstarts/execreloads defined. Is it a bug? | 11:36 |
damiandabrowski | How about other services? do we guarantee that all of them can be deployed with and without uwsgi? | 11:37 |
noonedeadpunk | We have plenty of services that work only with uwsgi now. I'd say even majority of apis work only through uwsgi | 11:37 |
damiandabrowski | ahh okok, thanks | 11:37 |
noonedeadpunk | Glance and neutron are more exceptions as they just don't work through uwsgi | 11:37 |
damiandabrowski | is it our decision or some openstack limitation? | 11:38 |
admin1 | noonedeadpunk, if people have more than one IP in the same range ( br-mgmt) then this issue comes | 11:38 |
damiandabrowski | (that most services work only through uwsgi) | 11:38 |
admin1 | and people do have more than 1 ip for multiple reasons .. base(ssh-ip), internal vip, external vip -- that is 3 already | 11:38 |
noonedeadpunk | damiandabrowski: well, it was recommended not to run through native services | 11:39 |
noonedeadpunk | there were even discussions if it's worth keeping native services at all | 11:39 |
damiandabrowski | okok, thanks | 12:10 |
noonedeadpunk | damiandabrowski: btw I think we will replace uwsgi quite soon :D | 12:14 |
damiandabrowski | yeah...do you have this topic in schedule for today's TC meeting? :D | 12:17 |
noonedeadpunk | I don't think we do but I'm quite sure it will be raised | 12:26 |
spatel | jamesdenton i saw you are in speaker list for coming summit. Bravo!! | 14:28 |
jamesdenton | thanks! | 14:28 |
spatel | I am pushing my company to send me there :) if i get budget then see you there | 14:28 |
jamesdenton | hey, join the club :D | 14:30 |
spatel | Hope!!! i wish next summit happen in USA | 14:30 |
spatel | is DPU for pure storage stuff or overall packet performance using L2/L3 offloading on HW? | 14:32 |
jamesdenton | Well, i think those are two popular use cases | 14:33 |
spatel | Got it pretty much offloading all packet processing off the kernel. | 14:33 |
jamesdenton | but the goal of my presentation was to focus on the use of a DPU w/ ironic - namely, the ability to abstract it away and offer the baremetal node to participate on geneve/vxlan networks and implement security | 14:34 |
noonedeadpunk | oh, you're using DPUs.. Fancy stuff | 14:34 |
jamesdenton | well, let's agree on the term "using" :D | 14:35 |
spatel | Oh wait.. why geneve/vxlan in picture when we are talking about baremetal? | 14:35 |
noonedeadpunk | hehe | 14:35 |
spatel | noonedeadpunk are you coming? | 14:35 |
noonedeadpunk | summit? yeah | 14:35 |
spatel | yes | 14:35 |
noonedeadpunk | at least I do have ticket and costs approved | 14:36 |
spatel | wow! good | 14:36 |
jamesdenton | spatel the ability for the DPU to manage the virtual networking via OVS/OVN and just give the node a "virtual" interface - but the DPU manages flows and interfaces with neutron | 14:36 |
noonedeadpunk | I don't have visa yet though | 14:36 |
jamesdenton | this is/was based on previous work by Mellanox, but my sails may have been deflated recently and i need to dig deeper | 14:36 |
spatel | You will get it without issue.. don't worry :) | 14:36 |
spatel | jamesdenton are you going to show us some demo? | 14:37 |
jamesdenton | hopefully | 14:37 |
*** lowercase_ is now known as lowercase | 14:37 | |
spatel | assuming you are using ConnectX®-6 Dx hw | 14:37 |
jamesdenton | right now i'm dealing with this: https://bugs.launchpad.net/neutron/+bug/2007167 | 14:38 |
jamesdenton | This would be BlueField-2 | 14:38 |
spatel | jamesdenton I am new for ironic but as far as i know OVN use flow based DHCP correct? it doesn't have real dhcp server. | 14:43 |
spatel | But ironic pxe required DHCP packet to kickstart and doesn't work with OVN flow based DHCP | 14:43 |
jamesdenton | yes, that's true. and i think DHCP is OK but the NICs I've used so far don't see to like the tftp server string being handed out | 14:44 |
jamesdenton | secondly, the DHCP replies coming from OVN aren't sourced from the IP I would expect them to source from, which is causing ARP conflicts or no arp at all | 14:44 |
lowercase | whats the tftp string? i can validate it against our own config | 14:44 |
jamesdenton | Well, if i compare OVN DHCP to DNSMASQ DHCP, the latter ends with a null character: ^@ | 14:45 |
jamesdenton | for instance, "10.20.0.22" vs "10.20.0.22^@". The latter works. But, it may be NIC dependent. I am testing Mellanox NIC now | 14:46 |
lowercase | mellanox nic's support ipxe nativly. you could try using that instead | 14:46 |
lowercase | instead of offering via tftp, you could offer via http | 14:46 |
jamesdenton | i think we're using tftp to bootstrap ipxe | 14:46 |
lowercase | ah, the ole, pxe to ipxe. we do that with some older nics | 14:47 |
admin1 | jamesdenton, any books this year ? | 14:59 |
jamesdenton | i'm lucky if i can read a book these days | 15:00 |
admin1 | :) | 15:00 |
noonedeadpunk | You're lucky indeed - haven't time for any good reading in last coule of years for sure... | 15:55 |
admin1 | i subscribed to packtpub .. so i do read but only enough for me to get the task done | 16:11 |
admin1 | too many stuffs | 16:11 |
admin1 | any k8s experts among us ? i am not finding good docs on how to use the octavia lb on k8s created by magnum .. magnum works fine, k8s is deployed .. all looks good ..except when it comes to the ingress part | 16:13 |
admin1 | also wanted to try osa + trove | 16:13 |
noonedeadpunk | Magnum should work just out of the box with octavia... | 16:17 |
noonedeadpunk | As basically it leverages heat to create LB | 16:17 |
noonedeadpunk | or well, maybe I'm talking about having multiple masters that uses octavia | 16:18 |
admin1 | k8s is deployed just fine by magnum and it also deployes 2 LB using octavia for its api and etcd enpoint .. the issue is when i want to use the ingress directly | 16:37 |
admin1 | it starts to create, but just get stuck without anything in the logs | 16:37 |
noonedeadpunk | ah, no idea about that, sorry | 16:46 |
spatel | admin1 i did that in past, i believe you have to create deployment.yml which use octavia LB for you application | 17:14 |
admin1 | spatel, got docs/notes for it anywhere ? | 19:24 |
spatel | I did for POC but didn't make any notes.. i will see if any notes.. | 19:25 |
opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible-haproxy_server master: Prepare haproxy role for separated haproxy config https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/871188 | 21:00 |
opendevreview | Merged openstack/openstack-ansible stable/zed: Install curl by defining binary that is provided https://review.opendev.org/c/openstack/openstack-ansible/+/873288 | 21:04 |
opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible master: Define some temporary vars for haproxy https://review.opendev.org/c/openstack/openstack-ansible/+/872328 | 21:06 |
opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible master: Prepare service roles for separated haproxy config https://review.opendev.org/c/openstack/openstack-ansible/+/871189 | 21:06 |
opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible master: Prepare service roles for separated haproxy config https://review.opendev.org/c/openstack/openstack-ansible/+/871189 | 21:07 |
opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible-os_nova master: Add TLS support to nova API backends https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/874810 | 21:17 |
opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible-os_neutron master: Add TLS support to neutron_server backends https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/873654 | 21:22 |
opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible-os_glance master: Add TLS support to glance backends https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/821011 | 21:24 |
opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible master: Do not use openstack.osa.linear strategy plugin https://review.opendev.org/c/openstack/openstack-ansible/+/874482 | 21:39 |
opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible-plugins master: Do not use openstack.osa.linear strategy plugin https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/874425 | 21:43 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!