Thursday, 2023-04-27

psyminaio deployed01:14
hamburglerIs there any recommendations for setting network QOS on East West traffic before private networks are created? Or is it best to look at doing this on the flavor side?02:59
manuvakery1Hi I just deployed Openstack with neutron ml2-ovn (1 controller and 2 compute).. Playbook succeded but neutron server failed to start with following error. 04:03
manuvakery1https://www.irccloud.com/pastebin/9E8YXwXM/neutron_server_dependancy_issue04:04
manuvakery1using openstack-ansible stable/xena branch, any help would be great04:05
manuvakery1installing openvswitch-common fixed the issue05:03
jrossermanuvakery1: in openstack-ansible stable/xena, OVN would have been highly experimental07:15
jrosserit would be much much better to be using stable/zed where OVN is the default, and has lots of testing07:18
manuvakery1jrosser: ok , thanks 07:27
jrosserit’s still likely a bug really, but lots and lots of work was done on OVN in the later OSA releases07:38
manuvakery1jrosser: I will try with zed 08:07
noonedeadpunkmornings08:22
jrosserhello08:23
noonedeadpunkmanuvakery1: I think you can get OVN on Xena if really needed, but I think that upgrade to Zed won't go really well as we didn't make an upgrade path08:23
noonedeadpunkI think this is main reason why we won't recommend OVN before Z08:24
noonedeadpunkDamn, what a hassle I had yestarday.... Offset time on controllers do sooooooo much mess...08:24
noonedeadpunkand it's so not easy to spot08:25
jrosserwe completely wedged up a ceph cluster with wrong time08:26
jrosserthat was what broke first08:26
noonedeadpunkoh yes, for ceph that is super crucial....08:27
noonedeadpunkbut it was like - 1 controller marks nova/neutron/cinder agents as active on the itself, while rest are down, and others marks this one as down and all rest are up. So depending on when in time you do API reuqest to check agent status you see completely different picture08:28
manuvakery1noonedeadpunk: I was just testing it in a Vagrant env. I'll rebuild with zed08:28
jrosserregarding timekeeping, hardware is getting sooooo tiny these days - i have this for example https://www.oscilloquartz.com/en/products-and-services/ptp-grandmaster-clocks/sfp-pluggable-ptp-grandmasters/osa-5401-series08:29
noonedeadpunkand with that agents just die randomly as they go crazy about mesaging 08:29
noonedeadpunkoh yes, looks quite amazing08:31
jrosserno idea how they fit entire computer and gps receiver in an sfp08:32
noonedeadpunkand without extra power08:33
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron master: Workaround ovs bug that resets hostname with add command  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/88158208:51
noonedeadpunkone more vote is needed on https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/881582?tab=change-view-tab-header-zuul-results-summary to unblock the gates13:06
mgariepydoes it needs backport ?13:32
mgariepyhopefully they fix the uca pkg at some point..13:41
noonedeadpunknope it does not14:01
noonedeadpunkit's affecting only antelope uca at the moment14:01
mgariepyk14:02
opendevreviewMerged openstack/openstack-ansible-os_neutron master: Workaround ovs bug that resets hostname with add command  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/88158215:46
NeilHanlonwoah jrosser, that's crazy (re: SFP GNSS receiver)16:42
jrosserNeilHanlon: it's incredible isnt it..... first time i saw that sort of system-in-sfp was these https://www.embrionix.com/product/subfamily/sdi-to-ip16:57
jrosserthose are professional video interface <> IP converters in SFP form factor, so computer + pretty large FPGA16:58
jrosseryou take a regular spf+ switch, push a load of those it and it obseletes a whole class of niche broadcast hardware16:59
NeilHanlondamn. broadcast is something I've always been intrigued by17:23
NeilHanlonnothing i've done has ever required precision time, at least, not high precision17:23
jrosserone of the biggest challenges is the legacy stuff17:25
jrosserwhere everything is assumed to be synchronous and has absurdly small latency requirements and absurdly small RX packet buffers for anything IP17:26
jrosseri guess these sfp things are a by-product of the assembly miniaturisation required for smartphones17:28
qwebirc99852Hello18:02
NeilHanlonhiya qwebirc9985218:12
qwebirc99852I'm Getting this following error when  in heat role:18:19
qwebirc99852https://storyboard.openstack.org/#!/story/201057918:19
qwebirc99852I receive this exception:18:25
qwebirc99852"msg": "Must specify either a user or a group"18:25
qwebirc99852I don't know if threre are some variables that is missing on default.18:28
jrosserqwebirc99852: did you try the patch on the storyboard bug?18:45
jrosseralso, this is the irc channel for the openstack-ansible deployment tool (https://opendev.org/openstack/openstack-ansible), not so much the ansible modules18:46
qwebirc99852I'm using openstack-ansible to deploy 18:51
jrosserthis is your own playbook though?18:53
opendevreviewDamian Dąbrowski proposed openstack/openstack-ansible stable/yoga: [DNM] Do not define cluster template labels  https://review.opendev.org/c/openstack/openstack-ansible/+/88166019:04
jrosserqwebirc99852: i think you might need to give a bit more info - i don't recognise the ansible task in the storyboard bug being from openstack-ansible19:06
qwebirc99852In this role: /etc/ansible/ansible_collections/openstack/osa/roles/service_setup/tasks/setup_roles.yml19:15
opendevreviewDamian Dąbrowski proposed openstack/openstack-ansible master: Deprecate certbot-auto  https://review.opendev.org/c/openstack/openstack-ansible/+/88157919:16
qwebirc99852The  "msg" exception  happed when utility container try to run the following  file: /openstack/venvs/utility-26.1.0/lib/python3.10/site-packages/openstack/cloud/_identity.py:119219:17
qwebirc99852This is the code where i'm  getting error:19:18
jrosserthat is a different path to the one here though? https://storyboard.openstack.org/#!/story/201057919:18
jrosser /usr/local/lib/python3.9/site-packages/openstack/cloud/_identity.py19:19
qwebirc99852Yeah, this issue looks like my problem. But is different, letme write here the specific code where i'm getting error19:20
qwebirc99852I'm getting "Must specify either a user or a group" in this code https://pastebin.com/mF77eJBa19:22
jrossercan you paste the actual ansible output of the task which fails?19:24
damiandabrowskijrosser: I'd appreciate a review here if you have some time tomorrow ;) so I can continue patching other roles19:30
damiandabrowskihttps://review.opendev.org/c/openstack/openstack-ansible-repo_server/+/87642919:30
qwebirc99852Yeah, this is the output. https://pastebin.com/LnTxXWGy19:33
jrosserqwebirc99852: is this a new deployment or an upgrade?19:52
qwebirc99852New Deployment19:52
admin1its the API returning that its not seeing the parameter that you passed .. may something changed .. openstack ansible has nothing to do with it though ..  . its best to put this in the heat channel 19:53
jrosseradmin1: the error is from the ansible collection19:54
jrosserwhich is not the code of openstack-ansible, but we call the module19:54
jrosserand are responsible for making sure the right version of the collection & openstacksdk are present19:54
qwebirc99852Oh ok, understand.19:55
qwebirc99852So, thanks for your help guys19:55
jrosserqwebirc99852: this should work though, so it is of interest19:56
admin1unless some api changed in heat and it does not see the way data is passed19:56
jrosserit's not code in heat :)19:56
jrosseranyway19:57
admin1sorry .. i read the heat wrong 19:57
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-os_heat stable/zed: DNM - test heat deployment for zed  https://review.opendev.org/c/openstack/openstack-ansible-os_heat/+/88175920:03
jrosserqwebirc99852: it's kind if late here and i can't think of anything obvious, but that patch i just made ^^ will run the heat CI tests for Zed to check if they pass or something has broken20:04
opendevreviewMerged openstack/openstack-ansible-os_blazar master: Add uWSGI support to blazar  https://review.opendev.org/c/openstack/openstack-ansible-os_blazar/+/88065120:12
qwebirc99852Thanks 20:17
opendevreviewMerged openstack/openstack-ansible master: Add support for TLS backends  https://review.opendev.org/c/openstack/openstack-ansible/+/87908521:01
opendevreviewMerged openstack/openstack-ansible master: Fix dstat run in gates  https://review.opendev.org/c/openstack/openstack-ansible/+/87935521:33

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!