Tuesday, 2023-01-17

jpward[m]I am attempting to deploy octavia, all of the containers are up, i can create a load balancer, it will create, but the worker service can't communicate with the antora. The management network is the one that was created by kolla-ansible so its a vxlan network.00:07
jpward[m]I read through the docs, it mentions using a vlan for the antora network, which I can do, but is there a way to  get it to work with the vxlan network?00:08
johnsomjpward[m] Octavia doesn't care what the ML2 type is of the management network, it is a deployment tool choice for how it is implemented. I will leave your question for the kolla community that may have kolla specific feedback to your question.00:55
jpward[m]yea that is what I'm trying to find out, what is the kolla recommended method. I read the docs, which suggests using vlan, however by "default" it seems to configure the lb-mgmt-net as a vxlan network. 02:21
*** parallax is now known as Guest155605:19
mnasiadkajpward[m]: can you check if controllers can reach amphora VMs? without checking the whole path (if the vxlan interface is defined on controllers, and so on) - it's hard to tell anything06:53
mnasiadkajpward[m]: and you're using ML2/OVS? neutron_plugin_agent: "openvswitch" right? not OVN?06:53
mnasiadkafrickler: I believe the same for Kayobe06:54
*** parallax is now known as Guest156106:55
opendevreviewBartosz Bezak proposed openstack/kayobe master: CI: move ubuntu upgrade jobs to jammy  https://review.opendev.org/c/openstack/kayobe/+/87071308:14
mnasiadkafrickler: added -1 on the Kayobe patchset08:39
kevkohi \o/09:48
kevkois there any plan to split neutron-server service in kolla-ansible orchestration to neutron-server-api and neutron-server-rpc ? 09:50
kevkoi want to do it for long time ..but didn't have a time for it :)09:51
mnasiadkaAnd are you sure that works?09:53
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/zed: Fix issue with genconfig and octavia_auto_configure  https://review.opendev.org/c/openstack/kolla-ansible/+/87050910:03
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/yoga: Fix issue with genconfig and octavia_auto_configure  https://review.opendev.org/c/openstack/kolla-ansible/+/87077010:03
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/xena: Fix issue with genconfig and octavia_auto_configure  https://review.opendev.org/c/openstack/kolla-ansible/+/87077110:03
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/wallaby: Fix issue with genconfig and octavia_auto_configure  https://review.opendev.org/c/openstack/kolla-ansible/+/87077210:04
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/zed: Fix prechecks in check mode  https://review.opendev.org/c/openstack/kolla-ansible/+/87077310:04
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/yoga: Fix prechecks in check mode  https://review.opendev.org/c/openstack/kolla-ansible/+/87077410:04
kevkomnasiadka: what if i am sure ? 10:07
mnasiadkakevko: then add it to cycle priorities, maybe somebody will pick this up :)10:08
kevkomnasiadka: neutron was historically rpc and api together ...but now you can just run rpc and serve api requests via wsgi as other services 10:08
mnasiadkabut IIRC Neutron and WSGI are not behaving well, or at least were not some time ago10:09
kevkomnasiadka: it is better to scale rpc and api separately 10:09
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/yoga: Fix prechecks in check mode  https://review.opendev.org/c/openstack/kolla-ansible/+/87077410:09
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/xena: Fix prechecks in check mode  https://review.opendev.org/c/openstack/kolla-ansible/+/87077510:09
kevkomnasiadka: it didn't work well ... but it is long time ago ..10:09
mnasiadkakevko: That's only useful for ML2/OVS10:09
kevkothat's not too much ? :D 10:10
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/xena: Fix prechecks in check mode  https://review.opendev.org/c/openstack/kolla-ansible/+/87077510:10
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/wallaby: Fix prechecks in check mode  https://review.opendev.org/c/openstack/kolla-ansible/+/87077610:10
mnasiadkakevko: I mean I'm not into ML2/OVS :)10:10
kevkomnasiadka: :D 10:11
kevkomnasiadka: btw, I found a bug in kolla-ansible heat ..it's the same problem as described here https://bugzilla.redhat.com/show_bug.cgi?id=1641667#c810:12
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/wallaby: Fix prechecks in check mode  https://review.opendev.org/c/openstack/kolla-ansible/+/87077610:13
kevkomnasiadka: point is that docker will kill container after some timeout ...  so i was going through the code and found that kolla_docker has support for add graceful_time_period ... and also kolla-ansible has variable for configure it ... but not used anywhere 10:13
mnasiadkanice, raise the bug in kolla-ansible launchpad and let's start using it ;)10:14
kevkomnasiadka: https://github.com/openstack/kolla-ansible/blob/1aa1cae1596c1dafc6691354af5def3e3e6a806f/ansible/group_vars/all.yml#L148   << do you know if it was removed or what ? 10:14
mnasiadkawell, mgoddard bumped that to 60 3 years ago10:15
mnasiadkamgoddard: ring any bell?10:15
kevkomnasiadka: because I am not sure if the first idea  (referring to variable in group vars )was to change graceful period for entire docker service .. or just additional parameter when containers restarting 10:15
mnasiadkait is used10:16
mnasiadkahttps://github.com/openstack/kolla-ansible/blob/09df6fc1aa33d1581251a182b0a34a84e8373ebf/ansible/group_vars/all.yml#L16010:16
kevkohmm10:16
opendevreviewMerged openstack/kolla stable/zed: CentOS/Rocky: use CentOS Cloud SIG repo instead of Delorean  https://review.opendev.org/c/openstack/kolla/+/86971610:16
kevkomnasiadka: but i am not sure if it is working when it is in commmon_options dict 10:20
mnasiadkawell, if it isn't, then it's a bug - but I guess it would be dumb if it didn't?10:20
kevkomnasiadka: i will check it 10:23
kevkomnasiadka: when I've added graceful_timeout: 60 for heat into kolla_docker module in handlers ...it works like a charm ..so that's the reason why i think it is not working via common_options .. i will vetify it ..thanks 10:24
kevkomnasiadka: i can see this in docker service10:26
kevkomnasiadka: controller0 dockerd[900]: time="2023-01-13T03:28:34.769135707Z" level=info msg="Container failed to exit within 10s of signal 15 - using the force" container=eda98e30fd4f67233edd0d16f3710:26
kevkomnasiadka: and graceful timeperiod is 10 by default ..so that's the reason why i think it is not used ... i will check ..again ..thanks 10:27
mnasiadkanice10:28
opendevreviewMerged openstack/kayobe master: CI: move ubuntu upgrade jobs to jammy  https://review.opendev.org/c/openstack/kayobe/+/87071310:34
opendevreviewMerged openstack/kolla stable/zed: relay non-zero exit codes when creating openvswitch bridges  https://review.opendev.org/c/openstack/kolla/+/87066410:47
opendevreviewVerification of a change to openstack/kolla stable/xena failed: relay non-zero exit codes when creating openvswitch bridges  https://review.opendev.org/c/openstack/kolla/+/87066610:53
opendevreviewRodolfo Alonso proposed openstack/kolla master: Add Dockerfile for neutron-ovn-agent  https://review.opendev.org/c/openstack/kolla/+/87079311:16
opendevreviewVerification of a change to openstack/kolla-ansible master failed: CI: Avoid running tgtd if BASE_DISTRO is rocky  https://review.opendev.org/c/openstack/kolla-ansible/+/87054211:23
jpward[m]the containers cannot reach the antora vm, I am using ml2 openvswitch11:40
kevkojpward[m]: healthcheck can't reach amphora VM, right ? 11:56
opendevreviewVerification of a change to openstack/kolla-ansible master failed: Remove use_forwarded_for configuration option  https://review.opendev.org/c/openstack/kolla-ansible/+/87053411:59
kevkomnasiadka: hahaaa - it's a bug ..i'll send a patch ..two lines 12:02
opendevreviewVerification of a change to openstack/kolla-ansible master failed: Remove [trustee]/auth_uri option from heat.conf  https://review.opendev.org/c/openstack/kolla-ansible/+/87053512:17
jpward[m]kevko: I haven't tried from the healthcheck container, I did try from the worker container12:18
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Fix kolla_toolbox module  https://review.opendev.org/c/openstack/kolla-ansible/+/87079812:33
kevkojpward[m]: point is that amphora instances are in different network (tenant network, vlan - based on configuration) and octavia services running on management network ...so you need some solution how to go from management_network -> octavia network and octavia_network -> management ... L2 or L312:34
opendevreviewMerged openstack/kolla-ansible stable/zed: Add a flag to handle RabbitMQ high availability  https://review.opendev.org/c/openstack/kolla-ansible/+/87049312:36
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Fix kolla_toolbox module  https://review.opendev.org/c/openstack/kolla-ansible/+/87079812:37
opendevreviewEbbex proposed openstack/kayobe master: [DNM] ansible-role-interfaces NetworkManager test  https://review.opendev.org/c/openstack/kayobe/+/86997712:52
priteauI see lots of kolla jobs failing13:07
priteau"msg": "The conditional check '(nova_compute_services.stdout | from_json | map(attribute='Host') | list) is superset(expected_compute_service_hosts)' failed. The error was: Expecting value: line 1 column 1 (char 0)"13:07
priteauDid nova break us?13:07
priteaunova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed.13:07
priteauin nova-api logs13:07
priteauI am guessing it's https://review.opendev.org/c/openstack/nova/+/86621813:08
priteauDo we have RBAC configuration ready or should we work around it?13:10
opendevreviewMerged openstack/kolla-ansible stable/xena: Add a flag to handle RabbitMQ high availability  https://review.opendev.org/c/openstack/kolla-ansible/+/87049513:12
opendevreviewMerged openstack/kolla-ansible stable/wallaby: Add a flag to handle RabbitMQ high availability  https://review.opendev.org/c/openstack/kolla-ansible/+/87049613:12
opendevreviewMerged openstack/kolla-ansible stable/yoga: Add a flag to handle RabbitMQ high availability  https://review.opendev.org/c/openstack/kolla-ansible/+/87049413:12
kevkopriteau: I don't know ..but for know it should be enough to configure enforce_scope=False  enforce_new_defaults=False ? 13:12
priteauThat's what I meant by work around it13:13
priteauI will submit a patch13:13
opendevreviewPierre Riteau proposed openstack/kolla-ansible master: Disable new defaults and scope for Nova API policies (RBAC)  https://review.opendev.org/c/openstack/kolla-ansible/+/87080413:18
kevkopriteau: could you check  https://review.opendev.org/c/openstack/kolla-ansible/+/870798 ? 13:29
priteauI am not core and I am afraid I don't know much about this part of the code13:37
opendevreviewVerification of a change to openstack/kolla-ansible master failed: CI: improve get_logs.sh  https://review.opendev.org/c/openstack/kolla-ansible/+/87052114:17
kevkofrickler: mnasiadka : https://review.opendev.org/c/openstack/kolla-ansible/+/870798  << trivial fix ? 14:18
kevkocan anyone advice me how to run tests for kolla_docker ? 14:43
kevkois it tested btw in upstream ? 14:43
kevkoi mean ..zuul 14:43
kevkoi am getting this -> https://paste.openstack.org/show/b0tjJKZgCcgQS4hh4KAf/14:45
opendevreviewVerification of a change to openstack/kolla stable/xena failed: relay non-zero exit codes when creating openvswitch bridges  https://review.opendev.org/c/openstack/kolla/+/87066615:10
opendevreviewPierre Riteau proposed openstack/kolla-ansible master: Disable new defaults and scope for Nova API policies (RBAC)  https://review.opendev.org/c/openstack/kolla-ansible/+/87080415:14
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Fix kolla_toolbox module  https://review.opendev.org/c/openstack/kolla-ansible/+/87079815:15
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Fix kolla_toolbox module  https://review.opendev.org/c/openstack/kolla-ansible/+/87079815:17
kevkomgoddard: could you check this please ? as graceful_timeout was implemented by you some time ago ? https://review.opendev.org/c/openstack/kolla-ansible/+/870798/415:19
opendevreviewJakub Neumann proposed openstack/kolla-ansible master: Add ceilometer_backend_notifier  https://review.opendev.org/c/openstack/kolla-ansible/+/86841715:58
spatelI would like to change logo in horizon which i did manually for testing but how do i put that in kolla-ansible so it will be permanent. I found this but no work item https://blueprints.launchpad.net/kolla-ansible/+spec/horizon-branding16:35
mnasiadkaspatel: https://github.com/openstack/kolla-ansible/blob/1aa1cae1596c1dafc6691354af5def3e3e6a806f/ansible/roles/horizon/tasks/config.yml#L13116:52
spatelmnasiadka so i should be placing new logo in /horizon/theme/ folder in someway correct? 16:57
mnasiadkain node_custom_config, which by default is /etc/kolla/config16:58
mnasiadkaand then horizon/themes/<your theme>16:58
mnasiadkathe whole directory will get copied16:58
spatelmnasiadka ah! so i can download default theme from horizon and copy it into horizon/themes/ folder and put logo etc.. correct?17:00
mnasiadkaprobably yes17:00
opendevreviewVerification of a change to openstack/kolla stable/xena failed: relay non-zero exit codes when creating openvswitch bridges  https://review.opendev.org/c/openstack/kolla/+/87066617:44
opendevreviewMerged openstack/kolla-ansible master: Disable new defaults and scope for Nova API policies (RBAC)  https://review.opendev.org/c/openstack/kolla-ansible/+/87080420:48
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Add ability to configure rabbitmq  https://review.opendev.org/c/openstack/kolla-ansible/+/86543421:00
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Add ability to configure rabbitmq  https://review.opendev.org/c/openstack/kolla-ansible/+/86543421:01
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Add ability to configure rabbitmq  https://review.opendev.org/c/openstack/kolla-ansible/+/86543421:04

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!