Wednesday, 2021-11-10

noonedeadpunkvotes on ussuri bump would be appreciated https://review.opendev.org/c/openstack/openstack-ansible/+/81558908:16
*** akahat|rover is now known as akahat|lunch08:44
jrosser_i don't know how we are supposed to handle the comment left on here https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/81721908:53
jrosser_using the zuul template makes it pretty hard to drop jobs08:53
*** akahat|lunch is now known as akahat|rover09:13
noonedeadpunkI don't think we really need to in this specific case09:16
noonedeadpunkbut I think we left some nv tempestconf job somehwere...09:18
noonedeadpunkwhich is worth fixing indeed09:18
opendevreviewlikui proposed openstack/openstack-ansible-os_placement master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/c/openstack/openstack-ansible-os_placement/+/81736809:20
opendevreviewlikui proposed openstack/openstack-ansible-os_cloudkitty master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/81736909:24
opendevreviewlikui proposed openstack/openstack-ansible-os_heat master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/c/openstack/openstack-ansible-os_heat/+/81737009:26
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-tests master: Bump ansible and collection versions  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/81268409:54
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump ansible and collection versions  https://review.opendev.org/c/openstack/openstack-ansible/+/81737509:57
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server master: Update rabbitmq version  https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/81738010:06
*** melwitt is now known as Guest550810:12
jonherhey, i have a wallaby test deployment that's been deployed since about the time it was released. it looks like my gnocchi is not happy though https://paste.openstack.org/show/810902/   it keeps on crashing on controller002 and controller003 where is seems to have what i'm guessing datafiles (gnocchii0000xxxx etc..) while controller001 only has 2 config files10:20
jonheri checked the commits on os_gnocchi but couldn't see anything newish that relates to this, is this a known issue of some sorts?10:21
noonedeadpunktbh I haven't used gnocchi on Wallaby. And where I do use it - it's integrated with ceph wither by s3 or directly with rbd10:22
noonedeadpunkand yeah - we didn't do any changes lately, but we use gnocchi 4.4 version for quite a while 10:22
noonedeadpunkSo in my deployments I don't have /var/lib/gnocchi/tmp at all (10:23
noonedeadpunkeventually I wanted to check gnocchi for quite a while now because I saw other weird things going on in the role when integrated with ceph as well, but never had time for that10:25
noonedeadpunkjonher: oh https://bugs.launchpad.net/openstack-ansible/+bug/191561810:26
noonedeadpunkjonher: so probably worth trying to comment out this condition https://opendev.org/openstack/openstack-ansible-os_gnocchi/src/branch/master/tasks/main.yml#L15810:28
noonedeadpunkbut ideally I guess would be to check if storage backend is file and apply this condition only when it's not10:28
noonedeadpunkwould be great if you could try to test this out actually10:29
jonheri can try that on my current deployment, i would probably want to go the ceph route myself later10:29
noonedeadpunkfor ceph there should be another change made. I believe that we don't need this https://opendev.org/openstack/openstack-ansible-os_gnocchi/src/branch/master/vars/main.yml#L29-L3010:31
noonedeadpunksince when you add ceph_alternative, setup.cfg of gnocchi tries to install python-librados, which is not available on pip 10:31
noonedeadpunkand we anyway workaround this with symlinking ceph libraries inside venv10:31
noonedeadpunkbut again - would be great to test this)10:32
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Update mariadb to 10.6.5  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/81738410:34
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: [DNM] Check out galera 10.6.5  https://review.opendev.org/c/openstack/openstack-ansible/+/81738510:35
noonedeadpunkwould be great to merge https://review.opendev.org/c/openstack/openstack-ansible-tests/+/812684 as well as it will unblock left functional tests10:56
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone master: Drop Nginx webserver support  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/81739011:54
admin1hi all . .haproxy_ssl_self_signed_regen: false   and haproxy_user_ssl_cert and _key is set .. but  the playbook still wants to generate the cert .. has something changed/updated in the new version ? 13:17
admin1hmm.. it worked again in the 2nd try 13:20
admin1¯\_(ツ)_/¯13:20
mgariepymorning everyone 13:21
damiandabrowski[m]hey!13:25
noonedeadpunkadmin1: I believe we didn't change there anything. but regen is broken in terms that even if you set to to true, it won't really regen13:28
mgariepyif you need some patch that need some attention please let me know.13:30
noonedeadpunkHm, I wonder why patches does not go to gates...13:31
mgariepythat is indeed weird.13:39
noonedeadpunkfeels like zuul has hang now...13:39
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server master: Update rabbitmq version  https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/81738013:43
mgariepynoonedeadpunk, did you poke infra about zuul ?14:19
jonheryes, #opendev14:26
mgariepychannel changes i will probably never get used to that lol.14:26
jonhernoonedeadpunk: removing https://opendev.org/openstack/openstack-ansible-os_gnocchi/src/branch/master/tasks/main.yml#L158 did indeed put the gnocchi-config and gnocchi-storage-config on all nodes as expected, making them start and run14:45
opendevreviewJames Gibson proposed openstack/openstack-ansible-os_nova master: Enable TLS for VNC from novncproxy to compute hosts  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/81722214:51
jonherso if i understand you correctly, in the scenario of  gnocchi_storage_driver: 'file'  it should run the db sync on all nodes, but in a scenario where it's not 'file' you'd want to run it only on "_gnocchi_is_first_play_host" because it would bootsrap on the common area?14:53
noonedeadpunkjonher: if I understood kolla bug correctly then yes it might be the case15:03
noonedeadpunkbecause for ceph I didn't need to run more then once15:04
noonedeadpunkso some ternary could fit there15:04
spatelnoonedeadpunk jrosser_ https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/81482515:09
spateli agreed we can improve code for more variables but i think lets go with this at present and in future we will add more methods to do bonding15:09
spatelproblem is i don't have lab with multiple nic card where i can test and certify code 15:10
spatelThis patch will keep things moving at present if someone looking to bond dpdk 15:10
spatelin January i am building new cloud in Singapore during that time i will have lots of new hardware to test out more feature of DPDK 15:11
noonedeadpunkspatel: just realized it missing at least a release note :)15:12
spateloh! can you point me to doc about how to do release notes.. its been a while i did that :)15:13
noonedeadpunkhttps://docs.openstack.org/reno/latest/user/usage.html15:14
noonedeadpunkbtw I can hardly get how several interfaces could be made here...15:14
noonedeadpunkwell, with extra variable probably...15:14
jrosser_spatel: the trouble is that you introduce new variables in defaults/main.yml, so this becomes the 'interface' to the os_neutron role15:16
jrosser_it's probably more that the definition of the bonds needs to be supplied as a list, or something, rather than just one15:16
jrosser_jamesdenton: ^15:16
noonedeadpunkI wonder how to loop over it then15:17
noonedeadpunkmaybe like with_subelements...15:17
noonedeadpunknah, it won't work.. 15:17
noonedeadpunkthe only way I see this working to make dynamic inlcude 15:18
jrosser_like i don't really understand straight away what this already loops over https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/814825/2/tasks/providers/setup_ovs_dpdk.yml15:18
spateljrosser_ this is what i did, took this list which defined by operator and just tell this code to bond them - https://paste.opendev.org/show/810911/15:19
noonedeadpunkit loops over mapping defined in provider_networks15:19
noonedeadpunkie https://opendev.org/openstack/openstack-ansible-os_neutron/src/branch/master/defaults/main.yml#L37715:19
spateli agreed if we have more provider network then this code may fail.. that part i didn't check yet15:20
spatelThis is extracting provider network bridge - bridge: "{{ bridge_mapping.split(':')[1] }}"15:21
noonedeadpunkspatel: I believe there should be some variable defined like that https://paste.opendev.org/show/810912/15:21
noonedeadpunkor https://paste.opendev.org/show/810914/15:22
noonedeadpunkand `bridge` I believe should be another key?15:23
spatelhmm now my brain stopped work.. 15:25
spatelnoonedeadpunk why do you want to define - ports: "{{ ovs_dpdk_pci_addresses }}"15:25
noonedeadpunkI mean - this way you can define mutiple aggregates?15:28
spatellet me understand, we are trying to make this code more flexible so if someone has multiple provider it should work in that scenario right?  example. i have 4 port nic -  A, B - bond0  and C,D - bond1   and bond0 is provider-0 and bond1 is provide-1  15:28
noonedeadpunkSo you would need to define just structure. and if you iterate over ovs_dpdk_lacp_bond - each element would have all data to create an aggregate15:29
noonedeadpunkspatel: yes, correct15:29
spatelnoonedeadpunk i am following you.. 15:29
jrosser_you can test this by just defining one key in the dict or one list element15:30
jrosser_if you only have one bond15:30
noonedeadpunkI dunno what's better list or dict - not sure it really matters as well15:31
noonedeadpunkI'm not sure yet how to process mapping in automated way though - you might need to define these as keys explicitly...15:31
spateli believe automated way will make thing complicate.. i would prefer define keys and lets this code suck them in.. 15:36
spatelDPDK is not common for all deployment so i don't think anyone care about more automation 15:36
noonedeadpunkI agree here15:36
noonedeadpunkI think jsut defining keys is best option here15:36
spatelI am having hard time to deploy.. :( look like i should start looking at XDP 15:37
* noonedeadpunk no idea what that is15:37
spatelhttps://docs.openvswitch.org/en/latest/intro/install/afxdp/15:38
spatelXDP is alternative way of DPDK.  (XDP doesn't need any fancy config like hugepage, CPU isolation etc.. which DPDK required)15:39
spateli believe soon XDP will replace DPDK 15:40
noonedeadpunkwell concept looks better then dpdk tbh15:40
spatelit provide comparable performance to DPDK 15:40
noonedeadpunknot sure about real performance though...15:40
noonedeadpunkwell then it's promising15:40
spatelit does provide equal performance and beauty is it does support all kernel feature like container networking, namespace etc.. 15:42
spatelDPDK doesn't support namespace that is why you can't gain performance if you deploy vRouter in namespace :(15:43
spatelhttps://www.youtube.com/watch?v=1oAsRzrwAAw&ab_channel=OpenInfrastructureFoundation15:44
*** akahat|rover is now known as akahat|lunch16:03
*** akahat|lunch is now known as akahat|dinner16:03
spateljrosser_ planning to add this snippet in default/main.yml  - https://paste.opendev.org/show/810916/ 16:06
jrosser_awesone, thats now extensible16:07
spatelThis way we can have two bond with different config if someone looking to do this way.. 16:07
spatellet me commit this change16:09
mgariepywow.. how long does zuul didn't check the +w patches ?16:20
mgariepyhttps://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/81531716:22
mgariepythis one didn't merge for some reason since nov. 2nd.16:23
noonedeadpunkI guess there might be somehow restarted then...16:23
noonedeadpunkbut yeah we need to take action on tons of stuff...16:24
mgariepydo you have a dashboard with patches that are not merged ?16:24
mgariepybut that should be ?16:24
noonedeadpunknah I think I didn't create that (ie patches that have +w and not merged yet)16:25
opendevreviewJonathan Herlin proposed openstack/openstack-ansible-os_gnocchi master: Fix gnocchi multi-node when storage_driver is file  https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/81745716:46
*** akahat|dinner is now known as akahat|rover16:52
opendevreviewSatish Patel proposed openstack/openstack-ansible-os_neutron master: Add support of dpdk bonding  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/81482516:56
opendevreviewSatish Patel proposed openstack/openstack-ansible-os_neutron master: Add support of dpdk bonding  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/81482517:01
opendevreviewMerged openstack/openstack-ansible-tests master: Bump ansible and collection versions  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/81268417:03
spateljamesdenton take a look at this patch when you have time - https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/81482517:05
jamesdentonhi spatel - i will, thank you17:05
jamesdentoni recall talking about this a couple of weeks ago17:05
opendevreviewSatish Patel proposed openstack/openstack-ansible-os_neutron master: Add support of dpdk bonding  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/81482517:05
jamesdentonthe problem with using ovs_dpdk_pci_addresses for the bond members, is that ovs_dpdk_pci_addresses is a list of all qualified dpdk interfaces. you may only want a subset of those for a given bond17:06
jamesdentoni also don't think i'd worry about a var to enable bond support, just build the bond if the list > 017:09
jamesdentonand to further simplify it, it may be better to have the bonding setup as an extension to the existing provider network logic; that already has a mechanism for plugging a network_interface in to the bridge. There can be something there like.. bond_interface: [eno1, eno2] or something17:15
opendevreviewSatish Patel proposed openstack/openstack-ansible-os_neutron master: Add support of dpdk bonding  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/81482517:15
spateljamesdenton hmm this is good point related ovs_dpdk_pci_addresses for the bond members.. 17:18
jamesdentonhttps://github.com/openstack/openstack-ansible-os_neutron/blob/ea9dae41ad61195ae25f7673d016bcf2486204c8/tasks/providers/ovs_config.yml#L3517:20
opendevreviewOpenStack Proposal Bot proposed openstack/openstack-ansible-os_murano master: Updated from OpenStack Ansible Tests  https://review.opendev.org/c/openstack/openstack-ansible-os_murano/+/74585617:20
jamesdentonthat mechanisn uses the provider library to say "br-provider: eno1" or "br-provider:bond1" - it uses a pre-existing interface17:20
jamesdentonbut you could extend that to be a "bond name: members" and keep it all within the provider network definition17:21
jamesdentonhttps://github.com/openstack/openstack-ansible-os_neutron/blob/ea9dae41ad61195ae25f7673d016bcf2486204c8/library/provider_networks17:21
jamesdentonhttps://github.com/openstack/openstack-ansible-os_neutron/blob/master/library/provider_networks17:21
spatelreason i am planning to use static list so we have less complexity in code and let operator decide what they want to do.. 17:25
jamesdentonwell in this case you still would be allowing the operator to define it, but all in one place17:26
spatelcould you please make comments in patch so make it easy to understand 17:27
jamesdentonfor example, defining provider networks is required, but defining network_interface is not. when it's there, the playbooks add the interface to the corresponding ovs bridge. you could say 'dpdk_bond_members' is a list of members, and when defined will create the dpdk bond on a "per provider network" basis17:27
jamesdentonsure17:27
opendevreviewMerged openstack/openstack-ansible stable/ussuri: Bump OpenStack-Ansible Ussuri  https://review.opendev.org/c/openstack/openstack-ansible/+/81558918:49
opendevreviewMerged openstack/openstack-ansible master: Remove reference to deprecated python-ceilometerclient  https://review.opendev.org/c/openstack/openstack-ansible/+/81531518:49
opendevreviewMerged openstack/ansible-role-python_venv_build stable/train: Set centos-7 jobs to non voting  https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/81721920:00
opendevreviewMerged openstack/ansible-role-python_venv_build stable/train: Workaround distro provided pip having old CA certs on centos-7  https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/81647322:31

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!