Friday, 2020-11-13

*** klamath_atx has quit IRC00:10
*** klamath_atx has joined #openstack-ansible00:13
*** nurdie has joined #openstack-ansible00:14
*** nurdie has quit IRC00:20
*** cshen has joined #openstack-ansible00:55
*** nurdie has joined #openstack-ansible00:55
*** klamath_atx has quit IRC00:59
*** klamath_atx has joined #openstack-ansible01:00
*** cshen has quit IRC01:00
*** nurdie has quit IRC01:01
*** klamath_atx has quit IRC01:06
*** nurdie has joined #openstack-ansible01:27
*** nurdie has quit IRC01:32
*** spatel has joined #openstack-ansible01:37
*** spatel has quit IRC01:42
*** macz_ has quit IRC02:09
*** tinwood has quit IRC02:10
*** tinwood has joined #openstack-ansible02:13
*** rh-jelabarre has quit IRC02:33
*** nurdie has joined #openstack-ansible02:37
*** macz_ has joined #openstack-ansible02:39
*** nurdie has quit IRC02:41
*** macz_ has quit IRC02:45
*** cshen has joined #openstack-ansible02:56
*** cshen has quit IRC03:00
*** rfolco has quit IRC03:14
*** nurdie has joined #openstack-ansible04:38
*** nurdie has quit IRC04:43
*** cshen has joined #openstack-ansible04:56
*** cshen has quit IRC05:00
*** gyee has quit IRC05:24
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-ansible05:33
*** tosky has joined #openstack-ansible06:24
*** nurdie has joined #openstack-ansible06:39
*** nurdie has quit IRC06:49
*** cshen has joined #openstack-ansible06:55
*** cshen has quit IRC07:00
*** miloa has joined #openstack-ansible07:03
*** cshen has joined #openstack-ansible07:08
*** rpittau|afk is now known as rpittau07:20
noonedeadpunknsmeds: this bug is really very weird... Especially when you said that you left only single haproxy backend07:42
noonedeadpunknsmeds: wait, so you deploy haproxy into nspawn? so this is kind of standalone haproxy right?07:43
noonedeadpunkI'm wondering if here might be some networking weirdness then...07:44
noonedeadpunkany reason not to use default setup of haproxy and keepalived?07:46
*** pcaruana has joined #openstack-ansible07:52
*** jamesgibo has joined #openstack-ansible08:04
*** andrewbonney has joined #openstack-ansible08:10
*** fanfi has joined #openstack-ansible08:17
*** fanfi has quit IRC08:28
*** nurdie has joined #openstack-ansible08:46
*** nurdie has quit IRC08:50
*** CeeMac has joined #openstack-ansible08:55
ptoI think I have found a bug. I have no definition of manila in the openstack_user_config.yml or conf.d etc. and the manila-share.service is still deployed (failing). Isn't that a bug?09:17
*** jawad_axd has joined #openstack-ansible09:22
noonedeadpunkI'm not sure how this is possible, since manila playbook gets run against specific set of hosts, and if they are not defined, play just won't run10:10
noonedeadpunkhttps://opendev.org/openstack/openstack-ansible/src/branch/stable/ussuri/playbooks/os-manila-install.yml#L6810:11
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Clean up barbican.conf  https://review.opendev.org/75908410:15
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-ops master: Install virtualenv  https://review.opendev.org/74199710:16
*** janno has quit IRC10:19
admin0hi all .. is there a way to map aio bridges to different host interfaces ?10:21
admin0or is it also fine to add interfaces post-install to the bridges created by aio  ?10:21
admin0i have 2 extra networks that i want an aio to use to test something10:21
noonedeadpunkI think it should be ok to add interfaces post-install10:21
noonedeadpunkas we don't really ahve any flexability here https://opendev.org/openstack/openstack-ansible/src/branch/master/tests/roles/bootstrap-host/tasks/prepare_networking.yml#L37-L16110:23
admin0how to test something like ironic via aio ?10:25
*** janno has joined #openstack-ansible10:27
*** gshippey has joined #openstack-ansible10:29
*** cshen has quit IRC10:37
*** cshen has joined #openstack-ansible10:42
*** nurdie has joined #openstack-ansible10:47
*** nurdie has quit IRC10:52
*** jawad_axd has quit IRC11:01
noonedeadpunkoh, well, there was some super challenging way but I haven't fully realized it tbh11:15
ptonoonedeadpunk: I am just testing your patch for mariadb bakcup, and it breaks at the community.mysql.mysql_user - module missing. Should it stay on ansible 2.9 or move to ansible 2.10?11:29
ptofatal: [os_infra1_galera_container-2423e74e]: FAILED! => {"reason": "couldn't resolve module/action 'community.mysql.mysql_user'. This often indicates a misspelling, missing collection, or incorrect module path.\n\nThe error appears to be in '/etc/ansible/roles/galera_server/tasks/galera_server_backups.yml': line 66, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offen11:29
ptoding line appears to be:\n\n\n- name: Grant access to the database for the backup service\n  ^ here\n"}11:29
noonedeadpunkyah, I'm afraind that indeed this patch is applicable only for 2.10 ansible....11:31
*** fanfi has joined #openstack-ansible11:31
noonedeadpunkbut I don't think you should upgrade your ansible...11:31
ptonoonedeadpunk: I agree with that. Any plans to make a 2.9 version?11:31
noonedeadpunknot sure what is the good way except backporting patch, but it's really new feature that I'm rather left to decide to the patch owner if it's worth backporting11:32
noonedeadpunkprobably it worth a backport11:33
ptonoonedeadpunk: Its a mess that ansible 2.10 is not backward compatible :-/11:33
noonedeadpunkwell yes...11:34
ptonoonedeadpunk: A backport will be nice :-)11:34
ptoWhat are the plans to jump to ansible 2.10?11:34
noonedeadpunkon V it will b 2.1011:35
noonedeadpunkstable branches will stay where they are11:35
ptonoonedeadpunk: I think there is an error in the default timer settings: http://paste.openstack.org/show/799986/11:36
noonedeadpunkwould be awesome if you could suggest a patch:)11:36
ptonoonedeadpunk: I would love to, but i might need a little guidance11:37
noonedeadpunkoh btw you got some comments on https://review.opendev.org/#/c/760090/11:38
*** fanfi has quit IRC11:38
*** fanfi has joined #openstack-ansible11:52
ptonoonedeadpunk: I have updated the comments on review and updated. Downloaded the git review -d 760090 and updated the core. Done a git commit --amend. How do I push it back to the review correctly?11:59
*** rfolco has joined #openstack-ansible11:59
noonedeadpunkgit review or git review -f :)11:59
noonedeadpunk(-f will drop just created branch during -d process)12:00
ptonoonedeadpunk: Awsome! Thanks12:06
*** fanfi has quit IRC12:09
ptonoonedeadpunk: Your branch and 'gerrit/master' have diverged, and have 1 and 4 different commits each, respectively. Should i do a git pull and merge and commit the change?12:11
noonedeadpunkdoesn't really matter12:16
noonedeadpunkgerrit is capable of merging non-conflicting commits and rebasing them on it's own12:17
openstackgerritPerToft proposed openstack/openstack-ansible master: Added Netplan examples for a Openstack Infrastructure node.  https://review.opendev.org/76009012:35
openstackgerritPerToft proposed openstack/openstack-ansible master: Added Netplan examples for a Openstack Infrastructure node.  https://review.opendev.org/76009012:37
ptoWhy does the review not update the changes? They are overwritten when I do a review12:38
jamesdentonjrosser do you recall if spatel had to install the centos-release-openstack-{train,ussuri,victoria} repo to get OVS working?12:44
jrosserjamesdenton: iirc it was the nfv repo needed to get ovs package with dpdk compiled in12:47
*** nurdie has joined #openstack-ansible12:48
jrosserI was trying to get him to submit a small patch just for that repo12:48
jamesdentonok, gotcha. i just tried to do an ovs deployment on centos 8 and openvswitch wouldn't install without that repo i mentioned. We should probably add a test for OVS12:48
jamesdentoni'll look into again later12:48
*** jamesgibo has quit IRC12:49
noonedeadpunkpto: not sure what you mean12:51
noonedeadpunkpto: oh, so you just updated commit msg...12:52
noonedeadpunkso before git commit --amend have you added changes?12:52
noonedeadpunkI mean you need to do git add . or smth like this12:52
noonedeadpunkand commit --amend only after you staged changes12:52
*** nurdie has quit IRC12:53
ptonoonedeadpunk: I did "git review -d 760090", Made the changes, git add etc/netplan/01-static.yml, git commit --amend, git review13:01
noonedeadpunklooks correct13:01
*** pto has quit IRC13:03
*** pto_ has joined #openstack-ansible13:03
*** pto_ is now known as pto13:03
ptonoonedeadpunk: But no files were chagned. I can try again13:04
noonedeadpunkwould be interesting to see git status before you amend13:04
noonedeadpunkand try checking out to master and removing current branch13:04
openstackgerritPerToft proposed openstack/openstack-ansible master: Added Netplan examples for a Openstack Infrastructure node. Updated with reviews.  https://review.opendev.org/76009013:07
*** rh-jelabarre has joined #openstack-ansible13:09
*** jamesgibo has joined #openstack-ansible13:09
*** rh-jelabarre has quit IRC13:13
ptonoonedeadpunk: I did it again, and not its working. Thanks for helping13:15
*** priteau has joined #openstack-ansible13:17
noonedeadpunksure, thanks for helping us:)13:18
*** rh-jelabarre has joined #openstack-ansible13:21
*** vakuznet has joined #openstack-ansible13:30
ptonoonedeadpunk: Thank you for your awsome work :-)13:34
ptoHave a nice weekend all13:35
noonedeadpunkhave a nice weekend as well)13:41
*** SiavashSardari has joined #openstack-ansible13:54
jamesdentonnoonedeadpunk are the zuul parent jobs defined anywhere? i can't recall. example: https://github.com/openstack/openstack-ansible-os_neutron/blob/master/zuul.d/jobs.yaml#L1814:09
jamesdentonn/m i got my answer14:09
openstackgerritJames Denton proposed openstack/openstack-ansible-os_neutron master: Test OVS deployments on CentOS 8  https://review.opendev.org/76266114:12
openstackgerritMerged openstack/openstack-ansible-tests stable/train: Add requirements_git_install_branch to test-vars  https://review.opendev.org/73252114:16
*** macz_ has joined #openstack-ansible14:17
*** macz_ has quit IRC14:22
*** nurdie has joined #openstack-ansible14:45
*** rpittau is now known as rpittau|afk14:49
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Trigger uwsgi restart  https://review.opendev.org/75668614:57
*** nurdie has quit IRC15:00
*** spatel has joined #openstack-ansible15:02
spatelceph question, do you guys have dedicated network for replication?  or using br-storage for both client data + replication?15:04
*** yann-kaelig has joined #openstack-ansible15:08
spatelnevermind i got my answer from my old deployment, i have dedicated network for replication15:09
*** jamesgibo has quit IRC15:10
*** gshippey has quit IRC15:19
mgariepyspatel, depends on your setup,15:23
mgariepymy newest deploy have 2x25G bond and i do use 2 separate vlans one for access and one for replication15:24
mgariepymy older one has only 2x 10G so i did separate them each on their interface.15:25
*** yann-kaelig has quit IRC15:25
*** nurdie has joined #openstack-ansible15:30
ThiagoCMCGuys, I've never used Manila and I'm interested on it... What services runs within the "manila-data_hosts:" group? I'm seeing that they're being (at the exmple) at the infrastructure hosts but, isn't it kinda of storage?15:30
*** ianychoi has joined #openstack-ansible15:30
*** SiavashSardari has quit IRC15:44
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Shibboleth and OIDC apache modules are co-installable on Focal  https://review.opendev.org/75884516:04
noonedeadpunkThiagoCMC: yeah, it is, it's running manila-share iirc16:04
noonedeadpunkwell, I know that folks are running manila successfully, but still, role is not finished properly... Like for ganesha nfs storage no HA made (ie balancing) and interfaces are probably not forwarded to the containers....16:05
ThiagoCMCnoonedeadpunk, cool! I'm planning to play with CephFS as a Service...  =P16:09
ThiagoCMCNot interested in NFS16:09
*** pcaruana has quit IRC16:09
noonedeadpunkwell, ganesha-nfs is abstract on ceph mds16:10
noonedeadpunkhttps://docs.ceph.com/en/latest/cephfs/nfs/16:10
jamesdentonjrosser here's that ovs issue i mentioned earlier on centos 8: https://zuul.opendev.org/t/openstack/build/bab8dcef97684ca68de4611d7e03c8d4. Looks like an additional repo will be needed that ties to the openstack release16:10
ThiagoCMCHmm... Thanks for sharing that!16:11
ThiagoCMCnoonedeadpunk, my ceph-nfs-install.yml doesn't do anything, is it required for Manila w/ CephFS ?16:11
noonedeadpunkyep16:12
noonedeadpunkI think it's running when specific hosts are set...16:12
ThiagoCMCOuch! Ok then!  lol16:12
noonedeadpunkThiagoCMC: but you can share cephfs directly without nfs as well16:12
noonedeadpunkbut then you need to ensure that client vms will have storage network iirc16:13
noonedeadpunkwhich is not always possible or prefferable16:13
ThiagoCMCHmmm... Got it16:13
ThiagoCMCYeah, I like my Ceph's cluster network (the one on top of br-storage) to be as isolated as possible!16:15
ThiagoCMCMy controllers doesn't even have br-storage, it's physically isolated.16:16
ThiagoCMCSo, I'm wondering about where to deply Manila Share (manila-data_hosts) and the NFS thing...16:17
ThiagoCMCOh, BTW, I gave up on that Erasure Code thing, for now.  :-/16:17
noonedeadpunkI guess the same place where cinder-volume is running16:19
ThiagoCMCI see... Well, my cinder-volume also doesn't have access to the br-storage network. I'll give it a try!16:22
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests  https://review.opendev.org/75416216:31
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Cleanup stop handler and barbican_apache_* variables  https://review.opendev.org/75668916:33
*** macz_ has joined #openstack-ansible16:36
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add default simple key to secrets  https://review.opendev.org/75908216:46
*** klamath_atx has joined #openstack-ansible16:48
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Allow multibackend support for Barbican  https://review.opendev.org/76269116:51
*** klamath_atx has quit IRC16:53
ThiagoCMCI'm seeing that the Charm Deployment support Ceph's Erasure Code, any plans to add this support on OSA as well?16:58
ThiagoCMChttps://docs.openstack.org/project-deploy-guide/charm-deployment-guide/latest/app-erasure-coding.html16:58
noonedeadpunkThiagoCMC: we just using ceph-ansible. I think they already do support16:59
noonedeadpunkbut I mean if they do support it - nothing stops from using it in OSA17:00
ThiagoCMCBut then, the OSA service's configuration doesn't work with the EC pools... I tried to set "rbd default data pool:" under ceph overrride but it didn't work.17:01
noonedeadpunkhm...17:01
noonedeadpunkI'm not suro how it's special17:01
noonedeadpunkI think from osa perspective it's just regular pool17:01
ThiagoCMCEC pools doesn't support omap, so, there is a need to tell Ceph clients about the "data_pool"...17:02
ThiagoCMCAnyway, today, I can deploy from scratch both OpenStack with Ceph by just running "setup-everything.yml" from my OSA deployment server. It would be awesome to just change a new lines under my /etc/openstack_deploy and make it happen with EC pools too!17:03
ThiagoCMC:-P17:03
noonedeadpunkbut iirc omap limitation is more about supporting pg balancing, but clients can live with it?17:03
ThiagoCMCI'm not sure lol17:04
noonedeadpunkI just can't find in docs that clients needs special directive....17:05
ThiagoCMCWhat about this guy here: https://themeanti.me/technology/2018/08/23/ceph_erasure_openstack.html ?17:06
ThiagoCMCThere is also info about this here: https://www.reddit.com/r/ceph/comments/72yc9m/ceph_openstack_with_ec/17:06
ThiagoCMCAnd here: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2018-July/027890.html - sorry about flood lol17:06
noonedeadpunkwell last one is more about ceph-ansible support as I said...17:07
ThiagoCMCYep17:07
noonedeadpunkand tbh I have no idea is they support it now or not (I think they should)17:07
ThiagoCMCI have no problems in creating/using EC pools outside of OpenStack, with rbd images and with OVERWRITES17:08
ThiagoCMCproblem is how to configure OpenStack/Ceph clients to make use of the EC pools and "data-pool" properly.17:09
ThiagoCMCAnyway, just saying this here that I think it would be awesome to be able to do this via OSA somewhere under /etc/openstack_deploy and let it do its magic!  ^_^17:10
noonedeadpunkHm, that's interesting and I'm wondering why nowhere in docs this neccessity is mentioned...17:14
noonedeadpunkas eventually it's not openstack specific then17:14
noonedeadpunkthe question here is where [client.cinder-ssd] should be in ceph.conf  - on mons, on osd hosts, on nova-compute hosts (from where ceph clients connects)17:16
ThiagoCMCExactly!  :-D17:20
noonedeadpunkThiagoCMC: so you had replicated meta pool and erasure pool for data right?17:25
noonedeadpunkie both images and images_data?17:25
ThiagoCMCYep! The "images" pool, replicated, and the "images_data" EC.17:25
noonedeadpunkuh, it's interesting to play with but no time atm honestly....17:26
ThiagoCMCI've configured the "rbd default data pool = images_data" in glance nodes, its ceph.conf, But, still, Glance failed to upload.17:26
ThiagoCMCOh, no worries! I'm just playing with this in my basement to learn and for fun lol17:27
*** miloa has quit IRC17:27
noonedeadpunkit sounds like worth going to ceph IRC channel....17:27
noonedeadpunkbut really interesting...17:28
ThiagoCMCGood call =)17:28
noonedeadpunkas not mentioning anything in the docs about this is super weird considering sevral years passed17:29
ThiagoCMCTrue... eheheh17:29
jamesdentonnoonedeadpunk i think the failure here, for at least the centos distro job, is that neutron-rpc-server may not be running: https://review.opendev.org/#/c/486156/17:30
jamesdentoni don't see the log in the journal list, but don't see any errors on the imp,ementation side17:33
noonedeadpunkalso ovn timing out instanly is weird...17:34
noonedeadpunkthings even worse that you can't reproduce it:(17:41
noonedeadpunkeventually nothing stops us from contunue using neutron-server binary...17:42
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Allow multibackend support for Barbican  https://review.opendev.org/76269117:46
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Allow multibackend support for Barbican  https://review.opendev.org/76269117:53
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Allow multibackend support for Barbican  https://review.opendev.org/76269117:55
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Allow multibackend support for Barbican  https://review.opendev.org/76269117:59
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Reduce number of processes on small systems  https://review.opendev.org/75989518:03
*** klamath_atx has joined #openstack-ansible18:12
*** klamath_atx has quit IRC18:17
*** klamath_atx has joined #openstack-ansible18:28
*** andrewbonney has quit IRC18:36
*** gyee has joined #openstack-ansible18:54
*** nurdie has quit IRC19:22
*** nurdie has joined #openstack-ansible19:22
*** nurdie has quit IRC19:22
*** nurdie has joined #openstack-ansible19:33
*** nurdie has quit IRC19:38
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add default simple key to secrets  https://review.opendev.org/75908220:34
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Clean up barbican.conf  https://review.opendev.org/75908420:34
noonedeadpunkcan I summon another vote for https://review.opendev.org/#/c/762184/  ?21:00
mgariepydone.21:04
noonedeadpunkthanks!21:07
noonedeadpunkwell roles unfreeze would be also great to be voted:)21:08
noonedeadpunkhttps://review.opendev.org/#/c/762185/121:08
mgariepyhaha ok done also.21:09
*** rfolco has quit IRC21:10
*** klamath_atx has quit IRC21:13
openstackgerritJames Denton proposed openstack/openstack-ansible-os_neutron master: Test OVS deployments on CentOS 8  https://review.opendev.org/76266121:47
*** klamath_atx has joined #openstack-ansible22:05
*** spatel has quit IRC22:07
*** klamath_atx has quit IRC22:11
*** klamath_atx has joined #openstack-ansible22:11
*** klamath_atx has quit IRC22:23
*** vakuznet has quit IRC22:35
*** rh-jelabarre has quit IRC22:43
*** cshen has quit IRC22:43
*** cshen has joined #openstack-ansible22:45
*** klamath_atx has joined #openstack-ansible22:49
ebbexo master and removing current branch22:50
*** klamath_atx has quit IRC23:20
*** rfolco has joined #openstack-ansible23:22
*** cshen has quit IRC23:26
*** rfolco has quit IRC23:26
*** klamath_atx has joined #openstack-ansible23:33
noonedeadpunkwhaaaaaat?:))23:39
*** tosky has quit IRC23:43

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!