Friday, 2021-07-02

opendevreviewLin PeiWen proposed openstack/kolla-ansible master: Delete haproxy_single_service_listen.cfg.j2 template  https://review.opendev.org/c/openstack/kolla-ansible/+/79788306:07
jingvarmorning06:50
mnasiadkamorning07:04
jingvarI have a question about glance-api HA07:30
jingvarI have an openstack installation with haproxy and multiply glance-api backends07:32
jingvarVictoria deplyed via kayobe with HA has only one y glance-api backend07:33
mnasiadkabecause your backend is file?07:45
jingvarmy cloud has file with mounted nfs07:49
jingvarwhat will be if I shutoff controller0? 07:49
kevkomorning07:50
jingvarmorning07:50
kevkoanyone with kolla masakari experiences ? 07:56
jingvar<kevko> - no08:00
mnasiadkajingvar: here is the variable that controls that - https://github.com/openstack/kolla-ansible/blob/e2bbded9672807f2053da110eec102d4f7839c13/ansible/group_vars/all.yml#L88508:04
mnasiadkajingvar: you can also override glance_file_datadir_volume to an nfs mount and it will spawn HA glance08:05
mnasiadkas/it/kolla-ansible/g08:06
jingvarwhat about haproxy08:08
opendevreviewMerged openstack/kolla-ansible stable/wallaby: CI: fix backups Ceph pool name  https://review.opendev.org/c/openstack/kolla-ansible/+/79907508:09
mnasiadkajingvar: what about haproxy?08:10
jingvarThere should be 3 backeds for glance08:11
jingvaras i understand , it works for all except file mode08:12
mnasiadkayes08:13
mnasiadkahttps://docs.openstack.org/kolla-ansible/latest/reference/shared-services/glance-guide.html#file-backend08:13
mnasiadkaJust read this, especially the line starting with "For better reliability"08:13
jingvarI.ve read it08:14
jingvarquestion is how much backends will be for glance in haproxy config with glance with file mode08:16
jingvari don't see where is options NFS like cinder08:16
jingvarCan I ovveride glance_api_hosts:  via kayobe ? 08:23
jingvarif I put into kolla.yaml08:23
mnasiadkain kolla/globals.yml, yes08:30
opendevreviewMerged openstack/kolla stable/wallaby: CI: Fix epel url override  https://review.opendev.org/c/openstack/kolla/+/79906408:39
opendevreviewMark Goddard proposed openstack/kolla-ansible master: Add disable_firewall variable  https://review.opendev.org/c/openstack/kolla-ansible/+/79885409:11
opendevreviewMerged openstack/kolla-ansible stable/wallaby: Make it possible to override automatic fluentd version detection  https://review.opendev.org/c/openstack/kolla-ansible/+/79888909:27
opendevreviewVerification of a change to openstack/kolla-ansible failed: Make it possible to override automatic fluentd version detection  https://review.opendev.org/c/openstack/kolla-ansible/+/79889009:27
opendevreviewVerification of a change to openstack/kolla-ansible failed: Make it possible to override automatic fluentd version detection  https://review.opendev.org/c/openstack/kolla-ansible/+/79889109:28
opendevreviewMerged openstack/kolla-ansible stable/wallaby: CI: Avoid generating a nova key in cephadm scenario  https://review.opendev.org/c/openstack/kolla-ansible/+/79888709:57
opendevreviewMerged openstack/kolla-ansible stable/victoria: CI: Avoid generating a nova key in ceph-ansible scenario  https://review.opendev.org/c/openstack/kolla-ansible/+/79902009:57
opendevreviewMerged openstack/kolla-ansible stable/wallaby: magnum: Add CA certificate configuration for internal TLS  https://review.opendev.org/c/openstack/kolla-ansible/+/79889310:07
opendevreviewMerged openstack/kolla-ansible stable/victoria: magnum: Add CA certificate configuration for internal TLS  https://review.opendev.org/c/openstack/kolla-ansible/+/79889410:07
opendevreviewMerged openstack/kolla-ansible stable/ussuri: magnum: Add CA certificate configuration for internal TLS  https://review.opendev.org/c/openstack/kolla-ansible/+/79889510:08
jingvarkolla/globals.yml >> glance_api_hosts: "{{ [groups['glance-api']] }}"10:11
jingvarTASK [Read the Kolla extra globals configuration file] >>The error was: 'glance_backend_file' is undefined\10:11
jingvarthere is the fantastic parsing10:14
opendevreviewMerged openstack/kolla stable/victoria: CI: Fix epel url override  https://review.opendev.org/c/openstack/kolla/+/79906510:15
mgoddardjingvar: double templating :(10:22
mgoddardjingvar: you can use {% raw %} to reference kolla-ansible variables10:22
jingvarmgoddard - I don't think that10:27
jingvarthe problem was - I had last line #{{ [groups['glance-api']|first] if glance_backend_file | bool and glance_file_datadir_volume == 'glance' else groups['glance-api'] }}10:28
jingvarIt try resolve comment line :)10:29
kevkojinja2 ? 10:30
jingvarIn general what about  glance with nfs? Can it be in your world?10:30
jingvarNow I'm having glance_api_hosts: "{{ [groups['glance-api']] }}"10:33
jingvarbut TASK [service-precheck : glance | Validate inventory groups] task path: /home/centos/kolla-venv/share/kolla-ansible/ansible/roles/service-precheck/tasks/main.yml:2 fatal: [controller1]: FAILED! => {     "msg": "{{ glance_services }}: 10:34
jingvarCurrent cluster (queens) has 3 glance with haproxy and file mode with mounted nfs share - can I reach the same with Kayobe?10:36
mgoddardjingvar: you've made a list of lists10:38
mgoddardglance_api_hosts: "{{ groups['glance-api'] }}"10:38
mgoddardjingvar: if you are using NFS, you'll need to set glance_file_datadir_volume10:39
mgoddardin which case you don't need to set glance_api_hosts10:39
mgoddardjingvar: https://docs.openstack.org/kolla-ansible/latest/reference/shared-services/glance-guide.html#file-backend10:40
jingvarin the example glance_file_datadir_volume: "/path/to/shared/storage/" - there have to be mounted nfs share ?10:43
jingvarIs it render error ? config/src/kayobe-config/etc/kolla/globals.yml:glance_api_hosts: '[AnsibleUndefined]'10:44
mgoddardyes10:46
mgoddardsurprised it didn't fail10:46
jingvarany way - my expectation is having same approach as cinder have 10:48
jingvarcinder it self mount nfs share10:49
jingvarglance?10:49
jingvarhow can I mount NFS for glance10:51
jingvar"config/src/kayobe-config/etc/kolla/globals.yml:glance_api_hosts: controller1 controller2" the same error10:52
mgoddardjingvar: you need to do it yourself10:53
mgoddardjingvar: could use a kayobe playbook10:53
mgoddard*custom playbook10:53
jingvarcan it be placed into kayobe-config? and intgrated with common workflow?10:57
mgoddardyes10:58
mgoddardhttps://docs.openstack.org/kayobe/latest/custom-ansible-playbooks.html10:58
mgoddardjingvar: you can use a hook to run it after host configure10:58
jingvarok , thanks , I'll try it. 11:02
jingvarbut main issue now it to start 3 glance11:03
mgoddardjingvar: kolla logic says if you modify glance_file_datadir_volume it will start 3 services11:06
jingvarhmm11:14
jingvarnow I have ok: [controller2] => (item=enable_glance_True) => {      "item": "enable_glance_True",11:15
jingvardeloy is not finished yet11:17
jingvarif I modify glance_file_datadir_volume , Do I need to  change glancу_api_hosts?11:19
kevkomgoddard: could you advise me how to get masakari working :/ ? 11:24
opendevreviewMerged openstack/kolla stable/ussuri: CI: Fix epel url override  https://review.opendev.org/c/openstack/kolla/+/79906611:40
opendevreviewMark Goddard proposed openstack/kolla-ansible master: DNM: CI: Enable TLS in all jobs  https://review.opendev.org/c/openstack/kolla-ansible/+/78238712:38
opendevreviewMerged openstack/kayobe stable/wallaby: Remove outdated upgrade step  https://review.opendev.org/c/openstack/kayobe/+/79757812:55
opendevreviewMerged openstack/kayobe stable/victoria: Remove outdated upgrade step  https://review.opendev.org/c/openstack/kayobe/+/79757912:55
opendevreviewMerged openstack/kolla-ansible stable/victoria: Make it possible to override automatic fluentd version detection  https://review.opendev.org/c/openstack/kolla-ansible/+/79889012:58
jingvarI playy with hooks13:15
jingvarfatal: [controller1]: UNREACHABLE! => {13:16
jingvarit trys connect via hostname instad od using IP13:17
jingvar- name: Mount NFS shares for glance   hosts: controllers13:17
mgoddardjingvar: follow the docs :)13:18
mgoddardyou need symlinks13:18
mgoddardjingvar: check symlinks are valid13:18
jingvarI just placed my file into /etc/kayobe/hooks/overcloud-service-deploy/pre.d13:19
jingvarDo I need symlink in this case?13:20
kevkomgoddard: could you advise me with masakari :) ? 13:21
jingvarmy playbook got hostnames from kayobe13:21
mgoddardjingvar: yes13:22
jingvarfor what? 13:22
mgoddardjingvar: the playbook needs access to kayobe filter_plugins, group_vars, test_plugins13:22
jingvarand what are restrictions to native provide them to it13:23
kevkomgoddard: http://paste.openstack.org/show/807109/13:23
mgoddardkevko: pacemaker is a PITA13:25
mgoddardkevko: it's probably related to capabilities/permissions/privileged mode13:25
kevkohh, PITA ..for sure :D 13:26
kevkoit is 13:26
kevkolet me try it 13:29
kevkoyoctozepto said it is working for him from vanilla kolla13:29
opendevreviewRafael Weingartner proposed openstack/kolla-ansible master: Make setup module arguments configurable  https://review.opendev.org/c/openstack/kolla-ansible/+/78339213:30
kevkomgoddard: started with --privileged and it's same :( 13:34
opendevreviewMerged openstack/kolla master: Improve offline build scenario.  https://review.opendev.org/c/openstack/kolla/+/79648013:51
opendevreviewMerged openstack/kolla-ansible stable/victoria: Make rabbitmq cluster_partition_handling configurable  https://review.opendev.org/c/openstack/kolla-ansible/+/79776313:57
scottsolhey 14:25
scottsoljust wanted to check in as https://review.opendev.org/c/openstack/kolla-ansible/+/792997 has a comment that it needs more discussion 14:25
scottsolhas there been any movement on this? 14:25
scottsolmnasiadka ^^14:35
mgoddardscottsol: mnasiadka just left for 3 weeks :)14:36
scottsolah dam I thought that was the end of today 14:36
scottsolnot really sure what else I can do with that patch. I think it is worth running but obviously its up to the cores if you want it :) 14:37
mgoddardmnasiadka is an hour ahead14:37
mgoddardscottsol: my preference would be to merge it as-is and debate later14:37
scottsol+114:38
mgoddardI guess I'll vote with my +214:38
scottsolthanks 14:38
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/wallaby: CI: only run cells job on changes to nova role  https://review.opendev.org/c/openstack/kolla-ansible/+/79915215:33
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/wallaby: docs: Add note about internal VIP when HAProxy is disabled  https://review.opendev.org/c/openstack/kolla-ansible/+/79915315:34
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/victoria: docs: Add note about internal VIP when HAProxy is disabled  https://review.opendev.org/c/openstack/kolla-ansible/+/79915415:34
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/ussuri: docs: Add note about internal VIP when HAProxy is disabled  https://review.opendev.org/c/openstack/kolla-ansible/+/79915515:34
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/wallaby: Reduce RabbitMQ busy waiting, lowering CPU load  https://review.opendev.org/c/openstack/kolla-ansible/+/79923715:41
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/victoria: Reduce RabbitMQ busy waiting, lowering CPU load  https://review.opendev.org/c/openstack/kolla-ansible/+/79923815:41
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/ussuri: Reduce RabbitMQ busy waiting, lowering CPU load  https://review.opendev.org/c/openstack/kolla-ansible/+/79923915:42
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/victoria: Disable docker's ip-forward when iptables disabled  https://review.opendev.org/c/openstack/kolla-ansible/+/79924015:44
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/ussuri: Reduce RabbitMQ busy waiting, lowering CPU load  https://review.opendev.org/c/openstack/kolla-ansible/+/79923915:44
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/victoria: [docker] Added a new flag to disable default network  https://review.opendev.org/c/openstack/kolla-ansible/+/78119815:47
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/victoria: Disable docker's ip-forward when iptables disabled  https://review.opendev.org/c/openstack/kolla-ansible/+/79924015:50
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/victoria: Reno follow up for docker_disable_ip_forward  https://review.opendev.org/c/openstack/kolla-ansible/+/79924115:52
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/victoria: Allow user to set sysctl_net_ipv4_tcp_retries2  https://review.opendev.org/c/openstack/kolla-ansible/+/79924215:56
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/victoria: Allow user to set sysctl_net_ipv4_tcp_retries2  https://review.opendev.org/c/openstack/kolla-ansible/+/79924215:57
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/ussuri: Allow user to set sysctl_net_ipv4_tcp_retries2  https://review.opendev.org/c/openstack/kolla-ansible/+/79924315:58
opendevreviewMartin Chlumsky proposed openstack/kolla-ansible stable/train: Fix empty match while setting supported_policy_files  https://review.opendev.org/c/openstack/kolla-ansible/+/79924415:59
opendevreviewMerged openstack/kolla master: Bump up cAdvisor's version  https://review.opendev.org/c/openstack/kolla/+/79727515:59
opendevreviewMerged openstack/kolla stable/victoria: [CI] Do not set ansible_python_interpreter for Zuul  https://review.opendev.org/c/openstack/kolla/+/79810716:00
opendevreviewMark Goddard proposed openstack/kayobe stable/wallaby: Ubuntu: CI: rely on os_distribution, remove interfaces pause  https://review.opendev.org/c/openstack/kayobe/+/79924516:02
opendevreviewMerged openstack/kolla stable/wallaby: [CI] Do not set ansible_python_interpreter for Zuul  https://review.opendev.org/c/openstack/kolla/+/79810616:08
opendevreviewMerged openstack/kolla stable/ussuri: [CI] Do not set ansible_python_interpreter for Zuul  https://review.opendev.org/c/openstack/kolla/+/79810816:08
opendevreviewMark Goddard proposed openstack/kayobe stable/wallaby: Prevent matching unrelated images  https://review.opendev.org/c/openstack/kayobe/+/79924616:09
opendevreviewMark Goddard proposed openstack/kayobe stable/victoria: Prevent matching unrelated images  https://review.opendev.org/c/openstack/kayobe/+/79924716:11
opendevreviewMark Goddard proposed openstack/kayobe stable/victoria: Prevent matching unrelated images  https://review.opendev.org/c/openstack/kayobe/+/79924716:13
opendevreviewMark Goddard proposed openstack/kayobe stable/ussuri: Prevent matching unrelated images  https://review.opendev.org/c/openstack/kayobe/+/79924816:14
opendevreviewMark Goddard proposed openstack/kayobe stable/ussuri: Prevent matching unrelated images  https://review.opendev.org/c/openstack/kayobe/+/79924816:15
kevkomgoddard: aaaa, maybe I found and issue with masakari-debian16:22
kevkomgoddard: but it is only theory ... masakari_hostmonitor and hacluster_pacemaker has different user mapping 16:24
kevkoso there is different owner in /dev/shm/* :(16:24
kevkoas they are system users can't be overriden :( 16:25
kevkobut firstly i has to test it16:25
opendevreviewIvan Halomi proposed openstack/kolla-ansible master: WIP: Adding support of podman deployment  https://review.opendev.org/c/openstack/kolla-ansible/+/79922916:34
opendevreviewMerged openstack/kolla-ansible stable/ussuri: Drop support for Cinder ZFSSA backend  https://review.opendev.org/c/openstack/kolla-ansible/+/79739717:10
opendevreviewMerged openstack/kolla-ansible stable/victoria: Drop support for Cinder ZFSSA backend  https://review.opendev.org/c/openstack/kolla-ansible/+/79739617:12
opendevreviewMerged openstack/kolla-ansible stable/ussuri: Make it possible to override automatic fluentd version detection  https://review.opendev.org/c/openstack/kolla-ansible/+/79889117:12
opendevreviewMerged openstack/kolla-ansible master: Support storing passwords in Hashicorp Vault  https://review.opendev.org/c/openstack/kolla-ansible/+/79299720:28

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!