Monday, 2019-07-08

« Sunday, 2019-07-07 Index Tuesday, 2019-07-09 »
*** k_mouza has joined #openstack-kolla00:28
*** k_mouza has quit IRC00:33
*** kplant has quit IRC01:11
*** altlogbot_0 has quit IRC01:28
*** altlogbot_0 has joined #openstack-kolla01:29
*** brett-soric has joined #openstack-kolla02:08
*** BjoernT has joined #openstack-kolla02:33
*** brett-soric has left #openstack-kolla02:54
*** BjoernT_ has joined #openstack-kolla03:08
*** BjoernT has quit IRC03:09
*** skramaja has joined #openstack-kolla03:54
*** factor has quit IRC04:13
*** factor has joined #openstack-kolla04:14
*** Sravan has joined #openstack-kolla04:19
*** Sravan has quit IRC04:28
*** Sravan has joined #openstack-kolla04:32
*** Sravan has quit IRC04:37
*** whoami-rajat has joined #openstack-kolla05:30
*** BjoernT_ has quit IRC05:32
*** Luzi has joined #openstack-kolla05:32
*** Tengu has quit IRC05:38
*** Tengu has joined #openstack-kolla05:43
*** baha has quit IRC05:45
*** shyamb has joined #openstack-kolla05:50
yoctozeptomorning05:57
*** pcaruana has joined #openstack-kolla06:12
*** jbadiapa has joined #openstack-kolla06:19
*** cah_link has joined #openstack-kolla06:21
*** luksky11 has joined #openstack-kolla06:34
*** shyamb has quit IRC06:39
*** shyamb has joined #openstack-kolla06:46
*** unicell has joined #openstack-kolla07:09
*** ivve has joined #openstack-kolla07:13
*** unicell has quit IRC07:25
*** JangwonLee has joined #openstack-kolla07:32
*** shyamb has quit IRC07:51
mgoddardmorning07:56
*** Wasaac has joined #openstack-kolla07:59
mgoddardgoldyfruit: is masakari working now?08:00
mnasiadkamorning08:00
mgoddardmorning mnasiadka08:01
mnasiadkao/ mgoddard08:01
mgoddardgoldyfruit: I found this, may or may not be useful to you: https://review.opendev.org/#/c/561940/08:02
*** rpittau|afk is now known as rpittau08:03
*** Wasaac has quit IRC08:04
*** Wasaac has joined #openstack-kolla08:13
*** Wasaac has quit IRC08:14
*** Wasaac has joined #openstack-kolla08:15
yoctozeptomgoddard, mnasiadka: any of you observed the ansible/jinja2 behavior that templating fails wherever there is an undefined variable used even if its only place is guarded by an 'if' which is false?08:15
*** cgrosjean has joined #openstack-kolla08:17
mgoddardyoctozepto: I don't think so, I thought it was lazy08:22
mgoddardis this in the template module?08:22
yoctozeptomgoddard: it was in our custom merge_configs, I replaced it with template for a moment but the result was the same08:23
mgoddardhmm08:24
yoctozepto"msg": "'ansible.vars.hostvars.HostVarsVars object' has no attribute u'ansible_nonexistent'"08:25
yoctozepto'if' works correctly08:25
yoctozeptoas in, after the offending variable is removed, the part is not in the resulting file08:25
yoctozeptothis is re: https://bugs.launchpad.net/kolla-ansible/+bug/183571308:27
openstackLaunchpad bug 1835713 in kolla-ansible train "migration_interface must exist for non-compute controllers" [Medium,In progress] - Assigned to Radosław Piliszek (yoctozepto)08:27
yoctozeptothe 'if' was missing but adding it by itself does not improve the situation08:27
yoctozeptoI ended up with coding relative 'include' support for our merge modules and using it there, will submit a change in a moment08:28
yoctozeptoso as long as you include it does not try to evaluate it for the failing cases08:30
mgoddardyoctozepto: how about using hostvars[host].get('migration_interface')?08:31
yoctozeptomigration_interface_address: "{{ hostvars[inventory_hostname]['ansible_' + migration_interface]['ipv4']['address'] }}"08:41
yoctozepto^ this is the offending variable08:42
yoctozeptonot tried using get in this context but that would be cumbersome I believe08:42
yoctozeptoI was surprised jinja2 tries to evaluate a variable under false 'if'08:43
*** hamzaachi has joined #openstack-kolla08:46
mgoddardyoctozepto: we have a pattern of using migration_interface_address elsewhere, would that help?08:47
mgoddardoops, I see it is used :)08:48
mgoddardhow about using the default filter?08:48
*** shyamb has joined #openstack-kolla08:49
*** skramaja_ has joined #openstack-kolla09:04
*** skramaja has quit IRC09:05
*** priteau has joined #openstack-kolla09:08
mgoddardthis one needs a review: https://review.opendev.org/#/c/669321/109:16
openstackgerritMerged openstack/kolla-ansible stable/stein: Specify endpoint when creating monasca user  https://review.opendev.org/66932709:21
openstackgerritMerged openstack/kolla-ansible master: Bump minimum Ansible version to 2.5  https://review.opendev.org/66838709:21
openstackgerritMerged openstack/kolla-ansible master: Fixes for MariaDB bootstrap and recovery  https://review.opendev.org/66790409:21
openstackgerritMerged openstack/kolla-ansible stable/stein: Add upgrade-bifrost command  https://review.opendev.org/66763009:21
openstackgerritMerged openstack/kolla-ansible master: CI: Pull images before upgrade  https://review.opendev.org/66688109:21
openstackgerritBharat Kunwar proposed x/kayobe-config master: Make source kayobe-env zsh compatible  https://review.opendev.org/66936409:22
openstackgerritMerged openstack/kolla-ansible master: CI: Test ironic also when nova role is modified  https://review.opendev.org/66913609:23
yoctozepto<mgoddard> how about using the default filter?09:24
yoctozeptowonder if that would not hide a real issue later09:24
yoctozeptosorry for the delay, had some other tasks to do09:25
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Bump minimum Ansible version to 2.5  https://review.opendev.org/66962709:31
mgoddardyoctozepto: could do09:32
mgoddardand this one please: https://review.opendev.org/#/c/669627/109:32
*** ohwhyosa has joined #openstack-kolla09:33
openstackgerritMerged openstack/kolla-ansible stable/stein: CI: Keep stderr in ansible logs  https://review.opendev.org/66908609:34
yoctozepto<mgoddard> yoctozepto: could do09:34
yoctozeptohence proposing alternative solution09:34
yoctozeptowhat a hectic day, can't sit down09:35
*** shyamb has quit IRC09:35
*** shyamb has joined #openstack-kolla09:44
openstackgerritMerged openstack/kolla-ansible master: CI: add periodic-stable-jobs Zuul project template  https://review.opendev.org/66795609:46
openstackgerritMerged openstack/kolla-ansible stable/stein: CI: Use template-overrides.j2 from kolla  https://review.opendev.org/66898309:47
openstackgerritMerged openstack/kolla stable/rocky: CI: Move to periodic-stable  https://review.opendev.org/66796209:47
mnasiadkauhh, ok, time go back to ansible bump up playground I see09:57
mnasiadka;)09:57
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: DNM: Troubleshoot ceph-nfs on ubuntu  https://review.opendev.org/66931510:08
*** luksky11 has quit IRC10:12
openstackgerritMerged openstack/kolla-ansible stable/rocky: Specify endpoint when creating monasca user  https://review.opendev.org/66932810:17
ohwhyosamorning everyone o/10:21
*** vmixor has joined #openstack-kolla10:23
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/stein: CI: add periodic-stable-jobs Zuul project template  https://review.opendev.org/66963010:24
vmixorHello, Iam10:26
vmixorHello, I am new to OpenStack Kolla developement and  I have a few questions about kolla-ansible10:29
mgoddardHello vmixor, welcome10:29
vmixorHello, mgoddard10:30
vmixorMy actual task is to implement changes tu run OpenStack Kolla Stein on Debian Buster and push my changes to upstream if possible10:31
mgoddardvmixor: do you work with hrw?10:34
vmixormgoddard: no10:35
mgoddardvmixor: just wondering, he works with Debian10:36
mgoddardvmixor: what questions do you have?10:36
brtknrmgoddard: any idea why my `kayobe overcloud service reconfigure -kt monasca` fails with: TASK [public-openrc : Read the admin OpenStack API environment file] ****************************************************************************************************************10:38
brtknrfatal: [localhost]: FAILED! => {"changed": false, "msg": "file not found: /opt/alaska/rundeck/alaska-prod/kayobe/src/kayobe-config/etc/kolla/admin-openrc.sh"}10:38
mgoddardbrtknr: yes, you need https://review.opendev.org/66745110:39
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Do not require valid migration_interface for controllers  https://review.opendev.org/66963110:39
brtknrmgoddard: I'm on rocky10:39
mgoddardbrtknr: cherry pick it10:40
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: CI: Pull images before upgrade  https://review.opendev.org/66695310:40
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Do not require valid migration_interface for controllers  https://review.opendev.org/66963110:42
*** priteau has quit IRC10:42
goldyfruitmgoddard, masakari works for instances for now, I'm working on the hacluster role10:42
goldyfruitSo far I'm able to have corosync/pacemaker/pcs&crmsh into different containers10:43
goldyfruitI working on the pacemaker-remote container now10:43
mgoddardgoldyfruit: did you see Sam P's comment on ML about running pacemaker on the host?10:45
mgoddardgoldyfruit: should we merge with just instance support?10:46
openstackgerritMerged x/kayobe-config master: Make source kayobe-env zsh compatible  https://review.opendev.org/66936410:46
goldyfruitmgoddard, Yes I saw Sam comment but I think itś doable10:47
goldyfruitJust want need some work10:48
mgoddardgoldyfruit: ok10:48
goldyfruitmgoddard, yes so far we could just merge with instance support10:48
mgoddardgoldyfruit: is the patch with CI changes passing?10:48
goldyfruitI will do an another review to support hostmonitor (and maybe process monitor)10:48
mgoddardand should we add a new job for it?10:49
goldyfruitthis one https://review.opendev.org/#/c/616050 ?10:49
vmixormgoddard: Is change like this: http://paste.openstack.org/show/754117/ ok for community?10:50
brtknrmgoddard: tyvm10:50
mgoddardgoldyfruit: yeah10:51
mgoddardbrtknr: yvw10:51
goldyfruitmgoddard, I got +1 from Zull since I rebased/updated but I'm sure if this patch is very useful10:53
mgoddardgoldyfruit: yeah, just commenting - it doesn't do anything right now :)10:53
goldyfruitTo validate Masakari, we need to spawn an instance with HA_enable property and then kill the KVM process and check if Nova starts the VM back10:54
goldyfruitmgoddard +!10:54
goldyfruit+110:54
mgoddardgoldyfruit: that should be possible. We have test scripts in tests/test-*.sh10:54
mgoddardvmixor: which branch are you on? check master - we already have it10:56
yoctozeptomgoddard: https://review.opendev.org/669631 <- or would you prefer that split?10:56
mgoddardvmixor: also stable/stein has it10:56
goldyfruitmgoddard, I'll have a look10:57
mgoddardyoctozepto: the split looks like it would work. I can see this getting out of hand though if we have many branches in config files and variables that could be undefined11:01
mgoddardyoctozepto: is this something that has changed in a recent version of ansible or jinja?11:03
yoctozeptomgoddard: checked with ansible 2.5 and 2.811:03
mgoddardhmm11:03
yoctozeptodid not check jinja11:03
yoctozeptoin both cases it was the latest - 2.10.111:04
yoctozeptoseems they had a delay in releases11:04
yoctozeptoand it has a security fix for 2.10 released 2 years earlier11:04
yoctozeptohttps://github.com/pallets/jinja/commit/a2a6c930bcca591a25d2b316fcfd2d6793897b2611:06
yoctozeptodoubt it could be breaking11:06
*** hjensas is now known as hjensas|lunch11:06
yoctozeptoit got me too, I thought the conditional was wrong but it was fine11:07
*** priteau has joined #openstack-kolla11:08
*** luksky11 has joined #openstack-kolla11:11
mgoddardyoctozepto: https://github.com/markgoddard/ansible-experiments/tree/master/04-templates11:12
mgoddardyoctozepto: simple case seems to work11:12
*** priteau has quit IRC11:16
*** kplant has joined #openstack-kolla11:17
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Test MariaDB operations in CI  https://review.opendev.org/65566311:18
yoctozeptomgoddard: yeah, I knew it worked11:24
yoctozeptonow why not here11:24
mgoddardhmm11:24
yoctozeptoI'll experiment11:24
mgoddardwould be nice to see a minimal example that doesn't work11:25
mgoddardansible would be simple, if it weren't for all the little oddities11:25
*** Wasaac has quit IRC11:27
mgoddardyoctozepto: isn't the problem just that we did not have {% if service_name == 'nova-compute' %}11:30
yoctozeptomgoddard: nope, tested thrice ;p11:31
mgoddard:(11:32
yoctozeptotrying for the smallest failure sample11:32
yoctozeptoansible quirk hunters 8-)11:32
mnasiadkaso... the ubuntu ceph-nfs problem is some RPC problem... digging...11:34
yoctozeptomnasiadka: missing rpcbind or dbus stuff?11:35
mnasiadkayoctozepto: might be - http://logs.openstack.org/15/669315/2/check/kolla-ansible-ubuntu-source-ceph/3952232/primary/logs/kolla/ceph/ceph-nfs.txt.gz11:35
*** happyhemant has joined #openstack-kolla11:37
mnasiadkaI'll try to force nfsv4, which shouldn't need rpcbind11:38
ohwhyosahttps://bugs.launchpad.net/kolla-ansible/+bug/1835735 --> When you have time (i see you are kinda busy) could someone take a look at this?11:39
openstackLaunchpad bug 1835735 in kolla-ansible "initrunonce fails with opendaylight" [Undecided,New]11:39
yoctozeptoohwhyosa: yikes, horrifying11:42
yoctozeptoneed someone knowledgeable to take a look11:42
ohwhyosayoctozepto: horrifying as a bug report (meaning, I should work on my bug reporting skills) or as a bug itself?11:42
ohwhyosaor both xP11:43
openstackgerritRaimund Hook (stingrayza) proposed openstack/kolla-ansible stable/stein: fixed spelling of 'Bootstrapping' in tools/kolla-ansible  https://review.opendev.org/66964311:44
stingrayza:) hoping to get :point_up: into stein release, but not major if it doesn't get there :)11:45
yoctozeptoohwhyosa: horrifying error to get as it makes little sense to me atm11:47
*** rgogunskiy has joined #openstack-kolla11:47
yoctozeptostingrayza: hopefully we arrive at the point where all our changes will be like yours now11:48
ohwhyosayoctozepto: Yeah, I was a bit like... why doesn't the database exist?11:49
stingrayza:D11:50
*** henriqueof has joined #openstack-kolla11:59
*** sean-k-mooney has quit IRC12:03
mgoddardohwhyosa: init-runonce is really just for testing. I don't think it's guaranteed to work in every environment12:04
mgoddardohwhyosa: looks like the neutron ODL database tables have not been configured. Normally this happens during initial deploy. There is a bug where it is not done on every deploy though, that could be the issue12:06
*** shyamb has quit IRC12:14
*** shyamb has joined #openstack-kolla12:14
*** sean-k-mooney has joined #openstack-kolla12:16
ohwhyosamgoddard:  Thanks!12:18
ohwhyosaSo it does work on some deploys on the same systems, or I have it guaranteed that it doesn't work on the same system?12:19
yoctozeptohttps://github.com/markgoddard/ansible-experiments/pull/112:20
yoctozeptomgoddard: ^ certainly you did not expect your repo to receive a pull request ;p12:20
yoctozeptothis loss of bug needed fixing asap12:21
*** goldyfruit has quit IRC12:22
*** skramaja_ has quit IRC12:24
mgoddardyoctozepto: nice :)12:34
mgoddardyoctozepto: so simple fix would be to use migration_interface rather than migration_interface_address?12:35
mgoddardyoctozepto: or allow for undefined migration_interface and add a precheck to ensure it is defined where necessary12:40
*** Wasaac has joined #openstack-kolla12:40
mgoddardjust thinking of things we could apply to other *_interface variables easily12:41
*** edleafe has joined #openstack-kolla12:42
openstackgerritMariusz Karpiarz proposed openstack/kolla-ansible master: Handle more return codes from nova-status upgrade check  https://review.opendev.org/66817712:43
ohwhyosaHmmm I happily destroyed and tried again with normal openvswitch (which AIO worked amazingly) but it does not create the bridges so creating an instance in nova fails miserably12:47
ohwhyosaAnd then ovs-vsctl just hangs there12:47
ohwhyosaShould my eno2 (the one I assign on the globals file to neutron external) be down or up during deployment? is it okay if it has an ipv6 but no ipv4?12:48
yoctozepto<mgoddard> yoctozepto: so simple fix would be to use migration_interface rather than migration_interface_address?12:48
yoctozeptougly!12:48
yoctozepto<mgoddard> yoctozepto: or allow for undefined migration_interface and add a precheck to ensure it is defined where necessary12:48
yoctozeptothe problem is they are all "defined"12:48
yoctozeptoonly the indexing is really a failure12:48
mgoddardyeah, but that failure makes it undefined12:49
yoctozeptoalso, using |default does not help12:49
yoctozeptomaybe let's go with what I crafted so carefully and in the meantime report a bug to ansible?12:50
yoctozeptoseems odd enough to be a bug12:50
mgoddardyoctozepto: I'm not against your approach as a one off, just concerned we'll hit the same elsewhere and we'll end up splitting lots of config files which will get messy12:50
yoctozeptoI share your concerns, hence  upstreaming the problem to ansible might be worth it12:51
mgoddardohwhyosa: I think your neutron external interface should be up12:51
yoctozeptoanyways, nova.conf grew pretty much so it deserves splitting ;p12:51
mgoddardyoctozepto: +1, would be nice to get a fix in ansible. Could take time though12:52
yoctozeptomgoddard: then we might find a solution till then, no more similar issues so far so could be only this one since nova shares so much config12:53
yoctozeptowe usually bail out at the ansible level12:54
*** hjensas|lunch is now known as hjensas12:54
ohwhyosamgoddard: good, it is up! I did a kolla-reconfigure after changing type=vxlan for type=flat, it managed to create and bring up the br-ext... but now it complains that br-int does not exist when creating an instance, though ovs-vsctl does show a br-int configured12:55
mgoddardyoctozepto: I think tunnel_interface_address will have the same issue12:55
*** KeithMnemonic has joined #openstack-kolla12:57
mgoddardohwhyosa: is this still dpdk?12:57
ohwhyosaNope, i tried to reduce complexity12:57
ohwhyosaPastebinning my globals.yml in a second12:58
ohwhyosamgoddard: https://pastebin.com/C5mqq2w313:00
ohwhyosaI believe that is all, apart from the change i did to neutron plugin in /etc/kolla/neutron-openvswitch-agent/ml2_xxx.ini13:01
ohwhyosahttps://pastebin.com/XYbWf68H this is ovs-vsctl show13:03
mgoddardohwhyosa: looks like neutron OVS agent can't reach OVS for some reason. did you reconfigure neutron too?13:04
ohwhyosaHmmm nope, i think13:04
ohwhyosaBy the way, there is no way for the config to be all in /etc/kolla/{service} on deployment host, right? instead of it being on each node13:05
ohwhyosaAnd also, for adding central_logging, kolla-ansible deploy or kolla-ansible reconfigure? silly question, i guess13:07
mgoddardohwhyosa: you only ever need to change config on localhost, kolla-ansible generates config on nodes13:07
mgoddarddeploy for adding a new service13:08
ohwhyosamgoddard: But which localhost? I have 1 deployment, 1 controller, 1 storage and 1 network-compute13:08
ohwhyosadeploy doesn't have any service config (apart from globals)13:09
ohwhyosathey are on each node (as in, kolla-controller has some in /etc/kolla/{service} , kolla-storage some others13:09
*** goldyfruit has joined #openstack-kolla13:10
mgoddardohwhyosa: deployment13:10
ohwhyosathat is the expected behaviour right?13:10
mgoddardthat's expected13:11
*** Wasaac has quit IRC13:11
ohwhyosaOh, good, okay, I thought the config files would also be centralized on deployment for ease of access13:12
*** Wasaac has joined #openstack-kolla13:12
ohwhyosaWhich doesn't mean it is not easy, still lovng kolla, in case it sounded like that13:13
*** Wasaac has quit IRC13:14
openstackgerritMariusz Karpiarz proposed openstack/kolla-ansible master: Handle more return codes from nova-status upgrade check  https://review.opendev.org/66817713:14
*** Wasaac has joined #openstack-kolla13:14
*** henriqueof has quit IRC13:15
*** gkadam has joined #openstack-kolla13:24
*** gkadam has quit IRC13:26
*** Wasaac has quit IRC13:29
*** Wasaac has joined #openstack-kolla13:29
mgoddardohwhyosa: when you say ease of access, do you mean for reading not writing?13:36
*** shyamb has quit IRC13:46
ohwhyosaBoth13:47
*** Luzi has quit IRC13:48
ohwhyosaMeaning, if I have it all on my deployment node on /etc/kolla/{service}/{config} then it would be easy to just write and check config and then kolla-ansible reconfigure from the same host (the deployment one)13:48
ohwhyosaNow i have to go to, say, neutron host, change the config there, then on the deployment host kolla-ansible -i multinode reconfigure13:50
*** BjoernT has joined #openstack-kolla13:52
mgoddardohwhyosa: you shouldn't ever modify files under /etc/kolla/{service}13:57
mgoddardohwhyosa: changes will be overwritten13:57
mgoddardif you need to modify config files, follow this: https://docs.openstack.org/kolla-ansible/latest/admin/advanced-configuration.html#openstack-service-configuration-in-kolla13:58
mgoddardonly needs changing on the deployment host13:58
ohwhyosamgoddard: Thanks, easier still then14:01
ohwhyosaI read that but i got it all backwards14:01
*** priteau has joined #openstack-kolla14:02
*** baha has joined #openstack-kolla14:02
*** rgogunskiy has quit IRC14:04
*** FlorianFa has quit IRC14:05
ohwhyosaOkay, some progress14:08
ohwhyosait seems ovs-vsctl now created the br-int and some others properly14:08
ohwhyosaafter restarting some containers in good order14:08
ohwhyosaand there is one netns now14:08
ohwhyosabut still neutron dhcp complains there is no br-int14:09
ohwhyosahttps://pastebin.com/L5n4MCRY14:09
ohwhyosaI put there both the log and the ovs-vsctl14:09
*** dmellado has quit IRC14:09
ohwhyosaThe former first, the latter at the bottom14:09
*** dmellado has joined #openstack-kolla14:11
ohwhyosaWell, now i'm getting another seemingly nasty error14:15
openstackgerritPierre Riteau proposed x/kayobe master: Move paramiko cap to test-requirements.txt  https://review.opendev.org/66509314:15
ohwhyosaBut progress, that's something at least14:15
*** dpawlik has quit IRC14:24
*** dmellado has quit IRC14:30
*** k_mouza has joined #openstack-kolla14:31
*** dmellado has joined #openstack-kolla14:32
yoctozepto<mgoddard> yoctozepto: I think tunnel_interface_address will have the same issue14:44
yoctozeptomhm14:44
yoctozeptocould be14:44
yoctozeptonope:14:45
yoctozepto    services_need_ml2_conf_ini:14:45
yoctozepto      - "neutron-linuxbridge-agent"14:45
yoctozepto      - "neutron-openvswitch-agent"14:45
yoctozepto      - "neutron-infoblox-ipam-agent"14:45
yoctozepto      - "neutron-server"14:45
yoctozeptoand they all need tunnel_interface anyway14:45
yoctozeptounless I'm missing something?14:46
yoctozeptothough precheck for tunnel interface is missing14:46
*** k_mouza has quit IRC14:47
*** gouthamr has quit IRC14:47
yoctozeptoit was not missing for migration though14:47
yoctozepto;p14:47
mnasiadkaso, in ganesha 2.6.0 (supplied by Ubuntu with Ceph Mimic) - forget about not running rpcbind or similar14:49
*** dmellado has quit IRC14:49
*** cah_link has quit IRC14:49
yoctozeptomnasiadka: hmm? why so?14:49
mnasiadkayoctozepto: because the code to support nfsv4 only without checking for rpcbind is in 2.7.x14:50
mgoddardyoctozepto: just finishing off the last every kayobe meeting :)14:50
yoctozeptomnasiadka: :-(14:50
*** cah_link has joined #openstack-kolla14:50
yoctozeptomgoddard: cool, I'm on the move so will be back in a bit again14:51
yoctozeptoI made a todo note to myself to report the bug to ansible14:52
yoctozeptomaybe they could take care of it14:52
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: DNM: Troubleshoot ceph-nfs on ubuntu  https://review.opendev.org/66931514:53
*** dmellado has joined #openstack-kolla14:53
mnasiadkayoctozepto: usually it means they will take care of it in 2.11 :)14:53
mnasiadka(if you report the bug today)14:53
*** gouthamr has joined #openstack-kolla14:56
*** jovial[m] has joined #openstack-kolla14:57
openstackgerritMerged openstack/kolla-ansible stable/stein: Bump minimum Ansible version to 2.5  https://review.opendev.org/66962714:59
openstackgerritMerged openstack/kolla-ansible stable/stein: Wait for all compute services before cell discovery  https://review.opendev.org/66932114:59
openstackgerritMark Goddard proposed x/kayobe master: Use new kolla-ansible upgrade-bifrost command  https://review.opendev.org/66763215:03
openstackgerritMark Goddard proposed x/kayobe master: Revert "Workaround: stop bifrost services before seed upgrade"  https://review.opendev.org/66888815:04
mgoddardyoctozepto: strictly I don't think neutron-server needs data plane access15:07
mgoddardnot sure about infoblox15:08
openstackgerritMerged openstack/kolla-ansible stable/stein: fixed spelling of 'Bootstrapping' in tools/kolla-ansible  https://review.opendev.org/66964315:10
*** BjoernT_ has joined #openstack-kolla15:11
*** k_mouza has joined #openstack-kolla15:14
*** BjoernT has quit IRC15:14
*** ivve has quit IRC15:16
*** Wasaac has quit IRC15:18
*** Wasaac_ has joined #openstack-kolla15:18
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/rocky: Wait for all compute services before cell discovery  https://review.opendev.org/66969815:19
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/queens: Wait for all compute services before cell discovery  https://review.opendev.org/66970015:20
*** Wasaac_ has quit IRC15:24
*** Wasaac has joined #openstack-kolla15:25
*** Wasaac has quit IRC15:26
*** Wasaac has joined #openstack-kolla15:27
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/rocky: Fixes for MariaDB bootstrap and recovery  https://review.opendev.org/66970115:28
*** Wasaac has quit IRC15:29
*** Wasaac has joined #openstack-kolla15:30
*** henriqueof has joined #openstack-kolla15:30
*** Wasaac has quit IRC15:32
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/queens: Fixes for MariaDB bootstrap and recovery  https://review.opendev.org/66970315:32
*** Wasaac has joined #openstack-kolla15:32
*** Wasaac has quit IRC15:34
*** Wasaac has joined #openstack-kolla15:35
mgoddardProposed patch to release kolla and kolla-ansible 8.0.0: 8a09547e270e716495183600b5d167983577924715:37
mgoddardhttps://review.opendev.org/66970715:37
yoctozeptomgoddard: +115:40
yoctozepto<mgoddard> yoctozepto: strictly I don't think neutron-server needs data plane access15:41
yoctozeptoright-yo, it's neutron-api if it followed nova naming15:41
mgoddardyeah15:41
yoctozeptook, checked the inventory, it would be separate and fail if I ran network nodes separate from control nodes15:43
ohwhyosahmmm is it still current, with kibana, adding the log-* index?15:43
ohwhyosaIt tells me15:43
yoctozepto{% if inventory_hostname in groups["network"] or inventory_hostname in groups["compute"] %}15:43
yoctozeptolocal_ip = {{ tunnel_interface_address }}15:43
yoctozepto{% endif %}15:43
ohwhyosaUnable to fetch mapping. Do you have indices matching the pattern?15:43
yoctozeptowe guard it but know we know it will fail anyways15:43
yoctozeptonow* we know15:44
yoctozeptoinfoblox should have tunnel interface by the way it looks though15:45
yoctozeptoso it's neutron-server to protect here15:45
yoctozeptoand also add a precheck15:45
yoctozeptobecause there is none15:45
yoctozepto;p15:45
vmixormgoddard: my mistake, I was using my branch created from master 2 or 3 weeks ago15:57
ohwhyosaokay, it is now flog, i have it now15:57
mgoddardvmixor: no problem16:02
*** hamzaachi has quit IRC16:02
openstackgerritGaëtan Trellu proposed openstack/kolla-ansible master: Testing Masakari role in gate  https://review.opendev.org/61605016:03
*** k_mouza has quit IRC16:07
*** whoami-rajat has quit IRC16:10
*** BjoernT has joined #openstack-kolla16:11
*** hamzaachi has joined #openstack-kolla16:14
openstackgerritMerged x/kayobe master: Support customising Prometheus config  https://review.opendev.org/65566916:14
*** whoami-rajat has joined #openstack-kolla16:15
*** BjoernT_ has quit IRC16:15
openstackgerritMerged x/kayobe master: Support customising refactored HAProxy config  https://review.opendev.org/66854716:17
yoctozeptoa few more deliverables and we become a lively channel16:18
*** k_mouza has joined #openstack-kolla16:19
openstackgerritMerged x/kayobe master: Fix custom ironic python agent environmental variables  https://review.opendev.org/66742216:24
*** Wasaac has quit IRC16:26
*** Sravan has joined #openstack-kolla16:27
*** Sravan has quit IRC16:32
openstackgerritMark Goddard proposed x/kayobe stable/rocky: Fix custom ironic python agent environmental variables  https://review.opendev.org/66971116:32
openstackgerritMark Goddard proposed x/kayobe stable/queens: Fix custom ironic python agent environmental variables  https://review.opendev.org/66971216:32
openstackgerritMark Goddard proposed x/kayobe stable/rocky: Add retries to ansible galaxy install for all envs  https://review.opendev.org/66971316:33
openstackgerritMark Goddard proposed x/kayobe stable/rocky: Add config tags to kolla-openstack play  https://review.opendev.org/66971416:33
openstackgerritMark Goddard proposed x/kayobe stable/queens: Add config tags to kolla-openstack play  https://review.opendev.org/66971516:33
*** igordc has joined #openstack-kolla16:37
*** Sravan has joined #openstack-kolla16:39
vmixormgoddard: Is there mechanism to override default Debian sources.list and/or to add backports? Buster release contains packages for Rocky by default.16:40
mgoddardvmixor: stein containers should have stein packages16:41
mgoddardvmixor: although hrw knows most about debian but he is out this week16:43
mgoddardvmixor: you can override the block base_ubuntu_package_sources_list if you want to provide your own sources.list though16:44
mgoddardvmixor: https://docs.openstack.org/kolla/latest/admin/index.html#building-container-images16:44
*** k_mouza has quit IRC16:46
*** ivve has joined #openstack-kolla16:48
*** rpittau is now known as rpittau|afk16:50
*** cah_link has quit IRC16:50
*** luksky11 has quit IRC16:51
openstackgerritPierre Riteau proposed x/kayobe master: Add support for overriding OpenStack configuration globally  https://review.opendev.org/66572116:51
*** cah_link has joined #openstack-kolla16:52
openstackgerritMerged openstack/kolla master: Add Python 3 Train unit tests  https://review.opendev.org/66937517:00
*** cah_link has quit IRC17:02
*** Sravan has quit IRC17:05
*** k_mouza has joined #openstack-kolla17:06
*** k_mouza has quit IRC17:06
*** dasp has quit IRC17:06
vmixormgodard: thank you17:07
*** igordc has quit IRC17:10
*** henriqueof has quit IRC17:12
*** Sravan has joined #openstack-kolla17:17
*** priteau has quit IRC17:21
openstackgerritMerged openstack/kolla-ansible master: Add Python 3 Train unit tests  https://review.opendev.org/66937617:24
*** jonaspaulo has joined #openstack-kolla17:25
*** hamzaachi has quit IRC17:27
*** henriqueof has joined #openstack-kolla17:32
*** unicell has joined #openstack-kolla17:41
*** igordc has joined #openstack-kolla17:41
*** dasp has joined #openstack-kolla17:42
*** igordc has quit IRC17:43
*** igordc has joined #openstack-kolla17:46
yoctozeptomgoddard: reported ~> https://github.com/ansible/ansible/issues/5883517:48
mgoddardyoctozepto: nice!17:48
mgoddardyoctozepto: now for another weird ansible issue, our discovery wait is broken in ansible <2.817:48
yoctozeptololz!17:49
yoctozeptohow so?17:49
yoctozeptomgoddard: need failure example17:51
mgoddardyoctozepto: https://github.com/markgoddard/ansible-experiments/tree/master/05-referencing-registered-var-do-until17:52
mgoddardwill push a fix17:52
mgoddardwill pause the release :(17:52
yoctozeptomgoddard: :-(17:53
*** cgrosjean has quit IRC17:57
yoctozeptomgoddard: maybe we should seriously consider supporting only the latest ansible - setting up a virtualenv for users is a blink of an eye and supporting so many ansible releases makes it impractical17:58
kplantyeah virtualenv is magic17:59
mgoddardyoctozepto: perhaps. if we add ansible to requirements.txt we could control it17:59
kplantopenstack-ansible doesn't even give the end-user a choice17:59
yoctozeptomgoddard: the lol thing about it is that my test plugin I abandoned would avoid this issue, life is brutal ;p17:59
kplanti think that's a pretty good approach imo17:59
mgoddardstill, the version will be different for different releases18:00
yoctozeptokplant: it's because ansible is pretty unstable stills18:00
mgoddardbut this is what we do with kayobe18:00
yoctozeptomgoddard: yeah but we could then pin one and test one18:00
kplantyoctozepto: yeah but forcing the version and accompanying requirements would help with that18:00
mgoddardyoctozepto: yeah18:00
mgoddardwe're stuck for stein and earlier though18:00
mgoddardtesting min and max will help a lot18:00
yoctozeptomgoddard: yeah, unfortunately18:00
kplantnot hoping joe operator is going to pip install ansible==2.7.1.3.5.2.rc1518:01
yoctozepto+118:01
mgoddardwould have caught this18:01
yoctozeptoyeah, test18:01
yoctozeptobut also think it over for future18:01
yoctozeptoreleases18:01
yoctozeptomgoddard: I think the best approach now is to make it uglier by throwing the expansion in 'util'18:02
yoctozeptoand be happy with the new knowledge18:02
mgoddardyoctozepto: yeah, working on it18:02
yoctozeptomgoddard: and remember the <2.8 compat comment18:03
yoctozeptoit seriously makes reading friendlier ;D18:03
*** BjoernT_ has joined #openstack-kolla18:05
*** BjoernT has quit IRC18:06
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Fix nova deploy with Ansible<2.8  https://review.opendev.org/66973018:08
mgoddardyoctozepto: seems we also didn't deprecate ceph: https://review.opendev.org/#/c/669214/18:09
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Test minimum supported and latest versions of Ansible  https://review.opendev.org/66841318:09
*** cgrosjean has joined #openstack-kolla18:19
*** whoami-rajat has quit IRC18:20
*** priteau has joined #openstack-kolla18:22
yoctozeptomgoddard: I deprecate18:25
yoctozeptoas soon as it merges there is a backport to stein18:25
yoctozeptono kidding18:25
*** hamzaachi has joined #openstack-kolla18:34
*** cgrosjea_ has joined #openstack-kolla18:52
*** cgrosjea_ has quit IRC18:52
*** cgrosjean has quit IRC18:55
*** whoami-rajat has joined #openstack-kolla18:57
*** BjoernT_ has quit IRC19:05
*** cloudnull is now known as cloudkiller19:25
*** BjoernT has joined #openstack-kolla19:28
*** factor has quit IRC19:30
*** factor has joined #openstack-kolla19:30
*** Sravan has quit IRC19:35
*** BjoernT_ has joined #openstack-kolla19:41
*** unicell has quit IRC19:44
*** BjoernT has quit IRC19:44
*** icarusfactor has joined #openstack-kolla19:45
*** factor has quit IRC19:47
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Test minimum supported and latest versions of Ansible  https://review.opendev.org/66841319:57
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Fix nova deploy with Ansible<2.8  https://review.opendev.org/66973019:58
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Test minimum supported and latest versions of Ansible  https://review.opendev.org/66841319:59
*** factor has joined #openstack-kolla20:01
*** icarusfactor has quit IRC20:03
*** kplant has quit IRC20:05
*** luksky11 has joined #openstack-kolla20:25
*** icarusfactor has joined #openstack-kolla20:25
*** factor has quit IRC20:27
*** priteau has quit IRC20:44
*** priteau has joined #openstack-kolla20:49
*** pcaruana has quit IRC20:50
*** whoami-rajat has quit IRC21:00
*** Sravan has joined #openstack-kolla21:06
*** BjoernT_ has quit IRC21:07
*** goldyfruit has quit IRC21:14
*** priteau has quit IRC21:27
*** priteau has joined #openstack-kolla21:27
*** cloudkiller is now known as cloudnull21:27
*** kplant has joined #openstack-kolla21:28
*** priteau has quit IRC21:29
*** Sravan has quit IRC21:31
*** henriqueof has quit IRC21:35
*** Sravan has joined #openstack-kolla21:36
*** ivve has quit IRC21:39
*** hamzaachi has quit IRC21:41
*** Sravan has quit IRC21:41
*** hamzaachi has joined #openstack-kolla21:42
*** Sravan has joined #openstack-kolla21:45
*** hamzaachi has quit IRC21:49
*** Sravan has quit IRC21:50
*** Sravan has joined #openstack-kolla21:51
*** cgrosjean has joined #openstack-kolla22:01
*** Sravan has quit IRC22:09
*** Sravan has joined #openstack-kolla22:12
*** Sravan has quit IRC22:13
*** Sravan has joined #openstack-kolla22:13
*** k_mouza has joined #openstack-kolla22:15
*** k_mouza has quit IRC22:18
*** luksky11 has quit IRC22:19
openstackgerritMerged openstack/kolla-ansible master: Deprecate Ceph deployment  https://review.opendev.org/66921422:22
*** cgrosjean has quit IRC22:31
*** goldyfruit has joined #openstack-kolla22:56
*** jonaspaulo has quit IRC23:14
*** goldyfruit has quit IRC23:19
*** Sravan has quit IRC23:30
*** BjoernT has joined #openstack-kolla23:48
« Sunday, 2019-07-07 Index Tuesday, 2019-07-09 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!