| *** jralbert has joined #openstack-ansible | 00:03 | |
| jralbert | Asking again, does anybody know the status of this bug: https://bugs.launchpad.net/openstack-ansible/+bug/1815043 | 00:03 |
|---|---|---|
| openstack | Launchpad bug 1815043 in openstack-ansible "running os-nova-install.yml --tags nova-config does note generate config" [Undecided,New] | 00:03 |
| jralbert | All of the tags (nova-config, neutron-config, nova-keys, etc) that used to work when passed to the os_nova.yml and os_neutron.yml playbooks are no longer functional, apparently because the role invocations have been passed down to these common-playbooks via include. This is a pretty major problem since it now means running full | 00:05 |
| jralbert | potentially-destructive plays for every tiny change, including scaling the environment | 00:05 |
| jralbert | Given the bug's been open a year and not triaged, I'm kind of assuming it's not going to be fixed at this point, so I guess maybe the more relevant question is whether bugs are still being actively triaged and fixed in OSA at this time? I can make a case to our management to dedicate some resources to contributing to the project if they're needed, | 00:10 |
| jralbert | but I haven't heard that such issues had arisen. | 00:10 |
| *** prometheanfire has joined #openstack-ansible | 00:13 | |
| *** prometheanfire has quit IRC | 00:15 | |
| *** nicolasbock has quit IRC | 00:30 | |
| *** nicolasbock has joined #openstack-ansible | 00:31 | |
| *** openstackstatus has joined #openstack-ansible | 00:43 | |
| *** ChanServ sets mode: +v openstackstatus | 00:43 | |
| *** nicolasbock has quit IRC | 00:43 | |
| *** jralbert has quit IRC | 00:53 | |
| *** prometheanfire has joined #openstack-ansible | 01:06 | |
| djhankb | CeeMac: I have a custom template that I copy to /etc/ansible/roles/lxc_container_create/templates/veth-cleanup.sh.j2 prior to building the containers. https://gitlab.com/snippets/1952211 | 01:16 |
| djhankb | CeeMac: The issue is that without this, when a container is stopped, the OVS port isn't cleaned up, and there's no "--may-exist" flag that is set in LXC prior to the container trying to start, which causes it to bomb. | 01:17 |
| djhankb | CeeMac: The other issue - is that if you're using faux-bridges with VLAN tags, there's some other hooks you need to put in place in order to get it to tag the container VETH on the right VLAN. | 01:19 |
| djhankb | So that's why I was saying that running OVS for everything is a bit Sadistic :-) There's also some other stuff regarding bootup of a controller node where stuff can get started out of order. | 01:20 |
| openstackgerrit | Merged openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests https://review.opendev.org/712374 | 01:23 |
| openstackgerrit | Merged openstack/ansible-role-systemd_networkd master: Updated from OpenStack Ansible Tests https://review.opendev.org/712399 | 01:25 |
| *** DanyC has quit IRC | 01:28 | |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests https://review.opendev.org/712366 | 01:28 |
| openstackgerrit | Merged openstack/openstack-ansible-os_panko master: Updated from OpenStack Ansible Tests https://review.opendev.org/712386 | 01:28 |
| *** DanyC has joined #openstack-ansible | 01:28 | |
| *** DanyC has quit IRC | 01:33 | |
| *** gyee has quit IRC | 01:51 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/train: Bump SHAs for stable/train https://review.opendev.org/711851 | 02:40 |
| *** KeithMnemonic1 has joined #openstack-ansible | 03:28 | |
| *** KeithMnemonic has quit IRC | 03:31 | |
| *** dave-mccowan has quit IRC | 03:58 | |
| *** KeithMnemonic1 has quit IRC | 04:06 | |
| *** udesale has joined #openstack-ansible | 04:17 | |
| *** evrardjp has quit IRC | 05:35 | |
| *** evrardjp has joined #openstack-ansible | 05:36 | |
| CeeMac | djhankb: yeah that sounds entirely like the wrong kind of fun :p | 06:07 |
| *** miloa has joined #openstack-ansible | 06:09 | |
| CeeMac | I'm using ovs primarily for future proofing against the need for things like DVR and dpdk. I'm still not familiar enough with it to use it globally, it can be a bit tricky for diagnosing network issues and debugging flow rules | 06:09 |
| *** prometheanfire has quit IRC | 06:26 | |
| *** prometheanfire has joined #openstack-ansible | 06:28 | |
| *** prometheanfire has quit IRC | 06:36 | |
| *** prometheanfire has joined #openstack-ansible | 06:37 | |
| *** prometheanfire has quit IRC | 07:10 | |
| *** prometheanfire has joined #openstack-ansible | 07:16 | |
| *** prometheanfire has quit IRC | 07:17 | |
| *** rpittau|afk is now known as rpittau | 07:17 | |
| *** prometheanfire has joined #openstack-ansible | 07:20 | |
| *** cshen has joined #openstack-ansible | 07:33 | |
| *** DanyC has joined #openstack-ansible | 07:51 | |
| *** tosky has joined #openstack-ansible | 08:18 | |
| *** gchamoul is now known as strider|afk | 08:27 | |
| *** strider|afk is now known as gchamoul | 08:27 | |
| *** DanyC has quit IRC | 08:28 | |
| *** fghaas has joined #openstack-ansible | 08:28 | |
| *** jbadiapa has joined #openstack-ansible | 08:36 | |
| *** xakaitetoia has joined #openstack-ansible | 08:44 | |
| *** rpittau is now known as rpittau|bbl | 08:52 | |
| *** pcaruana has joined #openstack-ansible | 08:54 | |
| *** sluna has quit IRC | 08:58 | |
| *** sluna has joined #openstack-ansible | 08:58 | |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible-repo_server master: lsyncd.lua.j2: update coding style https://review.opendev.org/712625 | 09:11 |
| *** fghaas has left #openstack-ansible | 09:16 | |
| *** DanyC has joined #openstack-ansible | 09:37 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:39 | |
| *** ansmith_ has joined #openstack-ansible | 09:57 | |
| *** ansmith has quit IRC | 10:00 | |
| jrosser | noonedeadpunk: is this a py2<>3 error againhttps://zuul.opendev.org/t/openstack/build/1c90ac91baac47448aed4244e24a2925/log/job-output.txt#13977-13986 | 10:06 |
| jrosser | its a distro job so i expect everything remains py2? | 10:07 |
| noonedeadpunk | iirc ceilometer don't have distro installation? | 10:09 |
| noonedeadpunk | but yeah, looking into that | 10:14 |
| noonedeadpunk | actually hardcoding path to lib is the bad pattern anyway... | 10:16 |
| noonedeadpunk | oh, it has distro install... And I guess we do depend on rdo here? | 10:21 |
| noonedeadpunk | https://opendev.org/openstack/openstack-ansible-os_ceilometer/src/branch/master/vars/redhat-7.yml#L28-L32 | 10:22 |
| jrosser | yeah - so i guess that looking in py3.6 lib dir is not going to work there | 10:24 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Use py3 for CentOS https://review.opendev.org/712096 | 10:24 |
| jrosser | so it's all about whatever ceilometer_lib_dir ends up being | 10:25 |
| noonedeadpunk | yeah | 10:26 |
| *** DanyC_ has joined #openstack-ansible | 10:30 | |
| *** DanyC has quit IRC | 10:33 | |
| *** pcaruana has quit IRC | 10:42 | |
| openstackgerrit | Duncan Martin Walker proposed openstack/openstack-ansible-ops master: Subdivision of elastic-logstash group https://review.opendev.org/707849 | 10:50 |
| openstackgerrit | Duncan Martin Walker proposed openstack/openstack-ansible-ops master: Expose Elasticsearch discovery nodes https://review.opendev.org/708826 | 10:50 |
| *** pcaruana has joined #openstack-ansible | 10:55 | |
| *** nicolasbock has joined #openstack-ansible | 10:57 | |
| *** jamesdenton has joined #openstack-ansible | 11:01 | |
| *** nicolasbock has quit IRC | 11:15 | |
| *** nicolasbock has joined #openstack-ansible | 11:16 | |
| *** DanyC_ has quit IRC | 11:17 | |
| *** sshnaidm has quit IRC | 11:18 | |
| *** DanyC has joined #openstack-ansible | 11:18 | |
| *** sshnaidm has joined #openstack-ansible | 11:19 | |
| *** sshnaidm has quit IRC | 11:22 | |
| *** DanyC has quit IRC | 11:27 | |
| *** DanyC has joined #openstack-ansible | 11:27 | |
| *** cshen has quit IRC | 11:28 | |
| *** sshnaidm has joined #openstack-ansible | 11:30 | |
| *** sshnaidm has quit IRC | 11:30 | |
| *** nicolasbock has quit IRC | 11:38 | |
| *** nicolasbock has joined #openstack-ansible | 11:40 | |
| *** nicolasbock has quit IRC | 11:42 | |
| *** nicolasbock has joined #openstack-ansible | 11:43 | |
| *** cshen has joined #openstack-ansible | 11:45 | |
| *** rgogunskiy has joined #openstack-ansible | 11:46 | |
| openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-haproxy_server master: Add server specific backend options https://review.opendev.org/712660 | 11:48 |
| *** nicolasbock has quit IRC | 11:51 | |
| *** cshen has quit IRC | 11:51 | |
| *** sshnaidm has joined #openstack-ansible | 11:52 | |
| *** sshnaidm has quit IRC | 11:53 | |
| *** sshnaidm has joined #openstack-ansible | 11:54 | |
| *** ansmith_ has quit IRC | 11:54 | |
| *** nicolasbock has joined #openstack-ansible | 11:54 | |
| *** cshen has joined #openstack-ansible | 11:55 | |
| *** nicolasbock has quit IRC | 11:56 | |
| *** nicolasbock has joined #openstack-ansible | 11:57 | |
| *** udesale_ has joined #openstack-ansible | 12:14 | |
| *** udesale has quit IRC | 12:17 | |
| *** rh-jelabarre has joined #openstack-ansible | 12:24 | |
| *** ansmith_ has joined #openstack-ansible | 12:39 | |
| *** ahosam has joined #openstack-ansible | 12:44 | |
| *** alvinstarr has joined #openstack-ansible | 12:48 | |
| *** joshualyle has joined #openstack-ansible | 12:56 | |
| *** rpittau|bbl is now known as rpittau | 13:02 | |
| *** ianychoi has quit IRC | 13:13 | |
| *** spatel has joined #openstack-ansible | 13:21 | |
| *** spatel has quit IRC | 13:26 | |
| *** ygk_12345 has joined #openstack-ansible | 13:28 | |
| *** ygk_12345 has quit IRC | 13:40 | |
| *** ygk_12345 has joined #openstack-ansible | 13:46 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_cinder master: Refactor memcached_servers https://review.opendev.org/712681 | 13:48 |
| guilhermesp | jrosser thoughts ^ ? | 14:00 |
| *** dave-mccowan has joined #openstack-ansible | 14:02 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_glance master: Refactor memcached_servers https://review.opendev.org/712688 | 14:04 |
| jrosser | guilhermesp: i guess there is to approaches | 14:05 |
| jrosser | you are adding a bunch of extra vars there, but you could alternatively just redefine memcached_servers in the group_vars/<service>_all.yml ? | 14:06 |
| jrosser | drop that in /etc/openstack/deploy/group_vars/cinder_all.yml for example? | 14:07 |
| mnaser | jrosser: problem is metal | 14:08 |
| jrosser | ah yes | 14:09 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_nova master: Refactor memcached_servers https://review.opendev.org/712691 | 14:10 |
| guilhermesp | yeah jrosser , in metal we are seeing that memcached_server are being applied globally in metal deployments | 14:17 |
| guilhermesp | I guess I can edit the commit message to add this use case | 14:17 |
| guilhermesp | at the moment I guess it is just one extra var per role, which would be ok i guess? | 14:18 |
| *** spatel has joined #openstack-ansible | 14:25 | |
| *** dave-mccowan has quit IRC | 14:25 | |
| *** dave-mccowan has joined #openstack-ansible | 14:30 | |
| *** ygk_12345 has quit IRC | 14:35 | |
| *** rgogunskiy has quit IRC | 14:36 | |
| *** gyee has joined #openstack-ansible | 14:43 | |
| *** spatel has quit IRC | 14:44 | |
| *** spatel has joined #openstack-ansible | 14:54 | |
| *** spatel has quit IRC | 14:57 | |
| *** spatel has joined #openstack-ansible | 14:58 | |
| *** bverschueren has quit IRC | 14:58 | |
| *** bverschueren has joined #openstack-ansible | 15:03 | |
| *** spatel has quit IRC | 15:03 | |
| openstackgerrit | Merged openstack/openstack-ansible-haproxy_server master: Add server specific backend options https://review.opendev.org/712660 | 15:08 |
| *** spatel has joined #openstack-ansible | 16:00 | |
| *** cshen has quit IRC | 16:01 | |
| *** spatel has quit IRC | 16:01 | |
| *** spatel has joined #openstack-ansible | 16:01 | |
| *** gshippey has joined #openstack-ansible | 16:30 | |
| *** Blinkiz has quit IRC | 16:30 | |
| *** Blinkiz has joined #openstack-ansible | 16:31 | |
| *** udesale_ has quit IRC | 16:49 | |
| *** sshnaidm is now known as sshnaidm|afk | 17:07 | |
| jrosser | noonedeadpunk: i think we broke something https://zuul.opendev.org/t/openstack/build/8e01bdfdc21a472fa08f0c486571c60a/log/job-output.txt#10047 | 17:15 |
| jrosser | seena few of those | 17:15 |
| guilhermesp | yep Im seeing on my patches too | 17:16 |
| noonedeadpunk | feel like running ansible via py2 | 17:16 |
| jrosser | it'll be tasks run against the host | 17:17 |
| jrosser | with the environment of the host rather than ansible-runtime venv | 17:17 |
| noonedeadpunk | I meant ansible_python_interpreter | 17:17 |
| jrosser | me too i think - thats subject to some sort of discovery | 17:18 |
| jrosser | https://docs.ansible.com/ansible/latest/reference_appendices/interpreter_discovery.html | 17:18 |
| noonedeadpunk | hm https://opendev.org/openstack/openstack-ansible/src/branch/master/tests/bootstrap-aio.yml#L27 | 17:19 |
| jrosser | it's failing much later though | 17:23 |
| noonedeadpunk | yeah | 17:23 |
| noonedeadpunk | on setup-openstack.... | 17:23 |
| jrosser | there seems to be a lot of chat in #infra today about py3-ish chagnes to the images | 17:23 |
| *** rpittau is now known as rpittau|afk | 17:27 | |
| *** ahosam has quit IRC | 17:28 | |
| *** ahosam has joined #openstack-ansible | 17:29 | |
| openstackgerrit | Duncan Martin Walker proposed openstack/openstack-ansible-ops master: Enable Filebeat kibana monitoring https://review.opendev.org/712745 | 17:31 |
| *** evrardjp has quit IRC | 17:35 | |
| *** evrardjp has joined #openstack-ansible | 17:36 | |
| Nick_A | Probably too general of a question, but what are some possible reasons why metrics would log properly for some instances but not others on the same compute? | 17:49 |
| *** DanyC_ has joined #openstack-ansible | 18:10 | |
| *** DanyC has quit IRC | 18:13 | |
| *** DanyC_ has quit IRC | 18:15 | |
| noonedeadpunk | Nick_A: do you mean ceilometer? | 18:15 |
| Nick_A | noonedeadpunk yes | 18:16 |
| noonedeadpunk | I can recall such issues pretty far ago and it depended on if instance was created with volume or just with ephemeral drive | 18:17 |
| Nick_A | No volumes involved - local qcow2 | 18:17 |
| noonedeadpunk | so no cinder deployed? | 18:18 |
| noonedeadpunk | and what release? | 18:18 |
| Nick_A | Nope and Rocky | 18:18 |
| noonedeadpunk | So I had such issue.. .https://bugs.launchpad.net/ceilometer/+bug/1801348 | 18:20 |
| openstack | Launchpad bug 1801348 in Ceilometer "notification agent fails with KeyError on volume create/delete" [Undecided,Fix released] - Assigned to Dmitriy Rabotyagov (noonedeadpunk) | 18:20 |
| noonedeadpunk | but if no cinder than it's probably not related... | 18:20 |
| noonedeadpunk | and what's in logs? | 18:21 |
| redkrieg | I've not seen anything specific to the problem instances in logs except for this one, but I see it for functional and non-functional instances: Mar 12 14:02:15 nl-skvm-1 ceilometer-polling[30834]: 2020-03-12 14:02:15.779 30834 WARNING ceilometer.compute.pollsters [-] cpu_l3_cache statistic in not available for instance fc192650-fcb5-40c1-a84f-9eb4c0d4ec34: NoVolumeException | 18:23 |
| noonedeadpunk | hm, I can recall it | 18:24 |
| *** ahosam has quit IRC | 18:26 | |
| noonedeadpunk | looks like https://bugs.launchpad.net/ceilometer/+bug/1786225 | 18:28 |
| openstack | Launchpad bug 1786225 in Ceilometer "Polling cpu_util does not work" [Undecided,New] | 18:28 |
| redkrieg | yeah, that does look related. wonder if it's been fixed in a later version. I need to move up to train soon | 18:34 |
| noonedeadpunk | from what I see in ceilometer repo - it's not | 18:35 |
| *** andrewbonney has quit IRC | 19:02 | |
| *** idlemind has quit IRC | 19:05 | |
| *** spatel has quit IRC | 19:29 | |
| *** spatel has joined #openstack-ansible | 19:29 | |
| *** trident has quit IRC | 19:51 | |
| *** trident has joined #openstack-ansible | 19:59 | |
| *** jamesdenton has quit IRC | 20:03 | |
| *** joshualyle has quit IRC | 20:03 | |
| *** jamesdenton has joined #openstack-ansible | 20:03 | |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible-repo_build master: repo_build: Do not sync links directory between repo_containers https://review.opendev.org/712784 | 20:04 |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible-repo_server master: Exclude repo_build_global_links_path from sync https://review.opendev.org/712787 | 20:16 |
| *** pcaruana has quit IRC | 20:20 | |
| *** rh-jelabarre has quit IRC | 20:22 | |
| *** spatel has quit IRC | 20:27 | |
| *** rh-jelabarre has joined #openstack-ansible | 20:29 | |
| *** ansmith_ has quit IRC | 20:33 | |
| *** rgogunskiy has joined #openstack-ansible | 20:38 | |
| *** joshualyle has joined #openstack-ansible | 20:39 | |
| *** rgogunskiy has quit IRC | 20:42 | |
| *** joshualyle has quit IRC | 20:44 | |
| *** ansmith_ has joined #openstack-ansible | 21:06 | |
| *** gshippey has quit IRC | 21:07 | |
| *** stampeder has joined #openstack-ansible | 21:21 | |
| *** rh-jelabarre has quit IRC | 21:26 | |
| *** rh-jelabarre has joined #openstack-ansible | 21:27 | |
| *** spatel has joined #openstack-ansible | 21:31 | |
| *** spatel has quit IRC | 21:36 | |
| *** stampeder has quit IRC | 21:37 | |
| *** CeeMac has quit IRC | 21:50 | |
| *** miloa has quit IRC | 21:55 | |
| *** CeeMac has joined #openstack-ansible | 21:56 | |
| *** sum12 has quit IRC | 22:06 | |
| *** jbadiapa has quit IRC | 22:06 | |
| *** sum12 has joined #openstack-ansible | 22:07 | |
| *** jbadiapa has joined #openstack-ansible | 22:09 | |
| *** jbadiapa has quit IRC | 22:37 | |
| *** nicolasbock has quit IRC | 22:43 | |
| *** dave-mccowan has quit IRC | 22:50 | |
| *** dave-mccowan has joined #openstack-ansible | 23:10 | |
| *** joshualyle has joined #openstack-ansible | 23:42 | |
| *** joshualyle has quit IRC | 23:46 | |
| *** threestrands has joined #openstack-ansible | 23:50 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!