*** spotz has joined #openstack-ansible | 00:25 | |
*** markvoelker has joined #openstack-ansible | 01:25 | |
*** markvoelker has quit IRC | 01:29 | |
*** cshen has joined #openstack-ansible | 01:52 | |
*** cshen has quit IRC | 01:57 | |
*** cshen has joined #openstack-ansible | 02:50 | |
*** cshen has quit IRC | 02:55 | |
*** cp- has quit IRC | 02:56 | |
*** cp- has joined #openstack-ansible | 03:02 | |
*** markvoelker has joined #openstack-ansible | 03:26 | |
*** markvoelker has quit IRC | 03:30 | |
*** markvoelker has joined #openstack-ansible | 04:14 | |
*** markvoelker has quit IRC | 04:19 | |
*** evrardjp has quit IRC | 04:33 | |
*** evrardjp has joined #openstack-ansible | 04:33 | |
*** udesale has joined #openstack-ansible | 05:33 | |
*** miloa has joined #openstack-ansible | 05:55 | |
*** markvoelker has joined #openstack-ansible | 06:15 | |
*** markvoelker has quit IRC | 06:20 | |
*** rpittau|afk is now known as rpittau | 06:21 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Do not use paramkio transport for delegated tasks https://review.opendev.org/737219 | 06:51 |
---|---|---|
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Remove debug output from linear strategy plugin https://review.opendev.org/737220 | 06:51 |
*** sep has quit IRC | 06:53 | |
*** sep has joined #openstack-ansible | 06:53 | |
*** markvoelker has joined #openstack-ansible | 06:54 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Increase default ansible forks from 5 to 20 https://review.opendev.org/737221 | 06:56 |
*** pcaruana has joined #openstack-ansible | 06:56 | |
*** markvoelker has quit IRC | 06:59 | |
*** cshen has joined #openstack-ansible | 07:02 | |
*** stingrayza has joined #openstack-ansible | 07:23 | |
*** also_stingrayza has quit IRC | 07:25 | |
*** tosky has joined #openstack-ansible | 07:29 | |
*** sshnaidm|off is now known as sshnaidm|ruck | 07:29 | |
*** janno_ has joined #openstack-ansible | 07:31 | |
*** janno has quit IRC | 07:35 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Increase default ansible forks from 5 to 20 https://review.opendev.org/737221 | 07:50 |
*** raukadah is now known as chandankumar | 07:58 | |
*** janno_ has quit IRC | 08:05 | |
*** janno has joined #openstack-ansible | 08:07 | |
admin0 | morning | 08:14 |
jrosser | noonedeadpunk: we should take a look at the linear strategy | 08:15 |
jrosser | noonedeadpunk: https://review.opendev.org/#/c/737220/1/strategy/linear.py | 08:15 |
jrosser | this is hugely expensive code | 08:15 |
jrosser | i broke the tests with that so i've misunderstood what it's doing a bit | 08:16 |
*** markvoelker has joined #openstack-ansible | 08:24 | |
*** markvoelker has quit IRC | 08:29 | |
*** janno has quit IRC | 09:04 | |
*** janno has joined #openstack-ansible | 09:04 | |
noonedeadpunk | So it seems that we use it to "optimize" conditionals and delegations, but wondering if it do right jobs nowadays, considering that ansible moved forward a lot comparing to days when this has been written... | 09:05 |
noonedeadpunk | and I guess what we see now, is that even skipping takes a lot of time, so tasks with failed conditions are still queued then? | 09:06 |
*** aedc has joined #openstack-ansible | 09:22 | |
*** janno has quit IRC | 09:25 | |
*** janno has joined #openstack-ansible | 09:25 | |
admin0 | i am trying osa-integrated ceph .. and stuck at ceph-mon : waiting for the monitor(s) to form the quorum... | 09:40 |
admin0 | what is the way to fix it ? | 09:40 |
admin0 | let me gist my config | 09:44 |
admin0 | https://gist.github.com/a1git/5590f44c198b68c190cc5ea6a9514090 -- my config .. stuck on ceph-mon : waiting for the monitor(s) to form the quorum... | 10:15 |
*** rpittau is now known as rpittau|bbl | 10:15 | |
*** markvoelker has joined #openstack-ansible | 10:25 | |
*** markvoelker has quit IRC | 10:30 | |
openstackgerrit | Merged openstack/openstack-ansible-os_placement master: Cleanup ansible_python_interpreter https://review.opendev.org/736268 | 11:23 |
jrosser | noonedeadpunk: sorry got in meetings | 11:27 |
jrosser | but yes i've been looking at whats taking time in our linear strategy | 11:27 |
jrosser | the conditionals optimisation doesnt really seem to save much, measurably | 11:27 |
jrosser | the use of paramiko for delegated tasks costs us extra time | 11:28 |
noonedeadpunk | yeah, eventually I was wondering a week ago or so if we can disable it, as have a thought that this extends our connection time | 11:29 |
jrosser | but really the part dealing with physical_host_addrs is costing us double time | 11:29 |
noonedeadpunk | but, when I left only sshkey out of ssh auth methods - got exactly the same time for running a single task | 11:29 |
jrosser | i used my existing AIO on centos-8 and am just re-running lxc-container-create playbook with everything already deployed | 11:29 |
jrosser | trying to get a feel for the amount of overhead rather than actually time taken with 'changed' tasks | 11:30 |
noonedeadpunk | I think it's fair method - was thinking about doing the same | 11:31 |
jrosser | pretty amazing here https://review.opendev.org/#/c/737221/ | 11:31 |
jrosser | buster is only 5 mins slower on LXC than metal | 11:31 |
jrosser | but could be wildly different nodes, so not really very scientific | 11:31 |
jrosser | i might start taking more stuff out that we don't use anywhere | 11:33 |
noonedeadpunk | hm, and you mean that argument about max connections for ssh is not valid anymore? | 11:34 |
jrosser | the bug there seems to be about what the defaults are, and boostrap_host incresases them to 100 already | 11:34 |
noonedeadpunk | but bootstrap host is for CI only? | 11:35 |
noonedeadpunk | Like it won't adjust settings for compute hosts, let's say | 11:35 |
jrosser | thats right, the default config is still whatever the host comes with | 11:37 |
jrosser | looking at the original but it seems this affects hosts with many containers | 11:37 |
jrosser | so specifically infra i think, rather than compute | 11:38 |
noonedeadpunk | yeah, but doesn't that mean we can get regrassion on non-aio deployments? | 11:40 |
noonedeadpunk | *regression | 11:41 |
jrosser | possibly - we could look as adjusting the sshd config, or adding it to the deployer pre-requisites | 11:50 |
jrosser | in the linked bug though they were running into issues at forks=40 | 11:51 |
jrosser | which is quite a large number | 11:51 |
*** rh-jelabarre has joined #openstack-ansible | 11:51 | |
jrosser | i think we should do *something* though, because just addinf -f=20 takes 20% off the runtime of my lxc-container-create test | 11:51 |
*** miloa has quit IRC | 11:56 | |
openstackgerrit | Merged openstack/openstack-ansible stable/stein: ceph: run handlers after common https://review.opendev.org/736998 | 11:56 |
openstackgerrit | Hervé Beraud proposed openstack/openstack-ansible master: Prefer to use the name of mariadb rather mysql https://review.opendev.org/737263 | 11:58 |
openstackgerrit | Hervé Beraud proposed openstack/openstack-ansible master: Rename mysql to mariadb for registered var https://review.opendev.org/737263 | 12:00 |
*** miloa has joined #openstack-ansible | 12:03 | |
openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Remove the neutron-fwaas since it retired https://review.opendev.org/736099 | 12:04 |
*** sep has quit IRC | 12:17 | |
*** jbadiapa has joined #openstack-ansible | 12:19 | |
*** rpittau|bbl is now known as rpittau | 12:22 | |
*** udesale_ has joined #openstack-ansible | 12:25 | |
*** markvoelker has joined #openstack-ansible | 12:26 | |
*** udesale has quit IRC | 12:27 | |
noonedeadpunk | jrosser: can you look through that cherry-pick? https://review.opendev.org/#/c/731601/ | 12:30 |
*** sep has joined #openstack-ansible | 12:30 | |
*** markvoelker has quit IRC | 12:31 | |
noonedeadpunk | btw I agree that we proably should increase number of workers | 12:31 |
noonedeadpunk | maybe we can do that as a part of openstack_hosts or smth... | 12:32 |
*** markvoelker has joined #openstack-ansible | 12:34 | |
*** markvoelker has quit IRC | 12:39 | |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: copy the actual keyring https://review.opendev.org/718883 | 12:44 |
*** aedc_ has joined #openstack-ansible | 12:57 | |
*** aedc has quit IRC | 12:59 | |
jrosser | noonedeadpunk: i think the swift stuff has been fixed properly upstream now | 13:04 |
jrosser | https://review.opendev.org/#/c/737071/ | 13:04 |
noonedeadpunk | oh, so we can drop these nasty workarounds... | 13:04 |
noonedeadpunk | however, we still need them for train | 13:05 |
*** cshen has quit IRC | 13:11 | |
*** vakuznet has joined #openstack-ansible | 13:12 | |
vakuznet | after 20.1.2 upgrade i'm getting "2020-06-22 07:24:41.838 201 ERROR octavia.network.drivers.neutron.base File "/openstack/venvs/octavia-20.1.2/lib/python2.7/site-packages/neutronclient/client.py", line 107, in _cs_request | 13:14 |
vakuznet | 2020-06-22 07:24:41.838 201 ERROR octavia.network.drivers.neutron.base raise exceptions.SslCertificateValidationError(reason=e)" | 13:15 |
vakuznet | cert is self-singned generated by osa | 13:15 |
openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Cleanup ansible_python_interpreter https://review.opendev.org/736261 | 13:19 |
openstackgerrit | Merged openstack/openstack-ansible-os_ironic master: Cleanup ansible_python_interpreter https://review.opendev.org/736262 | 13:24 |
openstackgerrit | Merged openstack/openstack-ansible-os_swift master: Cleanup ansible_python_interpreter https://review.opendev.org/736266 | 13:28 |
jrosser | noonedeadpunk: that swift patch is for train i think | 13:28 |
noonedeadpunk | yep, it is | 13:29 |
noonedeadpunk | but we need to sort of revert it for master and ussuri? | 13:29 |
jrosser | ideally yes becasue we added quite a lot of stuff for the workaround i think | 13:29 |
jrosser | unless there was also something else that needed two config files | 13:29 |
noonedeadpunk | iirc it was the only reason... | 13:30 |
*** d34dh0r53 has joined #openstack-ansible | 13:34 | |
admin0 | i need some pointers on how to fix this ceph-mon : waiting for the monitor(s) to form the quorum... | 13:39 |
*** cshen has joined #openstack-ansible | 13:41 | |
*** cshen has quit IRC | 13:48 | |
openstackgerrit | Merged openstack/openstack-ansible-ceph_client master: Cleanup ansible_python_interpreter https://review.opendev.org/736267 | 13:52 |
*** cshen has joined #openstack-ansible | 13:52 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Do not use paramkio transport for delegated tasks https://review.opendev.org/737219 | 13:55 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Remove physical_host_addrs parameter from ssh plugin https://review.opendev.org/737220 | 13:55 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Remove chroot connection from ssh plugin https://review.opendev.org/737273 | 13:55 |
*** d34dh0r53 has quit IRC | 14:01 | |
*** mmethot has quit IRC | 14:02 | |
*** mmethot has joined #openstack-ansible | 14:02 | |
*** markvoelker has joined #openstack-ansible | 14:07 | |
*** markvoelker has quit IRC | 14:12 | |
openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-lxc_hosts stable/ussuri: copy the actual keyring https://review.opendev.org/737280 | 14:28 |
openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-lxc_hosts stable/train: copy the actual keyring https://review.opendev.org/731626 | 14:29 |
*** spatel has joined #openstack-ansible | 14:40 | |
openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-openstack_hosts master: Enable PowerTools repository for distro installs https://review.opendev.org/737284 | 15:00 |
*** miloa has quit IRC | 15:12 | |
openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/ansible-role-systemd_networkd master: Add CentOS 8 support https://review.opendev.org/737122 | 15:13 |
*** cshen has quit IRC | 15:17 | |
*** spatel has quit IRC | 15:19 | |
prometheanfire | func tests still failing on train? | 15:24 |
prometheanfire | https://review.opendev.org/731626 seems consistant | 15:24 |
*** markvoelker has joined #openstack-ansible | 15:32 | |
*** markvoelker has quit IRC | 15:36 | |
*** cshen has joined #openstack-ansible | 15:44 | |
*** cshen has quit IRC | 15:50 | |
*** gyee has joined #openstack-ansible | 15:55 | |
openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [WIP] Centos-8 support https://review.opendev.org/689629 | 16:01 |
*** rpittau is now known as rpittau|afk | 16:01 | |
*** sshnaidm|ruck is now known as sshnaidm|afk | 16:13 | |
*** udesale_ has quit IRC | 16:21 | |
*** markvoelker has joined #openstack-ansible | 16:24 | |
*** markvoelker has quit IRC | 16:29 | |
*** spatel has joined #openstack-ansible | 16:30 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Remove chroot connection from ssh plugin https://review.opendev.org/737273 | 16:33 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Remove physical_host_addrs parameter from ssh plugin https://review.opendev.org/737220 | 16:33 |
*** markvoelker has joined #openstack-ansible | 16:44 | |
*** markvoelker has quit IRC | 16:48 | |
*** cshen has joined #openstack-ansible | 16:50 | |
*** cshen has quit IRC | 16:55 | |
*** cshen has joined #openstack-ansible | 17:02 | |
*** cshen has quit IRC | 17:06 | |
*** markvoelker has joined #openstack-ansible | 17:07 | |
*** markvoelker has quit IRC | 17:12 | |
openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-plugins master: Identity providers can be created with specifed domain https://review.opendev.org/735654 | 17:13 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Remove physical_host_addrs parameter from ssh plugin https://review.opendev.org/737220 | 17:22 |
openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-openstack_hosts master: Fix CentOS functional test https://review.opendev.org/737331 | 17:25 |
openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-openstack_hosts master: Enable PowerTools repository for distro installs https://review.opendev.org/737284 | 17:28 |
openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-openstack_hosts master: Fix CentOS functional test https://review.opendev.org/737331 | 17:31 |
openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-openstack_hosts master: Fix CentOS functional test https://review.opendev.org/737331 | 17:31 |
openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-openstack_hosts master: Enable PowerTools repository for distro installs https://review.opendev.org/737284 | 17:32 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Remove chroot connection from ssh plugin https://review.opendev.org/737273 | 17:40 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Remove physical_host_addrs parameter from ssh plugin https://review.opendev.org/737220 | 17:40 |
jrosser | mnaser: check out the runtime on https://review.opendev.org/#/c/737221/ openstack-ansible-deploy-aio_lxc-debian-buster job | 18:00 |
jrosser | guess which cloud that ran on? | 18:00 |
mnaser | jrosser: you're the second person to tell me today, someone else thought their job actually didn't run at all ;) | 18:01 |
jrosser | i thought my patch had a good effect | 18:01 |
jrosser | turns out bigger iron :) | 18:01 |
mnaser | jrosser: it's not out yet but amd epyc gen 2 systems with raid-0 local storage | 18:01 |
jrosser | it's only 5mins slower than the equivalent metal job | 18:02 |
*** aedc_ has quit IRC | 18:03 | |
*** aedc has joined #openstack-ansible | 18:06 | |
jrosser | mnaser: you might be interested in this too https://review.opendev.org/#/c/737220/ | 18:06 |
jrosser | even though it fails one test it takes 50% off the re-runtime of playbooks/lxc-container-create.yml | 18:07 |
jrosser | i.e for already deployed and no changes | 18:07 |
*** cshen has joined #openstack-ansible | 18:12 | |
openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-lxc_hosts master: move listchanges removal to where it's needed https://review.opendev.org/731628 | 18:13 |
openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-lxc_hosts stable/ussuri: move listchanges removal to where it's needed https://review.opendev.org/737346 | 18:16 |
jrosser | prometheanfire: usually we merge / cherry-pick..... | 18:17 |
prometheanfire | I did cherry-pick (if you are talking about https://review.opendev.org/737346 ) | 18:18 |
mnaser | jrosser: that's massive, its one of those "ansible sucks at copying things over" | 18:18 |
prometheanfire | hmm, not sure why the commit message didn't update | 18:18 |
prometheanfire | maybe it's because I needed to add -X to --continue (due to conflict) | 18:19 |
jrosser | mnaser: in my AIO just running it was WOAH! as the text flew past | 18:19 |
mnaser | jrosser: more proof that ripping out the openstack_services.yml which gets included in every single playbook/task will have a huge speed-up | 18:20 |
jrosser | i went through the whole strategy/linear and took all the various bits in/out and that one hurts massively | 18:20 |
mnaser | how many vars do we add to every single task with that alone... | 18:20 |
jrosser | the test that fails is covering this case https://review.opendev.org/#/c/550665/ | 18:20 |
jrosser | which i didnt even know was a thing....... | 18:21 |
jrosser | "When delegating to a host outside of the inventory..." <- what is that? | 18:22 |
prometheanfire | ya, stripped it there too | 18:22 |
openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-lxc_hosts stable/ussuri: move listchanges removal to where it's needed https://review.opendev.org/737346 | 18:25 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Remove physical_host_addrs parameter from ssh plugin https://review.opendev.org/737220 | 18:35 |
mnaser | jrosser: sounds like a weird... thing. | 18:50 |
mnaser | id rip it out. | 18:50 |
*** jeh has joined #openstack-ansible | 18:51 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Remove physical_host_addrs parameter from ssh plugin https://review.opendev.org/737220 | 19:01 |
*** cshen has quit IRC | 19:05 | |
*** cshen has joined #openstack-ansible | 19:10 | |
*** jeh has quit IRC | 19:12 | |
*** cshen has quit IRC | 19:15 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Remove physical_host_addrs parameter from ssh plugin https://review.opendev.org/737220 | 19:25 |
*** aedc_ has joined #openstack-ansible | 19:25 | |
*** markvoelker has joined #openstack-ansible | 19:25 | |
*** aedc has quit IRC | 19:27 | |
*** markvoelker has quit IRC | 19:30 | |
*** spatel has quit IRC | 19:53 | |
*** pcaruana has quit IRC | 20:42 | |
*** cshen has joined #openstack-ansible | 20:52 | |
*** markvoelker has joined #openstack-ansible | 20:55 | |
*** cshen has quit IRC | 20:57 | |
openstackgerrit | Vadim Kuznetsov proposed openstack/openstack-ansible-os_neutron master: VLAN tag support for ovs port https://review.opendev.org/737375 | 20:58 |
*** markvoelker has quit IRC | 20:59 | |
*** cshen has joined #openstack-ansible | 21:01 | |
*** jbadiapa has quit IRC | 21:05 | |
*** cshen has quit IRC | 21:05 | |
*** spatel has joined #openstack-ansible | 21:13 | |
*** spatel has quit IRC | 21:36 | |
*** spatel has joined #openstack-ansible | 21:42 | |
*** spatel has quit IRC | 21:46 | |
*** spatel has joined #openstack-ansible | 21:52 | |
*** pmacdonnell has quit IRC | 21:55 | |
*** pmacdonnell has joined #openstack-ansible | 21:55 | |
*** spatel has quit IRC | 22:10 | |
*** spatel has joined #openstack-ansible | 22:28 | |
*** spatel has quit IRC | 22:31 | |
*** markvoelker has joined #openstack-ansible | 22:56 | |
*** tosky has quit IRC | 22:59 | |
*** markvoelker has quit IRC | 23:00 | |
*** cshen has joined #openstack-ansible | 23:01 | |
*** cshen has quit IRC | 23:06 | |
*** cshen has joined #openstack-ansible | 23:41 | |
*** cshen has quit IRC | 23:46 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!