| *** goldyfruit_ has joined #openstack-ansible | 00:14 | |
| *** weshay has joined #openstack-ansible | 00:24 | |
| *** markvoelker has quit IRC | 00:26 | |
| *** gyee has quit IRC | 00:27 | |
| *** ianychoi has quit IRC | 01:17 | |
| *** ianychoi has joined #openstack-ansible | 01:18 | |
| *** dave-mccowan has joined #openstack-ansible | 01:21 | |
| *** nicolasbock has quit IRC | 01:57 | |
| *** elduderino80 has joined #openstack-ansible | 01:59 | |
| *** prometheanfire has quit IRC | 02:16 | |
| *** prometheanfire has joined #openstack-ansible | 02:16 | |
| *** macz has joined #openstack-ansible | 02:19 | |
| *** macz has quit IRC | 02:23 | |
| *** hwoarang has quit IRC | 02:38 | |
| *** BjoernT has joined #openstack-ansible | 02:47 | |
| *** hwoarang has joined #openstack-ansible | 02:48 | |
| *** dave-mccowan has quit IRC | 03:04 | |
| *** BjoernT has quit IRC | 03:14 | |
| *** BjoernT has joined #openstack-ansible | 03:18 | |
| *** raukadah is now known as chandankumar | 03:23 | |
| *** BjoernT has quit IRC | 03:29 | |
| *** spsurya has joined #openstack-ansible | 03:29 | |
| *** markvoelker has joined #openstack-ansible | 03:41 | |
| *** markvoelker has quit IRC | 03:42 | |
| *** markvoelker has joined #openstack-ansible | 03:43 | |
| *** gkadam has joined #openstack-ansible | 03:55 | |
| *** udesale has joined #openstack-ansible | 03:57 | |
| *** ianychoi has quit IRC | 03:59 | |
| *** ianychoi has joined #openstack-ansible | 04:00 | |
| *** gkadam has quit IRC | 04:08 | |
| *** macz has joined #openstack-ansible | 04:20 | |
| *** macz has quit IRC | 04:25 | |
| *** elduderino80 has quit IRC | 04:27 | |
| *** macz has joined #openstack-ansible | 04:28 | |
| *** macz has quit IRC | 04:30 | |
| *** macz has joined #openstack-ansible | 04:30 | |
| *** macz has quit IRC | 04:35 | |
| *** spsurya has quit IRC | 04:37 | |
| *** spsurya has joined #openstack-ansible | 04:38 | |
| *** weshay has quit IRC | 04:40 | |
| *** SmearedBeard has quit IRC | 04:45 | |
| *** SmearedBeard has joined #openstack-ansible | 04:56 | |
| *** pcaruana has joined #openstack-ansible | 05:01 | |
| *** ianychoi has quit IRC | 05:03 | |
| *** ianychoi has joined #openstack-ansible | 05:05 | |
| *** shyamb has joined #openstack-ansible | 05:11 | |
| *** jbadiapa has joined #openstack-ansible | 05:13 | |
| *** ianychoi has quit IRC | 05:27 | |
| *** ianychoi has joined #openstack-ansible | 05:29 | |
| *** markvoelker has quit IRC | 05:47 | |
| *** shyamb has quit IRC | 05:47 | |
| *** ianychoi has quit IRC | 06:00 | |
| *** ianychoi has joined #openstack-ansible | 06:01 | |
| *** shyamb has joined #openstack-ansible | 06:10 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [WIP] Use parallel git clone https://review.opendev.org/588372 | 06:12 |
|---|---|---|
| *** SmearedBeard has quit IRC | 06:12 | |
| *** jbadiapa has quit IRC | 06:22 | |
| *** shyamb has quit IRC | 06:28 | |
| *** shyamb has joined #openstack-ansible | 06:28 | |
| *** macz has joined #openstack-ansible | 06:32 | |
| *** macz has quit IRC | 06:36 | |
| *** ianychoi has quit IRC | 06:40 | |
| *** cshen has joined #openstack-ansible | 06:41 | |
| *** ianychoi has joined #openstack-ansible | 06:42 | |
| *** SmearedBeard has joined #openstack-ansible | 06:42 | |
| *** defionscode has quit IRC | 06:43 | |
| *** SmearedBeard has quit IRC | 06:47 | |
| *** Smeared_Beard has joined #openstack-ansible | 06:48 | |
| *** shyam89 has joined #openstack-ansible | 06:54 | |
| *** shyamb has quit IRC | 06:55 | |
| *** rpittau|afk is now known as rpittau | 07:04 | |
| *** zbr is now known as zbr|ruck | 07:08 | |
| *** tosky has joined #openstack-ansible | 07:16 | |
| *** kopecmartin|off is now known as kopecmartin | 07:24 | |
| *** jbadiapa has joined #openstack-ansible | 07:27 | |
| tacco | jrosser: thanks a lot. i already have this configs in place. My question is how this will be handled by ansible_ceph_client because i need some kind of credentials somewhere.. is it only the /etc/ceph/ceph.conf and what about the cluster fsid? | 07:32 |
| jrosser | the ansible controller uses ssh to connect to your ceph monitor and collect those things | 07:33 |
| jrosser | so you need to have that access set up beforehand | 07:34 |
| jrosser | if you cannot run ansible tasks against the ceph cluster (run by a different team for example) then we have some recent work to allow the ceph keyrings to be supplied from the deployment host | 07:36 |
| tacco | i see. ok i tought it would be possible only with a ceph client that connects to the mon by ceph.conf. | 07:37 |
| tacco | but ok if i need ssh i will arange that. | 07:37 |
| jrosser | and remember that openstack-ansible just calls the ceph-ansible roles, so anything you can override with ceph-ansible variables is available to you | 07:37 |
| *** luksky has joined #openstack-ansible | 07:38 | |
| tacco | ok will check this role first and grant ssh access if i learned a bit more about the role | 07:38 |
| jrosser | tacco: iirc you can collect ceph.conf from the mon with ansible or supply it manually yourself via variables | 07:39 |
| tacco | thansk jrosser for all those quick responses that helps a lot. | 07:39 |
| jrosser | but you also need to deal with keyrings | 07:39 |
| tacco | can i buy you a coffe or something? | 07:39 |
| jrosser | sure :) | 07:39 |
| tacco | send me the link | 07:39 |
| tacco | i implemented the ceph.conf by the var ceph_conf_file: | | 07:40 |
| *** shyam89 has quit IRC | 07:40 | |
| *** ygk_12345 has joined #openstack-ansible | 07:45 | |
| *** markvoelker has joined #openstack-ansible | 07:47 | |
| *** markvoelker has quit IRC | 07:51 | |
| *** Jeffrey4l has quit IRC | 07:59 | |
| *** Jeffrey4l has joined #openstack-ansible | 08:00 | |
| *** jbadiapa has quit IRC | 08:03 | |
| *** jbadiapa has joined #openstack-ansible | 08:04 | |
| ChosSimbaOne | morning. | 08:17 |
| *** yolanda has joined #openstack-ansible | 08:23 | |
| *** shyamb has joined #openstack-ansible | 08:28 | |
| ChosSimbaOne | When setting up ceilometer + gnocchi with OSA, is it correct that no default configuration for data sendt to gnocchi is made? | 08:29 |
| *** macz has joined #openstack-ansible | 08:32 | |
| *** lkoranda has joined #openstack-ansible | 08:32 | |
| *** macz has quit IRC | 08:36 | |
| ChosSimbaOne | Ohh, realized it is due to queens release. It has been patched. nvm then :-) | 08:47 |
| *** macz has joined #openstack-ansible | 08:51 | |
| *** macz has quit IRC | 08:55 | |
| *** ygk_12345 has quit IRC | 09:05 | |
| *** jbadiapa has quit IRC | 09:29 | |
| *** jbadiapa has joined #openstack-ansible | 09:30 | |
| openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-os_neutron stable/queens: Create symlink to neutron-keepalived-state-change https://review.opendev.org/650303 | 09:36 |
| *** shyamb has quit IRC | 09:38 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_octavia master: Allow venv python interpreter to be overridden https://review.opendev.org/681592 | 09:42 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Whitelist octavia tests when octavia service is present https://review.opendev.org/668136 | 09:45 |
| ChosSimbaOne | Hi. are anyone vizualizing ceilometer + gnoochi with grafana? | 09:48 |
| *** markvoelker has joined #openstack-ansible | 09:48 | |
| noonedeadpunk | ChosSimbaOne: me:) | 09:49 |
| noonedeadpunk | But it's tricky thing tbh | 09:49 |
| jrosser | noonedeadpunk: it is a shame OSA setup out of the box is hard for this | 09:51 |
| jrosser | that would be a nice thing to sort out in Train | 09:51 |
| noonedeadpunk | not really, just gnocchi is not really wel documented for this | 09:51 |
| jrosser | well we still don't have coordinator service? | 09:52 |
| jrosser | etcd or something | 09:52 |
| noonedeadpunk | So I had to spend some time configuring cors for gnocchi and grafana auth process for gnocchi was the biggest problem for me. | 09:52 |
| *** markvoelker has quit IRC | 09:53 | |
| noonedeadpunk | Well, I'm using zookeeper, and zookeeper pip modules are included for both | 09:53 |
| noonedeadpunk | And I was using https://github.com/openstack/ansible-role-zookeeper but now it's gone from openstack unfortunatelly | 09:55 |
| noonedeadpunk | Ah, it's still under governance https://opendev.org/windmill/ansible-role-zookeeper | 09:55 |
| ChosSimbaOne | well I just fixed the missing gnocchi_resources.yaml | 09:56 |
| noonedeadpunk | hm.... | 09:56 |
| ChosSimbaOne | so just trying to figure out what i can visualize with ceilometer + gnooci. | 09:56 |
| ChosSimbaOne | So now i am collecting metrics i thing. So was wondering with CORS step. But it seems that it must be configure for both keystone and the gnocchi container. | 09:57 |
| noonedeadpunk | I guess it's supposed to be there https://opendev.org/openstack/openstack-ansible-os_ceilometer/src/branch/master/vars/main.yml#L71-L76 | 09:57 |
| ChosSimbaOne | yeah, my problem is that we are running queens, due to ACI support. So the patch was not back ported :-S | 09:58 |
| noonedeadpunk | actually you can visualize resource usage per server, like cpu or disk utilization - depends on what you collect | 09:58 |
| noonedeadpunk | Ah, yes. | 09:58 |
| noonedeadpunk | Actually even in rocky things should eventually work | 09:58 |
| ChosSimbaOne | So i just need to enable CORS and setup the data source. | 09:59 |
| noonedeadpunk | but before it yes - there were a big problems | 09:59 |
| ChosSimbaOne | yeah, I am starting to regred that we chose ACI as SDN... | 09:59 |
| noonedeadpunk | Yeah, cisco seems to be not really good in suporting things for openstack | 10:00 |
| *** shyamb has joined #openstack-ansible | 10:01 | |
| ChosSimbaOne | yeah.. Guess we should have known :-S | 10:01 |
| ChosSimbaOne | But thanks for the help :-) Will dig into CORS now :-) | 10:02 |
| noonedeadpunk | let me recal regarding cors | 10:02 |
| noonedeadpunk | ah, ok, I ended up without cors | 10:04 |
| noonedeadpunk | So in datasource URL I have keystone public endpoint, access browser, auth mode keystone and placed gnocchi service credentials there, but you may create extra ones | 10:05 |
| *** ygk_12345 has joined #openstack-ansible | 10:12 | |
| *** ygk_12345 has left #openstack-ansible | 10:13 | |
| ChosSimbaOne | Ahh well I actually like that approach better! Think I will copy that. | 10:13 |
| *** primeministerp has quit IRC | 10:14 | |
| noonedeadpunk | ChosSimbaOne: And that,s how graph is configured for me http://i.piccy.info/i9/8df76f7cfc11a701b415453efeff21c0/1569924965/61133/1336302/Screenshot_20191001_131347.png | 10:14 |
| noonedeadpunk | Syntax was pretty tough for me here. | 10:15 |
| * jrosser would really like to have this working :) | 10:15 | |
| noonedeadpunk | and for variables - node has query "resources(instance, host, type=instance)", and instances has query "resources(instance, id, host="$node")" | 10:17 |
| *** shyamb has quit IRC | 10:21 | |
| *** udesale has quit IRC | 10:27 | |
| csmart | hey everyone, is it expected that a stock AIO (stein 19.0.3) should come back up after a reboot? | 10:28 |
| csmart | I noticed two issues, cinder was not happy because cinder-loop service failed due to missing /openstack mount, restarting the service made it happy | 10:28 |
| *** udesale has joined #openstack-ansible | 10:28 | |
| csmart | secondly, nova-compute service failed to come up because libvirtd hadn't started, starting libvirtd and restarting the nova-compute made the error go away but it's still in down state | 10:30 |
| csmart | secondly, nova-compute service failed to come up because libvirtd hadn't started, starting libvirtd and restarting the nova-compute made the error go away but it's still in down state | 10:32 |
| csmart | ok, and looks lke nova-compute is still down because /var/lock/nova doesn't exist, creating that and chowning to nova:nova brings it up | 10:35 |
| *** shyamb has joined #openstack-ansible | 10:40 | |
| *** r81 has joined #openstack-ansible | 10:42 | |
| jrosser | csmart: it's kind of just a test environment, but if you think we can make things more robust to a reboot that would be nice | 10:45 |
| *** macz has joined #openstack-ansible | 10:52 | |
| jrosser | csmart: i think you could fix a lot of this with adjusting these https://github.com/openstack/openstack-ansible/blob/master/tests/roles/bootstrap-host/tasks/prepare_loopback_cinder.yml#L33-L35 | 10:53 |
| *** jbadiapa has quit IRC | 10:53 | |
| jrosser | csmart: is this centos? https://bugs.launchpad.net/openstack-ansible/+bug/1833066 | 10:55 |
| openstack | Launchpad bug 1833066 in openstack-ansible "rebooting a centos compute node loses /var/lock/nova" [Undecided,New] | 10:55 |
| csmart | jrosser: k, maybe I should focus on settig it up with a few VMs then, rather than AIO? I'm just getting my feet wet again after a hiatus ;-) | 10:56 |
| csmart | jrosser: k, maybe I should focus on settig it up with a few VMs then, rather than AIO? I'm just getting my feet wet again after a hiatus ;-) | 10:57 |
| csmart | jrosser: k, maybe I should focus on settig it up with a few VMs then, rather than AIO? I'm just getting my feet wet again after a hiatus ;-) | 10:57 |
| csmart | and I guess LVM backed cinder probably isn't really a recommended prod config anyway... | 10:57 |
| *** macz has quit IRC | 10:57 | |
| jrosser | well, it feels like the cinder loop device thing should be fairly easily fixable by adjusting the systemd unit to wait for the mounts to be ready | 10:57 |
| jrosser | and if you are on centos looks like there is an already existing bug to address too | 10:57 |
| jrosser | so fixing the AIO to be better would be cool, and yes, AIO is not a prod environment | 10:58 |
| *** csmart_ has joined #openstack-ansible | 11:00 | |
| csmart_ | jrosser, sorry something weird is going on with riot chat atm.. | 11:00 |
| csmart_ | yep it's centos | 11:00 |
| csmart_ | jrosser, yep I did modify loop-cinder to start after openstack.mount | 11:01 |
| jrosser | if you have any time to help on small bugs like this it would be great | 11:01 |
| csmart_ | ...however it wasn't happy with that, complained about lvm2 something something... | 11:02 |
| csmart_ | yeah, sure I guess keen to know if I should invest some time on this or dig into more serious scenarios | 11:02 |
| *** Smeared_Beard has quit IRC | 11:02 | |
| csmart_ | (hence my question about if we expect it to work after reboot) | 11:02 |
| csmart_ | happy to do so if it's useful, fixing the centos bug seems reasonable... I'll take a closer look at that | 11:03 |
| jrosser | if it was only those two things preventing it working after reboot it would be worth a little time imho | 11:04 |
| *** nicolasbock has joined #openstack-ansible | 11:04 | |
| *** udesale has quit IRC | 11:05 | |
| jrosser | mnaser: is this something you see on your centos hosts? https://bugs.launchpad.net/openstack-ansible/+bug/1833066 | 11:05 |
| openstack | Launchpad bug 1833066 in openstack-ansible "rebooting a centos compute node loses /var/lock/nova" [Undecided,New] | 11:05 |
| *** udesale has joined #openstack-ansible | 11:06 | |
| *** shyamb has quit IRC | 11:08 | |
| csmart_ | jrosser, sure, happy to look into it and send some patches | 11:10 |
| *** dave-mccowan has joined #openstack-ansible | 11:12 | |
| *** udesale has quit IRC | 11:17 | |
| *** ansmith has quit IRC | 11:25 | |
| csmart | ok so looks like we used to have nova-systemd-tmpfiles.j2 but that was removed... | 11:27 |
| csmart_ | https://review.opendev.org/#/c/466179/ | 11:32 |
| jrosser | csmart_: yes it does look like that just got dropped probably accidentally in that patch | 11:34 |
| *** cshen has quit IRC | 11:37 | |
| *** weshay has joined #openstack-ansible | 11:41 | |
| csmart_ | hmm.. calling the systemd_service role which looks like it has a task to create the tmpfiles... and systemd_lock_path is defined... | 11:43 |
| csmart_ | getting late here I'll dig some more tomorrow :-) | 11:43 |
| csmart_ | \o | 11:43 |
| csmart_ | ok yeah it is there under /etc/tmpfiles.d/openstack-nova-compute.conf | 11:45 |
| csmart_ | interesting | 11:46 |
| *** cshen has joined #openstack-ansible | 11:46 | |
| *** shyamb has joined #openstack-ansible | 11:47 | |
| *** markvoelker has joined #openstack-ansible | 11:49 | |
| *** markvoelker has quit IRC | 11:54 | |
| *** shyamb has quit IRC | 12:03 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Drop octaviav2 specific jobs https://review.opendev.org/683595 | 12:04 |
| ChosSimbaOne | noonedeadpunk: I just tried you suggestion without cors, and it does not seem to work for queens. Which version are you using? | 12:07 |
| noonedeadpunk | It's eventually queens.... Oh, just a sec | 12:08 |
| noonedeadpunk | It required cors as well... | 12:10 |
| *** ianychoi has quit IRC | 12:10 | |
| noonedeadpunk | So for keystone you need to set in "cors" section "allowed_origin = https://grafana.service.net" | 12:11 |
| noonedeadpunk | yeah, sorry for misleading you | 12:11 |
| *** ianychoi has joined #openstack-ansible | 12:13 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Fix python path when deploy host is not localhost https://review.opendev.org/669838 | 12:23 |
| ChosSimbaOne | noonedeadpunk: no problem, just wanted to be sure so i didn't bang my head to much :-) | 12:25 |
| ChosSimbaOne | Thank you :-) | 12:26 |
| *** ansmith has joined #openstack-ansible | 12:31 | |
| *** trident has quit IRC | 12:34 | |
| *** trident has joined #openstack-ansible | 12:35 | |
| *** macz has joined #openstack-ansible | 12:53 | |
| *** nicolasbock has quit IRC | 12:56 | |
| *** nicolasbock has joined #openstack-ansible | 12:56 | |
| *** macz has quit IRC | 12:57 | |
| *** jbadiapa has joined #openstack-ansible | 13:06 | |
| *** nicolasbock1 has joined #openstack-ansible | 13:07 | |
| *** nicolasbock has quit IRC | 13:07 | |
| *** nicolasbock1 is now known as nicolasbock | 13:07 | |
| *** dave-mccowan has quit IRC | 13:13 | |
| *** jawad_axd has joined #openstack-ansible | 13:14 | |
| *** jbadiapa has quit IRC | 13:16 | |
| *** trident has quit IRC | 13:22 | |
| *** trident has joined #openstack-ansible | 13:23 | |
| *** BjoernT has joined #openstack-ansible | 13:26 | |
| *** SmearedBeard has joined #openstack-ansible | 13:37 | |
| *** ivve has joined #openstack-ansible | 13:42 | |
| noonedeadpunk | jrosser: I've figured out what's wrong with tempest lol The good thing that it's easy to fix. | 13:45 |
| noonedeadpunk | it's because of https://opendev.org/openstack/openstack-ansible-os_tempest/commit/f4b1c94de9be8d16f55e4b45e5f4873b06d7e1c2 | 13:46 |
| noonedeadpunk | "{{ }}" can't be used in when statements:) | 13:46 |
| jrosser | you know what | 13:48 |
| jrosser | i was just part way through adding a debug: to my AIO to see if that actually worked :) | 13:49 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Allow venv python interpreter to be overridden https://review.opendev.org/681592 | 13:49 |
| jrosser | because all of the python_venv_build was skipped so it can only be that | 13:49 |
| noonedeadpunk | That's exactly what I did:) | 13:49 |
| jrosser | and also looking again i don't really like the not (A and B) | 13:49 |
| jrosser | we can probably make that logic clearer | 13:50 |
| *** markvoelker has joined #openstack-ansible | 13:50 | |
| jrosser | in a similar way this is also fixing wrong {{ }} https://review.opendev.org/#/c/684125/1/playbooks/common-tasks/os-lxc-container-setup.yml | 13:51 |
| jrosser | argh | 13:51 |
| jrosser | https://review.opendev.org/#/c/684125/ | 13:51 |
| noonedeadpunk | not really see how to optimize logic there... | 13:52 |
| jrosser | use venv build if install method is source, or distro is debian | 13:54 |
| jrosser | ^ makes me wonder if it is actually correct now | 13:54 |
| *** jawad_axd has quit IRC | 13:54 | |
| jrosser | turn the and to an or, and lose the 'not' from the front | 13:54 |
| *** markvoelker has quit IRC | 13:55 | |
| *** spatel has joined #openstack-ansible | 13:56 | |
| *** markvoelker has joined #openstack-ansible | 13:57 | |
| noonedeadpunk | actually looking at this, we can probably just leave "not (tempest_install_method | default('source') == 'distro')" | 13:57 |
| noonedeadpunk | or without not - "(tempest_install_method | default('source') == 'source')" | 14:00 |
| jrosser | but this whole mess is becasue ubuntu distro install needs source install of tempest plugins | 14:01 |
| *** markvoelker has quit IRC | 14:01 | |
| noonedeadpunk | as we are including source install either for source or for tempest_plugin_install_source | 14:01 |
| noonedeadpunk | yep, that's true | 14:01 |
| noonedeadpunk | but not sure about reverting patch for ubuntu | 14:02 |
| noonedeadpunk | But I'd wish canonical shipped packages for tempest plugins | 14:02 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_tempest master: Fix tempest source install condition https://review.opendev.org/685974 | 14:06 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Freeze roles for Train milestone https://review.opendev.org/681002 | 14:08 |
| jrosser | noonedeadpunk: i'm a bit confused, do we use the python_venv_build to install the tempest plugins from source? | 14:12 |
| jrosser | when it is ubuntu and install_method is distro? | 14:13 |
| noonedeadpunk | It looks like we don't use python_venv_build for plugin installation at all | 14:13 |
| noonedeadpunk | they're installed by the pip commands directly in the following tasks | 14:14 |
| noonedeadpunk | we're just omitting virtualenv for pip module in case of ubuntu distro case | 14:15 |
| noonedeadpunk | but looks like pip creates venv if it's missing, and plugin installation install tempest as it's in the requirements | 14:16 |
| noonedeadpunk | so that's how we got tempest from pip | 14:16 |
| *** markvoelker has joined #openstack-ansible | 14:22 | |
| jrosser | noonedeadpunk: you can probably lose this comment too https://github.com/openstack/openstack-ansible-os_tempest/blob/465f5749b43bbff080b99947edc6a3c12be5cf50/tasks/tempest_install_source.yml#L32-L35 | 14:26 |
| *** markvoelker has quit IRC | 14:26 | |
| *** markvoelker has joined #openstack-ansible | 14:27 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_tempest master: Fix tempest source install condition https://review.opendev.org/685974 | 14:27 |
| *** spatel has quit IRC | 14:33 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-specs master: Drop unsupported oslosphinx https://review.opendev.org/685988 | 14:47 |
| *** lkoranda has quit IRC | 14:54 | |
| *** jbadiapa has joined #openstack-ansible | 14:58 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-specs master: Drop unsupported oslosphinx https://review.opendev.org/685988 | 15:00 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-specs master: fix misspelling https://review.opendev.org/682305 | 15:01 |
| *** cshen has quit IRC | 15:03 | |
| *** jbadiapa has quit IRC | 15:05 | |
| *** SmearedBeard has quit IRC | 15:08 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-specs master: Update Specs to use openstackdocstheme https://review.opendev.org/685988 | 15:12 |
| *** BjoernT has quit IRC | 15:12 | |
| *** BjoernT has joined #openstack-ansible | 15:18 | |
| *** ianychoi has quit IRC | 15:20 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-specs master: Update Specs to use openstackdocstheme https://review.opendev.org/685988 | 15:20 |
| *** ianychoi has joined #openstack-ansible | 15:23 | |
| *** prometheanfire has quit IRC | 15:24 | |
| *** prometheanfire has joined #openstack-ansible | 15:25 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Whitelist octavia tests when octavia service is present https://review.opendev.org/668136 | 15:25 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-specs master: fix misspelling https://review.opendev.org/682305 | 15:31 |
| *** gyee has joined #openstack-ansible | 15:34 | |
| *** BjoernT has quit IRC | 15:39 | |
| *** rpittau is now known as rpittau|afk | 15:42 | |
| *** BjoernT has joined #openstack-ansible | 15:44 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_nova master: vars: package cleanup https://review.opendev.org/662585 | 15:46 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_nova master: vars: package cleanup https://review.opendev.org/662585 | 15:46 |
| *** BjoernT_ has joined #openstack-ansible | 15:48 | |
| *** BjoernT has quit IRC | 15:49 | |
| *** ivve has quit IRC | 15:55 | |
| tiffanie | #startmeeting openstack_ansible_meeting | 16:00 |
| openstack | Meeting started Tue Oct 1 16:00:05 2019 UTC and is due to finish in 60 minutes. The chair is tiffanie. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)" | 16:00 | |
| openstack | The meeting name has been set to 'openstack_ansible_meeting' | 16:00 |
| tiffanie | #topic office hours | 16:00 |
| *** openstack changes topic to "office hours (Meeting topic: openstack_ansible_meeting)" | 16:00 | |
| noonedeadpunk | o/ | 16:00 |
| cjloader | o/ | 16:00 |
| noonedeadpunk | cjloader: how is your ironic patch doing? | 16:00 |
| cjloader | i'm testing on hardware now | 16:01 |
| cjloader | to ensure that it is not breaking ironic | 16:01 |
| noonedeadpunk | ok, great | 16:02 |
| jrosser | o/ | 16:02 |
| *** macz has joined #openstack-ansible | 16:04 | |
| guilhermesp | o/ | 16:06 |
| *** SmearedBeard has joined #openstack-ansible | 16:07 | |
| noonedeadpunk | so I'm a bit stuck with murano right now. Tempest tests that never ends... But during looking inside I've just found that it's nova instance that stuck in build state. Hadn't dig into this yet. | 16:08 |
| noonedeadpunk | jrosser: I see you had some progress with mind-to-mgmt ? | 16:09 |
| guilhermesp | i guess the last chance was a couple of days ago https://review.opendev.org/#/q/topic:bind-to-mgmt+(status:open+OR+status:merged) | 16:10 |
| guilhermesp | but I see almost a greenfield here https://review.opendev.org/#/c/670051/ :) | 16:11 |
| noonedeadpunk | yep, and debian is kinda worth rechecking | 16:11 |
| noonedeadpunk | so that's what I was asking:) | 16:11 |
| guilhermesp | so let me recheck that | 16:12 |
| jrosser | guilhermesp: yes we are very very close | 16:15 |
| jrosser | i wonder if we should just merge all the "Add global override for service bind address" patches | 16:15 |
| jrosser | then even if we don't finish the detail of galera for train we already have a set of overrides that work for multinode | 16:15 |
| noonedeadpunk | why not? | 16:15 |
| jrosser | i mean we should merge them, i think | 16:16 |
| guilhermesp | i just rechecked some that has some isolated jobs failing | 16:16 |
| noonedeadpunk | Just remove -W and I'm pretty ready for reviews | 16:16 |
| jrosser | possibly some minor py3 bugs revealed by these as some roles we've not really touched since switching to py3 | 16:17 |
| jrosser | so os_glance is failing this now always openstack-ansible-nfs_glance | 16:17 |
| jrosser | which maybe we should just get rid of? | 16:17 |
| guilhermesp | btw, looking at https://review.opendev.org/#/c/683080/ do we still need this job? https://github.com/openstack/openstack-ansible-os_glance/blob/ae681ded4e6bc033c75f72b7a429a5b04dd0a676/zuul.d/jobs.yaml#L16 | 16:18 |
| guilhermesp | yeah jrosser | 16:18 |
| jrosser | if anyone really wants that we should convert it to a scenario in the integrated repo | 16:19 |
| guilhermesp | agreed | 16:20 |
| noonedeadpunk | jrosser: it's failing due to the same tempest thing | 16:20 |
| jrosser | ok, so i removed all the -W from the bind-to-mgmt patches | 16:21 |
| noonedeadpunk | So, we can just fix tempest and leave it as is as for now | 16:21 |
| jrosser | noonedeadpunk: ah interesting, how did you find that? | 16:21 |
| jrosser | i could not find the tempest log easily | 16:21 |
| jrosser | another outstanding thing is i've not been able to land any of the ansible 2.8 patches to the test repo | 16:22 |
| jrosser | they fail in obscure ways looks like the connection plugin | 16:22 |
| jrosser | which we don't see at all in the integrated repo | 16:22 |
| jrosser | for example https://review.opendev.org/#/c/659658/ | 16:23 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_masakari master: Add global override for service bind address https://review.opendev.org/683138 | 16:24 |
| *** weshay_ has joined #openstack-ansible | 16:25 | |
| noonedeadpunk | I've scrolled through ara error and found that the same keystone test fails | 16:25 |
| *** weshay has quit IRC | 16:26 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_glance master: Add global override for service bind address https://review.opendev.org/683080 | 16:33 |
| jrosser | noonedeadpunk: ^ that should test the glance / tempest thing | 16:34 |
| noonedeadpunk | actually https://review.opendev.org/#/c/685974/ seems to fail:( | 16:36 |
| noonedeadpunk | ok, but that's completely another thing I'd say.... | 16:36 |
| openstackgerrit | Merged openstack/openstack-ansible master: Collect logs from auditd in CI jobs https://review.opendev.org/681241 | 16:37 |
| chandankumar | jrosser: noonedeadpunk what was the tempest issue? | 16:37 |
| jrosser | chandankumar: https://review.opendev.org/#/c/685974/ | 16:37 |
| *** BjoernT has joined #openstack-ansible | 16:40 | |
| jrosser | so one of those is failing on this https://github.com/openstack/tempest/blob/master/tempest/api/identity/admin/v3/test_trusts.py#L34-L35 | 16:40 |
| jrosser | maybe becasue of this? https://github.com/openstack/openstack-ansible-os_tempest/blob/master/templates/tempest.conf.j2#L69-L70 | 16:41 |
| *** BjoernT_ has quit IRC | 16:42 | |
| noonedeadpunk | let's check | 16:43 |
| jrosser | then the second one is here https://github.com/openstack/tempest/blob/master/tempest/api/identity/base.py#L315-L317 | 16:43 |
| chandankumar | checking | 16:44 |
| jrosser | needs application_credentials=true as well in [identity-feature-enabled] | 16:44 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_tempest master: Fix tempest source install condition https://review.opendev.org/685974 | 16:46 |
| *** SmearedBeard has quit IRC | 16:46 | |
| *** weshay_ is now known as weshay | 16:46 | |
| chandankumar | as per this https://github.com/openstack/tempest/blob/master/tempest/config.py#L251 -> it should be enabled by default | 16:46 |
| jrosser | chandankumar: default=False? | 16:47 |
| noonedeadpunk | but default is false | 16:47 |
| noonedeadpunk | ++ | 16:47 |
| jrosser | or you mean by default we should enable it :) | 16:48 |
| chandankumar | we need to enable by default to true | 16:48 |
| chandankumar | I am checking centos one | 16:48 |
| chandankumar | jrosser: noonedeadpunk in centos it is skipped https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_53d/685974/2/check/openstack-ansible-deploy-aio_distro_metal-centos-7/53d5c75/logs/openstack/aio1-utility/stestr_results.html | 16:50 |
| chandankumar | setUpClass (tempest.api.identity.admin.v3.test_trusts | 16:50 |
| chandankumar | https://eb7fd4fca907b0349dac-fddd31f569f44d98bd401bfd88253d97.ssl.cf1.rackcdn.com/685974/2/check/openstack-ansible-deploy-aio_metal-debian-stable/6801486/logs/openstack/aio1-utility/stestr_results.html -> failed but why | 16:51 |
| * chandankumar looks deeper | 16:51 | |
| noonedeadpunk | that's rly interesting question... Maybe new condition doesn't work as expected? | 16:52 |
| noonedeadpunk | I mean which changed with that patch... | 16:52 |
| jrosser | so we've now moved to master git version of tempest rather than pip | 16:54 |
| noonedeadpunk | yep, that might be the case as wel.. But why centos do not fail then.. | 16:54 |
| noonedeadpunk | but skips as expected | 16:54 |
| jrosser | oh well, we've not bumped the master sha have we | 16:55 |
| jrosser | so now we could have the opposite problem that tempest is too new for the versions of the service we run | 16:55 |
| *** cshen has joined #openstack-ansible | 16:56 | |
| noonedeadpunk | I'd say we did https://opendev.org/openstack/openstack-ansible/src/commit/e2c7eb271cc79e8077d2ac6e13f614053d2585f8/playbooks/defaults/repo_packages/openstack_testing.yml | 16:56 |
| noonedeadpunk | but yeah, we didn't test it actually | 16:56 |
| jrosser | right - but this https://review.opendev.org/#/c/683821/ | 16:56 |
| jrosser | ^ thats failing becasue tempest pip is too old for the service sha | 16:57 |
| jrosser | this has the feeling of a circular problem :( | 16:57 |
| chandankumar | from this https://eb7fd4fca907b0349dac-fddd31f569f44d98bd401bfd88253d97.ssl.cf1.rackcdn.com/685974/2/check/openstack-ansible-deploy-aio_metal-debian-stable/6801486/logs/ara-report/ | 16:57 |
| chandankumar | https://github.com/openstack/tempest/commit/8d1b36559c499c588c2a2644cd80cbcfeeda4291 got installed | 16:57 |
| noonedeadpunk | but jrosser means that we probably need newer one | 16:58 |
| noonedeadpunk | mich makes kinda cross-dependency | 16:58 |
| noonedeadpunk | If I understand correctly | 16:58 |
| chandankumar | noonedeadpunk: may be due this https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L244 it is coming? | 16:58 |
| jrosser | so if we rewind a bit, this is where it all started https://review.opendev.org/#/c/682460/ | 16:58 |
| jrosser | there was a fix in keystone, we needed to bump the sha to get that | 16:59 |
| jrosser | but then * was broken because in turn that needed a newer tempest | 17:00 |
| tiffanie | #endmeeting | 17:01 |
| *** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC" | 17:01 | |
| openstack | Meeting ended Tue Oct 1 17:01:37 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-10-01-16.00.html | 17:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-10-01-16.00.txt | 17:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-10-01-16.00.log.html | 17:01 |
| * jrosser has to travel | 17:01 | |
| noonedeadpunk | all in all I hope that enabling things will work out | 17:03 |
| *** cshen has quit IRC | 17:06 | |
| *** cshen has joined #openstack-ansible | 17:07 | |
| *** cshen has quit IRC | 17:12 | |
| *** cshen has joined #openstack-ansible | 17:23 | |
| *** gillesMo has quit IRC | 17:25 | |
| *** r81 has quit IRC | 17:27 | |
| *** cshen has quit IRC | 17:28 | |
| jrosser | oh nice this works now https://review.opendev.org/#/c/662585/ | 17:37 |
| *** ivve has joined #openstack-ansible | 17:41 | |
| *** gillesMo has joined #openstack-ansible | 18:26 | |
| *** ansmith_ has joined #openstack-ansible | 19:00 | |
| *** ansmith has quit IRC | 19:02 | |
| *** spsurya has quit IRC | 19:09 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_sahara master: Add global override for service bind address https://review.opendev.org/683139 | 19:19 |
| *** markvoelker has quit IRC | 19:21 | |
| *** spatel has joined #openstack-ansible | 19:22 | |
| spatel | noonedeadpunk: hey! | 19:22 |
| noonedeadpunk | jrosser: that's nice:) | 19:23 |
| noonedeadpunk | spatel: hi:) sorry, a bit busy now | 19:23 |
| spatel | noonedeadpunk: no problem, take your time. | 19:25 |
| noonedeadpunk | jrosser: but https://review.opendev.org/#/c/685974/3 is even worse.... | 19:29 |
| jrosser | i saw yes, just looking | 19:29 |
| jrosser | quite probably we misunderstand something here | 19:29 |
| *** SmearedBeard has joined #openstack-ansible | 19:30 | |
| mnaser | its just yaml thjey said | 19:35 |
| mnaser | they said* | 19:35 |
| *** Miouge has quit IRC | 19:38 | |
| *** Miouge has joined #openstack-ansible | 19:38 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Bump SHAs for master https://review.opendev.org/683821 | 19:43 |
| jrosser | noonedeadpunk: https://zuul.opendev.org/t/openstack/build/9c6cba0c1d914529980ad348f2a7629e/log/logs/host/keystone-wsgi-public.service.journal-18-18-10.log.txt.gz#7170 | 19:56 |
| *** ansmith_ has quit IRC | 19:57 | |
| jrosser | hmm just a warning though | 19:58 |
| *** markvoelker has joined #openstack-ansible | 20:00 | |
| jrosser | it actually fails here https://zuul.opendev.org/t/openstack/build/9c6cba0c1d914529980ad348f2a7629e/log/logs/host/keystone-wsgi-public.service.journal-18-18-10.log.txt.gz#7152 | 20:04 |
| *** kopecmartin is now known as kopecmartin|off | 20:11 | |
| *** SmearedBeard has quit IRC | 20:11 | |
| *** Smeared_Beard has joined #openstack-ansible | 20:11 | |
| jrosser | noonedeadpunk: cmurphy> jrosser: it needs 'application_credential' as part of the list in [auth]/methods, it is in the list by default but if your ansible config is overriding it then it would fail | 20:11 |
| noonedeadpunk | ah, yep | 20:12 |
| *** ansmith_ has joined #openstack-ansible | 20:12 | |
| noonedeadpunk | I remember overriding this for keystone localy | 20:12 |
| noonedeadpunk | To enable application credentials | 20:13 |
| noonedeadpunk | keystone_auth_methods | 20:13 |
| noonedeadpunk | https://opendev.org/openstack/openstack-ansible-os_keystone/src/branch/master/defaults/main.yml#L63\ | 20:14 |
| jrosser | maybe no good reason we override the default? | 20:15 |
| noonedeadpunk | I'd say that this default was placed when application credentials was not in keystone... So maybe we should update defaults? | 20:16 |
| noonedeadpunk | With upgrade reno | 20:17 |
| jrosser | maybe even remove the setting totally | 20:17 |
| noonedeadpunk | i guess we needed it for federation? | 20:18 |
| noonedeadpunk | https://opendev.org/openstack/openstack-ansible-os_keystone/src/branch/master/templates/keystone.conf.j2#L52 | 20:19 |
| noonedeadpunk | and default is the way wider | 20:20 |
| noonedeadpunk | and not applicable for federation | 20:20 |
| *** ansmith has joined #openstack-ansible | 20:20 | |
| noonedeadpunk | So I'd just adjusted keystone_auth_methods | 20:21 |
| jrosser | yes here https://opendev.org/openstack/openstack-ansible-os_keystone/src/branch/master/defaults/main.yml#L63 | 20:21 |
| jrosser | agreed | 20:21 |
| jrosser | i can patch? | 20:22 |
| *** ansmith_ has quit IRC | 20:23 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: Add application credentials as a default authentication method https://review.opendev.org/686041 | 20:29 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Fix tempest source install condition https://review.opendev.org/685974 | 20:30 |
| *** pcaruana has quit IRC | 20:33 | |
| *** ansmith has quit IRC | 20:45 | |
| mnaser | jrosser: we just got an epyc (rome) server to try and see how things work | 20:56 |
| jrosser | i have some arriving in the next eek or so | 20:56 |
| jrosser | *week | 20:56 |
| mnaser | cat /proc/cpuinfo | grep ^process | wc -l => 96 | 20:56 |
| mnaser | and the price is stupid compared to intels | 20:56 |
| jrosser | is this for compute? | 20:56 |
| mnaser | yeah | 20:57 |
| mnaser | the equiv of this is the intel 8268 | 20:57 |
| mnaser | $6.3k each, so $12.6k both | 20:57 |
| jrosser | i have some 7402P for all NVMe ceph osd nodes | 20:57 |
| mnaser | the epyc server turns out to be the price of a single intel cpu, with 512g of ddr4-3200 (intel doesnt even support this fast) cpus | 20:58 |
| mnaser | and pcie 4, not that i have anything that can use it yet | 20:58 |
| jrosser | mellanox dual port 100G is the only thing i have which could actually need that | 20:59 |
| mnaser | and i think this is setup with 8 memory channels? | 20:59 |
| jrosser | yes | 20:59 |
| mnaser | im very excited to see what it does | 20:59 |
| mnaser | btw if you're interested, train will support SEV | 21:00 |
| mnaser | you do lose live migration but | 21:00 |
| jrosser | i held off amd for computes | 21:00 |
| mnaser | jrosser: well ill let you know how it goes :) | 21:02 |
| jrosser | similar for the ceph things | 21:03 |
| jrosser | i'm very interested to see if it can keep up with a good number of NVMe | 21:03 |
| jrosser | and if i need to do a bunch of cpu pinning as iirc it's actually a numa system even in one socket | 21:04 |
| BjoernT | does anyone how to deal with distutils.errors.DistutilsError: Download error for https://files.pythonhosted.org/packages/8d/e9/0c8afd1579e5cf7bc0f06fbcd7cdb954cbc0baadd505973949a99337da1c/cffi-1.12.3-cp27-cp27mu-manylinux1_x86_64.whl#sha256=2444d0c61f03dcd26dbf7600cf64354376ee579acad77aef459e34efcb438c63: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590) | 21:09 |
| BjoernT | http://paste.openstack.org/show/780646/ | 21:09 |
| BjoernT | I have already --trusted-host=files.pythonhosted.org inside command line and also pip.conf | 21:10 |
| BjoernT | but it seems that the setuptools import inside the /usr/local/lib/python2.7/dist-packages/setuptools/package_index.py is ignoring all this | 21:10 |
| jrosser | BjoernT: i wonder if it is python2.7.<whatever> not dealing with SNI properly? | 21:13 |
| BjoernT | hard to tell , i can pip wheel it manually | 21:15 |
| BjoernT | but not when repo-install runs | 21:15 |
| BjoernT | makes me believe that --trusted-host are ignored | 21:16 |
| *** nicolasbock has quit IRC | 21:17 | |
| BjoernT | also there is a mismatch in queens on the version, cffi is limited to 1.11.4 but cryptography pulls in 1.12.3 which is strange | 21:17 |
| *** csmart_ has quit IRC | 21:24 | |
| *** openstackstatus has quit IRC | 21:32 | |
| *** openstackstatus has joined #openstack-ansible | 21:34 | |
| *** ChanServ sets mode: +v openstackstatus | 21:34 | |
| *** spatel has quit IRC | 21:44 | |
| *** ansmith has joined #openstack-ansible | 22:06 | |
| *** luksky has quit IRC | 22:10 | |
| *** weshay has quit IRC | 22:29 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: vars: package cleanup https://review.opendev.org/662585 | 22:30 |
| *** tosky has quit IRC | 23:02 | |
| *** BjoernT has quit IRC | 23:04 | |
| *** macz has quit IRC | 23:05 | |
| *** macz has joined #openstack-ansible | 23:07 | |
| *** macz has quit IRC | 23:10 | |
| *** BjoernT has joined #openstack-ansible | 23:33 | |
| snadge | is redhat 8 supported, or preferred to v7? whats the story with that.. what platforms are we all using | 23:37 |
| *** markvoelker has quit IRC | 23:38 | |
| *** markvoelker has joined #openstack-ansible | 23:44 | |
| *** ivve has quit IRC | 23:47 | |
| BjoernT | I doubt redhat 8 has been tested yet, as usually centos would come first as it's easier to gate (no licenses)... | 23:50 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
