Wednesday, 2018-11-07

*** DanyC has quit IRC00:01
*** DanyC_ has quit IRC00:27
*** nurdie has joined #openstack-ansible00:27
*** nurdie has quit IRC00:31
*** irclogbot_0 has quit IRC00:38
*** nurdie has joined #openstack-ansible00:48
*** cshen has joined #openstack-ansible00:50
*** nurdie has quit IRC00:52
*** cshen has quit IRC00:55
*** jonher has quit IRC01:37
*** jonher has joined #openstack-ansible01:40
*** jonher has quit IRC01:46
*** nurdie has joined #openstack-ansible01:49
*** jonher has joined #openstack-ansible01:51
*** nurdie has quit IRC01:54
*** markvoelker has quit IRC02:00
*** markvoelker has joined #openstack-ansible02:00
*** markvoelker has quit IRC02:02
*** cmart has quit IRC02:06
*** dave-mccowan has joined #openstack-ansible02:16
*** DanyC has joined #openstack-ansible02:27
*** dave-mccowan has quit IRC02:27
*** nurdie has joined #openstack-ansible02:30
*** DanyC has quit IRC02:32
*** nurdie has quit IRC02:34
*** mmercer has quit IRC02:44
ravirjnjrosser: I have deployed cinder successfully. it was haproxy.02:50
*** nurdie has joined #openstack-ansible02:51
*** nurdie has quit IRC02:55
*** cmart has joined #openstack-ansible03:06
*** dave-mccowan has joined #openstack-ansible03:24
*** cmart has quit IRC03:24
*** dave-mccowan has quit IRC03:36
*** radeks has joined #openstack-ansible03:47
*** cmart has joined #openstack-ansible03:50
*** nurdie has joined #openstack-ansible03:52
*** nurdie has quit IRC03:57
*** nurdie has joined #openstack-ansible04:13
*** nurdie has quit IRC04:17
*** cmart has quit IRC04:23
*** ThiagoCMC has quit IRC04:33
*** cmart has joined #openstack-ansible04:43
*** cshen has joined #openstack-ansible04:45
*** cshen has quit IRC04:50
*** cshen has joined #openstack-ansible04:56
*** faizy98 has joined #openstack-ansible04:56
*** cshen has quit IRC05:00
*** cmart has quit IRC05:02
*** nurdie has joined #openstack-ansible05:14
*** hamzy has joined #openstack-ansible05:18
*** med_ has quit IRC05:29
openstackgerritCorey Wright proposed openstack/openstack-ansible master: Fix blazar-nova Git field names  https://review.openstack.org/61607305:47
*** vnogin has joined #openstack-ansible05:52
*** vnogin has quit IRC05:57
*** cshen has joined #openstack-ansible06:04
*** cshen has quit IRC06:09
*** rgogunskiy has joined #openstack-ansible06:39
*** radeks has quit IRC06:49
*** nurdie has quit IRC06:55
*** nurdie has joined #openstack-ansible07:15
*** nurdie has quit IRC07:20
*** cshen has joined #openstack-ansible07:28
*** nurdie has joined #openstack-ansible07:36
*** pcaruana has joined #openstack-ansible07:36
*** hamzaachi has joined #openstack-ansible07:40
*** nurdie has quit IRC07:40
*** fghaas has joined #openstack-ansible07:48
*** nurdie has joined #openstack-ansible07:57
*** nurdie has quit IRC08:01
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata  https://review.openstack.org/61577008:08
*** blinkiz has joined #openstack-ansible08:17
blinkizHello. Software requirements for targets hosts include a working Ubuntu 18.04 installation. I have a bunch of Supermicro X11 computers that will be the target hosts. Am looking for recommendation about automating the deployment of these target hosts into a running system that OpenStack-Ansible likes. Something like Canonical Metal as a Service (MAAS) for Ubuntu.08:21
*** rgogunskiy has quit IRC08:25
jrosserblinkiz: there will be as many different answers to that as people you ask..... :)08:32
blinkizjrosser, it sure is.08:35
jrosserI spent time with cobbler and other “black box” provisioning tools, but eventually ditched anything like that in favour of just running plain vanilla dhcpd and tftpd.08:35
blinkizApparently what am looking for is called Linux Server Provisioning Software. With that keyword I have now found a couple of alternatives08:35
jrosserIf you are doing anything with reasonable scale or wanting repeatability imho you should first consider what the “source of truth” is going to be for the data which describes everything you provision08:37
*** nurdie has joined #openstack-ansible08:37
blinkizAfter I have searched a bit it seems that Foreman and Ubuntu MAAS is best if I want Ubuntu 18.04 as operating system.08:39
jrosserYou are probably going to need some subsequent configuration after  pxebootling, like an additional set of ansible that you must run08:40
jrosserIn order to meet the prerequisites of OSA08:40
blinkizjrosser, yeah. you are right. Actually currently looking into that. How Foreman/Ubuntu MAAS can launch Ansible playbooks within AWX. I hope one of these two products will be a clear winner so I do not need to install and test them both ;)08:42
*** nurdie has quit IRC08:42
jrosserYou need to pick whatever suits your requirements, the products you mention will have a defined workflow and set of behaviour that may/may not be acceptable. Also consider what would happen if your mass/foreman server blew up, can you trivially reprovision it and put the data back?08:46
*** radeks has joined #openstack-ansible08:52
openstackgerritKimMinsik proposed openstack/openstack-ansible-os_cinder master: Add resource_filter field in cinder.conf to retrive volume & snapshot information with filter for for non-admin user  https://review.openstack.org/61611308:58
*** nurdie has joined #openstack-ansible08:58
*** nurdie has quit IRC09:03
*** kukacz has quit IRC09:04
*** kukacz has joined #openstack-ansible09:05
*** vnogin has joined #openstack-ansible09:15
openstackgerritwangqi proposed openstack/openstack-ansible-plugins master: 'os' imported but unused  https://review.openstack.org/61611909:18
*** shardy has joined #openstack-ansible09:19
*** vnogin has quit IRC09:20
*** DanyC has joined #openstack-ansible09:20
*** django has joined #openstack-ansible09:26
*** electrofelix has joined #openstack-ansible09:29
odyssey4memorning folks09:30
fghaasblinkiz: you could stand up an AIO OSA on your laptop, use that to deploy Ubuntu to your proper cloud hardware with ironic, then use OSA again to deploy OpenStack on that...09:33
odyssey4mejrosser hwoarang could you give https://review.openstack.org/615258 a review please - it'll unblock stable/rocky's integrated build09:33
blinkizfghaas, aa, cool solution09:34
odyssey4meblinkiz you may want to take a look at the very simple dhcpd/tftpboot implementation here: https://github.com/openstack/openstack-ansible-ops/tree/master/pxelinux-provisioning09:34
odyssey4mesmoke87 I think the vpnaas dashboard is implemented - which series & release are you using?09:36
noonedeadpunkmorning everyone09:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Adds option to enable ARA plugin install  https://review.openstack.org/61600409:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Restart cinder-scheduler instead of reloading  https://review.openstack.org/61564509:38
hwoarangodyssey4me: checking09:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: zuul: Make openSUSE distro jobs voting  https://review.openstack.org/61446309:39
hwoarangah one of these again09:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Ensure ceph server apt pinning is well defined  https://review.openstack.org/61477709:39
odyssey4mehwoarang yep, this is the final one that pulls it all together again09:40
arxcruzodyssey4me: https://review.openstack.org/#/c/612968/ pass, can you check so i can set the tempestconf value to false?09:44
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_neutron master: Refactor pre-install checks into neutron_check.yml  https://review.openstack.org/61526209:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: refactor: remove unused proxy settings file  https://review.openstack.org/61533709:59
*** blinkiz has quit IRC09:59
*** nurdie has joined #openstack-ansible10:00
odyssey4mearxcruz so tempestconf puts its result into the workspace/etc/tempest.conf ?10:03
*** nurdie has quit IRC10:04
openstackgerritwangqiang-bj proposed openstack/openstack-ansible master: fix typo  https://review.openstack.org/61613710:07
openstackgerritwangqi proposed openstack/openstack-ansible-os_sahara master: Trivial: Fix the pep8 warning  https://review.openstack.org/58905710:08
arxcruzodyssey4me: yes, i tried to put directly on /etc/tempest but didn’t work, i don’t know the reason10:08
odyssey4mearxcruz alright - to add tests with that enabled would be a few lines in tox.ini and zuul.d/ - but I guess you're wanting to work that out next, right?10:09
openstackgerritArx Cruz proposed openstack/openstack-ansible-os_tempest master: Enable python-tempestconf support  https://review.openstack.org/61296810:10
arxcruzodyssey4me: yup10:10
arxcruzodyssey4me: done, patch with the value set to false10:10
noonedeadpunkfolks, am I right, that keystone needs this https://github.com/openstack/openstack-ansible-os_keystone/blob/master/templates/keystone.conf.j2#L25-L27 only when keystone_ceilometer_enabled: true?10:11
noonedeadpunkAs I'm going to patch this10:11
noonedeadpunkoh, it's just not backported to rocky...10:12
odyssey4menoonedeadpunk port it back then :)10:12
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: Drop COPR priority settings  https://review.openstack.org/61534910:16
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: lxc: stop mirroring COPR locally on CentOS 7  https://review.openstack.org/61535110:16
openstackgerritwangqi proposed openstack/openstack-ansible-os_sahara master: Trivial: Fix the pep8 warning  https://review.openstack.org/58905710:17
openstackgerritwangqi proposed openstack/openstack-ansible-os_sahara master: Trivial: Fix the pep8 warning  https://review.openstack.org/58905710:19
*** nurdie has joined #openstack-ansible10:21
mnaserdoes anyone know off the top of their minds why the endpoint would report as missing here? https://review.openstack.org/#/c/614556/10:21
mnasertrying to give dcdamien a hand with his patch10:21
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_keystone stable/rocky: Update messaging configuration  https://review.openstack.org/61614210:22
mnaseri cant imagine why it wouldnt be there..10:23
mnaseroh wait10:23
mnasermistral trove  murano and designate tests running there10:23
mnaserdid we break something with os_tempest maybe?10:24
mnaserhttp://logs.openstack.org/56/614556/5/check/openstack-ansible-functional-distro_install-centos-7/2b12218/logs/openstack/keystone/stestr_results.html arxcruz any ideas?10:24
jrossermnaser: the barbican role tests look like they have blown up co-incident with the tempest changes too10:24
*** nurdie has quit IRC10:25
arxcruzmnaser: well, my patch isn’t merged yet, the endpoint not found error is related to keystone, perhaps the server didn’t started properly ?10:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Combined backport from master to ensure nspawn functionality in rocky  https://review.openstack.org/61190510:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Combined backport from master to ensure nspawn functionality in rocky  https://review.openstack.org/61190510:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Combined backport from master to ensure nspawn functionality in rocky  https://review.openstack.org/61190510:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Install the timezone package by default  https://review.openstack.org/61615010:40
noonedeadpunkDoes anybody knows, why do we need it here? https://github.com/openstack/openstack-ansible/blob/master/inventory/group_vars/nova_all.yml#L65-L68 Just curiosity10:40
*** nurdie has joined #openstack-ansible10:41
odyssey4menoonedeadpunk that was a way of trying to optimise the deployment - we could move that to using a sensible default in the role10:41
odyssey4mesame with these: https://github.com/openstack/openstack-ansible/blob/master/inventory/group_vars/nova_all.yml#L44-L4910:42
odyssey4mein fact, many of the group vars can be moved into role defaults instead - and it'd reduce memory consumption and speed deploys up a bit10:42
noonedeadpunkok, thanks for explanation)10:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Ensure libpython is included in base container builds  https://review.openstack.org/61615110:44
noonedeadpunkI've just found, that every group has "<service>_ceilometer_enabled", except ceilometer_all, so decided to dig a bit into it10:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Ensure development libs are installed in containers  https://review.openstack.org/61615210:45
DoberMann instead of splitting load hi, i was wondering if there is a reason to  use haproxy in active backup mode for the galera cluster by default ? ends up with all connections active on the same galera node10:45
noonedeadpunkSo we've got situation, that keystone thinks, that ceilometer is enabled, but ceilometer itself doesn't think so and don't read messages from rabbitmq queue10:45
*** nurdie has quit IRC10:45
DoberMannhi, i was wondering if there is a reason to  use haproxy in active backup mode for the galera cluster by default ? ends up with all connections active on the same galera node instead of splitting load10:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Document adding "extra" networks  https://review.openstack.org/61615410:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Add documentation for routed interfaces  https://review.openstack.org/61615510:47
*** hamzaachi has quit IRC10:48
noonedeadpunkodyssey4me: so should I stick to the rules and patch group_vars, or place condition in ceilometer role itself in main.yml?10:49
odyssey4menoonedeadpunk we've been trying to move things out of group vars and into role defaults where possible, so I'd suggest doing that with the appropriate precautions10:52
odyssey4meassuming it's sensible to do that10:52
DoberMannanswering to myself : it seems related to https://openstack.nimeyo.com/35943/openstack-operators-openstack-and-mysql-galera-with-haproxy10:52
*** priteau has joined #openstack-ansible10:53
odyssey4meDoberMann we have found that there's little benefit from a performance standpoint, but more risk of transactions collisions - most OSA consumers are happy with it as-is and have found no real incentive to change it10:54
*** coolj has quit IRC10:57
*** nurdie has joined #openstack-ansible11:02
*** gokhan has joined #openstack-ansible11:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Add documentation for routed interfaces  https://review.openstack.org/61615511:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Add missing variable for nspawn networking  https://review.openstack.org/61615911:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Add host only network option  https://review.openstack.org/61616011:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Modify the network to ensure their more restrictive  https://review.openstack.org/61616111:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts stable/rocky: Correct host only routes  https://review.openstack.org/61616211:03
openstackgerritMerged openstack/openstack-ansible-os_nova master: Clean up a-r-r role for upgrade test removal  https://review.openstack.org/61333011:04
*** nurdie has quit IRC11:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_container_create stable/rocky: Add test for host_only networks and ensure network ordering  https://review.openstack.org/61616311:08
jrosserodyssey4me: thanks for the tip yesterday about how to run the lxc_hosts role test locally11:09
jrosserit did of course pass, somewhat in contrast to my across-the-board failure here https://review.openstack.org/#/c/613078/11:10
jrossersomething seems to clobber the container startup there which isnt obvious, have you seen anything like that?11:11
DoberMannodyssey4me: thx11:11
DoberMannwe're hitting this issue because in iddle (dur mainly to monitoring) we have about 1450 connections and the limit is (by default) 1600 the too many connections is not that far ;)11:12
DoberMann*due11:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_container_create stable/rocky: Add missing user defined interface support  https://review.openstack.org/61616411:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_container_create stable/rocky: Add missing user defined interface support  https://review.openstack.org/61616411:14
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_container_create stable/rocky: Add a guard so we don't allow for duplicate config  https://review.openstack.org/61616511:14
odyssey4mejrosser hwoarang these are all the backports needed to get nspawn up to speed for rocky: https://review.openstack.org/#/q/topic:nspawn-rocky-fixes+(status:open+OR+status:merged)11:16
odyssey4meIf you could verify that they're matching backports I'd appreciate it.11:17
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Added designate and trove services  https://review.openstack.org/61616711:19
mnaserarxcruz: those services aren’t even deployed though. It’s trying to test for things like murano11:21
arxcruzmnaser: so keystone isn’t deployed? Then, that’s the problem huh?11:22
mnaserNo, that link was testing murano too11:23
arxcruztempest.lib.exceptions.EndpointNotFound: Endpoint not found11:23
arxcruzSomething went wrong with whatever designate_tempest_plugin endpoint uses11:30
arxcruzAnd it’s only happening in this job right ?11:33
arxcruzOther jobs i see it’s passing11:33
arxcruzodyssey4me: mnaser https://review.openstack.org/612968 ready for review/merge :)11:34
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Added designate and trove services  https://review.openstack.org/61616711:40
odyssey4meDoberMann it's probably best to up the number of connections then?11:41
*** nurdie has joined #openstack-ansible11:42
DoberMannodyssey4me: yes will do11:42
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Added designate and trove services  https://review.openstack.org/61616711:44
*** nurdie has quit IRC11:47
noonedeadpunkjrosser: I've moved "ssl=0" out of this patch. So should I split another (all) parts of it into separate patches?11:48
jrossernoonedeadpunk: in the spirit of one patch solving one just problem it would be better to split them. Particularly having the fix for something broken in it's own patch means it can easily be backported.11:53
odyssey4mefolks, I need another vote to remove this tech debt: https://review.openstack.org/#/q/topic:remove-dragonflow+status:open11:53
* jrosser looks11:53
jrosserodyssey4me: done the one i can...... can i swap for some advice on lxc_hosts?11:55
odyssey4mejrosser of course11:56
jrosseri was digging into this https://review.openstack.org/#/c/613078/    full house of test failures there11:56
jrosserand i ran it locally via the lxc_container_create role test, which of course has passed11:57
jrosseris there anything obvious there i'm missing?11:57
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Added designate and trove services  https://review.openstack.org/61616711:58
odyssey4mejrosser looking12:00
*** nurdie has joined #openstack-ansible12:03
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/rocky: [DNM] Testing openSUSE jobs  https://review.openstack.org/60151812:04
*** nurdie has quit IRC12:07
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: <service>_ceilometer_enabled defaults based on services existence  https://review.openstack.org/61617612:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron master: Update legacy neutron L3HA tool support  https://review.openstack.org/61617912:17
mnaserfire drill12:18
mnasergah12:18
mnasercentos 7 rabbitmq gpg keys are borked?12:18
mnaserhttps://review.openstack.org/#/c/615258/ at least there it's complaining12:19
mnaserPublic key for erlang-20.3.8.10-1.el7.centos.x86_64.rpm is not installed12:19
mnaserhttps://www.rabbitmq.com/rabbitmq-release-signing-key.asc is down12:19
mnaseroh12:20
mnaserlooks like they changed their site12:20
mnaserhttps://github.com/rabbitmq/signing-keys/releases/download/2.0/rabbitmq-release-signing-key.asc is the new path12:20
mnaserboo12:20
* mnaser will hardcode key into role to avoid further breakages12:21
odyssey4mejrosser the discussion in https://review.openstack.org/615338 - I'm of the opinion that disabling caching like that when using a proxy is too brutal too, and think perhaps what's done there should be opt-in, or should be left to the deployer to implement on their own12:21
noonedeadpunkcores, your reviews on https://review.openstack.org/#/c/584629/ will be appreciated)12:21
jrosserodyssey4me: it feels like fixing it in the wrong place, a properly done proxy should not break upstream repos12:23
odyssey4meagreed, although I kinda see how it might have got there - because not all proxies are configured well12:23
jrosserif a deployer finds themselves behind a broken proxy then they can add an apt config fragment as part of host prep12:24
odyssey4memnaser yes, please do12:25
odyssey4mewe should actually do that for all the gpg keys12:25
odyssey4mejrosser agreed, and those would get copied into the container in the greenfield deploy12:25
jrosserodyssey4me: here is an example of doing it properly with squid http://www.rushiagr.com/blog/2015/06/05/cache-apt-packages-with-squid-proxy/12:25
odyssey4mejrosser perhaps push up a patch to remove it, but add a release note informing people of the removal and link to where to do it right12:26
odyssey4memaybe also add that to the limited connectivity docs?12:26
jrossersounds like a good plan12:28
mnaserjrosser: feel free to restore my patch12:28
mnaserwe could leave this in there with opt in12:28
mnaserbut i feel like just by default ripping it out might be meh12:28
mnaserat this rate we might as well bundle the damn debs12:30
mnaser:P12:30
odyssey4memnaser I'd prefer to remove it - but we need to notify people about it and how to work with proxies the right way.12:31
jrossermnaser: it sounds like we are all agreed that it should be removed12:31
odyssey4meWe actually have a bunch of stuff to disable cert checks for a similar reason and could do much the same if we're able to articulate how to make things work the right way.12:32
mnaseryeah12:32
jrossertbh i never understood that12:33
jrosserunless there are a bunch of wierd MITM proxies that people have12:34
odyssey4meI think it's transparent proxies that cause trouble.12:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Minimise distro packages installed into the lxc image  https://review.openstack.org/61307812:36
odyssey4mejrosser I don't see why that's failing - trying a rebase to see whether it makes a difference.12:36
jrosserah good plan - my local test would have been very much with latest version of everything12:37
odyssey4mejrosser I wonder if the lxc-container-create role does some thing which rely on some of those packages12:38
odyssey4mein which case, perhaps it should install them12:38
jrosserit's odd, becasue the lxc-hosts role test which invokes the lxc_container_create tests fails there12:38
odyssey4me(the packages it requires)12:38
jrosserbut locally the lxc_container_create one on it's own is ok, but like you say a rebase is a good idea12:38
jrosserit's certainly needing ping as the lxc_container_create role test uses that12:39
jrosserbut that shouldnt stop the containers starting up12:39
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Drop COPR priority settings  https://review.openstack.org/61534912:39
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: lxc: stop mirroring COPR locally on CentOS 7  https://review.openstack.org/61535112:39
fghaasjrosser: do you happen to know why we're doing this? https://github.com/openstack/openstack-ansible/blob/master/inventory/group_vars/ceph-rgw.yml#L3 in other words: why doesn't this simply use "client.rgw.{{ ansible_hostname }}"?12:42
openstackgerritMohammed Naser proposed openstack/openstack-ansible-rabbitmq_server master: Use vendored RPM GPG keys for RabbitMQ  https://review.openstack.org/61618612:46
mnaserodyssey4me: ^12:46
mnasermay be of interest to hwoarang too as it touches a bit of the suse stuff12:47
noonedeadpunkjrosser: splitted into 2 commits https://review.openstack.org/#/q/topic:fix/missing_services+(status:open+OR+status:merged)12:49
mnaserok did we dig into tempest failures on centos?12:49
mnasersorry i had to step out12:49
hwoarangmnaser: for suse so far we are using the distro packages from the cloud repos. maybe centos can do the same from rdo ?12:53
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Remove dragonflow ML2 driver  https://review.openstack.org/61557612:53
jrosserfghaas: i'm really not sure - i was just fiddling with some ansible ad-hoc commands to see what that all comes out as12:53
fghaasjrosser: All right I'm officially stumped because I fail to grok how user_variables and inventory and whatnot works together in this instance. If I override ceph_conf_overrides_rgw in user_variables.yml, run the ceph-rgw-install.yml playbook, then remove the override again from user_variables.yml, and rerun the playbook, I end up with this mess and my rgw's are borked (because they no longer run on the correct ports): http://p12:57
fghaasaste.openstack.org/show/734349/ ([global] section omitted for brevity)12:57
fghaasDon't even know where to start looking here. :(12:57
odyssey4memnaser mind if I tweak to respect the existing data structure which allows people to override if they wish - or are you intentionally removing the ability to override?12:58
odyssey4meoverriding is useful for offline builds, or using your own packages12:58
mnaserodyssey4me: all yours12:58
odyssey4me^ with rgards to https://review.openstack.org/#/c/61618612:59
mnaserYeah it was just easier to put through and I guess I didn’t think of the use casss12:59
jrosserfghaas: unfortunatley my ceph is not deployed with OSA, but i did try this test http://paste.openstack.org/show/734351/13:02
fghaasjrosser: right, so those two out to be equivalent then — or did I miss something?13:03
jrosserfghaas: ansible_hostname may not be available if facts have not been gathered properly, that could be a problem13:03
jrosserfor me it looks OK, but perhaps try that in your environment, changing the hosts: to your rgqw13:03
jrosser*rgw13:03
fghaaswell I've been using just ansible_hostname in my overrides and that worked just fine, hence why I asked13:04
jrosserthis may be one for an ansible jedi....... odyssey4me ?13:04
fghaasbut why I am getting this [client.rgw.] section for things I *didn't* override I have no idea...13:05
*** nurdie has joined #openstack-ansible13:05
odyssey4memnaser bother - it looks like it didn't work in the first place anyway, ok will do a review as is13:06
jrosserfghaas: oh hmm - this could be related to default sections with config_template13:09
*** nurdie has quit IRC13:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server master: Use vendored RPM GPG keys for RabbitMQ  https://review.openstack.org/61618613:10
odyssey4memnaser so here's the kicker - neither redhat nor suse use the upstream packages any more for stein, they use the 'distro' packages (ie OBS (suse) and RDO (redhat))13:11
odyssey4methe issue for stein is that the repo has that URL for gpg checks13:11
odyssey4mebut yeah, if we can get that merged pronto I'll backport a proper change for the stable branches13:12
mnaserodyssey4me: oh thats silly, thats what i thought13:14
mnaserodyssey4me: we desperately need to figure out the upgrade path for that though13:14
odyssey4memnaser well, it'll just take a test to verify what happens13:15
jrosserfghaas: so it's going wrong somewhere here https://github.com/ceph/ceph-ansible/blob/stable-3.2/roles/ceph-config/templates/ceph.conf.j2#L172-L17413:19
jrosserwhich probably means some debug around this point would be useful https://github.com/ceph/ceph-ansible/blob/stable-3.2/roles/ceph-defaults/tasks/facts.yml#L228-L24113:21
fghaasjrosser: I have absolutely no idea.13:23
fghaasI also don't know how I got to this point.13:23
fghaasI'll probably nuke my rgw containers and try deploying them anew13:23
*** nurdie has joined #openstack-ansible13:26
vollmanodyssey4me When you have time can you give this another look?  https://review.openstack.org/#/c/614210/13:27
*** nurdie has quit IRC13:30
arxcruzmnaser: hey, when you have time, can you review https://review.openstack.org/#/c/612968/ ?13:30
*** ansmith has joined #openstack-ansible13:30
odyssey4mejrosser fghaas that is a bit odd - why reach into the cached facts when you can just use the facts at hand... perhaps logan- can shed light, but it seems to me better to use {{ ansible_hostname }} as you suggest13:31
odyssey4mevollman LGTM - need a second review on https://review.openstack.org/614210 from cloudnull or d34dh0r5313:34
fghaasodyssey4me: right. I've given up on this one and I'm spinning a whole new reference environment. Might be able to get back to it tomorrow.13:34
vollmanodyssey4me tyvm13:34
*** fghaas has quit IRC13:34
guilhermespthanks hwoarang https://review.openstack.org/#/c/615608/ :)13:38
smoke87odyssey4me: thanks! openstack-ansible queens 17.1.213:42
mnaserarxcruz: checking13:43
*** nurdie has joined #openstack-ansible13:43
mnaserarxcruz, odyssey4me: i don't want to be a pain and we've done a lot of reiterating on the tempestconf support but is there any reason we're not prefixing variables with the role name13:44
mnaseraka no tempest_ ?13:44
*** pcaruana has quit IRC13:45
mnaserhttps://review.openstack.org/#/c/616186/ could get some love13:48
*** nurdie has quit IRC13:49
mnaserhwoarang: is opensuse 15 the release that comes after 42 or?13:50
mnaseraka once we add opensuse 15 support can we drop the jobs for 42?13:51
odyssey4mesmoke87 it was remove, because the dashboard as it was then was deprecated: https://github.com/openstack/openstack-ansible-os_horizon/commit/6d4412889123516d4cc2ec9f55a961659257eb13#diff-7eeda618087b49ae876084ab6c73fdbb13:51
odyssey4mesmoke87 if there's a new dashboard, then it'll need to be implemented in the horizon role again13:52
*** strattao has joined #openstack-ansible13:52
smoke87odyssey4me: ah ok.. I tried to install the neutron-vpnaas-dashboard but I messed up the horizon container .. .13:54
odyssey4mesmoke87 just destroy and recreate the container13:55
smoke87Yes.. I did13:55
smoke87anyway.. thanks for your help :)13:55
odyssey4mehwoarang are you happy with https://review.openstack.org/616186 - it doesn't really affect the default path for suse, but it does touch the code13:56
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Do not disable caching for apt when http proxies are configured  https://review.openstack.org/61533813:57
jrosserodyssey4me: ^ theres some different words in the commit message and a release note13:57
odyssey4memnaser is the lerlang vendored key missing in here on purpose? https://review.openstack.org/#/c/616186/2/vars/redhat.yml13:58
*** pcaruana has joined #openstack-ansible14:00
arxcruzmnaser: well, i wasn’t aware of that rule, if that’s a thing, I’m glad to change the patch14:05
arxcruzIn fact, i prefer14:06
*** radeks_ has joined #openstack-ansible14:06
*** nurdie has joined #openstack-ansible14:06
*** radeks has quit IRC14:07
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Add ability to deploy Ceph  https://review.openstack.org/60733814:08
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Add ability to deploy Ceph  https://review.openstack.org/60733814:09
arxcruzmnaser: hmmm checking now the name of the variable is tempest_use_tempestconf ...14:09
*** nurdie has quit IRC14:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: MNAIO: Add ability to deploy Ceph  https://review.openstack.org/60733814:12
hwoarangmnaser: yes 15 is after 42...14:16
hwoarangodyssey4me:  https://review.openstack.org/616186 don't know this code path is never actually executed. it's just a placeholder14:17
odyssey4mehwoarang yep, I know14:17
odyssey4mehwoarang the same is true for redhat on stein - I wonder whether the code path should just be removed rather14:19
hwoarangi am not familiar with this role to judge whether it makes sense to use the upstream packages rather than the distro cloud ones :/ i would say that using the distro ones is probably safer14:20
*** nurdie has joined #openstack-ansible14:26
*** pcaruana has quit IRC14:33
*** pcaruana has joined #openstack-ansible14:34
*** nurdie has quit IRC14:35
mnaserarxcruz: as much as it sounds a bit silly14:35
mnaseri'd prefer tempest_use_tempestconf14:35
arxcruzmnaser: but it is tempest_use_tempestconf :)14:36
*** strattao has quit IRC14:36
*** DanyC has quit IRC14:36
arxcruzmnaser: oh, got it, the other variables, sorry, my bad, fixing14:36
*** DanyC has joined #openstack-ansible14:37
openstackgerritArx Cruz proposed openstack/openstack-ansible-os_tempest master: Enable python-tempestconf support  https://review.openstack.org/61296814:40
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: refactor: remove unused proxy settings file  https://review.openstack.org/61533714:41
*** DanyC has quit IRC14:42
openstackgerritArx Cruz proposed openstack/openstack-ansible-os_tempest master: Enable python-tempestconf support  https://review.openstack.org/61296814:42
mnaserok14:43
mnaseri found out why it's broken14:43
mnaserarxcruz: the distro install support in centos7 installs all of the tempest plugins14:44
mnaserarxcruz: and we run smoke tests here -- https://github.com/openstack/openstack-ansible-os_cinder/blob/master/tests/os_cinder-overrides.yml14:44
mnaserso thats why that role is broken14:44
odyssey4memnaser but tempest is supposed to be smart and skip tests for services which aren't installed14:45
*** strattao has joined #openstack-ansible14:45
odyssey4meI guess some plugins might be dumb.14:45
arxcruzno, not plugin14:45
mnaserhttp://logs.openstack.org/56/614556/5/check/openstack-ansible-functional-distro_install-centos-7/d11af04/logs/ara-report/result/94c415ef-cf80-4998-93e6-3db4b56bb8e6/14:45
mnaseryeah14:45
arxcruzproblem is14:45
arxcruzplugins have their own config.py14:45
odyssey4meIn which case we're going to have to re-do how the plugins are installed for pretty much all install methods.14:45
arxcruzand the value to run particular test/service is set to true by default14:45
mnaserhttp://logs.openstack.org/56/614556/5/check/openstack-ansible-functional-distro_install-centos-7/d11af04/logs/openstack/keystone/stestr_results.html14:46
mnaserah i see14:46
mnaserso maybe we need some toggle on/off?14:46
arxcruztempestconf is able to check for the service and set it to false or true btw14:46
arxcruz;)14:46
mnaseri knew it14:46
mnaserarxcruz: purposely broke our gate to make us use tempestconf14:46
arxcruzIMHO, we should not install all plugins14:46
arxcruzLOL, that patch wasn’t mine :P14:46
odyssey4mesure, but then we need to do a bunch of conditional logic and maintain the enable/disable bits - which isn't fun14:47
arxcruzyes, i agree14:47
arxcruzwe should not install all plugins, we had similar problems on tripleo14:47
odyssey4meFML14:47
openstackgerritPanagiotis Karalis proposed openstack/openstack-ansible-os_glance master: Turn the filesystem directory to be configurable  https://review.openstack.org/61392414:47
arxcruzand we decided to install the plugin only if it’s required14:47
arxcruzand later, using tempestconf we were able to fix these services set to true/false14:48
mnaserhttp://logs.openstack.org/56/614556/5/check/openstack-ansible-functional-distro_install-centos-7/d11af04/logs/ara-report/result/f2397549-e670-4acb-a689-e963e7d0fea0/14:50
mnaserthis is installing the world14:50
mnaserlooks like its trying to install openstack-tempest-all14:51
dcdamienhm, I know this review ^^14:51
mnaserdcdamien: hehe yeah trying to see how your stuff is broken14:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server stable/rocky: Use vendored RPM GPG keys for RabbitMQ  https://review.openstack.org/61621814:51
mnaseroh thats weird14:52
mnaserhttps://github.com/openstack/openstack-ansible-os_tempest/commit/7e6e614ff035c428fa34384169da7dfc00ccb10314:52
mnasernothing here14:52
dcdamienmnaser: cool, it looked for me like a unrelated issue14:52
mnaseroh14:53
odyssey4memnaser https://github.com/openstack/openstack-ansible-os_tempest/commit/2dbd375b44dbc2ae8788482500785be0e157955014:53
mnaserthere we go14:53
mnaserhttps://github.com/openstack/openstack-ansible-os_tempest/commit/2dbd375b44dbc2ae8788482500785be0e157955014:53
mnaserarxcruz: what do you think we should do about this?14:53
odyssey4memnaser arxcruz we have https://github.com/openstack/openstack-ansible-os_tempest/blob/master/vars/main.yml#L23 which does all the source plugins, we could extend that to also include the plugin package names for each distro package, then use that var to extract the enabled plugin list14:55
odyssey4meI was thinking about doing that yesterday, then got bogged down in other work14:55
odyssey4meanother option is to just have things like "{{ (<service_name>_enabled | bool) | ternary('<service_plugin_package_name', '') }}" in the vars list for each distro, assuming that it allows empty list entries14:56
logan-odyssey4me fghaas: yeah, not sure. those 2 statements should generally be interchangeable, i can't think of any reason to use one vs the other there14:56
openstackgerritMerged openstack/openstack-ansible-os_nova master: Add support to kvm nested virt  https://review.openstack.org/61560814:57
*** vnogin has joined #openstack-ansible14:57
*** priteau has quit IRC15:01
*** vnogin has quit IRC15:02
*** priteau has joined #openstack-ansible15:02
arxcruzmnaser: odyssey4me to unblock the gate, we should remove the tempest-all package, and then, install the plugins per service with an override in that variable15:03
odyssey4mearxcruz adding that unblocked a different set of gates, so we're going to have to do this all at once15:04
arxcruzsorry, didn’t get, add what?15:05
mnaserarxcruz: i think odyssey4me meant that if we revert that, we break the gate in another way15:06
* arxcruz doesn’t speak English very well, sometimes it’s hard to follow15:06
mnaserso that patch itself was a gate unbreaker15:06
odyssey4mearxcruz mnaser apologies - let me be clearer15:06
mnaserso if we revert it, we take it from broken to broken :D15:06
mnaseri think15:06
odyssey4mebefore that patch, the gates in neutron were broken because they use the neutron tempest plugins for testing15:07
odyssey4meso if we revert that patch, we break the os_neutron role tests15:07
arxcruzlol15:07
odyssey4meso - in order to get things working right, we should implement a fix which selectively installs the packages as you suggested15:07
arxcruzokay, I understand now15:07
odyssey4meit seems that for source builds we do https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L8415:07
mnaserodyssey4me: im thinking something similar to https://github.com/openstack/openstack-ansible-os_tempest/commit/bf077bc1936432d3677cc67eb28f7b268505dd79 .. where we have two vars files15:08
odyssey4mewell, I guess I've been meaning to figure this all out for some time - so maybe I should just get it done now :p15:08
*** cmart has joined #openstack-ansible15:08
mnaseror i was thinking having var/source.yml and vars/distro.yml15:09
odyssey4memnaser I started working out how to make that do pip installs from pypi yesterday, so that we don't always have to install from git... so yeah, I'm thinking much the same thing15:09
odyssey4melemme see if I can work out a way to stop the bleeding - that'll buy some time to figure out a decent holistic solution15:09
mnaserodyssey4me: thanks and sorry for the extra work you just got signed up for15:10
mnaser;<15:10
odyssey4meok, I have an idea which I think will work15:12
arxcruzare the rpm package equals to the name in vars/main.yml ?15:14
*** gkadam has joined #openstack-ansible15:20
arxcruzwe can parse zuul job name to figure out which package to install15:23
arxcruzfor example, for os_keystone, we can parse this keystone, and get the package required from the vars/main.yml15:23
noonedeadpunkHave a bit strange question. It seems, that currently service and rpc user password are updated every time when playbok is launched. So why don't we use "update_password: always" for mysql_user module, so that changed password inside user_secrets.yml lead to password rotation?15:25
noonedeadpunkoh, it's default. sorry15:26
noonedeadpunkSo than it's rather safe now to change password inside user_secrets.yml, isn't it?15:27
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Selectively install tempest plugin distro packages  https://review.openstack.org/61586915:40
odyssey4memnaser arxcruz ^15:40
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Do not disable caching for apt when http proxies are configured  https://review.openstack.org/61533815:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Do not disable caching for apt when http proxies are configured  https://review.openstack.org/61533815:41
*** nurdie has joined #openstack-ansible15:41
odyssey4mejrosser I just removed some trailing whitespace15:41
jrosserdoh! thanks15:42
mnaserI wonder why it didn’t get caught in ci15:42
mnaserOh we don’t run smoke tests in cI15:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Selectively install tempest plugin distro packages  https://review.openstack.org/61586915:43
*** DanyC has joined #openstack-ansible15:43
openstackgerritAndy Smith proposed openstack/openstack-ansible master: Add qdrouterd role for oslo.messaging backend deployment  https://review.openstack.org/57026115:43
*** ivve has joined #openstack-ansible15:44
*** DanyC has quit IRC15:47
arxcruzodyssey4me: do you mind if later I change it a little bit? but just for the future :)15:48
odyssey4mearxcruz could you suggest a change in the review as a comment?15:49
arxcruzodyssey4me: nah, right now we need to stop the bleeding, i want to have like install from source, from pip, and from rpm splited on their own files/tasks15:50
arxcruzbut it’s something for the future15:50
*** cmart has quit IRC15:50
odyssey4menoonedeadpunk - maybe, I think you'll find that changing the password will break any related services until the playbook for the service is run to update the template and restart the service15:51
odyssey4mearxcruz yep, I'll be doing a follow up to do something similar for source builds - the current mechanism is somewhat inadequate15:51
arxcruzit’s pretty complicated imho15:52
arxcruzbut hey, let me work on that, i need to help more on this :)15:52
* arxcruz wants to be core on os_tempest in the future :P15:52
odyssey4mearxcruz the current source build thing - it is complicated, yep, but it will need to cater to git and pypi-based installs... but as part of the python build simplification I've been wanting to simplify it anyway15:53
odyssey4mebut if you'd like to have a go at it - please do :)15:53
arxcruzsure15:54
odyssey4mearxcruz there are a few things I'm thinking would be good to do - one is to move these defaults into the role, and remove them from the integrated build's group_vars: https://github.com/openstack/openstack-ansible/blob/master/inventory/group_vars/utility_all.yml#L57-L6615:55
odyssey4methat way we don't have to maintain or set them in two places15:55
odyssey4methen have this dict have another attribute - perhaps 'enabled', which enables/disables the presence of the plugin based on that same key var from defaults: https://github.com/openstack/openstack-ansible-os_tempest/blob/master/vars/main.yml#L23-L9115:57
*** DanyC has joined #openstack-ansible15:57
odyssey4methen also have the source install determine whether it should install from git or pypi, and adapt accordingly15:57
odyssey4medoes all of that make much sense?15:57
odyssey4mepopping into a meeting now - be back in a bit15:58
*** DanyC_ has joined #openstack-ansible15:58
*** gyee has joined #openstack-ansible15:58
*** DanyC has quit IRC16:01
openstackgerritPanagiotis Karalis proposed openstack/openstack-ansible-os_glance master: Turn the filesystem directory to be configurable  https://review.openstack.org/61392416:11
openstackgerritwangqi proposed openstack/openstack-ansible-os_sahara master: fix Unexpected indentation  https://review.openstack.org/61623216:17
openstackgerritwangqi proposed openstack/openstack-ansible-os_sahara master: fix Unexpected indentation  https://review.openstack.org/61623516:20
*** cshen has quit IRC16:27
openstackgerritMerged openstack/openstack-ansible master: Fix blazar-nova Git field names  https://review.openstack.org/61607316:32
arxcruzodyssey4me: yeah, and keep the role self contained16:34
odyssey4mearxcruz I'm happy to work on that last bit (install from git/pypi) if you'd like to tackle the first two bits?16:35
arxcruzsure16:35
arxcruzodyssey4me: can we talk tomorrow? pretty late here now :)16:36
odyssey4mearxcruz of course :) I'm winding down for the day too, and tomorrow morning's better for new information :)16:36
arxcruzyup, after a big glass of coffee16:36
odyssey4me++16:37
*** pcaruana has quit IRC16:38
*** shardy has quit IRC16:46
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_nova stable/rocky: Add support to kvm nested virt  https://review.openstack.org/61624616:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server master: Use vendored RPM GPG keys for RabbitMQ  https://review.openstack.org/61618616:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server stable/rocky: Use vendored RPM GPG keys for RabbitMQ  https://review.openstack.org/61621816:58
*** irclogbot_0 has joined #openstack-ansible17:04
*** gkadam has quit IRC17:04
jrosserodyssey4me: what do you reckon? missing python lib? http://paste.openstack.org/show/734361/17:16
odyssey4mejrosser yep, that seems likely17:18
jrosserthat's why bionic/nova-lxd is broken17:18
odyssey4meperhaps a class path has changed or something?17:18
jrosserwould i expect to see that in the nova requirements?17:19
jrosseri.e which lib it should need17:19
odyssey4mehttps://github.com/openstack/openstack-ansible-os_nova/blob/master/defaults/main.yml#L173-L17717:19
jrosserhttps://github.com/openstack/nova-lxd/blob/master/requirements.txt#L1317:19
odyssey4mehttps://github.com/openstack/openstack-ansible-os_nova/blob/master/defaults/main.yml#L594-L59717:20
jrosserwierd, can't find much that looks like nova-lxd17:23
dcdamienmnaser, odyssey4me https://review.openstack.org/#/c/561266/ - this is not passing on ceph because there is no additional volume types defined and association fails. I'm for skipping qos association when expected volume type doesn't exist. What do you think about?17:24
odyssey4medcdamien that seems sensible17:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Selectively install tempest plugin distro packages  https://review.openstack.org/61586917:26
odyssey4mejrosser what do you mean, nova-lxd is at https://git.openstack.org/openstack/nova-lxd17:30
odyssey4methat's not browsable, but this is: https://github.com/openstack/nova-lxd17:30
odyssey4mejrosser you can also reach out to tinwood or jamespage - although I think they're uk and may not be around right now, the #openstack-charms folks may also be able to help17:32
odyssey4mejrosser although I wonder if we broke it somehow given that module's not there, but should be17:33
*** cmart has joined #openstack-ansible17:34
jrosserodyssey4me: sorry was trying to find the files - which are there in the venv17:39
jrosserso they are installed17:39
odyssey4meI know some of the projects now require a full classpath when doing the import - maybe nova has changed too17:40
jrosseri'm also wondering if that is the nova service started before the proper config is present, and just log noise17:40
odyssey4mefair point17:41
tinwoododyssey4me, jrosser is that a py2 py3 issue?17:41
odyssey4mewell, the venv was prepped with py2, but that is perhaps an issue17:41
jrosserjust a mo.....17:42
tinwoodi.e. are you loading from ubuntu packages?17:42
tinwoodOr from source (pip)17:42
odyssey4metinwood nope, this is pip installed from source17:42
odyssey4mefrom git, specifically17:42
jrosser2018-11-07 17:29:05.542 1461 DEBUG oslo_service.service [req-dc5d1e5c-e38e-4a1e-89ce-17fa6b4da737 - - - - -] lxd.pool                       = None log_opt_values /openstack/venvs/nova-testing/lib/python2.7/site-packages/oslo_config/cfg.py:257517:42
jrosser^ is that a problem?17:43
tinwoodjrosser, is that on bionic?17:43
odyssey4mejrosser look in the venv itself, is there a python3 lib folder?17:43
odyssey4metinwood yes17:43
dcdamienodyssey4me: yesterday you've written that horizon's firewall and vpn options was removed because they're deprecated. As I see there are separate projects for them. Is there any reason to not integrate them in OSA?17:44
jrosserodyssey4me: this is all i have root@ubuntu-bionic:/openstack/venvs/nova-testing/lib/python2.717:44
odyssey4medcdamien no, assuming they're up to date and useful - they're just waiting for someone to add a patch!17:44
tinwoodjrosser, odyssey4me, so lxd 3 is the default on bionic and it *has* to have a storage pool set up (even if it's just a dir).  -- however, that might not be the issue here17:45
dcdamienodyssey4me: okay, thanks17:45
odyssey4metinwood good heads up - I dunno if that's done in our case17:45
dcdamiensmoke87: stay tuned :D17:46
tinwoododyssey4me, jrosser the only time I've seen an error similar to the one you posted in the paste is when the nova-lxd module isn't getting installed - in my case it was a mismatch between a python3 nova and a python2 nova-lxd ... but your doing pip, so that seems unlikely???17:47
jrossertinwood: the lxd storage pool is created, i can see it with lxc storage list17:49
tinwoodjrosser, okay, that's good.17:50
jrosserbut this looks bad from the nova log "lxd.pool                       = None"17:50
jrosseri expect thats a config option which our default test doesnt account for17:50
tinwoodjrosser, ah, that's a config option that needs to be set in the nova config.17:50
* tinwood goes looking17:50
tinwoodjrosser, so in /etc/nova/nova.conf, in the [lxd] section, you need a pool = <name-of-pool>17:52
jrosseri'll try - /me failing with google to find the config reference17:53
tinwoodjrosser, Interestingly, I raised this bug: https://bugs.launchpad.net/openstack-ansible/+bug/180083717:54
openstackLaunchpad bug 1800837 in openstack-ansible "openstack-ansible-nova-lxd test fails due to lxd storage pool not set up on bionic host" [Low,Confirmed]17:54
jrosserah well after that got discussed yesterday i fired off a speculative local build to see if it was anything obvious17:55
tinwoodSadly, I don't know enough ansible to fix it, although I'm reading up on it!17:55
jrosserand just getting round to poking at that17:55
*** vnogin has joined #openstack-ansible18:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server master: Ensure that RedHat/SUSE only use a distro install  https://review.openstack.org/61618618:02
odyssey4mehwoarang mnaser rather than constantly muck about - perhaps https://review.openstack.org/616186 is the better way to handle it for stein.... there can be only one18:03
odyssey4mefor the rocky implementation, the current issue is http://logs.openstack.org/18/616218/2/check/openstack-ansible-functional-centos-7/d25eb22/logs/ara-report/result/770acdc1-87aa-412a-ae6c-8d46cf54e6d3/18:04
*** vnogin has quit IRC18:04
jrossertinwood: i have to run to get my train now, but this is as far as i've got, i see the lxd section in the nova.conf template here https://github.com/openstack/openstack-ansible-os_nova/blob/master/templates/nova.conf.j2#L283-L28618:05
jrosserbut when i ran the test locally the [lxd] section is missing from nova.conf, so that needs figuring out why18:05
tinwoodjrosser, kk, we can catch up tomorrow?  Just ping me.18:06
jrossersure, i'd like to get this sorted out18:07
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server stable/rocky: Use vendored RPM GPG keys for RabbitMQ  https://review.openstack.org/61621818:18
*** radeks_ has quit IRC18:29
*** mmercer has joined #openstack-ansible18:36
*** cshen has joined #openstack-ansible18:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server master: Ensure that RedHat/SUSE only use a distro install  https://review.openstack.org/61618618:58
odyssey4mecores - https://review.openstack.org/616218 should unblock rocky in terms of the rabbitmq installation failures for centos18:59
odyssey4memnaser ^18:59
*** nurdie has quit IRC19:02
*** priteau has quit IRC19:10
guilhermespmnaser: same rabbit gpg key error in https://review.openstack.org/#/c/616246/19:11
guilhermesphttp://logs.openstack.org/46/616246/1/check/openstack-ansible-functional-centos-7/da2e599/job-output.txt.gz#_2018-11-07_17_14_02_85253019:11
*** priteau has joined #openstack-ansible19:12
guilhermespI saw that you hardcoded the role earlier to avoid further breakage19:12
guilhermespodyssey4me mnaser it depends on this? https://review.openstack.org/#/c/616186/19:19
*** radeks_ has joined #openstack-ansible19:20
guilhermespah ok just saw above https://review.openstack.org/#/c/616218/ :)19:20
*** faizy_ has joined #openstack-ansible19:30
*** faizy98 has quit IRC19:33
*** nurdie has joined #openstack-ansible19:33
*** electrofelix has quit IRC19:47
*** DanyC_ has quit IRC19:47
*** radeks_ has quit IRC19:51
*** nurdie_ has joined #openstack-ansible19:52
*** radeks_ has joined #openstack-ansible19:54
*** nurdie has quit IRC19:54
*** DanyC has joined #openstack-ansible20:07
openstackgerritAndy Smith proposed openstack/openstack-ansible master: Add qdrouterd role for oslo.messaging backend deployment  https://review.openstack.org/57026120:07
odyssey4me guilhermesp for master, https://review.openstack.org/616186 - for rocky, https://review.openstack.org/61621820:15
odyssey4meguilhermesp given it's a blocking issue - fast approving those reviews, once they merge, just recheck your patch(es)20:19
guilhermespthanks odyssey4me ! The only thing I can do now is +1 :P20:19
guilhermesplet's wait then20:20
*** radeks_ has quit IRC20:20
odyssey4meguilhermesp you can +1 if you think it's a good patch, it also helps me know that I'm not doing work without someone else seeing it ;)20:20
guilhermespodyssey4me: ++20:21
odyssey4mecloudnull if you're around, https://review.openstack.org/614210 needs a second review with someone more in touch with that tooling20:34
*** guilhermesp has quit IRC20:47
*** jungleboyj has quit IRC20:47
*** hogepodge has quit IRC20:47
*** fdegir has quit IRC20:47
*** neith has quit IRC20:47
*** mnaser has quit IRC20:48
*** mwhahaha has quit IRC20:48
*** guilhermesp has joined #openstack-ansible20:48
*** hogepodge has joined #openstack-ansible20:48
*** fdegir has joined #openstack-ansible20:48
*** mwhahaha has joined #openstack-ansible20:49
*** mnaser has joined #openstack-ansible20:49
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_nova master: Switch LXD job from xenial to bionic  https://review.openstack.org/61630120:50
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_nova master: Ensure LXD pool name is always specified in nova config  https://review.openstack.org/61630220:50
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Ensure that RedHat/SUSE only use a distro install  https://review.openstack.org/61618620:51
odyssey4meguilhermesp there we go - master should be unblocked20:53
*** jungleboyj has joined #openstack-ansible21:35
*** ansmith has quit IRC21:37
*** strattao has quit IRC21:37
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_nova master: Ensure LXD pool name is always specified in nova config  https://review.openstack.org/61630221:45
*** ivve has quit IRC21:46
openstackgerritMerged openstack/openstack-ansible master: SUSE: Add support for openSUSE Leap 15  https://review.openstack.org/60436621:47
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server stable/rocky: Use vendored RPM GPG keys for RabbitMQ  https://review.openstack.org/61621822:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Ensure pip/setuptools/wheel are up to date in the utility venv  https://review.openstack.org/61525822:05
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: zuul: Make openSUSE distro jobs voting  https://review.openstack.org/61446322:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Ensure ceph server apt pinning is well defined  https://review.openstack.org/61477722:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Adds option to enable ARA plugin install  https://review.openstack.org/61600422:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Restart cinder-scheduler instead of reloading  https://review.openstack.org/61564522:06
odyssey4mejrosser mnaser unfortunately had to update https://review.openstack.org/615258 again due to another circumstance that changed, but that should now unblock stable/rocky's integrated build again cc guilhermesp22:07
*** vnogin has joined #openstack-ansible22:11
*** vnogin has quit IRC22:15
guilhermespthanks odyssey4me ! Rechecked22:16
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Selectively install tempest plugin distro packages  https://review.openstack.org/61586922:24
*** priteau has quit IRC22:47
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_nova master: Ensure LXD pool name is always specified in nova config  https://review.openstack.org/61630222:49
*** DanyC_ has joined #openstack-ansible22:59
*** dcdamien has quit IRC23:00
*** dcdamien has joined #openstack-ansible23:00
*** DanyC has quit IRC23:02
*** dcdamien has quit IRC23:02
*** dcdamien has joined #openstack-ansible23:03
*** dcdamien has joined #openstack-ansible23:03
*** DanyC_ has quit IRC23:04
*** faizy_ has quit IRC23:13
*** faizy_ has joined #openstack-ansible23:13
*** cshen has quit IRC23:15
*** nurdie_ has quit IRC23:18
*** nurdie has joined #openstack-ansible23:19
*** nurdie has quit IRC23:23
openstackgerritDamian Cikowski (dcdamien) proposed openstack/openstack-ansible-os_cinder master: tasks: cinder_qos: Ommit nonexistent volume types  https://review.openstack.org/61637623:42
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-plugins stable/rocky: Modify provider_network plugin to compare group_binds to group_names  https://review.openstack.org/61637723:43
openstackgerritJimmy McCrory proposed openstack/openstack-ansible stable/rocky: Provides group_names for use with provider_network plugin  https://review.openstack.org/61637823:43
openstackgerritJimmy McCrory proposed openstack/openstack-ansible stable/rocky: Provides group_names for use with provider_network plugin  https://review.openstack.org/61637823:44
*** dhellmann has quit IRC23:45
openstackgerritJimmy McCrory proposed openstack/openstack-ansible stable/queens: Provides group_names for use with provider_network plugin  https://review.openstack.org/61637923:45
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-plugins stable/queens: Modify provider_network plugin to compare group_binds to group_names  https://review.openstack.org/61638023:45
openstackgerritJimmy McCrory proposed openstack/openstack-ansible stable/queens: Provides group_names for use with provider_network plugin  https://review.openstack.org/61637923:46
*** nurdie has joined #openstack-ansible23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!