Saturday, 2019-02-09

*** tosky has quit IRC00:04
*** slaweq has joined #openstack-ansible00:11
*** chhagarw has joined #openstack-ansible00:21
*** sdake has quit IRC00:21
*** slaweq has quit IRC00:24
*** chhagarw has quit IRC00:36
*** markvoelker has joined #openstack-ansible01:10
*** sdake has joined #openstack-ansible01:11
*** sdake has quit IRC01:11
*** slaweq has joined #openstack-ansible01:16
*** gyee has quit IRC01:16
*** slaweq has quit IRC01:24
*** gary_perkins has quit IRC01:28
*** gary_perkins has joined #openstack-ansible01:29
*** partlycloudy has joined #openstack-ansible01:33
*** markvoelker has quit IRC01:42
*** hwoarang has quit IRC01:53
*** sdake has joined #openstack-ansible01:58
*** hwoarang has joined #openstack-ansible01:59
*** dave-mccowan has joined #openstack-ansible02:13
*** slaweq has joined #openstack-ansible02:16
*** dave-mccowan has quit IRC02:18
*** slaweq has quit IRC02:25
*** sdake has quit IRC02:28
*** dave-mccowan has joined #openstack-ansible02:38
*** markvoelker has joined #openstack-ansible02:40
*** mhayden has quit IRC02:44
*** mhayden has joined #openstack-ansible02:46
*** dave-mccowan has quit IRC03:00
*** slaweq has joined #openstack-ansible03:12
*** markvoelker has quit IRC03:13
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Cleanup files and templates using smart sources  https://review.openstack.org/58895903:15
*** slaweq has quit IRC03:24
*** hwoarang has quit IRC03:34
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Switch to using mirrors instead of direct download  https://review.openstack.org/63458103:35
*** hwoarang has joined #openstack-ansible03:38
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Improve overview subpage  https://review.openstack.org/63393403:38
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Fix README.rst  https://review.openstack.org/62808503:40
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/rocky: Increase LXC container default shutdown delay  https://review.openstack.org/63376703:45
openstackgerritMerged openstack/openstack-ansible-plugins master: Prevent interface map from being built for neutron_server container  https://review.openstack.org/63518803:51
*** ArchiFleKs has quit IRC03:54
*** ArchiFleKs has joined #openstack-ansible04:00
openstackgerritMerged openstack/openstack-ansible-os_ceilometer stable/rocky: Fixes gnocchi resource-type list being empty after setup  https://review.openstack.org/63518904:00
openstackgerritMerged openstack/openstack-ansible-tests master: Add mistral_install_method for distro installations  https://review.openstack.org/63500704:05
openstackgerritMerged openstack/openstack-ansible-os_designate master: Revert "Get the adminuri variable from adminurl variable"  https://review.openstack.org/63432104:06
openstackgerritKevin Carter (cloudnull) proposed openstack/ansible-role-systemd_service master: Build out the PrivateNetwork function for services  https://review.openstack.org/63539604:06
prometheanfire:D04:07
*** markvoelker has joined #openstack-ansible04:10
*** slaweq has joined #openstack-ansible04:12
openstackgerritMerged openstack/openstack-ansible-os_aodh stable/rocky: Enable overriding the service setup host python interpreter  https://review.openstack.org/63556404:24
*** slaweq has quit IRC04:24
*** markvoelker has quit IRC04:43
*** partlycloudy has left #openstack-ansible04:46
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add option to disable container builds on specific hosts  https://review.openstack.org/63599704:47
cloudnull^ mnaser that may be of use to you04:47
prometheanfireinteresting04:56
openstackgerritMerged openstack/openstack-ansible-os_aodh master: venv: use inventory_hostname instead of ansible_hostname  https://review.openstack.org/63516504:59
*** hwoarang has quit IRC05:00
cloudnullindeed.05:01
*** hwoarang has joined #openstack-ansible05:02
prometheanfirein other news wayland/sway is working out well so far05:03
cloudnulli had an environment where I needed exactly that 1 infra was baremetal, 2 other infras were virt and I couldn't disable the port security to get container networking to go . so boom! new option to the rescue :)05:03
* prometheanfire is still waiting for systemd 241 to trigger infra builds for the gentoo stuff05:03
cloudnullnot running 245 yet?05:03
cloudnull:P05:03
prometheanfireare you from the future? :P05:03
prometheanfireya, it's an interesting option05:04
prometheanfiremy home build running osa on gentoo will likely be 3 converged nodes (running compute/infra on the same nodes, but 3 of them) might be useful there too, not sure05:04
cloudnullhahaha05:04
cloudnullseems v241 is rc205:05
* cloudnull goes to upgrade my laptop 05:05
prometheanfireyep, we have rc2 packaged, but I'm still waiting05:05
prometheanfirewhat I added to dib needs an actual release05:05
cloudnullI give wayland a try every now and again05:05
cloudnulli want it to work05:05
cloudnullbut...05:06
prometheanfirewith sway rc1 it works for me05:06
prometheanfiresystray is gone (need to look at that next), but everything else works05:06
cloudnullI had issues with random things.05:07
cloudnulllike gpg key managers, etc.05:07
prometheanfireI got that working05:07
cloudnullworks in x, not in wayland.05:07
prometheanfireusing systemd user units05:07
* cloudnull will have to try again 05:07
cloudnullyea I got around some of the ssh-agent things with user units05:08
prometheanfireanother gentoo dev is having your same problem though05:08
cloudnullbut it was odd.05:08
cloudnullso i switched back05:08
cloudnulli haven't tried in a month or so05:08
cloudnullmaybe its time :)05:08
prometheanfireit's TIME05:08
*** slaweq has joined #openstack-ansible05:12
*** slaweq has quit IRC05:24
openstackgerritMerged openstack/openstack-ansible stable/rocky: Define OSA clone dir in the openstack-ansible.sh script  https://review.openstack.org/63582105:28
*** markvoelker has joined #openstack-ansible05:40
*** sdake has joined #openstack-ansible06:00
*** slaweq has joined #openstack-ansible06:12
*** markvoelker has quit IRC06:13
*** sdake has quit IRC06:13
*** slaweq has quit IRC06:24
*** hamzaachi has joined #openstack-ansible06:38
*** hamzaachi has quit IRC06:38
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Set the dnsmasq aa profile to complain  https://review.openstack.org/63600006:43
*** markvoelker has joined #openstack-ansible07:10
*** slaweq has joined #openstack-ansible07:16
*** slaweq has quit IRC07:24
*** markvoelker has quit IRC07:43
*** slaweq has joined #openstack-ansible08:14
*** slaweq has quit IRC08:22
*** Emine has joined #openstack-ansible08:31
*** markvoelker has joined #openstack-ansible08:39
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Bump SHAs for master  https://review.openstack.org/63600208:42
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/rocky: Bump SHAs for stable/rocky  https://review.openstack.org/63600308:44
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/queens: Bump SHAs for stable/queens  https://review.openstack.org/63600408:44
*** jbadiapa has quit IRC08:45
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/pike: Bump SHAs for stable/pike  https://review.openstack.org/63600508:45
*** slaweq has joined #openstack-ansible09:12
*** markvoelker has quit IRC09:13
*** slaweq has quit IRC09:25
*** DanyC has joined #openstack-ansible09:38
*** DanyC has joined #openstack-ansible09:40
*** slaweq has joined #openstack-ansible09:50
*** markvoelker has joined #openstack-ansible10:11
*** Emine has quit IRC10:50
*** markvoelker has quit IRC10:53
*** tbarron has quit IRC11:32
*** DanyC has quit IRC11:36
*** DanyC has joined #openstack-ansible11:36
*** markvoelker has joined #openstack-ansible11:50
*** slaweq has quit IRC12:19
*** markvoelker has quit IRC12:23
*** Emine has joined #openstack-ansible12:34
*** tosky has joined #openstack-ansible12:40
*** sdake has joined #openstack-ansible13:09
*** ArchiFleKs has quit IRC13:09
*** markvoelker has joined #openstack-ansible13:20
*** Emine has quit IRC13:23
*** ArchiFleKs has joined #openstack-ansible13:24
*** sdake has quit IRC13:44
*** sdake has joined #openstack-ansible13:47
*** markvoelker has quit IRC14:00
*** tosky has quit IRC14:08
*** sdake has quit IRC14:08
*** sdake has joined #openstack-ansible14:20
*** sdake has quit IRC14:21
*** sdake has joined #openstack-ansible14:22
*** sdake has quit IRC14:31
*** dave-mccowan has joined #openstack-ansible14:54
*** markvoelker has joined #openstack-ansible14:58
*** dave-mccowan has quit IRC15:25
*** dave-mccowan has joined #openstack-ansible15:29
*** markvoelker has quit IRC15:30
*** sdake has joined #openstack-ansible16:07
*** markvoelker has joined #openstack-ansible16:28
*** sdake has quit IRC16:30
*** bgmccollum has quit IRC16:33
*** bgmccollum has joined #openstack-ansible16:41
*** sdake has joined #openstack-ansible16:52
*** markvoelker has quit IRC17:00
*** jroll has quit IRC17:11
*** jroll has joined #openstack-ansible17:33
*** ansmith has quit IRC17:38
*** sdake has quit IRC17:47
*** markvoelker has joined #openstack-ansible18:02
*** sdake has joined #openstack-ansible18:06
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Set the dnsmasq aa profile to complain  https://review.openstack.org/63600018:07
*** spatel has joined #openstack-ansible18:10
*** spatel has quit IRC18:10
*** DanyC has quit IRC18:11
*** giere has joined #openstack-ansible18:18
gierehello !!! some one here18:19
*** DanyC has joined #openstack-ansible18:21
giereCould i ask questions here ?18:22
guilhermespgiere: go adead18:27
*** sdake has quit IRC18:27
giereOn my cluster 3 (controller+network) and 2 compute on ubuntu 16.04  using openstack-ansible 18.1.2 tagged, old configure from queens.18:33
giereBut i found that HA is not work after I stop 1 RabbitMQ service all service is going down.18:37
gieresorry it nova-compute and all neutron services not all of them.18:38
giereAnd never comeback.18:38
giereI'm already check the log on all service it switch to another rabbitmq server but service still down18:39
cloudnullgiere o/18:40
cloudnullgiere hard to say, however, depending on how long the cluster was up, its possible for all of the "master" queues to land on a single host which can cause that.18:42
guilhermespheeeey cloudnull I was just reviewing what we were discussing yesterday about the tempest stuff18:42
guilhermespyou asked if would be possible to import the test_agent module inside the venvs right?18:43
guilhermespto make it easy http://paste.openstack.org/show/744756/18:43
cloudnullgiere the services connect to rabbitmq directly via oslo messaging however rabbitmq HA is a proxy to the master queue, and while it can move throughout the cluster if ALL of the master queues go down at once, then there's not much you can do to prevent this type of issue.18:44
* cloudnull is guessing this is what you're seeing18:44
cloudnullguilhermesp yes.18:45
cloudnullit looks like an issue between the venv and site-packages?18:45
guilhermespI think that this could be a good clue of what is happening18:46
guilhermespso I'm already here in the hold of the job, already source the 19.0.0.b1 venv18:47
guilhermespwould I invoke python and try to import the test_agents module?18:47
cloudnullyes18:47
cloudnullthat should cause the issue we're seeing18:47
cloudnullthe other thing could be something like a "nested" venv18:47
guilhermesphttp://paste.openstack.org/show/744791/ I should be missing something18:48
giere@cloudnull For my cluster It newly deploy(OSA rocky) so it fresh and I'm just curious for my previous deploy(OSA queens) it actually work fine when 1 of the rabbitmq is down(also switch to another host).18:52
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Set the dnsmasq aa profile to complain  https://review.openstack.org/63600018:54
giereIf you cannot understand my question, please tell to me. So really sorry i'm not a good at english.18:57
*** markvoelker has quit IRC19:02
giereSo after bring RabbitMQ back 3 node(running) nova-compute and all neutron services still down.19:04
guilhermespgiere: I think you might reset the queues of all vhosts19:08
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62196119:09
giereguilhermesp: The way to bring back cluster is stop_app restart all rabbitmq-server service then going to restart nova-compute and all neutron service then cluster will work but it should not being like this Right ?19:14
guilhermespfirst of all, did you check the cluster status but rabbitmqctl cluster_status? is everything running?19:15
*** sdake has joined #openstack-ansible19:15
*** sdake has quit IRC19:35
*** markvoelker has joined #openstack-ansible19:59
giereguilhermesp: already done it all 3 rabbitmq are in cluster19:59
*** ArchiFleKs has quit IRC20:21
*** markvoelker has quit IRC20:32
*** ArchiFleKs has joined #openstack-ansible20:36
*** dave-mccowan has quit IRC20:41
*** sdake has joined #openstack-ansible21:15
*** markvoelker has joined #openstack-ansible21:32
*** markvoelker has quit IRC22:23
*** sdake has quit IRC22:37
*** dave-mccowan has joined #openstack-ansible22:57
*** dave-mccowan has quit IRC23:03
*** dmsimard has quit IRC23:06
*** sdake has joined #openstack-ansible23:09
*** sdake has quit IRC23:19
*** markvoelker has joined #openstack-ansible23:20
*** fresta_ has joined #openstack-ansible23:24
*** sdake has joined #openstack-ansible23:24
*** fresta has quit IRC23:24
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Set the dnsmasq aa profile to complain  https://review.openstack.org/63600023:32
*** markvoelker has quit IRC23:52
*** sdake has quit IRC23:53
*** sdake has joined #openstack-ansible23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!