Monday, 2019-07-15

openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_mistral master: db_setup: refactor database setup to a common file  https://review.opendev.org/67074401:01
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_tacker master: db_setup: refactor database setup to a common file  https://review.opendev.org/67074501:08
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_blazar master: db_setup: refactor database setup to a common file  https://review.opendev.org/67074701:17
*** kplant has quit IRC01:18
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_horizon master: db_setup: refactor database setup to a common file  https://review.opendev.org/67074801:23
*** markvoelker has joined #openstack-ansible03:37
*** udesale has joined #openstack-ansible03:49
*** kopecmartin has joined #openstack-ansible05:12
*** raukadah is now known as chandankumar05:26
*** cshen has joined #openstack-ansible05:36
*** shyamb has joined #openstack-ansible05:43
*** ivve has quit IRC05:58
*** miloa has joined #openstack-ansible06:04
*** shyamb has quit IRC06:14
*** shyamb has joined #openstack-ansible06:21
*** luksky11 has joined #openstack-ansible06:23
*** cshen has quit IRC06:23
openstackgerritzhufl proposed openstack/openstack-ansible-ops master: Fix :param: in docstring  https://review.opendev.org/66557006:26
*** cshen has joined #openstack-ansible06:29
openstackgerritzhufl proposed openstack/openstack-ansible-ops master: Fix :param: in docstring  https://review.opendev.org/66557006:33
*** pcaruana has joined #openstack-ansible06:36
*** pcaruana has quit IRC06:40
*** geekinutah has quit IRC06:50
*** gshippey_ has quit IRC06:50
*** zbr has quit IRC06:50
*** fungi has quit IRC06:50
*** nyloc has quit IRC06:50
*** flaviosr_ has quit IRC06:50
*** neith has quit IRC06:50
*** mubix has quit IRC06:50
*** persia has quit IRC06:50
*** NobodyCam has quit IRC06:50
*** mugsie has quit IRC06:50
*** j^2 has quit IRC06:50
*** ChosSimbaOne has quit IRC06:50
*** niceplace_ has quit IRC06:50
*** csmart has quit IRC06:50
*** sum12 has quit IRC06:50
*** mpjetta has quit IRC06:50
*** jhesketh has quit IRC06:50
*** AB2019 has quit IRC06:53
*** AB2019 has joined #openstack-ansible06:53
jrosserMorning06:56
jrosserBlazar looks broken http://logs.openstack.org/47/670747/1/check/openstack-ansible-deploy-aio_metal-debian-stable/2068c3e/logs/ara-report/result/5159ac84-3f33-4620-8265-b4204241fe38/06:56
*** ivve has joined #openstack-ansible06:57
*** ChosSimbaOne has joined #openstack-ansible07:16
*** niceplace_ has joined #openstack-ansible07:16
*** csmart has joined #openstack-ansible07:16
*** sum12 has joined #openstack-ansible07:16
*** mpjetta has joined #openstack-ansible07:16
*** jhesketh has joined #openstack-ansible07:16
*** tosky has joined #openstack-ansible07:16
*** geekinutah has joined #openstack-ansible07:16
*** 21WAAI5TG has joined #openstack-ansible07:16
*** zbr has joined #openstack-ansible07:16
*** fungi has joined #openstack-ansible07:16
*** nyloc has joined #openstack-ansible07:16
*** neith has joined #openstack-ansible07:16
*** j^2 has joined #openstack-ansible07:16
*** mubix has joined #openstack-ansible07:16
*** persia has joined #openstack-ansible07:16
*** NobodyCam has joined #openstack-ansible07:16
*** mugsie has joined #openstack-ansible07:16
*** openstackgerrit has quit IRC07:18
*** rpittau|afk is now known as rpittau07:19
*** zerick_ has quit IRC07:21
*** zerick has joined #openstack-ansible07:23
*** shyamb has quit IRC07:28
*** aedc has joined #openstack-ansible07:29
*** shyamb has joined #openstack-ansible08:10
*** ChosSimbaOne has quit IRC08:26
*** niceplace_ has quit IRC08:26
*** csmart has quit IRC08:26
*** sum12 has quit IRC08:26
*** mpjetta has quit IRC08:26
*** jhesketh has quit IRC08:26
*** geekinutah has quit IRC08:27
*** 21WAAI5TG has quit IRC08:27
*** zbr has quit IRC08:27
*** fungi has quit IRC08:27
*** nyloc has quit IRC08:27
*** neith has quit IRC08:27
*** mubix has quit IRC08:27
*** persia has quit IRC08:27
*** NobodyCam has quit IRC08:27
*** mugsie has quit IRC08:27
*** j^2 has quit IRC08:27
CeeMacmorning08:29
*** persia has joined #openstack-ansible08:35
*** NobodyCam has joined #openstack-ansible08:35
*** neith has joined #openstack-ansible08:35
*** mubix has joined #openstack-ansible08:36
*** j^2 has joined #openstack-ansible08:36
*** zbr has joined #openstack-ansible08:36
*** niceplace has joined #openstack-ansible08:36
*** ChosSimbaOne has joined #openstack-ansible08:36
*** mpjetta has joined #openstack-ansible08:36
*** nyloc has joined #openstack-ansible08:37
*** mugsie has joined #openstack-ansible08:37
*** fungi has joined #openstack-ansible08:37
*** jhesketh has joined #openstack-ansible08:37
*** sum12 has joined #openstack-ansible08:38
*** csmart has joined #openstack-ansible08:42
noonedeadpunkmorning everyone09:27
noonedeadpunkwhat interesting I've missed for the last 2 weeks?09:28
*** rpittau has quit IRC10:03
*** johnsom has quit IRC10:06
*** rpittau has joined #openstack-ansible10:06
*** gshippey has quit IRC10:07
*** johnsom has joined #openstack-ansible10:07
*** gshippey has joined #openstack-ansible10:09
*** vnogin has joined #openstack-ansible10:20
*** shyamb has quit IRC10:32
*** cshen has quit IRC10:35
*** luksky11 has quit IRC10:38
*** cshen has joined #openstack-ansible10:51
*** shyamb has joined #openstack-ansible10:53
*** cshen has quit IRC10:57
*** vnogin has quit IRC11:11
*** luksky11 has joined #openstack-ansible11:14
*** kplant has joined #openstack-ansible11:17
*** cshen has joined #openstack-ansible11:23
*** cshen has quit IRC11:28
*** pcaruana has joined #openstack-ansible11:32
*** udesale has quit IRC11:39
*** udesale has joined #openstack-ansible11:40
*** cshen has joined #openstack-ansible11:44
*** cshen has quit IRC11:49
*** jsquare has quit IRC11:50
*** ansmith has quit IRC11:50
*** jsquare has joined #openstack-ansible11:51
*** weshay|rover is now known as weshay11:51
*** goldyfruit has quit IRC12:05
*** vnogin has joined #openstack-ansible12:06
*** vnogin has quit IRC12:09
*** cshen has joined #openstack-ansible12:14
mnasernoonedeadpunk: just a release.. i think :P12:30
noonedeadpunksince it's still not landed let's consider that I didn't miss it :P12:31
*** shyamb has quit IRC12:34
*** electrofelix has joined #openstack-ansible12:36
jrosserhow are we doing on the db_sync stuff?12:38
jrosserdb_sync/setup rather12:38
mnaserjrosser: like how is it being sync'd across roles or?12:38
jrossermnaser: yes, i think we're going to need an update to * roles for the db_setup as part of binding to the mgmt address12:39
mnaserjrosser: once https://review.opendev.org/#/c/670672/ lands, it will be sync'd globally :)12:39
jrossermnaser: i did a DNM here to test it https://review.opendev.org/#/c/670687/12:40
jrosseri think we'll need that everywhere12:40
mnaserhow nice is it we have a system for that :D12:40
jrosserindeed!12:40
mnaserTable 'computehosts' already exists12:40
mnaseri bet its because we start the service before we sync the db12:41
mnaserand the service does a db sync12:41
jrosserwouldnt it run this each time the role is run?12:41
jrosseri.e shouldnt it be tolerant to redoing it * times12:42
mnaserjrosser: right but it races on the first deploy12:42
*** stuartgr has quit IRC12:42
mnaserbecause it start12:42
mnaserbecause service and sync starts at the same time12:42
mnaserboth think there is no migrations to do12:42
mnaserboth start migrating and then clash12:42
jrosserahha12:42
mnaserguilhermesp: left a review on that which i think should help12:43
*** ansmith has joined #openstack-ansible12:43
jrosseri got bind-to-mgmt working a bit further on containers, theres more unhelpful 127.0.1.1 /etc/hosts messing that i found https://review.opendev.org/#/c/670705/ and https://review.opendev.org/#/c/670706/12:46
*** jbadiapa has joined #openstack-ansible12:46
jrosseri'm not really sure why those got put there in the first place12:46
mnaser<insert magic gif>12:48
*** shyamb has joined #openstack-ansible12:50
*** kaiokmo has joined #openstack-ansible12:52
jonherthis is what blame shows ^ https://github.com/openstack/openstack-ansible-lxc_container_create/commit/ccddfc7731a72627e4fda919e56d2061741bbc3f12:53
*** shyamb has quit IRC12:56
*** electrofelix has quit IRC12:56
*** vnogin has joined #openstack-ansible13:13
guilhermesp@mnaser seems to be still breaking adding the db sync before systemd unit...13:14
guilhermesplocally I mean13:14
*** shyamb has joined #openstack-ansible13:15
mnaserguilhermesp: eh that means that something is installing/running ?13:17
mnaserlike the service went up somehow13:17
guilhermespyeah I have a local vm running that patch to see what is going on.. gonna try to be iterating over it13:22
*** vnogin has quit IRC13:25
spotzAroundish... no guarantee of coherence:)13:29
*** electrofelix has joined #openstack-ansible13:33
*** stingrayza has joined #openstack-ansible13:33
stingrayzahey folks. I'm trying to help shepherd in a PR in ansible for a new os_ module (os_group_info) if any reviewers could take a look, that'd be great, thanks!13:38
*** shyamb has quit IRC13:38
stingrayzahttps://github.com/ansible/ansible/pull/5712013:38
mnaserstingrayza: might wanna try #openstack-sdks as thats where a lot of the development happens too13:51
*** goldyfruit has joined #openstack-ansible14:01
*** openstackgerrit has joined #openstack-ansible14:12
openstackgerritMerged openstack/openstack-ansible stable/pike: Bump SHAs for stable/pike  https://review.opendev.org/67073014:12
*** vnogin has joined #openstack-ansible14:15
*** cshen has quit IRC14:22
mnasersimple backport:14:25
mnaserhttps://review.opendev.org/#/c/670617/14:25
*** goldyfruit has quit IRC14:26
guilhermespoh mnaser I think the error now is unrelated to the db sync http://logs.openstack.org/47/670747/2/check/openstack-ansible-deploy-aio_metal-opensuse-15/128dd34/logs/ara-report/14:28
redkrieghi all, I had an issue over the weekend running the bootstrap script for rocky 18.1.8 due to the os-mistral repo failing to clone "fatal: reference is not a tree: 4100d0c8e8ad25e26769d8a75f97900dcbd08749".  is this something local to me or a problem with the repo?  http://paste.openstack.org/show/754381/14:28
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_neutron master: Use systemd-journald instead of log files  https://review.opendev.org/67082414:29
*** joshualyle has joined #openstack-ansible14:32
*** joshualyle has quit IRC14:33
stingrayzamnaser: will do, thanks!14:34
*** ivve has quit IRC14:36
*** TxGirlGeek has joined #openstack-ansible14:40
*** irclogbot_1 has quit IRC14:41
*** irclogbot_3 has joined #openstack-ansible14:50
*** oligau has quit IRC14:54
*** oligau has joined #openstack-ansible14:54
*** luksky11 has quit IRC15:04
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_neutron master: Use systemd-journald instead of log files  https://review.opendev.org/67082415:14
*** chandankumar is now known as raukadah15:14
*** goldyfruit has joined #openstack-ansible15:19
*** gyee has joined #openstack-ansible15:31
*** ivve has joined #openstack-ansible15:40
noonedeadpunkfolks, what do you think regarding https://review.opendev.org/#/c/670471/ ? It has edits to service_setup.yml so in case of merging this I'll update service_setup for already merged roles15:40
redkriegapparently there was some kind of corruption in my mistral clone, removed it entirely and the bootstrapper pulled again with no problems.  not sure how that can happen15:47
*** spatel has joined #openstack-ansible15:54
spatelFolks, I am using LinuxBridge and running tcpdump on instance can see all other instance traffic on same host, is that normal behavior ?15:55
*** grabes has joined #openstack-ansible15:55
grabesCan someone help me clarify a network issue.  Running Stein/Linux Bridge.  VMs within the same project, and network can see all unicast traffic to any other VM on that compute host.  Is that normal behaviour?  I am getting conflicting answers from others.16:02
*** miloa has quit IRC16:04
spateljamesdenton: ^^ i think grabes also seeing same result which i am seeing16:05
*** cshen has joined #openstack-ansible16:06
jamesdentonon one of the computes.. can you send me the output of 'ip -d link show <bridge>', where bridge is some brq* bridge16:07
jamesdentonactually. one sec16:10
spatelgrabes: ^^16:10
grabeshttps://pastebin.com/2MG06rdZ16:12
*** the_intern has joined #openstack-ansible16:13
*** kopecmartin is now known as kopecmartin|off16:13
*** flaviosr has joined #openstack-ansible16:15
guilhermespall right cores, ready to land :) https://review.opendev.org/#/c/670747/216:16
guilhermespcc mnaser jrosser noonedeadpunk16:17
*** cshen has quit IRC16:18
spateljamesdenton: grabes - i pick one of instance and running "tcpdump -i any -nn not host <my_host_ip>"  and not seeing any other host traffic but i am sure i saw that before which i thought it could be linuxbridge behavior16:25
jamesdentoni see similar behavior. looking into it16:27
*** cshen has joined #openstack-ansible16:30
*** rpittau is now known as rpittau|afk16:30
spateli wonder linuxbridge act like some short of hub instead of switch :)  may be some kernel turning..16:32
grabesTotally freaked me out when I was running some tests.  Phantom traffic :)16:34
*** cshen has quit IRC16:35
Nick_Adid you guys upgrade to stein or are you seeing it on a new install?16:43
grabesNick_A: This was a new install16:48
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_nova master: Use systemd-journald instead of log files  https://review.opendev.org/67088216:48
*** udesale has quit IRC16:56
*** spatel has quit IRC16:58
*** flaviosr_ has joined #openstack-ansible17:00
*** sum12 has quit IRC17:03
*** flaviosr has quit IRC17:03
*** sum12 has joined #openstack-ansible17:05
*** the_intern has quit IRC17:07
*** tosky has quit IRC17:13
*** tosky has joined #openstack-ansible17:13
*** vnogin has quit IRC17:16
*** altlogbot_2 has quit IRC17:25
*** irclogbot_3 has quit IRC17:26
*** altlogbot_0 has joined #openstack-ansible17:27
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_nova master: Use systemd-journald instead of log files  https://review.opendev.org/67088217:27
*** irclogbot_1 has joined #openstack-ansible17:28
*** TxGirlGeek has quit IRC17:29
*** altlogbot_0 has quit IRC17:31
*** irclogbot_1 has quit IRC17:32
*** TxGirlGeek has joined #openstack-ansible17:32
*** sum12 has quit IRC17:36
*** flaviosr_ has quit IRC17:36
*** sum12 has joined #openstack-ansible17:37
*** irclogbot_0 has joined #openstack-ansible17:38
*** altlogbot_3 has joined #openstack-ansible17:39
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_glance master: Use systemd-journald instead of log files  https://review.opendev.org/67089017:40
*** vnogin has joined #openstack-ansible17:44
*** vnogin has quit IRC17:48
*** weifan has joined #openstack-ansible17:49
*** cyberpear has joined #openstack-ansible17:59
*** the_intern has joined #openstack-ansible18:27
openstackgerritMerged openstack/openstack-ansible-os_blazar master: db_setup: refactor database setup to a common file  https://review.opendev.org/67074718:30
*** electrofelix has quit IRC18:31
logan-jamesdenton: I noticed the bridge fdb is empty when that is happening. maybe learning is disabled on the bridge so it is broadcasting all the traffic as unknown unicast18:37
logan-?18:37
*** weifan has quit IRC18:38
*** vnogin has joined #openstack-ansible18:40
jamesdentonyeah i suspect fdb18:41
logan-OH you know what, when I was looking into that last week, I was seeing the VM side of the tap port mac rather than the host side in the fdb18:42
logan-so it was not matching any mac known on the host18:42
jamesdentonyeah, the f3:16:3e mac, right?18:47
jamesdentonfe18:47
logan-right18:48
logan-it seems like neutron's taps are all fa:* on the host side and corresponding fe:* on the instance side18:49
logan-and then for some reason the fe:* are getting populated into the fdb18:49
*** the_intern has quit IRC18:52
openstackgerritMerged openstack/openstack-ansible master: Bump SHAs for master  https://review.opendev.org/67072619:00
*** vnogin has quit IRC19:04
*** 7JTAATE3D has joined #openstack-ansible19:05
*** 7JTAATE3D has quit IRC19:05
*** weifan has joined #openstack-ansible19:05
*** weifan has quit IRC19:06
*** weifan has joined #openstack-ansible19:06
*** weifan has quit IRC19:07
*** weifan has joined #openstack-ansible19:07
*** weifan has quit IRC19:08
*** weifan has joined #openstack-ansible19:08
*** weifan has quit IRC19:08
*** weifan has joined #openstack-ansible19:09
*** weifan has quit IRC19:09
*** weifan has joined #openstack-ansible19:09
*** weifan has quit IRC19:10
*** weifan has joined #openstack-ansible19:10
*** weifan has quit IRC19:11
*** weifan has joined #openstack-ansible19:11
*** weifan has quit IRC19:12
*** weifan has joined #openstack-ansible19:12
*** weifan has quit IRC19:12
*** weifan has joined #openstack-ansible19:13
*** weifan has quit IRC19:13
*** weifan has joined #openstack-ansible19:13
*** weifan has quit IRC19:14
*** weifan has joined #openstack-ansible19:14
*** weifan has quit IRC19:15
*** weifan has joined #openstack-ansible19:15
*** weifan has quit IRC19:16
*** weifan has joined #openstack-ansible19:16
*** weifan has quit IRC19:16
*** weifan has joined #openstack-ansible19:17
*** weifan has quit IRC19:17
*** weifan has joined #openstack-ansible19:17
*** weifan has quit IRC19:18
*** weifan has joined #openstack-ansible19:18
*** weifan has quit IRC19:19
*** weifan has joined #openstack-ansible19:19
*** weifan has quit IRC19:20
*** vnogin has joined #openstack-ansible19:20
*** vnogin has quit IRC19:24
*** weifan has joined #openstack-ansible19:26
*** spatel has joined #openstack-ansible19:29
*** luksky11 has joined #openstack-ansible19:34
*** aedc has quit IRC19:35
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_glance master: Use systemd-journald instead of log files  https://review.opendev.org/67089019:39
redkriegHas anyone had issues with service containers being very slow to respond when running playbooks?  Every task takes 30 seconds to run for each container when it happens, usually starts mid-playbook run when I do all the setup-* playbooks back to back and affects the repo and utility containers most often.  stopping and starting the container that's being slow fixes the problem for a few runs.19:42
redkriegmanually using ssh to connect to the container behaves the same way, takes about 30 seconds to get a prompt19:42
NewJorg30 seconds? sounds like it tries to resolve the ip address of the connecting client but cant reach a DNS server19:44
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_glance master: Use systemd-journald instead of log files  https://review.opendev.org/67089019:46
*** kplant has quit IRC19:47
*** cshen has joined #openstack-ansible19:48
*** vnogin has joined #openstack-ansible19:59
*** cshen has quit IRC20:00
*** cshen has joined #openstack-ansible20:07
*** vnogin has quit IRC20:07
*** altlogbot_3 has quit IRC20:10
*** tiffanie has joined #openstack-ansible20:13
*** altlogbot_1 has joined #openstack-ansible20:13
*** cshen has quit IRC20:15
*** weifan has quit IRC20:27
*** weifan has joined #openstack-ansible20:27
*** pcaruana has quit IRC20:29
spatellogan-: who add macs in fdb tables? i think that process is dynamic learning right?20:29
*** grabes has quit IRC20:34
*** TxGirlGeek has quit IRC20:35
*** BjoernT has joined #openstack-ansible20:37
*** grabes has joined #openstack-ansible20:40
*** BjoernT_ has joined #openstack-ansible20:41
*** BjoernT has quit IRC20:42
*** TxGirlGeek has joined #openstack-ansible20:46
*** ansmith has quit IRC20:53
*** grabes has quit IRC21:04
openstackgerritMerged openstack/openstack-ansible-os_trove stable/queens: Updated from OpenStack Ansible Tests  https://review.opendev.org/66410721:04
*** grabes has joined #openstack-ansible21:07
openstackgerritMerged openstack/openstack-ansible-os_tacker stable/rocky: Updated from OpenStack Ansible Tests  https://review.opendev.org/66669321:08
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_nova master: Use systemd-journald instead of log files  https://review.opendev.org/67088221:12
openstackgerritMerged openstack/openstack-ansible-os_zun master: Updated from OpenStack Ansible Tests  https://review.opendev.org/66473421:27
*** ansmith has joined #openstack-ansible21:28
openstackgerritMerged openstack/openstack-ansible-os_blazar stable/stein: Updated from OpenStack Ansible Tests  https://review.opendev.org/66669721:40
*** tosky has quit IRC21:50
*** spatel has quit IRC21:54
*** BjoernT_ has quit IRC22:07
openstackgerritMerged openstack/openstack-ansible-os_mistral stable/rocky: Updated from OpenStack Ansible Tests  https://review.opendev.org/66668622:15
openstackgerritMerged openstack/openstack-ansible-os_swift stable/stein: Updated from OpenStack Ansible Tests  https://review.opendev.org/65861422:15
*** luksky11 has quit IRC22:20
openstackgerritMerged openstack/openstack-ansible-os_ceilometer stable/stein: Updated from OpenStack Ansible Tests  https://review.opendev.org/66669922:24
openstackgerritMerged openstack/openstack-ansible-os_masakari stable/stein: Updated from OpenStack Ansible Tests  https://review.opendev.org/66671122:24
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.opendev.org/65803822:25
*** goldyfruit has quit IRC22:25
*** TxGirlGeek has quit IRC23:45
openstackgerritMerged openstack/openstack-ansible stable/stein: ceph: stop adding repos  https://review.opendev.org/67061723:45

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!