| *** amotoki has quit IRC | 00:02 | |
| *** lucas-dinner has quit IRC | 00:03 | |
| *** lucasagomes has joined #openstack-oslo | 00:06 | |
| *** jamielennox is now known as jamielennox|away | 00:10 | |
| *** mtanino__ has quit IRC | 00:15 | |
| *** ozamiatin_ has joined #openstack-oslo | 00:16 | |
| *** mtanino__ has joined #openstack-oslo | 00:16 | |
| *** salv-orlando has quit IRC | 00:25 | |
| *** browne has quit IRC | 00:50 | |
| *** browne has joined #openstack-oslo | 00:52 | |
| *** arthus has joined #openstack-oslo | 00:52 | |
| *** eliqiao_ has quit IRC | 01:17 | |
| *** browne has quit IRC | 01:20 | |
| *** mtanino has quit IRC | 01:22 | |
| *** eliqiao_ has joined #openstack-oslo | 01:22 | |
| *** browne has joined #openstack-oslo | 01:28 | |
| *** jamielennox|away is now known as jamielennox | 01:34 | |
| openstackgerrit | Merged openstack/osprofiler: Make class detection more accurate https://review.openstack.org/278103 | 01:34 |
|---|---|---|
| *** arthus has quit IRC | 01:41 | |
| *** yamamoto_ has joined #openstack-oslo | 01:44 | |
| openstackgerrit | Merged openstack/oslo.privsep: UnprivilegedPrivsepFixture: Clear capabilities config https://review.openstack.org/278194 | 01:51 |
| *** harlowja has quit IRC | 01:55 | |
| *** yamahata has quit IRC | 01:56 | |
| *** eliqiao_ has quit IRC | 01:56 | |
| *** ozamiatin_ has quit IRC | 01:57 | |
| *** edmondsw has quit IRC | 01:57 | |
| *** eliqiao_ has joined #openstack-oslo | 01:58 | |
| *** amotoki has joined #openstack-oslo | 01:58 | |
| *** shakamunyi has joined #openstack-oslo | 01:58 | |
| *** amotoki has quit IRC | 02:02 | |
| *** yamamoto_ has quit IRC | 02:04 | |
| *** shakamunyi has quit IRC | 02:12 | |
| openstackgerrit | Merged openstack/osprofiler: stop making a copy of options discovered by config generator https://review.openstack.org/278613 | 02:14 |
| openstackgerrit | Merged openstack/osprofiler: run py34 tests before py27 to work around testr bug https://review.openstack.org/278614 | 02:14 |
| openstackgerrit | Merged openstack/osprofiler: remove python 2.6 trove classifier https://review.openstack.org/260821 | 02:14 |
| *** jecarey has joined #openstack-oslo | 02:14 | |
| *** jecarey has quit IRC | 02:18 | |
| *** arthus has joined #openstack-oslo | 02:26 | |
| *** shakamunyi has joined #openstack-oslo | 02:31 | |
| *** browne has quit IRC | 02:33 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/oslo.messaging: [WIP] Ignore me. Just testing https://review.openstack.org/279366 | 02:42 |
| *** zz_dimtruck is now known as dimtruck | 02:43 | |
| *** ozamiatin_ has joined #openstack-oslo | 02:47 | |
| *** yamahata has joined #openstack-oslo | 02:48 | |
| *** yamamoto_ has joined #openstack-oslo | 02:51 | |
| *** salv-orlando has joined #openstack-oslo | 02:53 | |
| *** salv-orlando has quit IRC | 02:55 | |
| openstackgerrit | Merged openstack/taskflow: Updated from global requirements https://review.openstack.org/279130 | 02:57 |
| *** ozamiatin_ has quit IRC | 02:58 | |
| *** amrith is now known as _amrith_ | 03:02 | |
| *** vilobhmm11 has quit IRC | 03:07 | |
| *** dims has quit IRC | 03:11 | |
| *** dims has joined #openstack-oslo | 03:11 | |
| *** ozamiatin_ has joined #openstack-oslo | 03:25 | |
| *** dims has quit IRC | 03:31 | |
| *** links has joined #openstack-oslo | 03:32 | |
| openstackgerrit | Merged openstack/oslo.messaging: Remove server queue creating if target's server is empty https://review.openstack.org/278457 | 03:34 |
| *** achanda has joined #openstack-oslo | 03:39 | |
| *** arthus has quit IRC | 03:40 | |
| *** achanda has quit IRC | 03:41 | |
| *** browne has joined #openstack-oslo | 03:45 | |
| *** achanda has joined #openstack-oslo | 03:46 | |
| openstackgerrit | Merged openstack/oslo.versionedobjects: Updated from global requirements https://review.openstack.org/279116 | 03:47 |
| *** rakhmerov has quit IRC | 03:57 | |
| *** ativelkov has quit IRC | 03:57 | |
| *** rakhmerov has joined #openstack-oslo | 03:58 | |
| *** ativelkov has joined #openstack-oslo | 03:58 | |
| *** deray has joined #openstack-oslo | 04:12 | |
| *** yamahata has quit IRC | 04:17 | |
| *** arthus has joined #openstack-oslo | 04:26 | |
| *** salv-orlando has joined #openstack-oslo | 04:37 | |
| *** amotoki has joined #openstack-oslo | 04:41 | |
| *** salv-orlando has quit IRC | 04:42 | |
| *** ozamiatin_ has quit IRC | 04:45 | |
| *** browne has quit IRC | 05:08 | |
| *** browne has joined #openstack-oslo | 05:08 | |
| *** dimtruck has quit IRC | 05:10 | |
| *** hockeynut has quit IRC | 05:10 | |
| *** arthus has quit IRC | 05:10 | |
| *** stevemar has quit IRC | 05:11 | |
| *** hockeynut has joined #openstack-oslo | 05:12 | |
| *** dimtruck has joined #openstack-oslo | 05:12 | |
| *** stevemar has joined #openstack-oslo | 05:13 | |
| *** arthus has joined #openstack-oslo | 05:14 | |
| *** boris-42 has quit IRC | 05:24 | |
| *** mss-4_ has quit IRC | 05:30 | |
| *** achanda has quit IRC | 05:38 | |
| *** salv-orlando has joined #openstack-oslo | 05:54 | |
| *** salv-orlando has quit IRC | 05:56 | |
| *** achanda has joined #openstack-oslo | 05:57 | |
| openstackgerrit | Joshua Harlow proposed openstack/taskflow: Don't bother scanning for workers if no new messages arrived https://review.openstack.org/276872 | 06:00 |
| openstackgerrit | Joshua Harlow proposed openstack/taskflow: Some WBE protocol/executor cleanups https://review.openstack.org/276941 | 06:08 |
| *** achanda has quit IRC | 06:09 | |
| *** achanda has joined #openstack-oslo | 06:11 | |
| *** jecarey has joined #openstack-oslo | 06:15 | |
| *** deray has quit IRC | 06:15 | |
| *** jecarey has quit IRC | 06:20 | |
| *** achanda has quit IRC | 06:20 | |
| *** achanda has joined #openstack-oslo | 06:21 | |
| *** achanda has quit IRC | 06:28 | |
| *** vilobhmm11 has joined #openstack-oslo | 06:34 | |
| *** arthus has quit IRC | 06:40 | |
| *** arthus has joined #openstack-oslo | 06:41 | |
| *** nkrinner has joined #openstack-oslo | 06:43 | |
| *** boris-42 has joined #openstack-oslo | 07:02 | |
| *** salv-orlando has joined #openstack-oslo | 07:12 | |
| *** dimtruck is now known as zz_dimtruck | 07:13 | |
| openstackgerrit | Steve Martinelli proposed openstack/pycadf: Add docstring validation https://review.openstack.org/230257 | 07:15 |
| *** amotoki has quit IRC | 07:16 | |
| openstackgerrit | Steve Martinelli proposed openstack/pycadf: Add docstring validation https://review.openstack.org/230257 | 07:17 |
| *** salv-orlando has quit IRC | 07:23 | |
| *** amotoki has joined #openstack-oslo | 07:24 | |
| *** amotoki has quit IRC | 07:35 | |
| *** amotoki has joined #openstack-oslo | 07:39 | |
| *** vilobhmm11 has quit IRC | 07:41 | |
| *** amotoki has quit IRC | 07:43 | |
| *** deray has joined #openstack-oslo | 07:50 | |
| *** amotoki has joined #openstack-oslo | 07:55 | |
| *** sputnik13 has joined #openstack-oslo | 07:58 | |
| *** achanda has joined #openstack-oslo | 07:58 | |
| openstackgerrit | Merged openstack/tooz: Updated from global requirements https://review.openstack.org/279131 | 07:59 |
| *** dtardivel has joined #openstack-oslo | 08:10 | |
| *** yottatsa has joined #openstack-oslo | 08:12 | |
| *** zakora has joined #openstack-oslo | 08:19 | |
| *** mss-4 has joined #openstack-oslo | 08:27 | |
| *** deray has quit IRC | 08:27 | |
| *** harlowja_at_home has quit IRC | 08:27 | |
| *** salv-orlando has joined #openstack-oslo | 08:28 | |
| *** mss-4 has quit IRC | 08:32 | |
| *** salv-orlando has quit IRC | 08:35 | |
| *** arthus has quit IRC | 08:39 | |
| *** browne has quit IRC | 08:44 | |
| *** ig0r_ has quit IRC | 08:45 | |
| *** arthus has joined #openstack-oslo | 08:45 | |
| *** e0ne has joined #openstack-oslo | 08:49 | |
| *** deray has joined #openstack-oslo | 08:51 | |
| *** salv-orlando has joined #openstack-oslo | 09:05 | |
| *** mhickey has joined #openstack-oslo | 09:07 | |
| *** mhickey has quit IRC | 09:08 | |
| *** mhickey has joined #openstack-oslo | 09:09 | |
| *** sputnik13 has quit IRC | 09:09 | |
| *** ihrachys has joined #openstack-oslo | 09:12 | |
| *** ndipanov has joined #openstack-oslo | 09:21 | |
| *** bauzas is now known as bauwser | 09:21 | |
| *** KanagarajM has joined #openstack-oslo | 09:22 | |
| *** yottatsa has quit IRC | 09:23 | |
| *** yassine has joined #openstack-oslo | 09:25 | |
| *** achanda has quit IRC | 09:27 | |
| *** amotoki has quit IRC | 09:34 | |
| *** amotoki has joined #openstack-oslo | 09:48 | |
| *** yottatsa has joined #openstack-oslo | 09:49 | |
| *** salv-orlando has quit IRC | 09:52 | |
| *** amotoki has quit IRC | 09:53 | |
| *** amotoki has joined #openstack-oslo | 09:56 | |
| *** amotoki has quit IRC | 10:01 | |
| *** salv-orlando has joined #openstack-oslo | 10:03 | |
| *** amotoki has joined #openstack-oslo | 10:10 | |
| *** amotoki has quit IRC | 10:12 | |
| *** amotoki has joined #openstack-oslo | 10:13 | |
| *** ig0r_ has joined #openstack-oslo | 10:13 | |
| *** yottatsa has quit IRC | 10:18 | |
| *** ozamiatin_ has joined #openstack-oslo | 10:20 | |
| *** openstackgerrit has quit IRC | 10:32 | |
| *** openstackgerrit has joined #openstack-oslo | 10:32 | |
| *** _amrith_ is now known as amrith | 10:35 | |
| *** salv-orl_ has joined #openstack-oslo | 10:41 | |
| *** dims has joined #openstack-oslo | 10:41 | |
| *** salv-orlando has quit IRC | 10:45 | |
| *** cdent has joined #openstack-oslo | 10:53 | |
| *** arthus has quit IRC | 11:07 | |
| *** yottatsa has joined #openstack-oslo | 11:10 | |
| *** jecarey has joined #openstack-oslo | 11:15 | |
| *** deray is now known as deray|afk | 11:18 | |
| *** jecarey has quit IRC | 11:19 | |
| *** bogdando has quit IRC | 11:20 | |
| *** sileht has quit IRC | 11:20 | |
| *** yottatsa has quit IRC | 11:22 | |
| *** yottatsa has joined #openstack-oslo | 11:23 | |
| *** bogdando has joined #openstack-oslo | 11:25 | |
| *** achanda has joined #openstack-oslo | 11:28 | |
| *** amotoki has quit IRC | 11:30 | |
| *** achanda has quit IRC | 11:34 | |
| *** amrith is now known as _amrith_ | 11:35 | |
| KanagarajM | dims, hi, around? like to discuss on https://review.openstack.org/279392 | 11:37 |
| dims | Hi KanagarajM | 11:37 |
| KanagarajM | would like to give the details on oslo.namos | 11:38 |
| *** sileht has joined #openstack-oslo | 11:39 | |
| KanagarajM | working on the openstack/namos service and it will have an common code, which can be used by any openstack service | 11:39 |
| dims | sure, that would be helpful to me, but the team who has to bless this would need a spec. here's an example of the debate/consenus - https://review.openstack.org/#/c/103825/ | 11:39 |
| dims | KanagarajM where did the concept originate? | 11:40 |
| KanagarajM | while i was working on the openstack, found that its missing this part and started to develop the new service | 11:41 |
| KanagarajM | https://wiki.openstack.org/wiki/Namos has more details on it | 11:42 |
| dims | cool will read. | 11:43 |
| *** deray|afk is now known as deray | 11:43 | |
| dims | another question you will get asked is...why oslo? example oslo.win was asked to be its own project oswin - https://review.openstack.org/#/c/209193/ | 11:44 |
| dims | is there a existing team who takes care of this? then a separate core team is enough and it's not needed to be under existing projects like oslo | 11:45 |
| KanagarajM | dims, sure. thanks. i realised that any common library used across openstack services, it shuold go under oslo | 11:45 |
| dims | KanagarajM : ack not trying to discourage, we'll need to take it to the weekly meeting and we'll need a spec | 11:46 |
| *** ig0r_ has quit IRC | 11:48 | |
| dims | Another one, all oslo projects are libraries with no REST API, sure we provide middleware, but not a separate process to run it in | 11:48 |
| KanagarajM | dims, sure. I will write an spec, like osprofilier and will bring it to team. | 11:48 |
| dims | thank you sir! | 11:49 |
| *** ig0r_ has joined #openstack-oslo | 11:49 | |
| KanagarajM | dims, it will be an tiny agent like os profiler, which does similar task | 11:50 |
| dims | ack, that's not clear from the wiki :) | 11:50 |
| KanagarajM | dims, sure, i will update the wiki with details. | 11:51 |
| dims | KanagarajM : also please find a core from Nova or another prominent project to co-write the spec and flesh out the idea, i've seen that helps a lot as well. | 11:52 |
| KanagarajM | dims, sure. thanks. | 11:54 |
| KanagarajM | dims, i gone thru osprofiler and observed that we could start as seprate project initially | 11:56 |
| KanagarajM | so would you advise me to start something like 'osnamos' project and once its stablized, could be brought under oslo? | 11:57 |
| dims | KanagarajM : the reason osprofiler chose to get into oslo was they were facing adoption issues by big projects. | 11:58 |
| dims | so there are tradeoffs | 11:58 |
| dims | another example you can look at is oslo.privsep | 11:58 |
| dims | started with zero code | 11:58 |
| dims | oswin had zero code as well when the spec was written | 11:59 |
| dims | so its upto you | 11:59 |
| dims | big tent definitely helps bootstrap your own team with your own ideas | 11:59 |
| KanagarajM | ok. :) | 12:00 |
| dims | if you write a spec and discussion on ML and weekly oslo meeting, you will get valuable feedback that will be useful later when you try to get others to adopt | 12:00 |
| dims | oslo.cache and even oslo.policy took a long time to get into nova | 12:01 |
| dims | for example | 12:02 |
| KanagarajM | ok, looks bring the spec in first place , better :) | 12:04 |
| *** links has quit IRC | 12:10 | |
| *** yamamoto_ has quit IRC | 12:12 | |
| *** yottatsa has quit IRC | 12:15 | |
| *** lucasagomes is now known as lucas-hungry | 12:30 | |
| *** edmondsw has joined #openstack-oslo | 12:40 | |
| *** ozamiatin_ has quit IRC | 12:41 | |
| *** jaypipes is now known as leakypipes | 12:50 | |
| *** cdent is now known as dentures | 12:51 | |
| *** salv-orl_ has quit IRC | 12:58 | |
| *** _amrith_ is now known as amrith | 12:58 | |
| *** mhickey has quit IRC | 13:12 | |
| *** thumpba has joined #openstack-oslo | 13:13 | |
| *** thumpba has quit IRC | 13:14 | |
| *** thumpba has joined #openstack-oslo | 13:14 | |
| *** thumpba has quit IRC | 13:19 | |
| *** lucas-hungry is now known as lucasagomes | 13:31 | |
| *** achanda has joined #openstack-oslo | 13:32 | |
| *** amotoki has joined #openstack-oslo | 13:33 | |
| *** achanda has quit IRC | 13:38 | |
| *** binarin has joined #openstack-oslo | 13:40 | |
| dims | dmitryme : have you seen this? http://logs.openstack.org/33/278333/2/check/gate-grenade-dsvm/25e431e/logs/new/screen-n-api.txt.gz#_2016-02-10_13_12_07_942 | 13:41 |
| dims | dmitryme : seems to happen only on the "new" grenade side | 13:41 |
| dmitryme | dims: what is “new” side? | 13:42 |
| dims | so the old side in grenade is stable/liberty, the new side is the code from master | 13:43 |
| *** amotoki has quit IRC | 13:43 | |
| dims | grenade installs the old version, then kills nova-api and starts a new one with fresh code | 13:43 |
| dmitryme | got it, let me think a little | 13:44 |
| dims | dmitryme : i suspect it will happen master to master upgrade as well, but i don't have sufficent logs to prove that | 13:44 |
| dims | ack thanks | 13:44 |
| *** ozamiatin_ has joined #openstack-oslo | 13:47 | |
| *** amotoki has joined #openstack-oslo | 13:51 | |
| dims | one another data point dmitryme is i see "no exchange" in rabbitmq logs (http://logs.openstack.org/33/278333/2/check/gate-grenade-dsvm/25e431e/logs/rabbitmq/rabbit@devstack-trusty-ovh-gra1-7857487.txt.gz) just before this happens | 13:51 |
| dims | sileht : ^^ | 13:52 |
| *** amotoki has quit IRC | 13:52 | |
| dims | sileht : logstash query message:"<class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500)" has 27 hits for last week in grenade "new" side | 13:53 |
| sileht | dims, that can be fine, I'm imagine this occurs when nova-scheduler is restarted after the update | 13:53 |
| *** edmondsw has quit IRC | 13:53 | |
| dims | sileht : usually yes, here it causes a failure in "ip floating remove" - http://logs.openstack.org/33/278333/2/check/gate-grenade-dsvm/25e431e/logs/grenade.sh.txt.gz#_2016-02-10_13_11_06_514 | 13:54 |
| *** edmondsw has joined #openstack-oslo | 13:54 | |
| dims | that's the actual problem i am trying to track | 13:54 |
| dims | dmitryme : ^^ | 13:54 |
| sileht | dims, I think the issue is: | 13:55 |
| sileht | =ERROR REPORT==== 10-Feb-2016::13:11:50 === | 13:55 |
| sileht | closing AMQP connection <0.1420.0> (127.0.0.1:60151 -> 127.0.0.1:5672): | 13:55 |
| sileht | {heartbeat_timeout,running} | 13:55 |
| dmitryme | sileht: but that should not lead to message loss | 13:56 |
| dmitryme | dims: I am also examining http://logs.openstack.org/33/278333/2/check/gate-grenade-dsvm/25e431e/logs/new/screen-n-net.txt.gz - that seems to be server side of that failed RPC call | 13:56 |
| sileht | http://logs.openstack.org/33/278333/2/check/gate-grenade-dsvm/25e431e/logs/new/screen-n-cond.txt.gz#_2016-02-10_13_11_51_484 | 13:56 |
| dims | that one is new, i had not seen that before | 13:57 |
| dims | sileht that comes much later | 13:58 |
| dims | dmitryme : looking | 13:58 |
| *** amotoki has joined #openstack-oslo | 13:58 | |
| dims | dmitryme : the errors in http://logs.openstack.org/33/278333/2/check/gate-grenade-dsvm/25e431e/logs/new/screen-n-net.txt.gz?level=ERROR#_2016-02-10_13_11_42_539 is also later in time after the "ip floating remove" fails | 13:59 |
| dmitryme | dims: hmm, actually the removal of IP timed out at 13:12:07 | 14:00 |
| dmitryme | http://logs.openstack.org/33/278333/2/check/gate-grenade-dsvm/25e431e/logs/new/screen-n-api.txt.gz#_2016-02-10_13_12_07_942 | 14:00 |
| dims | oops, i was looking at multiple logs | 14:00 |
| *** clayton has quit IRC | 14:00 | |
| *** rlrossit has joined #openstack-oslo | 14:00 | |
| sileht | dims, something is stuck in nova-network that prevent the heatbeat packet to be send by kombu/oslo.messaging | 14:01 |
| dims | k, back in a bit, i have to switch for a little bit | 14:02 |
| *** MVenesio has joined #openstack-oslo | 14:05 | |
| *** amrith is now known as _amrith_ | 14:07 | |
| *** KanagarajM has quit IRC | 14:07 | |
| *** kgiusti has joined #openstack-oslo | 14:08 | |
| *** jecarey has joined #openstack-oslo | 14:10 | |
| dmitryme | dims: what I understand is that the request has reached the nova-network - there is an entry at 13:11:07.947 in its log mentioning nova.network.floating_ips.do_disassociate | 14:11 |
| dmitryme | it is not clear though if nova-network responded or not | 14:11 |
| dmitryme | i.e. it might be that nova-network did not respond at all. Or it might be that respond was sent by nova-network, but was not received by nova-api | 14:12 |
| *** clayton- has joined #openstack-oslo | 14:12 | |
| dmitryme | could oslo.messaging debug logs be enabled for that job? With them we will be able to understand if nova-network responded or not | 14:13 |
| *** salv-orlando has joined #openstack-oslo | 14:13 | |
| *** yottatsa has joined #openstack-oslo | 14:18 | |
| *** jecarey has quit IRC | 14:20 | |
| *** jecarey has joined #openstack-oslo | 14:21 | |
| dims | sileht : Two experiments :) Nadya just pointed me to https://review.openstack.org/#/c/279488/ and dukhlov pointed me to https://review.openstack.org/#/c/279018/ | 14:23 |
| dims | first one is in ceilometer and the other one in mistral | 14:24 |
| *** jecarey has quit IRC | 14:25 | |
| *** mriedem has joined #openstack-oslo | 14:26 | |
| sileht | dims, the mistral one is again the same broken idea to ack message after the callback have been executed .... | 14:28 |
| dims | y | 14:28 |
| *** dansmith is now known as superdan | 14:28 | |
| dims | dmitryme : sileht : let's use this bug to track - https://bugs.launchpad.net/oslo.messaging/+bug/1545002 | 14:34 |
| openstack | Launchpad bug 1545002 in oslo.messaging "Grenade Failure - ip floating remove" [Critical,Confirmed] | 14:35 |
| dims | sdague : mriedem : ^^ | 14:35 |
| mriedem | dims: looks like probably the same one i pointed out the other day | 14:36 |
| dims | mriedem : yes, that's the one | 14:36 |
| mriedem | i wouldn't say it's critical | 14:36 |
| dims | mriedem : cool | 14:37 |
| sdague | mriedem: it's at least high | 14:37 |
| sdague | oslo.messaging not reconnecting after service restart randomly is kind of a big deal | 14:38 |
| dims | sdague : mriedem : so i see it only in "gate-grenade-dsvm" but not in "gate-grenade-dsvm-neutron" | 14:38 |
| mriedem | dims: yeah the failures are in n-net | 14:38 |
| mriedem | 2016-02-12 10:31:05.380 DEBUG oslo_concurrency.lockutils [req-b1f17c4c-b814-4a21-9209-13db7915370f cinder_grenade cinder_grenade] Lock "172.24.5.2" acquired by "nova.network.floating_ips.do_disassociate" :: waited 0.000s inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:270 2016-02-12 10:32:06.595 22979 DEBUG oslo.messaging._drivers.impl_rabbit [-] Received recoverable error from kombu: on_error /usr/local/lib/py | 14:38 |
| mriedem | crap | 14:38 |
| mriedem | n-api fails here http://logs.openstack.org/12/278012/3/check/gate-grenade-dsvm/ac87c30/logs/new/screen-n-api.txt.gz?level=TRACE#_2016-02-12_10_32_05_378 | 14:39 |
| dims | so it's at least not across the board | 14:39 |
| mriedem | things start failing in n-net here (same time): http://logs.openstack.org/12/278012/3/check/gate-grenade-dsvm/ac87c30/logs/new/screen-n-net.txt.gz#_2016-02-12_10_31_05_380 | 14:39 |
| dims | y, sileht and dmitryme are looking as well | 14:39 |
| mriedem | we get the lock to disassociate the floating ip | 14:40 |
| mriedem | 2016-02-12 10:31:05.380 DEBUG oslo_concurrency.lockutils [req-b1f17c4c-b814-4a21-9209-13db7915370f cinder_grenade cinder_grenade] Lock "172.24.5.2" acquired by "nova.network.floating_ips.do_disassociate" :: waited 0.000s inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:270 | 14:40 |
| mriedem | 1 minute later we have a socket closed error: | 14:40 |
| mriedem | 2016-02-12 10:32:06.595 22979 DEBUG oslo.messaging._drivers.impl_rabbit [-] Received recoverable error from kombu: on_error /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py:654 | 14:40 |
| mriedem | and that 1 minute causes the messaging timeout in n-api | 14:40 |
| sdague | n-net might be more sensitive to it, but it's still not good | 14:41 |
| dims | mriedem : so the heartbeat thingy may be stuck during that time | 14:41 |
| sdague | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22IOError%3A%20Socket%20closed%5C%22%20AND%20module%3A%5C%22oslo.messaging._drivers.impl_rabbit%5C%22 | 14:41 |
| dims | [09:01:30] <sileht>dims, something is stuck in nova-network that prevent the heatbeat packet to be send by kombu/oslo.messaging | 14:41 |
| sdague | it hits across all grenade jobs | 14:42 |
| mriedem | sdague: that query is too broad | 14:42 |
| mriedem | it's 100% success | 14:43 |
| dims | :) | 14:43 |
| sileht | perhaps the threading or time module is not monkeypatched somewhere | 14:43 |
| mriedem | this is what i've been using | 14:43 |
| sdague | mriedem: sure, but it's still terrible. We're throwing this big error after restart of services all the time | 14:44 |
| mriedem | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22_disassociate_floating_ip%5C%22%20AND%20message%3A%5C%22MessagingTimeout%5C%22%20AND%20tags%3A%5C%22screen-n-api.txt%5C%22&from=7d | 14:44 |
| sdague | mriedem: right, which is clearly only ever going to hit on nova-network | 14:45 |
| sdague | as you have referenced a nova network internals function | 14:45 |
| *** yottatsa has quit IRC | 14:45 | |
| *** amotoki has quit IRC | 14:45 | |
| sdague | which is maybe fine, but we shouldn't assume that this is only nova-network for this reason | 14:45 |
| mriedem | also, fwiw, this really started showing up around 2/4 | 14:45 |
| sdague | this is just one of the first API calls that happens when we start tearing things down | 14:46 |
| dims | sdague : my query was message:"<class 'oslo_messaging.exceptions.MessagingTimeout'>" | 14:46 |
| mriedem | dims: that's too generic | 14:47 |
| mriedem | message:"cinder_grenade" AND message:"_disassociate_floating_ip" AND message:"MessagingTimeout" AND tags:"screen-n-api.txt" | 14:47 |
| dims | mriedem : right, but that still shows just 2 jobs | 14:47 |
| dims | both jobs are nova-network | 14:47 |
| sdague | right, this is the first API call of any kind made after the service restart | 14:47 |
| mriedem | right | 14:47 |
| mriedem | i haven't seen this failure in any neutron grenade jobs | 14:47 |
| mriedem | and i noticed it at the beginning of the week | 14:47 |
| sdague | so be careful about assuming the particular API call is the issue | 14:48 |
| dims | y, sdague pinged me too about that | 14:48 |
| sdague | 0 api calls have worked at this point on new | 14:48 |
| *** amotoki has joined #openstack-oslo | 14:48 | |
| mriedem | i'm most interested in what released on 2/4 | 14:49 |
| mriedem | running what-broke now | 14:49 |
| dims | mriedem easy way to check is what the requirements bot logged that day, give me a sec | 14:49 |
| sdague | mriedem: 2/4 is the very end of our ES dataset | 14:50 |
| mriedem | sdague: it was 2/4 when i pointed this out days ago | 14:50 |
| sdague | are you sure that's a real trigger, or just a data artifact | 14:50 |
| sdague | well - <Released oslo.messaging 4.1.0 2016-02-04 20:36:27> | 14:51 |
| mriedem | yes, i think i pointed out o.m 4.1.0 before too | 14:51 |
| mriedem | and was looking for changes in there that could be related, but there are a lot of changes | 14:51 |
| dims | yep https://review.openstack.org/#/c/276058/ | 14:51 |
| sdague | right, so this is an o.m regression | 14:52 |
| *** pradk has joined #openstack-oslo | 14:52 | |
| mriedem | https://github.com/openstack/oslo.messaging/compare/4.0.0...4.1.0 | 14:52 |
| sdague | but figuring out what triggered it, or what usage of it is triggering it, is the problem | 14:52 |
| dims | i had held back releases for o.m for m2 i think which piled up the reviews | 14:52 |
| *** yottatsa has joined #openstack-oslo | 14:53 | |
| *** amotoki has quit IRC | 14:53 | |
| sdague | https://github.com/openstack/oslo.messaging/commit/e0a9b0c0551eb98d031bec1d4bd621d3e4796977 | 14:54 |
| sdague | ? | 14:54 |
| mriedem | there are also 3 new rabbit config options introduced in 4.1.0 | 14:54 |
| *** deray has quit IRC | 14:55 | |
| *** clayton- is now known as clayton | 14:55 | |
| *** yottatsa has quit IRC | 14:55 | |
| sdague | https://github.com/openstack/oslo.messaging/commit/3d4babe900d76bdc6d23d236a916e218e457c08d | 14:56 |
| mriedem | https://github.com/openstack/oslo.messaging/commit/c5825e25864bf6dbd22ddb1fd16bcb6a0473b0c1 | 14:56 |
| sdague | https://github.com/openstack/oslo.messaging/commit/d49ddc3b9828f097d5bb39bca0381386a9de7762 | 14:57 |
| sdague | yeh, all sorts of potential behavior changes | 14:57 |
| sdague | mriedem: the c1 retry seems most likely here, as we are seeing a delayed retry | 14:57 |
| *** yottatsa has joined #openstack-oslo | 14:58 | |
| sdague | but, again it's deep internals | 14:58 |
| sileht | this one looks the more suspicious to me: https://github.com/openstack/oslo.messaging/commit/e0a9b0c0551eb98d031bec1d4bd621d3e4796977 | 14:59 |
| sdague | sileht: yeh, I don't even know what it means :) | 14:59 |
| sdague | but that's mostly my ignorance of the internals here | 15:00 |
| *** jecarey has joined #openstack-oslo | 15:01 | |
| sileht | the root cause is how a connection can be blocked more than 1 minutes | 15:01 |
| dims | sdague : sileht : that would blow up both on the old side and the new side right? | 15:02 |
| sdague | dims: the issue is reconnecting to existing topics | 15:02 |
| sdague | we only ever do that in grenade | 15:02 |
| sdague | because otherwise the services are connect once | 15:03 |
| openstackgerrit | Steve Martinelli proposed openstack/pycadf: Add docstring validation https://review.openstack.org/230257 | 15:03 |
| mriedem | dims: old side liberty oslo.messaging is capped at 3.0.0 | 15:03 |
| mriedem | which is why we don't also see it in liberty grenade jobs | 15:03 |
| sdague | mriedem: oh.... really? | 15:03 |
| *** jecarey has quit IRC | 15:04 | |
| mriedem | yeah it's only master grenade | 15:04 |
| sdague | right, ok | 15:04 |
| sdague | I forgot there was a cap there, but that more implicates 4.1.0 | 15:04 |
| mriedem | and 'capped' as in upper-constraints | 15:04 |
| *** jecarey has joined #openstack-oslo | 15:04 | |
| *** jecarey has quit IRC | 15:05 | |
| *** jecarey has joined #openstack-oslo | 15:06 | |
| *** yottatsa has quit IRC | 15:06 | |
| *** yottatsa has joined #openstack-oslo | 15:07 | |
| sdague | dims: which patch again were you concerned about? | 15:08 |
| dims | sileht : mriedem : sdague : rabbit_transient_queues_ttl is my guess, we should set the default to 0 to go back to old behavior | 15:08 |
| mriedem | https://github.com/openstack/oslo.messaging/commit/10625eed87b4c7f980bd5cd7cacbc4caa2dec197 | 15:08 |
| dims | rabbit_transient_queues_ttl | 15:09 |
| *** amotoki has joined #openstack-oslo | 15:09 | |
| mriedem | "The change does not affect upgrade in any way." | 15:09 |
| *** yamamot__ has joined #openstack-oslo | 15:09 | |
| mriedem | the commit message says it doesn't affect upgrade, so it can't be it :) | 15:09 |
| mriedem | jeckersb: ^ want to help debug | 15:09 |
| * jeckersb looks | 15:10 | |
| dims | mriedem : ah, the old queue already created is the one that went away | 15:10 |
| *** yottatsa has quit IRC | 15:10 | |
| mriedem | the default on that is 10 minutes | 15:10 |
| dims | right | 15:10 |
| mriedem | would the queue be unused for 10 minutes in a grenade run? | 15:10 |
| sdague | 10 minutes seems long, but we can look | 15:11 |
| mriedem | jeckersb: for context, grenade jobs sometimes fail on the mitaka side, started after oslo.messaging 4.1.0 was released | 15:12 |
| mriedem | tracked in bug https://bugs.launchpad.net/oslo.messaging/+bug/1545002 | 15:12 |
| openstack | Launchpad bug 1545002 in oslo.messaging "Grenade Failure - MessagingTimeout on floating IP remove" [High,Confirmed] | 15:12 |
| sdague | we are done with services at - http://logs.openstack.org/12/278012/3/check/gate-grenade-dsvm/ac87c30/logs/grenade.sh.txt.gz#_2016-02-12_10_27_13_098 | 15:12 |
| mriedem | jeckersb: so we're looking for regressions in rabbit in that release | 15:12 |
| *** yottatsa has joined #openstack-oslo | 15:12 | |
| jeckersb | mriedem: cool, the context was what i was trying to figure out :) | 15:12 |
| *** gordc has joined #openstack-oslo | 15:13 | |
| mriedem | seeing this in n-net http://logs.openstack.org/12/278012/3/check/gate-grenade-dsvm/ac87c30/logs/new/screen-n-net.txt.gz?level=TRACE | 15:13 |
| sdague | our failure is - http://logs.openstack.org/12/278012/3/check/gate-grenade-dsvm/ac87c30/logs/grenade.sh.txt.gz#_2016-02-12_10_27_13_098 | 15:13 |
| sdague | http://logs.openstack.org/12/278012/3/check/gate-grenade-dsvm/ac87c30/logs/grenade.sh.txt.gz#_2016-02-12_10_31_02_846 | 15:13 |
| sdague | so, it's only 4 minutes later | 15:13 |
| *** yottatsa has quit IRC | 15:14 | |
| jeckersb | so possibly heartbeat is being missed in order to cause disconnect | 15:16 |
| *** yottatsa has joined #openstack-oslo | 15:16 | |
| mriedem | hmm, https://review.openstack.org/#/c/263712/ | 15:16 |
| mriedem | they say kombu is already doing the conversion,m | 15:16 |
| mriedem | but which version of kombu? | 15:17 |
| mriedem | must be new enough i guess since https://github.com/celery/kombu/commit/c5eacdafaeda498539b2c6c2a8d5023132141043 was made a year ago | 15:17 |
| sdague | jeckersb: well, the services are offline for 3-4 minutes | 15:17 |
| sdague | I guess who is supposed to be making a heartbeat | 15:18 |
| sileht | mriedem, the commit is only master ... | 15:18 |
| *** yottatsa has quit IRC | 15:18 | |
| mriedem | sileht: orly | 15:18 |
| sdague | sileht: that can't be | 15:19 |
| sdague | github has it's in the other tags | 15:19 |
| jeckersb | yeah git doesn't want to "describe" it to me | 15:19 |
| mriedem | https://github.com/celery/kombu/commits/v3.0.25 | 15:20 |
| mriedem | it was in 3.0.25 | 15:20 |
| *** zz_dimtruck is now known as dimtruck | 15:20 | |
| mriedem | https://review.openstack.org/#/c/265843/ should be on stable/liberty though | 15:20 |
| sdague | oh, sorry wrong tree.... I'll let you folks figure it out | 15:20 |
| mriedem | since g-r for kombu in stable/liberty is not >=3.0.25 | 15:20 |
| mriedem | sileht: are you able to confirm that https://github.com/celery/kombu/commit/1cfe771f7a586dcad45dfdb2acfdb43403986065 was released in kombu 3.0.25? | 15:23 |
| sileht | mriedem, yes | 15:25 |
| sileht | https://github.com/celery/kombu/blob/v3.0.25/kombu/messaging.py#L161 | 15:25 |
| mriedem | sileht: ok, then g-r should require kombu>=3.0.25 | 15:26 |
| mriedem | https://github.com/openstack/requirements/blob/master/global-requirements.txt#L78 | 15:26 |
| e0ne | dhellmann: hi Doug. could you please take a look on https://review.openstack.org/#/c/260976/ if you'll have a time? I would like to have it in Mitaka | 15:26 |
| mriedem | sileht: i've proposed a revert of the backport to oslo.messaging on stable/liberty | 15:26 |
| mriedem | https://review.openstack.org/#/c/279600/ | 15:26 |
| *** yamahata has joined #openstack-oslo | 15:26 | |
| *** ozamiatin_ has quit IRC | 15:27 | |
| *** mtanino has joined #openstack-oslo | 15:29 | |
| *** achanda has joined #openstack-oslo | 15:36 | |
| *** achanda has quit IRC | 15:41 | |
| openstackgerrit | Julien Danjou proposed openstack/tooz: Use overtest to setup daemons https://review.openstack.org/279611 | 15:43 |
| *** _amrith_ is now known as amrith | 15:44 | |
| openstackgerrit | Julien Danjou proposed openstack/tooz: Use overtest to setup daemons https://review.openstack.org/279611 | 15:44 |
| *** yottatsa has joined #openstack-oslo | 15:47 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 15:48 | |
| *** KanagarajM has joined #openstack-oslo | 15:49 | |
| *** MVenesio has quit IRC | 15:53 | |
| *** amrith is now known as _amrith_ | 16:00 | |
| *** salv-orlando has quit IRC | 16:01 | |
| dhellmann | e0ne : I think the logic error I was trying to describe in PS3 is still present in this version. | 16:03 |
| dhellmann | e0ne : you store mtime as the time the checks began, and then each time _check_for_file_changes runs it compares the modification time of the file against that original value | 16:04 |
| e0ne | dhellmann: thanks! I have to head home, will take a look and test later today or on Monday morning | 16:04 |
| dhellmann | e0ne : that means that if you start at mtime=1 and the file is modified at time 2, every time the comparison happens the file will appear to be newer | 16:04 |
| dhellmann | e0ne : ok, I'll comment on the review | 16:05 |
| e0ne | dhellmann: I remember that I tryied to fix that. maybe it's missed due to rebase. I'll test it and comment or submit a new patch | 16:06 |
| e0ne | dhellmann: thanks for feedback | 16:06 |
| *** KanagarajM has quit IRC | 16:08 | |
| *** pblaho has quit IRC | 16:11 | |
| *** pblaho has joined #openstack-oslo | 16:11 | |
| *** zakora has quit IRC | 16:12 | |
| *** zakora has joined #openstack-oslo | 16:13 | |
| *** zakora has quit IRC | 16:16 | |
| *** mss-4 has joined #openstack-oslo | 16:17 | |
| *** ig0r_ has quit IRC | 16:20 | |
| *** pblaho has quit IRC | 16:20 | |
| *** pblaho has joined #openstack-oslo | 16:20 | |
| *** yottatsa has quit IRC | 16:22 | |
| *** pblaho has quit IRC | 16:22 | |
| *** pblaho has joined #openstack-oslo | 16:23 | |
| *** links has joined #openstack-oslo | 16:23 | |
| *** pblaho has quit IRC | 16:24 | |
| *** e0ne has quit IRC | 16:24 | |
| *** mriedem is now known as mriedem_meeting | 16:24 | |
| *** jecarey_ has joined #openstack-oslo | 16:24 | |
| *** pblaho has joined #openstack-oslo | 16:25 | |
| *** yottatsa has joined #openstack-oslo | 16:28 | |
| *** jecarey has quit IRC | 16:28 | |
| *** MVenesio has joined #openstack-oslo | 16:31 | |
| openstackgerrit | Julien Danjou proposed openstack/tooz: Use overtest to setup daemons https://review.openstack.org/279611 | 16:32 |
| openstackgerrit | Julien Danjou proposed openstack/tooz: Compute requires_beating https://review.openstack.org/279651 | 16:32 |
| openstackgerrit | Julien Danjou proposed openstack/tooz: Use overtest to setup daemons https://review.openstack.org/279611 | 16:36 |
| openstackgerrit | Julien Danjou proposed openstack/tooz: Compute requires_beating https://review.openstack.org/279651 | 16:36 |
| *** pblaho has quit IRC | 16:36 | |
| *** browne has joined #openstack-oslo | 16:36 | |
| *** yottatsa has quit IRC | 16:38 | |
| *** yottatsa has joined #openstack-oslo | 16:39 | |
| *** yottatsa has quit IRC | 16:40 | |
| openstackgerrit | Julien Danjou proposed openstack/tooz: Compute requires_beating https://review.openstack.org/279651 | 16:47 |
| *** yottatsa has joined #openstack-oslo | 16:53 | |
| *** yamamot__ has quit IRC | 16:59 | |
| *** yamamoto_ has joined #openstack-oslo | 17:00 | |
| *** rlrossit has quit IRC | 17:09 | |
| *** MVenesio has quit IRC | 17:09 | |
| *** rlrossit has joined #openstack-oslo | 17:09 | |
| *** yamahata has quit IRC | 17:10 | |
| *** rlrossit_ has joined #openstack-oslo | 17:10 | |
| *** yottatsa has quit IRC | 17:12 | |
| *** yottatsa has joined #openstack-oslo | 17:13 | |
| *** rlrossit has quit IRC | 17:14 | |
| *** openstackgerrit has quit IRC | 17:17 | |
| *** openstackgerrit has joined #openstack-oslo | 17:17 | |
| *** browne has quit IRC | 17:20 | |
| *** yamahata has joined #openstack-oslo | 17:29 | |
| *** amotoki has quit IRC | 17:31 | |
| *** achanda has joined #openstack-oslo | 17:38 | |
| *** MVenesio has joined #openstack-oslo | 17:39 | |
| *** MVenesio has quit IRC | 17:39 | |
| *** achanda has quit IRC | 17:39 | |
| *** achanda has joined #openstack-oslo | 17:40 | |
| *** achanda has quit IRC | 17:41 | |
| *** achanda has joined #openstack-oslo | 17:42 | |
| *** achanda has quit IRC | 17:43 | |
| *** mriedem_meeting is now known as mriedem | 17:53 | |
| *** achanda has joined #openstack-oslo | 17:54 | |
| *** ihrachys has quit IRC | 17:56 | |
| *** ihrachys has joined #openstack-oslo | 17:57 | |
| *** ihrachys has quit IRC | 17:57 | |
| *** links has quit IRC | 17:58 | |
| *** browne has joined #openstack-oslo | 17:59 | |
| *** MVenesio has joined #openstack-oslo | 18:02 | |
| *** dimtruck is now known as zz_dimtruck | 18:05 | |
| *** achanda has quit IRC | 18:06 | |
| *** terryw is now known as otherwiseguy | 18:14 | |
| *** amotoki has joined #openstack-oslo | 18:14 | |
| *** salv-orlando has joined #openstack-oslo | 18:16 | |
| *** yassine has quit IRC | 18:18 | |
| *** gordc has quit IRC | 18:19 | |
| *** e0ne has joined #openstack-oslo | 18:20 | |
| *** mhickey has joined #openstack-oslo | 18:24 | |
| *** openstack has joined #openstack-oslo | 18:25 | |
| *** harlowja_at_home has joined #openstack-oslo | 18:26 | |
| *** achanda has joined #openstack-oslo | 18:30 | |
| *** lucasagomes is now known as lucas-afk | 18:41 | |
| *** vilobhmm11 has joined #openstack-oslo | 18:41 | |
| *** e0ne has quit IRC | 18:44 | |
| *** rlrossit_ has quit IRC | 18:45 | |
| *** openstackgerrit has quit IRC | 18:47 | |
| *** openstackgerrit has joined #openstack-oslo | 18:47 | |
| openstackgerrit | Merged openstack/oslo.log: stop making a copy of options discovered by config generator https://review.openstack.org/278607 | 18:49 |
| openstackgerrit | Merged openstack/oslo.log: remove pypy from default tox environment list https://review.openstack.org/278608 | 18:49 |
| *** mhickey has quit IRC | 18:56 | |
| openstackgerrit | Brant Knudson proposed openstack/oslo-specs: policy: Support YAML https://review.openstack.org/279725 | 18:59 |
| dims | dhellmann : have you seen this? http://logs.openstack.org/23/272823/3/check/gate-oslotest-python27/14402ea/testr_results.html.gz | 19:01 |
| dims | dhellmann : not sure what changed underneath us to cause that test to break | 19:01 |
| dhellmann | dims : no, I hadn't seen that | 19:02 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/oslo.service: Updated from global requirements https://review.openstack.org/278717 | 19:03 |
| dhellmann | dims : I'll poke at it a bit | 19:03 |
| dims | dhellmann : thanks! | 19:03 |
| openstackgerrit | Merged openstack/oslo.db: stop making a copy of options discovered by config generator https://review.openstack.org/278610 | 19:04 |
| *** mhickey has joined #openstack-oslo | 19:10 | |
| *** zz_dimtruck is now known as dimtruck | 19:10 | |
| openstackgerrit | Doug Hellmann proposed openstack/oslotest: move unit tests into the oslotest package https://review.openstack.org/279727 | 19:10 |
| openstackgerrit | Doug Hellmann proposed openstack/oslotest: add mock.stopall cleanup in setUp not init https://review.openstack.org/279728 | 19:10 |
| dhellmann | dims : it looks like a behavior change in the base class maybe. ^^ fixes it | 19:10 |
| dims | ah that was easy :) | 19:13 |
| dims | thanks dhellmann | 19:13 |
| dims | rbradfor : looks like oslo.config has accumulated code, do you want to request a release? http://paste.openstack.org/show/486877/ | 19:17 |
| dims | dukhlov : ozamiatin : one of you want to request a oslo.messaging release please? | 19:18 |
| dims | boris-42 : how about a osprofiler release? | 19:19 |
| *** rlrossit has joined #openstack-oslo | 19:20 | |
| openstackgerrit | Andy Smith proposed openstack/devstack-plugin-amqp1: Set oslo_messaging-amqp section for qpid user https://review.openstack.org/279736 | 19:27 |
| *** dtardivel has quit IRC | 19:28 | |
| *** yottatsa has quit IRC | 19:30 | |
| dhellmann | rbradfor, dims : it would be nice to get my generator override feature into this oslo.config release, if it's going to be our last | 19:31 |
| *** sputnik13 has joined #openstack-oslo | 19:31 | |
| dims | dhellmann : y, trying to get all the code out the door. leave just g-r updates for the last minute | 19:31 |
| dhellmann | dims : yep | 19:32 |
| *** yamamoto_ has quit IRC | 19:34 | |
| dims | lifeless : Nakato : pbr release please? | 19:34 |
| *** sputnik13 has quit IRC | 19:37 | |
| openstackgerrit | Doug Hellmann proposed openstack/oslo.config: add generator hook for apps to update option defaults https://review.openstack.org/278604 | 19:39 |
| dhellmann | rbradfor : fixed ^^ | 19:39 |
| *** sdague has quit IRC | 19:42 | |
| *** kashyap has quit IRC | 19:45 | |
| *** edmondsw has quit IRC | 19:46 | |
| *** ozamiatin_ has joined #openstack-oslo | 19:51 | |
| *** sdague has joined #openstack-oslo | 19:51 | |
| *** kashyap has joined #openstack-oslo | 19:51 | |
| *** browne has quit IRC | 19:52 | |
| *** ozamiatin_ has quit IRC | 19:55 | |
| *** achanda has quit IRC | 20:04 | |
| *** mss-4_ has joined #openstack-oslo | 20:06 | |
| *** mss-4 has quit IRC | 20:09 | |
| *** achanda has joined #openstack-oslo | 20:10 | |
| *** mriedem has quit IRC | 20:12 | |
| stevemar | dims: dhellmann question about the oslo.db engine facade stuff | 20:13 |
| stevemar | dims: dhellmann i noticed the old method is deprecated, when will it be removed? | 20:13 |
| * dhellmann looks at rpodolyaka | 20:13 | |
| *** mriedem has joined #openstack-oslo | 20:13 | |
| *** edmondsw has joined #openstack-oslo | 20:21 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/oslo.messaging: Updated from global requirements https://review.openstack.org/279776 | 20:29 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/taskflow: Updated from global requirements https://review.openstack.org/279778 | 20:31 |
| *** MVenesio has quit IRC | 20:41 | |
| *** sdague has quit IRC | 20:41 | |
| *** yamamoto_ has joined #openstack-oslo | 20:48 | |
| *** nkrinner has quit IRC | 20:49 | |
| *** yamamoto_ has quit IRC | 20:52 | |
| dhellmann | dims, lifeless : it looks like the oslotest base class issue is caused by something resetting the list of cleanups after the test constructor is called | 20:56 |
| dhellmann | ah, testtools.TestCase.run does | 20:56 |
| *** ericksonsantos has quit IRC | 21:01 | |
| rbradfor | dhellmann, dims I agreed with doug to get this set defaults change in | 21:02 |
| *** salv-orlando has quit IRC | 21:03 | |
| rbradfor | dims, can look at https://review.openstack.org/#/c/278604/2 again! | 21:03 |
| dims | rbradfor : y, in just a little bit | 21:06 |
| *** jecarey_ has quit IRC | 21:18 | |
| *** yamamoto_ has joined #openstack-oslo | 21:18 | |
| *** ozamiatin_ has joined #openstack-oslo | 21:22 | |
| *** yamamoto_ has quit IRC | 21:22 | |
| *** ozamiatin_ has quit IRC | 21:24 | |
| dims | rbradfor : dhellmann : +2A | 21:26 |
| dhellmann | dims : this oslotest thing has me stumped | 21:26 |
| dims | dhellmann : no worries, we can deal with it early next week | 21:27 |
| *** mhickey has quit IRC | 21:28 | |
| dhellmann | dims : I think we're going to need to get lifeless in on it, to figure out how to force that cleanup to be first | 21:30 |
| *** rlrossit has quit IRC | 21:32 | |
| dims | dhellmann : +1 | 21:32 |
| *** kgiusti has left #openstack-oslo | 21:33 | |
| dhellmann | dims : do you have a bug filed? | 21:35 |
| stevemar | dhellmann: is rpodolyaka the oslo.db guru? | 21:36 |
| dhellmann | stevemar : one of, yes | 21:36 |
| stevemar | dhellmann: i just want to make sure we can fix the engine facade deprecation warning in N instead of M | 21:37 |
| stevemar | it is rather chatty though :\ | 21:37 |
| stevemar | and migrating away from is doesn't seem all that simple | 21:37 |
| dhellmann | stevemar : sure. I don't know the plan there, but rpodolyaka ought to be able to help you out. | 21:37 |
| stevemar | dhellmann: cool, i await his/her reply | 21:38 |
| dhellmann | stevemar : roman (he) | 21:38 |
| stevemar | neat | 21:39 |
| *** bauwser is now known as bauzas | 21:41 | |
| openstackgerrit | Doug Hellmann proposed openstack/oslotest: add mock.stopall cleanup in setUp not init https://review.openstack.org/279728 | 21:42 |
| -openstackstatus- NOTICE: The infrastructure team is taking gerrit offline for maintenance this afternoon, beginning at 22:00 utc. We should have it back online around 23:00 utc. http://lists.openstack.org/pipermail/openstack-dev/2016-February/086195.html | 21:46 | |
| *** achanda has quit IRC | 21:46 | |
| *** yamamoto_ has joined #openstack-oslo | 21:48 | |
| *** nikhil has quit IRC | 21:48 | |
| harlowja_at_home | dims, if u get any time can u look over https://review.openstack.org/#/q/status:open+project:openstack/taskflow+branch:master+topic:wbe-cleanups | 21:51 |
| harlowja_at_home | rackspace folks i think would like to get some of those merged (if possible) | 21:51 |
| dims | harlowja_at_home : ack will do | 21:51 |
| harlowja_at_home | thx :) | 21:51 |
| *** yamamoto_ has quit IRC | 21:52 | |
| *** ndipanov has quit IRC | 21:56 | |
| *** achanda has joined #openstack-oslo | 21:57 | |
| -openstackstatus- NOTICE: Gerrit is offline for maintenacne until 23:00 utc | 22:05 | |
| *** ChanServ changes topic to "Gerrit is offline for maintenacne until 23:00 utc" | 22:05 | |
| *** vilobhmm11 has quit IRC | 22:06 | |
| *** browne has joined #openstack-oslo | 22:06 | |
| *** mriedem has quit IRC | 22:09 | |
| *** vilobhmm11 has joined #openstack-oslo | 22:09 | |
| *** vilobhmm11 has quit IRC | 22:10 | |
| *** vilobhmm11 has joined #openstack-oslo | 22:10 | |
| *** pradk has quit IRC | 22:16 | |
| *** mtanino has quit IRC | 22:25 | |
| *** mtanino has joined #openstack-oslo | 22:25 | |
| *** eliqiao_ has quit IRC | 22:26 | |
| *** eliqiao_ has joined #openstack-oslo | 22:27 | |
| *** achanda has quit IRC | 22:41 | |
| *** edmondsw has quit IRC | 22:43 | |
| *** yamamoto_ has joined #openstack-oslo | 22:48 | |
| *** _amrith_ is now known as amrith | 22:52 | |
| *** yamamoto_ has quit IRC | 22:52 | |
| -openstackstatus- NOTICE: Gerrit is offline for maintenance, ETA updated to 23:30 utc | 23:06 | |
| *** ChanServ changes topic to "Gerrit is offline for maintenance, ETA updated to 23:30 utc" | 23:07 | |
| *** lucas-afk is now known as lucasagomes | 23:08 | |
| *** andymaier has joined #openstack-oslo | 23:09 | |
| *** nikhil has joined #openstack-oslo | 23:12 | |
| *** nikhil has quit IRC | 23:13 | |
| *** nikhil has joined #openstack-oslo | 23:15 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 23:22 | |
| *** leakypipes has quit IRC | 23:23 | |
| *** vilobhmm11 has quit IRC | 23:26 | |
| *** vilobhmm11 has joined #openstack-oslo | 23:26 | |
| *** vilobhmm11 has quit IRC | 23:27 | |
| *** vilobhmm11 has joined #openstack-oslo | 23:27 | |
| *** dentures has quit IRC | 23:29 | |
| *** yamamoto_ has joined #openstack-oslo | 23:33 | |
| *** achanda has joined #openstack-oslo | 23:36 | |
| *** yamamoto_ has quit IRC | 23:37 | |
| *** lucasagomes is now known as lucas-afk | 23:37 | |
| -openstackstatus- NOTICE: Gerrit is offline for maintenance, ETA updated to 23:59 utc | 23:41 | |
| *** ChanServ changes topic to "Gerrit is offline for maintenance, ETA updated to 23:59 utc" | 23:41 | |
| *** salv-orlando has joined #openstack-oslo | 23:44 | |
| *** achanda has quit IRC | 23:48 | |
| *** salv-orlando has quit IRC | 23:53 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!