| *** tosky has quit IRC | 00:00 | |
| *** gildub has joined #openstack-sdks | 00:20 | |
| *** d0ugal__ has joined #openstack-sdks | 00:27 | |
| gtmanfred | ok, maybe tomorrow | 00:37 |
|---|---|---|
| *** d0ugal__ has quit IRC | 00:58 | |
| *** d0ugal__ has joined #openstack-sdks | 01:06 | |
| *** slaweq has joined #openstack-sdks | 01:11 | |
| openstackgerrit | Mark Kirkwood proposed openstack/python-openstackclient master: Add an option to container create for storage policy https://review.openstack.org/564665 | 01:13 |
| *** slaweq has quit IRC | 01:16 | |
| *** salv-orlando has joined #openstack-sdks | 01:31 | |
| *** thrash is now known as thrash|g0ne | 01:34 | |
| *** salv-orlando has quit IRC | 01:36 | |
| *** d0ugal__ has quit IRC | 01:39 | |
| *** chenyb4 has joined #openstack-sdks | 02:08 | |
| *** dave-mccowan has joined #openstack-sdks | 02:11 | |
| *** chenyb4 has quit IRC | 02:42 | |
| *** slaweq has joined #openstack-sdks | 02:56 | |
| *** slaweq has quit IRC | 03:01 | |
| mnaser | it seems like providing 'key_manager_endpoint_override' doesn't seem to properly work in a connection? | 03:05 |
| *** d0ugal__ has joined #openstack-sdks | 03:06 | |
| *** d0ugal__ has quit IRC | 03:21 | |
| *** d0ugal__ has joined #openstack-sdks | 03:22 | |
| *** d0ugal__ has quit IRC | 03:29 | |
| *** salv-orlando has joined #openstack-sdks | 03:32 | |
| *** d0ugal__ has joined #openstack-sdks | 03:36 | |
| *** salv-orlando has quit IRC | 03:37 | |
| *** d0ugal__ has quit IRC | 03:47 | |
| *** lbragstad has joined #openstack-sdks | 03:49 | |
| *** gildub has quit IRC | 04:24 | |
| *** salv-orlando has joined #openstack-sdks | 04:33 | |
| *** salv-orlando has quit IRC | 04:37 | |
| *** dave-mccowan has quit IRC | 04:43 | |
| *** lbragstad has quit IRC | 04:51 | |
| openstackgerrit | XiaojueGuan proposed openstack/keystoneauth master: Trivial: Update pypi url to new url https://review.openstack.org/565418 | 04:59 |
| *** salv-orlando has joined #openstack-sdks | 05:01 | |
| *** salv-orlando has quit IRC | 05:02 | |
| *** slaweq has joined #openstack-sdks | 06:11 | |
| *** slaweq has quit IRC | 06:15 | |
| *** salv-orlando has joined #openstack-sdks | 07:04 | |
| *** jpich has joined #openstack-sdks | 07:04 | |
| *** salv-orlando has quit IRC | 07:09 | |
| *** salv-orlando has joined #openstack-sdks | 07:10 | |
| *** salv-orlando has quit IRC | 07:14 | |
| *** gildub has joined #openstack-sdks | 07:34 | |
| *** gkadam has joined #openstack-sdks | 07:45 | |
| *** slaweq has joined #openstack-sdks | 08:11 | |
| *** slaweq has quit IRC | 08:15 | |
| *** ralonsoh has joined #openstack-sdks | 08:37 | |
| *** d0ugal__ has joined #openstack-sdks | 08:57 | |
| *** d0ugal__ has quit IRC | 09:02 | |
| *** slaweq has joined #openstack-sdks | 09:07 | |
| *** cdent has joined #openstack-sdks | 09:08 | |
| *** slaweq has quit IRC | 09:22 | |
| *** slaweq has joined #openstack-sdks | 09:23 | |
| *** lifeless_ is now known as lifeless | 09:46 | |
| *** cdent has quit IRC | 09:50 | |
| *** gildub has quit IRC | 09:58 | |
| *** d0ugal has joined #openstack-sdks | 10:00 | |
| *** gildub has joined #openstack-sdks | 10:11 | |
| *** gtema has joined #openstack-sdks | 10:28 | |
| mordred | mnaser: no? | 10:36 |
| lifeless | mordred: ETIMEZONE | 10:36 |
| mordred | lifeless: so much E | 10:38 |
| mordred | wait - that implies the wrong thing :) | 10:38 |
| mordred | lifeless: also, o hai | 10:39 |
| *** gtema has quit IRC | 10:58 | |
| openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Defer all endpoint discovery to keystoneauth https://review.openstack.org/564494 | 11:00 |
| *** slaweq has quit IRC | 11:22 | |
| mnaser | mordred: I’ll paste what I have that’s not working for me. By looking over the code it seems that cloud region get_endpoint_session() uses the override however the normal adapter doesn’t seem to use it | 11:45 |
| mnaser | mordred: use case here is using sensu-plugins-python + openstacksdk for small integration monitoring tests | 11:45 |
| *** thrash|g0ne is now known as thrash | 11:48 | |
| *** slaweq has joined #openstack-sdks | 11:50 | |
| *** dave-mccowan has joined #openstack-sdks | 12:08 | |
| *** tosky has joined #openstack-sdks | 12:13 | |
| mordred | mnaser: seems like a good use case - I'm looking through the code to see if I can see where endpoint_override isn't getting passed ... | 12:19 |
| *** edmondsw has joined #openstack-sdks | 12:19 | |
| mordred | mnaser: ah. there it is. it's in the part where it's not getting passed | 12:20 |
| mnaser | mordred: currently doing this.. but it also feels a little dirty, i could be doing it the wrong way | 12:22 |
| mnaser | i didnt find a way to just connect to a region with overrides | 12:22 |
| mordred | yah - there'sa bug - patch coming | 12:22 |
| mnaser | (the reason i'm overriding is because i want to test the *local* instance using that monitoring agent rather than going through load balancer, etc) | 12:23 |
| mnaser | and cool thank you! | 12:23 |
| openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Honor endpoint_override for get_session_client https://review.openstack.org/565489 | 12:24 |
| mordred | mnaser: ^^ | 12:24 |
| mnaser | yay | 12:24 |
| mnaser | let me try and test that locally | 12:24 |
| mnaser | mordred: your patch is missing a , after 'endpoint_override=self.get_endpoint(service_key)' | 12:29 |
| mnaser | (before the **kwargs) | 12:29 |
| mnaser | and it also fixes the issue-- CheckBarbicanIntegration CRITICAL: Unable to establish connection to http://foobar/secrets: HTTPConnectionPool(host='foobar', port=80): Max retries exceeded with url: /secrets (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x30922d0>: Failed to establish a new connection: [Errno -2] Name or service not known',)) :D | 12:30 |
| mordred | mnaser: whoops | 12:32 |
| openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Honor endpoint_override for get_session_client https://review.openstack.org/565489 | 12:32 |
| mordred | Shrews: ^^ if you get a sec | 12:35 |
| *** slaweq has quit IRC | 12:47 | |
| *** crunchengine has joined #openstack-sdks | 13:05 | |
| *** slaweq has joined #openstack-sdks | 13:11 | |
| *** slaweq has quit IRC | 13:15 | |
| *** lbragstad has joined #openstack-sdks | 13:32 | |
| *** openstackgerrit has quit IRC | 13:34 | |
| *** tosky has quit IRC | 13:51 | |
| *** slaweq has joined #openstack-sdks | 13:52 | |
| *** slaweq has quit IRC | 13:53 | |
| *** slaweq has joined #openstack-sdks | 13:53 | |
| *** gtema has joined #openstack-sdks | 13:55 | |
| *** gtema has quit IRC | 14:15 | |
| mordred | Shrews: you may also enjoy https://review.openstack.org/549307 | 14:15 |
| mordred | slaweq: ^^ you may also enjoy both of those patches (or you might not :) ) | 14:15 |
| slaweq | mordred: looking | 14:15 |
| slaweq | :) | 14:15 |
| *** bobh has joined #openstack-sdks | 14:19 | |
| *** gildub has quit IRC | 14:19 | |
| *** bobh has quit IRC | 14:23 | |
| *** bobh has joined #openstack-sdks | 14:24 | |
| *** slaweq has quit IRC | 14:34 | |
| *** gkadam has quit IRC | 14:43 | |
| gtmanfred | mordred: ping | 14:57 |
| mordred | gtmanfred: hi! I'm about to be on a phone call for an hour - but then I'll be here | 14:59 |
| gtmanfred | awesome, thanks | 14:59 |
| mordred | gtmanfred: however, that race condition you mention should not exist on a reasonably modern openstack - we use the create-floaing-ip-with-server-port approach rather than the 'create-floating-ip-then-attach-to-server' approach which suffers from the race condition mentioned | 15:00 |
| mordred | if the cloud in quetsion does not expose the neutron endpoints needed to safely create floating ips in a multi-process or multi-threaded manner, we will fall back to create-and-attach | 15:01 |
| mordred | (this is all just backgound info) | 15:02 |
| gtmanfred | kk | 15:04 |
| gtmanfred | lemme check what they are running, it is older | 15:04 |
| mordred | yah- the pure nova api version of this is ... not great .. for the reasons listed in the story | 15:06 |
| gtmanfred | mordred: he is using mitaka | 15:10 |
| *** slaweq has joined #openstack-sdks | 15:11 | |
| mordred | hrm. that should be new enough | 15:12 |
| *** slaweq has quit IRC | 15:15 | |
| gtmanfred | I also think I tested with pike, and was running into the same problem. | 15:17 |
| gtmanfred | what it seems like the problem is, is that we are trying to use floating ips that have already been allocated | 15:18 |
| gtmanfred | and since multiple processes list all the available ips, and then pick one, multiple processes try to assign the same ip | 15:18 |
| gtmanfred | this is why we went with `create and assign by default. if there are no free ips, log a warning that we are going to be not multiprocess safe, because we need to list available ones and pick one from a list` | 15:19 |
| *** openstackgerrit has joined #openstack-sdks | 15:23 | |
| openstackgerrit | Hongbin Lu proposed openstack/openstacksdk master: Add 'port_details' to Floating IP https://review.openstack.org/533811 | 15:23 |
| mordred | yah. multi-process re-use of pre-existing floating ips is basically unpossible - without some sort of shared locking/brokering system | 15:23 |
| mordred | in nodepool (which does this process in many many parallel threads) - we make sure we delete floating ips when we delete servers - and also have a cleanup thread that deletes any unattached floating ips it finds | 15:24 |
| mordred | since if the create-with-server-port method is being used, there is no such thing as a validly unattached floating ip | 15:25 |
| gtmanfred | ok, i think what I am just going to do is change the default `reuse_ips` to False, and allow them to set it if they really really really really really really really really are dumb and want to use it | 15:25 |
| openstackgerrit | XiaojueGuan proposed openstack/keystoneauth master: Trivial: Update pypi url to new url https://review.openstack.org/565418 | 15:26 |
| *** gkadam has joined #openstack-sdks | 15:26 | |
| mordred | gtmanfred: yah | 15:26 |
| mordred | gtmanfred: so - that said - there is an option we can do | 15:27 |
| mordred | (it's on my list already = it's just deep down there and there's a few big ticket items we need to likely get done first) | 15:27 |
| mordred | task number 1 is to finish making the caching tier use dogpile.cache everywhere (servers, ports and floating ips are currently done manually if caching is enabled - and there are some tricky interactions as it relates to batched operations and thundering herd that we hvae to be careful about when fixing that) | 15:28 |
| mordred | but once we've got that, then we should be able to add in a locking/multi-process aware TaskManager (similar to the multithreaded TaskManager that's in nodepool right now) | 15:29 |
| mordred | and leverge dogpile for the shared locking | 15:29 |
| gtmanfred | :+1: | 15:29 |
| gtmanfred | Lemme know what I can help with, i need to figure out what to contribute to so I can go to berlin. | 15:30 |
| mordred | so if someone then wants to do multi-process with reuse_ips there will be a story for it | 15:30 |
| mordred | cool. I'll write up the above into a more consumable story that doesn't involve memories in my head and ping you with it | 15:30 |
| gtmanfred | that would be great | 15:30 |
| mordred | \o/ winning | 15:30 |
| *** jpich has quit IRC | 15:32 | |
| gtmanfred | other than that, the new shade cloud driver has gotten rave reviews, and everyone says it is much easier to configure and more reliable than what we had before | 15:34 |
| openstackgerrit | Merged openstack/openstacksdk master: Drop bogus attributes from network port resource https://review.openstack.org/565217 | 15:54 |
| *** tosky has joined #openstack-sdks | 16:02 | |
| *** ralonsoh has quit IRC | 16:20 | |
| *** pabelanger has left #openstack-sdks | 16:20 | |
| *** ralonsoh has joined #openstack-sdks | 16:36 | |
| *** tosky has quit IRC | 16:37 | |
| mordred | gtmanfred: yay! | 16:56 |
| *** e0ne has joined #openstack-sdks | 17:01 | |
| *** gkadam has quit IRC | 17:17 | |
| *** thrash is now known as thrash|biab | 17:26 | |
| *** ralonsoh has quit IRC | 17:47 | |
| *** slaweq has joined #openstack-sdks | 18:11 | |
| *** slaweq has quit IRC | 18:15 | |
| *** slaweq has joined #openstack-sdks | 19:11 | |
| *** slaweq has quit IRC | 19:15 | |
| *** e0ne has quit IRC | 19:19 | |
| gtmanfred | mordred: also, with the cache stuff for servers, it is about 10 times faster | 19:21 |
| mordred | yah. the cache stuff is really important - and the other thing is also about being able to enable at least in-memory caching by default | 19:23 |
| *** slaweq has joined #openstack-sdks | 19:50 | |
| *** bobh has quit IRC | 19:51 | |
| crunchengine | mordred: hello | 19:56 |
| mordred | crunchengine: hiya | 19:57 |
| crunchengine | I am listing active instances, but compute give me migrating instances too | 19:57 |
| crunchengine | self.conn.compute.servers(host=self.hostname, all_tenants=True, status="ACTIVE") | 19:57 |
| crunchengine | those instances are still active, from kvm point of view but the filter should be state consistent no ? | 19:58 |
| mordred | I dunno about the kvm POV - but the filter from a REST API perspective only knows about the value of teh status field. doesn't migration status show up in vm_state? | 19:59 |
| mordred | ah - sorry - progress | 19:59 |
| mordred | nope. thinking out loud - sorry :) | 19:59 |
| mordred | yah - I'd expect for the status of the vm to be 'MIGRATING' from looking at the api docs | 20:01 |
| crunchengine | print("uuid: {} status: {} task_state: {} vm_state: {}".format(i.id, i.status, i.task_state, i.vm_state)) | 20:01 |
| crunchengine | uuid: 5a562937-b0e2-4e67-8b2e-490cd44bbc3d status: MIGRATING task_state: migrating vm_state: active | 20:01 |
| crunchengine | too much state ! | 20:01 |
| mordred | right? | 20:01 |
| crunchengine | okay thanks ! | 20:01 |
| crunchengine | so naming is inconsistent too: return self.conn.compute.servers(host=self.hostname, all_tenants=True, status="ACTIVE") | 20:03 |
| crunchengine | status => vm_state in lowercase... | 20:03 |
| *** crunchengine has quit IRC | 20:55 | |
| *** edmondsw has quit IRC | 21:48 | |
| openstackgerrit | Merged openstack/keystoneauth master: Allow tuples and sets in interface list https://review.openstack.org/564495 | 21:58 |
| *** gildub has joined #openstack-sdks | 22:08 | |
| *** lbragstad has quit IRC | 22:22 | |
| *** thrash|biab is now known as thrash|g0ne | 22:30 | |
| *** lbragstad has joined #openstack-sdks | 22:46 | |
| *** slaweq has quit IRC | 22:46 | |
| *** slaweq has joined #openstack-sdks | 22:47 | |
| *** gildub has quit IRC | 23:17 | |
| *** slaweq has quit IRC | 23:27 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!