| *** marst has joined #openstack-ansible | 00:38 | |
| *** BjoernT has joined #openstack-ansible | 00:41 | |
| *** BjoernT has quit IRC | 00:55 | |
| *** DanyC has joined #openstack-ansible | 01:10 | |
| *** DanyC has quit IRC | 01:14 | |
| cloudnull | mnaser when using centos, https://spacewalkproject.github.io/ might be of some assistance, however spacewalk on its own comes with some decent overhead | 02:20 |
|---|---|---|
| cloudnull | on the ubuntu side landscape is half way decent, though not exactly cheap | 02:21 |
| mnaser | cloudnull: oh god i tried spacewalk once and i think the deployment of it drove me nuts | 02:21 |
| cloudnull | ++ | 02:21 |
| * cloudnull has had similar experiences | 02:21 | |
| cloudnull | ubuntu has auto-updates config, may be of some use ? | 02:22 |
| mnaser | i just wrote some ansible playbooks that evacuate host, check no more vms are running, update, reboot, go onto the next | 02:22 |
| mnaser | and it inventories things first to start with the oldest machines so you dont have a set of 'hot' always recently updated machines and a bunch that lag behind | 02:22 |
| cloudnull | an that sounds awesome | 02:23 |
| cloudnull | **ah | 02:23 |
| mnaser | always having fun | 02:24 |
| cloudnull | how are things otherwise? | 02:25 |
| mnaser | everything humming along. pre-summit keeps me busy :) | 02:25 |
| mnaser | and with a few more hats its .. more busy! | 02:25 |
| * mnaser wants to try setting up awx somewhere at some point | 02:26 | |
| mnaser | cloudnull: making it out to denver? or dont know yet? | 02:26 |
| *** marst has quit IRC | 02:26 | |
| mnaser | if so http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003737.html | 02:26 |
| mnaser | and cc spotz i think i got a ping but never got to it | 02:27 |
| cloudnull | mnaser idk yet. | 02:28 |
| cloudnull | sadly . | 02:28 |
| cloudnull | trying to though | 02:29 |
| mnaser | ah.. lets hope you make it out | 02:29 |
| cloudnull | ++ | 02:30 |
| mnaser | we need a texas summit again | 02:30 |
| mnaser | that bbq looks so good all the time | 02:30 |
| cloudnull | ++ its getting better. | 02:31 |
| cloudnull | My brisket this evening was the best one I've made yet. | 02:32 |
| cloudnull | not perfect though | 02:32 |
| cloudnull | going to have to make a few more to really nail it down ;) | 02:33 |
| *** BjoernT has joined #openstack-ansible | 02:49 | |
| *** cmart has joined #openstack-ansible | 03:03 | |
| *** cmart has quit IRC | 03:11 | |
| *** BjoernT has quit IRC | 03:33 | |
| cloudnull | curious if anyone has seen this in the gates, https://pasted.tech/pastes/0f2b33b121b0bc9b17bc82181c4c734d8cb503af - rabbitmq connection issues in various services. rabbitmq itself seems fine, however, service interactions have been generally busted. | 04:42 |
| cloudnull | ^ running the HEAD of master | 04:42 |
| cloudnull | other logs from the scheduler - https://pasted.tech/pastes/44b8a4f326001ff48b0991aa201830cc694a879a | 04:47 |
| cloudnull | and a simple test script shows that im able to connect to rabbit without issues | 04:49 |
| cloudnull | https://pasted.tech/pastes/a9c93841bd16cbd6c3051b6c143716a20da22495 | 04:49 |
| cloudnull | so idk ... | 04:50 |
| cloudnull | https://pasted.tech/pastes/7f03e4cb5cec2a7d15344d5ca62cbcbfd47187d7 - test script if anyone is curious | 04:50 |
| cloudnull | interesting - [u'amqp://nova:605b25c34df667e4231c87fcac5119@172.16.26.129:5671//nova']: this is what nova is parsing | 05:08 |
| cloudnull | shouldn't that connection prefix be rabbit:// | 05:09 |
| cloudnull | ? | 05:09 |
| cloudnull | https://github.com/openstack/oslo.messaging/blob/master/oslo_messaging/_drivers/impl_rabbit.py#L592 - I guess not... | 05:12 |
| cloudnull | looks like it all recently changed (6 mo ago) https://github.com/openstack/oslo.messaging/commit/b0d3bfceb8ea5d2574651e24e347be55f63c3fca - maybe we've just not had this issue or maybe this is all totally unrelated. | 05:14 |
| *** noonedeadpunk has quit IRC | 05:17 | |
| *** noonedeadpunk has joined #openstack-ansible | 05:19 | |
| cloudnull | may be a red harring, maybe im just tired :) | 05:21 |
| cloudnull | welp, for anyone that has been following along at home: it turns out that the rabbit connection string is actual stored in the nova_api db ... | 05:47 |
| cloudnull | https://pasted.tech/pastes/09b13478ca0dddd56b0779ee42f35a6a318a4d33 | 05:47 |
| cloudnull | so if a rabbitmq node is move/replaced/re-ip'd this becomes an issue | 05:47 |
| cloudnull | wasy to fix, https://pasted.tech/pastes/70d8082545a807b160e2d9192919a07aa19561dd , miserable to diagnose . | 05:48 |
| cloudnull | TIL :) | 05:49 |
| cloudnull | frustratingly it looks like the transport_url is also stored in the nova_api db within a request spec: https://pasted.tech/pastes/d0c542c565335e361d8264d8b50e81d23144067b - so those need to be purged too... | 06:02 |
| cloudnull | again, easy to fix - https://pasted.tech/pastes/b436bcf1ecb45333d2eb8bc890f2f9eab6baaee1 - but miserable to diagnose. | 06:03 |
| cloudnull | it may be worth our while to talk to the nova folks to see what we can do to make some of that better? | 06:03 |
| *** maxbab has joined #openstack-ansible | 06:21 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata https://review.openstack.org/643730 | 06:58 |
| *** DanyC has joined #openstack-ansible | 07:32 | |
| *** DanyC has quit IRC | 08:10 | |
| *** gkadam has joined #openstack-ansible | 08:16 | |
| *** hamzaachi has joined #openstack-ansible | 08:30 | |
| *** simon-AS559 has joined #openstack-ansible | 10:19 | |
| *** nicolasbock has joined #openstack-ansible | 10:40 | |
| *** hamzaachi has joined #openstack-ansible | 11:06 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Fix connectivity between octavia and amphorae. https://review.openstack.org/643659 | 11:35 |
| *** simon-AS559 has quit IRC | 12:12 | |
| *** phasespace has joined #openstack-ansible | 12:46 | |
| *** simon-AS559 has joined #openstack-ansible | 12:49 | |
| *** ivve has quit IRC | 13:18 | |
| *** dave-mccowan has joined #openstack-ansible | 13:20 | |
| *** ivve has joined #openstack-ansible | 13:43 | |
| *** luksky has joined #openstack-ansible | 13:52 | |
| *** dave-mccowan has quit IRC | 14:03 | |
| *** vollman has quit IRC | 14:06 | |
| *** maxbab has quit IRC | 14:35 | |
| *** hamzaachi has quit IRC | 14:36 | |
| *** simon-AS559 has quit IRC | 14:44 | |
| *** hamzaachi has joined #openstack-ansible | 14:44 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Fix bashate https://review.openstack.org/643300 | 14:49 |
| openstackgerrit | Merged openstack/openstack-ansible master: Imported Translations from Zanata https://review.openstack.org/643730 | 14:49 |
| *** hamzaachi has quit IRC | 15:15 | |
| *** dave-mccowan has joined #openstack-ansible | 15:47 | |
| *** hamzaachi has joined #openstack-ansible | 16:00 | |
| *** gkadam_ has joined #openstack-ansible | 16:02 | |
| *** gkadam has quit IRC | 16:05 | |
| *** gkadam_ has quit IRC | 16:10 | |
| *** dave-mccowan has quit IRC | 16:33 | |
| *** hamzaachi has quit IRC | 17:00 | |
| *** hamzaachi has joined #openstack-ansible | 17:03 | |
| *** hamzaachi has quit IRC | 18:26 | |
| *** Haunted330 has joined #openstack-ansible | 18:36 | |
| *** Haunted330 has left #openstack-ansible | 18:36 | |
| *** Haunted330 has joined #openstack-ansible | 18:40 | |
| *** simon-AS559 has joined #openstack-ansible | 18:41 | |
| *** Haunted330 has quit IRC | 18:45 | |
| *** DanyC has joined #openstack-ansible | 18:57 | |
| *** DanyC has quit IRC | 19:14 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-ops master: Fix plugins loading in embedded ansible https://review.openstack.org/643758 | 19:34 |
| *** hamzaachi has joined #openstack-ansible | 21:07 | |
| *** marst has joined #openstack-ansible | 22:01 | |
| *** DanyC has joined #openstack-ansible | 22:33 | |
| *** luksky has quit IRC | 22:39 | |
| *** hamzaachi has quit IRC | 22:40 | |
| *** marst has quit IRC | 22:41 | |
| DimGR | hi | 23:01 |
| *** simon-AS559 has quit IRC | 23:57 | |
| *** shyamb has joined #openstack-ansible | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!