| *** skamithi13 has quit IRC | 00:18 | |
| *** skamithi13 has joined #openstack-astara | 00:45 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/astara: Updated from global requirements https://review.openstack.org/305564 | 01:51 |
|---|---|---|
| *** cleverdevil- has joined #openstack-astara | 03:31 | |
| *** cleverdevil has quit IRC | 03:32 | |
| *** dhellmann has quit IRC | 03:32 | |
| *** cleverdevil- is now known as cleverdevil | 03:32 | |
| *** dhellmann has joined #openstack-astara | 04:05 | |
| *** jordantardif1 has joined #openstack-astara | 05:25 | |
| *** jordantardif has quit IRC | 05:28 | |
| *** davidlenwell has quit IRC | 05:44 | |
| *** davidlenwell has joined #openstack-astara | 05:46 | |
| openstackgerrit | Merged openstack/astara: Updated from global requirements https://review.openstack.org/305564 | 05:52 |
| *** ronis_ has joined #openstack-astara | 06:38 | |
| *** ronis__ has joined #openstack-astara | 06:59 | |
| *** davidlenwell_ has joined #openstack-astara | 07:01 | |
| *** ronis_ has quit IRC | 07:04 | |
| *** davidlenwell has quit IRC | 07:04 | |
| *** pcaruana has joined #openstack-astara | 07:31 | |
| *** openstackgerrit has quit IRC | 08:08 | |
| *** reedip is now known as outofmemory | 08:14 | |
| *** openstackgerrit has joined #openstack-astara | 08:18 | |
| *** openstack has quit IRC | 11:51 | |
| *** openstack has joined #openstack-astara | 11:53 | |
| *** skamithi14 has joined #openstack-astara | 12:04 | |
| *** skamithi13 has quit IRC | 12:06 | |
| *** busterswt has joined #openstack-astara | 12:15 | |
| *** busterswt has quit IRC | 12:28 | |
| *** busterswt has joined #openstack-astara | 12:32 | |
| *** justinlund has joined #openstack-astara | 13:15 | |
| *** ronis__ has quit IRC | 13:59 | |
| *** pcaruana has quit IRC | 15:06 | |
| *** markmcclain has quit IRC | 15:13 | |
| *** bustersw_ has joined #openstack-astara | 15:16 | |
| *** jordantardif has joined #openstack-astara | 15:16 | |
| *** drwahl_ has joined #openstack-astara | 15:20 | |
| *** markmcclain has joined #openstack-astara | 15:20 | |
| *** davidlenwell has joined #openstack-astara | 15:24 | |
| *** busterswt has quit IRC | 15:25 | |
| *** davidlenwell_ has quit IRC | 15:25 | |
| *** jordantardif1 has quit IRC | 15:25 | |
| *** dhellmann has quit IRC | 15:25 | |
| *** drwahl has quit IRC | 15:25 | |
| *** dhellmann has joined #openstack-astara | 15:26 | |
| *** ronis__ has joined #openstack-astara | 15:29 | |
| stupidnic | I am wondering if somebody can help me with something... | 15:42 |
| stupidnic | I know that we are supposed to have a VXLAN interface on the console, but after a reboot I am not seeing it, and that is causing issues with Astara | 15:42 |
| stupidnic | Is Astara supposed to create that interface? | 15:43 |
| *** skamithi14 has quit IRC | 15:44 | |
| *** skamithi13 has joined #openstack-astara | 15:45 | |
| *** jordant has joined #openstack-astara | 15:50 | |
| *** jordantardif has quit IRC | 15:51 | |
| *** jordant has quit IRC | 15:51 | |
| *** jordant has joined #openstack-astara | 15:51 | |
| *** bustersw_ has quit IRC | 16:08 | |
| *** busterswt has joined #openstack-astara | 16:08 | |
| *** jordant has quit IRC | 16:13 | |
| *** jordant has joined #openstack-astara | 16:14 | |
| *** jordant has quit IRC | 16:27 | |
| stupidnic | markmcclain: sorry... I a bit desparate here... the vxlan interface for the service network isn't being created on the controller after a reboot. I am pretty sure this is the job of linuxbridge_agent... but nothing in the logs | 16:28 |
| stupidnic | so Astara can't talk to the routers | 16:29 |
| *** jordantardif has joined #openstack-astara | 16:29 | |
| *** skamithi13 has quit IRC | 16:30 | |
| markmcclain | stupidnic: hmmm... it's the orchestrator's job to create the tap device and the linuxbridge agent's job to add it to the bridge | 16:33 |
| stupidnic | markmcclain: okay... I see the tap | 16:34 |
| markmcclain | stupidnic: if the tap is there... the agent should wire it | 16:34 |
| markmcclain | does neutron think the tap is bound? | 16:35 |
| stupidnic | Device tap0bdd910d-8b not defined on plugin | 16:35 |
| stupidnic | I am not sure what that is telling me though | 16:35 |
| stupidnic | Got it | 16:39 |
| stupidnic | So apparently there were two ports plugged into the service network of type ASTARA:RUG:SERVICE | 16:40 |
| stupidnic | one with the main IP (:1) and another with :69 | 16:41 |
| stupidnic | I deleted the one. | 16:42 |
| stupidnic | I delete the :69 one | 16:43 |
| stupidnic | Hmmm this is still wrecked. Astara is trying to pull an address other than the :1 address and because the router instances are hard coded to look for that address they aren't being acked as up and running | 16:49 |
| stupidnic | I am going to delete the service network and add it back | 16:49 |
| markmcclain | the newer code isn't dependent on :1 as the orchestrator address | 16:59 |
| markmcclain | stupidnic: I thought you were running mitaka everything | 16:59 |
| stupidnic | No. Liberty | 16:59 |
| stupidnic | I am getting | 16:59 |
| markmcclain | oh liberty orchestrator | 17:00 |
| stupidnic | No route to host | 17:00 |
| stupidnic | for the ipv6 addresses of the routers | 17:00 |
| markmcclain | hmmm if you have local addr and the tap isn't added to the bridge ND failure will yield that answer | 17:01 |
| stupidnic | I have the vxlan interface now | 17:02 |
| stupidnic | I show that the brq is there and is connecting the tap to the vxlan | 17:03 |
| markmcclain | what's in the neighbor table? UNREACHABLES? | 17:05 |
| stupidnic | how do I check that? | 17:06 |
| stupidnic | I am doing a tcpdump on the compute nodes that already have a vxlan-10 interface on them and I can see that there is neighbor solicitation coming through, but nothing else. | 17:16 |
| *** jordantardif1 has joined #openstack-astara | 17:19 | |
| *** ronis_ has joined #openstack-astara | 17:23 | |
| stupidnic | I am completely lost now... in the weeds.... I am seeing NeutronClientException: Authentication required on the nova compute nodes now | 17:23 |
| *** jordantardif has quit IRC | 17:27 | |
| *** ronis__ has quit IRC | 17:27 | |
| *** dhellmann has quit IRC | 17:27 | |
| *** markmcclain has quit IRC | 17:27 | |
| *** drwahl_ has quit IRC | 17:27 | |
| *** openstackgerrit has quit IRC | 17:27 | |
| *** cleverdevil has quit IRC | 17:27 | |
| *** cleverdevil has joined #openstack-astara | 17:33 | |
| *** dhellmann has joined #openstack-astara | 17:44 | |
| *** openstackgerrit has joined #openstack-astara | 17:48 | |
| *** dhellmann has quit IRC | 17:50 | |
| *** dhellmann has joined #openstack-astara | 17:55 | |
| *** markmcclain has joined #openstack-astara | 17:56 | |
| *** dhellmann has quit IRC | 17:57 | |
| stupidnic | markmcclain: just an update. I finally have it working again. | 18:01 |
| stupidnic | When I deleted the management network I needed to restart linuxbridge and nova-compute on the compute nodes to get them to work with the new management network | 18:01 |
| stupidnic | I still don't understand why Astara created a new ASTARA:RUG:SERVICE port on the management network in the first place. | 18:02 |
| *** drwahl has joined #openstack-astara | 18:05 | |
| markmcclain | kind of crazy you had to restart nova since it knows nothing about the management network | 18:07 |
| markmcclain | did the hostname change by chance? | 18:07 |
| markmcclain | if changes the orchestrator does not have a good way to retrieve the last used service port | 18:08 |
| stupidnic | markmcclain: that's EXACTLY what we did | 18:09 |
| stupidnic | man... if I had known what a nightmare that would have turned into, I would have changed the other hostname :) | 18:10 |
| stupidnic | markmcclain: We restarted nova-compute mainly as a precaution (restart all the things!) | 18:12 |
| stupidnic | Okay. So for those keeping score at home. hostname changes are bad... not only did it negatively impact Astara, it also negatively impacted RabbitMQ as well | 18:13 |
| markmcclain | stupidnic: yeah sorry it's such a royal pain to change hostname | 18:20 |
| stupidnic | markmcclain: no problem, hard won knowledge is the best | 18:20 |
| stupidnic | I certainly won't be forgetting it anytime soon | 18:20 |
| *** jordantardif has joined #openstack-astara | 19:19 | |
| *** drwahl has quit IRC | 19:22 | |
| *** jordantardif1 has quit IRC | 19:22 | |
| *** drwahl has joined #openstack-astara | 19:43 | |
| *** justinlund1 has joined #openstack-astara | 20:36 | |
| *** justinlund has quit IRC | 20:38 | |
| *** thingee has joined #openstack-astara | 21:00 | |
| thingee | ryanpetrello: hey the Astara fish bowl session is still marked as TBD. Can you please update that today with a title and description? | 21:01 |
| *** ronis_ has quit IRC | 21:55 | |
| *** busterswt has quit IRC | 21:56 | |
| ryanpetrello | thingee: yep, working on it as we speak | 22:22 |
| *** busterswt has joined #openstack-astara | 23:46 | |
| *** busterswt has quit IRC | 23:50 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!