| *** achanda has quit IRC | 00:01 | |
| *** dane_leblanc has quit IRC | 00:10 | |
| *** jlcoello has joined #openstack-containers | 00:12 | |
| *** SourabhP has quit IRC | 00:14 | |
| *** Marga_ has quit IRC | 00:17 | |
| *** suro-patz has quit IRC | 00:22 | |
| *** Marga_ has joined #openstack-containers | 00:25 | |
| *** dimtruck is now known as zz_dimtruck | 00:28 | |
| *** vahidh has quit IRC | 00:31 | |
| *** Tango has quit IRC | 00:40 | |
| *** slagle has joined #openstack-containers | 00:47 | |
| *** dims_ has joined #openstack-containers | 00:48 | |
| *** zz_dimtruck is now known as dimtruck | 01:04 | |
| *** banix has joined #openstack-containers | 01:06 | |
| *** zhenguo has joined #openstack-containers | 01:09 | |
| *** Tango has joined #openstack-containers | 01:14 | |
| *** jlcoello has quit IRC | 01:14 | |
| *** jlcoello has joined #openstack-containers | 01:21 | |
| *** erkules_ has joined #openstack-containers | 01:21 | |
| *** puranamr has joined #openstack-containers | 01:22 | |
| *** Marga_ has quit IRC | 01:22 | |
| *** erkules has quit IRC | 01:24 | |
| *** jjfreric has joined #openstack-containers | 01:40 | |
| *** dave-mccowan has quit IRC | 01:40 | |
| openstackgerrit | Vilobh Meshram proposed openstack/magnum: WIP : Objects from Bay - Services https://review.openstack.org/223367 | 01:41 |
|---|---|---|
| openstackgerrit | Merged openstack/magnum: Add a link versioned object document https://review.openstack.org/222939 | 01:42 |
| openstackgerrit | Vilobh Meshram proposed openstack/magnum: WIP : Objects from Bay - Pods https://review.openstack.org/223367 | 01:42 |
| *** jjfreric has quit IRC | 01:44 | |
| openstackgerrit | Martin Falatic proposed openstack/magnum: If headerParams = None, don't use it to .update() https://review.openstack.org/223369 | 01:45 |
| *** vilobhmm_11 has quit IRC | 01:48 | |
| *** julim has joined #openstack-containers | 01:49 | |
| *** Marga_ has joined #openstack-containers | 01:49 | |
| *** puranamr has quit IRC | 01:53 | |
| *** eghobo has quit IRC | 02:11 | |
| *** dims_ has quit IRC | 02:11 | |
| *** harshs has quit IRC | 02:13 | |
| *** dave-mccowan has joined #openstack-containers | 02:13 | |
| *** harshs has joined #openstack-containers | 02:13 | |
| *** harshs has quit IRC | 02:17 | |
| *** dave-mccowan has quit IRC | 02:17 | |
| *** banix has quit IRC | 02:21 | |
| *** hongbin has joined #openstack-containers | 02:24 | |
| *** unicell has quit IRC | 02:26 | |
| *** achanda has joined #openstack-containers | 02:27 | |
| *** eliqiao has joined #openstack-containers | 02:37 | |
| *** sthillma has quit IRC | 02:44 | |
| *** adrian_otto has joined #openstack-containers | 02:44 | |
| *** banix has joined #openstack-containers | 02:47 | |
| *** ganeshna has joined #openstack-containers | 02:50 | |
| *** adrian_otto has quit IRC | 02:57 | |
| eliqiao | hongbin: ping | 02:59 |
| *** vilobhmm_11 has joined #openstack-containers | 02:59 | |
| openstackgerrit | Vilobh Meshram proposed openstack/magnum: WIP : Objects from Bay - Services https://review.openstack.org/223384 | 03:01 |
| *** shuquan has joined #openstack-containers | 03:05 | |
| *** dims_ has joined #openstack-containers | 03:12 | |
| *** madhuri has joined #openstack-containers | 03:12 | |
| *** hongbin has quit IRC | 03:13 | |
| *** hongbin has joined #openstack-containers | 03:13 | |
| *** dave-mccowan has joined #openstack-containers | 03:14 | |
| *** ganeshna_ has joined #openstack-containers | 03:18 | |
| *** dave-mccowan has quit IRC | 03:18 | |
| *** dims_ has quit IRC | 03:19 | |
| *** ganeshna has quit IRC | 03:20 | |
| *** ganeshna_ has quit IRC | 03:24 | |
| *** dimtruck has quit IRC | 03:26 | |
| *** ganeshna has joined #openstack-containers | 03:26 | |
| *** daneyon_ has joined #openstack-containers | 03:27 | |
| openstackgerrit | Vilobh Meshram proposed openstack/magnum: WIP : Objects from Bay - Replication Controller https://review.openstack.org/213368 | 03:28 |
| *** apmelton has quit IRC | 03:28 | |
| *** daneyon has quit IRC | 03:28 | |
| *** gus has quit IRC | 03:29 | |
| *** julim has quit IRC | 03:30 | |
| *** harshs has joined #openstack-containers | 03:30 | |
| *** gus has joined #openstack-containers | 03:31 | |
| *** apmelton has joined #openstack-containers | 03:31 | |
| *** dimtruck has joined #openstack-containers | 03:31 | |
| *** banix has quit IRC | 03:32 | |
| *** kebray has joined #openstack-containers | 03:32 | |
| *** kebray has quit IRC | 03:33 | |
| gus | huh, I thought "docker" was the main use case for Atomic - and yet this fedora-21-atomic-5 image has a completely broken docker daemon. | 03:34 |
| *** dimtruck is now known as zz_dimtruck | 03:35 | |
| * gus wonders what other testcases they're running against their images.. | 03:35 | |
| *** kebray has joined #openstack-containers | 03:38 | |
| *** zz_dimtruck has quit IRC | 03:39 | |
| *** suro-patz has joined #openstack-containers | 03:39 | |
| *** gus has quit IRC | 03:41 | |
| *** kebray has quit IRC | 03:41 | |
| *** kebray has joined #openstack-containers | 03:42 | |
| *** apmelton has quit IRC | 03:42 | |
| *** ganeshna_ has joined #openstack-containers | 03:44 | |
| *** gus has joined #openstack-containers | 03:44 | |
| *** apmelton has joined #openstack-containers | 03:45 | |
| *** ganeshna has quit IRC | 03:47 | |
| *** shuquan has quit IRC | 03:48 | |
| *** david-lyle has joined #openstack-containers | 03:50 | |
| *** hongbin has quit IRC | 03:52 | |
| *** deepthi has joined #openstack-containers | 03:52 | |
| *** achanda has quit IRC | 03:52 | |
| *** harshs has quit IRC | 03:53 | |
| *** shuquan has joined #openstack-containers | 03:58 | |
| gus | Tango: so before I spend more time on this - do you have a working k8s 1.0 setup at all? | 04:00 |
| * gus has sunk another day into just getting magnum+k8s-v1 actually working. | 04:01 | |
| *** ganeshna_ has quit IRC | 04:03 | |
| gus | At this point I think I should go work on other things and come back once more of your changes have merged, or attempt to reproduce whatever the k8s-neutron-lb issue is without magnum (difficult without a clear understanding of the failing json request and what was meant to be produced instead). | 04:03 |
| *** ganeshna has joined #openstack-containers | 04:03 | |
| *** zz_dimtruck has joined #openstack-containers | 04:04 | |
| gus | :-( | 04:04 |
| *** zz_dimtruck is now known as dimtruck | 04:04 | |
| *** achanda has joined #openstack-containers | 04:05 | |
| Tango | gus: Hi Gus, thanks so much for helping out. | 04:05 |
| Tango | gus: I spent the last few days adding a lot of logging to version 1.0.4 and stepped through the plugin code | 04:05 |
| gus | Tango: sorry I haven't made any progress yet - at this point I feel I'm just duplicating whatever you're already working on to get k8s-v1 supported. | 04:06 |
| Tango | gus: I finally figured out the discrepancy between what the plugin code expects and what Magnum deployed | 04:06 |
| *** wshao has joined #openstack-containers | 04:07 | |
| Tango | gus: So after fixing those discrepancies, I was just able to get the load balancer working this morning | 04:07 |
| gus | oh! What change was required? | 04:08 |
| Tango | gus: I am testing the patches now to implement. To get the minimum working, basically two things: | 04:08 |
| Tango | gus: all on Magnum side | 04:08 |
| Tango | 1. the name we register for a minion has to match the nova instance name | 04:09 |
| Tango | 2. the private neutron network we set up for the cluster has to be named "private" | 04:09 |
| Tango | gus: So with Magnum deploying the cluster this way, the load balancer gets created correctly | 04:10 |
| *** achanda has quit IRC | 04:11 | |
| gus | aha. Yes, 1 is unavoidable since I need to go from the minion "name" that k8s gives me to the address that the neutron LB needs. | 04:11 |
| gus | 2 will try "private", "public", and then accessIPs (v4, then v6) | 04:12 |
| Tango | Yep, once I step through your code, then I understand | 04:12 |
| *** harshs has joined #openstack-containers | 04:13 | |
| gus | the first two are a bit of a rackspace public cloud-ism. I can easily add more config for that part if there's something else you'd like it to do. | 04:13 |
| Tango | I can offer to write a little document to add to the plugin directory | 04:13 |
| Tango | One thing we might consider adding to the plugin is to manage the floating IP. Right now, the user would have to associate manually. | 04:14 |
| Tango | Not sure how GCE handles this, but the VIP for the pool is a private IP, so we need to get a floating IP to be able to access. | 04:14 |
| *** dave-mccowan has joined #openstack-containers | 04:15 | |
| gus | Tango: yeah, I think there's work underway to do the same thing for the aws plugin - but I had a lot of trouble getting the author of the patch to describe exactly what semantics he was trying to move towards :-/ | 04:15 |
| *** dims_ has joined #openstack-containers | 04:16 | |
| gus | GCE just goes straight from "public VIP" to "list of machines where you want that traffic to arrive" - without all these extra steps in between. | 04:17 |
| gus | ... hence the k8s API being so simple (initially). | 04:17 |
| *** wshao has quit IRC | 04:17 | |
| Tango | gus: So you think we can borrow from the aws once they implement theirs? | 04:17 |
| gus | Tango: https://github.com/kubernetes/kubernetes/pull/13005 is the relevant change. | 04:19 |
| *** dave-mccowan has quit IRC | 04:19 | |
| gus | But like I said, I'm still waiting for more docs to work out exactly what "LoadBalancerIP" is meant to mean (chassis/private IP or floating IP) | 04:19 |
| Tango | ok, I would like to keep an ear on this work | 04:20 |
| *** achanda has joined #openstack-containers | 04:21 | |
| *** ganeshna has quit IRC | 04:21 | |
| *** dims_ has quit IRC | 04:22 | |
| gus | Tango: I _think_ an alternative would be to create the LB+VIP and attach a floating IP to it in the heat template - then set that LB (private) IP in the k8s service ExternalIP. | 04:24 |
| gus | I agree it would be better to manage the floating-ip within k8s, but this is how you would do it outside k8s. | 04:25 |
| Tango | gus: hmm, then would it be difficult to manage the LB+VIP externally in response to changes in the services? | 04:26 |
| *** jlcoello has quit IRC | 04:27 | |
| *** achanda has quit IRC | 04:27 | |
| gus | You would have to follow some of the changes people might make in their services, yes. | 04:28 |
| gus | (but I sort of thought that was the point of magnum intercepting the k8s api(?)) | 04:28 |
| *** eghobo has joined #openstack-containers | 04:29 | |
| Tango | no, we thought about intercepting the k8s api but that was frowned upon by the k8s team, so now we are only passing everything straight through | 04:29 |
| Tango | Magnum mainly creates and manages the cluster as infrastructure | 04:30 |
| gus | .. so what's the point of pod-create, etc magnum commands? | 04:30 |
| gus | (as opposed to not having them and forcing the user to always go directly to the k8s apiserver endpoint) | 04:31 |
| Tango | they are passed straight through to k8s, but the purpose is really for orchesration. Later there will be heat resources for these and you can code in the heat template | 04:31 |
| gus | ah, heat integration makes some sense. | 04:32 |
| Tango | The user is totally free to use k8s api | 04:32 |
| *** deepthi has quit IRC | 04:33 | |
| *** elynn has joined #openstack-containers | 04:39 | |
| *** jjfreric has joined #openstack-containers | 04:40 | |
| *** unicell has joined #openstack-containers | 04:41 | |
| *** jjfreric has quit IRC | 04:44 | |
| *** SourabhP has joined #openstack-containers | 04:47 | |
| *** SourabhP_ has joined #openstack-containers | 04:51 | |
| *** suro-patz has quit IRC | 04:53 | |
| Tango | gus: So it looks like the 3 issues that you pointed out ealier have been merged to k8s master | 04:53 |
| Tango | gus: How do we tell if they have been picked up in a release yet? | 04:54 |
| *** SourabhP has quit IRC | 04:54 | |
| *** SourabhP_ is now known as SourabhP | 04:54 | |
| *** diga has joined #openstack-containers | 04:55 | |
| Tango | gus: (12203, 12262, 12288) | 04:55 |
| gus | Tango: usual github releases and git tags: https://github.com/kubernetes/kubernetes/releases | 04:58 |
| Tango | gus: So if I search for 12203 and don't see it, then it's not picked up yet? | 04:59 |
| Tango | gus: It doesn't look like those 3 have been picked up yet | 05:00 |
| *** eghobo_ has joined #openstack-containers | 05:00 | |
| gus | they don't always mention every (non-bug) change in the releases. The most robust way is to check the contents of the git tree at each tag, :/ | 05:01 |
| Tango | ok | 05:01 |
| Tango | I know version 1.0.4 doesn't have them | 05:02 |
| gus | they might not make it into 1.0.x at all - I'm not sure how strict the branch policy is. | 05:02 |
| Tango | Let me check the latest 1.0.6 pre-release | 05:03 |
| *** SourabhP has quit IRC | 05:03 | |
| *** SourabhP_ has joined #openstack-containers | 05:03 | |
| *** tbh has joined #openstack-containers | 05:03 | |
| *** eghobo has quit IRC | 05:04 | |
| *** ganeshna has joined #openstack-containers | 05:11 | |
| Tango | gus: Nope, they are not there yet in 1.0.6 | 05:11 |
| *** harshs has quit IRC | 05:11 | |
| *** suro-patz has joined #openstack-containers | 05:12 | |
| *** coolsvap has joined #openstack-containers | 05:15 | |
| *** dave-mccowan has joined #openstack-containers | 05:16 | |
| *** dave-mccowan has quit IRC | 05:20 | |
| *** Marga_ has quit IRC | 05:24 | |
| *** suro-patz has quit IRC | 05:35 | |
| *** vimal has joined #openstack-containers | 05:47 | |
| *** Marga_ has joined #openstack-containers | 05:52 | |
| *** Marga_ has quit IRC | 05:52 | |
| *** Marga_ has joined #openstack-containers | 05:53 | |
| *** vilobhmm_11 has quit IRC | 05:57 | |
| *** ishant has joined #openstack-containers | 06:01 | |
| *** jwcroppe has quit IRC | 06:04 | |
| *** vilobhmm_11 has joined #openstack-containers | 06:04 | |
| *** muralia has quit IRC | 06:18 | |
| *** jlcoello has joined #openstack-containers | 06:22 | |
| *** shuquan has quit IRC | 06:23 | |
| *** suro-patz has joined #openstack-containers | 06:24 | |
| *** coolsvap_ has joined #openstack-containers | 06:24 | |
| *** shuquan has joined #openstack-containers | 06:26 | |
| *** suro-patz has quit IRC | 06:28 | |
| *** muralia has joined #openstack-containers | 06:30 | |
| *** vilobhmm_11 has quit IRC | 06:32 | |
| *** tbh has quit IRC | 06:33 | |
| *** humble__ has joined #openstack-containers | 06:35 | |
| *** kebray_ has joined #openstack-containers | 06:35 | |
| *** ganeshna has quit IRC | 06:35 | |
| *** humble_ has quit IRC | 06:38 | |
| *** kebray has quit IRC | 06:39 | |
| *** alex_klimov has joined #openstack-containers | 06:39 | |
| *** jlcoello has quit IRC | 06:41 | |
| *** deepthi has joined #openstack-containers | 06:42 | |
| *** wshao has joined #openstack-containers | 06:42 | |
| openstackgerrit | Hua Wang proposed openstack/magnum: Add registry_enabled to api and db https://review.openstack.org/222908 | 06:47 |
| *** coolsvap_ has quit IRC | 06:49 | |
| openstackgerrit | Motohiro/Yuanying Otsuka proposed openstack/magnum: [WIP] Add TLS support in heat kubernetes template https://review.openstack.org/202873 | 06:58 |
| openstackgerrit | Motohiro/Yuanying Otsuka proposed openstack/magnum: Fix calling parameter at get_cert/delete_cert https://review.openstack.org/223438 | 06:58 |
| openstackgerrit | Motohiro/Yuanying Otsuka proposed openstack/magnum: Allow unicode text as CSR https://review.openstack.org/223439 | 06:58 |
| *** unicell1 has joined #openstack-containers | 07:01 | |
| *** unicell has quit IRC | 07:03 | |
| *** tbh has joined #openstack-containers | 07:05 | |
| *** achanda has joined #openstack-containers | 07:06 | |
| *** wshao has quit IRC | 07:10 | |
| *** tbh has quit IRC | 07:12 | |
| *** shuquan has quit IRC | 07:15 | |
| *** j___ has joined #openstack-containers | 07:20 | |
| *** ganeshna has joined #openstack-containers | 07:21 | |
| *** achanda has quit IRC | 07:22 | |
| *** madhuri has quit IRC | 07:24 | |
| *** achanda has joined #openstack-containers | 07:25 | |
| *** eghobo has joined #openstack-containers | 07:26 | |
| *** eghobo_ has quit IRC | 07:28 | |
| eliqiao | hi tcammmann tcammmann1 | 07:29 |
| eliqiao | around? | 07:29 |
| eliqiao | hi tcammann tcammann1 | 07:29 |
| *** tbh has joined #openstack-containers | 07:32 | |
| *** Tango has quit IRC | 07:33 | |
| *** SourabhP has joined #openstack-containers | 07:33 | |
| *** SourabhP_ has quit IRC | 07:36 | |
| *** SourabhP has quit IRC | 07:39 | |
| *** achanda has quit IRC | 07:41 | |
| openstackgerrit | Martin Falatic proposed openstack/magnum: If headerParams = None, don't use it to .update() https://review.openstack.org/223369 | 07:45 |
| *** shuquan has joined #openstack-containers | 08:06 | |
| *** sdake has quit IRC | 08:07 | |
| openstackgerrit | Motohiro/Yuanying Otsuka proposed openstack/magnum: Allow unicode text as CSR https://review.openstack.org/223439 | 08:08 |
| openstackgerrit | Motohiro/Yuanying Otsuka proposed openstack/magnum: [WIP] Add TLS support in heat kubernetes template https://review.openstack.org/202873 | 08:08 |
| *** kebray_ has quit IRC | 08:14 | |
| *** VikasC has joined #openstack-containers | 08:16 | |
| *** shuquan has quit IRC | 08:16 | |
| *** dims_ has joined #openstack-containers | 08:20 | |
| *** wangqun has joined #openstack-containers | 08:23 | |
| *** humble_ has joined #openstack-containers | 08:24 | |
| *** ganeshna has quit IRC | 08:26 | |
| *** shuquan has joined #openstack-containers | 08:27 | |
| *** humble__ has quit IRC | 08:28 | |
| *** ganeshna has joined #openstack-containers | 08:29 | |
| *** apuimedo has joined #openstack-containers | 08:31 | |
| *** humble__ has joined #openstack-containers | 08:42 | |
| *** humble_ has quit IRC | 08:46 | |
| *** chandankumar has joined #openstack-containers | 08:46 | |
| *** dims_ has quit IRC | 08:53 | |
| *** tbh has quit IRC | 09:01 | |
| openstackgerrit | Hua Wang proposed openstack/magnum: Add registry_enabled to api and db https://review.openstack.org/222908 | 09:07 |
| *** tbh has joined #openstack-containers | 09:14 | |
| *** ganeshna has quit IRC | 09:18 | |
| *** diga has quit IRC | 09:26 | |
| *** ganeshna has joined #openstack-containers | 09:30 | |
| *** jun_ has joined #openstack-containers | 09:33 | |
| jun_ | Hello. I installed devstack with Magnum, but after bay creation, the docker/etcd services cannot start from Fedoral atomic image based kubernate master node. | 09:35 |
| *** ganeshna has quit IRC | 09:40 | |
| eliqiao | jun_: what is the coe ? | 09:40 |
| eliqiao | swarm/k8s? | 09:40 |
| jun_ | k8s | 09:43 |
| jun_ | Has anyone installed the latest fedora image through magnum and get k8s services running correctly? | 09:44 |
| *** bradjones|away has quit IRC | 09:47 | |
| *** bradjones has joined #openstack-containers | 09:49 | |
| *** bradjones has quit IRC | 09:49 | |
| *** bradjones has joined #openstack-containers | 09:49 | |
| *** dims_ has joined #openstack-containers | 09:52 | |
| jun_ | I used a flavor with 10GB disk for the k8s master/minion nodes, and found they will almost stuck during the first boot up, and I have to soft reboot them again in order to get cloud-init executed and finish bay-create. After that, I found docker/etcd services cannot start and report either timeout or terminated. | 09:52 |
| jun_ | Another question is: why the support to CoreOS is poor, compared with Fedora image, as many heat templates related to CoreOS are out of date. | 09:54 |
| *** dims_ has quit IRC | 09:57 | |
| *** elynn has quit IRC | 10:02 | |
| *** shuquan has quit IRC | 10:09 | |
| *** wangqun has quit IRC | 10:14 | |
| *** jun_ has quit IRC | 10:17 | |
| *** julim has joined #openstack-containers | 10:21 | |
| *** ganeshna has joined #openstack-containers | 10:30 | |
| *** sgordon has quit IRC | 10:31 | |
| *** sgordon has joined #openstack-containers | 10:32 | |
| *** diga has joined #openstack-containers | 10:34 | |
| *** humble_ has joined #openstack-containers | 10:37 | |
| *** diga has quit IRC | 10:40 | |
| *** humble__ has quit IRC | 10:41 | |
| *** dims_ has joined #openstack-containers | 10:44 | |
| *** ganeshna_ has joined #openstack-containers | 10:45 | |
| *** ganeshn__ has joined #openstack-containers | 10:47 | |
| *** ganeshna has quit IRC | 10:49 | |
| *** ganeshna_ has quit IRC | 10:50 | |
| *** ganeshn__ has quit IRC | 10:52 | |
| *** ganeshna has joined #openstack-containers | 10:55 | |
| *** ishant has quit IRC | 11:08 | |
| *** ganeshna has quit IRC | 11:09 | |
| openstackgerrit | Hua Wang proposed openstack/magnum: Add registry to template https://review.openstack.org/223526 | 11:15 |
| *** junhongl has quit IRC | 11:19 | |
| *** sdake has joined #openstack-containers | 11:25 | |
| *** sdake_ has joined #openstack-containers | 11:30 | |
| *** sdake has quit IRC | 11:31 | |
| *** deepthi has quit IRC | 11:49 | |
| *** coolsvap_ has joined #openstack-containers | 11:56 | |
| *** chandankumar has quit IRC | 11:59 | |
| *** alex_klimov has quit IRC | 12:13 | |
| *** annegentle has joined #openstack-containers | 12:25 | |
| *** raildo-afk is now known as raildo | 12:25 | |
| *** EricGonczer_ has joined #openstack-containers | 12:25 | |
| *** EricGonczer_ has quit IRC | 12:27 | |
| *** sdake_ has quit IRC | 12:30 | |
| *** VikasC has quit IRC | 12:36 | |
| *** humble_ has quit IRC | 12:44 | |
| *** banix has joined #openstack-containers | 12:45 | |
| *** alex_klimov has joined #openstack-containers | 12:47 | |
| *** tbh has quit IRC | 12:48 | |
| *** puranamr has joined #openstack-containers | 12:49 | |
| *** rlrossit1 has joined #openstack-containers | 12:54 | |
| *** rlrossit1 has left #openstack-containers | 12:54 | |
| *** puranamr has quit IRC | 12:55 | |
| *** rlrossit1 has joined #openstack-containers | 12:55 | |
| *** rlrossit1 has quit IRC | 12:55 | |
| *** rlrossit has joined #openstack-containers | 12:56 | |
| *** jruano has joined #openstack-containers | 12:59 | |
| *** chandankumar has joined #openstack-containers | 13:00 | |
| *** chandankumar has quit IRC | 13:03 | |
| *** eghobo has quit IRC | 13:05 | |
| *** banix has quit IRC | 13:16 | |
| *** coolsvap_ has quit IRC | 13:19 | |
| *** dims_ has quit IRC | 13:21 | |
| *** dims_ has joined #openstack-containers | 13:22 | |
| *** chandankumar has joined #openstack-containers | 13:23 | |
| *** ctrath has joined #openstack-containers | 13:32 | |
| *** jruano_ has joined #openstack-containers | 13:34 | |
| *** jruano has quit IRC | 13:38 | |
| *** hongbin has joined #openstack-containers | 13:38 | |
| *** shuquan has joined #openstack-containers | 13:45 | |
| *** annegentle has quit IRC | 13:46 | |
| *** shuquan has quit IRC | 13:49 | |
| *** shuquan has joined #openstack-containers | 13:50 | |
| *** EricGonczer_ has joined #openstack-containers | 13:56 | |
| *** julim has quit IRC | 14:01 | |
| *** jruano_ has quit IRC | 14:04 | |
| *** annegentle has joined #openstack-containers | 14:08 | |
| *** shuquan has quit IRC | 14:15 | |
| *** david-lyle has quit IRC | 14:20 | |
| *** muralia has quit IRC | 14:20 | |
| *** muralia has joined #openstack-containers | 14:20 | |
| *** muralia has joined #openstack-containers | 14:20 | |
| *** gsagie_ has joined #openstack-containers | 14:23 | |
| *** harshs has joined #openstack-containers | 14:27 | |
| *** vimal has quit IRC | 14:28 | |
| *** banix has joined #openstack-containers | 14:28 | |
| *** achanda has joined #openstack-containers | 14:30 | |
| *** jlcoello has joined #openstack-containers | 14:30 | |
| *** achanda has quit IRC | 14:31 | |
| *** kbyrne has quit IRC | 14:31 | |
| *** dane_leblanc has joined #openstack-containers | 14:35 | |
| *** julim has joined #openstack-containers | 14:35 | |
| *** harshs has quit IRC | 14:36 | |
| *** annegentle has quit IRC | 14:36 | |
| *** apuimedo has quit IRC | 14:36 | |
| *** annegentle has joined #openstack-containers | 14:37 | |
| *** kbyrne has joined #openstack-containers | 14:37 | |
| *** kbyrne has quit IRC | 14:38 | |
| *** chandankumar has quit IRC | 14:39 | |
| *** Drago has joined #openstack-containers | 14:39 | |
| *** gsagie__ has joined #openstack-containers | 14:40 | |
| *** kbyrne has joined #openstack-containers | 14:40 | |
| *** gsagie_ has quit IRC | 14:40 | |
| *** Drago has quit IRC | 14:43 | |
| *** Drago has joined #openstack-containers | 14:43 | |
| *** harshs has joined #openstack-containers | 14:45 | |
| *** ganeshna has joined #openstack-containers | 14:50 | |
| *** adrian_otto has joined #openstack-containers | 14:51 | |
| *** ganeshna has quit IRC | 14:51 | |
| *** _navneet has joined #openstack-containers | 14:52 | |
| *** ganeshna has joined #openstack-containers | 14:52 | |
| *** achanda has joined #openstack-containers | 14:58 | |
| *** Tango has joined #openstack-containers | 15:03 | |
| *** achanda has quit IRC | 15:06 | |
| *** zhenguo has quit IRC | 15:06 | |
| *** adrian_otto has quit IRC | 15:11 | |
| *** david-lyle has joined #openstack-containers | 15:13 | |
| *** adrian_otto has joined #openstack-containers | 15:16 | |
| *** harshs has quit IRC | 15:20 | |
| *** dane_leblanc has quit IRC | 15:21 | |
| *** wanghua has joined #openstack-containers | 15:23 | |
| *** kebray has joined #openstack-containers | 15:25 | |
| *** dane_leblanc has joined #openstack-containers | 15:28 | |
| *** slagle has quit IRC | 15:30 | |
| *** j___ has quit IRC | 15:30 | |
| *** ganeshna has quit IRC | 15:31 | |
| *** coolsvap has quit IRC | 15:31 | |
| *** ganeshna has joined #openstack-containers | 15:31 | |
| *** ganeshna has quit IRC | 15:33 | |
| *** ganeshna_ has joined #openstack-containers | 15:33 | |
| *** rpothier has joined #openstack-containers | 15:41 | |
| *** ganeshna_ has quit IRC | 15:44 | |
| *** puranamr has joined #openstack-containers | 15:45 | |
| *** ganeshna has joined #openstack-containers | 15:45 | |
| *** unicell1 has quit IRC | 15:51 | |
| *** vahidh has joined #openstack-containers | 15:52 | |
| openstackgerrit | Daneyon Hansen proposed openstack/magnum: Adds network_driver Support of Container Network Model https://review.openstack.org/214909 | 15:52 |
| adrian_otto | Our team meeting begins in about 5 minutes in #openstack-meeting-alt at 1600 UTC. See you there! | 15:54 |
| *** ganeshna has quit IRC | 15:54 | |
| openstackgerrit | Daneyon Hansen proposed openstack/magnum: Adds labels support to baymodels https://review.openstack.org/217888 | 15:56 |
| *** fawadkhaliq has joined #openstack-containers | 15:58 | |
| daneyon_ | hongbin fyi swapping the dependencies did not work. I removed the client tests on the labels and net-driver patches and resubmitted. I will add the client tests back in after the client code merges. | 15:58 |
| *** eghobo has joined #openstack-containers | 15:58 | |
| *** vilobhmm_11 has joined #openstack-containers | 15:59 | |
| *** juggler has joined #openstack-containers | 15:59 | |
| openstackgerrit | Daneyon Hansen proposed openstack/magnum: WIP: Validates baymodel network_driver requests https://review.openstack.org/222337 | 16:00 |
| hongbin | daneyon_: ack | 16:00 |
| daneyon_ | hongbin i have a quick question about this review: https://review.openstack.org/#/c/214762/ | 16:01 |
| daneyon_ | I see the gate-magnum-tox-bandit tests fail | 16:01 |
| daneyon_ | However all tox tests pass when i run tox locally. | 16:01 |
| daneyon_ | Should I be concerned at all about this? | 16:01 |
| hongbin | non-voting test doesn't matter | 16:02 |
| hongbin | BTW, I am on the magnum meeting right now | 16:02 |
| *** slagle has joined #openstack-containers | 16:04 | |
| *** dane_leblanc has quit IRC | 16:07 | |
| *** Marga_ has quit IRC | 16:10 | |
| *** alex_klimov has quit IRC | 16:13 | |
| *** j___ has joined #openstack-containers | 16:14 | |
| *** suro-patz has joined #openstack-containers | 16:14 | |
| *** puranamr has quit IRC | 16:16 | |
| *** Marga_ has joined #openstack-containers | 16:17 | |
| *** puranamr has joined #openstack-containers | 16:17 | |
| *** chandankumar has joined #openstack-containers | 16:17 | |
| *** gsagie__ has quit IRC | 16:18 | |
| *** annegent_ has joined #openstack-containers | 16:22 | |
| *** annegentle has quit IRC | 16:24 | |
| *** juggler has quit IRC | 16:25 | |
| *** SourabhP has joined #openstack-containers | 16:26 | |
| *** sdake has joined #openstack-containers | 16:28 | |
| *** juggler has joined #openstack-containers | 16:28 | |
| *** annegentle has joined #openstack-containers | 16:28 | |
| *** SourabhP_ has joined #openstack-containers | 16:28 | |
| *** sgordon has quit IRC | 16:28 | |
| *** annegentle has quit IRC | 16:30 | |
| *** annegentle has joined #openstack-containers | 16:31 | |
| *** sdake_ has joined #openstack-containers | 16:31 | |
| *** annegent_ has quit IRC | 16:31 | |
| *** SourabhP has quit IRC | 16:32 | |
| *** SourabhP_ is now known as SourabhP | 16:32 | |
| *** juggler_ has joined #openstack-containers | 16:32 | |
| openstackgerrit | Andrew Melton proposed openstack/magnum: [WIP] Add TLS to Docker-Swarm Template https://review.openstack.org/212598 | 16:32 |
| *** sgordon has joined #openstack-containers | 16:33 | |
| *** juggler has quit IRC | 16:34 | |
| *** sdake has quit IRC | 16:35 | |
| *** juggler_ has quit IRC | 16:39 | |
| *** unicell has joined #openstack-containers | 16:40 | |
| *** j___ has quit IRC | 16:42 | |
| *** j___ has joined #openstack-containers | 16:42 | |
| *** vilobhmm_11 has quit IRC | 16:47 | |
| *** harshs has joined #openstack-containers | 16:49 | |
| *** puranamr has quit IRC | 16:49 | |
| *** puranamr has joined #openstack-containers | 16:51 | |
| *** puranamr has quit IRC | 16:52 | |
| *** puranamr has joined #openstack-containers | 16:52 | |
| *** raildo has left #openstack-containers | 16:54 | |
| *** ctrath has quit IRC | 17:01 | |
| *** chandankumar has quit IRC | 17:03 | |
| *** j___ has quit IRC | 17:03 | |
| *** vahidh has quit IRC | 17:03 | |
| openstackgerrit | Daneyon Hansen proposed openstack/magnum: Refactors Heat templates for Container Networking Model https://review.openstack.org/214762 | 17:04 |
| *** ctrath has joined #openstack-containers | 17:05 | |
| *** j___ has joined #openstack-containers | 17:06 | |
| *** wanghua has quit IRC | 17:07 | |
| openstackgerrit | Daneyon Hansen proposed openstack/magnum: Adds network_driver Support of Container Network Model https://review.openstack.org/214909 | 17:08 |
| openstackgerrit | Daneyon Hansen proposed openstack/magnum: WIP: Validates baymodel network_driver requests https://review.openstack.org/222337 | 17:10 |
| *** dane_leblanc has joined #openstack-containers | 17:11 | |
| openstackgerrit | Daneyon Hansen proposed openstack/magnum: Adds labels support to baymodels https://review.openstack.org/217888 | 17:13 |
| *** sthillma has joined #openstack-containers | 17:14 | |
| openstackgerrit | Daneyon Hansen proposed openstack/python-magnumclient: Adds Container Network Model network_driver support https://review.openstack.org/222749 | 17:15 |
| openstackgerrit | Daneyon Hansen proposed openstack/python-magnumclient: Adds Labels Support https://review.openstack.org/215260 | 17:15 |
| *** vilobhmm_11 has joined #openstack-containers | 17:16 | |
| *** puranamr_ has joined #openstack-containers | 17:24 | |
| *** puranamr has quit IRC | 17:26 | |
| *** achanda has joined #openstack-containers | 17:28 | |
| *** puranamr has joined #openstack-containers | 17:29 | |
| *** puranamr_ has quit IRC | 17:31 | |
| *** sthillma has quit IRC | 17:32 | |
| *** sdake_ is now known as sdake | 17:33 | |
| _navneet | Still stuck on this - running into a problem when creating a kubernetes or swarm bay where it is stuck in CREATE_IN_PROGRESS. heat resource-list shows that master_wait_condition is the one that's stuck in that state. Does anyone have any ideas on how to debug this? | 17:36 |
| suro-patz | _navneet: You see the instance for master on 'nova list', right? | 17:38 |
| _navneet | yes | 17:38 |
| _navneet | and I can ssh into it | 17:38 |
| suro-patz | cool, can you see if you can reach internet from the instance | 17:39 |
| *** rlrossit has quit IRC | 17:39 | |
| *** annegentle has quit IRC | 17:39 | |
| suro-patz | I mean 'ping 8.8.8.8` sort of things | 17:40 |
| _navneet | yes, I can | 17:40 |
| suro-patz | from the kub-master-instance | 17:40 |
| *** rlrossit has joined #openstack-containers | 17:40 | |
| suro-patz | does it time out after being in CREATE_IN_PROGRESS? | 17:41 |
| *** sdake_ has joined #openstack-containers | 17:41 | |
| *** puranamr has quit IRC | 17:42 | |
| _navneet | no, I haven't seen it time out, but I think I've always deleted the bay after 20-30 minutes to try something else, so not sure if the timeout is longer than my patience :) | 17:42 |
| *** SourabhP has quit IRC | 17:42 | |
| *** adrian_otto has quit IRC | 17:42 | |
| suro-patz | If you are doing nested virtualization it may take time | 17:43 |
| suro-patz | are you running this devstack on a VM | 17:43 |
| _navneet | no, it's running on baremetal | 17:44 |
| *** sdake has quit IRC | 17:44 | |
| suro-patz | then it should have been faster to converge | 17:44 |
| _navneet | yes, and all the other heat resources reach CREATE_COMPLETE within a few seconds ... it's just master_wait_condition that just remains stuck in CREATE_IN_PROGRESS even though the resources it should be waiting on have completed | 17:46 |
| suro-patz | I have seen it to take time to converge, at least 10-15 for me | 17:46 |
| *** puranamr has joined #openstack-containers | 17:46 | |
| suro-patz | 10-15m | 17:47 |
| *** annegentle has joined #openstack-containers | 17:47 | |
| suro-patz | basically once the master is set up it signals the heat server to proceed | 17:48 |
| suro-patz | so the issue can be either in the setup not happening or the signaling not happening | 17:48 |
| suro-patz | if the box can reach internet it means all the networking path is setup properly so the setup should have happened | 17:49 |
| suro-patz | now let's check the signaling part | 17:49 |
| _navneet | yes, kube_master shows completed about 15 minutes back | 17:49 |
| *** kbyrne has quit IRC | 17:49 | |
| suro-patz | then what is stuck? | 17:50 |
| _navneet | I have no idea ... everything else in heat resource-list shows CREATE_COMPLETE including kube_master.. except kube_minions is in INIT_COMPLETE and master_wait_condition is stuck in CREATE_IN_PROGRESS | 17:52 |
| *** Tango has quit IRC | 17:52 | |
| suro-patz | okay - | 17:52 |
| suro-patz | _navneet: Would you be able to browse the cloud config | 17:54 |
| suro-patz | on the instance | 17:54 |
| _navneet | not sure what you mean by that, but I have root on the instance, so should be able to do anything | 17:55 |
| _navneet | oh, you mean on the kube master instance | 17:55 |
| suro-patz | cat /etc/sysconfig/heat-params | 17:56 |
| *** annegent_ has joined #openstack-containers | 17:56 | |
| _navneet | http://paste.openstack.org/show/463337/ | 17:59 |
| *** annegentle has quit IRC | 18:00 | |
| suro-patz | Using the WAIT_HANDLE, it curls back to heat-wait-fun | 18:00 |
| *** vahidh has joined #openstack-containers | 18:00 | |
| suro-patz | you need to check if that's what is failing | 18:00 |
| *** ctrath has quit IRC | 18:01 | |
| suro-patz | I need to rush for a meeting … sorry I can't give you all the details required | 18:01 |
| suro-patz | Sorry :( | 18:01 |
| _navneet | yes, the curl on the url says: Peer's certificate issuer has been marked as not trusted by the user | 18:01 |
| _navneet | thanks for getting me this far ... so maybe I need to pass in the cert info for my self signed cert somehow or signal heat to use insecure connection somehow ? | 18:02 |
| *** puranamr_ has joined #openstack-containers | 18:04 | |
| *** sthillma has joined #openstack-containers | 18:04 | |
| *** annegent_ has quit IRC | 18:04 | |
| *** annegentle has joined #openstack-containers | 18:05 | |
| *** ctrath has joined #openstack-containers | 18:05 | |
| *** ctrath has quit IRC | 18:05 | |
| *** ctrath has joined #openstack-containers | 18:06 | |
| *** puranamr has quit IRC | 18:06 | |
| *** ctrath has quit IRC | 18:06 | |
| *** SourabhP has joined #openstack-containers | 18:07 | |
| *** puranamr has joined #openstack-containers | 18:08 | |
| *** puranamr_ has quit IRC | 18:09 | |
| *** annegentle has quit IRC | 18:11 | |
| *** kebray has quit IRC | 18:13 | |
| hongbin | suro-patz: still there? | 18:13 |
| *** annegentle has joined #openstack-containers | 18:13 | |
| *** fawadkhaliq has quit IRC | 18:25 | |
| suro-patz | hongbin: back | 18:30 |
| suro-patz | _navneet: Glad that helped you root cause the issue … | 18:30 |
| hongbin | suro-patz: just answer your question in the review | 18:30 |
| hongbin | In here https://review.openstack.org/#/c/220702/ | 18:31 |
| hongbin | The try catch thing | 18:31 |
| suro-patz | actually the wrapper does ignore the exception | 18:32 |
| suro-patz | periodic_task.periodic_task | 18:32 |
| hongbin | Yes, I guess that is the purpose | 18:32 |
| *** manjeets has joined #openstack-containers | 18:32 | |
| hongbin | one thing is if you want to explicitly ignore the exception | 18:33 |
| suro-patz | I did not have any such scenrrio here | 18:33 |
| suro-patz | as the lookup failure gets absorbed in the objects layer and None is returned | 18:34 |
| hongbin | get that | 18:34 |
| suro-patz | So if any exception happens I wanted the stack instead of ignoring | 18:34 |
| *** Tango has joined #openstack-containers | 18:35 | |
| suro-patz | and @periodic_task.periodic_task helps that without killing the task | 18:35 |
| hongbin | hmm | 18:35 |
| hongbin | this is what I don't know | 18:35 |
| hongbin | OK, if periodic task will make sure the tasks won't be killed, I am happy | 18:35 |
| hongbin | never mind | 18:36 |
| *** puranamr has quit IRC | 18:36 | |
| hongbin | Maybe we should remove the try catch block in other periodic tasks if this is the case | 18:36 |
| suro-patz | no problem, its good that you checked | 18:36 |
| *** ctrath has joined #openstack-containers | 18:36 | |
| suro-patz | in sync_bay_status: it is really ignoring the exception | 18:37 |
| suro-patz | I was not sure, if the coder was doing it purposefully | 18:37 |
| hongbin | hmm, I doubt that | 18:38 |
| hongbin | Look like a mistake | 18:38 |
| suro-patz | I can knock that of - I will also put a reference to the code of periodic_task.periodic_task | 18:39 |
| suro-patz | That will increase readability | 18:39 |
| hongbin | Then the reference will be on every periodic task | 18:41 |
| hongbin | looks verbose | 18:41 |
| hongbin | or maybe you can put one on top of the file | 18:42 |
| suro-patz | sure! | 18:42 |
| hongbin | sounds good | 18:42 |
| suro-patz | hongbin: sincerely appreciate your detail oriented reviews! | 18:43 |
| hongbin | suro-patz: np | 18:43 |
| *** sdake_ is now known as sdake | 18:45 | |
| *** puranamr has joined #openstack-containers | 18:46 | |
| *** puranamr has quit IRC | 18:46 | |
| *** wshao has joined #openstack-containers | 18:50 | |
| mfalatic | Seeking a +2 on https://review.openstack.org/#/c/223369/ - a small but vexing bug | 18:50 |
| *** ctrath has quit IRC | 18:51 | |
| *** ctrath has joined #openstack-containers | 18:57 | |
| rlrossit | I could use a little help on the dev-quickstart stuff | 19:04 |
| rlrossit | I'm trying to create a container in a swarm cluster (https://github.com/openstack/magnum/blob/master/doc/source/dev/dev-quickstart.rst#building-and-using-a-swarm-bay) | 19:04 |
| rlrossit | I'm trying the container-create with --image cirros, but it looks like conductor is trying to parse a url from that image that it can then do a docker pull on | 19:05 |
| rlrossit | is that something wrong with the parsing code, or do the docs need to be updated? | 19:05 |
| *** ctrath has quit IRC | 19:06 | |
| *** dane_leblanc has quit IRC | 19:07 | |
| annegentle | rlrossit: I tried container-create myself this week and last with master branch and get a Docker internal Error each time | 19:08 |
| annegentle | rlrossit: so not ready to blame the docs yet :) | 19:08 |
| annegentle | rlrossit: do you think it's an image problem? | 19:08 |
| _navneet | suro-patz: I added 'insecure = true' in the heat_client section in magnum.conf and restarted magnum api and conductor and tried creating a new bay ... but still the same problem with master_wait_condition stuck | 19:08 |
| *** ctrath has joined #openstack-containers | 19:09 | |
| suro-patz | _navneet: Let me find the folks who have added the TLS support recently | 19:10 |
| suro-patz | apmelton: madhuri: ^^ | 19:10 |
| _navneet | also when I try curl --insecure $WAIT_HANDLE .. I get this response: <ErrorResponse><Error><Message>The request signature does not conform to AWS standards</Message><Code>IncompleteSignature</Code><Type>Sender</Type></Error></ErrorResponse> | 19:11 |
| _navneet | FYI, I'm running stable/kilo, not master | 19:11 |
| suro-patz | do you need to do 'curl —insecure' ? | 19:11 |
| rlrossit | annegentle: https://github.com/openstack/magnum/blob/master/magnum/conductor/handlers/docker_conductor.py#L128 is what's blowing up. It's expecting a repo url, which is just "cirros" in the situation of the doc | 19:12 |
| _navneet | yes, if i run without --insecure I still get 'Peer's certificate issuer has been marked as not trusted by the user' | 19:12 |
| apmelton | rlrossit: annegentle: I suspect this is an incompatibility between redhat's docker and vanilla docker-py | 19:13 |
| suro-patz | _navneet: that indicates the heat-cfn is still expecting it to be secure | 19:13 |
| annegentle | rlrossit: but does that mean https://hub.docker.com/_/cirros/? | 19:13 |
| suro-patz | time to call in the TLS experts :) | 19:13 |
| apmelton | suro-patz: _navneet: the TLS work doesn't touch inter service communication between other openstack services | 19:13 |
| rlrossit | annegentle: no idea | 19:14 |
| suro-patz | apmelton: In _navneet 's case, the curl from kube-master fails with the msg - 'Peer's certificate issuer has been marked as not trusted by the user' | 19:14 |
| suro-patz | even after he set the insecure=True in the conf | 19:14 |
| suro-patz | So looks like the heat-wait-server is expecting a secure communication back, right? apmelton: | 19:15 |
| _navneet | I only updated the heat-client section in magnum.conf with insecure = true .. do I also need to do that on the heat-cfn config file ? | 19:15 |
| annegentle | apmelton: oh please do expand on that, why would there be differences? | 19:16 |
| _navneet | I also tried setting my ca-file in the heat_client section in magnum.conf with no luck .. not sure where to look for the cert on the kube master instance | 19:17 |
| apmelton | annegentle: redhat has some changes in their docker that allows for changing the default registry/index, and even disabling the public docker registry entirely | 19:17 |
| apmelton | annegentle: when they introduced that change, all images now show up as docker.io/<repo>/<name> | 19:18 |
| apmelton | I think the interaction was breaking down when docker-py attempted to go query docker.io | 19:18 |
| rlrossit | apmelton: how would I know if I have RH docker or vanilla docker? | 19:18 |
| apmelton | rlrossit: are you running fedora atomic? | 19:19 |
| rlrossit | yep | 19:19 |
| apmelton | then you've got RH docker | 19:19 |
| annegentle | apmelton: running fedora atomic where? host? | 19:20 |
| apmelton | annegentle: fedora atomic as the base image of your bay | 19:20 |
| annegentle | apmelton: ok thanks | 19:20 |
| apmelton | _navneet: when you tried curl --insecure, did you run it manually? | 19:20 |
| _navneet | yes | 19:20 |
| apmelton | I wonder if the signature of the actual wait handle got mangled in the translation to running it manually | 19:21 |
| apmelton | and that's what heat doesn't like | 19:21 |
| suro-patz | apmelton: for _navneet: the kube master is getting stuck in wait_condition forever | 19:21 |
| rlrossit | apmelton: so should this be a doc update? or is there something broken here? | 19:21 |
| suro-patz | we were debugging that and we were suspecting that the curl is failing and thus the cluster is not converging apmelton: | 19:22 |
| apmelton | rlrossit: when you create your container, try creating it with docker.io/cirros | 19:23 |
| apmelton | if the whole create, run, delete flow works, then it's likely a doc update | 19:23 |
| _navneet | util.py[WARNING]: Failed running /var/lib/cloud/instance/scripts/part-009 [60] | 19:23 |
| _navneet | cc_scripts_user.py[WARNING]: Failed to run module scripts-user (scripts in /var/lib/cloud/instance/scripts) | 19:23 |
| _navneet | util.py[WARNING]: Running scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_scripts_user.py'>) failed | 19:23 |
| suro-patz | _navneet: for your reference, Last I took devstack [* master d9ac6ca [ahead 1] Local changes for magnum devstack onto stable/kilo] and magnum[commit 25ae7c7044def5eab6dda642abe4259fc2b1aedf Merge "Conductor: Remove _update_stack_outputs from bay_conductor"] and this had worked for me - deploying kube cluster | 19:23 |
| _navneet | also, not sure if this is relevant, but I see these warnings in /var/log/cloud-init-output.log on kube master: | 19:23 |
| suro-patz | _navneet: it can be relevant | 19:23 |
| suro-patz | if there was a parsing error certain things won't happen | 19:24 |
| *** kebray has joined #openstack-containers | 19:24 | |
| *** alex_klimov has joined #openstack-containers | 19:24 | |
| rlrossit | apmelton: that did not work either | 19:26 |
| _navneet | apmelton: about your question on whether I ran curl manually ...is there a different command I can run to try to mimic the actual request that would be sent when kube_master completes ? | 19:27 |
| apmelton | rlrossit: then it's very likely there's a bug | 19:27 |
| rlrossit | oh boy oh boy | 19:27 |
| apmelton | _navneet: if it's a script that's injected as a multi-part mime resource, I'd suggest editing the script by hand, and just re-running the script directly | 19:29 |
| _navneet | I'm using the first k8s baymodel example that's listed on the dev-quickstart page | 19:30 |
| *** dane_leblanc has joined #openstack-containers | 19:32 | |
| apmelton | hmmmm _navneet it looks like the k8s template doesn't actually craft the curl command, it gets it directly from the wait handle resource | 19:34 |
| _navneet | do you know if it logs the output somewhere ? | 19:36 |
| apmelton | usually /var/log/cloud-init-output.log | 19:36 |
| apmelton | from your output above, it looks like /var/lib/cloud/instance/scripts/part-009 is the script that's failing | 19:37 |
| apmelton | what you might try doing is opening that up, and grabbing the curl command directly from there | 19:37 |
| rlrossit | apmelton: annegentle: I submitted https://bugs.launchpad.net/magnum/+bug/1496110 for the container-create issues | 19:37 |
| openstack | Launchpad bug 1496110 in Magnum "container-create fails with ContainerException: Docker internal Error: ('Connection aborted.', gaierror(-2, 'Name or service not known'))" [Undecided,New] | 19:37 |
| annegentle | thanks rlrossit | 19:40 |
| *** adrian_otto has joined #openstack-containers | 19:42 | |
| _navneet | apmelton: thanks! that was the problem, on running part-009 with the silent flags removed, it complained that 'Peer's certificate issuer has been marked as not trusted by the user' .. on adding the --insecure flag and running it again, it ran fine, and the stuck master_wait_condition completed | 19:46 |
| apmelton | cool _navneet | 19:46 |
| _navneet | but I don't know why adding insecure = true in magnum.conf didn't do the same for me | 19:47 |
| rlrossit | apmelton: looks like I've got more problems... is the api_address on a swarm bay supposed to be None? That's causing issues with container-delete | 19:47 |
| apmelton | _navneet: I think the issue is, then curl_cli here https://github.com/openstack/magnum/blob/79929f3aa2605ebeb073127ef37811cd78d98195/magnum/templates/heat-kubernetes/kubemaster.yaml#L201 generated by heat doesn't have --insecure | 19:48 |
| apmelton | _navneet: I have no idea how that works though, you'll need to check with someone who knows heat better than I do | 19:48 |
| apmelton | rlrossit: that should definitely not be none | 19:49 |
| rlrossit | grrr | 19:49 |
| *** annegentle has quit IRC | 19:50 | |
| apmelton | if you don't have the api_address, everything in the container conductor is going to fail :/ | 19:50 |
| apmelton | rlrossit: ^^ | 19:50 |
| _navneet | ok, apmelton: suro-patz: thanks so much for your help! | 19:50 |
| apmelton | rlrossit: I think I see the problem | 19:51 |
| *** devlaps has joined #openstack-containers | 19:51 | |
| apmelton | rlrossit: if you need a quick fix, change 'swarm_manager' here https://github.com/openstack/magnum/blob/79929f3aa2605ebeb073127ef37811cd78d98195/magnum/conductor/template_definition.py#L450 to 'swarm_master' | 19:53 |
| *** Drago has quit IRC | 19:54 | |
| rlrossit | apmelton: thanks, I'll give that a try | 19:54 |
| apmelton | rlrossit: my devstack is a bit on the surgical table, so I can't test it 100% but that sets api address | 19:55 |
| apmelton | and should get your container conductor talking to the bay | 19:55 |
| rlrossit | apmelton: after making that change, I'll have to delete my existing bay and make a new one right? | 19:55 |
| apmelton | rlrossit: yup | 19:56 |
| manjeets | i think you have to delete bay but you can use same bay model | 19:56 |
| apmelton | rlrossit: I wonder if this is what's causing: https://bugs.launchpad.net/magnum/+bug/1496110 | 19:58 |
| openstack | Launchpad bug 1496110 in Magnum "container-create fails with ContainerException: Docker internal Error: ('Connection aborted.', gaierror(-2, 'Name or service not known'))" [Undecided,New] | 19:58 |
| apmelton | rlrossit: if api_address is none, it might be trying to connect to tcp://None:2376 | 19:58 |
| apmelton | and thus you're getting "Name or service not known" when trying to resolve a domain 'None' | 19:58 |
| *** Drago has joined #openstack-containers | 19:59 | |
| *** Drago has quit IRC | 20:00 | |
| *** Drago has joined #openstack-containers | 20:00 | |
| *** achanda has quit IRC | 20:01 | |
| *** wshao has quit IRC | 20:08 | |
| *** Drago has quit IRC | 20:11 | |
| *** eghobo has quit IRC | 20:15 | |
| rlrossit | apmelton: well, it looks like it solved the original problem, but now I'm getting 404 Client Error: Not Found ("No such image: cirros") on container-create | 20:16 |
| apmelton | rlrossit: try docker.io/cirros now | 20:16 |
| rlrossit | apmelton: no dice. same error | 20:17 |
| apmelton | docker.io/library/cirros? | 20:17 |
| *** daneyon has joined #openstack-containers | 20:17 | |
| rlrossit | apmelton: nope. is this supposed to have http(s)://? | 20:18 |
| *** mjbrewer has joined #openstack-containers | 20:18 | |
| *** mjbrewer has left #openstack-containers | 20:18 | |
| apmelton | don't think so | 20:18 |
| apmelton | wouldn't hurt to try though | 20:18 |
| rlrossit | tried and failed :( | 20:19 |
| apmelton | D: | 20:19 |
| apmelton | rlrossit: you might try logging onto one of the nodes itself and issuing a docker pull cirros, then docker images and see what it shows up as | 20:19 |
| *** daneyon_ has quit IRC | 20:21 | |
| *** Drago has joined #openstack-containers | 20:24 | |
| rlrossit | apmelton: apparently, I can't ssh to these nodes... well that's depressing... probably something messed up with my network setup | 20:32 |
| apmelton | rlrossit: which addresses were you using to ssh? | 20:33 |
| apmelton | and were you sshing from the devstack host itself, or some other host? | 20:33 |
| rlrossit | from the devstack host to the public IP of them. I got into one so let's see what it says | 20:34 |
| *** eghobo has joined #openstack-containers | 20:35 | |
| *** achanda has joined #openstack-containers | 20:35 | |
| *** achanda has quit IRC | 20:35 | |
| *** achanda has joined #openstack-containers | 20:35 | |
| *** daneyon_ has joined #openstack-containers | 20:36 | |
| *** annegentle has joined #openstack-containers | 20:37 | |
| rlrossit | apmelton: I pulled the image. What information are we looking for here? | 20:38 |
| apmelton | rlrossit: can you paste/gist your 'docker images' output? | 20:38 |
| *** daneyon has quit IRC | 20:39 | |
| rlrossit | apmelton: http://paste.openstack.org/show/463538/ | 20:39 |
| apmelton | rlrossit: do you know if you're on the master node, or one of the other nodes? | 20:40 |
| rlrossit | apmelton: I'm not on the master | 20:41 |
| apmelton | can you grab the master's address and run docker -H tcp://<master_address>:2376 images | 20:42 |
| rlrossit | apmelton: running docker -H on the master shows the same output as in the paste | 20:48 |
| apmelton | theherm | 20:49 |
| apmelton | herm* | 20:49 |
| apmelton | I'm not sure what's going on | 20:49 |
| rlrossit | :( | 20:50 |
| Tango | I have a question for the git expert: how do you add a dependency between 2 existing patches? I know how to have a new patch depends on an existing one, but not sure how to do this with 2 e | 20:56 |
| Tango | xisting ones | 20:56 |
| *** wshao has joined #openstack-containers | 20:57 | |
| rlrossit | Tango: so you have patch A and B, which don't depend on each other, and then patch C which you want to depend on both A and B? | 20:57 |
| Tango | rlrossit: Just to add a dependency between A and B | 20:58 |
| Tango | rlrossit: and both exist already | 20:58 |
| rlrossit | gotcha | 20:58 |
| rlrossit | git review -d <id of A> to pull down A | 20:58 |
| rlrossit | git review -d <id of B> to pull down B | 20:58 |
| rlrossit | then rebase B on A then redo git-review | 20:59 |
| Tango | ah, I miss the rebase part | 20:59 |
| Tango | let me try that, thanks rlrossit | 20:59 |
| rlrossit | if A already has +2's, you may want to do git-review -R when uploading B then, or else you'll rebase a on current master and lose any +2's | 21:00 |
| rlrossit | Tango: ^ | 21:00 |
| Tango | rlrossit: So the -R option prevents rebasing A ? | 21:01 |
| *** manjeets has quit IRC | 21:01 | |
| rlrossit | it uploads the review without doing an auto-rebase of the bottom patch on master | 21:01 |
| Tango | rlrossit: Sounds good, I will do that | 21:03 |
| *** rpothier has quit IRC | 21:07 | |
| openstackgerrit | Ryan Rossiter proposed openstack/magnum: Change swarm_manager to swarm_master https://review.openstack.org/223815 | 21:16 |
| rlrossit | apmelton: was this ^ all that's needed? | 21:17 |
| apmelton | rlrossit: yea, but we need to get some test coverage around output parsing | 21:19 |
| rlrossit | apmelton: I was wondering how to test that... | 21:20 |
| rlrossit | I'm also going to put a suggestion on the ML to get some bare-bones tempest tests added to magnum just to catch happy paths on all of the CRUD operations | 21:21 |
| apmelton | rlrossit: dimtruck is working through that | 21:22 |
| apmelton | re: tempest | 21:22 |
| rlrossit | well then I don't need to post about it! | 21:22 |
| dimtruck | :) rlrossit - i should get something with tempest_lib in a day or so...right now just having trouble resolving oslo conf | 21:23 |
| apmelton | rlrossit: you can test those outputs by calling https://github.com/openstack/magnum/blob/master/magnum/conductor/template_definition.py#L317-L319 on each of the template definitions with a mocked up stack, then asserting the proper values get set on the bay | 21:23 |
| rlrossit | dimtruck: I was sent this (http://docs.openstack.org/developer/tempest/plugin.html) if you weren't already aware for the tempest stuff | 21:24 |
| rlrossit | dimtruck: also add me to whatever you put up, I'll be happy (hopefully) to review it | 21:24 |
| dimtruck | yeah i heard about it...not sure what state its in yet | 21:24 |
| dimtruck | rlrossit: sounds good! i'm taking you up on it | 21:25 |
| rlrossit | dimtruck: in my opinion, we need it to work soon. If that means making it look all nice like the plugin doc promises will be done later, so be it | 21:25 |
| dimtruck | +1 | 21:26 |
| *** puranamr has joined #openstack-containers | 21:28 | |
| apmelton | rlrossit: I've gotta run, think you've got what ya need to get that testing in place? | 21:29 |
| rlrossit | apmelton: I actually need to head out too :P. I'll take a look at it again tomorrow | 21:30 |
| apmelton | sounds good, I'll be around tomorrow if you've got questions | 21:30 |
| *** rlrossit has left #openstack-containers | 21:31 | |
| *** puranamr has quit IRC | 21:33 | |
| *** puranamr has joined #openstack-containers | 21:36 | |
| *** EricGonczer_ has quit IRC | 21:39 | |
| *** ctrath has quit IRC | 21:42 | |
| *** _navneet has quit IRC | 21:46 | |
| *** ctrath has joined #openstack-containers | 21:48 | |
| daneyon_ | apmelton u have a moment for a swarm related question? | 21:51 |
| *** jlcoello has quit IRC | 21:58 | |
| *** jlcoello has joined #openstack-containers | 21:59 | |
| *** jlcoello has quit IRC | 22:03 | |
| *** puranamr has quit IRC | 22:04 | |
| *** harshs has quit IRC | 22:09 | |
| *** harshs has joined #openstack-containers | 22:17 | |
| *** harshs has quit IRC | 22:17 | |
| *** harshs has joined #openstack-containers | 22:17 | |
| *** harshs has quit IRC | 22:18 | |
| *** eghobo_ has joined #openstack-containers | 22:19 | |
| *** eghobo has quit IRC | 22:22 | |
| openstackgerrit | Merged openstack/magnum: If headerParams = None, don't use it to .update() https://review.openstack.org/223369 | 22:31 |
| *** harshs has joined #openstack-containers | 22:32 | |
| *** muralia has quit IRC | 22:46 | |
| *** ctrath has quit IRC | 22:46 | |
| *** banix has quit IRC | 22:48 | |
| *** kebray has quit IRC | 22:51 | |
| openstackgerrit | Ton Ngo proposed openstack/magnum: Temporarily remove dependency on package certifi https://review.openstack.org/221376 | 22:51 |
| openstackgerrit | Ton Ngo proposed openstack/magnum: Migrate to Kubernetes Release 1 https://review.openstack.org/207299 | 22:51 |
| *** sdake has quit IRC | 22:56 | |
| *** wshao has quit IRC | 23:01 | |
| *** dane_leblanc has quit IRC | 23:02 | |
| *** annegentle has quit IRC | 23:03 | |
| *** julim has quit IRC | 23:08 | |
| openstackgerrit | Ton Ngo proposed openstack/magnum: Configure CoreOS for Kubernetes load balancer feature https://review.openstack.org/192425 | 23:09 |
| openstackgerrit | Ton Ngo proposed openstack/magnum: Configure Ironic for Kubernetes load balancer feature https://review.openstack.org/192426 | 23:09 |
| openstackgerrit | Ton Ngo proposed openstack/magnum: Configure Fedora Atomic for Kubernetes load balancer feature https://review.openstack.org/191878 | 23:09 |
| *** openstackgerrit has quit IRC | 23:16 | |
| *** openstackgerrit has joined #openstack-containers | 23:16 | |
| *** david-lyle has quit IRC | 23:17 | |
| *** hongbin has quit IRC | 23:20 | |
| *** banix has joined #openstack-containers | 23:21 | |
| *** harshs has quit IRC | 23:21 | |
| *** harshs has joined #openstack-containers | 23:22 | |
| *** eliqiao has quit IRC | 23:27 | |
| openstackgerrit | Surojit Pathak proposed openstack/magnum: Backend support for magnum service healthcheck https://review.openstack.org/220702 | 23:27 |
| *** EricGonczer_ has joined #openstack-containers | 23:43 | |
| *** adrian_otto has quit IRC | 23:46 | |
| *** adrian_otto has joined #openstack-containers | 23:48 | |
| *** achanda_ has joined #openstack-containers | 23:55 | |
| *** yuanying has quit IRC | 23:55 | |
| *** banix has quit IRC | 23:56 | |
| *** achanda_ has quit IRC | 23:57 | |
| *** alex_klimov has quit IRC | 23:58 | |
| *** achanda has quit IRC | 23:58 | |
| *** adrian_otto has quit IRC | 23:59 | |
| *** yuanying has joined #openstack-containers | 23:59 | |
| *** wshao has joined #openstack-containers | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!