Wednesday, 2015-08-05

*** SourabhP has quit IRC00:01
openstackgerritEli Qiao proposed openstack/magnum: API: Handler exception when doing container-list  https://review.openstack.org/19900700:02
*** zul has joined #openstack-containers00:09
*** achanda_ has quit IRC00:11
*** ctrath has joined #openstack-containers00:13
*** Tango|2 has quit IRC00:55
*** ctrath has quit IRC00:55
*** banix has quit IRC00:57
*** suro-patz has quit IRC00:59
*** ashuk has quit IRC01:04
*** david-lyle has joined #openstack-containers01:19
*** erkules has joined #openstack-containers01:20
*** ashuk has joined #openstack-containers01:21
*** shuquan has joined #openstack-containers01:22
*** erkules_ has quit IRC01:22
*** shuquan_ has joined #openstack-containers01:27
*** shuquan has quit IRC01:28
*** shuquan_ is now known as shuquan01:28
*** gangil1 has joined #openstack-containers01:29
*** ashuk has quit IRC01:30
*** jruano has quit IRC01:30
*** gangil has quit IRC01:32
*** gangil1 has quit IRC01:33
*** jruano has joined #openstack-containers01:44
*** unicell1 has quit IRC01:48
*** daneyon_ has quit IRC01:49
*** julim has joined #openstack-containers01:51
*** sdake_ has quit IRC02:04
*** sdake has joined #openstack-containers02:04
*** dims has quit IRC02:04
*** zz_dimtruck is now known as dimtruck02:04
*** achanda has joined #openstack-containers02:07
*** zul has quit IRC02:09
*** achanda has quit IRC02:14
*** humble_ has joined #openstack-containers02:24
*** Tennyson has joined #openstack-containers02:26
*** mathspanda has joined #openstack-containers02:26
*** humble__ has quit IRC02:28
*** achanda has joined #openstack-containers02:28
*** humble__ has joined #openstack-containers02:32
*** humble_ has quit IRC02:35
*** ctrath has joined #openstack-containers02:47
*** achanda_ has joined #openstack-containers02:54
*** achanda has quit IRC02:55
*** achanda has joined #openstack-containers03:03
*** achanda_ has quit IRC03:03
*** dimtruck is now known as zz_dimtruck03:15
openstackgerritHua Wang proposed openstack/magnum: Replace etcd ports by its offical ports  https://review.openstack.org/20933003:21
*** achanda has quit IRC03:38
*** suro-patz has joined #openstack-containers03:51
*** coolsvap|away is now known as coolsvap03:54
*** jruano has quit IRC03:55
*** jruano has joined #openstack-containers03:57
*** chandankumar has joined #openstack-containers04:09
*** ctrath has quit IRC04:19
*** Tango|2 has joined #openstack-containers04:22
*** jwcroppe has joined #openstack-containers04:23
*** fawadkhaliq has joined #openstack-containers04:25
*** harshs has joined #openstack-containers04:33
*** julim has quit IRC04:38
*** achanda has joined #openstack-containers04:41
*** jruano has quit IRC04:46
*** fawadkhaliq has quit IRC04:57
*** fawadkhaliq has joined #openstack-containers04:58
*** suro-patz has quit IRC05:02
*** harshs has quit IRC05:04
openstackgerritMerged openstack/magnum: Updated from global requirements  https://review.openstack.org/20870105:06
*** shuquan has quit IRC05:11
*** shuquan has joined #openstack-containers05:12
*** Bhavya has joined #openstack-containers05:14
*** SourabhP has joined #openstack-containers05:48
*** shuquan has quit IRC05:50
*** shuquan has joined #openstack-containers05:51
*** banix has joined #openstack-containers05:53
*** adrian_otto has joined #openstack-containers06:10
*** apuimedo has joined #openstack-containers06:12
*** banix has quit IRC06:16
*** yuanying has joined #openstack-containers06:16
*** shuquan has quit IRC06:20
*** shuquan has joined #openstack-containers06:23
*** funzo has quit IRC06:23
*** SourabhP has quit IRC06:26
*** shuquan_ has joined #openstack-containers06:27
*** adrian_otto has quit IRC06:27
*** shuquan has quit IRC06:27
*** shuquan_ is now known as shuquan06:27
*** ishant has joined #openstack-containers06:28
*** shuquan has quit IRC06:35
*** vilobhmm has left #openstack-containers06:41
*** achanda has quit IRC06:42
*** shuquan has joined #openstack-containers06:43
*** alex_klimov has joined #openstack-containers06:52
*** unicell has joined #openstack-containers06:54
*** Bhavya has quit IRC06:55
*** Tango|2 has quit IRC06:57
*** j___ has joined #openstack-containers07:08
*** irenab has quit IRC07:10
*** Bhavya has joined #openstack-containers07:10
*** erkules has quit IRC07:13
*** erkules has joined #openstack-containers07:13
*** macjack has joined #openstack-containers07:19
*** ganga_ has joined #openstack-containers07:19
*** ganga_ has quit IRC07:20
*** gangil has joined #openstack-containers07:21
*** funzo has joined #openstack-containers07:24
*** Marga_ has joined #openstack-containers07:27
*** Marga_ has quit IRC07:27
*** Marga_ has joined #openstack-containers07:28
*** shuquan has quit IRC07:33
*** gangil has quit IRC07:37
*** funzo has quit IRC07:42
*** shuquan has joined #openstack-containers07:45
*** shuquan has quit IRC07:59
*** diga has quit IRC08:02
*** diga has joined #openstack-containers08:03
*** fawadkhaliq has quit IRC08:06
*** mathspanda has quit IRC08:20
*** mathspanda has joined #openstack-containers08:21
*** kmARC has joined #openstack-containers08:23
*** belmoreira has joined #openstack-containers08:23
*** barra204 has quit IRC08:25
*** fawadkhaliq has joined #openstack-containers08:28
*** jwcroppe has quit IRC08:29
openstackgerritMerged openstack/magnum: Remove incorrect variable in etcd.conf  https://review.openstack.org/20895008:33
*** jwcroppe has joined #openstack-containers08:35
*** shuquan has joined #openstack-containers08:52
*** shuquan has quit IRC08:58
*** shuquan has joined #openstack-containers08:59
*** Marga_ has quit IRC09:00
*** Marga_ has joined #openstack-containers09:11
*** funzo has joined #openstack-containers09:12
*** shuquan has quit IRC09:13
*** humble_ has joined #openstack-containers09:16
*** humble__ has quit IRC09:19
*** shuquan has joined #openstack-containers09:20
*** Bhavya has quit IRC09:26
*** Bhavya has joined #openstack-containers09:26
*** Tennyson has quit IRC09:33
*** jwcroppe has quit IRC09:38
*** mathspanda has quit IRC09:39
*** jwcroppe has joined #openstack-containers09:39
openstackgerritHua Wang proposed openstack/magnum: Replace etcd ports by its offical ports  https://review.openstack.org/20933009:39
*** jwcroppe has quit IRC09:44
*** dims has joined #openstack-containers10:00
*** dims has quit IRC10:00
*** dims has joined #openstack-containers10:00
*** humble_ has quit IRC10:02
*** Marga__ has joined #openstack-containers10:16
*** Marga_ has quit IRC10:16
*** shuquan has quit IRC10:21
*** Marga__ has quit IRC10:27
*** coolsvap is now known as coolsvap|away10:33
*** jwcroppe has joined #openstack-containers10:45
*** yuanying has quit IRC10:46
*** jasondotstar has joined #openstack-containers10:50
*** jruano has joined #openstack-containers10:50
*** h00327910__ has quit IRC10:58
*** Marga_ has joined #openstack-containers11:05
*** irenab has joined #openstack-containers11:11
*** dims_ has joined #openstack-containers11:26
*** dims has quit IRC11:28
*** j___ has quit IRC11:32
*** jwcroppe has quit IRC11:33
*** Marga_ has quit IRC11:43
*** mathspanda has joined #openstack-containers11:43
*** coolsvap|away is now known as coolsvap11:44
*** dims_ has quit IRC11:44
*** j___ has joined #openstack-containers11:46
*** julim has joined #openstack-containers11:49
*** dims has joined #openstack-containers11:51
*** Marga_ has joined #openstack-containers12:02
*** Bhavya has quit IRC12:07
*** jwcroppe has joined #openstack-containers12:12
*** alejandrito has joined #openstack-containers12:19
*** shuquan has joined #openstack-containers12:23
*** chandankumar has quit IRC12:36
*** fawadkhaliq has quit IRC12:38
*** jkraj has joined #openstack-containers12:43
*** j___ has quit IRC12:43
*** jwcroppe has quit IRC12:43
*** j___ has joined #openstack-containers12:55
*** dims_ has joined #openstack-containers12:57
*** dims has quit IRC12:59
*** j___ has quit IRC12:59
*** jjfreric has joined #openstack-containers13:02
*** mathspanda has quit IRC13:04
*** zul has joined #openstack-containers13:05
*** alejandrito has quit IRC13:10
*** ishant has quit IRC13:11
*** mathspan_ has joined #openstack-containers13:14
*** wznoinsk1 is now known as wznoinsk13:18
*** sdake has quit IRC13:21
*** mathspan_ has quit IRC13:21
*** shuquan has quit IRC13:22
*** dave-mccowan has joined #openstack-containers13:23
*** dane_leblanc has joined #openstack-containers13:25
*** dave-mcc_ has joined #openstack-containers13:28
*** dave-mccowan has quit IRC13:29
*** coolsvap is now known as coolsvap|away13:30
*** dave-mccowan has joined #openstack-containers13:31
*** dave-mcc_ has quit IRC13:33
*** jjfreric has left #openstack-containers13:34
*** dims has joined #openstack-containers13:36
*** dims_ has quit IRC13:38
*** ashuk has joined #openstack-containers13:39
openstackgerritJay Lau proposed openstack/magnum: Update test cases for test_bay.py and test_baymodel.py  https://review.openstack.org/20907813:40
*** ashuk has quit IRC13:40
*** dims_ has joined #openstack-containers13:42
*** dims has quit IRC13:44
*** ctrath has joined #openstack-containers13:45
*** dims has joined #openstack-containers13:55
*** dims_ has quit IRC13:57
*** zz_dimtruck is now known as dimtruck14:02
*** harshs has joined #openstack-containers14:04
*** chandankumar has joined #openstack-containers14:07
*** jjfreric has joined #openstack-containers14:07
*** EricGonczer_ has joined #openstack-containers14:16
*** fawadkhaliq has joined #openstack-containers14:22
*** rods has quit IRC14:26
*** dims_ has joined #openstack-containers14:27
*** jjlehr has joined #openstack-containers14:28
*** dims has quit IRC14:29
*** shuquan has joined #openstack-containers14:30
*** muralia has joined #openstack-containers14:31
*** dims has joined #openstack-containers14:31
*** dims_ has quit IRC14:33
*** dims_ has joined #openstack-containers14:34
*** dims has quit IRC14:37
*** dims has joined #openstack-containers14:38
*** dims_ has quit IRC14:40
*** banix has joined #openstack-containers14:47
*** jruano has quit IRC14:49
*** banix has quit IRC14:57
*** banix has joined #openstack-containers15:00
*** agireud has joined #openstack-containers15:02
*** banix has quit IRC15:06
*** jjfreric has quit IRC15:11
*** gangil has joined #openstack-containers15:19
*** adrian_otto has joined #openstack-containers15:20
*** gangil has quit IRC15:23
*** shuquan has quit IRC15:23
*** daneyon has joined #openstack-containers15:33
*** shakamunyi has joined #openstack-containers15:35
*** daneyon has quit IRC15:36
*** jjlehr has quit IRC15:36
*** adrian_otto has quit IRC15:37
*** belmoreira has quit IRC15:39
*** adrian_otto has joined #openstack-containers15:39
*** ahcorporto has joined #openstack-containers15:40
*** adrian_otto has quit IRC15:41
*** harshs_ has joined #openstack-containers15:46
*** harshs has quit IRC15:49
*** harshs_ is now known as harshs15:49
*** Tango|2 has joined #openstack-containers15:49
*** sdake has joined #openstack-containers15:50
*** harshs has quit IRC15:56
*** EricGonczer_ has quit IRC15:56
*** daneyon has joined #openstack-containers15:57
*** dane_leblanc has quit IRC15:57
*** dims_ has joined #openstack-containers16:00
*** hongbin has joined #openstack-containers16:01
*** dims__ has joined #openstack-containers16:02
*** dims has quit IRC16:02
*** jjfreric has joined #openstack-containers16:03
*** EricGonczer_ has joined #openstack-containers16:03
*** dims_ has quit IRC16:04
*** dane_leblanc has joined #openstack-containers16:08
*** hongbin has quit IRC16:10
*** dims has joined #openstack-containers16:11
*** jjlehr has joined #openstack-containers16:12
*** dims__ has quit IRC16:13
*** eghobo has joined #openstack-containers16:15
*** kmARC has quit IRC16:18
*** unicell has quit IRC16:19
*** gangil has joined #openstack-containers16:21
*** ahcorporto has left #openstack-containers16:28
*** openstackgerrit_ has joined #openstack-containers16:30
*** linevan has joined #openstack-containers16:32
*** thomasem_ has joined #openstack-containers16:33
*** irenab has quit IRC16:35
*** irenab has joined #openstack-containers16:36
*** alex_klimov has quit IRC16:46
*** irenab has quit IRC16:46
*** irenab_ has joined #openstack-containers16:47
*** unicell has joined #openstack-containers16:51
*** harshs has joined #openstack-containers16:55
*** sdake has quit IRC16:58
*** ctrath has quit IRC17:01
*** jwcroppe has joined #openstack-containers17:03
*** openstackgerrit_ has quit IRC17:05
*** dims has quit IRC17:11
*** dims has joined #openstack-containers17:12
*** thomasem_ has quit IRC17:16
*** openstackgerrit_ has joined #openstack-containers17:24
*** achanda has joined #openstack-containers17:25
*** rods has joined #openstack-containers17:30
*** openstackgerrit_ has quit IRC17:34
*** erkules has quit IRC17:35
*** ctrath has joined #openstack-containers17:36
*** apuimedo has quit IRC17:37
*** erkules has joined #openstack-containers17:39
*** jjfreric1 has joined #openstack-containers17:39
*** apuimedo has joined #openstack-containers17:40
*** jwcroppe has quit IRC17:41
*** jwcroppe has joined #openstack-containers17:42
*** jjfreric has quit IRC17:43
*** Marga_ has quit IRC17:44
*** fawadkhaliq has quit IRC17:45
*** jwcroppe has quit IRC17:47
*** chandankumar has quit IRC17:50
openstackgerritDaneyon Hansen proposed openstack/magnum: Magnum Container Networking Spec  https://review.openstack.org/20468617:51
*** irenab_ has quit IRC17:55
*** SourabhP has joined #openstack-containers18:00
*** chandankumar has joined #openstack-containers18:03
*** kmARC has joined #openstack-containers18:05
*** s3wong has joined #openstack-containers18:09
*** diga has quit IRC18:09
*** diga has joined #openstack-containers18:11
*** Marga_ has joined #openstack-containers18:21
*** irenab has joined #openstack-containers18:25
mfalaticThoughts on what would cause pod-create to error with "ERROR: 'NoneType' object has no attribute 'status' (HTTP 500)"18:30
mfalatic? THings seemed fine up tot hat point18:30
*** irenab has quit IRC18:31
*** diga has quit IRC18:31
*** sdake has joined #openstack-containers18:32
*** diga has joined #openstack-containers18:33
*** apuimedo has quit IRC18:41
*** Marga_ has quit IRC18:42
*** openstackgerrit has quit IRC18:46
*** openstackgerrit has joined #openstack-containers18:46
*** jjfreric1 has quit IRC18:56
*** jjfreric has joined #openstack-containers19:10
*** jkraj has quit IRC19:13
*** achanda has quit IRC19:16
*** linevan has quit IRC19:20
*** irenab has joined #openstack-containers19:26
*** chandankumar has quit IRC19:31
*** Marga_ has joined #openstack-containers19:38
*** harshs has quit IRC19:45
*** irenab has quit IRC19:46
*** irenab has joined #openstack-containers19:47
*** jjfreric1 has joined #openstack-containers19:49
*** jjfreric has quit IRC19:51
*** Marga_ has quit IRC19:51
*** Marga_ has joined #openstack-containers19:52
*** irenab_ has joined #openstack-containers19:53
*** irenab has quit IRC19:54
*** irenab_ has quit IRC19:57
*** jjfreric has joined #openstack-containers19:57
*** jjfreric1 has quit IRC19:57
*** EricGonczer_ has quit IRC19:58
*** jjfreric1 has joined #openstack-containers20:00
*** agireud has quit IRC20:01
*** jjfreric has quit IRC20:02
*** irenab has joined #openstack-containers20:07
*** jasondotstar has quit IRC20:08
*** harshs has joined #openstack-containers20:12
*** suro-patz has joined #openstack-containers20:13
*** jjfreric1 has left #openstack-containers20:15
suro-patzadrian_otto: https://wiki.openstack.org/wiki/Meetings/Ironic-neutron20:15
*** dimtruck is now known as zz_dimtruck20:17
*** dane_leblanc_ has joined #openstack-containers20:25
*** dane_leblanc__ has joined #openstack-containers20:26
*** dane_leblanc has quit IRC20:28
*** dane_leblanc_ has quit IRC20:29
*** jjlehr has quit IRC20:34
*** irenab has quit IRC20:34
*** irenab has joined #openstack-containers20:39
*** irenab has quit IRC20:44
*** jjfreric has joined #openstack-containers20:44
*** irenab has joined #openstack-containers20:46
*** kmARC has quit IRC20:57
*** kmARC has joined #openstack-containers20:59
*** zz_dimtruck is now known as dimtruck20:59
tcammann1mfalatic: check the heat engine logs21:01
tcammann1oh no, completely useless advice with pods. I have seen this before with bay creates where looking at heat would be useful21:02
*** jwcroppe has joined #openstack-containers21:02
*** irenab has quit IRC21:03
*** irenab has joined #openstack-containers21:03
-openstackstatus- NOTICE: Zuul has been restarted to resolve a reconfiguration failure: previously running jobs have been reenqueued but change events between 19:50-20:54 UTC have been lost and will need to be rechecked or their approvals reapplied to trigger testing.21:04
*** kmARC has quit IRC21:06
*** dave-mccowan has quit IRC21:08
-openstackstatus- NOTICE: Correction: change events between 20:50-20:54 UTC (during the restart only) have been lost and will need to be rechecked or their approvals reapplied to trigger testing.21:09
mfalatichttps://bugs.launchpad.net/magnum/+bug/148188921:10
openstackLaunchpad bug 1481889 in Magnum "pod-create fails ('NoneType' object has no attribute 'status')" [Undecided,New]21:10
*** julim has quit IRC21:10
mfalatictcammann - not seeing anything in the other logs (e.g., heat) at this point.21:10
mfalatic(which seems to be what you said after you asked. :-D21:10
mfalatictcammann1 that is21:11
*** alex_klimov has joined #openstack-containers21:18
*** jwcroppe has quit IRC21:25
*** jwcroppe has joined #openstack-containers21:26
*** jwcroppe has quit IRC21:32
*** irenab has quit IRC21:34
openstackgerritHongbin Lu proposed openstack/magnum: Add a new field 'master_count' to bay in API  https://review.openstack.org/20724621:35
openstackgerritHongbin Lu proposed openstack/magnum: Add a new field 'master_count' to bay in API  https://review.openstack.org/20724621:37
mfalaticlooks like createPod is returning None.21:40
*** jjlehr has joined #openstack-containers21:40
*** muralia1 has joined #openstack-containers21:42
*** irenab has joined #openstack-containers21:42
*** muralia has quit IRC21:42
*** zul has quit IRC21:45
*** irenab_ has joined #openstack-containers21:46
*** irenab has quit IRC21:47
*** irenab_ is now known as irenab21:47
mfalaticAdded more detail to bug 148188921:54
openstackbug 1481889 in Magnum "pod-create fails ('NoneType' object has no attribute 'status')" [Undecided,New] https://launchpad.net/bugs/148188921:54
mfalaticMagnum Helpme22:00
*** jjlehr has quit IRC22:01
*** dane_leblanc__ has quit IRC22:10
*** vilobhmm has joined #openstack-containers22:17
*** alex_klimov has quit IRC22:18
*** SourabhP has quit IRC22:22
*** irenab has quit IRC22:24
*** ctrath has quit IRC22:25
*** irenab has joined #openstack-containers22:25
*** jjfreric has quit IRC22:27
*** achanda has joined #openstack-containers22:28
*** SourabhP has joined #openstack-containers22:32
tcammann1The void stares back at mfalatic22:32
*** hongbin has joined #openstack-containers22:33
mfalaticIt finds me lacking... a valid variable.22:33
hongbinI am here22:33
mfalatichongbin - has anything substantial changed about how pods get created in the last week?22:33
mfalaticsee 148188922:33
mfalatichttps://launchpad.net/bugs/148188922:33
openstackLaunchpad bug 1481889 in Magnum "pod-create fails ('NoneType' object has no attribute 'status')" [Undecided,New]22:33
*** linevan has joined #openstack-containers22:33
mfalatichongbin - Someone else said they've seen the same sort of problem in the last week and I wonder if you might have some insight on this. all I did was reinstall devstack and magnum as I did before.22:35
hongbinmfalatic: Could you try the same command in kubectl to see if it works?22:35
mfalaticI can create bays and all that, but pod creation is failing and it's because the resp is empty which seems rather odd22:35
mfalaticsame exact command?22:35
*** suro-patz has quit IRC22:36
hongbinmfalatic: Not remember exactly, something like: kubectl create pod -f ...22:36
mfalaticI'm not as familiar with it. I need to install kubectl I presume22:36
mfalaticfound it22:38
hongbinhttps://github.com/openstack/magnum/blob/master/doc/source/dev/dev-quickstart.rst#using-kubernetes22:38
hongbinJust download it22:38
hongbinmfalatic: Another thing to check: ssh to the bay nodes and make sure they have internet connection22:39
mfalaticwill try to do that. no idea what the kubectl args would be for this.22:40
*** suro-patz has joined #openstack-containers22:40
*** dimtruck is now known as zz_dimtruck22:42
hongbinmfalatic: kubectl create -f pod.json22:42
hongbinthe pod.json is a manifest file22:43
mfalatichmm well, I don't have a manifest file though I can probably create one from the manifest dump I did.22:43
hongbinYou can download it from kubernetes22:44
mfalaticI'm going a node-list (naively?) and not seeing any nodes.22:44
mfalatic*doing22:44
hongbintypes these command:22:44
hongbinwget https://github.com/GoogleCloudPlatform/kubernetes/releases/download/v0.15.0/kubernetes.tar.gz22:45
mfalaticAlready did that.22:45
*** irenab has quit IRC22:45
hongbintar -xvzf kubernetes.tar.gz22:45
mfalaticFollowing the steps of the quickstart into the redis area.22:45
hongbincd kubernetes/examples/redis/v1beta322:45
hongbincd kubernetes/examples/redis/v1beta322:45
mfalaticit's the first redis part that fails.22:45
mfalaticyep22:45
hongbinkubectl create -f redis-master.yaml22:45
hongbinhow it fails?22:45
mfalaticError: Post http://localhost:8080/api/v1beta3/namespaces/default/pods: dial tcp 127.0.0.1:8080: connection refused22:46
mfalaticI tried that earlier but wasn't sure if I had the right args.22:46
hongbinuse the -s flag22:46
mfalaticNot expecting a debug of my setup but it worked prior to reinstalling devstack.22:46
mfalatic-s what?22:48
hongbinSorry, this is the command: kubectl create -f redis-master.yaml -s $API_ADDRESS22:48
mfalatic(I've not used kubectl extensively before now)22:48
hongbinYou can find the api address by: magnum bay-show k8sbay22:49
mfalatichome/localadmin/kubernetes/platforms/linux/amd64/kubectl create -f redis-master.yaml -s 172.24.4.8:808022:53
mfalaticError: an error on the server has prevented the request from succeeding (post pods)22:53
mfalaticthat's not exactly informative22:53
hongbinmfalatic: You k8s bay is not setup correctly22:53
hongbinHave you tried to destroy and re-create the bay?22:53
mfalaticStack CREATE completed successfully22:53
mfalaticI actually did that once already.22:54
*** irenab has joined #openstack-containers22:54
mfalaticcan certainly try again.22:54
hongbinIf it doesn't work, you need to SSH to the master and debug it there.22:55
mfalaticis there a special way to ssh to the master?22:56
mfalatic(I can connect but it's refusing the key)22:56
mfalaticand yes I created a key earlier22:56
mfalaticactually, which one is the master? the node address for k8sbay?22:56
mfalaticjust making sure I'm at least on the right track22:57
*** jjlehr has joined #openstack-containers22:58
mfalatic(and for the record, the fact that someone else also ran into the same wall and hadn't before makes me wonder if there's some new or changed step not reflected in the quickstart now.)22:58
mfalatic(assuming this isn't a code bug)22:58
hongbinmfalatic: You are the first one to report this error, as far as I know.23:01
hongbinuse nova list to find the master23:01
mfalaticOk, I was apparently able to ssh to the master (k8sbay) as user "minion"23:01
hongbinthen ssh minion@$MASTER_IP23:01
hongbink23:01
hongbintry: curl google.ca23:01
mfalaticah23:01
mfalaticthat helped23:01
hongbinit works?23:01
mfalaticthe nova bit.23:02
mfalatichang on while I try the curl tests23:02
mfalatichmm23:02
mfalaticexternal dns is clearly not working right. worked last week.23:02
mfalaticwonder if neutron changed something now.23:02
mfalaticdamn23:04
hongbinpossibly it has something to do with the iptables23:04
*** achanda has quit IRC23:04
mfalaticwhat's annoying is I have no way to verify if this was the same way before when it worked (as long as it can see local addresses should it matter if it can route to the outside world?)23:05
mfalaticodd. I provided the bay with DNS when I created it (8.8.8.8)... I can see that. I can curl by IP.23:08
mfalaticbut I can't resolve DNS FWIW23:09
mfalaticand I'm not even sure that matters in this case.23:09
mfalaticnameserver 8.8.8.823:10
mfalatic. /etc/resolv.conf on master shows it: nameserver 8.8.8.823:11
hongbinNo idea. I am not good at debuging DNS....23:11
mfalaticNot sure it matters anyway. I can certainly route out by IP and I don't think that's the problem (but will ponder it just the same)23:15
*** irenab has quit IRC23:15
*** irenab_ has joined #openstack-containers23:15
mfalaticI'll probbaly tear it down and restack it.23:16
mfalaticI saved the old stack dir so I might unstack and restack based on that. At least I know that one worked.23:16
mfalaticTango|2 - you mentioned you've seen this issue as well? Or do I have the right username23:18
Tango|2Hi mfalatic: you mean the 500 on pod-create?23:19
mfalaticyep23:19
Tango|2yes, on a new devstack 2 days ago23:19
mfalaticspecifically the resp being None which leads to that.23:20
mfalatichttps://bugs.launchpad.net/magnum/+bug/148188923:20
openstackLaunchpad bug 1481889 in Magnum "pod-create fails ('NoneType' object has no attribute 'status')" [Undecided,New]23:20
mfalaticWere you able to get past that point?23:20
mfalaticRight now it seems I can't even get DNS to work on the master but I'm not sure it worked previously (though I can curl to IP addresses with ease)23:22
mfalatictrying to narrow down if it's a fluke or something systematic about devstack in the last few days.23:23
*** yuanying has joined #openstack-containers23:23
mfalaticif I don't get any further I will likely unstack and restack using the old stack I had before (whihc I happened to save)23:24
mfalaticsee if that works where this fails, then try to work backwards to what changed. And if it still fails then it's something else.23:25
mfalaticTango|2 If you get a chance to confirm this bug please add a note to the bug. It would be helpful to know that it's reproducible.23:28
Tango|2mfalatic: ok I will double check23:29
mfalatic(and if not, well, it's something unique here)23:30
mfalaticsee the bug for the exact output. It's like the create doesn't fail but instead breaks somehow, returning a null response.23:30
mfalatic(doesn't fail the usual way it should)23:31
mfalaticTango|2 one question - did you find a workaround for it, or did it just block you and that's where it stands?23:31
Tango|2mfalatic: For me I am working on actually creating pods in k8s, so for now I just log into the master and run kubectl23:33
Tango|2mfalatic: So that's my workaround at this time.23:33
mfalaticwas there a bug report I missed?23:37
*** Marga_ has quit IRC23:39
*** irenab has joined #openstack-containers23:44
*** irenab_ has quit IRC23:44
mfalaticFWIW bay-update fails as well - it seems that the failed pod create breaks lots of other things (it appeared to work prior to that)23:48
*** julim has joined #openstack-containers23:50
*** harshs has quit IRC23:51
*** gangil has quit IRC23:52
*** hongbin has quit IRC23:54
*** eghobo has quit IRC23:55
*** linevan has quit IRC23:55
*** suro-patz has quit IRC23:56
*** sdake has quit IRC23:56
*** rods has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!