Monday, 2015-06-08

*** eghobo has joined #openstack-containers00:04
*** sdake_ has joined #openstack-containers00:06
*** sdake has quit IRC00:10
*** eghobo has quit IRC00:16
*** rongze_ has quit IRC00:26
*** jay-lau-513 has quit IRC00:26
*** sdake has joined #openstack-containers00:32
*** sdake_ has quit IRC00:35
openstackgerritDavanum Srinivas (dims) proposed openstack/magnum: Add netaddr to requirements  https://review.openstack.org/18903100:44
*** kebray has joined #openstack-containers00:48
*** kebray has quit IRC00:49
*** jjlehr has quit IRC00:55
*** sdake_ has joined #openstack-containers01:06
*** dims__ has quit IRC01:06
*** sdake__ has joined #openstack-containers01:08
*** sdake has quit IRC01:09
*** sdake__ is now known as sdake01:09
*** sdake_ has quit IRC01:13
*** erkules_ has joined #openstack-containers01:32
*** eliqiao1 has quit IRC01:34
*** erkules has quit IRC01:35
madhurisdake, hi, did you see zaneb?01:37
madhuriI want that patch to land soon01:37
*** eliqiao has joined #openstack-containers01:37
sdakelink plz01:41
sdakeno didn't see01:41
openstackgerritMerged openstack/magnum: Add netaddr to requirements  https://review.openstack.org/18903101:43
*** sdake_ has joined #openstack-containers01:43
*** sdake has quit IRC01:46
*** sdake has joined #openstack-containers01:54
*** sdake_ has quit IRC01:58
*** dims_ has joined #openstack-containers01:58
*** Kennan2 has joined #openstack-containers02:03
*** dims_ has quit IRC02:03
*** Kennan has quit IRC02:04
*** sthillma has joined #openstack-containers02:10
*** sthillma_ has joined #openstack-containers02:11
*** sthillma has quit IRC02:15
*** sthillma_ is now known as sthillma02:15
*** kebray has joined #openstack-containers02:24
*** sdake_ has joined #openstack-containers02:25
openstackgerritEli Qiao proposed openstack/magnum: WIP: Add periodict task support for to rpc service  https://review.openstack.org/18709002:27
openstackgerritEli Qiao proposed openstack/magnum: WIP: Add periodic task to bay conductor  https://review.openstack.org/18711402:27
madhurisdake, This one https://review.openstack.org/#/c/188059/02:28
*** hongbin_desktop has quit IRC02:29
*** sdake has quit IRC02:29
*** sthillma has quit IRC02:30
*** sdake has joined #openstack-containers02:44
*** sdake_ has quit IRC02:48
*** julim has joined #openstack-containers02:50
*** eghobo has joined #openstack-containers02:54
*** dims_ has joined #openstack-containers03:03
sdakemadhuri ping re zane'bs patch - got a link?03:04
*** eghobo has quit IRC03:07
madhuriI shared the link03:08
madhurihttps://review.openstack.org/#/c/188059/03:08
*** dims_ has quit IRC03:09
madhurisdake, around?03:13
sdakesure what do you need from me madhuri03:14
*** kebray has quit IRC03:14
sdakei looked at bug, looks like waiting on action from zaneb03:14
openstackgerrityuntongjin proposed openstack/magnum: Add support for API microversions  https://review.openstack.org/18497503:14
sdakebug/review03:14
madhuriYes03:14
sdakeyou want me to ping zaneb then?03:14
*** kebray has joined #openstack-containers03:15
madhuriNo no03:15
madhuriLeave that review03:15
madhuriI want to discuss about the tls support03:15
sdakei need more punishment, shoot ;)03:16
*** vilobhmm has joined #openstack-containers03:16
madhuriI configures kubernetes-apiserver with certificate and keys03:16
madhuriIt started well03:16
madhuriBut it seems the apiserver listens on different ports for secure and insecure connection03:16
madhuriI also remember I read it in their docs03:17
madhuriThe apiserver has 3 ports03:17
madhuriOne for secure connection, second for insecure connection and third for read-only insecure03:18
*** snrism has joined #openstack-containers03:19
sdakeok got that03:20
sdakethe problem is which?03:20
madhuriIf you wanna have a look http://paste.openstack.org/show/272770/03:21
madhurisdake, I have my lunch time now03:21
madhuriSorry03:21
madhuriBut I will be back after an hr03:22
sdakeenjoy03:22
madhuriLunch timing is fixed03:22
sdaketoo late to look at reviews atm03:22
sdake9pm time to eat soon :)03:22
*** brendenblanco has quit IRC03:27
*** bradjones|away has quit IRC03:27
*** brendenblanco has joined #openstack-containers03:28
*** bradjones has joined #openstack-containers03:28
*** bradjones has quit IRC03:28
*** bradjones has joined #openstack-containers03:28
*** julim has quit IRC03:31
openstackgerritHongbin Lu proposed openstack/magnum: Initial Heat template for Mesos  https://review.openstack.org/18917903:44
openstackgerritHongbin Lu proposed openstack/magnum: WIP: Elements for building Mesos image  https://review.openstack.org/18918003:44
*** coolsvap|afk is now known as coolsvap03:44
*** eghobo has joined #openstack-containers03:53
*** eghobo has quit IRC03:56
*** eghobo has joined #openstack-containers04:03
madhuriHi sdake04:14
sdakeshoot04:14
madhuriOk04:15
madhuriSo after configuring apiserver with cert04:15
madhuriI tried to run a command, but it failed04:15
madhuriDid you see the paste?04:17
madhuriHere is the error http://paste.openstack.org/show/272925/04:18
madhuriI also noticed that the URL still doesn't have https04:18
*** unicell1 has joined #openstack-containers04:31
*** achanda has joined #openstack-containers04:33
*** unicell has quit IRC04:33
*** eghobo_ has joined #openstack-containers04:33
*** eghobo has quit IRC04:37
*** Drago has quit IRC04:40
*** eghobo has joined #openstack-containers04:40
*** eghobo_ has quit IRC04:41
*** achanda has quit IRC04:55
*** kebray has quit IRC04:56
sdakemadhuri doesn't kubectl take an argument for target http port and host04:58
madhuriYes -s option04:58
madhuriin the paste above I have specified the secure port using -s option04:59
madhuriDo you have any idea how do we make kubectl to send https request rather than http?05:00
*** achanda has joined #openstack-containers05:13
*** belmoreira has joined #openstack-containers05:20
*** achanda_ has joined #openstack-containers05:22
*** achanda has quit IRC05:23
eliqiaosdake: r u around?05:27
sdakewound me05:28
*** achanda_ has quit IRC05:28
sdakemadhuri no idea05:28
sdakemadhuri complain #google-containers in about 8 hours ;)05:28
eliqiaosdake: I think the periodic task patches are ready for reviewing.. I wonder if you have time to do a reviewing?05:29
sdake10;30 at night05:29
sdakeheaded to the rack05:29
sdakewe have a large core team though05:29
sdakefeel free to submit them, somebody will get to them05:30
sdakei am out of the office next week on travel05:30
eliqiaosdake: ah okay, I saw you are very active in my day-time , so I though your TZ are closed to me... seems I am very bad.05:30
*** snrism has quit IRC05:30
eliqiaos/bad/wrong...05:30
sdakeits ok I have a bad habit of living on irc05:31
eliqiaosdake:  yeah , cool, thanks . good team :)05:31
eliqiaoyou working so hard ..05:31
sdakemore like playing05:31
eliqiao sdake: have a good travel ;)05:32
*** vilobhmm has quit IRC05:32
sdakethanks05:32
*** apuimedo has joined #openstack-containers05:37
*** eghobo_ has joined #openstack-containers05:38
*** vilobhmm has joined #openstack-containers05:39
*** eghobo has quit IRC05:41
*** eghobo has joined #openstack-containers05:46
*** eghobo_ has quit IRC05:47
*** Kennan2 has quit IRC05:47
*** rongze has joined #openstack-containers05:47
*** Kennan has joined #openstack-containers05:48
*** destiny has joined #openstack-containers06:02
*** belmoreira has quit IRC06:06
*** snrism has joined #openstack-containers06:18
*** achanda has joined #openstack-containers06:19
*** jay-lau-513 has joined #openstack-containers06:22
*** snrism_ has joined #openstack-containers06:26
*** snrism has quit IRC06:26
*** BertrandN has joined #openstack-containers06:34
openstackgerritEli Qiao proposed openstack/magnum: Add periodict task support for to rpc service  https://review.openstack.org/18709006:35
*** nshaikh has joined #openstack-containers06:43
*** tobe has joined #openstack-containers06:45
openstackgerritBaohua Yang proposed openstack/magnum: Fix Bug #1462887  https://review.openstack.org/18920306:59
openstackbug 1462887 in Magnum "The PodFactory base class inherits from the ContainerBase Class directory" [Undecided,New] https://launchpad.net/bugs/1462887 - Assigned to Baohua Yang (yangbaohua)06:59
*** vilobhmm has quit IRC07:02
*** achanda has quit IRC07:02
*** suro-patz has joined #openstack-containers07:02
*** snrism_ has quit IRC07:03
*** achanda has joined #openstack-containers07:04
*** suro-patz has quit IRC07:11
*** suro-patz has joined #openstack-containers07:12
*** snrism has joined #openstack-containers07:13
*** eghobo has quit IRC07:16
*** achanda has quit IRC07:17
*** rongze has quit IRC07:39
*** snrism has quit IRC07:39
*** snrism has joined #openstack-containers07:40
*** snrism has quit IRC07:46
*** snrism has joined #openstack-containers07:46
*** ahcorporto has joined #openstack-containers08:00
*** belmoreira has joined #openstack-containers08:00
*** suro-patz has quit IRC08:02
*** yuanying has quit IRC08:13
*** achanda has joined #openstack-containers08:14
*** dims_ has joined #openstack-containers08:28
*** achanda has quit IRC08:29
*** achanda has joined #openstack-containers08:30
*** rongze has joined #openstack-containers08:31
*** dims_ has quit IRC08:33
*** achanda has quit IRC08:35
*** achanda has joined #openstack-containers08:49
*** achanda has quit IRC08:56
*** achanda has joined #openstack-containers08:57
*** achanda has quit IRC09:03
*** achanda has joined #openstack-containers09:31
*** achanda has quit IRC09:33
*** achanda has joined #openstack-containers09:34
*** kbyrne has quit IRC09:45
*** snrism has quit IRC09:48
*** kbyrne has joined #openstack-containers09:48
*** achanda_ has joined #openstack-containers09:51
*** achanda has quit IRC09:53
openstackgerritTom Cammann proposed openstack/magnum: Fix ignored E121 to E125 pep 8 rules  https://review.openstack.org/18924209:57
*** sdake has quit IRC10:00
*** openstackgerrit has quit IRC10:09
*** dims_ has joined #openstack-containers10:09
*** openstackgerrit has joined #openstack-containers10:09
*** snrism has joined #openstack-containers10:17
*** snrism has quit IRC10:23
*** achanda_ has quit IRC10:28
digahongbin: Hi10:29
*** achanda has joined #openstack-containers10:35
*** achanda has quit IRC10:42
*** achanda has joined #openstack-containers10:43
*** achanda has quit IRC10:45
*** achanda has joined #openstack-containers10:46
*** coolsvap is now known as coolsvap|afk10:47
*** snrism has joined #openstack-containers10:51
*** achanda has quit IRC10:52
openstackgerritTom Cammann proposed openstack/magnum: Fix ignored E121 to E125 pep 8 rules  https://review.openstack.org/18924210:55
*** snrism has quit IRC10:56
*** ubuntu has joined #openstack-containers10:59
*** ubuntu is now known as tcammann11:00
*** jay-lau-513 has quit IRC11:07
openstackgerritDavanum Srinivas (dims) proposed openstack/python-magnumclient: Sync from latest oslo-incubator  https://review.openstack.org/18912511:09
*** madhuri_ has joined #openstack-containers11:09
openstackgerritBradley Jones proposed openstack/magnum: Web Interface for Magnum in Horizon  https://review.openstack.org/18895811:23
*** tobe has quit IRC11:26
*** alex_klimov has joined #openstack-containers11:46
*** jjlehr has joined #openstack-containers12:37
*** jjlehr has quit IRC12:43
*** achanda has joined #openstack-containers12:52
*** achanda has quit IRC13:20
*** achanda has joined #openstack-containers13:21
*** rlrevell has joined #openstack-containers13:21
*** rlrevell has quit IRC13:23
*** achanda has quit IRC13:26
*** rpothier has joined #openstack-containers13:27
*** ahcorporto has quit IRC13:33
*** rlrevell has joined #openstack-containers13:35
*** adrian_otto has joined #openstack-containers13:36
*** dboik has quit IRC13:36
*** julim has joined #openstack-containers13:36
*** sdake has joined #openstack-containers13:48
*** jjlehr has joined #openstack-containers13:50
*** dboik has joined #openstack-containers13:57
*** sdake_ has joined #openstack-containers14:00
*** sdake has quit IRC14:04
*** logan2 has quit IRC14:12
*** achanda has joined #openstack-containers14:12
*** logan2 has joined #openstack-containers14:13
*** achanda has quit IRC14:18
*** nshaikh has left #openstack-containers14:19
*** hongbin has joined #openstack-containers14:21
*** Drago has joined #openstack-containers14:27
*** Drago has quit IRC14:28
*** Drago has joined #openstack-containers14:28
*** unicell has joined #openstack-containers14:31
*** unicell1 has quit IRC14:31
*** adrian_otto has quit IRC14:42
*** madhuri_ has quit IRC14:44
*** achanda has joined #openstack-containers14:56
openstackgerritZane Bitter proposed openstack/magnum: Eliminate eval from swagger.py in k8sclient  https://review.openstack.org/18805914:57
*** achanda has quit IRC15:02
*** belmoreira has quit IRC15:06
*** snrism has joined #openstack-containers15:10
*** suro-patz has joined #openstack-containers15:10
*** adrian_otto has joined #openstack-containers15:11
*** suro-patz1 has joined #openstack-containers15:15
*** snrism has quit IRC15:15
*** suro-patz has quit IRC15:17
*** kebray has joined #openstack-containers15:21
*** adrian_otto has quit IRC15:30
*** BertrandN has quit IRC15:31
*** suro-patz1 has quit IRC15:37
*** Drago has quit IRC15:38
*** dane_leblanc has joined #openstack-containers15:38
*** unicell has quit IRC15:41
*** sdake_ has quit IRC15:42
*** rpothier has quit IRC15:47
*** sdake has joined #openstack-containers15:47
*** snrism has joined #openstack-containers15:48
*** sdake_ has joined #openstack-containers15:48
*** sdake has quit IRC15:52
*** sdake_ is now known as sdake15:56
*** daneyon has joined #openstack-containers15:56
*** eghobo has joined #openstack-containers15:58
*** rongze has quit IRC15:58
*** eghobo has quit IRC15:58
*** rongze has joined #openstack-containers15:58
*** eghobo has joined #openstack-containers16:03
*** mfalatic has joined #openstack-containers16:04
*** eghobo has quit IRC16:08
*** jay-lau-513 has joined #openstack-containers16:10
*** eghobo has joined #openstack-containers16:10
*** daneyon_ has joined #openstack-containers16:12
*** apuimedo has quit IRC16:12
*** daneyon has quit IRC16:14
*** achanda has joined #openstack-containers16:16
*** unicell has joined #openstack-containers16:29
*** rlrevell1 has joined #openstack-containers16:31
*** rlrevell has quit IRC16:32
*** Drago has joined #openstack-containers16:38
*** dane_leblanc has quit IRC16:38
*** Drago has quit IRC16:39
*** Drago has joined #openstack-containers16:39
*** achanda has quit IRC16:41
*** kebray has quit IRC16:42
*** belmoreira has joined #openstack-containers16:44
*** achanda has joined #openstack-containers16:44
*** dane_leblanc has joined #openstack-containers16:45
*** Tango has joined #openstack-containers16:46
*** alex_klimov has quit IRC16:55
*** snrism has quit IRC17:00
*** dane_leblanc has quit IRC17:02
*** vilobhmm has joined #openstack-containers17:03
*** jjlehr has quit IRC17:04
*** daneyon has joined #openstack-containers17:05
*** daneyon_ has quit IRC17:07
*** dims has joined #openstack-containers17:07
*** dims_ has quit IRC17:10
*** bradjones has quit IRC17:10
*** bradjones has joined #openstack-containers17:11
*** bradjones has quit IRC17:11
*** bradjones has joined #openstack-containers17:11
*** harshs has joined #openstack-containers17:15
*** harshs has quit IRC17:15
*** erw has quit IRC17:18
*** erw has joined #openstack-containers17:18
*** ybathia has joined #openstack-containers17:21
*** Marga_ has joined #openstack-containers17:23
*** rongze has quit IRC17:25
*** dane_leblanc has joined #openstack-containers17:25
*** harshs has joined #openstack-containers17:26
*** Marga_ has quit IRC17:27
*** Marga_ has joined #openstack-containers17:27
*** pradk has joined #openstack-containers17:30
*** jjlehr has joined #openstack-containers17:35
*** rlrevell1 has quit IRC17:44
*** daneyon_ has joined #openstack-containers17:45
*** vahidh has quit IRC17:45
*** vahidh has joined #openstack-containers17:47
*** daneyon has quit IRC17:48
*** eliqiao has quit IRC17:51
*** rlrevell has joined #openstack-containers17:51
*** snrism has joined #openstack-containers17:52
*** snrism has quit IRC17:52
*** snrism_ has joined #openstack-containers17:52
*** sthillma has joined #openstack-containers17:52
*** rlrevell has quit IRC17:52
*** rlrevell has joined #openstack-containers17:52
*** eliqiao has joined #openstack-containers17:57
*** achanda_ has joined #openstack-containers17:59
*** dontalton has joined #openstack-containers18:00
*** achanda has quit IRC18:02
*** sdake_ has joined #openstack-containers18:02
*** sdake has quit IRC18:02
*** sdake has joined #openstack-containers18:02
*** sdake_ has quit IRC18:06
*** juggler has joined #openstack-containers18:06
*** openstackgerrit has quit IRC18:09
*** openstackgerrit has joined #openstack-containers18:09
*** jruano has joined #openstack-containers18:15
*** rpothier has joined #openstack-containers18:20
*** daneyon_ has quit IRC18:26
*** achanda_ has quit IRC18:32
*** eliqiao has quit IRC18:37
*** jjlehr has quit IRC18:37
*** Marga_ has quit IRC18:40
*** achanda has joined #openstack-containers18:41
*** eliqiao has joined #openstack-containers18:41
*** achanda has quit IRC18:46
*** jjlehr has joined #openstack-containers18:46
*** Marga_ has joined #openstack-containers18:47
*** prad__ has joined #openstack-containers19:14
*** prad__ has quit IRC19:23
*** pradk has quit IRC19:28
*** dane_leblanc has quit IRC19:28
*** harshs has quit IRC19:37
*** harshs has joined #openstack-containers19:40
*** alex_klimov has joined #openstack-containers19:56
*** Marga_ has quit IRC19:57
*** kebray has joined #openstack-containers20:03
*** snrism_ has quit IRC20:17
*** eghobo has quit IRC20:22
*** rpothier has quit IRC20:23
*** snrism has joined #openstack-containers20:33
*** apuimedo has joined #openstack-containers20:49
*** achanda has joined #openstack-containers20:51
*** dane_leblanc has joined #openstack-containers20:53
*** Marga_ has joined #openstack-containers20:54
*** belmoreira has quit IRC20:56
*** achanda has quit IRC20:56
*** pradk has joined #openstack-containers20:57
*** Marga_ has quit IRC20:59
*** Marga_ has joined #openstack-containers20:59
*** rlrevell has quit IRC20:59
dane_leblancHello, I'm new to Magnum, and I'm trying to follow the quick-start guide (https://github.com/openstack/magnum/blob/master/doc/source/dev/dev-quickstart.rst) to set up a swarm bay, without much luck. When I try to create a bay, it seems forever stuck in CREATE_IN_PROGRESS state. Can anyone suggest some debugging steps?20:59
*** abe_music has quit IRC21:13
sdakedane_leblanc i am not intimately familiar with the swarm bay type, but I can walk you thorugh debug21:16
sdakerun heat stack-list21:16
sdakethis will givey ou a list of stacks running21:16
sdakeone of them mpas to the gap21:16
sdakegap/bay21:16
*** julim has quit IRC21:16
sdakebrain crossed wires there21:16
sdakeyou can use heat event-list bay-id21:16
sdakethis will tell you where heat is stuck21:16
sdakeif you could paste that output in a pastebin tool I can help debug further21:17
sdakemy speculation is your heat-api-cfn process is not running or cannot be contacted from the vm because of communication problems with neutron config21:18
sdakei expect wwe will see heat is jammed up at the wait condition21:18
*** sdake_ has joined #openstack-containers21:19
dane_leblancsdake: http://paste.openstack.org/show/275390/21:20
dane_leblancsdake: Here is the heat event-list output: http://paste.openstack.org/show/275391/21:22
*** sdake has quit IRC21:23
*** kebray has quit IRC21:24
sdake_| agent_wait_handle           | 88e62362-07bc-4ad1-be12-6642c77e0e13 | Signal: status:SUCCESS reason:Setup complete | SIGNAL_COMPLETE    | 2015-06-08T20:32:42Z |21:26
sdake_that violates my speculation21:26
sdake_anything in the magnum conductor logs?21:27
sdake_or in the heat engine logs21:27
sdake_apmelton ping ^21:27
mfalaticIf I may add, what are the basic characteristics of the server you're attempting this on? Memory, disk, etc.21:27
sdake_oh ya good point mfalatic are you running in a vm21:28
sdake_dane_leblanc run heat resource-list stack-id21:29
dane_leblancThis is on a UCS server, 256G disk21:30
mfalaticmemory?21:30
dane_leblancLooks like 32G memory21:32
sdake_need to see a past eof resource-list to further diagnose21:32
sdake_running on bare metal then?21:32
dane_leblancYes21:33
mfalaticSounds like no shortage of space and memory then.21:33
dane_leblancThis is behind a corporate firewall, don't know if external access could be an issue?21:34
sdake_which base os are you using?  oreos or fedora?21:34
sdake_the vms need external access21:35
sdake_but i've never debugged swarm, would like to continue ;)21:35
dane_leblancResource-list is here: http://paste.openstack.org/show/275432/21:35
dane_leblancBase OS is ubuntu21:36
mfalatic14.04?21:37
dane_leblancYEs21:37
*** Marga_ has quit IRC21:37
mfalaticDevstack branch is master or something else?21:37
dane_leblancYes, devstack is master21:37
*** jruano has quit IRC21:38
sdake_ca nyou create a kubernetes bay?21:40
sdake_dane_leblanc run heat resource-show master_wait_condition21:43
dane_leblancYes, I was able to create a Kubernetes bay, but I was getting a 500 error when I tried creating a pod21:43
sdake_ok so problem with template and not your enviornment21:43
sdake_which base os are you using, fedora or coreos?21:43
dane_leblancUbuntu 14.04 desktop21:43
sdake_nah i mean for the vms21:43
dane_leblancFedora21:44
sdake_is your kubernetes bay still running?21:44
dane_leblancFedora atomic21:44
dane_leblancNo, I shut down the kubernetes, just trying to isolate one bay type at a time21:44
sdake_well apparently both ar ebroke nfor you :)21:45
sdake_my devstack is bust atm21:45
sdake_so I can't see the kube output21:45
sdake_can you start a new bay of kubernetes while keeping your existing bay at bay :)21:45
dane_leblancFor "vms need external access", what needs to be opened?21:45
sdake_the docker cdn21:45
sdake_i don't recall which port docker runs on21:46
dane_leblancHave to step out for a couple of minutes to exchange car keys with my wife, be right back21:46
sdake_yar21:46
*** dboik has quit IRC21:46
sdake_so steps to take - run heat resource-show master_wait_condition21:47
sdake_(you will need to file a bug for this, its outside my expertise to fix this problem)21:47
sdake_but lets get the info needed for hte bug report21:47
sdake_and apmelton can tackle it21:48
*** snrism has quit IRC21:48
*** snrism has joined #openstack-containers21:50
*** snrism has quit IRC21:50
*** achanda has joined #openstack-containers21:51
dane_leblancOkay, I'm back (sorry, my wife needed to take our "dog bus")21:56
sdake_dane_leblanc I wont even ask :)21:56
dane_leblancIt's the car we let the dogs ride in.21:56
sdake_so I am pretty sure the problem is your ports 2375 and 2376 (docker cdn) are not open for reading from the internets21:56
*** achanda has quit IRC21:57
sdake_https://github.com/openstack/magnum/blob/master/magnum/templates/docker-swarm/fragments/write-swarm-agent-service.yaml#L1721:57
dane_leblancSo it's a problem with those ports on my setup, and not a bug?21:58
sdake_possibly21:58
sdake_lets debug kubernetes21:58
sdake_I know much mor eabout that ;)21:58
dane_leblancokay, awesome21:59
sdake_docker pulls the swarm agent and master via the docker registry21:59
*** achanda has joined #openstack-containers21:59
sdake_if docker can't pull it won't signal the wait condition of success21:59
dane_leblancAhhh.21:59
sdake_I'm not sure what precisely teh deal was with teh signalling but not all signals were received21:59
sdake_that is why in resource-show you saw some uncompleted resources21:59
sdake_it times out after 6000 seconds21:59
sdake_and then will say "create_failed" :)22:00
sdake_but i know kubernetes inside and out lets atleast get that working22:00
sdake_note for kubernetes to work it also uses docker pull on same ports i believe22:00
sdake_the folks from china that work on magnum suffer this problem all the time as a result of the GFW22:02
sdake_this may be way you got a 500 error in pod creation22:03
sdake_why22:03
sdake_i'd like to knwo for sure - because if that is not the cause it means a regression in teh code base22:03
dane_leblancKubernetes bay create in progress...22:06
sdake_when it finishes, scp the pod files you intended to launch into the master node22:07
sdake_scp file.yml minion@floating-ip22:07
*** achanda has quit IRC22:08
*** pradk has quit IRC22:08
sdake_you can get the floating ip i think bybay-show or nova list22:08
dane_leblancThe pod yaml files would be the --manifest file, redis-master.yml in this example?22:08
sdake_yup22:09
sdake_ocne you have scp'ed the files to /tmp or somewhere approrpaite22:10
sdake_ssh into the master22:10
sdake_and run kubectl get minions and paste output22:10
*** jjlehr has quit IRC22:11
*** muralia has quit IRC22:16
sdake_dane_leblanc bay created yet?22:21
dane_leblancYes, just collecting the get minions22:21
sdake_cool22:21
dane_leblanc2 minions are ready: http://paste.openstack.org/show/275507/22:21
sdake_fantastic22:22
sdake_that tells you your devstack is working correctly ;)22:22
sdake_and magnum did the right thing22:22
sdake_and kubernetes cooperated22:22
dane_leblancNice22:22
sdake_kubernetes is a highly complex beast22:22
sdake_if get minions says "Ready" it means all went right ;)22:22
sdake_if it says "NotReady" it means there is a regression in the code base in magnum22:22
dane_leblancSo should I try to create a pod?22:23
sdake_from within the vm yes22:23
sdake_kubectl create file.yaml22:23
sdake_does this display any output?22:24
dane_leblancThink I need a -f option22:25
sdake_ok22:25
sdake_add er in22:25
dane_leblancNo output from that command22:25
sdake_kubectl get pods22:25
sdake_paste output22:26
dane_leblancLooks like a healthy output22:26
sdake_login to the node where the pod was started22:26
sdake_via ssh22:26
sdake_you wil have to do from outside the vm22:26
sdake_you will have to coorelate the internal ip with the external floating ip22:26
dane_leblanchttp://paste.openstack.org/show/275510/22:26
sdake_in nova list, you will see a node 10.0.0.5 which has a floating ip22:27
dane_leblancright22:27
sdake_ssh minion@floating-ip-of-10.0.0.522:27
sdake_the internal vms don't set up cross-keys22:27
sdake_they probably should but they dont22:27
sdake_if you were in the summit fishbowl sessions, this is the native api support we were talkingabout (usingkubectl vs magnum pod-create)22:29
dane_leblancOkay, I'm in that minion22:29
sdake_docker images into paste22:29
dane_leblancI'm not seeing any images... will paste output.22:30
dane_leblanchttp://paste.openstack.org/show/275529/22:30
sdake_docker pull centos22:31
dane_leblancAre the images downloaded from the repo?22:31
sdake_they are downloaded from the dockerhub cdn22:31
sdake_i need to understand what errors you get when this happens - it helps us make magnum more resilient22:31
sdake_sorry for experimenting on your machine :)22:32
dane_leblancNo worries at all! At least I feel like I'm making progress!22:32
sdake_you got devstack running properly count that as serious progress ;-)22:33
sdake_did that docker pull do anything22:33
dane_leblancIt's still working on it. How long does it normally take?22:34
sdake_it should be printing things out by now22:34
dane_leblancFATAL, connection timed out22:34
sdake_go back to the master node22:35
dane_leblancLooks like more firewall woes22:35
dane_leblancOkay, I'm on the master22:35
sdake_kubectl get pods22:35
sdake_paste output22:36
dane_leblanchttp://paste.openstack.org/show/275530/22:36
sdake_ok first action22:37
sdake_file bug with the kubernetes upstream indicating when a firewall blocks docker pull from executing, the pod status stays in "PENDING" rather then entering an error state22:37
sdake_maybe they will be kind enough to fix that problem22:37
dane_leblancOkay, will do22:38
sdake_now kubectl delete -f manifest.yaml22:38
sdake_a docker pull failureis fatal imo :022:38
dane_leblancRight22:38
sdake_i guess it could be retried22:39
sdake_but eventually k8s needs to give up and tell the user "your network is bust" vs leaving people guessing22:39
sdake_after that kubectl delete finishes the job make sure with kubectl get minions nothing is running22:39
dane_leblancAfter kubectl delete, 'kubectl get pods' shows empty list22:40
sdake_ok create the pod one mor etime22:40
sdake_and echo $?22:40
dane_leblanc'kubectl get minions' shows minions still alive22:40
sdake_sorry kubectl get pods above 4 lines22:41
sdake_too many abstractions in my brain ;)22:41
sdake_minions should still be alive22:41
sdake_i want to retry the kubectl create pod operatioin and print the exit code of kubectl22:41
*** apuimedo has quit IRC22:42
dane_leblanc022:43
sdake_expected22:43
sdake_delete the pod22:43
dane_leblancOh wait, hang on a sec22:43
dane_leblancLet me redo that, I had an extra kubectl in there22:44
dane_leblancYep, 0 result code22:44
sdake_ok delete the pod check its gone22:44
dane_leblancHmmm... my VNC connection is slow22:46
dane_leblancOkay, empty list for pods22:47
sdake_ok exit vm22:47
sdake_from your bare metal run magnum pod-ccreate -f manifest.yaml22:47
sdake_i think you need to specify a bay uuid as well ;)22:47
sdake_or by name should work22:47
sdake_i can't tell you how long its been since i've hada  working devstack22:48
* sdake_ groans22:48
sdake_clearly awhile since i don't remember the syntax :(22:48
*** hongbin has quit IRC22:48
sdake_hey hongbin22:48
sdake_oh bye hongbin ;)22:49
dane_leblancGot this error for pod-create: "ERROR: invalid syntax (line 2) (HTTP 500)"22:49
sdake_paste pod file22:49
dane_leblancThe manifest?22:50
sdake_right22:50
dane_leblanchttp://paste.openstack.org/show/275591/22:51
sdake_give me a minute22:51
dane_leblancsure22:51
sdake_at line two add "id: groan"22:55
sdake_between lines 1 and 2 :)22:56
dane_leblancWas just about to ask!22:56
dane_leblancokay22:57
dane_leblancRetry?22:57
sdake_yar22:57
dane_leblancSame error22:58
dane_leblancwith (line 2)22:58
*** harshs has quit IRC22:58
dane_leblanc"ERROR: invalid syntax (line 2) (HTTP 500)"22:58
sdake_punishment for past life events i'm sure22:58
sdake_which tarball of examples did you download22:59
dane_leblancSounds about right. :)22:59
dane_leblancThis was from a kubernetes git clone22:59
dane_leblancgit clone https://github.com/GoogleCloudPlatform/kubernetes.git23:00
dane_leblanccd kubernetes/examples/redis/23:00
sdake_second action - file bug for that problem in magnum23:01
dane_leblancIf I were to try this from a VM, would 30G drive and 8G memory work?23:01
sdake_30g drive might be a little tight23:02
sdake_not sure23:02
dane_leblancI can open up some more, maybe try 50G23:02
dane_leblancSo for the magnum bug, this is a problem separate from my firewall issues?23:03
sdake_wget https://github.com/GoogleCloudPlatform/kubernetes/releases/download/v0.15.0/kubernetes.tar.gz23:03
sdake_yup this is a documentation bug23:03
sdake_or an implementation bug depending on your perspective ;)23:04
dane_leblancBug against the wiki page?23:04
sdake_the developer quickstart guide23:04
dane_leblancOh, the rst doc23:04
dane_leblancRight23:04
sdake_try that wget23:04
sdake_untar it and try the redis pod in it23:04
sdake_you downloaded 0.18+, fedora image has 0.1523:05
sdake_world apart in .03 versions23:05
sdake_every time I update the fedora image it cuses major chaos so I try to keep it to a minimum during development ;)23:05
sdake_google shoudl be on version 4.0 of kubernetes or so by now23:07
sdake_but they refuse to pull the trigger on a 1.0 until its "perfect"23:07
dane_leblancOkay, that manifest shows an error, but a more meaningful error:23:09
dane_leblanc"ERROR: Field metadata['name'] can't be empty in manifest. (HTTP 400)"23:09
sdake_diff the two manifests23:09
sdake_addthe name field where required23:09
*** daneyon has joined #openstack-containers23:10
dane_leblancD'oh, I overwrote the original, let me re-clone that23:10
sdake_paste the diff if you wouldn't mind23:11
*** daneyon_ has joined #openstack-containers23:11
sdake_wow talk about changing everything about the manifest23:14
*** daneyon has quit IRC23:15
dane_leblancYeah, no kidding23:15
sdake_ok in the redis directory23:15
sdake_there is a v1beta3 directory23:15
sdake_from the tarball23:15
sdake_run the pod from that directory23:15
sdake_we are running the v1beta3 api in magnum23:16
dane_leblancv1beta3 shows the original error that I was seeing from the git clone23:17
dane_leblanc"ERROR: invalid syntax (line 2) (HTTP 500)"23:17
sdake_magnum pod-list23:17
sdake_any output?23:17
dane_leblancYes!23:18
sdake_ok delete all those pods23:18
sdake_you will have to use uuid unfortunately23:18
dane_leblancOkay, 3 pods are deleted23:19
sdake_create a new pod23:19
sdake_then past eoutput of pod-show on that new pod23:19
dane_leblanchttp://paste.openstack.org/show/275642/23:20
sdake_5 minutes reading code23:21
sdake_ssh into master pls23:24
sdake_rpm -qa | grep kubernetes23:24
*** yuanying has joined #openstack-containers23:25
dane_leblanckubernetes-0.15.0-5.fc21.x86_6423:27
sdake_ins't debugging kubernetes fun - whee23:27
dane_leblancYes indeed23:29
*** alex_klimov has quit IRC23:29
sdake_ok action #2, create bug report with the pod create operation23:34
sdake_ignore previous action #223:34
sdake_in the magnum laucnhpad tracker23:34
sdake_and link me the bug when done so I can make it essential23:34
sdake_can you create other types of objects like services and replication controllers?23:34
* sdake_ swears at swagger some more23:35
dane_leblancNo, I wasn't able to create pods, so couldn't make services and replication controllers.23:35
sdake_did you try?23:35
sdake_one doesnot depend on the other23:36
dane_leblancOh. Perhaps I should try. :)23:36
sdake_agree :)23:36
dane_leblancWhat details do I need for the bug, besides that I'm seeing the HTTP 500 error?23:37
sdake_if there is something more meaningful in the conductor log that owuld be helpful23:37
sdake_any sort of trace with teh actual data sent23:38
sdake_I see what the problem is with the code I suspect23:38
sdake_yuanying when does madhuri make it in23:38
sdake_morning btw ;)23:39
yuanyingwhat about?23:40
sdake_pod create is busted on master23:40
madhurimorning sdake_ yuanying23:40
sdake_hey madhuri23:40
yuanyingmorning23:40
sdake_is pod create busted on master for you?23:40
madhuriI haven't checked23:41
madhuriLet me check23:41
sdake_can you check plz23:41
madhuriWhat is the error you are getting bdw?23:41
dane_leblancsdake: I'm seeing a similar error for service-create:23:41
sdake_dane_leblanc go ahead and file a bug plz23:41
dane_leblancsdake: Bug for the pod-create?23:41
yuanyingI will also check it23:42
sdake_yes23:42
sdake_    def createPod(self, **kwargs):23:42
sdake_            namespaces, str: object name and auth scope, such as for teams and projects (required)23:42
sdake_            body, V1beta3_Pod:  (required)23:42
sdake_manifest is not of type V1beta3_Pod23:42
madhuriFor manifest v1beta3, it is succesful23:43
madhuriI have checked23:43
sdake_dane_leblanc can yo upaste your error23:44
sdake_dane_leblanc is using v1beta3 redis example23:44
dane_leblancERROR: invalid syntax (line 2) (HTTP 500)23:44
madhuridane_leblanc, can you please paste the command and output?23:45
*** dontalton has quit IRC23:45
madhuriHere http://paste.openstack.org/23:46
dane_leblanchttp://paste.openstack.org/show/275665/23:46
sdake_dane try adding --name abc23:46
sdake_dane_leblanc that is ;)23:47
sdake_or did we take that out23:47
sdake_can't remember23:47
dane_leblancYou mean add it at line 2 of the manifest file?23:48
sdake_no i mean add to cmd line23:48
sdake_madhuri try a git pull --rebase of master23:49
sdake_with a fresh bay23:49
yuanyingI have checked at master23:49
yuanyingsucceeded23:49
sdake_same result as madhuri?23:49
yuanyinghttp://paste.openstack.org/show/275666/23:49
madhuriNo23:49
sdake_your manifest is parsed yuanying dane_leblanc's is not23:50
sdake_how about we paste our pod files for comparison :)23:50
madhurisucceeded23:50
madhuriSure23:50
sdake_madhuri using master python-magnumclient?23:51
madhurihttp://paste.openstack.org/show/275692/23:51
madhuriI guess no23:51
madhuriLet me update it23:51
sdake_dane_leblanc diff madhuri's pod vs yours23:52
madhuriWith master magnumclient and magnum, succeeded23:52
*** vahidh has quit IRC23:52
*** jjlehr has joined #openstack-containers23:53
sdake_if the pods are the same must be a dependency issue23:53
madhuriFrom looking at the error of dane_leblanc, it seems the yaml has invalid syntax23:54
sdake_it would be dandy to know where that error is origniating from - kubernetse, our rest api or what23:54
madhuridane_leblanc, Can you validate your yaml?23:54
dane_leblancThe yaml I'm using matches Madhuri's23:54
madhuriReally?23:54
madhuriCan you please paste it?23:55
madhuriI will try it out23:55
dane_leblanchttp://paste.openstack.org/show/275696/23:55
madhuridane_leblanc, It succeded23:56
madhuriDo you have the master branch?23:57
madhuriIf yes, can you please check magnum-api or magnum-conductor logs for error?23:57
dane_leblancYes, this is master for magnum23:58
madhuriStrange23:59
madhuriDid you see any error in logs?23:59
sdake_madhuri pip show six plz23:59
sdake_dane_leblanc pip show six plz23:59
dane_leblancYes, I see traceback in m-api.log23:59
sdake_paste traceback plz23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!