Monday, 2019-01-28

*** mgoddard has quit IRC00:42
*** hongbin has joined #openstack-containers01:03
*** jaewook_oh has joined #openstack-containers01:29
*** hongbin has quit IRC01:37
*** hongbin has joined #openstack-containers01:56
*** ricolin has joined #openstack-containers02:01
*** ricolin_ has joined #openstack-containers02:07
*** ricolin has quit IRC02:09
*** jaewook_oh has quit IRC02:21
*** sapd1 has joined #openstack-containers02:22
*** jaewook_oh has joined #openstack-containers02:25
*** hongbin has quit IRC02:25
*** jaewook_oh has quit IRC02:40
*** _fragatina has quit IRC03:13
*** _fragatina has joined #openstack-containers03:13
*** _fragatina has quit IRC03:15
*** _fragatina has joined #openstack-containers03:16
*** _fragatina has quit IRC03:17
*** _fragatina has joined #openstack-containers03:18
*** sapd1 has quit IRC03:39
*** hongbin has joined #openstack-containers03:46
*** sapd1 has joined #openstack-containers03:55
*** _fragatina has quit IRC04:00
*** _fragatina has joined #openstack-containers04:00
*** flwang1 has quit IRC04:01
*** ramishra has joined #openstack-containers04:02
*** ykarel|away has joined #openstack-containers04:21
*** jaewook_oh has joined #openstack-containers04:22
*** Bhujay has joined #openstack-containers04:24
*** Bhujay has quit IRC04:25
*** Bhujay has joined #openstack-containers04:26
*** Bhujay has quit IRC04:27
*** spsurya has joined #openstack-containers04:28
*** Bhujay has joined #openstack-containers04:28
*** _fragatina has quit IRC04:31
*** _fragatina has joined #openstack-containers04:32
*** ykarel|away is now known as ykarel04:35
*** ykarel has quit IRC04:42
*** _fragatina has quit IRC04:42
*** hongbin has quit IRC04:55
*** ykarel has joined #openstack-containers04:58
*** ArchiFleKs has quit IRC05:40
*** Bhujay has quit IRC05:48
*** Bhujay has joined #openstack-containers06:01
*** ArchiFleKs has joined #openstack-containers06:05
*** sapd1 has quit IRC06:32
*** ramishra has quit IRC07:08
*** mkuf_ has joined #openstack-containers07:11
*** mkuf has quit IRC07:12
*** ramishra has joined #openstack-containers07:41
*** Bhujay has quit IRC07:44
*** lpetrut has joined #openstack-containers07:50
*** pcaruana has joined #openstack-containers08:01
*** ykarel is now known as ykarel|lunch08:20
*** ricolin_ has quit IRC08:32
*** flwang1 has joined #openstack-containers08:45
flwang1strigazi: around08:46
flwang108:46
*** ykarel|lunch is now known as ykarel08:51
strigaziflwang1: yes08:51
flwang1strigazi: have a moment?08:52
strigaziflwang1: yes08:52
flwang1did you ever use the http/https proxy in k8s template?08:52
strigaziworking on upgrades. http/https proxy -> we don't have this issue08:52
strigaziso no08:52
strigaziothers seems to use it08:53
flwang1ok, we're going to dig into that based on a customer's requirement08:53
flwang1anyway, any progress as for rolling upgrade?08:53
strigaziflwang1: you might have an issue with the atomic command if you use docker.io08:54
strigaziflwang1: uprades: still working on it.08:54
flwang1what do you mean? use atomic install to pull images from docker.io?08:54
strigaziyes. I think you need to export the proxy vars. There is someone that sent quite some email in the ML08:55
strigaziflwang1: http://lists.openstack.org/pipermail/openstack-discuss/2019-January/001908.html08:56
strigazihe didn't push a patch.08:56
strigazialso etcd discovery needs this: https://review.openstack.org/#/c/633064/08:57
*** lpetrut has quit IRC08:57
flwang1strigazi: good timing08:58
flwang1i will take care all of them08:58
openstackgerritSpyros Trigazis proposed openstack/magnum master: k8s_fedora: Deploy tiller  https://review.openstack.org/61233608:59
flwang1strigazi: do you know if Ignazio Cassano is in this channel?08:59
strigaziflwang1: I have also spent quite some time on this one ^^ if you can have a look at some point08:59
flwang1tiller?09:00
strigaziyes09:00
flwang1strigazi: no problem, i love to see magnum can support it09:00
strigaziflwang1: he is not here at the moment09:00
strigaziflwang1: not sure if he is here every day09:00
flwang1strigazi: ok, i will reply his email to ask if he want to propose a patch09:00
strigaziflwang1: same timezone as mine09:01
flwang1also work for cern?09:01
strigaziflwang1: no09:02
*** mgoddard has joined #openstack-containers09:02
flwang1strigazi: do you guys start to engage with autoscaler team to propose the openstack driver?09:09
openstackgerritRicardo Rocha proposed openstack/magnum master: Update kube cmd documentation links  https://review.openstack.org/63345809:10
strigaziflwang1: not at this point09:12
strigaziflwang1: there is no benefit IMO09:12
flwang1strigazi: what does that mean?09:12
flwang1shouldn't we get it upstream finally?09:12
strigaziflwang1: when it is complete yes09:13
flwang1you mean at this moment, they don't really care?09:13
strigaziflwang1: but it is stand alone, we won't benefit from any ci for functional tests and so on09:14
flwang1strigazi: i got your point09:15
flwang1now my current tasks are:  1. keystone auth client support 2. code review for FIP cleanup  3. code review for octavia ingress controller  4. auto healing/scaling09:22
flwang1strigazi: just FYI09:22
strigaziyou can add review tiller :)09:22
flwang1strigazi: sorry, yes09:23
flwang1it's on my list now ;)09:23
strigaziflwang1: what do you think about this in rocky? https://review.openstack.org/#/c/561783/09:26
openstackgerritMerged openstack/magnum master: Add framework for magnum-status upgrade check  https://review.openstack.org/61150509:29
flwang1strigazi: that's a good question09:31
flwang1strigazi: TBH, i'd like to make rocky like a LTS version09:32
flwang1though we don't have LTS in openstack world09:32
strigaziflwang1: what this means? we add it or not?09:32
openstackgerritMerged openstack/magnum master: Enable CoreDNS prometheus metrics plugin  https://review.openstack.org/63074809:32
openstackgerritMerged openstack/magnum master: Update kube cmd documentation links  https://review.openstack.org/63345809:32
flwang1add it, and i'd like to make it enabled by default09:33
flwang1here is my point09:33
flwang1the value of Magnum is,  it can ship k8s fully integrate with OpenStack and we do the job much better than any other tools/services09:34
flwang1so any feature can enhance the integration should be highly promoted, does that make any sense?09:34
flwang1strigazi: ^09:34
strigaziyes09:35
strigaziflwang1: it has conflicts :(09:35
strigazithe patch09:35
flwang1strigazi: did you try to cherrypick?09:35
strigaziI'm going for it then.09:36
strigaziyes I tried09:36
flwang1ok, never mind, i can fix the conflict if you're happy to let it go into rocky09:36
strigaziflwang1: only on the heat-container-agent-tag patch09:37
strigaziafter that it applies09:38
flwang1strigazi: you mean back port after https://review.openstack.org/#/c/561858/ ?09:38
strigazifirst cherry-pick 612727 then 56178309:39
openstackgerritFeilong Wang proposed openstack/magnum stable/rocky: Add heat_container_agent_tag label  https://review.openstack.org/63346309:40
flwang1strigazi: https://review.openstack.org/#/q/topic:heat-container-agent-tag-stable/rocky+(status:open+OR+status:merged)09:40
flwang1let's do it09:40
flwang1and as for  https://review.openstack.org/#/c/561858/ , are you going to continue it?09:41
strigazijust click the button09:41
strigaziah, for 561858 I'm doing it  now09:42
flwang1strigazi: cool, then i will leave the baby for you09:42
*** cmurphy has joined #openstack-containers10:02
*** ignaziocassano1 has joined #openstack-containers10:03
ignaziocassano1Feilong ? Here I am10:06
flwang1ignaziocassano1: hello10:06
ignaziocassano1hello10:06
flwang1ignaziocassano1: so you mean you're using same workaround but your heat stack  is stuck now, is it?10:07
ignaziocassano1patched magnum create stacks . These stacks go in timeout creating master resource group10:07
flwang1can you see any error in heat-engine?10:07
ignaziocassano1I must retry, because I re patched magnum againg10:08
ignaziocassano1let me to retry10:09
flwang1thanks10:10
*** sapd1 has joined #openstack-containers10:10
*** Adri2000 has joined #openstack-containers10:10
ArchiFleKsHi, I'm re testing magnum in Queens, is there a reason why DNS is default to 8.8.8.8 in cluster template ? And not does not default to empty which would allow to use default Neutron DNS which then forward to whatever DNS is configured by the cloud provider ?10:13
ignaziocassano1The first problem is variable are not exported by write-heat-params-master.yaml10:14
flwang1ignaziocassano1: we can fixed it by adding 'export', but i would like to understand why the source '.' doesn't work10:14
flwang1s/fixed/fix10:14
ignaziocassano1I fixed it modifyng scripts10:15
flwang1ok, next?10:15
flwang1ArchiFleKs: that's a good question, strigazi, thoughts?10:15
ignaziocassano1Now, the stack is creating the master10:16
ignaziocassano1heat-engine reports:  creating Server "kube-master" Stack "kb-7zakzhd2aroa-kube_masters-2bmpxxupx6al-0-7u5fsh75pkhy" [d243cd2b-2f38-4a5d-a3f8-425c8b2c9d21]10:16
strigaziArchiFleKs: flwang1, no reason, history10:16
flwang1strigazi: should we encourage ArchiFleKs to propose a patch for that?10:17
ignaziocassano1I am reading the cloudinit output log on the master ....is going on10:18
ArchiFleKsThis is useful for private cloud / endpoint (I just noticed the error because my magnum endpoint are private DNS name so it breaks TLS cert creation)10:18
flwang1ArchiFleKs: so if you have time, welcome to propose a  patch10:20
flwang1strigazi: did you ever try the v1.11.6 images?10:21
strigaziflwang1: no10:21
flwang1it doesn't work for me10:21
ignaziocassano1Kubemaster cloudint reports running 'modules:final'10:21
strigaziflwang1: I'm trying quickly10:21
flwang1strigazi: i got this http://paste.openstack.org/show/744008/10:22
ignaziocassano1but the heat stack is on creating in Progress on resource  OS::Heat::ResourceGroup10:23
flwang1ignaziocassano1: any interesting log in heat-engine?10:23
ignaziocassano1for kube-masters10:23
ignaziocassano1it is always on: NFO heat.engine.resource [req-5d20ecc8-0b63-41e3-8d30-24ad7589fcac - admin - default default] creating Server "kube-master" Stack "kb-7zakzhd2aroa-kube_masters-2bmpxxupx6al-0-7u5fsh75pkhy" [d243cd2b-2f38-4a5d-a3f8-425c8b2c9d21]10:24
ignaziocassano1I thing we must wait the stack timeout I fixed in 15 minutes10:25
ArchiFleKsflwang1: alright, what's the latest Kubernetes supported version in Queens ? and Rocky ?10:26
ignaziocassano1we are at 13 minutes10:26
ignaziocassano1with the prepatched magnum it completes in 10 minutes10:28
ignaziocassano1OK: stack reports CREATE aborted (Task create from ResourceGroup "kube_masters" Stack "kb-7zakzhd2aroa" [2fba541e-3ccf-48a5-92cd-370ab50cb3f5] Timed out)10:28
flwang1hmm..10:29
flwang1ArchiFleKs: for rocky it's 1.11.5 iirc10:29
ignaziocassano1would you like heat engine log ?10:29
flwang1ignaziocassano1: yep, sure, thanks10:29
ignaziocassano1I never remember the site where I can post logs :-(10:30
ignaziocassano1sorry10:30
flwang1paste.openstack.org10:30
ignaziocassano1ok10:30
ignaziocassano1thanks :-)10:30
ignaziocassano1http://paste.openstack.org/show/744011/10:31
ignaziocassano1Why it not happens with pre patched version ? The old version does not create resource group ?10:32
flwang1what's the 'pre patched version'?10:33
ignaziocassano1I installed magnum on a ubuntu virtual machine (not on controllers).10:34
ignaziocassano1dpkg -l |grep magnum10:35
ignaziocassano1ii  magnum-api                          6.1.0-0ubuntu1~cloud0                      all          OpenStack containers as a service10:35
ignaziocassano1ii  magnum-common                       6.1.0-0ubuntu1~cloud0                      all          OpenStack containers as a service - API server10:35
ignaziocassano1ii  magnum-conductor                    6.1.0-0ubuntu1~cloud0                      all          OpenStack containers as a service - conductor10:35
ignaziocassano1ii  python-magnum                       6.1.0-0ubuntu1~cloud0                      all          OpenStack containers as a service - Python library10:35
ignaziocassano1ii  python-magnumclient                 2.8.0-0ubuntu1~cloud0                      all          client library for Magnum API - Python 2.x10:35
ignaziocassano1For patching magnum I followed this procedure:10:35
flwang16.1 is queens10:36
flwang1there are quite a lot changes in rocky10:36
ignaziocassano1cd /tmp10:36
ignaziocassano1git clone git://git.openstack.org/openstack/magnum10:36
ignaziocassano1cd magnum10:36
ignaziocassano1git fetch git://git.openstack.org/openstack/magnum refs/changes/30/629130/9 && git checkout FETCH_HEAD10:36
ignaziocassano1mv /usr/lib/python2.7/dist-packages/magnum /usr/lib/python2.7/dist-packages/magnum.orig10:36
ignaziocassano1cp -rp magnum /usr/lib/python2.7/dist-packages/10:36
ignaziocassano1OK10:37
ignaziocassano1So I must upgrade my openstack to rocky ?10:37
openstackgerritSpyros Trigazis proposed openstack/magnum master: k8s_fedora: Deploy tiller  https://review.openstack.org/61233610:37
ignaziocassano1I know my patching procedure is not the best .... I should wait new apt packages with patches10:39
strigaziflwang1: for 1.11.6, kubectl in the host doesn't work10:41
strigaziflwang1: the rest seem to work10:41
ignaziocassano1anyway we need a patch to export variables10:41
strigaziflwang1: talk to the API from the outside or with curl10:41
flwang1strigazi: interesting10:42
flwang1where is the kubeconfig on master?10:42
strigaziflwang1: there is not kubeconfig in master, it talks to localhost10:42
ignaziocassano1I think  write-heat-params-master.yaml and write-heat-params.yaml must contain an export for each variable10:43
strigaziflwang1: openstack coe cluster config ...10:43
flwang1ignaziocassano1: we can add the export but we need to make sure it works10:43
ignaziocassano1With the magnum installed by apt, I tried to add export in the above files and it works10:44
ignaziocassano1the patched version works with the export but goes in timeout for resource group but it is another problem10:45
ignaziocassano1I presume my patching procedure is wrong10:45
flwang1ignaziocassano1: did you apply https://review.openstack.org/#/c/632581/ ?10:48
ignaziocassano1No , I did not10:48
*** salmankhan has joined #openstack-containers10:49
flwang1it could be related10:49
ignaziocassano1I am not so expert on git. How can I do it ?10:49
ignaziocassano1Please...10:50
flwang1strigazi: try this curl -LO https://storage.googleapis.com/kubernetes-release/release/$(curl -s https://storage.googleapis.com/kubernetes-release/release/stable.txt)/bin/linux/amd64/kubectl10:51
flwang1strigazi: not sure why, but we probably need a new kubectl for v1.11.6, weird10:51
flwang1strigazi:  see https://github.com/kubernetes/kubernetes/issues/7299010:52
flwang1ignaziocassano1: try git fetch https://git.openstack.org/openstack/magnum refs/changes/26/628026/2 && git checkout FETCH_HEAD10:54
ignaziocassano1flawang1: thi patch is for proxy ? I mean ...it is not for the timeout issue ?10:56
openstackgerritSpyros Trigazis proposed openstack/magnum master: ci: Rebuild kubernetes v1.11.6 containers  https://review.openstack.org/63347810:57
*** salmankhan has quit IRC10:57
ArchiFleKsflwang1, strigazi the templates actually support only one dns_nameserver, which is here (https://github.com/openstack/magnum/blob/master/magnum/drivers/common/templates/network.yaml#L45), could we make the parameter in template def an array, and use "[]" as default, so user can specify more than one if necessary, and fallback to neutron is not specify ?10:58
flwang1ArchiFleKs: i discussed that with strigazi before but we haven't got time to do it10:59
flwang1if you have bandwidth, pls take it10:59
strigaziflwang1: ArchiFleKs the fix will start here I guess: https://github.com/openstack/magnum/blob/master/magnum/drivers/k8s_fedora_atomic_v1/templates/kubecluster.yaml#L5711:00
flwang1yes11:00
strigaziwe may be able to pass [] or ["8.8.8.8"] ?11:00
flwang1strigazi: need heat expert here but we can just give it a try11:01
flwang1i probably have to leave11:01
ArchiFleKsstrigazi: yes, it will hange to "comma_delimited_list"11:01
ArchiFleKsso user can specify a list of DNS, or if not, just pass "[]" ans the it will default to the Neutron DNSmasq default ones11:02
ArchiFleKsI think th default should be switched to "[]" to not force hardcoded values if not specify11:03
strigaziArchiFleKs: this doesn't work on the API --dns-nameserver "[]" :(11:03
strigaziWe can start by defaulting to []11:04
strigaziand still accept on IP in the api11:04
flwang1strigazi: why not propose a full patch to address this? we have a long cycle for stein11:05
flwang1strigazi: i have to offline now11:05
flwang1see you in the weekly meeting11:05
strigaziflwang1: see you11:05
ArchiFleKsstrigazi: what do you mean it does not work you mean the magnum APi ? or the Heat one ?11:06
ArchiFleKsflwang1: I'll try some local patch and propose a full patch if successful11:06
strigaziArchiFleKs: if you want to change this in the magnum API you are welcome :)11:06
strigaziin the magnum api11:06
ignaziocassano1flwang1: applying patch you suggested the magnum conductor service does not start anymore11:07
strigaziArchiFleKs:  this needs to change to accept a list https://github.com/openstack/magnum/blob/master/magnum/api/controllers/v1/cluster_template.py#L6411:08
ignaziocassano1gen 28 12:04:12 tst2-magnum-ubu magnum-conductor[25827]: AttributeError: type object 'deprecated' has no attribute 'ROCKY'11:09
ignaziocassano1flwang1: in italy is lunching time. See you latare11:12
ignaziocassano1se you later11:12
ignaziocassano1ops ...see you later11:13
openstackgerritMerged openstack/magnum stable/rocky: Add heat_container_agent_tag label  https://review.openstack.org/63346311:48
ArchiFleKsstrigazi: yes, for now it only accepts a single ipv4 because of the type "wtypes.IPv4AddressType" I'm not familiar with API /wsme but I guess we can allow list of "IPv4AddressType"11:51
ignaziocassano1flwang1: here I am. If you need anything on testing .....11:56
openstackgerritMerged openstack/magnum master: ci: Rebuild kubernetes v1.11.6 containers  https://review.openstack.org/63347812:00
*** sapd1 has quit IRC12:04
*** salmankhan has joined #openstack-containers12:15
*** ramishra has quit IRC12:20
*** pcaruana has quit IRC12:36
*** pcaruana has joined #openstack-containers12:37
*** danil has joined #openstack-containers12:44
*** salmankhan has quit IRC12:46
*** salmankhan has joined #openstack-containers12:47
openstackgerritSpyros Trigazis proposed openstack/magnum master: [k8s_fedora] Add heat-agent to worker nodes  https://review.openstack.org/56185812:48
*** salmankhan has quit IRC12:56
*** jaewook_oh has quit IRC12:59
*** ramishra has joined #openstack-containers13:09
openstackgerritKevin Lefevre proposed openstack/python-magnumclient master: Remove hardcoded dns_nameserver  https://review.openstack.org/63349713:14
openstackgerritSpyros Trigazis proposed openstack/magnum master: [k8s_fedora] Add heat-agent to worker nodes  https://review.openstack.org/56185813:16
*** ignaziocassano1 has quit IRC13:17
openstackgerritSpyros Trigazis proposed openstack/magnum master: [k8s_fedora] Add heat-agent to worker nodes  https://review.openstack.org/56185813:17
*** pcaruana has quit IRC13:32
*** pcaruana has joined #openstack-containers13:50
*** jento has quit IRC13:50
openstackgerritSpyros Trigazis proposed openstack/magnum master: [k8s_fedora] Add heat-agent to worker nodes  https://review.openstack.org/56185813:51
openstackgerritSpyros Trigazis proposed openstack/magnum master: heat-agent: Add openssh-clients  https://review.openstack.org/63350413:51
*** cmurphy has left #openstack-containers13:52
openstackgerritKevin Lefevre proposed openstack/python-magnumclient master: Remove hardcoded dns_nameserver  https://review.openstack.org/63349713:54
*** jento has joined #openstack-containers14:02
*** jmlowe has quit IRC14:03
*** dave-mccowan has joined #openstack-containers14:09
*** ArchiFleKs has quit IRC14:12
*** ArchiFleKs has joined #openstack-containers14:18
*** mrodriguez has joined #openstack-containers14:21
*** mgariepy has joined #openstack-containers14:22
*** itlinux has quit IRC14:37
*** spiette has quit IRC14:38
*** spiette has joined #openstack-containers14:40
*** ykarel is now known as ykarel|away14:43
*** kaiokmo has quit IRC15:03
*** jmlowe has joined #openstack-containers15:06
*** zul has joined #openstack-containers15:06
*** ykarel|away has quit IRC15:07
ArchiFleKsstrigazi: I tried to change the cluster_template to an array of IPv4 address : dns_nameserver = wtypes.ArrayType(wtypes.IPv4AddressType()) but I get this error in magnum API, rong type. Expected '[<wsme.types.IPv4AddressType object at 0x7f567ca9c8d0>]', got '<type 'unicode'>' . I'm not sure if it is pyton-magnumclient related. Python dev is not really my skill. I can still provide a workaround15:26
ArchiFleKsfor now with Heat, or if you can point me to the right direction I can still try15:26
*** ykarel|away has joined #openstack-containers15:36
*** sapd1 has joined #openstack-containers15:37
*** openstackgerrit has quit IRC15:51
*** itlinux has joined #openstack-containers16:06
*** sapd1 has quit IRC16:25
*** pcaruana has quit IRC16:47
*** ttsiouts has joined #openstack-containers16:53
*** ttsiouts has quit IRC17:00
*** ttsiouts has joined #openstack-containers17:01
*** ttsiouts has quit IRC17:05
*** dims has quit IRC17:08
*** _fragatina has joined #openstack-containers17:11
*** sdake has quit IRC17:34
*** sdake has joined #openstack-containers17:37
*** sdake has quit IRC17:51
*** sdake_ has joined #openstack-containers17:52
*** sdake_ has quit IRC17:53
*** _fragatina has quit IRC17:58
*** _fragatina has joined #openstack-containers17:58
*** openstackgerrit has joined #openstack-containers18:00
openstackgerritFeilong Wang proposed openstack/magnum stable/rocky: Support Keystone AuthN and AuthZ for k8s  https://review.openstack.org/63357118:00
colby_flwang1: Sorry you mean the space in the availability zone? Yes kubelet seems to complain when it tries to join to the master with the following error: Unable to register node "colby-cluster-test18-k4hwlawypjpg-minion-0" with API server: Node xxxx is invalid: metadata.labels: Invalid value: "West Datacenter": a valid label must be an empty string or consist of alphanumeric characters, '-', '_' or '.', and must start and end with an alphanumer18:01
colby_ic character (e.g. 'MyValue',  or 'my_value',  or '12345', regex used for validation is '(([A-Za-z0-9][-A-Za-z0-9_.]*)?[A-Za-z0-9])?')18:01
flwang1colby_: what's the context? pls ;)18:01
colby_queens magnum. Trying to create cluster18:02
colby_it fails18:02
flwang1ah, ok18:02
colby_kubernetes with cinder volumes18:02
flwang1colby_: that's a cinder issue, iirc18:03
flwang1what's your cinder version?18:03
*** _fragatina has quit IRC18:03
*** ykarel|away has quit IRC18:13
*** sdake_ has joined #openstack-containers18:13
*** sdake_ is now known as sdkae18:14
*** _fragatina has joined #openstack-containers18:34
*** ramishra has quit IRC18:53
openstackgerritFeilong Wang proposed openstack/magnum master: Allow cluster template being renamed  https://review.openstack.org/60917418:57
*** dave-mccowan has quit IRC19:00
openstackgerritFeilong Wang proposed openstack/magnum master: [k8s] Update cluster health status by native API  https://review.openstack.org/57289719:00
*** flwang1 has quit IRC19:01
*** dave-mccowan has joined #openstack-containers19:08
*** jmlowe has quit IRC19:08
*** spsurya has quit IRC19:14
*** dims has joined #openstack-containers19:15
colby_flwang1: queens 12.0.319:28
*** dave-mccowan has quit IRC19:34
*** jmlowe has joined #openstack-containers19:43
*** jmlowe has quit IRC20:09
*** jmlowe has joined #openstack-containers20:28
*** jmlowe has quit IRC20:50
*** flwang has joined #openstack-containers20:54
flwangstrigazi: ping20:54
*** sdkae has quit IRC22:03
*** sdake has joined #openstack-containers22:06
*** rcernin has joined #openstack-containers22:14
*** rcernin has quit IRC22:15
*** rcernin has joined #openstack-containers22:15
*** itlinux has quit IRC22:27
*** jmlowe has joined #openstack-containers22:30
*** _fragatina has quit IRC22:34
*** sdake has quit IRC22:45
*** eandersson has quit IRC22:45
*** sdake has joined #openstack-containers22:49
colby_flwang1: do you know where I should look for the cinder issue? Its the kubelet that is generating the error so I was suprised its cinder22:49
*** sdake has quit IRC22:57
*** sdake has joined #openstack-containers23:00
*** sdake has quit IRC23:01
*** sdake has joined #openstack-containers23:03
flwangcolby_: could you please show me more logs from controller-manager pls?23:11
*** _fragatina has joined #openstack-containers23:36
*** _fragatina has quit IRC23:36

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!