Monday, 2018-08-13

« Sunday, 2018-08-12 Index Tuesday, 2018-08-14 »
*** ejat has quit IRC00:59
openstackgerritMerged openstack/magnum master: [k8s] Fix docker volume issue  https://review.openstack.org/58724201:28
*** Nel1x has quit IRC01:33
openstackgerritMerged openstack/magnum master: Change Kubelet flexvolume directory  https://review.openstack.org/57825801:40
openstackgerritMerged openstack/magnum stable/queens: Fix etcd race condition issue  https://review.openstack.org/58649501:41
*** hongbin has joined #openstack-containers02:19
*** ramishra has joined #openstack-containers03:53
*** ramishra has quit IRC03:54
*** ramishra has joined #openstack-containers03:54
*** flwang has quit IRC03:55
*** udesale has joined #openstack-containers03:57
*** adrian_otto has joined #openstack-containers04:26
*** dave-mccowan has quit IRC04:28
*** adrian_otto has quit IRC04:38
*** flwang1 has joined #openstack-containers04:40
*** Bhujay has joined #openstack-containers04:50
*** rcernin has quit IRC04:54
*** rcernin has joined #openstack-containers04:54
*** flwang1 has quit IRC05:00
*** openstackgerrit has quit IRC05:18
*** hongbin has quit IRC05:20
*** ricolin has joined #openstack-containers05:39
*** ykarel has joined #openstack-containers05:54
*** janki has joined #openstack-containers05:59
*** pcaruana has joined #openstack-containers05:59
*** pcaruana has quit IRC06:05
*** pcaruana has joined #openstack-containers06:19
*** ykarel_ has joined #openstack-containers06:25
*** udesale has quit IRC06:25
*** mattgo has joined #openstack-containers06:27
*** ykarel has quit IRC06:27
*** mattgo has quit IRC06:32
*** ykarel__ has joined #openstack-containers06:33
*** ykarel_ has quit IRC06:35
*** adrianc has joined #openstack-containers06:36
*** serlex has joined #openstack-containers06:40
*** ykarel__ is now known as ykarel06:41
*** jaewook_oh has joined #openstack-containers06:45
*** ispp has joined #openstack-containers06:52
*** udesale has joined #openstack-containers07:02
*** rcernin has quit IRC07:03
*** mattgo has joined #openstack-containers07:19
*** pcaruana has quit IRC07:43
*** openstackgerrit has joined #openstack-containers07:56
openstackgerritOpenStack Proposal Bot proposed openstack/magnum master: Imported Translations from Zanata  https://review.openstack.org/59012707:56
*** pcaruana has joined #openstack-containers07:57
*** ykarel is now known as ykarel|lunch07:59
*** ispp has quit IRC08:11
*** ktibi has joined #openstack-containers08:37
*** ykarel|lunch is now known as ykarel08:56
*** salmankhan has joined #openstack-containers09:00
*** mvpnitesh has joined #openstack-containers09:10
*** adrianc has quit IRC09:27
*** ktibi has quit IRC09:30
*** ktibi has joined #openstack-containers09:31
*** ricolin_ has joined #openstack-containers09:38
*** serlex has quit IRC09:40
*** ricolin has quit IRC09:40
*** serlex has joined #openstack-containers09:43
*** adrianc has joined #openstack-containers09:54
*** flwang1 has joined #openstack-containers09:58
*** ricolin_ has quit IRC09:58
flwang1strigazi: around?10:00
flwang1for a quick sync10:00
strigaziflwang1: yes10:01
openstackgerritJangwonLee proposed openstack/magnum master: Remove last slash of auth_url  https://review.openstack.org/58693410:23
*** ykarel is now known as ykarel|afk10:38
openstackgerritMerged openstack/magnum master: Reno for embed certs in kubernetes config  https://review.openstack.org/58647010:51
openstackgerritFeilong Wang proposed openstack/magnum master: [k8s] Add new label `service_cluster_ip_range`  https://review.openstack.org/57853110:58
openstackgerritFeilong Wang proposed openstack/magnum master: [k8s] Add new label `service_cluster_ip_range`  https://review.openstack.org/57853111:10
*** mattgo has quit IRC11:10
*** slagle has joined #openstack-containers11:22
*** mattgo has joined #openstack-containers11:26
*** udesale has quit IRC11:27
rabelhi there. could we please merge some fixes to the docs? all minor fixes. the oldest also more than a month old. https://review.openstack.org/#/c/578741/  https://review.openstack.org/#/c/578758/  https://review.openstack.org/#/c/587053/  https://review.openstack.org/#/c/587393/11:31
strigazirabel: could squash the indentation commits to one? 578758 587053 58739311:39
*** mvpnitesh has quit IRC11:39
openstackgerritDavid Rabel proposed openstack/magnum master: Fix doc format  https://review.openstack.org/57875811:45
*** ykarel|afk is now known as ykarel11:45
rabelstrigazi: squashed them to https://review.openstack.org/#/c/578758/ and will abandon the others11:45
strigazirabel: I'm waiting for the branch to be cut and I'll merge them11:46
rabelthanks11:47
*** jaewook_oh has quit IRC11:51
*** dave-mccowan has joined #openstack-containers11:51
*** jaewook_oh has joined #openstack-containers11:52
openstackgerritMerged openstack/python-magnumclient master: osc: Don't pass parameters with null value  https://review.openstack.org/57884311:56
*** adrianc has quit IRC12:02
*** ricolin has joined #openstack-containers12:13
rabelcan you tell me, why --cluod-provider and --cloud-config are only set when TRUST_ID is set? https://github.com/openstack/magnum/blob/master/magnum/drivers/common/templates/kubernetes/fragments/configure-kubernetes-minion.sh#L12312:15
*** mvpnitesh has joined #openstack-containers12:17
strigazirabel: the cloud provider is using the trust id to authenticate. Without the trust id keystone will return unscoped tokens to the cloud provider. makes sens?12:17
strigazi*sense12:17
rabelstrigazi: so without the trust_id it wouldn't even work, right?12:18
strigazirabel: yes12:18
rabelok. thank you12:18
strigaziit would work if you manually add credentials12:19
mvpniteshstrigazi: I'm trying to create a cluster, when the cloud init is executing "atomic install --storage ostree --system --system-package=no --name=kube-apiserver docker.io/openstackmagnum/kubernetes-apiserver:v1.9.3"  it is pulling the image and throwing this error " g-io-error-quark: fallocate: No space left on device (12)"12:21
rabelstrigazi: how would i do this?12:22
strigazirabel: you need a bigger flavor i guess12:22
rabelmvpnitesh: ^ that answer was for you, i guess ;)12:22
mvpniteshrabel: Yes12:23
rabelstrigazi: how could i manually add credentials?12:23
mvpniteshstrigazi: Intially i tried with m1.medium and again i've used m1.large, I'm still getting the same error12:24
strigaziin all nodes in /etc/kubernetes/kube_os_config , you can add the openstack user creds12:24
rabelstrigazi: thanks again :)12:24
strigazioh, use --docker-storage-driver overlay212:24
mvpniteshstrigazi:^ Are you suggessting this to me12:26
strigaziyes12:26
mvpniteshstrigazi: Thanks, i'll try and let you know12:28
*** adrianc has joined #openstack-containers12:36
*** jaewook_oh has quit IRC12:44
*** ramishra has quit IRC13:04
*** mvpnitesh has quit IRC13:07
rabelstrigazi: if cluster_user_trust is set to true, a trust will always be generated and TRUST_ID is therefore always set, right?13:17
mattgoHello team and Magnum users, how long does a simple kubernetes cluster (1 Master 1 node) takes to be deployed in your environments ? I'm running Queens/Magnum in different settings : on HDD it takes up to 50 minutes / on SSD about 10 minutes13:18
mattgoDo those numbers looks normal to you ? Can you think of a way to optimize the creation time ?13:19
mattgoI was thinking of building an image with as many pre requisites as possible installed already, to avoid multiple download. But I'm not sure yet if there is such a huge amount of data downloaded every time.13:20
*** ricolin has quit IRC13:38
*** ramishra has joined #openstack-containers13:48
*** ricolin has joined #openstack-containers13:48
*** pbourke has quit IRC13:52
*** pbourke has joined #openstack-containers13:54
*** janki has quit IRC14:24
*** janki has joined #openstack-containers14:24
*** Bhujay has quit IRC14:27
*** ykarel is now known as ykarel|away14:30
openstackgerritJim Bach proposed openstack/magnum master: cleanup config-k8s-masters.sh, added roles to nodes on startup  https://review.openstack.org/58921414:34
*** ykarel|away has quit IRC14:36
strigaziimdigitaljim: around?14:42
strigazimattgo you can use a local registry but in the case of ssd the time is low already. In our env with ssds it takes 6 to 8 mins pulling everything from a local registry14:44
imdigitaljimyes14:45
imdigitaljimstrigazi: im here14:45
strigaziimdigitaljim: for 58921414:47
strigaziimdigitaljim: I'm thinking about it again, just a sec :)14:48
imdigitaljimno worries just let me know we can discuss :)14:49
imdigitaljimtheres also https://review.openstack.org/#/c/590346/14:51
*** hongbin has joined #openstack-containers15:01
*** serlex has quit IRC15:12
rabelhaving --config=/etc/kubernetes/manifests instead of --pod-manifest-path=/etc/kubernetes/manifests as kubectl parameters in newton was a bug, right?15:14
*** janki has quit IRC15:19
strigaziimdigitaljim: https://review.openstack.org/#/c/589214/8/magnum/drivers/common/templates/kubernetes/fragments/configure-kubernetes-master.sh@3315:24
imdigitaljimso if you check out my other PR15:25
imdigitaljimi was going to do a final PR for proxy/kubelet on both15:26
imdigitaljimjust to make it more digestable15:26
imdigitaljimbecause the code cleanup with heavy15:26
imdigitaljimbut if you'd rather i can combine all 315:26
imdigitaljimand add kube-proxy/kubelet together15:26
imdigitaljimand then we can look at the kube-proxy as a daemonset (maybe migrating to self-hosted over time)15:27
imdigitaljimstrigazi: thoughts?^15:27
strigaziwhat is the 3rd PR?15:28
strigaziimdigitaljim: ^^15:28
imdigitaljimwhen those 2 are merged, id make the final changes but the outline is to add kubelet/kubeproxy15:28
imdigitaljimwhich by then certs are generated, codes cleaned up, itd be a couple line changes15:29
strigaziwe can do three then, I don't mind. The only reason is easier code review and debuggig15:34
strigaziWhat we could do is:15:35
strigaziuse the same make-cert for master and minion15:35
strigaziin the case of nodes: just create the requited certs15:36
strigaziimdigitaljim: makes sense?15:36
strigazithis way we will have only one make cert to maintain15:36
*** pcaruana has quit IRC15:37
*** mattgo has quit IRC15:38
imdigitaljimyeah15:38
imdigitaljimthat sounds good, i can make those changes15:38
imdigitaljimjust any random work the script also does that the node might not need should be negligible15:39
strigazionly the alt_names might be diffrent15:39
imdigitaljimin other words the parts that dont need to be shared15:39
imdigitaljimyeah15:39
imdigitaljimlets have that be another PR15:39
imdigitaljimill do the 3 to get us to kubelet/proxy15:40
imdigitaljimthen ill do one more to remove minion makecert15:40
imdigitaljimheaded out for a bit, bbiab15:40
*** sgrasley has joined #openstack-containers15:57
openstackgerritOpenStack Release Bot proposed openstack/magnum stable/rocky: Update .gitreview for stable/rocky  https://review.openstack.org/59144816:13
openstackgerritOpenStack Release Bot proposed openstack/magnum stable/rocky: Update UPPER_CONSTRAINTS_FILE for stable/rocky  https://review.openstack.org/59144916:13
openstackgerritOpenStack Release Bot proposed openstack/magnum master: Update reno for stable/rocky  https://review.openstack.org/59145016:13
eanderssonnp flwang1 glad it worked16:17
*** pcaruana has joined #openstack-containers16:41
*** ricolin has quit IRC17:16
*** openstackgerrit has quit IRC17:19
rabeldoes magnum not provide ntp for the nodes out of the box?17:21
colin-like manipulating the worker/master's local ntp conf? or within the control plane once kubernetes is online17:29
colin-i'm not aware of it touching either, atm17:29
*** eandersson has quit IRC17:32
*** ktibi has quit IRC17:34
*** ianychoi_ has joined #openstack-containers17:38
*** ianychoi has quit IRC17:41
*** pcaruana has quit IRC17:59
*** salmankhan has quit IRC18:15
rabelcolin-, i was referring to the worker/master's local ntp conf18:27
*** lxkong_ has joined #openstack-containers19:17
*** lxkong has quit IRC19:25
*** mnasiadka has quit IRC19:25
*** serverascode_ has quit IRC19:25
*** Miouge has quit IRC19:25
*** lxkong_ is now known as lxkong19:25
*** Miouge- has joined #openstack-containers19:25
*** salmankhan has joined #openstack-containers19:39
*** salmankhan has quit IRC19:44
*** adrianc has quit IRC19:45
*** openstackgerrit has joined #openstack-containers20:19
openstackgerritSergey Filatov proposed openstack/magnum master: Add prometheus & grafana container image tags  https://review.openstack.org/59150720:19
*** flwang1 has quit IRC20:24
*** salmankhan has joined #openstack-containers20:32
*** markguz_ has joined #openstack-containers21:07
*** markguz_ has quit IRC21:15
*** slagle has quit IRC21:26
*** Nisha_Agarwal has joined #openstack-containers21:30
Nisha_Agarwalstrigazi, ping21:32
*** flwang has joined #openstack-containers21:33
Nisha_Agarwalstrigazi, or other team members, i was trying to build heat-container-agent container. I wanted to build a fresh container image instead of downloading it from magnum docker hub21:34
Nisha_Agarwalstrigazi, others, I Need help in understanding what shall be the inputs for building the container image? Has it to built from system having keystone client etc? or it can be build on system having docker enabled21:36
Nisha_Agarwal>21:36
Nisha_Agarwal?21:36
*** hongbin has quit IRC21:54
flwangNisha_Agarwal: firstly, why do you need a private image?22:00
Nisha_Agarwali have modified the dockerfile for centos22:00
Nisha_Agarwalflwang,22:00
Nisha_Agarwal^^22:01
Nisha_Agarwalflwang, i am trying to deploy centos cluster...if it works will submit it upstream22:01
flwangNisha_Agarwal: are you aware of this https://github.com/openstack/magnum/tree/master/magnum/drivers/common/image/heat-container-agent ?22:01
*** rcernin has joined #openstack-containers22:01
Nisha_Agarwalflwang, yes22:01
Nisha_Agarwalflwang, i was using this to build the image for centos heat-container-agent22:02
Nisha_Agarwalflwang, the base image in this container is fedora22:02
Nisha_Agarwaland when we pull the image from openstackmagnum docker hub location the service fails to come up22:03
Nisha_Agarwalon centos22:03
Nisha_Agarwalit comes up on fedora22:03
flwangNisha_Agarwal: ok, cool. because now we're using pip to install some openstack libs, so based on my understanding, the main thing you need to focus on is make those os-collect-config, etc works22:03
Nisha_Agarwalflwang, yes but i need some info on this...are there any env varables which needs to be defined before building up container image22:04
Nisha_Agarwal?22:04
flwangNisha_Agarwal: now magnum does't support centos, so you're maintaining a private driver for centos?22:04
Nisha_Agarwalflwang, we are planning to write a driver for centos in magnum22:04
Nisha_Agarwali am doing OC for it22:04
Nisha_AgarwalPOC22:04
Nisha_Agarwal*22:04
Nisha_AgarwalWe have plans to submit it upstream, but once i have clarity how it will work22:05
flwangok, i see now22:05
Nisha_Agarwalthe customer needs some intel drivers which doesnt work on atomic images22:06
Nisha_Agarwalso i am trying my POC on regular centos images and installing system containers22:06
flwangstrigazi probably know more details, but I'd saying something like elephant in the room, you have to read the dockerfile and https://github.com/openstack/magnum/blob/master/magnum/drivers/common/image/heat-container-agent/config.json.template22:06
flwangfor https://github.com/openstack/magnum/blob/master/magnum/drivers/common/image/heat-container-agent/config.json.template you have to understand the mount22:07
flwangand https://github.com/openstack/magnum/blob/master/magnum/drivers/common/image/heat-container-agent/config.json.template#L353  the env variables22:07
Nisha_Agarwalflwang, Thanks for the pointers.22:09
Nisha_Agarwalflwang, i was basically able to build the container on centos and start it as service also22:09
Nisha_Agarwalbut it gives me this http://paste.openstack.org/show/727956/22:10
Nisha_Agarwalflwang, thats where i wanted to know are there any env variables which i need to pass before building the container image22:10
Nisha_Agarwalflwang, do u have any idea what i can do to overcome these warnings22:12
flwangchecking....22:13
flwang/var/lib/os-collect-config/local-data not found. Skipping22:14
flwangthis line should be fine22:14
Nisha_Agarwaland auth_url?22:15
Nisha_AgarwalNo auth_url configured.??22:15
Nisha_Agarwalthis one?22:15
Nisha_AgarwalMy master came up with this container image but i am not sure if its correct or i need to pass somethings(perhaps env variables or something else) to have it up without any warning messages22:16
Nisha_Agarwalbasically not sure is it ok to have these warning messages22:17
flwangi'm not too sure about the auth_url22:22
flwangi need to check my env22:22
flwangcan you create cluster successfully?22:22
Nisha_AgarwalIt shud create the cluster successfully...actually i am using baremetal for creating cluster and i have only one baremetal which gets successfully created as master with this image, for minion i need to acquire one more baremetal which i shud get by tomorrow22:27
Nisha_Agarwalflwang, for my knowledge wanted to know, does heat-container-agent plays any role for minion creation apart from service being up in master?22:29
flwangNisha_Agarwal: no, it's not22:29
flwanglet me double check22:30
flwangyep, i think it's only impact master node to notify heat22:31
Nisha_Agarwalflwang, which means if master creation is successful, the heat notification is also successful?22:32
flwangi think so22:32
flwangi would recommend double check the cloud-init log of your master node22:33
flwangif there is no error, then you're doing well22:33
Nisha_Agarwalcloud-init doesnt report any error22:34
*** rtjure has quit IRC22:35
flwangthen you're all good ;)22:36
flwangbut do create a whole cluster to get peace of mind22:37
Nisha_Agarwalflwang, http://paste.openstack.org/show/727957/22:37
Nisha_Agarwalflwang, yes thats my target for tomorrow22:37
Nisha_Agarwali pasted the cloud-init and cloud-init-output logs22:38
flwangNisha_Agarwal: btw, i don't think maintaining a new driver is a good idea unless you have some limitations22:38
Nisha_Agarwalflwang, the customer for whom we are doing POC requires some intel drivers which are not supported on atomic images22:39
Nisha_Agarwalflwang, plus they are supported only in UEFI boot mode22:39
flwanghow about coreOS?22:39
Nisha_Agarwalflwang, and the driver is supported only on centos, rhel and sles22:40
flwangah, fair enough22:40
Nisha_Agarwaland they most often use centos22:40
flwangi understand22:40
Nisha_Agarwalflwang, but i could use most of the things from fedora atomic driver apart from some minor changes22:41
flwangthat's cool22:42
Nisha_Agarwalflwang, BTW coreos has deprecated cloud-init so how does coreos driver works for meta-data agent22:42
flwangNisha_Agarwal: that's a good piont, we didn't put much love on cores due to the limited resources22:43
Nisha_Agarwalflwang, i had tried that too but then we learnt the above intel driver requirement and has to leave that in between. but i couldnt make coreos work for metadata agent22:43
flwangI know someone is working on that, but i haven't reviewed the patch yet22:43
Nisha_Agarwalwith latest coreos image in place22:43
flwangNisha_Agarwal: could you please leave comments on https://review.openstack.org/579026 ?22:44
flwangso that he/she won't go wrong direction for some cases22:44
Nisha_Agarwalflwang, sure. i will look at the changes and review it22:45
Nisha_Agarwalbecause i fixed that for baremetal also22:45
flwangNisha_Agarwal: fantastic, many thanks22:45
Nisha_Agarwalflwang, do u know in what timezone strigazi works22:46
Nisha_Agarwal?22:46
Nisha_AgarwalI am in IST22:46
Nisha_Agarwalhere it is 4.16 am right now22:47
flwangwait a sec22:47
flwang Tuesday, 14 August 2018   (GMT+2)     Time in Geneva, Switzerland22:47
Nisha_Agarwali would like to double check heat container agent related warnings once again22:47
Nisha_Agarwalok22:48
flwangnow 12:47 AM22:48
flwangi'm based in NZ22:48
Nisha_Agarwal:)22:48
Nisha_AgarwalOk i wil check with him tomorrow if i can catch him22:49
flwangcool, good luck22:49
Nisha_Agarwalflwang, many thanks for your explanations22:49
flwanganytime22:49
Nisha_Agarwalthey are really helpful22:49
Nisha_Agarwal:)22:49
Nisha_Agarwali am new to magnum and just know little bit in it22:49
Nisha_Agarwalbefore magnum have worked in ironic a lot22:50
flwangno problem, we're very welcome to new contributors22:50
flwangah, i see.22:50
Nisha_Agarwal:)22:50
flwangI can see you have done a lot contributions on ironic22:50
Nisha_Agarwal:) yeah...wanted to do something different so now having hands on magnum22:50
Nisha_Agarwal:)22:50
flwangnice nice22:51
Nisha_AgarwalOk logging off for today. see u tomorrow22:52
Nisha_Agarwalgn22:52
flwangcya22:53
*** Nisha_Agarwal has quit IRC23:17
openstackgerritFeilong Wang proposed openstack/magnum master: [k8s] Add new label `service_cluster_ip_range`  https://review.openstack.org/57853123:20
*** salmankhan has quit IRC23:25
*** flwang1 has joined #openstack-containers23:28
openstackgerritFeilong Wang proposed openstack/magnum master: [k8s] Update cluster health status by native API  https://review.openstack.org/57289723:52
« Sunday, 2018-08-12 Index Tuesday, 2018-08-14 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!