Thursday, 2017-07-27

« Wednesday, 2017-07-26 Index Friday, 2017-07-28 »
openstackgerritAntoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: allow overriding keystone config  https://review.openstack.org/48751700:25
openstackgerritAntoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: do not delete service ipallocation pool  https://review.openstack.org/48751800:25
*** kiennt has joined #openstack-kuryr00:42
*** limao has joined #openstack-kuryr00:46
*** caowei has joined #openstack-kuryr01:04
openstackgerritLiping Mao proposed openstack/kuryr-libnetwork master: Fix Rally test case error.  https://review.openstack.org/48747601:14
*** yedongcan has joined #openstack-kuryr01:18
*** yedongcan has quit IRC01:23
*** yedongcan has joined #openstack-kuryr01:23
*** yamamoto_ has quit IRC01:31
*** yamamoto has joined #openstack-kuryr01:35
*** tonanhngo has joined #openstack-kuryr01:48
*** limao has quit IRC02:00
*** limao_ has joined #openstack-kuryr02:00
*** limao_ has quit IRC02:19
*** limao has joined #openstack-kuryr02:20
*** limao has quit IRC02:50
*** limao has joined #openstack-kuryr02:51
openstackgerritJaivish Kothari(janonymous) proposed openstack/kuryr-kubernetes master: Systemd usage of kubernetes startup  https://review.openstack.org/48475403:00
*** rwallner has joined #openstack-kuryr03:16
*** rwallner has quit IRC03:20
*** aojea has joined #openstack-kuryr03:23
*** limao has quit IRC03:26
*** aojea has quit IRC03:28
vikascirenab, hi03:36
vikascirenab, did you notice apuimedo's reply to your comments on network-addon patch?03:37
openstackgerritvikas choudhary proposed openstack/kuryr-kubernetes master: Add support to install Kuryr as a network addon  https://review.openstack.org/46667503:45
*** longfei_zhang has joined #openstack-kuryr04:06
longfei_zhangirenab, Kuryr support that set the fix clusterIP in service yaml file, i have tested this04:09
longfei_zhangthe previous error war due to the wrong  clusterIP in yaml file04:10
openstackgerritMerged openstack/kuryr-kubernetes master: devstack: Move to devstack-plugin-container  https://review.openstack.org/47423804:11
*** limao has joined #openstack-kuryr04:30
*** gouthamr has quit IRC04:38
*** tonanhngo has quit IRC04:44
*** limao has quit IRC04:47
*** limao has joined #openstack-kuryr04:59
*** caowei has quit IRC05:06
*** hyunsun has joined #openstack-kuryr05:11
*** aojea has joined #openstack-kuryr05:31
*** kiennt has quit IRC05:44
*** hongbin has joined #openstack-kuryr05:47
*** janki has joined #openstack-kuryr05:50
*** yuanying has joined #openstack-kuryr05:57
*** caowei has joined #openstack-kuryr05:58
*** yboaron_ has joined #openstack-kuryr06:01
*** kiennt has joined #openstack-kuryr06:02
*** kiennt has quit IRC06:16
*** kiennt_ has joined #openstack-kuryr06:17
*** kiennt has joined #openstack-kuryr06:17
*** kiennt has quit IRC06:17
*** kzaitsev_ws has joined #openstack-kuryr06:33
*** tonanhngo has joined #openstack-kuryr06:34
*** tonanhngo has quit IRC06:39
*** kzaitsev_ws has quit IRC06:56
*** hongbin has quit IRC07:04
*** aojea_ has joined #openstack-kuryr07:08
*** aojea has quit IRC07:12
ltomasbohi apuimedo07:32
ltomasboI complete the installation without problems, and the information is right at the nested kuryr.conf07:33
ltomasbohowever, it is not working, and I'm not sure if it is due to the different project07:33
ltomasbohttp://paste.openstack.org/show/616666/07:37
*** yboaron_ has quit IRC07:38
ltomasboumm, weird:  openstack port create --network k8s-pod-net --project k8s test07:39
ltomasboHttpException: Conflict (HTTP 409) (Request-ID: req-b97a79e6-b90d-44ea-88a3-d69c639536ac), No more IP addresses available on network 9dcaeaf9-2d54-439d-a45a-97e996a24b32.07:39
*** kural_ has joined #openstack-kuryr07:43
*** kural has joined #openstack-kuryr07:43
*** kural_ has quit IRC07:46
*** kural has quit IRC07:46
*** egonzalez has joined #openstack-kuryr07:48
*** roeyc has joined #openstack-kuryr07:49
*** garyloug has joined #openstack-kuryr08:04
*** tonanhngo has joined #openstack-kuryr08:15
*** tonanhngo has quit IRC08:19
*** longfei_zhang has quit IRC08:21
*** kural has joined #openstack-kuryr08:21
*** yboaron_ has joined #openstack-kuryr08:33
openstackgerritDaniel Mellado proposed openstack/kuryr-kubernetes master: DNM Infra test  https://review.openstack.org/48776208:49
*** hyunsun has quit IRC08:50
*** kzaitsev_ws has joined #openstack-kuryr08:51
kzaitsev_wshm, I wonder if we need a release for kuryr k8s for p-308:52
kzaitsev_wskuryr-k8s is cycle with intermediary, right?08:53
kzaitsev_wsok then we need to make a release by August 21st that will be the cycle release08:55
apuimedoltomasbo: ok. I know about this error ltomasbo08:55
apuimedoltomasbo: I'll upload a fix in a moment08:55
apuimedokzaitsev_ws: yes we do08:55
kzaitsev_wswas just wrapping up murano release tasks.09:03
irenabvikasc: I am going to verify https://review.openstack.org/#/c/466675/. Any advice on the steps?09:03
kzaitsev_wsand thought to check09:03
openstackgerritAntoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: Use separate nets and project for kuryr  https://review.openstack.org/48613409:04
apuimedoltomasbo: here you have your fix ^^09:04
vikascirenab, you will have to change configmap values for kuryr config, besides i think README instructions should be enough build the images09:05
apuimedovikasc: they are enough09:06
apuimedovikasc: but no need to build09:06
apuimedoI already built and pushed them to dockerhub09:06
vikascyeah she can use the docker images09:06
apuimedoso she can just do docker pull for them09:06
vikascyep09:06
vikascirenab,09:06
apuimedovikasc: dmellado: did you see about my idea to have a gate that builds the images and puts them to tarballs.openstack.org09:07
apuimedoso other gates can use them?09:07
vikascyep, sounds good to me09:08
kzaitsev_wsapuimedo: there was a lengthy discussion about why kolla shouldn't do exactly that09:08
kzaitsev_wson ML09:08
kzaitsev_wsI don't remember what was the conclusion though09:08
apuimedokzaitsev_ws: but that's what they do right?09:09
apuimedothey were my inspiration09:10
apuimedolook, all I want is a darned infra docker registry09:10
apuimedobut this is taking longer than Catalan independence already09:10
kzaitsev_wshttp://lists.openstack.org/pipermail/openstack-dev/2017-May/116677.html09:11
* kzaitsev_ws afk will be back in 15 mins09:12
apuimedothanks kzaitsev_ws09:12
* apuimedo should read ml more often09:13
*** longfei_zhang has joined #openstack-kuryr09:15
*** kiennt_ is now known as kiennt09:15
*** limao has quit IRC09:21
*** limao has joined #openstack-kuryr09:22
*** limao has quit IRC09:26
longfei_zhangHi I have a question , can we set the pod_subnet and service_subnet to the same subnet?09:27
apuimedolongfei_zhang: why do you want that?09:27
longfei_zhangjust curious09:28
longfei_zhangif so then we will face conflict ip address?09:28
longfei_zhangk8s pass the service cluster ip to kuryr , maybe this ip already used by pod , right?09:28
longfei_zhangif they are using the same subnet09:29
apuimedolongfei_zhang: I'm not surprised you are curious. It is an interesting proposition09:31
apuimedothe conflict would come if and when Kubernetes would decide on a clusterIP that is already taken by the pods09:31
apuimedoI don't think kubernetes IPAM looks at pod IPs to see which clusterIPs are free09:31
longfei_zhangapuimedo, yes09:32
apuimedoIIRC kubernetes assumes they are different allocation ranges09:32
longfei_zhangok09:32
apuimedoltomasbo: it passed ;-) https://review.openstack.org/#/c/486134/09:32
dmelladoapuimedo: I didn't09:33
dmelladodo you have any email/blueprint about that?09:33
apuimedodmellado: nah...09:33
apuimedoIt was something I wrote yesterday on IRC09:33
longfei_zhangapuimedo, currently the lb's performance is not good, so if they are in different subnets, they have to go thorugh the route09:34
dmelladoapuimedo: they're decommissioning my bouncer09:34
* dmellado cries09:34
ltomasboapuimedo, going to test it now09:34
longfei_zhangif they can use the same subnet ,then performance will be  better09:34
ltomasboapuimedo, we should also remove all that stuff at the unstack (as irenab suggested)09:34
irenablongfei_zhang: I am fraid this is not properly supported by kuryr09:37
apuimedodmellado: I can rent you an account in my home bouncer09:38
longfei_zhangirenab, yes09:38
dmelladoapuimedo: does it include internal access?09:38
apuimedoit costs one arbitrary patch a month09:38
apuimedodmellado: of course it does09:38
dmelladoapuimedo: I'll hook my znc onto yours09:39
dmelladoxD09:39
apuimedo99.5% availability09:39
apuimedoltomasbo: which stuff?09:40
apuimedoirenab: longfei_zhang: I'm not even sure it could be supported09:40
apuimedolongfei_zhang: I think the best bet would be to use a neutron plugin that doesn't go all the way to the router, like ovn or dragonflow09:40
apuimedoirenab: longfei_zhang: do you have some idea how it could be done in the same subnet?09:41
apuimedommmm09:41
apuimedomoment, let me think09:41
apuimedook, I haven't tried this09:41
irenabfrom the admin perspective, I think it makes sense to have sparate subnets (or at least ranges ) for Pod sand Services09:41
apuimedobut probably it would be possible to give kubernetes a subnet of the real subnet09:41
apuimedolet's say that you have a /2209:42
apuimedoso you tell kubernetes API server that the service subnet is a /24 of that09:42
apuimedothen you modify the pod subnet in neutron so that its allocation pools don't include that /2409:43
apuimedoand you tell kuryr-kubernetes that both the pod subnet and the service subnet are the same09:43
apuimedolongfei_zhang: irenab: I think this could work09:43
openstackgerritAntoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: allow overriding keystone config  https://review.openstack.org/48751709:43
kzaitsev_wsirenab: longfei_zhang: I believe k8s doesn't check anything but already allocated ips when choosing an ip for a new service09:44
vikascirenab, addressed your comment about adding reference to dockerhub images in README. PTAL09:44
kzaitsev_wsah09:44
kzaitsev_wsyeah. probably using same subnet, different ranges might work09:44
irenabkzaitsev_ws: correct09:44
apuimedolongfei_zhang: It would be interesting if you can try this09:45
apuimedoand report back09:45
apuimedomaybe send a doc patch explaining this deployment variation09:45
longfei_zhangapuimedo, ok  I will try this09:48
vikascirenab, do you want me to move instructions from README to a doc, "containerized-installation.rst" in /source/installation? or you meant something else.09:48
apuimedothanks longfei_zhang. I'll eagerly await the result of the investigation09:49
irenabvikasc: I think this  is a good idea, it is about installation mainly09:49
apuimedovikasc: I think that's a good idea09:49
ltomasboapuimedo, the lbaas, subnet and networks created09:49
apuimedoltomasbo: good09:49
vikascok, going to update09:49
apuimedothanks09:52
apuimedoltomasbo: so, can you create the ports now?09:52
irenabvikasc: I think with devstack support, the kuryr.yml can be updated automatically09:53
apuimedoirenab: yes. But do we want a devstack that build the images and then uses them?09:53
vikascirenab, yes09:53
vikascapuimedo, cant devstack have option to either build or pull from dockerhub?09:54
irenabapuimedo: I think so, maybe it can use latest image based on some config in devstack09:54
irenabvikasc: :-)09:54
irenabeventually we will have a book on varios options in devstack09:55
vikasc:D09:55
apuimedovikasc: sure it can09:55
apuimedovikasc: irenab: but please, not on this patch09:55
apuimedolet's put it as a follow-up09:56
apuimedoI don't want it any bigger09:56
apuimedoirenab: I haven't forgotten about your worker node only multi node devstack09:57
apuimedoI have it open and I'll get to it09:57
apuimedoI hope soon I can stop doing devstack patches09:57
apuimedocause bash and I don't like each other09:57
irenabapuimedo: I think dmellado already picked this one09:57
apuimedodmellado: you did?09:58
* dmellado gets into context09:58
irenabI did some ugly changes locally based on ltomasbo advice and got it run09:58
dmelladooh, that one, yes09:58
dmelladoI still didn't get the time to work on that09:58
dmelladoso if you've a working patch before me don't hesitate to push it there09:58
* dmellado into endless meetings today...09:59
*** yamamoto has quit IRC10:00
ltomasboirenab, great! (and I agree they are ugly! At least the ones I did)10:00
irenabltomasbo: I totally ruined the one with kuryr-kubernetes enabled, but for worker node only it seems to work10:01
ltomasbo:D10:02
ltomasboapuimedo, re-stacking10:02
ltomasboapuimedo, it was easy than remove the networks, that also were failing due to some ports bounds10:02
apuimedo:-)10:05
irenabapuimedo: vikasc : what should be set in kuryr.yml for the images from dockerhub?10:09
openstackgerritMerged openstack/kuryr-kubernetes master: Systemd usage of kubernetes startup  https://review.openstack.org/48475410:10
vikascirenab, in that case, imagePullPolicy: Never, will have to removed i guess10:10
apuimedoirenab: vikasc: can I get https://review.openstack.org/#/c/486134/9 merged?10:11
irenabapuimedo: this one is next after vikasc patch verifucation10:11
irenabgive 1 hour at most10:11
apuimedoirenab: ok. it is exercised by devstack gate, so I think that for this one the gate can be trusted10:12
irenabapuimedo: great, so will just do a quick overview10:13
vikascapuimedo, will take a look after updating updating the changes to move instaructions from readme10:13
apuimedothanks irenab10:19
apuimedovikasc: very well10:19
ltomasboapuimedo, I'm testing it right now10:21
openstackgerritHyunsun Moon proposed openstack/kuryr-libnetwork master: Add new network ID pattern  https://review.openstack.org/48780210:21
ltomasboI'll give the +1 as soon as it finished for my nested deployment10:21
apuimedoltomasbo: good10:21
*** tonanhngo has joined #openstack-kuryr10:21
ltomasboapuimedo, should be done in 5 minutes or so10:21
apuimedogreat, thanks10:21
*** tonanhngo has quit IRC10:26
openstackgerritAntoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: allow overriding keystone config  https://review.openstack.org/48751710:27
*** yamamoto has joined #openstack-kuryr10:31
openstackgerritvikas choudhary proposed openstack/kuryr-kubernetes master: Add support to install Kuryr as a network addon  https://review.openstack.org/46667510:32
openstackgerritvikas choudhary proposed openstack/kuryr-kubernetes master: Add support to install Kuryr as a network addon  https://review.openstack.org/46667510:34
vikascirenab,  moved instructions from readme to containerized.rst ^10:36
irenabvikasc: checking10:36
vikascthanks10:36
irenabvikasc: with devstack, do I need to stop kuryr-kubernetes and kubelet before or its ok after the kuryr.yml deployment?10:41
vikascirenab, you will need to add subnet id etc in kuryr.yml, which will available only after devstack has run.10:42
vikascirenab, or may be i misread your question10:43
apuimedoirenab: before10:44
vikascirenab, if thats the case , can you please reword your query10:44
irenabapuimedo: thanks, since I forgot and now need to restack to verify …10:44
*** rwallner has joined #openstack-kuryr10:44
apuimedowhy?10:45
*** rwallner has quit IRC10:45
apuimedoirenab: ^^10:45
irenabpods just stuck in the pending10:45
*** rwallner has joined #openstack-kuryr10:45
irenabdo not know why, let me do it properly10:45
apuimedook10:45
irenab1. devstack 2. set kuryr.yml with config 3. stop kubelet and kuryr-k8s services 4. kubectl apply -f kuryr,yml. correct?10:46
vikasccorrect10:46
vikascirenab, or just dont enable kuryr-kubernetes plugin in devstack localrc10:47
irenabvikasc: how would I get the config for the yml then?10:47
vikascirenab, i just set default subnet id and demo project ids in configmap10:48
irenabvikasc: hm. If the flow I suggested won’t work, will do your way10:49
apuimedoirenab: if you don't disable them, it may be necessary to disable kuryr cni (so they don't get stuck on pending)10:49
apuimedois that right, vikasc ?10:49
apuimedoor do we have cni code that skips host networking pods?10:49
irenabapuimedo: vikasc : open for any verification flow you suggest as long as its clear10:50
vikascapuimedo, hostnetworking pod, i.e cni daemonset pod, dont need cni plugin10:52
apuimedovikasc: is the controller the same?10:53
vikascirenab, which pod was in pending state, controller or cni or the application pods?10:53
vikascapuimedo, yes10:53
vikascapuimedo, controller container also host networking10:53
irenabapuimedo: vikasc : now at step 310:54
irenabcurrently both are pending10:55
vikascare you able launch a sample pod?10:56
vikascjust to see if NoSchedule taint is not there10:56
irenabI stopped kuryr and kubelet, so won’t work10:56
irenabbrb10:56
vikasckubelet you should not stop10:56
vikascirenab,10:56
vikascirenab, i am assuming that you have installed k8s using kubeadm10:57
apuimedovikasc: no, she said devstack10:58
apuimedoso hyperkube10:58
vikascis she is stopping kubelet how pods will run10:59
vikascapuimedo, is it expected that this patch will work on a non-kubeadm installed deployment also11:00
apuimedovikasc: yeah. kubelet should not be stopped11:00
apuimedoonly kuryr things should be stopped11:01
vikascapuimedo, let me check network-addon functionality docs to verify it is supported only with kubeadm or with all schemes11:01
apuimedovikasc: any recent kubernetes deployment should be game11:01
apuimedoand by game I meant that we'd accept patches to increase compatibility11:01
vikascapuimedo, current patch should work on devstack installed k8s as well.11:04
apuimedoyes, I think so11:04
vikascirenab, can you please just stop kuryr-k8s and not kubelet11:05
vikascirenab, also please delete devstack installed cni binary from /opt/cni/bin11:06
vikascapuimedo, ^ make sense?11:06
vikascand then move on to step 4.11:06
irenabback11:08
irenabvikasc: apuimedo : seems it just cannot get the image11:09
apuimedoirenab: do a "docker pull"11:10
apuimedoand then tag them with docket tag11:10
apuimedoas kuryr/cni:latest and kuryr/controller:latest11:10
irenabnot the tag in the dockerhub?11:11
irenabI modified the yml with it11:11
apuimedoirenab: paste the yml11:11
apuimedopleas11:11
apuimedo*please11:11
irenaba sec11:12
vikascirenab, can you please try with imagePullPolicy: IfNotPresent11:13
irenabhttps://pastebin.com/sixBYmaF11:15
irenabtrying with the pull11:16
vikascirenab,  "imagePullPolicy: IfNotPresent"  or "imagePullPolicy: Always" should also work.11:19
irenabvikasc: gonna try it now11:19
vikascirenab, thanks and sorry for wrong information to delete imagePullPolicy earlier.11:20
irenabvikasc: please add the details about cni removal and kuryr service stop somewhere11:22
apuimedokzaitsev_ws: ltomasbo: do you see the mistake in https://review.openstack.org/#/c/487517/4 ?11:23
apuimedoI'm a bit puzzled11:23
apuimedo(probably as a result of staying with devstack until 3am)11:23
apuimedo:P11:23
kzaitsev_wsapuimedo: looking at it right now )11:23
apuimedoI just don't see that trailing backslash11:24
apuimedofscking hell11:24
vikascirenab, sure. you got it working?11:25
apuimedoline 194 of devstack/lib/kuryr_kubernetes11:25
irenabvikasc: not yet11:26
vikascirenab, still cni and controller pods in pending state?11:27
irenabno, some error in yml to json11:27
openstackgerritAntoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: allow overriding keystone config  https://review.openstack.org/48751711:28
kzaitsev_wsapuimedo: found? =)11:29
apuimedokzaitsev_ws: nah...11:30
apuimedothose are cosmetic things I improved11:30
kzaitsev_wsok then I think I found it =)11:30
apuimedook, let's try11:31
kzaitsev_ws$ openstack --help | grep project-id11:31
kzaitsev_ws                 [--os-project-id <auth-project-id>]11:31
apuimedokzaitsev_ws: right11:32
apuimedothe error message seems to point to something else though11:32
apuimedoI wonder if it's just poor error handling11:32
openstackgerritAntoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: allow overriding keystone config  https://review.openstack.org/48751711:32
vikascirenab, i am trying again locally to verify any kuryr.yml related error11:33
irenabok11:33
kzaitsev_wshttp://logs.openstack.org/17/487517/4/check/gate-install-dsvm-default-kuryr-kubernetes/aa21237/logs/devstacklog.txt.gz#_2017-07-27_10_42_22_24411:34
kzaitsev_wsalthough yes11:34
kzaitsev_wsI'm perplexed by how it'11:34
kzaitsev_wss showing the whole line instead of just the11:35
kzaitsev_wsactual error. (having trouble printing straight)11:35
kzaitsev_wss/printing/typing/11:35
vikascirenab, it ran fine without any yml to json related error11:35
irenabI think I got rid of it now11:36
irenabpods are running11:36
irenabnow going to try to deploy some app and see that it works11:36
irenabvikasc: what do you usually use to verify?11:37
apuimedo:-)11:38
openstackgerritMerged openstack/kuryr-kubernetes master: devstack: Use separate nets and project for kuryr  https://review.openstack.org/48613411:39
irenabvikasc: another question. any reason to use yml extension and not yaml?11:39
vikascirenab, no specific reason11:40
irenabin k8s they use yaml all over in the examples11:40
vikascirenab, i am naive and dont understand difference between the two11:40
*** yboaron_ has quit IRC11:41
irenabvikasc: seems it has almost religion involved :-) https://stackoverflow.com/questions/22268952/what-is-the-difference-between-yaml-vs-yml-extension11:41
vikasc:D11:41
vikasci was always using both interchangebly11:42
vikascirenab,11:43
vikasckuryr-kubernetes]# cat ~/demo1.yml11:43
vikascapiVersion: v111:43
vikasckind: Pod11:43
vikascmetadata:11:43
vikasc  name: my.pod111:43
vikascspec:11:43
vikasc  containers:11:43
vikasc  - name: demo111:43
vikasc    image: nginx:latest11:43
kzaitsev_wsseems like jpeg vs jpg...11:44
irenabvikasc: I tryed the guestbook-all-in-one k8s example, all pods are in Container create11:44
apuimedokzaitsev_ws: it is yml vs jpeg11:44
vikasci just run this test pod to see if it gets ip fromneutron11:44
apuimedoxD11:44
kzaitsev_wsthe only problem with nginx is that it doesn't have ip/ifconfig nothing, so I use 2-container pods with busybox =)11:44
irenab network: failed to find plugin \"kuryr-cni\" in path [/opt/stack/cni/bin /opt/kuryr-cni/bin]"11:46
irenabvikasc: this is what I get in the pod events11:46
irenabany idea what I did wrong?11:47
vikascirenab, if cni daemonset pod is running fine, it should have copied kuryr-cni at /opt/cni/bin11:47
irenabwith devstack we put it in the /opt/stack/cni/bin11:48
irenabvikasc: I see it in the path you posted11:48
*** apuimedo_ has joined #openstack-kuryr11:49
vikascirenab, if you see in the error, kubelet is not searching in correct path11:49
irenab#!/bin/bash11:49
irenabexport PBR_VERSION='0.1.1.dev26'11:49
vikascirenab, cni directory path is passed to kubelet11:49
*** apuimedo has quit IRC11:49
*** apuimedo_ is now known as apuimedo11:49
vikascirenab, you can do a "ps ax | grep kubelet" to see what path is being passed to kubelet for cni location11:50
kzaitsev_wsapuimedo: still failing, but we caught the right error there http://logs.openstack.org/17/487517/6/check/gate-install-dsvm-default-kuryr-kubernetes/fb19cbf/logs/devstacklog.txt.gz#_2017-07-27_11_40_22_52711:51
vikascirenab, two solutions, either pass /opt/cni/bin to kubelet or copy contents of /opt/cni/bin/ to /opt/kuryr-cni/bin11:51
irenab --cni-bin-dir=/opt/stack/cni/bin --cni-conf-dir=/opt/stack/cni/conf11:51
vikascyeah11:52
vikascthats the inconsistency between paths11:52
irenabvikasc: I just restarted the kubelet service after the kuryr.yml was done11:52
vikascsystemctl restart kubelet?11:53
vikascirenab,11:53
irenabdevstack@kubelet.service11:53
vikascok11:53
*** kural has quit IRC11:54
vikascyou can change cni dir path from within kuryr devstack plugin, i think11:54
kzaitsev_wsapuimedo: I think we sould add a user role to the newly created project out there11:54
openstackgerritHyunsun Moon proposed openstack/kuryr-libnetwork master: Add new network ID pattern  https://review.openstack.org/48780211:57
vikascirenab, worked?12:05
*** caowei has quit IRC12:05
irenabvikasc: no12:06
vikascirenab, what error now12:06
irenabcan you try on your side with the devstack ?12:06
irenabnetwork: netplugin failed but error parsing its diagnostic message \"\": unexpected end of JSON input12:07
irenabvikasc: how to see the logs from the kuryr-controller?12:09
vikascirenab, i use devstack just to install neutron and keystone and install kubernetes using kubeadm. This patch does not claim to be supporting kuryr devstack plugin. I  can try though.12:10
vikascirenab, kubectl logs <controller-pod-name>12:10
*** kiennt has quit IRC12:11
irenabvikasc: I think maybe we need more complete installation guide, or just list of prerequisite12:11
apuimedovikasc: is the cni conf specifying use_stderr?12:12
vikascapuimedo, it must.12:13
vikascapuimedo, cp /opt/kuryr-kubernetes/etc/cni/net.d/* "$CNI_CONFIG_DIR_PATH"12:13
vikascapuimedo, are you suggesting to make this change12:13
apuimedovikasc: as a follow-up12:13
apuimedokzaitsev_ws: you were right12:14
apuimedothat was the problem12:14
vikascapuimedo, sure12:14
*** yamamoto has quit IRC12:14
apuimedofunnily enough, now it tells me that there's some auth issue12:14
apuimedohttp://logs.openstack.org/17/487517/6/check/gate-install-dsvm-default-kuryr-kubernetes/fb19cbf/logs/devstacklog.txt.gz12:14
apuimedo:/12:14
*** atoth has joined #openstack-kuryr12:15
vikascirenab, use_stderr = true, must be there in cni config map12:15
irenabvikasc: it is there12:16
apuimedoirenab: I answered your question on vikas' patch12:17
vikascirenab, if i mention in the containerized.rst that currently kuryr devstack plugin is not supported, and steps on how to install k8s, devstack and kuryr, will that be fine12:18
apuimedovikasc: fine to me12:19
irenabvikasc: I would prefer to have it working for devs as well12:21
irenabvikasc: if I understand correctly  what you are saying, it should be fine12:22
apuimedoirenab: is it fine for you if I add it as a follow-up patch now and we verify the follow-up patch?12:22
apuimedoand then merge both together?12:22
irenabapuimedo: I am just not sure how to verify the current patch12:22
irenabhow did you do it?12:23
vikasc1. run devstack without kuryr plugin12:23
vikasc2. install k8s using kubeadm12:23
vikasc3. update kuryr.yml configmaps12:24
vikasc4. kubectl apply -f kuryr.yml12:24
vikascirenab, ^12:24
irenabvikasc: do you have instructions for step 2?12:25
vikascirenab, sure12:25
vikascirenab, this is the simplest way to install k8s, wait a moment12:25
irenabapuimedo: I recall we planned to have kubeadm replace hyperkube in devstack. Is it still omn the map?12:26
vikascirenab, https://kubernetes.io/docs/setup/independent/create-cluster-kubeadm/12:26
vikascirenab, to summarize,  install kubeadm, https://kubernetes.io/docs/setup/independent/install-kubeadm/12:27
vikascand then kubeadm init12:27
irenabvikasc: for step 1; do you have local.conf?12:29
vikascyes12:29
vikascirenab, wait, will share paste12:30
apuimedoirenab: it is on the roadmap for p312:31
apuimedobut it is pending on this patch from vikas, actually :P12:31
irenab:-)12:32
apuimedoirenab: also on other things12:33
apuimedoit is not well documented how to point it to an existing etcd, for example12:33
apuimedoI researched it a bit12:33
apuimedobut I had to prioritize the octavia stuff first12:33
apuimedosince what we currently have, works12:33
irenabapuimedo: I would prefer to have dev andproducton envs as similar as possible12:34
apuimedoirenab: I agree12:34
apuimedoit's just harder to justify the time spent12:34
apuimedowhen replacing something that works12:34
vikascirenab, localrc http://paste.openstack.org/show/616714/12:35
*** kural has joined #openstack-kuryr12:35
vikascirenab, please note that at the end of file, kubelet and kuryr related lines are commented12:36
*** apuimedo has quit IRC12:42
*** apuimedo has joined #openstack-kuryr12:42
irenabapuimedo: yea12:44
*** alraddarla has joined #openstack-kuryr12:46
irenabvikasc: sorry, it takes me time to verify, hope to complete it today12:53
vikascirenab, no problem. I will hold on and see if get more suggestions from you before updating the patch12:54
apuimedoirenab: keep pinging if you encounter issues12:59
irenabapuimedo: sure13:02
apuimedoirenab: I'll make the follow-up patch that adds support for it in devstack13:02
irenabapuimedo: great, thanks13:02
irenabnot having kuryr services running as k8s elements is really bad13:03
apuimedoirenab: hence why I'm so eager to merge this13:05
apuimedoxD13:05
irenabapuimedo: my first prio for the rest of theday13:05
apuimedoirenab: thanks a lot13:07
apuimedoyour verification is improving the quality13:08
irenabI hope so13:10
*** yedongcan has left #openstack-kuryr13:10
*** yamamoto has joined #openstack-kuryr13:14
*** yamamoto has quit IRC13:21
*** gouthamr has joined #openstack-kuryr13:31
irenabvikasc: what about docker?13:34
*** kural has quit IRC13:36
*** kural has joined #openstack-kuryr13:36
apuimedoirenab: what about it?13:38
irenabapuimedo: it was commented in the local.conf that vikasc posted. I wonder if he installed it manually since it seems not be part of the kubeadm install13:39
irenabkubeadm init complains about not having it13:40
apuimedoirenab: you know what. I start the patch13:44
apuimedofor devstack integration13:44
apuimedoI'll rebase vikasc patch on master as well13:44
*** yboaron_ has joined #openstack-kuryr13:45
irenabapuimedo: I am lamost done deploying the env. but I think we need some sort of the policy to have proper info for testing if the patch does not include testing13:45
apuimedoirenab: I agree13:46
* irenab starting to master devstack a little13:46
apuimedobut yeah, install docker <=1.12.113:46
apuimedoirenab: if you say such things I'll assign you the devstack patches. I'd be happy not to have to do them XD13:46
irenabapuimedo: heh, mostly on user side13:47
apuimedopity13:47
apuimedoI'm so sick of devstack13:47
apuimedoI wish I could replace it with ansible13:47
irenabi can imagine13:47
*** roeyc has quit IRC13:49
*** ashishb_ has joined #openstack-kuryr14:01
*** ashishb has quit IRC14:04
*** janki has quit IRC14:14
apuimedodmellado: do you know how to refer to the devstack directory from plugin.sh ?14:29
apuimedo(as in, where the local.conf lives)14:29
dmelladoI'd say let's write ansiblestack14:29
dmelladoand drop devstack xD14:29
dmelladoI do *recall* that there were some var14:29
dmelladolet me check14:29
dmelladooh, you mean the devstack dir where it was cloned14:31
dmelladoI was thinking about /opt/stack14:32
dmelladowhich is DEST=${DEST:-/opt/stack}14:32
dmelladoapuimedo: from the stack.sh run14:33
dmelladothat dir is being kept as14:33
dmellado  69 # Keep track of the DevStack directory14:34
dmellado  70 TOP_DIR=$(cd $(dirname "$0") && pwd)14:34
dmelladoso depending on what you're trying to modify you should be able to get that var14:34
apuimedodmellado: I meant $TOP_DIR14:35
apuimedojust found it now14:35
dmelladoapuimedo: please don't break devstack more than it already is xD14:35
apuimedodmellado: you've seen nothing14:36
apuimedoIt's going to make uruk hai look pretty14:36
openstackgerritLuis Tomas Bolivar proposed openstack/kuryr-kubernetes master: Spec for adding OpenDaylight support in kuryr-k8s  https://review.openstack.org/48788514:56
*** kzaitsev_ws has quit IRC14:56
openstackgerritLuis Tomas Bolivar proposed openstack/kuryr-kubernetes master: Spec for adding OpenDaylight support in kuryr-k8s  https://review.openstack.org/48788515:01
openstackgerritLuis Tomas Bolivar proposed openstack/kuryr-kubernetes master: Update documentation about nested deployment  https://review.openstack.org/48790615:26
apuimedoirenab: ltomasbo: dmellado: Octavia is working!15:32
dmelladoapuimedo: \o/15:33
apuimedohttp://paste.openstack.org/show/616753/15:33
dmelladopls send any needed patch and I'll update the gates when you're done ;)15:33
apuimedodmellado: it's already merged ;-)15:33
apuimedoonly the local.conf is missing15:33
dmelladoawesome, so we can modify that on the gates :P15:33
apuimedodmellado: I'd rather you create additional devstack and tempest gates for octavia15:34
dmelladooh, so much work! xD15:34
apuimedountil we deprecate and drop plain old neutron lbaasv215:34
dmelladoI'll create a new -octavia gate15:34
apuimedodmellado: come on, you can do it before going on holiday15:34
*** yboaron_ has quit IRC15:34
dmelladoI deff can xD15:35
dmelladobut I'll need to delay my bp about moving everything to devstackgaterc and reorganize15:35
dmelladoxD15:35
ltomasboapuimedo, great!15:35
apuimedodmellado: http://paste.openstack.org/show/616754/15:35
apuimedodmellado: is that a lot of work?15:35
dmelladonah, but I'll need to sort a few things out15:36
ltomasboapuimedo, so, you need to enable q-lbaas-v2 and a few octavia services and pluggins (plus barbican)15:36
ltomasboand that is pretty much it?15:37
dmelladoapuimedo: are you enabling barbican for any reason?15:37
apuimedoltomasbo: and the placement API15:38
apuimedodmellado: it is used for the amphorae15:38
ltomasboapuimedo, placement API is always needed for VMs, isn't it?15:38
apuimedoltomasbo: I don't know :P15:41
apuimedoxD15:41
ltomasboyep, I think they split the placement out from the scheduler a few months ago15:42
ltomasboanyway, great news! and nice to know that we only needed to change the local.conf! that is awesome!15:42
*** hongbin has joined #openstack-kuryr15:48
apuimedoltomasbo: well, some devstack changes as well ;-)15:49
ltomasbo:D15:49
*** egonzalez has quit IRC16:02
dmelladoapuimedo: https://review.openstack.org/48792816:08
dmelladostart preparing fuets16:08
apuimedodmellado: it failed :P16:13
dmelladodammity16:14
dmelladotypo16:14
dmelladoxD16:14
apuimedo:-)16:14
*** roeyc has joined #openstack-kuryr16:15
apuimedomeh16:15
apuimedoI just noticed that I create an interface for the kubelet to be able to do probes16:15
apuimedobut now it's in a different subnet and without a route to it16:15
* apuimedo facepalms16:16
*** roeyc has quit IRC16:16
dmelladoapuimedo: as long as you don't create a makefile I'm fine16:17
apuimedoxD16:17
apuimedodmellado: you know that golang uses makefiles, right?16:17
dmelladothat's a different story16:18
dmelladoyou know which ones I'm referring to16:18
dmelladoxD16:18
dmelladodon't play dumb xD16:18
*** kural has quit IRC16:18
openstackgerritAntoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: create host interface to the pod subnet  https://review.openstack.org/48793516:24
apuimedodmellado: please, review ^^16:24
apuimedoirenab: if you are still here too16:25
apuimedo:-)16:25
dmelladoapuimedo: https://review.openstack.org/487928 let's exchange reviews xD16:25
apuimedodmellado: why experimental man!16:28
apuimedothen it only runs if manually triggered16:28
dmelladobecause I want to test this refactor16:28
apuimedoput it in check as non voting16:28
dmelladoand it's totally cheap to move from experimental16:28
dmelladoxD16:28
apuimedook, ok16:28
apuimedocan you do one for gate-install?16:28
apuimedohey, wait a sec16:28
apuimedoyou didn't put the postconfig16:29
dmelladooh, was that needed?16:29
apuimedodmellado: well, in rdocloud otherwise the creation of the first amphora will fail due to time out16:29
dmelladolet's check this out here first16:29
dmelladoit might need to be tweaked to the infra16:29
apuimedoI don't know how fast the infra nodes are16:30
apuimedook16:30
*** limao has joined #openstack-kuryr16:32
*** limao has quit IRC16:36
*** yboaron_ has joined #openstack-kuryr16:53
*** c00281451_ has quit IRC17:01
*** c00281451_ has joined #openstack-kuryr17:02
*** garyloug_ has joined #openstack-kuryr17:47
*** garyloug has quit IRC17:47
*** vikasc has quit IRC18:19
*** vikasc has joined #openstack-kuryr18:32
openstackgerritMerged openstack/kuryr-kubernetes master: Update documentation about nested deployment  https://review.openstack.org/48790618:50
*** garyloug_ has quit IRC19:42
*** rwallner has quit IRC20:21
*** rwallner has joined #openstack-kuryr20:24
*** rwallner has quit IRC20:28
*** edisonxiang has quit IRC20:54
*** edisonxiang has joined #openstack-kuryr20:54
*** alraddarla has quit IRC21:12
*** yamamoto_ has joined #openstack-kuryr21:13
*** yamamoto_ has quit IRC21:20
*** aojea_ has quit IRC21:40
*** aojea has joined #openstack-kuryr21:41
*** aojea has quit IRC21:45
*** aojea has joined #openstack-kuryr21:54
*** pmannidi has joined #openstack-kuryr21:57
*** aojea has quit IRC21:59
*** yboaron_ has quit IRC22:04
*** yamamoto has joined #openstack-kuryr22:04
*** rwallner has joined #openstack-kuryr22:07
*** gouthamr_ has joined #openstack-kuryr22:10
*** gouthamr has quit IRC22:10
*** rwallner has quit IRC22:12
*** aojea has joined #openstack-kuryr22:14
*** aojea has quit IRC22:19
*** rwallner has joined #openstack-kuryr22:20
*** rwallner_ has joined #openstack-kuryr22:21
*** rwallner has quit IRC22:24
*** gouthamr_ has quit IRC22:37
*** openstack has joined #openstack-kuryr22:42
*** mchiappero has quit IRC22:48
*** rwallner_ has quit IRC22:51
*** gouthamr has joined #openstack-kuryr22:53
*** hongbin has quit IRC23:03
*** edisonxiang_ has joined #openstack-kuryr23:38
*** edisonxiang has quit IRC23:38
apuimedobleh23:55
apuimedoOctavia works, but we have some mess to sort out with security groups23:56
apuimedoalso, it seems it is needlessly taking ports in the pod subnet23:56
apuimedoanyway. Tomorrow's another day23:56
« Wednesday, 2017-07-26 Index Friday, 2017-07-28 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!