Thursday, 2017-05-04

*** limao_ has quit IRC00:00
*** pmannidi has quit IRC00:01
*** pmannidi has joined #openstack-kuryr00:04
*** limao has joined #openstack-kuryr01:16
*** yamamoto has joined #openstack-kuryr01:31
*** yamamoto has quit IRC01:35
*** yedongcan has joined #openstack-kuryr01:45
*** salv-orlando has joined #openstack-kuryr02:05
*** salv-orlando has quit IRC02:09
*** yamamoto has joined #openstack-kuryr02:36
*** yamamoto has quit IRC02:46
*** hongbin has joined #openstack-kuryr02:53
*** salv-orlando has joined #openstack-kuryr03:06
*** irenab_ has joined #openstack-kuryr03:10
*** salv-orlando has quit IRC03:11
*** irenab has quit IRC03:11
*** portdirect has quit IRC03:11
*** irenab_ is now known as irenab03:11
*** vikasc has joined #openstack-kuryr03:35
*** salv-orlando has joined #openstack-kuryr04:07
*** salv-orlando has quit IRC04:11
*** salv-orlando has joined #openstack-kuryr04:52
*** hongbin has quit IRC04:56
*** limao has quit IRC05:06
*** limao has joined #openstack-kuryr05:07
*** portdirect has joined #openstack-kuryr05:13
*** yamamoto has joined #openstack-kuryr05:18
*** yamamoto has quit IRC05:21
*** janki has joined #openstack-kuryr05:40
*** irenab has left #openstack-kuryr05:44
*** irenab has joined #openstack-kuryr05:48
*** salv-orlando has quit IRC06:04
*** kzaitsev_ws has joined #openstack-kuryr06:07
*** yamamoto has joined #openstack-kuryr06:21
*** yamamoto has quit IRC06:26
*** yamamoto has joined #openstack-kuryr06:26
*** yamamoto has quit IRC06:28
*** ltomasbo|away is now known as ltomasbo06:37
*** pcaruana has joined #openstack-kuryr06:45
*** limao has quit IRC06:53
*** limao has joined #openstack-kuryr06:54
*** limao has quit IRC06:57
*** limao has joined #openstack-kuryr06:57
*** yamamoto has joined #openstack-kuryr06:59
*** yamamoto has quit IRC07:09
*** salv-orlando has joined #openstack-kuryr07:24
*** yedongcan1 has joined #openstack-kuryr07:35
*** yedongcan has quit IRC07:37
*** egonzalez has joined #openstack-kuryr07:43
*** pmannidi has quit IRC07:46
*** aojea has joined #openstack-kuryr07:48
*** yedongcan has joined #openstack-kuryr08:09
*** yedongcan1 has quit IRC08:10
*** garyloug has joined #openstack-kuryr08:50
*** salv-orl_ has joined #openstack-kuryr08:56
*** salv-orlando has quit IRC08:59
*** yamamoto has joined #openstack-kuryr09:15
*** yamamoto has quit IRC09:19
irenabapuimedo: dmellado ltomasbo : ping09:22
dmelladoirenab: pong09:22
ltomasbohi irenab09:22
irenabdid you try to run kuryr-k8s devstack recently?09:23
irenabI get some strange error: Failure retrieving ROUTER_GW_IP09:23
irenab‘openstack --os-cloud devstack-admin --os-region RegionOne port list -c 'Fixed IP Addresses' --device-owner network:router_gateway09:24
irenab2017-05-04 09:18:10.736 | public endpoint for compute service in RegionOne region not found09:24
irenab09:24
apuimedo:/09:24
dmellado:\09:24
apuimedonot lately, no09:24
irenabbut we do not run compute service at all ..09:24
dmelladoirenab: I did a few days ago09:24
dmelladoI'll spawn one and check if I hit that09:24
dmelladoirenab: which local.conf are you using?09:24
irenabdmellado: 3 days ago, devstack was kind to me :-)09:24
dmelladojust the recommended one?09:24
irenabdmellado: yes09:24
irenabdmellado: I just added USE_SCREEN , since now devstack uses systemd by default09:25
dmelladoirenab: yeah, I noticed09:26
dmelladoI was adding USE_SYSTEMD=False09:26
irenabyou are so negative person :-)09:26
*** limao has quit IRC09:26
dmelladolol09:27
irenabdmellado: let me know if devstack works for you09:27
ltomasbolol09:28
dmelladoirenab: will do, let's keep our hopes09:28
dmelladoirenab: in any case, I got a OSIC account09:28
dmelladoso I was going to try debugging the gate issues there09:28
dmelladoirenab: apuimedo would you have some time around the summit to try to gather and take a look together in case I don't find out?09:28
irenabdmellado: great, otherwise we may not be able to merge patches09:29
irenabsure09:29
irenabdmellado: we can do handson during the kuryr onboarding if no one shows up :-)09:29
dmelladoheh, we could totally do that09:29
dmelladobut let's hope that somebody shows up! xD09:30
dmelladoirenab: do you have the link for the session around?09:30
irenabdmellado:  a sec09:30
irenabWed 11:00-12:3009:32
openstackgerritKirill Zaitsev proposed openstack/kuryr-kubernetes master: Add sriov handler to kuryr-kubernetes  https://review.openstack.org/46245509:32
openstackgerritKirill Zaitsev proposed openstack/kuryr-kubernetes master: [WIP] Add kuryr-sriov-cni  https://review.openstack.org/46245609:32
irenabdmellado: https://www.openstack.org/summit/boston-2017/summit-schedule/events/18705/kuryr-project-onboarding09:33
kzaitsev_wsugh =)09:33
dmelladocool, I'll be around for the onboarding too xD09:34
dmelladothanks irenab09:34
dmelladokzaitsev_ws: o/ we tracked the issue up to OSIC xD09:34
kzaitsev_wsthose are some wips that I wanted to share later =)09:34
kzaitsev_wsOSIC =)09:34
kzaitsev_wsOSIC? I meant )09:34
irenabkzaitsev_ws: the forst patch is marked as abandoned09:35
kzaitsev_wsyep =) I made a typo — wanted to push them to local gerrit first =)09:35
kzaitsev_wsno real damage here, just sure that these are not yet ready for any sensible review09:36
kzaitsev_wsI'm working on sriov passthrough for k8s containers09:36
kzaitsev_wsas you may guess from the commit messages =)09:37
kzaitsev_wsI will restore and share these as soon as I make them work, to ask for some feedback and see if you guys are interested in this direction )09:40
kzaitsev_wsdmellado: ah, you probably mean the gate failures09:43
irenabkzaitsev_ws: great, thank you for heads up09:43
dmelladokzaitsev_ws: heh, yeap09:43
mchiapperokzaitsev_ws: which one is the right change?09:48
mchiapperokzaitsev_ws: are both changes supposed to be applied?09:49
kzaitsev_wsmchiappero: they're not ready yet )09:52
kzaitsev_wsthe first one adds a sriov handler for Pod events in the controller (ivc will be furious =)) and the 2d one adds a cni, that will be handling actuall passthrough09:54
kzaitsev_wsI'm intending to run them under multus-cni09:55
kzaitsev_wsto get ips from regular kuryr-cni and optional sriov-ed interfaces09:55
* kzaitsev_ws will be afk (on a meeting) for a while09:56
mchiapperokzaitsev_ws: thank you!09:56
irenabkzaitsev_ws: I think devref can be helpful to follow the overal approach10:00
apuimedoalraddarla: ping10:27
*** apuimedo has quit IRC10:33
*** apuimedo has joined #openstack-kuryr10:34
*** apuimedo has quit IRC10:40
*** apuimedo has joined #openstack-kuryr10:40
*** dimak_ has joined #openstack-kuryr10:43
irenabdmellado: any luck with devstack?10:52
dmelladoirenab: had to back some things up before launching the instance10:54
dmelladolet's see if it gets to succeed10:54
*** salv-orl_ has quit IRC10:55
dmelladoirenab: deploying now, let's cross fingers11:08
dmelladowhen did you hit that error?11:08
irenabthis morning11:11
irenabIt seems like openstack cli requiring compute service endpoint,but we do not have compute service11:12
kzaitsev_wsirenab: devref?11:12
irenabkzaitsev_ws: develper reference or maybe spec is better11:12
kzaitsev_wsirenab: sure a spec is a must11:13
kzaitsev_wsI just want to get a demoable POC first =)11:13
*** yedongcan1 has joined #openstack-kuryr11:15
kzaitsev_wsyou all guys will be on the summit next week?11:15
*** yedongcan has quit IRC11:15
irenabkzaitsev_ws: I will11:34
*** limao has joined #openstack-kuryr11:44
dmelladoirenab: argh11:49
dmelladoI forgot I had to cherry-pick my change in order for this to work on fedora....11:49
dmelladoso current status in any case11:50
dmelladoFedora//CentOS dsvm=> broken...11:50
irenabdmellado: related to issue I had?11:51
dmelladoirenab: the first one, related to this11:51
dmelladohttps://review.openstack.org/#/c/459292/11:51
dmelladowithout this, you hit 2017-05-04 11:32:12.754 | Failed to get unit file state for devstack@docker.service: No such file or directory11:52
dmelladoand out it goes11:52
irenabI run Ubuntu devstack11:52
irenabhttps://review.openstack.org/#/c/459292/ seems to hit deadlock with CI issue …11:53
*** salv-orlando has joined #openstack-kuryr11:54
*** limao has quit IRC11:55
dmelladoirenab: yeah, that's how I first got to dig on this :_11:55
irenabonce you cherry-pick the change, does it work?11:56
dmelladoyep11:56
dmelladoI usually just have that on my devstack11:56
dmelladolocal.conf.j211:57
dmelladoon the ref for the plugin11:57
irenabpastebin?11:57
dmelladoi.e. https://paste.fedoraproject.org/paste/Hr3~-IiufQ1m8svz91Yrul5M1UNdIGYhyRLivL9gydE=/11:59
irenabwell, you run it with nova, I am adding it too12:00
irenabbut I think devstack now is not eable to run without nova12:00
dmelladolet me retrigger this in any case12:01
dmelladowe might hit your error after adding the ref too12:01
irenabdmellado: I am running with nova now, lets see12:02
*** dimak_ has quit IRC12:10
*** yedongcan1 has left #openstack-kuryr12:27
kzaitsev_wsi'm skipping summit this time =) but hope to attend next ptg12:44
kzaitsev_wsguess the location will be announced on summit12:44
kzaitsev_wsdmellado: btw, in the https://review.openstack.org/#/c/459292 wouldn't it be enough to rm -f it?12:46
*** limao has joined #openstack-kuryr12:51
*** yamamoto has joined #openstack-kuryr12:54
irenabkzaitsev_ws: at previous weekly meeting we voted for virtual kuryr PTG13:17
irenabthe location is already known, Denver, Colorado13:17
dmelladokzaitsev_ws: nope, because if it doesn't exist it fails ;)13:19
dmelladobtw, irenab now it fails again13:20
dmelladoI guess it'd be related to the systemctl move13:20
dmelladoFailed to start devstack@docker.service: Unit devstack@docker.service is not loaded properly: Invalid argument.13:20
dmelladoSee system logs and 'systemctl status devstack@docker.service' for details.13:20
irenaboh..13:20
apuimedowhat fails?13:20
irenabdevstack13:20
irenabfor kuryr-kubernetes13:21
dmelladoirenab: did it work with you@ubuntu?13:21
apuimedodmellado: now that devstack uses docker13:21
apuimedoI think it is pointless for us to use run_process for docker13:21
apuimedowe should just do systemctl start docker13:21
irenabdmellado: not yet13:21
irenabcleaning and running again13:21
*** yamamoto has quit IRC13:22
dmelladoMay 04 12:13:19 devstack systemd[1]: devstack@docker.service: Service lacks both ExecStart= and ExecStop= setting. Refusing.13:24
dmelladoI'd say that maybe the service script for docker is badly done13:24
dmelladolet me try a quick fix on it13:24
*** janki has quit IRC13:24
*** yamamoto has joined #openstack-kuryr13:24
dmelladoyep, it all comes from that13:29
dmelladobut I'll need to check on how to fix it ;13:29
dmellado;)13:29
egonzalezapuimedo, were you able to generate config files?13:34
*** garyloug has quit IRC13:38
dmelladookay, fixed it13:40
dmelladonow I need to check where does devstack generates the service files...13:40
apuimedoegonzalez: no. It was very funny actually13:48
apuimedoI rebooted the workstation13:48
apuimedoand it didn't get stuck anymore13:48
apuimedoxD13:48
apuimedobut!13:48
apuimedothen it failed complaining about some "basestring" crap13:48
egonzalezapuimedo, anyway, genconfig wont work on k8s since in ansible we removed some neutron files they still using, inc0 created an genconfig alternative iirc13:51
apuimedooh13:51
apuimedoegonzalez: so it's a case of outdated documentation13:51
apuimedoit happens to all of us :-)13:51
dmelladoso, bug in devstack  /me sighs13:55
*** garyloug has joined #openstack-kuryr13:56
dmelladoirenab: apuimedo (and fellas)14:09
dmelladohttps://bugs.launchpad.net/devstack/+bug/168830014:09
openstackLaunchpad bug 1688300 in devstack "Since migrating to systemd, docker service doesn't work due to bad unit file" [Undecided,New] - Assigned to Daniel Mellado (daniel-mellado)14:09
irenabdmellado: screen version still works?14:10
apuimedovikasc: ping14:12
kzaitsev_wsirenab: thanks for the headsup about colorado and virtual summit14:16
kzaitsev_wss/summit/ptg/14:16
* kzaitsev_ws needs to sleep more14:16
openstackgerritDaniel Mellado proposed openstack/kuryr-kubernetes master: Fix devstack docker unit file  https://review.openstack.org/46257814:35
dmelladoirenab: apuimedo ^^14:37
dmelladohttps://bugs.launchpad.net/kuryr-kubernetes/+bug/168830014:37
openstackLaunchpad bug 1688300 in kuryr-kubernetes "Since migrating to systemd, docker service doesn't work due to bad unit file" [Undecided,In progress] - Assigned to Daniel Mellado (daniel-mellado)14:37
dmelladokzaitsev_ws: heh, get some rest!14:40
*** yamamoto has quit IRC14:44
*** limao has quit IRC14:51
*** salv-orl_ has joined #openstack-kuryr14:56
*** salv-orlando has quit IRC14:59
*** hongbin has joined #openstack-kuryr15:00
*** limao has joined #openstack-kuryr15:12
*** dougbtv has joined #openstack-kuryr15:18
*** limao has quit IRC15:30
*** yamamoto has joined #openstack-kuryr15:45
*** yamamoto has quit IRC15:57
*** egonzalez has quit IRC16:02
*** kzaitsev_ws has quit IRC16:12
*** yamamoto has joined #openstack-kuryr16:26
*** salv-orl_ has quit IRC16:26
*** yamamoto has quit IRC16:37
*** pcaruana has quit IRC16:40
openstackgerritDaniel Mellado proposed openstack/kuryr-kubernetes master: Add absolute path to docker in run_container.  https://review.openstack.org/46267216:55
*** garyloug has quit IRC16:59
*** aojea has quit IRC17:10
*** aojea has joined #openstack-kuryr17:11
*** ltomasbo is now known as ltomasbo|away17:14
*** aojea has quit IRC17:15
*** egonzalez has joined #openstack-kuryr17:42
*** tonanhngo has joined #openstack-kuryr18:28
hongbinapuimedo: ping18:41
hongbinapuimedo: check this demo: https://www.youtube.com/watch?v=SgH5qJYQDOs&feature=youtu.be18:42
hongbinapuimedo: just let me know if you have any feedback18:42
tonanhngoHi everyone, quick question:  where can I find instructions to set up Kuryr CNI for Kubernetes?18:47
apuimedotonanhngo: you mean the specific cni part?18:48
apuimedohongbin: thanks. I'll check18:49
hongbinapuimedo: ack18:49
tonanhngoapuimedo: I see https://github.com/openstack/kuryr-kubernetes18:49
tonanhngoapuimedo: wondering if that's all I need18:50
apuimedotonanhngo: you want to deploy manually, or to check what needs to be done for automation?18:51
tonanhngoapuimedo: manually for now18:51
apuimedotonanhngo: ok18:52
tonanhngoapuimedo: to consider automation18:52
apuimedowell. I did the automation last week18:52
apuimedoso you can see it here18:52
apuimedohttps://github.com/danielmellado/openshift-ansible/commit/8eca310eaac24c3da425bae650dc55e651e3bf5918:54
apuimedoin ansible format18:54
apuimedoI need to improve the documentation18:54
apuimedobecause this was from both memory and devstack18:54
apuimedo:P18:54
tonanhngoNice, checking it out.18:55
tonanhngoBut this is not in an OpenStack project?18:56
apuimedono. That's a project to deploy openshift (which for your purposes is the same as k8s)18:57
apuimedo(i.e., kuryr is configured in the same way)18:57
apuimedotonanhngo: the same that is done in openshift-ansible, should be probably done in magnum18:57
apuimedoonce heat supports trunk ports18:57
apuimedo(I'm not aware if they merged the patch yet)18:58
tonanhngook, this definitely helps18:58
apuimedo:-)18:58
apuimedolet me know if you have any questions18:58
tonanhngoSo I am giving a talk next Monday on Kubernetes on OpenStack and would like to mention about the next steps in Kuryr CNI support19:00
fkautzdmellado: do you know if zuul will merge https://review.openstack.org/#/c/462578/ and https://review.openstack.org/#/c/462672/ despite both of them failing?19:00
fkautzthey both depend on each other to work19:00
apuimedotonanhngo: good19:01
apuimedowell. We have kubernetes cni and clusterIP services19:02
apuimedosupport19:02
apuimedowe are working on integrating with deployment tools as well, as you can see19:02
apuimedoalso, we are working on pooling neutron resources to make things go faster19:02
apuimedofkautz: I don't think so19:02
apuimedowe'd need to squash them19:02
tonanhngoapuimedo: can you point me to some blueprints?19:03
apuimedofkautz: wanna try sending a squashed version and see if it passes the gates19:03
apuimedotonanhngo: https://blueprints.launchpad.net/kuryr-kubernetes/+spec/ports-pool19:03
apuimedohttps://blueprints.launchpad.net/kuryr-kubernetes/+spec/use-ovsdbapp19:03
apuimedohttps://blueprints.launchpad.net/kuryr-kubernetes/+spec/macvlan-pod-in-vm19:03
fkautzapuimedo: maybe irenab knows :)19:03
fkautzalso, there are more services that need to be fixed19:10
fkautzetcd, kubectl (and maybe more) use run_process with sudo19:11
fkautzmmm, wrong conclusion, it fails because docker logs is not an absolute path19:16
fkautzdockers logs -f name rather than /path/to/docker logs -f name19:16
apuimedo:P19:24
apuimedosuch a bother19:24
fkautzwe're getting there :p19:25
*** aojea has joined #openstack-kuryr19:27
dmelladofkautz: apuimedo19:40
dmelladoI just pointed there than I'd swuash them19:40
fkautzcool19:40
dmelladofkautz: I'm not so sure on the kubelet comment, in any case19:41
dmelladobut I'll check19:41
fkautzyea, basically anything using run_process needs to be an absolute path and the user should be set using the run_process parameters19:42
fkautzso run_process name "/path/to/kubelet" group user19:42
dmelladofkautz: I mean, I understand that but if you check there it might've a different usecase19:42
dmelladoin any case I'll need to run it local19:42
dmelladobefore getting to the OSIC issue ;)19:42
fkautzno worries, better to point it out and a decision made about it than to ignore :)19:43
openstackgerritDaniel Mellado proposed openstack/kuryr-kubernetes master: Fix kuryr devstack systemd unit file issues  https://review.openstack.org/46257819:49
*** aojea has quit IRC19:50
dmelladofkautz: https://review.openstack.org/#/c/462578/219:50
dmelladosquashed patch19:50
dmelladowe'll go from there19:50
*** aojea has joined #openstack-kuryr19:50
dmelladofeel free to amend a patch for it if you've the time ;)19:50
fkautzthanks, i'll take a look19:50
apuimedo:-)19:51
apuimedothis is like a factory19:51
apuimedothere's turns19:51
apuimedoand this week I'm in all of them19:51
apuimedodarned demos :-)19:51
*** salv-orlando has joined #openstack-kuryr19:52
fkautz:D19:52
*** aojea_ has joined #openstack-kuryr19:52
dmelladoand darned summit19:52
dmelladoyou wouldn't believe how many folks pinged me today for the interop thing...19:52
apuimedoxD19:53
*** aojea has quit IRC19:53
apuimedodmellado: is it working already?19:53
dmelladofor us, works19:53
dmelladofor some of the another folks, not so sure19:54
*** hongbin has quit IRC20:17
*** aojea_ has quit IRC20:19
*** dimak_ has joined #openstack-kuryr20:39
*** dimak_ has quit IRC20:47
*** hongbin has joined #openstack-kuryr20:50
*** salv-orl_ has joined #openstack-kuryr20:56
*** salv-orlando has quit IRC20:59
*** dougbtv has quit IRC21:32
*** salv-orl_ has quit IRC21:51
*** hongbin has quit IRC22:03
*** hongbin has joined #openstack-kuryr22:05
*** hongbin_ has joined #openstack-kuryr22:33
*** hongbin has quit IRC22:33
*** salv-orlando has joined #openstack-kuryr22:51
*** egonzalez has quit IRC22:53
*** salv-orlando has quit IRC22:58
*** pmannidi has joined #openstack-kuryr23:14
*** hongbin_ has quit IRC23:53
*** salv-orlando has joined #openstack-kuryr23:54
*** salv-orlando has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!