| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr master: Updated from global requirements https://review.openstack.org/496048 | 00:04 |
|---|---|---|
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-libnetwork master: Updated from global requirements https://review.openstack.org/502663 | 00:04 |
| *** yboaron has quit IRC | 00:16 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr master: Updated from global requirements https://review.openstack.org/496048 | 00:23 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-libnetwork master: Updated from global requirements https://review.openstack.org/502663 | 00:23 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr master: Updated from global requirements https://review.openstack.org/496048 | 00:38 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-libnetwork master: Updated from global requirements https://review.openstack.org/502663 | 00:38 |
| *** kiennt26 has joined #openstack-kuryr | 00:42 | |
| *** kzaitsev1pi has quit IRC | 00:52 | |
| *** kzaitsev_pi has joined #openstack-kuryr | 00:54 | |
| *** hongbin has joined #openstack-kuryr | 01:22 | |
| *** wangbo_ has joined #openstack-kuryr | 02:05 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr master: Updated from global requirements https://review.openstack.org/496048 | 02:05 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-libnetwork master: Updated from global requirements https://review.openstack.org/502663 | 02:05 |
| *** yamamoto has joined #openstack-kuryr | 02:22 | |
| *** yamamoto has quit IRC | 02:22 | |
| *** yamamoto has joined #openstack-kuryr | 02:22 | |
| *** kiennt26 has quit IRC | 02:51 | |
| *** kiennt26 has joined #openstack-kuryr | 02:51 | |
| *** kiennt26 has quit IRC | 03:06 | |
| *** janki has joined #openstack-kuryr | 03:09 | |
| *** kiennt26 has joined #openstack-kuryr | 03:11 | |
| *** kiennt26 has quit IRC | 04:09 | |
| *** wangbo_ has quit IRC | 04:28 | |
| *** wangbo_ has joined #openstack-kuryr | 04:28 | |
| *** wangbo_ has quit IRC | 04:29 | |
| *** hongbin has quit IRC | 04:31 | |
| *** gsagie has quit IRC | 04:44 | |
| *** wangbo_ has joined #openstack-kuryr | 05:05 | |
| *** wangbo_ has quit IRC | 05:06 | |
| *** wangbo_ has joined #openstack-kuryr | 05:19 | |
| *** aojea has joined #openstack-kuryr | 05:33 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr master: Updated from global requirements https://review.openstack.org/496048 | 05:53 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-libnetwork master: Updated from global requirements https://review.openstack.org/502663 | 05:53 |
| *** pcaruana has joined #openstack-kuryr | 06:19 | |
| *** yboaron has joined #openstack-kuryr | 06:54 | |
| *** reedip has quit IRC | 07:14 | |
| *** reedip has joined #openstack-kuryr | 07:28 | |
| apuimedo | ltomasbo: ping | 07:29 |
| *** kiennt26 has joined #openstack-kuryr | 07:44 | |
| *** egonzalez has joined #openstack-kuryr | 07:50 | |
| *** yamamoto has quit IRC | 07:56 | |
| ltomasbo | apuimedo, pong | 07:58 |
| apuimedo | ltomasbo: remember https://bugs.launchpad.net/neutron/+bug/1696051 | 07:59 |
| openstack | Launchpad bug 1696051 in neutron "Missing binding details for bulk port creation requests" [Undecided,New] | 07:59 |
| apuimedo | ? | 07:59 |
| ltomasbo | ohh, yes | 07:59 |
| ltomasbo | I forgot about that one | 07:59 |
| apuimedo | https://gist.github.com/celebdor/dba48c702d799bda5e9fe1b35e641ba4 | 08:00 |
| apuimedo | With this code I don't see the problem | 08:00 |
| ltomasbo | apuimedo, what is the difference? | 08:01 |
| apuimedo | ltomasbo: look at the comment I posted https://gist.github.com/celebdor/dba48c702d799bda5e9fe1b35e641ba4 | 08:01 |
| ltomasbo | and when you see the port, do you see the binding information? | 08:03 |
| ltomasbo | perhaps it was fixed | 08:03 |
| ltomasbo | but not linked to the bug... | 08:03 |
| apuimedo | could be | 08:03 |
| apuimedo | in any case | 08:03 |
| *** yamamoto has joined #openstack-kuryr | 08:03 | |
| apuimedo | this means we should change yesterday's patch | 08:03 |
| ltomasbo | why? | 08:03 |
| ltomasbo | how is that related? | 08:03 |
| apuimedo | ltomasbo: well, this means that the ports do have host information that should be used to choose which pool they should be going to | 08:04 |
| apuimedo | instead of just doing it in round robin | 08:04 |
| ltomasbo | well, that is only the case if you create the ports associated to a given node | 08:04 |
| ltomasbo | and that is only allowed to admin users | 08:04 |
| apuimedo | ltomasbo: if I just created them unbound the ports never went active | 08:07 |
| apuimedo | I ignore if it's an ovn thing though | 08:07 |
| ltomasbo | umm | 08:07 |
| ltomasbo | apuimedo, do you mean that if you create a port and then the pod uses it, the port does not become active? | 08:08 |
| ltomasbo | that is not the case for ml2/ovs | 08:08 |
| ltomasbo | I can confirm that | 08:08 |
| apuimedo | ltomasbo: that's right | 08:09 |
| apuimedo | that's exactly what my life was yesterday from 12am to 3am | 08:09 |
| apuimedo | trying to figure out what the hell was going on | 08:09 |
| apuimedo | the moment I set the host | 08:09 |
| apuimedo | the port went active | 08:09 |
| ltomasbo | umm | 08:10 |
| ltomasbo | but the host should be set when the pod is in use, right? | 08:11 |
| ltomasbo | let me check in ml2/ovs | 08:11 |
| yboaron | ping irenab | 08:11 |
| apuimedo | thanks | 08:12 |
| apuimedo | ltomasbo: how did you create the ports? | 08:12 |
| ltomasbo | binding_host_id | masterovn-c4b897262b2017ce3d1dd43665423d34afd6e056vm-0 | 08:12 |
| ltomasbo | yep, it is set for ml2/ovs | 08:12 |
| ltomasbo | apuimedo, I have ajo and dalvarez here at the office today | 08:12 |
| ltomasbo | if you want me to ping them | 08:12 |
| apuimedo | will do | 08:13 |
| apuimedo | ltomasbo: how did you create the ports then? Did you let the vif pool driver create them or did you do it by hand? | 08:14 |
| ltomasbo | I allowed the pool port to created them, and then restart the k8s-kubernetes service | 08:14 |
| ltomasbo | apuimedo, so that they are re-covered | 08:14 |
| ltomasbo | and then create another pod and see that it using them, instead of creating new ones | 08:15 |
| apuimedo | ltomasbo: ah! | 08:15 |
| apuimedo | that's the thing though | 08:15 |
| apuimedo | vif pool creates them with host info | 08:15 |
| ltomasbo | really? | 08:15 |
| apuimedo | I had originally created the ports without any host info | 08:15 |
| ltomasbo | true | 08:15 |
| apuimedo | ltomasbo: you'll see | 08:15 |
| ltomasbo | let me check then | 08:15 |
| apuimedo | it puts the host info of the host that first needs them | 08:15 |
| apuimedo | ltomasbo: it may be, though, that once it has a host, we can bind on another and it all works fine | 08:16 |
| apuimedo | ltomasbo: did you try allinone? | 08:16 |
| ltomasbo | can you pass me the exact command you used to create the port? | 08:16 |
| ltomasbo | so that I can test it exactly the same in my ml2/ovs dev | 08:16 |
| ltomasbo | apuimedo, yes, allinone (devstack) | 08:20 |
| *** wangbo_ has quit IRC | 08:21 | |
| ltomasbo | apuimedo, so, it seems host_id is needed, so, I'll update the patch to get that information and set the port back in the right pool | 08:24 |
| apuimedo | ltomasbo: it's that gist I sent you | 08:25 |
| *** yamamoto has quit IRC | 08:25 | |
| apuimedo | ltomasbo: https://gist.github.com/celebdor/dba48c702d799bda5e9fe1b35e641ba4 | 08:27 |
| *** yamamoto has joined #openstack-kuryr | 08:30 | |
| *** yamamoto_ has joined #openstack-kuryr | 08:32 | |
| *** yamamoto_ has quit IRC | 08:34 | |
| *** yamamoto has quit IRC | 08:35 | |
| dulek | irenab: Hi, can you take a look on https://review.openstack.org/#/c/505125/ ? It has +2 from apuimedo and was confirmed to fix the issue by ltomasbo. | 08:39 |
| apuimedo | ltomasbo: what do you think of this for your patch http://paste.openstack.org/show/622115/ | 08:45 |
| apuimedo | ? | 08:45 |
| *** wangbo_ has joined #openstack-kuryr | 08:46 | |
| ltomasbo | apuimedo, I'm working on it, but if we assume the host_id is there, we can just read it from the ports binding info, right? | 08:47 |
| apuimedo | ltomasbo: don't we need to convert it to an id? | 08:48 |
| *** pgadige has joined #openstack-kuryr | 08:48 | |
| apuimedo | or you mean that we can just use the port_hostname as the host_addr key to the pool? | 08:49 |
| ltomasbo | that was what I was thinking | 08:49 |
| ltomasbo | if we can change that, but perhaps we can do the translation | 08:49 |
| apuimedo | ltomasbo: no, you're right | 08:50 |
| apuimedo | better without translation | 08:50 |
| apuimedo | much less work | 08:50 |
| apuimedo | ltomasbo: except... | 08:51 |
| apuimedo | the request_vif uses the pod hostIP | 08:51 |
| apuimedo | so I guess we'll have to keep this translation I put | 08:51 |
| ltomasbo | yep, that is what I'm seeing | 08:51 |
| ltomasbo | ok, if you already have the patch, feel free to push it to gerrit | 08:52 |
| ltomasbo | I'll test it too | 08:52 |
| ltomasbo | apuimedo, or if you prefer me to do it, I can do it too | 08:52 |
| apuimedo | ltomasbo: ok. I'll push this diff I sent you | 08:52 |
| apuimedo | try it out | 08:53 |
| ltomasbo | on another topic, apuimedo, irenab: https://review.openstack.org/#/c/505605/ | 08:53 |
| ltomasbo | also, for the octavia, I lost apuimedo's +2 and irenab's +1: https://review.openstack.org/#/c/499103/ | 08:53 |
| ltomasbo | irenab, did you test it? | 08:53 |
| openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: Recover precreated ports at NeutronVIFPool driver https://review.openstack.org/507932 | 09:00 |
| *** kiennt26 has quit IRC | 09:00 | |
| apuimedo | ltomasbo: let me know if it works | 09:00 |
| ltomasbo | great! thanks! I'll test it asap | 09:05 |
| ajo | apuimedo: I was talking to ltomasbo before about the issue you were finding (I didn't read the scrollback yet), but I believe you need to update the host_id before binding | 09:05 |
| ajo | at least that's true for the reference solution, may be OVN will provide you connectivity, and not move to ACTIVE | 09:06 |
| ajo | because ML2 cries | 09:06 |
| ajo | but, in the reference solution you don't even get the port tagged, it's moved to the dead VLAN | 09:06 |
| *** yamamoto has joined #openstack-kuryr | 09:14 | |
| apuimedo | ajo: got it | 09:15 |
| apuimedo | thanks | 09:15 |
| *** wangbo_ has quit IRC | 09:15 | |
| ajo | apuimedo: np :) btw, did OVN provide connectivity and the port never went ACTIVE? | 09:16 |
| ajo | or did it also not provide connectivity? | 09:16 |
| ajo | I guess it may had... based on what I know | 09:16 |
| ajo | but.. :) | 09:16 |
| apuimedo | ajo: thing is. We never set teh container to run unless we see it ACTIVE in Neutron | 09:16 |
| ajo | oh | 09:17 |
| ajo | ok | 09:17 |
| apuimedo | but I suspect it didn't work | 09:17 |
| *** yamamoto has quit IRC | 09:17 | |
| *** wangbo_ has joined #openstack-kuryr | 09:17 | |
| apuimedo | because from the namespace I couldn't really ping crap all | 09:17 |
| ajo | ack | 09:17 |
| ltomasbo | apuimedo, I tested your modification and it seems to work | 09:19 |
| apuimedo | yay! | 09:25 |
| apuimedo | dmellado: dulek fkautz irenab ivc janonymous livelace ltomasbo vikasc yboaron zengchen: https://etherpad.openstack.org/p/kuryr-queens-vPTG | 09:50 |
| apuimedo | I also sent an email to the ml | 09:50 |
| *** ltomasbo has quit IRC | 09:59 | |
| *** yamamoto has joined #openstack-kuryr | 10:03 | |
| *** ltomasbo has joined #openstack-kuryr | 10:04 | |
| *** yamamoto has quit IRC | 10:05 | |
| apuimedo | dmellado: I finally send it and I don't even get an "about time!" ? | 10:05 |
| * apuimedo is sad | 10:05 | |
| *** garyloug has joined #openstack-kuryr | 10:06 | |
| dmellado | apuimedo: finally | 10:08 |
| dmellado | don't be sad | 10:08 |
| dmellado | xD | 10:08 |
| dmellado | I was into a meeting | 10:08 |
| apuimedo | :-) | 10:08 |
| dmellado | apuimedo: I might invite you to a hiring interview because I don't want to go myself | 10:08 |
| dmellado | xD | 10:08 |
| apuimedo | dmellado: I accept payment in switch games | 10:08 |
| dmellado | apuimedo: I can get you a switch | 10:09 |
| dmellado | I've one which is really old and would work at 10mbps | 10:09 |
| dmellado | xD | 10:09 |
| apuimedo | xD | 10:12 |
| *** reedip has quit IRC | 10:12 | |
| dmellado | even better 3com 812 officeconnect router | 10:14 |
| dmellado | it used to be really good, back in those days | 10:14 |
| dmellado | xD | 10:14 |
| openstackgerrit | Luis Tomas Bolivar proposed openstack/kuryr-kubernetes master: Recover precreated ports at NeutronVIFPool driver https://review.openstack.org/507932 | 10:14 |
| ltomasbo | apuimedo, https://blueprints.launchpad.net/kuryr-kubernetes/+spec/bm-recover-ports | 10:15 |
| apuimedo | ltomasbo: bp approved | 10:18 |
| apuimedo | thanks | 10:18 |
| ltomasbo | thanks! | 10:18 |
| ltomasbo | I also updated the patch with the change to the pool_key | 10:19 |
| ltomasbo | let me know if you have any issues with it | 10:19 |
| *** janki has quit IRC | 10:20 | |
| apuimedo | very well | 10:25 |
| *** reedip has joined #openstack-kuryr | 10:26 | |
| *** yamamoto has joined #openstack-kuryr | 10:29 | |
| openstackgerrit | Jaivish Kothari(janonymous) proposed openstack/kuryr-kubernetes master: CNI Daemon template https://review.openstack.org/480028 | 10:29 |
| *** janki has joined #openstack-kuryr | 10:30 | |
| openstackgerrit | Jaivish Kothari(janonymous) proposed openstack/kuryr-kubernetes master: [WIP] CNI Unit Tests Framework https://review.openstack.org/508106 | 10:31 |
| janonymous | apuimedo : thanks! | 10:31 |
| *** yamamoto has quit IRC | 10:31 | |
| *** vikasc has quit IRC | 10:33 | |
| *** yamamoto has joined #openstack-kuryr | 10:37 | |
| *** yamamoto has quit IRC | 10:38 | |
| *** yamamoto has joined #openstack-kuryr | 10:40 | |
| apuimedo | ltomasbo: your patch should have a LOG.info when it finishes recovering the ports | 10:42 |
| ltomasbo | ohhh, true! I'll add it (and the unittest too) | 10:42 |
| ltomasbo | let me know if the rest is ok and I'll update it | 10:43 |
| *** yamamoto has quit IRC | 10:43 | |
| apuimedo | ltomasbo: can you fpaste me your kuryr.conf? | 10:43 |
| ltomasbo | give me a -1! | 10:43 |
| ltomasbo | sure | 10:43 |
| apuimedo | done | 10:44 |
| ltomasbo | http://paste.openstack.org/show/622129/ | 10:45 |
| ltomasbo | apuimedo, ^^ | 10:45 |
| *** yamamoto has joined #openstack-kuryr | 10:46 | |
| *** yamamoto has quit IRC | 10:49 | |
| *** danil has joined #openstack-kuryr | 10:50 | |
| apuimedo | ltomasbo: I'm getting http://paste.openstack.org/show/622131/ | 10:50 |
| apuimedo | I must have something wrong | 10:50 |
| apuimedo | but I can't find it | 10:50 |
| ltomasbo | umm | 10:52 |
| ltomasbo | creo que una vez me paso | 10:53 |
| ltomasbo | ups | 10:53 |
| ltomasbo | wrong chat | 10:53 |
| ltomasbo | apuimedo, be sure you have the pool enabled | 10:53 |
| ltomasbo | and that the vif_type is the neutron one instead of the nested | 10:54 |
| apuimedo | ltomasbo: it's ultra fast to load the pool | 10:57 |
| apuimedo | 8 seconds compared to the 12-14min of the nested case | 10:57 |
| apuimedo | but the nested pool recovery can be improved a lot | 10:57 |
| apuimedo | so we'll be fine | 10:57 |
| *** vikasc has joined #openstack-kuryr | 10:58 | |
| apuimedo | ltomasbo: wtf | 10:58 |
| apuimedo | http://paste.openstack.org/show/622133/ | 10:59 |
| *** ivc_ has joined #openstack-kuryr | 11:07 | |
| *** ivc has quit IRC | 11:07 | |
| *** yamamoto has joined #openstack-kuryr | 11:28 | |
| *** wangbo_ has quit IRC | 11:42 | |
| *** yamamoto has quit IRC | 12:03 | |
| *** reedip has quit IRC | 12:07 | |
| *** dougbtv_ has quit IRC | 12:20 | |
| *** reedip has joined #openstack-kuryr | 12:21 | |
| apuimedo | livelace: how long did it take in your bare metal pool to have pods running? | 12:26 |
| livelace | apuimedo, Hello, what do you mean ? | 12:30 |
| livelace | brb | 12:30 |
| apuimedo | livelace: you tried the port pool in baremetal pods, right? | 12:30 |
| apuimedo | I wanted to ask how long does it usually take for you from port creation until port running when using the pool | 12:30 |
| *** pcaruana has quit IRC | 12:31 | |
| *** pcaruana has joined #openstack-kuryr | 13:00 | |
| *** atoth has joined #openstack-kuryr | 13:02 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr master: Updated from global requirements https://review.openstack.org/496048 | 13:03 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-libnetwork master: Updated from global requirements https://review.openstack.org/502663 | 13:03 |
| *** yamamoto has joined #openstack-kuryr | 13:03 | |
| *** yamamoto has quit IRC | 13:09 | |
| livelace | apuimedo, Sorry, wild day, in a baremetal case it was fast, but some ports were in a DOWN state and didn't change their state to ACTIVE | 13:12 |
| livelace | Not so fast as a nested pool, but fast | 13:12 |
| *** pgadige has quit IRC | 13:13 | |
| livelace | Mostly I investigated a PLEG situation, I think it's a root of other issues too | 13:14 |
| *** atoth has quit IRC | 13:19 | |
| *** atoth has joined #openstack-kuryr | 13:34 | |
| *** gouthamr has joined #openstack-kuryr | 13:35 | |
| *** alishaaneja has joined #openstack-kuryr | 13:42 | |
| *** livelace2 has joined #openstack-kuryr | 13:42 | |
| apuimedo | ok | 13:45 |
| apuimedo | thanks livelace | 13:45 |
| yboaron | Hi irenab, I’ve updated the documentation athttps://review.openstack.org/#/c/498253/ | 13:46 |
| yboaron | I would be very grateful if u can review it. | 13:46 |
| *** kiennt26 has joined #openstack-kuryr | 13:56 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr master: Updated from global requirements https://review.openstack.org/496048 | 14:00 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-libnetwork master: Updated from global requirements https://review.openstack.org/502663 | 14:00 |
| *** danil has quit IRC | 14:04 | |
| *** yboaron has quit IRC | 14:08 | |
| *** hongbin has joined #openstack-kuryr | 14:35 | |
| *** atoth has quit IRC | 15:15 | |
| *** atoth has joined #openstack-kuryr | 15:16 | |
| *** atoth has quit IRC | 15:44 | |
| *** egonzalez has quit IRC | 15:59 | |
| openstackgerrit | Luis Tomas Bolivar proposed openstack/kuryr-kubernetes master: Recover precreated ports at NeutronVIFPool driver https://review.openstack.org/507932 | 16:12 |
| *** kiennt26 has quit IRC | 16:31 | |
| *** livelace2 has quit IRC | 17:55 | |
| *** alishaaneja has quit IRC | 18:01 | |
| *** aojea has quit IRC | 18:12 | |
| *** aojea has joined #openstack-kuryr | 18:13 | |
| *** aojea has quit IRC | 18:17 | |
| *** aojea has joined #openstack-kuryr | 18:18 | |
| *** aojea has quit IRC | 18:37 | |
| *** aojea has joined #openstack-kuryr | 18:38 | |
| *** atoth has joined #openstack-kuryr | 18:38 | |
| *** aojea has quit IRC | 18:42 | |
| *** janki has quit IRC | 18:45 | |
| *** janki has joined #openstack-kuryr | 18:48 | |
| *** aojea has joined #openstack-kuryr | 19:17 | |
| *** oikiki has joined #openstack-kuryr | 19:17 | |
| *** pcaruana has quit IRC | 19:31 | |
| *** janki has quit IRC | 20:02 | |
| *** gilfoyle has joined #openstack-kuryr | 20:34 | |
| *** gilfoyle has quit IRC | 20:55 | |
| *** premsankar has joined #openstack-kuryr | 21:33 | |
| *** aojea has quit IRC | 21:45 | |
| *** dulek has quit IRC | 21:53 | |
| *** dulek has joined #openstack-kuryr | 21:54 | |
| *** gouthamr has quit IRC | 21:56 | |
| *** gouthamr has joined #openstack-kuryr | 22:03 | |
| *** gilfoyle has joined #openstack-kuryr | 22:10 | |
| *** gouthamr has quit IRC | 22:18 | |
| *** gouthamr has joined #openstack-kuryr | 22:20 | |
| *** oikiki has quit IRC | 22:23 | |
| *** gouthamr has quit IRC | 22:23 | |
| *** oikiki has joined #openstack-kuryr | 22:30 | |
| *** gilfoyle_ has joined #openstack-kuryr | 22:41 | |
| *** gilfoyle has quit IRC | 22:44 | |
| *** garyloug has quit IRC | 22:50 | |
| *** hongbin has quit IRC | 23:07 | |
| *** gilfoyle_ has quit IRC | 23:17 | |
| *** ltomasbo has quit IRC | 23:44 | |
| *** ltomasbo has joined #openstack-kuryr | 23:45 | |
| *** alishaaneja has joined #openstack-kuryr | 23:50 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!