*** dims has quit IRC | 00:42 | |
*** salv-orl_ has joined #openstack-kuryr | 01:04 | |
*** salv-orlando has quit IRC | 01:07 | |
*** hongbin_ has joined #openstack-kuryr | 01:14 | |
*** caowei has joined #openstack-kuryr | 02:08 | |
*** janki has joined #openstack-kuryr | 02:45 | |
*** hongbin_ has quit IRC | 03:35 | |
*** caowei has quit IRC | 03:49 | |
*** gcheresh_ has joined #openstack-kuryr | 04:00 | |
*** gcheresh_ has quit IRC | 04:06 | |
*** caowei has joined #openstack-kuryr | 04:30 | |
*** caowei has quit IRC | 05:10 | |
*** yboaron has joined #openstack-kuryr | 05:14 | |
*** caowei has joined #openstack-kuryr | 05:17 | |
openstackgerrit | Yossi Boaron proposed openstack/kuryr-kubernetes master: Kuryr controller - pluggable handlers documentation https://review.openstack.org/561447 | 05:38 |
---|---|---|
openstackgerrit | Yossi Boaron proposed openstack/kuryr-kubernetes master: Devstack deployment - handle LoadBalancer creation failure https://review.openstack.org/558616 | 06:06 |
*** gcheresh_ has joined #openstack-kuryr | 06:14 | |
*** yboaron has quit IRC | 06:25 | |
*** yboaron has joined #openstack-kuryr | 06:26 | |
*** jchhatbar has joined #openstack-kuryr | 06:29 | |
*** salv-orlando has joined #openstack-kuryr | 06:31 | |
*** salv-orl_ has quit IRC | 06:31 | |
*** janki has quit IRC | 06:32 | |
*** snapiri has joined #openstack-kuryr | 06:49 | |
*** livelace-link has quit IRC | 07:09 | |
*** livelace-link has joined #openstack-kuryr | 07:10 | |
*** livelace-link has quit IRC | 07:11 | |
*** pcaruana has joined #openstack-kuryr | 07:14 | |
*** yboaron has quit IRC | 07:25 | |
*** caowei_ has joined #openstack-kuryr | 07:45 | |
*** caowei_ has quit IRC | 07:45 | |
*** caowei has quit IRC | 07:46 | |
*** threestrands has quit IRC | 07:47 | |
*** caowei has joined #openstack-kuryr | 07:51 | |
*** yboaron has joined #openstack-kuryr | 08:18 | |
*** garyloug has joined #openstack-kuryr | 08:49 | |
openstackgerrit | Michał Dulko proposed openstack/kuryr-tempest-plugin master: Apply cap from upper reqs https://review.openstack.org/560885 | 09:25 |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-kubernetes master: Fix the experimental multinode jobs https://review.openstack.org/558762 | 09:29 |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-kubernetes master: Add tarballed amphora. https://review.openstack.org/560313 | 09:29 |
*** celebdor1 has joined #openstack-kuryr | 09:36 | |
celebdor1 | dmellado: did you see the revert patch? | 09:38 |
dmellado | celebdor1: yeah, saw it, failed | 09:38 |
dmellado | I rechecked it to see the current status | 09:38 |
dmellado | did you test it locally? | 09:39 |
dmellado | might be an octavia issue, in any case | 09:40 |
dmellado | http://logs.openstack.org/64/561364/1/check/kuryr-kubernetes-tempest-octavia/eda7b4c/controller/logs/screen-o-api.txt.gz | 09:40 |
dmellado | that's why I rechecked in order to see their current state | 09:40 |
celebdor1 | dmellado: what am I supposed to see in that log? | 09:41 |
dmellado | check for ERROR | 09:41 |
dmellado | xD | 09:41 |
dmellado | http://logs.openstack.org/64/561364/1/check/kuryr-kubernetes-tempest-octavia/eda7b4c/controller/logs/screen-o-api.txt.gz#_Apr_13_23_07_02_484374 | 09:41 |
celebdor1 | it seems octavia is exploding | 09:41 |
dmellado | exactly | 09:42 |
dmellado | exploding so no lbaas | 09:42 |
dmellado | no service | 09:42 |
dmellado | boom to the test | 09:42 |
dmellado | no traffic | 09:42 |
celebdor1 | dafuq | 09:42 |
dmellado | I'm afraid this is an octavia issue | 09:42 |
celebdor1 | is this the first test we ran? | 09:42 |
dmellado | so rechecked to see if it goes well with current master | 09:42 |
celebdor1 | could it be some leftover? | 09:42 |
dmellado | nope, used to work before | 09:42 |
dmellado | it's a clear env | 09:42 |
dmellado | from upstream | 09:42 |
dmellado | so shouldn't | 09:43 |
celebdor1 | ok | 09:43 |
*** caowei has quit IRC | 10:26 | |
dmellado | celebdor1: around? | 10:31 |
*** celebdor1 is now known as apuimedo | 10:34 | |
apuimedo | irenab: ping | 10:37 |
irenab | apuimedo, pong | 10:37 |
apuimedo | irenab: dmellado told me you were discussing about the gate issues | 10:37 |
irenab | apuimedo, dmellado just updated what is the status, since he won't be able to attend the weekly | 10:41 |
apuimedo | irenab: I should backport the octavia fix to stable/queens | 10:44 |
apuimedo | dulek: I uploaded a new master controller container to dockerhub | 10:44 |
dulek | apuimedo: Okay, good. I wanted to clean up the dockerhub this Friday but still haven't figured out correct course of actions. | 10:45 |
dulek | apuimedo: I wanted to upload stable/queens as well, but we don't have a stable release with all the fixes yet. | 10:46 |
irenab | apuimedo, dmellado said he has a patch that fetches amphora imafe from tarball instead of building it on the fly | 10:53 |
irenab | and he had to revert servide test to fix the CI for now | 10:53 |
irenab | service | 10:53 |
apuimedo | dulek: my idea was to have kuryr/controller:queens being the tip of queens | 10:57 |
apuimedo | and then kuryr/controller:queens-0.4 that would be the latest release | 10:57 |
apuimedo | irenab: yes | 10:58 |
apuimedo | I'm surprised the tarball parch didn't shrink the test time | 10:58 |
dulek | apuimedo: I'm looking at that at the moment. | 10:59 |
dulek | apuimedo: It seems everything's fine there. | 10:59 |
apuimedo | dulek: is the tarball really being used? | 11:00 |
dulek | apuimedo: It looks so. Build function takes only 2 minutes now. | 11:00 |
dulek | While it was 7 before the patch. | 11:00 |
apuimedo | :/ | 11:00 |
irenab | apuimedo, tests are passing | 11:00 |
dulek | I'd check how much does downloading from tarballs.openstack.org take. | 11:00 |
apuimedo | well, 5 minutes is 5 minutes, I suppose | 11:01 |
dulek | That's 2.5 minute. | 11:01 |
apuimedo | it's ~630MiB | 11:02 |
apuimedo | dafuq is it that big for | 11:02 |
apuimedo | I guess the tarball is still not getting generated with the minimal image | 11:02 |
dulek | 10:02:22 - start of the method, 10:02:29 - end of the method. That's with the patch, so it's not 2 minutes, just 7 seconds. :P | 11:02 |
apuimedo | they have some patch for that I think | 11:02 |
dulek | I must have looked wrong. | 11:03 |
apuimedo | fucking hell | 11:03 |
apuimedo | downloading the tarball took 3 minutes | 11:04 |
apuimedo | ok, ok, 2.5minutes | 11:04 |
apuimedo | it prolly takes less from my home even | 11:04 |
apuimedo | ok, no. It takes 30minutes at home | 11:04 |
apuimedo | this is being served on a potato or the server is overloaded | 11:05 |
dulek | Building the image on another patch took 6 minutes. | 11:05 |
apuimedo | yeah | 11:06 |
apuimedo | I'm hoping they merge https://review.openstack.org/#/c/559416/ soon | 11:06 |
dulek | So there's definitely an improvement. Now I don't know what was the gate usage at the time of runs. | 11:06 |
dulek | The only way to tell would be to merge this and use openstack's graphana to plot average Octavia gate times. | 11:07 |
apuimedo | dulek: let's get it in | 11:07 |
dulek | And while it's super cool, I think it's a waste of time at the moment. ;) | 11:07 |
apuimedo | dulek: what's super cool? | 11:07 |
dulek | apuimedo: Graphs and plots. :D | 11:08 |
dulek | apuimedo: Daniel's patch still depends on https://review.openstack.org/#/c/560885 - so it won't get merged until this gets in. | 11:08 |
dulek | I've rechecked it, let's see what happens. | 11:08 |
dulek | Ah wait, that one failed just a moment ago. Damn. | 11:09 |
apuimedo | dulek: why should it depend on that? | 11:10 |
dulek | apuimedo: It does not need to IMO. | 11:10 |
dulek | apuimedo: http://logs.openstack.org/85/560885/3/check/kuryr-kubernetes-tempest-octavia/585970a/job-output.txt.gz#_2018-04-16_10_05_18_733368 | 11:10 |
dulek | But looks like something else is broken in Octavia image building. | 11:10 |
*** vkuramshin has joined #openstack-kuryr | 11:10 | |
apuimedo | dulek: so let's cherry-pick the tarball one | 11:11 |
dulek | So I assume we have gate blocked and the fix is to merge the tarball installation. What a coincidence? | 11:11 |
dulek | apuimedo: I'll edit dmellado patch and remove the Depends-On. | 11:11 |
apuimedo | dulek: thanks | 11:11 |
openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: Add tarballed amphora. https://review.openstack.org/560313 | 11:12 |
dulek | Ah, crap. dmellado also made it dependent on experimental multinode gate fixes. | 11:13 |
dulek | Aaand merge conflict. I'll try to cherry pick it. | 11:14 |
openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: Add tarballed amphora. https://review.openstack.org/560313 | 11:16 |
apuimedo | ok | 11:18 |
apuimedo | dulek: is it intentional that you did not backport https://review.openstack.org/#/c/559966/ ? | 11:20 |
apuimedo | I can backport mine without it, but if we want yours, then it's going to be more difficult to backport too | 11:21 |
openstackgerrit | Merged openstack/kuryr-libnetwork master: add lower-constraints job https://review.openstack.org/555756 | 11:21 |
dulek | apuimedo: https://review.openstack.org/#/c/561239 - it's backported. | 11:30 |
dulek | And even passes tests. :D | 11:30 |
dulek | Hm, BTW yboaron has a point with his remark about 6443 on that patch… | 11:30 |
yboaron | dulek: Does https://review.openstack.org/#/c/560313/ should handle the Octavia worker image problem ? | 11:32 |
dulek | yboaron: You mean the issue of its generation? | 11:33 |
dulek | yboaron: It should fix it, it passed the gate fine in the morning. | 11:33 |
yboaron | dulek, yes, the one that the gates fail on | 11:33 |
dulek | yboaron: So yes. We'll try to merge it fast once it passes the Jenkins. | 11:33 |
yboaron | dulek, OK 10x , I spoke with nmagenzi from Octavia this morning, he was investigating this issue .. | 11:34 |
openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: Dockerfiles: COPY code after installing packages https://review.openstack.org/545059 | 11:44 |
irenab | dulek, apuimedo would you be around for the weekly? I can lead the meeting first 20-30 mins, then have conflict | 11:45 |
dulek | irenab: I can run it, though I might be a little bit late there. | 11:46 |
irenab | ok | 11:47 |
apuimedo | irenab: I'll be there too | 11:50 |
irenab | thanks | 11:51 |
*** maysamacedos has joined #openstack-kuryr | 11:56 | |
*** atoth has joined #openstack-kuryr | 11:59 | |
*** rh-jelabarre has joined #openstack-kuryr | 12:09 | |
irenab | apuimedo, I do no have +2 on stable/queens, maybe you should merge the change | 12:12 |
apuimedo | irenab: that's odd | 12:25 |
apuimedo | I'll check | 12:25 |
apuimedo | irenab: fixed | 12:26 |
apuimedo | try now | 12:26 |
irenab | apuimedo, seems to be fixed | 12:27 |
apuimedo | :-) | 12:30 |
apuimedo | you were missing from the kuryr-release group | 12:30 |
apuimedo | only gal and I were there | 12:30 |
*** dims has joined #openstack-kuryr | 12:30 | |
*** yamamoto has quit IRC | 12:38 | |
*** dougbtv has joined #openstack-kuryr | 12:40 | |
*** oanson has quit IRC | 12:49 | |
*** lihi has quit IRC | 12:49 | |
*** snapiri has quit IRC | 12:49 | |
*** irenab has quit IRC | 12:49 | |
openstackgerrit | Merged openstack/kuryr master: add lower-constraints job https://review.openstack.org/555754 | 12:53 |
*** maysamacedos has quit IRC | 12:55 | |
*** snapiri has joined #openstack-kuryr | 12:57 | |
*** irenab has joined #openstack-kuryr | 12:57 | |
*** oanson has joined #openstack-kuryr | 12:57 | |
*** lihi has joined #openstack-kuryr | 12:58 | |
*** yamamoto has joined #openstack-kuryr | 13:01 | |
openstackgerrit | Merged openstack/kuryr-kubernetes master: Add tarballed amphora. https://review.openstack.org/560313 | 13:20 |
dulek | apuimedo, irenab, yboaron, ltomasbo: We have a meeting in #openstack-meeting-4. I've already started it! :) | 14:00 |
irenab | celebdor, weekly | 14:02 |
*** yboaron has quit IRC | 14:39 | |
*** hongbin_ has joined #openstack-kuryr | 14:59 | |
openstackgerrit | Merged openstack/kuryr master: Update reno for stable/queens https://review.openstack.org/537501 | 15:02 |
*** gcheresh_ has quit IRC | 15:02 | |
*** pcaruana has quit IRC | 15:09 | |
*** pc_m- has quit IRC | 15:15 | |
*** pc_m has joined #openstack-kuryr | 15:16 | |
*** jchhatbar has quit IRC | 15:32 | |
*** jistr is now known as jistr|mtg | 15:33 | |
*** maysamacedos has joined #openstack-kuryr | 15:40 | |
openstackgerrit | Merged openstack/kuryr-tempest-plugin master: Apply cap from upper reqs https://review.openstack.org/560885 | 15:53 |
*** lihi has quit IRC | 15:55 | |
*** lihi has joined #openstack-kuryr | 15:56 | |
*** jistr|mtg is now known as jistr | 16:03 | |
*** gcheresh_ has joined #openstack-kuryr | 16:05 | |
*** lihi has quit IRC | 16:10 | |
*** lihi has joined #openstack-kuryr | 16:12 | |
*** garyloug has quit IRC | 16:40 | |
*** yamamoto has quit IRC | 16:41 | |
*** gcheresh_ has quit IRC | 16:45 | |
*** yamamoto has joined #openstack-kuryr | 16:46 | |
*** yamamoto has quit IRC | 16:51 | |
*** yamamoto has joined #openstack-kuryr | 17:01 | |
*** yamamoto has quit IRC | 17:06 | |
*** yamamoto has joined #openstack-kuryr | 17:11 | |
*** yamamoto has quit IRC | 17:11 | |
*** vkuramshin has quit IRC | 17:39 | |
*** yamamoto has joined #openstack-kuryr | 17:57 | |
*** yamamoto has quit IRC | 18:02 | |
*** apuimedo has quit IRC | 18:02 | |
*** apuimedo has joined #openstack-kuryr | 18:11 | |
*** atoth has quit IRC | 18:46 | |
*** yamamoto has joined #openstack-kuryr | 18:58 | |
*** yamamoto has quit IRC | 19:02 | |
*** openstackgerrit has quit IRC | 19:05 | |
dulek | FYI - still something in Octavia is broken: http://logs.openstack.org/64/561364/1/check/kuryr-kubernetes-tempest-octavia/c27b38e/controller/logs/screen-o-api.txt.gz#_Apr_16_19_23_50_663286 | 19:50 |
*** apuimedo has quit IRC | 19:50 | |
*** yamamoto has joined #openstack-kuryr | 19:58 | |
*** yamamoto has quit IRC | 20:04 | |
*** celebdor1 has joined #openstack-kuryr | 20:19 | |
*** yamamoto has joined #openstack-kuryr | 21:00 | |
*** yamamoto has quit IRC | 21:06 | |
*** maysamacedos has quit IRC | 21:15 | |
*** celebdor1 has quit IRC | 21:44 | |
*** kong is now known as lxkong | 21:45 | |
*** salv-orlando has quit IRC | 21:50 | |
*** yamamoto has joined #openstack-kuryr | 22:02 | |
*** yamamoto has quit IRC | 22:08 | |
*** salv-orlando has joined #openstack-kuryr | 22:50 | |
*** hongbin_ has quit IRC | 22:55 | |
*** salv-orlando has quit IRC | 22:56 | |
*** yamamoto has joined #openstack-kuryr | 23:04 | |
*** yamamoto has quit IRC | 23:09 | |
*** maysamacedos has joined #openstack-kuryr | 23:28 | |
*** salv-orlando has joined #openstack-kuryr | 23:51 | |
*** salv-orlando has quit IRC | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!