*** artom has joined #openstack-meeting | 00:08 | |
*** enriquetaso has quit IRC | 00:15 | |
*** brinzhang_ has joined #openstack-meeting | 00:34 | |
*** ijw has quit IRC | 00:36 | |
*** brinzhang has quit IRC | 00:37 | |
*** ekcs has quit IRC | 00:40 | |
*** TxGirlGeek has joined #openstack-meeting | 00:48 | |
*** Liang__ has joined #openstack-meeting | 00:58 | |
*** igordc has quit IRC | 01:01 | |
*** bbowen has quit IRC | 01:02 | |
*** bbowen has joined #openstack-meeting | 01:02 | |
*** yamamoto has joined #openstack-meeting | 01:03 | |
*** yamamoto has quit IRC | 01:06 | |
*** yamamoto has joined #openstack-meeting | 01:09 | |
*** gyee has quit IRC | 01:14 | |
*** yamamoto has quit IRC | 01:14 | |
*** jaewook_oh_ has joined #openstack-meeting | 01:37 | |
*** baojg has joined #openstack-meeting | 01:42 | |
*** yamamoto has joined #openstack-meeting | 01:48 | |
*** mhen has quit IRC | 01:48 | |
*** yamamoto has quit IRC | 01:50 | |
*** yamamoto has joined #openstack-meeting | 01:50 | |
*** armax has quit IRC | 01:53 | |
*** ykatabam has quit IRC | 01:54 | |
*** apetrich has quit IRC | 01:57 | |
*** yamamoto has quit IRC | 02:01 | |
*** iyamahat has quit IRC | 02:09 | |
*** yamahata has quit IRC | 02:09 | |
*** yamamoto has joined #openstack-meeting | 02:10 | |
*** yamamoto has quit IRC | 02:11 | |
*** yamamoto has joined #openstack-meeting | 02:16 | |
*** yamamoto has quit IRC | 02:20 | |
*** hemna has quit IRC | 02:30 | |
*** whoami-rajat has joined #openstack-meeting | 02:42 | |
*** hyunsikyang has joined #openstack-meeting | 02:44 | |
*** hyunsikyang__ has quit IRC | 02:48 | |
*** ykatabam has joined #openstack-meeting | 02:51 | |
*** hyunsikyang__ has joined #openstack-meeting | 02:52 | |
*** hongbin has joined #openstack-meeting | 03:00 | |
*** njohnston has quit IRC | 03:16 | |
*** yamamoto has joined #openstack-meeting | 03:20 | |
*** psachin has joined #openstack-meeting | 03:26 | |
*** ykatabam has quit IRC | 03:30 | |
*** armax has joined #openstack-meeting | 03:37 | |
*** hongbin has quit IRC | 03:42 | |
*** tpatil has joined #openstack-meeting | 03:47 | |
*** TxGirlGeek has quit IRC | 03:59 | |
*** imsurit has joined #openstack-meeting | 03:59 | |
samP | #startmeeting masakari | 04:00 |
---|---|---|
openstack | Meeting started Tue Jul 16 04:00:45 2019 UTC and is due to finish in 60 minutes. The chair is samP. Information about MeetBot at http://wiki.debian.org/MeetBot. | 04:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 04:00 |
*** openstack changes topic to " (Meeting topic: masakari)" | 04:00 | |
openstack | The meeting name has been set to 'masakari' | 04:00 |
samP | Hi all for masakari | 04:00 |
tpatil | Hi | 04:00 |
samP | #topic Critical bugs and patches | 04:01 |
*** openstack changes topic to "Critical bugs and patches (Meeting topic: masakari)" | 04:01 | |
samP | Any critical bugs or patches? | 04:01 |
tpatil | NO | 04:02 |
samP | we have one new spec, | 04:04 |
samP | #link https://review.opendev.org/#/c/670476/ | 04:04 |
samP | I will review this. Please review this if you have spare time. | 04:04 |
*** nitinuikey has joined #openstack-meeting | 04:05 | |
tpatil | Yes, I will review this spec in this week | 04:06 |
samP | tpatil: thanks | 04:06 |
samP | #topic Train Work Items | 04:06 |
*** openstack changes topic to "Train Work Items (Meeting topic: masakari)" | 04:06 | |
samP | Please the updates of Train work items | 04:07 |
tpatil | 1) devstack support to install host-monitors | 04:07 |
tpatil | done with the changes. It will install hostmonitor only where IPMI is enabled | 04:07 |
tpatil | The patch will be pushed sometime in this week | 04:08 |
*** yamahata has joined #openstack-meeting | 04:08 | |
samP | thanks. | 04:08 |
tpatil | In case of masakari-monitor, devstack script doesn't create a failover segment against which notifications can be sent | 04:09 |
tpatil | I think in masakari-monitor, there is a logic which will add host to the segment if notification fails | 04:09 |
tpatil | let me check if that check is present | 04:10 |
*** armax has quit IRC | 04:10 | |
tpatil | I remember this kind of check discussions long back. I don't that check is present in the master code | 04:11 |
tpatil | Even though devstack-monitor supports to install various monitors, it won't work automatically until a failover segment is created and hosts are added to it. | 04:12 |
samP | sorry, question is not clear. | 04:12 |
tpatil | it's not possible to automatically discover on which compute hosts masakari-monitors are installed | 04:12 |
samP | Question is, are hosts added to failover segment automatically? | 04:12 |
samP | tpatil: it is not. | 04:13 |
tpatil | Even though we are adding support to install various masakari-monitors in devstack, it won't work until a failover segment is created | 04:13 |
samP | tpatil: yes | 04:13 |
tpatil | the creation of failover segment is outside the scope of devstack plugin | 04:13 |
tpatil | but I think it should be part of it | 04:14 |
samP | tpatil: It should be one of the initialization setup for devstack | 04:14 |
tpatil | but there is no way to create add hosts to the failover segment automatically even if we decide to create a failover segment where masakari-api is installed | 04:14 |
samP | Like in registering the glance images or create user | 04:15 |
tpatil | creation of failover segment is simple | 04:15 |
tpatil | the main question is how to add hosts to the failover segments | 04:15 |
samP | ah.. got it. | 04:17 |
samP | if it is not in the CI, user should do it manually | 04:17 |
tpatil | I will add a separate patch to create a failover segment in devstack script | 04:18 |
tpatil | and after installation of masakari-monitors is complete on all nodes, user will need to add hosts to the segment manually | 04:19 |
samP | tpatil: thanks. | 04:19 |
tpatil | 2) Masakari-monitors documentation | 04:20 |
tpatil | work is in progress | 04:20 |
samP | there was an proposal for automatically register nodes at the end of the masakari-monitor install process. | 04:20 |
samP | let me find it. | 04:20 |
tpatil | FYI, there is one mailing thread where one of the user is facing problem to install masakari-monitors using kolla ansible plugin for masakari | 04:21 |
tpatil | he is facing this issue on CentOS | 04:21 |
samP | #link https://review.opendev.org/#/q/topic:bp/auto-compute-node-registration+(status:open+OR+status:merged) | 04:21 |
tpatil | Yes, it requires failover segment uuid | 04:22 |
samP | tpatil: I couldn't follow the discussion. I will check the thread | 04:22 |
tpatil | # link : http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007565.html | 04:22 |
samP | tpatil:thanks | 04:22 |
tpatil | Right now, we are making changes to the patch : https://review.opendev.org/#/c/489095/, to add steps to install masakar-monitors on Ubuntu | 04:24 |
tpatil | once that is done, we will add the steps to install it on other OSes | 04:24 |
tpatil | Plan is to push the patch sometime in the next week for Ubuntu | 04:25 |
tpatil | That's all update about Train work items from my side | 04:26 |
samP | tpatil: Thanks | 04:26 |
samP | #topic AOB | 04:27 |
*** openstack changes topic to "AOB (Meeting topic: masakari)" | 04:27 | |
samP | There are some questions about how to install masakari, kolla support in ML | 04:27 |
samP | I will try to support and answer them as much as I can. | 04:28 |
samP | tpatil: Thanks for creating the docs for masakari | 04:29 |
samP | Nothing else from my side. | 04:29 |
samP | If no more items to discuss, we could finish today's meeting here. | 04:29 |
tpatil | Ok | 04:29 |
samP | Next meeting will be 7/30 | 04:30 |
tpatil | Got it | 04:30 |
samP | Thank you all! | 04:30 |
samP | #endmeeting | 04:30 |
tpatil | samP: Thanks | 04:30 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 04:30 | |
openstack | Meeting ended Tue Jul 16 04:30:37 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 04:30 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/masakari/2019/masakari.2019-07-16-04.00.html | 04:30 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/masakari/2019/masakari.2019-07-16-04.00.txt | 04:30 |
openstack | Log: http://eavesdrop.openstack.org/meetings/masakari/2019/masakari.2019-07-16-04.00.log.html | 04:30 |
*** hyunsikyang__ has quit IRC | 04:31 | |
*** nitinuikey has quit IRC | 04:35 | |
*** tpatil has quit IRC | 04:35 | |
*** iyamahat has joined #openstack-meeting | 04:49 | |
*** jamesmcarthur has quit IRC | 04:50 | |
*** imsurit has quit IRC | 05:01 | |
*** ykatabam has joined #openstack-meeting | 05:05 | |
*** yamamoto has quit IRC | 05:05 | |
*** igordc has joined #openstack-meeting | 05:07 | |
*** pcaruana has joined #openstack-meeting | 05:08 | |
*** ricolin_ has joined #openstack-meeting | 05:10 | |
*** imsurit has joined #openstack-meeting | 05:10 | |
*** ykatabam has quit IRC | 05:25 | |
*** jamesmcarthur has joined #openstack-meeting | 05:29 | |
*** ykatabam has joined #openstack-meeting | 05:29 | |
*** yamamoto has joined #openstack-meeting | 05:34 | |
*** jamesmcarthur has quit IRC | 05:37 | |
*** vishalmanchanda has joined #openstack-meeting | 05:55 | |
*** ykatabam has quit IRC | 05:56 | |
*** SWDevAngel has quit IRC | 06:01 | |
*** hyunsik_m has joined #openstack-meeting | 06:10 | |
*** imsurit has quit IRC | 06:12 | |
*** links has joined #openstack-meeting | 06:18 | |
*** belmoreira has joined #openstack-meeting | 06:19 | |
*** imsurit has joined #openstack-meeting | 06:36 | |
*** iyamahat has quit IRC | 06:46 | |
*** yamamoto has quit IRC | 06:51 | |
*** yamamoto has joined #openstack-meeting | 06:52 | |
*** yamamoto has quit IRC | 06:52 | |
*** iyamahat has joined #openstack-meeting | 06:58 | |
*** yamamoto has joined #openstack-meeting | 06:58 | |
*** yamamoto has quit IRC | 06:58 | |
*** rcernin has quit IRC | 07:00 | |
*** dtrainor has quit IRC | 07:08 | |
*** _pewp_ has quit IRC | 07:15 | |
*** _pewp_ has joined #openstack-meeting | 07:15 | |
*** igordc has quit IRC | 07:16 | |
*** tssurya has joined #openstack-meeting | 07:20 | |
*** belmoreira has quit IRC | 07:30 | |
*** jamesmcarthur has joined #openstack-meeting | 07:33 | |
*** ricolin_ is now known as ricolin | 07:33 | |
*** jamesmcarthur has quit IRC | 07:38 | |
*** slaweq has joined #openstack-meeting | 07:43 | |
*** priteau has joined #openstack-meeting | 07:43 | |
*** jraju__ has joined #openstack-meeting | 07:45 | |
*** links has quit IRC | 07:45 | |
*** jaewook_oh_ has quit IRC | 07:46 | |
*** igordc has joined #openstack-meeting | 07:47 | |
*** joxyuki has joined #openstack-meeting | 07:54 | |
*** dkushwaha has joined #openstack-meeting | 08:02 | |
dkushwaha | #startmeeting tacker | 08:03 |
openstack | Meeting started Tue Jul 16 08:03:03 2019 UTC and is due to finish in 60 minutes. The chair is dkushwaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 08:03 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 08:03 |
*** openstack changes topic to " (Meeting topic: tacker)" | 08:03 | |
openstack | The meeting name has been set to 'tacker' | 08:03 |
dkushwaha | #topic Roll Call | 08:03 |
*** openstack changes topic to "Roll Call (Meeting topic: tacker)" | 08:03 | |
dkushwaha | who is here for Tacker weekly meeting? | 08:03 |
*** ttsiouts has joined #openstack-meeting | 08:03 | |
hyunsik_m | Hi | 08:03 |
joxyuki | hi | 08:03 |
dkushwaha | hello joxyuki hyunsik_m | 08:04 |
*** belmoreira has joined #openstack-meeting | 08:05 | |
hyunsik_m | I am hyunsikyang :) this is another account | 08:05 |
*** yamamoto has joined #openstack-meeting | 08:05 | |
*** igordc has quit IRC | 08:06 | |
dkushwaha | hyunsik_m, IMO you can use same nickname for different account too | 08:07 |
*** imsurit has quit IRC | 08:07 | |
*** imsurit_ofc has joined #openstack-meeting | 08:07 | |
*** kopecmartin|off is now known as kopecmartin | 08:07 | |
hyunsik_m | Ah ok i will. Now i am in the outside. So.. please understand it this time!:) | 08:08 |
dkushwaha | np :) | 08:08 |
dkushwaha | seems no other members available today | 08:08 |
dkushwaha | ok lets start.. | 08:09 |
dkushwaha | #topic announcement | 08:09 |
*** openstack changes topic to "announcement (Meeting topic: tacker)" | 08:09 | |
*** imsurit_ofc is now known as imsurit | 08:09 | |
dkushwaha | I propose Hiroyuki Jo to join Tacker core team | 08:10 |
dkushwaha | http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007602.html | 08:10 |
joxyuki | well, thanks dkushwaha | 08:10 |
hyunsik_m | Good:) I will reply it soon!:) | 08:10 |
dkushwaha | joxyuki, Welcome to Tacker core-Team. You did a great contribution. | 08:11 |
dkushwaha | Looking for your more support now | 08:11 |
joxyuki | yea, of course I will :) | 08:12 |
*** takahashi-tsc has joined #openstack-meeting | 08:12 | |
dkushwaha | :) | 08:13 |
*** ralonsoh has joined #openstack-meeting | 08:13 | |
*** dtrainor has joined #openstack-meeting | 08:14 | |
*** yamamoto has quit IRC | 08:15 | |
dkushwaha | joxyuki, Being core member, you also needs to keep tack on bugs part also. You can start getting those things slowly. And feel free to ask me for any confusion/doubts | 08:16 |
dkushwaha | moving next.. | 08:16 |
joxyuki | dkushwaha, all right. actually I am staring to prepare to fix bugs. I will update patches soon. | 08:17 |
*** jaewook_oh_ has joined #openstack-meeting | 08:17 | |
dkushwaha | joxyuki, thanks | 08:17 |
dkushwaha | #topic BP rolling upgrades | 08:18 |
*** openstack changes topic to "BP rolling upgrades (Meeting topic: tacker)" | 08:18 | |
dkushwaha | hyunsik_m, any update on your BP ? | 08:18 |
dkushwaha | jaewook_oh_, ^ | 08:19 |
hyunsik_m | Yes. I think we can find gap while we are developing this | 08:19 |
hyunsik_m | I think basic contents are almost done in this blueprint | 08:20 |
dkushwaha | hyunsik_m, if you have those gap list, feel free to discuss | 08:21 |
hyunsik_m | Ok!:) I will. | 08:23 |
hyunsik_m | Thanks | 08:23 |
dkushwaha | hyunsik_m, If you have initial patch sets available, feel free to push that WIP patch on gerrit where more reviewer give their opinion. | 08:25 |
dkushwaha | #topic BP Multi-Interface for Containerized VNF | 08:26 |
*** openstack changes topic to "BP Multi-Interface for Containerized VNF (Meeting topic: tacker)" | 08:26 | |
hyunsik_m | yes | 08:26 |
hyunsik_m | Actually I am developing this one first | 08:27 |
hyunsik_m | So. I will upload this patch soon as a WIP:) | 08:27 |
dkushwaha | hyunsik_m, nice | 08:27 |
dkushwaha | hyunsik_m, As these both BPs are already merged, so I request to please start drafting/pushing code part also. So that we will have sufficient time for code review | 08:28 |
dkushwaha | even WIP patch is also ok for now | 08:28 |
hyunsik_m | OK I am supposed to go to business trip until next week. So I will upload it ASAP | 08:29 |
hyunsik_m | Thanks dkushwaha | 08:29 |
dkushwaha | hyunsik_m, thanks for the update :) | 08:30 |
dkushwaha | moving next.. | 08:30 |
*** yamamoto has joined #openstack-meeting | 08:30 | |
dkushwaha | #topic OpenDiscussion | 08:30 |
*** openstack changes topic to "OpenDiscussion (Meeting topic: tacker)" | 08:30 | |
dkushwaha | I have no other update for this week. | 08:31 |
dkushwaha | joxyuki, anything from your side ? | 08:31 |
hyunsik_m | I am done too | 08:31 |
joxyuki | no | 08:31 |
jaewook_oh_ | Hello, for the open discussion, I updated the Prometheus plugin blueprint, could you check or comment for that one? | 08:32 |
jaewook_oh_ | https://review.opendev.org/#/c/540416/ | 08:33 |
dkushwaha | jaewook_oh_, yea, Its in my list. | 08:33 |
jaewook_oh_ | good thanks :) | 08:34 |
dkushwaha | jaewook_oh_, I have some questions on that, and will comment it on spec by today itself | 08:34 |
jaewook_oh_ | Great! OK I got it. | 08:35 |
dkushwaha | Does anyone have something more to discuss for now? | 08:36 |
dkushwaha | otherwise we can close this meeting. | 08:36 |
hyunsik_m | Thanks | 08:37 |
jaewook_oh_ | Thanks | 08:37 |
dkushwaha | Ok, Thanks Folks for joining this meeting. | 08:37 |
dkushwaha | closing it now. | 08:37 |
dkushwaha | #endmeeting | 08:37 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 08:37 | |
openstack | Meeting ended Tue Jul 16 08:37:32 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 08:37 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-07-16-08.03.html | 08:37 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-07-16-08.03.txt | 08:37 |
openstack | Log: http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-07-16-08.03.log.html | 08:37 |
*** hyunsikyang has quit IRC | 08:37 | |
joxyuki | bye | 08:37 |
*** joxyuki has left #openstack-meeting | 08:37 | |
*** belmoreira has quit IRC | 08:48 | |
*** yamahata has quit IRC | 08:50 | |
*** panda has quit IRC | 08:54 | |
*** belmoreira has joined #openstack-meeting | 08:54 | |
*** jamesmcarthur has joined #openstack-meeting | 08:56 | |
*** panda has joined #openstack-meeting | 08:57 | |
*** dkushwaha has quit IRC | 08:58 | |
*** tetsuro has joined #openstack-meeting | 09:00 | |
*** jamesmcarthur has quit IRC | 09:00 | |
*** Liang__ has quit IRC | 09:20 | |
*** ricolin has quit IRC | 09:20 | |
*** jamesmcarthur has joined #openstack-meeting | 09:28 | |
*** jamesmcarthur has quit IRC | 09:32 | |
*** boxiang has joined #openstack-meeting | 09:41 | |
*** belmoreira has quit IRC | 09:44 | |
*** yamamoto has quit IRC | 10:00 | |
*** yamamoto has joined #openstack-meeting | 10:05 | |
*** yamamoto has quit IRC | 10:08 | |
*** jaewook_oh_ has quit IRC | 10:09 | |
*** priteau has quit IRC | 10:10 | |
*** apetrich has joined #openstack-meeting | 10:16 | |
*** tetsuro has quit IRC | 10:16 | |
*** ttsiouts has quit IRC | 10:18 | |
*** ttsiouts has joined #openstack-meeting | 10:19 | |
*** ttsiouts has quit IRC | 10:23 | |
*** yamamoto has joined #openstack-meeting | 10:38 | |
*** yamamoto has quit IRC | 10:41 | |
*** electrofelix has joined #openstack-meeting | 10:45 | |
*** yamamoto has joined #openstack-meeting | 10:47 | |
*** bbowen has quit IRC | 10:49 | |
*** yamamoto has quit IRC | 10:54 | |
*** yamamoto has joined #openstack-meeting | 10:56 | |
*** yamamoto has quit IRC | 10:56 | |
*** yamamoto has joined #openstack-meeting | 10:56 | |
*** brinzhang has joined #openstack-meeting | 10:59 | |
*** brinzhang_ has quit IRC | 11:03 | |
*** njohnston_ has joined #openstack-meeting | 11:06 | |
*** jraju__ has quit IRC | 11:12 | |
*** links has joined #openstack-meeting | 11:12 | |
*** ttsiouts has joined #openstack-meeting | 11:22 | |
*** jamesmcarthur has joined #openstack-meeting | 11:29 | |
*** tesseract has joined #openstack-meeting | 11:30 | |
*** jamesmcarthur has quit IRC | 11:33 | |
*** imsurit_ofc has joined #openstack-meeting | 11:37 | |
*** imsurit has quit IRC | 11:37 | |
*** imsurit_ofc is now known as imsurit | 11:37 | |
*** jraju__ has joined #openstack-meeting | 11:53 | |
*** links has quit IRC | 11:53 | |
*** yamamoto has quit IRC | 11:54 | |
*** takahashi-tsc has quit IRC | 11:54 | |
*** raildo has joined #openstack-meeting | 11:55 | |
*** lpetrut has joined #openstack-meeting | 11:57 | |
*** dmacpher has quit IRC | 11:57 | |
*** bbowen has joined #openstack-meeting | 12:00 | |
*** dmacpher has joined #openstack-meeting | 12:01 | |
*** jamesmcarthur has joined #openstack-meeting | 12:03 | |
*** Lucas_Gray has joined #openstack-meeting | 12:06 | |
*** jamesmcarthur has quit IRC | 12:08 | |
*** jawad_axd has joined #openstack-meeting | 12:11 | |
*** yamamoto has joined #openstack-meeting | 12:12 | |
*** yamamoto has quit IRC | 12:12 | |
*** jamesmcarthur has joined #openstack-meeting | 12:15 | |
*** imsurit has quit IRC | 12:17 | |
*** boxiang has quit IRC | 12:17 | |
*** lpetrut has quit IRC | 12:28 | |
*** lpetrut has joined #openstack-meeting | 12:32 | |
*** Luzi has joined #openstack-meeting | 12:32 | |
*** ricolin has joined #openstack-meeting | 12:35 | |
*** ijw has joined #openstack-meeting | 12:38 | |
*** jawad_axd has quit IRC | 12:43 | |
*** ijw has quit IRC | 12:43 | |
*** ykatabam has joined #openstack-meeting | 12:45 | |
*** ykatabam has quit IRC | 12:50 | |
*** tesseract has quit IRC | 12:53 | |
*** yamamoto has joined #openstack-meeting | 12:54 | |
*** tesseract has joined #openstack-meeting | 12:55 | |
*** lpetrut has quit IRC | 12:57 | |
*** yamamoto has quit IRC | 12:58 | |
*** Lucas_Gray has quit IRC | 13:05 | |
*** Lucas_Gray has joined #openstack-meeting | 13:11 | |
*** zaneb has joined #openstack-meeting | 13:12 | |
*** zaneb has quit IRC | 13:14 | |
*** zaneb has joined #openstack-meeting | 13:14 | |
*** ricolin has quit IRC | 13:18 | |
*** jamesmcarthur has quit IRC | 13:19 | |
*** eharney has quit IRC | 13:22 | |
*** ykatabam has joined #openstack-meeting | 13:25 | |
*** hemna has joined #openstack-meeting | 13:27 | |
*** brinzhang has quit IRC | 13:28 | |
*** shilpasd has quit IRC | 13:31 | |
*** vishalmanchanda has quit IRC | 13:32 | |
*** liuyulong has joined #openstack-meeting | 13:33 | |
*** ttsiouts has quit IRC | 13:34 | |
*** ttsiouts has joined #openstack-meeting | 13:35 | |
*** trident has quit IRC | 13:38 | |
*** ttsiouts has quit IRC | 13:38 | |
*** ttsiouts has joined #openstack-meeting | 13:38 | |
*** trident has joined #openstack-meeting | 13:39 | |
*** enriquetaso has joined #openstack-meeting | 13:43 | |
*** Luzi has quit IRC | 13:43 | |
*** carloss has joined #openstack-meeting | 13:45 | |
*** TxGirlGeek has joined #openstack-meeting | 13:48 | |
*** psachin has quit IRC | 13:52 | |
*** jraju__ has quit IRC | 13:53 | |
*** mlavalle has joined #openstack-meeting | 13:55 | |
*** tidwellr has joined #openstack-meeting | 13:59 | |
slaweq | #startmeeting networking | 14:00 |
openstack | Meeting started Tue Jul 16 14:00:33 2019 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
*** openstack changes topic to " (Meeting topic: networking)" | 14:00 | |
openstack | The meeting name has been set to 'networking' | 14:00 |
mlavalle | o/ | 14:00 |
slaweq | welcome on neutron meeting :) | 14:00 |
amotoki | o/ | 14:00 |
tidwellr | o/ | 14:00 |
rubasov | o/ | 14:00 |
ralonsoh | hi | 14:01 |
slaweq | so, lets start | 14:01 |
slaweq | #topic Announcements | 14:01 |
*** openstack changes topic to "Announcements (Meeting topic: networking)" | 14:01 | |
* mlavalle has to drive wife to follow up appointment after kidney transplant so will leave at 30 minutes after the meeting started | 14:01 | |
slaweq | mlavalle: good luck :) | 14:01 |
ralonsoh | mlavalle, good luck!! | 14:02 |
slaweq | first announcement | 14:02 |
njohnston_ | o/ | 14:02 |
slaweq | next milestone is T-2 and it will be next week | 14:02 |
slaweq | https://releases.openstack.org/train/schedule.html | 14:02 |
*** TxGirlGeek has quit IRC | 14:03 | |
slaweq | and a short reminder: train PTG summary is at http://lists.openstack.org/pipermail/openstack-discuss/2019-May/006408.html if someone needs to look | 14:03 |
liuyulong | hi | 14:03 |
*** TxGirlGeek has joined #openstack-meeting | 14:03 | |
slaweq | that's all from me, anyone else have got any announcement? | 14:03 |
mlavalle | I have one | 14:04 |
amotoki | There is a discussion on repo retrirement process | 14:04 |
amotoki | http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007749.html | 14:04 |
*** jrbalderrama has joined #openstack-meeting | 14:04 | |
amotoki | it affects neutron stadium process. | 14:04 |
amotoki | let's keep our eyes on it. | 14:05 |
amotoki | all from me. | 14:05 |
slaweq | thx amotoki | 14:05 |
slaweq | I will read it later today | 14:05 |
mlavalle | also if you are planning to attend the PTG in Shanghai , please add your name to this etherpad | 14:06 |
mlavalle | Hopefully by the first week of August | 14:06 |
mlavalle | I have to provide the Foundation with the number of people that will attend the PTG by August 11th | 14:07 |
mlavalle | for planning purposes | 14:07 |
mlavalle | and while you are at it, please start adding topics to be discussed there | 14:07 |
mlavalle | that's it from me | 14:08 |
*** boden has joined #openstack-meeting | 14:08 | |
slaweq | thx mlavalle | 14:08 |
slaweq | ok, so lets move on | 14:08 |
*** TxGirlGeek has quit IRC | 14:08 | |
slaweq | #topic Blueprints | 14:08 |
*** openstack changes topic to "Blueprints (Meeting topic: networking)" | 14:08 | |
slaweq | Train-2 blueprints: https://launchpad.net/neutron/+milestone/train-2 | 14:08 |
slaweq | any updates on BPs? | 14:09 |
mlavalle | I don't have any this week | 14:09 |
tidwellr | I think subnets-different-pools-same-net is ready to go, I pushed one patch set this morning to clean up a nit | 14:09 |
tidwellr | https://review.opendev.org/#/c/667511/ | 14:09 |
*** TxGirlGeek has joined #openstack-meeting | 14:10 | |
haleyb | tidwellr: it's on my list | 14:10 |
rubasov | I managed to upload a few patches for the extraroute-atomic stuff: https://review.opendev.org/#/q/topic:extraroute+(p:openstack/neutron+OR+p:openstack/neutron-lib) | 14:10 |
*** TxGirlGeek has quit IRC | 14:10 | |
slaweq | tidwellr: I already +2'ed Your patch, I will check last PS today | 14:11 |
rubasov | despite being WIP I'd be happy if you can tell whether you like the basic direction in them or not | 14:11 |
slaweq | rubasov: added to my list of reviews todo :) | 14:12 |
slaweq | thx for updates | 14:12 |
rubasov | slaweq: thanks a lot | 14:12 |
slaweq | also, for https://blueprints.launchpad.net/neutron/+spec/multiple-segment-per-network-per-host there is patch with spec proposed https://review.opendev.org/#/c/657170 | 14:13 |
slaweq | and we should review this spec :) | 14:13 |
mlavalle | I'll look at it | 14:13 |
slaweq | ok, thx | 14:14 |
slaweq | I think we can move on then | 14:14 |
slaweq | #topic Community goals | 14:14 |
*** openstack changes topic to "Community goals (Meeting topic: networking)" | 14:14 | |
slaweq | I don't have any updates about IPv6-Only deployment goal, still waiting for gmann actions on it | 14:15 |
*** yamamoto has joined #openstack-meeting | 14:15 | |
slaweq | any updates about py3 or pdf generation? | 14:16 |
amotoki | for pdf generation, a storyboard story was created. I assigned me to it. | 14:16 |
amotoki | https://storyboard.openstack.org/#!/story/2006099 | 14:16 |
amotoki | For note, storyboard stories are prepared per project in this cycle | 14:17 |
slaweq | amotoki: it says "review" for neutron, is there any patch related to this for neutron? | 14:18 |
amotoki | I believe we can land neutron one first and then apply the same thing to other stadium projects, but we have more room to be improved. | 14:18 |
*** jrbalderrama has quit IRC | 14:18 | |
amotoki | slaweq: you can find a corresponding patch in comment section below. | 14:18 |
slaweq | amotoki: ok, thx | 14:19 |
slaweq | one more question, what about api-ref? will it be also generated to pdf? | 14:19 |
amotoki | slaweq: this is the thing I would like to clarify to alex but I think it is not a target. | 14:19 |
slaweq | amotoki: ok, please keep it in mind just :) | 14:20 |
amotoki | slaweq: sure | 14:20 |
slaweq | thx amotoki for update on this | 14:20 |
slaweq | about py3 I can also mention that there is this etherpad: https://etherpad.openstack.org/p/neutron_stadium_python3_status | 14:20 |
slaweq | with list of what is still todo | 14:21 |
slaweq | if anyone wants to help, You can check this etherpad and assign Yourself to some project/job and send patch :) | 14:21 |
slaweq | ok, lets move on | 14:22 |
slaweq | #topic Bugs | 14:22 |
*** openstack changes topic to "Bugs (Meeting topic: networking)" | 14:22 | |
slaweq | I was on bug deputy last week | 14:22 |
*** yamamoto has quit IRC | 14:22 | |
slaweq | summary is available at http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007763.html | 14:22 |
slaweq | all high bugs are "in progress" so it's good | 14:23 |
slaweq | there is couple of medium/low which needs some volunteers | 14:23 |
rubasov | I just assigned the metadata caching one to myself | 14:23 |
*** eharney has joined #openstack-meeting | 14:23 | |
slaweq | basically there wasn't anything really scary during last week | 14:23 |
slaweq | thx rubasov | 14:23 |
slaweq | do You want to talk about any other bug here? | 14:24 |
*** shintaro has joined #openstack-meeting | 14:24 | |
slaweq | ok, I will take that as no :) | 14:25 |
slaweq | our bug deputy this week is hongbin and he confirmed me that he will handle that | 14:25 |
slaweq | and next week it's boden's turn | 14:26 |
boden | ack, can barely wait :) | 14:26 |
slaweq | thx boden :) | 14:26 |
*** links has joined #openstack-meeting | 14:26 | |
mlavalle | I had also sent hongbin an email last week | 14:26 |
slaweq | ok, next topic | 14:26 |
mlavalle | so he got two reminders | 14:26 |
slaweq | mlavalle: :) | 14:26 |
slaweq | ok, next topi then | 14:27 |
slaweq | #topic neutron-lib | 14:27 |
*** openstack changes topic to "neutron-lib (Meeting topic: networking)" | 14:27 | |
slaweq | boden: any updates? | 14:27 |
boden | not much to report; business as usual... but could I ask for some help landing a bagpipe patch: https://review.opendev.org/#/c/664672/ | 14:27 |
boden | that's really all from the neutron-lib side unless others have comments | 14:28 |
* mlavalle looking at it | 14:28 | |
slaweq | boden: done :) | 14:29 |
haleyb | hah, triple whammy on that patch :) | 14:29 |
boden | thanks all! | 14:29 |
mlavalle | dang you all beat me to it | 14:29 |
slaweq | ok, lets move on then | 14:30 |
slaweq | #topic On demand agenda | 14:30 |
*** openstack changes topic to "On demand agenda (Meeting topic: networking)" | 14:30 | |
slaweq | In agenda there is nothing in this section | 14:30 |
*** ykatabam has quit IRC | 14:30 | |
slaweq | but maybe someone wants to talk about something | 14:30 |
mlavalle | so maybe I am not going to miss anything | 14:30 |
slaweq | mlavalle: probably | 14:30 |
tidwellr | slaweq: you had pinged me about the API tests for neutron-dynamic-routing moving to neutron-tempest-plugin | 14:30 |
tidwellr | right now it's hung up on docker not being installed on the system when the jobs run | 14:31 |
*** shintaro has quit IRC | 14:32 | |
slaweq | tidwellr: do You want me to take a look at it? | 14:32 |
tidwellr | I could use some help with that, if we can work that out https://review.opendev.org/#/c/652099/ will be good to go | 14:32 |
slaweq | tidwellr: sure, I will check it tonight or tomorrow, and I will update Your patch if will find anything | 14:32 |
slaweq | ok? | 14:32 |
tidwellr | sounds good, the scripts in neutron-dynamic-routing have a section installs these goodies before launching the tests, I'm not sure how to replicate that | 14:33 |
slaweq | tidwellr: ok, I will try to figure it out | 14:34 |
* mlavalle departs the meeting | 14:35 | |
slaweq | ok, if there is nothing else, I will give You back 25 minutes | 14:36 |
slaweq | thx for attending | 14:36 |
njohnston_ | \o | 14:36 |
slaweq | and have a great week o/ | 14:36 |
slaweq | #endmeeting | 14:36 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:36 | |
openstack | Meeting ended Tue Jul 16 14:36:33 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:36 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/networking/2019/networking.2019-07-16-14.00.html | 14:36 |
ralonsoh | bye | 14:36 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/networking/2019/networking.2019-07-16-14.00.txt | 14:36 |
rubasov | thank you | 14:36 |
openstack | Log: http://eavesdrop.openstack.org/meetings/networking/2019/networking.2019-07-16-14.00.log.html | 14:36 |
rubasov | bye | 14:36 |
amotoki | bye | 14:36 |
*** mlavalle has left #openstack-meeting | 14:37 | |
*** shintaro has joined #openstack-meeting | 14:38 | |
*** boden has left #openstack-meeting | 14:38 | |
*** armax has joined #openstack-meeting | 14:42 | |
*** snierodz has joined #openstack-meeting | 14:43 | |
*** davidsha has joined #openstack-meeting | 14:45 | |
*** links has quit IRC | 14:52 | |
ralonsoh | #openstack-meeting | 15:00 |
ralonsoh | #startmeeting neutron_qos | 15:00 |
openstack | Meeting started Tue Jul 16 15:00:11 2019 UTC and is due to finish in 60 minutes. The chair is ralonsoh. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
*** openstack changes topic to " (Meeting topic: neutron_qos)" | 15:00 | |
openstack | The meeting name has been set to 'neutron_qos' | 15:00 |
ralonsoh | Yes, this is the command | 15:00 |
ralonsoh | hi | 15:00 |
davidsha | Hey! | 15:00 |
ralonsoh | apart from your feature and a bug almost resolved, there is no agenda | 15:01 |
ralonsoh | let's wait 30 secs more | 15:01 |
ralonsoh | ok, let's go | 15:01 |
ralonsoh | #topic RFEs | 15:02 |
*** openstack changes topic to "RFEs (Meeting topic: neutron_qos)" | 15:02 | |
ralonsoh | nothing in the agenda | 15:02 |
ralonsoh | let's move to bug | 15:02 |
ralonsoh | bugs | 15:02 |
ralonsoh | #topic Bugs | 15:02 |
*** openstack changes topic to "Bugs (Meeting topic: neutron_qos)" | 15:02 | |
ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/1826695 | 15:02 |
openstack | Launchpad bug 1826695 in neutron "[L3][QoS] cache does not removed when router is down or deleted" [Medium,In progress] - Assigned to LIU Yulong (dragon889) | 15:02 |
ralonsoh | patch: #link https://review.opendev.org/#/c/656105/ | 15:02 |
ralonsoh | IMO, the code is ok, I'll review it later today | 15:03 |
ralonsoh | nothing else in the list | 15:03 |
*** jamesmcarthur has joined #openstack-meeting | 15:03 | |
ralonsoh | so, let's move to open discussion | 15:04 |
ralonsoh | #topic Open Discussion | 15:04 |
*** openstack changes topic to "Open Discussion (Meeting topic: neutron_qos)" | 15:04 | |
ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/1476527 | 15:04 |
openstack | Launchpad bug 1476527 in neutron "[RFE] Add common classifier resource" [Wishlist,Triaged] - Assigned to Igor D.C. (igordcard) | 15:04 |
ralonsoh | davidsha, any updates? | 15:04 |
ralonsoh | I've seen your POC updated today | 15:04 |
davidsha | Yup, I put up that patch that migrated the service plugin into Neutron: https://review.opendev.org/#/c/670050/ | 15:04 |
*** shilpasd has joined #openstack-meeting | 15:05 | |
ralonsoh | so 670050 is the first one, introducing the classification groups into the neutron repo | 15:05 |
ralonsoh | (just to follow an order when reviewing) | 15:06 |
davidsha | I need to migrated the RPC advertiser from the other patch over into the new patch and then rebase the QoS patch to remove the DB classification thing | 15:06 |
davidsha | Yup thats correct | 15:06 |
ralonsoh | ok, so first the DB and then the RPC | 15:06 |
davidsha | yup | 15:06 |
ralonsoh | anything peculiar in the DB patch? | 15:06 |
ralonsoh | BTW, https://review.opendev.org/#/c/670049/ should be reviewed first? | 15:07 |
ralonsoh | 670050 depends on the n-lib API change | 15:07 |
davidsha | No, it's basically a straight migration of the code in Neutron Classifier with a little refactoring to clarifying variable types in the functions. | 15:07 |
ralonsoh | ok | 15:08 |
davidsha | Yup 49 is first but the guts of the change are in 50 | 15:08 |
ralonsoh | should you remove the "ccf" references? | 15:08 |
ralonsoh | just asking | 15:08 |
davidsha | We can, you wanted to migrate the resources under qos, was it? | 15:09 |
ralonsoh | I think so | 15:09 |
davidsha | or just leave the resources under / ? | 15:09 |
ralonsoh | but | 15:09 |
ralonsoh | please, ask miguel and slaweq | 15:09 |
ralonsoh | I'm in doubt about this... | 15:09 |
davidsha | kk | 15:09 |
ralonsoh | is the neutron classifier (in neutron core) going to be used outside qos? | 15:10 |
ralonsoh | this is, IMO, a QoS extension | 15:10 |
ralonsoh | Am I correct? | 15:10 |
ralonsoh | DSCP -> CCF | 15:10 |
davidsha | There were rfe's to have security groups use it, but that was over a year ago. | 15:10 |
ralonsoh | hmmmm you are right | 15:11 |
ralonsoh | ok, there is no need to make this to depend on QoS | 15:11 |
ralonsoh | maybe you can leave the resources under / | 15:11 |
davidsha | When it was proposed it was a QoS extension, but the original team saw values in expanding it out | 15:11 |
ralonsoh | yes, there is no hard dependency againts this | 15:11 |
davidsha | kk | 15:11 |
ralonsoh | that's the point, | 15:11 |
ralonsoh | perfect! | 15:11 |
davidsha | will I keep /ccf or just / ? ccf=common classification framework | 15:12 |
ralonsoh | I see no reason to keep CCF | 15:12 |
davidsha | kk, I'll remove it | 15:12 |
ralonsoh | but, as I said, make this comment in the patch and I'll do the same | 15:13 |
ralonsoh | I'll review both patches today (or tomorrow morning) | 15:13 |
davidsha | Thanks! | 15:13 |
ralonsoh | something else?? | 15:13 |
davidsha | Nope, thats it for me. | 15:13 |
ralonsoh | cool! | 15:13 |
ralonsoh | I think we can finish the meeting now (quite fast today)! | 15:14 |
ralonsoh | thanks David | 15:14 |
ralonsoh | #endmeeting | 15:14 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:14 | |
openstack | Meeting ended Tue Jul 16 15:14:24 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:14 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_qos/2019/neutron_qos.2019-07-16-15.00.html | 15:14 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_qos/2019/neutron_qos.2019-07-16-15.00.txt | 15:14 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_qos/2019/neutron_qos.2019-07-16-15.00.log.html | 15:14 |
davidsha | Cool! talk to ya, enjoy the nice evening! | 15:14 |
*** e0ne has joined #openstack-meeting | 15:32 | |
*** Lucas_Gray has quit IRC | 15:36 | |
*** gyee has joined #openstack-meeting | 15:39 | |
*** Lucas_Gray has joined #openstack-meeting | 15:41 | |
*** diablo_rojo has joined #openstack-meeting | 15:41 | |
*** eharney has quit IRC | 15:46 | |
*** eharney has joined #openstack-meeting | 15:46 | |
*** igordc has joined #openstack-meeting | 15:47 | |
*** ttsiouts has quit IRC | 15:51 | |
*** ttsiouts has joined #openstack-meeting | 15:52 | |
*** tssurya has quit IRC | 15:55 | |
*** ttsiouts has quit IRC | 15:57 | |
*** manjeets has joined #openstack-meeting | 15:59 | |
slaweq | #startmeeting neutron_ci | 16:00 |
openstack | Meeting started Tue Jul 16 16:00:10 2019 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
*** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
njohnston_ | o/ | 16:00 |
slaweq | welcome on another meeting :) | 16:00 |
njohnston_ | last meeting of the day for me! \o/ | 16:00 |
ralonsoh | hi | 16:00 |
slaweq | njohnston_: yes, for me too :) | 16:01 |
haleyb | hi | 16:01 |
slaweq | ok, lets start as mlavalle will not be here today | 16:01 |
slaweq | Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:01 |
slaweq | please open the link and we can move on | 16:01 |
slaweq | #topic Actions from previous meetings | 16:01 |
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 16:01 | |
slaweq | first one: | 16:02 |
slaweq | mlavalle to continue debugging neutron-tempest-plugin-dvr-multinode-scenario issues | 16:02 |
slaweq | he send me some update about his findings: | 16:02 |
slaweq | "In regards to the test connectivity with 2 routers scenario, when the L3 agent requests the router to the server, we call https://github.com/openstack/neutron/blob/master/neutron/plugins/ml2/plugin.py#L1835-L1852 | 16:02 |
slaweq | my theory right now is that we are leaving one execption uncaught in that peace of code: duplicate entry. I will propose a WIP patch to prove the theory. That's the next step." | 16:02 |
slaweq | so he is making progress on this one, hopefully this will be fixed soon :) | 16:03 |
slaweq | I will add action for him for the next week to not forget about this | 16:03 |
slaweq | #action mlavalle to continue debugging neutron-tempest-plugin-dvr-multinode-scenario issues | 16:03 |
slaweq | next one: | 16:04 |
slaweq | slaweq to contact yamamoto about networking-midonet py3 status | 16:04 |
slaweq | I emailed yamamoto and he respond me | 16:04 |
slaweq | I pasted info from him to the related etherpad | 16:04 |
slaweq | basically there are 2 issues with midonet and py3 right now, they are aware of them but they don't know when this can be fixed | 16:05 |
slaweq | next one | 16:05 |
slaweq | ralonsoh to check how to increase, in FT, the privsep pool | 16:05 |
ralonsoh | slaweq, the number of threads is == num of CPUs | 16:06 |
ralonsoh | we should not increase that number thus | 16:06 |
ralonsoh | how to solve the timeouts? I still don't know | 16:06 |
*** vishalmanchanda has joined #openstack-meeting | 16:06 | |
slaweq | ralonsoh: can we maybe limit number of test runners? | 16:06 |
ralonsoh | slaweq, but we'll reduce a lot the speed of execution | 16:07 |
ralonsoh | slaweq, I recommend to do this just as the last resource | 16:07 |
slaweq | ralonsoh: maybe it's worth to check how much longer it would take then | 16:07 |
*** bobh has joined #openstack-meeting | 16:07 | |
ralonsoh | slaweq, we can do (num_cpu - 1) | 16:07 |
*** Lucas_Gray has quit IRC | 16:07 | |
ralonsoh | just for functional tests? or fullstack too? | 16:08 |
slaweq | ralonsoh: in fullstack it's differently I think I each test as got own "environment" so probably also own privsep-helpers pool | 16:08 |
*** ricolin has joined #openstack-meeting | 16:09 | |
ralonsoh | ok | 16:09 |
ralonsoh | I'll submit a patch to reduce the number of workers in FT | 16:09 |
slaweq | thx | 16:09 |
slaweq | #action ralonsoh to try a patch to resuce the number of workers in FT | 16:09 |
slaweq | and the last one: | 16:10 |
slaweq | slaweq to check neutron.tests.functional.agent.l3.test_ha_router.L3HATestCase issue | 16:10 |
slaweq | Bug reported https://bugs.launchpad.net/neutron/+bug/1836565 | 16:10 |
openstack | Launchpad bug 1836565 in neutron "Functional test test_keepalived_state_change_notification may fail do to race condition" [Medium,In progress] - Assigned to Slawek Kaplonski (slaweq) | 16:10 |
slaweq | Patch proposed https://review.opendev.org/670815 | 16:10 |
slaweq | I found that it is race condition which may cause such failure in rare cases | 16:10 |
slaweq | but fortunatelly fix was quite easy :) | 16:10 |
slaweq | any questions/comments? | 16:11 |
*** jawad_axd has joined #openstack-meeting | 16:11 | |
ralonsoh | slaweq, I need to check the patch first, I'll comment on it | 16:11 |
slaweq | ralonsoh: sure, thx | 16:11 |
slaweq | ok, so lets move on | 16:12 |
slaweq | #topic Stadium projects | 16:12 |
*** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)" | 16:12 | |
slaweq | Python 3 migration | 16:12 |
slaweq | Stadium projects etherpad: https://etherpad.openstack.org/p/neutron_stadium_python3_status | 16:12 |
slaweq | I already talked about midonet plugin | 16:12 |
slaweq | but I have also short update anout neutron-fwaas and networking-ovn | 16:12 |
njohnston_ | I have a bagpipe update that looks ready to go: https://review.openstack.org/641057 | 16:12 |
slaweq | for neutron-fwaas all voting jobs are switched to py3 now | 16:13 |
slaweq | today I sent patch to switch multinode tempest job: https://review.opendev.org/671005 | 16:13 |
slaweq | but I think I will have to wait with it and propose it to neutron-tempest-plugin repo when njohnston_ will finish his patches related to neutron-fwaas tempest plugin | 16:14 |
slaweq | for networking-ovn I today sent patch to switch rally job to py3: https://review.opendev.org/671006 | 16:14 |
slaweq | with this patch I think we can consieder networking-ovn as done, because last job which isn't switched is based on Centos 7 so can't be run on py3 probably | 16:15 |
slaweq | that's all from me | 16:15 |
*** jawad_axd has quit IRC | 16:15 | |
slaweq | njohnston_: thx for Your update about bagpipe | 16:15 |
slaweq | I will review this patch tomorrow morning | 16:16 |
njohnston_ | slaweq: The fwaas change in the neutron-tempest-plugin repo is already merged, so you could go ahead and propose it there immediately | 16:16 |
slaweq | njohnston_: ahh, yes, thx | 16:16 |
slaweq | so I will do it that way | 16:16 |
njohnston_ | +1 | 16:16 |
slaweq | so we are "almost" done with this transition :) | 16:17 |
*** mattw4 has joined #openstack-meeting | 16:17 | |
slaweq | any other questions/comments? | 16:17 |
igordc | not on this topic from me | 16:18 |
slaweq | ok, lets move on then | 16:18 |
slaweq | tempest-plugins migration | 16:18 |
slaweq | Etherpad: https://etherpad.openstack.org/p/neutron_stadium_move_to_tempest_plugin_repo | 16:18 |
slaweq | any updates? | 16:18 |
njohnston_ | As I mentioned before, the first part of the fwaas move happened and I am tinkering with the second half now: https://review.opendev.org/643668 | 16:18 |
*** mattw4 has quit IRC | 16:19 | |
njohnston_ | If you propose your converted multinode tempest job in n-t-p then I will incorporate it into that change | 16:19 |
*** mattw4 has joined #openstack-meeting | 16:19 | |
slaweq | njohnston_: ok, thx a lot :) | 16:19 |
slaweq | from my side, I will tomorrow take a look at tidwellr's patch for neutron-dynamic-routing to help with it | 16:20 |
slaweq | so that should be all related to the stadium projects | 16:21 |
slaweq | I think we can move on to next topics | 16:21 |
slaweq | #topic Grafana | 16:21 |
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:21 | |
*** hemna has quit IRC | 16:22 | |
njohnston_ | midonet cogate broken again | 16:22 |
slaweq | I don't know why there is no any data for gate queue since last few days - didn't we merge anything recently? | 16:22 |
njohnston_ | the number of jobs that have been run in the gate queue seems pretty low, so I wonder if many patches are making it through | 16:23 |
njohnston_ | when lots of jobs have moderate fail numbers - even pep8 has an 11% failure right now, which is unusual - then it seems likely that something will fail in a given run. | 16:23 |
slaweq | njohnston_: about midonet job, You're right but I don't think we have anyone who wants to look into it | 16:24 |
slaweq | I guess it will have to wait for yamamoto | 16:24 |
njohnston_ | indeed | 16:24 |
slaweq | njohnston_: about pep8 jobs I think I saw quite many WIP patches recently which may cause this failure rate | 16:25 |
*** mmethot has quit IRC | 16:25 | |
slaweq | from good things I see that functional/fullstack jobs are slightly better now (below 30%) | 16:26 |
njohnston_ | ok, could be. I hope so! | 16:26 |
slaweq | and also our "highest rates" jobs one with uwsgi and one with dvr are better now | 16:27 |
slaweq | not good but better at least :) | 16:27 |
slaweq | anything else You want to add or can we move on? | 16:28 |
*** manjeets has quit IRC | 16:28 | |
slaweq | ok, lets move on | 16:29 |
slaweq | #topic fullstack/functional | 16:29 |
*** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)" | 16:29 | |
njohnston_ | nothing else from me | 16:29 |
slaweq | I saw at least twice this week issue with neutron.tests.functional.agent.linux.test_keepalived.KeepalivedManagerTestCase: | 16:29 |
slaweq | http://logs.openstack.org/15/670815/1/check/neutron-functional-python27/028631e/testr_results.html.gz | 16:29 |
slaweq | http://logs.openstack.org/11/662111/27/check/neutron-functional/8404d24/testr_results.html.gz | 16:29 |
*** jamesmcarthur has quit IRC | 16:29 | |
slaweq | but IIRC it's related to privsep pool in tests, right ralonsoh? | 16:30 |
ralonsoh | let me check | 16:30 |
ralonsoh | yes, and I think this is related to the sync decorator in ip_lib | 16:30 |
*** Shrews has joined #openstack-meeting | 16:30 | |
ralonsoh | but, of course, until we have a new pyroute2 release, we need to keep this sync decorator | 16:31 |
*** jamesmcarthur has joined #openstack-meeting | 16:31 | |
ralonsoh | and in this order: first the sync and then the privsep | 16:31 |
ralonsoh | this is killing sometimes the FTs | 16:31 |
ralonsoh | because you enter into the privsep and the wait | 16:31 |
ralonsoh | that should be in the other way, but this is not suppoerted by py2 | 16:31 |
ralonsoh | that' all | 16:32 |
slaweq | ok, thx ralonsoh for confirmation | 16:32 |
slaweq | and do we have bug reported for that? | 16:32 |
ralonsoh | yes | 16:32 |
ralonsoh | I'll find it | 16:32 |
ralonsoh | please don;'t stop for me | 16:32 |
ralonsoh | https://review.opendev.org/#/c/666853/ | 16:33 |
ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/1833721 | 16:33 |
openstack | Launchpad bug 1833721 in neutron "ip_lib synchronized decorator should wrap the privileged one" [Medium,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 16:33 |
*** tesseract has quit IRC | 16:33 | |
slaweq | ralonsoh: thx a lot | 16:33 |
slaweq | ok | 16:33 |
slaweq | for fullstack I found one new failure | 16:34 |
slaweq | http://logs.openstack.org/70/670570/1/check/neutron-fullstack/b563af4/testr_results.html.gz | 16:34 |
slaweq | failed test neutron.tests.fullstack.test_qos.TestMinBwQoSOvs.test_bw_limit_qos_port_removed | 16:34 |
slaweq | did You saw somethig like that before? | 16:34 |
ralonsoh | yes, but almost one year ago | 16:34 |
ralonsoh | and that was solved | 16:34 |
ralonsoh | I can take a look at this | 16:34 |
*** electrofelix has quit IRC | 16:35 | |
slaweq | I see such error in logs: http://logs.openstack.org/70/670570/1/check/neutron-fullstack/b563af4/controller/logs/dsvm-fullstack-logs/TestBwLimitQoSOvs.test_bw_limit_qos_port_removed_egress_.txt.gz#_2019-07-15_22_14_11_638 | 16:35 |
slaweq | but I'm not sure if that is related really | 16:36 |
ralonsoh | this should not happen | 16:36 |
ralonsoh | I'll download the logs and I'll grep to see if someone else is deleting this port before | 16:37 |
slaweq | ok, thx ralonsoh | 16:37 |
*** ayoung has joined #openstack-meeting | 16:37 | |
slaweq | can You also report a bug for it, that we can track it there? | 16:38 |
njohnston_ | +1 | 16:38 |
ralonsoh | slaweq, perfect | 16:38 |
slaweq | #action ralonsoh to report a bug and investigate failed test neutron.tests.fullstack.test_qos.TestMinBwQoSOvs.test_bw_limit_qos_port_removed | 16:38 |
slaweq | thx ralonsoh :) | 16:38 |
slaweq | anything else related to functional/fullstack tests? | 16:39 |
*** ijw has joined #openstack-meeting | 16:39 | |
*** ijw has quit IRC | 16:39 | |
*** ijw has joined #openstack-meeting | 16:39 | |
slaweq | ok, lets move on then | 16:40 |
slaweq | #topic Tempest/Scenario | 16:40 |
*** TxGirlGeek has joined #openstack-meeting | 16:40 | |
*** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)" | 16:40 | |
slaweq | first few short informations | 16:40 |
slaweq | Two patches which should improve our gate a bit: | 16:40 |
slaweq | https://review.opendev.org/#/c/670717/ | 16:40 |
slaweq | https://review.opendev.org/#/c/670718/ | 16:40 |
slaweq | please take a look at them if You will have a minute :) | 16:40 |
njohnston_ | added them to the pile | 16:41 |
slaweq | thx njohnston_ | 16:41 |
slaweq | and second thing | 16:41 |
slaweq | I sent patches to propose 2 new jobs: | 16:41 |
slaweq | https://review.opendev.org/#/c/670029/ - based on TripleO standalone | 16:41 |
igordc | slaweq, do you think these will decrease the odds of sshtimeout? | 16:41 |
slaweq | this is non-voting job for now, please review it too | 16:41 |
slaweq | and the second patch: https://review.opendev.org/#/c/670738/ | 16:42 |
slaweq | I realized recently that we don't have simple openvswitch job which runs neutron_tempest_plugin tests | 16:42 |
slaweq | we have only linuxbridge job like that | 16:42 |
slaweq | so I'm proposing to have similar job for ovs too | 16:42 |
slaweq | please let me know what do You think about it | 16:43 |
slaweq | (in patch review of course :)) | 16:43 |
njohnston_ | thanks, these are great ideas | 16:43 |
slaweq | thx njohnston_ :) | 16:43 |
slaweq | igordc: According to SSH issue, I opened bug https://bugs.launchpad.net/neutron/+bug/1836642 | 16:43 |
openstack | Launchpad bug 1836642 in OpenStack Compute (nova) "Metadata responses are very slow sometimes" [Undecided,Incomplete] | 16:43 |
*** enriquetaso has quit IRC | 16:43 | |
slaweq | basically there are 2 main issues with ssh: | 16:44 |
*** enriquetaso has joined #openstack-meeting | 16:44 | |
slaweq | 1. covered by mlavalle's investigation which we talked on the beginning of the meeting | 16:44 |
*** hemna has joined #openstack-meeting | 16:44 | |
slaweq | 2. this issue with slow metadata responses for /public-keys/ request which cause failure of confguring ssh key on instance and than failure with ssh | 16:45 |
slaweq | according to 2) I reported it for both nova and neutron as I noticed that in most cases it is nova-metadata-api which is responding very slow | 16:45 |
slaweq | but sean-k-mooney found out today that (at least in one case) nova was waiting very long time on response from neutron to get security groups | 16:46 |
slaweq | (this workflow is really complicated IMHO) | 16:46 |
igordc | slaweq, is the error different than sshtimeout for 2. ? | 16:46 |
*** mmethot has joined #openstack-meeting | 16:47 | |
slaweq | so I will continue investigating this but if someone wants to help, please take a look at this bug, maybe You will find something interesting :) | 16:47 |
njohnston_ | wow, so nova has to ask for security group info in order to satisfy a metadata request? that seems highly nonintuitive. | 16:47 |
slaweq | igordc: basically in both cases final issue is authentication failure during sshing to the vm | 16:47 |
*** shintaro has quit IRC | 16:47 | |
slaweq | njohnston_: yes, I was also surprised today when sean told me that | 16:47 |
igordc | yep I will take some time and see if I can find out something.. some patches get sshtimeout almost every time | 16:48 |
*** armax has quit IRC | 16:48 | |
slaweq | igordc: difference between those 2 cases is that in 1) You will see about 20 attempts to get instance-id from metadata server | 16:48 |
*** hemna has quit IRC | 16:49 | |
slaweq | and in 2) You will see that instance-id was returned to vm properly and there was "failed to get .../public-keys" message in this console log | 16:49 |
slaweq | and in this second case, in most cases which I checked it was like that becasuse response for this request took more than 10 seconds | 16:49 |
*** iyamahat has quit IRC | 16:50 | |
slaweq | 10 seconds is timeout set in curl used in this ec2-metadata script in cirros | 16:50 |
slaweq | that's all from me about this issue | 16:51 |
slaweq | any questions/comments? | 16:51 |
igordc | wondering if certain patches with changes in certain places make this more likely | 16:52 |
slaweq | igordc: I don't think so | 16:52 |
slaweq | IMO, at least this second problem described by me is somehow related to performance of node at which tests are run | 16:53 |
slaweq | and nothing else | 16:53 |
slaweq | but I don't have any proof for that | 16:53 |
slaweq | ok | 16:54 |
slaweq | lets move on | 16:54 |
slaweq | from other things | 16:54 |
slaweq | neutron-tempest-with-uwsgi job is now running better after my fix for tempest was merged | 16:55 |
slaweq | but it has a lot of timeouts | 16:55 |
slaweq | maybe it will be better when it will be switched to run only neutron and nova related tests | 16:55 |
slaweq | but I think it's worth to investigate why it's so slow so often | 16:56 |
slaweq | so I will open bug for it | 16:56 |
slaweq | #action slaweq to open bug about slow neutron-tempest-with-uwsgi job | 16:56 |
slaweq | and that's all from me regarding tempest jobs | 16:57 |
slaweq | anything else You want to add here? | 16:57 |
njohnston_ | not I | 16:57 |
ralonsoh | no | 16:57 |
haleyb | -1 | 16:57 |
slaweq | ok, thx for attending the meeting | 16:58 |
njohnston_ | thanks! | 16:58 |
slaweq | and have a nice week | 16:58 |
slaweq | #endmeeting | 16:58 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 16:58 | |
slaweq | o/ | 16:58 |
ralonsoh | bye! | 16:58 |
openstack | Meeting ended Tue Jul 16 16:58:17 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:58 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-07-16-16.00.html | 16:58 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-07-16-16.00.txt | 16:58 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-07-16-16.00.log.html | 16:58 |
igordc | ty, bye | 16:58 |
*** dtrainor has quit IRC | 17:00 | |
*** iyamahat has joined #openstack-meeting | 17:05 | |
*** iyamahat_ has joined #openstack-meeting | 17:08 | |
*** yamamoto has joined #openstack-meeting | 17:11 | |
*** kopecmartin is now known as kopecmartin|off | 17:11 | |
*** davidsha has quit IRC | 17:11 | |
*** iyamahat has quit IRC | 17:11 | |
*** hemna has joined #openstack-meeting | 17:14 | |
*** TxGirlGeek has quit IRC | 17:17 | |
*** igordc has quit IRC | 17:17 | |
*** hemna has quit IRC | 17:18 | |
*** e0ne has quit IRC | 17:20 | |
*** yamahata has joined #openstack-meeting | 17:24 | |
*** armax has joined #openstack-meeting | 17:34 | |
*** hemna has joined #openstack-meeting | 17:34 | |
*** ijw has quit IRC | 17:36 | |
*** ijw has joined #openstack-meeting | 17:36 | |
*** hemna has quit IRC | 17:38 | |
*** ijw has quit IRC | 17:38 | |
*** ijw has joined #openstack-meeting | 17:39 | |
*** ricolin has quit IRC | 17:40 | |
*** dtrainor has joined #openstack-meeting | 17:41 | |
*** jamesmcarthur has quit IRC | 17:43 | |
*** igordc has joined #openstack-meeting | 17:44 | |
*** TxGirlGeek has joined #openstack-meeting | 17:53 | |
*** hemna has joined #openstack-meeting | 17:54 | |
*** hemna has quit IRC | 17:59 | |
*** electrofelix has joined #openstack-meeting | 18:00 | |
*** eharney has quit IRC | 18:02 | |
*** electrofelix has quit IRC | 18:03 | |
*** eharney has joined #openstack-meeting | 18:06 | |
*** jamesmcarthur has joined #openstack-meeting | 18:07 | |
*** efried has quit IRC | 18:12 | |
*** efried has joined #openstack-meeting | 18:21 | |
*** jamesmcarthur has quit IRC | 18:24 | |
*** hemna has joined #openstack-meeting | 18:37 | |
*** jamesmcarthur has joined #openstack-meeting | 18:42 | |
*** jamesmcarthur has quit IRC | 18:51 | |
*** jamesmcarthur has joined #openstack-meeting | 18:52 | |
*** jamesmcarthur_ has joined #openstack-meeting | 18:53 | |
*** jamesmcarthur_ has quit IRC | 18:54 | |
*** mattw4 has quit IRC | 18:55 | |
*** jamesmcarthur has quit IRC | 18:57 | |
*** jamesmcarthur has joined #openstack-meeting | 18:58 | |
*** jamesmcarthur_ has joined #openstack-meeting | 18:59 | |
clarkb | hello anyone else here for the infra meeting? | 18:59 |
clarkb | mordred said he won't make it | 18:59 |
Shrews | aww | 19:00 |
fungi | he'll be missed | 19:00 |
fungi | who can throw wet animals in his place? | 19:00 |
clarkb | he will probably be underwater or something | 19:00 |
clarkb | so all of the animals are already wet for him | 19:00 |
clarkb | #startmeeting infra | 19:01 |
openstack | Meeting started Tue Jul 16 19:01:04 2019 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
*** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
openstack | The meeting name has been set to 'infra' | 19:01 |
clarkb | #link http://lists.openstack.org/pipermail/openstack-infra/2019-July/006417.html | 19:01 |
clarkb | Find our agenda at ^ | 19:01 |
clarkb | #topic Announcements | 19:01 |
*** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:01 | |
ianw | o/ | 19:02 |
clarkb | Nothing major. As mentioned previously I'm largely afk today visiting people in town for oscon | 19:02 |
corvus | o/ | 19:02 |
clarkb | #topic Actions from last meeting | 19:02 |
*** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:02 | |
clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-07-09-19.01.txt minutes from last meeting | 19:02 |
clarkb | #action mordred create opendevadmin github account | 19:03 |
clarkb | #action mordred clean up openstack-infra github org | 19:03 |
clarkb | mordred has apparently started on this second item and is writing a currently non working script to do the work | 19:03 |
*** jamesmcarthur has quit IRC | 19:03 | |
clarkb | #topic Priority Efforts | 19:04 |
*** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:04 | |
fungi | hopefully he's writing a working script, and its non-workingness is merely a transient state | 19:04 |
clarkb | fungi: that was how I understood it :) | 19:04 |
clarkb | #topic Update Config Management | 19:04 |
*** openstack changes topic to "Update Config Management (Meeting topic: infra)" | 19:04 | |
*** jamesmcarthur_ has quit IRC | 19:04 | |
*** bbowen has quit IRC | 19:05 | |
clarkb | has anyone noticed yet the shiny job running optomization for system-config when you update it's .zuul.yaml? | 19:05 |
*** jamesmcarthur has joined #openstack-meeting | 19:05 | |
clarkb | Other than ^ I'm not sure we've made much progresson this item in the last week. Anyone have items to share related to this? | 19:05 |
fungi | while i'm loathe to admit it, i haven't had occasion to update system-config's .zuul.yaml yet | 19:06 |
corvus | i think the gitea repo creation is ready to merge | 19:06 |
fungi | (since the changes took effect) | 19:06 |
*** jamesmcarthur_ has joined #openstack-meeting | 19:06 | |
clarkb | corvus: do we need to squash any of the changes together because the chagnes only fully work near the end of the stack? | 19:06 |
corvus | that will unblock the next steps in the zuul-and-related-systems playbook | 19:07 |
clarkb | (or an alternative would be to disable ansible for a bit, get everything merged, then turn ansible on | 19:07 |
corvus | clarkb: i think we can merge them as-is, the worst that can happen if the broken version runs is that it immediately errors out | 19:07 |
clarkb | gotcha so not failing and doing the wrong thing but failing safe. perfect | 19:07 |
corvus | i'll start that going right now | 19:08 |
clarkb | The changes that I have reviewed so far look great (I need to rereview the parallelization change) | 19:08 |
corvus | (since they have sufficient +2s) | 19:08 |
*** eharney has quit IRC | 19:08 | |
clarkb | as an added bonus I find the python script much more readable than the ansible yaml for this type of stuff (particularly in the manipulation of text/json) | 19:09 |
corvus | :( i liked the yaml | 19:09 |
corvus | clarkb: also, wait till you see the parallelized version before you say it's readable ;) | 19:09 |
clarkb | I always find it hard to reason about the loop constructs with item and subelements... | 19:09 |
*** jamesmcarthur has quit IRC | 19:10 | |
corvus | but yeah, we certainly wouldn't be doing *that* in ansible | 19:10 |
clarkb | in any case it is much faster: about half an hour serialized instead of ~4 hours | 19:10 |
corvus | and i'm aiming for ~10m with the updates | 19:10 |
clarkb | and down to ~9 minutes if done in parallel? great improvement | 19:10 |
fungi | i similarly find it hard to reason about threads and mutexes | 19:10 |
fungi | so ymmv ;) | 19:10 |
corvus | 0:13:43 | 19:11 |
corvus | is how long it just took | 19:11 |
corvus | so that node is a little slower than my workstation :) | 19:11 |
clarkb | That is probably a good transition into opendev topics | 19:11 |
clarkb | #topic OpenDev | 19:11 |
fungi | quite the speedup! | 19:11 |
corvus | still, all things considered, i think it probably means we can keep using the real data in the test jobs | 19:11 |
*** openstack changes topic to "OpenDev (Meeting topic: infra)" | 19:11 | |
clarkb | corvus: nice | 19:12 |
clarkb | corvus: and at that speed can probably run it twice (to check the nooping too | 19:12 |
corvus | yeah, that should be very fast | 19:12 |
clarkb | This related to opendev because this is sort of the very first step in improving project creation work that we discussed at the PTG | 19:12 |
*** diablo_rojo has quit IRC | 19:13 | |
clarkb | We'd like to get to a place for orgs can largely self manage the proejcts under their umbrellas and making sure that doesn't take hours to reconcile is the very first step in that | 19:13 |
clarkb | so yay | 19:13 |
clarkb | Next we can have zuul trigger updates, then we can start distributing responsibility for managing those updates into the orgs ya? | 19:14 |
corvus | yep | 19:14 |
fungi | also we can thoroughly test changes to those mechanisms in a timely manner | 19:15 |
fungi | (in addition to speeding up gitea server replacements) | 19:15 |
fungi | so much win | 19:16 |
clarkb | fungi: those are actually done via database recovery currently to preserve the redirects | 19:16 |
clarkb | fungi: so that doesn't take very long | 19:16 |
fungi | ahh, right, good point | 19:16 |
clarkb | (we have docs on that) | 19:16 |
corvus | though we have plans for doing it from scratch | 19:16 |
fungi | though we do have the redirects recorded in yaml | 19:16 |
corvus | so we may get to that point in the future | 19:16 |
clarkb | yup eventually we should eb able to make it more automated via direct restoration | 19:17 |
fungi | should we need to rebuild them | 19:17 |
clarkb | The other opendev/gitea item I wanted to bring up was the one from today with the OOMing | 19:17 |
clarkb | Our gitea servers don't have swap and under some circumstances (this needs further investigation) they OOM which can kill git which can prevent replication of refs | 19:18 |
clarkb | I've got https://review.opendev.org/#/c/671102/ pushed up and if yall can take a quick look at that and decide it mostly does the right thing I can run that manually on gitea06. The reason for doing it on 06 is 06 has much more disk than the other gitea servers which unfortunately don't have much extra to spare | 19:18 |
fungi | i am mildly concerned that one client can basically cause an arbitrary gitea backend to cancel random git processes | 19:18 |
fungi | but that ought to help | 19:18 |
clarkb | and ya we'll need to investigate further to see what is causing that and hopefully work to fix it in gitea | 19:19 |
clarkb | Anything else opendev related or should we move on? | 19:19 |
fungi | cacti says outbound bandwidth spiked to at least 150mbps when this happened | 19:19 |
fungi | where the baseline was around 10mbps | 19:20 |
fungi | so maybe client rate limits could help, if haproxy has those | 19:20 |
clarkb | journald should have logs of what requests we made then right? | 19:20 |
clarkb | corvus: ^ does gitea log that information? | 19:20 |
fungi | probably | 19:20 |
fungi | well, apache will, presumable? | 19:20 |
fungi | er, presumably | 19:20 |
corvus | i think gitea has it | 19:21 |
clarkb | we don't run apache with gitea | 19:21 |
corvus | i don't think we have an apache (though we talked about it; we can add one if needed) | 19:21 |
corvus | but right now, our setup is simple enough we can do without | 19:21 |
fungi | oh, got it, so it's haproxy straight to the gitea sockets | 19:21 |
corvus | yep, and gitea is terminating the tls | 19:21 |
fungi | and haproxy won't know the nature of the requests because of not terminating ssl/tls | 19:21 |
clarkb | fungi: it should know l3 information which may be sufficient for rate limiting (though that may make NAT users sad) | 19:22 |
fungi | right, just won't tell us what they were requesting that might be so voluminous (maybe they were just recloning every repo though) | 19:22 |
corvus | pretty sure gitea is logging the reqs | 19:23 |
clarkb | cool so we can look into it further than | 19:23 |
clarkb | s/than/then | 19:23 |
fungi | and docker-compose can spit those out? | 19:23 |
clarkb | The other thing I've done to help temporarily is triggered replication on against all gitea backends (currently on 06) | 19:24 |
clarkb | fungi: ya or the docker command | 19:24 |
clarkb | (and possibly journalctl too) | 19:24 |
fungi | cool, thanks | 19:24 |
clarkb | The extra replications are ensuring that all refs are in place which may have been OOMKilled | 19:24 |
fungi | seems like a reasonable precaution until we get this under control | 19:25 |
*** jamesmcarthur_ has quit IRC | 19:25 | |
clarkb | Sounds like we have rough ideas of how to address this further so lets move on | 19:26 |
clarkb | storyboard time | 19:26 |
clarkb | #topic Storyboard | 19:26 |
*** openstack changes topic to "Storyboard (Meeting topic: infra)" | 19:26 | |
clarkb | diablo_rojo_phon is at OSCON so unsure if paying attention today | 19:26 |
clarkb | fungi: any new news | 19:26 |
fungi | we're going to try to do some story feature request subclassification on friday | 19:27 |
fungi | but other than that, no major news i'm aware of | 19:27 |
clarkb | #topic General Topics | 19:28 |
*** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:28 | |
clarkb | first up is trusty server upgrades | 19:28 |
*** jamesmcarthur has joined #openstack-meeting | 19:28 | |
clarkb | fungi: any luck with the wiki git repo situation? | 19:28 |
clarkb | I meant to help dig into that then got sucked into new cloud stuff | 19:28 |
clarkb | link https://etherpad.openstack.org/p/201808-infra-server-upgrades-and-cleanup | 19:29 |
*** jamesmcarthur_ has joined #openstack-meeting | 19:29 | |
clarkb | I think the new cloud stuff is largely under control/done so I can help with this tomorrow if still a problem | 19:29 |
fungi | i haven't had a chance to dig into what might be causing it. weird though... basically files like /srv/mediawiki/w/extensions/Renameuser/.git which just contain "gitdir: ../../.git/modules/extensions/Renameuser" | 19:29 |
fungi | is that what submodules look like? | 19:30 |
fungi | seems like the reverse of a submodule | 19:30 |
fungi | or maybe not | 19:30 |
clarkb | maybe it is subtree? which is like submodules in practice but implemeted differently | 19:30 |
clarkb | but ya my hunch would be somethign around submodules | 19:30 |
corvus | i was just thinking git needed another way to be used wrong | 19:31 |
fungi | oh! we are cloning these into another git worktree, so... maybe! | 19:31 |
clarkb | corvus: I think they set out to make submodules work better :) and well ya | 19:31 |
fungi | i think the repo we're cloning to /srv/mediawiki/w/ may include files like extensions/Renameuser/.git | 19:31 |
fungi | i'll pursue that avenue | 19:32 |
clarkb | cool let me know if I can help tomorrow | 19:32 |
*** jamesmcarthur_ has quit IRC | 19:32 | |
clarkb | Next up is New cloud updates | 19:32 |
clarkb | Wanted to mention that fortnebula is now in full use | 19:32 |
clarkb | thank you donnyd for getting that set up | 19:32 |
*** jamesmcarthur_ has joined #openstack-meeting | 19:33 | |
clarkb | In the process we fixed some issues with our cloud launcher config, problems in glean/dib with centos/fedora network manager compatibility and probably other things I'm forgetting now | 19:33 |
clarkb | Hopefully that makes it easier to set up the MOC and linaro resources that we expect will be coming up soon | 19:33 |
*** jamesmcarthur has quit IRC | 19:33 | |
clarkb | For linaro Kevin Zhang has reached out to me and says they are starting to build an oepnstack arm cloud on packethost | 19:34 |
clarkb | and will get in touch when that is working and they ahve sorted out IP addressing (I gave them our IP addr requirements) | 19:34 |
*** jamesmcarthur has joined #openstack-meeting | 19:34 | |
clarkb | corvus: mordred isn't here, do you know what is going on with MOC? | 19:34 |
fungi | or knikolla? | 19:34 |
knikolla | o/ | 19:35 |
clarkb | just curious if there was anything more to share today since it was mentioned last week | 19:36 |
fungi | knikolla: mordred mentioned you were looking at providing moc resources to opendev's nodepool. have any details/updates? | 19:36 |
clarkb | if not I'll wait patiently :) | 19:36 |
donnyd | clarkb: I still have 40% more to go, just waiting on more gear | 19:36 |
corvus | knikolla: i think mordred made an account and maybe next thing is to add the second project to that? | 19:36 |
donnyd | I plan to have 100 builders | 19:36 |
knikolla | i remember seeing a request for an account on our cloud from mordred, i assume someone on our side approved that | 19:36 |
clarkb | donnyd: awesome | 19:37 |
fungi | ahh, cool | 19:37 |
fungi | thanks knikolla! | 19:37 |
knikolla | if more than one project is needed, mordred can apply for another in the same way | 19:37 |
*** jamesmcarthur_ has quit IRC | 19:37 | |
clarkb | ya typically we use two so that we can separate untrusted test nodes from trusted services like the mirror | 19:38 |
clarkb | good to know the process is the same just repeated | 19:38 |
corvus | cool, sounds like progress and we should check with mordred | 19:38 |
knikolla | cool, does nodepool support application credentials? | 19:38 |
clarkb | knikolla: it supports authentication via anything configurable through clouds.yaml | 19:39 |
clarkb | so maybe? | 19:39 |
knikolla | then most probably yes. | 19:39 |
cmurphy | clouds.yaml supports app creds | 19:39 |
clarkb | ok sounds like next step is sync with mordred, thanks | 19:40 |
clarkb | Next on the agenda is managing our PPA | 19:40 |
clarkb | I've never personally had to manage a PPA so not sure I should lead this discussion but it was mentioned last week that it would be good for us to formalize the process a bit more | 19:41 |
clarkb | maybe that means docs or full on automation or some balance in between | 19:41 |
clarkb | ianw: ^ you've done much of the work there so probably have thoughts | 19:41 |
ianw | yesterday I wrote up some docs at | 19:41 |
ianw | #link https://review.opendev.org/#/c/670952/ | 19:41 |
ianw | if people want to make roles/jobs to build and sign debs and put them into the ppas with dput or whatever, that seems just fine | 19:42 |
clarkb | Thank you for the docs that seems like a good place to start | 19:42 |
clarkb | corvus maybe you can review that change and think about whether you'd like more (like automation) | 19:42 |
ianw | i would say, for things like the afs work ... you're taking an upstream tarball and then shoe-horning it into the existing (older) debian package. it's a lot of manual fiddling, and you've got to have a pretty good idea of how debian packaging works | 19:42 |
corvus | if ianw is away, and someone says "we need a new openafs package" i'd like to know what to do... | 19:43 |
clarkb | hrm ya in that case automating the shoehorning might be a good idea | 19:43 |
clarkb | maybe thats jsut a script we can run periodically? | 19:43 |
corvus | i mean, i don't need a general guide, it's more, specifically, what commands do i run to make an updated openafs package? | 19:44 |
corvus | (that could be a job, i'm ambivalent about that) | 19:44 |
corvus | we actually have precedent for this: https://docs.openstack.org/infra/system-config/nodepool.html#vhd-util | 19:46 |
clarkb | gotcha so its that bit of documentation. FWIW I find the other bit ianw wrote useful too (particularly the stuff around perms) | 19:46 |
clarkb | ianw: so maybe we can add something like the vhd package build docs too and start from there? | 19:46 |
corvus | the equivalent of that for openafs i think would be sufficient | 19:47 |
*** ijw has quit IRC | 19:47 | |
fungi | if the openafs source package includes a debian/watch file it may be as simple as running uupdate in the source tree | 19:47 |
clarkb | that seems like a reasonable path forward. We only have 12 minutes left so I'll continue as the last item is fairly important too | 19:48 |
ianw | fungi: it can be, but then we've also done quite a lot of backporting at times for things like arm64 support. the complexity definitely varies based on what is being done. | 19:48 |
corvus | (also, is that vhd-util stuff completely obsolete now?) | 19:48 |
clarkb | corvus: no we still use it to build rax images | 19:49 |
fungi | given rra used to handle the openafs uploads for debian, the package is probably fairly easy to update like that | 19:49 |
fungi | and yeah, patching is always going to be the gotcha | 19:49 |
fungi | though you can probably drop diffs into the debian/patches/ directory | 19:49 |
clarkb | We have been asked if we would like to attend the PTG as a team. I know I'll be going and expect fungi to be there as well and think mordred and corvus are going too. A rough headcount will be helpful for planning purposes but I think even with a small group we should have a chunk of time to work on opendev type things (this was useful in denver) | 19:50 |
corvus | ++ | 19:50 |
clarkb | Also I know that we'd like to invite some of the gitea developers to have some space there too | 19:50 |
clarkb | so I'll be requesting space for them as well | 19:50 |
fungi | i don't have a visa yet, and travel late in hurricane season is always a big question mark for me, but i will be there if at all possible | 19:50 |
clarkb | I have until early august to fill out the survey but figure I'll probably send it in sometime this week | 19:51 |
clarkb | so if you think you might be going just let me know so I can adjust the headcount numbers appropriately | 19:51 |
clarkb | #topic Open Discussion | 19:52 |
*** openstack changes topic to "Open Discussion (Meeting topic: infra)" | 19:52 | |
clarkb | We have a few minutes for any other business that you want to bring up | 19:52 |
*** jamesmcarthur has quit IRC | 19:53 | |
*** jamesmcarthur has joined #openstack-meeting | 19:53 | |
Shrews | china exceeds my travel tolerance by, like, a whole lot :) | 19:53 |
fungi | mine too, but i've learned to repress my feelings | 19:54 |
ianw | speaking of docs | 19:54 |
*** jamesmcarthur_ has joined #openstack-meeting | 19:54 | |
ianw | #link https://review.opendev.org/669602 | 19:54 |
ianw | #link https://review.opendev.org/668833 | 19:54 |
ianw | that's letsencrypt docs i wrote, and also updates to mirror-update docs to reflect the new server | 19:54 |
clarkb | ianw: thanks! | 19:55 |
ianw | note we're exporting the logs of the rsync runs now -> http://mirror.ord.rax.opendev.org/logs/rsync-mirrors/ | 19:55 |
ianw | that should be helpful to people who want to contribute mirrors but previously had no way to see what was happening | 19:55 |
fungi | excellent | 19:55 |
ianw | and if you want to see them in your browser | 19:56 |
ianw | #link https://review.opendev.org/670934 | 19:56 |
ianw | fixes that :) | 19:56 |
fungi | / | 19:56 |
ianw | oh, and for that to apply | 19:56 |
ianw | #link https://review.opendev.org/670927 | 19:56 |
fungi | probably better to link to http://files.openstack.org/mirror/logs/rsync-mirrors/ | 19:56 |
clarkb | Shrews: thankfully there is a direct flight from seattle to shanghai | 19:57 |
ianw | fungi: hrm yes, i guess that will need a mimetype update too | 19:57 |
*** ijw has joined #openstack-meeting | 19:57 | |
fungi | that way you don't have to pick a random mirror to look at the central logs from the mirror updater | 19:58 |
*** jamesmcarthur has quit IRC | 19:58 | |
fungi | alternatively, we can just point them at the really trivial docs on how to set up your machine as an openafs client | 19:58 |
fungi | and they can use whatever local tools they want to view those logs over afs | 19:58 |
ianw | many options :) | 19:59 |
clarkb | And we are just about at time. Thank you everyone! | 19:59 |
fungi | thanks clarkb! | 19:59 |
clarkb | Feel free to follow up on any and all topics here in #openstack-infra or at openstack-infra@lists.openstack.org | 19:59 |
clarkb | #endmeeting | 19:59 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 19:59 | |
openstack | Meeting ended Tue Jul 16 19:59:39 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:59 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-07-16-19.01.html | 19:59 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-07-16-19.01.txt | 19:59 |
openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-07-16-19.01.log.html | 19:59 |
*** Shrews has left #openstack-meeting | 20:00 | |
*** mattw4 has joined #openstack-meeting | 20:04 | |
*** eharney has joined #openstack-meeting | 20:06 | |
*** bbowen has joined #openstack-meeting | 20:11 | |
*** bobh has quit IRC | 20:33 | |
*** ralonsoh has quit IRC | 20:35 | |
*** diablo_rojo has joined #openstack-meeting | 20:37 | |
*** rfolco is now known as rfolco_l8r | 20:39 | |
*** ykatabam has joined #openstack-meeting | 20:41 | |
*** dasp has quit IRC | 20:45 | |
*** jamesmcarthur_ has quit IRC | 20:45 | |
*** dasp has joined #openstack-meeting | 20:47 | |
*** ykatabam has quit IRC | 20:47 | |
*** ykatabam has joined #openstack-meeting | 20:52 | |
*** pcaruana has quit IRC | 21:01 | |
*** raildo has quit IRC | 21:04 | |
*** armax has quit IRC | 21:43 | |
*** diablo_rojo has quit IRC | 22:13 | |
*** whoami-rajat has quit IRC | 22:31 | |
*** rcernin has joined #openstack-meeting | 22:36 | |
*** ijw has quit IRC | 22:39 | |
*** ijw has joined #openstack-meeting | 22:43 | |
*** slaweq has quit IRC | 22:55 | |
*** armax has joined #openstack-meeting | 22:59 | |
*** vishalmanchanda has quit IRC | 23:05 | |
*** carloss has quit IRC | 23:17 | |
*** diablo_rojo has joined #openstack-meeting | 23:23 | |
*** hemna has quit IRC | 23:24 | |
*** brinzhang has joined #openstack-meeting | 23:49 | |
*** tobiash has quit IRC | 23:51 | |
*** tobiash has joined #openstack-meeting | 23:52 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!