| *** hongbin has quit IRC | 00:03 | |
| *** bobh has joined #openstack-meeting | 00:04 | |
| *** weshay is now known as weshay_PTO | 00:04 | |
| *** jamesmcarthur has quit IRC | 00:17 | |
| *** abelur has joined #openstack-meeting | 00:17 | |
| *** donghao has joined #openstack-meeting | 00:19 | |
| *** esberglu has quit IRC | 00:24 | |
| *** Dinesh_Bhor has joined #openstack-meeting | 00:26 | |
| *** Dinesh_Bhor has quit IRC | 00:26 | |
| *** tssurya has joined #openstack-meeting | 00:33 | |
| *** Dinesh_Bhor has joined #openstack-meeting | 00:39 | |
| *** tssurya has quit IRC | 00:42 | |
| *** Dinesh_Bhor has quit IRC | 00:43 | |
| *** Dinesh_Bhor has joined #openstack-meeting | 00:44 | |
| *** mjturek has quit IRC | 00:47 | |
| *** tovin07_ has joined #openstack-meeting | 00:51 | |
| *** jamesmcarthur has joined #openstack-meeting | 00:52 | |
| *** jamesmcarthur has quit IRC | 00:57 | |
| *** shu-mutou-AWAY has quit IRC | 01:01 | |
| *** slaweq has joined #openstack-meeting | 01:03 | |
| *** wxy has joined #openstack-meeting | 01:06 | |
| *** epico has joined #openstack-meeting | 01:06 | |
| *** gyee has quit IRC | 01:07 | |
| *** slaweq has quit IRC | 01:08 | |
| *** yangyapeng has quit IRC | 01:12 | |
| *** yangyapeng has joined #openstack-meeting | 01:12 | |
| *** pzchen has joined #openstack-meeting | 01:12 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:14 | |
| *** cloudrancher has joined #openstack-meeting | 01:18 | |
| *** andreykurilin has quit IRC | 01:20 | |
| *** armstrong has joined #openstack-meeting | 01:20 | |
| *** andreykurilin has joined #openstack-meeting | 01:21 | |
| *** mriedem has quit IRC | 01:31 | |
| *** jamesmcarthur has quit IRC | 01:33 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:34 | |
| *** lbragstad has quit IRC | 01:34 | |
| *** Swami has quit IRC | 01:37 | |
| *** yamahata has quit IRC | 01:37 | |
| *** jamesmcarthur has quit IRC | 01:38 | |
| *** dangtrinhnt1 has left #openstack-meeting | 01:43 | |
| *** yangyapeng has quit IRC | 01:53 | |
| *** yangyapeng has joined #openstack-meeting | 01:54 | |
| *** bobh has quit IRC | 01:54 | |
| *** kiennt26 has joined #openstack-meeting | 01:57 | |
| *** rossella_s has joined #openstack-meeting | 01:57 | |
| *** dangtrinhnt has joined #openstack-meeting | 01:58 | |
| *** diablo_rojo has quit IRC | 02:03 | |
| *** kaisers__ has joined #openstack-meeting | 02:04 | |
| *** kaisers_ has quit IRC | 02:08 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:09 | |
| *** Sukhdev has quit IRC | 02:10 | |
| *** shu-mutou has joined #openstack-meeting | 02:13 | |
| *** fzdarsky_ has joined #openstack-meeting | 02:14 | |
| *** salv-orl_ has joined #openstack-meeting | 02:16 | |
| *** fzdarsky has quit IRC | 02:18 | |
| *** salv-orlando has quit IRC | 02:19 | |
| *** kevzha01_ has joined #openstack-meeting | 02:24 | |
| *** kevzha01 has joined #openstack-meeting | 02:24 | |
| *** kevzha01_ is now known as kevinz | 02:24 | |
| *** kevzha01 has quit IRC | 02:25 | |
| *** yamahata has joined #openstack-meeting | 02:26 | |
| *** bkopilov has quit IRC | 02:34 | |
| *** SerenaFeng has joined #openstack-meeting | 02:35 | |
| *** links has joined #openstack-meeting | 02:35 | |
| *** hongbin has joined #openstack-meeting | 02:38 | |
| *** jamesmcarthur has quit IRC | 02:39 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:40 | |
| *** fnaval has joined #openstack-meeting | 02:41 | |
| *** jamesmcarthur has quit IRC | 02:47 | |
| *** ricolin has joined #openstack-meeting | 02:52 | |
| *** wanghao_ has quit IRC | 02:55 | |
| *** wanghao has joined #openstack-meeting | 02:55 | |
| *** tovin07_ has quit IRC | 02:56 | |
| *** Chargen has joined #openstack-meeting | 02:56 | |
| *** felipemonteiro has joined #openstack-meeting | 02:59 | |
| *** felipemonteiro_ has joined #openstack-meeting | 03:00 | |
| *** felipemonteiro has quit IRC | 03:04 | |
| *** harlowja has quit IRC | 03:04 | |
| *** VW has joined #openstack-meeting | 03:07 | |
| *** VW has quit IRC | 03:08 | |
| *** VW has joined #openstack-meeting | 03:09 | |
| *** epico has quit IRC | 03:11 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:18 | |
| *** felipemonteiro_ has quit IRC | 03:18 | |
| *** felipemonteiro__ has joined #openstack-meeting | 03:18 | |
| *** SerenaFeng has quit IRC | 03:21 | |
| *** jamesmcarthur has quit IRC | 03:23 | |
| *** felipemonteiro__ has quit IRC | 03:26 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:27 | |
| *** yangyapeng has quit IRC | 03:28 | |
| *** yangyapeng has joined #openstack-meeting | 03:29 | |
| *** Tom-Tom has joined #openstack-meeting | 03:29 | |
| *** jamesmcarthur has quit IRC | 03:30 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:31 | |
| *** ekcs has quit IRC | 03:31 | |
| *** Chargen has quit IRC | 03:33 | |
| *** yangyapeng has quit IRC | 03:33 | |
| *** nsingh has joined #openstack-meeting | 03:35 | |
| *** jamesmcarthur has quit IRC | 03:36 | |
| *** brault has quit IRC | 03:39 | |
| *** sapd has quit IRC | 03:42 | |
| *** brault has joined #openstack-meeting | 03:45 | |
| *** epico has joined #openstack-meeting | 03:46 | |
| *** samNTT has joined #openstack-meeting | 03:48 | |
| *** bkopilov has joined #openstack-meeting | 03:49 | |
| *** lbragstad has joined #openstack-meeting | 03:54 | |
| *** epico has quit IRC | 03:55 | |
| *** sagara has joined #openstack-meeting | 03:59 | |
| *** ttsiouts_ has joined #openstack-meeting | 03:59 | |
| *** armstrong has quit IRC | 03:59 | |
| samNTT | #startmeeting masakari | 04:00 |
|---|---|---|
| openstack | Meeting started Tue Feb 13 04:00:07 2018 UTC and is due to finish in 60 minutes. The chair is samNTT. Information about MeetBot at http://wiki.debian.org/MeetBot. | 04:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 04:00 |
| *** openstack changes topic to " (Meeting topic: masakari)" | 04:00 | |
| openstack | The meeting name has been set to 'masakari' | 04:00 |
| samNTT | Hi all for masakari | 04:00 |
| sagara | hi | 04:00 |
| nsingh | hi all | 04:00 |
| Dinesh_Bhor | Hi all | 04:00 |
| samNTT | Hi all | 04:00 |
| samNTT | let's start | 04:00 |
| samNTT | #topic Queens Release | 04:00 |
| *** openstack changes topic to "Queens Release (Meeting topic: masakari)" | 04:00 | |
| *** tpatil has joined #openstack-meeting | 04:01 | |
| *** epico has joined #openstack-meeting | 04:01 | |
| tpatil | Hi All | 04:01 |
| samNTT | As we discussed last week, I will create stable/queens for masakari-monitors and python-masakariclient today | 04:01 |
| samNTT | tpatil: Hi | 04:02 |
| samNTT | Though, we have to resolve one issue, #link https://review.openstack.org/#/c/542683/ | 04:02 |
| tpatil | The above issue should be fixed in queens or rocky release? | 04:03 |
| samNTT | tpatil: For queens, openstacksdk>=0.9.19 and upper openstacksdk===0.11.3 | 04:04 |
| *** links has quit IRC | 04:05 | |
| samNTT | tpatil: as you all pointed out in the review | 04:05 |
| samNTT | with current code, UT should fail if openstacksdk>=0.10.0 | 04:06 |
| tpatil | But then we will need to wait until global requirements bumps openstacksdk>=0.10.0 | 04:06 |
| samNTT | tpatil: correct | 04:07 |
| sagara | samNTT: I think we can support both version openstacksdk>=0.9.19 and >=0.10.0 with modifying masakarimonitors/ha/masakari.py. | 04:07 |
| *** ijw has quit IRC | 04:07 | |
| samNTT | sagara: That can be done | 04:07 |
| tpatil | Does OpenStack community is in favor of bumping openstacksdk to 0.10.0 in queens? | 04:07 |
| *** dtrainor has quit IRC | 04:07 | |
| samNTT | tpatil: I think not for queens | 04:08 |
| samNTT | tpatil: as you mentioned in the review, #link https://review.openstack.org/#/c/540343/1 | 04:08 |
| samNTT | Monty proposed it, but it seems not gonna happen | 04:09 |
| tpatil | ok, so basically we need to add exception handling code (AttributeError) to support both versions | 04:10 |
| Dinesh_Bhor | I agree with sagara san. | 04:10 |
| samNTT | tpatil: sure, agree. | 04:10 |
| samNTT | support both versions is the best possible solution at this time. | 04:11 |
| tpatil | the same problem must be existing in other projects too, does anyone know how the other projects are addressing this issue? | 04:11 |
| samNTT | seems that swift using http_status, but I think they are not using requirement updates | 04:12 |
| *** ekcs has joined #openstack-meeting | 04:14 | |
| Dinesh_Bhor | #link https://review.openstack.org/#/c/540315/3 | 04:15 |
| samNTT | and trove, ironic, zaqur | 04:16 |
| tpatil | Dinesh_Bhor: Even though the above patch is merged , it will fail if openstacksdk installed version is 0.9.19 | 04:17 |
| Dinesh_Bhor | exactly | 04:17 |
| Dinesh_Bhor | I think they haven't noticed the openstacksdk>=0.9.19 issue | 04:17 |
| samNTT | you will not hit http_status error, if you are not deliberately test against <=0.9.19 | 04:19 |
| samNTT | Any way, I will check with other projects and update the patch work for both versions | 04:21 |
| Dinesh_Bhor | samNTT: okay | 04:21 |
| samNTT | If you find anything, please share. | 04:21 |
| Dinesh_Bhor | sure | 04:22 |
| tpatil | samNTT: Ok | 04:22 |
| samNTT | Once we done with this, I will cut off stable/queens. | 04:22 |
| *** links has joined #openstack-meeting | 04:24 | |
| samNTT | For openstack/masakari, initial proposal was to create stable/queens on 2/23. | 04:24 |
| samNTT | However, thinking about the release schedule of other projects, 2/23 seems bit late. | 04:25 |
| tpatil | #link https://bugs.launchpad.net/masakari/+bug/1746229 | 04:26 |
| openstack | Launchpad bug 1746229 in masakari "masakari-engine recovery looking for URL endpoint for service_name='Compute Service' instead of 'nova'" [Undecided,New] - Assigned to Louie Kwan (lkwan) | 04:26 |
| tpatil | Do you think this bug is critical? | 04:27 |
| tpatil | I think masakari engine doesn't handle reload of config files correctly | 04:27 |
| tpatil | I haven't yet reproduced this bug though | 04:27 |
| tpatil | This issue was discussed in this ML thread http://lists.openstack.org/pipermail/openstack-dev/2018-January/126552.html | 04:30 |
| samNTT | tpatil: I think we must fix it. my impression was need more survey on this | 04:30 |
| tpatil | Ok, We will reproduce this bug | 04:31 |
| Dinesh_Bhor | If operator sets 'nova_catalog_admin_info' correctly then there will be no issue. | 04:31 |
| *** kiennt26 has quit IRC | 04:32 | |
| tpatil | Dinesh_Bhor: so I think it's not critical. Maybe some issue with handling reloading of config files | 04:32 |
| Dinesh_Bhor | tpatil: yes, agree. I will check this. But definitely the default value of this config option needs to be changed. | 04:33 |
| *** SerenaFeng has joined #openstack-meeting | 04:33 | |
| samNTT | Dinesh_Bhor: tpatil: understood. | 04:34 |
| tpatil | is there any common place where we can see the default service_name of all projects similar to service_type | 04:34 |
| *** donghao has quit IRC | 04:34 | |
| samNTT | tpatil: Why would you say "problem with config reload"? | 04:34 |
| *** abhishekk has joined #openstack-meeting | 04:34 | |
| Dinesh_Bhor | samNTT: Greg said in his email that after also he changed the config option value he was not able to resolve the issue. | 04:35 |
| tpatil | samNTT: Becoz if you change the nova_catalog_admin_info config option in masakari.conf and restart the masakari-engine, it doesn't refer to the latest service name | 04:35 |
| samNTT | tpatil: Dinesh_Bhor: gotit.. | 04:36 |
| *** psachin has joined #openstack-meeting | 04:37 | |
| *** lpetrut has joined #openstack-meeting | 04:37 | |
| *** SerenaFeng has quit IRC | 04:38 | |
| *** pzchen has quit IRC | 04:39 | |
| samNTT | tpatil: Dinesh_Bhor: Could you please find more about this bug and let me know what can be done in queens to fix this issue? | 04:40 |
| tpatil | samNTT: Sure | 04:41 |
| Dinesh_Bhor | yes | 04:41 |
| samNTT | Adding the correct default would fix this temporary and I would like to know how critical is the "config reload" issue | 04:42 |
| samNTT | tpatil: Dinesh_Bhor; thank you.. | 04:43 |
| samNTT | I think I'm still in release topic | 04:43 |
| tpatil | samNTT: how critical this bug is: it depends on how often you change the config file and want to reload instead of stop/start | 04:43 |
| tpatil | samNTT: Will reproduce this bug and let you know if this is a easy fix or not | 04:44 |
| *** yamamoto has joined #openstack-meeting | 04:44 | |
| samNTT | tpatil: exactly :).. I meant to say is this effect all config options or part of it. | 04:45 |
| samNTT | #topic Critical Bugs/Patches | 04:45 |
| *** openstack changes topic to "Critical Bugs/Patches (Meeting topic: masakari)" | 04:45 | |
| tpatil | samNTT: Will find out the required info | 04:45 |
| samNTT | Any critical issues apart from discussed above | 04:46 |
| samNTT | tpatil: thanks | 04:46 |
| Dinesh_Bhor | I think this needs attention: https://review.openstack.org/#/c/531310/3 | 04:46 |
| tpatil | Dinesh_Bhor: I will review this patch today | 04:48 |
| Dinesh_Bhor | okay | 04:48 |
| samNTT | Dinesh_Bhor: thanks for the info, I will review this too | 04:49 |
| nsingh | ui-cookiecutter patch is pending for review. | 04:50 |
| nsingh | https://review.openstack.org/#/c/528647/ | 04:50 |
| tpatil | samNTT: In queens cycle, you have no plan to include masakari-dashboard, correct? | 04:51 |
| samNTT | tpatil: correct | 04:51 |
| samNTT | The reason is, we only have cookiecutter code in there. | 04:52 |
| tpatil | samNTT: Ok, Niraj is ready with the patches for adding failover segment and hosts in masakari-dashboard. he will propose these patches soon for the community review. Let's review this patch and merge it for Rocky relese | 04:53 |
| samNTT | tpatil: sure, sounds good. | 04:53 |
| nsingh | yes | 04:53 |
| samNTT | Let's review and merge #528647 | 04:54 |
| samNTT | nsingh: Thanks for the great work..! | 04:54 |
| nsingh | samNTT: thank you :) | 04:54 |
| samNTT | Any other issues to discuss? | 04:55 |
| samNTT | nsingh: NP | 04:55 |
| samNTT | Last 5 mins of the meeting | 04:55 |
| samNTT | #topic AOB | 04:55 |
| *** openstack changes topic to "AOB (Meeting topic: masakari)" | 04:55 | |
| samNTT | I will cut the stable/queens for projects as we discussed above. | 04:56 |
| samNTT | Please let me know if you would like to backport any patches after we create queens branch | 04:56 |
| *** kevinz has quit IRC | 04:57 | |
| tpatil | samNTT: Sure | 04:57 |
| samNTT | For further discussion, please use IRC #openstack-masakari or openstack-dev ML with [masakari] | 04:57 |
| samNTT | Let's finish today's meeting. | 04:58 |
| samNTT | Thank you all | 04:58 |
| sagara | thanks all, bye | 04:58 |
| samNTT | BYE | 04:58 |
| samNTT | #endmeeting | 04:58 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 04:58 | |
| openstack | Meeting ended Tue Feb 13 04:58:40 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 04:58 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-02-13-04.00.html | 04:58 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-02-13-04.00.txt | 04:58 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-02-13-04.00.log.html | 04:58 |
| *** samNTT has left #openstack-meeting | 04:58 | |
| *** sagara has quit IRC | 05:00 | |
| *** VW has quit IRC | 05:02 | |
| *** VW has joined #openstack-meeting | 05:02 | |
| *** tpatil has quit IRC | 05:03 | |
| *** slaweq has joined #openstack-meeting | 05:05 | |
| *** lpetrut has quit IRC | 05:05 | |
| *** VW has quit IRC | 05:08 | |
| *** VW has joined #openstack-meeting | 05:08 | |
| *** abhishekk has left #openstack-meeting | 05:08 | |
| *** VW has quit IRC | 05:08 | |
| *** VW has joined #openstack-meeting | 05:09 | |
| *** VW has quit IRC | 05:09 | |
| *** ricolin has quit IRC | 05:09 | |
| *** VW has joined #openstack-meeting | 05:09 | |
| *** VW has quit IRC | 05:10 | |
| *** slaweq has quit IRC | 05:10 | |
| *** VW has joined #openstack-meeting | 05:10 | |
| *** VW has quit IRC | 05:11 | |
| *** VW has joined #openstack-meeting | 05:11 | |
| *** lpetrut has joined #openstack-meeting | 05:11 | |
| *** Leo_m has quit IRC | 05:11 | |
| *** Leo_m has joined #openstack-meeting | 05:15 | |
| *** VW has quit IRC | 05:15 | |
| *** Tom-Tom_ has joined #openstack-meeting | 05:18 | |
| *** ttsiouts_ has quit IRC | 05:19 | |
| *** Tom-Tom has quit IRC | 05:21 | |
| *** claudiub has joined #openstack-meeting | 05:23 | |
| *** lpetrut has quit IRC | 05:29 | |
| *** hongbin has quit IRC | 05:37 | |
| *** VW has joined #openstack-meeting | 05:42 | |
| *** janki has joined #openstack-meeting | 05:43 | |
| *** VW has quit IRC | 05:47 | |
| *** harlowja has joined #openstack-meeting | 05:52 | |
| *** VW has joined #openstack-meeting | 05:55 | |
| *** sridharg has joined #openstack-meeting | 05:59 | |
| *** VW has quit IRC | 06:00 | |
| *** slaweq has joined #openstack-meeting | 06:01 | |
| *** slaweq has quit IRC | 06:02 | |
| *** nsingh has left #openstack-meeting | 06:06 | |
| *** pzchen has joined #openstack-meeting | 06:07 | |
| *** kiennt26 has joined #openstack-meeting | 06:13 | |
| *** aeng has quit IRC | 06:16 | |
| *** VW has joined #openstack-meeting | 06:26 | |
| *** VW has quit IRC | 06:31 | |
| *** harlowja has quit IRC | 06:33 | |
| *** yamamoto has quit IRC | 06:41 | |
| *** yamamoto has joined #openstack-meeting | 06:43 | |
| *** dtrainor has joined #openstack-meeting | 06:48 | |
| *** shu-mutou is now known as shu-mutou-AWAY | 06:49 | |
| *** yamamoto has quit IRC | 06:50 | |
| *** rbartal has joined #openstack-meeting | 06:50 | |
| *** yamamoto has joined #openstack-meeting | 06:55 | |
| *** marios has joined #openstack-meeting | 06:57 | |
| *** VW has joined #openstack-meeting | 07:00 | |
| *** lbragstad has quit IRC | 07:01 | |
| *** jamesmcarthur has joined #openstack-meeting | 07:03 | |
| *** VW has quit IRC | 07:05 | |
| *** jamesmcarthur has quit IRC | 07:07 | |
| *** lpetrut has joined #openstack-meeting | 07:15 | |
| *** _alastor__ has quit IRC | 07:16 | |
| *** Dinesh_Bhor has quit IRC | 07:21 | |
| *** numans_ has joined #openstack-meeting | 07:24 | |
| *** rcernin has quit IRC | 07:25 | |
| *** Dinesh_Bhor has joined #openstack-meeting | 07:25 | |
| *** numans has quit IRC | 07:28 | |
| *** armax has quit IRC | 07:30 | |
| *** VW has joined #openstack-meeting | 07:32 | |
| *** armax has joined #openstack-meeting | 07:33 | |
| *** numans_ has quit IRC | 07:35 | |
| *** VW has quit IRC | 07:36 | |
| *** Dinesh_Bhor has quit IRC | 07:37 | |
| *** Dinesh_Bhor has joined #openstack-meeting | 07:38 | |
| *** rbartal has quit IRC | 07:38 | |
| *** numans has joined #openstack-meeting | 07:40 | |
| *** pcaruana has joined #openstack-meeting | 07:41 | |
| *** alexchadin has joined #openstack-meeting | 07:44 | |
| *** Dinesh_Bhor has quit IRC | 07:45 | |
| *** Dinesh_Bhor has joined #openstack-meeting | 07:49 | |
| *** slaweq has joined #openstack-meeting | 07:49 | |
| *** d0ugal has quit IRC | 07:52 | |
| *** apetrich has quit IRC | 07:55 | |
| *** [HeOS] has quit IRC | 07:56 | |
| *** apetrich has joined #openstack-meeting | 07:56 | |
| *** HeOS has joined #openstack-meeting | 08:00 | |
| *** e0ne has joined #openstack-meeting | 08:02 | |
| *** d0ugal has joined #openstack-meeting | 08:02 | |
| *** phil has joined #openstack-meeting | 08:03 | |
| *** phil is now known as Guest13990 | 08:03 | |
| *** slaweq_ has joined #openstack-meeting | 08:03 | |
| *** Dinesh_Bhor has quit IRC | 08:04 | |
| *** VW has joined #openstack-meeting | 08:07 | |
| *** slaweq_ has quit IRC | 08:08 | |
| *** Dinesh_Bhor has joined #openstack-meeting | 08:08 | |
| *** Dinesh_Bhor has quit IRC | 08:09 | |
| *** numans_ has joined #openstack-meeting | 08:10 | |
| *** VW has quit IRC | 08:12 | |
| *** numans has quit IRC | 08:13 | |
| *** numans_ has quit IRC | 08:15 | |
| *** Dinesh_Bhor has joined #openstack-meeting | 08:20 | |
| *** yamahata has quit IRC | 08:23 | |
| *** rbartal has joined #openstack-meeting | 08:25 | |
| *** oidgar has joined #openstack-meeting | 08:26 | |
| *** tesseract has joined #openstack-meeting | 08:26 | |
| *** tssurya has joined #openstack-meeting | 08:28 | |
| *** fzdarsky_ has quit IRC | 08:34 | |
| *** yamamoto has quit IRC | 08:35 | |
| *** longkb has quit IRC | 08:36 | |
| *** longkb has joined #openstack-meeting | 08:36 | |
| *** peterlisak has joined #openstack-meeting | 08:37 | |
| *** Alex_Staf has joined #openstack-meeting | 08:37 | |
| *** armax has quit IRC | 08:38 | |
| *** yamamoto has joined #openstack-meeting | 08:39 | |
| *** onovy has joined #openstack-meeting | 08:40 | |
| *** VW has joined #openstack-meeting | 08:44 | |
| *** pzchen has quit IRC | 08:44 | |
| *** pzchen has joined #openstack-meeting | 08:45 | |
| *** VW has quit IRC | 08:49 | |
| *** pzchen has quit IRC | 08:51 | |
| *** ttsiouts has quit IRC | 08:54 | |
| *** ttsiouts has joined #openstack-meeting | 08:54 | |
| *** slaweq_ has joined #openstack-meeting | 08:55 | |
| *** rossella_s has quit IRC | 08:55 | |
| *** rossella_s has joined #openstack-meeting | 08:56 | |
| *** pzchen has joined #openstack-meeting | 08:59 | |
| *** priteau has joined #openstack-meeting | 08:59 | |
| *** slaweq_ has quit IRC | 08:59 | |
| *** rossella_s has quit IRC | 09:03 | |
| *** rossella_s has joined #openstack-meeting | 09:07 | |
| *** ricolin has joined #openstack-meeting | 09:12 | |
| *** kopecmartin has joined #openstack-meeting | 09:15 | |
| *** Tom-Tom_ has quit IRC | 09:15 | |
| *** Tom-Tom has joined #openstack-meeting | 09:15 | |
| *** Tom-Tom has quit IRC | 09:20 | |
| *** VW has joined #openstack-meeting | 09:20 | |
| *** VW has quit IRC | 09:25 | |
| *** slaweq_ has joined #openstack-meeting | 09:36 | |
| *** Dinesh_Bhor has quit IRC | 09:37 | |
| *** slaweq_ has quit IRC | 09:41 | |
| *** wanghao has quit IRC | 09:42 | |
| *** anilvenkata has joined #openstack-meeting | 09:45 | |
| *** numans has joined #openstack-meeting | 09:50 | |
| *** VW has joined #openstack-meeting | 09:51 | |
| *** VW has quit IRC | 09:55 | |
| *** yamamoto has quit IRC | 09:58 | |
| *** kiennt26 has quit IRC | 09:59 | |
| *** epico has quit IRC | 10:05 | |
| *** qwebirc30643 has joined #openstack-meeting | 10:08 | |
| qwebirc30643 | hi, need help for senlin Getting the error ERROR: Property error: : resources.profile.properties.type: : Could not find requested endpoint in Service Catalog. | 10:09 |
| *** electrofelix has joined #openstack-meeting | 10:09 | |
| *** pzchen has quit IRC | 10:09 | |
| *** yamamoto has joined #openstack-meeting | 10:15 | |
| *** priteau has quit IRC | 10:17 | |
| *** cdub has joined #openstack-meeting | 10:18 | |
| *** VW has joined #openstack-meeting | 10:21 | |
| *** yamamoto has quit IRC | 10:22 | |
| *** VW has quit IRC | 10:25 | |
| *** alexchadin has quit IRC | 10:28 | |
| *** alexchadin has joined #openstack-meeting | 10:29 | |
| *** manikanta_tadi has joined #openstack-meeting | 10:31 | |
| *** alexchadin has quit IRC | 10:32 | |
| *** links has quit IRC | 10:36 | |
| *** alexchadin has joined #openstack-meeting | 10:38 | |
| *** SerenaFeng has joined #openstack-meeting | 10:39 | |
| *** alexchadin has quit IRC | 10:41 | |
| *** SerenaFeng has quit IRC | 10:43 | |
| *** links has joined #openstack-meeting | 10:49 | |
| *** VW has joined #openstack-meeting | 10:50 | |
| *** VW has quit IRC | 10:55 | |
| *** ricolin has quit IRC | 10:56 | |
| *** alexchadin has joined #openstack-meeting | 11:00 | |
| *** alexchadin has quit IRC | 11:01 | |
| *** jamesmcarthur has joined #openstack-meeting | 11:04 | |
| *** rfolco|off is now known as rfolco|rover | 11:06 | |
| *** jamesmcarthur has quit IRC | 11:08 | |
| *** yamamoto has joined #openstack-meeting | 11:13 | |
| *** bkopilov has quit IRC | 11:19 | |
| *** VW has joined #openstack-meeting | 11:26 | |
| *** zhongjun has quit IRC | 11:30 | |
| *** zhongjun has joined #openstack-meeting | 11:30 | |
| *** _liusheng has quit IRC | 11:31 | |
| *** VW has quit IRC | 11:31 | |
| *** _liusheng has joined #openstack-meeting | 11:31 | |
| *** larainema has quit IRC | 11:31 | |
| *** larainema has joined #openstack-meeting | 11:32 | |
| *** alexchadin has joined #openstack-meeting | 11:36 | |
| *** qwebirc30643 has left #openstack-meeting | 11:39 | |
| *** tomhambleton_ has quit IRC | 11:43 | |
| *** tomhambleton_ has joined #openstack-meeting | 11:43 | |
| *** jamesmcarthur has joined #openstack-meeting | 11:45 | |
| *** jamesmcarthur has quit IRC | 11:50 | |
| *** mwhahaha has quit IRC | 11:51 | |
| *** mwhahaha has joined #openstack-meeting | 11:52 | |
| *** portdirect has quit IRC | 12:03 | |
| *** portdirect has joined #openstack-meeting | 12:04 | |
| *** Dmitrii-Sh has quit IRC | 12:04 | |
| *** Dmitrii-Sh has joined #openstack-meeting | 12:05 | |
| *** VW has joined #openstack-meeting | 12:06 | |
| *** alexchadin has quit IRC | 12:06 | |
| *** alexchadin has joined #openstack-meeting | 12:06 | |
| *** guyr-infinidat has quit IRC | 12:10 | |
| *** guyr-infinidat has joined #openstack-meeting | 12:10 | |
| *** jbryce has quit IRC | 12:11 | |
| *** VW has quit IRC | 12:11 | |
| *** jbryce has joined #openstack-meeting | 12:11 | |
| *** anilvenkata has quit IRC | 12:13 | |
| *** rbartal has quit IRC | 12:26 | |
| *** Tom-Tom has joined #openstack-meeting | 12:28 | |
| *** rbartal has joined #openstack-meeting | 12:40 | |
| *** liusheng has quit IRC | 12:42 | |
| *** VW has joined #openstack-meeting | 12:42 | |
| *** liusheng has joined #openstack-meeting | 12:42 | |
| *** ianychoi_ has joined #openstack-meeting | 12:42 | |
| *** ykatabam has quit IRC | 12:43 | |
| *** Tom-Tom has quit IRC | 12:45 | |
| *** bkopilov has joined #openstack-meeting | 12:46 | |
| *** ianychoi has quit IRC | 12:46 | |
| *** dmacpher has quit IRC | 12:47 | |
| *** dmacpher has joined #openstack-meeting | 12:47 | |
| *** VW has quit IRC | 12:51 | |
| *** edmondsw has joined #openstack-meeting | 12:56 | |
| *** sambetts|afk is now known as sambetts | 12:57 | |
| Qiming | Hi, qwebirc30643, you may want to stop by the #senlin channel | 12:57 |
| *** rbartal has quit IRC | 12:58 | |
| *** cdub has quit IRC | 12:59 | |
| *** slaweq_ has joined #openstack-meeting | 13:01 | |
| *** slaweq_ has quit IRC | 13:05 | |
| *** rbowen has joined #openstack-meeting | 13:07 | |
| *** pchavva has joined #openstack-meeting | 13:14 | |
| *** eharney has quit IRC | 13:14 | |
| *** rbartal has joined #openstack-meeting | 13:15 | |
| *** jaypipes has joined #openstack-meeting | 13:15 | |
| *** pcaruana has quit IRC | 13:16 | |
| *** lbragstad has joined #openstack-meeting | 13:21 | |
| *** cdub has joined #openstack-meeting | 13:22 | |
| *** Tom-Tom has joined #openstack-meeting | 13:24 | |
| *** Tom-Tom has quit IRC | 13:26 | |
| *** dprince has joined #openstack-meeting | 13:27 | |
| *** janki has quit IRC | 13:32 | |
| *** oanson has quit IRC | 13:33 | |
| *** kaisers__ has quit IRC | 13:34 | |
| *** oanson has joined #openstack-meeting | 13:35 | |
| *** larainema has quit IRC | 13:41 | |
| *** yamamoto has quit IRC | 13:41 | |
| *** dprince has quit IRC | 13:43 | |
| *** kaisers_ has joined #openstack-meeting | 13:44 | |
| *** slaweq_ has joined #openstack-meeting | 13:45 | |
| *** alexchadin has quit IRC | 13:45 | |
| *** mriedem has joined #openstack-meeting | 13:46 | |
| *** alexchadin has joined #openstack-meeting | 13:46 | |
| *** ianychoi_ has quit IRC | 13:48 | |
| *** ianychoi_ has joined #openstack-meeting | 13:49 | |
| *** kaisers_ has quit IRC | 13:49 | |
| *** slaweq_ has quit IRC | 13:50 | |
| *** janzian has joined #openstack-meeting | 13:51 | |
| *** dustins has joined #openstack-meeting | 13:54 | |
| *** kaisers_ has joined #openstack-meeting | 13:55 | |
| *** jlibosva has joined #openstack-meeting | 13:57 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:58 | |
| *** esberglu has joined #openstack-meeting | 13:58 | |
| *** boden has joined #openstack-meeting | 13:59 | |
| *** jamesmcarthur has quit IRC | 13:59 | |
| *** jamesmca_ has joined #openstack-meeting | 13:59 | |
| *** kaisers_ has quit IRC | 13:59 | |
| *** dprince has joined #openstack-meeting | 14:00 | |
| jlibosva | #startmeeting networking | 14:00 |
| openstack | Meeting started Tue Feb 13 14:00:03 2018 UTC and is due to finish in 60 minutes. The chair is jlibosva. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| *** openstack changes topic to " (Meeting topic: networking)" | 14:00 | |
| jlibosva | Hi everybody :) | 14:00 |
| openstack | The meeting name has been set to 'networking' | 14:00 |
| slaweq | hi | 14:00 |
| *** jamesmca_ has quit IRC | 14:00 | |
| jlibosva | #topic Announcements | 14:00 |
| *** openstack changes topic to "Announcements (Meeting topic: networking)" | 14:00 | |
| *** jamesmcarthur has joined #openstack-meeting | 14:00 | |
| jlibosva | The rc1 has been cut and as far as I understand the master branch is the Rocky branch now | 14:00 |
| *** mlavalle has joined #openstack-meeting | 14:01 | |
| jlibosva | Which means only critical fixes need to go to queens at this stage | 14:01 |
| mlavalle | o/ | 14:01 |
| jlibosva | and the release week is at the week of Feb 26 | 14:01 |
| jlibosva | mlavalle: hi, I just updated that we cut rc1 and master is Rocky now. Is that correct? :) | 14:01 |
| *** eharney has joined #openstack-meeting | 14:01 | |
| *** alexchadin has quit IRC | 14:02 | |
| mlavalle | as always, you are correct :-) | 14:02 |
| jlibosva | thanks for confirmation :) | 14:02 |
| jlibosva | next announcement is that at the same week, the PTG is happening in Dublin | 14:03 |
| jlibosva | if you have a topic you want to discuss there, please put it to the etherpad | 14:03 |
| jlibosva | #link https://etherpad.openstack.org/p/neutron-ptg-rocky | 14:03 |
| mlavalle | I started arranging the topics by day and hour yesterday | 14:03 |
| jlibosva | that's all from me :) | 14:03 |
| mlavalle | as I assign sessions to days and times, please feel free to add your topic to the session that best fits it | 14:04 |
| mlavalle | if you don't find any that fits, just throw it in the general section at the top and I'll assign it | 14:05 |
| jlibosva | one note from me: I see that the list of attendees is just mlavalle :) perhaps those attending can write their names down there ;) | 14:05 |
| mlavalle | also I added yesterday a section at the very top for atendees to register your name | 14:05 |
| mlavalle | the format is: name (irc nickname) days staying in Dublin | 14:06 |
| mlavalle | please register if you are going to Dublin | 14:06 |
| mlavalle | the reason is that we are going to have a social event on Thursday | 14:06 |
| *** mrmartin has quit IRC | 14:07 | |
| mlavalle | so I want to have an accurate head count to make a reservation for the group dinner | 14:07 |
| mlavalle | IO'll send a message to the ML later today | 14:07 |
| *** mrmartin has joined #openstack-meeting | 14:07 | |
| mlavalle | that's it | 14:07 |
| jlibosva | thanks :) | 14:07 |
| jlibosva | does anybody have any other announcement? | 14:07 |
| jlibosva | ok, moving on | 14:08 |
| jlibosva | #topic Blueprints | 14:08 |
| *** openstack changes topic to "Blueprints (Meeting topic: networking)" | 14:08 | |
| jlibosva | I'm looking at the LP: https://launchpad.net/neutron/+milestone/queens-rc1 | 14:08 |
| jlibosva | looks like there are no blueprints that made it to rc, that's good | 14:09 |
| jlibosva | does anybody have anything to add regarding blueprints here? | 14:09 |
| mlavalle | there is a bug related to ovsfw | 14:09 |
| mlavalle | that slaweq was working on | 14:10 |
| mlavalle | and we wanted jlibosva's opinion on the patch | 14:10 |
| slaweq | mlavalle: I think it is merged already | 14:10 |
| mlavalle | did you have a chance to look at it? | 14:10 |
| jlibosva | mlavalle: https://review.openstack.org/#/c/542257/ ? | 14:10 |
| slaweq | jlibosva approved :) | 14:10 |
| jlibosva | #topic Bugs | 14:10 |
| *** openstack changes topic to "Bugs (Meeting topic: networking)" | 14:10 | |
| mlavalle | ah perfect | 14:10 |
| jlibosva | since we're already talking about the bugs :) | 14:10 |
| jlibosva | thanks slaweq for the patch! | 14:11 |
| slaweq | no problem | 14:11 |
| mlavalle | we want to port it to Queens | 14:11 |
| mlavalle | and that is what is going to be our RC2 | 14:11 |
| mlavalle | so far | 14:11 |
| slaweq | I hope that together with https://review.openstack.org/#/c/542596/ it will make tempest tests green | 14:11 |
| slaweq | mlavalle: I will do cherry-picks today | 14:12 |
| jlibosva | mlavalle: good point, it's a clean cherry-pick https://review.openstack.org/#/c/543944/ | 14:12 |
| jlibosva | slaweq: oh, sorry, I just tried to click the button and it worked :) | 14:12 |
| slaweq | jlibosva: thx | 14:12 |
| slaweq | :) | 14:12 |
| boden | hi I was on bug duty last week, but I have to step away in 1 min for a short bit… the only critical bug I saw come in was https://bugs.launchpad.net/neutron/+bug/1748546 which you just discussed | 14:12 |
| openstack | Launchpad bug 1748546 in neutron "ovsfw tempest tests random fails" [High,Fix committed] - Assigned to Slawek Kaplonski (slaweq) | 14:12 |
| mlavalle | cool | 14:12 |
| slaweq | I think that https://review.openstack.org/#/c/542596/ should be also cherry-picked | 14:12 |
| jlibosva | yep | 14:13 |
| mlavalle | boden: yeah, that's the fix we are talking about. Thanks ! | 14:13 |
| boden | however I see some bugs came in over the past few days so someone prob needs to take a pass through the new ones | 14:13 |
| jlibosva | I also see there is also one bug scheduled to rc: https://bugs.launchpad.net/neutron/+bug/1713499 | 14:13 |
| openstack | Launchpad bug 1713499 in neutron "Cannot delete a neutron network, if the currently configured MTU is lower than the network's MTU" [High,In progress] - Assigned to Reedip (reedip-banerjee) | 14:13 |
| mlavalle | that one we decided last week that we are going to merge it early in Rocky | 14:14 |
| mlavalle | actually I am taking it over to make sure we fix it | 14:14 |
| jlibosva | mlavalle: ack. do you know who can create a rocky milestone at the Launchpad? | 14:14 |
| mlavalle | and then we will backport it to Queens | 14:15 |
| mlavalle | jlibosva: I'll take care of that today | 14:15 |
| *** coolsvap has joined #openstack-meeting | 14:15 | |
| *** mjturek has joined #openstack-meeting | 14:15 | |
| jlibosva | thanks, I added queens-backport-potential tag to it | 14:15 |
| mlavalle | perfect | 14:15 |
| *** amito has quit IRC | 14:16 | |
| mlavalle | I will send an email announcing it later today as well | 14:16 |
| jlibosva | ok | 14:16 |
| *** amito has joined #openstack-meeting | 14:16 | |
| *** fnaval has quit IRC | 14:16 | |
| jlibosva | as boden said, we had some incoming bugs that need to be triaged, for this week bug deputy should be janzian | 14:16 |
| jlibosva | janzian: hi, are you online? | 14:16 |
| mlavalle | if he is not, I'll ping him later today | 14:17 |
| mlavalle | He is my Austin neighbor ;-) | 14:17 |
| *** kaisers_ has joined #openstack-meeting | 14:17 | |
| jlibosva | nice :) | 14:17 |
| jlibosva | thanks mlavalle | 14:17 |
| jlibosva | anything else related to bugs? | 14:17 |
| mlavalle | before we go on, I have something very important to announce | 14:18 |
| mlavalle | drum rolls....... | 14:18 |
| jlibosva | drrrrr | 14:18 |
| mlavalle | jlibosva just became a Dad | 14:18 |
| jlibosva | oh, lol | 14:18 |
| jlibosva | thanks! :D | 14:18 |
| mlavalle | so please join me in congrtulating him | 14:18 |
| slaweq | wow, congratulations!!!!! | 14:18 |
| jlibosva | mlavalle: how do you know? | 14:18 |
| mlavalle | boy or girl? | 14:18 |
| haleyb | +2 to a little neutronian | 14:18 |
| jlibosva | mlavalle: also why is it in the bugs section? :D | 14:18 |
| slaweq | LOL | 14:19 |
| jlibosva | mlavalle: it's a girl named Sara | 14:19 |
| mlavalle | mom a baby ok? | 14:19 |
| mlavalle | and baby^^^ | 14:19 |
| jlibosva | they are, thanks :) | 14:19 |
| mlavalle | haleyb pinged me and let me know | 14:19 |
| jlibosva | that said, I won't be reachable next few weeks | 14:19 |
| jlibosva | probably three | 14:19 |
| jlibosva | so I'll be back after the PTG, hopefully :) | 14:19 |
| *** jamesmcarthur has quit IRC | 14:19 | |
| jlibosva | mlavalle: thanks, that was a surprise to me you announced it :D | 14:20 |
| slaweq | have fun jlibosva :) | 14:20 |
| * haleyb buys some diaper stocks | 14:20 | |
| mlavalle | of course, go enjoy your baby | 14:20 |
| jlibosva | slaweq: thanks :) | 14:20 |
| jlibosva | ok, moving on :) | 14:20 |
| jlibosva | #topic Docs | 14:20 |
| *** openstack changes topic to "Docs (Meeting topic: networking)" | 14:20 | |
| *** yamahata has joined #openstack-meeting | 14:20 | |
| jlibosva | boden: hi, are you still here? | 14:20 |
| mlavalle | he is not | 14:21 |
| *** netapp has quit IRC | 14:21 | |
| mlavalle | he is taking kid to school | 14:21 |
| jlibosva | oh | 14:21 |
| mlavalle | 7:21am his time | 14:21 |
| mlavalle | he stepped out | 14:21 |
| *** kaisers_ has quit IRC | 14:21 | |
| mlavalle | he also pinged me on the side | 14:21 |
| jlibosva | mlavalle: using 'whois' or he is also your neighbour? :) | 14:21 |
| jlibosva | ah, ok | 14:21 |
| jlibosva | amotoki: are you still here? | 14:22 |
| mlavalle | he is my time zone neighbor | 14:22 |
| mlavalle | he is in the Denver area | 14:22 |
| slaweq | everyone is a neighbour of mlavalle :D | 14:22 |
| *** bobh has joined #openstack-meeting | 14:22 | |
| jlibosva | seems like it's too late there. does anybody have anything related to the docs? | 14:23 |
| mlavalle | just to say | 14:23 |
| mlavalle | that if you have interest in dcos and you are attending the PTG | 14:24 |
| mlavalle | there will be a docs track the first day day | 14:24 |
| mlavalle | let me confirm | 14:24 |
| mlavalle | actually, Monday and Tuesday: | 14:25 |
| mlavalle | #link https://www.openstack.org/ptg/#tab_schedule | 14:25 |
| mlavalle | that's it | 14:25 |
| jlibosva | thanks | 14:25 |
| jlibosva | jumping to the next topic | 14:26 |
| jlibosva | #topic Transition to OSC | 14:26 |
| *** openstack changes topic to "Transition to OSC (Meeting topic: networking)" | 14:26 | |
| jlibosva | with amotoki afk, does anybody have anything? | 14:26 |
| mlavalle | I don't | 14:27 |
| *** yamamoto has joined #openstack-meeting | 14:27 | |
| jlibosva | perhaps https://review.openstack.org/#/c/534085/ should land? | 14:27 |
| mlavalle | good point | 14:27 |
| mlavalle | I'll take a look at the end of the meeting | 14:27 |
| jlibosva | ok, thanks | 14:28 |
| jlibosva | moving on | 14:28 |
| jlibosva | #topic neutron-lib | 14:28 |
| *** openstack changes topic to "neutron-lib (Meeting topic: networking)" | 14:28 | |
| *** jamesmcarthur has joined #openstack-meeting | 14:28 | |
| *** jamesmcarthur has quit IRC | 14:28 | |
| *** jamesmcarthur has joined #openstack-meeting | 14:28 | |
| *** fnaval has joined #openstack-meeting | 14:28 | |
| boden | 0/ | 14:28 |
| mlavalle | hey | 14:28 |
| mlavalle | you made it back, nice | 14:28 |
| jlibosva | nice :) | 14:28 |
| jlibosva | I was just about to repeat what was said last week with the api-ref :) | 14:29 |
| jlibosva | boden: you were fast. I hope you didn't break the speed limit ;) | 14:29 |
| mlavalle | jlibosva: that shows you some skills that you need to learn now that you are a Dad | 14:29 |
| jlibosva | lol | 14:29 |
| boden | now that we are in Rocky mode, things are returning to normal.. you’ll start to see both lib and consumption patches surface again | 14:29 |
| boden | I’ve also started to “re-kick” the neutron-lib database related specs… I’ve got some PoC patches out there.. I hope we can work through some of these topics in Rocky | 14:30 |
| mlavalle | yeap, boden pinged yesterday at the first possible moment to make sure we can start merging things. Super diligent ;-) | 14:30 |
| boden | 1 last quick thing on lib | 14:31 |
| boden | garyk brought up a high-level migration path concern on the LBaaS deprecation work https://review.openstack.org/#/c/542846/ | 14:32 |
| boden | if anyone has comments please see ^ | 14:32 |
| boden | that’s it for me unless others have want to add something | 14:32 |
| mlavalle | boden: thabks for pointing that out | 14:32 |
| *** fnaval has quit IRC | 14:33 | |
| mlavalle | and I just want to highlight the two specs that boden added to the PTG etherpad | 14:33 |
| *** david-lyle has quit IRC | 14:33 | |
| mlavalle | #link https://review.openstack.org/#/c/473531 | 14:33 |
| mlavalle | #link https://review.openstack.org/#/c/509564/ | 14:34 |
| *** oidgar has quit IRC | 14:34 | |
| mlavalle | chime in if you have a chance | 14:34 |
| mlavalle | that's all from me | 14:34 |
| jlibosva | thanks folks | 14:34 |
| *** kaisers_ has joined #openstack-meeting | 14:34 | |
| jlibosva | anybody else has anything related to the lib? | 14:34 |
| jlibosva | ok, we have plenty of time today :) | 14:35 |
| jlibosva | #topic On demand agenda | 14:35 |
| *** openstack changes topic to "On demand agenda (Meeting topic: networking)" | 14:35 | |
| jlibosva | I added one topic to the wiki that slaweq and I want to discuss: https://wiki.openstack.org/wiki/Network/Meetings#On_Demand_Agenda | 14:35 |
| jlibosva | there was a ML thread earlier in Sept about typo fixing patches: http://lists.openstack.org/pipermail/openstack-dev/2017-September/122472.html | 14:36 |
| jlibosva | you can see an example of a such patch here: https://review.openstack.org/#/c/540225/ | 14:36 |
| jlibosva | I wanted to get some consensus about what to do as a core reviewer. as similar patches have some small value, I personally don't think it's worth to load CI with them and I would welcome if such patches come with multiple fixes | 14:37 |
| *** kaisers_ has quit IRC | 14:38 | |
| *** leanderthal|afk is now known as leanderthal | 14:38 | |
| jlibosva | what are your opinions? what should we be doing in these cases? just a small note that all similar patches come from the same email domain | 14:39 |
| mlavalle | I think that if the behavior is recurring, we should probably stop it | 14:39 |
| jlibosva | and it's just not Neutron | 14:39 |
| *** Alex_Staf has quit IRC | 14:39 | |
| mlavalle | specifically this group from inspur seem to be trying to game the numbers | 14:40 |
| mlavalle | so I would sugest that if we see that it becomes a recurring behavior, flag it with a -2 | 14:40 |
| mlavalle | and indicate in the comment that it is recurring behavior | 14:41 |
| jlibosva | do you think it would be healthy to provide an argument to find multiple typos? | 14:41 |
| jlibosva | like.. I don't know, 20 typos per patch or something :) | 14:41 |
| *** Tom-Tom has joined #openstack-meeting | 14:41 | |
| *** Tom-Tom has quit IRC | 14:41 | |
| slaweq | jlibosva++ | 14:41 |
| jlibosva | and in the docs as comments are not operator facing | 14:41 |
| mlavalle | jlibosva: would you propose a patch to the contributors guide with a policy proposal on this regard? | 14:42 |
| *** Tom-Tom has joined #openstack-meeting | 14:42 | |
| jlibosva | and related to that, if such patch comes, can we somehow throw it from the check queue? | 14:42 |
| jlibosva | mlavalle: yes, that's a good idea | 14:42 |
| mlavalle | that way we can discuss / refine it in gerrit | 14:42 |
| slaweq | I agree with that | 14:43 |
| * jlibosva nods | 14:43 | |
| jlibosva | thanks for help on that :) | 14:43 |
| mlavalle | that way we have a formal guideline | 14:43 |
| mlavalle | and also, when we reject patches, we can point to a policy in the comment | 14:43 |
| jlibosva | I read the whole thread on the ML but there doesn't seem to be any consensus, so we can solve it at least on a project level this way | 14:43 |
| mlavalle | yeap | 14:44 |
| jlibosva | alright, we have a next step then. does anybody have any other topic to discuss? | 14:44 |
| mlavalle | just to let the team know that this meeting | 14:44 |
| mlavalle | will be cancelled in two weeeks | 14:44 |
| mlavalle | because we will be in Dublin in the PTG | 14:45 |
| jlibosva | enjoy the PTG folks :) | 14:45 |
| mlavalle | so next Tuesday meeting will be on March 13th | 14:45 |
| *** oidgar has joined #openstack-meeting | 14:45 | |
| mlavalle | that's all I had | 14:45 |
| jlibosva | thanks | 14:46 |
| jlibosva | and thanks everyone for coming | 14:46 |
| jlibosva | #endmeeting | 14:46 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:46 | |
| openstack | Meeting ended Tue Feb 13 14:46:20 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:46 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/networking/2018/networking.2018-02-13-14.00.html | 14:46 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/networking/2018/networking.2018-02-13-14.00.txt | 14:46 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/networking/2018/networking.2018-02-13-14.00.log.html | 14:46 |
| *** boden has left #openstack-meeting | 14:46 | |
| mlavalle | jlibosva: please give Sara a welcome kiss to this World from the Neutron team | 14:46 |
| *** iyamahat has joined #openstack-meeting | 14:46 | |
| jlibosva | mlavalle: haha, I'll do :))) thanks | 14:47 |
| slaweq | thx | 14:47 |
| slaweq | bye | 14:47 |
| mlavalle | o/ | 14:47 |
| *** slaweq_ has joined #openstack-meeting | 14:47 | |
| *** kaisers_ has joined #openstack-meeting | 14:47 | |
| *** links has quit IRC | 14:47 | |
| *** fnaval has joined #openstack-meeting | 14:47 | |
| *** bbzhao has quit IRC | 14:50 | |
| *** bbzhao has joined #openstack-meeting | 14:50 | |
| *** awaugama has joined #openstack-meeting | 14:51 | |
| *** kaisers_ has quit IRC | 14:52 | |
| *** slaweq_ has quit IRC | 14:52 | |
| *** kaisers_ has joined #openstack-meeting | 14:57 | |
| *** anilvenkata has joined #openstack-meeting | 14:59 | |
| *** shintaro has joined #openstack-meeting | 15:00 | |
| *** Tom-Tom has quit IRC | 15:02 | |
| *** rossella_s has quit IRC | 15:02 | |
| *** Leo_m has quit IRC | 15:03 | |
| *** Tom-Tom_ has joined #openstack-meeting | 15:04 | |
| *** rossella_s has joined #openstack-meeting | 15:04 | |
| *** Tom-Tom__ has joined #openstack-meeting | 15:05 | |
| *** Tom-Tom_ has quit IRC | 15:08 | |
| *** Fouadben has joined #openstack-meeting | 15:08 | |
| *** Tom-Tom__ has quit IRC | 15:09 | |
| *** Fouadben has quit IRC | 15:13 | |
| *** lamt_ has joined #openstack-meeting | 15:14 | |
| *** leanderthal has left #openstack-meeting | 15:14 | |
| *** Leo_m has joined #openstack-meeting | 15:19 | |
| *** Leo_m has quit IRC | 15:22 | |
| *** Leo_m has joined #openstack-meeting | 15:22 | |
| *** Tom-Tom has joined #openstack-meeting | 15:23 | |
| *** jlibosva has quit IRC | 15:23 | |
| *** lpetrut has quit IRC | 15:24 | |
| *** eharney has quit IRC | 15:25 | |
| *** eharney has joined #openstack-meeting | 15:28 | |
| *** eharney has quit IRC | 15:28 | |
| *** eharney has joined #openstack-meeting | 15:28 | |
| *** Leo_m has quit IRC | 15:33 | |
| *** fouadben has joined #openstack-meeting | 15:33 | |
| *** armax has joined #openstack-meeting | 15:36 | |
| *** slaweq_ has joined #openstack-meeting | 15:38 | |
| *** Leo_m has joined #openstack-meeting | 15:39 | |
| *** slaweq_ has quit IRC | 15:42 | |
| *** shintaro has quit IRC | 15:46 | |
| *** Tom-Tom_ has joined #openstack-meeting | 15:50 | |
| *** gagehugo has joined #openstack-meeting | 15:51 | |
| *** Tom-Tom has quit IRC | 15:53 | |
| *** david-lyle has joined #openstack-meeting | 15:54 | |
| *** rossella_s has quit IRC | 16:00 | |
| *** diablo_rojo has joined #openstack-meeting | 16:00 | |
| *** ihrachys has joined #openstack-meeting | 16:00 | |
| ihrachys | #startmeeting neutron_ci | 16:00 |
| openstack | Meeting started Tue Feb 13 16:00:48 2018 UTC and is due to finish in 60 minutes. The chair is ihrachys. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
| openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
| mlavalle | o/ | 16:00 |
| slaweq | hi | 16:01 |
| ihrachys | #topic Actions from prev meeting | 16:01 |
| *** openstack changes topic to "Actions from prev meeting (Meeting topic: neutron_ci)" | 16:01 | |
| mlavalle | ihrachys: Kuba won't make it to the meeting | 16:01 |
| ihrachys | ack | 16:01 |
| ihrachys | thanks for the notice | 16:01 |
| mlavalle | He went to hospital to see wife | 16:01 |
| ihrachys | yeah he has better things to care about right now ;) | 16:01 |
| mlavalle | and Sara | 16:01 |
| *** rossella_s has joined #openstack-meeting | 16:01 | |
| ihrachys | first action item was "ihrachys report bug for -pg- failure to glance" | 16:02 |
| ihrachys | that was rather optimistic, before we learned about OVO / facade issue | 16:02 |
| ihrachys | so i didn't | 16:02 |
| ihrachys | let me check if it's still relevant | 16:02 |
| ihrachys | http://grafana.openstack.org/dashboard/db/neutron-failure-rate?panelId=14&fullscreen | 16:03 |
| ihrachys | there was a 2d trench apparently on weekend | 16:04 |
| ihrachys | don't we run periodics on weekends? | 16:04 |
| ihrachys | ok the latest failure seems to be smth different than devstack failure we saw before: | 16:05 |
| ihrachys | http://logs.openstack.org/periodic/git.openstack.org/openstack/neutron/master/legacy-periodic-tempest-dsvm-neutron-pg-full/894eb3b/job-output.txt.gz#_2018-02-13_07_13_23_633653 | 16:05 |
| ihrachys | test_get_service_by_service_and_host_name failed | 16:05 |
| ihrachys | that's for compute admin api | 16:06 |
| ihrachys | I will report this one instead | 16:07 |
| ihrachys | #action ihrachys report test_get_service_by_service_and_host_name failure in periodic -pg- job | 16:07 |
| ihrachys | then there was "slaweq to report bug for ovsfw job failure / sea of red in ovs agent logs" | 16:07 |
| ihrachys | I believe this is largely contained now | 16:07 |
| slaweq | so I reported bug: https://bugs.launchpad.net/neutron/+bug/1747709 | 16:07 |
| openstack | Launchpad bug 1747709 in neutron "neutron-tempest-ovsfw fails 100% times" [High,Fix released] - Assigned to Slawek Kaplonski (slaweq) | 16:07 |
| *** pcarver has quit IRC | 16:08 | |
| slaweq | and later also https://bugs.launchpad.net/neutron/+bug/1748546 | 16:08 |
| openstack | Launchpad bug 1748546 in neutron "ovsfw tempest tests random fails" [High,Fix committed] - Assigned to Slawek Kaplonski (slaweq) | 16:08 |
| slaweq | and now patches for both are merged | 16:08 |
| slaweq | https://review.openstack.org/#/c/542596/ | 16:08 |
| slaweq | adn https://review.openstack.org/#/c/542257/ | 16:08 |
| slaweq | *and | 16:08 |
| *** felipemonteiro has joined #openstack-meeting | 16:09 | |
| ihrachys | ok, we need to land backports: https://review.openstack.org/#/q/I750224f7495aa46634bec1211599953cbbd4d1df | 16:09 |
| ihrachys | and https://review.openstack.org/#/q/I6d917cbac61293e9a956a2efcd9f2b720e4cac95 | 16:09 |
| slaweq | with those 2 patches neutron-tempest-ovsfw job was green at least 5-6 times when I checked that during weekend | 16:09 |
| mlavalle | yeap | 16:09 |
| ihrachys | mlavalle, we'll need rc2 for those right? | 16:10 |
| mlavalle | yes | 16:10 |
| slaweq | yes, cherry-picks to queens are done already also | 16:10 |
| mlavalle | those two are the only ones we have for RC2, so far | 16:10 |
| ihrachys | slaweq, do we need earlier backports for those bugs? | 16:10 |
| ihrachys | pike and ocata are still open | 16:10 |
| *** felipemonteiro_ has joined #openstack-meeting | 16:10 | |
| slaweq | I'm not sure but I will check it ASAP | 16:11 |
| mlavalle | with Pike we have more time | 16:11 |
| mlavalle | Ocata is the urgent one | 16:11 |
| *** Tom-Tom_ has quit IRC | 16:11 | |
| slaweq | ihrachys: please assign "action" for me - I will check it after the meeting | 16:12 |
| ihrachys | #action slaweq to backport ovsfw fixes to older stable branches | 16:12 |
| slaweq | thx | 16:12 |
| ihrachys | thanks for fixing the job! incredible. | 16:12 |
| mlavalle | ++ | 16:13 |
| ihrachys | next was "ihrachys to look at linuxbridge scenario random failures when sshing to FIP" | 16:13 |
| ihrachys | ok that's another one that fell through cracks | 16:13 |
| ihrachys | and I don't have capacity for anything new / time consuming this week | 16:13 |
| ihrachys | so maybe someone can take it over | 16:14 |
| ihrachys | actually, we can probably check if it's still an important issue later in the meeting when we talk about scenarios | 16:14 |
| mlavalle | let's do that | 16:14 |
| *** felipemonteiro has quit IRC | 16:15 | |
| ihrachys | #topic Grafana | 16:15 |
| ihrachys | http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:15 |
| *** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:15 | |
| *** oidgar has quit IRC | 16:16 | |
| ihrachys | fullstack seems to be the only job that is above 50% | 16:17 |
| slaweq | what is also good ;) | 16:17 |
| ihrachys | well except ovsfw but it looks like it quickly goes down with its average | 16:17 |
| slaweq | ovsfw patches was merged today so I think we should wait with this one some time | 16:18 |
| *** tssurya has quit IRC | 16:18 | |
| * mlavalle keeping fingers crossed | 16:18 | |
| ihrachys | right, but it's clear it's going down very quick. if that would be a Dow Jones chart we would see people jumping from windows. | 16:18 |
| mlavalle | LOL | 16:19 |
| slaweq | LOL | 16:19 |
| mlavalle | like 1929 | 16:19 |
| slaweq | but here lower is better | 16:19 |
| ihrachys | ok on serious note... seems like we want to talk about fullstack first thing | 16:19 |
| ihrachys | and then move to scenarios if time allows for it | 16:19 |
| ihrachys | #topic Fullstack | 16:20 |
| *** openstack changes topic to "Fullstack (Meeting topic: neutron_ci)" | 16:20 | |
| ihrachys | before going through latest failures, I think it makes sense to check some patches | 16:20 |
| ihrachys | specifically, https://review.openstack.org/#/c/539953/ enables test_dscp_marking_packets (it's actually already in gate so maybe we can just make a note it may resurface now and skip it) | 16:21 |
| ihrachys | also those backports for the same test for older branches: https://review.openstack.org/#/q/Ia3522237dc787edb90d162ac4a5535ff5d2a03d5 | 16:21 |
| slaweq | but I believe this test should works fine now | 16:21 |
| ihrachys | I believe once those are in, we can also backport the re-enabling patch | 16:21 |
| ihrachys | there are also those backports: https://review.openstack.org/#/q/Ib2d588d081a48f4f2b6e98a943bca95b9955a149 | 16:22 |
| ihrachys | any other patches I missed for fullstack? | 16:23 |
| slaweq | AFAIR https://review.openstack.org/#/q/Ib2d588d081a48f4f2b6e98a943bca95b9955a149 are required by https://review.openstack.org/#/q/Ia3522237dc787edb90d162ac4a5535ff5d2a03d5 | 16:23 |
| *** slaweq_ has joined #openstack-meeting | 16:24 | |
| ihrachys | yeah I think I mentioned both | 16:24 |
| mlavalle | yes you did | 16:24 |
| slaweq | yes, just saying :) | 16:24 |
| ihrachys | ok now looking at a latest run | 16:24 |
| ihrachys | http://logs.openstack.org/53/539953/2/check/neutron-fullstack/55e3511/logs/testr_results.html.gz | 16:24 |
| ihrachys | test_controller_timeout_does_not_break_connectivity_sigterm and test_l2_agent_restart | 16:25 |
| ihrachys | all old friends | 16:25 |
| ihrachys | at some point I should have even looked at one of them but never did | 16:25 |
| ihrachys | and as I said I am out of capacity for this week anyway | 16:25 |
| slaweq | I can take a look on them | 16:26 |
| ihrachys | I can't see neither reported in https://bugs.launchpad.net/neutron/+bugs?field.tag=fullstack | 16:26 |
| ihrachys | slaweq, | 16:27 |
| ihrachys | great | 16:27 |
| slaweq | https://bugs.launchpad.net/neutron/+bug/1673531 | 16:27 |
| openstack | Launchpad bug 1673531 in neutron "fullstack test_controller_timeout_does_not_break_connectivity_sigkill(GRE and l2pop,openflow-native_ovsdb-cli) failure" [High,Confirmed] - Assigned to Ihar Hrachyshka (ihar-hrachyshka) | 16:27 |
| ihrachys | actually maybe the sigterm one is https://bugs.launchpad.net/neutron/+bug/1673531 | 16:27 |
| ihrachys | riiight | 16:27 |
| slaweq | isn't this related? | 16:27 |
| ihrachys | probably | 16:27 |
| ihrachys | just different signal | 16:27 |
| slaweq | I will take a look on them this week | 16:28 |
| ihrachys | #action slaweq to look at http://logs.openstack.org/53/539953/2/check/neutron-fullstack/55e3511/logs/testr_results.html.gz failures | 16:28 |
| ihrachys | slaweq, very cool, thanks | 16:28 |
| slaweq | no problem | 16:28 |
| *** slaweq_ has quit IRC | 16:29 | |
| *** sambetts is now known as sambetts|afk | 16:29 | |
| ihrachys | checked another run, same failures: http://logs.openstack.org/01/542301/1/check/neutron-fullstack/d8f312e/logs/testr_results.html.gz | 16:29 |
| ihrachys | and another failed run - same: http://logs.openstack.org/96/542596/6/check/neutron-fullstack/8db76b7/logs/testr_results.html.gz (just one failed though) | 16:29 |
| ihrachys | it's clear that if those are tackled, it may get fullstack down to normal failure rate | 16:30 |
| *** Guest13990 has quit IRC | 16:30 | |
| *** Sukhdev has joined #openstack-meeting | 16:30 | |
| ihrachys | so it's great we'll have slaweq on those, meaning next week we'll have it green ;) | 16:30 |
| slaweq | I hope so :) | 16:30 |
| slaweq | I can always mark them as unstable to make it green :P | 16:30 |
| ihrachys | true lol | 16:31 |
| ihrachys | #topic Functional | 16:32 |
| *** openstack changes topic to "Functional (Meeting topic: neutron_ci)" | 16:32 | |
| ihrachys | I am looking at functional job charts and it seems to work fine. actually showing weird 0% failure last several days. | 16:32 |
| ihrachys | mlavalle, what would be the standard to hit to get it marked voting in check queue? | 16:32 |
| ihrachys | for the record I look at http://grafana.openstack.org/dashboard/db/neutron-failure-rate?panelId=7&fullscreen | 16:33 |
| *** pcarver has joined #openstack-meeting | 16:34 | |
| *** pcarver has quit IRC | 16:34 | |
| mlavalle | good question | 16:34 |
| mlavalle | 10% sounds good to me but I am shooting from the hip | 16:34 |
| *** pcarver has joined #openstack-meeting | 16:34 | |
| mlavalle | what do you think? | 16:34 |
| * ihrachys checking what's average for unit tests | 16:35 | |
| ihrachys | these are unit tests: http://grafana.openstack.org/dashboard/db/neutron-failure-rate?panelId=10&fullscreen | 16:35 |
| *** psachin has quit IRC | 16:36 | |
| ihrachys | if you look at 30 days stats, you see average is somewhere between 10 and 15 | 16:36 |
| mlavalle | so 10% sounds good | 16:37 |
| ihrachys | mlavalle, let's say we can hit 10%. how long should we experience it to consider voting? | 16:37 |
| mlavalle | let's say a week | 16:37 |
| mlavalle | with that average | 16:37 |
| ihrachys | ok gotcha, and full *working* week I believe | 16:37 |
| ihrachys | because weekends are not normal | 16:37 |
| mlavalle | yes | 16:37 |
| ihrachys | ok we are in the second day then right now. I will monitor it proactively then. ;) | 16:38 |
| mlavalle | cool | 16:38 |
| mlavalle | we can revisit net meeting | 16:39 |
| mlavalle | next^^^ | 16:39 |
| ihrachys | ok | 16:39 |
| *** fouadben has quit IRC | 16:39 | |
| ihrachys | #topic Scenarios | 16:39 |
| *** openstack changes topic to "Scenarios (Meeting topic: neutron_ci)" | 16:39 | |
| ihrachys | the chart here: http://grafana.openstack.org/dashboard/db/neutron-failure-rate?panelId=8&fullscreen | 16:39 |
| ihrachys | ok. first, dvr one is 20-25% | 16:40 |
| ihrachys | slaweq since the job uses ovsfw shouldn't we expect some stabilization there too? | 16:40 |
| slaweq | I don't know exactly | 16:41 |
| slaweq | do You have some example failure? | 16:41 |
| ihrachys | no not yet. we'll look at them later. | 16:42 |
| ihrachys | as for linuxbridge job, it's 25-30% so slightly worse | 16:42 |
| ihrachys | hence first looking at linuxbridge | 16:42 |
| ihrachys | example failure: http://logs.openstack.org/07/492107/9/check/neutron-tempest-plugin-scenario-linuxbridge/086f728/logs/testr_results.html.gz | 16:43 |
| ihrachys | all ssh failures using fip | 16:43 |
| ihrachys | since this job is not dvr / ha, routers are legacy | 16:45 |
| ihrachys | so we should e.g. see arpings and iptables-restore and 'ip addr add' in logs | 16:45 |
| ihrachys | this is where the fip address is configured on l3agent side: http://logs.openstack.org/07/492107/9/check/neutron-tempest-plugin-scenario-linuxbridge/086f728/logs/screen-q-l3.txt.gz#_Feb_13_15_11_35_940199 | 16:47 |
| *** pcaruana has joined #openstack-meeting | 16:47 | |
| ihrachys | so the address is configured in namespace; arping is executed; tempest should know about correct location of the address | 16:48 |
| slaweq | and iptables-save is also done just after so NAT should be also done | 16:48 |
| haleyb | there's no errors in the l2 agent log either | 16:48 |
| slaweq | maybe there is some issue with SG then? | 16:49 |
| *** eharney has quit IRC | 16:49 | |
| ihrachys | hm possible | 16:50 |
| ihrachys | and also instances booted fine and reached metadata | 16:50 |
| haleyb | the only thing that merged recently was the ARP change i did maybe, moved things to PREROUTING chain | 16:50 |
| ihrachys | (it's seen in one of test cases that logs console) | 16:50 |
| haleyb | slaweq: right, unless its SG | 16:50 |
| ihrachys | slaweq, wouldn't it be Connection refused if SG closed the port? | 16:51 |
| slaweq | I don't think so | 16:51 |
| ihrachys | there it seems it just hangs there until timeout | 16:52 |
| *** lpetrut has joined #openstack-meeting | 16:53 | |
| *** chyka has joined #openstack-meeting | 16:53 | |
| ihrachys | haleyb, so one thing that pops up is this message: | 16:55 |
| ihrachys | http://logs.openstack.org/07/492107/9/check/neutron-tempest-plugin-scenario-linuxbridge/086f728/logs/screen-q-agt.txt.gz?#_Feb_13_15_19_22_794763 | 16:55 |
| ihrachys | Tried to remove rule that was not there: 'POSTROUTING' u'-m physdev --physdev-in tap967365b4-ce --physdev-is-bridged -j neutron-linuxbri-qos-o967365' | 16:55 |
| slaweq | I think there is already patch for that | 16:55 |
| ihrachys | or is it the red herring that slaweq has a patch for | 16:55 |
| ihrachys | https://review.openstack.org/#/c/539922/ ? | 16:56 |
| slaweq | haleyb did this patch I think | 16:56 |
| haleyb | yes, there is, red herring i believe | 16:56 |
| ihrachys | ah wait that's db side | 16:56 |
| ihrachys | https://review.openstack.org/#/c/541379/ ? | 16:56 |
| slaweq | yes | 16:56 |
| slaweq | You were faster :) | 16:56 |
| haleyb | and that passed the scenario test | 16:57 |
| ihrachys | ok I nudged it in gate | 16:57 |
| ihrachys | but do we think it could break anything? | 16:57 |
| slaweq | this warning? I don't think so | 16:58 |
| ihrachys | ok | 16:58 |
| ihrachys | so there is something else | 16:58 |
| ihrachys | and we are almost out of time | 16:58 |
| slaweq | IMHO yes | 16:58 |
| slaweq | *yes, there is something else :) | 16:59 |
| ihrachys | this issue doesn't have obvious leads in logs so one thing to consider is maybe we should expand logging | 16:59 |
| mlavalle | ihrachys: I don't have much time this week, but if nobody else has, I'll try to take a stab at it | 16:59 |
| slaweq | I will probably be busy with debugging fullstack tests | 17:00 |
| ihrachys | one thing I noticed is most tests that failed don't log console on failure. that could be worth expanding on, not just for this issue. | 17:00 |
| ihrachys | mlavalle, please do! | 17:00 |
| mlavalle | ok | 17:00 |
| ihrachys | #action mlavalle to look into linuxbridge ssh timeout failures | 17:00 |
| ihrachys | thanks folks for joining | 17:00 |
| ihrachys | #endmeeting | 17:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 17:00 | |
| openstack | Meeting ended Tue Feb 13 17:00:42 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:00 |
| mlavalle | o/ | 17:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-02-13-16.00.html | 17:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-02-13-16.00.txt | 17:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-02-13-16.00.log.html | 17:00 |
| slaweq | thx, bye | 17:00 |
| *** slaweq has quit IRC | 17:02 | |
| *** Sukhdev has quit IRC | 17:02 | |
| *** slaweq has joined #openstack-meeting | 17:03 | |
| *** bcafarel has quit IRC | 17:07 | |
| *** slaweq has quit IRC | 17:07 | |
| *** iyamahat has quit IRC | 17:15 | |
| *** bbzhao has quit IRC | 17:15 | |
| *** bbzhao has joined #openstack-meeting | 17:16 | |
| *** yamahata has quit IRC | 17:17 | |
| *** yamamoto has quit IRC | 17:21 | |
| *** marios has quit IRC | 17:22 | |
| *** yamamoto has joined #openstack-meeting | 17:24 | |
| *** yamamoto has quit IRC | 17:24 | |
| *** kopecmartin has quit IRC | 17:25 | |
| *** sridharg has quit IRC | 17:25 | |
| *** Leo_m has quit IRC | 17:30 | |
| *** iyamahat has joined #openstack-meeting | 17:33 | |
| *** e0ne has quit IRC | 17:35 | |
| *** yamamoto has joined #openstack-meeting | 17:40 | |
| *** ekcs has quit IRC | 17:40 | |
| *** yamamoto has quit IRC | 17:45 | |
| *** slaweq has joined #openstack-meeting | 17:45 | |
| *** devananda has joined #openstack-meeting | 17:45 | |
| *** markvoelker has joined #openstack-meeting | 17:46 | |
| *** slaweq has quit IRC | 17:50 | |
| *** yamahata has joined #openstack-meeting | 17:51 | |
| *** bcafarel has joined #openstack-meeting | 17:55 | |
| *** pcaruana has quit IRC | 17:55 | |
| lbragstad | #startmeeting keystone | 18:00 |
| openstack | Meeting started Tue Feb 13 18:00:01 2018 UTC and is due to finish in 60 minutes. The chair is lbragstad. Information about MeetBot at http://wiki.debian.org/MeetBot. | 18:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 18:00 |
| lbragstad | ping ayoung, breton, cmurphy, dstanek, gagehugo, henrynash, hrybacki, knikolla, lamt, lbragstad, lwanderley, kmalloc, rderose, rodrigods, samueldmq, spilla, aselius, dpar, jdennis, ruan_he | 18:00 |
| *** openstack changes topic to " (Meeting topic: keystone)" | 18:00 | |
| openstack | The meeting name has been set to 'keystone' | 18:00 |
| kmalloc | BUT I DUNT WANNA /needsmorecoffee :P | 18:00 |
| kmalloc | ;) | 18:00 |
| lbragstad | #link https://etherpad.openstack.org/p/keystone-weekly-meeting | 18:00 |
| gagehugo | o/ | 18:00 |
| lbragstad | agenda ^ | 18:00 |
| *** Sukhdev has joined #openstack-meeting | 18:00 | |
| knikolla | o/ | 18:01 |
| lbragstad | i know we have a couple people that are going to miss - but we'll give it another minute since the agenda is light today | 18:01 |
| *** tobiash has joined #openstack-meeting | 18:01 | |
| lbragstad | ok - let's get started | 18:03 |
| lbragstad | #topic RC status | 18:03 |
| *** openstack changes topic to "RC status (Meeting topic: keystone)" | 18:03 | |
| lbragstad | so - a couple things cropped up | 18:03 |
| lbragstad | we still have to figure out what is going on with the translations | 18:03 |
| lbragstad | i attempted to back port those to stable/queens, but one apparently went into merge conflict | 18:04 |
| lbragstad | i checked with the translation team yesterday and they suggested we wait to see what the proposal bot does today | 18:04 |
| lbragstad | we'll likely have to follow back up with them | 18:04 |
| kmalloc | wfm | 18:04 |
| hrybacki | o/ | 18:05 |
| gagehugo | ok | 18:05 |
| kmalloc | just ping me when it goes up if i don't see it | 18:05 |
| kmalloc | i'll push those through | 18:05 |
| lbragstad | kmalloc | 18:05 |
| lbragstad | thanks | 18:05 |
| lbragstad | in other news | 18:05 |
| kmalloc | any proposal bot/release bot stuff for stab* branches is easy | 18:05 |
| lbragstad | it's never a release without a fire of some kind | 18:05 |
| kmalloc | eh, this isn't even a fire | 18:05 |
| lbragstad | https://bugs.launchpad.net/keystone/+bug/1748970 | 18:05 |
| openstack | Launchpad bug 1748970 in OpenStack Identity (keystone) "Role assignment API doesn't prune system roles when querying role.id={role_id}" [High,In progress] - Assigned to Lance Bragstad (lbragstad) | 18:05 |
| kmalloc | this is a mild smolder | 18:05 |
| *** pcaruana has joined #openstack-meeting | 18:06 | |
| kmalloc | grizzly.. that was a fire of a release :P | 18:06 |
| lbragstad | #Link https://bugs.launchpad.net/keystone/+bug/1748970 is going to need to be fixed and backported before we cut rc2 | 18:06 |
| *** yamamoto has joined #openstack-meeting | 18:06 | |
| *** yamamoto has quit IRC | 18:06 | |
| lbragstad | in addition to that, i found another bug where system role assignments aren't cleaned up when users/groups are deleted | 18:06 |
| lbragstad | #link https://review.openstack.org/#/c/543622/ | 18:06 |
| *** mlavalle has left #openstack-meeting | 18:06 | |
| lbragstad | i apologize, this was my doing and likely a gap in my testing when i did the implementation | 18:07 |
| lbragstad | i'm going to get bug reports open for ^ | 18:07 |
| lbragstad | so that we can track appropriate fixes for them and get them backported as well | 18:07 |
| lbragstad | after that - we should be good to go | 18:08 |
| samueldmq | lbragstad: cool | 18:08 |
| lbragstad | i did talk to smcginnis yesterday about rc2, and he suggested we wait until the end of the week to propose it | 18:08 |
| samueldmq | are all the tests for system scope consolidated in a place, such a separate test class? | 18:09 |
| samueldmq | or are they mixed up with the other role assignment tests | 18:09 |
| lbragstad | that's if we land the translations, the fix for 1748907 and the role assignment clean up patch | 18:09 |
| lbragstad | they are in with the role assignment tests | 18:09 |
| * samueldmq nods | 18:09 | |
| lbragstad | i plan on getting all that stuff squared away during office hours | 18:10 |
| lbragstad | qq for the group though, do we consider the fact that bootstrap doesn't assign the admin a role on the system a bug? | 18:11 |
| lbragstad | #link https://review.openstack.org/#/c/530410/ | 18:11 |
| *** david-lyle has quit IRC | 18:11 | |
| kmalloc | i'd say yeah | 18:12 |
| kmalloc | since we're looking to transition to system-roles | 18:12 |
| lbragstad | ok - i'll get another bug report open for that and repropose it | 18:12 |
| lbragstad | otherwise it would be possible for people to lock themselves out of APIs | 18:13 |
| lbragstad | if that bootstrapping didn't happen | 18:13 |
| *** cloudrancher has quit IRC | 18:13 | |
| kmalloc | yep | 18:13 |
| lbragstad | is anyone going to be around during office hours that can help expedite reviews for these? | 18:13 |
| kmalloc | yeah. i'll be around | 18:14 |
| lbragstad | awesome | 18:15 |
| lbragstad | #action lbragstad to finish opening bugs for fresh rc blocking issues | 18:15 |
| *** cloudrancher has joined #openstack-meeting | 18:15 | |
| hrybacki | I'm heads down this week =/ | 18:15 |
| lbragstad | #action lbragstad to respin patches for release blockers | 18:15 |
| hrybacki | yes, all of them | 18:15 |
| lbragstad | #action kmalloc to review | 18:16 |
| lbragstad | :) | 18:16 |
| gagehugo | I'll be around but not super available | 18:16 |
| lbragstad | gagehugo ack | 18:16 |
| lbragstad | i think that's all i have on release status | 18:17 |
| lbragstad | does anyone have anything else release-wise before we cut rc2? | 18:17 |
| lbragstad | cool - sounds like we can move on | 18:19 |
| lbragstad | #topic open discussion | 18:19 |
| *** openstack changes topic to "open discussion (Meeting topic: keystone)" | 18:19 | |
| lbragstad | does anyone have anything in general? | 18:19 |
| samueldmq | when are we cutting rc2? | 18:20 |
| lbragstad | pending the fixes we need to land, we're shooting for the end of the week | 18:20 |
| * samueldmq nods | 18:21 | |
| lbragstad | but we have until next week | 18:21 |
| samueldmq | ok, good | 18:21 |
| lbragstad | yep - anything else? | 18:22 |
| *** Sukhdev has quit IRC | 18:22 | |
| lbragstad | alright - i know everyone is busy, i appreciate the time! | 18:23 |
| lbragstad | thanks for coming, all | 18:23 |
| lbragstad | #endmeeting | 18:23 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 18:23 | |
| openstack | Meeting ended Tue Feb 13 18:23:47 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 18:23 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/keystone/2018/keystone.2018-02-13-18.00.html | 18:23 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/keystone/2018/keystone.2018-02-13-18.00.txt | 18:23 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/keystone/2018/keystone.2018-02-13-18.00.log.html | 18:23 |
| *** slaweq has joined #openstack-meeting | 18:25 | |
| *** slaweq has quit IRC | 18:26 | |
| *** slaweq has joined #openstack-meeting | 18:26 | |
| *** gagehugo has left #openstack-meeting | 18:26 | |
| *** gema has joined #openstack-meeting | 18:29 | |
| *** jamesmcarthur has quit IRC | 18:31 | |
| *** slaweq has quit IRC | 18:39 | |
| *** e0ne has joined #openstack-meeting | 18:40 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:40 | |
| *** slaweq has joined #openstack-meeting | 18:40 | |
| *** tesseract has quit IRC | 18:40 | |
| *** Sukhdev has joined #openstack-meeting | 18:41 | |
| *** jamesmcarthur has quit IRC | 18:45 | |
| *** pcaruana has quit IRC | 18:45 | |
| *** slaweq has quit IRC | 18:45 | |
| *** lpetrut has quit IRC | 18:53 | |
| *** eharney has joined #openstack-meeting | 18:54 | |
| *** ttsiouts_ has joined #openstack-meeting | 18:54 | |
| *** AJaeger has joined #openstack-meeting | 18:54 | |
| *** ssathaye has quit IRC | 18:56 | |
| *** ssathaye has joined #openstack-meeting | 18:56 | |
| clarkb | hello infraers | 19:00 |
| dmsimard | \o | 19:00 |
| AJaeger | Good evening! | 19:00 |
| ianw | o/ | 19:00 |
| gema | o/ | 19:01 |
| clarkb | #startmeeting infra | 19:01 |
| openstack | Meeting started Tue Feb 13 19:01:06 2018 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
| *** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
| openstack | The meeting name has been set to 'infra' | 19:01 |
| clarkb | #link https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting | 19:01 |
| clarkb | #topic Announcements | 19:01 |
| *** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:01 | |
| clarkb | #link https://etherpad.openstack.org/p/infra-rocky-ptg PTG Brainstorming | 19:01 |
| *** anilvenkata has quit IRC | 19:01 | |
| clarkb | If we end up having time towards the end of the meeting we will swing back around on ^ to make sure we aren't missing anything critical | 19:01 |
| *** cloudrancher has quit IRC | 19:01 | |
| clarkb | but please do skim it over when you have a chance | 19:02 |
| *** david-lyle has joined #openstack-meeting | 19:02 | |
| clarkb | also PTL Election season is now, about one day left to vote in elections. I think kolla, QA, and one other project have elections this time around | 19:02 |
| fungi | mistral | 19:02 |
| *** cloudrancher has joined #openstack-meeting | 19:02 | |
| fungi | voter turn-out is around 40% across all 3 teams | 19:02 |
| clarkb | so go vote if you are eligible and haven't yet | 19:02 |
| clarkb | #topic Actions from last meeting | 19:03 |
| *** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:03 | |
| clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-02-06-19.01.txt minutes from last meeting | 19:03 |
| *** harlowja has joined #openstack-meeting | 19:03 | |
| clarkb | I have yet to clean out old specs because either there is firefighting or I've come down with the latest plague it seems like | 19:03 |
| clarkb | #action clarkb actually clean up specs | 19:04 |
| clarkb | #topic Specs Approval | 19:04 |
| *** openstack changes topic to "Specs Approval (Meeting topic: infra)" | 19:04 | |
| clarkb | (sorry for moving fast but I would like to get through normal agenda then hopefully have time to talk about ptg things as it is coming up fast) | 19:04 |
| clarkb | I am not aware of any specs that need review other than general cleanup | 19:05 |
| clarkb | have I missed any that people want to call attention to? | 19:05 |
| fungi | the topic of polling platforms has come up recently in a few conversations | 19:05 |
| fungi | i wonder if we should ressurrect the proposed spec for that as a help-wanted thing | 19:05 |
| fungi | might be a potential future internship opportunity much in the same way codesearch.o.o was | 19:06 |
| clarkb | in the email I wrote last month I suggested that maybe we didn't need that anymore but since then yes more people have asked about polls | 19:06 |
| clarkb | probably a good indication there is still a use for it | 19:06 |
| *** yamamoto has joined #openstack-meeting | 19:06 | |
| *** rmcall has joined #openstack-meeting | 19:07 | |
| clarkb | when going over the old specs I can look at resurrecting it | 19:07 |
| fungi | cool, just a thought i had | 19:07 |
| *** Sukhdev has quit IRC | 19:07 | |
| clarkb | #topic Priority Efforts | 19:08 |
| *** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:08 | |
| clarkb | #topic Zuul v3 | 19:08 |
| *** openstack changes topic to "Zuul v3 (Meeting topic: infra)" | 19:08 | |
| clarkb | corvus: ianw Looks like you want to talk about executors OOMing and the status of ze02 with the new kernel | 19:08 |
| corvus | good topic! | 19:09 |
| ianw | looking at http://grafana01.openstack.org/dashboard/db/zuul-status you'd have to think ze02 was the lowest memory usage? | 19:09 |
| corvus | it's the highest | 19:09 |
| fungi | "used" | 19:09 |
| corvus | i'm going to invert that metric :) | 19:09 |
| fungi | yeah, available ram is sort of backwards from what people expect to see graphed | 19:10 |
| ianw | ahhh, well ... the only difference there is the hwe kernel | 19:10 |
| ianw | so is it working or not? :) | 19:10 |
| corvus | anyway, the biggest thing i would take from that is apparently memory management is different | 19:10 |
| corvus | that's probably a good thing since i believe our oom was caused by poor memory management in the kernel | 19:11 |
| fungi | it doesn't seem to be running more builds than the others though | 19:11 |
| corvus | (ie, my hypothesis is that it wasn't recovering slab memory correctly) | 19:11 |
| corvus | it's run for several days without ooming, which is a good sign (other servers have oom'd since, but not all) | 19:12 |
| dmsimard | There slabtop we can use to monitor that (I haven't used that in ages) | 19:12 |
| fungi | but yeah, i wonder if it's simply more accurately reporting actual available memory while the others simply seem like they have more available than they do | 19:12 |
| *** hongbin has joined #openstack-meeting | 19:12 | |
| corvus | if we wanted to increase our confidence it was improving things, we could try to unwind some of the executor load improvements we made recently in an attempt to intentionally stress the executors more. | 19:13 |
| pabelanger | o/ | 19:13 |
| corvus | or we could assume it's an improvement and roll it out to the others. then we'll have full coverage and obviously any oom will disprove it. | 19:13 |
| fungi | fwiw, no oom indicated in dmesg since booting a week ago | 19:13 |
| clarkb | I'm somewhat partial to just rolling it out considering how easy it is to revert (just build new executors or switch kernels and reboot) | 19:14 |
| dmsimard | If the HWE kernel hasn't made thing _worse_, I would roll it out to the others | 19:14 |
| dmsimard | and what clarkb said | 19:14 |
| clarkb | I think increasing the load to shake things out more will likely result in more pain for our users | 19:14 |
| pabelanger | we have had 2 zuul-executor OOM, taking down streaming too | 19:14 |
| corvus | ianw: what's the cost for the afs package? | 19:14 |
| clarkb | especially since hwe kernel hasn't catastrophically failed | 19:14 |
| pabelanger | ze04 / ze09, IIRC | 19:14 |
| ianw | ok; the only trick is i've got some custom afs .debs that need installing | 19:14 |
| pabelanger | ianw: could we add them to a PPA? | 19:14 |
| ianw | we can either puppet that in, or just do it manually | 19:15 |
| fungi | we could set those up in our ppa? | 19:15 |
| *** yamamoto has quit IRC | 19:15 | |
| pabelanger | +1 | 19:15 |
| fungi | we already have bwrap in there | 19:15 |
| fungi | er, set up a ppa for that in our ppa space i suppose | 19:15 |
| corvus | i'm assuming we'll revisit this in 2-3months as well. | 19:16 |
| ianw | i can just stick them on tarballs like https://tarballs.openstack.org/package-afs-aarch64/ | 19:16 |
| corvus | i sort of like the ppa aspect for .debs -- it seems more accessible and repeatable if someone else has to make an update | 19:17 |
| pabelanger | agree | 19:17 |
| pabelanger | I think there is also arm64 PPA support too? | 19:18 |
| dmsimard | ianw: so afs is kernel-specific ? I mean, would that package work against a non-HWE kernel ? I mostly wonder about how this translates for people potentially uses our puppet modules/PPA | 19:18 |
| clarkb | dmsimard: yes the drawback to being an out of kernel driver | 19:18 |
| pabelanger | You may also request builds for arm64, armhf, and/or ppc64el. Use the "Change details" page for the PPA to enable the architectures you want. | 19:18 |
| pabelanger | https://help.launchpad.net/Packaging/PPA | 19:18 |
| clarkb | apis change and then you break against newer kernels | 19:18 |
| ianw | dmsimard: the modules are pretty kernel specific, since kernel has no abi ... it just needs a later version to work against later kernels | 19:18 |
| clarkb | package dependencies should be able to express that at least | 19:19 |
| fungi | #link https://launchpad.net/~openstack-ci-core/+activate-ppa Activate a New “OpenStack CI Core” team Personal Package Archive | 19:19 |
| fungi | for reference | 19:19 |
| corvus | clarkb: well, to be fair *ubuntu's* afs package is broken against *ubuntu's* kernel. | 19:19 |
| clarkb | ianw's package can depend on the hwe kernel | 19:19 |
| dmsimard | ok, it's been too long since I've done debian packaging but clarkb beat me to it -- it should be possible for the newer package to require the hwe kernel to make sure it doesn't get installed on non-hwe | 19:19 |
| pabelanger | fungi: FWIW: I don't have permission for that | 19:19 |
| ianw | it won't really matter if it does anyway, it's backwards compat | 19:19 |
| ianw | just not fowards | 19:20 |
| dmsimard | ianw: oh, that's what I was asking -- if it's backwards compatible it's fine then | 19:20 |
| clarkb | I like the idea of a ppa for this too fwiw. especially if we have to do it for arm too | 19:20 |
| pabelanger | fungi: looks like need to be added to https://launchpad.net/~openstack-admins/+members | 19:20 |
| corvus | pabelanger: done | 19:21 |
| *** jamesmcarthur has joined #openstack-meeting | 19:21 | |
| pabelanger | corvus: thankyou | 19:21 |
| corvus | ianw: added you | 19:21 |
| clarkb | so maybe we continue to monitor it while we get that set up and if still looking good do the update across the executors? | 19:21 |
| ianw | so is this one ppa with "everything" we build? | 19:21 |
| fungi | yeah, i expect any infra-root person who wants to help maintain that ppa can be added to the group there | 19:21 |
| ianw | i just mean, will it drag in other stuff we've built | 19:22 |
| pabelanger | ianw: yah, vhd-util and bwrap right now | 19:22 |
| pabelanger | oh, and python3 testing :) | 19:22 |
| clarkb | you have to explicitly install those packages but if you do ya should come from the ppa | 19:22 |
| fungi | note that they're individual ppas. i expect this would be an openafs-hwe-kernel (or similar) ppa adjacent to the bwrap and vhdutil ones | 19:22 |
| *** ijw has joined #openstack-meeting | 19:22 | |
| clarkb | ++ | 19:22 |
| ianw | oh right, that's what i meant | 19:23 |
| fungi | as opposed to, say, a single ppa with all those unrelated packages dumped in | 19:23 |
| ianw | ok, maybe we should discuss in infra. i'll take an action item to get the ppa setup with packages and then we can do a few upgrades from that | 19:23 |
| *** ekcs has joined #openstack-meeting | 19:23 | |
| fungi | thanks ianw! | 19:23 |
| corvus | dmsimard: added you | 19:23 |
| clarkb | #action ianw set up afs ppa for arm and hwe kernels | 19:23 |
| pabelanger | ianw: happy to help | 19:23 |
| ianw | one other quick thing was that ipv6 is broken to ze02 for undeterminted reasons | 19:23 |
| clarkb | ianw: separately from the larger scale ipv6 breakage we had right? | 19:24 |
| corvus | i guess we should just replace that server? | 19:24 |
| ianw | rax said they didn't know what's wrong and wanted access to the hosts on either end of the issue (cacti and ze02) which i wasn't too sure about | 19:24 |
| fungi | where "broken" means some significant % packet loss, but not 100% | 19:24 |
| ianw | yeah, so should i try 1) a hard reboot (maybe ends up on a different node) and 2) a rebuild | 19:24 |
| fungi | do any other instances also get ipv6 packet loss communicating with ze02? | 19:24 |
| ianw | i haven't noticed any. a sure fire way is if cacti has no/spotty logs | 19:25 |
| corvus | i'm not comfortable sharing access to ze02. | 19:25 |
| clarkb | maybe make new server then nova rebuild old one with a new image? | 19:25 |
| clarkb | I have a feeling nova actually reschedules you to a new hypervisor when you do that which may invalidate the testing | 19:26 |
| corvus | clarkb: yeah, and if that works, share that with rax. and if it doesn't, "oh well" | 19:26 |
| corvus | i guess we could try to clean the server then give them access | 19:26 |
| ianw | i don't think they *want* to investigate, but probably would if we asked, if you know what i mean | 19:26 |
| fungi | we wouldn't want to reuse it after they log in, at any rate | 19:26 |
| clarkb | ianw: in that case maybe we just make a new server | 19:27 |
| fungi | and wouldn't want to leave keys on it | 19:27 |
| corvus | wfm | 19:27 |
| ianw | so basically ok to hard reboot/rebuild over the next day or so and see what happens? | 19:27 |
| pabelanger | wfm | 19:27 |
| clarkb | ianw: wfm | 19:27 |
| fungi | sounds good | 19:27 |
| clarkb | maybe do that before we commit hard to the hwe kernel. It is possible that breaks ipv6 somehow | 19:27 |
| clarkb | however I think the server had similar problems before we updated the kernel | 19:27 |
| ianw | true also, but the access (from cacti) has been bad for ages | 19:28 |
| fungi | worth noting we still have cacti01 in dns | 19:28 |
| pabelanger | fungi: oh, it is possible I didn't remove it | 19:28 |
| clarkb | The other zuul item on the agenda is handling zk disconnects. Which I think should be fixed at this point, but wanted to double check on that before removing it from the agenda. | 19:29 |
| *** david-lyle has quit IRC | 19:29 | |
| pabelanger | do we want to consider migrating to new zookeeper at PTG? | 19:30 |
| pabelanger | zk01 / zk02 / zk03 | 19:30 |
| pabelanger | from nodepool.o.o | 19:30 |
| clarkb | pabelanger: probably not a bad time to do it considering load will likely be low during ptg | 19:30 |
| fungi | how disruptive do we anticipate that being? | 19:30 |
| pabelanger | I believe we need to stop / start everything to pick up new configuration | 19:30 |
| fungi | it requires a full outage for nodepool because we can't expand/contract zk clusters i guess? | 19:31 |
| clarkb | fungi: yes | 19:31 |
| pabelanger | yes, and zuul too | 19:31 |
| clarkb | at least my reading of docs is that you need a very new version of zk to do expansion safely | 19:31 |
| fungi | oh, i suppose zuul does need to know to connect to the new cluster as well yes ;) | 19:31 |
| dmsimard | Have we ever tested connecting to a cluster in the first place ? | 19:32 |
| *** david-lyle has joined #openstack-meeting | 19:32 | |
| clarkb | process would be something like stop all services including zk, copy zk data files to 3 new servers. Start 3 new servers. Check quorum and data is present, start nodepool and zuul | 19:32 |
| pabelanger | dmsimard: not yet, but we likely should | 19:32 |
| dmsimard | I'm admittedly not knowledgeable about Zookeeper but maybe there's a few gotchas around connecting to a cluster | 19:32 |
| pabelanger | would be good to confirm replication is working correctly | 19:32 |
| dmsimard | For example, some client bindings require listing all the nodes in the configuration and the client decides where to go, others it's handled server side, etc. | 19:33 |
| clarkb | ya its worth testing. We even have a cluster you can use :) | 19:33 |
| dmsimard | pabelanger: not just replication but actual usage/connection | 19:33 |
| tobiash | dmsimard, pabelanger: I connect to a cluster since day one ;) | 19:33 |
| pabelanger | oh | 19:33 |
| pabelanger | :) | 19:33 |
| clarkb | tobiash wins. Can double check our config for us :P | 19:33 |
| dmsimard | tobiash: well isn't that awesome | 19:33 |
| dmsimard | a wild tobiash has appeared :D | 19:33 |
| tobiash | didn't notice any problems related to this so far ;) | 19:34 |
| clarkb | alright anything else related to zuul? | 19:34 |
| pabelanger | okay, so we still need to figure out how to move data between servers, but i can maybe look into that and start an etherpad | 19:34 |
| clarkb | pabelanger: its just file copies aiui | 19:34 |
| pabelanger | okay | 19:34 |
| clarkb | pabelanger: so stop zk everywhere, copy the files out, start zk | 19:34 |
| clarkb | we may even be able to test it on the new cluster by just copying what is on disk at any point in time of existing server | 19:35 |
| clarkb | (basically don't stop the source side) | 19:35 |
| pabelanger | clarkb: yah, that's what I'm thinking for first test | 19:35 |
| clarkb | #topic General Topics | 19:36 |
| *** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:36 | |
| clarkb | ianw: gema aarch64 udpate time? | 19:36 |
| ianw | i got what would be testing-nodes building a booting | 19:36 |
| pabelanger | nice | 19:37 |
| ianw | it's a bit janky but gets there -> https://review.openstack.org/542591 | 19:37 |
| gema | ianw: the hw_firmware_type is not needed anymore, the patch was not fully applied everywhere, should be redundant | 19:38 |
| ianw | actually it's up if you have access @ root@211.148.24.197 | 19:38 |
| gema | ianw: but we can clean that up when we upgrade the clouds to queens | 19:38 |
| ianw | cool. so on my todo list is figuring out how to get the hwe kernel installed by default during the build ... it seems to work better, and just finishing off the efi stack | 19:38 |
| ianw | the dib gate has been broken so took me on a journey of fixing jobs last few days | 19:39 |
| gema | ianw: if HWE kernel works better on arm64 I can talk to the ubuntu folks to make it default on arm cloud images | 19:39 |
| clarkb | ianw: worst case you should be able to just have a package install for it right? | 19:39 |
| gema | ianw: we have a conversation pending for PTG, you can join if you'd like | 19:39 |
| clarkb | small element that checks arch and installs hwe if arm | 19:39 |
| ianw | yep, there's always a way :) | 19:40 |
| gema | ianw: this is awesome work, thank you | 19:40 |
| pabelanger | infra-needs-element :D | 19:40 |
| ianw | if we get this ppa going, i was also going to update puppet to make sure we can build the mirror automatically | 19:41 |
| fungi | much appreciated | 19:41 |
| ianw | and we should probably mirror ports.ubuntu | 19:41 |
| pabelanger | yah, that would be awesome | 19:41 |
| fungi | is that where ubuntu sticks non-x86 architecture builds? | 19:41 |
| ianw | yep, so we'd want to prune that to arm64 | 19:42 |
| * fungi is too used to debian just putting all architectures in one place | 19:42 | |
| ianw | so i think it's all moving forward ... if anyone wants to review the dib stack at https://review.openstack.org/#/c/539731/ feel free :) | 19:43 |
| gema | clarkb: from our side we are moving hw to a new lab in london next week and after that we'll bring up a new cloud, with some resources for infra also | 19:44 |
| corvus | is this a second cloud or a replacement? | 19:44 |
| gema | a second cloud | 19:45 |
| *** slaweq has joined #openstack-meeting | 19:45 | |
| clarkb | ianw: gema sounds like good progress, exciting! | 19:45 |
| gema | we have another one in the US that needs updating and will also be added in due time | 19:45 |
| *** iyamahat_ has joined #openstack-meeting | 19:45 | |
| fungi | most awesome | 19:45 |
| gema | corvus: the plan is to have the three clouds running queens during the coming months | 19:45 |
| gema | and have resources for infra on the three of them | 19:45 |
| corvus | groovy! | 19:45 |
| pabelanger | Yay | 19:46 |
| * clarkb is now going to try and quickly get through a couple of things leaving us ~10 minutes to talk PTG | 19:46 | |
| gema | and our members are super excited and talking about contributing more hw | 19:46 |
| gema | clarkb: sorry, go for it :D | 19:46 |
| clarkb | I've switched jjb's core review group in Gerrit to be self managed as they are already operating mostly independently. I do not think this is at odds with them remaining as an infra project | 19:47 |
| *** noslzzp has quit IRC | 19:47 | |
| clarkb | if anyone has concerns about this let me know but reality is they've been operating independently for some time | 19:47 |
| clarkb | I did speak with the release team last week about project renames and the date I got back was March 16 | 19:47 |
| clarkb | cycle trailing releases should just be about done then. we will want to dobuel check with release team before taking gerrit down though | 19:47 |
| fungi | yeah, in my tenure as ptl i basically just acted on whatever recommendations their core team had for adding new core members | 19:48 |
| fungi | (jjb that is) | 19:48 |
| pabelanger | I don't believe I'll be around that week to help | 19:48 |
| clarkb | we can sort out process for renames after hte PTG I expect | 19:48 |
| fungi | i'll be available | 19:48 |
| clarkb | pabelanger: thats ok, I think several of us will be around we should have enough people to do it | 19:48 |
| *** iyamahat has quit IRC | 19:48 | |
| clarkb | Alright PTG planning | 19:49 |
| fungi | that is the night before a major drinking holiday, but shouldn't pose any problems | 19:49 |
| clarkb | fungi: ya its day after you have to wrry about | 19:49 |
| *** slaweq has quit IRC | 19:49 | |
| fungi | ;) | 19:49 |
| clarkb | Looks like we have a good collection of stuff for wed-fri | 19:49 |
| clarkb | do we want to try and schedule that loosely say put all the Zuul stuff on wednesday/thursday and the rest of it on friday? Or do it more unconference style and let people work through what they are interested in as they are able? | 19:50 |
| clarkb | I'm not sure if one of the other helps or hurts people's ability to attend based on travel or other scheduling demands | 19:51 |
| corvus | i think attempting scheduling would be helpful | 19:51 |
| gema | for the arm64 bit it'd help if we had a slot, so I know when we'll be discussing it. We will be splitting time between kolla and infra | 19:51 |
| dmsimard | I'll stay in the cold land of Montreal to help regular infra-root things along during North American timezones :) | 19:51 |
| clarkb | ok thats two votes for scheduling. I'll work up a proposed schedule then. Probably put it in the etherpad then send mail to the infra list letting people know they should look it over | 19:52 |
| pabelanger | wfm | 19:52 |
| *** bobh has quit IRC | 19:52 | |
| gema | wfm | 19:52 |
| clarkb | it probably won't be super specific and instead be rough like wednesday morning vs friday after noon | 19:52 |
| fungi | yeah, there are a few non-infra discussions i need to split my time between too, so knowing when would be convenient helps me | 19:53 |
| corvus | we still have an ethercalc, right? | 19:53 |
| clarkb | corvus: oh good point I should use that | 19:53 |
| fungi | indeed we do! | 19:53 |
| fungi | there's no ptg-wide ethercalc integrated with ptgbot any longer, but doesn't preclude us from having our own spreadsheet for this | 19:53 |
| clarkb | thinking about it that might be a good way to do "appointments" with the help days too | 19:54 |
| clarkb | just block out each hour of the day monday/tuesday and let projects sign up | 19:54 |
| pabelanger | great idea | 19:54 |
| corvus | ++ | 19:54 |
| clarkb | ok I will work on getting that set up | 19:55 |
| clarkb | and the last thing is do we want to try and do a team dinner (I think we should I've just been sick and otherwise distracted by family obligations haven't had much time to look into it) | 19:55 |
| clarkb | worst case I imagine we can roll into a pub and sit at a couple tables | 19:55 |
| *** anilvenkata has joined #openstack-meeting | 19:56 | |
| clarkb | but maybe a quick poll of what night works for people would be good too | 19:56 |
| corvus | i like eating with people | 19:56 |
| corvus | also drinking | 19:56 |
| clarkb | pabelanger: ^ were you maybe still interested in that? | 19:56 |
| pabelanger | sure, I can look into it more | 19:56 |
| pabelanger | get up etherpad for people to vote on a datetime | 19:57 |
| clarkb | #topic open discussion | 19:57 |
| fungi | dublin has a preponderance of venues where a large group can just wander in and get served. we may have to spread out across multiple tables, but i doubt we'll have trouble finding somewhere | 19:57 |
| *** openstack changes topic to "open discussion (Meeting topic: infra)" | 19:57 | |
| clarkb | few minutes for anything else that we've missed | 19:57 |
| clarkb | fungi: good to know thanks | 19:57 |
| AJaeger | One request: I have two stacks up that will remove together /usr/local/jenkins from our nodes, please review and comment on naming/location. https://review.openstack.org/541868 and https://review.openstack.org/543139/ | 19:57 |
| pabelanger | https://review.openstack.org/542422/ is something nodepool related to help better manage our min-ready nodes. If people are maybe interested in reviewing | 19:58 |
| corvus | AJaeger: why don't we use the ansible script module ? | 19:58 |
| *** salv-orlando has joined #openstack-meeting | 19:58 | |
| AJaeger | corvus: where exactly? Happy to make changes... | 19:59 |
| corvus | pabelanger: min-ready: 0 is now the default, but we may need launcher restarts to pick that up | 19:59 |
| pabelanger | corvus: k, will update | 20:00 |
| AJaeger | corvus: let's continue in #openstack-infra | 20:00 |
| corvus | AJaeger: well, it's more of a question of approach -- rather than have jobs which expect scripts to already exist on a node, the ansible 'script' module copies and runs the scripts | 20:00 |
| clarkb | ya discussion will have to move to -infra. We are out of time! thank you everyone. | 20:01 |
| fungi | thanks! | 20:01 |
| clarkb | #endmeeting | 20:01 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 20:01 | |
| openstack | Meeting ended Tue Feb 13 20:01:18 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-02-13-19.01.html | 20:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-02-13-19.01.txt | 20:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-02-13-19.01.log.html | 20:01 |
| *** salv-orl_ has quit IRC | 20:01 | |
| *** tobiash has left #openstack-meeting | 20:04 | |
| *** anilvenkata has quit IRC | 20:06 | |
| *** rfolco|rover is now known as rfolco|off | 20:06 | |
| *** coolsvap has quit IRC | 20:14 | |
| *** amodi has joined #openstack-meeting | 20:14 | |
| *** e0ne_ has joined #openstack-meeting | 20:22 | |
| *** e0ne has quit IRC | 20:25 | |
| *** SerenaFeng has joined #openstack-meeting | 20:32 | |
| *** Leo_m has joined #openstack-meeting | 20:35 | |
| *** kaisers_ has quit IRC | 20:36 | |
| *** kaisers_ has joined #openstack-meeting | 20:36 | |
| *** awaugama has quit IRC | 20:39 | |
| *** AJaeger has left #openstack-meeting | 20:44 | |
| *** amodi has quit IRC | 20:58 | |
| *** ykatabam has joined #openstack-meeting | 21:00 | |
| *** VW has joined #openstack-meeting | 21:05 | |
| *** pabelanger has quit IRC | 21:05 | |
| *** pabelanger has joined #openstack-meeting | 21:05 | |
| *** iyamahat__ has joined #openstack-meeting | 21:09 | |
| *** slaweq has joined #openstack-meeting | 21:11 | |
| *** iyamahat_ has quit IRC | 21:11 | |
| *** VW has quit IRC | 21:12 | |
| *** VW has joined #openstack-meeting | 21:13 | |
| *** rmcall has quit IRC | 21:13 | |
| *** Leo_m_ has joined #openstack-meeting | 21:14 | |
| *** Leo_m has quit IRC | 21:16 | |
| *** Sukhdev has joined #openstack-meeting | 21:18 | |
| *** VW has quit IRC | 21:18 | |
| *** ttsiouts_ has quit IRC | 21:20 | |
| *** ttsiouts_ has joined #openstack-meeting | 21:21 | |
| *** felipemonteiro_ has quit IRC | 21:22 | |
| *** ijw has quit IRC | 21:23 | |
| *** ijw has joined #openstack-meeting | 21:24 | |
| *** ttsiouts_ has quit IRC | 21:26 | |
| *** cloudrancher has quit IRC | 21:28 | |
| *** cloudrancher has joined #openstack-meeting | 21:29 | |
| *** dustins has quit IRC | 21:30 | |
| *** e0ne_ has quit IRC | 21:30 | |
| *** ttx has quit IRC | 21:30 | |
| *** beekhof_mb has quit IRC | 21:31 | |
| *** dprince has quit IRC | 21:31 | |
| *** SerenaFeng has quit IRC | 21:32 | |
| *** pchavva has quit IRC | 21:33 | |
| *** armstrong has joined #openstack-meeting | 21:40 | |
| *** rbartal has quit IRC | 21:41 | |
| *** aeng has joined #openstack-meeting | 21:42 | |
| *** ykatabam has quit IRC | 21:42 | |
| *** jamesmcarthur has quit IRC | 21:49 | |
| *** armstrong has quit IRC | 21:49 | |
| *** ttsiouts_ has joined #openstack-meeting | 21:50 | |
| *** afazekas has quit IRC | 21:50 | |
| *** afazekas has joined #openstack-meeting | 21:52 | |
| *** ttsiouts_ has quit IRC | 21:53 | |
| *** rbartal has joined #openstack-meeting | 21:53 | |
| *** jamesmcarthur has joined #openstack-meeting | 21:56 | |
| *** gyee has joined #openstack-meeting | 22:00 | |
| *** ihrachys has quit IRC | 22:00 | |
| *** ihrachys has joined #openstack-meeting | 22:01 | |
| *** jamesmcarthur has quit IRC | 22:01 | |
| *** ykatabam has joined #openstack-meeting | 22:01 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:02 | |
| *** ekcs has quit IRC | 22:02 | |
| *** rcernin has joined #openstack-meeting | 22:05 | |
| *** slaweq_ has joined #openstack-meeting | 22:06 | |
| *** Alex_Staf has joined #openstack-meeting | 22:08 | |
| *** eharney has quit IRC | 22:09 | |
| *** lamt_ has quit IRC | 22:31 | |
| *** lamt_ has joined #openstack-meeting | 22:31 | |
| *** ekcs has joined #openstack-meeting | 22:39 | |
| *** felipemonteiro has joined #openstack-meeting | 22:40 | |
| *** slaweq_ has quit IRC | 22:46 | |
| *** slaweq_ has joined #openstack-meeting | 22:47 | |
| *** slaweq_ has quit IRC | 22:51 | |
| *** ijw has quit IRC | 22:57 | |
| *** lamt_ has quit IRC | 22:58 | |
| *** jamesmcarthur has quit IRC | 23:07 | |
| *** hongbin has quit IRC | 23:10 | |
| *** fnaval has quit IRC | 23:10 | |
| *** mriedem is now known as mriedem_afk | 23:17 | |
| *** armstrong has joined #openstack-meeting | 23:17 | |
| *** Zara has quit IRC | 23:18 | |
| *** Zara has joined #openstack-meeting | 23:18 | |
| *** Alex_Staf has quit IRC | 23:19 | |
| *** VW has joined #openstack-meeting | 23:21 | |
| *** ijw has joined #openstack-meeting | 23:24 | |
| *** fnaval has joined #openstack-meeting | 23:27 | |
| *** VW has quit IRC | 23:35 | |
| *** VW has joined #openstack-meeting | 23:35 | |
| *** VW has quit IRC | 23:40 | |
| *** Sukhdev has quit IRC | 23:42 | |
| *** ijw has quit IRC | 23:42 | |
| *** slaweq has quit IRC | 23:45 | |
| *** Sukhdev has joined #openstack-meeting | 23:46 | |
| *** Sukhdev has quit IRC | 23:48 | |
| *** fnaval has quit IRC | 23:48 | |
| *** fnaval has joined #openstack-meeting | 23:48 | |
| *** felipemonteiro has quit IRC | 23:50 | |
| *** ijw has joined #openstack-meeting | 23:52 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:53 | |
| *** jamesmcarthur has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!