| *** gyee has quit IRC | 00:04 | |
| *** jamesmcarthur has joined #openstack-meeting | 00:10 | |
| *** slaweq has joined #openstack-meeting | 00:11 | |
| *** slaweq has quit IRC | 00:16 | |
| *** aagate has quit IRC | 00:19 | |
| *** e0ne has joined #openstack-meeting | 00:20 | |
| *** jamesmcarthur has quit IRC | 00:29 | |
| *** longkb has joined #openstack-meeting | 00:29 | |
| *** markvoelker has quit IRC | 00:44 | |
| *** jamesmcarthur has joined #openstack-meeting | 00:49 | |
| *** jamesmcarthur has quit IRC | 01:10 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:12 | |
| *** e0ne has quit IRC | 01:20 | |
| *** bobh has joined #openstack-meeting | 01:22 | |
| *** jamesmcarthur has quit IRC | 01:22 | |
| *** yamahata has quit IRC | 01:25 | |
| *** iyamahat has quit IRC | 01:25 | |
| *** e0ne has joined #openstack-meeting | 01:27 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:33 | |
| *** felipemonteiro has quit IRC | 01:38 | |
| *** felipemonteiro has joined #openstack-meeting | 01:54 | |
| *** mriedem_away is now known as mriedem | 01:55 | |
| *** jamesmcarthur has quit IRC | 02:01 | |
| *** diablo_rojo has quit IRC | 02:02 | |
| *** manjeets has joined #openstack-meeting | 02:06 | |
| *** felipemonteiro has quit IRC | 02:10 | |
| *** slaweq has joined #openstack-meeting | 02:11 | |
| *** slaweq has quit IRC | 02:16 | |
| *** tetsuro has joined #openstack-meeting | 02:26 | |
| *** hongbin has joined #openstack-meeting | 02:37 | |
| *** mriedem has quit IRC | 02:38 | |
| *** tetsuro has quit IRC | 02:38 | |
| *** tetsuro has joined #openstack-meeting | 02:38 | |
| *** e0ne has quit IRC | 02:40 | |
| *** e0ne has joined #openstack-meeting | 02:48 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:52 | |
| *** apetrich has quit IRC | 02:52 | |
| *** sagara has joined #openstack-meeting | 02:56 | |
| *** jamesmcarthur has quit IRC | 02:57 | |
| *** felipemonteiro has joined #openstack-meeting | 02:58 | |
| *** lbragstad has quit IRC | 03:04 | |
| *** e0ne has quit IRC | 03:05 | |
| *** lbragstad has joined #openstack-meeting | 03:11 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:13 | |
| *** jamesmcarthur has quit IRC | 03:17 | |
| *** felipemonteiro has quit IRC | 03:23 | |
| *** hongbin has quit IRC | 03:25 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:33 | |
| *** jamesmcarthur has quit IRC | 03:37 | |
| *** erlon has joined #openstack-meeting | 03:42 | |
| *** felipemonteiro has joined #openstack-meeting | 03:46 | |
| *** erlon has quit IRC | 03:48 | |
| *** lbragstad has quit IRC | 03:48 | |
| *** felipemonteiro has quit IRC | 03:52 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:54 | |
| *** felipemonteiro has joined #openstack-meeting | 03:56 | |
| *** jamesmcarthur has quit IRC | 03:58 | |
| *** tpatil has joined #openstack-meeting | 03:58 | |
| *** samP has joined #openstack-meeting | 03:59 | |
| samP | Hi all for masakari | 04:00 |
|---|---|---|
| tpatil | Hi | 04:00 |
| samP | #startmeeting masakari | 04:00 |
| openstack | Meeting started Tue Sep 18 04:00:30 2018 UTC and is due to finish in 60 minutes. The chair is samP. Information about MeetBot at http://wiki.debian.org/MeetBot. | 04:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 04:00 |
| *** openstack changes topic to " (Meeting topic: masakari)" | 04:00 | |
| openstack | The meeting name has been set to 'masakari' | 04:00 |
| samP | Hi all | 04:00 |
| *** felipemonteiro has quit IRC | 04:00 | |
| *** tetsuro has quit IRC | 04:01 | |
| sagara | Hi | 04:01 |
| samP | sagara: Hi | 04:01 |
| tpatil | samP: Today, I'm in India, waiting for taxi to go to Office | 04:01 |
| tpatil | I might disconnect in 10 mins, is it ok? | 04:01 |
| samP | tpatil: no problem | 04:02 |
| tpatil | Thanks | 04:02 |
| samP | right after the PTG, nothing much to discuss, unless you have any topics | 04:02 |
| samP | Here is the etherpad for PTG discussion in Stein. | 04:03 |
| samP | #link https://etherpad.openstack.org/p/masakari-ptg-stein | 04:03 |
| tpatil | No new topics to be discussed, but awaiting for patches to be merged pushed into stable branches | 04:04 |
| samP | I will prepare the spec repo to Stein. | 04:04 |
| samP | tpatil: Sure, I will take a look. | 04:04 |
| sagara | I also don't have any special topic. | 04:04 |
| samP | sagara: Thanks | 04:05 |
| tpatil | samP: You have already approved those patches, need another +2 | 04:05 |
| *** yamamoto has joined #openstack-meeting | 04:06 | |
| samP | tpatil: Ah ok, Sagara san please take a look, when you have time. | 04:07 |
| sagara | samP: OK | 04:08 |
| samP | I will try to add more details or specs for Stein work items. Then, we can discuss more details in coming meetings | 04:08 |
| samP | If no other topics to discuss, let's end today's meeting | 04:09 |
| tpatil | Ok | 04:09 |
| samP | tpatil: have a good time in India! | 04:09 |
| sagara | tpatil: have a good time! | 04:09 |
| tpatil | Thank you | 04:09 |
| samP | please pass my regards to team !! | 04:10 |
| tpatil | Sure | 04:10 |
| tpatil | I have got few mascots, will share with them | 04:10 |
| samP | OK then, CU on next week. | 04:10 |
| tpatil | Yes | 04:10 |
| samP | tpatil: great.. thanks | 04:10 |
| samP | Till then, | 04:11 |
| *** slaweq has joined #openstack-meeting | 04:11 | |
| samP | Please use openstack-dev ML with [masakari] or #openstack-masakari @freenode IRC for further discussion | 04:11 |
| samP | Thank you ! | 04:11 |
| samP | #endmeeting | 04:11 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 04:11 | |
| openstack | Meeting ended Tue Sep 18 04:11:47 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 04:11 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-09-18-04.00.html | 04:11 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-09-18-04.00.txt | 04:11 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-09-18-04.00.log.html | 04:11 |
| *** tpatil has quit IRC | 04:12 | |
| *** diablo_rojo has joined #openstack-meeting | 04:14 | |
| *** jamesmcarthur has joined #openstack-meeting | 04:14 | |
| *** slaweq has quit IRC | 04:16 | |
| *** bobh has quit IRC | 04:18 | |
| *** sagara has quit IRC | 04:19 | |
| *** jamesmcarthur has quit IRC | 04:19 | |
| *** tetsuro has joined #openstack-meeting | 04:20 | |
| *** diablo_rojo has quit IRC | 04:48 | |
| *** jamesmcarthur has joined #openstack-meeting | 04:55 | |
| *** jamesmcarthur has quit IRC | 05:00 | |
| *** slaweq has joined #openstack-meeting | 05:01 | |
| *** slaweq has quit IRC | 05:06 | |
| *** diablo_rojo has joined #openstack-meeting | 05:10 | |
| *** armax has quit IRC | 05:21 | |
| *** jamesmcarthur has joined #openstack-meeting | 05:22 | |
| *** jamesmcarthur has quit IRC | 05:27 | |
| *** belmoreira has joined #openstack-meeting | 05:30 | |
| *** diablo_rojo has quit IRC | 05:44 | |
| *** tetsuro has quit IRC | 05:49 | |
| *** tetsuro has joined #openstack-meeting | 05:50 | |
| *** tetsuro has quit IRC | 06:03 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:04 | |
| *** tetsuro has joined #openstack-meeting | 06:04 | |
| *** psachin has joined #openstack-meeting | 06:05 | |
| *** janki has joined #openstack-meeting | 06:08 | |
| *** jamesmcarthur has quit IRC | 06:08 | |
| *** slaweq has joined #openstack-meeting | 06:19 | |
| *** joxyuki has joined #openstack-meeting | 06:22 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:25 | |
| *** jamesmcarthur has quit IRC | 06:29 | |
| *** ykatabam has quit IRC | 06:44 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:46 | |
| *** jamesmcarthur has quit IRC | 06:50 | |
| *** rossella_s has quit IRC | 07:01 | |
| *** rcernin has quit IRC | 07:03 | |
| *** jamesmcarthur has joined #openstack-meeting | 07:27 | |
| *** jamesmcarthur has quit IRC | 07:31 | |
| *** akozhevnikov has joined #openstack-meeting | 07:41 | |
| *** priteau has joined #openstack-meeting | 07:41 | |
| *** ahrechny has joined #openstack-meeting | 07:57 | |
| *** kopecmartin has joined #openstack-meeting | 08:00 | |
| *** cloudrancher has joined #openstack-meeting | 08:02 | |
| *** YanXing_an has joined #openstack-meeting | 08:02 | |
| *** phuoc_ has joined #openstack-meeting | 08:03 | |
| *** persia has quit IRC | 08:06 | |
| *** persia has joined #openstack-meeting | 08:07 | |
| *** AndreyS_ has joined #openstack-meeting | 08:12 | |
| *** belmoreira has quit IRC | 08:15 | |
| *** AndreyS_ has quit IRC | 08:16 | |
| *** cloudrancher has quit IRC | 08:16 | |
| *** AndreyS has joined #openstack-meeting | 08:16 | |
| *** cloudrancher has joined #openstack-meeting | 08:17 | |
| *** trinaths has joined #openstack-meeting | 08:21 | |
| *** psachin has quit IRC | 08:22 | |
| phuoc_ | #startmeeting tacker | 08:30 |
| openstack | Meeting started Tue Sep 18 08:30:39 2018 UTC and is due to finish in 60 minutes. The chair is phuoc_. Information about MeetBot at http://wiki.debian.org/MeetBot. | 08:30 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 08:30 |
| *** openstack changes topic to " (Meeting topic: tacker)" | 08:30 | |
| openstack | The meeting name has been set to 'tacker' | 08:30 |
| YanXing_an | cool | 08:30 |
| longkb | Great LOL | 08:31 |
| phuoc_ | #chair YanXing_an | 08:31 |
| openstack | Current chairs: YanXing_an phuoc_ | 08:31 |
| phuoc_ | Because Tacker PTL is not here | 08:31 |
| phuoc_ | I and YanXing_an host this meeting | 08:31 |
| trinaths | Ok | 08:31 |
| phuoc_ | #topic Roll Call | 08:32 |
| *** openstack changes topic to "Roll Call (Meeting topic: tacker)" | 08:32 | |
| phuoc_ | anyone here | 08:32 |
| trinaths | Hi | 08:32 |
| trinaths | I'm trinaths | 08:32 |
| joxyuki | hi | 08:32 |
| phuoc_ | hi trinaths, joxyuki, YanXing_an | 08:33 |
| YanXing_an | phuoc_, hi | 08:33 |
| phuoc_ | #topic Announcements | 08:33 |
| *** openstack changes topic to "Announcements (Meeting topic: tacker)" | 08:33 | |
| phuoc_ | I remind that we will have vPTG on this Friday | 08:34 |
| phuoc_ | #link https://etherpad.openstack.org/p/Tacker-PTG-Stein | 08:35 |
| phuoc_ | the time is on 21 September | 08:35 |
| *** markvoelker has joined #openstack-meeting | 08:36 | |
| YanXing_an | wow, only a few days left | 08:36 |
| phuoc_ | you guys can add your idea in that link, each of topic will be presented | 08:36 |
| phuoc_ | I think the time for each of them is 20~30 minutes | 08:37 |
| joxyuki | I want to talk my topic first because I am available til 8:30 UTC | 08:37 |
| phuoc_ | joxyuki, I will set your topic in the top | 08:38 |
| joxyuki | phouc_, ok :) | 08:38 |
| trinaths | Ok | 08:39 |
| phuoc_ | hi ahrechny, AndreyS, akozhevnikov | 08:39 |
| ahrechny | hi | 08:39 |
| phuoc_ | I see that you guys have proposed some important blueprints | 08:39 |
| ahrechny | yes, and we try to update our reviews before | 08:40 |
| akozhevnikov | hi | 08:41 |
| phuoc_ | I will discuss with other core reviewers like dkushwaha (PTL), YanXing_an, gongysh (ex-PTL) to set you guys blueprints to high priority | 08:41 |
| *** alexchadin has joined #openstack-meeting | 08:41 | |
| *** tetsuro has quit IRC | 08:41 | |
| phuoc_ | and VDU healing too (with contribution from joxyuki and tpatil) | 08:42 |
| joxyuki | yea, I will upload spec by vPTG | 08:43 |
| ahrechny | Yes, we interested in the heal too | 08:43 |
| *** cloudrancher has quit IRC | 08:43 | |
| phuoc_ | did you guys check the time slot, it is from 7:00 UTC to 11:00 UTC | 08:43 |
| phuoc_ | in vPTG, you guys can prepare a simple or detail presentation, and we can discuss and give advices | 08:45 |
| phuoc_ | YanXing_an, I hope you can attend in that day :-) | 08:45 |
| ahrechny | ok, we will prepare it | 08:45 |
| phuoc_ | ahrechny, thanks | 08:46 |
| YanXing_an | phuoc_, i think i can attend it if no urgent things | 08:46 |
| phuoc_ | I think in this meeting, I just remind about vPTG | 08:47 |
| YanXing_an | phuoc_ thanks a lot | 08:48 |
| phuoc_ | We will spend more time on 21 September | 08:48 |
| phuoc_ | Thank you guys | 08:48 |
| phuoc_ | anyone has other thing to talk now | 08:49 |
| trinaths | Can someone share tacker odl devstack localrc .. where I can run through latest addition to tacker | 08:49 |
| phuoc_ | trinaths, I think we can discuss on tacker channel | 08:51 |
| trinaths | Ok | 08:51 |
| trinaths | No issues | 08:51 |
| phuoc_ | I will end the meeting now, thank you ^^ | 08:52 |
| phuoc_ | #endmeeting | 08:52 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 08:52 | |
| openstack | Meeting ended Tue Sep 18 08:52:13 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 08:52 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tacker/2018/tacker.2018-09-18-08.30.html | 08:52 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tacker/2018/tacker.2018-09-18-08.30.txt | 08:52 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tacker/2018/tacker.2018-09-18-08.30.log.html | 08:52 |
| *** joxyuki has left #openstack-meeting | 08:52 | |
| *** trinaths has left #openstack-meeting | 08:53 | |
| *** lbragstad has joined #openstack-meeting | 08:59 | |
| *** belmoreira has joined #openstack-meeting | 09:04 | |
| *** cloudrancher has joined #openstack-meeting | 09:08 | |
| *** belmoreira has quit IRC | 09:10 | |
| *** cloudrancher has quit IRC | 09:10 | |
| *** markvoelker has quit IRC | 09:11 | |
| *** belmoreira has joined #openstack-meeting | 09:11 | |
| *** hyunsikyang has quit IRC | 09:13 | |
| *** YanXing_an has quit IRC | 09:25 | |
| *** kopecmartin has quit IRC | 09:26 | |
| *** alexchadin has quit IRC | 09:26 | |
| *** tetsuro has joined #openstack-meeting | 09:30 | |
| *** alexchadin has joined #openstack-meeting | 09:34 | |
| *** sambetts_ is now known as sambetts | 09:44 | |
| *** longkb has quit IRC | 09:56 | |
| *** Emine has joined #openstack-meeting | 09:58 | |
| *** kopecmartin has joined #openstack-meeting | 10:02 | |
| *** e0ne has joined #openstack-meeting | 10:04 | |
| *** markvoelker has joined #openstack-meeting | 10:07 | |
| *** iyamahat has joined #openstack-meeting | 10:29 | |
| *** yamamoto has quit IRC | 10:31 | |
| *** kopecmartin has quit IRC | 10:31 | |
| *** alexchadin has quit IRC | 10:33 | |
| *** iyamahat has quit IRC | 10:35 | |
| *** markvoelker has quit IRC | 10:41 | |
| *** yamamoto has joined #openstack-meeting | 10:44 | |
| *** litao__ has quit IRC | 10:51 | |
| *** Luzi has joined #openstack-meeting | 10:53 | |
| *** tetsuro has quit IRC | 11:00 | |
| *** alexchadin has joined #openstack-meeting | 11:07 | |
| *** alexchadin has quit IRC | 11:11 | |
| *** alexchadin has joined #openstack-meeting | 11:14 | |
| *** kopecmartin has joined #openstack-meeting | 11:14 | |
| *** artom has joined #openstack-meeting | 11:15 | |
| *** phuoc_ has left #openstack-meeting | 11:18 | |
| *** imacdonn has quit IRC | 11:19 | |
| *** imacdonn has joined #openstack-meeting | 11:19 | |
| *** akozhevnikov has quit IRC | 11:19 | |
| *** tssurya has joined #openstack-meeting | 11:26 | |
| *** alexchadin has quit IRC | 11:36 | |
| *** yamamoto has quit IRC | 11:37 | |
| *** alexchadin has joined #openstack-meeting | 11:40 | |
| *** e0ne has quit IRC | 11:51 | |
| *** cloudrancher has joined #openstack-meeting | 11:55 | |
| *** yamamoto has joined #openstack-meeting | 12:01 | |
| *** markvoelker has joined #openstack-meeting | 12:04 | |
| *** priteau has quit IRC | 12:14 | |
| *** priteau has joined #openstack-meeting | 12:17 | |
| *** kopecmartin has quit IRC | 12:22 | |
| *** cloudrancher has quit IRC | 12:24 | |
| *** raildo has joined #openstack-meeting | 12:26 | |
| *** kopecmartin has joined #openstack-meeting | 12:54 | |
| *** efried_off is now known as efried | 13:05 | |
| *** mriedem has joined #openstack-meeting | 13:07 | |
| *** r-mibu_ has joined #openstack-meeting | 13:07 | |
| *** r-mibu_ has quit IRC | 13:08 | |
| *** ahrechny has quit IRC | 13:12 | |
| *** r-mibu has joined #openstack-meeting | 13:13 | |
| *** r-mibu has quit IRC | 13:14 | |
| *** mjturek has joined #openstack-meeting | 13:15 | |
| *** r-mibu has joined #openstack-meeting | 13:15 | |
| *** sfotony has joined #openstack-meeting | 13:21 | |
| *** alexchadin has quit IRC | 13:22 | |
| *** dustins has joined #openstack-meeting | 13:26 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:28 | |
| *** awaugama has joined #openstack-meeting | 13:31 | |
| *** alexchadin has joined #openstack-meeting | 13:32 | |
| *** efried is now known as efried_afak | 13:32 | |
| *** efried_afak is now known as efried_afk | 13:32 | |
| *** jamesmcarthur has quit IRC | 13:32 | |
| *** alexchadin has quit IRC | 13:45 | |
| *** efried_afk is now known as efried | 13:47 | |
| *** apetrich has joined #openstack-meeting | 13:48 | |
| *** erlon has joined #openstack-meeting | 13:51 | |
| *** lbragstad has quit IRC | 13:53 | |
| *** lbragstad has joined #openstack-meeting | 13:54 | |
| *** alexchadin has joined #openstack-meeting | 13:54 | |
| *** awaugama has quit IRC | 13:55 | |
| *** mjturek has quit IRC | 13:57 | |
| *** awaugama has joined #openstack-meeting | 13:57 | |
| *** njohnston has joined #openstack-meeting | 13:58 | |
| *** radeks_ has joined #openstack-meeting | 13:58 | |
| *** sfotony1 has joined #openstack-meeting | 14:06 | |
| *** mjturek has joined #openstack-meeting | 14:06 | |
| *** Emine has quit IRC | 14:06 | |
| *** annabelleB has joined #openstack-meeting | 14:07 | |
| *** sfotony has quit IRC | 14:07 | |
| *** sfotony1 has quit IRC | 14:10 | |
| *** jgriffith has quit IRC | 14:10 | |
| *** jgriffith has joined #openstack-meeting | 14:10 | |
| *** alexchadin has quit IRC | 14:11 | |
| *** alexchadin has joined #openstack-meeting | 14:12 | |
| *** radeks_ has quit IRC | 14:14 | |
| *** Emine has joined #openstack-meeting | 14:19 | |
| *** yamamoto has quit IRC | 14:19 | |
| *** rossella_s has joined #openstack-meeting | 14:21 | |
| *** annabelleB has quit IRC | 14:22 | |
| *** bobh has joined #openstack-meeting | 14:22 | |
| *** yamamoto has joined #openstack-meeting | 14:24 | |
| *** yamamoto has quit IRC | 14:24 | |
| *** yamamoto has joined #openstack-meeting | 14:24 | |
| *** annabelleB has joined #openstack-meeting | 14:28 | |
| *** rossella_s has quit IRC | 14:29 | |
| *** yamamoto has quit IRC | 14:29 | |
| *** Luzi has quit IRC | 14:30 | |
| *** rossella_s has joined #openstack-meeting | 14:33 | |
| *** mjturek has quit IRC | 14:43 | |
| *** hongbin has joined #openstack-meeting | 14:46 | |
| *** mjturek has joined #openstack-meeting | 14:47 | |
| *** iyamahat has joined #openstack-meeting | 14:52 | |
| *** rossella_s has quit IRC | 14:56 | |
| *** rossella_s has joined #openstack-meeting | 15:01 | |
| *** armax has joined #openstack-meeting | 15:02 | |
| *** AndreyS has quit IRC | 15:09 | |
| *** jamesmcarthur has joined #openstack-meeting | 15:12 | |
| *** belmoreira has quit IRC | 15:15 | |
| *** Leo_m has joined #openstack-meeting | 15:22 | |
| *** felipemonteiro has joined #openstack-meeting | 15:24 | |
| *** Emine has quit IRC | 15:31 | |
| *** felipemonteiro has quit IRC | 15:39 | |
| *** ssbarnea has joined #openstack-meeting | 15:41 | |
| *** bobh has quit IRC | 15:46 | |
| slaweq | #startmeeting neutron_ci | 16:00 |
| openstack | Meeting started Tue Sep 18 16:00:37 2018 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** jamesmcarthur has quit IRC | 16:00 | |
| *** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
| slaweq | hi | 16:00 |
| openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
| *** mlavalle has joined #openstack-meeting | 16:00 | |
| mlavalle | o/ | 16:00 |
| *** sfotony has joined #openstack-meeting | 16:01 | |
| slaweq | lets wait few more minutes for others | 16:01 |
| slaweq | maybe someone else will join | 16:01 |
| mlavalle | np | 16:02 |
| *** longkb has joined #openstack-meeting | 16:02 | |
| mlavalle | I didn't show up late, did I? | 16:02 |
| slaweq | mlavalle: no, You were just on time :) | 16:02 |
| mlavalle | I was distracted doing the homework you gave me last meeting and I was startled by the time | 16:03 |
| * haleyb wanders in | 16:03 | |
| slaweq | :) | 16:03 |
| *** jamesmcarthur has joined #openstack-meeting | 16:04 | |
| njohnston | o/ | 16:04 |
| slaweq | hi njohnston :) | 16:04 |
| slaweq | lets start then | 16:04 |
| njohnston | hello slaweq, sorry I am late - working on a bug | 16:05 |
| slaweq | #topic Actions from previous meetings | 16:05 |
| *** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 16:05 | |
| slaweq | njohnston: no problem :) | 16:05 |
| slaweq | * mlavalle to talk with mriedem about https://bugs.launchpad.net/neutron/+bug/1788006 | 16:05 |
| openstack | Launchpad bug 1788006 in neutron "Tests fail with "Server [UUID] failed to reach ACTIVE status and task state "None" within the required time ([INTEGER] s). Current status: BUILD. Current task state: spawning."" [Critical,Fix released] - Assigned to Slawek Kaplonski (slaweq) | 16:05 |
| slaweq | I think it's done, right? :) | 16:05 |
| mlavalle | we did and we fixed it | 16:05 |
| mriedem | yar | 16:05 |
| mlavalle | \o/ | 16:05 |
| mriedem | virt_type=qemu | 16:05 |
| mlavalle | thanks mriedem | 16:05 |
| slaweq | thx mriedem for help on that | 16:05 |
| njohnston | \o/ | 16:06 |
| slaweq | ok, next one | 16:06 |
| slaweq | * mlavalle continue debugging failing MigrationFromHA tests, bug https://bugs.launchpad.net/neutron/+bug/1789434 | 16:06 |
| openstack | Launchpad bug 1789434 in neutron "neutron_tempest_plugin.scenario.test_migration.NetworkMigrationFromHA failing 100% times" [High,Confirmed] - Assigned to Miguel Lavalle (minsel) | 16:06 |
| mlavalle | manjeets took over that bug last week | 16:06 |
| slaweq | yes, I saw but I don't think his approach to fix that is good | 16:06 |
| manjeets | ++ | 16:06 |
| mlavalle | he literally stole it from my hands, despite my strong resistance ;-) | 16:07 |
| slaweq | LOL | 16:07 |
| slaweq | I can imagine that mlavalle :P | 16:07 |
| mlavalle | manjeets: I am going to assign the bug to you, ok? | 16:07 |
| manjeets | mlavalle, ++ | 16:07 |
| slaweq | I was looking on it also quickly during the weekend | 16:07 |
| slaweq | and I think that it is again some race condition or something like that | 16:08 |
| manjeets | It could be some subscribed callback as well ? | 16:08 |
| slaweq | IMO this ports set to down should comes from L2 agent, not directly from l3 service plugin | 16:08 |
| slaweq | becasuse it is something like: neutron-sever sends notification that router is disabled to L3 agent, L3 agent removes ports so L2 agent updates ports to down status (probably) | 16:09 |
| slaweq | and probably there is no this notification send properly and because of that other things didn't happens | 16:09 |
| slaweq | haleyb: mlavalle does it makes sense for You? or I missunderstood something in this workflow maybe? | 16:10 |
| *** mjturek has quit IRC | 16:10 | |
| haleyb | slaweq: yes, that makes sense. originally i thought it was in the hadbmode code, but l2 is maybe more likely | 16:11 |
| mlavalle | agree | 16:11 |
| * manjeets take a note will dig into l2 | 16:11 | |
| haleyb | but it's someone getting the event and missing something | 16:11 |
| slaweq | give me a sec, I will check one thing according to that | 16:12 |
| *** mjturek has joined #openstack-meeting | 16:12 | |
| slaweq | so what I found was that when I was checking migrtation from Legacy to HA, ports were down after this notification: https://github.com/openstack/neutron/blob/master/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py#L55 | 16:14 |
| slaweq | in case of migration from HA it didn't happen | 16:14 |
| slaweq | but I didn't have more time on the airport to dig more into it | 16:15 |
| manjeets | slaweq, you that notification wasn't called in case of HA ? | 16:15 |
| manjeets | you mean** | 16:15 |
| slaweq | I think that it was called but then "hosts" list was empty and it wasn't send to any agent | 16:16 |
| slaweq | but it has to be checked still, I'm not 100% sure | 16:16 |
| manjeets | i'll test that today | 16:16 |
| slaweq | ok, thx manjeets | 16:17 |
| manjeets | the host thing if its empty in case | 16:17 |
| slaweq | so I will assign this to You as an action, ok? | 16:17 |
| manjeets | sure ! | 16:17 |
| slaweq | thx | 16:17 |
| slaweq | #action manjeets continue debugging why migration from HA routers fails 100% of times | 16:17 |
| slaweq | ok, lets move on | 16:17 |
| slaweq | next one | 16:18 |
| slaweq | * mlavale to check issue with failing test_attach_volume_shelved_or_offload_server test | 16:18 |
| manjeets | but the issue occurs after migration to HA , migration from HA worked | 16:18 |
| manjeets | slaweq, its migration to HA, from HA i think is fine | 16:18 |
| slaweq | manjeets: http://logs.openstack.org/29/572729/9/check/neutron-tempest-plugin-dvr-multinode-scenario/21bb5b7/logs/testr_results.html.gz | 16:19 |
| slaweq | first example | 16:19 |
| slaweq | from HA to any other fails always | 16:19 |
| mlavalle | yes, that was my experience when I tried it | 16:19 |
| manjeets | ah ok got it ! | 16:20 |
| slaweq | :) | 16:20 |
| mlavalle | are we moving on then? | 16:20 |
| slaweq | I think we can | 16:20 |
| mlavalle | That bug was the reason I was almost late for this meeting | 16:21 |
| mlavalle | we have six instances in kibana over the past 7 days | 16:21 |
| mlavalle | two of them is with the experimental queue | 16:21 |
| slaweq | so not too many | 16:21 |
| *** mjturek has quit IRC | 16:22 | |
| mlavalle | njohnston is playing with change 580450 and the experimental queue | 16:22 |
| njohnston | yes | 16:22 |
| slaweq | so it's njohnston's fault :P | 16:22 |
| njohnston | => fault <= | 16:22 |
| njohnston | :-) | 16:22 |
| mlavalle | the other failures are with neutron-tempest-ovsfw and tempest-multinode-full, which are non voting if I remember correctly | 16:22 |
| slaweq | IIRC this issue was caused by instance was not pinging after shelve/unshelve, right? | 16:23 |
| mlavalle | yeah | 16:24 |
| mlavalle | we get a timeout | 16:24 |
| slaweq | maybe something was changed in nova then and this is not an issue anymore? | 16:24 |
| mlavalle | I'll dig a little longer | 16:25 |
| mlavalle | before concluding that | 16:25 |
| slaweq | ok | 16:25 |
| mlavalle | for the time being I am just making the point that it is not hitting us very hard | 16:25 |
| slaweq | that is good information | 16:26 |
| slaweq | ok, lets assign it to You for one more week then | 16:26 |
| mlavalle | yes | 16:26 |
| slaweq | #action mlavale to check issue with failing test_attach_volume_shelved_or_offload_server test | 16:26 |
| slaweq | thx mlavalle | 16:26 |
| slaweq | can we go to the next one? | 16:26 |
| * mlavalle has long let go of the hope of meeting El Comandante without getting homework | 16:27 | |
| slaweq | LOL | 16:27 |
| slaweq | mlavalle: next week I will not give You homework :P | 16:27 |
| mlavalle | np whatsoever.... just taking the opportunity to make a joke | 16:28 |
| slaweq | I know :) | 16:28 |
| slaweq | ok, lets move on | 16:28 |
| slaweq | last one | 16:28 |
| slaweq | njohnston to switch fullstack-python35 to python36 job | 16:28 |
| *** bnemec has quit IRC | 16:28 | |
| *** bnemec has joined #openstack-meeting | 16:28 | |
| slaweq | njohnston: are You around? | 16:29 |
| njohnston | yes, I have a change for that up; I think it just needs a little love now that the gate is clear | 16:29 |
| njohnston | I'll check it and make sure it's good to go | 16:29 |
| slaweq | ok, thx njohnston | 16:29 |
| slaweq | sounds good | 16:30 |
| njohnston | https://review.openstack.org/599711 | 16:30 |
| slaweq | #action njohnston will continue work on switch fullstack-python35 to python36 job | 16:30 |
| slaweq | ok, that's all from last meeting | 16:30 |
| slaweq | #topic Grafana | 16:31 |
| *** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:31 | |
| slaweq | http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:31 |
| slaweq | I was checking grafana earlier today and there wasn't many problems there | 16:32 |
| slaweq | at least not problems which we are not aware of :) | 16:32 |
| haleyb | not since we removed the dvr-multinode from the gate :( | 16:32 |
| slaweq | haleyb: yes | 16:32 |
| slaweq | so we have still neutron-tempest-plugin-dvr-multinode-scenario 100% failures but it's related to issue with migration from HA routers | 16:33 |
| slaweq | and issue related to grenade job | 16:33 |
| slaweq | other things I think I in quite good shape now | 16:34 |
| slaweq | I was recently checking also reasons of some failures in tempest jobs and it was usually some issues with volumes (I don't have links to examples now) | 16:34 |
| mlavalle | I have a question | 16:34 |
| slaweq | sure mlavalle | 16:34 |
| mlavalle | This doesn't have an owner: https://bugs.launchpad.net/neutron/+bug/1791989 | 16:35 |
| openstack | Launchpad bug 1791989 in neutron "grenade-dvr-multinode job fails" [High,Confirmed] | 16:35 |
| slaweq | yes, sorry | 16:35 |
| *** longkb has quit IRC | 16:35 | |
| slaweq | I forgot to assign myself to it | 16:35 |
| slaweq | I just did it now | 16:35 |
| *** sambetts is now known as sambetts|afk | 16:35 | |
| mlavalle | it is not voting for the time being, but we need to fix it right? | 16:35 |
| slaweq | yes, I was checking that even today | 16:35 |
| mlavalle | ah ok, question answered | 16:35 |
| mlavalle | thanks | 16:36 |
| slaweq | :) | 16:36 |
| *** bobh has joined #openstack-meeting | 16:36 | |
| slaweq | and I wanted to talk about it now as it's last point on my list for today :) | 16:36 |
| mlavalle | ok | 16:36 |
| slaweq | #topic grenade | 16:36 |
| *** openstack changes topic to "grenade (Meeting topic: neutron_ci)" | 16:36 | |
| slaweq | so speaking about this issue | 16:36 |
| slaweq | yesterday I pushed patch https://review.openstack.org/#/c/602156/6/playbooks/legacy/neutron-grenade-dvr-multinode/run.yaml to neutron | 16:37 |
| *** annabelleB has quit IRC | 16:38 | |
| *** gyee has joined #openstack-meeting | 16:38 | |
| slaweq | together with depends-on from grenade https://review.openstack.org/#/c/602204/7/projects/60_nova/resources.sh it allowed me to log into at least controller node in this job | 16:38 |
| slaweq | so I tried today and then I spawned manually same vm as is spawned by grenade script | 16:39 |
| slaweq | and all worked perfectly fine, instance was pinging after around 5 seconds :/ | 16:39 |
| slaweq | so now I added some additional logs to this grenade script: https://review.openstack.org/#/c/602204/9/projects/60_nova/resources.sh | 16:40 |
| slaweq | and I'm running this job once again: http://zuul.openstack.org/stream.html?uuid=928662f6de054715835c6ef9599aefbd&logfile=console.log | 16:40 |
| slaweq | I'm waiting for results of it | 16:40 |
| *** mjturek has joined #openstack-meeting | 16:40 | |
| *** annabelleB has joined #openstack-meeting | 16:40 | |
| *** bobh has quit IRC | 16:40 | |
| slaweq | I also compared packages installed on nodes in such failed job from this week with packages installed before 7.09 on job which passed | 16:41 |
| slaweq | I have list of packages which have different versions | 16:41 |
| slaweq | there is different libvirt, linux-kernel, qemu, openvswitch | 16:41 |
| slaweq | so many potential culprits | 16:42 |
| slaweq | I think I will start with downgrading libvirt as it was updated in cloud-archive repo on 7.09 | 16:42 |
| haleyb | slaweq: we will eventually figure that one out! | 16:42 |
| slaweq | any ideas what else I can check/test/do here? | 16:43 |
| mlavalle | checking packages seems the right way to go | 16:43 |
| slaweq | yes, so I will try to send some DNM patches with downgraded each of those packages (except kernel) and will try to recheck them few times | 16:44 |
| haleyb | yes, other than that you can keep adding debug commands to the script - eg for looking at interfaces, routes, ovs, etc, but packages is a good first step | 16:44 |
| slaweq | and see if issue will still happen on each of them | 16:44 |
| slaweq | haleyb: yes, I just don't know if it's possible (and how to do it) to run such commands on subnode | 16:45 |
| *** mjturek has quit IRC | 16:45 | |
| slaweq | so currently I only added some OSC commands to check status of instance/port/fip on control plane level | 16:45 |
| *** bobh has joined #openstack-meeting | 16:47 | |
| slaweq | so I will continue debugging of this issue | 16:47 |
| slaweq | ohh, one more thing, yesterday we spotted it with haleyb also in stable/pike job | 16:47 |
| slaweq | and when I was looking for this issue in logstash, I found that it happend couple of times in stable/pike | 16:47 |
| slaweq | less than in master but still it happend there also | 16:48 |
| mlavalle | nice ctach | 16:48 |
| mlavalle | catch | 16:48 |
| slaweq | strange thing is that I didn't saw it on stable/queens or stable/rocky branches | 16:48 |
| slaweq | so as this is failing on "old" openstack this means that it fails on neutron with stable/rocky and stable/ocata branches | 16:49 |
| *** yamahata has joined #openstack-meeting | 16:50 | |
| slaweq | and that's all as summary of this f..... issue :/ | 16:50 |
| mlavalle | LOL | 16:50 |
| slaweq | I will assign it to me as an action for this week | 16:51 |
| mlavalle | I see you are learning some Frnech | 16:51 |
| mlavalle | French | 16:51 |
| slaweq | #action slaweq will continue debugging multinode-dvr-grenade issue | 16:51 |
| slaweq | mlavalle: it can be "French" :P | 16:51 |
| * slaweq is becoming Hulk when has to deal with grenade multinode issue ;) | 16:52 | |
| njohnston | LOL! | 16:52 |
| slaweq | ok, that's all from me about this issue | 16:52 |
| slaweq | #topic Open discussion | 16:52 |
| *** openstack changes topic to "Open discussion (Meeting topic: neutron_ci)" | 16:52 | |
| slaweq | do You have anything else to talk about? | 16:53 |
| njohnston | I just sent email to openstack-dev to inquire about the python3 conversion status of tempest and grenade | 16:53 |
| slaweq | thx njohnston, I will read it after the meeting then | 16:53 |
| njohnston | if those conversions have not happened yet, and further if they need to be done globally, that could be interesting. | 16:54 |
| njohnston | But I'll try not to borrow trouble. Thats it from me. | 16:55 |
| slaweq | speaking about emails, I want to ask mlavalle one thing :) | 16:55 |
| mlavalle | ok | 16:55 |
| slaweq | do You remember to send email about adding some 3rd party projects jobs to neutron? | 16:55 |
| mlavalle | yes | 16:55 |
| slaweq | ok, great :) | 16:55 |
| slaweq | ok, so if there is nothing else to talk, I think we can finish now | 16:56 |
| mlavalle | Thanks! | 16:56 |
| slaweq | thanks for attending | 16:57 |
| slaweq | and see You next week | 16:57 |
| slaweq | o/ | 16:57 |
| slaweq | #endmeeting | 16:57 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 16:57 | |
| openstack | Meeting ended Tue Sep 18 16:57:11 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:57 |
| manjeets | bye | 16:57 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-09-18-16.00.html | 16:57 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-09-18-16.00.txt | 16:57 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-09-18-16.00.log.html | 16:57 |
| njohnston | thanks all! o/ | 16:57 |
| *** cloudrancher has joined #openstack-meeting | 16:59 | |
| *** kopecmartin has quit IRC | 17:01 | |
| *** jchhatbar has joined #openstack-meeting | 17:14 | |
| *** mlavalle has left #openstack-meeting | 17:16 | |
| *** janki has quit IRC | 17:17 | |
| *** sfotony has quit IRC | 17:20 | |
| *** alexchadin has quit IRC | 17:25 | |
| *** arne_wiebalck has quit IRC | 17:29 | |
| *** cloudrancher has quit IRC | 17:40 | |
| *** jchhatbar has quit IRC | 17:40 | |
| *** jamesmcarthur has quit IRC | 17:41 | |
| *** bobh has quit IRC | 17:42 | |
| *** electrofelix has quit IRC | 17:45 | |
| *** hemna_ has joined #openstack-meeting | 17:48 | |
| *** goldenfri has joined #openstack-meeting | 17:52 | |
| *** diablo_rojo has joined #openstack-meeting | 17:57 | |
| *** bobh has joined #openstack-meeting | 18:02 | |
| *** mjturek has joined #openstack-meeting | 18:16 | |
| *** iyamahat has quit IRC | 18:17 | |
| *** yamahata has quit IRC | 18:17 | |
| *** alexchadin has joined #openstack-meeting | 18:20 | |
| *** alexchadin has quit IRC | 18:24 | |
| *** iyamahat has joined #openstack-meeting | 18:27 | |
| *** priteau has quit IRC | 18:28 | |
| *** iyamahat_ has joined #openstack-meeting | 18:30 | |
| *** iyamahat has quit IRC | 18:34 | |
| *** alexchadin has joined #openstack-meeting | 18:37 | |
| *** alexchadin has quit IRC | 18:40 | |
| *** alexchadin has joined #openstack-meeting | 18:41 | |
| *** alexchadin has quit IRC | 18:44 | |
| *** yamahata has joined #openstack-meeting | 18:48 | |
| *** dustins has quit IRC | 18:52 | |
| *** Shrews has joined #openstack-meeting | 18:54 | |
| *** annabelleB has quit IRC | 18:56 | |
| clarkb | Hello, anyone here for the infra meeting? | 19:00 |
| *** annabelleB has joined #openstack-meeting | 19:00 | |
| clarkb | I expect it may be a light crowd, but I'll probably run through the topics anyway as there is PTG related material and not everyone would have been able to attend the PTG | 19:00 |
| ianw | o/ | 19:00 |
| clarkb | #startmeeting infra | 19:01 |
| openstack | Meeting started Tue Sep 18 19:01:09 2018 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
| *** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
| openstack | The meeting name has been set to 'infra' | 19:01 |
| clarkb | #link https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting | 19:01 |
| clarkb | #topic Announcements | 19:01 |
| *** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:01 | |
| Shrews | ohai | 19:01 |
| diablo_rojo | o/ | 19:01 |
| clarkb | Mostly just a reminder that last week was the PTG and this week it seems like a good chunk of the team is either on vacation or something resembling vacation so that they can deal with a hurricane | 19:02 |
| clarkb | #topic Actions from last meeting | 19:02 |
| *** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:02 | |
| clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-09-04-19.01.txt minutes from last meeting | 19:02 |
| clarkb | There weren't any concrete actions listed. It was prep for PTG for many of us I think | 19:03 |
| clarkb | Maybe I should do a high level recap of the PTG then we can dig in through the rest of our agenda | 19:03 |
| clarkb | #topic High level PTG recap | 19:03 |
| *** openstack changes topic to "High level PTG recap (Meeting topic: infra)" | 19:03 | |
| ianw | ++ | 19:04 |
| clarkb | The first two days of the PTG the infra team was in the "Ask Me Anything" helproom | 19:04 |
| clarkb | This ended up being fairly productive. We ended up helping OSA with various zuul related job questions as well as pointing them in the direction of how to reproduce those builds locally (I think we may see them push changes to make that possible in the near future) | 19:04 |
| clarkb | Swift came by a couple times as they were working on multinode functional testing and doc build updates | 19:05 |
| notmyname | clarkb: and we're just waiting on zuul to land it! thanks for your help (https://review.openstack.org/#/c/601686/) | 19:05 |
| tdasilva | thanks for the help :) | 19:05 |
| clarkb | Tripleo/RDO are interesting in how we might do OVB (something virtual baremetal) testing. Which requires working PXE boot which requires layer 2 broadcast for dhcp in the current design | 19:06 |
| clarkb | one suggestion was to test the pxe provisioning independent of the workload those nodes run so that OVB can boot lightweight instances using our existing network overlays and qemu then test the workload on nodepool provisioned nodes so that nested virt isn't a problem | 19:07 |
| clarkb | Sahara and others were interested in third part CI as well as zuul v3 | 19:07 |
| clarkb | ianw: ^ I tried pushing people to your spec to see if we could get a volunteer to write out what that looks like in practice | 19:07 |
| clarkb | ianw: the other popular idea was to just use software factory | 19:07 |
| clarkb | which apparently works very well out of the box at small scale (but needs tuning as things grow) | 19:07 |
| clarkb | I also helped StarlingX sketch out their docs publishing which intersected with AFS ( you may have seen chagnes from dtroyer and myself for that which I think are not yet merged ) | 19:08 |
| ianw | i've actually updated that spec, so was interested if there was talk on it | 19:08 |
| clarkb | ianw: the sense I got was that for most users they would be fine just using software factory | 19:08 |
| clarkb | which is maybe a reasonable thing to point people at | 19:09 |
| clarkb | Jan from I forget South African networking company in particular was a fan of that | 19:09 |
| clarkb | (I'm really bad with names sorry) | 19:09 |
| Shrews | yeah, i think SF is pretty solid and close to what we run | 19:09 |
| Shrews | a few extras | 19:09 |
| clarkb | Another recurrent topic in the helproom was working around nested virt | 19:10 |
| clarkb | I think where we have gotten with that is if we can continue to push on our cloud providers to have better communications channels we can explore the possibility of nested virt enabled flavors. Then jobs are best effort if they run on that. Basically you'd have to talk to the cloud not infra if they break in weird ways. I think that should happen once we've largely moved to bionic though | 19:10 |
| clarkb | new kernels seem to lead to new nested virt trouble | 19:11 |
| clarkb | That was Monday and Tuesday | 19:11 |
| clarkb | Wednesday and Thurday were infra dedicated time. The first day was largely spent getting Zuul to trigger CD updates of Zuul via bridge.o.o | 19:11 |
| clarkb | Turns out this is more complicated than we originally anticipated. Current status is we have a job that will add bridge.o.o to its inventory then fail to ssh to bridge.o.o because we only allow ssh in as root from bridge and puppetmaster | 19:12 |
| clarkb | (we can talk about this more in the priority topic section of the meeting) | 19:12 |
| * fungi is sorta here for a few minutes, but not completely and may disappear again shortly | 19:13 | |
| clarkb | To get to that point we addressed quite a few of the smaller issues we've run into with ansible. Including upgrading ansible to 2.7.0rcX on bridge.o.o which seemed to speed up execution of ansible | 19:13 |
| clarkb | Overall it was quite useful in getting ansible things running more reliably | 19:13 |
| clarkb | Thursday was the last day of Infra dedicated time and we used it to talk about the other items on our etherpad. I and others tried to take notes about the conversation there. /me picks out some highlights | 19:13 |
| clarkb | The openstack transition from xenial to bionic will ideally be managed by the openstack project with infra and zuul teams assisting | 19:14 |
| *** raildo has quit IRC | 19:14 | |
| clarkb | fungi: will be sending out mailing list merge plan details as soon as the hurricane allows | 19:14 |
| fungi | yup | 19:14 |
| fungi | the list creation change has been up for review since friday, btw | 19:15 |
| clarkb | The lounge has come up again as a thing we shoudl try to run to make irc more friendly to new users | 19:15 |
| clarkb | ttx volunteered to make that a 20% time project of his | 19:15 |
| fungi | #link https://review.openstack.org/602781 Create the OpenStack discussion mailing list | 19:15 |
| clarkb | mostly need to figure out authentication for our users there | 19:15 |
| clarkb | And finally there was a conversation in which kmalloc volunteered to start buildign a proof of concept for authentication/identity aggregation so that we can point gerrit and wiki and storyboard etc at a single identity provider that proxies for say launchpad, openstackid, github, or whatever else people want | 19:16 |
| fungi | ideally 602781 will be merged and the resulting list locked down before i announce its existence | 19:16 |
| clarkb | fungi: would it be best for us to +2 then you can approve and lock down when ready? | 19:16 |
| fungi | sure, wfm | 19:17 |
| clarkb | I think that is it for a high level recap | 19:17 |
| clarkb | Before we talk the config management update priority effort anything I missed people want more info on? | 19:17 |
| clarkb | or topics that I skimmed too much on in general? | 19:17 |
| *** mrhillsman has joined #openstack-meeting | 19:18 | |
| Shrews | any experimenting/discussing the dockerhub zuul/nodepool containers? | 19:18 |
| clarkb | Shrews: we did discuss some of the pain points that SpamapS ran into with the pbrx generated images in the helproom | 19:18 |
| clarkb | Shrews: I think we had general consensus that we should improve zuul's default behavior around daemonizing to be more container friendly as well as improving the documentation aroudn what each image is/does | 19:19 |
| clarkb | but otherwise SpamapS said the images were working for him they just had to have some minor tweaks done | 19:19 |
| Shrews | cool | 19:19 |
| clarkb | zuul-base vs zuul image is confusing. Also you don't want to daemonize by default in docker containers | 19:20 |
| *** raildo has joined #openstack-meeting | 19:20 | |
| clarkb | #topic Update Config Management | 19:20 |
| *** openstack changes topic to "Update Config Management (Meeting topic: infra)" | 19:20 | |
| clarkb | Don't forget to review 'topic:puppet-4 and topic:update-cfg-mgmt' changes in gerrit | 19:21 |
| clarkb | This is what msot of the time was dedicated to at the PTG. cmurphy has got quite a few services puppeting under puppet 4 parser (and improved the inventory listing to make it less merge conflicty) | 19:21 |
| clarkb | Then mordred corvus jhesketh myself et al worked on setting up Zuul to trigger ansible playbook runs on bridge.o.o so that we can run CD from zuul | 19:22 |
| clarkb | There are two big things we need to address to make ^ possible. The first is we only allow ssh as root into the bridge from the bridge and puppetmaster. We need a zuul user on bridge or we need to allow the zuul executors to ssh into bridge.o.o as root | 19:23 |
| clarkb | I'm actually leaning towards adding a zuul user myself since we already manage arbitrary users that can ssh in and sudo | 19:23 |
| clarkb | The other item is our support for nil nodeset jobs is pretty basic in our base jobs | 19:23 |
| clarkb | we don't get all the same logging for example nor do we clean out the master ssh key from the ssh agent like we do on jobs with a nodeset | 19:24 |
| clarkb | Another item to be aware of is mordred is writing a new inventory plugin for us that will more quickly filter and add nodes to groups than the current constructed plugin can do (the constructed plugin accounts for like 2 minutes of every ansible-playbook run right now, it isn't fast) | 19:25 |
| clarkb | mordred: ^ you aren't around today to talk about that are you | 19:25 |
| clarkb | there were some unexpected runtime behaviors around removing nodes from groups that I don't think have been solved yet | 19:25 |
| Shrews | 2 minutes? eek | 19:26 |
| clarkb | Shrews: ya its creating and evaluating a jinja template for all our groups X all our hosts | 19:26 |
| clarkb | something like 10k jinja template evaluations | 19:26 |
| fungi | matrix expansion at its finest | 19:26 |
| Shrews | cartesian inventory ftw | 19:27 |
| clarkb | to summarize this topic we are in a much more reliable state for running ansible frequently in a loop than we were last week. But still work to be done to get zuul talking to bridge.o.o to trigger ansible runs there | 19:27 |
| clarkb | Also the puppet-4 futureparser work continues and if you can help review those changes I'm more than happy to approve them when I can monitor them :) | 19:28 |
| clarkb | #topic General Topics | 19:28 |
| *** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:28 | |
| clarkb | Lets keep moving because we have half an hour left and plenty of other items related to PTG to talk about :) | 19:28 |
| clarkb | OpenDev | 19:28 |
| clarkb | it hda been about 3 weeks without seeing any strong opposition to the OpenDev name (the only thing I saw aws concern about confusion with the conference and fungi made a strong argument for why that shouldn't be a problem and that seemed to settle it on the therpad) | 19:29 |
| clarkb | I went ahead and decided it was important for us to keep making progress on this and did the no news is good news thing and sent email to the list saying we should go with it | 19:29 |
| clarkb | one thing corvus brought up at the PTG is that we should enlist the help of the OpenStack Foundation to draft clear communications about what this means for existing and potential new projects | 19:30 |
| *** priteau has joined #openstack-meeting | 19:30 | |
| *** tobiash has joined #openstack-meeting | 19:30 | |
| clarkb | one concern in particular being that if we aren't careful we could send the message that this is just a rename of the openstack infra team and they exist only to serve openstack the project | 19:30 |
| clarkb | I've got it on my todo to talk to the foundation about drafting this | 19:31 |
| clarkb | From a technical perspective we will spin up ns1.opendev.org ns2.opendev.org and adns1.opendev.org. Host opendev.org DNS there and then migrate zuul-ci.org DNS there then delete ns*.openstack.org | 19:31 |
| clarkb | that is sort of a step 0 to starting to host things with that name branding. | 19:32 |
| clarkb | corvus: has volunteered to spin those up | 19:32 |
| fungi | just want to chime in with my support for self-hosting dns as the day-zero prerequisite | 19:32 |
| clarkb | The last related item on my list si that we should consider booting new servers eg etherpad01.openstack.org replacement as etherpad01.opendev.org in nova so that we don't have to replace everything once we do trusty upgrades | 19:33 |
| clarkb | that will likely be a case by case basis (and in that particular example it would continue to run etherpad.openstack.org since dns won't necessarily be up yet and comms won't have been sent out yet) | 19:33 |
| clarkb | just a nova api bookkeeping item. | 19:33 |
| *** mjturek has quit IRC | 19:34 | |
| *** alexchadin has joined #openstack-meeting | 19:34 | |
| clarkb | Questions, concerns, thoughts on OpenDev before we move on to the next item? | 19:34 |
| mnaser | (yay for opendev) | 19:34 |
| *** bobh has quit IRC | 19:34 | |
| Shrews | are we going to use resources donated for openstack for opendev? | 19:35 |
| Shrews | any concerns around that? | 19:35 |
| * fungi is looking forward to typing two fewer keys for our urls ;) | 19:35 | |
| clarkb | Shrews: the clouds we've spoken too so far (mostly vexxhost and potential arm resources) seem tothink that being a little more generic is easier to sell | 19:36 |
| clarkb | Shrews: but we haven't talked to all of them yet. | 19:36 |
| clarkb | Shrews: what I like to point out is that tripleo + nova + neutron are ~80% of our resource utilization | 19:36 |
| clarkb | and I don't expect that will change | 19:36 |
| fungi | some of the sentiment was that resources are being donated to primarily serve the communities operated under the osf, and that won't really change | 19:36 |
| Shrews | makes sense | 19:36 |
| clarkb | Shrews: and we've always hosted related projects its just that many are unwilling to do so with "openstack" featured so prominently with branding and naming | 19:37 |
| clarkb | its definitely somethign to be aware of though | 19:37 |
| Shrews | 19:37 | |
| Shrews | k | 19:37 |
| *** alexchadin has quit IRC | 19:38 | |
| clarkb | Speaking of ARM we have a new linaro cloud region | 19:38 |
| clarkb | ianw: ^ thank you for setting that up | 19:38 |
| ianw | i think fungi has leads on more arm resources? | 19:39 |
| clarkb | in parallel to that Gary Perkins is spinning up another arm cloud https://review.openstack.org/#/c/602436/ | 19:39 |
| ianw | there's certainly a review out for adding credentials | 19:39 |
| clarkb | ya I think fungi got the secret portions of the credentials ^ fungi any idea if we are good to move forward on that at this point? | 19:39 |
| fungi | yeah, if someone has time to pick up the creds are in a file in my homedir on bridge.o.o at the moment | 19:39 |
| clarkb | ah, we need to add them to hiera but after that should be good to go? | 19:40 |
| ianw | fungi: ahh, cool, i can take a look. i know we got confirmation it works with the same images nb03.o.o is producing, which is good | 19:40 |
| fungi | ~fungi/temp_clouds.yaml | 19:40 |
| fungi | i was trying to get it working well enough with osc to reset the password | 19:40 |
| fungi | but didn't get quite that far yet | 19:40 |
| fungi | was running into some sort of error i think with my syntax there | 19:40 |
| clarkb | ianw: ^ let me know if I can help too | 19:41 |
| fungi | anyway, feel free to take that over, i was mostly acting as an in-person secrets receptacle | 19:41 |
| clarkb | prometheanfire has been working to get gentoo images running in nodepool | 19:42 |
| clarkb | I think those are close but may need some small tweaks still. Mostly a heads up that this is happening and probably still slightly broken | 19:42 |
| ianw | i guess we should promote that to voting jobs in dib | 19:43 |
| clarkb | most of the issues so far have been around unbound config, gentoo is different than other distros | 19:43 |
| clarkb | I think we are past that particular set of problems now though | 19:43 |
| ianw | my one concern is that nobody but prometheanfire has really every maintained those in dib | 19:43 |
| clarkb | ya, I'm not really a gentooian myself having never run it | 19:44 |
| clarkb | but we do have other gentoo people in the larger community (like ttx) | 19:44 |
| Shrews | what's the need for gentoo? | 19:44 |
| Shrews | just more os coverage? | 19:44 |
| clarkb | Shrews: OSA is interested in supporting it, and the consequence of that will be that gentoo doesn't need their own tooling for openstack support | 19:44 |
| Shrews | gotcha | 19:45 |
| fungi | certainly a good option for some kinds of bleeding-edge versions of dependencies and platform testing | 19:45 |
| *** awaugama has quit IRC | 19:45 | |
| Shrews | or for folks who really like waiting on compiles | 19:46 |
| persia | There was some talk of precompiling most things for the test nodes | 19:46 |
| clarkb | Heads up that OVH is doing openstack upgrades in BHS1 tonight. THis has a couple of consequences for us. First is that we'll disable nodepool in BHS1 this afternoon (I'll approve that change later today). The other is my IRC bouncer runs on ovh openstack in BHS1 so uh I may not be around in the morning while I recover :) | 19:47 |
| fungi | if i ever get around to it i'll try to get debian unstable images building too (which is remarkably stable, contrary to its name, i've run it for a nearly two decades) | 19:47 |
| clarkb | On October 10th they will do the same in GRA1 | 19:47 |
| clarkb | And the last thing on my list of agenda items is there is an openstack baord meeting in 13 minutes | 19:47 |
| *** bobh has joined #openstack-meeting | 19:47 | |
| clarkb | #link http://lists.openstack.org/pipermail/foundation/2018-September/002620.html OpenStack Board Meeting after this meeting | 19:48 |
| mordred | clarkb: ohai | 19:48 |
| clarkb | This meeting will cover the plans for focus areas and new projects like zuul and starlingx and airship and kata | 19:48 |
| mordred | clarkb: sorry my brain still isn't quite working | 19:48 |
| fungi | a wild board member appears! | 19:48 |
| clarkb | I know that particular topic is of interest to many around here so feel free to join | 19:48 |
| *** dustins has joined #openstack-meeting | 19:48 | |
| Shrews | mordred: that implies that it once *did* work | 19:48 |
| clarkb | I'll dial in then work on this conference talk slide deck probably :) | 19:49 |
| *** mjturek has joined #openstack-meeting | 19:49 | |
| clarkb | also lunch | 19:49 |
| fungi | i have to miss the board call this time, but have confidence that others will fill me in | 19:49 |
| clarkb | #topic Open Discussion | 19:49 |
| *** openstack changes topic to "Open Discussion (Meeting topic: infra)" | 19:49 | |
| ianw | fungi: my laptop sleep state would like to disagree with you on debian unstable stability ;) | 19:49 |
| clarkb | Anything else? feel free to dig into mroe PTG related stuff too | 19:49 |
| clarkb | ianw: ha | 19:50 |
| fungi | ianw: fair, let's try to avoid putting our servers to sleep ;) | 19:50 |
| clarkb | fungi: that is how live migration works fwiw | 19:50 |
| fungi | something tells me we don't care if a live migration of one of our test nodes fails | 19:50 |
| *** bobh has quit IRC | 19:52 | |
| clarkb | mordred: when your brain does start working you may want to sync up on the current zuul cd to brideg issues | 19:52 |
| clarkb | mordred: they are just tricky enough that I think we should consider them a bit before choosing a path forward | 19:52 |
| ianw | if people want to look at the 3rd party ci spec, i think it's about done | 19:54 |
| *** alexchadin has joined #openstack-meeting | 19:54 | |
| ianw | #link https://review.openstack.org/#/c/563849/ | 19:54 |
| mordred | clarkb: ++ | 19:54 |
| ianw | however, i'm also willing to promote softwarefactory to a more prominent "this is a solution", if that's what people want | 19:54 |
| clarkb | ianw: I think its what people are doing, unsure if its what they all want | 19:55 |
| clarkb | but those doing it with software factory do seem happy with it | 19:55 |
| kmalloc | o/ | 19:55 |
| * kmalloc reads backscroll and confirms what folks said re: volunteering | 19:56 | |
| clarkb | Seems like we are winding down now. Thank you everyone. If any of this doesn't make sense or is crazy or needs further clarification please do reach out to me or start a mailing list thread and we can discuss it further | 19:57 |
| clarkb | (I'm happy to start a thread if you aren't comfortable with it either) | 19:58 |
| clarkb | with that I'll give you all a minute to dial into the baord meeting if you choose or have breakfast or dinner etc :) | 19:58 |
| clarkb | #endmeeting | 19:58 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 19:58 | |
| openstack | Meeting ended Tue Sep 18 19:58:35 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:58 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-09-18-19.01.html | 19:58 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-09-18-19.01.txt | 19:58 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-09-18-19.01.log.html | 19:58 |
| *** Shrews has left #openstack-meeting | 19:58 | |
| *** bobh has joined #openstack-meeting | 19:58 | |
| *** gouthamr has quit IRC | 20:00 | |
| *** stevebaker has quit IRC | 20:01 | |
| *** dmellado has quit IRC | 20:01 | |
| *** david-lyle is now known as dklyle | 20:02 | |
| *** gouthamr has joined #openstack-meeting | 20:03 | |
| *** bobh has quit IRC | 20:03 | |
| *** raildo_ has joined #openstack-meeting | 20:04 | |
| *** alexchadin has quit IRC | 20:04 | |
| *** raildo has quit IRC | 20:06 | |
| *** bobh has joined #openstack-meeting | 20:16 | |
| *** erlon has quit IRC | 20:16 | |
| *** bobh has quit IRC | 20:20 | |
| *** rmascena__ has joined #openstack-meeting | 20:26 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:26 | |
| *** bobh has joined #openstack-meeting | 20:27 | |
| *** raildo_ has quit IRC | 20:29 | |
| *** munimeha1 has joined #openstack-meeting | 20:31 | |
| *** bobh has quit IRC | 20:31 | |
| *** rmascena__ has quit IRC | 20:35 | |
| *** bobh has joined #openstack-meeting | 20:37 | |
| *** bobh has quit IRC | 20:41 | |
| *** janders_ has joined #openstack-meeting | 20:43 | |
| *** efried has quit IRC | 20:44 | |
| *** efried has joined #openstack-meeting | 20:44 | |
| *** mjturek has quit IRC | 20:47 | |
| *** bobh has joined #openstack-meeting | 20:48 | |
| *** bobh has quit IRC | 20:52 | |
| *** oneswig has joined #openstack-meeting | 20:54 | |
| *** rbudden has joined #openstack-meeting | 20:55 | |
| *** r-mibu has quit IRC | 20:56 | |
| *** b1air has joined #openstack-meeting | 20:57 | |
| *** priteau has quit IRC | 20:57 | |
| *** bobh has joined #openstack-meeting | 20:57 | |
| *** priteau has joined #openstack-meeting | 20:59 | |
| oneswig | it's that time again | 21:00 |
| oneswig | #startmeeting scientific-sig | 21:00 |
| openstack | Meeting started Tue Sep 18 21:00:26 2018 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| janders_ | g'day everyone | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: scientific-sig)" | 21:00 | |
| openstack | The meeting name has been set to 'scientific_sig' | 21:00 |
| oneswig | greetings janders_ and all | 21:00 |
| oneswig | what's new? | 21:00 |
| oneswig | #link agenda for today is https://wiki.openstack.org/wiki/Scientific_SIG#IRC_Meeting_September_18th_2018 | 21:01 |
| *** bobh has quit IRC | 21:02 | |
| oneswig | Tomorrow is upgrade day over here... but this specific time it's Pike->Queens | 21:02 |
| oneswig | We've been doing the drill on the staging environment but there's nothing quite like the real thing ... | 21:03 |
| janders_ | oneswig: what are the main challenges? | 21:03 |
| oneswig | In this case, not too many. One concern is correctly managing resource classes in Ironic | 21:04 |
| janders_ | right! are you doing BIOS/firmware upgrades as well? | 21:04 |
| oneswig | oh no. That's not in the plan (should it be I wonder?) | 21:05 |
| b1air | o/ | 21:05 |
| oneswig | G'day b1air, which airport are you in today? :-) | 21:05 |
| b1air | Do all the changes all at once!! | 21:05 |
| janders_ | if you were to, would you use something like lifecycle manager, or would you temporarily boot ironic nodes into a "service image" with all the tools? | 21:05 |
| b1air | Very near AKL as it happens | 21:05 |
| oneswig | Fighting talk from a safe distance, that | 21:06 |
| b1air | ;-) | 21:06 |
| oneswig | janders_: last time we did this, it was the latter - a heat stack for all compute instances with a service image in it. | 21:06 |
| *** martial_ has joined #openstack-meeting | 21:07 | |
| janders_ | right! in a KVM-centric world, it's easy - just incorporate all the BIOS/FW management tools in the image. Ironic changes this paradigm so I was wondering how do you go about it. Might be an interesting forum topic. | 21:07 |
| martial_ | (difficulty joining on the phone) | 21:07 |
| oneswig | Have you seen an Ansible playbook for doing firmware upgrades via the dell idrac? | 21:07 |
| oneswig | Hello martial_ | 21:07 |
| *** diablo_rojo has quit IRC | 21:07 | |
| oneswig | #chair b1air martial_ | 21:07 |
| openstack | Current chairs: b1air martial_ oneswig | 21:07 |
| oneswig | (remiss of me) | 21:07 |
| janders_ | do you pxeboot the service image via ironic or outside ironic? | 21:07 |
| oneswig | In that case we booted it like a standard compute instance, via Ironic | 21:08 |
| b1air | KVM world easy? Pull the other one @janders_ ! :-) | 21:08 |
| janders_ | no.. I looked at the playbooks managing the settings but not the BIOS/FW versions. If it works (and I'm not worried about the playbooks, I'm worried about the Dell hardware side :) it'd be gold | 21:08 |
| janders_ | oneswig: does this mean you had to delete all the ironic instances first? | 21:09 |
| janders_ | b1air: KVM world is easy in this one sense :) | 21:09 |
| oneswig | In that case, yes - I guess the lifecycle manager could have avoided that, do you think? | 21:09 |
| *** bobh has joined #openstack-meeting | 21:09 | |
| janders_ | oneswig: yes - it will do all of this in the pre-boot environment (if it works..) | 21:10 |
| *** tssurya has quit IRC | 21:10 | |
| janders_ | when I say "if it works" - on our few hundred nodes of HPC it definitely works for 70-95% nodes. Success rates vary. The ones that failed usually just need more attempts.. (thanks, Dell) | 21:10 |
| b1air | Power drain? | 21:11 |
| janders_ | however I am unsure if Mellanox firmware can be done via Lifecycle Controller (we usually do this part from the compute OS) | 21:11 |
| oneswig | janders_: is this the playbooks at https://github.com/dell/Dell-EMC-Ansible-Modules-for-iDRAC ? | 21:11 |
| b1air | janders_: only if it is a Dell OEM Mellanox part - that's the value add | 21:12 |
| janders_ | b1air: most of our HCAs are indeed OEM - I need to revisit this (I guess the guys have always done this with mft & flint, cause it works 99/100) - in the ironic world doing everything from LC could simplify things | 21:13 |
| *** bobh has quit IRC | 21:14 | |
| janders_ | closer to the main topics - from your experience, how big do the forum sessions typically get? | 21:14 |
| oneswig | janders_: there has also been talk previously of performing these actions as a manual cleaning step - less obtrusive but without out-of-band dependencies on idrac | 21:14 |
| b1air | At Monash we found the LCs to be ok reliability-wise from 13G | 21:15 |
| oneswig | janders_: perhaps we should, indeed, look at the agenda.. | 21:15 |
| oneswig | #topic Forum sessions | 21:15 |
| *** openstack changes topic to "Forum sessions (Meeting topic: scientific-sig)" | 21:15 | |
| oneswig | Forum sessions I've been in have ranged in size from ~8 people to ~50 (but about 12 holding court) | 21:16 |
| janders_ | oneswig: this is a neat way to do it in a rolling fashion - however the drawback is having a mix of versions for quite a while as users delete/reprovision the nodes. I'm trying to come up with an option of doing it all in a defined downtime window, without affecting existing ironic instances. | 21:16 |
| janders_ | b1air: that is great to hear! :) | 21:16 |
| janders_ | oneswig: that is good - it shouldn't be impossible to get some bandwidth in these sessions! :) | 21:16 |
| oneswig | I get the feeling one on Ironic and BIOS firmware management could be interesting! | 21:17 |
| oneswig | Facilitating it but also, conversely, preventing it | 21:17 |
| *** bobh has joined #openstack-meeting | 21:17 | |
| *** gouthamr_ has joined #openstack-meeting | 21:18 | |
| priteau | janders_: I think at CERN they have a way of letting the instance owner select their downtime period | 21:19 |
| priteau | I am trying to find where I saw it described | 21:19 |
| oneswig | Good evening priteau! | 21:20 |
| janders_ | wow - very cool idea.. I wonder if it's leveraging AZs (which might have different downtime windows) or something else | 21:20 |
| priteau | Hi everyone by the way :-) | 21:20 |
| priteau | janders_: it may even be per-host | 21:20 |
| *** dmellado has joined #openstack-meeting | 21:20 | |
| b1air | Sounds a bit like AWS' reboot/downtime scheduling API | 21:21 |
| *** bobh has quit IRC | 21:22 | |
| janders_ | thinking about it - if it's just the instance that's supposed to be up and it has no volumes etc attached it can be quite fine grained | 21:22 |
| janders_ | however if the instance is leveraging any services coming off the control plane, it might be tricky to go below AZ-level downtime | 21:23 |
| janders_ | or at least that's my quick high level thought without looking into details | 21:23 |
| janders_ | very interesting topic though! :) | 21:23 |
| oneswig | question of procedure - do we add a proposal like this to the Ironic forum etherpad, or mint our own SIG etherpad and add it to the list? | 21:24 |
| *** rmascena__ has joined #openstack-meeting | 21:25 | |
| priteau | I found http://openstack-in-production.blogspot.com/2018/01/keep-calm-and-reboot-patching-recent.html, but it's not how I remember it | 21:25 |
| *** rmascena__ has quit IRC | 21:26 | |
| *** gouthamr has quit IRC | 21:26 | |
| oneswig | Another area I am interested in pursuing is support for the recent features introduced to Ironic for alternative boot methods (boot from volume, boot to ramdisk) - is there scope for getting these working with multi-tenant networking? | 21:26 |
| priteau | Maybe there is another procedure for the less critical upgrades | 21:26 |
| *** bobh has joined #openstack-meeting | 21:27 | |
| *** Emine has joined #openstack-meeting | 21:28 | |
| janders_ | oneswig: alternative boot methods would definitely be of interest. Looking at the PTG notes there are some good ideas so it looks like the next step would be to find out if/when these ideas can be implemented | 21:30 |
| janders_ | something from my side (across all the storage-related components) would be BeeGFS support/integration in OpenStack | 21:31 |
| oneswig | Ooh, interesting. | 21:31 |
| janders_ | would you guys be interested in this, too? | 21:31 |
| oneswig | Like, in Manila? | 21:31 |
| janders_ | yes, that's the most powerful scenario | 21:31 |
| oneswig | Absolutely! We've got playbooks for it, but nothing "integrated" | 21:32 |
| *** bobh has quit IRC | 21:32 | |
| oneswig | (but does it need to be?) | 21:32 |
| janders_ | but running VM instances (for those who still need VMs) and cinder volumes off BeeGFS would be of value as well | 21:32 |
| oneswig | That follows quite closely what IBM was up to with SpectrumScale | 21:32 |
| janders_ | given no kerberos support in BeeGFS for the time being I think it would be very useful to have some smarts there | 21:33 |
| oneswig | OK, let's get these down... | 21:33 |
| janders_ | haha! you found the logic behind my thinking | 21:33 |
| oneswig | #link SIG brainstorming ideas https://etherpad.openstack.org/p/BER-stein-forum-scientific-sig | 21:33 |
| janders_ | I liked what IBM have done with GPFS/Spectrum however I find deploying and maintaining this solution more and more painful as time goes | 21:33 |
| janders_ | I see the same sentiment on the storage side | 21:34 |
| janders_ | "it's good, but..." | 21:34 |
| janders_ | I'll add some points to the etherpad now | 21:34 |
| janders_ | ok, you already have - thank you! :) | 21:35 |
| janders_ | another storage related idea | 21:36 |
| *** stevebaker has joined #openstack-meeting | 21:36 | |
| janders_ | would you find it useful to be able to separate storage backends for instance boot drives and ephemeral drives? | 21:36 |
| janders_ | I like the raw performance of node-local SSD/NVMe | 21:36 |
| janders_ | however having something more resilient (and possibly shared) for the boot drive is good, too | 21:37 |
| janders_ | I would happily see support for splitting the two up (I do not think this is possible today, please correct me if I am wrong) | 21:37 |
| goldenfri | I was just thinking about that today, so I 2nd that | 21:37 |
| janders_ | in this case, we could even wipe ephemeral on live migration (this would have to be configurable) so only the boot drive needs to persist | 21:38 |
| oneswig | It seems like a good idea to me, certainly worth suggesting | 21:38 |
| janders_ | ok! | 21:38 |
| *** bobh has joined #openstack-meeting | 21:38 | |
| oneswig | hello goldenfri! | 21:38 |
| goldenfri | o/ | 21:39 |
| priteau | janders_: if the ephemeral storage is mounted while live migrating, wouldn't the guest OS complain if data gets wiped out? | 21:40 |
| *** Emine has quit IRC | 21:40 | |
| janders_ | good point, there would have to be some smarts around it. I don't have this fully thought through yet, but I think the capability would be useful. Perhaps cloud-* services could help facilitate this? | 21:42 |
| oneswig | OK we are linked up to https://wiki.openstack.org/wiki/Forum/Berlin2018#Etherpads_from_Teams_and_Working_Groups | 21:42 |
| janders_ | but obviously if there's heavy IO hitting ephemeral, some service trying to umount /dev/sdb won't have a lot of luck.. | 21:42 |
| b1air | +1 to janders_ ephemeral separation feature request | 21:42 |
| *** bobh has quit IRC | 21:43 | |
| priteau | janders_: VM-aware live migration? | 21:43 |
| b1air | I see it more likely to be used with cold migration | 21:43 |
| b1air | Where you have a fleet of long lived instances that you want to move around due to underlying maintenance etc | 21:44 |
| janders_ | another thing I'm looking at is using trim/discard like features for node cleaning - however bits of this might be already implemented, looking at ironic and pxe_idrac/pxe_ilo bits | 21:46 |
| janders_ | have any of you used this with success? | 21:46 |
| janders_ | (I might have asked this question here already, not sure) | 21:46 |
| b1air | Yes I recall discussing this before, but don't think anything came of it yet | 21:47 |
| oneswig | Did we cover this last week? I think there's an Ironic config parameter for key rotation | 21:47 |
| b1air | With hardware encrypted storage? | 21:47 |
| *** bobh has joined #openstack-meeting | 21:47 | |
| oneswig | We use it, and when I checked up I believe it was as simple as that - with the caveat that some of the drives needed a firmware update (of course!) | 21:48 |
| priteau | janders_: you asked last week ;-) http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-09-12-11.00.log.html#l-139 | 21:48 |
| oneswig | b1air: hardware encryption as I understand it but with an empty secret. | 21:48 |
| *** bobh has quit IRC | 21:48 | |
| oneswig | So not really encryption... | 21:49 |
| *** bobh has joined #openstack-meeting | 21:49 | |
| b1air | Cunning - the baddies will never suspect an empty password! | 21:49 |
| janders_ | oneswig: :) I've discussed this with too many parties and lost track (scientific-sig, RHAT, Dell, ... ) | 21:50 |
| oneswig | janders_: your comrades here are the source of truth, you can't trust those other guys :-) | 21:50 |
| janders_ | that's right :) can't trust those sales organisations | 21:51 |
| oneswig | There was one other matter to cover today, before I forget | 21:51 |
| priteau | keycloack | 21:51 |
| oneswig | #topic SIG event space at Berlin | 21:51 |
| *** openstack changes topic to "SIG event space at Berlin (Meeting topic: scientific-sig)" | 21:51 | |
| oneswig | priteau: I think we have that on the agenda for next week | 21:52 |
| priteau | Oh, I looked at the wrong week :-) | 21:52 |
| oneswig | I know - it's a handy aide memoire for me, probably confusing for anyone else! | 21:52 |
| oneswig | Anyway - We have the option of 1 working group session + 1 bof session (ie, what we've had at previous summits). | 21:53 |
| oneswig | I think this works well enough, unless anyone prefers to shorten it? | 21:53 |
| oneswig | b1air? martial_? Thoughts on that? | 21:53 |
| janders_ | I have couple more forum ideas - given we're running low on time I will fire these away now | 21:56 |
| oneswig | Please do. | 21:57 |
| janders_ | 1) being able to schedule a bare-metal instance to a specific piece of hardware (I don't think this is supported today) - would this be useful to you? | 21:57 |
| janders_ | think --availability-zone host:x.y.z equivalent for Ironic | 21:57 |
| oneswig | On the SIG events - looks like Wednesday morning is clear for the AI-HPC-GPU track | 21:57 |
| oneswig | janders_: I believe that exists, in the form of a three-tuple delimited by colons | 21:58 |
| janders_ | 2) I don't think "nova rebuild" works with baremetal instances - I think it would be something useful | 21:58 |
| oneswig | The form might be nova::<Ironic uuid of the node> | 21:58 |
| oneswig | On 2, are you sure? I think I've rebuilt Ironic instances before | 21:59 |
| *** dustins has quit IRC | 21:59 | |
| oneswig | Let's follow up on that... | 21:59 |
| janders_ | in this case, I will retest both and update the etherpad as required | 21:59 |
| oneswig | good plan, let us know! | 21:59 |
| oneswig | OK, we are out of time | 22:00 |
| oneswig | Thanks everyone | 22:00 |
| oneswig | keep adding to that etherpad if you get more ideas we should advocate | 22:00 |
| *** goldenfri has quit IRC | 22:00 | |
| oneswig | https://etherpad.openstack.org/p/BER-stein-forum-scientific-sig | 22:00 |
| janders_ | thanks guys! | 22:00 |
| oneswig | #endmeeting | 22:01 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 22:01 | |
| openstack | Meeting ended Tue Sep 18 22:01:02 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 22:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-09-18-21.00.html | 22:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-09-18-21.00.txt | 22:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-09-18-21.00.log.html | 22:01 |
| oneswig | until next time! | 22:01 |
| b1air | Bye! | 22:01 |
| *** oneswig has quit IRC | 22:02 | |
| *** rbudden has quit IRC | 22:03 | |
| *** janders_ has quit IRC | 22:05 | |
| *** priteau has quit IRC | 22:05 | |
| *** slaweq has quit IRC | 22:26 | |
| *** annabelleB has quit IRC | 22:36 | |
| *** diablo_rojo has joined #openstack-meeting | 22:36 | |
| *** annabelleB has joined #openstack-meeting | 22:37 | |
| *** tetsuro has joined #openstack-meeting | 22:45 | |
| *** rcernin has joined #openstack-meeting | 22:47 | |
| *** ykatabam has joined #openstack-meeting | 22:47 | |
| *** janki has joined #openstack-meeting | 22:47 | |
| *** tpsilva has quit IRC | 22:52 | |
| *** annabelleB has quit IRC | 22:56 | |
| *** munimeha1 has quit IRC | 22:57 | |
| *** mriedem has quit IRC | 22:59 | |
| *** jamesmcarthur has quit IRC | 23:00 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:01 | |
| *** hongbin has quit IRC | 23:03 | |
| *** jamesmcarthur has quit IRC | 23:07 | |
| *** slaweq has joined #openstack-meeting | 23:11 | |
| *** Leo_m has quit IRC | 23:11 | |
| *** slaweq has quit IRC | 23:16 | |
| *** martial_ has quit IRC | 23:16 | |
| *** dmacpher has quit IRC | 23:26 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!