*** bobh has joined #openstack-meeting | 00:00 | |
*** pchavva has quit IRC | 00:02 | |
*** heyongli has quit IRC | 00:03 | |
*** heyongli has joined #openstack-meeting | 00:03 | |
*** yamamoto has quit IRC | 00:03 | |
*** shaohe_feng has quit IRC | 00:05 | |
*** shaohe_feng has joined #openstack-meeting | 00:06 | |
*** mjturek has quit IRC | 00:08 | |
*** chyka has joined #openstack-meeting | 00:10 | |
*** salv-orlando has joined #openstack-meeting | 00:11 | |
*** heyongli has quit IRC | 00:13 | |
*** heyongli has joined #openstack-meeting | 00:13 | |
*** shaohe_feng has quit IRC | 00:15 | |
*** chyka has quit IRC | 00:15 | |
*** shaohe_feng has joined #openstack-meeting | 00:16 | |
*** salv-orlando has quit IRC | 00:16 | |
*** heyongli has quit IRC | 00:23 | |
*** heyongli has joined #openstack-meeting | 00:23 | |
*** tetsuro has quit IRC | 00:24 | |
*** shaohe_feng has quit IRC | 00:25 | |
*** tetsuro has joined #openstack-meeting | 00:26 | |
*** shaohe_feng has joined #openstack-meeting | 00:26 | |
*** aeng has quit IRC | 00:33 | |
*** heyongli has quit IRC | 00:33 | |
*** heyongli has joined #openstack-meeting | 00:34 | |
*** kbyrne has quit IRC | 00:34 | |
*** Swami_ has quit IRC | 00:34 | |
*** Swami has quit IRC | 00:34 | |
*** kbyrne has joined #openstack-meeting | 00:35 | |
*** shaohe_feng has quit IRC | 00:35 | |
*** edmondsw has quit IRC | 00:37 | |
*** longkb has joined #openstack-meeting | 00:38 | |
*** shaohe_feng has joined #openstack-meeting | 00:40 | |
*** heyongli has quit IRC | 00:44 | |
*** heyongli has joined #openstack-meeting | 00:44 | |
*** abelur_ has joined #openstack-meeting | 00:45 | |
*** shaohe_feng has quit IRC | 00:46 | |
*** aeng has joined #openstack-meeting | 00:46 | |
*** abelur_ has quit IRC | 00:48 | |
*** shaohe_feng has joined #openstack-meeting | 00:48 | |
*** wanghao_ has quit IRC | 00:52 | |
*** wanghao has joined #openstack-meeting | 00:52 | |
*** heyongli has quit IRC | 00:54 | |
*** heyongli has joined #openstack-meeting | 00:54 | |
*** shaohe_feng has quit IRC | 00:56 | |
*** shaohe_feng has joined #openstack-meeting | 00:58 | |
*** markstur has quit IRC | 00:58 | |
*** boden has joined #openstack-meeting | 00:58 | |
*** yamamoto has joined #openstack-meeting | 00:59 | |
*** boden has quit IRC | 01:03 | |
*** heyongli has quit IRC | 01:04 | |
*** njohnston has quit IRC | 01:04 | |
*** heyongli has joined #openstack-meeting | 01:04 | |
*** yamamoto has quit IRC | 01:05 | |
*** shaohe_feng has quit IRC | 01:06 | |
*** shaohe_feng has joined #openstack-meeting | 01:07 | |
*** salv-orlando has joined #openstack-meeting | 01:11 | |
*** ekcs has quit IRC | 01:12 | |
*** heyongli has quit IRC | 01:14 | |
*** heyongli has joined #openstack-meeting | 01:15 | |
*** kaisers_ has joined #openstack-meeting | 01:15 | |
*** salv-orlando has quit IRC | 01:15 | |
*** shaohe_feng has quit IRC | 01:16 | |
*** shaohe_feng has joined #openstack-meeting | 01:18 | |
*** kaisers has quit IRC | 01:19 | |
*** hongbin has joined #openstack-meeting | 01:21 | |
*** heyongli has quit IRC | 01:25 | |
*** heyongli has joined #openstack-meeting | 01:25 | |
*** shaohe_feng has quit IRC | 01:27 | |
*** shaohe_feng has joined #openstack-meeting | 01:28 | |
*** fzdarsky_ has joined #openstack-meeting | 01:28 | |
*** fzdarsky has quit IRC | 01:32 | |
*** imacdonn has joined #openstack-meeting | 01:35 | |
*** heyongli has quit IRC | 01:35 | |
*** heyongli has joined #openstack-meeting | 01:35 | |
*** yangyapeng has joined #openstack-meeting | 01:36 | |
*** shaohe_feng has quit IRC | 01:37 | |
*** bobh has quit IRC | 01:37 | |
*** shaohe_feng has joined #openstack-meeting | 01:40 | |
*** hemna_ has quit IRC | 01:41 | |
*** gongysh has joined #openstack-meeting | 01:42 | |
*** julim has joined #openstack-meeting | 01:44 | |
*** heyongli has quit IRC | 01:45 | |
*** heyongli has joined #openstack-meeting | 01:45 | |
*** harlowja has quit IRC | 01:46 | |
*** shaohe_feng has quit IRC | 01:47 | |
*** gongysh has quit IRC | 01:47 | |
*** mordred has quit IRC | 01:49 | |
*** shaohe_feng has joined #openstack-meeting | 01:49 | |
*** yamahata has quit IRC | 01:51 | |
*** heyongli has quit IRC | 01:55 | |
*** jamesmcarthur has joined #openstack-meeting | 01:55 | |
*** heyongli has joined #openstack-meeting | 01:56 | |
*** shaohe_feng has quit IRC | 01:57 | |
*** shaohe_feng has joined #openstack-meeting | 01:59 | |
*** jamesmcarthur has quit IRC | 02:00 | |
*** heyongli has quit IRC | 02:06 | |
*** heyongli has joined #openstack-meeting | 02:06 | |
*** mordred has joined #openstack-meeting | 02:07 | |
*** shaohe_feng has quit IRC | 02:08 | |
*** shaohe_feng has joined #openstack-meeting | 02:08 | |
*** heyongli has quit IRC | 02:16 | |
*** heyongli has joined #openstack-meeting | 02:16 | |
*** shaohe_feng has quit IRC | 02:18 | |
*** shaohe_feng has joined #openstack-meeting | 02:20 | |
*** iyamahat_ has quit IRC | 02:23 | |
*** heyongli has quit IRC | 02:26 | |
*** heyongli has joined #openstack-meeting | 02:26 | |
*** shaohe_feng has quit IRC | 02:28 | |
*** shaohe_feng has joined #openstack-meeting | 02:29 | |
*** heyongli has quit IRC | 02:36 | |
*** heyongli has joined #openstack-meeting | 02:37 | |
*** shaohe_feng has quit IRC | 02:38 | |
*** shaohe_feng has joined #openstack-meeting | 02:40 | |
*** psachin` has joined #openstack-meeting | 02:42 | |
*** ricolin has joined #openstack-meeting | 02:42 | |
*** bkopilov has quit IRC | 02:43 | |
*** heyongli has quit IRC | 02:47 | |
*** heyongli has joined #openstack-meeting | 02:47 | |
*** shaohe_feng has quit IRC | 02:49 | |
*** shaohe_feng has joined #openstack-meeting | 02:50 | |
*** bkopilov has joined #openstack-meeting | 02:57 | |
*** heyongli has quit IRC | 02:57 | |
*** heyongli has joined #openstack-meeting | 02:57 | |
*** tpatil has joined #openstack-meeting | 02:58 | |
*** shaohe_feng has quit IRC | 02:59 | |
tpatil | samP: Ping? | 03:00 |
---|---|---|
*** shaohe_feng has joined #openstack-meeting | 03:01 | |
tpatil | #startmeeting Masakari | 03:01 |
openstack | Meeting started Tue Jun 26 03:01:14 2018 UTC and is due to finish in 60 minutes. The chair is tpatil. Information about MeetBot at http://wiki.debian.org/MeetBot. | 03:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 03:01 |
*** openstack changes topic to " (Meeting topic: Masakari)" | 03:01 | |
openstack | The meeting name has been set to 'masakari' | 03:01 |
tpatil | Hi All | 03:01 |
samP | sorry Im late | 03:01 |
*** yamamoto has joined #openstack-meeting | 03:01 | |
samP | Hi | 03:01 |
tpatil | Hi samP | 03:02 |
*** Dinesh_Bhor has joined #openstack-meeting | 03:02 | |
tpatil | Please take the pilot seat | 03:02 |
samP | not started yet, right? | 03:02 |
samP | tpatil: sure.. | 03:02 |
tpatil | already started | 03:02 |
samP | ah.. yes thanks | 03:02 |
samP | OK then, | 03:02 |
samP | #topic bugs and patches | 03:03 |
samP | any bugs or patches need to discuss? | 03:04 |
tpatil | Louie Kwan has uploaded a new PS | 03:04 |
tpatil | I'm busy reviewing other patches. Need help in reviewing his patch | 03:04 |
tpatil | #link https://review.openstack.org/#/c/534958/ | 03:04 |
patchbot | patch 534958 - masakari-monitors - Introspective Instance Monitoring through QEMU Gue... | 03:04 |
samP | tpatil: great.,, I will take a look on that | 03:04 |
samP | tpatil: thanks for the review | 03:05 |
tpatil | Thank you | 03:05 |
tpatil | I have proposed a fix for LP bug https://bugs.launchpad.net/masakari/+bug/1773132 | 03:05 |
openstack | Launchpad bug 1773132 in masakari "masakari-engine runs recovery twice for one notification when disconnection with rabbitmq" [Undecided,In progress] - Assigned to Tushar Patil (tpatil) | 03:05 |
tpatil | #link https://review.openstack.org/#/c/576042/ | 03:05 |
patchbot | patch 576042 - masakari - Avoid recovery from failure twice | 03:05 |
tpatil | Please take a look at this patch as well | 03:05 |
samP | tpatil: sure | 03:06 |
samP | tpatil: thanks for the fix | 03:06 |
*** heyongli has quit IRC | 03:07 | |
*** yamamoto has quit IRC | 03:07 | |
*** heyongli has joined #openstack-meeting | 03:07 | |
tpatil | Other LP bug https://bugs.launchpad.net/masakari/+bug/1773765 | 03:08 |
openstack | Launchpad bug 1773765 in masakari "There is a possibility that 'running' notification will remain" [Undecided,New] | 03:08 |
tpatil | It is little tricky to fix this issue becoz we don't have much information about which instances are already evacuated | 03:08 |
tpatil | Masakari doesn't save any info about which instances are evacuated and how many are still pending during host failure notification | 03:09 |
tpatil | hence it's difficult to re-execute running status notification | 03:09 |
*** shaohe_feng has quit IRC | 03:09 | |
samP | humm...I think we can store some of these info in masakari, and with current status form nova, we are able to calculate it. | 03:11 |
samP | But, not sure is this the best way to deal with. | 03:11 |
*** shaohe_feng has joined #openstack-meeting | 03:11 | |
tpatil | yes, it's a big change | 03:12 |
tpatil | Can we focus on this issue in next release? | 03:12 |
tpatil | If we decide to maintain basic info in masakari, we can also add code to show the current progress of host failure notification | 03:13 |
tpatil | like source host failure, out of 10 instances, 5th instance evacuation is in progress | 03:13 |
samP | tpatil: Indeed. | 03:13 |
samP | toabctl: IIRC, nova does have api for get the status for migration, | 03:14 |
tpatil | samP: Yes, but Masakari will still need to maintain basic info to query status from nova | 03:17 |
*** heyongli has quit IRC | 03:17 | |
*** heyongli has joined #openstack-meeting | 03:18 | |
samP | tpatil: agree. In any cause, it seems like this fix is too heavy for this release. | 03:18 |
tpatil | samP: Correct | 03:18 |
samP | Let's postpone it to next release. Otherwise, some one raise urgent flag..! | 03:19 |
*** shaohe_feng has quit IRC | 03:19 | |
*** shaohe_feng has joined #openstack-meeting | 03:20 | |
samP | any other bugs or patches? | 03:20 |
tpatil | One minor issue | 03:21 |
tpatil | #link https://review.openstack.org/#/c/574614/ | 03:21 |
patchbot | patch 574614 - masakari - Segment description allows multiline characters | 03:21 |
tpatil | Description doesn't allow multiline characters | 03:21 |
tpatil | I will review this patch today | 03:21 |
samP | LGTM | 03:23 |
samP | need to rebase | 03:24 |
samP | thanks for the fix | 03:24 |
tpatil | Ok | 03:24 |
tpatil | I have voted + 2 on this patch https://review.openstack.org/#/c/567825/ | 03:25 |
patchbot | patch 567825 - masakari - Enable mutable config in Masakari | 03:25 |
tpatil | Need someone to review and approve this patch | 03:25 |
samP | sure, I will take a look | 03:26 |
samP | tpatil: thanks | 03:26 |
samP | Let's move to status update for features and sub-projects | 03:27 |
*** heyongli has quit IRC | 03:28 | |
samP | (1) Horizon Plugin | 03:28 |
*** heyongli has joined #openstack-meeting | 03:28 | |
tpatil | I have reviewed 3-4 patches and posted comments | 03:28 |
samP | I want to review, but it will take some time to get there...;) | 03:29 |
tpatil | ok | 03:29 |
samP | but I will be their soon | 03:29 |
*** shaohe_feng has quit IRC | 03:30 | |
samP | tpatil: thanks for reviews | 03:30 |
samP | (2) recovery method customization | 03:30 |
tpatil | specs to be reviewed | 03:31 |
samP | I read the spec. I will put my comments soon, No critical comments, basically LGTM | 03:31 |
tpatil | Implementation is almost finished. Working on adding unit tests. Expect to push patch in next week | 03:31 |
samP | tpatil: sure, thanks a lot | 03:31 |
*** shaohe_feng has joined #openstack-meeting | 03:31 | |
samP | (3) Ansible support for Masakari | 03:32 |
samP | Any issues? | 03:33 |
tpatil | This task is currently on hold due to unavailability of dev. environment | 03:33 |
tpatil | we had discussed about this issue in last-to-last meeting | 03:33 |
samP | tpatil: ah, yes. my fault | 03:33 |
samP | I will try to provide server init method asap | 03:34 |
tpatil | Still many items are pending. Looks like we will need to postpone it to the next release | 03:34 |
tpatil | samP: Thanks | 03:34 |
samP | tpatil: are you referring to ansible? | 03:36 |
tpatil | yes | 03:36 |
*** chyka has joined #openstack-meeting | 03:36 | |
samP | tpatil: monitor part is bit difficult and I think it is OK to postpone it to next release | 03:37 |
*** heyongli has quit IRC | 03:38 | |
*** yamahata has joined #openstack-meeting | 03:38 | |
tpatil | samP: Agree | 03:38 |
*** heyongli has joined #openstack-meeting | 03:38 | |
samP | if some one came up with a quick solution, then we can reconsider to put it into to this release. | 03:39 |
tpatil | ok | 03:39 |
samP | Otherwise, let's consider it on next release | 03:40 |
samP | #topic AOB | 03:40 |
*** shaohe_feng has quit IRC | 03:40 | |
tpatil | I want to bring up this issue report by Torin on openstack ML | 03:40 |
tpatil | #link http://lists.openstack.org/pipermail/openstack/2018-June/046620.html | 03:40 |
tpatil | s/report/reported | 03:40 |
*** shaohe_feng has joined #openstack-meeting | 03:41 | |
*** psahoo has joined #openstack-meeting | 03:41 | |
*** chyka has quit IRC | 03:41 | |
tpatil | execute method is failing with 124 error | 03:41 |
samP | humm.... seems like Corosync faild to sync | 03:42 |
tpatil | timeout returns 124 error, but if you pass --preserve-status option to timeout it return 0 | 03:43 |
tpatil | In that case, I don't think it will raise ProcessExecutionError | 03:44 |
tpatil | Do we expect host monitor process to be run by superuser? | 03:45 |
tpatil | becoz run_as_root=True is passed to utils.execute method | 03:46 |
tpatil | https://github.com/openstack/masakari-monitors/blob/master/masakarimonitors/hostmonitor/host_handler/handle_host.py#L113 | 03:46 |
samP | tpatil: case here is, tcpdump can not be run by the normal user. | 03:47 |
*** heyongli has quit IRC | 03:48 | |
*** heyongli has joined #openstack-meeting | 03:48 | |
tpatil | If you have any info about this issue, can you please reply to the above ML thread | 03:49 |
samP | tpatil: sure, I will join to discussion. | 03:49 |
samP | I need to read the thread carefully. I will reply to thread | 03:49 |
*** lpetrut has joined #openstack-meeting | 03:50 | |
samP | tpatil: thanks for answering to thread | 03:50 |
*** shaohe_feng has quit IRC | 03:50 | |
*** yangyapeng has quit IRC | 03:50 | |
samP | ah, and this is openstack ML, not the dev | 03:51 |
*** yangyapeng has joined #openstack-meeting | 03:51 | |
tpatil | yes | 03:51 |
samP | OK got it. | 03:51 |
tpatil | After upgrading to Queens, Torin is not able to run host monitor process | 03:52 |
samP | That is critical. | 03:52 |
*** shu-mutow has joined #openstack-meeting | 03:52 | |
*** shaohe_feng has joined #openstack-meeting | 03:52 | |
samP | tpatil: I will take a look on this issue. | 03:52 |
tpatil | Thanks | 03:53 |
samP | Any other items to discuss? | 03:54 |
samP | Otherwise, let finish today's meeting. | 03:54 |
tpatil | That's all from my end for now | 03:54 |
*** hongbin has quit IRC | 03:54 | |
samP | Please use openstack-dev ML or IRC #openstack-masakari on freenode for further discussion.. | 03:55 |
*** yangyapeng has quit IRC | 03:55 | |
samP | thank you for attending today's meeting | 03:55 |
samP | tpatil: thanks | 03:55 |
samP | #endmeeting | 03:55 |
tpatil | Thank you, Bye | 03:56 |
samP | ah, you have to end it.. | 03:56 |
tpatil | yes will do | 03:56 |
tpatil | #endmeeting | 03:56 |
samP | tpatil: :) | 03:56 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 03:56 | |
openstack | Meeting ended Tue Jun 26 03:56:22 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 03:56 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-06-26-03.01.html | 03:56 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-06-26-03.01.txt | 03:56 |
openstack | Log: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-06-26-03.01.log.html | 03:56 |
samP | tpatil: thanks | 03:56 |
*** tpatil has quit IRC | 03:56 | |
*** heyongli has quit IRC | 03:58 | |
*** heyongli has joined #openstack-meeting | 03:59 | |
*** shaohe_feng has quit IRC | 04:00 | |
*** shaohe_feng has joined #openstack-meeting | 04:04 | |
*** yamamoto has joined #openstack-meeting | 04:04 | |
*** heyongli has quit IRC | 04:09 | |
*** heyongli has joined #openstack-meeting | 04:09 | |
*** yamamoto has quit IRC | 04:09 | |
*** shaohe_feng has quit IRC | 04:11 | |
*** shaohe_feng has joined #openstack-meeting | 04:12 | |
*** ekcs has joined #openstack-meeting | 04:14 | |
*** sridharg has joined #openstack-meeting | 04:19 | |
*** heyongli has quit IRC | 04:19 | |
*** heyongli has joined #openstack-meeting | 04:19 | |
*** shaohe_feng has quit IRC | 04:21 | |
*** shaohe_feng has joined #openstack-meeting | 04:21 | |
*** yangyapeng has joined #openstack-meeting | 04:26 | |
*** lpetrut has quit IRC | 04:28 | |
*** ekcs has quit IRC | 04:29 | |
*** heyongli has quit IRC | 04:29 | |
*** heyongli has joined #openstack-meeting | 04:29 | |
*** dims has quit IRC | 04:30 | |
*** shaohe_feng has quit IRC | 04:31 | |
*** ekcs has joined #openstack-meeting | 04:33 | |
*** shaohe_feng has joined #openstack-meeting | 04:33 | |
*** dims has joined #openstack-meeting | 04:35 | |
*** psahoo has quit IRC | 04:35 | |
*** diablo_rojo has quit IRC | 04:37 | |
*** heyongli has quit IRC | 04:39 | |
*** heyongli has joined #openstack-meeting | 04:40 | |
*** shaohe_feng has quit IRC | 04:41 | |
*** shaohe_feng has joined #openstack-meeting | 04:42 | |
*** cloudrancher has joined #openstack-meeting | 04:47 | |
*** heyongli has quit IRC | 04:50 | |
*** heyongli has joined #openstack-meeting | 04:50 | |
*** psahoo has joined #openstack-meeting | 04:50 | |
*** shaohe_feng has quit IRC | 04:52 | |
*** shaohe_feng has joined #openstack-meeting | 04:53 | |
*** janki has joined #openstack-meeting | 04:54 | |
*** heyongli has quit IRC | 05:00 | |
*** heyongli has joined #openstack-meeting | 05:00 | |
*** armax has joined #openstack-meeting | 05:01 | |
*** shaohe_feng has quit IRC | 05:02 | |
*** shaohe_feng has joined #openstack-meeting | 05:03 | |
*** aeng has quit IRC | 05:03 | |
*** yamamoto has joined #openstack-meeting | 05:05 | |
*** ekcs has quit IRC | 05:06 | |
*** ekcs has joined #openstack-meeting | 05:07 | |
*** slaweq has joined #openstack-meeting | 05:07 | |
*** slaweq has quit IRC | 05:07 | |
*** jchhatbar has joined #openstack-meeting | 05:09 | |
*** heyongli has quit IRC | 05:10 | |
*** heyongli has joined #openstack-meeting | 05:10 | |
*** numans has quit IRC | 05:11 | |
*** shaohe_feng has quit IRC | 05:12 | |
*** yamamoto has quit IRC | 05:12 | |
*** numans has joined #openstack-meeting | 05:13 | |
*** janki has quit IRC | 05:13 | |
*** e0ne has joined #openstack-meeting | 05:13 | |
*** shaohe_feng has joined #openstack-meeting | 05:13 | |
*** chyka has joined #openstack-meeting | 05:14 | |
*** cloudrancher has quit IRC | 05:15 | |
*** lifeless has joined #openstack-meeting | 05:16 | |
*** vabada2 has joined #openstack-meeting | 05:16 | |
*** ekcs has quit IRC | 05:16 | |
*** arnewiebalck_ has joined #openstack-meeting | 05:16 | |
*** strigazi has quit IRC | 05:17 | |
*** vabada has quit IRC | 05:18 | |
*** arnewiebalck has quit IRC | 05:18 | |
*** arnewiebalck_ is now known as arnewiebalck | 05:18 | |
*** chyka has quit IRC | 05:19 | |
*** strigazi has joined #openstack-meeting | 05:19 | |
*** heyongli has quit IRC | 05:20 | |
*** heyongli has joined #openstack-meeting | 05:21 | |
*** shaohe_feng has quit IRC | 05:22 | |
*** arnewiebalck_ has joined #openstack-meeting | 05:24 | |
*** vabada has joined #openstack-meeting | 05:24 | |
*** strigazi_ has joined #openstack-meeting | 05:24 | |
*** shaohe_feng has joined #openstack-meeting | 05:25 | |
*** arnewiebalck has quit IRC | 05:26 | |
*** arnewiebalck_ is now known as arnewiebalck | 05:26 | |
*** strigazi has quit IRC | 05:27 | |
*** vabada2 has quit IRC | 05:27 | |
*** heyongli has quit IRC | 05:31 | |
*** heyongli has joined #openstack-meeting | 05:31 | |
*** armax has quit IRC | 05:32 | |
*** shaohe_feng has quit IRC | 05:33 | |
*** shaohe_feng has joined #openstack-meeting | 05:33 | |
*** armax has joined #openstack-meeting | 05:34 | |
*** psahoo has quit IRC | 05:36 | |
*** heyongli has quit IRC | 05:41 | |
*** heyongli has joined #openstack-meeting | 05:41 | |
*** shaohe_feng has quit IRC | 05:43 | |
*** Dinesh_Bhor has quit IRC | 05:44 | |
*** shaohe_feng has joined #openstack-meeting | 05:44 | |
*** jmnk has joined #openstack-meeting | 05:49 | |
*** heyongli has quit IRC | 05:51 | |
*** heyongli has joined #openstack-meeting | 05:51 | |
*** psahoo has joined #openstack-meeting | 05:51 | |
*** shaohe_feng has quit IRC | 05:53 | |
*** shaohe_feng has joined #openstack-meeting | 05:55 | |
*** tssurya has joined #openstack-meeting | 05:56 | |
*** heyongli has quit IRC | 06:01 | |
*** heyongli has joined #openstack-meeting | 06:02 | |
*** shaohe_feng has quit IRC | 06:03 | |
*** shaohe_feng has joined #openstack-meeting | 06:06 | |
*** e0ne has quit IRC | 06:08 | |
*** yamamoto has joined #openstack-meeting | 06:09 | |
*** slaweq has joined #openstack-meeting | 06:10 | |
*** heyongli has quit IRC | 06:12 | |
*** heyongli has joined #openstack-meeting | 06:12 | |
*** shaohe_feng has quit IRC | 06:14 | |
*** yamamoto has quit IRC | 06:14 | |
*** shaohe_feng has joined #openstack-meeting | 06:17 | |
*** alexchadin has joined #openstack-meeting | 06:20 | |
*** heyongli has quit IRC | 06:22 | |
*** heyongli has joined #openstack-meeting | 06:22 | |
*** cloudrancher has joined #openstack-meeting | 06:24 | |
*** shaohe_feng has quit IRC | 06:24 | |
*** shaohe_feng has joined #openstack-meeting | 06:25 | |
*** heyongli has quit IRC | 06:32 | |
*** heyongli has joined #openstack-meeting | 06:32 | |
*** andreas_s has joined #openstack-meeting | 06:33 | |
*** qwebirc7707 has joined #openstack-meeting | 06:34 | |
*** rbartal has joined #openstack-meeting | 06:34 | |
*** shaohe_feng has quit IRC | 06:34 | |
*** shaohe_feng has joined #openstack-meeting | 06:36 | |
*** qwebirc7707 has quit IRC | 06:38 | |
*** heyongli has quit IRC | 06:42 | |
*** heyongli has joined #openstack-meeting | 06:43 | |
*** shaohe_feng has quit IRC | 06:44 | |
*** psachin` has quit IRC | 06:45 | |
*** shaohe_feng has joined #openstack-meeting | 06:45 | |
*** psachin` has joined #openstack-meeting | 06:47 | |
*** peereb has joined #openstack-meeting | 06:48 | |
*** peereb has quit IRC | 06:49 | |
*** peereb has joined #openstack-meeting | 06:49 | |
*** peereb has quit IRC | 06:50 | |
*** alexchadin has quit IRC | 06:52 | |
*** heyongli has quit IRC | 06:53 | |
*** heyongli has joined #openstack-meeting | 06:53 | |
*** shaohe_feng has quit IRC | 06:55 | |
*** caobin has joined #openstack-meeting | 06:55 | |
*** yamamoto has joined #openstack-meeting | 06:56 | |
*** shaohe_feng has joined #openstack-meeting | 06:56 | |
*** ircuser-1 has joined #openstack-meeting | 06:58 | |
*** heyongli has quit IRC | 07:03 | |
*** heyongli has joined #openstack-meeting | 07:03 | |
*** shaohe_feng has quit IRC | 07:05 | |
*** shaohe_feng has joined #openstack-meeting | 07:06 | |
*** slaweq has quit IRC | 07:06 | |
*** lpetrut has joined #openstack-meeting | 07:07 | |
*** rcernin has quit IRC | 07:08 | |
*** slaweq has joined #openstack-meeting | 07:10 | |
*** gongysh has joined #openstack-meeting | 07:10 | |
*** caobin has quit IRC | 07:12 | |
*** caobin has joined #openstack-meeting | 07:13 | |
*** heyongli has quit IRC | 07:13 | |
*** heyongli has joined #openstack-meeting | 07:13 | |
*** tesseract has joined #openstack-meeting | 07:14 | |
*** shaohe_feng has quit IRC | 07:15 | |
*** slaweq has quit IRC | 07:15 | |
*** shaohe_feng has joined #openstack-meeting | 07:17 | |
*** pcaruana has joined #openstack-meeting | 07:20 | |
*** kopecmartin has joined #openstack-meeting | 07:23 | |
*** heyongli has quit IRC | 07:23 | |
*** heyongli has joined #openstack-meeting | 07:24 | |
*** andreas_s has quit IRC | 07:25 | |
*** shaohe_feng has quit IRC | 07:25 | |
*** andreas_s has joined #openstack-meeting | 07:26 | |
*** shaohe_feng has joined #openstack-meeting | 07:26 | |
*** andreas_s_ has joined #openstack-meeting | 07:28 | |
*** yamahata has quit IRC | 07:30 | |
*** andreas_s has quit IRC | 07:32 | |
*** heyongli has quit IRC | 07:34 | |
*** heyongli has joined #openstack-meeting | 07:34 | |
*** shaohe_feng has quit IRC | 07:36 | |
*** shaohe_feng has joined #openstack-meeting | 07:36 | |
*** phil_ has joined #openstack-meeting | 07:37 | |
*** phil_ is now known as Guest1606 | 07:37 | |
*** andreas_s_ has quit IRC | 07:38 | |
*** andreas_s has joined #openstack-meeting | 07:39 | |
*** andreas_s has quit IRC | 07:39 | |
*** andreas_s_ has joined #openstack-meeting | 07:40 | |
*** AndreyS has joined #openstack-meeting | 07:42 | |
*** cloudrancher has quit IRC | 07:43 | |
*** heyongli has quit IRC | 07:44 | |
*** heyongli has joined #openstack-meeting | 07:44 | |
*** ahrechny has joined #openstack-meeting | 07:45 | |
*** Magistrazh has joined #openstack-meeting | 07:45 | |
*** Magistrazh has left #openstack-meeting | 07:45 | |
*** akozhevnikov has joined #openstack-meeting | 07:46 | |
*** shaohe_feng has quit IRC | 07:46 | |
*** shaohe_feng has joined #openstack-meeting | 07:47 | |
*** phuoc has joined #openstack-meeting | 07:48 | |
*** ttsiouts has joined #openstack-meeting | 07:51 | |
*** heyongli has quit IRC | 07:54 | |
*** heyongli has joined #openstack-meeting | 07:54 | |
*** joxyuki has joined #openstack-meeting | 07:56 | |
*** shaohe_feng has quit IRC | 07:56 | |
*** dkushwaha has joined #openstack-meeting | 07:56 | |
*** shaohe_feng has joined #openstack-meeting | 07:57 | |
*** alexchadin has joined #openstack-meeting | 07:58 | |
*** caobin has left #openstack-meeting | 07:58 | |
*** andreas_s_ has quit IRC | 07:59 | |
*** andreas_s has joined #openstack-meeting | 08:00 | |
*** andreas_s has quit IRC | 08:00 | |
*** andreas_s has joined #openstack-meeting | 08:01 | |
*** alexchadin has quit IRC | 08:01 | |
gongysh | #startmeeting tacker | 08:02 |
openstack | Meeting started Tue Jun 26 08:02:07 2018 UTC and is due to finish in 60 minutes. The chair is gongysh. Information about MeetBot at http://wiki.debian.org/MeetBot. | 08:02 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 08:02 |
*** openstack changes topic to " (Meeting topic: tacker)" | 08:02 | |
openstack | The meeting name has been set to 'tacker' | 08:02 |
gongysh | #topic roll call | 08:02 |
*** openstack changes topic to "roll call (Meeting topic: tacker)" | 08:02 | |
dkushwaha | o/ | 08:02 |
gongysh | dkushwaha, hi | 08:03 |
joxyuki | hi | 08:03 |
*** jamesmcarthur has joined #openstack-meeting | 08:03 | |
phuoc | hi | 08:03 |
*** heyongli has quit IRC | 08:04 | |
*** slaweq has joined #openstack-meeting | 08:04 | |
*** heyongli has joined #openstack-meeting | 08:05 | |
*** e0ne has joined #openstack-meeting | 08:05 | |
gongysh | ok | 08:05 |
gongysh | it seems other guys are busy. | 08:05 |
gongysh | #topic bp | 08:05 |
*** openstack changes topic to "bp (Meeting topic: tacker)" | 08:05 | |
gongysh | phuoc, any thing to talk? | 08:05 |
phuoc | gongysh, I havee some bug with devstack | 08:06 |
phuoc | but I think it can be fixed in this week | 08:06 |
*** browny has quit IRC | 08:06 | |
AndreyS | Hi, everyone | 08:06 |
gongysh | AndreyS, hi | 08:06 |
longkb | o/ | 08:06 |
*** shaohe_feng has quit IRC | 08:06 | |
dkushwaha | AndreyS, hi | 08:07 |
AndreyS | we would like to discuss BP https://blueprints.launchpad.net/tacker/+spec/tosca-csar-mgmt-driver | 08:07 |
gongysh | AndreyS, can you introduce yourself first? | 08:07 |
AndreyS | Andrey Sviridov | 08:08 |
*** cloudrancher has joined #openstack-meeting | 08:08 | |
phuoc | AndreyS, nice to see you :) | 08:08 |
*** alexchadin has joined #openstack-meeting | 08:08 | |
*** jamesmcarthur has quit IRC | 08:08 | |
gongysh | AndreyS, what is your company? | 08:08 |
ahrechny | Hi all, I work with AndreyS on that blueprint and have some questions | 08:08 |
*** Li_Jiale has joined #openstack-meeting | 08:09 | |
ahrechny | We are from Netcracker/DTAG | 08:09 |
AndreyS | My company is Netcracker | 08:09 |
joxyuki | AndreyS, ahrechny, hi | 08:09 |
gongysh | ahrechny, hi, welcome | 08:09 |
phuoc | welcome to Tacker :) | 08:10 |
gongysh | AndreyS, ok do you have any idea for that spec? | 08:10 |
ahrechny | We want to add ability to support csar packages only for VNFM | 08:10 |
akozhevnikov | Hi all, also working with AndreyS and ahrechny | 08:10 |
gongysh | akozhevnikov, hi | 08:10 |
gongysh | big welcome | 08:10 |
ahrechny | And want to discuss some architecture points | 08:11 |
gongysh | ahrechny, ok | 08:11 |
gongysh | go on | 08:11 |
nguyenhai | o/ | 08:11 |
ahrechny | First of all - rest api | 08:11 |
ahrechny | now it supports only text descriptors | 08:11 |
ahrechny | but we need to upload files | 08:12 |
*** shaohe_feng has joined #openstack-meeting | 08:12 | |
gongysh | ahrechny, yes | 08:12 |
ahrechny | so we have some ways for it - send serialized text or add new api for files uploading | 08:13 |
AndreyS | I agree with ahrecny that ability to onboard CSAR VNF packages (not simple yaml, but archive) is very important | 08:13 |
ahrechny | is it possible to change current API? | 08:13 |
*** caobin has joined #openstack-meeting | 08:14 | |
caobin | hello | 08:14 |
gongysh | ahrechny you can have a draft design in a spec file | 08:14 |
gongysh | caobin, helo | 08:14 |
gongysh | welcome | 08:14 |
gongysh | caobin, could you please introduce yourself first? | 08:14 |
Li_Jiale | My colleague | 08:14 |
*** heyongli has quit IRC | 08:15 | |
ahrechny | unfortunately we don't have draft yet | 08:15 |
gongysh | caobin, welcome. | 08:15 |
*** heyongli has joined #openstack-meeting | 08:15 | |
caobin | thanks | 08:15 |
*** slaweq has quit IRC | 08:15 | |
gongysh | ahrechny, to save csar files on tacker server side, we can use ceph. | 08:15 |
gongysh | ahrechny, please have draft design, and then we can have a talk at the next meeting. | 08:16 |
*** cloudrancher has quit IRC | 08:16 | |
*** shaohe_feng has quit IRC | 08:17 | |
phuoc | I think you guys want to upload csar file to Tacker server | 08:17 |
*** cloudrancher has joined #openstack-meeting | 08:17 | |
*** shaohe_feng has joined #openstack-meeting | 08:17 | |
phuoc | then Tacker server will create something, such as images, files | 08:18 |
ahrechny | but one important question about API - may I change current method for creating VNF or I should create new one? | 08:18 |
phuoc | and then create VNFD ? | 08:18 |
gongysh | ahrechny, I think csar is a way to create a vnfd, nsd, or vnffgd | 08:19 |
ahrechny | we want to create VNFD from csar, not from plain yaml file | 08:19 |
ahrechny | *not only | 08:19 |
phuoc | ahrechny, IMO we should extend current method | 08:19 |
dkushwaha | ahrechny, IMO, it can be done with existing api too, needs to check that | 08:20 |
ahrechny | But it means that I should change content type | 08:20 |
ahrechny | for example to multipart/form-data instead of application/json | 08:21 |
*** cloudrancher has quit IRC | 08:21 | |
*** salv-orlando has joined #openstack-meeting | 08:22 | |
gongysh | csar should be a self explained archive. it will read it is a vnfd, vnfgd or nsd something | 08:22 |
*** cloudrancher has joined #openstack-meeting | 08:22 | |
ahrechny | yes, but we want to start for VNFM | 08:23 |
ahrechny | than it can be extended for NFVO | 08:23 |
gongysh | ahrechny, first you need to have an idea what is the csar. maybe to refer to some standards or other mano systems. | 08:23 |
gongysh | and then we can see how the workflow is. | 08:24 |
ahrechny | I have some examples | 08:24 |
*** YanXingAn has joined #openstack-meeting | 08:24 | |
akozhevnikov | This will also require changes in the taker-client, now there is only support for yaml when creating VNFD | 08:24 |
*** cloudrancher has quit IRC | 08:24 | |
*** julim has quit IRC | 08:24 | |
AndreyS | archive for VNF descriptor, which contains yaml file, meta data, imports, definitions of types, artifacts & etc | 08:25 |
*** heyongli has quit IRC | 08:25 | |
*** heyongli has joined #openstack-meeting | 08:25 | |
gongysh | AndreyS, I think you guys need a draft design, and we can have a talk. | 08:25 |
*** salv-orlando has quit IRC | 08:25 | |
gongysh | who knows Dinesh Bhor ? | 08:26 |
*** salv-orlando has joined #openstack-meeting | 08:26 | |
dkushwaha | gongysh, yea, I know | 08:26 |
joxyuki | gongysh, yes | 08:26 |
gongysh | is he online? | 08:26 |
joxyuki | no | 08:27 |
*** kaisers1 has quit IRC | 08:27 | |
gongysh | he just updated a patch | 08:27 |
*** shaohe_feng has quit IRC | 08:27 | |
gongysh | https://review.openstack.org/#/c/570845/ | 08:27 |
patchbot | patch 570845 - tacker - Add placement policies support | 08:27 |
*** cloudrancher has joined #openstack-meeting | 08:27 | |
*** shaohe_feng has joined #openstack-meeting | 08:28 | |
gongysh | he also did not reply to the comment | 08:28 |
*** cloudrancher has quit IRC | 08:28 | |
joxyuki | gongysh, do you want him to attend this weekly meeting? | 08:28 |
gongysh | sure | 08:28 |
joxyuki | ok, I will talk to him to attend next meeting | 08:29 |
gongysh | joxyuki, thanks | 08:29 |
gongysh | I want to merge the policy spec early | 08:29 |
gongysh | since we are close to rocky cycle. | 08:30 |
joxyuki | oh, I understood | 08:30 |
joxyuki | I talk to him to join tacker channel | 08:30 |
gongysh | YanXingAn, hi | 08:31 |
YanXingAn | hi | 08:31 |
gongysh | how is the barbican problem? | 08:31 |
gongysh | joxyuki, if you have time, please have a test that patch too. | 08:32 |
gongysh | it is almost done. | 08:32 |
gongysh | there is no big issue with that patch. | 08:32 |
joxyuki | https://review.openstack.org/#/c/570845/ ? | 08:32 |
patchbot | patch 570845 - tacker - Add placement policies support | 08:32 |
*** psahoo has quit IRC | 08:33 | |
YanXingAn | gongysh: still coding | 08:33 |
gongysh | yes | 08:33 |
gongysh | YanXingAn, don't you want a bp for it? | 08:33 |
joxyuki | ok, what is the big problme? | 08:33 |
gongysh | a spec? | 08:33 |
*** cloudrancher has joined #openstack-meeting | 08:33 | |
gongysh | YanXingAn, spec is not required of course. | 08:34 |
*** electrofelix has joined #openstack-meeting | 08:35 | |
*** alexchadin has quit IRC | 08:35 | |
*** alexchadin has joined #openstack-meeting | 08:35 | |
*** heyongli has quit IRC | 08:35 | |
*** heyongli has joined #openstack-meeting | 08:35 | |
gongysh | #topic open discussion | 08:36 |
*** openstack changes topic to "open discussion (Meeting topic: tacker)" | 08:36 | |
gongysh | dkushwaha, do you have some thing to talk? | 08:36 |
dkushwaha | gongysh, nguyenhai, I am reusing this patch, https://review.openstack.org/#/c/486924 | 08:36 |
patchbot | patch 486924 - tacker - Implement VNF monitoring using Mistral | 08:36 |
dkushwaha | nguyenhai, But seems vim authentication related issue. | 08:36 |
nguyenhai | yes, we have problem with vim authentication | 08:37 |
*** alexchad_ has joined #openstack-meeting | 08:37 | |
gongysh | dkushwaha, this is why YanXingAn is doing barbican stuff. | 08:37 |
dkushwaha | Do you have any idea about that, as i missed it | 08:37 |
*** shaohe_feng has quit IRC | 08:37 | |
dkushwaha | gongysh, oh i see | 08:37 |
*** alexchadin has quit IRC | 08:37 | |
gongysh | YanXingAn will design a service account which can access all vim credentials. | 08:38 |
*** shaohe_feng has joined #openstack-meeting | 08:38 | |
*** alexchadin has joined #openstack-meeting | 08:38 | |
dkushwaha | gongysh, is this specific to conductor ? | 08:38 |
gongysh | yes | 08:38 |
gongysh | only conductor needs that. | 08:39 |
dkushwaha | yup | 08:39 |
*** psachin` is now known as psachin | 08:39 | |
*** cloudrancher has quit IRC | 08:39 | |
dkushwaha | YanXingAn, do you have some draft for that? | 08:39 |
gongysh | #topic berlin summit | 08:39 |
*** openstack changes topic to "berlin summit (Meeting topic: tacker)" | 08:39 | |
gongysh | berlin summit is calling for presentation. | 08:40 |
*** salv-orlando has quit IRC | 08:40 | |
gongysh | at vancouver, we have sfc, multi-vim talks. | 08:40 |
YanXingAn | dkushwaha: will have a draft before next meeting | 08:40 |
dkushwaha | YanXingAn, great, thanks | 08:41 |
*** kaisers has joined #openstack-meeting | 08:41 | |
gongysh | any tacker oriented presentations are welcome. | 08:42 |
*** alexchad_ has quit IRC | 08:42 | |
gongysh | seems we have no other stuff to talk. | 08:42 |
gongysh | ahrechny, look forward to you csar draft design next meeting. thanks | 08:43 |
gongysh | #endmeeting | 08:43 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 08:43 | |
openstack | Meeting ended Tue Jun 26 08:43:49 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 08:43 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/tacker/2018/tacker.2018-06-26-08.02.html | 08:43 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tacker/2018/tacker.2018-06-26-08.02.txt | 08:43 |
openstack | Log: http://eavesdrop.openstack.org/meetings/tacker/2018/tacker.2018-06-26-08.02.log.html | 08:43 |
*** heyongli has quit IRC | 08:45 | |
*** heyongli has joined #openstack-meeting | 08:46 | |
*** YanXingAn has quit IRC | 08:46 | |
*** YanXingAn has joined #openstack-meeting | 08:47 | |
*** cloudrancher has joined #openstack-meeting | 08:47 | |
*** shaohe_feng has quit IRC | 08:47 | |
*** shaohe_feng has joined #openstack-meeting | 08:48 | |
*** psahoo has joined #openstack-meeting | 08:48 | |
*** YanXingAn has quit IRC | 08:49 | |
*** priteau has joined #openstack-meeting | 08:54 | |
*** phuoc has left #openstack-meeting | 08:54 | |
*** cloudrancher has quit IRC | 08:55 | |
*** cloudrancher has joined #openstack-meeting | 08:55 | |
*** cloudrancher has quit IRC | 08:55 | |
*** heyongli has quit IRC | 08:56 | |
*** diman has joined #openstack-meeting | 08:56 | |
*** heyongli has joined #openstack-meeting | 08:56 | |
*** iyamahat has joined #openstack-meeting | 08:56 | |
*** brault has quit IRC | 08:57 | |
*** shaohe_feng has quit IRC | 08:58 | |
*** iyamahat has quit IRC | 08:59 | |
*** shaohe_feng has joined #openstack-meeting | 09:00 | |
*** jchhatbar is now known as janki | 09:01 | |
tetsuro | o/ | 09:04 |
*** armax has quit IRC | 09:06 | |
*** heyongli has quit IRC | 09:06 | |
*** heyongli has joined #openstack-meeting | 09:06 | |
*** ricolin has quit IRC | 09:07 | |
*** shaohe_feng has quit IRC | 09:08 | |
*** shaohe_feng has joined #openstack-meeting | 09:09 | |
*** brault has joined #openstack-meeting | 09:13 | |
*** slaweq has joined #openstack-meeting | 09:15 | |
*** heyongli has quit IRC | 09:16 | |
*** heyongli has joined #openstack-meeting | 09:16 | |
*** lifeless has quit IRC | 09:16 | |
*** kaisers_ has quit IRC | 09:18 | |
*** shaohe_feng has quit IRC | 09:18 | |
*** aloga has joined #openstack-meeting | 09:19 | |
*** shaohe_feng has joined #openstack-meeting | 09:20 | |
*** psahoo has quit IRC | 09:21 | |
*** slaweq has quit IRC | 09:23 | |
*** heyongli has quit IRC | 09:26 | |
*** heyongli has joined #openstack-meeting | 09:27 | |
*** qwebirc77170 has joined #openstack-meeting | 09:27 | |
*** shaohe_feng has quit IRC | 09:28 | |
*** shaohe_feng has joined #openstack-meeting | 09:29 | |
*** psahoo has joined #openstack-meeting | 09:33 | |
*** wanghao has quit IRC | 09:36 | |
*** heyongli has quit IRC | 09:37 | |
*** heyongli has joined #openstack-meeting | 09:37 | |
*** wanghao has joined #openstack-meeting | 09:37 | |
*** wanghao has quit IRC | 09:37 | |
*** wanghao has joined #openstack-meeting | 09:37 | |
*** wanghao has quit IRC | 09:38 | |
*** wanghao has joined #openstack-meeting | 09:38 | |
*** shaohe_feng has quit IRC | 09:39 | |
*** wanghao has quit IRC | 09:39 | |
*** wanghao has joined #openstack-meeting | 09:39 | |
*** akozhevnikov has quit IRC | 09:40 | |
*** salv-orlando has joined #openstack-meeting | 09:41 | |
*** shaohe_feng has joined #openstack-meeting | 09:41 | |
*** salv-orlando has quit IRC | 09:46 | |
*** strigazi_ is now known as strigazi | 09:47 | |
*** heyongli has quit IRC | 09:47 | |
*** heyongli has joined #openstack-meeting | 09:47 | |
*** shaohe_feng has quit IRC | 09:49 | |
*** shaohe_feng has joined #openstack-meeting | 09:50 | |
*** qwebirc77170 has left #openstack-meeting | 09:55 | |
*** heyongli has quit IRC | 09:57 | |
*** heyongli has joined #openstack-meeting | 09:57 | |
*** shaohe_feng has quit IRC | 09:59 | |
*** shaohe_feng has joined #openstack-meeting | 10:00 | |
*** Li_Jiale has quit IRC | 10:01 | |
*** heyongli has quit IRC | 10:07 | |
*** heyongli has joined #openstack-meeting | 10:08 | |
*** shaohe_feng has quit IRC | 10:09 | |
*** shaohe_feng has joined #openstack-meeting | 10:10 | |
*** ttsiouts has quit IRC | 10:14 | |
*** jchhatbar has joined #openstack-meeting | 10:17 | |
*** heyongli has quit IRC | 10:18 | |
*** heyongli has joined #openstack-meeting | 10:18 | |
*** julim has joined #openstack-meeting | 10:18 | |
*** janki has quit IRC | 10:19 | |
*** shaohe_feng has quit IRC | 10:20 | |
*** numans has quit IRC | 10:20 | |
*** shaohe_feng has joined #openstack-meeting | 10:21 | |
*** numans has joined #openstack-meeting | 10:25 | |
*** heyongli has quit IRC | 10:28 | |
*** heyongli has joined #openstack-meeting | 10:28 | |
*** caobin has quit IRC | 10:29 | |
*** caobin has joined #openstack-meeting | 10:29 | |
*** shaohe_feng has quit IRC | 10:30 | |
*** shaohe_feng has joined #openstack-meeting | 10:31 | |
*** boden has joined #openstack-meeting | 10:38 | |
*** heyongli has quit IRC | 10:38 | |
*** heyongli has joined #openstack-meeting | 10:38 | |
*** boden has quit IRC | 10:38 | |
*** joxyuki has quit IRC | 10:39 | |
*** shaohe_feng has quit IRC | 10:40 | |
*** salv-orlando has joined #openstack-meeting | 10:42 | |
*** shaohe_feng has joined #openstack-meeting | 10:42 | |
*** caobin has quit IRC | 10:47 | |
*** salv-orlando has quit IRC | 10:47 | |
*** slaweq has joined #openstack-meeting | 10:48 | |
*** heyongli has quit IRC | 10:48 | |
*** heyongli has joined #openstack-meeting | 10:49 | |
*** shaohe_feng has quit IRC | 10:50 | |
*** shaohe_feng has joined #openstack-meeting | 10:51 | |
*** cloudrancher has joined #openstack-meeting | 10:56 | |
*** yamamoto has quit IRC | 10:58 | |
*** heyongli has quit IRC | 10:59 | |
*** heyongli has joined #openstack-meeting | 10:59 | |
*** andreas_s has quit IRC | 11:00 | |
*** andreas_s has joined #openstack-meeting | 11:00 | |
*** andreas_s has quit IRC | 11:00 | |
*** shaohe_feng has quit IRC | 11:01 | |
*** andreas_s has joined #openstack-meeting | 11:01 | |
*** andreas_s has quit IRC | 11:02 | |
*** shaohe_feng has joined #openstack-meeting | 11:02 | |
*** andreas_s has joined #openstack-meeting | 11:02 | |
*** ttsiouts has joined #openstack-meeting | 11:02 | |
*** andreas_s has quit IRC | 11:03 | |
*** dkushwaha has quit IRC | 11:06 | |
*** yamamoto has joined #openstack-meeting | 11:07 | |
*** heyongli has quit IRC | 11:09 | |
*** tetsuro has quit IRC | 11:09 | |
*** heyongli has joined #openstack-meeting | 11:09 | |
*** shaohe_feng has quit IRC | 11:11 | |
*** shaohe_feng has joined #openstack-meeting | 11:14 | |
*** andreas_s has joined #openstack-meeting | 11:17 | |
*** heyongli has quit IRC | 11:19 | |
*** heyongli has joined #openstack-meeting | 11:19 | |
*** shaohe_feng has quit IRC | 11:21 | |
*** shaohe_feng has joined #openstack-meeting | 11:22 | |
*** pchavva has joined #openstack-meeting | 11:22 | |
*** slaweq has quit IRC | 11:23 | |
*** andreas_s has quit IRC | 11:26 | |
*** heyongli has quit IRC | 11:29 | |
*** heyongli has joined #openstack-meeting | 11:30 | |
*** yamamoto has quit IRC | 11:30 | |
*** sambetts|afk is now known as sambetts | 11:31 | |
*** shaohe_feng has quit IRC | 11:31 | |
*** shaohe_feng has joined #openstack-meeting | 11:32 | |
*** yamamoto has joined #openstack-meeting | 11:33 | |
*** andreas_s has joined #openstack-meeting | 11:35 | |
*** longkb has quit IRC | 11:36 | |
*** tpsilva has joined #openstack-meeting | 11:37 | |
*** cloudrancher has quit IRC | 11:37 | |
*** alexchad_ has joined #openstack-meeting | 11:38 | |
*** alexchadin has quit IRC | 11:38 | |
*** heyongli has quit IRC | 11:40 | |
*** heyongli has joined #openstack-meeting | 11:40 | |
*** shaohe_feng has quit IRC | 11:42 | |
*** shaohe_feng has joined #openstack-meeting | 11:42 | |
*** andreas_s has quit IRC | 11:44 | |
*** andreas_s has joined #openstack-meeting | 11:48 | |
*** heyongli has quit IRC | 11:50 | |
*** heyongli has joined #openstack-meeting | 11:50 | |
*** shaohe_feng has quit IRC | 11:52 | |
*** shaohe_feng has joined #openstack-meeting | 11:53 | |
*** cloudrancher has joined #openstack-meeting | 11:55 | |
*** rbartal has quit IRC | 12:00 | |
*** heyongli has quit IRC | 12:00 | |
*** heyongli has joined #openstack-meeting | 12:00 | |
*** shaohe_feng has quit IRC | 12:02 | |
*** rbartal has joined #openstack-meeting | 12:02 | |
*** shaohe_feng has joined #openstack-meeting | 12:04 | |
*** julim has quit IRC | 12:09 | |
*** eharney has quit IRC | 12:10 | |
*** heyongli has quit IRC | 12:10 | |
*** heyongli has joined #openstack-meeting | 12:11 | |
*** raildo has joined #openstack-meeting | 12:12 | |
*** shaohe_feng has quit IRC | 12:12 | |
*** shaohe_feng has joined #openstack-meeting | 12:13 | |
*** bobh has joined #openstack-meeting | 12:13 | |
*** imcsk8 has quit IRC | 12:16 | |
*** alexchad_ has quit IRC | 12:17 | |
*** alexpilotti has joined #openstack-meeting | 12:18 | |
*** alexpil__ has joined #openstack-meeting | 12:19 | |
*** heyongli has quit IRC | 12:21 | |
*** heyongli has joined #openstack-meeting | 12:21 | |
*** alexpilo_ has quit IRC | 12:21 | |
*** alexpilotti has quit IRC | 12:23 | |
*** shaohe_feng has quit IRC | 12:23 | |
*** imcsk8 has joined #openstack-meeting | 12:23 | |
*** shaohe_feng has joined #openstack-meeting | 12:24 | |
*** slaweq has joined #openstack-meeting | 12:25 | |
*** ttsiouts has quit IRC | 12:25 | |
*** cloudrancher has quit IRC | 12:27 | |
*** cloudran_ has joined #openstack-meeting | 12:27 | |
*** fnaval has joined #openstack-meeting | 12:28 | |
*** slaweq has quit IRC | 12:29 | |
*** alexpil__ has quit IRC | 12:30 | |
*** heyongli has quit IRC | 12:31 | |
*** alexchadin has joined #openstack-meeting | 12:31 | |
*** heyongli has joined #openstack-meeting | 12:31 | |
*** shaohe_feng has quit IRC | 12:33 | |
*** shaohe_feng has joined #openstack-meeting | 12:34 | |
*** alexpilotti has joined #openstack-meeting | 12:39 | |
*** heyongli has quit IRC | 12:41 | |
*** heyongli has joined #openstack-meeting | 12:41 | |
*** shaohe_feng has quit IRC | 12:43 | |
*** alexpilotti has quit IRC | 12:44 | |
*** shaohe_feng has joined #openstack-meeting | 12:45 | |
*** andreas_s has quit IRC | 12:48 | |
*** ttsiouts has joined #openstack-meeting | 12:49 | |
*** andreas_s has joined #openstack-meeting | 12:50 | |
*** mriedem has joined #openstack-meeting | 12:51 | |
*** heyongli has quit IRC | 12:51 | |
*** heyongli has joined #openstack-meeting | 12:52 | |
*** shaohe_feng has quit IRC | 12:53 | |
*** shaohe_feng has joined #openstack-meeting | 12:54 | |
*** dmacpher has quit IRC | 12:55 | |
*** andreas_s has quit IRC | 12:57 | |
*** cloudran_ has quit IRC | 12:57 | |
*** edmondsw has joined #openstack-meeting | 12:58 | |
*** cloudrancher has joined #openstack-meeting | 12:58 | |
*** cloudrancher has quit IRC | 12:59 | |
*** andreas_s has joined #openstack-meeting | 12:59 | |
*** yamamoto has quit IRC | 13:01 | |
*** ian_ott has joined #openstack-meeting | 13:01 | |
*** r-mibu has joined #openstack-meeting | 13:01 | |
*** heyongli has quit IRC | 13:02 | |
*** rossella_s has joined #openstack-meeting | 13:02 | |
*** heyongli has joined #openstack-meeting | 13:02 | |
*** aloga has quit IRC | 13:02 | |
*** shaohe_feng has quit IRC | 13:04 | |
*** shaohe_feng has joined #openstack-meeting | 13:04 | |
*** zhhuabj has joined #openstack-meeting | 13:10 | |
*** alexpilotti has joined #openstack-meeting | 13:11 | |
*** heyongli has quit IRC | 13:12 | |
*** heyongli has joined #openstack-meeting | 13:12 | |
*** julim has joined #openstack-meeting | 13:13 | |
*** mjturek has joined #openstack-meeting | 13:14 | |
*** shaohe_feng has quit IRC | 13:14 | |
*** shaohe_feng has joined #openstack-meeting | 13:15 | |
*** dustins has joined #openstack-meeting | 13:17 | |
*** alexpilo_ has joined #openstack-meeting | 13:20 | |
*** heyongli has quit IRC | 13:22 | |
*** heyongli has joined #openstack-meeting | 13:22 | |
*** eharney has joined #openstack-meeting | 13:23 | |
*** alexpilotti has quit IRC | 13:24 | |
*** shaohe_feng has quit IRC | 13:24 | |
*** shaohe_feng has joined #openstack-meeting | 13:25 | |
*** frickler has quit IRC | 13:26 | |
*** frickler has joined #openstack-meeting | 13:26 | |
*** bobh has quit IRC | 13:29 | |
*** yamamoto has joined #openstack-meeting | 13:29 | |
*** alexpilotti has joined #openstack-meeting | 13:30 | |
*** heyongli has quit IRC | 13:32 | |
*** alexchadin has quit IRC | 13:33 | |
*** heyongli has joined #openstack-meeting | 13:33 | |
*** fabian_ has joined #openstack-meeting | 13:33 | |
*** alexpilo_ has quit IRC | 13:33 | |
*** shaohe_feng has quit IRC | 13:34 | |
*** shaohe_feng has joined #openstack-meeting | 13:35 | |
*** awaugama has joined #openstack-meeting | 13:36 | |
*** e0ne has quit IRC | 13:39 | |
*** alexpilo_ has joined #openstack-meeting | 13:40 | |
*** hongbin has joined #openstack-meeting | 13:42 | |
*** heyongli has quit IRC | 13:43 | |
*** heyongli has joined #openstack-meeting | 13:43 | |
*** alexpilotti has quit IRC | 13:43 | |
*** e0ne has joined #openstack-meeting | 13:44 | |
*** shaohe_feng has quit IRC | 13:45 | |
*** shaohe_feng has joined #openstack-meeting | 13:47 | |
*** alexpilotti has joined #openstack-meeting | 13:50 | |
*** alexchadin has joined #openstack-meeting | 13:51 | |
*** heyongli has quit IRC | 13:53 | |
*** heyongli has joined #openstack-meeting | 13:53 | |
*** alexpilo_ has quit IRC | 13:53 | |
*** shaohe_feng has quit IRC | 13:55 | |
*** shaohe_feng has joined #openstack-meeting | 13:56 | |
*** alexpilo_ has joined #openstack-meeting | 14:00 | |
*** julim_ has joined #openstack-meeting | 14:01 | |
*** jchhatbar is now known as janki | 14:01 | |
*** julim_ has quit IRC | 14:02 | |
*** njohnston has joined #openstack-meeting | 14:02 | |
*** rfolco_ is now known as rfolco | 14:03 | |
*** dkushwaha has joined #openstack-meeting | 14:03 | |
*** heyongli has quit IRC | 14:03 | |
*** julim_ has joined #openstack-meeting | 14:03 | |
*** alexpilotti has quit IRC | 14:03 | |
*** heyongli has joined #openstack-meeting | 14:03 | |
*** julim has quit IRC | 14:04 | |
*** rpioso|afk is now known as rpioso | 14:04 | |
*** shaohe_feng has quit IRC | 14:05 | |
*** rossella_s has quit IRC | 14:07 | |
*** shaohe_feng has joined #openstack-meeting | 14:08 | |
*** dkushwaha has quit IRC | 14:08 | |
*** alexchadin has quit IRC | 14:08 | |
*** rossella_s has joined #openstack-meeting | 14:09 | |
*** psahoo has quit IRC | 14:09 | |
*** artom has joined #openstack-meeting | 14:09 | |
*** alexpilotti has joined #openstack-meeting | 14:10 | |
*** jamesmcarthur_ has joined #openstack-meeting | 14:12 | |
*** heyongli has quit IRC | 14:13 | |
*** rossella_s has quit IRC | 14:13 | |
*** alexpilo_ has quit IRC | 14:13 | |
*** heyongli has joined #openstack-meeting | 14:14 | |
*** shaohe_feng has quit IRC | 14:15 | |
*** wxy| has joined #openstack-meeting | 14:16 | |
*** shaohe_feng has joined #openstack-meeting | 14:16 | |
*** armax has joined #openstack-meeting | 14:16 | |
*** cdub has joined #openstack-meeting | 14:17 | |
*** fabian_ has quit IRC | 14:17 | |
*** slaweq has joined #openstack-meeting | 14:17 | |
*** rossella_s has joined #openstack-meeting | 14:17 | |
*** heyongli has quit IRC | 14:18 | |
*** shaohe_feng has quit IRC | 14:18 | |
*** heyongli has joined #openstack-meeting | 14:19 | |
*** shaohe_feng has joined #openstack-meeting | 14:19 | |
*** alexpilo_ has joined #openstack-meeting | 14:20 | |
*** cdub has quit IRC | 14:22 | |
*** e0ne has quit IRC | 14:23 | |
*** alexpilotti has quit IRC | 14:23 | |
*** heyongli has quit IRC | 14:24 | |
*** heyongli has joined #openstack-meeting | 14:24 | |
*** eharney has quit IRC | 14:25 | |
*** shintaro has joined #openstack-meeting | 14:25 | |
*** e0ne has joined #openstack-meeting | 14:25 | |
*** shaohe_feng has quit IRC | 14:26 | |
*** felipemonteiro has joined #openstack-meeting | 14:26 | |
*** shaohe_feng has joined #openstack-meeting | 14:26 | |
*** psachin has quit IRC | 14:28 | |
*** felipemonteiro_ has joined #openstack-meeting | 14:29 | |
*** alexpilotti has joined #openstack-meeting | 14:30 | |
*** felipemonteiro has quit IRC | 14:33 | |
*** alexpilo_ has quit IRC | 14:33 | |
*** heyongli has quit IRC | 14:34 | |
*** heyongli has joined #openstack-meeting | 14:34 | |
*** shaohe_feng has quit IRC | 14:36 | |
*** shaohe_feng has joined #openstack-meeting | 14:36 | |
*** efried has quit IRC | 14:40 | |
*** antosh has joined #openstack-meeting | 14:40 | |
*** alexpilo_ has joined #openstack-meeting | 14:40 | |
*** efried has joined #openstack-meeting | 14:40 | |
*** bobh has joined #openstack-meeting | 14:40 | |
*** heyongli has quit IRC | 14:40 | |
*** shaohe_feng has quit IRC | 14:40 | |
*** eharney has joined #openstack-meeting | 14:42 | |
*** alexpilotti has quit IRC | 14:43 | |
*** rossella_s has quit IRC | 14:49 | |
*** alexpilotti has joined #openstack-meeting | 14:50 | |
*** rossella_s has joined #openstack-meeting | 14:51 | |
*** gongysh has quit IRC | 14:53 | |
*** alexpilo_ has quit IRC | 14:53 | |
*** cloudrancher has joined #openstack-meeting | 14:55 | |
*** shintaro has quit IRC | 14:57 | |
*** alexpilo_ has joined #openstack-meeting | 15:00 | |
*** alexpilotti has quit IRC | 15:03 | |
*** kaisers_ has joined #openstack-meeting | 15:05 | |
*** hemna_ has joined #openstack-meeting | 15:06 | |
*** e0ne has quit IRC | 15:07 | |
*** markstur has joined #openstack-meeting | 15:09 | |
*** alexpilotti has joined #openstack-meeting | 15:10 | |
*** e0ne has joined #openstack-meeting | 15:11 | |
*** jamesmca_ has joined #openstack-meeting | 15:12 | |
*** janki has quit IRC | 15:13 | |
*** alexpilo_ has quit IRC | 15:13 | |
*** munimeha2 has joined #openstack-meeting | 15:17 | |
*** felipemonteiro_ has quit IRC | 15:19 | |
*** felipemonteiro_ has joined #openstack-meeting | 15:19 | |
*** cloudrancher has quit IRC | 15:20 | |
*** alexpilo_ has joined #openstack-meeting | 15:20 | |
*** cloudrancher has joined #openstack-meeting | 15:21 | |
*** felipemonteiro has joined #openstack-meeting | 15:22 | |
*** alexpilotti has quit IRC | 15:24 | |
*** felipemonteiro_ has quit IRC | 15:24 | |
*** Guest1606 has quit IRC | 15:28 | |
*** alexpilotti has joined #openstack-meeting | 15:30 | |
*** andreas_s has quit IRC | 15:32 | |
*** heyongli has joined #openstack-meeting | 15:32 | |
*** felipemonteiro has quit IRC | 15:32 | |
*** felipemonteiro has joined #openstack-meeting | 15:32 | |
*** felipemonteiro_ has joined #openstack-meeting | 15:33 | |
*** alexpilo_ has quit IRC | 15:33 | |
*** shaohe_feng has joined #openstack-meeting | 15:34 | |
*** heyongli has quit IRC | 15:34 | |
*** heyongli has joined #openstack-meeting | 15:34 | |
*** shaohe_feng has quit IRC | 15:36 | |
*** ttsiouts has quit IRC | 15:36 | |
*** felipemonteiro has quit IRC | 15:37 | |
*** shaohe_feng has joined #openstack-meeting | 15:37 | |
*** eharney has quit IRC | 15:39 | |
*** alexpilo_ has joined #openstack-meeting | 15:40 | |
*** ricolin has joined #openstack-meeting | 15:42 | |
*** pcaruana has quit IRC | 15:42 | |
*** ttsiouts has joined #openstack-meeting | 15:43 | |
*** alexpilotti has quit IRC | 15:44 | |
*** heyongli has quit IRC | 15:44 | |
*** heyongli has joined #openstack-meeting | 15:45 | |
*** shaohe_feng has quit IRC | 15:47 | |
*** shaohe_feng has joined #openstack-meeting | 15:47 | |
*** gyee has joined #openstack-meeting | 15:50 | |
*** alexpilotti has joined #openstack-meeting | 15:50 | |
*** dklyle has quit IRC | 15:50 | |
*** chyka has joined #openstack-meeting | 15:52 | |
*** dklyle has joined #openstack-meeting | 15:53 | |
*** cloudrancher has quit IRC | 15:53 | |
*** alexpilo_ has quit IRC | 15:54 | |
*** cloudrancher has joined #openstack-meeting | 15:54 | |
*** heyongli has quit IRC | 15:55 | |
*** heyongli has joined #openstack-meeting | 15:55 | |
*** shaohe_feng has quit IRC | 15:57 | |
*** shaohe_feng has joined #openstack-meeting | 16:00 | |
*** mlavalle has joined #openstack-meeting | 16:00 | |
slaweq | #startmeeting neutron_ci | 16:00 |
openstack | Meeting started Tue Jun 26 16:00:22 2018 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
slaweq | hi | 16:00 |
*** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
mlavalle | o/ | 16:00 |
openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
*** alexpilo_ has joined #openstack-meeting | 16:00 | |
njohnston | o/ | 16:00 |
slaweq | haleyb: are You around? | 16:01 |
* slaweq is on airport so sorry if there will be some issues with connection | 16:02 | |
slaweq | ok, I maybe haleyb will join later | 16:02 |
slaweq | let's start | 16:02 |
mlavalle | going on vaction? | 16:02 |
slaweq | no, I'm going back home from internal training | 16:02 |
mlavalle | ahhh | 16:03 |
mlavalle | have a safe flight | 16:03 |
slaweq | thx :) | 16:03 |
slaweq | #topic Actions from previous meetings | 16:03 |
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 16:03 | |
slaweq | we have only one action from last week | 16:03 |
slaweq | njohnston to look into adding Grafana dasboard for stable branches | 16:03 |
*** gyee has quit IRC | 16:03 | |
*** alexpilotti has quit IRC | 16:03 | |
njohnston | I have started working on that but got pulled into some other things; I plan to push something for people to review later this week | 16:04 |
njohnston | Apologies for the delay | 16:04 |
slaweq | ok, thx for update | 16:04 |
slaweq | no problem, it's not very urgent :) | 16:04 |
slaweq | #action njohnston to look into adding Grafana dasboard for stable branches | 16:04 |
slaweq | You have it for next week :) | 16:04 |
mlavalle | no apologies needed. we all have sponsors who help us to pay the bills | 16:05 |
njohnston | thanks | 16:05 |
mlavalle | and they have their priorities | 16:05 |
slaweq | mlavalle: well said :) | 16:05 |
*** heyongli has quit IRC | 16:05 | |
slaweq | #topic Grafana | 16:05 |
*** heyongli has joined #openstack-meeting | 16:05 | |
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:05 | |
slaweq | http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:05 |
slaweq | generally it doesn't looks very bad this week IMO | 16:07 |
*** shaohe_feng has quit IRC | 16:07 | |
slaweq | but I don't know why there is some "gap" with graphs yesterday and on Sunday | 16:07 |
mlavalle | The tempest linux bridge job has had some failures | 16:07 |
slaweq | mlavalle: are You talking about this "spike" in gate queue? | 16:08 |
mlavalle | yeah | 16:08 |
slaweq | I was checking that and I found few issues not related to neutron, like e.g. 503 errors from cinder: http://logs.openstack.org/63/323963/61/check/neutron-tempest-linuxbridge/1d56164/logs/testr_results.html.gz | 16:08 |
mlavalle | yes, I agree, What I've seens is someting about Nova tagging testing | 16:09 |
slaweq | and I think that this high failure rate is also because there was no many runs counted this time | 16:09 |
*** AndreyS has quit IRC | 16:09 | |
*** shaohe_feng has joined #openstack-meeting | 16:09 | |
*** e0ne has quit IRC | 16:09 | |
slaweq | as I went yesterday through some of failed jobs and there wasn't many failed examples of this job | 16:10 |
mlavalle | ok, let's keep an eye on it and see what happens over the next few days | 16:10 |
slaweq | about tagging test failure I have it for one of next topics :) | 16:10 |
*** diman has quit IRC | 16:10 | |
*** alexpilotti has joined #openstack-meeting | 16:10 | |
slaweq | mlavalle: I agree | 16:10 |
*** rossella_s has quit IRC | 16:10 | |
mlavalle | maybe I am just pissed off with this job because it has failed in some of my patches ;-) | 16:11 |
slaweq | so let's now talk about some specific jobs | 16:11 |
slaweq | mlavalle: LOL | 16:11 |
slaweq | maybe | 16:11 |
slaweq | #topic Unit tests | 16:11 |
*** openstack changes topic to "Unit tests (Meeting topic: neutron_ci)" | 16:11 | |
slaweq | I added UT as a topic today because I found few failures with some timeout | 16:11 |
slaweq | like e.g.: http://logs.openstack.org/58/565358/14/check/openstack-tox-py35/aa30b12/job-output.txt.gz or http://logs.openstack.org/03/563803/9/check/openstack-tox-py35/a50de4a/job-output.txt.gz | 16:11 |
slaweq | and it was always py35 | 16:12 |
*** cloudrancher has quit IRC | 16:12 | |
*** cdub has joined #openstack-meeting | 16:12 | |
slaweq | or maybe You saw something similar with py27 but I didn't spotted it yet | 16:12 |
*** harlowja has joined #openstack-meeting | 16:12 | |
mlavalle | mhhh, let me see | 16:12 |
slaweq | I think that this should be investigated | 16:12 |
*** e0ne has joined #openstack-meeting | 16:13 | |
mlavalle | no, I saw I timeout a few minutes ago, but it wasn't unit tests | 16:13 |
*** alexpilo_ has quit IRC | 16:13 | |
*** r-mibu has quit IRC | 16:14 | |
*** rossella_s has joined #openstack-meeting | 16:14 | |
njohnston | I have seen tempest get killed due to timeouts as well, for example: http://logs.openstack.org/61/566961/4/check/neutron-tempest-iptables_hybrid/c70896b/job-output.txt.gz#_2018-06-26_08_55_07_638631 | 16:14 |
*** ahrechny has quit IRC | 16:14 | |
*** heyongli has quit IRC | 16:15 | |
slaweq | I think that we should report this one as a bug, check how long "good" run takes and then check what issue it is maybe | 16:15 |
*** heyongli has joined #openstack-meeting | 16:15 | |
mlavalle | sounds like a plan | 16:16 |
slaweq | and I will try to investigate this UT tests | 16:16 |
slaweq | #actions slaweq will report and investigate py35 timeouts | 16:16 |
slaweq | njohnston: tempest is probably different issue | 16:16 |
slaweq | I know that it happens sometimes and we probably also should check | 16:17 |
*** shaohe_feng has quit IRC | 16:17 | |
slaweq | njohnston: would You like to investigate it? | 16:18 |
slaweq | ok, I will report it as a bug also and I will see if I will be able to check it this week | 16:19 |
*** shaohe_feng has joined #openstack-meeting | 16:19 | |
slaweq | #action slaweq reports a bug with tempest timeouts, like on http://logs.openstack.org/61/566961/4/check/neutron-tempest-iptables_hybrid/c70896b/job-output.txt.gz | 16:20 |
slaweq | ok, let's go to next one | 16:20 |
slaweq | #topic Functional | 16:20 |
*** openstack changes topic to "Functional (Meeting topic: neutron_ci)" | 16:20 | |
*** alexpilo_ has joined #openstack-meeting | 16:20 | |
slaweq | I saw at least few times something like: * http://logs.openstack.org/58/574058/10/check/neutron-functional/f38d685/logs/testr_results.html.gz | 16:20 |
slaweq | it might be related to https://bugs.launchpad.net/neutron/+bug/1687027 | 16:21 |
openstack | Launchpad bug 1687027 in neutron "test_walk_versions tests fail with "IndexError: tuple index out of range" after timeout" [High,Confirmed] | 16:21 |
slaweq | it happens at least few times this week so I think we should also dig into it and maybe find a way how to fix it :) | 16:21 |
*** alexpilotti has quit IRC | 16:23 | |
slaweq | and those are different tests failing but with similar error, second example from last few days: * http://logs.openstack.org/61/567461/4/check/neutron-functional/81d69a4/logs/testr_results.html.gz | 16:24 |
slaweq | any volunteer to debug this issue? | 16:24 |
mlavalle | o/ | 16:24 |
slaweq | thx mlavalle :) | 16:24 |
mlavalle | I assigned it to me | 16:25 |
slaweq | #action mlavalle will check functional tests issue, https://bugs.launchpad.net/neutron/+bug/1687027 | 16:25 |
openstack | Launchpad bug 1687027 in neutron "test_walk_versions tests fail with "IndexError: tuple index out of range" after timeout" [High,Confirmed] - Assigned to Miguel Lavalle (minsel) | 16:25 |
slaweq | ok, thx a lot | 16:25 |
slaweq | I will not talk about fullstack tests today as it is on quite good failure rate recently and I didn't have time to dig into this one often failing test yet | 16:25 |
*** heyongli has quit IRC | 16:25 | |
slaweq | so next topic will be now | 16:25 |
*** yangyape_ has joined #openstack-meeting | 16:26 | |
slaweq | #topic Scenarios | 16:26 |
*** openstack changes topic to "Scenarios (Meeting topic: neutron_ci)" | 16:26 | |
*** heyongli has joined #openstack-meeting | 16:26 | |
slaweq | As mlavalle mentioned before, there is some issue with tagging test from tempest | 16:26 |
slaweq | bug report: https://bugs.launchpad.net/tempest/+bug/1775947 | 16:26 |
openstack | Launchpad bug 1775947 in tempest "tempest.api.compute.servers.test_device_tagging.TaggedAttachmentsTest failing" [Medium,Confirmed] - Assigned to Deepak Mourya (mourya007) | 16:26 |
mlavalle | yeah I've seen it more in api tests | 16:26 |
slaweq | example of failure is e.g. on http://logs.openstack.org/44/575444/4/gate/neutron-tempest-linuxbridge/118cc97/logs/testr_results.html.gz | 16:27 |
mlavalle | not as much in scenrio tests | 16:27 |
slaweq | ahh, yes | 16:27 |
slaweq | sorry, my bad | 16:27 |
slaweq | I mixed them as it's "tempest" in both cases :) | 16:27 |
slaweq | it's in tempest api tests | 16:27 |
slaweq | so let's change topic to | 16:27 |
mlavalle | and ye, I see it most;y in the linuxbridge job | 16:27 |
*** yangyapeng has quit IRC | 16:27 | |
slaweq | #topic tempest tests | 16:27 |
*** openstack changes topic to "tempest tests (Meeting topic: neutron_ci)" | 16:27 | |
slaweq | :) | 16:27 |
*** shaohe_feng has quit IRC | 16:28 | |
slaweq | I didn't check if it's only related to linuxbridge job | 16:28 |
*** shaohe_feng has joined #openstack-meeting | 16:28 | |
slaweq | what I saw often was something like "process exited with errcode 137" on VM | 16:28 |
*** jamesmca_ has quit IRC | 16:28 | |
slaweq | during doing "curl" to metadata service | 16:28 |
mlavalle | right, I've also seen the message about the metadata service | 16:29 |
*** jamesmca_ has joined #openstack-meeting | 16:29 | |
*** alexpilotti has joined #openstack-meeting | 16:30 | |
slaweq | for now it is reported against tempest as I suspected at first glance that it might be issue with "too fast" removing of port from instance and doing curl from VM to metadata API | 16:31 |
slaweq | but now I'm not sure if that is (only) issue | 16:31 |
slaweq | I will try to investigate it more as I was already checking it a bit | 16:31 |
slaweq | but I'm not sure if I will be able to do it this week | 16:32 |
*** cloudrancher has joined #openstack-meeting | 16:32 | |
slaweq | #action slaweq will investigate tagging tempest test issue | 16:32 |
*** cdub has quit IRC | 16:33 | |
*** ricolin has quit IRC | 16:33 | |
slaweq | from other issues which I found and wanted to raise here is failure in neutron-tempest-dvr test: | 16:33 |
slaweq | http://logs.openstack.org/14/529814/16/check/neutron-tempest-dvr/d9696d5/logs/testr_results.html.gz | 16:33 |
slaweq | I think I spotted it only once but maybe You saw it also somewhere? | 16:33 |
*** alexpilo_ has quit IRC | 16:33 | |
*** jamesmca_ has quit IRC | 16:34 | |
mlavalle | NO I haven't seen it | 16:34 |
mlavalle | But I'll keep an eye open for it | 16:34 |
slaweq | thx mlavalle | 16:35 |
*** e0ne has quit IRC | 16:35 | |
*** heyongli has quit IRC | 16:36 | |
slaweq | I also found timeout issue with tempest-py3 test: http://logs.openstack.org/61/566961/4/gate/tempest-full-py3/4ca37f8/job-output.txt.gz | 16:36 |
*** heyongli has joined #openstack-meeting | 16:36 | |
*** cloudrancher has quit IRC | 16:36 | |
slaweq | but I think that's the same as pointed by njohnston earlier | 16:36 |
slaweq | so it's already assigned to me :) | 16:36 |
mlavalle | lol | 16:37 |
slaweq | anything else to add here? | 16:37 |
mlavalle | not from me | 16:37 |
slaweq | ok, moving to next topic then | 16:37 |
slaweq | #topic Rally | 16:37 |
*** openstack changes topic to "Rally (Meeting topic: neutron_ci)" | 16:37 | |
slaweq | There was an issue related to rally last week (spike on grafana) but was fixed quickly on rally side after talk with andreykurilin | 16:37 |
slaweq | it's just FYI :) | 16:37 |
mlavalle | ack | 16:38 |
slaweq | today boden spotted some new issue with rally for stable/queens branch | 16:38 |
slaweq | https://bugs.launchpad.net/neutron/+bug/1778714 | 16:38 |
openstack | Launchpad bug 1778714 in neutron "neutron-rally-neutron fails with `NeutronTrunks.create_and_list_trunk_subports` in in any platform" [Critical,New] | 16:38 |
*** shaohe_feng has quit IRC | 16:38 | |
slaweq | but it looks that patch which he proposed fixes this problem | 16:38 |
mlavalle | is that a neutron patch? | 16:38 |
slaweq | I also talked with andreykurilin on rally channel and he confirmed me just before meeting that this should help :) | 16:38 |
slaweq | yes: https://review.openstack.org/#/c/578104/ | 16:39 |
patchbot | patch 578104 - neutron (stable/queens) - Use rally 0.12.1 release for stable/pike branch. | 16:39 |
*** janki has joined #openstack-meeting | 16:39 | |
mlavalle | ok, added to my pile | 16:39 |
*** qwebirc17612 has joined #openstack-meeting | 16:40 | |
slaweq | thx mlavalle | 16:40 |
*** tesseract has quit IRC | 16:40 | |
*** alexpilo_ has joined #openstack-meeting | 16:40 | |
slaweq | so I guess we can go to next topic now | 16:40 |
slaweq | #topic Grenade | 16:40 |
*** openstack changes topic to "Grenade (Meeting topic: neutron_ci)" | 16:40 | |
slaweq | I also found issue in neutron-grenade-dvr-multinode job: | 16:40 |
slaweq | http://logs.openstack.org/03/563803/9/check/neutron-grenade-dvr-multinode/13338d9/logs/testr_results.html.gz | 16:41 |
slaweq | did You saw it already? | 16:41 |
*** shaohe_feng has joined #openstack-meeting | 16:41 | |
mlavalle | I think I did, yeah | 16:41 |
slaweq | so it't also something which we should check | 16:41 |
mlavalle | This specific failure is the instance failing to become active | 16:42 |
slaweq | it looks for me like something what can be potentially related to neutron | 16:42 |
slaweq | L2 agent could not configure port or server didn't send notification to nova | 16:42 |
slaweq | or it's maybe just misconfiguration problem as it stays in error message that it didn't become active in 196 seconds | 16:43 |
slaweq | and IIRC nova-compute waits for port to be active for 300 seconds by default | 16:43 |
*** alexpilotti has quit IRC | 16:44 | |
*** heyongli has quit IRC | 16:46 | |
*** heyongli has joined #openstack-meeting | 16:46 | |
slaweq | strange thing for me is that this instance uuid is not in nova-compute logs at all | 16:47 |
slaweq | but I don't know exactly if it should be there | 16:47 |
*** qwebirc17612 has quit IRC | 16:47 | |
*** njohnston has quit IRC | 16:48 | |
*** shaohe_feng has quit IRC | 16:48 | |
slaweq | mlavalle: but in neutron-server logs there are some errors relted to dvr somehow: http://logs.openstack.org/03/563803/9/check/neutron-grenade-dvr-multinode/13338d9/logs/screen-q-svc.txt.gz?level=ERROR | 16:48 |
*** njohnston has joined #openstack-meeting | 16:48 | |
*** rossella_s has quit IRC | 16:48 | |
slaweq | check first 3 lines | 16:48 |
slaweq | do You think that it might be related? | 16:49 |
*** lpetrut has quit IRC | 16:50 | |
*** alexpilotti has joined #openstack-meeting | 16:50 | |
*** shaohe_feng has joined #openstack-meeting | 16:50 | |
slaweq | mlavalle: are You here still? :) | 16:51 |
mlavalle | mhhh | 16:51 |
mlavalle | I was looking | 16:51 |
slaweq | ahh, ok :) | 16:51 |
mlavalle | at first glance I don't think so | 16:51 |
mlavalle | the messages refer to DVR ports | 16:51 |
mlavalle | and multiple port bindings only apply to compute ports | 16:52 |
mlavalle | but I will keep an eye open anyways | 16:52 |
mlavalle | thanks for bringingi up | 16:52 |
slaweq | thx | 16:52 |
slaweq | ok, that's all from me according to failures in CI for this week | 16:53 |
slaweq | do You have anything else? | 16:53 |
mlavalle | nope, thanks flor the thorough update, as usual | 16:53 |
*** rossella_s has joined #openstack-meeting | 16:53 | |
njohnston | Quick question, do the grafana graphs include just jobs that end in ERROR, or do they also include the increasing number of jobs that end in TIMED_OUT status as reported back in Zuul? | 16:53 |
*** alexpilo_ has quit IRC | 16:53 | |
slaweq | njohnston: good question | 16:53 |
slaweq | I don't know to be honest | 16:54 |
mlavalle | don't know either | 16:54 |
mlavalle | better ask in the infra channel | 16:54 |
slaweq | according to config file of dashboard: https://git.openstack.org/cgit/openstack-infra/project-config/tree/grafana/neutron.yaml | 16:55 |
slaweq | it's FAILURE but I have no idea how this value is calculated :) | 16:55 |
njohnston | right | 16:55 |
njohnston | OK, i will ask in infra channel and report back | 16:55 |
slaweq | njohnston: thx a lot | 16:55 |
slaweq | if You don't have anything else I have one more thing to tell You | 16:56 |
njohnston | #action njohnston to ask infra team if TIMED_OUT is included in FAILURE for grafana graphs | 16:56 |
njohnston | go ahead | 16:56 |
*** heyongli has quit IRC | 16:56 | |
slaweq | next 2 weeks I will be on PTO (\o/) so I will not be able to do this meeting | 16:56 |
*** heyongli has joined #openstack-meeting | 16:56 | |
slaweq | You will need to find someone else who will replace me or just cancel them | 16:57 |
*** yamahata has joined #openstack-meeting | 16:57 | |
slaweq | I will be able to chair it again on 17.07 | 16:57 |
mlavalle | Next week will be slow anyway with the July 4th holiday anywas | 16:57 |
mlavalle | so probably it will be best to cancel it | 16:57 |
mlavalle | but I can run it on the 10th | 16:57 |
slaweq | ok, I will send email about canceling next week's meeting | 16:58 |
slaweq | and thx for handling 10th of July :) | 16:58 |
mlavalle | if you trust I can handle it, that is | 16:58 |
njohnston | thanks mlavalle | 16:58 |
slaweq | #action slaweq will cancel next week's meeting | 16:58 |
*** shaohe_feng has quit IRC | 16:58 | |
slaweq | mlavalle: You will do it better than me for sure :) | 16:58 |
mlavalle | doubt it. I'll do it anyway | 16:59 |
slaweq | ok, thx for attending today | 16:59 |
* haleyb waves in the final minute, just got back and will go through the logs | 16:59 | |
slaweq | hi haleyb :) | 16:59 |
slaweq | see You all | 16:59 |
haleyb | bye slaweq :) | 16:59 |
mlavalle | what airport are you at slaweq ? | 16:59 |
slaweq | #endmeeting | 16:59 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 16:59 | |
openstack | Meeting ended Tue Jun 26 16:59:41 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:59 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-06-26-16.00.html | 16:59 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-06-26-16.00.txt | 16:59 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-06-26-16.00.log.html | 16:59 |
slaweq | haleyb: bye :) | 16:59 |
slaweq | mlavalle: Munich | 16:59 |
mlavalle | have a safe flight! | 17:00 |
slaweq | thanks | 17:00 |
*** alexpilo_ has joined #openstack-meeting | 17:00 | |
*** shaohe_feng has joined #openstack-meeting | 17:01 | |
*** alexpilotti has quit IRC | 17:03 | |
*** sambetts is now known as sambetts|afk | 17:04 | |
*** wxy| has quit IRC | 17:04 | |
*** heyongli has quit IRC | 17:06 | |
*** heyongli has joined #openstack-meeting | 17:07 | |
*** shaohe_feng has quit IRC | 17:09 | |
*** shaohe_feng has joined #openstack-meeting | 17:10 | |
*** harlowja has quit IRC | 17:10 | |
*** alexpilotti has joined #openstack-meeting | 17:10 | |
*** e0ne has joined #openstack-meeting | 17:11 | |
*** yamamoto has quit IRC | 17:12 | |
*** alexpilo_ has quit IRC | 17:13 | |
*** felipemonteiro_ has quit IRC | 17:14 | |
*** ttsiouts has quit IRC | 17:14 | |
*** felipemonteiro_ has joined #openstack-meeting | 17:14 | |
*** yamamoto has joined #openstack-meeting | 17:14 | |
*** ttsiouts has joined #openstack-meeting | 17:15 | |
*** heyongli has quit IRC | 17:17 | |
*** heyongli has joined #openstack-meeting | 17:17 | |
*** e0ne has quit IRC | 17:18 | |
*** shaohe_feng has quit IRC | 17:19 | |
*** gyee has joined #openstack-meeting | 17:20 | |
*** ttsiouts has quit IRC | 17:20 | |
*** yamamoto has quit IRC | 17:20 | |
*** shaohe_feng has joined #openstack-meeting | 17:20 | |
*** alexpilo_ has joined #openstack-meeting | 17:20 | |
*** alexpilotti has quit IRC | 17:23 | |
*** heyongli has quit IRC | 17:27 | |
*** heyongli has joined #openstack-meeting | 17:27 | |
*** shaohe_feng has quit IRC | 17:29 | |
*** alexpilotti has joined #openstack-meeting | 17:30 | |
*** shaohe_feng has joined #openstack-meeting | 17:30 | |
*** alexpilo_ has quit IRC | 17:34 | |
*** heyongli has quit IRC | 17:37 | |
*** heyongli has joined #openstack-meeting | 17:37 | |
*** Swami has joined #openstack-meeting | 17:39 | |
*** Swami_ has joined #openstack-meeting | 17:39 | |
*** shaohe_feng has quit IRC | 17:39 | |
*** slaweq has quit IRC | 17:40 | |
*** alexpilo_ has joined #openstack-meeting | 17:40 | |
*** shaohe_feng has joined #openstack-meeting | 17:42 | |
*** tssurya has quit IRC | 17:43 | |
*** alexpilotti has quit IRC | 17:43 | |
*** felipemonteiro__ has joined #openstack-meeting | 17:44 | |
*** kopecmartin has quit IRC | 17:46 | |
*** heyongli has quit IRC | 17:47 | |
*** cdub has joined #openstack-meeting | 17:47 | |
*** heyongli has joined #openstack-meeting | 17:48 | |
*** felipemonteiro_ has quit IRC | 17:48 | |
*** andreas_s has joined #openstack-meeting | 17:48 | |
*** felipemonteiro__ has quit IRC | 17:49 | |
*** felipemonteiro__ has joined #openstack-meeting | 17:49 | |
*** shaohe_feng has quit IRC | 17:50 | |
*** alexpilotti has joined #openstack-meeting | 17:50 | |
*** shaohe_feng has joined #openstack-meeting | 17:51 | |
*** electrofelix has quit IRC | 17:52 | |
*** andreas_s has quit IRC | 17:53 | |
*** felipemonteiro has joined #openstack-meeting | 17:53 | |
*** felipemonteiro__ has quit IRC | 17:54 | |
*** alexpilo_ has quit IRC | 17:54 | |
*** heyongli has quit IRC | 17:58 | |
*** heyongli has joined #openstack-meeting | 17:58 | |
*** rossella_s has quit IRC | 17:58 | |
*** shaohe_feng has quit IRC | 18:00 | |
*** alexpilo_ has joined #openstack-meeting | 18:00 | |
*** felipemonteiro has quit IRC | 18:01 | |
*** shaohe_feng has joined #openstack-meeting | 18:01 | |
*** felipemonteiro has joined #openstack-meeting | 18:01 | |
*** rossella_s has joined #openstack-meeting | 18:02 | |
*** gary_perkins has quit IRC | 18:03 | |
*** armstrong has joined #openstack-meeting | 18:03 | |
*** alexpilotti has quit IRC | 18:03 | |
*** felipemonteiro_ has joined #openstack-meeting | 18:08 | |
*** heyongli has quit IRC | 18:08 | |
*** gary_perkins has joined #openstack-meeting | 18:08 | |
*** heyongli has joined #openstack-meeting | 18:08 | |
*** shaohe_feng has quit IRC | 18:10 | |
*** alexpilotti has joined #openstack-meeting | 18:10 | |
*** felipemonteiro has quit IRC | 18:11 | |
*** shaohe_feng has joined #openstack-meeting | 18:11 | |
*** cdub has quit IRC | 18:14 | |
*** alexpilo_ has quit IRC | 18:14 | |
*** armstrong has quit IRC | 18:14 | |
*** armstrong has joined #openstack-meeting | 18:15 | |
*** eharney has joined #openstack-meeting | 18:16 | |
*** yamamoto has joined #openstack-meeting | 18:16 | |
*** heyongli has quit IRC | 18:18 | |
*** heyongli has joined #openstack-meeting | 18:19 | |
*** cdub has joined #openstack-meeting | 18:19 | |
*** armstrong has quit IRC | 18:19 | |
*** alexpilo_ has joined #openstack-meeting | 18:20 | |
*** yamamoto has quit IRC | 18:20 | |
*** shaohe_feng has quit IRC | 18:20 | |
*** yamamoto has joined #openstack-meeting | 18:21 | |
*** shaohe_feng has joined #openstack-meeting | 18:21 | |
*** alexpilotti has quit IRC | 18:23 | |
*** ekcs has joined #openstack-meeting | 18:26 | |
*** rossella_s has quit IRC | 18:28 | |
*** heyongli has quit IRC | 18:28 | |
*** heyongli has joined #openstack-meeting | 18:29 | |
*** alexpilotti has joined #openstack-meeting | 18:30 | |
*** shaohe_feng has quit IRC | 18:31 | |
*** dmellado has quit IRC | 18:32 | |
*** gouthamr has quit IRC | 18:32 | |
*** rossella_s has joined #openstack-meeting | 18:33 | |
*** antosh has quit IRC | 18:33 | |
*** stevebaker has quit IRC | 18:33 | |
*** alexpilo_ has quit IRC | 18:34 | |
*** slaweq has joined #openstack-meeting | 18:34 | |
*** shaohe_feng has joined #openstack-meeting | 18:35 | |
*** heyongli has quit IRC | 18:39 | |
*** heyongli has joined #openstack-meeting | 18:39 | |
*** alexpilo_ has joined #openstack-meeting | 18:40 | |
*** shaohe_feng has quit IRC | 18:41 | |
*** shaohe_feng has joined #openstack-meeting | 18:43 | |
*** alexpilotti has quit IRC | 18:44 | |
*** heyongli has quit IRC | 18:49 | |
*** heyongli has joined #openstack-meeting | 18:49 | |
*** alexpilotti has joined #openstack-meeting | 18:50 | |
*** antosh has joined #openstack-meeting | 18:50 | |
*** shaohe_feng has quit IRC | 18:51 | |
*** shaohe_feng has joined #openstack-meeting | 18:52 | |
*** sridharg has quit IRC | 18:52 | |
*** alexpilo_ has quit IRC | 18:53 | |
clarkb | anyone here for the Infra meeting? we'll get started in a couple minutes | 18:59 |
*** heyongli has quit IRC | 18:59 | |
*** heyongli has joined #openstack-meeting | 18:59 | |
corvus | o/ | 19:00 |
*** alexpilo_ has joined #openstack-meeting | 19:00 | |
clarkb | #startmeeting infra | 19:01 |
openstack | Meeting started Tue Jun 26 19:01:08 2018 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
*** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
openstack | The meeting name has been set to 'infra' | 19:01 |
clarkb | #link https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting | 19:01 |
ianw | o/ | 19:01 |
*** jamesmcarthur_ has quit IRC | 19:01 | |
*** shaohe_feng has quit IRC | 19:01 | |
clarkb | The agenda hasn't been updated for today, as I'm somewhat underprepared chasing a bunch of stuff this morning as well as watching WC. That said its not too terribly wrong | 19:02 |
clarkb | #topic Announcements | 19:02 |
*** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:02 | |
*** shaohe_feng has joined #openstack-meeting | 19:02 | |
clarkb | As mentioned world cup is happening. Big game right now :) | 19:02 |
clarkb | Other than that don't forget to take the openstack user survey if you run or use an openstack cloud | 19:03 |
clarkb | provides valuable feedback to openstack on what is important and what can be improved | 19:03 |
* mordred can't take the survey - too much football on tv | 19:03 | |
*** alexpilotti has quit IRC | 19:03 | |
*** janki has quit IRC | 19:04 | |
clarkb | #topic Specs Approval | 19:04 |
*** openstack changes topic to "Specs Approval (Meeting topic: infra)" | 19:04 | |
clarkb | Monty's spec for future config mgmt is up and no longer WIP. I don't think it is ready for approval but we should all review that this week if we can find time | 19:04 |
clarkb | #link https://review.openstack.org/#/c/565550/ config mgmt and containers | 19:04 |
patchbot | patch 565550 - openstack-infra/infra-specs - Update config management for the Infra Control Plane | 19:04 |
fungi | thanks mordred! | 19:05 |
corvus | notmyname: ^ can you clear out patchbot please? | 19:05 |
*** Shrews has joined #openstack-meeting | 19:05 | |
clarkb | If possible I'd like for next week's meeting to be able to have a discussion about it in detail if necessary and we can work to merging that spec the week after (if not next week if everyone agrees with what monty has already written) | 19:05 |
mordred | \o/ | 19:05 |
clarkb | tl;dr please review :) | 19:05 |
*** patchbot has left #openstack-meeting | 19:06 | |
clarkb | though fungi and I will be travelingthe week after | 19:06 |
mordred | I tried to list all the things - but to leave some bits open for impl - definitely feedback welcome if I missed something or am just dumb | 19:06 |
fungi | yup | 19:06 |
*** cloudrancher has joined #openstack-meeting | 19:07 | |
* fungi is disappearing a lot next month | 19:07 | |
clarkb | as for working on this at the PTG I've heard rumor we'll hvae ~3 days of room space as well as aday or two of general help room | 19:08 |
* mordred throws paint on fungi to try to defeat the invisibility | 19:08 | |
clarkb | I think that will work well for digging into this in denver | 19:08 |
mordred | yah. if people are happy with the direction - there are several tasks I think I should be able to knock out by denver | 19:08 |
corvus | i don't expect us to have any dedicated zuul time at this ptg, so those of us with multiple hats should be able to focus on this too | 19:08 |
clarkb | I should get an etherpad for the PTG going so that we can start coordinating what happens there vs what happens prior | 19:09 |
* clarkb makes a note to get that going today | 19:09 | |
clarkb | GOL! (sorry) | 19:09 |
*** heyongli has quit IRC | 19:09 | |
fungi | note that there will, again, be a cross-project "helproom" for a couple days where we can still help people with questions about zuul job configuration and the like | 19:10 |
corvus | (though getting this done unlocks a bunch of neato zuul stuff, like running zuul from containers and more cd of zuul) | 19:10 |
corvus | fungi: ++ | 19:10 |
mordred | clarkb: I think we're watching different games | 19:10 |
*** heyongli has joined #openstack-meeting | 19:10 | |
*** alexpilotti has joined #openstack-meeting | 19:10 | |
fungi | the futbol is multi-threaded | 19:10 |
clarkb | mordred: possibly, I was leaving that info out for people that might be avoiding spoilers | 19:11 |
clarkb | corvus: yup I think this opens a few exciting followup threads once we get things rolling | 19:11 |
fungi | highly parallel gol processing | 19:11 |
*** cdub has quit IRC | 19:11 | |
clarkb | #topic Priority Efforts | 19:11 |
*** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:11 | |
*** cloudrancher has quit IRC | 19:12 | |
clarkb | Exciting updates have happend on the storyboard database query side of things | 19:12 |
*** shaohe_feng has quit IRC | 19:12 | |
clarkb | you might notice that storyboard boards are much quicker now thanks to dhellmann | 19:12 |
fungi | mostly thanks to dhellmann | 19:12 |
fungi | thanks again dhellmann! | 19:12 |
fungi | it's amazing how much adding an index on a column can speed stuff up ;) | 19:12 |
dhellmann | knowing we were missing an index made that pretty easy to figure out | 19:12 |
* mordred hands dhellmann a fluffy bunny rabbit | 19:13 | |
* dhellmann gets out the stew pot | 19:13 | |
mordred | mmm. rabbit stew | 19:13 |
dhellmann | mmm | 19:13 |
clarkb | fungi: any other storyboard related items worth bringing up? | 19:13 |
fungi | we're still struggling a bit on the name-based project urls... something's not quite right with decoding url-escaped slashes in project names | 19:13 |
clarkb | fungi: does it work without apache in front of it? apache likes to mangle those | 19:14 |
fungi | see discussion in #storyboard for current status | 19:14 |
*** alexpilo_ has quit IRC | 19:14 | |
fungi | yeah, the pecan-based dev server works fine | 19:14 |
fungi | but when running the api server through apache it's a problem | 19:14 |
*** felipemonteiro_ has quit IRC | 19:15 | |
* mordred is very excited about the future of name-based urls | 19:15 | |
fungi | i spent a good chunk of last night experimenting but couldn't come up with a workaround, though i also don't fully grasp the api routing in sb | 19:15 |
*** slaweq has quit IRC | 19:15 | |
fungi | so adding debugging wasn't easy | 19:16 |
*** shaohe_feng has joined #openstack-meeting | 19:16 | |
fungi | in other news, vitrage migrated all their deliverables from lp to sb on friday and that seems to be going well | 19:16 |
fungi | oh, also important, ianw noticed that the occasional rash of 500 internal server error from write operations may be related to rabbitmq disconnects causing the socket to it to get blocked | 19:17 |
clarkb | fungi: rabbitmq runs on the same instance though right? odd for there to be disconnects | 19:17 |
ianw | at first glance at the code, it looked liked it was trying to handle that | 19:18 |
fungi | yeah, unless it gets restarted or something i suppose | 19:18 |
ianw | but something in pika seemed to get itself stuck, if i had to guess | 19:18 |
* ianw pats myself on the back for such an excellent, helpful bug report :) | 19:19 | |
*** felipemonteiro has joined #openstack-meeting | 19:19 | |
fungi | it's more detail than we've gathered on the situation to date | 19:19 |
fungi | so thanks for the insightful observation | 19:19 |
*** heyongli has quit IRC | 19:20 | |
*** heyongli has joined #openstack-meeting | 19:20 | |
*** alexpilo_ has joined #openstack-meeting | 19:20 | |
clarkb | anything else re storyboard? | 19:20 |
fungi | no other storyboard news afaik | 19:20 |
clarkb | Ok and to follow up on config management proposed changes please go review https://review.openstack.org/#/c/565550/ and we'll catch up on that in more detail next week. | 19:21 |
clarkb | #topic General Topics | 19:21 |
*** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:21 | |
clarkb | Why don't we start with a packethost cloud update. We've set max servers to 0 due to the mtu problem. | 19:21 |
clarkb | I've got a couple changes up to address that in zuul-jobs and devstack-gate for our network overlay setup | 19:22 |
*** shaohe_feng has quit IRC | 19:22 | |
fungi | where "the mtu problem" is described simply as the interface mtu on instances there is 1450 | 19:22 |
clarkb | right it is smaller than we assume (1500) in a few places | 19:22 |
fungi | (same as in our linaro arm64 cloud, too) | 19:22 |
*** shaohe_feng has joined #openstack-meeting | 19:23 | |
clarkb | #link https://review.openstack.org/578146 handle small mtu in devstack-gate | 19:23 |
*** cdub has joined #openstack-meeting | 19:23 | |
clarkb | #link https://review.openstack.org/#/c/578153/ handle small mtu in zuul-jobs | 19:23 |
clarkb | if we can get those in and osa isn't strongly opposed I'd like to turn packethost back on and see if we get more reliable results | 19:23 |
*** slaweq has joined #openstack-meeting | 19:24 | |
*** alexpilotti has quit IRC | 19:24 | |
mordred | ++ | 19:25 |
clarkb | I should also write an email to the dev list explaining we can't make these assumptions anymore | 19:26 |
corvus | that looks like a good solution and backwards compat, so merging into zuul-jobs should be fine | 19:26 |
corvus | at least, backwards compat for working setups :) | 19:26 |
clarkb | corvus: yup should be backward compat if you already had to yes that | 19:26 |
clarkb | kolla and tripleo are the other two I'm semi worried about but I think tripleo has done a decent job reconsuming our overaly tooling | 19:27 |
clarkb | I expect they will get a working setup if we upate our tools | 19:27 |
clarkb | The other packethost issue is a bit more osa specific according to logstash and has to do with tcp checksum errors. Possibly related to mtus but osa also explicitly sets some iptables checksum options | 19:28 |
corvus | this might be worth a quick email then, just to make sure kolla/tripleo/other folks see the changes? | 19:29 |
*** rbartal has quit IRC | 19:29 | |
clarkb | yup, I'll write one up explaining we have morethan one cloud with smaller MTUs now and we hvae to stop assuming 1500 | 19:29 |
*** rbartal has joined #openstack-meeting | 19:30 | |
*** heyongli has quit IRC | 19:30 | |
clarkb | hopefully it isn't too controversial as it is a problem we've made for ourselves via neutron overlay networking :) | 19:30 |
fungi | and we could stand to update the testing environment document accordingly | 19:30 |
*** heyongli has joined #openstack-meeting | 19:30 | |
clarkb | fungi: I have a pathc up for that | 19:30 |
*** alexpilotti has joined #openstack-meeting | 19:30 | |
fungi | ahh, see what i miss when i go to get lunch? | 19:30 |
clarkb | looks like it must've merged its not in my open queue anymore | 19:31 |
fungi | i'm sure i was +2 on that in spirit | 19:31 |
clarkb | https://review.openstack.org/578159 | 19:31 |
*** shaohe_feng has quit IRC | 19:32 | |
clarkb | On winterstack naming I followed up with jbryce last week really quickly and the plan he has proposed is that he wants to double check a couple foundation people have had a chance to look it over then he will request we start +1'ing or similar to whittle our list down. He and a bunch of the foundation staff are travling in APAC right now so that may not happen this week | 19:33 |
clarkb | feel free to continue adding suggestions if you have new ideas | 19:33 |
*** shaohe_feng has joined #openstack-meeting | 19:33 | |
*** alexpilo_ has quit IRC | 19:34 | |
clarkb | SSL certs for just about everything were updated late last week. Rooters are not longer getting all those emails every day :) | 19:35 |
clarkb | One thing we/I discovered in that process is that we can no longer rely on email based verification for the signing requests | 19:36 |
corvus | oh? | 19:36 |
clarkb | yup, GDPR fallout is that our registrar for .orgs is not publishing contact info in whois anymore | 19:36 |
corvus | is there no forwarder? | 19:36 |
clarkb | and despite asking them fairly directly to publish thatdata they don't seem interested. This wasn't a problem for openstack.org as namecheap lets you use hostmaster@openstack.org but for openstackid.org was more problematic | 19:37 |
clarkb | corvus: not that I could determine | 19:37 |
fungi | it appears that the .org tld registry is special in this case | 19:37 |
clarkb | The solution I used was to use DNS record based verification | 19:37 |
clarkb | I created a random string CNAME to a comodo name and then after 20 minutes they checked and found it there and signed the cert | 19:37 |
corvus | is one cname sufficient for all certs, or did you have to do that for each? | 19:38 |
fungi | .com and .net (for example) are still publishing technical, anuse and administrative contact e-mail addresses and mailing addresses in the publiv 43/tcp whois | 19:38 |
clarkb | corvus: one for each name in a cert | 19:38 |
fungi | s/anuse/abuse/ | 19:38 |
corvus | blech | 19:38 |
corvus | informally, what are our latest thoughts about exploring letsencrypt? | 19:38 |
corvus | any questions/problems i can help answer/research? | 19:39 |
clarkb | fungi has apparnetly been poking at it. The process for verifying certs with them is basically the same if using DNS | 19:39 |
fungi | i've gotten over my organizational concerns with the isrg members and am trying it out on some of my personal systems. at this point i'm more concerned about the bootstrapping problem | 19:39 |
clarkb | you use a TXT record instead of a cname though iirc | 19:39 |
clarkb | most of the tooling that seems to exist today assumes root access which bugs me (but is necessary if listening on a privileged port for verification) | 19:40 |
*** heyongli has quit IRC | 19:40 | |
fungi | yeah, the acme rfc draft has details, but basically it's a specially-formatted txt record in your domain, _or_ serving a string from a webserver already present at the dns name in question | 19:40 |
corvus | i've been using apache | 19:40 |
*** alexpilo_ has joined #openstack-meeting | 19:40 | |
*** heyongli has joined #openstack-meeting | 19:41 | |
corvus | any reason not to use http instead of dns? | 19:41 |
clarkb | corvus: mostly my concern with it needing root to perform config management tasks out of band of config management | 19:41 |
fungi | the dns solution presumes orchestrating dns, and the www mechaism assumes you'll do multipstage deployment initially with no ssl cert | 19:41 |
clarkb | separately I also think the cert limit per domain could bite us with letsencrypt | 19:42 |
corvus | fungi: true, it is difficult to convince apache to start with no cert... but maybe we could have config management handle that? if no cert, don't add the ssl hosts? | 19:42 |
fungi | the www solution can also be worked around with a proxy sort of setup, but then boils back down to dns orchestration | 19:42 |
clarkb | a wildcard is an option but that reduces segmentation | 19:42 |
*** shaohe_feng has quit IRC | 19:42 | |
fungi | though unrelated, we noticed that *.openstack.org is already in use for a cert with the caching proxy service the foundation is contracting for www.openstack.org | 19:42 |
corvus | we could put a handler in all of our vhosts for /.well-known/acme-challenge/ | 19:43 |
fungi | somewhat worrisome, and makes me eager to be on our own domain for important things | 19:43 |
corvus | fungi: yeah | 19:43 |
*** shaohe_feng has joined #openstack-meeting | 19:43 | |
clarkb | corvus: ya we can engotiate the verification exchange ourselves rather than use the published tools | 19:43 |
corvus | i mean, we put in a lot of work to avoid doing that and then poof | 19:43 |
fungi | the ubiquitous acme handler solution is compelling, though still means eventually-consistent sice the first pass of configuration management won't bring up working https | 19:44 |
*** alexpilotti has quit IRC | 19:44 | |
corvus | clarkb: oh, i just meant that all we need from apache is a non-ssl vhost which support servince static files in /.well-known/acme-challenge/. then we can use certbot | 19:44 |
clarkb | oh will certbot operate without opening the port itself? | 19:44 |
clarkb | last I looked that was a requirement iirc and jamielennox had written a tool to avoid that | 19:45 |
fungi | it operates over https (80/tcp) | 19:45 |
corvus | fungi: right, so it's mostly config-management complication. i haven't thought about what that would mean in the new ansible-container space | 19:45 |
fungi | er, over http | 19:45 |
fungi | i suppose we could temporarily copy snakeoil into the certbot cert/key path until it updates those files | 19:45 |
corvus | fungi: that's an option too | 19:45 |
fungi | so allowing apache to listen on 443/tcp from the start | 19:45 |
*** lpetrut has joined #openstack-meeting | 19:46 | |
corvus | clarkb: aiui, it will write files to, eg, /var/www/www.example.com/.well-known/acme-challenge/ poke its server, get a cert, then write out the key | 19:46 |
fungi | and just make sure any generic 80->443 redirect we configure has a carve-out for .well-known/acme-challenge | 19:46 |
corvus | er, write out the signed cert | 19:46 |
corvus | fungi: ya | 19:46 |
corvus | clarkb: "certbot-auto certonly --webroot -w /var/www/www.example.com/ -d www.example.com -d example.com" makes it do that | 19:47 |
clarkb | corvus: cool, good to know | 19:47 |
fungi | though on my newer systems the updated apache certbot module is working fine and basically provides the same | 19:47 |
corvus | (this is how i use it without giving it any special access, other than write to that directory and /etc/letsencrypt) | 19:47 |
corvus | fungi: oh neat, didn't know about that | 19:48 |
clarkb | other than that my only other real concern is rate limits and quota limits | 19:48 |
clarkb | I know when they first started it was quite limited but I think they are a lot less limited now | 19:48 |
clarkb | looks like limit is 20 certs per week now and each cert can have up to 100 names | 19:49 |
corvus | 20 certs/week now according to https://letsencrypt.org/docs/rate-limits/ | 19:49 |
fungi | it's more making sure that since we're in the 20 certs range, we don't try to renew them all in the same week | 19:50 |
corvus | apparently there's an exemption for renewing :) | 19:50 |
clarkb | those limits should be fine given what I just refreshed | 19:50 |
*** lpetrut has quit IRC | 19:50 | |
*** alexpilotti has joined #openstack-meeting | 19:50 | |
*** heyongli has quit IRC | 19:50 | |
clarkb | I did 17 certs with one having 8 names and the rest had 1 name | 19:50 |
clarkb | and we have a handful of certs that weren't expiring soon enough to worry about | 19:51 |
*** heyongli has joined #openstack-meeting | 19:51 | |
fungi | le didn't allow san at one time, not sure if they've started to do so | 19:51 |
clarkb | fungi: the link above implies they do now up to 100 per cert | 19:51 |
fungi | but could imply we need 24 at this point if all distinct certs? | 19:51 |
fungi | ahh, nice | 19:51 |
fungi | i missed that | 19:52 |
*** priteau has quit IRC | 19:52 | |
*** slaweq has quit IRC | 19:52 | |
*** e0ne has joined #openstack-meeting | 19:52 | |
corvus | if renewing doesn't count (which is how i read it), we're effectively unlimited. it's a growth limit, not a size limit. | 19:52 |
*** shaohe_feng has quit IRC | 19:53 | |
corvus | er, growth rate | 19:53 |
clarkb | Before we run out of time I wanted to give a quick kata + zuul update. We've got a fedora 28 job running now that sometimes crashes (presumably due to nested virt problems). I'm also sorting through what they feel are requirements from their end after a bug update last night | 19:53 |
fungi | oh, neat | 19:53 |
*** shaohe_feng has joined #openstack-meeting | 19:53 | |
clarkb | from my perspective we haven't run into any deal breakers, things that are broken were either already broken or never running in jenkins in the first place | 19:53 |
corvus | clarkb: where's the f28 job running? | 19:54 |
*** gouthamr has joined #openstack-meeting | 19:54 | |
clarkb | corvus: against kata-containers/proxy on vexxhost VM | 19:54 |
*** alexpilo_ has quit IRC | 19:54 | |
corvus | so it still sometimes crashes even in vexxhost? | 19:54 |
corvus | (i thought vexxhost had the right settings or something) | 19:54 |
clarkb | corvus: yes, apparently they have issues with their Jenkins running ubuntu 17.10 as well | 19:54 |
clarkb | mnaser thinks it is related to kernel versions in the guest | 19:54 |
clarkb | (newer kernels less stable) | 19:55 |
mnaser | we're running the newest centos kernel on the hypervisor | 19:55 |
clarkb | he is working with them to debug that since it affects jenkins just as much as zuul | 19:55 |
mnaser | and noticed 16.04 never crashed, but 17.10+ was crashing | 19:55 |
mnaser | salvador from kata came up with a reproducer too | 19:55 |
*** jamesmcarthur has joined #openstack-meeting | 19:56 | |
mnaser | i gave all the tracebacks and the info necessary but this isn't as much of a zuul/infra issue as it is a kernel, but i'm open to providing whatever they need to solve things :) | 19:56 |
*** hemna_ has quit IRC | 19:56 | |
corvus | downgrading kernel versions is an option too | 19:57 |
corvus | (i mean, in the job as a pre-playbook) | 19:57 |
*** pchavva has quit IRC | 19:57 | |
corvus | since zuul *can* handle in-job test-node reboots | 19:57 |
clarkb | really quickly before we run out of time, is there anything else anyone had to bring up? | 19:57 |
clarkb | #topic Open Discussion | 19:57 |
*** openstack changes topic to "Open Discussion (Meeting topic: infra)" | 19:57 | |
clarkb | (happy to follow up on kata in -infra) | 19:57 |
clarkb | or in kata-dev | 19:57 |
corvus | i gave a talk on zuul at openinfradays china. it was well attended. | 19:58 |
fungi | thanks for doing that! | 19:59 |
corvus | my pleasure :) | 19:59 |
clarkb | We are out of time. Thank you everyone. I amgoing to grab lunch then will follow up to the mailing lists with the mtu topic and infra ptg item | 20:00 |
clarkb | #endmeeting | 20:00 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 20:00 | |
openstack | Meeting ended Tue Jun 26 20:00:26 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:00 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-06-26-19.01.html | 20:00 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-06-26-19.01.txt | 20:00 |
openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-06-26-19.01.log.html | 20:00 |
*** alexpilo_ has joined #openstack-meeting | 20:00 | |
clarkb | find us in #openstack-infra or openstack-infra@lists.openstack.org if you want to discuss things further | 20:00 |
*** heyongli has quit IRC | 20:01 | |
*** Shrews has left #openstack-meeting | 20:01 | |
*** heyongli has joined #openstack-meeting | 20:01 | |
*** shaohe_feng has quit IRC | 20:03 | |
*** shaohe_feng has joined #openstack-meeting | 20:04 | |
*** alexpilotti has quit IRC | 20:04 | |
*** dustins has quit IRC | 20:04 | |
*** rossella_s has quit IRC | 20:04 | |
*** rossella_s has joined #openstack-meeting | 20:05 | |
*** trandles has joined #openstack-meeting | 20:06 | |
*** dustins has joined #openstack-meeting | 20:07 | |
*** alexpilotti has joined #openstack-meeting | 20:10 | |
*** heyongli has quit IRC | 20:11 | |
*** heyongli has joined #openstack-meeting | 20:11 | |
*** awaugama has quit IRC | 20:12 | |
*** m_ebert has joined #openstack-meeting | 20:12 | |
*** shaohe_feng has quit IRC | 20:13 | |
*** alexpilo_ has quit IRC | 20:14 | |
*** shaohe_feng has joined #openstack-meeting | 20:14 | |
*** e0ne has quit IRC | 20:15 | |
*** m_ebert has left #openstack-meeting | 20:15 | |
*** jamesmcarthur has quit IRC | 20:17 | |
*** gouthamr has quit IRC | 20:19 | |
*** raildo has quit IRC | 20:20 | |
*** alexpilo_ has joined #openstack-meeting | 20:21 | |
*** heyongli has quit IRC | 20:21 | |
*** heyongli has joined #openstack-meeting | 20:22 | |
*** gouthamr has joined #openstack-meeting | 20:22 | |
*** shaohe_feng has quit IRC | 20:23 | |
*** alexpilotti has quit IRC | 20:23 | |
*** shaohe_feng has joined #openstack-meeting | 20:25 | |
*** gouthamr_ has joined #openstack-meeting | 20:29 | |
*** gouthamr has quit IRC | 20:29 | |
*** gouthamr_ is now known as gouthamr | 20:29 | |
*** alexpilotti has joined #openstack-meeting | 20:30 | |
*** erming has joined #openstack-meeting | 20:31 | |
*** heyongli has quit IRC | 20:31 | |
*** heyongli has joined #openstack-meeting | 20:32 | |
*** cdub has quit IRC | 20:33 | |
*** shaohe_feng has quit IRC | 20:34 | |
*** jamesmcarthur has joined #openstack-meeting | 20:34 | |
*** shaohe_feng has joined #openstack-meeting | 20:34 | |
*** alexpilo_ has quit IRC | 20:34 | |
*** cdub has joined #openstack-meeting | 20:38 | |
*** alexpilo_ has joined #openstack-meeting | 20:40 | |
*** heyongli has quit IRC | 20:42 | |
*** heyongli has joined #openstack-meeting | 20:42 | |
*** alexpilotti has quit IRC | 20:44 | |
*** shaohe_feng has quit IRC | 20:44 | |
*** munimeha2 has quit IRC | 20:46 | |
*** shaohe_feng has joined #openstack-meeting | 20:46 | |
*** martial has joined #openstack-meeting | 20:46 | |
*** alexpilotti has joined #openstack-meeting | 20:50 | |
*** stevebaker has joined #openstack-meeting | 20:52 | |
*** heyongli has quit IRC | 20:52 | |
*** heyongli has joined #openstack-meeting | 20:52 | |
*** cdub has quit IRC | 20:53 | |
*** alexpilo_ has quit IRC | 20:54 | |
*** shaohe_feng has quit IRC | 20:54 | |
*** shaohe_feng has joined #openstack-meeting | 20:55 | |
*** m_ebert has joined #openstack-meeting | 20:56 | |
*** julim_ has quit IRC | 20:57 | |
martial | Welcome Marcus, we will be starting shortly | 20:58 |
*** janders has joined #openstack-meeting | 20:59 | |
martial | #start_meeting Scientific-sig | 21:00 |
martial | #startmeeting Scientific-sig | 21:00 |
openstack | Meeting started Tue Jun 26 21:00:39 2018 UTC and is due to finish in 60 minutes. The chair is martial. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
*** openstack changes topic to " (Meeting topic: Scientific-sig)" | 21:00 | |
openstack | The meeting name has been set to 'scientific_sig' | 21:00 |
martial | Good day everybody | 21:00 |
*** alexpilo_ has joined #openstack-meeting | 21:01 | |
trandles | hi martial | 21:01 |
m_ebert | Hello Martial | 21:01 |
janders | good evening, good morning :) | 21:01 |
martial | Today we are joined by Marcus Ebert who will share with us "Utilizing Distributed Clouds for Compute and Storage" | 21:02 |
janders | excellent, hello Marcus | 21:02 |
martial | The links to the video and slide deck are as follow | 21:02 |
*** heyongli has quit IRC | 21:02 | |
m_ebert | Hello everyone! | 21:02 |
martial | #link Video https://youtu.be/QAda-ee-9Ko | 21:02 |
*** heyongli has joined #openstack-meeting | 21:03 | |
martial | #link Slides https://goo.gl/g9EmWg | 21:03 |
*** rbudden has joined #openstack-meeting | 21:03 | |
*** b1airo has joined #openstack-meeting | 21:03 | |
martial | now we understand that not everybody has had a chance to review the video | 21:03 |
martial | as such we want to give Mr Ebert a chance to discuss his slide deck and answer questions | 21:03 |
b1airo | o/ | 21:03 |
martial | #chair b1airo | 21:03 |
openstack | Current chairs: b1airo martial | 21:03 |
martial | welcome Blair | 21:04 |
b1airo | Thanks martial | 21:04 |
*** alexpilotti has quit IRC | 21:04 | |
martial | m_ebert: would you like to give us an introduction to the work please? | 21:04 |
*** shaohe_feng has quit IRC | 21:04 | |
m_ebert | Sure | 21:05 |
b1airo | I'm feeding the animals/children breakfast, so sorry if I'm a little slow... | 21:05 |
b1airo | Hi m_ebert | 21:05 |
m_ebert | Hi blairo | 21:05 |
*** shaohe_feng has joined #openstack-meeting | 21:06 | |
*** rossella_s has quit IRC | 21:06 | |
*** verdurin has joined #openstack-meeting | 21:06 | |
m_ebert | What I wanted to show in the slide is the system we developed to utilize different clouds, which can be anywhere in the world, by building system that unifies different clouds and types into a single infrastructure | 21:07 |
m_ebert | It hides the cloud structure from the users, which only see a single "local" batch system to which they submit their jobs | 21:07 |
m_ebert | In addition, since the jobs can now run anywhere and the user has no idea where, we are also working on an data infrastructure that unifies storage space on different endpoints into a single files system like structure | 21:08 |
*** rossella_s has joined #openstack-meeting | 21:08 | |
m_ebert | an overview of how the compute part work is shown on slide 9 | 21:09 |
m_ebert | and slide 19/20 how we would like to have the storage part that the compute is using in the future | 21:10 |
b1airo | m_ebert: presumably this works well for high-throughput workloads. What does the job definition contain, and can the system accommodate jobs added dynamically via API? | 21:10 |
*** felipemonteiro has quit IRC | 21:10 | |
*** alexpilotti has joined #openstack-meeting | 21:11 | |
m_ebert | blairo: do you mean with API submitting directly to condor, or which API do you mean? | 21:11 |
*** mjturek has quit IRC | 21:11 | |
*** heyongli has quit IRC | 21:12 | |
janders | m_ebert: this is excellent work. Regarding storage, is the workflow 1) download 2) process 3) upload results, or is in-place access to data also possible? | 21:12 |
*** heyongli has joined #openstack-meeting | 21:13 | |
b1airo | Either I suppose. (I haven't seen the slides yet sorry - just woke up) | 21:13 |
*** alexpilo_ has quit IRC | 21:14 | |
m_ebert | janders: the workflow of the 2 experiments is right now download-process-upload, but in-place access is possible. On slide 22 for example there is an example how the root analysis framework could open files directly over the network, but any other tool that can stream files should work to when it uses http/webdav | 21:14 |
*** shaohe_feng has quit IRC | 21:15 | |
m_ebert | blairo: Yes, all jobs that can be submitted to condor will go to VMs. In the job definition, requirements for RAM,CPUs, disk and so on can be defined, and if not then defaults will be used | 21:16 |
*** shaohe_feng has joined #openstack-meeting | 21:16 | |
janders | m_ebert: great! Slide 22 says mounting the whole data federation is "reasonably fast". Do you know the approximate throughput you're getting? (just an order of magnitude will suffice) | 21:17 |
*** dustins has quit IRC | 21:17 | |
m_ebert | and if no VMs available that satisfy these requirements, then cloudscheduler will start a new VM | 21:17 |
martial | from your slide deck, this uses HTCondor as the batch server, can communicate to can use Openstack, OpenNebula, Amazon, Microsoft Azure, and Google Cloud, and I would second the question on storage as I see "DynaFed"? | 21:17 |
*** trandles has quit IRC | 21:17 | |
*** zaneb has quit IRC | 21:17 | |
m_ebert | janders: getting data from a minio instance running on a VM on the same cloud, we see up to 3Gbps (but we use only files that are some GBs large) | 21:18 |
janders | m_ebert: Thank you. What do you think is the limiting factor in terms of achieving more throughput? storage bandwidth? WAN bandwidth? Applications (eg TCP window tuning)? | 21:20 |
*** alexpilo_ has joined #openstack-meeting | 21:21 | |
m_ebert | martial: yes, HTCondor is the batch system, and cloudscheduler can use these types of clouds right now and can communicate with it. Then it uses cloud-init to send the condor config to a VM, which then can communicate with the HTcondor server. | 21:21 |
*** cmurphy_vacation is now known as cmurphy | 21:22 | |
m_ebert | The limiting factor I see is the storage system itself in case of minio (data is on a volume mounted on a VM, where minio is just a layer), the cloud network interface to the outside, and all other ongoing activity on the cloud/hypervisor | 21:23 |
*** heyongli has quit IRC | 21:23 | |
*** heyongli has joined #openstack-meeting | 21:23 | |
b1airo | Any issues with condor here? I have not used it for a long time but remember it was sometimes seeming a but slow to get started | 21:24 |
m_ebert | using gfalFS on a baremetal system, we get nearly line speed (tested up to 10Gbps interfaces) - but depends largely on where the endpoints are | 21:24 |
*** alexpilotti has quit IRC | 21:24 | |
*** shaohe_feng has quit IRC | 21:25 | |
m_ebert | No issues in daily production so far. Only when we have a very large number of cores available temporary (>>10,000) then it made problems in the past | 21:25 |
*** gouthamr has quit IRC | 21:25 | |
*** gouthamr has joined #openstack-meeting | 21:26 | |
m_ebert | Well, not cores really, but job slots (we run mostly single core jobs, so job slots==cores) | 21:26 |
b1airo | Ok, yes that sounds more familiar | 21:27 |
*** shaohe_feng has joined #openstack-meeting | 21:28 | |
*** erming has quit IRC | 21:29 | |
*** zaneb has joined #openstack-meeting | 21:29 | |
b1airo | What sort of length jobs are you running? | 21:30 |
*** alexpilotti has joined #openstack-meeting | 21:31 | |
m_ebert | we run mostly so called pilot jobs, which are just a wrapper to setup the environment for real jobs and then pull in from the experiments server the real payload. pilots can run up to 2days (defined in condor), payload jobs usually between some minutes and up to about 15h) | 21:32 |
martial | how much time is spend copying data then in those jobs? | 21:32 |
*** heyongli has quit IRC | 21:33 | |
*** heyongli has joined #openstack-meeting | 21:33 | |
*** numans_ has joined #openstack-meeting | 21:34 | |
*** alexpilo_ has quit IRC | 21:34 | |
b1airo | Yeah i was meaning the actual payload jobs. Do you know if condor handles short jobs (10s to 1s of seconds) ok? | 21:34 |
m_ebert | Well, with dynafed it comes mostly from close by storage so it's just some seconds at the beginning of the job. We run mostly 8core VMs, so 8 such jobs will run in parallel | 21:34 |
*** shaohe_feng has quit IRC | 21:35 | |
m_ebert | well, in our case, the condor job is only the pilot since that is all it knows about. But we had misconfigured pilots before which terminated within seconds and then run through hundreds before we stopped it - condor was fine with that | 21:36 |
martial | do you have some local vs remote benchmark to share? | 21:36 |
m_ebert | martial: when we had to go back to the site SE, the pulling in of data can take up to half hour or timed out, since it allows only a specific number of parallel transfers and send all others in a waiting queue | 21:36 |
martial | (on similar enough systems) to see how bad the overhead is? | 21:37 |
*** numans has quit IRC | 21:37 | |
m_ebert | martial: not right now, but working on a benchmarking sytem. There will be the CHEP conference in 2 weeks, I should have it by then to present. I can send a link around once I have it ready | 21:37 |
*** shaohe_feng has joined #openstack-meeting | 21:37 | |
martial | thanks we can do a follow up then | 21:38 |
janders | that would be great | 21:38 |
*** lifeless has joined #openstack-meeting | 21:38 | |
m_ebert | sure, I'll do that | 21:38 |
*** alexpilo_ has joined #openstack-meeting | 21:41 | |
martial | any other questions for Mr Ebert? | 21:41 |
martial | seems to me we have reached a natural stopping point in this conversation for the time being | 21:41 |
martial | we invite people to check the video for additional details | 21:41 |
martial | allow me to thank you again for coming to explain this very interesting solution to us | 21:42 |
martial | please follow with us in a few weeks if you have more to add | 21:42 |
*** antosh has quit IRC | 21:43 | |
martial | for the time, please allow me to thank you for accepting to talk to us m_ebert | 21:43 |
m_ebert | Thank you! Also everyone please feel free to send me questions/comments by email later if some come up by reviewing the slides, also if you have free resources somewhere ;-) | 21:43 |
*** heyongli has quit IRC | 21:43 | |
b1airo | Thanks m_ebert , we'll also share this in next week's meeting which is friendlier to different timezones | 21:43 |
m_ebert | I'll try to join more often the meetings and let you know when the benchmarks are ready | 21:43 |
martial | your email is listed in the slides | 21:43 |
*** heyongli has joined #openstack-meeting | 21:43 | |
m_ebert | thanks blairo | 21:44 |
martial | thank you | 21:44 |
*** fnaval has quit IRC | 21:44 | |
martial | and with this, our other topic for today was | 21:44 |
martial | #topic AOB | 21:44 |
*** openstack changes topic to "AOB (Meeting topic: Scientific-sig)" | 21:44 | |
*** alexpilotti has quit IRC | 21:44 | |
martial | for once I do not have content for AOB :) | 21:44 |
martial | b1airo? | 21:44 |
b1airo | Ha! | 21:44 |
b1airo | Hmmmm, no not off the top of my head. But I am a little slow off the mark this morning | 21:45 |
janders | the submission deadline for Berlin is approaching.. I wonder what talks would you guys like to hear? | 21:45 |
*** shaohe_feng has quit IRC | 21:45 | |
verdurin | janders: the talk where someone solves all my controlled-data problems? | 21:47 |
*** rcernin has joined #openstack-meeting | 21:47 | |
janders | verdurin: :) | 21:47 |
b1airo | Yeah that would be pretty wonderful | 21:47 |
b1airo | Even just a talk that tells me what they all are | 21:48 |
*** fnaval has joined #openstack-meeting | 21:49 | |
b1airo | I'd be interested in hearing about how people do general purpose "managed" cloud, i.e., long-lived instances with patching etc | 21:49 |
martial | that is a tough one indeed | 21:50 |
janders | b1airo: on your RoCE-enabled system, do you install MOFED in the images or are you running upstream mlnx stack? | 21:50 |
*** ian_ott has quit IRC | 21:51 | |
*** alexpilotti has joined #openstack-meeting | 21:51 | |
*** shaohe_feng has joined #openstack-meeting | 21:51 | |
b1airo | Yeah we use MOFED | 21:51 |
janders | do you embed custom repo config in images and manage kernel-dependent packages? | 21:51 |
janders | or do you leave that to the users? | 21:51 |
b1airo | Though it gets installed post launch via Ansible | 21:51 |
janders | do you keep your own MOFED repos? | 21:52 |
janders | (or use mlnx iso/tgz ?) | 21:52 |
*** mriedem has quit IRC | 21:52 | |
b1airo | The HPC crew who are the primary users of the RoCE enabled stuff do have their own repo for managing updates consistently | 21:52 |
b1airo | They use the ISO I think | 21:53 |
janders | ok! | 21:53 |
*** heyongli has quit IRC | 21:53 | |
janders | I maintain MOFED repos and put excludes in the yum config - that's mostly for the infra, but I'm considering doing something similar for the instances | 21:54 |
*** heyongli has joined #openstack-meeting | 21:54 | |
*** jamesmcarthur has quit IRC | 21:54 | |
b1airo | I think it's mostly ok now. Though I sometimes hear them grumbling about needing to rebuild modules | 21:54 |
janders | sounds like mlnx_add_kernel_support.sh :) | 21:54 |
*** alexpilo_ has quit IRC | 21:54 | |
janders | mostly works, occasionally causes frustration.. | 21:54 |
b1airo | Yeah. Dkms on Ubuntu seems to be fine | 21:55 |
janders | it's an interesting lifecycle-related challenge, quite a boutique one though | 21:55 |
janders | what's your motivation for using MOFED as opposed to upstream? better perforamnce? supportability? good practice? all of the above? | 21:55 |
b1airo | It's a bugbear across the research cloud | 21:56 |
*** shaohe_feng has quit IRC | 21:56 | |
martial | we have only a short few minutes at this point | 21:56 |
*** mriedem has joined #openstack-meeting | 21:56 | |
*** afazekas has quit IRC | 21:56 | |
b1airo | Lots of fairly green users with root access of public machines. Would be nice to give them guardrails and help protect their data | 21:57 |
*** shaohe_feng has joined #openstack-meeting | 21:57 | |
janders | b1airo: +1! :) | 21:57 |
*** afazekas has joined #openstack-meeting | 21:59 | |
martial | and on those words, I am about to end our meeting | 21:59 |
martial | thanks everybody for spending this time with us | 21:59 |
b1airo | I see scope for a community project in this, but not something I can start at the moment! | 21:59 |
b1airo | Cheers all | 21:59 |
martial | and to Mr Ebert for presenting | 21:59 |
martial | bye all | 21:59 |
martial | #endmeeting | 21:59 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:59 | |
openstack | Meeting ended Tue Jun 26 21:59:53 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:59 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-06-26-21.00.html | 21:59 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-06-26-21.00.txt | 21:59 |
m_ebert | Thanks everyone for the discussion! cheers | 21:59 |
openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-06-26-21.00.log.html | 22:00 |
*** m_ebert has quit IRC | 22:00 | |
*** alexpilo_ has joined #openstack-meeting | 22:01 | |
*** janders has quit IRC | 22:01 | |
*** heyongli has quit IRC | 22:04 | |
*** edmondsw has quit IRC | 22:04 | |
*** heyongli has joined #openstack-meeting | 22:04 | |
*** alexpilotti has quit IRC | 22:04 | |
*** shaohe_feng has quit IRC | 22:06 | |
*** edmondsw has joined #openstack-meeting | 22:07 | |
*** bobh has quit IRC | 22:07 | |
*** shaohe_feng has joined #openstack-meeting | 22:08 | |
*** felipemonteiro has joined #openstack-meeting | 22:10 | |
*** alexpilotti has joined #openstack-meeting | 22:11 | |
*** edmondsw has quit IRC | 22:11 | |
*** antosh has joined #openstack-meeting | 22:12 | |
*** felipemonteiro_ has joined #openstack-meeting | 22:12 | |
*** felipemonteiro has quit IRC | 22:12 | |
*** felipemonteiro__ has joined #openstack-meeting | 22:13 | |
*** alexpilo_ has quit IRC | 22:14 | |
*** heyongli has quit IRC | 22:14 | |
*** heyongli has joined #openstack-meeting | 22:14 | |
*** shaohe_feng has quit IRC | 22:16 | |
*** shaohe_feng has joined #openstack-meeting | 22:16 | |
*** felipemonteiro_ has quit IRC | 22:17 | |
*** alexpilo_ has joined #openstack-meeting | 22:21 | |
*** mriedem has quit IRC | 22:21 | |
*** alexpilotti has quit IRC | 22:24 | |
*** heyongli has quit IRC | 22:24 | |
*** heyongli has joined #openstack-meeting | 22:24 | |
*** shaohe_feng has quit IRC | 22:26 | |
*** shaohe_feng has joined #openstack-meeting | 22:27 | |
*** bnemec has quit IRC | 22:29 | |
*** alexpilotti has joined #openstack-meeting | 22:31 | |
*** rbudden has quit IRC | 22:34 | |
*** alexpilo_ has quit IRC | 22:34 | |
*** heyongli has quit IRC | 22:34 | |
*** bnemec has joined #openstack-meeting | 22:35 | |
*** heyongli has joined #openstack-meeting | 22:35 | |
*** hongbin has quit IRC | 22:36 | |
*** shaohe_feng has quit IRC | 22:37 | |
*** shaohe_feng has joined #openstack-meeting | 22:37 | |
*** alexpilo_ has joined #openstack-meeting | 22:41 | |
*** Swami_ has quit IRC | 22:43 | |
*** Swami has quit IRC | 22:43 | |
*** alexpilotti has quit IRC | 22:44 | |
*** heyongli has quit IRC | 22:45 | |
*** heyongli has joined #openstack-meeting | 22:45 | |
*** shaohe_feng has quit IRC | 22:47 | |
*** shaohe_feng has joined #openstack-meeting | 22:47 | |
*** rbudden has joined #openstack-meeting | 22:47 | |
*** alexpilotti has joined #openstack-meeting | 22:51 | |
*** alexpilo_ has quit IRC | 22:54 | |
*** tpsilva has quit IRC | 22:55 | |
*** heyongli has quit IRC | 22:55 | |
*** heyongli has joined #openstack-meeting | 22:55 | |
*** rossella_s has quit IRC | 22:56 | |
*** shaohe_feng has quit IRC | 22:57 | |
*** rossella_s has joined #openstack-meeting | 22:59 | |
*** shaohe_feng has joined #openstack-meeting | 22:59 | |
*** rbudden has quit IRC | 23:00 | |
*** alexpilo_ has joined #openstack-meeting | 23:01 | |
*** felipemonteiro__ has quit IRC | 23:01 | |
*** alexpilotti has quit IRC | 23:04 | |
*** Kevin_Zheng has joined #openstack-meeting | 23:05 | |
*** heyongli has quit IRC | 23:05 | |
*** heyongli has joined #openstack-meeting | 23:05 | |
*** shaohe_feng has quit IRC | 23:07 | |
*** shaohe_feng has joined #openstack-meeting | 23:08 | |
*** bobh has joined #openstack-meeting | 23:08 | |
*** alexpilotti has joined #openstack-meeting | 23:11 | |
*** alexpilo_ has quit IRC | 23:15 | |
*** heyongli has quit IRC | 23:15 | |
*** heyongli has joined #openstack-meeting | 23:16 | |
*** shaohe_feng has quit IRC | 23:18 | |
*** shaohe_feng has joined #openstack-meeting | 23:21 | |
*** alexpilo_ has joined #openstack-meeting | 23:21 | |
*** alexpilotti has quit IRC | 23:24 | |
*** heyongli has quit IRC | 23:26 | |
*** heyongli has joined #openstack-meeting | 23:26 | |
*** shaohe_feng has quit IRC | 23:28 | |
*** shaohe_feng has joined #openstack-meeting | 23:29 | |
*** alexpilotti has joined #openstack-meeting | 23:31 | |
*** alexpilo_ has quit IRC | 23:34 | |
*** mjturek has joined #openstack-meeting | 23:35 | |
*** heyongli has quit IRC | 23:36 | |
*** mlavalle has quit IRC | 23:36 | |
*** chyka has quit IRC | 23:36 | |
*** heyongli has joined #openstack-meeting | 23:36 | |
*** rpioso is now known as rpioso|afk | 23:36 | |
*** shaohe_feng has quit IRC | 23:38 | |
*** shaohe_feng has joined #openstack-meeting | 23:39 | |
*** antosh has quit IRC | 23:39 | |
*** alexpilo_ has joined #openstack-meeting | 23:41 | |
*** alexpilotti has quit IRC | 23:44 | |
*** tetsuro has joined #openstack-meeting | 23:45 | |
*** heyongli has quit IRC | 23:46 | |
*** heyongli has joined #openstack-meeting | 23:47 | |
*** shaohe_feng has quit IRC | 23:48 | |
*** shaohe_feng has joined #openstack-meeting | 23:49 | |
*** alexpilotti has joined #openstack-meeting | 23:51 | |
*** mjturek has quit IRC | 23:54 | |
*** alexpilo_ has quit IRC | 23:54 | |
*** heyongli has quit IRC | 23:56 | |
*** mjturek has joined #openstack-meeting | 23:57 | |
*** heyongli has joined #openstack-meeting | 23:57 | |
*** shaohe_feng has quit IRC | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!