*** sdague has quit IRC | 00:01 | |
*** yamamoto has joined #openstack-meeting-3 | 00:02 | |
*** david-lyle has quit IRC | 00:03 | |
*** dklyle has joined #openstack-meeting-3 | 00:03 | |
*** slaweq has joined #openstack-meeting-3 | 00:04 | |
*** david-lyle has joined #openstack-meeting-3 | 00:07 | |
*** dklyle has quit IRC | 00:08 | |
*** hongbin has quit IRC | 00:08 | |
*** slaweq has quit IRC | 00:09 | |
*** Sukhdev has joined #openstack-meeting-3 | 00:09 | |
*** Sukhdev has quit IRC | 00:10 | |
*** VW has joined #openstack-meeting-3 | 00:16 | |
*** Sukhdev has joined #openstack-meeting-3 | 00:17 | |
*** tssurya_ has quit IRC | 00:19 | |
*** salv-orlando has joined #openstack-meeting-3 | 00:23 | |
*** VW has quit IRC | 00:26 | |
*** VW has joined #openstack-meeting-3 | 00:27 | |
*** salv-orlando has quit IRC | 00:27 | |
*** dklyle has joined #openstack-meeting-3 | 00:29 | |
*** david-lyle has quit IRC | 00:30 | |
*** VW has quit IRC | 00:30 | |
*** VW has joined #openstack-meeting-3 | 00:30 | |
*** chyka has quit IRC | 00:32 | |
*** julim has joined #openstack-meeting-3 | 00:33 | |
*** VW has quit IRC | 00:40 | |
*** VW has joined #openstack-meeting-3 | 00:41 | |
*** Sukhdev has quit IRC | 00:41 | |
*** yamamoto has quit IRC | 00:45 | |
*** VW has quit IRC | 00:45 | |
*** Sukhdev has joined #openstack-meeting-3 | 00:52 | |
*** david-lyle has joined #openstack-meeting-3 | 00:55 | |
*** dklyle has quit IRC | 00:55 | |
*** julim has quit IRC | 00:58 | |
*** david-lyle has quit IRC | 01:01 | |
*** shuyingya has joined #openstack-meeting-3 | 01:15 | |
*** shuyingya has quit IRC | 01:19 | |
*** salv-orlando has joined #openstack-meeting-3 | 01:24 | |
*** yamamoto has joined #openstack-meeting-3 | 01:24 | |
*** salv-orlando has quit IRC | 01:29 | |
*** shuyingya has joined #openstack-meeting-3 | 01:51 | |
*** shuyingy_ has joined #openstack-meeting-3 | 01:51 | |
*** sgrasley1 has joined #openstack-meeting-3 | 01:51 | |
*** shuyingya has quit IRC | 01:55 | |
*** spzala has joined #openstack-meeting-3 | 02:01 | |
*** spzala has quit IRC | 02:01 | |
*** yamamoto has quit IRC | 02:22 | |
*** yamamoto has joined #openstack-meeting-3 | 02:24 | |
*** salv-orlando has joined #openstack-meeting-3 | 02:24 | |
*** salv-orlando has quit IRC | 02:29 | |
*** shu-mutou-AWAY is now known as shu-mutou | 02:30 | |
*** VW has joined #openstack-meeting-3 | 02:33 | |
*** yamamoto has quit IRC | 02:40 | |
*** gcb has joined #openstack-meeting-3 | 02:40 | |
*** zhurong has joined #openstack-meeting-3 | 02:46 | |
*** yamahata has quit IRC | 02:54 | |
*** iyamahat has quit IRC | 02:54 | |
*** yamamoto has joined #openstack-meeting-3 | 02:54 | |
*** trungnv has quit IRC | 03:03 | |
*** trungnv has joined #openstack-meeting-3 | 03:04 | |
*** yamamoto has quit IRC | 03:05 | |
*** Sukhdev has quit IRC | 03:07 | |
*** diablo_rojo has quit IRC | 03:13 | |
*** absubram has quit IRC | 03:17 | |
*** bobh has quit IRC | 03:23 | |
*** gcb has quit IRC | 03:25 | |
*** salv-orlando has joined #openstack-meeting-3 | 03:25 | |
*** gcb has joined #openstack-meeting-3 | 03:26 | |
*** e0ne has joined #openstack-meeting-3 | 03:28 | |
*** salv-orlando has quit IRC | 03:30 | |
*** bobh has joined #openstack-meeting-3 | 03:31 | |
*** VW has quit IRC | 03:31 | |
*** VW has joined #openstack-meeting-3 | 03:32 | |
*** e0ne has quit IRC | 03:32 | |
*** VW has quit IRC | 03:37 | |
*** zhurong has quit IRC | 03:46 | |
*** d0ugal_ has joined #openstack-meeting-3 | 03:50 | |
*** d0ugal has quit IRC | 03:52 | |
*** e0ne has joined #openstack-meeting-3 | 03:55 | |
*** bobh has quit IRC | 03:58 | |
*** e0ne has quit IRC | 04:00 | |
*** gcb has quit IRC | 04:09 | |
*** iyamahat has joined #openstack-meeting-3 | 04:10 | |
*** e0ne has joined #openstack-meeting-3 | 04:11 | |
*** e0ne has quit IRC | 04:16 | |
*** coolsvap has joined #openstack-meeting-3 | 04:20 | |
*** psachin has joined #openstack-meeting-3 | 04:20 | |
*** e0ne has joined #openstack-meeting-3 | 04:23 | |
*** yamahata has joined #openstack-meeting-3 | 04:26 | |
*** salv-orlando has joined #openstack-meeting-3 | 04:26 | |
*** e0ne has quit IRC | 04:28 | |
*** VW has joined #openstack-meeting-3 | 04:29 | |
*** salv-orlando has quit IRC | 04:30 | |
*** VW has quit IRC | 04:34 | |
*** e0ne has joined #openstack-meeting-3 | 04:39 | |
*** VW has joined #openstack-meeting-3 | 04:42 | |
*** e0ne has quit IRC | 04:44 | |
*** e0ne has joined #openstack-meeting-3 | 04:50 | |
*** Sukhdev has joined #openstack-meeting-3 | 04:57 | |
*** e0ne has quit IRC | 05:03 | |
*** VW has quit IRC | 05:06 | |
*** VW has joined #openstack-meeting-3 | 05:06 | |
*** VW has quit IRC | 05:06 | |
*** VW has joined #openstack-meeting-3 | 05:07 | |
*** e0ne has joined #openstack-meeting-3 | 05:07 | |
*** VW has quit IRC | 05:09 | |
*** VW has joined #openstack-meeting-3 | 05:09 | |
*** VW has quit IRC | 05:10 | |
*** VW has joined #openstack-meeting-3 | 05:10 | |
*** VW has quit IRC | 05:11 | |
*** VW has joined #openstack-meeting-3 | 05:11 | |
*** VW has quit IRC | 05:12 | |
*** e0ne has quit IRC | 05:12 | |
*** VW has joined #openstack-meeting-3 | 05:12 | |
*** pgadiya has joined #openstack-meeting-3 | 05:14 | |
*** cshen_ has joined #openstack-meeting-3 | 05:15 | |
*** VW has quit IRC | 05:16 | |
*** e0ne has joined #openstack-meeting-3 | 05:17 | |
*** cshen_ has quit IRC | 05:20 | |
*** e0ne has quit IRC | 05:22 | |
*** pgadiya has quit IRC | 05:23 | |
*** Sukhdev has quit IRC | 05:25 | |
*** salv-orlando has joined #openstack-meeting-3 | 05:27 | |
*** chyka has joined #openstack-meeting-3 | 05:27 | |
*** e0ne has joined #openstack-meeting-3 | 05:30 | |
*** kei-ichi has quit IRC | 05:31 | |
*** salv-orlando has quit IRC | 05:32 | |
*** chyka has quit IRC | 05:32 | |
*** kei-ichi has joined #openstack-meeting-3 | 05:34 | |
*** tellesnobrega has quit IRC | 05:34 | |
*** e0ne has quit IRC | 05:35 | |
*** e0ne has joined #openstack-meeting-3 | 05:38 | |
*** yamamoto has joined #openstack-meeting-3 | 05:39 | |
*** yamamoto has quit IRC | 05:43 | |
*** e0ne has quit IRC | 05:43 | |
*** e0ne has joined #openstack-meeting-3 | 05:45 | |
*** mikal has quit IRC | 05:47 | |
*** absubram has joined #openstack-meeting-3 | 05:47 | |
*** cshen_ has joined #openstack-meeting-3 | 05:50 | |
*** absubram_ has joined #openstack-meeting-3 | 05:50 | |
*** e0ne has quit IRC | 05:51 | |
*** absubram has quit IRC | 05:52 | |
*** absubram_ is now known as absubram | 05:52 | |
*** cshen_ has quit IRC | 05:52 | |
*** yamamoto has joined #openstack-meeting-3 | 05:53 | |
*** mikal has joined #openstack-meeting-3 | 05:55 | |
*** tellesnobrega has joined #openstack-meeting-3 | 05:55 | |
*** yamamoto has quit IRC | 05:57 | |
*** e0ne has joined #openstack-meeting-3 | 05:57 | |
*** tellesnobrega has quit IRC | 05:59 | |
*** tellesnobrega has joined #openstack-meeting-3 | 05:59 | |
*** e0ne has quit IRC | 06:02 | |
*** cshastri has joined #openstack-meeting-3 | 06:03 | |
*** e0ne has joined #openstack-meeting-3 | 06:04 | |
*** pcaruana has joined #openstack-meeting-3 | 06:05 | |
*** mikal_ has joined #openstack-meeting-3 | 06:06 | |
*** e0ne has quit IRC | 06:09 | |
*** mikal has quit IRC | 06:10 | |
*** salv-orlando has joined #openstack-meeting-3 | 06:12 | |
*** e0ne has joined #openstack-meeting-3 | 06:15 | |
*** pcaruana has quit IRC | 06:16 | |
*** e0ne has quit IRC | 06:20 | |
*** e0ne has joined #openstack-meeting-3 | 06:24 | |
*** e0ne has quit IRC | 06:29 | |
*** yamamoto has joined #openstack-meeting-3 | 06:31 | |
*** jgu has quit IRC | 06:37 | |
*** jgu has joined #openstack-meeting-3 | 06:38 | |
*** yamamoto has quit IRC | 06:43 | |
*** mikal_ has quit IRC | 06:45 | |
*** mikal has joined #openstack-meeting-3 | 06:47 | |
*** marios has joined #openstack-meeting-3 | 06:59 | |
*** yamamoto has joined #openstack-meeting-3 | 06:59 | |
*** yamamoto has quit IRC | 07:06 | |
*** david-lyle has joined #openstack-meeting-3 | 07:19 | |
*** gouthamr has quit IRC | 07:20 | |
*** markvoelker has quit IRC | 07:37 | |
*** yamahata has quit IRC | 07:38 | |
*** yamamoto has joined #openstack-meeting-3 | 07:49 | |
*** yamamoto has quit IRC | 07:51 | |
*** pcaruana has joined #openstack-meeting-3 | 07:55 | |
*** yamamoto has joined #openstack-meeting-3 | 07:57 | |
*** georgk has joined #openstack-meeting-3 | 08:01 | |
*** TuanLA has joined #openstack-meeting-3 | 08:07 | |
*** makowals has quit IRC | 08:16 | |
*** e0ne has joined #openstack-meeting-3 | 08:18 | |
*** yamamoto has quit IRC | 08:33 | |
*** makowals has joined #openstack-meeting-3 | 08:36 | |
*** markvoelker has joined #openstack-meeting-3 | 08:38 | |
*** yamamoto has joined #openstack-meeting-3 | 08:40 | |
*** gmann is now known as gmann_afk | 08:41 | |
*** MarkBaker has quit IRC | 08:44 | |
*** yamamoto has quit IRC | 08:44 | |
*** iyamahat has quit IRC | 08:52 | |
*** ccamacho has joined #openstack-meeting-3 | 08:52 | |
*** georgk has left #openstack-meeting-3 | 08:58 | |
*** ccamacho has quit IRC | 09:02 | |
*** chyka has joined #openstack-meeting-3 | 09:03 | |
*** yamamoto has joined #openstack-meeting-3 | 09:04 | |
*** ccamacho has joined #openstack-meeting-3 | 09:05 | |
*** ccamacho has quit IRC | 09:06 | |
*** ccamacho has joined #openstack-meeting-3 | 09:06 | |
*** chyka has quit IRC | 09:08 | |
*** belmoreira has joined #openstack-meeting-3 | 09:13 | |
*** rossella_s has joined #openstack-meeting-3 | 09:16 | |
*** d0ugal_ has quit IRC | 09:17 | |
*** d0ugal has joined #openstack-meeting-3 | 09:18 | |
*** d0ugal has quit IRC | 09:18 | |
*** d0ugal has joined #openstack-meeting-3 | 09:18 | |
*** yamamoto has quit IRC | 09:19 | |
*** VW has joined #openstack-meeting-3 | 09:22 | |
*** VW has quit IRC | 09:26 | |
*** mfedosin_ has joined #openstack-meeting-3 | 09:38 | |
*** mfedosin has quit IRC | 09:39 | |
*** _pewp_ has quit IRC | 09:39 | |
*** pcaruana has quit IRC | 09:39 | |
*** mfedosin_ is now known as mfedosin | 09:39 | |
*** _pewp_ has joined #openstack-meeting-3 | 09:39 | |
*** pcaruana has joined #openstack-meeting-3 | 09:40 | |
*** e0ne has quit IRC | 09:40 | |
*** kbyrne has quit IRC | 09:43 | |
*** cshastri has quit IRC | 09:43 | |
*** kbyrne has joined #openstack-meeting-3 | 09:44 | |
*** chason has quit IRC | 09:45 | |
*** chason has joined #openstack-meeting-3 | 09:45 | |
*** david-lyle has quit IRC | 09:46 | |
*** TuanLA has quit IRC | 09:58 | |
*** coolsvap has quit IRC | 09:59 | |
*** e0ne has joined #openstack-meeting-3 | 10:01 | |
*** belmoreira has quit IRC | 10:03 | |
*** belmoreira has joined #openstack-meeting-3 | 10:07 | |
*** borisnet[m]1 has joined #openstack-meeting-3 | 10:08 | |
*** xgerman_ has quit IRC | 10:09 | |
*** fyxim has quit IRC | 10:09 | |
*** kong has quit IRC | 10:09 | |
*** zhenguo has quit IRC | 10:09 | |
*** dgonzalez has quit IRC | 10:09 | |
*** borisnet[m] has quit IRC | 10:09 | |
*** anubhaskar[m] has quit IRC | 10:09 | |
*** anubhaskar[m] has joined #openstack-meeting-3 | 10:15 | |
*** xgerman_ has joined #openstack-meeting-3 | 10:15 | |
*** fyxim has joined #openstack-meeting-3 | 10:15 | |
*** kong has joined #openstack-meeting-3 | 10:15 | |
*** zhenguo has joined #openstack-meeting-3 | 10:15 | |
*** dgonzalez has joined #openstack-meeting-3 | 10:15 | |
*** trungnv has quit IRC | 10:15 | |
*** calbers has quit IRC | 10:18 | |
*** calbers has joined #openstack-meeting-3 | 10:22 | |
*** VW has joined #openstack-meeting-3 | 10:33 | |
*** cshastri has joined #openstack-meeting-3 | 10:34 | |
*** salv-orlando has quit IRC | 10:36 | |
*** VW has quit IRC | 10:37 | |
*** MarkBaker has joined #openstack-meeting-3 | 10:47 | |
*** salv-orlando has joined #openstack-meeting-3 | 10:48 | |
*** shu-mutou is now known as shu-mutou-AWAY | 10:55 | |
*** raildo has joined #openstack-meeting-3 | 11:00 | |
*** sdague has joined #openstack-meeting-3 | 11:02 | |
*** kabhishek[m] has quit IRC | 11:06 | |
*** natorious has quit IRC | 11:11 | |
*** warlord77[m] has quit IRC | 11:13 | |
*** borisnet[m]1 has quit IRC | 11:13 | |
*** natorious has joined #openstack-meeting-3 | 11:14 | |
*** Kodzo[m] has quit IRC | 11:14 | |
*** anubhaskar[m] has quit IRC | 11:14 | |
*** zerga[m] has quit IRC | 11:14 | |
*** johnwhitlow[m] has quit IRC | 11:14 | |
*** Eko[m] has quit IRC | 11:14 | |
*** salv-orlando has quit IRC | 11:18 | |
*** salv-orlando has joined #openstack-meeting-3 | 11:32 | |
*** MarkBaker has quit IRC | 11:53 | |
*** ywat has quit IRC | 11:53 | |
*** rossella_s has quit IRC | 11:54 | |
*** rossella_s has joined #openstack-meeting-3 | 11:55 | |
*** coolsvap has joined #openstack-meeting-3 | 12:10 | |
*** etingof has quit IRC | 12:12 | |
*** bobh has joined #openstack-meeting-3 | 12:26 | |
*** Eko[m] has joined #openstack-meeting-3 | 12:27 | |
*** bobh has quit IRC | 12:30 | |
*** belmoreira has quit IRC | 12:33 | |
*** chyka has joined #openstack-meeting-3 | 12:34 | |
*** yamamoto has joined #openstack-meeting-3 | 12:37 | |
*** chyka has quit IRC | 12:38 | |
*** warlord77[m] has joined #openstack-meeting-3 | 12:42 | |
*** zerga[m] has joined #openstack-meeting-3 | 12:42 | |
*** johnwhitlow[m] has joined #openstack-meeting-3 | 12:42 | |
*** anubhaskar[m] has joined #openstack-meeting-3 | 12:42 | |
*** kabhishek[m] has joined #openstack-meeting-3 | 12:42 | |
*** Kodzo[m] has joined #openstack-meeting-3 | 12:42 | |
*** borisnet[m] has joined #openstack-meeting-3 | 12:42 | |
*** dobson has quit IRC | 12:44 | |
*** etingof has joined #openstack-meeting-3 | 12:50 | |
*** dobson has joined #openstack-meeting-3 | 12:52 | |
*** belmoreira has joined #openstack-meeting-3 | 12:53 | |
*** etingof has quit IRC | 12:58 | |
*** yamamoto has quit IRC | 13:04 | |
*** yamamoto has joined #openstack-meeting-3 | 13:05 | |
*** etingof has joined #openstack-meeting-3 | 13:10 | |
*** lhx_ has joined #openstack-meeting-3 | 13:16 | |
*** VW has joined #openstack-meeting-3 | 13:17 | |
*** markvoelker has quit IRC | 13:23 | |
*** markvoelker has joined #openstack-meeting-3 | 13:24 | |
*** sambetts|afk is now known as sambetts | 13:29 | |
*** shuyingy_ has quit IRC | 13:35 | |
*** lyan has joined #openstack-meeting-3 | 13:40 | |
*** stendulker has joined #openstack-meeting-3 | 13:41 | |
*** donghao has joined #openstack-meeting-3 | 13:51 | |
*** shuyingya has joined #openstack-meeting-3 | 13:57 | |
*** tssurya_ has joined #openstack-meeting-3 | 13:59 | |
*** gmann_afk is now known as gmann | 14:00 | |
tellesnobrega | #startmeeting sahara | 14:00 |
---|---|---|
openstack | Meeting started Thu Nov 30 14:00:48 2017 UTC and is due to finish in 60 minutes. The chair is tellesnobrega. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
*** openstack changes topic to " (Meeting topic: sahara)" | 14:00 | |
openstack | The meeting name has been set to 'sahara' | 14:00 |
tellesnobrega | waiting for people to show hands | 14:01 |
shuyingya | o/ | 14:01 |
shuyingya | Wait me 3 minutes please | 14:01 |
tellesnobrega | sure | 14:01 |
*** jeremyfreudberg has joined #openstack-meeting-3 | 14:01 | |
jeremyfreudberg | o/ | 14:02 |
*** shuyingya has quit IRC | 14:02 | |
*** d0ugal has quit IRC | 14:03 | |
*** margaret has joined #openstack-meeting-3 | 14:03 | |
*** shuyingya has joined #openstack-meeting-3 | 14:03 | |
tellesnobrega | waiting until 5 after so we can start | 14:04 |
jeremyfreudberg | sure | 14:05 |
*** shuyingy_ has joined #openstack-meeting-3 | 14:05 | |
tellesnobrega | and that is time | 14:05 |
tellesnobrega | #topic News/Updates | 14:05 |
*** openstack changes topic to "News/Updates (Meeting topic: sahara)" | 14:05 | |
shuyingy_ | Hi I am comming | 14:05 |
*** tosky has joined #openstack-meeting-3 | 14:05 | |
tosky | here, sorry | 14:05 |
jeremyfreudberg | o/ | 14:05 |
tellesnobrega | I'm currently finishing up the work on decommission of specific node. I just need to check shuyingy_'s comment on the order of deletion, and write tests | 14:06 |
tellesnobrega | other than that, I need to get back to mapr image generation | 14:06 |
tellesnobrega | and try to squeeze some time to work on plugin outside sahara code | 14:06 |
tellesnobrega | not sure it will happen, the last one, but I will try | 14:07 |
tellesnobrega | Oh, I also need to do the decommission work on the sahara client and UI | 14:07 |
tellesnobrega | UI should be a pain, but it is a necessary evil | 14:07 |
jeremyfreudberg | so, I'm working on revising s3_hadoop element, finishing up s3 job binary mostly | 14:09 |
tellesnobrega | good, do you believe we will have the feature in queens? | 14:09 |
shuyingy_ | Today is the last day of business travel. this week mostly working on deploying sahara on k8s by helm. If you are interesting, please review https://review.openstack.org/#/c/477718/. and will continue to work on HBase support next week. hopefully it can be finished next week. | 14:09 |
jeremyfreudberg | tellesnobrega, s3 job binary should defniitely be done | 14:09 |
jeremyfreudberg | data source is another story, those are always a bit trickier since they have to work on the cluster itself, it's not just an abstraction | 14:10 |
tellesnobrega | that is great shuyingy_, did it all work well: | 14:10 |
tellesnobrega | ? | 14:10 |
tellesnobrega | jeremyfreudberg, I understand, we still have some time, let me know if you need help | 14:10 |
jeremyfreudberg | tellesnobrega, sure | 14:10 |
shuyingy_ | I am try to review s3 patch. but doesn't find any problem because of lack of knowledge about s3 | 14:11 |
jeremyfreudberg | yes, it would be good have someone who really knows S3 to say whether or not we are exposing enough boto options | 14:12 |
jeremyfreudberg | i made some nodes about s3 region and such | 14:12 |
jeremyfreudberg | there are lots of fancy kwargs that can go there | 14:12 |
jeremyfreudberg | but who knows what users actually need | 14:12 |
jeremyfreudberg | *notes | 14:12 |
tellesnobrega | that might be tricky to find | 14:12 |
tellesnobrega | s3 knowledge interested in OpenStack, even more on sahara | 14:13 |
shuyingy_ | yes, it works well. I need try to find more frequently changed configurations for user to configure sahara. | 14:13 |
*** shuyingya has quit IRC | 14:13 | |
tellesnobrega | tosky, any news/updates? | 14:14 |
tosky | I'm swamped in internal testing, but I'm still keeping an eye on the zuul changes (and nagging zuul developers) | 14:14 |
tellesnobrega | cool | 14:14 |
tosky | so yes, we will have proper native jobs way before queens (hopefully before the end of the year) | 14:15 |
tellesnobrega | nice :) that is great to hear | 14:15 |
tosky | I think I already wrote it: I could have pushed some changes, and then fixed them; but infra is not pushing to remove the old jobs, so I'm lazily waiting to avoid some loops of write/fix | 14:16 |
tellesnobrega | makes sense | 14:16 |
jeremyfreudberg | tosky, i see | 14:16 |
shuyingy_ | now is in middle of Queen, right? I am sorry that i didn't finished HBase support and keypair injecting util now | 14:16 |
jeremyfreudberg | shuyingy_, that's ok | 14:16 |
jeremyfreudberg | i have the same schedule problems | 14:16 |
tellesnobrega | shuyingy_, yes, we are approaching q-2. It is on December 7th | 14:17 |
jeremyfreudberg | feature freeze is between Jan 22 - Jan 26, so you still have time after that | 14:17 |
tosky | up to the PTL, but as long as the new features are additional and do not impact the existing code, it should not be a problem if they land a bit later | 14:17 |
tellesnobrega | yes | 14:17 |
*** d0ugal has joined #openstack-meeting-3 | 14:17 | |
tellesnobrega | and we can always get FFE if needed | 14:18 |
* jeremyfreudberg reminds everyone he has to log off today by 14:27 UTC | 14:18 | |
shuyingy_ | that is great | 14:18 |
tellesnobrega | it won't be a problem I believe. But we can't wait too much | 14:18 |
*** coolsvap has quit IRC | 14:19 | |
tellesnobrega | lets move on, we have a important topic for today | 14:19 |
jeremyfreudberg | every topic is important | 14:19 |
jeremyfreudberg | ;) | 14:19 |
shuyingy_ | :) | 14:19 |
tellesnobrega | true | 14:19 |
shuyingy_ | aha | 14:19 |
tellesnobrega | critical one | 14:19 |
tellesnobrega | #topic plugins update | 14:20 |
*** openstack changes topic to "plugins update (Meeting topic: sahara)" | 14:20 | |
jeremyfreudberg | indeed, this is is a critical topic | 14:20 |
tellesnobrega | At the PTG we decided that we should try to have all updates by Q2 | 14:20 |
tellesnobrega | that means we have about 7 days to finish them all | 14:20 |
tosky | or defines exceptions :) | 14:21 |
tellesnobrega | this isn't a must, and if we fail, nobody will die. | 14:21 |
tellesnobrega | My plan here is for us to have a list of the plugins that needs to be updated and we can start working on it asap | 14:21 |
jeremyfreudberg | yes, nobody will die, and i put a provision here https://releases.openstack.org/queens/schedule.html#q-sahara-plugin-deadline that telles can basically suspend this rule if he wants | 14:21 |
tosky | and an estimated rough complexity, if you can | 14:21 |
jeremyfreudberg | yes, let's figure out what can get updated | 14:21 |
jeremyfreudberg | yes | 14:22 |
tellesnobrega | so we can have it finished close to our schedule | 14:22 |
jeremyfreudberg | so, there is a finally as of a few weeks ago a stable Hadoop 2.8.x release | 14:22 |
jeremyfreudberg | it ended up 2.8.2 | 14:22 |
jeremyfreudberg | there is no stable 2.9 or 3.0 yet | 14:22 |
tellesnobrega | yes | 14:22 |
jeremyfreudberg | so vanilla plugin can be upgraded if we want | 14:23 |
jeremyfreudberg | along with pig and hive and oozie(?) on that image | 14:23 |
tosky | and will 2.9 be close 2.8, before the big breakage with 3.0? | 14:24 |
tellesnobrega | sounds about right | 14:24 |
tosky | I wonder why they still plan full development on the old series, but well... | 14:24 |
jeremyfreudberg | tosky, 2.9 is close to 2.8 yes | 14:24 |
jeremyfreudberg | and there will be parallel development | 14:24 |
jeremyfreudberg | not quite like Python 2 / Python 3, but something like that :( | 14:24 |
jeremyfreudberg | so, vanilla | 14:25 |
jeremyfreudberg | spark plugin can can be upgraded too | 14:25 |
shuyingy_ | cdh too | 14:25 |
shuyingy_ | it has cdh 5.13 right now | 14:25 |
jeremyfreudberg | cdh maybe not, i had some problem with a package no longer available | 14:25 |
jeremyfreudberg | we had to cancel our 5.12 upgrade because we didn't have time to figure it out | 14:25 |
tellesnobrega | #action update vanilla to 2.8.2 also pig, hive and oozie(?) | 14:26 |
jeremyfreudberg | for spark there is 2.1.2 and 2.2.0 so far | 14:26 |
jeremyfreudberg | the cdh thing was navigator trustee if i recall correctly | 14:26 |
tellesnobrega | shuyingy_, jeremyfreudberg is right, we have to take a deeper look into CDH, they changed some packages to enterprise only, so we may have hit a roadblock there | 14:26 |
jeremyfreudberg | btw, i have to sign off basically now | 14:27 |
jeremyfreudberg | but tellesnobrega can figure out storm | 14:27 |
tellesnobrega | thanks jeremyfreudberg | 14:27 |
tosky | bye jeremyfreudberg o/ | 14:27 |
jeremyfreudberg | mapr and hdp i'm sure have something new | 14:27 |
shuyingy_ | jeremy byebye | 14:27 |
jeremyfreudberg | not sure if that's absolutely essential | 14:27 |
jeremyfreudberg | bye all! | 14:27 |
jeremyfreudberg | send me an email if you have urgent questions | 14:27 |
tellesnobrega | see ya | 14:27 |
tellesnobrega | will do | 14:27 |
jeremyfreudberg | i will read the trasncript of ths meeting asap | 14:27 |
*** jeremyfreudberg has quit IRC | 14:27 | |
tellesnobrega | do we want both new spark versions? | 14:28 |
shuyingy_ | I don't think so. | 14:28 |
tosky | uhm, do you mean basic spark and cdh/spark? | 14:28 |
* tosky confused | 14:28 | |
tellesnobrega | I think spark 2.1.0 should not be deprecated yet, we can add the newest one | 14:28 |
tellesnobrega | upstream spark | 14:28 |
tosky | oh, I see | 14:28 |
tellesnobrega | and later, if needed we replace 2.1.0 with 2.1.2 | 14:29 |
tosky | isn't 2.1.2 just a minor update for 2.1? I think we didn't solve the problem of minor compatibile versions | 14:29 |
shuyingy_ | we don't need update minor version I think | 14:29 |
tosky | maybe we could just allow the code to define multiple tags for each plugin/version | 14:29 |
tosky | so can we register it as 2.1.0 and it should work? | 14:29 |
tellesnobrega | that would be nice | 14:30 |
tellesnobrega | to be sure, spark is going to 2.2.0 | 14:30 |
tellesnobrega | and we keep 2.1.0 and see if we can work tags to have minor versions | 14:31 |
tellesnobrega | all agreed? | 14:31 |
shuyingy_ | do you mean we can build an image with spark 2.1.2 and tag it as 2.1.0? | 14:32 |
tosky | I would say that it should be fine for n ow | 14:32 |
tosky | now | 14:32 |
tellesnobrega | shuyingy_, yes | 14:32 |
shuyingy_ | from code side, that's is not difficult. sound nice | 14:32 |
shuyingy_ | \o/ | 14:33 |
tellesnobrega | #action update spark to 2.2.0 | 14:33 |
tellesnobrega | lets move on to storm | 14:33 |
tellesnobrega | storm newest version is 1.1.1 | 14:33 |
tellesnobrega | we have 1.1.0, so we can take the same approach we did for spark | 14:33 |
tellesnobrega | sounds ok? | 14:34 |
shuyingy_ | sure. it is really convenient to user | 14:35 |
tellesnobrega | cool | 14:35 |
tellesnobrega | MapR | 14:35 |
tellesnobrega | I check their website, seems like the newest version is 5.2 | 14:35 |
tellesnobrega | which we already have | 14:36 |
tosky | it would be nice to understand why they disappeared also from sahara | 14:36 |
tosky | but no new upstream versions too, uhm | 14:36 |
tellesnobrega | wait, seems like there is a mapr 6 | 14:37 |
tellesnobrega | but in tr mapr the newest version is 5.2 | 14:38 |
*** e0ne has quit IRC | 14:39 | |
tellesnobrega | yeah, seems like 5.2 is the last one on downloads | 14:40 |
*** e0ne has joined #openstack-meeting-3 | 14:40 | |
tellesnobrega | Ambari has a new version 2.6 | 14:40 |
*** gmann is now known as gmann_afk | 14:40 | |
tellesnobrega | https://cwiki.apache.org/confluence/display/AMBARI/Installation+Guide+for+Ambari+2.6.0 | 14:41 |
tosky | I can't find the release date for 6, but there is the documentaiton | 14:41 |
shuyingy_ | we may not have too much energy to update them all. MapR used to update by MapR themself, right? | 14:41 |
tosky | and which HDP versions can be deployed by ambari 2.6? | 14:41 |
tellesnobrega | tosky, checking that now | 14:41 |
shuyingy_ | https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_support-matrices/content/ch_matrices-ambari.html#ambari_stack | 14:42 |
tellesnobrega | 6.0.0November 21, 2017N/A | 14:42 |
tellesnobrega | tosky, ^ | 14:42 |
*** Swami has joined #openstack-meeting-3 | 14:42 | |
tosky | tellesnobrega: argh, one week | 14:42 |
tosky | I would say we can push it to Rocky | 14:42 |
tellesnobrega | tosky, for sure | 14:42 |
tellesnobrega | seems like hdp doesn't support ambari 2.6 yet | 14:43 |
tosky | that would be weird | 14:43 |
tosky | I remember that Ambari x.y should support at least HDP x.y | 14:43 |
tosky | but I may remember incorrectly | 14:43 |
tellesnobrega | the link is looking was wrong | 14:44 |
*** cshastri has quit IRC | 14:45 | |
tellesnobrega | on HDP website there is only the matrix up to ambari 2.5 | 14:45 |
tellesnobrega | https://hortonworks.com/blog/hdp-2-6-3-dataplane-service/ | 14:46 |
tellesnobrega | tosky, shuyingy_ ^ | 14:46 |
tosky | uhm uhm | 14:46 |
tellesnobrega | both ambari 2.6.0 and HDP 2.6.3 | 14:46 |
tosky | at least we are not the only one with documentation that requires some updates :) | 14:46 |
tellesnobrega | lol | 14:46 |
tellesnobrega | true | 14:47 |
shuyingy_ | haha | 14:47 |
shuyingy_ | :) | 14:47 |
tellesnobrega | so we want to update ambari to 2.6.0 with HDP to 2.6.3 | 14:47 |
tellesnobrega | all in favor? | 14:47 |
shuyingy_ | up | 14:48 |
shuyingy_ | agree | 14:48 |
tellesnobrega | #action update ambari to 2.6 with HDP to 2.6.3 | 14:49 |
*** stendulker has quit IRC | 14:49 | |
shuyingy_ | Now we should decide how to divide the work | 14:49 |
tellesnobrega | I think we covered all plugins | 14:49 |
tellesnobrega | yes | 14:49 |
shuyingy_ | yes | 14:49 |
tellesnobrega | I believe that spark and storm should be fairly quick work, I can take them both | 14:50 |
tosky | only HDP 2.6, or should we try to switch to ambari 2.6 to deploy also the older versions? | 14:50 |
shuyingy_ | btw, I will share you the performance comparison of vanilla to aws emr next week | 14:50 |
tellesnobrega | cool | 14:50 |
tosky | it may be complicated, but it could also simplify part of the matrix | 14:50 |
*** mlavalle has joined #openstack-meeting-3 | 14:51 | |
tellesnobrega | tosky, not sure, ambari/hdp has always confused me | 14:51 |
shuyingy_ | I will update vanilla if I can. otherwise I can invite my colleague to help us. | 14:51 |
tosky | Ambari can deploy few versions | 14:51 |
shuyingy_ | ambari/hdp has always confused me too | 14:51 |
shuyingy_ | the image name of ambari let me crazy | 14:52 |
*** bobh has joined #openstack-meeting-3 | 14:52 | |
*** janzian has joined #openstack-meeting-3 | 14:52 | |
tosky | yeah | 14:53 |
tellesnobrega | tosky, what do you think is the best way to go with ambari? | 14:53 |
tosky | from the previous document it seems that Ambari 2.5 was able to deploy all the old versions | 14:53 |
tosky | so it may be the same with Ambari 2.6 | 14:53 |
tosky | right now, if I'm not mistaken, we deploy two slightly different versions of ambari for the two version of hdp | 14:54 |
tosky | but if ambari 2.6 can deploy 2.6, 2.4 (and 2.3, if we don't want to deprecated it), maybe it's easier to handle | 14:54 |
tosky | otherwise we would need different codepaths on our side if the various ambari versions differs | 14:55 |
tosky | but if ambari hides the differences between HDP versions, well | 14:55 |
tellesnobrega | yeah, I think we have 2.2.0.0 and 2.2.1.0 | 14:55 |
tellesnobrega | our ambari version is very old at this point | 14:55 |
tellesnobrega | so we have ambari and vanilla to update | 14:57 |
tosky | I think we support ambari 2.4 too | 14:57 |
tellesnobrega | yeah | 14:57 |
tellesnobrega | not sure | 14:58 |
shuyingy_ | 2.4 and 2.5 both support | 14:58 |
tellesnobrega | on image gen the versions are 2.2.0.0 and 2.2.1.0 | 14:58 |
tosky | but again, if HDP 2.6 can be deployed with ambari 2.6 only (ok, also 2.5), we need to update to support that ambari | 14:58 |
tosky | if, on the other side, that ambari can deploy all hdp versions, why not kill the olders ambari? | 14:58 |
tellesnobrega | sounds good, lets take a closer look on that and get back to it | 14:59 |
tellesnobrega | that would be good too | 14:59 |
tellesnobrega | and maybe we should take a class on ambari/hdp | 14:59 |
tellesnobrega | lol | 14:59 |
*** hongbin has joined #openstack-meeting-3 | 14:59 | |
tellesnobrega | shuyingy_, do you have time to update any plugin? | 15:00 |
shuyingy_ | so I will update vanilla | 15:00 |
shuyingy_ | you may miss my message | 15:00 |
shuyingy_ | :) | 15:00 |
tellesnobrega | great | 15:00 |
*** iyamahat has joined #openstack-meeting-3 | 15:00 | |
tellesnobrega | I will try to check ambari and see if jeremy can work on it | 15:00 |
*** yamahata has joined #openstack-meeting-3 | 15:00 | |
shuyingy_ | at 22:51, I said it :) | 15:00 |
tellesnobrega | otherwise I will work on it was well | 15:01 |
tellesnobrega | yes | 15:01 |
shuyingy_ | haha | 15:01 |
tellesnobrega | we have to close it | 15:01 |
tellesnobrega | thanks guys | 15:01 |
shuyingy_ | bye | 15:01 |
tellesnobrega | see you next week | 15:01 |
tellesnobrega | bye | 15:01 |
shuyingy_ | see you next week | 15:01 |
tosky | o/ | 15:01 |
tellesnobrega | #endmeeting | 15:01 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings" | 15:01 | |
openstack | Meeting ended Thu Nov 30 15:01:39 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:01 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/sahara/2017/sahara.2017-11-30-14.00.html | 15:01 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/sahara/2017/sahara.2017-11-30-14.00.txt | 15:01 |
openstack | Log: http://eavesdrop.openstack.org/meetings/sahara/2017/sahara.2017-11-30-14.00.log.html | 15:01 |
mlavalle | #startmeeting neutron_l3 | 15:01 |
openstack | Meeting started Thu Nov 30 15:01:49 2017 UTC and is due to finish in 60 minutes. The chair is mlavalle. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:01 |
*** openstack changes topic to " (Meeting topic: neutron_l3)" | 15:01 | |
openstack | The meeting name has been set to 'neutron_l3' | 15:01 |
haleyb | hi | 15:02 |
Swami | hi | 15:02 |
*** tosky has left #openstack-meeting-3 | 15:02 | |
janzian | o/ | 15:02 |
mlavalle | sorry for the delay, the Sahara guys were wrapping up their meeting | 15:02 |
mlavalle | #topic Announcements | 15:02 |
*** openstack changes topic to "Announcements (Meeting topic: neutron_l3)" | 15:02 | |
mlavalle | First announcement is that the Q-2 milestone will be next week | 15:03 |
mlavalle | after that, we are on the home stretch of the Queens cycle | 15:04 |
mlavalle | Second annoucement is that the Rocky PTG is open to buy tickets and make hotel reservations | 15:04 |
mlavalle | #link https://www.openstack.org/ptg/ | 15:05 |
mlavalle | the venue is a soccer stadium that also has meeting rooms to host conferences | 15:05 |
Swami | nice | 15:06 |
haleyb | s/soccer/football right? :) | 15:06 |
mlavalle | I made my reservation at the event hotel yesterday, to make sure I get the discounted price of 155 euros and comply with my employer policies | 15:07 |
*** davidsha has joined #openstack-meeting-3 | 15:07 | |
mlavalle | haleyb: lol, you made doubt whether my subconcious had betrayed me.... | 15:07 |
haleyb | i just got approved today so will be doing the same. i will only be there wed-fri though, the ptg always conflicts with my vacation | 15:08 |
*** jrist has quit IRC | 15:08 | |
davidsha | Sorry I'm late, just got out of a meeting @.@ | 15:08 |
mlavalle | that rate includes breakfasts and taxes | 15:08 |
mlavalle | so that is the net net rate | 15:08 |
*** jrist has joined #openstack-meeting-3 | 15:09 | |
mlavalle | haleyb: nice, we can have go to the Irish pubs with davidsha to discuss kick ass dvr | 15:09 |
davidsha | :D | 15:09 |
mlavalle | any other announcements? | 15:09 |
mlavalle | ok, moving on | 15:10 |
mlavalle | #topic Bugs | 15:10 |
*** openstack changes topic to "Bugs (Meeting topic: neutron_l3)" | 15:10 | |
mlavalle | Swami: please fire away | 15:10 |
Swami | mlavalle: thanks | 15:10 |
*** donghao has quit IRC | 15:11 | |
Swami | #link https://bugs.launchpad.net/neutron/+bug/1717302 | 15:11 |
openstack | Launchpad bug 1717302 in neutron "Tempest floatingip scenario tests failing on DVR Multinode setup with HA" [High,Confirmed] | 15:11 |
Swami | mlavalle, haleyb: I was able to debug this issue further and found some issues in the floatingip translation from the router namespace to the fip namespace. | 15:12 |
haleyb | Swami: great! | 15:12 |
Swami | I have captured all my findings in the bug report. | 15:12 |
Swami | The rules are configured in the router namespace and the packet is getting out of the router namespace with a private ip and so it is not getting in sync. | 15:13 |
Swami | I see both the nodes reponding to the ping, but they are not syncing up. | 15:13 |
*** VW has quit IRC | 15:13 | |
*** VW has joined #openstack-meeting-3 | 15:14 | |
Swami | haleyb: Do you know why this would happen or have you seen similar issues. | 15:14 |
haleyb | i will have to read through all the notes | 15:14 |
Swami | This is very hard to reproduce, because out of the four tests either one fails randomly. The only test that does not fail is the 'without FIP' condition for both SRC and DEST. | 15:15 |
Swami | sorry I meant hard to debug, but easy to reproduce, you will get a failure at least once in two runs. | 15:15 |
haleyb | Swami: thanks for debugging further | 15:16 |
Swami | haleyb: I think the culprit is the floatingip-chain in the router-namespace, but let me look further and update. In the meanwhile if you see any thing let me know or update the bug report. | 15:16 |
Swami | So I will continue my debugging on this. | 15:17 |
mlavalle | Thanks! | 15:17 |
*** marst has joined #openstack-meeting-3 | 15:17 | |
Swami | #link https://bugs.launchpad.net/neutron/+bug/1733987 | 15:17 |
openstack | Launchpad bug 1733987 in neutron "name resolution error with DVR+HA routers" [Medium,In progress] - Assigned to Armando Migliaccio (armando-migliaccio) | 15:17 |
Swami | There is a patch up for review for this bug. | 15:17 |
Swami | #link https://review.openstack.org/#/c/522362/ | 15:18 |
haleyb | i see armando updated it, will take another look | 15:19 |
Swami | Nothing else to discuss on this patch, since we already have some review comments from anil and haleyb | 15:19 |
*** stendulker has joined #openstack-meeting-3 | 15:19 | |
Swami | haleyb: ok, thanks. | 15:19 |
*** zhipeng has joined #openstack-meeting-3 | 15:19 | |
Swami | #link https://bugs.launchpad.net/neutron/+bug/1733852 | 15:20 |
openstack | Launchpad bug 1733852 in neutron "Incorrect ARP entries in new DVR routers for Octavia VRRP addresses" [Medium,In progress] - Assigned to Daniel Russell (danielr-2) | 15:20 |
Swami | Sorry I just noticed this issue. I am backlogged from my vacation in Sydney. | 15:20 |
Swami | haleyb: thanks for triaging this. | 15:20 |
haleyb | np, i just haven't looked at the review yet | 15:21 |
*** MarkBaker has joined #openstack-meeting-3 | 15:21 | |
Swami | I need to take a further look at this and see what is triggering this ARP entry. May be we might have some code that needs cleanup on the server side. | 15:21 |
Swami | But I will update the bug report after doing my testing. | 15:21 |
Swami | haleyb: I did see that the patch was abandoned. | 15:22 |
haleyb | there's a new one, don't know why the first was abandoned | 15:22 |
mlavalle | there is another one: | 15:22 |
*** zhipeng has quit IRC | 15:22 | |
Swami | #link https://review.openstack.org/#/c/524037/ | 15:22 |
mlavalle | yeah, that seems to be the good one | 15:23 |
Swami | mlavalle: yes this patch is still active against the bug. I will take a look at it. The other one has been abandoned. | 15:23 |
Swami | #link .launchpad.net/neutron/+bug/1731857 | 15:23 |
*** stendulker_ has joined #openstack-meeting-3 | 15:24 | |
Swami | #link https://bugs.launchpad.net/neutron/+bug/1731857 | 15:24 |
openstack | Launchpad bug 1731857 in neutron "DVR scenario tests fail in default deployment" [Low,New] | 15:24 |
Swami | The bug says there is a mismatch in the default settings with DVR and legacy routers. | 15:24 |
Swami | I need to check this out. I might not have tested with legacy routers. | 15:25 |
haleyb | for the migration tests it would seem legacy was not a good choice, so maybe it is just a quick fix? | 15:26 |
*** stendulker has quit IRC | 15:26 | |
*** stendulker_ has quit IRC | 15:26 | |
Swami | haleyb: yes | 15:27 |
*** gouthamr has joined #openstack-meeting-3 | 15:27 | |
*** stendulker_ has joined #openstack-meeting-3 | 15:27 | |
Swami | #link https://bugs.launchpad.net/neutron/+bug/1728665 | 15:27 |
openstack | Launchpad bug 1728665 in neutron "Removing gateway ip for tenant network (DVR) causes traceback in neutron-openvswitch-agent" [Medium,In progress] - Assigned to Brian Haley (brian-haley) | 15:27 |
Swami | #link https://review.openstack.org/#/c/521199/ | 15:28 |
Swami | There is a patch up for review. | 15:28 |
haleyb | Swami: i had forgoteen about that one, will look at your comments | 15:28 |
Swami | haleyb: no problem. | 15:28 |
Swami | #link https://bugs.launchpad.net/neutron/+bug/1716401 | 15:29 |
openstack | Launchpad bug 1716401 in neutron "FWaaS: Ip tables rules do not get updated in case of distributed virtual routers (DVR)" [Undecided,New] | 15:29 |
Swami | I haven't got any information on this from the FWaaS team. I tried to sync up with Sridhar in Sydney but he was busy and mentioned that he will through this issue with me later. | 15:30 |
Swami | So this is still pending. | 15:30 |
Swami | mlavalle: may be you can bring this up in the FWaaS meeting. | 15:30 |
Swami | That's all I had for today's meeting. | 15:30 |
mlavalle | Swami: ok, I will | 15:30 |
Swami | mlavalle: back to you | 15:30 |
mlavalle | on my side we have https://bugs.launchpad.net/neutron/+bug/1706750 | 15:31 |
openstack | Launchpad bug 1706750 in neutron "FlushError for automatic IPAllocations when subnet create is retried" [High,Confirmed] - Assigned to Ihar Hrachyshka (ihar-hrachyshka) | 15:31 |
mlavalle | ihrachys is wroking on it | 15:31 |
mlavalle | he has two WIP patchsets | 15:31 |
mlavalle | #link https://review.openstack.org/518988 | 15:32 |
mlavalle | #link https://review.openstack.org/518989 | 15:32 |
mlavalle | so I guess keep an eye on them | 15:32 |
mlavalle | and that's all I got | 15:33 |
mlavalle | any other bucgs from the team? | 15:33 |
haleyb | i have one | 15:33 |
haleyb | https://bugs.launchpad.net/neutron/+bug/1731595 | 15:33 |
openstack | Launchpad bug 1731595 in neutron "L3 HA: multiple agents are active at the same time" [High,In progress] - Assigned to venkata anil (anil-venkata) | 15:33 |
haleyb | anil has a patch that addresses the problem, just needs an update with a test | 15:34 |
mlavalle | is that the one where he has patgchset for master and stable branches? | 15:34 |
haleyb | mlavalle: yes, he proposed stable ones just to test, and make it easier to pick downstream for testing | 15:35 |
mlavalle | ok, cool, they are in my radar screen then | 15:35 |
haleyb | that's it from me | 15:36 |
mlavalle | ok thanks for the updates | 15:36 |
mlavalle | #topic Kick-ass DVR | 15:36 |
*** openstack changes topic to "Kick-ass DVR (Meeting topic: neutron_l3)" | 15:36 | |
davidsha | Thanks, I'm working on breaking out the roter_info_base file into a seperate patch atm | 15:37 |
davidsha | There are a few calls outside of the routers I'm looking into absorbing into the base router classes | 15:38 |
davidsha | An example of some are these calls: https://github.com/openstack/neutron/blob/master/neutron/agent/metadata/driver.py#L283-L324 | 15:38 |
Swami | mlavalle: haleyb: I need to drop off my son at school, so will signogg | 15:39 |
Swami | s/signogg/signoff | 15:39 |
mlavalle | Swami: go ahead, thanks for the updates :-) | 15:39 |
davidsha | Just as a general question, are these functions ok to move into router info base? | 15:39 |
haleyb | Swami: ok, thanks for the updates - jinx | 15:39 |
davidsha | Swami: cya! | 15:39 |
davidsha | By moving them into router_info, I'd hope that we could abstract out the use of iptables from the main l3-agent | 15:40 |
mlavalle | it seems worth exploring to me | 15:41 |
mlavalle | they are not even part of the meta driver per se | 15:42 |
haleyb | yeah, they are self-contained | 15:42 |
*** nikhil has joined #openstack-meeting-3 | 15:42 | |
*** rossella_s has quit IRC | 15:43 | |
davidsha | Kk, I'll try to have this patch up for review by next Friday. Are both of you ok with the idea of trying to abstract iptables calls into the routers and out of the Agent? | 15:44 |
mlavalle | well it seems to me that is an effort to start re-factoring code in prepration for adopting the openflow approach, while we fix our DVR mess | 15:45 |
mlavalle | under that assumption, yes | 15:45 |
haleyb | yes, it is fine with me | 15:45 |
*** stendulker_ has quit IRC | 15:46 | |
*** rossella_s has joined #openstack-meeting-3 | 15:46 | |
*** stendulker_ has joined #openstack-meeting-3 | 15:46 | |
davidsha | cool, thanks. thats all from me unless there are any questions? | 15:47 |
mlavalle | davidsha: none from me. Thanks for continuing with this. We are aware your priorities have been changing lately and highly appreciate the effort | 15:47 |
mlavalle | let's move on | 15:49 |
*** yamamoto has quit IRC | 15:49 | |
mlavalle | #topic QoS for floating ips | 15:49 |
*** openstack changes topic to "QoS for floating ips (Meeting topic: neutron_l3)" | 15:49 | |
mlavalle | The patchset for the server side merged yesterday. Thanks haleyb for the reviews :-) | 15:49 |
*** dtantsur has joined #openstack-meeting-3 | 15:50 | |
*** yamamoto has joined #openstack-meeting-3 | 15:50 | |
*** stendulker_ has quit IRC | 15:51 | |
mlavalle | The agent side is here: | 15:51 |
mlavalle | #link https://review.openstack.org/#/c/521079/ | 15:51 |
*** stendulker_ has joined #openstack-meeting-3 | 15:51 | |
mlavalle | and and seems ripe for reviews | 15:52 |
mlavalle | I am thinking we also need some docs, either added to this last patchset or in another one | 15:52 |
mlavalle | and the python openstackclient patch is here: | 15:53 |
mlavalle | #link https://review.openstack.org/#/c/517845/ | 15:53 |
*** elmiko has joined #openstack-meeting-3 | 15:54 | |
*** thingee has joined #openstack-meeting-3 | 15:54 | |
*** thingee has left #openstack-meeting-3 | 15:55 | |
*** thingee has joined #openstack-meeting-3 | 15:55 | |
mlavalle | ok, moving on | 15:55 |
mlavalle | #topic Open agenda | 15:55 |
*** openstack changes topic to "Open agenda (Meeting topic: neutron_l3)" | 15:55 | |
mlavalle | Does anyone have any toher topics to discuss today? | 15:55 |
*** cdent has joined #openstack-meeting-3 | 15:56 | |
mlavalle | I have one | 15:56 |
mlavalle | haleyb: I took a look at this review: https://review.openstack.org/#/c/516055/ | 15:56 |
mlavalle | it seems good to me. The question is, won't we break someone who is using the extension as it is today? | 15:57 |
haleyb | mlavalle: yes, i thought about that, but it seems they are maybe broken as-is, so perhaps noone is using it much? | 15:58 |
mlavalle | that was my thinking also but I wanted to check anyway | 15:58 |
mlavalle | I also think we need some sort of doc | 15:59 |
davidsha | Just before we run out of time! | 15:59 |
mlavalle | for the extension, because we have none now | 15:59 |
davidsha | I have one also, Someone has been assigned to take over the DVR patch, I'll ask him to try and join this meeting next week, but he is in China I believe, so it is late for them. | 15:59 |
mlavalle | davidsha: ok, thanks for the heads up | 15:59 |
cdent | (feel free to run over a bit, we api-sig people in no rush) | 15:59 |
mlavalle | cdent: I think we are done | 16:00 |
haleyb | mlavalle: doc the metering extension? sure | 16:00 |
* cdent WAVES AT MLAVALLE | 16:00 | |
mlavalle | #endmeeing | 16:00 |
*** rossella_s has quit IRC | 16:00 | |
* mlavalle waves back at cdent | 16:00 | |
* edleafe waves at mlavalle too | 16:00 | |
mlavalle | #endmeeting | 16:00 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings" | 16:00 | |
haleyb | :16 over | 16:00 |
openstack | Meeting ended Thu Nov 30 16:00:40 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:00 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_l3/2017/neutron_l3.2017-11-30-15.01.html | 16:00 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2017/neutron_l3.2017-11-30-15.01.txt | 16:00 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_l3/2017/neutron_l3.2017-11-30-15.01.log.html | 16:00 |
cdent | #startmeeting api-sig | 16:01 |
openstack | Meeting started Thu Nov 30 16:01:00 2017 UTC and is due to finish in 60 minutes. The chair is cdent. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:01 |
*** openstack changes topic to " (Meeting topic: api-sig)" | 16:01 | |
openstack | The meeting name has been set to 'api_sig' | 16:01 |
cdent | #chair edleafe elmiko dtantsur | 16:01 |
elmiko | heyo/ | 16:01 |
openstack | Current chairs: cdent dtantsur edleafe elmiko | 16:01 |
cdent | dtantsur: are you around today? | 16:01 |
edleafe | \o | 16:01 |
cdent | #link https://wiki.openstack.org/wiki/Meetings/API-SIG#Agenda | 16:01 |
dtantsur | o/ | 16:01 |
dtantsur | cdent: it feels so, but I'm not confident :) | 16:01 |
*** rossella_s has joined #openstack-meeting-3 | 16:01 | |
cdent | I know how that can be | 16:01 |
edleafe | likewise | 16:02 |
elmiko | hehe | 16:02 |
cdent | #link last log http://eavesdrop.openstack.org/meetings/api_sig/2017/api_sig.2017-11-16-16.00.html | 16:02 |
cdent | #topic old biz | 16:02 |
*** openstack changes topic to "old biz (Meeting topic: api-sig)" | 16:02 | |
cdent | I think it's been so long that any biz has died on the vine? | 16:02 |
elmiko | seems likely | 16:02 |
dtantsur | yeah, I cannot recall anything already | 16:03 |
cdent | right then | 16:03 |
cdent | #topic new biz | 16:03 |
*** openstack changes topic to "new biz (Meeting topic: api-sig)" | 16:03 | |
cdent | #link summit session etherpad https://etherpad.openstack.org/p/api-sig-sydney-forum | 16:03 |
cdent | anything we need to lift from that | 16:03 |
cdent | the main topic ended up being sdk related | 16:03 |
elmiko | interesting | 16:04 |
*** janzian has quit IRC | 16:04 | |
edleafe | has anyone heard anything from any SDK folk? | 16:04 |
cdent | sort of a "how to engage with sdk folk" | 16:04 |
cdent | since then? no | 16:04 |
cdent | but I think they, like us, have been travelling and turkeying &c | 16:04 |
elmiko | makes sense | 16:04 |
elmiko | would be nice to figure out how we can pull some of the sdk folks in closer | 16:05 |
*** davidsha has left #openstack-meeting-3 | 16:05 | |
cdent | At this stage of the game I don't think there's a specific action for us other than to continue to provide a place for people to talk | 16:05 |
elmiko | agreed | 16:05 |
cdent | and if they aren't talking yet, that's okay | 16:05 |
elmiko | yup | 16:05 |
cdent | dtantsur: did you ever find my email and if you di, did you decide about your availability? | 16:06 |
dtantsur | cdent: man sorry, I don't think I even looked for it :( | 16:06 |
cdent | well we can do it here? Would you like to be a core reviewer on the guidelines? (as in, do you have to continue doing what you were already doing, with slightly more time?) | 16:07 |
dtantsur | cdent: you did hit spam :) I'll gladly join you guys | 16:07 |
cdent | #startvote should dtantsur be a core, yes or no | 16:07 |
openstack | Unable to parse vote topic and options. | 16:07 |
cdent | omg | 16:07 |
cdent | #startvote should dtantsure be core? | 16:07 |
openstack | Begin voting on: should dtantsure be core? Valid vote options are Yes, No. | 16:07 |
openstack | Vote using '#vote OPTION'. Only your last vote counts. | 16:08 |
*** MarkBaker has quit IRC | 16:08 | |
cdent | undo | 16:08 |
elmiko | #vote yes | 16:08 |
edleafe | #vote YEs | 16:08 |
* cdent breaks everything | 16:08 | |
* edleafe expects nothing less from cdent | 16:08 | |
cdent | #vote yes | 16:08 |
cdent | #endvote | 16:08 |
openstack | Voted on "should dtantsure be core?" Results are | 16:08 |
* dtantsur votes meow - just for the sake of voting | 16:08 | |
cdent | well that went about as well as every other official thing we do | 16:08 |
cdent | welcome to the club | 16:08 |
edleafe | wow - lots of votes to tally | 16:08 |
cdent | #info dtantsur is core | 16:09 |
dtantsur | thanks :) | 16:09 |
cdent | #action cdent to update the gerrit stuff | 16:09 |
edleafe | Now for the initiation rites... | 16:09 |
cdent | THEY ARE SUPPOSED TO BE A SURPRISE | 16:09 |
elmiko | XD | 16:09 |
*** stendulker_ has quit IRC | 16:09 | |
* dtantsur gets ready to hide | 16:09 | |
cdent | any other new biz? | 16:09 |
* dtantsur looks at mordred | 16:10 | |
cdent | The only thing I've got is that I continue to maintain all my good intentions about writing additional guidelines and that summary/frontdoor thing I mentioned a while ago | 16:10 |
cdent | but so far they are all good intentions | 16:10 |
dtantsur | ++ a few good intentions here too | 16:11 |
dtantsur | well, we're in discussion on how to expose API versions in ironicclient in a saner fashion | 16:11 |
cdent | #topic guidelines | 16:11 |
*** openstack changes topic to "guidelines (Meeting topic: api-sig)" | 16:11 | |
edleafe | I have *lots* of good intentions | 16:11 |
dtantsur | this may end up in something readable | 16:11 |
cdent | undo | 16:11 |
cdent | #undo | 16:11 |
openstack | Removing item from minutes: #topic guidelines | 16:11 |
* cdent is at a standing desk, all my typing problems are multiplied | 16:11 | |
cdent | dtantsur: you mean so the client can express which version they want, or so that the version is inferred or what? | 16:12 |
cdent | I ask because that seems to be a big deal for the non-python SDKs (and for osc as well I guess) | 16:12 |
dtantsur | cdent: so, now the only thing you can do with ironicclient is to pass api_version into its __init__ | 16:12 |
dtantsur | which is a very lame way to use microversions, and it can easily lead to broken upgrades | 16:13 |
cdent | ah, indeed | 16:13 |
dtantsur | we want to expose some actual negotiation, make a caller be able to be flexible | 16:13 |
*** rossella_s has quit IRC | 16:13 | |
dtantsur | we have a few options of how precisely that could work | 16:13 |
dtantsur | and we have a real-world case: nova-ironic interaction | 16:13 |
mordred | yes - also to allow it to be per-call | 16:13 |
cdent | the emerging best practice is allow people to set a version on every request, _if_ they want to, based on what discovery/negotiation has revealed | 16:13 |
edleafe | dtantsur: sounds like a reasonable solution would be the __init__ value is the default used, but individual calls should be able to override | 16:14 |
dtantsur | well, yes, but there are still details :) | 16:14 |
mordred | yah. the keystoneauth options added a default_microversion to the __init__ - and then a microversion= argument to each request/get/post whatnot | 16:14 |
dtantsur | in our case this ^^^ will require rewriting half of ironicclient, I'm afraid.. | 16:14 |
dtantsur | but that's a side note | 16:14 |
mordred | havne't fully decided how to expose that in the openstacksdk object layer | 16:14 |
cdent | that ksa stuff is good soup | 16:15 |
dtantsur | I'm thinking of getting a guideline, explaining this with a real-world example in Python and *preferably* in some compiled language | 16:15 |
* dtantsur looks at his rust-openstack and sighs | 16:15 | |
cdent | :) | 16:15 |
mordred | dtantsur: well - we could discuss whether or not we can implement what you need in sdk more easier and switch nova to using that instead of python-ironicclient - but that's probably *way* out of scope here | 16:15 |
mordred | dtantsur: I'd love to work with you on both the guideline ... AND rust-openstack :) | 16:16 |
dtantsur | mordred: welcome - to both :) | 16:16 |
* cdent clones self | 16:16 | |
dtantsur | well, rust-openstack got to the stage of compiling AGAIN after the switch to newer HTTP library | 16:16 |
dtantsur | now, unit tests........... | 16:16 |
dtantsur | but that's kinda offtopic :) | 16:16 |
cdent | naw mate, we the api-sig now, nearly everything is on topioc | 16:17 |
dtantsur | hah, true | 16:17 |
elmiko | hehe | 16:17 |
edleafe | on tapioca? | 16:17 |
mordred | dtantsur: I keep wanting to do more rust - but the lack of an http library as good as requests is annoying | 16:17 |
elmiko | moar rust-openstack! \o/ | 16:17 |
dtantsur | mordred: they have something actually, it has a funny name like reqwest | 16:17 |
elmiko | edleafe: tapioca-openstack? | 16:17 |
cdent | neither tapioca nor bubble-tea are on topic and while I stand on this hill never will be | 16:18 |
dtantsur | but I use Hyper, it's more low level. and it got rewritten a few months ago essentialyl from scratch ._< | 16:18 |
dtantsur | mordred: https://docs.rs/reqwest/0.8.1/reqwest/ | 16:18 |
elmiko | cdent: lol | 16:19 |
dtantsur | anyway, we should team up with TheJulia and come up with something around this version negotiation topic | 16:19 |
cdent | +1 | 16:19 |
mordred | dtantsur: oh awesome! that wasn't there last time I looked | 16:19 |
* TheJulia appears and looks slightly confused | 16:20 | |
TheJulia | oh, that topic :( | 16:20 |
dtantsur | TheJulia: about having a guideline on dealing with api versions in SDKs like ironicclient | 16:20 |
edleafe | dtantsur: Reading that code with an Elmer Fudd voice | 16:20 |
dtantsur | heh | 16:20 |
TheJulia | edleafe: lol | 16:20 |
edleafe | http://www.barbneal.com/the-collection/looney-tunes/elmer-fudd/ | 16:21 |
mordred | dtantsur: fwiw, TheJulia just added some code to shade that consumes ironic microversion - but the shade story for microversion is likely different than the sdk version | 16:21 |
dtantsur | I suspect so, but worth checking. #link? | 16:21 |
*** shuyingy_ has quit IRC | 16:22 | |
*** MarkBaker has joined #openstack-meeting-3 | 16:22 | |
mordred | the shade pov is, I *think* that users should never know anything about a microversion, and as we add support to shade for more microversoins it should use the best available - and normalize the data model we return to include the various fields with None values if the cloud doesn't support the newer thing | 16:22 |
TheJulia | dtantsur: https://review.openstack.org/#/c/499774/ | 16:22 |
TheJulia | dtantsur: fwiw, I will be revising it later today to align with mordred POV which I agree with | 16:22 |
mordred | but shade is a higher-level do-things-for-you interface ... for the object layer in sdk, I imagine we'll need the ability for a user to request microversion specifics and do negotiation | 16:22 |
dtantsur | #link https://review.openstack.org/#/c/499774/ shade patch to implement microversions for ironic | 16:23 |
edleafe | #link https://review.openstack.org/#/c/499774/ | 16:23 |
mordred | that'll be... interesting ... because the object layer has resource objects that make calls behind the scenes for you ... | 16:23 |
dtantsur | mordred: I still cannot decide if I should make rust-openstack something like shade or something like clients.. | 16:23 |
mordred | cdent: you had a microversion-consumption-version-negotiation lib somewhere didn't you? | 16:23 |
edleafe | dtantsur: in my experience, SDK users generally want things to "just work" | 16:24 |
mordred | dtantsur: well.... I got some positive feedback from fokls in sydney about eh approach for the shade/sdk merge ... | 16:24 |
*** MarkBaker has quit IRC | 16:24 | |
dtantsur | that's where I'm leaning too | 16:24 |
mordred | which is that we'll have all three in the same thing - | 16:24 |
*** MarkBaker has joined #openstack-meeting-3 | 16:24 | |
cdent | mordred: server side header parsing, but it includes a handy Version class that might be of some use "microversion-parse" | 16:24 |
mordred | you get a Connectoin to the cloud-region | 16:24 |
dtantsur | esp. since I'm not ready to implement All The Things OpenStack in Rust myself | 16:24 |
cdent | there's some pending changes under review that ought to make it a bit more useful | 16:24 |
cdent | and it can happily grow to become whatever is required | 16:25 |
mordred | then from that you can do conn.list_servers() (shade version) conn.compute.servers() (sdk object layer) or conn.compute.get('/servers) (rest fallthrough on the compute endpoint) | 16:25 |
cdent | patches accepted etc | 16:25 |
mordred | so sdk should *always* be usable to talk to all the services in all the openstack clouds at at least the rest layer - and as objects are added or shade fancy functions are added, people can shift to them as they desire | 16:25 |
*** rossella_s has joined #openstack-meeting-3 | 16:26 | |
mordred | cdent: ah yes - cool - I remember that now | 16:26 |
dtantsur | mordred: that's.. an interesting approach, I like it. | 16:26 |
mordred | dtantsur: the second two parts of that above strategy work today in sdk master ... haven't combined the shade OpenStackCloud object and the Connection object just yet ... | 16:27 |
mordred | but that's mostly just code-reorg work rather than actually hard work | 16:27 |
cdent | that onion approach++ | 16:27 |
dtantsur | yeah | 16:27 |
dtantsur | and it can be developed gradually (still thinking about rust-openstack) | 16:28 |
dtantsur | start with list_servers(), keeping compute private until it's ready.. | 16:28 |
dtantsur | or the other way around - depends | 16:28 |
* dtantsur has food for thought now, thanks all | 16:28 | |
*** MarkBaker has quit IRC | 16:29 | |
cdent | Unless someone has something to say about them I think we can skip both the guidelines and bugs topics as they haven't seen any recent action (as explained above). | 16:30 |
cdent | #topic weekly newsletter | 16:30 |
cdent | #link https://etherpad.openstack.org/p/api-sig-newsletter | 16:30 |
*** openstack changes topic to "weekly newsletter (Meeting topic: api-sig)" | 16:30 | |
cdent | Any takers? I got time if nobody else is dying to do it. | 16:31 |
* cdent listens to the crickets | 16:31 | |
elmiko | i have more meetings after this, i'd be thankful for someone else doing it | 16:31 |
edleafe | Maybe dtantsur would like to give it a go? | 16:31 |
edleafe | Being all official and such | 16:32 |
cdent | I figured since in this one we'd be announcing his ascendancy it would be better if it were someone else. He's on the hook for next week. | 16:32 |
dtantsur | I'm avoiding that because of my English being not on the same level | 16:32 |
* cdent does it | 16:32 | |
edleafe | dtantsur: well, the rest of us review before sending it out | 16:32 |
cdent | I'll ping folk when it's ready for a look | 16:32 |
edleafe | but yeah, I get it | 16:32 |
elmiko | thanks cdent ! | 16:32 |
dtantsur | edleafe: nice, then it's not so painful :) | 16:32 |
cdent | Gonna switch puters though | 16:33 |
cdent | Thanks everyone for coming and the interesting discussion. | 16:33 |
cdent | #endmeeting | 16:33 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings" | 16:33 | |
openstack | Meeting ended Thu Nov 30 16:33:28 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:33 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/api_sig/2017/api_sig.2017-11-30-16.01.html | 16:33 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/api_sig/2017/api_sig.2017-11-30-16.01.txt | 16:33 |
openstack | Log: http://eavesdrop.openstack.org/meetings/api_sig/2017/api_sig.2017-11-30-16.01.log.html | 16:33 |
*** dtantsur has left #openstack-meeting-3 | 16:33 | |
*** cdent has left #openstack-meeting-3 | 16:33 | |
*** belmoreira has quit IRC | 16:37 | |
*** chyka has joined #openstack-meeting-3 | 16:39 | |
*** elmiko has left #openstack-meeting-3 | 16:41 | |
*** e0ne has quit IRC | 16:43 | |
*** MarkBaker has joined #openstack-meeting-3 | 16:51 | |
*** d0ugal has quit IRC | 16:55 | |
*** david-lyle has joined #openstack-meeting-3 | 16:59 | |
*** marios has quit IRC | 17:00 | |
*** iyamahat has quit IRC | 17:07 | |
*** pcaruana has quit IRC | 17:08 | |
*** yamahata has quit IRC | 17:08 | |
*** d0ugal has joined #openstack-meeting-3 | 17:08 | |
*** Swami has quit IRC | 17:12 | |
*** lhx_ has quit IRC | 17:13 | |
*** gauravsitlani has joined #openstack-meeting-3 | 17:16 | |
*** psachin has quit IRC | 17:18 | |
*** VW_ has joined #openstack-meeting-3 | 17:23 | |
*** VW has quit IRC | 17:23 | |
*** d0ugal has quit IRC | 17:24 | |
*** jlvacation is now known as jlvillal | 17:25 | |
*** rossella_s has quit IRC | 17:27 | |
*** tssurya_ has quit IRC | 17:31 | |
*** iyamahat has joined #openstack-meeting-3 | 17:33 | |
*** d0ugal has joined #openstack-meeting-3 | 17:35 | |
*** MarkBaker has quit IRC | 17:36 | |
*** rossella_s has joined #openstack-meeting-3 | 17:42 | |
*** yamahata has joined #openstack-meeting-3 | 17:51 | |
*** nikhil has quit IRC | 17:51 | |
*** cshastri has joined #openstack-meeting-3 | 17:51 | |
*** SumitNaiksatam has joined #openstack-meeting-3 | 17:53 | |
*** rkukura has joined #openstack-meeting-3 | 17:54 | |
SumitNaiksatam | rkukura: hi | 17:59 |
rkukura | hi SumitNaiksatam! | 17:59 |
SumitNaiksatam | rkukura: seems like just us two today | 18:01 |
*** absubram has quit IRC | 18:01 | |
SumitNaiksatam | perhaps should have sent a reminder email about the timing | 18:01 |
SumitNaiksatam | but dont have much of an agenda either | 18:01 |
rkukura | maybe an email before next week would help | 18:02 |
SumitNaiksatam | rkukura: yeah | 18:02 |
*** annakk has joined #openstack-meeting-3 | 18:02 | |
SumitNaiksatam | thought about it, but didnt want to hype it too much :-) | 18:02 |
SumitNaiksatam | ah annakk is here | 18:02 |
annakk | hi! | 18:02 |
SumitNaiksatam | annakk: hi | 18:02 |
SumitNaiksatam | #startmeeting networking_policy | 18:02 |
openstack | Meeting started Thu Nov 30 18:02:38 2017 UTC and is due to finish in 60 minutes. The chair is SumitNaiksatam. Information about MeetBot at http://wiki.debian.org/MeetBot. | 18:02 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 18:02 |
*** openstack changes topic to " (Meeting topic: networking_policy)" | 18:02 | |
openstack | The meeting name has been set to 'networking_policy' | 18:02 |
rkukura | hi annakk | 18:02 |
SumitNaiksatam | as I was mentioning to rkukura, I dont have much of an agenda for today except the “pike sync" | 18:03 |
SumitNaiksatam | but i thought it might be good to meet since we havent met for a few weeks for different reasons | 18:04 |
* mlavalle waves at rkukura and SumitNaiksatam | 18:04 | |
SumitNaiksatam | mlavalle: hi there! :-) | 18:04 |
rkukura | maybe we should discuss the stable/newton branch a bit too | 18:04 |
SumitNaiksatam | rkukura: sure | 18:04 |
SumitNaiksatam | #topic Pike Support | 18:04 |
rkukura | hi mlavalle! | 18:04 |
*** openstack changes topic to "Pike Support (Meeting topic: networking_policy)" | 18:04 | |
SumitNaiksatam | so we need at least one more reviewer on this: #link https://review.openstack.org/#/c/514864/ | 18:05 |
SumitNaiksatam | rkukura: thanks for your review | 18:05 |
rkukura | looks good | 18:05 |
SumitNaiksatam | (had fixed the devstack gate job prior to this, so it reflects in this patch as well) | 18:05 |
SumitNaiksatam | annakk: sorry, i might have missed your comment here | 18:05 |
annakk | I had one comment there but its not a must for sure | 18:06 |
SumitNaiksatam | i saw it before thanksgiving and have been on leave since | 18:06 |
SumitNaiksatam | totally forgot about it | 18:06 |
annakk | np :) | 18:06 |
annakk | I just thought it was preferrable to limit the hack to aim notifier only | 18:06 |
SumitNaiksatam | annakk: yes sure, i will respond to the comment | 18:07 |
rkukura | I’ll be ready to re-review | 18:07 |
SumitNaiksatam | and i can also do a follow up patch if required (i might not be able to get to this until monday) | 18:07 |
SumitNaiksatam | i was spending most of my time on this patch #link https://review.openstack.org/#/c/514864/ | 18:08 |
SumitNaiksatam | but the patchset is outdated | 18:08 |
SumitNaiksatam | i have lot more changes in my local repo which i should have posted | 18:08 |
rkukura | same patch? | 18:08 |
SumitNaiksatam | oh sorry | 18:09 |
SumitNaiksatam | #link https://review.openstack.org/#/c/518183/ | 18:09 |
SumitNaiksatam | basically i was stuck at a transactions issue | 18:09 |
*** cshastri has quit IRC | 18:10 | |
SumitNaiksatam | the new reader/wrtier calls in neutron were breaking the apic driver’s long transaction requirement | 18:10 |
SumitNaiksatam | had discussed with rkukura and tbachman offline before | 18:10 |
SumitNaiksatam | rkukura: thanks for the discussion | 18:11 |
rkukura | SumitNaiksatam: Is this an issue for the apic_aim MD, or just the aim_mapping PD? | 18:11 |
SumitNaiksatam | so it seems like nesting the reader/writer calls will preserve the session | 18:11 |
annakk | is this a new issue? sounds like a deja vu | 18:11 |
SumitNaiksatam | starts with apic_aim MD | 18:11 |
SumitNaiksatam | rkukura: ^^^ | 18:12 |
SumitNaiksatam | and of course for the aim_mapping as well | 18:12 |
rkukura | SumitNaiksatam: was wondering if the problem surfaces in the apic_aim MD UTs? | 18:12 |
SumitNaiksatam | annakk: the issue is now, the usage of reader/writer is not new | 18:12 |
SumitNaiksatam | rkukura: yes, those are the ones i was trying to fix all along | 18:13 |
SumitNaiksatam | so anyway, the nesting seems to work, what was throwing me off was another bug in neutron (in the extend dict part) | 18:13 |
SumitNaiksatam | we will still have to patch the reader/writer part for attaching the notification queue to the session (like before) | 18:14 |
SumitNaiksatam | and for that i am trying to figure out how to get it to work with the context manager | 18:14 |
annakk | the extend dict was handled in ocata as well (subnet pools and address scopes) | 18:15 |
SumitNaiksatam | annakk: yes, but there was a commit made in neutron which moved the extend_dict call to a different point (essentially before post_commit is called) | 18:15 |
annakk | oh | 18:15 |
SumitNaiksatam | annakk: and because of that we were never seeing resources extended | 18:16 |
rkukura | SumitNaiksatam: Is it called within the transaction now? | 18:16 |
SumitNaiksatam | rkukura: no | 18:16 |
rkukura | That’s too bad | 18:16 |
SumitNaiksatam | rkukura: i had meant to sent you the commit last week, somehow slipped my mind | 18:16 |
SumitNaiksatam | by commit, i mean the patch where this change happened | 18:17 |
rkukura | I’d like to see it | 18:17 |
SumitNaiksatam | i cant seem to find it now | 18:17 |
SumitNaiksatam | it was a patch dealing with MTU setting i think | 18:17 |
rkukura | later is fine | 18:17 |
SumitNaiksatam | rkukura: to fix that would require a small monkey patch in GBP | 18:18 |
SumitNaiksatam | but having done all that, the UT seemed to pass in my local env | 18:19 |
rkukura | ok, but maybe there is a reason for the change in Neutron | 18:19 |
SumitNaiksatam | so that was some progress as opposed to what seemed a bit of a hopeless situation with regards to dealing with the transactions (when i last spoke to rkukura) | 18:19 |
SumitNaiksatam | rkukura: yes, i think for that particular resource they needed it that way | 18:19 |
SumitNaiksatam | rkukura: they might have not hit the side effects since other resources might not be using the extension | 18:20 |
SumitNaiksatam | rkukura: but anyway, you can take look at it and let me know what you think | 18:20 |
rkukura | sure | 18:20 |
rkukura | I’ve always felt extend_dict should be done just before the transaction commits to ensure that the results returned to the client reflect the state commited by the operation | 18:21 |
SumitNaiksatam | rkukura: agree | 18:22 |
SumitNaiksatam | i was down to some 200 UT failures and most seemed to be related to this transaction issue | 18:22 |
*** diablo_rojo has joined #openstack-meeting-3 | 18:22 | |
SumitNaiksatam | i hope there is no other issue lurking | 18:22 |
SumitNaiksatam | this was just the UT, so we would still need to update the devstack job to see if everything works properly | 18:23 |
*** thingee has left #openstack-meeting-3 | 18:23 | |
SumitNaiksatam | *UTs | 18:23 |
rkukura | so did this reduce below 200 failures with the extend_dict monkey patch? | 18:23 |
rkukura | or was it 200 failures with the monkey patch? | 18:23 |
SumitNaiksatam | rkukura: no no, the 200 UT failures is prior to all the discussion above | 18:24 |
rkukura | ok, great! | 18:24 |
SumitNaiksatam | all what i discussed above is not in the lastes patchset posted | 18:24 |
SumitNaiksatam | and apologies, i should have posted that patchset like a week back | 18:24 |
SumitNaiksatam | i had too many debugs all over the place and didnt get a chance to clean them | 18:25 |
SumitNaiksatam | anywat | 18:25 |
SumitNaiksatam | annakk: rkukura anything more to discuss on Pike? | 18:25 |
annakk | not from me.. | 18:25 |
rkukura | nothing from me | 18:25 |
SumitNaiksatam | once the UTs pass, perhaps if anyone has time, we can split work and knock off updating the gate jobs in parallel | 18:26 |
SumitNaiksatam | rkukura: we would need to create temp branches for the apic repos | 18:26 |
SumitNaiksatam | rkukura: hopefully we dont have to do much code updates | 18:26 |
SumitNaiksatam | will need to discuss with tbachman | 18:26 |
rkukura | right | 18:27 |
SumitNaiksatam | so far i was just running against the master of those branches and the UTs seemed to be okay | 18:27 |
SumitNaiksatam | but we should at least have place holder branches | 18:27 |
annakk | I hope to be able to take some, but in a while cause next week I'm on PTO | 18:27 |
SumitNaiksatam | nsx is great in that regard since they have long had the pike branches :-) | 18:27 |
rkukura | I think we use AIM master for all GBP branches, don’t we? | 18:27 |
SumitNaiksatam | annakk: np | 18:28 |
SumitNaiksatam | rkukura: will need to go back and check (aim does use some oslo libs) | 18:28 |
rkukura | agreed we need to check | 18:28 |
SumitNaiksatam | #topic Newton branches | 18:29 |
*** openstack changes topic to "Newton branches (Meeting topic: networking_policy)" | 18:29 | |
SumitNaiksatam | rkukura: go ahead | 18:29 |
rkukura | I back-ported an AIM-related fix to stable/newton recently, and noticed only a small subset of the UTs run. I understand this is done because the number of cores for stable/newton jobs has been reduced. | 18:30 |
SumitNaiksatam | rkukura: yes, we went through several iterations on this, and eseentially gave up! | 18:30 |
rkukura | So I tried restoring the full set (we had already eliminated a lot of redundant Neutron UTs from ml2plus) | 18:30 |
SumitNaiksatam | since the branch is eol’ed upstream | 18:31 |
rkukura | Right. That stlll timed out. | 18:31 |
SumitNaiksatam | rkukura: right | 18:31 |
rkukura | So I tried running the full set locally. I ran into some failures with my branch, then eventually tried running the full set locally on stable/newton without my branch. | 18:32 |
rkukura | This also hit some failures. | 18:32 |
rkukura | So I think stable/newton may already be in a somewhat broken state. | 18:32 |
SumitNaiksatam | rkukura: i think there is an ordering issue | 18:32 |
rkukura | Right, pretty much any small group of tests would run fine in isolation. | 18:32 |
SumitNaiksatam | which gets exposed when we run subsets, or in local environments | 18:32 |
rkukura | I think the schema loading and table clearing stuff isn’t exactly right. | 18:33 |
SumitNaiksatam | i think the config gets carried over to tests | 18:33 |
SumitNaiksatam | rkukura: yes, that too | 18:33 |
SumitNaiksatam | i think i ran into this in the pike prep branch | 18:33 |
rkukura | I cleaned that up with regards to the AIM schema by adding a new AimSqlFixture | 18:33 |
SumitNaiksatam | rkukura: yes, that was great | 18:33 |
rkukura | And I spent some time trying to cleanup the way we handle the GBP schema, which uses Neutrons base class, and therefore needs to be handled via Neutron’s StaticSqlFixture | 18:34 |
rkukura | But getting this to work properly requires some work… | 18:35 |
rkukura | I think we need to elminate all of the non-fixture schema loading and table clearing code | 18:35 |
SumitNaiksatam | rkukura: yeah, and the problem is that its pretty to challenging to validate this in the upstream gate (for newton) | 18:35 |
rkukura | And we also need to ensure that the entire GBP schema is visible in every single test module | 18:35 |
SumitNaiksatam | rkukura: sure | 18:36 |
rkukura | So I think we should add a new models.py into GBP that imports all the DB model files that use Neutron’s ModelBase. | 18:36 |
SumitNaiksatam | rkukura: the assumption is that it is currently visible in all the tests that need it | 18:36 |
SumitNaiksatam | rkukura: okay | 18:37 |
rkukura | I think some of the tests don’t import model files that are not needed for that test modules, which means subsequent tests run by the same process fail later | 18:37 |
SumitNaiksatam | rkukura: okay | 18:37 |
rkukura | Just wanted to see if you all thought this analysis made sense | 18:38 |
SumitNaiksatam | we do the explicit create_tables thing, which is for sure a red flag, and should not be required if we use the fixtures properly, i guess | 18:38 |
rkukura | and if its worth trying to clean it up on master, then backport it to all our active branches | 18:38 |
SumitNaiksatam | rkukura: per my comment above, the only hole in my understanding is the use of the sql fixture, i thought using that correctly would fix this problem | 18:39 |
rkukura | SumitNaiksatam: My conclusion is that Neutron’s StaticSqlFixture should work properly as long as all the GBP repo’s models that use Neutron’s ModelBase are imported in every test module | 18:39 |
SumitNaiksatam | rkukura: ah, was just saying that, perhaps the import is required in addition to get it to work | 18:40 |
rkukura | I think its a combo of not going around the fixture, and making sure the fixture always loads the entire schema for all tests | 18:40 |
SumitNaiksatam | rkukura: yeah, nice explanation, it makes sense to me | 18:40 |
rkukura | annakk: make sense to you? | 18:40 |
annakk | I need to catch up on this, sorry :) | 18:41 |
rkukura | no problem | 18:41 |
rkukura | Anyway, if it does make sense, I’ll start a new branch and try to get it working | 18:41 |
SumitNaiksatam | rkukura: sounds good to me | 18:42 |
SumitNaiksatam | annakk: its a little difficult to follow this discussion without enough context | 18:42 |
rkukura | SumitNaiksatam: Did you say this may be currently an issue for the pike sync? | 18:42 |
annakk | yeah I noticed the cleanup was weird, but never got to the bottom of it | 18:42 |
*** absubram has joined #openstack-meeting-3 | 18:43 | |
SumitNaiksatam | rkukura: i made some spot fixes which eliminated issues with configs not getting loaded correctly (previously it worked since the test were running in a different order in the gate, i guess) | 18:43 |
SumitNaiksatam | rkukura: so, so far not a blocker for pike sync | 18:44 |
SumitNaiksatam | but i can only say with confidence if can get the whole suite to pass :-) | 18:44 |
rkukura | SumitNaiksatam: OK. If there are fixes related to UT ordering, it would be ideal to back-port those to the older branches | 18:44 |
SumitNaiksatam | rkukura: okay | 18:44 |
SumitNaiksatam | we might have to cherry-pick only part of the change | 18:45 |
rkukura | sure | 18:45 |
rkukura | the other thing with stable/newton... | 18:45 |
rkukura | It seems to me that if infra reduces the number of CPU cores allocated, they should correspondingly increase the overall job timeout. | 18:46 |
SumitNaiksatam | rkukura: right, that is the source of the timeout | 18:46 |
SumitNaiksatam | sorry, i missed your “if” | 18:47 |
rkukura | s/if/when/ | 18:47 |
SumitNaiksatam | rkukura: well, based on my observation, that definitely did not happen | 18:47 |
rkukura | what’s the process to request such a change from infra? | 18:48 |
SumitNaiksatam | rkukura: i think this can be controlled from our gate job | 18:48 |
rkukura | really? | 18:48 |
SumitNaiksatam | i mean, not from our repo | 18:48 |
SumitNaiksatam | but from our definittion of the gate job in the openstack-infra | 18:48 |
rkukura | Do we propose a change in gerrit to do that? | 18:49 |
SumitNaiksatam | but i wasnt comforable even doing that before we put our house in order | 18:49 |
SumitNaiksatam | rkukura: yes, but i dont know what is that exact config | 18:49 |
rkukura | Any particular part of our house? | 18:49 |
SumitNaiksatam | i believe it would go into the zuul def in project-config repo | 18:49 |
SumitNaiksatam | rkukura: well we did a part of that by eliminating some UTs | 18:50 |
SumitNaiksatam | some of our UTs run for 90 seconds or so | 18:50 |
*** pcaruana has joined #openstack-meeting-3 | 18:50 | |
rkukura | We control the timeout for individual UTs in our own repo, so I don’t see that as an issue | 18:50 |
*** slaweq has joined #openstack-meeting-3 | 18:51 | |
SumitNaiksatam | in general, if you see much bigger projects like neutron, their py27 jobs still finish in about 20 mins | 18:51 |
SumitNaiksatam | so we are doing more than unit testing :-) | 18:51 |
rkukura | we are better off with fewer long-running UTs that having many UTs duplicate the same work to get setup | 18:51 |
rkukura | right | 18:51 |
SumitNaiksatam | rkukura: i agree that the philosophy makes more sense for GBP | 18:51 |
rkukura | but I don’t see us changing that anytime soon | 18:51 |
SumitNaiksatam | rkukura: yes | 18:52 |
SumitNaiksatam | and hence my predicament in going to infra :-) | 18:52 |
SumitNaiksatam | *going to infra -> approaching the infra team earlier | 18:52 |
SumitNaiksatam | also trying to make this case for an eol’ed branch seemed like a tough proposition to begin with | 18:53 |
rkukura | If we just proposed a patch to an infra repo to increase the stable/newton py27 job timeout, explaining that its needed due to fewer cores being allocated, do you think they would reject it? | 18:53 |
annakk | can we split the UT to several jobs? | 18:53 |
SumitNaiksatam | annakk: yes, that is possible, and its a nice novel idea | 18:53 |
*** slaweq has quit IRC | 18:53 | |
rkukura | Seems restructuring UTs is not something that should even be back-ported to a stable branch, let alone for an EOL branch | 18:54 |
SumitNaiksatam | rkukura: agree | 18:54 |
*** slaweq has joined #openstack-meeting-3 | 18:54 | |
SumitNaiksatam | annakk: but i dont think we would be able to do that for newton branch | 18:54 |
rkukura | So we could promise to work to improve things on our master, while asking for the change on the EOL stable jobs | 18:54 |
SumitNaiksatam | rkukura: one option is taht we enumerate the tests that we want to run | 18:55 |
SumitNaiksatam | rkukura: possible | 18:55 |
rkukura | was wondering if we could specify a regex or list in testr.conf | 18:55 |
SumitNaiksatam | rkukura: unfortunately not regex | 18:55 |
rkukura | that’s what I concluded too | 18:55 |
SumitNaiksatam | you can either give a directory starting point for discovery | 18:55 |
SumitNaiksatam | or provide a list | 18:56 |
SumitNaiksatam | i havent tried the later, but based on documentation it should be doable | 18:56 |
*** gauravsitlani has quit IRC | 18:56 | |
rkukura | when running tox manually, you can use a regex on the command line I think, which matches a subset of those discovered | 18:56 |
*** gauravsitlani has joined #openstack-meeting-3 | 18:56 | |
rkukura | wonder if we can change the job to do that? | 18:56 |
SumitNaiksatam | rkukura: ah, i did not try that, but good point | 18:56 |
SumitNaiksatam | rkukura: we might have to completely define a new py27 job | 18:57 |
annakk | I think regex worked for me | 18:57 |
SumitNaiksatam | annakk: nice | 18:57 |
SumitNaiksatam | rkukura: we currently use the standard py27 job definition | 18:58 |
SumitNaiksatam | anyway, we are hitting the hour | 18:58 |
rkukura | I’ve never looked at how these jobs are defined | 18:58 |
SumitNaiksatam | rkukura: i can send you a pointer | 18:58 |
rkukura | that’s all from me on stable/newton | 18:58 |
SumitNaiksatam | rkukura: thanks | 18:58 |
*** slaweq has quit IRC | 18:58 | |
SumitNaiksatam | annakk: anything more for today? | 18:59 |
SumitNaiksatam | annakk: great to read that you enjoyed Sydney! :-) | 18:59 |
annakk | no | 18:59 |
annakk | :) | 18:59 |
SumitNaiksatam | was planning to put your retrospective on the agenda that following week but we missed the meeting | 18:59 |
SumitNaiksatam | thanks for your email though! | 18:59 |
SumitNaiksatam | alrighty thanks rkukura and annakk for joining! | 18:59 |
SumitNaiksatam | bye! | 18:59 |
rkukura | thanks! | 18:59 |
SumitNaiksatam | #endmeeting | 19:00 |
annakk | thanks, bye! | 19:00 |
rkukura | bye | 19:00 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings" | 19:00 | |
openstack | Meeting ended Thu Nov 30 19:00:00 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:00 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/networking_policy/2017/networking_policy.2017-11-30-18.02.html | 19:00 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/networking_policy/2017/networking_policy.2017-11-30-18.02.txt | 19:00 |
openstack | Log: http://eavesdrop.openstack.org/meetings/networking_policy/2017/networking_policy.2017-11-30-18.02.log.html | 19:00 |
*** annakk has quit IRC | 19:00 | |
*** rkukura has left #openstack-meeting-3 | 19:00 | |
*** SumitNaiksatam has quit IRC | 20:00 | |
*** shuyingya has joined #openstack-meeting-3 | 20:05 | |
*** shuyingya has quit IRC | 20:09 | |
*** gauravsitlani has quit IRC | 20:10 | |
*** mguiney has quit IRC | 20:10 | |
*** mguiney has joined #openstack-meeting-3 | 20:11 | |
*** VW_ has quit IRC | 20:11 | |
*** VW has joined #openstack-meeting-3 | 20:12 | |
*** slaweq has joined #openstack-meeting-3 | 20:32 | |
*** slaweq has quit IRC | 20:34 | |
*** slaweq has joined #openstack-meeting-3 | 20:34 | |
*** e0ne has joined #openstack-meeting-3 | 20:39 | |
*** lyan has quit IRC | 20:42 | |
*** lyan has joined #openstack-meeting-3 | 20:47 | |
*** pcaruana has quit IRC | 20:55 | |
*** e0ne has quit IRC | 20:58 | |
*** shuyingya has joined #openstack-meeting-3 | 21:00 | |
*** shuyingya has quit IRC | 21:04 | |
*** raildo has quit IRC | 21:12 | |
*** ccamacho has quit IRC | 21:21 | |
*** pcaruana has joined #openstack-meeting-3 | 21:24 | |
*** lyan has quit IRC | 21:36 | |
*** pcaruana has quit IRC | 21:39 | |
*** mlavalle has left #openstack-meeting-3 | 21:53 | |
*** julim has joined #openstack-meeting-3 | 21:59 | |
*** julim has quit IRC | 22:02 | |
*** julim has joined #openstack-meeting-3 | 22:08 | |
*** marst has quit IRC | 22:19 | |
*** shuyingya has joined #openstack-meeting-3 | 22:35 | |
*** VW has quit IRC | 22:35 | |
*** shuyingya has quit IRC | 22:39 | |
*** VW has joined #openstack-meeting-3 | 22:49 | |
*** etingof has quit IRC | 22:53 | |
*** bobh has quit IRC | 23:01 | |
*** slaweq has quit IRC | 23:02 | |
*** kei-ichi has quit IRC | 23:02 | |
*** slaweq has joined #openstack-meeting-3 | 23:02 | |
*** kei-ichi has joined #openstack-meeting-3 | 23:04 | |
*** slaweq has quit IRC | 23:07 | |
*** VW has quit IRC | 23:20 | |
*** iyamahat_ has joined #openstack-meeting-3 | 23:22 | |
*** iyamahat has quit IRC | 23:22 | |
*** bnemec has quit IRC | 23:22 | |
*** pbourke has quit IRC | 23:28 | |
*** pbourke has joined #openstack-meeting-3 | 23:30 | |
*** MarkBaker has joined #openstack-meeting-3 | 23:32 | |
*** salv-orlando has quit IRC | 23:41 | |
*** ywat has joined #openstack-meeting-3 | 23:48 | |
*** MarkBaker has quit IRC | 23:54 | |
*** etingof has joined #openstack-meeting-3 | 23:59 | |
*** chyka_ has joined #openstack-meeting-3 | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!