| *** namnh has joined #openstack-nova | 00:00 | |
| *** namnh has quit IRC | 00:00 | |
| *** esberglu has quit IRC | 00:01 | |
| *** ijw has quit IRC | 00:03 | |
| *** tbachman has quit IRC | 00:05 | |
| *** gjayavelu has quit IRC | 00:09 | |
| *** tbachman has joined #openstack-nova | 00:10 | |
| *** flanders_ has quit IRC | 00:11 | |
| *** gjayavelu has joined #openstack-nova | 00:12 | |
| *** tbachman has quit IRC | 00:15 | |
| *** tbachman has joined #openstack-nova | 00:17 | |
| *** jmlowe has quit IRC | 00:19 | |
| *** yingjun has joined #openstack-nova | 00:19 | |
| *** yikun has quit IRC | 00:20 | |
| *** yikun_ is now known as yikun | 00:20 | |
| *** smatzek has joined #openstack-nova | 00:20 | |
| *** liusheng has quit IRC | 00:23 | |
| *** smatzek has quit IRC | 00:25 | |
| *** tbachman_ has joined #openstack-nova | 00:26 | |
| *** tbachman has quit IRC | 00:27 | |
| *** tbachman_ is now known as tbachman | 00:27 | |
| *** gjayavelu has quit IRC | 00:27 | |
| *** andreas_s has joined #openstack-nova | 00:28 | |
| *** gjayavelu has joined #openstack-nova | 00:28 | |
| -openstackstatus- NOTICE: due to unscheduled restart of zuulv3.o.o you will need to 'recheck' your jobs that were last running. Sorry for the inconvenience. | 00:32 | |
| *** psachin has joined #openstack-nova | 00:32 | |
| *** yikun_jiang has joined #openstack-nova | 00:34 | |
| *** liusheng has joined #openstack-nova | 00:34 | |
| *** Apoorva has quit IRC | 00:35 | |
| mriedem | yikun_jiang: did you see the updates to https://review.openstack.org/#/c/506030/ ? | 00:35 |
|---|---|---|
| *** andreas_s has quit IRC | 00:37 | |
| *** xinliang has quit IRC | 00:37 | |
| *** suresh12 has quit IRC | 00:40 | |
| *** cjvolzka has quit IRC | 00:43 | |
| *** isq has quit IRC | 00:45 | |
| *** isq has joined #openstack-nova | 00:45 | |
| *** ijw has joined #openstack-nova | 00:45 | |
| *** salv-orlando has joined #openstack-nova | 00:48 | |
| *** xinliang has joined #openstack-nova | 00:50 | |
| *** yangyapeng has quit IRC | 00:51 | |
| *** yangyapeng has joined #openstack-nova | 00:51 | |
| *** salv-orlando has quit IRC | 00:52 | |
| *** suresh12 has joined #openstack-nova | 00:53 | |
| *** markvoelker_ has quit IRC | 00:53 | |
| *** markvoelker has joined #openstack-nova | 00:54 | |
| *** TuanLA has joined #openstack-nova | 00:54 | |
| *** andreas_s has joined #openstack-nova | 00:55 | |
| *** yangyapeng has quit IRC | 00:56 | |
| *** thorst has joined #openstack-nova | 00:57 | |
| *** markvoelker has quit IRC | 00:58 | |
| *** smatzek has joined #openstack-nova | 01:02 | |
| *** thorst has quit IRC | 01:02 | |
| *** thorst has joined #openstack-nova | 01:03 | |
| *** andreas_s has quit IRC | 01:04 | |
| *** andreas_s has joined #openstack-nova | 01:04 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova-specs master: Add pagination and changes since filter support for os-instance-action API https://review.openstack.org/507762 | 01:04 |
| *** huanxie has joined #openstack-nova | 01:05 | |
| *** thorst has quit IRC | 01:08 | |
| Kevin_Zheng | mriedem hi, for https://review.openstack.org/#/c/509326/ | 01:09 |
| Kevin_Zheng | I was thinking adding a config option will let the operator to choose from 1. improved performance and 2. regex matching | 01:11 |
| Kevin_Zheng | if the neutron is old | 01:11 |
| mriedem | Kevin_Zheng: we don't really want config-driven API behavior | 01:11 |
| *** phuongnh has joined #openstack-nova | 01:11 | |
| mriedem | if neutron has the new regex filtering support, we use it, else we fallback to what we do today | 01:12 |
| Kevin_Zheng | OK, that's also good, I was just adding it for discussion | 01:12 |
| mriedem | if someone really really needed to both filter by IPs and list deleted instances, they could still do that client side if necessary | 01:12 |
| *** andreas_s has quit IRC | 01:13 | |
| Kevin_Zheng | understood | 01:13 |
| *** crushil has quit IRC | 01:19 | |
| *** mriedem has quit IRC | 01:20 | |
| *** AlexeyAbashkin has joined #openstack-nova | 01:23 | |
| *** smatzek has quit IRC | 01:25 | |
| *** smatzek has joined #openstack-nova | 01:26 | |
| *** yamahata has quit IRC | 01:27 | |
| *** andreas_s has joined #openstack-nova | 01:27 | |
| *** AlexeyAbashkin has quit IRC | 01:27 | |
| *** gjayavelu has quit IRC | 01:28 | |
| *** ijw has quit IRC | 01:30 | |
| *** suresh12 has quit IRC | 01:33 | |
| *** suresh12 has joined #openstack-nova | 01:42 | |
| *** yikun has quit IRC | 01:45 | |
| *** suresh12 has quit IRC | 01:46 | |
| *** yangyapeng has joined #openstack-nova | 01:48 | |
| *** salv-orlando has joined #openstack-nova | 01:48 | |
| *** yangyape_ has joined #openstack-nova | 01:49 | |
| *** andreas_s has quit IRC | 01:50 | |
| *** smatzek has quit IRC | 01:50 | |
| *** yangyapeng has quit IRC | 01:52 | |
| *** salv-orlando has quit IRC | 01:53 | |
| *** hongbin has joined #openstack-nova | 01:54 | |
| *** yamamoto has joined #openstack-nova | 01:56 | |
| *** andreas_s has joined #openstack-nova | 01:59 | |
| *** abhi89 has quit IRC | 02:00 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Refactor placement version check https://review.openstack.org/512497 | 02:01 |
| openstackgerrit | jichenjc proposed openstack/nova master: mv generate_glance_url to get_image_endpoint_url https://review.openstack.org/511400 | 02:01 |
| openstackgerrit | jichenjc proposed openstack/nova master: Remove duplicate error info https://review.openstack.org/510719 | 02:02 |
| *** thorst has joined #openstack-nova | 02:03 | |
| *** takashin has quit IRC | 02:04 | |
| *** andreas_s has quit IRC | 02:07 | |
| *** andreas_s has joined #openstack-nova | 02:08 | |
| *** thorst has quit IRC | 02:08 | |
| *** hemna_ has quit IRC | 02:09 | |
| *** huanxie has quit IRC | 02:09 | |
| *** huanxie has joined #openstack-nova | 02:10 | |
| *** suresh12 has joined #openstack-nova | 02:10 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Add description for reousrce class creation https://review.openstack.org/508083 | 02:14 |
| *** suresh12 has quit IRC | 02:15 | |
| *** gjayavelu has joined #openstack-nova | 02:15 | |
| *** andreas_s has quit IRC | 02:17 | |
| *** vladikr has joined #openstack-nova | 02:17 | |
| *** takashin has joined #openstack-nova | 02:17 | |
| *** Shunli has joined #openstack-nova | 02:18 | |
| *** andreas_s has joined #openstack-nova | 02:22 | |
| *** AlexeyAbashkin has joined #openstack-nova | 02:23 | |
| *** vladikr has quit IRC | 02:27 | |
| *** AlexeyAbashkin has quit IRC | 02:27 | |
| *** vladikr has joined #openstack-nova | 02:27 | |
| openstackgerrit | Huan Xie proposed openstack/nova master: VGPU: Define vgpu resource class https://review.openstack.org/511180 | 02:28 |
| *** pramodrj07 has quit IRC | 02:29 | |
| *** MasterOfBugs has quit IRC | 02:29 | |
| *** andreas_s has quit IRC | 02:30 | |
| openstackgerrit | Hironori Shiina proposed openstack/nova-specs master: Ironic: Resize and cold migration support https://review.openstack.org/449155 | 02:32 |
| *** gouthamr has joined #openstack-nova | 02:32 | |
| *** huanxie has quit IRC | 02:42 | |
| *** gouthamr has quit IRC | 02:42 | |
| *** gouthamr has joined #openstack-nova | 02:43 | |
| *** dave-mccowan has quit IRC | 02:44 | |
| openstackgerrit | Huan Xie proposed openstack/nova master: VGPU: Define vgpu resource class https://review.openstack.org/511180 | 02:44 |
| *** hieulq has quit IRC | 02:47 | |
| *** TuanLA has quit IRC | 02:47 | |
| *** yamahata has joined #openstack-nova | 02:47 | |
| openstackgerrit | jichenjc proposed openstack/nova master: fix race condition of instance host https://review.openstack.org/494458 | 02:47 |
| *** hieulq has joined #openstack-nova | 02:48 | |
| *** TuanLA has joined #openstack-nova | 02:48 | |
| *** dave-mccowan has joined #openstack-nova | 02:48 | |
| *** salv-orlando has joined #openstack-nova | 02:50 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova-specs master: Add pagination and timestamp filtering support for os-migrations API https://review.openstack.org/506030 | 02:51 |
| *** nicolasbock has quit IRC | 02:53 | |
| *** salv-orlando has quit IRC | 02:54 | |
| *** tbachman has quit IRC | 02:55 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Add create inventories doc for placement https://review.openstack.org/512215 | 02:55 |
| openstackgerrit | jichenjc proposed openstack/nova master: check query param for server groups function https://review.openstack.org/500347 | 02:56 |
| *** TuanLA has quit IRC | 02:56 | |
| *** hieulq has quit IRC | 02:56 | |
| *** TuanLA has joined #openstack-nova | 02:57 | |
| *** tbachman has joined #openstack-nova | 02:57 | |
| *** hieulq has joined #openstack-nova | 02:57 | |
| *** phuongnh has quit IRC | 03:01 | |
| *** andreas_s has joined #openstack-nova | 03:02 | |
| *** phuongnh has joined #openstack-nova | 03:03 | |
| *** thorst has joined #openstack-nova | 03:04 | |
| *** vladikr has quit IRC | 03:07 | |
| *** vladikr has joined #openstack-nova | 03:07 | |
| *** thorst has quit IRC | 03:09 | |
| *** andreas_s has quit IRC | 03:11 | |
| *** andreas_s has joined #openstack-nova | 03:12 | |
| *** jmlowe has joined #openstack-nova | 03:12 | |
| *** gjayavelu has quit IRC | 03:17 | |
| *** andreas_s has quit IRC | 03:20 | |
| *** openstackgerrit has quit IRC | 03:22 | |
| *** AlexeyAbashkin has joined #openstack-nova | 03:23 | |
| *** AlexeyAbashkin has quit IRC | 03:27 | |
| *** huanxie has joined #openstack-nova | 03:27 | |
| *** liusheng has quit IRC | 03:28 | |
| *** liusheng has joined #openstack-nova | 03:29 | |
| *** pratapagoutham has quit IRC | 03:31 | |
| *** shewless has quit IRC | 03:31 | |
| *** ijw has joined #openstack-nova | 03:31 | |
| *** mdnadeem has joined #openstack-nova | 03:36 | |
| *** yamamoto_ has joined #openstack-nova | 03:39 | |
| *** hongbin has quit IRC | 03:40 | |
| *** andreas_s has joined #openstack-nova | 03:41 | |
| *** yamamoto has quit IRC | 03:42 | |
| *** andreas_s has quit IRC | 03:45 | |
| *** links has joined #openstack-nova | 03:45 | |
| *** salv-orlando has joined #openstack-nova | 03:50 | |
| *** smatzek has joined #openstack-nova | 03:51 | |
| *** salv-orlando has quit IRC | 03:55 | |
| *** smatzek has quit IRC | 03:55 | |
| *** huanxie has quit IRC | 03:58 | |
| *** gongysh has joined #openstack-nova | 04:02 | |
| *** Jeffrey4l has quit IRC | 04:02 | |
| *** Jeffrey4l has joined #openstack-nova | 04:03 | |
| *** chyka has joined #openstack-nova | 04:06 | |
| *** udesale has joined #openstack-nova | 04:09 | |
| *** chyka has quit IRC | 04:10 | |
| *** claudiub has joined #openstack-nova | 04:11 | |
| *** udesale has quit IRC | 04:14 | |
| *** udesale has joined #openstack-nova | 04:15 | |
| *** hshiina has joined #openstack-nova | 04:23 | |
| *** diga has joined #openstack-nova | 04:25 | |
| *** abhi89 has joined #openstack-nova | 04:25 | |
| *** huanxie has joined #openstack-nova | 04:26 | |
| *** vladikr has quit IRC | 04:28 | |
| *** vladikr has joined #openstack-nova | 04:29 | |
| *** trinaths has joined #openstack-nova | 04:36 | |
| *** vks1 has joined #openstack-nova | 04:39 | |
| *** zsli_ has joined #openstack-nova | 04:47 | |
| *** vvargaszte has joined #openstack-nova | 04:47 | |
| *** dave-mccowan has quit IRC | 04:47 | |
| *** ijw has quit IRC | 04:48 | |
| *** Shunli has quit IRC | 04:50 | |
| *** vks1 has quit IRC | 04:51 | |
| *** salv-orlando has joined #openstack-nova | 04:51 | |
| *** vks1 has joined #openstack-nova | 04:53 | |
| *** openstackgerrit has joined #openstack-nova | 04:54 | |
| openstackgerrit | Ian Wienand proposed openstack/nova master: [DNM] testing nova changes https://review.openstack.org/512929 | 04:54 |
| *** salv-orlando has quit IRC | 04:57 | |
| *** suresh12 has joined #openstack-nova | 04:57 | |
| *** avolkov`` has joined #openstack-nova | 04:59 | |
| *** avolkov` has quit IRC | 05:00 | |
| *** gjayavelu has joined #openstack-nova | 05:01 | |
| *** huanxie has quit IRC | 05:05 | |
| *** thorst has joined #openstack-nova | 05:05 | |
| *** huanxie has joined #openstack-nova | 05:07 | |
| *** thorst has quit IRC | 05:10 | |
| *** josecastroleon has quit IRC | 05:10 | |
| *** suresh12 has quit IRC | 05:11 | |
| *** josecastroleon has joined #openstack-nova | 05:11 | |
| *** suresh12 has joined #openstack-nova | 05:11 | |
| *** suresh12 has quit IRC | 05:11 | |
| openstackgerrit | Naichuan Sun proposed openstack/nova master: VGPU_support: add enabled white list https://review.openstack.org/512580 | 05:12 |
| *** suresh12 has joined #openstack-nova | 05:12 | |
| *** salv-orlando has joined #openstack-nova | 05:15 | |
| openstackgerrit | Naichuan Sun proposed openstack/nova master: VGPU_support: add enabled white list https://review.openstack.org/512580 | 05:17 |
| *** cheneydc has joined #openstack-nova | 05:18 | |
| *** lajoskatona has joined #openstack-nova | 05:23 | |
| *** jmlowe has quit IRC | 05:28 | |
| *** gongysh has quit IRC | 05:31 | |
| *** gouthamr has quit IRC | 05:34 | |
| *** markvoelker has joined #openstack-nova | 05:35 | |
| *** trinaths has left #openstack-nova | 05:37 | |
| *** markvoelker_ has joined #openstack-nova | 05:37 | |
| *** markvoelker has quit IRC | 05:39 | |
| *** markvoelker_ has quit IRC | 05:46 | |
| *** markvoelker has joined #openstack-nova | 05:47 | |
| *** chyka has joined #openstack-nova | 05:48 | |
| *** markvoelker has quit IRC | 05:50 | |
| *** markvoelker has joined #openstack-nova | 05:50 | |
| *** markvoelker has quit IRC | 05:51 | |
| *** chyka has quit IRC | 05:53 | |
| *** huanxie has quit IRC | 05:53 | |
| *** edand has joined #openstack-nova | 05:56 | |
| *** Tom has joined #openstack-nova | 05:56 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Fix 500 error while passing 4-byte unicode data https://review.openstack.org/407514 | 05:56 |
| *** suresh12 has quit IRC | 06:00 | |
| *** Oku_OS-away is now known as Oku_OS | 06:06 | |
| *** TuanLA has quit IRC | 06:11 | |
| *** andreas_s has joined #openstack-nova | 06:14 | |
| *** xinliang has quit IRC | 06:17 | |
| *** Tom has quit IRC | 06:19 | |
| *** sahid has joined #openstack-nova | 06:26 | |
| *** xinliang has joined #openstack-nova | 06:26 | |
| *** sahid has quit IRC | 06:27 | |
| *** sahid has joined #openstack-nova | 06:27 | |
| *** liusheng has quit IRC | 06:30 | |
| *** liusheng has joined #openstack-nova | 06:31 | |
| *** sridharg has joined #openstack-nova | 06:31 | |
| *** cfriesen has quit IRC | 06:32 | |
| *** salv-orlando has quit IRC | 06:33 | |
| *** TuanLA has joined #openstack-nova | 06:33 | |
| *** trungnv has joined #openstack-nova | 06:34 | |
| *** salv-orlando has joined #openstack-nova | 06:35 | |
| *** Tom has joined #openstack-nova | 06:39 | |
| *** belmoreira has joined #openstack-nova | 06:40 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Refactor placement version check https://review.openstack.org/512497 | 06:42 |
| *** gjayavelu has quit IRC | 06:42 | |
| *** Tom has quit IRC | 06:42 | |
| *** Tom has joined #openstack-nova | 06:42 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova-specs master: Add pagination and changes since filter support for os-instance-action API https://review.openstack.org/507762 | 06:43 |
| *** pcaruana has joined #openstack-nova | 06:45 | |
| *** markvoelker has joined #openstack-nova | 06:45 | |
| *** armax has quit IRC | 06:45 | |
| *** thorst has joined #openstack-nova | 06:58 | |
| *** hshiina has quit IRC | 06:58 | |
| openstackgerrit | Naichuan Sun proposed openstack/nova master: VGPU_support: add enabled white list https://review.openstack.org/512580 | 06:59 |
| *** josecastroleon has quit IRC | 06:59 | |
| *** chyka has joined #openstack-nova | 07:00 | |
| *** chyka has quit IRC | 07:00 | |
| *** josecastroleon has joined #openstack-nova | 07:01 | |
| *** thorst has quit IRC | 07:03 | |
| *** suresh12 has joined #openstack-nova | 07:04 | |
| *** chyka has joined #openstack-nova | 07:07 | |
| *** suresh12 has quit IRC | 07:09 | |
| *** chyka has quit IRC | 07:11 | |
| *** sshwarts has joined #openstack-nova | 07:12 | |
| *** cheneydc_ has joined #openstack-nova | 07:14 | |
| *** cheneydc has quit IRC | 07:14 | |
| *** tesseract has joined #openstack-nova | 07:17 | |
| *** avolkov`` has quit IRC | 07:21 | |
| *** avolkov`` has joined #openstack-nova | 07:21 | |
| *** belmoreira has quit IRC | 07:26 | |
| *** markus_z has joined #openstack-nova | 07:31 | |
| *** hoonetorg has joined #openstack-nova | 07:32 | |
| *** kuzko has quit IRC | 07:32 | |
| *** ttsiouts has quit IRC | 07:33 | |
| *** ttsiouts has joined #openstack-nova | 07:33 | |
| *** gcb has quit IRC | 07:34 | |
| *** wasmum has joined #openstack-nova | 07:34 | |
| *** kuzko has joined #openstack-nova | 07:35 | |
| *** yingjun has quit IRC | 07:36 | |
| *** vvargaszte has quit IRC | 07:39 | |
| *** Yingxin has quit IRC | 07:39 | |
| *** rodolof has joined #openstack-nova | 07:40 | |
| *** Yingxin has joined #openstack-nova | 07:40 | |
| *** mikal has quit IRC | 07:40 | |
| *** ragiman has joined #openstack-nova | 07:40 | |
| *** mikal has joined #openstack-nova | 07:41 | |
| *** jpena|off is now known as jpena | 07:42 | |
| *** huanxie has joined #openstack-nova | 07:48 | |
| *** gjayavelu has joined #openstack-nova | 07:51 | |
| * lyarwood is finally back online, catching up with https://review.openstack.org/#/c/400384/ now | 07:53 | |
| *** gjayavelu has quit IRC | 07:54 | |
| *** udesale has quit IRC | 07:55 | |
| *** AlexeyAbashkin has joined #openstack-nova | 07:57 | |
| *** edand has quit IRC | 08:04 | |
| *** edand has joined #openstack-nova | 08:04 | |
| gibi | efried: I left one comment in https://review.openstack.org/#/c/511879 | 08:06 |
| *** kashyap has quit IRC | 08:07 | |
| *** lucas-afk has quit IRC | 08:07 | |
| *** weshay|ruck has quit IRC | 08:07 | |
| *** jpena has quit IRC | 08:07 | |
| *** ansiwen has quit IRC | 08:08 | |
| *** mdbooth has quit IRC | 08:08 | |
| *** jpena has joined #openstack-nova | 08:08 | |
| *** kashyap has joined #openstack-nova | 08:09 | |
| *** weshay has joined #openstack-nova | 08:09 | |
| *** lucasagomes has joined #openstack-nova | 08:09 | |
| *** ansiwen has joined #openstack-nova | 08:10 | |
| *** mdbooth has joined #openstack-nova | 08:12 | |
| *** yassine has quit IRC | 08:15 | |
| *** flanders_ has joined #openstack-nova | 08:21 | |
| *** slaweq has joined #openstack-nova | 08:23 | |
| *** ralonsoh has joined #openstack-nova | 08:23 | |
| *** Qiming_ has joined #openstack-nova | 08:25 | |
| gibi | a pretty trivial patch for already awake cores: https://review.openstack.org/#/c/510635/ | 08:25 |
| *** ralonsoh_ has joined #openstack-nova | 08:26 | |
| openstackgerrit | Jianghua Wang proposed openstack/nova master: vGPU: XenAPI: get vgpu stats from hypervisor https://review.openstack.org/512965 | 08:26 |
| *** clayton_ has joined #openstack-nova | 08:27 | |
| *** john51 has quit IRC | 08:28 | |
| *** ujjain has quit IRC | 08:28 | |
| *** clayton has quit IRC | 08:28 | |
| *** Qiming has quit IRC | 08:28 | |
| *** john51 has joined #openstack-nova | 08:28 | |
| *** clayton_ is now known as clayton | 08:28 | |
| *** ralonsoh has quit IRC | 08:29 | |
| *** ujjain has joined #openstack-nova | 08:30 | |
| *** ujjain has quit IRC | 08:30 | |
| *** ujjain has joined #openstack-nova | 08:30 | |
| *** fragatina has joined #openstack-nova | 08:30 | |
| *** yassine has joined #openstack-nova | 08:30 | |
| *** mnaser has quit IRC | 08:30 | |
| *** fragatina has quit IRC | 08:31 | |
| *** fragatina has joined #openstack-nova | 08:31 | |
| *** mnaser has joined #openstack-nova | 08:35 | |
| *** yamamoto_ has quit IRC | 08:37 | |
| *** yamamoto has joined #openstack-nova | 08:40 | |
| *** yamamoto has quit IRC | 08:40 | |
| *** dtantsur|afk is now known as dtantsur | 08:40 | |
| *** diga has quit IRC | 08:41 | |
| *** chyka has joined #openstack-nova | 08:44 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Refactor placement version check https://review.openstack.org/512497 | 08:45 |
| *** derekh has joined #openstack-nova | 08:45 | |
| *** chyka has quit IRC | 08:48 | |
| *** ralonsoh_ is now known as ralonsoh | 08:48 | |
| openstackgerrit | Naichuan Sun proposed openstack/nova master: VGPU_support: add enabled white list https://review.openstack.org/512580 | 08:49 |
| *** david-lyle has quit IRC | 08:53 | |
| *** karthiks has joined #openstack-nova | 08:55 | |
| *** yamahata has quit IRC | 08:55 | |
| openstackgerrit | Naichuan Sun proposed openstack/nova master: VGPU_support: add enabled white list https://review.openstack.org/512580 | 08:57 |
| *** thorst has joined #openstack-nova | 08:59 | |
| *** ociuhandu has quit IRC | 08:59 | |
| *** thorst has quit IRC | 09:04 | |
| *** yamamoto has joined #openstack-nova | 09:07 | |
| *** seba has quit IRC | 09:10 | |
| *** yamamoto has quit IRC | 09:11 | |
| *** sridharg is now known as sridharg|afk | 09:14 | |
| *** yamamoto has joined #openstack-nova | 09:17 | |
| *** Tom has quit IRC | 09:18 | |
| *** yamamoto has quit IRC | 09:21 | |
| *** Tom____ has joined #openstack-nova | 09:24 | |
| *** jled_ has joined #openstack-nova | 09:24 | |
| *** gcb has joined #openstack-nova | 09:25 | |
| *** yamamoto has joined #openstack-nova | 09:28 | |
| *** jled_ has quit IRC | 09:28 | |
| *** Tom____ has quit IRC | 09:28 | |
| *** zsli_ has quit IRC | 09:30 | |
| stephenfin | sean-k-mooney, ralonsoh: Sean brought this up at the PTG, but what bus do the on-die FPGAs on recent Xeon chips hook into? QPI? | 09:32 |
| ralonsoh | stephenfin: that's what I can give you now: https://www.ece.cmu.edu/~calcm/carl/lib/exe/fetch.php?media=carl15-gupta.pdf | 09:33 |
| ralonsoh | stephenfin: take a look at slide 15. As you said, is QPI | 09:34 |
| *** yamamoto_ has joined #openstack-nova | 09:34 | |
| stephenfin | ralonsoh: Just what I wanted. Thanks! | 09:35 |
| *** diga has joined #openstack-nova | 09:35 | |
| *** yamamoto has quit IRC | 09:37 | |
| *** edand has quit IRC | 09:43 | |
| openstackgerrit | Merged openstack/nova stable/pike: Target context for build notification in conductor https://review.openstack.org/511292 | 09:44 |
| *** sapd__ has quit IRC | 09:45 | |
| *** sapd_ has joined #openstack-nova | 09:45 | |
| *** cdent has joined #openstack-nova | 09:45 | |
| *** ociuhandu has joined #openstack-nova | 09:47 | |
| *** sapd_ has quit IRC | 09:47 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova-specs master: PCI NUMA Policies https://review.openstack.org/361140 | 09:48 |
| *** sapd_ has joined #openstack-nova | 09:48 | |
| *** AlexeyAbashkin has quit IRC | 09:49 | |
| *** mvk has quit IRC | 09:50 | |
| openstackgerrit | Dinesh Bhor proposed openstack/nova-specs master: Schedule VM's on default host aggregate https://review.openstack.org/512990 | 09:52 |
| *** yamamoto_ has quit IRC | 09:56 | |
| *** andreas_s has quit IRC | 09:57 | |
| *** andreas_s has joined #openstack-nova | 09:58 | |
| *** cdent has quit IRC | 10:03 | |
| *** gmann is now known as gmann_afk | 10:07 | |
| openstackgerrit | Jianghua Wang proposed openstack/nova master: vGPU: XenAPI: get vgpu stats from hypervisor https://review.openstack.org/512965 | 10:07 |
| *** andreas_s has quit IRC | 10:07 | |
| *** yangyape_ has quit IRC | 10:09 | |
| *** cheneydc_ has quit IRC | 10:09 | |
| *** andreas_s has joined #openstack-nova | 10:12 | |
| *** diga has quit IRC | 10:12 | |
| *** baoli has joined #openstack-nova | 10:14 | |
| *** takashin has left #openstack-nova | 10:18 | |
| *** baoli has quit IRC | 10:19 | |
| *** edand has joined #openstack-nova | 10:21 | |
| *** andreas_s has quit IRC | 10:21 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Cleanup mount / umount and associated rmdir calls https://review.openstack.org/494423 | 10:22 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move lvm handling to privsep. https://review.openstack.org/495516 | 10:22 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move shred to privsep. https://review.openstack.org/495537 | 10:22 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move xend existence probes to privsep. https://review.openstack.org/495538 | 10:22 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move the idmapshift binary into privsep. https://review.openstack.org/495541 | 10:22 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move loopback setup and removal to privsep. https://review.openstack.org/495664 | 10:22 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move nbd commands to privsep. https://review.openstack.org/500351 | 10:22 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move kpartx calls to privsep. https://review.openstack.org/500354 | 10:22 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move blkid calls to privsep. https://review.openstack.org/500398 | 10:22 |
| *** TuanLA has quit IRC | 10:24 | |
| *** yamamoto has joined #openstack-nova | 10:26 | |
| *** andreas_s has joined #openstack-nova | 10:27 | |
| *** sdague has joined #openstack-nova | 10:28 | |
| *** flanders_ has quit IRC | 10:31 | |
| *** andreas_s has quit IRC | 10:36 | |
| *** gszasz has joined #openstack-nova | 10:36 | |
| *** edand has quit IRC | 10:37 | |
| *** andreas_s has joined #openstack-nova | 10:41 | |
| *** andreas_s has quit IRC | 10:42 | |
| *** andreas_s has joined #openstack-nova | 10:43 | |
| *** edand has joined #openstack-nova | 10:51 | |
| openstackgerrit | Merged openstack/nova master: Remove unnecessary BDM destroy during instance delete https://review.openstack.org/510635 | 10:54 |
| *** AlexeyAbashkin has joined #openstack-nova | 10:55 | |
| openstackgerrit | Merged openstack/nova master: api-ref: fix server status values in GET /servers docs https://review.openstack.org/510696 | 10:55 |
| openstackgerrit | Merged openstack/nova master: Update "SHUTOFF" description in API guide https://review.openstack.org/510697 | 10:55 |
| openstackgerrit | Merged openstack/nova master: Fix binary name https://review.openstack.org/501359 | 10:55 |
| openstackgerrit | Merged openstack/nova master: Make etree.tostring() emit unicode everywhere https://review.openstack.org/507488 | 10:55 |
| openstackgerrit | Merged openstack/nova master: Modernize set_vm_state_and_notify https://review.openstack.org/499799 | 10:55 |
| openstackgerrit | John Garbutt proposed openstack/nova master: Only add CUSTOM_ prefix if required https://review.openstack.org/513001 | 10:58 |
| openstackgerrit | John Garbutt proposed openstack/nova master: Only add CUSTOM_ prefix if required https://review.openstack.org/513001 | 10:59 |
| openstackgerrit | John Garbutt proposed openstack/nova master: Only add CUSTOM_ prefix if required https://review.openstack.org/513001 | 11:00 |
| *** thorst has joined #openstack-nova | 11:00 | |
| *** thorst has quit IRC | 11:05 | |
| *** chyka has joined #openstack-nova | 11:08 | |
| openstackgerrit | Naichuan Sun proposed openstack/nova master: VGPU_support: add enabled white list https://review.openstack.org/512580 | 11:08 |
| *** zzzeek has quit IRC | 11:10 | |
| *** chyka has quit IRC | 11:12 | |
| *** huanxie has quit IRC | 11:13 | |
| *** zzzeek has joined #openstack-nova | 11:14 | |
| *** vks1 has quit IRC | 11:17 | |
| *** smatzek has joined #openstack-nova | 11:19 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Refactor placement version check https://review.openstack.org/512497 | 11:21 |
| *** phuongnh has quit IRC | 11:23 | |
| sean-k-mooney | stephenfin: ralonsoh technically pcie and qpi pre skylake upi + pcie from skylake on | 11:26 |
| *** vladikr has quit IRC | 11:27 | |
| sean-k-mooney | stephenfin: ralonsoh upi is the replacement for qpi | 11:27 |
| *** vladikr has joined #openstack-nova | 11:27 | |
| efried | gibi Ack, thanks | 11:30 |
| *** dave-mccowan has joined #openstack-nova | 11:31 | |
| *** janki has joined #openstack-nova | 11:33 | |
| *** dave-mcc_ has joined #openstack-nova | 11:35 | |
| *** rodolof has quit IRC | 11:36 | |
| janki | Hi. Is there a way to know which microversion of API is used in Pike? According to https://docs.openstack.org/nova/latest/reference/api-microversion-history.html, its 2.53 but API calls shows /compute/v2.1/.. | 11:36 |
| *** dave-mccowan has quit IRC | 11:37 | |
| *** lucasagomes is now known as lucas-hungry | 11:38 | |
| *** acormier has joined #openstack-nova | 11:39 | |
| *** nicolasbock has joined #openstack-nova | 11:40 | |
| *** liverpooler has quit IRC | 11:43 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Send Allocations to spawn https://review.openstack.org/511879 | 11:44 |
| efried | gibi ^ Thanks for the find. | 11:44 |
| *** acormier has quit IRC | 11:44 | |
| efried | janki The microversion is in an HTTP header | 11:44 |
| *** acormier has joined #openstack-nova | 11:44 | |
| efried | Not the endpoint URL | 11:44 |
| *** gcb has quit IRC | 11:45 | |
| gibi | efried: thanks. I'm +2 now | 11:45 |
| efried | gibi Thanks! | 11:45 |
| *** yangyapeng has joined #openstack-nova | 11:45 | |
| *** huanxie has joined #openstack-nova | 11:46 | |
| efried | janki In what context are you wanting to know? The nova CLI? The openstack CLI? Some external API call? | 11:46 |
| *** gcb has joined #openstack-nova | 11:47 | |
| janki | efried, I am running tempest with ODL + openstack Pike and this test https://github.com/openstack/tempest/blob/master/tempest/scenario/test_server_basic_ops.py fails with 404 POST http://10.29.13.2/compute/v2.1/os-floating-ips | 11:48 |
| efried | janki Do you have a link to the error trace? | 11:49 |
| janki | efried, nova doc says this API is deprecated from 2.36 microversion and will return 404. Pike uses microversion 2.53. How do I know which microversion is used | 11:50 |
| janki | efried, https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-pike-upstream-stateful-carbon/36/tempest/tempest_results.html.gz is the traceback | 11:50 |
| *** belmoreira has joined #openstack-nova | 11:50 | |
| janki | efried, please expand the first test which says "fail" | 11:51 |
| rgerganov | efried, could you please answer my last question at https://review.openstack.org/#/c/511879/7//COMMIT_MSG | 11:51 |
| *** thorst has joined #openstack-nova | 11:52 | |
| efried | janki You're looking for an HTTP header like: "OpenStack-API-Version: compute 2.53". If it's not there, I *think* we default to the earliest in the API. | 11:52 |
| efried | rgerganov Looking... | 11:52 |
| *** litao__ has quit IRC | 11:53 | |
| janki | efried, so API verion is 2.1 as seen in https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-pike-upstream-stateful-carbon/36/tempest/tempest.log.gz | 11:54 |
| efried | janki Is it possible that the floating IP pool actually isn't there? :) | 11:55 |
| janki | efried, thats my next step to debug. I first wanted to ensure the API version. I will need tempest.conf for it and searching for that file. or is it any other way I can verify? | 11:56 |
| efried | janki It's not something you can set in the config file. The microversion is per API call. Looking at the log... | 11:57 |
| efried | janki It looks like that header is being returned by nova (so it's not being set by the caller) only for one call in that log, and it's not the call you're concerned about because it's a 200. | 11:59 |
| *** yamamoto has quit IRC | 11:59 | |
| janki | efried, all jenkins build logs are at https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-pike-upstream-stateful-carbon/36/ | 11:59 |
| efried | rgerganov Responded, sorry I missed that the first time. I would have seen it eventually :) | 12:01 |
| *** dtantsur is now known as dtantsur|brb | 12:01 | |
| efried | rgerganov Let me know if you want to talk it though some more. There's a lot TBD about how drivers will model their RPs, and we especially haven't talked a lot about IP addresses as generic resources. | 12:02 |
| efried | rgerganov At least *I* haven't. sean-k-mooney might know more on that front. | 12:02 |
| *** acormier has quit IRC | 12:03 | |
| sean-k-mooney | i heard my name :) | 12:03 |
| sean-k-mooney | IP adress as a generic resource? | 12:04 |
| sean-k-mooney | as in like routed network today or something different | 12:04 |
| janki | efried, I dont find any api call before running this test. ANy specific file I should be looking into? | 12:04 |
| *** eharney has joined #openstack-nova | 12:05 | |
| efried | janki I was poking around for your n-api log, haven't found it yet. Was skimming the n-cpu log, but kinda doubt I'm going to find anything useful in there. | 12:05 |
| efried | sean-k-mooney Greetings. rgerganov was asking about how https://review.openstack.org/511879 would play with IP addresses. | 12:05 |
| rgerganov | efried, thanks for the response, it seems that our longstanding problem with VMW shared datastores won't get fixed any time soon :) | 12:05 |
| *** jpena is now known as jpena|lunch | 12:06 | |
| efried | rgerganov Tell me more about the problem, if you have time. Perhaps there's a nice placement-y solution... | 12:06 |
| sean-k-mooney | rgerganov: i think the intent is that if you need to boot a vm on a specifc nfs share you will associate the boot request with the nfs share by modeling the nfs share as a shared resource provider and using an aggregate to associate the hosts that can connect to that share | 12:06 |
| *** mvk has joined #openstack-nova | 12:07 | |
| efried | sean-k-mooney ++ | 12:07 |
| efried | But note that shared RPs are not in scope for Queens. | 12:07 |
| efried | Though there's some code already in place that's gonna have to be trodden carefully around. | 12:07 |
| sean-k-mooney | ya thats the rub. rgerganov shared resouce providers is the feature you are looking for to correctly model vmw shared datastores | 12:08 |
| rgerganov | even it is a shared RP, we still need to know how to connect to it in order to use it, right | 12:08 |
| rgerganov | there should be some way for virt drivers to obtain connection info | 12:09 |
| sean-k-mooney | rgerganov: yes that info can be sotred in the nova-compute agents config | 12:09 |
| rgerganov | sean-k-mooney, is that some kind of static data? | 12:09 |
| *** Dinesh_Bhor has quit IRC | 12:09 | |
| sean-k-mooney | rgerganov: well in the case of the the storage backend for the specific compute node yes its static | 12:10 |
| sean-k-mooney | for libvirt for example by default we use the filesystemd under /var/lib/libvirt but i can configure it to use an nfs share or rbd to ceph by default instead | 12:11 |
| rgerganov | sean-k-mooney, I don't think this will work well for the vmware driver | 12:12 |
| rgerganov | it's hard to believe that after we added so much complexity with placement, RP, allocations, etc we can't solve a simple use case with shared datastores | 12:13 |
| efried | janki https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-pike-upstream-stateful-carbon/36/control_1/n-api.log.2017-10-16-060444.gz Search for 'Floating IP' - confirms that the call is using microversion 2.1. There's a policy check failure a few lines earlier, not sure if that's related. | 12:13 |
| sean-k-mooney | rgerganov: well we could but be dont have the shared resouce providers code merged yet | 12:14 |
| janki | efried, ya. didnot find anything useful in cpu logs | 12:14 |
| efried | rgerganov Is there some kind of API endpoint that can be queried to get the details on the NFS store? | 12:14 |
| janki | efried, ya. policies is 1 of the reason for 404 as per the api doc | 12:14 |
| efried | rgerganov That would be another way to do it. | 12:14 |
| sean-k-mooney | if we did we coudl store info such as the ip adress as a trait on the resouce provider | 12:14 |
| efried | janki Oh, then maybe that's the whole problem. | 12:14 |
| efried | sean-k-mooney Just so. | 12:14 |
| efried | sean-k-mooney Though I'm not sure that's a great idea. More likely you would want to maintain a mapping of RP UUIDs to configs. | 12:15 |
| sean-k-mooney | efried: ya the down side to that is it is a public api... | 12:15 |
| rgerganov | efried, yeah, this is what I am calling "connect info" for resource provider | 12:16 |
| sean-k-mooney | at least i think it is placement is now admin only correct | 12:16 |
| rgerganov | maybe the right term is just "config", idk | 12:16 |
| efried | A trait like CUSTOM_NFS_SHARE_IP_192_168_0_55 is a pretty hideous thought. | 12:16 |
| *** huanxie has quit IRC | 12:16 | |
| sean-k-mooney | efried: ya at least that was not an ipv6 address ... | 12:17 |
| efried | Hah, totally | 12:17 |
| *** sridharg|afk is now known as sridharg | 12:17 | |
| efried | sean-k-mooney rgerganov As with PCI devices, we would rather maintain the specifics (like PCI address) external to placement, and have the driver responsible for mapping RP UUIDs to whatever entry in that external data store. | 12:17 |
| janki | efried, POST /compute/v2.1/os-floating-ips => generated 73 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) - "generated" in this line means HTTP package is generated and not FIP is generated right | 12:18 |
| efried | janki I don't know what FIP is. I think that's just saying the response payload was 73 bytes. | 12:19 |
| rgerganov | efried, the problem with this is that it may go out of sync; why not storing this info in placement itself? | 12:19 |
| efried | rgerganov How does it go out of sync? You would have to keep it up to date in placement somehow too, nah? | 12:19 |
| janki | efried, FIP = Floating IP. sorry for short form | 12:19 |
| efried | janki Oh, yeah, it's talking about the response payload. The API message knows nothing about the internals of what you're doing with the call. | 12:20 |
| *** edmondsw has joined #openstack-nova | 12:21 | |
| janki | efried, ack. "Policy check for os_compute_api:os-extended-server-attributes failed with credentials" doesnot mean that os-floating-ip has policy issues and couldnot find anthing in log which suggests that | 12:22 |
| rgerganov | efried, ok maybe keeping them in sync is not a real problem; for me it just feels natural the config info to be associated with the RP and be available through the placement api | 12:22 |
| sean-k-mooney | im sure we can come up with a clean way to store config info for a resouce provders such as adding a new field to the rp itself or reusing the description field | 12:22 |
| rgerganov | sean-k-mooney, +1 | 12:23 |
| sean-k-mooney | that config section though should be admin only | 12:23 |
| janki | efried, but again there is no os-extended-server-attributes API | 12:23 |
| sean-k-mooney | normal users never need to see it only openstack services like the virt diriver | 12:23 |
| efried | janki I really don't understand the test case, but if the policy check failed, is it possible it didn't even get to the API you're concerned about? | 12:24 |
| sean-k-mooney | janki: that api is being moved into the normal server respoce i belive | 12:24 |
| efried | janki The API call in question, if it needed to use a specific microversion, would presumably be coded up to do that. | 12:25 |
| janki | efried, I dont think it needed a specific microversion. I was just checking if that is the reason for failure | 12:25 |
| efried | janki Okay, well, it sounds like the policy is the first thing to sort out. | 12:26 |
| *** salv-orlando has quit IRC | 12:26 | |
| sean-k-mooney | janki: this might be of interest to you https://review.openstack.org/#/c/508101/5/specs/queens/approved/api-extensions-policy-removal.rst | 12:27 |
| sean-k-mooney | you will see on line 75 the proposal is to add the extended attributes to the get server responce | 12:28 |
| *** salv-orlando has joined #openstack-nova | 12:28 | |
| janki | sean-k-mooney, ya. looks like os-extended-server-attributes is a collection of REST APIs exposed by Nova. right? | 12:29 |
| *** dave-mcc_ is now known as dave-mccowan | 12:29 | |
| sean-k-mooney | janki: it was technically a buch of rest apis exposed by a nova api extention | 12:30 |
| *** huanxie has joined #openstack-nova | 12:30 | |
| *** lucas-hungry is now known as lucasagomes | 12:30 | |
| sean-k-mooney | janki: as of pike we nolonger support extending the api like that but the existing extions were more or less kept | 12:31 |
| sean-k-mooney | janki: i think the useful ones will be adopted into the main api and the unsed ones will be drop. i would expect the extended server attribute to be adopted in to the server resouce | 12:31 |
| janki | sean-k-mooney, ohk. so I am getting 404 on os-floating-ips and policy error for os-extended-server-attributes. could this be related? | 12:32 |
| *** MVenesio has joined #openstack-nova | 12:32 | |
| sean-k-mooney | janki: if you query with admin prviliges dose the same happen | 12:32 |
| sean-k-mooney | janki: the reason for the clean up spec is that there are two set of policies applied to the extentions | 12:33 |
| sean-k-mooney | the main api policies and the extention level policies that we are looking to remove | 12:33 |
| janki | sean-k-mooney, I dont have acces to the setup. Its jenkins build. But I think the naswer is no. there is 1 more variable in policy.json "os_compute_api:os-floating-ips": "rule:admin_or_owner" so there are not related | 12:34 |
| *** liverpooler has joined #openstack-nova | 12:34 | |
| sean-k-mooney | dumb question im assumeing the setup is using neutron, im not sure how the extentions were enabled in the past but if it was using nova-network you would have no floating-ips | 12:36 |
| alex_xu | janki: it looks like the floating pool isn't there | 12:37 |
| janki | alex_xu, yes. because the API that creates floating ip is failing | 12:38 |
| *** jhesketh_ has joined #openstack-nova | 12:38 | |
| alex_xu | janki: ok, great, you already know that, I didn't read the full chat log yet :) | 12:39 |
| janki | alex_xu, I am trying to figure out the reason for the API to fail. I checked, with help of efried, that microversion used is 2.1 (< 2.36). | 12:40 |
| janki | alex_xu, also there is policy check failure for os-extended-server-attributes in log but no such failure for os-floating-ips | 12:42 |
| *** jhesketh has quit IRC | 12:43 | |
| *** swamireddy has quit IRC | 12:43 | |
| *** links has quit IRC | 12:44 | |
| alex_xu | janki: they are sounds unrelated | 12:44 |
| janki | alex_xu, Ya. initially I thought they are but looking at sample policy file, I do think the same | 12:45 |
| *** clayton has quit IRC | 12:45 | |
| *** ujjain has quit IRC | 12:46 | |
| openstackgerrit | Jan Zerebecki proposed openstack/nova master: Only log not correcting allocation once per period https://review.openstack.org/508262 | 12:48 |
| *** clayton has joined #openstack-nova | 12:49 | |
| *** gjayavelu has joined #openstack-nova | 12:49 | |
| openstackgerrit | Jan Zerebecki proposed openstack/nova master: Only log not correcting allocation once per period https://review.openstack.org/508262 | 12:50 |
| *** ujjain has joined #openstack-nova | 12:51 | |
| *** tssurya has joined #openstack-nova | 12:51 | |
| *** ujjain has quit IRC | 12:51 | |
| *** ujjain has joined #openstack-nova | 12:51 | |
| *** gmann_afk is now known as gmann | 12:52 | |
| *** takashin has joined #openstack-nova | 12:55 | |
| alex_xu | janki: looks like you needn't worry about that policy check failure, the log will be emitted each time when the user doesn't have the permission | 12:55 |
| alex_xu | and that log looks like annoying | 12:55 |
| *** cdent has joined #openstack-nova | 12:55 | |
| janki | alex_xu, well then, the next step is look into tempest.conf | 12:56 |
| *** rodolof has joined #openstack-nova | 12:56 | |
| *** lyan has joined #openstack-nova | 12:56 | |
| *** mriedem has joined #openstack-nova | 12:59 | |
| *** yamamoto has joined #openstack-nova | 12:59 | |
| alex_xu | nova api meeting is running at #openstack-meeting-4 | 13:00 |
| *** huanxie has quit IRC | 13:01 | |
| mriedem | sdague: johnthetubaguy: can you take a look at this ocata-only fix? https://review.openstack.org/#/c/512406/ turns out we backported something awhile ago that requires some special handling based on the version of libvirt you're running | 13:01 |
| *** vdrok has quit IRC | 13:02 | |
| *** tommylikehu has quit IRC | 13:02 | |
| *** vdrok has joined #openstack-nova | 13:02 | |
| *** tommylikehu has joined #openstack-nova | 13:03 | |
| gmann | janki: what is error actually, i can help from tempest.conf side | 13:03 |
| *** jpena|lunch is now known as jpena | 13:03 | |
| *** belmoreira has quit IRC | 13:04 | |
| janki | gmann, so I am running tempest for ODL + Pike setup and https://github.com/openstack/tempest/edit/master/tempest/scenario/test_server_basic_ops.py is failing with error https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-pike-upstream-stateful-carbon/36/tempest/tempest_results.html.gz | 13:06 |
| stephenfin | mriedem: Any suggestions on who else I can ask to review https://review.openstack.org/#/c/361140/ in jaypipes' absence? | 13:07 |
| *** yamamoto has quit IRC | 13:07 | |
| janki | gmann, as per https://developer.openstack.org/api-ref/compute/#create-allocate-floating-ip-address, I verified that microverion is 2.1 and there are no logs about policy failure for os-floating-ips | 13:08 |
| mriedem | stephenfin: i think that dansmith guy is pretty smart | 13:08 |
| janki | gmann, next is to check tempest.conf for proper flag settings | 13:09 |
| gmann | janki: its not policy related, what FIP pool you configured on nova> | 13:10 |
| janki | gmann, I didnot manually configure anything. These logs are from jenkins build. Which file would those be in? I can dig that file up | 13:11 |
| stephenfin | mriedem: I agree: dansmith is a super smart guy who'd surely love to review https://review.openstack.org/#/c/361140/ | 13:11 |
| gmann | janki: sure in api meeting, ll ping/debug after that | 13:11 |
| *** jaypipes has joined #openstack-nova | 13:12 | |
| janki | gmann, ack. | 13:12 |
| stephenfin | Then again, if jaypipes is back from the dead, he might also like to review https://review.openstack.org/#/c/361140/ ... | 13:13 |
| stephenfin | No rest for the weary :) | 13:13 |
| *** felipemonteiro_ has joined #openstack-nova | 13:15 | |
| *** lbragstad has joined #openstack-nova | 13:16 | |
| *** felipemonteiro__ has joined #openstack-nova | 13:17 | |
| *** lyan has quit IRC | 13:20 | |
| *** felipemonteiro_ has quit IRC | 13:20 | |
| *** gouthamr has joined #openstack-nova | 13:25 | |
| efried | stephenfin I'm probably just missing something fundamental on https://review.openstack.org/#/c/361140/ | 13:26 |
| * stephenfin looks | 13:27 | |
| lyarwood | mdbooth: re https://github.com/openstack/nova/commit/29735973336b1038a2a9fb9072049fe3ed151502 - do you recall why context.auth_token isn't set? | 13:29 |
| mdbooth | lyarwood: looking | 13:29 |
| lyarwood | mdbooth: https://github.com/openstack/nova/commit/5e650e3681d40069dacf1ea2e43b07b362cf1bc3 that introduced the workaround doesn't really say why it isn't there via init_host | 13:29 |
| cdent | efried: going back through the log looking at the conversation you had with sean-k-mooney and rgerganov; where in the powervm universe is the mapping from rp uuid to <other> going to live? | 13:29 |
| stephenfin | efried: The problem I'm trying to get at is, even if we somehow managed to keep non-PCI-needing instances off of PCI-having NUMA nodes, we can still end up in the situation where we have no free PCI-having NUMA nodes for PCI-needing instances | 13:30 |
| mdbooth | lyarwood: Could it be cause there's no request context at that point? | 13:31 |
| mdbooth | i.e. no user, no api call? | 13:31 |
| * mdbooth is guessing | 13:31 | |
| efried | cdent That's a pretty big TBD. We don't have any persistent data on our "hypervisor" (the NovaLink partition), which is a fairly fundamental point of architecture. You're supposed to be able to trash the partition and recreate it with no loss. | 13:31 |
| stephenfin | This approach reduces the possibility but it doesn't mitigate it entirely. We want to use the two in tandem, which is what you've kind of hinted at (I think) | 13:31 |
| lyarwood | mdbooth: yeah sorry, https://github.com/openstack/nova/blob/master/nova/context.py#L279 | 13:31 |
| sean-k-mooney | stephenfin: that was the usecase we created https://github.com/openstack/nfv-filters/blob/master/nfv_filters/nova/scheduler/filters/aggregate_instance_type_filter.py to address | 13:31 |
| openstackgerrit | Chris Dent proposed openstack/nova-specs master: Add spec for symmetric GET and PUT of allocations https://review.openstack.org/508164 | 13:32 |
| efried | stephenfin Yes. You'll never get around that limitation. Unless you want to totally deny non-PCI-needing instances from booting on PCI-having NUMA nodes. Which ain't reasonable IMO. | 13:32 |
| * lyarwood elevates | 13:32 | |
| sean-k-mooney | it allows you to create aggregates of nodes with scarce resouces and require that they are requested in the flavor to schedule to those nodes | 13:32 |
| stephenfin | efried: But you will with this spec, which allows booting PCI-needing instances from using non-PCI-having NUMA nodes | 13:32 |
| efried | cdent Off the cuff, the idea would be to make some part of the RP relate to some part of whatever thingy we're "mapping" to. | 13:32 |
| sean-k-mooney | this filter will work with traits in request in the flavor too by the way | 13:33 |
| mdbooth | lyarwood: Yeah, that would be required for a glance request, I guess | 13:33 |
| *** smatzek has quit IRC | 13:33 | |
| stephenfin | sean-k-mooney: I saw that, but it wasn't too inflexible, hence https://blueprints.launchpad.net/nova/+spec/reserve-numa-with-pci | 13:33 |
| mdbooth | Although there's useful work it can do without that | 13:33 |
| sean-k-mooney | that is your new weigher right | 13:33 |
| *** lajoskatona has quit IRC | 13:33 | |
| *** smatzek has joined #openstack-nova | 13:33 | |
| lyarwood | mdbooth: it's the cinder encryption metadata lookup that's failing at the moment | 13:34 |
| sean-k-mooney | stephenfin: i tought that merged in pike? | 13:34 |
| efried | stephenfin The "problem" you won't get around is where I boot a hundred non-PCI-needing instances and run out of non-PCI-having NUMA nodes after the first fifty, so I start using my PCI-having NUMA nodes. Once those are full, I can no longer boot "required"-affinity PCI-needing instances. | 13:34 |
| stephenfin | sean-k-mooney: Correct. If you had to divide your cloud into aggregates for PCI devices, it made it very inflexible if you wanted to, say, start using a lot of PCI-having instances or vice versa | 13:34 |
| stephenfin | sean-k-mooney: It did. I'm saying https://review.openstack.org/#/c/361140/ forms a one-two combo :) | 13:34 |
| mdbooth | lyarwood: Hmm, yeah. That's not gonna work unless we've got some special-sauce cinder admin login, or we cached it. | 13:35 |
| stephenfin | efried: Yup, there's nothing we can do about that, I'm afraid. If you want to use 'required' then this is what you signed up for. Go buy more PCI devices :P | 13:35 |
| sean-k-mooney | stephenfin: right we really need to merge https://review.openstack.org/#/c/361140/29/specs/queens/approved/share-pci-between-numa-nodes.rst and implemented this cycle it was originally ment to work in icehouse.. | 13:36 |
| *** takashin has left #openstack-nova | 13:36 | |
| efried | stephenfin Cool, then we're on the same page mentally; but then I don't think that chunk of the spec is expressing any reasonable "Alternatives". | 13:36 |
| cdent | efried: k, thanks. I’d rather we avoid putting that kind of mapping into placement if possible, but it seems there is a fairly generic need for a translation. I presumem using rp.name is insufficient. Next comes the sort of config info that rgerganov mentioned (things like the IP for the shared storage piece?). That, to me, especially should not go into placement as we’re doing a serious mission creep at that point. | 13:36 |
| stephenfin | efried: However, the https://blueprints.launchpad.net/nova/+spec/reserve-numa-with-pci should help mitigate that, and the 'preferred' policy in https://review.openstack.org/#/c/361140/ should solve it completely | 13:36 |
| sean-k-mooney | stephenfin: as an employee of a hardware vendor that sells pic devices i feel oblidged to +1 that responce :P | 13:36 |
| *** esberglu has joined #openstack-nova | 13:36 | |
| *** burt has joined #openstack-nova | 13:37 | |
| stephenfin | *if* you're ok living with the downsides (possible performance impact) | 13:37 |
| stephenfin | sean-k-mooney: :P | 13:37 |
| stephenfin | efried: Sure, I'm happy to drop it, if that makes sense? :) | 13:37 |
| stephenfin | *if that would help? | 13:37 |
| efried | stephenfin If you don't mind, perhaps give me a crack at rewording it? | 13:37 |
| stephenfin | efried: Knock yourself out | 13:38 |
| *** smatzek has quit IRC | 13:38 | |
| *** gcb has quit IRC | 13:38 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Add pagination and timestamp filtering support for os-migrations API https://review.openstack.org/506030 | 13:38 |
| *** gcb has joined #openstack-nova | 13:38 | |
| markus_z | Here's a doc change waiting for review for 5 weeks: https://review.openstack.org/#/c/476188/ | 13:38 |
| stephenfin | efried: Also, saw your reply on the "two spaces indicate age" comment. It was just an amusing article I read once upon a time that stuck with me. Not an actual ageist thing or anything! | 13:38 |
| * stephenfin only got the "want to comment on my hair" comment after seeing that, heh | 13:39 | |
| efried | cdent I agree with you (at least in the sense that I've accepted the stated limitations of the placement architecture). We could conceivably get some mileage out of overloading the 'name' field, or embedding information into gross custom traits. But I would be wanting to look for cleaner alternatives pretty hard before resorting to that. | 13:39 |
| stephenfin | markus_z: Sure, I'll take a look | 13:39 |
| markus_z | stephenfin: thanks! | 13:39 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: docs: Explain the flow of the "serial console" feature https://review.openstack.org/476188 | 13:39 |
| *** awaugama has joined #openstack-nova | 13:40 | |
| *** edand has quit IRC | 13:41 | |
| efried | stephenfin No offense taken, of course. It's an argument that's been made to me before, so you may have caught some blowback from arguments I've had with others who were... um... more serious about it (to the point of -1ing stuff). My take on it is that the reasons for "never do that" don't apply to programmers. | 13:41 |
| *** peter-hamilton has joined #openstack-nova | 13:42 | |
| dansmith | mriedem: tell me you don't care and I'll +W: https://review.openstack.org/#/c/512406/3 | 13:42 |
| * cdent starts using three spaces, since he is older than efried | 13:42 | |
| * edleafe uses 13 spaces | 13:43 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova-specs master: Spec for API extensions policy removal https://review.openstack.org/508101 | 13:44 |
| efried | stephenfin Before I start, can you confirm that https://review.openstack.org/#/c/361140/29/specs/queens/approved/share-pci-between-numa-nodes.rst@131 was indeed supposed to be "without"? | 13:44 |
| gmann | johnthetubaguy: sdague alex_xu ^^ updated spec - https://review.openstack.org/#/c/508101/ | 13:45 |
| mriedem | dansmith: i could fix quick, but don't care too much | 13:45 |
| gmann | janki: where i can see the nova logs? i see all networking things there | 13:45 |
| stephenfin | efried: Ah, cool, just making sure. I don't do it because it was never something that was taught to do, though I have been known to strip them out when I rewrite stuff. All good point though | 13:46 |
| stephenfin | efried: Yes, without | 13:46 |
| dansmith | mriedem: if it were master I'd want it fixed, but I guess you could make the argument that it doesn't matter on a frozen branch | 13:46 |
| peter-hamilton | hi everyone, i'm hoping to get final feedback on the updated cert validation spec: https://review.openstack.org/#/c/488541/ | 13:46 |
| mriedem | dansmith: i'll fix it quick, 2 minutes | 13:46 |
| peter-hamilton | let me know if you have any questions | 13:46 |
| janki | gmann, https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-pike-upstream-stateful-carbon/36/control_1/n-api.log.2017-10-16-060444.gz | 13:46 |
| mdbooth | dansmith: The problem with that is the hair pulling when some random other test fails because of it, and then you end up having to bisect a testrun to determine the ordering which causes a failure. | 13:47 |
| *** pchavva has joined #openstack-nova | 13:47 | |
| janki | gmann, nova-cpu logs https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-pike-upstream-stateful-carbon/36/compute_1/n-cpu.log.2017-10-16-060456.gz | 13:47 |
| dansmith | mdbooth: that's what I said in my review, yes | 13:47 |
| dansmith | mdbooth: the thing is that it's in a branch that shouldn't really get a lot of debug anymore | 13:47 |
| mdbooth | dansmith: I was agreeing with you, but with additional angst. | 13:48 |
| * dansmith shakes his fist in angry agreement at mdbooth | 13:48 | |
| mdbooth | lol | 13:48 |
| johnthetubaguy | gmann: there is a bit of wording in there I am not totally sure about, agreed with what I think you mean. | 13:48 |
| * mdbooth has spent a couple of days swearing at those in the past. | 13:49 | |
| gmann | johnthetubaguy: right, ll update thanks | 13:50 |
| *** Tom____ has joined #openstack-nova | 13:50 | |
| gmann | janki: error is floating ip pool is not found | 13:50 |
| *** armax has joined #openstack-nova | 13:50 | |
| janki | gmann, yes. because the API call to create it fails right. | 13:51 |
| gmann | janki: API fail because there is no floating ip pool in your env | 13:51 |
| janki | gmann, isnt that what /compute/v2.1/os-floating-ips do? | 13:52 |
| gmann | janki: you mean POST? | 13:52 |
| janki | gmann, ya. POST on compute/v2.1/os-floating-ips returns 404 | 13:53 |
| gmann | janki: error is raised from here but i can double check the logs to confirm them same - https://github.com/openstack/nova/blob/fce56ce8c04b20174cd89dfbc2c06f0068324b55/nova/network/neutronv2/api.py#L1985 | 13:53 |
| janki | gmann, https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-pike-upstream-stateful-carbon/36/tempest/tempest.log.gz - search for os-floating-ips | 13:54 |
| *** Tom____ has quit IRC | 13:54 | |
| *** yamamoto has joined #openstack-nova | 13:54 | |
| *** yamamoto has quit IRC | 13:55 | |
| *** coreywright has quit IRC | 13:55 | |
| openstackgerrit | Matthew Booth proposed openstack/nova master: libvirt: Don't VIR_MIGRATE_NON_SHARED_INC without migrate_disks https://review.openstack.org/507202 | 13:56 |
| *** edand has joined #openstack-nova | 13:56 | |
| *** amodi has joined #openstack-nova | 13:57 | |
| dansmith | mriedem: fyi, this is the last thing i think is critical to land for fixing up our weird cell0 listing wart: https://review.openstack.org/#/c/508595/8 | 13:58 |
| dansmith | the smartness patches after that are not critical, just gravy | 13:58 |
| dansmith | that jenkins -1 isn't going to disappear, in case that has been deterring review | 13:58 |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/ocata: libvirt: add check for VIR_DOMAIN_BLOCK_REBASE_COPY_DEV https://review.openstack.org/512406 | 13:58 |
| mriedem | dansmith: ^ | 13:58 |
| mriedem | dansmith: ok, what's been deterring review is the looming newton eol and spec freeze | 13:59 |
| dansmith | mriedem: ack | 13:59 |
| gmann | janki: yea floating ip pool is needed to create the floating ip and if there is nothing then raise error. | 13:59 |
| gmann | janki: what is value of default_floating_pool in conf? under default or neutron section | 14:00 |
| *** abhi89 has quit IRC | 14:00 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Extract instance allocation removal code https://review.openstack.org/513041 | 14:00 |
| dansmith | mriedem: then speaking of spec freeze: https://review.openstack.org/#/c/510244/ | 14:00 |
| openstackgerrit | Merged openstack/nova-specs master: Add pagination and timestamp filtering support for os-migrations API https://review.openstack.org/506030 | 14:00 |
| dansmith | we *have* to have that for a variety of things | 14:00 |
| dansmith | mriedem: it's a thick review, so you might just want to assume that efried has worded the ass off it and stamp it through | 14:01 |
| efried | stephenfin Are you still looking at ^? | 14:02 |
| *** markus_z has quit IRC | 14:02 | |
| janki | gmann, its "public" under [DEFAULT] In nova.conf | 14:03 |
| *** vks1 has joined #openstack-nova | 14:03 | |
| janki | gmann, these will also depend on values in tempest.conf right? | 14:03 |
| stephenfin | efried: At what now? | 14:03 |
| efried | stephenfin The granular resource request spec | 14:03 |
| stephenfin | efried: It's on my backlog, but I think I saw it merge this morning? | 14:04 |
| stephenfin | Or at least get some +2s? | 14:04 |
| *** eharney has quit IRC | 14:04 | |
| efried | stephenfin Not merged yet, has dansmith +2 and some +1s. | 14:04 |
| *** psachin has quit IRC | 14:05 | |
| gmann | janki: hat tests did not pass the pool so default is being used and not found in neutron | 14:05 |
| gmann | *that | 14:05 |
| janki | gmann, ohhkk..so what next? I still doubt if tempest.conf has anything to do with this | 14:07 |
| stephenfin | efried: Then yes, I should get to it before EOD | 14:08 |
| gmann | janki: did you specified this in tempest.conf - floating_network_name | 14:08 |
| *** crushil has joined #openstack-nova | 14:08 | |
| efried | stephenfin Cool, thanks. | 14:09 |
| *** coreywright has joined #openstack-nova | 14:09 | |
| janki | gmann, thats the blockage. I have no access to tempest.conf and trying to find it somewhere in the logs :( | 14:09 |
| gibi | bauzas: hi! I pushed the follow up patch to refactor allocation removal as you suggested https://review.openstack.org/#/c/513041/ | 14:09 |
| gmann | janki: no prob, i got it fro log and its None | 14:10 |
| janki | gmann, but then again floating IP related calls are passing for other tempest tests expect this one. | 14:10 |
| janki | gmann, where did you find it? | 14:10 |
| openstackgerrit | Steve Noyes proposed openstack/nova master: Update live migration to use v3 cinder api https://review.openstack.org/463987 | 14:11 |
| *** salv-orlando has quit IRC | 14:11 | |
| *** salv-orlando has joined #openstack-nova | 14:11 | |
| *** huanxie has joined #openstack-nova | 14:12 | |
| johnthetubaguy | I am looking at ironic and resource classes, and hitting some problems with the transition around claims, is that a known issue / known user error? | 14:13 |
| *** sambetts|afk is now known as sambetts | 14:14 | |
| johnthetubaguy | basically we update the resource class in the flavor, but the allocations don't get updated | 14:14 |
| *** lyan has joined #openstack-nova | 14:14 | |
| johnthetubaguy | dunno if that is as designed | 14:14 |
| johnthetubaguy | it seems to cause problems | 14:14 |
| cdent | johnthetubaguy: you mean already exisitng allocations? | 14:15 |
| johnthetubaguy | cdent: yes | 14:15 |
| cdent | I think you’d have to do some kind of move/migration/resize/whatever for them to change | 14:15 |
| mriedem | johnthetubaguy: isn't that similar to editing a flavor on an existing instance? which we don't allow outside of resize? | 14:15 |
| *** salv-orlando has quit IRC | 14:16 | |
| mriedem | we probably never considered that, but now that flavor resource allocations are going to be tied to classes in the flavor extra specs, and you can edit extra specs at will, | 14:16 |
| johnthetubaguy | so... I should roll back, this is basically trying to do the Pike resource class transition for ironic | 14:16 |
| mriedem | people might think that will auto-adjust the instance using that flavor somehow | 14:16 |
| johnthetubaguy | so I update my ironic nodes to have resources classes, thats all cool | 14:17 |
| johnthetubaguy | put the existing instances have only allocations for some of the resources now | 14:17 |
| johnthetubaguy | so if I update my existing flavors to request the new resource class, and stop requesting VCPU I have a problem | 14:18 |
| johnthetubaguy | when I do a build instance, obviously I see all the nodes with existing instances as candidate hosts, as they still have the resources I need | 14:18 |
| johnthetubaguy | boom... my transition path is busted | 14:18 |
| johnthetubaguy | now what does work, is keeping claiming VCPU and RAM in the flavor | 14:19 |
| *** baoli has joined #openstack-nova | 14:19 | |
| johnthetubaguy | but I think that will cause problems in queens when we stop reporting those resources for ironic | 14:19 |
| johnthetubaguy | ... wondering if I am missing something here | 14:19 |
| cdent | does it make any different if you keep the old flavors and makeentirely new flavors? | 14:20 |
| johnthetubaguy | no, same resource request problem | 14:21 |
| *** baoli has quit IRC | 14:21 | |
| * cdent is just scratching around spitbaling, etc | 14:21 | |
| mriedem | johnthetubaguy: are you seeing logs in the compute from here? https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L531 | 14:21 |
| cdent | what about not updating the in use node to have resource classes? | 14:21 |
| johnthetubaguy | all my nodes have a resource class now | 14:22 |
| johnthetubaguy | mriedem: that stuff all works, all my instances have their flavor updated, but the allocations are not refreshed | 14:22 |
| johnthetubaguy | (basically I did update the in use nodes to have a resource class) | 14:22 |
| mriedem | johnthetubaguy: did you change the allocation amounts? | 14:23 |
| efried | mriedem dansmith Can we get https://review.openstack.org/#/c/510957/ pushed through, please? Clean cherry-pick, and got a vendor request for it. | 14:23 |
| johnthetubaguy | mriedem: where would I do that? | 14:23 |
| efried | (cc gibi) | 14:23 |
| mriedem | johnthetubaguy: well i'm confused what you mean by allocations being refreshed | 14:23 |
| mriedem | the allocation amounts shouldn't change just because there is a resource class now | 14:23 |
| mriedem | or, | 14:23 |
| mriedem | do you mean the custom resource class allocatoin isn't showing up for the instance? | 14:24 |
| johnthetubaguy | I mean old instances don't have allocations for the new resource, which breaks the scheduling of new flavors that use the resource class | 14:24 |
| mriedem | so instance A had vcpu/ram/disk allocations before the node.resource_class was set, then you set node.resource_class = baremetal and now you expect to see a 'baremetal' allocation for instance A in placement | 14:24 |
| *** janki has quit IRC | 14:25 | |
| johnthetubaguy | that is what I expected, yes | 14:25 |
| johnthetubaguy | (clearly incorrectly) | 14:25 |
| mriedem | that's probably because the RT isn't reporting allocations anymore once all of your computes are pike | 14:25 |
| mriedem | sucka! | 14:25 |
| johnthetubaguy | yup | 14:25 |
| cdent | more importantly, with that expectation not met, scheduling breaks, right? | 14:25 |
| * edleafe tries to remember dtantsur|brb's advice on this... | 14:25 | |
| johnthetubaguy | cdent: +1 | 14:25 |
| edleafe | johnthetubaguy: this came up last cycle | 14:26 |
| gibi | efried: I'm +1 on pushing that notification backport through | 14:26 |
| mriedem | in the before times, the update_available_resource periodic task would update the allocations for the instances running on that node | 14:26 |
| mriedem | until we squashed that | 14:26 |
| johnthetubaguy | mriedem: yeah, that is what I was thinking | 14:26 |
| mriedem | efried: i can't +W my own backport | 14:26 |
| *** ragiman has quit IRC | 14:26 | |
| edleafe | johnthetubaguy: unfortunately, it was in the middle of a bunch of other discussions about the ironic transition to custom RCs | 14:26 |
| cdent | edleafe: yeah, I seem to recall dtantsur|brb had something to say about this. since he is brb, maybe he’ll brb | 14:27 |
| mriedem | johnthetubaguy: ok so the scheduling issue is a new instance request can try to claim the 'baremetal' resource on node A even though instance A is already using it | 14:27 |
| mriedem | which causes a scheduler failure yes? | 14:27 |
| efried | mriedem Right, and I'm led to understand the set of cores on stable is not the same as master, but I don't really understand how it works. Guess I'm asking what needs to be done to get it in? | 14:27 |
| johnthetubaguy | mriedem: yes | 14:27 |
| mriedem | johnthetubaguy: ok yeah i seem to remember this coming up too....maybe dansmith remembers | 14:28 |
| *** baoli has joined #openstack-nova | 14:28 | |
| mriedem | efried: yes different core group on stable https://review.openstack.org/#/admin/groups/540,members | 14:28 |
| mriedem | b/c different rules | 14:28 |
| dansmith | um what | 14:29 |
| mriedem | efried: https://docs.openstack.org/project-team-guide/stable-branches.html | 14:29 |
| dansmith | johnthetubaguy: mriedem I'm not sure what you're talking about | 14:29 |
| dansmith | I'm on a call right now so I'm a bit distracted | 14:29 |
| mriedem | efried: we could use more stable cores, so if that's something you're interested in helping with, please dig in, get to know the rules, and do reviews | 14:29 |
| *** yikun has joined #openstack-nova | 14:29 | |
| efried | mriedem ack | 14:29 |
| *** smatzek has joined #openstack-nova | 14:29 | |
| mriedem | basically means don't backport features, or backward incompatible changes, all things start on master and go backward, and there are support phases for what's appropriate to backport based on severity | 14:30 |
| mriedem | johnthetubaguy: ok, got it - want to start by reporting a bug? | 14:30 |
| *** sridharg has quit IRC | 14:31 | |
| johnthetubaguy | mriedem: yeah, will do, I was hoping I just miss-read the docs | 14:31 |
| *** sridharg has joined #openstack-nova | 14:31 | |
| *** erlon has joined #openstack-nova | 14:32 | |
| mriedem | johnthetubaguy: https://review.openstack.org/#/c/492964/ is the change i was thinking of, | 14:33 |
| mriedem | slightly different though | 14:33 |
| mriedem | that's about reporting inventory, not allocations | 14:33 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Extract instance allocation removal code https://review.openstack.org/513041 | 14:33 |
| gibi | mriedem: fixed your nit in ^^ | 14:33 |
| *** gmann is now known as gmann_afk | 14:33 | |
| *** smatzek has quit IRC | 14:34 | |
| openstackgerrit | Eric Fried proposed openstack/nova-specs master: PCI NUMA Policies https://review.openstack.org/361140 | 14:35 |
| efried | stephenfin ^ | 14:35 |
| efried | I basically just took that nonsensical chunk out, and fixed up those couple of words. | 14:35 |
| *** smatzek has joined #openstack-nova | 14:36 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova-specs master: Spec for API extensions policy removal https://review.openstack.org/508101 | 14:36 |
| mriedem | johnthetubaguy: ok so normally, at least if you have 1 ocata compute, the update_available_resource periodic would run, that would get available nodes, which would refresh nodes from ironic, and that refresh does the resoure class / flavor migration thing, | 14:38 |
| *** david-lyle has joined #openstack-nova | 14:38 | |
| mriedem | and then as part of the update_available_resource periodic, the RT would update allocations for each instance on the node (if you have at least 1 ocata compute) | 14:38 |
| mriedem | we don't really have a hook between the virt driver and the RT to say if the allocations should be updated, | 14:39 |
| stephenfin | efried: Looks good to me. Thank you :) | 14:39 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Moving more utils to ServerResourceAllocationTestBase https://review.openstack.org/499539 | 14:39 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: factor out compute service start in ServerMovingTest https://review.openstack.org/503037 | 14:39 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Test resource allocation during soft delete https://review.openstack.org/495159 | 14:39 |
| stephenfin | dansmith: Could you stick https://review.openstack.org/361140 on your review backlog? | 14:39 |
| stephenfin | sean-k-mooney, cdent: Ye might like to look at that again too ^ | 14:40 |
| mriedem | johnthetubaguy: random thoughts: we could have the ironic driver set a flag when a flavor was migrated and the RT calls into the driver to see if the flag was set and allocations should be forcefully updated (kind of gross and maybe racy), | 14:40 |
| *** smatzek has quit IRC | 14:40 | |
| mriedem | johnthetubaguy: we could have the driver update allocations on it's own...also kind of gross but at least very specific case | 14:40 |
| dansmith | stephenfin: I can, but the queue is long and I'm not sure I'm the best person to review that | 14:40 |
| dansmith | I guess I don't really know who is though | 14:40 |
| johnthetubaguy | mriedem: yeah, being part of the instance flavor migration doesn't seem totally crazy | 14:41 |
| stephenfin | dansmith: That's the problem :( jaypipes would be the best person, but he has his hands full with nested-resource-providers | 14:41 |
| dansmith | stephenfin: he has his hands full with being a slacker | 14:41 |
| stephenfin | dansmith: You could just approve it and assume it's perfect? :P | 14:41 |
| johnthetubaguy | mriedem: I attempted to write it all up here: https://bugs.launchpad.net/nova/+bug/1724589 | 14:41 |
| openstack | Launchpad bug 1724589 in OpenStack Compute (nova) "Unable to transition to Ironic Node Resource Classes in Pike" [High,New] | 14:41 |
| stephenfin | Well, that goes without saying | 14:41 |
| mriedem | another idea is the RT could check to see if there are any new resource classes in the flavor, but that would be complicated - and the only way to tell new from old is by checking existing allocations in placement - not something we want to do while holding a lock in the RT | 14:41 |
| *** smatzek has joined #openstack-nova | 14:42 | |
| *** huanxie has quit IRC | 14:42 | |
| *** tonygunk has joined #openstack-nova | 14:43 | |
| johnthetubaguy | mriedem: I don't mind a nova-manage cmd you have to run to update the allocations for the node you are on? | 14:43 |
| jaypipes | stephenfin: I'm currently reviewing the PCI NUMA policy spec. | 14:43 |
| jaypipes | stephenfin: also, still on vacation.. | 14:43 |
| edmondsw | efried here are the nova stable cores: https://review.openstack.org/#/admin/groups/540,members | 14:43 |
| johnthetubaguy | mriedem: although that breaks our upgrade ABI... | 14:43 |
| jaypipes | stephenfin: but I just got some coffee and fuck it, might as well do some work. | 14:43 |
| openstackgerrit | Chris Dent proposed openstack/nova master: [placement] Clean up TODOs in allocations.yaml gabbit https://review.openstack.org/513057 | 14:44 |
| kashyap | jaypipes: On vacation and on specs? Sheesh | 14:44 |
| kashyap | jaypipes: Setting a baaaaad example, I tell ya | 14:44 |
| mriedem | johnthetubaguy: i'd rather we do it automatically | 14:45 |
| stephenfin | jaypipes: You're a better man than I. I didn't know you were on vacation | 14:45 |
| johnthetubaguy | mriedem: yeah, I will have a dig | 14:45 |
| mriedem | johnthetubaguy: one issue though is i think once we migrate the flavor, we no longer check this stuff in the ironic driver, | 14:45 |
| mriedem | so anyone that has already upgraded and migrated the flavors, not sure if we can correct the issue for them | 14:46 |
| mriedem | without detecting if the instance allocations include the resource class or not, and if not, add it | 14:46 |
| mriedem | which sucks since that would run every time | 14:46 |
| *** smatzek has quit IRC | 14:46 | |
| jaypipes | stephenfin: it's cool duder. I'll be back into my normal swing of things later today. | 14:46 |
| jaypipes | stephenfin: just got back from Ohio at midnight last night. | 14:46 |
| johnthetubaguy | mriedem: it would only be once per process restart to do that allocation check | 14:46 |
| *** xyang1 has joined #openstack-nova | 14:46 | |
| *** ociuhandu has quit IRC | 14:46 | |
| mriedem | johnthetubaguy: the flavor migration thing happens on every node refresh | 14:47 |
| mriedem | because of the hash ring stuff | 14:47 |
| johnthetubaguy | mriedem: will find you the link | 14:47 |
| *** smatzek has joined #openstack-nova | 14:48 | |
| johnthetubaguy | mriedem: before this line is only one per process restart, I think: https://github.com/openstack/nova/blob/e11a8687aef527eee9f7c733db6cccd5b902afbb/nova/virt/ironic/driver.py#L523 | 14:48 |
| *** lyan has quit IRC | 14:48 | |
| johnthetubaguy | mriedem: well, per instance you create too, there is the _migrated_instance_uuids guard to stop the worst of it | 14:48 |
| stephenfin | jaypipes: Gotcha. Looking through efried's spec rn, but if there's anything you want reviews on let me know | 14:49 |
| jaypipes | stephenfin: will do. cheers. | 14:49 |
| *** josecastroleon has quit IRC | 14:50 | |
| mriedem | https://github.com/openstack/nova/blob/e11a8687aef527eee9f7c733db6cccd5b902afbb/nova/virt/ironic/driver.py#L536-L539 | 14:50 |
| mriedem | "By adding just the custom RC to the existing flavor extra_specs, the periodic call to update_available_resources() will add an allocation against the custom resource class, and prevent placement from thinking that that node is available." | 14:50 |
| mriedem | gah | 14:50 |
| mriedem | except it won't... | 14:50 |
| cdent | I kinda wish we could figure out some way to have that back. | 14:51 |
| cdent | if we can’t, then I think we should be okay with the virt driver doing it | 14:52 |
| mriedem | johnthetubaguy: this is where we start the migration checking https://github.com/openstack/nova/blob/e11a8687aef527eee9f7c733db6cccd5b902afbb/nova/virt/ironic/driver.py#L716 | 14:52 |
| *** smatzek has quit IRC | 14:52 | |
| cdent | we’re seeing increasing situations where the virt driver being able to talk to placement is sueful | 14:52 |
| mriedem | any time a node is refreshed | 14:52 |
| dansmith | cdent: you mean compute | 14:53 |
| cdent | no, I mean virt driver | 14:53 |
| mriedem | dansmith: not in this case | 14:53 |
| efried | bauzas Could you take a look at https://review.openstack.org/#/c/510957/ please? | 14:53 |
| johnthetubaguy | mriedem: but most of it doesn't happen, as we check https://github.com/openstack/nova/blob/e11a8687aef527eee9f7c733db6cccd5b902afbb/nova/virt/ironic/driver.py#L555 | 14:53 |
| mriedem | johnthetubaguy: so consider i've upgraded to pike, added resource classes to my existing nodes, and those migrated the flavor extra specs | 14:53 |
| mriedem | we get to https://github.com/openstack/nova/blob/e11a8687aef527eee9f7c733db6cccd5b902afbb/nova/virt/ironic/driver.py#L523 | 14:53 |
| dansmith | mriedem: I really want to avoid the virt driver talking to placement | 14:53 |
| *** josecastroleon has joined #openstack-nova | 14:53 | |
| bauzas | efried: sure, top prio just being specs reviews for today | 14:53 |
| johnthetubaguy | mriedem: yes | 14:53 |
| efried | bauzas Of course; that one should be an easy +A hopefully. | 14:54 |
| mriedem | johnthetubaguy: before https://github.com/openstack/nova/blob/e11a8687aef527eee9f7c733db6cccd5b902afbb/nova/virt/ironic/driver.py#L523 we'd have to check if there is an existing allocation for normalized_rc in placement for that instance | 14:54 |
| mriedem | and if not, add it | 14:54 |
| bauzas | cdent: I'm pretty against the idea to see the virt driver talking to placement | 14:54 |
| mriedem | johnthetubaguy: that is at most redundant once per restart of nova-compute i agree | 14:54 |
| johnthetubaguy | mriedem: +1 that's what I was trying to say above | 14:54 |
| mriedem | because then self._migrated_instance_uuids.add(node.instance_uuid) | 14:54 |
| johnthetubaguy | yep, yep | 14:54 |
| johnthetubaguy | I mean its horrid, but seems the least horrid | 14:54 |
| cdent | bauzas: yes, it is icky, but the non libvirt drivers (notably powervm and vmware) may very well need to do it despite the ickiness | 14:55 |
| *** yamamoto has joined #openstack-nova | 14:55 | |
| dansmith | cdent: why? | 14:55 |
| *** suresh12 has joined #openstack-nova | 14:55 | |
| *** suresh12 has quit IRC | 14:56 | |
| mriedem | johnthetubaguy: ok we both said the same thing in https://bugs.launchpad.net/nova/+bug/1724589 :) | 14:56 |
| openstack | Launchpad bug 1724589 in OpenStack Compute (nova) "Unable to transition to Ironic Node Resource Classes in Pike" [High,New] | 14:56 |
| johnthetubaguy | mriedem: I can go and try code that up, to see how bad it looks | 14:56 |
| *** cfriesen has joined #openstack-nova | 14:56 | |
| cdent | dansmith: one example is the conversation that efried, rgerganov and efried were having earlier today about device management. /me locates link | 14:56 |
| mriedem | johnthetubaguy: go nuts - you've got the recreate so you'll be able to tell if it fixes it | 14:57 |
| efried | cdent I think having the allocations passed into the virt driver obviates any need to query placement further | 14:57 |
| dansmith | cdent: I want compute asking the virt driver what it thinks it needs and then compute doing that work | 14:57 |
| efried | or that ^ | 14:57 |
| mriedem | so, what john and i are talking about is a special one off ase | 14:57 |
| mriedem | *case | 14:57 |
| dansmith | cdent: having two things managing allocations or RCs or anything like that gets us further into the territory we had before where things are stomping on each other | 14:57 |
| mriedem | for the ironic flavor migration stuff | 14:57 |
| johnthetubaguy | *arse | 14:57 |
| cdent | dansmith: I agree we probably don’t want multiple places doing writes | 14:58 |
| cdent | but reads, I’m not ure | 14:58 |
| cdent | I don’t know for certain, at this stage I’m merely speculating | 14:58 |
| dansmith | we should be passing anything in that it needs, otherwise we're likely duplicating queries | 14:59 |
| *** vks1 has quit IRC | 14:59 | |
| dansmith | mriedem: can you explain what you think you need for ironic? | 14:59 |
| johnthetubaguy | https://bugs.launchpad.net/nova/+bug/1724589 | 14:59 |
| openstack | Launchpad bug 1724589 in OpenStack Compute (nova) "Unable to transition to Ironic Node Resource Classes in Pike" [High,In progress] - Assigned to John Garbutt (johngarbutt) | 14:59 |
| *** baoli has quit IRC | 14:59 | |
| mriedem | dansmith: it's in ^ | 14:59 |
| mriedem | johnthetubaguy: one issue might be a chicken and egg with the custom RC inventory being available when we PUT /allocations/{consumer_uuid} | 15:00 |
| *** baoli has joined #openstack-nova | 15:00 | |
| mriedem | because the inventory gets updated via the RT periodic | 15:00 |
| mriedem | so if i just set a custom rc on my ironic node, the periodic runs, it detects the new rc and will update inventory, but while in the driver we're migrating the instance because it's node has an rc now, if we try updating the allocation for that rc before the node RP inventory has that rc, it will fail with a 409 | 15:01 |
| johnthetubaguy | mriedem: dang, yeah | 15:01 |
| mriedem | "409 Conflict if there is no available inventory in any of the resource providers for any specified resource classes or inventories are updated by another thread while attempting the operation." | 15:01 |
| johnthetubaguy | mriedem: I guess we skip adding it as migration complete, and go around again | 15:01 |
| dansmith | mriedem: is comment #1 what I should read? | 15:01 |
| mriedem | dansmith: or 2 | 15:01 |
| mriedem | oh yeah 1 is my description of the problem | 15:02 |
| mriedem | in 'merican | 15:02 |
| johnthetubaguy | mriedem: I have a related thing here, I am not keen on what it could do across upgrade mind: https://review.openstack.org/#/c/513001 | 15:02 |
| *** baoli has quit IRC | 15:02 | |
| johnthetubaguy | heh | 15:02 |
| *** baoli has joined #openstack-nova | 15:02 | |
| dansmith | mriedem: this is because pike doesn't do healing of allocations right? | 15:03 |
| johnthetubaguy | dansmith: +1 | 15:03 |
| mriedem | yes | 15:03 |
| *** mdnadeem has quit IRC | 15:03 | |
| mriedem | the flavor migration code has a comment asserting that the allocations are updated via the RT periodic | 15:03 |
| mriedem | probably b/c it was written 1/2 a day before that changed :) | 15:03 |
| dansmith | having the virt driver do that thing we decided was bad to have compute (at all) do, seems like a bad call to me, | 15:04 |
| dansmith | although I understand something needs to do it | 15:04 |
| *** acormier has joined #openstack-nova | 15:04 | |
| dansmith | it'd be nice if we had some way to let the driver signal to compute that something fundamental has changed about the instance to force the heal, | 15:04 |
| mriedem | could we get the scheduler to do it? probably not b/c the issue during scheduling isn't with the instance already consuming that node, it's a new build request and the scheduler thinking the node is free | 15:04 |
| mriedem | dansmith: that's what i was thinking as an option above, | 15:05 |
| *** yamamoto has quit IRC | 15:05 | |
| mriedem | have a way for the RT to call into the driver to ask if the allocatoin should be forced | 15:05 |
| dansmith | yeah | 15:05 |
| mriedem | that might also fix the issue with trying to update the allocatoin before we've posted inventory for the newly set node.rc | 15:05 |
| dansmith | which could apply to other virt drivers that have things happen underneath them (like vmware moving an instance within a cluster) | 15:05 |
| johnthetubaguy | I am missing the trigger, a new build fails and triggers the refresh? | 15:06 |
| jaypipes | stephenfin: k, done on the pci numa policies spec. | 15:06 |
| mriedem | johnthetubaguy: where does the new build fail? scheduler or compute? | 15:06 |
| mriedem | i thought it was compute and triggered a retry | 15:06 |
| johnthetubaguy | yeah, its on the compute, ironic find the node is already in use by another instance | 15:06 |
| mriedem | so spawn fails? | 15:06 |
| johnthetubaguy | yeah | 15:07 |
| *** Oku_OS is now known as Oku_OS-away | 15:07 | |
| johnthetubaguy | I should double check the logs on that | 15:07 |
| stephenfin | jaypipes: Thank you sir. Much appreciated, as always | 15:07 |
| jaypipes | stephenfin: no problem. or however one says no problem in Gaelic. | 15:07 |
| *** acormier has quit IRC | 15:08 | |
| *** penick has joined #openstack-nova | 15:08 | |
| *** lyan has joined #openstack-nova | 15:08 | |
| mriedem | bauzas: you were +2 on https://review.openstack.org/#/c/361140/ before so are you still good | 15:09 |
| mriedem | ? | 15:09 |
| efried | An dtugann stephenfin Gaeilge? I was kind of guessing not... | 15:09 |
| mriedem | johnthetubaguy: not sure i like the spawn fail / refresh thing, | 15:10 |
| mriedem | trying to think of how we can set a flag for instances that have migrated but need their allocations updated by the RT | 15:10 |
| mriedem | including instances that have had their flavors migrated already | 15:10 |
| *** ragiman has joined #openstack-nova | 15:11 | |
| dansmith | the problem being we do the migration async right? | 15:11 |
| dansmith | we come up and before we can do all of them we might get a boot request? | 15:11 |
| mriedem | ah crap didn't think about that either | 15:11 |
| dansmith | we could disable ourselves until the migration is complete | 15:11 |
| mriedem | the async migration also means that if the RT asked the driver for any instances to forcefully update allocations, they might not be set yet, but the next pass or the periodic would hit them | 15:12 |
| mriedem | i was thinking the driver is shoving stuff onto a work queue, | 15:12 |
| mriedem | the RT pulls off that queue | 15:12 |
| mriedem | once all instances are processed the queue remains empty | 15:12 |
| johnthetubaguy | get_inventory, could we do the migration on that call, and return something if the allocation needs refreshing? | 15:13 |
| dansmith | if we disable ourselves we can still do management operations of existing instances, and the scheduler won't send us new stuff until we're ready | 15:13 |
| dansmith | johnthetubaguy: that's kinda icky | 15:13 |
| *** catintheroof has joined #openstack-nova | 15:13 | |
| dansmith | johnthetubaguy: I mean, really icky | 15:13 |
| dansmith | johnthetubaguy: gross even | 15:13 |
| johnthetubaguy | worse than virt driver calling to placement? | 15:14 |
| dansmith | also recall that people can do this before anything starts back up during an upgrade | 15:14 |
| *** vks1 has joined #openstack-nova | 15:14 | |
| *** lpetrut has joined #openstack-nova | 15:14 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Transform instance.exists notification https://review.openstack.org/403660 | 15:14 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add sample test for instance audit https://review.openstack.org/480955 | 15:14 |
| dansmith | johnthetubaguy: it's just overloading get_inventory() as a general hook to do potentially a ton of db maintenance | 15:15 |
| johnthetubaguy | so the alternative is dropping the resources:VCPU=0 in the new flavor | 15:15 |
| dansmith | johnthetubaguy: it'd be better to just provide a proper hook I think | 15:15 |
| johnthetubaguy | dansmith: I am agreeing its horrid, just thinking relative horrid here really | 15:15 |
| dansmith | johnthetubaguy: it's relatively horrid yes :) | 15:16 |
| dansmith | johnthetubaguy: you don't like the self disable? | 15:16 |
| dansmith | if we do it in get_inventory we still have a race right? | 15:16 |
| dansmith | with the scheduler | 15:16 |
| johnthetubaguy | so its a race with when the flavor gets updated I guess | 15:16 |
| mriedem | i'm not sure at which point you auto-disable | 15:17 |
| dansmith | mriedem: on init_host(), if there are unmigrated instances | 15:17 |
| dansmith | and then re-enable when you're done with the migration | 15:18 |
| johnthetubaguy | but if the resource class isn't set on the node, we are never done | 15:18 |
| mriedem | so originally when we did the flavor migration it was on init_host and then that moved because of the hash ring stuff | 15:18 |
| dansmith | johnthetubaguy: that had to be set before queens, right? | 15:19 |
| mriedem | yeah i'm trying to think if we re-enable too soon, or disable too long | 15:19 |
| *** pcaruana has quit IRC | 15:19 | |
| dansmith | so queens starting up can assume it's set no? | 15:19 |
| johnthetubaguy | dansmith: yes, but this is really about making pike work | 15:19 |
| johnthetubaguy | so right know I can't update the flavors in pike, for them to be set in time for queens, because of this bug | 15:20 |
| dansmith | oh, was this migration in pike? I'm misremembering the timing | 15:20 |
| johnthetubaguy | yeah, sadly | 15:20 |
| *** tesseract has quit IRC | 15:20 | |
| mriedem | yeah we have to backport the fix | 15:20 |
| dansmith | johnthetubaguy: but you can set the node class before pike, and you can run the migration before you start anything else up right/ | 15:21 |
| mriedem | so i'm still thinking queue and hook callback from RT to driver | 15:21 |
| dansmith | mriedem: explain your queue thing again? | 15:21 |
| mriedem | so before https://github.com/openstack/nova/blob/e11a8687aef527eee9f7c733db6cccd5b902afbb/nova/virt/ironic/driver.py#L523 we're going to have to see if the instance already has an allocation for the normalized_rc, | 15:22 |
| cdent | does anyone have a reference to previous discussion/decisions on why we don’t do regular allocation updates? (something I can read, rather than taking us off track here) | 15:22 |
| mriedem | if it doesn't, we have to put the instance/rc into a queue, | 15:22 |
| mriedem | when the RT periodic runs, it calls into the driver to say, give me any instances that need their allocations updated and we'd dequeue at that point | 15:22 |
| mriedem | then ^ should auto-heal during the periodic as the admin is setting node rcs in ironic | 15:23 |
| mriedem | while things are running | 15:23 |
| mriedem | cdent: https://review.openstack.org/#/c/491012/ | 15:24 |
| cdent | thanks | 15:24 |
| dansmith | mriedem: you mean the first time we run the RT periodic we end up migrating all the instances the driver needs before we update inventory? | 15:24 |
| mriedem | cdent: in a nutshell, in pike we want the scheduler to create allocations, including doubling them up for moves and shared providers (before we stopped trying to make shared providers work in pike) - the problem is the periodic task in ocata computes will overwrite the allocations created by the scheduler | 15:25 |
| mriedem | dansmith: need to see if the RT updates inventory before allocations | 15:25 |
| *** eharney has joined #openstack-nova | 15:25 | |
| *** gjayavelu has quit IRC | 15:25 | |
| mriedem | it doesn't | 15:26 |
| mriedem | shit | 15:26 |
| mriedem | the RT would update allocations before inventory | 15:26 |
| dansmith | even still, we run most of that code at other times than just the perioidic | 15:26 |
| *** jgriffith has quit IRC | 15:26 | |
| *** Sukhdev_ has joined #openstack-nova | 15:26 | |
| mriedem | the allocatoin update does happen during instance_claim | 15:27 |
| dansmith | mriedem: so we still do allocation updates if we have ocata computes.. what if we keep doing them if we have ocata nodes and the driver says we need to? | 15:27 |
| *** hongbin has joined #openstack-nova | 15:27 | |
| dansmith | s/and/or | 15:28 |
| *** MVenesio has quit IRC | 15:28 | |
| *** slaweq_ has joined #openstack-nova | 15:28 | |
| mriedem | and the driver says we need to only for ironic and only until we remove the flavor migration code | 15:28 |
| sean-k-mooney | stephenfin: gladly. ill review it in the next 20 mins or so. i was pretty happy with the previous version so i dont expect that ill see anything wrong with it | 15:28 |
| *** andreas_s has quit IRC | 15:28 | |
| dansmith | mriedem: yeah | 15:28 |
| johnthetubaguy | ... now that I like | 15:29 |
| mriedem | dansmith: that would be simpler | 15:29 |
| johnthetubaguy | will code that up now | 15:29 |
| dansmith | the commit message would need to be "Extend existing shitpile with more shit because.. why not" | 15:29 |
| mriedem | you can't migrate ironic instances anyway right | 15:29 |
| mriedem | ? | 15:29 |
| mriedem | so the ocata compute allocation overwrite thing is less of a concern there | 15:30 |
| johnthetubaguy | mriedem: there is a spec on that ;) | 15:30 |
| dansmith | no migrations at all? | 15:30 |
| mriedem | johnthetubaguy: sure, but not in pike | 15:30 |
| dansmith | I thought evac worked at least | 15:30 |
| mriedem | evac is the only one i can think of | 15:30 |
| mriedem | but, | 15:30 |
| johnthetubaguy | oh, rebuild does I guess | 15:30 |
| *** gszasz has quit IRC | 15:30 | |
| mriedem | you don't care about the allocations on the dead source host | 15:30 |
| mriedem | although these are nodes, not hosts | 15:30 |
| * dansmith points to his shitpile comment | 15:31 | |
| mriedem | hmm, so how does evac work for ironic - the nodes might not be down, but the nova-compute service is, | 15:31 |
| mriedem | so you evacuate and move all of those instances to other ironic nodes managed by another compute host? | 15:31 |
| * dansmith points to his shitpile comment again | 15:31 | |
| * johnthetubaguy has no idea how evacuate works | 15:32 | |
| mriedem | well regardless, | 15:32 |
| mriedem | because of gibi's fixes, | 15:32 |
| mriedem | when/if the source compute comes back up, we remove the allocations from the old instances that were on it | 15:32 |
| *** gszasz_ has joined #openstack-nova | 15:32 | |
| mriedem | so yeah the callback to the driver to ask if it should update allocatoins is probably ok for ironic, | 15:33 |
| mriedem | simpler, | 15:33 |
| mriedem | lesser of all evils, | 15:33 |
| mriedem | and temporary | 15:33 |
| dansmith | not not evil, but less evil | 15:34 |
| mriedem | like mike pence | 15:34 |
| * cdent blinks | 15:36 | |
| *** dtantsur|brb is now known as dtantsur | 15:36 | |
| dtantsur | johnthetubaguy, cdent, whas was the question, could you please give a tl;dr? | 15:40 |
| johnthetubaguy | dtantsur: hit this bug: https://bugs.launchpad.net/nova/+bug/1724589 | 15:41 |
| openstack | Launchpad bug 1724589 in OpenStack Compute (nova) "Unable to transition to Ironic Node Resource Classes in Pike" [High,In progress] - Assigned to John Garbutt (johngarbutt) | 15:41 |
| edleafe | dtantsur: if you update an ironic flavor with a custom RC, nova may schedule to an existing node | 15:41 |
| *** jgriffit1 has joined #openstack-nova | 15:41 | |
| edleafe | because we don't create the allocation for nodes with that custom RC | 15:41 |
| *** fragatina has quit IRC | 15:42 | |
| dtantsur | wait, wasn't that periodic task in the ironic virt driver written to update the allocations? | 15:42 |
| *** fragatina has joined #openstack-nova | 15:42 | |
| dansmith | dtantsur: no, the flavors | 15:43 |
| dansmith | dtantsur: when it was written the compute node would unceremoniously heal allocations | 15:43 |
| edleafe | dtantsur: that was supposed to be part of it, but only the flavor migration was added | 15:43 |
| dansmith | dtantsur: right over top of the scheduler, which is why we made it stop, | 15:43 |
| dtantsur | oooooh | 15:43 |
| dansmith | dtantsur: but that periodic in the ironic driver was depending on that | 15:43 |
| dtantsur | was the update bit removed in Pike or Queens or both? | 15:44 |
| *** jgriffit1 has quit IRC | 15:44 | |
| johnthetubaguy | Pike | 15:44 |
| dansmith | dtantsur: pike once all compute nodes have been updated | 15:44 |
| *** jgriffith has joined #openstack-nova | 15:44 | |
| dansmith | dtantsur: it would keep doing it as long as ocata nodes were in the cluster | 15:44 |
| *** jgriffith has quit IRC | 15:45 | |
| dtantsur | so, is our only option to update the periodic task to fix up allocations as well? | 15:46 |
| dtantsur | I don't know nova well enough to suggest anything else :) | 15:46 |
| dansmith | dtantsur: we're going to let ironic have a vote on the "should we keep healing" decision | 15:48 |
| *** felipemonteiro__ has quit IRC | 15:48 | |
| efried | cdent I wrote that test case, but I can't get it to fail properly. I suspect it may be due to that bug, though. | 15:50 |
| *** smatzek has joined #openstack-nova | 15:50 | |
| efried | cdent Mebbe I post it and see if you can find holes. | 15:50 |
| cdent | efried: sounds like a grand plan | 15:50 |
| *** Sukhdev has joined #openstack-nova | 15:51 | |
| dtantsur | dansmith: I just don't see other options. I don't think we should ask operators to go into Placement and fix up stuff themselves. or should we? | 15:52 |
| dansmith | dtantsur: nobody is suggesting that | 15:52 |
| dtantsur | johnthetubaguy: btw you may also hit https://bugs.launchpad.net/nova/+bug/1723423 in your testing | 15:52 |
| openstack | Launchpad bug 1723423 in OpenStack Compute (nova) "Ironic node cannot be used if it does not report VCPU" [Undecided,In progress] - Assigned to Dmitry Tantsur (divius) | 15:52 |
| *** sahid has quit IRC | 15:52 | |
| johnthetubaguy | dtantsur: so ironic should eventually return 0 for all the resources that are no longer being claimed? | 15:53 |
| dtantsur | johnthetubaguy: sorry, I don't quite get it. Which of the bugs are you referring to? | 15:54 |
| *** jmlowe has joined #openstack-nova | 15:54 | |
| *** links has joined #openstack-nova | 15:54 | |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: CLI for resource classes https://review.openstack.org/511182 | 15:55 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: [WIP] RP list: member_of and resources parameters https://review.openstack.org/511183 | 15:55 |
| johnthetubaguy | dtantsur: the one you just linked too, that might be a bit of the picture I was missing | 15:55 |
| johnthetubaguy | dtantsur: once the resource class is updated, we stop reporting the vcpu mem and disk from ironic? | 15:55 |
| *** chyka has joined #openstack-nova | 15:56 | |
| dtantsur | johnthetubaguy: we don't, no. only if you remove 'cpus' key from node.properties | 15:56 |
| efried | cdent Actually the problem is that AllocationCandidates refuses to find anything in the shared RP as long as the compute node also has inventory in the same RC (DISK_GB). | 15:56 |
| dtantsur | which is what I tried doing in my testing | 15:56 |
| efried | alex_xu yt? | 15:57 |
| cdent | efried: are you based on alex’s stuff? that may be a semi-intentional holdover from the early policy of “we don’t do that” | 15:57 |
| johnthetubaguy | dtantsur: OK, I didn't know that was a thing, makes sense now, thanks. | 15:57 |
| cdent | in which case you’ve found a version (there are many) of the bug | 15:58 |
| efried | cdent Yes, I'm based on his in-flight patch to implement traits in allocation candidates. | 15:58 |
| efried | cdent Got a handy dashboard of placement bugs? This one is worth filing separately if we don't already have it. | 15:59 |
| dtantsur | so, back to the first bug. are there any options except for fixing the periodic task? I really don't know | 15:59 |
| *** sahid has joined #openstack-nova | 15:59 | |
| cdent | efried: just make a nova one tagged placement: https://bugs.launchpad.net/nova/+bugs?field.tag=placement | 15:59 |
| *** slaweq_ has quit IRC | 16:00 | |
| johnthetubaguy | dtantsur: we went through some, they all seem a lot worse, like calling into placement to correct the allocations after we migrate the instance flavor | 16:00 |
| efried | cdent Cool, but don't want to dup if there's already one out there. | 16:00 |
| efried | cdent Oh. That's the dashboard. Got it :) | 16:00 |
| *** andreas_s has joined #openstack-nova | 16:01 | |
| openstackgerrit | Merged openstack/nova-specs master: PCI NUMA Policies https://review.openstack.org/361140 | 16:01 |
| *** gjayavelu has joined #openstack-nova | 16:02 | |
| dtantsur | johnthetubaguy: okay.. wanna try to make a patch? at least you have a reproducer already | 16:05 |
| efried | cdent What do we call the "main" RP to distinguish it from the shared RPs? Today it's always the "compute node RP" - but do we have a generic name for it? | 16:05 |
| *** jmccarthy has joined #openstack-nova | 16:06 | |
| cdent | efried: we haven’t really settled on anything. alex_xu tried to use “root” in his stuff but that overlaps with nested | 16:06 |
| *** sridharg has quit IRC | 16:06 | |
| efried | cdent Right | 16:06 |
| efried | I'll use "compute node" for the sake of the bug, but eventually we should have a word. | 16:06 |
| cdent | the other one is the “sharing” rp, so maybe the main one is the “non-sharing” (that’s a bit weak though) | 16:07 |
| *** vks1 has quit IRC | 16:07 | |
| cfriesen | cdent: we could have multiple non-shared RPs per compute node, no? I think I remember hearing that some Intel folks were talking about creating a separate non-shared RP to provide L3 cache. | 16:09 |
| *** Apoorva has joined #openstack-nova | 16:09 | |
| cfriesen | if so then it's really the "nova compute node RP" or something like that. :) | 16:09 |
| openstackgerrit | John Garbutt proposed openstack/nova master: Keep updating allocations for Ironic https://review.openstack.org/513085 | 16:09 |
| johnthetubaguy | dtantsur: that is my first stab at it ^ | 16:09 |
| *** andreas_s has quit IRC | 16:09 | |
| cdent | cfriesen: non-sharing-root-provider is more complete then | 16:11 |
| cdent | was trying to leave that complexity out for mow | 16:11 |
| *** gszasz_ has quit IRC | 16:12 | |
| cfriesen | cdent: although in the case of L3 cache it would be properly modelled as a per-NUMA-node resource and would need nested providers. :) | 16:12 |
| *** salv-orlando has joined #openstack-nova | 16:12 | |
| cdent | let’s hope so | 16:13 |
| *** ijw has joined #openstack-nova | 16:14 | |
| *** andreas_s has joined #openstack-nova | 16:14 | |
| *** jgriffith has joined #openstack-nova | 16:15 | |
| edleafe | "greedy rp"? (i.e., not sharing) | 16:15 |
| *** mmehan has joined #openstack-nova | 16:15 | |
| *** lucasagomes is now known as lucas-afk | 16:15 | |
| *** baoli has quit IRC | 16:15 | |
| *** jgriffith has quit IRC | 16:15 | |
| mriedem | efried: dansmith: i went through https://review.openstack.org/#/c/510244/ for the granular allocation candidates request syntax, | 16:16 |
| mriedem | only sticking point right now is this means you can only specify one set of resource classes/traits which are spread across providers, right? | 16:16 |
| mriedem | because all numbered groups are applied to the same RP | 16:16 |
| efried | mriedem Correct. | 16:16 |
| efried | mriedem Why would you need more than... oh. | 16:16 |
| mriedem | i'm trying to think if that screws us later | 16:16 |
| efried | mriedem Actually, no, I think that's aight. | 16:17 |
| mriedem | i'm mostly worried about the shared storage scenario, | 16:17 |
| mriedem | which i know we're punting, but | 16:17 |
| *** salv-orlando has quit IRC | 16:17 | |
| *** amodi has quit IRC | 16:17 | |
| dansmith | wait, what? | 16:17 |
| dansmith | the point of this is you specifying traits/classes that go together | 16:17 |
| efried | mriedem Well, the spec deliberately leaves out shared RP semantics. | 16:17 |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/nova-specs master: Network bandwidth resource provider https://review.openstack.org/502306 | 16:18 |
| *** jgriffith has joined #openstack-nova | 16:18 | |
| efried | mriedem But we do have a couple of pretty big holes even without this, when it comes to traits + aggregates. | 16:18 |
| efried | I'm writing one up now :) | 16:18 |
| *** ttsiouts has quit IRC | 16:18 | |
| * dansmith actually reads the review | 16:19 | |
| dansmith | ah, I see | 16:19 |
| mriedem | so with shared storage, i think we wanted the scheduler to ask for vcpu/memory_mb and disk_gb, and we could get 2 providers back, | 16:19 |
| mriedem | one compute node RP for the vcpu/memory_mb, and one shared storage provider for the disk_gb | 16:19 |
| mriedem | scheduler would claim on both | 16:19 |
| dansmith | with this, | 16:19 |
| mriedem | maybe that still works ok with this new thing | 16:19 |
| mriedem | you request those in an unnumbered resources group | 16:19 |
| mriedem | so the resources can be spread across providers | 16:19 |
| dansmith | you could ask for resources2:DISK=1,required2=SHARED | 16:19 |
| dansmith | to make sure you get a shared disk, right? | 16:20 |
| mriedem | in previous thinking about shared storage i didn't think the flavor had to be specific as to the type of storage | 16:20 |
| dansmith | it doesn't have to be | 16:20 |
| mriedem | so like i said, i think we don't lose the ability to do what we can do today with an unnumbered request, | 16:21 |
| mriedem | you just can't have more than one unnumbered request | 16:21 |
| mriedem | but i can't think of any reason why that might be bad | 16:21 |
| efried | Correct. Except "what we can do today with an unnumbered request" is poorly defined and broken. | 16:21 |
| dansmith | um | 16:22 |
| dansmith | is there some special behavior assigned to resources= that isn't there for resourcesN=? | 16:22 |
| dansmith | I must have missed that if so | 16:22 |
| mriedem | also, now that i'm thinking about this, what is preventing placementing from returning 2 compute node providers, one that satisfies the vcpu requirement and one that satisfies the memory_mb requirement, scheduler claiming on both and the build failing? | 16:22 |
| efried | Sorry, by "today" I actually mean "not today at all". I mean when both traits and aggregates are considered. | 16:22 |
| mriedem | dansmith: my comment here https://review.openstack.org/#/c/510244/6/specs/queens/approved/granular-resource-requests.rst@230 | 16:23 |
| *** peter-hamilton has quit IRC | 16:23 | |
| dansmith | mriedem: ah, I see, I had read that first bullet differently I guess | 16:23 |
| *** gszasz_ has joined #openstack-nova | 16:23 | |
| dansmith | I read this as "if you only have one grouping" | 16:24 |
| *** alex_xu has quit IRC | 16:24 | |
| efried | "same tree" is the key there, mriedem. That's how you don't get VCPU and MEMORY_MB from separate computes. | 16:24 |
| *** Yingxin has quit IRC | 16:25 | |
| mriedem | ok so compute node today is a tree of 1 node | 16:25 |
| mriedem | the alpha and omega | 16:25 |
| *** salv-orlando has joined #openstack-nova | 16:25 | |
| efried | correct | 16:25 |
| mriedem | whew :) | 16:26 |
| efried | I would think we want to enforce that one allocation can only ever get resources from one tree plus zero or more shared-via-aggregate | 16:26 |
| mriedem | yeah i think so | 16:26 |
| mriedem | otherwise it gets crazy | 16:26 |
| efried | For the unnumbered group, the resources from one class are always from the same RP; but resources from different classes can be spread throughout the tree + aggregates | 16:26 |
| mriedem | i guess we never answered the question from the other day about whether or not a compute node provider can report both local disk_gb and disk_gb via a shared-with-aggregate storage pool | 16:27 |
| efried | For the numbered group, all resources are always from the same RP (one node within a tree)... but I don't know how aggregates come into play there. | 16:27 |
| efried | mriedem Just so. That's the bug I'm writing up now. As currently implemented, we ignore the aggregate if the compute node has DISK_GB. | 16:27 |
| efried | and I don't think that's the right answer, generally/long-term. | 16:28 |
| *** andreas_s has quit IRC | 16:28 | |
| mriedem | ah, yeah, i'd think we'd pull from the aggregate inventory | 16:28 |
| *** Yingxin has joined #openstack-nova | 16:28 | |
| *** links has quit IRC | 16:28 | |
| mriedem | since you're assuming that's a pool the operator wants you to use | 16:28 |
| efried | well, we should return candidates for both. | 16:28 |
| mriedem | maybe that becomes a traits tihng | 16:28 |
| efried | mriedem we're busted there too | 16:29 |
| efried | Because my compute RP can have e.g. RAID trait, and my shared RP can have e.g. SSD trait. | 16:29 |
| efried | But placement has no way to know that those should stick together. | 16:29 |
| efried | So if I ask for RAID+SSD, I'll get candidates, but I shouldn't. | 16:29 |
| efried | that was in fact the bug I was trying to express (by writing a test for it) when I discovered the previous. | 16:30 |
| *** baoli has joined #openstack-nova | 16:30 | |
| *** baoli has quit IRC | 16:30 | |
| mriedem | dansmith: so no major issues with you for this unnumbered resource limitation thing? | 16:30 |
| mriedem | as noted, it's no worse than what we have today | 16:31 |
| *** alex_xu has joined #openstack-nova | 16:31 | |
| dansmith | mriedem: no, I didn't have it in my head, but Idon't think it changes anything | 16:31 |
| dansmith | right | 16:31 |
| cfriesen | mriedem: efried: why would the compute node provider report the shared storage amounts? shouldn't it just report that it has access to a particular shared storage? | 16:31 |
| dansmith | I don't like the asymmetry, but I think we probably need to keep it to avoid breakage in the meantime | 16:31 |
| efried | cfriesen Nono, the compute node *has* local storage. | 16:31 |
| dansmith | it's really the resourcesN being different that I hadn't grokked | 16:31 |
| *** baoli has joined #openstack-nova | 16:32 | |
| efried | cfriesen So it's got a local disk, and it's also attached to a SAN or whatever. The former is reported in the compute node RP; the latter via the shared RP. | 16:32 |
| dansmith | what efried said | 16:32 |
| dansmith | that's not possible today, but should be eventually | 16:32 |
| *** markvoelker has quit IRC | 16:32 | |
| cfriesen | efired: yeah, that makes sense. mriedem's comment made it sound like the compute node RP was reporting on sizes of available shared storage | 16:33 |
| *** markvoelker has joined #openstack-nova | 16:33 | |
| mriedem | don't compute nodes that are getting storage from NFS today report disk_gb for the entire NFS cluster? | 16:34 |
| cfriesen | mreidem: yeah, and that's been a bug for a long time I think. | 16:34 |
| mriedem | so it makes it look like you have potentially 100 computes with 1TB of storage each, but not really | 16:34 |
| efried | https://bugs.launchpad.net/nova/+bug/1724613 < there's the first one. | 16:34 |
| openstack | Launchpad bug 1724613 in OpenStack Compute (nova) "AllocationCandidates.get_by_filters ignores shared RPs when the RC exists in both places" [Undecided,New] | 16:34 |
| cfriesen | incidentally, who updates the stats for the shared storage RP? is there an auditor somewhere? | 16:35 |
| mriedem | yeah so i wasn't sure how we are goign to fix the NFS disk reporting thing with shared providers, because the compute service is reporting that disk_gb | 16:35 |
| mriedem | cfriesen: was supposed to be external to nova | 16:35 |
| mriedem | like how neutron reports IP allocation pools | 16:35 |
| efried | mriedem Multiple compute services report the same inventory, but to the same RP, because the shared RP has a UUID that they can all agree on. | 16:36 |
| efried | I think that's what jaypipes update_inventory_if_needed thingy is for (or whatever it's called) | 16:36 |
| mriedem | efried: i don't think that's quite accurate | 16:36 |
| mriedem | each compute node get_inventory is going to report what it thinks it's local disk is, | 16:36 |
| mriedem | but it can't tell if it's shared or not | 16:36 |
| efried | We talking Q or later? | 16:37 |
| mriedem | this is why we have the 'is_shared_storage' ssh stuff during migration | 16:37 |
| mriedem | well, shared storage is not Q, so later, | 16:37 |
| mriedem | but this is why it's not Q, among other reasons | 16:37 |
| efried | Yeah, so each compute node happily reports all the storage, but the conductor (or whatever is doing the rollup) can see that those inventories are coming from the same RP, so it can report the total just once rather than adding it up. | 16:38 |
| *** sshwarts has quit IRC | 16:38 | |
| *** markvoelker has quit IRC | 16:38 | |
| dansmith | efried: mriedem right, computes will need to not report shared storage | 16:38 |
| efried | But wait, the compute node shouldn't be reporting inventory in the compute node RP for storage that's in an aggregate. | 16:38 |
| dansmith | not just report the same | 16:38 |
| efried | yeah, that % | 16:38 |
| dansmith | computes will report their storage if they have some, else none | 16:38 |
| openstackgerrit | Merged openstack/nova-specs master: Granular Resource Request Syntax https://review.openstack.org/510244 | 16:38 |
| mriedem | efried: the omputes aren't aware of hte aggregate | 16:38 |
| efried | dansmith So who's responsible for creating the shared storage RP and its inventory? | 16:39 |
| dansmith | efried: some storage agent | 16:39 |
| dansmith | like neutron does | 16:39 |
| mriedem | thinking back on pike issues, this was also a thing where the scheduler would claim disk_gb on the shared storage RP, but the compute would overwrite the instance disk_gb allocation against it's local compute node | 16:39 |
| cdent | mriedem: the rt has an aggregate map (as yet unused) | 16:39 |
| mriedem | because it wasn't aware of the aggregate relationship for disk | 16:39 |
| cdent | that was supposed to allow it to be able to report inventory correctly | 16:40 |
| cdent | once shared exists | 16:40 |
| mriedem | cdent: ah, fun | 16:40 |
| cdent | “fun” | 16:40 |
| mriedem | i remember working a patch for one afternoon late in pike rc time trying to sort out how to not get the rt to overwrite the shared disk allocation and it went down the hole fast | 16:40 |
| mriedem | involved basically reverse engineering the logic in placement and the scheduler, from the rt | 16:41 |
| cdent | wheeee! | 16:41 |
| mriedem | but, another reason why we don't want the RT trying to figure out allocations | 16:41 |
| cdent | the aggregate_map still leaves open the question of whether a compute node can have both local and shared, which, unsure | 16:41 |
| *** rushiagr has quit IRC | 16:41 | |
| *** andreas_s has joined #openstack-nova | 16:41 | |
| *** derekh has quit IRC | 16:42 | |
| mriedem | yeah idk, couldn't you mount an NFS share on a compute and configure the instance path to use that share, but leave root and everything else that's local disk for the OS and running nova-compute? | 16:42 |
| mriedem | like, i want all my instance and image crap to go in the NFS share | 16:42 |
| mriedem | leave local disk for everything else | 16:42 |
| *** mvk has quit IRC | 16:42 | |
| dansmith | there's lots of things that need to change on compute to make that duality possible | 16:43 |
| dansmith | the easiest to do today would be local disk + ceph I think, | 16:43 |
| *** gyee has joined #openstack-nova | 16:43 | |
| dansmith | since it's not fighting over /var/lib/instances | 16:43 |
| * dansmith imagines the above, but with correct grammar | 16:43 | |
| *** suresh12 has joined #openstack-nova | 16:44 | |
| mriedem | ok well this is why no shared storage support in queens :) | 16:44 |
| dansmith | cha | 16:44 |
| mriedem | granular request syntax spec approved | 16:44 |
| cdent | huzzah | 16:44 |
| dansmith | efried: get to work | 16:44 |
| * dansmith runs off for a bit | 16:44 | |
| efried | Thanks for that. (jaypipes should really read it at some point, since it was his idea.) | 16:45 |
| mriedem | artom: you want to start working on squashing https://review.openstack.org/#/c/512406/ into https://review.openstack.org/#/c/471356/ ? | 16:45 |
| *** AlexeyAbashkin has quit IRC | 16:47 | |
| *** vks1 has joined #openstack-nova | 16:48 | |
| *** suresh12 has quit IRC | 16:48 | |
| jmccarthy | Trying to figure out about using horizon to view instance console (instance on xen compute) - the console.log works, but not the console, any ideas ? | 16:50 |
| *** andreas_s has quit IRC | 16:50 | |
| *** Sukhdev has quit IRC | 16:50 | |
| *** andreas_s has joined #openstack-nova | 16:51 | |
| artom | mriedem, sure | 16:52 |
| artom | I wonder what'll come first - CI allowed you to merge it, or the next solar eclipse | 16:52 |
| mriedem | or me going to lunch | 16:54 |
| artom | Maybe you could eat the sun, two birds with one stone | 16:55 |
| *** andreas_s has quit IRC | 16:55 | |
| mriedem | i'm gonna need some psilocybin to pull that off | 16:56 |
| openstackgerrit | sean mooney proposed openstack/nova-specs master: Use neutron's new port binding API https://review.openstack.org/375580 | 16:56 |
| artom | That was awfully erudite way of asking for shrooms | 16:57 |
| *** jmlowe has quit IRC | 16:58 | |
| *** yikun has quit IRC | 16:59 | |
| openstackgerrit | Artom Lifshitz proposed openstack/nova stable/newton: Use VIR_DOMAIN_BLOCK_REBASE_COPY_DEV when rebasing https://review.openstack.org/471356 | 17:00 |
| artom | mriedem, ^^ | 17:00 |
| *** ralonsoh has quit IRC | 17:01 | |
| *** sdague has quit IRC | 17:04 | |
| *** ociuhandu has joined #openstack-nova | 17:10 | |
| *** jpena is now known as jpena|off | 17:11 | |
| *** Swami has joined #openstack-nova | 17:12 | |
| openstackgerrit | John Garbutt proposed openstack/nova master: Keep updating allocations for Ironic https://review.openstack.org/513085 | 17:13 |
| *** rha has quit IRC | 17:14 | |
| *** vvargaszte has joined #openstack-nova | 17:14 | |
| *** rushiagr has joined #openstack-nova | 17:14 | |
| *** suresh12 has joined #openstack-nova | 17:15 | |
| *** Swami has quit IRC | 17:15 | |
| *** Swami has joined #openstack-nova | 17:16 | |
| *** andreas_s has joined #openstack-nova | 17:18 | |
| *** rha has joined #openstack-nova | 17:19 | |
| *** rha has joined #openstack-nova | 17:19 | |
| *** suresh12 has quit IRC | 17:20 | |
| *** felipemonteiro_ has joined #openstack-nova | 17:20 | |
| *** felipemonteiro__ has joined #openstack-nova | 17:21 | |
| jmccarthy | Any ideas about how the console connection is setup to it can work via horizon ? (with instances on xen) | 17:21 |
| *** huanxie has joined #openstack-nova | 17:22 | |
| sean-k-mooney | stephenfin: just looked at https://review.openstack.org/#/c/361140/30. there are some minor inaccuacyies in the spec but nothing i care about enough to warrent updating now that its merged | 17:23 |
| *** Apoorva_ has joined #openstack-nova | 17:23 | |
| *** dtantsur is now known as dtantsur|afk | 17:24 | |
| *** lpetrut has quit IRC | 17:25 | |
| *** felipemonteiro_ has quit IRC | 17:25 | |
| *** Apoorva has quit IRC | 17:26 | |
| sean-k-mooney | jmccarthy: i belive with xen you can still use spice/vnc or xens own console | 17:26 |
| efried | cdent https://bugs.launchpad.net/nova/+bug/1724633 | 17:26 |
| openstack | Launchpad bug 1724633 in OpenStack Compute (nova) "AllocationCandidates.get_by_filters hits incorrectly when traits are split across the main RP and aggregates" [Undecided,New] | 17:26 |
| jmccarthy | sean-k-mooney: True, those do work (at least the xen console that I tried earlier). I was hoping to see about getting it going via horizon | 17:27 |
| sean-k-mooney | jmccarthy: connect it to horizon should work all you need to do is deploy the same proxy service on dom0 that you would use for kvm | 17:28 |
| sean-k-mooney | horrizon bassically uses a html5 canvas and a websocket to deliver the vnc/spice console | 17:29 |
| melwitt | looks like zuul was restarted again, so check to see if you need to recheck your patches | 17:29 |
| jmccarthy | sean-k-mooney: Not sure I follow here about proxy service that is needed on xen compute ? | 17:30 |
| *** suresh12 has joined #openstack-nova | 17:31 | |
| cdent | thanks efried will pay real attention a bit later | 17:31 |
| sean-k-mooney | jmccarthy: actully it does not need to be on the computes. for kvm we deploy nova_novncproxy on the contoler and it connect to the hypervisor vnc console and proxyies it to horizon via a websocket | 17:31 |
| *** andreas_s has quit IRC | 17:31 | |
| efried | cdent The bug doesn't have anything you don't already know. I'll post the reviews in a bit and poke ya. | 17:31 |
| cdent | s’cool, good to have on radar | 17:32 |
| jmccarthy | sean-k-mooney: Ah ok yep I have that - I have both types of computes in this setup actually | 17:32 |
| *** suresh12 has quit IRC | 17:33 | |
| *** amodi has joined #openstack-nova | 17:34 | |
| sean-k-mooney | jmccarthy: ya so backically in the nova compute nodes you have to add eitehr a vnc or spice section to the nova.conf or nova-compute.conf that points the hypervior at the proxy | 17:34 |
| sean-k-mooney | jmccarthy: somthing like this http://paste.openstack.org/show/624007/ | 17:34 |
| mriedem | need another specs core on this one https://review.openstack.org/#/c/509326/ | 17:34 |
| jmccarthy | sean-k-mooney: I think I have that tho ? The console in horizon is working for instances on kvm compute | 17:35 |
| sean-k-mooney | jmccarthy: is xen configured to use a xen console for guests or a vnc console. you will have to match them up | 17:35 |
| *** Sukhdev_ has quit IRC | 17:36 | |
| *** andreas_s has joined #openstack-nova | 17:36 | |
| sean-k-mooney | jmccarthy: are you using xen via libvirt | 17:38 |
| jmccarthy | sean-k-mooney: yep | 17:38 |
| sean-k-mooney | jmccarthy: if so dump the xml of the xen instance and check if its using vnc like kvm or is it using the xen console | 17:38 |
| sean-k-mooney | you have to pass the -c xen:// option to virsh to see the instance by default | 17:39 |
| sean-k-mooney | so virsh -c xen:// list then virsh -c xen:// dumpxml <domain name> | 17:39 |
| *** suresh12 has joined #openstack-nova | 17:39 | |
| jmccarthy | sean-k-mooney: I see this console bit ? http://paste.openstack.org/show/624009/ | 17:40 |
| sean-k-mooney | jmccarthy: can you show me the full xml | 17:41 |
| sean-k-mooney | jmccarthy: it should look something like http://paste.openstack.org/show/623903/ | 17:42 |
| jmccarthy | sean-k-mooney: http://paste.openstack.org/show/624010/ | 17:42 |
| sean-k-mooney | <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0' keymap='en-us'> | 17:42 |
| sean-k-mooney | <listen type='address' address='0.0.0.0'/> | 17:42 |
| sean-k-mooney | </graphics> | 17:42 |
| sean-k-mooney | so its using vnc | 17:42 |
| sean-k-mooney | so you need to configre the nova conf also for vnc | 17:43 |
| *** Apoorva_ has quit IRC | 17:44 | |
| *** gszasz_ has quit IRC | 17:44 | |
| *** Apoorva has joined #openstack-nova | 17:44 | |
| jmccarthy | sean-k-mooney: Oh I think vnc is off, spice is enabled | 17:45 |
| sean-k-mooney | jmccarthy: :) that would cause issues. vnc works better in general | 17:46 |
| *** sambetts is now known as sambetts|afk | 17:46 | |
| sean-k-mooney | at least via horizon | 17:46 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Test alloc candidates with same RC in cn & shared https://review.openstack.org/513149 | 17:47 |
| efried | cdent ^ thar she blows. | 17:47 |
| cdent | word | 17:47 |
| efried | mriedem dansmith ^ demonstrates those two bugs I mentioned earlier. | 17:47 |
| *** mvk has joined #openstack-nova | 17:48 | |
| jmccarthy | sean-k-mooney: Ok I have to re-jig this and try it again | 17:49 |
| jmccarthy | sean-k-mooney: Thanks :) ! | 17:49 |
| *** abhi89 has joined #openstack-nova | 17:49 | |
| *** catinthe_ has joined #openstack-nova | 17:53 | |
| *** catintheroof has quit IRC | 17:53 | |
| *** andreas_s has quit IRC | 17:54 | |
| *** sahid has quit IRC | 17:54 | |
| *** rodolof has quit IRC | 17:54 | |
| *** rodolof has joined #openstack-nova | 17:55 | |
| *** MVenesio has joined #openstack-nova | 17:56 | |
| *** lbragstad has quit IRC | 17:56 | |
| * edleafe notices that efried studied at the jaypipes school of variable naming | 17:58 | |
| *** catintheroof has joined #openstack-nova | 17:59 | |
| *** vks1 has quit IRC | 17:59 | |
| *** andreas_s has joined #openstack-nova | 17:59 | |
| *** vvargaszte has quit IRC | 18:00 | |
| *** ociuhandu has quit IRC | 18:00 | |
| *** catinthe_ has quit IRC | 18:01 | |
| *** avolkov`` has quit IRC | 18:01 | |
| *** baoli has quit IRC | 18:02 | |
| *** huanxie has quit IRC | 18:03 | |
| *** baoli has joined #openstack-nova | 18:04 | |
| *** ragiman has quit IRC | 18:04 | |
| *** catinthe_ has joined #openstack-nova | 18:05 | |
| *** catintheroof has quit IRC | 18:07 | |
| jmccarthy | sean-k-mooney: Oh actually it is vnc hmm | 18:08 |
| *** baoli has quit IRC | 18:13 | |
| dims | edleafe : ah ivy league school :) | 18:13 |
| edleafe | dims: :) | 18:14 |
| *** baoli has joined #openstack-nova | 18:14 | |
| *** catintheroof has joined #openstack-nova | 18:14 | |
| *** catinthe_ has quit IRC | 18:15 | |
| *** andreas_s has quit IRC | 18:16 | |
| *** lbragstad has joined #openstack-nova | 18:16 | |
| *** lpetrut has joined #openstack-nova | 18:19 | |
| *** AlexeyAbashkin has joined #openstack-nova | 18:19 | |
| *** Sukhdev has joined #openstack-nova | 18:20 | |
| *** AlexeyAbashkin has quit IRC | 18:24 | |
| *** tonygunk has quit IRC | 18:24 | |
| openstackgerrit | Elod Illes proposed openstack/nova master: Transform keypair.import notification https://review.openstack.org/513159 | 18:24 |
| *** andreas_s has joined #openstack-nova | 18:26 | |
| *** ijw has quit IRC | 18:27 | |
| *** Tom__ has joined #openstack-nova | 18:27 | |
| *** vvargaszte has joined #openstack-nova | 18:29 | |
| *** weshay is now known as weshay|ruck|brb | 18:30 | |
| openstackgerrit | melanie witt proposed openstack/nova master: DNM: Test websocketproxy with TLS https://review.openstack.org/513160 | 18:31 |
| *** slaweq_ has joined #openstack-nova | 18:33 | |
| *** sdague has joined #openstack-nova | 18:33 | |
| *** andreas_s has quit IRC | 18:33 | |
| efried | edleafe Where, in that test case? I was just following examples in the rest of the file. Thought I was mimicking alex_xu - but apparently he was mimicking jaypipes :) | 18:34 |
| openstackgerrit | melanie witt proposed openstack/nova master: DNM: Test websocketproxy with TLS https://review.openstack.org/513160 | 18:35 |
| efried | jaypipes I was about to start tackling the functional test failures in https://review.openstack.org/#/c/385693/ but don't want to step on you if you're on it. | 18:37 |
| *** slaweq_ has quit IRC | 18:37 | |
| *** jmccarthy has left #openstack-nova | 18:40 | |
| jaypipes | efried: looking.. | 18:40 |
| jaypipes | dims: that would be an i v lg schl | 18:41 |
| dims | LOL | 18:41 |
| jaypipes | dims: or, just to piss off edleafe and dansmith, it would be: | 18:43 |
| jaypipes | an | 18:43 |
| jaypipes | i | 18:43 |
| jaypipes | v | 18:43 |
| jaypipes | lg | 18:43 |
| jaypipes | schl | 18:43 |
| jaypipes | ) | 18:43 |
| *** markvoelker has joined #openstack-nova | 18:44 | |
| *** crushil has quit IRC | 18:46 | |
| * penick thinks winnie stepped on Jay's keyboard | 18:49 | |
| *** vvargaszte has quit IRC | 18:50 | |
| jaypipes | penick: :) | 18:50 |
| dansmith | penick: that's jay's coding style... "indistinguishable from dog-on-keyboard" | 18:51 |
| * dansmith kids | 18:51 | |
| jaypipes | :) | 18:52 |
| dansmith | it's like pep192 or something I think | 18:52 |
| jaypipes | pep8919280afiksjhf | 18:52 |
| dansmith | sounds more like it | 18:53 |
| edleafe | "dog_on_keyboard" sounds about right :) | 18:53 |
| jaypipes | heh | 18:53 |
| openstackgerrit | Merged openstack/nova master: placement: set/check if inventory change in tree https://review.openstack.org/470575 | 18:54 |
| efried | woot^ | 18:54 |
| efried | next... | 18:54 |
| jaypipes | efried: so, can you brief me on any changes, if any, you made in the n-r-p series please? | 18:55 |
| jaypipes | efried: just rebases or anything functional? | 18:55 |
| efried | jaypipes Almost entirely rebases, fixing nits, a couple of bugs. I don't think there was anything functional - lemme skim real quick... | 18:56 |
| jaypipes | efried: I'm gonna pull the top patch (385693) and run tests locally. | 18:56 |
| jaypipes | kk | 18:56 |
| openstackgerrit | Chris Dent proposed openstack/nova master: [placement] manage cache headers for resource classes https://review.openstack.org/513161 | 18:56 |
| edleafe | jaypipes: I know you got a ton to catch up with, but the alternate hosts series is ready for review, starting with https://review.openstack.org/#/c/486215/ | 18:56 |
| jaypipes | edleafe: rock on, will do that as soon as I get those tests running. | 18:56 |
| efried | jaypipes Okay, should I assume you're taking the reins back at this point, or do you want to do some pair dev on that series? | 18:56 |
| jaypipes | efried: oh, I can take it over again, no prob. | 18:57 |
| efried | jaypipes I'm totally prepared to fix those test cases if you have more important (or jaypipes-needin) things to do. | 18:57 |
| jaypipes | efried: nope, I'm good to take it back | 18:57 |
| jaypipes | appreciate you, edleafe and dansmith pushing on this while I was off | 18:57 |
| efried | jaypipes At some point you should give https://review.openstack.org/#/c/510244/ a once-over, make sure it gels with what you conceived at the PTG. | 18:59 |
| jaypipes | efried: yep, it's near the top of my queue. | 19:00 |
| efried | coo | 19:00 |
| *** tbachman has quit IRC | 19:02 | |
| efried | jaypipes The only changes of any substance were: 1) https://review.openstack.org/#/c/377138/50..51/nova/objects/resource_provider.py -- please double-check me to make sure I referenced the exception from the right spot | 19:02 |
| efried | jaypipes 2) https://review.openstack.org/#/c/377215/48/nova/objects/resource_provider.py@1275 moved no-op reformatting stuff to a new patch | 19:03 |
| efried | jaypipes That's it. The rest were rebases & spelling. | 19:04 |
| jaypipes | efried: coolio. thx. | 19:05 |
| mriedem | dansmith: this newton backport of artom's looks good to me now https://review.openstack.org/#/c/471356/ - it's kind of a frankenpatch with squashes but does the job | 19:05 |
| mriedem | would be the last one for newton before we release and tag for eol | 19:05 |
| * dansmith looks | 19:05 | |
| *** ociuhandu has joined #openstack-nova | 19:06 | |
| efried | jaypipes And as soon as you come up for air, would like your input on the possibility of ripping out some of the existing aggregate code until we can figure out how tf it's ever going to work with traits & nested & numbered. | 19:07 |
| jaypipes | efried: well, on that, if it isn't currently affecting anything (other than read queries which cdent has patches up to address perf issues), I'd just as soon leave it be for now. We have lots of other things to get done by SYD | 19:08 |
| dansmith | yeah | 19:08 |
| dansmith | me too | 19:08 |
| efried | jaypipes That's just it: it very well may be affecting "things". | 19:08 |
| *** slaweq_ has joined #openstack-nova | 19:08 | |
| jaypipes | efried: well, I'm perfectly happy to see your thoughts on it. just not a huge priority unless you can show me it's causing bugs. | 19:10 |
| jaypipes | efried: besides the general "tech debt bugs" which I certainly admit there are many. | 19:10 |
| jaypipes | ok, lemme read this granular spec :) | 19:10 |
| mriedem | dansmith: john put up a patch for the ironic flavor migratoin allocatoins thing https://review.openstack.org/#/c/513085/2 | 19:13 |
| mriedem | seems ok to me | 19:13 |
| dansmith | mriedem: yeah, sorry, I'm just behind | 19:14 |
| *** suresh12 has quit IRC | 19:14 | |
| mriedem | np, i just got back from running errands | 19:14 |
| mriedem | your context targeting thing in pike is also happy for ci now https://review.openstack.org/#/c/512456/ | 19:15 |
| mriedem | sdague: ^ we need to get that released soon | 19:15 |
| dansmith | okay I can hit that one quick | 19:16 |
| dansmith | because I know it's perfect | 19:16 |
| mriedem | :) | 19:17 |
| *** weshay|ruck|brb is now known as weshay|ruck | 19:18 | |
| *** edand has quit IRC | 19:18 | |
| *** AlexeyAbashkin has joined #openstack-nova | 19:19 | |
| *** huanxie has joined #openstack-nova | 19:19 | |
| sdague | mriedem: yeh, that seems fine. I wasn't originally sure that the sc reinflates over that, but it looks like it does | 19:21 |
| *** AlexeyAbashkin has quit IRC | 19:24 | |
| efried | cdent What was the thing where you could modify an allocations/{consumer_uuid} - is that gonna be via PUT or POST? | 19:26 |
| melwitt | mriedem: have you seen live migration job fails like this before? raises InstanceNotFound because of VIR_ERR_NO_DOMAIN? https://github.com/openstack/nova/blob/stable/ocata/nova/virt/libvirt/host.py#L553 | 19:26 |
| cdent | efried: that’s always PUT, and it always replaces | 19:26 |
| cdent | the post version is in progress at: https://review.openstack.org/#/c/500073/ | 19:27 |
| efried | cdent Okay. I'm looking at your schema here https://review.openstack.org/#/c/510625/7/nova/api/openstack/placement/handlers/allocation.py and I think it's a little strict. Will see if you "fixed" it via ^. | 19:27 |
| melwitt | mriedem: the "target build notification" patch for ocata failed the live migration job on that and I was wondering if it's just something to recheck or if it's something more | 19:27 |
| cdent | efried: strict how? (entirely possible my jsonschema fu doesn’t allow for handstands) | 19:28 |
| *** jdavis has joined #openstack-nova | 19:28 | |
| efried | cdent I think you might have done it, but still pondering. Basically by saying minProperties=1 in a couple places, you would be disallowing resources: {} which was (I thought) how you would say you're deleting those pieces of the allocation. | 19:28 |
| efried | Though I guess omitting that chunk entirely would also work, since it's replacing. | 19:29 |
| efried | So maybe moot. | 19:29 |
| cdent | minProperties is disallowing anything other than the resource provider keyed object | 19:29 |
| cdent | which is required on PUT, but will not be required on POST | 19:30 |
| mriedem | melwitt: was just looking at that one | 19:30 |
| efried | cdent So what's the POST supposed to do? Oh, allow you to modify allocations for multiple consumers at once? | 19:30 |
| mriedem | melwitt: it's this http://logs.openstack.org/25/511325/1/check/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/5130700/logs/libvirt/qemu/instance-00000004.txt.gz | 19:31 |
| mriedem | known issue | 19:31 |
| mriedem | qemu-system-x86_64: /build/qemu-GGGtkw/qemu-2.8+dfsg/block/io.c:1514: bdrv_co_pwritev: Assertion `!(bs->open_flags & BDRV_O_INACTIVE)' failed. | 19:31 |
| melwitt | okay. I looked at it earlier and it's not related to that patch but I hesitated to blindly recheck | 19:31 |
| *** salv-orlando has quit IRC | 19:31 | |
| cdent | efried: yes, so the the migration uuid stuff that dansmith has is not racey | 19:31 |
| * efried is up to speed now. Thanks cdent. | 19:31 | |
| melwitt | mriedem: cool, thanks | 19:31 |
| mriedem | melwitt: https://bugs.launchpad.net/nova/+bug/1706377 | 19:31 |
| openstack | Launchpad bug 1706377 in OpenStack Compute (nova) "(libvirt) live migration fails on source host due to "Assertion `!(bs->open_flags & BDRV_O_INACTIVE)' failed."" [Undecided,Confirmed] | 19:31 |
| mriedem | we can't fingerprint that in e-r because the failure is in the qemu instance logs, which we don't index | 19:32 |
| melwitt | gotcha | 19:32 |
| jaypipes | efried: k, just read the granular resource requests spec. lgtm. | 19:34 |
| efried | jaypipes Cool, thanks for going through it. | 19:35 |
| *** salv-orlando has joined #openstack-nova | 19:35 | |
| efried | cdent Is there a patch somewhere that's adding the project_id/user_id to the GET /allocations/{consumer_uuid} response? | 19:35 |
| cdent | yeah, it’s an antecedent to the thing that adds the schema: https://review.openstack.org/#/c/500073/ | 19:36 |
| cdent | sorry wrong paste | 19:36 |
| cdent | https://review.openstack.org/#/c/512420/ | 19:36 |
| mriedem | melwitt: now you just need to find another stable core to approve it :) | 19:38 |
| efried | cdent Okay, and where does the api-ref get updated? | 19:38 |
| efried | cdent This sucker: https://developer.openstack.org/api-ref/placement/#list-allocations | 19:38 |
| mriedem | efried: https://github.com/openstack/nova/tree/master/placement-api-ref/source ? | 19:38 |
| mriedem | or the actual infra that updates the page? | 19:39 |
| cdent | efried: it’s not done yet. I haven’t decided where to put it. Could go in a more generic https://review.openstack.org/#/c/510626/ | 19:39 |
| cdent | efried: so please feel free to put a -1 somewhere in there that says “oi, you’ve not done the docs yet" | 19:40 |
| *** suresh12 has joined #openstack-nova | 19:40 | |
| efried | cdent Okay, cool, that's what I wanted to know. (mriedem specifically the doc change that adds the project/user id to that api-ref piece) | 19:40 |
| cdent | efried: thanks for the attention to detail, the content of that stack has expanded a lot since I started, so some steps have been lost | 19:42 |
| efried | cdent Swhat I'm here for. Eventually I'll be useful for something other than pointing out typos and missed paperwork. | 19:42 |
| dansmith | efried: don't forget rebasing | 19:43 |
| efried | Mm | 19:43 |
| dansmith | you can rebase a mofo like a sonofabee | 19:43 |
| *** mlavalle has joined #openstack-nova | 19:44 | |
| mriedem | sdague: can you get this pike backport and the one below? | 19:44 |
| mlavalle | mriedem: any chance we can get nova team eyes on the lastest revisions of https://review.openstack.org/#/c/375580/ and https://review.openstack.org/#/c/502306/ | 19:45 |
| dansmith | edleafe: cdent: so that limits or {} thing.. limits is nullable in reqspec.. are we sure we need do that thing? | 19:45 |
| dansmith | also, I'm not clear on what part of this series requires this when we didn't before | 19:46 |
| * dansmith bets edleafe is super glad he's bringing this one line change up again | 19:46 | |
| mriedem | mlavalle: honestly i think the bandwidth provider thing is not going to happen in queens | 19:46 |
| mriedem | given the various dependencies and overall complexity | 19:46 |
| *** csuttles_ has quit IRC | 19:47 | |
| mlavalle | mriedem: dependencies meaning functionality that is being developed in the Nova side? | 19:47 |
| mriedem | mlavalle: yes | 19:47 |
| mriedem | there are some major challenges to overcome before we can even get to bandwidth provider | 19:48 |
| mriedem | mlavalle: for example, it relies on the compute pushing the bandwidth allocations and we're moving away from the computes trying to create allocations | 19:48 |
| *** huanxie has quit IRC | 19:50 | |
| openstackgerrit | Chris Dent proposed openstack/nova master: [placement] manage cache headers for usages https://review.openstack.org/513174 | 19:53 |
| edleafe | dansmith: it caused multiple unit test failures without the 'or {} | 19:54 |
| edleafe | dansmith: not sure if the change back to including limits makes that no longer the case. | 19:54 |
| dansmith | edleafe: lol. well we should put that in the comment then, eh? | 19:55 |
| dansmith | edleafe: I'd like to understand why we're making that change if we are | 19:55 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: placement: adds REST API for nested providers https://review.openstack.org/384807 | 19:55 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: placement: update client to set parent provider https://review.openstack.org/385693 | 19:55 |
| jaypipes | efried: fixed. ^ | 19:55 |
| cdent | goodnight all | 19:56 |
| *** cdent has quit IRC | 19:56 | |
| mriedem | gdi i hate reviewing specs in new gerrit | 19:57 |
| *** crushil has joined #openstack-nova | 19:57 | |
| mriedem | jumps all over the place when trying to expand comments | 19:57 |
| jaypipes | mriedem: yuuuuup. drives me friggin nuts. | 19:57 |
| *** slaweq_ has quit IRC | 19:57 | |
| *** penick has quit IRC | 19:57 | |
| mriedem | firefox? | 19:57 |
| jaypipes | yup. | 19:57 |
| edleafe | dansmith: re-running tests with that change reverted - will let you know | 19:58 |
| dansmith | edleafe: thanks | 19:58 |
| dansmith | mriedem: jaypipes not just in firefox | 19:58 |
| dansmith | mriedem: left one nit and one real comment in johnthetubaguy's ironic patch | 19:59 |
| dansmith | I can fix the nit (and the functional bit too I guess) if you agree | 19:59 |
| *** xyang1 has quit IRC | 19:59 | |
| *** armax has quit IRC | 19:59 | |
| *** lpetrut has quit IRC | 20:00 | |
| *** lpetrut has joined #openstack-nova | 20:00 | |
| *** penick has joined #openstack-nova | 20:01 | |
| mriedem | replied | 20:01 |
| *** salv-orlando has quit IRC | 20:02 | |
| *** salv-orlando has joined #openstack-nova | 20:02 | |
| *** gjayavelu has quit IRC | 20:04 | |
| dansmith | mriedem: I do it in with statements because python requires it :P | 20:05 |
| *** yamahata has joined #openstack-nova | 20:05 | |
| dansmith | mriedem: so you think we have no other situations other than moves that ironic doesn't support where we don't want said stomping? | 20:06 |
| *** gyee has quit IRC | 20:07 | |
| *** salv-orlando has quit IRC | 20:07 | |
| mriedem | my brain is kind of fried, | 20:08 |
| mriedem | at this point, you're likely to blow your foot off either way | 20:08 |
| mriedem | because of the minefield i mean | 20:08 |
| mriedem | the stomp was really because of moves from ocata to pike nodes i thought, scheduler would claim on both (double stuff) and ocata periodic would overwrite the allocations created by the scheduler, | 20:09 |
| mriedem | and then the dest node would overwrite the allocations again once the move was done | 20:09 |
| mriedem | you can't resize, live migrate or unshelve an ironic instance | 20:09 |
| mriedem | and with evacuate, the source host isn't running the stomper | 20:09 |
| *** gjayavelu has joined #openstack-nova | 20:09 | |
| *** abhi89 has quit IRC | 20:10 | |
| dansmith | alright | 20:11 |
| mriedem | i could be missing something | 20:12 |
| mriedem | like i said, minefield | 20:12 |
| *** MVenesio has quit IRC | 20:12 | |
| mriedem | seinfeld minefield | 20:12 |
| *** pchavva has quit IRC | 20:12 | |
| *** vvargaszte has joined #openstack-nova | 20:12 | |
| mriedem | "what's the deal with all these allocations?!" | 20:12 |
| *** esberglu has quit IRC | 20:14 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Keep updating allocations for Ironic https://review.openstack.org/513085 | 20:14 |
| *** esberglu has joined #openstack-nova | 20:15 | |
| *** awaugama has quit IRC | 20:15 | |
| mriedem | omfg, | 20:15 |
| mriedem | dansmith: jaypipes: change the rendering setting to 'slow' | 20:16 |
| mriedem | seems to help | 20:16 |
| mriedem | smcginnis: ++ | 20:16 |
| smcginnis | mriedem: It helped even more in the last gerrit. This one has some more quirks, but I think it's better. | 20:17 |
| dansmith | I don't even know what that would mean, but... cool | 20:17 |
| *** openstackgerrit has quit IRC | 20:17 | |
| *** lpetrut has quit IRC | 20:17 | |
| mriedem | gerrit settings | 20:18 |
| dansmith | I mean I dunno what fast rendering would be | 20:18 |
| *** vvargaszte has quit IRC | 20:18 | |
| dansmith | it all seems pretty slow to me :) | 20:18 |
| *** salv-orlando has joined #openstack-nova | 20:18 | |
| mriedem | they should rename the setting to "stop fucking up my gd cursor placement fucker" | 20:19 |
| mriedem | i agree | 20:19 |
| *** eharney has quit IRC | 20:19 | |
| *** esberglu has quit IRC | 20:19 | |
| mriedem | efried: thanks for helping to review this https://review.openstack.org/#/c/502306/ | 20:20 |
| mriedem | it's definitely hairy | 20:20 |
| efried | mriedem phew, thought I was just being dense. | 20:20 |
| smcginnis | mriedem: +1 to that name, it would be much more accurate. | 20:21 |
| mriedem | no man, it's building on like all of the worst things | 20:21 |
| mriedem | port orchestration, nested resource providers, scheduling, neutron agent stuff, etc etc | 20:21 |
| *** Sukhdev has quit IRC | 20:21 | |
| *** acormier has joined #openstack-nova | 20:22 | |
| *** liverpooler has quit IRC | 20:22 | |
| *** acormier has joined #openstack-nova | 20:22 | |
| *** smatzek has quit IRC | 20:24 | |
| *** smatzek has joined #openstack-nova | 20:25 | |
| *** smatzek_ has joined #openstack-nova | 20:27 | |
| mriedem | sean-k-mooney: in https://review.openstack.org/#/c/502306/ - so when nova binds a port to a selected host, neutron will put some kind of allocation information in the port binding profile, and nova will proxy that allocation information to placement? | 20:29 |
| mriedem | and the suggested flow is: | 20:29 |
| mriedem | 1. conductor asks scheduler for a host | 20:29 |
| *** smatzek has quit IRC | 20:29 | |
| mriedem | 2. scheduler filter looks for ports with a qos policy and if found, gets allocatoin candidates for hosts that have a nested bw provider | 20:29 |
| mriedem | 3. scheduler returns host to conductor | 20:29 |
| mriedem | 4. conductor binds the port to the host | 20:30 |
| mriedem | 5. the bound port profile has some allocation juju that nova proxies to placement as an allocation request for the port on the bw provider | 20:30 |
| mriedem | 6. conductor sends to compute to build the instance | 20:30 |
| mriedem | 7. compute activates the bound port | 20:30 |
| mriedem | 8. compute plugs vifs | 20:30 |
| mriedem | 9. profit?! | 20:30 |
| *** smatzek_ has quit IRC | 20:31 | |
| mriedem | why can't the allocation juju happen on the neutron side when the port is bound | 20:31 |
| mriedem | ? | 20:31 |
| *** suresh12 has quit IRC | 20:33 | |
| mriedem | i seem to remember some discussion at the ptg about it being cool that nova will proxy the allocation creation for neutron, but i'm not sure why | 20:33 |
| mriedem | mlavalle: ^ do you remember? | 20:33 |
| mriedem | ultimately we don't want nova managing resource allocations for network things | 20:34 |
| *** esberglu has joined #openstack-nova | 20:34 | |
| mriedem | especially out of band things like qos policies in neutron | 20:34 |
| *** armax has joined #openstack-nova | 20:35 | |
| efried | mriedem This may be slightly off topic, but who will be the consumer of the allocations related to the port? The port itself, or the instance? | 20:36 |
| *** tpatzig_ has joined #openstack-nova | 20:37 | |
| mriedem | i think the port | 20:38 |
| *** tpatzig_ has quit IRC | 20:39 | |
| *** suresh12 has joined #openstack-nova | 20:39 | |
| *** esberglu has quit IRC | 20:39 | |
| *** esberglu has joined #openstack-nova | 20:40 | |
| mriedem | it's a bit confusing in the spec | 20:40 |
| mriedem | "A virtual machine port can consume bandwidth from one of these Resources | 20:40 |
| mriedem | Providers." | 20:40 |
| mriedem | and | 20:40 |
| mriedem | "By the time the port is bound, the bandwidth allocated to the instance is already recorded." | 20:40 |
| sdague | mriedem: I looked at the stable stuff, should be good. You still need somone else on the top patch | 20:40 |
| mriedem | sdague: yeah, thanks - i can find someone | 20:40 |
| mriedem | someone named dan | 20:41 |
| dansmith | link m | 20:41 |
| dansmith | e | 20:41 |
| *** esberglu has quit IRC | 20:41 | |
| *** esberglu has joined #openstack-nova | 20:41 | |
| mriedem | can't find it | 20:42 |
| dansmith | offer expires in 3....2... | 20:42 |
| mriedem | dansmith: https://review.openstack.org/#/c/512716/ | 20:43 |
| *** gouthamr has quit IRC | 20:43 | |
| *** tssurya_ has joined #openstack-nova | 20:48 | |
| efried | mriedem The port is actually the only thing that makes sense. | 20:48 |
| efried | Otherwise we would either have to a) allocate the network resources and the other instance resources at the same time, i.e. from the scheduler; or b) overwrite the allocation from the scheduler so it goes from [just the port] to [port plus other instance resources] | 20:49 |
| efried | Either one of those things would be pretty weird. | 20:50 |
| efried | mm, maybe a) wouldn't be so weird. | 20:50 |
| mriedem | the spec is proposing that we do (a) | 20:52 |
| mriedem | it's saying the neutron agent populates the bw provider inventory, | 20:53 |
| mriedem | and when nova binds a port to a host, neutron will return information about the allocation in the binding profile, | 20:53 |
| mriedem | and nova will create the allocation in placement for the port on the bw resource class on behalf of neutron | 20:53 |
| mriedem | that's what i don't agree with | 20:53 |
| *** catintheroof has quit IRC | 20:53 | |
| mriedem | we don't want nova-compute managing port bw allocations | 20:53 |
| *** catintheroof has joined #openstack-nova | 20:54 | |
| mriedem | which also means nova would then be responsible for removing allocatoins when migrating the instance to another host | 20:54 |
| mriedem | i'm suggesting that neutron manage the allocatoins when the port is bound or unbound, which is triggered by nova | 20:54 |
| *** sbezverk has quit IRC | 20:54 | |
| mriedem | if the allocation on the neutron side fails, the port binding fails and we have to reschedule with another host providing bw resources | 20:54 |
| mriedem | if we do the port binding in the conductor, then that reschedule isn't as expensive as doing it in the compute | 20:55 |
| mriedem | but that also means this depends on picking up johnthetubaguy's network-aware scheduling stuff to move port creation etc to conductor | 20:55 |
| mriedem | so let's recap - deps are nested RPs, port binding API integration in nova, prep for nw aware scheduling, plus some API changes in neutron | 20:56 |
| mriedem | == me telling mlavalle it's probably DOA for queens | 20:56 |
| *** andreas_s has joined #openstack-nova | 20:57 | |
| *** tbachman has joined #openstack-nova | 20:57 | |
| *** catintheroof has quit IRC | 20:58 | |
| melwitt | are we having a cells meeting today or no? | 21:01 |
| mriedem | umm | 21:02 |
| mriedem | i forgot | 21:02 |
| mriedem | don't think we have much to talk about do we? | 21:02 |
| mriedem | need reviews on alternate hosts | 21:02 |
| melwitt | I don't, but just wanted to ask in case I missed something | 21:02 |
| mriedem | and dan has one more thing for the efficient instance listing weirdness with cell0 | 21:02 |
| mriedem | i think i tipped dan over with one too many stable reviews | 21:03 |
| melwitt | heh | 21:03 |
| *** suresh12 has quit IRC | 21:03 | |
| tssurya_ | so that means no meeting right ? | 21:03 |
| *** suresh12 has joined #openstack-nova | 21:04 | |
| *** thorst has quit IRC | 21:04 | |
| melwitt | tssurya_: yeah, I guess so. did you have anything you wanted to talk about or bring to attention? | 21:04 |
| tssurya_ | melwitt : nothing in particular | 21:05 |
| melwitt | k, me either | 21:05 |
| tssurya_ | melwitt : just wanted to discuss about this : https://bugs.launchpad.net/nova/+bug/1724621 which we can do in the channel I guess | 21:05 |
| openstack | Launchpad bug 1724621 in OpenStack Compute (nova) "nova-manage cell_v2 verify_instance returns a valid instance mapping even after the instance is deleted" [Undecided,New] - Assigned to Surya Seetharaman (tssurya) | 21:05 |
| *** andreas_s has quit IRC | 21:06 | |
| dansmith | whoa | 21:06 |
| dansmith | sorry I apparently hit dismiss earlier on my cells reminder | 21:06 |
| dansmith | and then got distracted | 21:06 |
| dansmith | mriedem: tssurya_ melwitt sorry about that | 21:06 |
| tssurya_ | melwitt : saw your comment, | 21:06 |
| *** andreas_s has joined #openstack-nova | 21:06 | |
| tssurya_ | dansmith : no problem :) | 21:07 |
| dansmith | I literally did my errands earlier so I'd be around for it, | 21:07 |
| dansmith | and then one click spoiled it all :) | 21:07 |
| dansmith | tssurya_: did your patch merge? | 21:07 |
| tssurya_ | dansmith : yes it did :D | 21:07 |
| dansmith | sweet | 21:07 |
| efried | mriedem Okay, you may want to call out https://review.openstack.org/#/c/502306/13/specs/queens/approved/bandwidth-resource-provider.rst@304 specifically then. It says the conductor is handling the resource classes and allocations. | 21:08 |
| dansmith | tssurya_: so regarding the bug above, melwitt is right, we can't remove those instance mappings until the instance is removed from the cell db | 21:08 |
| dansmith | tssurya_: however, there's a work item that needs to be done if you're looking for another thing to work on | 21:08 |
| mriedem | efried: i did elsewhere above | 21:09 |
| dansmith | tssurya_: (related to this I mean) | 21:09 |
| efried | Oh, dansmith is in stable easy +A mode? https://review.openstack.org/#/c/510957/ you're welcome | 21:09 |
| mriedem | heh | 21:09 |
| tssurya_ | dansmith : sure but is there a way to remove the instances ? | 21:09 |
| dansmith | efried: haven't I approved enough stuff for you lately? | 21:09 |
| mriedem | tssurya_: yeah, nova-manage db archive_deleted_rows | 21:09 |
| dansmith | tssurya_: yes, that's the work item :) | 21:09 |
| dansmith | mriedem: DUDE | 21:09 |
| dansmith | mriedem: let me tell the stoy | 21:09 |
| dansmith | *story | 21:09 |
| tssurya_ | just like we now have a way to remove the hosts https://review.openstack.org/#/c/510324/ | 21:09 |
| efried | dansmith "for me"? It's all "for nova"! | 21:09 |
| mriedem | oh, oops | 21:09 |
| efried | There is no efried. Only zuulv3 | 21:09 |
| mriedem | well gather round children, | 21:10 |
| mriedem | it's uncle dan's story time | 21:10 |
| *** gyee has joined #openstack-nova | 21:10 | |
| dansmith | tssurya_: so we remove instances once they're marked as deleted by "archiving" them with the command that mriedem mentioned | 21:10 |
| mriedem | long ago in a land called north carolina lived a boy named dan | 21:10 |
| *** gyee has quit IRC | 21:10 | |
| *** andreas_s has quit IRC | 21:11 | |
| dansmith | tssurya_: that moves them from the instances table to shadow_instances, where there are no constraints and then they can be deleted or dumped out to an archive log or something | 21:11 |
| dansmith | tssurya_: right now, if you do this, you leave instance mappings for those instances which are no longer there forever, which is bad | 21:11 |
| tssurya_ | mriedem, dansmith : I have seen the review of this nova-manage db archive_deleted_rows | 21:11 |
| *** gyee has joined #openstack-nova | 21:11 | |
| dansmith | tssurya_: while they're deleted=yes, they need their mapping, but once they get archived, the mapping should go away | 21:11 |
| *** jdavis has quit IRC | 21:11 | |
| *** gyee has quit IRC | 21:11 | |
| dansmith | tssurya_: so that archive command needs to follow up after the archival by deleting instance mappings from the api database | 21:11 |
| dansmith | tssurya_: if you want to fix that since you're familiar with nova-manage now, that would be super awesome | 21:12 |
| dansmith | generations of DBAs will thank you for years to come | 21:12 |
| tssurya_ | dansmith : yes please would love to do it | 21:12 |
| dansmith | woot ;) | 21:12 |
| mriedem | uh, deleted=id | 21:12 |
| mriedem | derp | 21:12 |
| mriedem | c'mon | 21:12 |
| dansmith | mriedem: in the object, it's boolean, c'mon | 21:13 |
| mriedem | oh sheesh | 21:13 |
| dansmith | tssurya_: you could re-use your bug for this, just maybe add a comment or change the title slightly to s/deleted/archived/ | 21:13 |
| mriedem | once you've mastered removing instance mappings for super gone instances, | 21:13 |
| mriedem | you can do the same for request specs | 21:13 |
| dansmith | oh yeah, tssurya_ you should delete the reqspec at the same time | 21:13 |
| dansmith | good call | 21:14 |
| tssurya_ | dansmith, mriedem : yes shall do ; its this one ? https://bugs.launchpad.net/nova/+bug/1678056 | 21:14 |
| openstack | Launchpad bug 1678056 in OpenStack Compute (nova) "RequestSpec records are never deleted when destroying an instance" [High,In progress] - Assigned to Sylvain Bauza (sylvain-bauza) | 21:14 |
| dansmith | tssurya_: yep | 21:14 |
| *** john5223 has quit IRC | 21:14 | |
| mriedem | yeah | 21:14 |
| dansmith | tssurya_: you'll also have bauzas' gratitude for finishing his unfinished work :P | 21:15 |
| tssurya_ | dansmith , mriedem : will get them done then :D | 21:15 |
| dansmith | \o/ | 21:15 |
| mriedem | thanks | 21:15 |
| mriedem | also, my porch is suddenly full of wasps and spiders and i need someone to take care of that for me | 21:15 |
| mriedem | although it is kind of spooky just in time for halloween | 21:15 |
| *** john5223 has joined #openstack-nova | 21:15 | |
| *** salv-orlando has quit IRC | 21:16 | |
| *** salv-orlando has joined #openstack-nova | 21:18 | |
| *** ijw has joined #openstack-nova | 21:18 | |
| *** AlexeyAbashkin has joined #openstack-nova | 21:19 | |
| *** suresh12 has quit IRC | 21:20 | |
| *** gouthamr has joined #openstack-nova | 21:20 | |
| *** salv-orlando has quit IRC | 21:21 | |
| *** suresh12 has joined #openstack-nova | 21:21 | |
| *** salv-orlando has joined #openstack-nova | 21:23 | |
| *** smatzek has joined #openstack-nova | 21:23 | |
| *** ociuhandu has quit IRC | 21:24 | |
| *** AlexeyAbashkin has quit IRC | 21:24 | |
| *** andreas_s has joined #openstack-nova | 21:25 | |
| mlavalle | mriedem: I responded to your comment in the spec | 21:25 |
| mlavalle | I don't recall either that conversation during the PTG, but your feedback in the spec makes sense | 21:26 |
| *** eharney has joined #openstack-nova | 21:26 | |
| *** acormier has quit IRC | 21:27 | |
| *** andreas_s has quit IRC | 21:29 | |
| *** Sukhdev has joined #openstack-nova | 21:29 | |
| *** openstackgerrit has joined #openstack-nova | 21:30 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Service user token requested with no auth https://review.openstack.org/512329 | 21:30 |
| *** chyka has quit IRC | 21:32 | |
| mriedem | mlavalle: looks like the spec was based on the notes in https://etherpad.openstack.org/p/placement-nova-neutron-queens-ptg | 21:33 |
| mriedem | and i asked in there about the proxy thing too | 21:33 |
| * mlavalle looking | 21:35 | |
| *** baoli has quit IRC | 21:35 | |
| *** peter-hamilton has joined #openstack-nova | 21:35 | |
| openstackgerrit | Chris Dent proposed openstack/nova master: [placement] Clean up TODOs in allocations.yaml gabbit https://review.openstack.org/513057 | 21:35 |
| *** smatzek has quit IRC | 21:36 | |
| *** claudiub has quit IRC | 21:38 | |
| *** tbachman has quit IRC | 21:39 | |
| *** jmlowe has joined #openstack-nova | 21:39 | |
| efried | Thanks dansmith. edmondsw FYI, https://review.openstack.org/#/c/510957/ is in the gate. | 21:41 |
| openstackgerrit | Merged openstack/nova master: Send Allocations to spawn https://review.openstack.org/511879 | 21:41 |
| efried | Thanks johnthetubaguy too ^ | 21:41 |
| openstackgerrit | Merged openstack/nova master: docs: Explain the flow of the "serial console" feature https://review.openstack.org/476188 | 21:41 |
| edmondsw | efried saw... tx everyone | 21:41 |
| tonyb | Will writing an external app to listen to the notifications bus 'void my warrantee?' or otherwise make y'all sad? | 21:42 |
| *** andreas_s has joined #openstack-nova | 21:42 | |
| mriedem | ? | 21:42 |
| tonyb | I need to clean up an external system when an instance is deleted and I think that's the least gross way to do it | 21:43 |
| mriedem | there are lots of things that do that already | 21:43 |
| mriedem | mistral | 21:43 |
| mriedem | telemetry, searchlight | 21:43 |
| mriedem | designate sink i think | 21:43 |
| mriedem | tonyb: use the versioned notifications | 21:43 |
| tonyb | okay cool. That's knoda what I thought, but they're OpenStack and this things would be far from it | 21:44 |
| *** edmondsw has quit IRC | 21:44 | |
| mriedem | oh well if it's not openstack it's not allowed | 21:44 |
| tonyb | mriedem: Yup no point writing to the old thing | 21:44 |
| tonyb | mriedem: okay | 21:44 |
| mriedem | i'm joking | 21:44 |
| * tonyb hangs head low and goes to look for another approach | 21:44 | |
| tonyb | ;p | 21:44 |
| mriedem | about the not openstack thing | 21:44 |
| mriedem | cross polination is the name of the game nowadays | 21:45 |
| tonyb | mriedem: of course I'll push for it but the decision isn't really mine to make | 21:46 |
| *** openstackgerrit has quit IRC | 21:48 | |
| *** takashin has joined #openstack-nova | 21:49 | |
| *** acormier has joined #openstack-nova | 21:50 | |
| *** edmondsw has joined #openstack-nova | 21:50 | |
| *** andreas_s has quit IRC | 21:51 | |
| *** openstackgerrit has joined #openstack-nova | 21:53 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova-specs master: Abort Cold Migration https://review.openstack.org/334732 | 21:53 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Add 'delete_host' command in 'nova-manage cell_v2' https://review.openstack.org/510324 | 21:53 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (1/2) https://review.openstack.org/430608 | 21:54 |
| *** acormier has quit IRC | 21:54 | |
| *** edmondsw has quit IRC | 21:54 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (2/2) https://review.openstack.org/459483 | 21:55 |
| openstackgerrit | Takashi NATSUME proposed openstack/python-novaclient master: Microversion 2.54 - List/Show all server migration types https://review.openstack.org/430839 | 21:55 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(1/2) https://review.openstack.org/408955 | 21:56 |
| *** edmondsw has joined #openstack-nova | 21:56 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(2/2) https://review.openstack.org/408964 | 21:56 |
| *** markvoelker_ has joined #openstack-nova | 21:57 | |
| *** edmondsw_ has joined #openstack-nova | 21:58 | |
| *** slaweq_ has joined #openstack-nova | 21:58 | |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Return Selection objects from the scheduler driver https://review.openstack.org/495854 | 21:59 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Change RPC for select_destinations() https://review.openstack.org/510159 | 21:59 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Move the claim_resources method to scheduler utils https://review.openstack.org/511357 | 21:59 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Make conductor pass and use host_lists https://review.openstack.org/511358 | 21:59 |
| *** edmondsw has quit IRC | 22:00 | |
| *** markvoelker has quit IRC | 22:00 | |
| *** edmondsw_ has quit IRC | 22:02 | |
| *** slaweq_ has quit IRC | 22:02 | |
| *** tssurya_ has quit IRC | 22:02 | |
| *** tbachman has joined #openstack-nova | 22:02 | |
| *** lbragstad has quit IRC | 22:03 | |
| *** tssurya__ has joined #openstack-nova | 22:04 | |
| edleafe | dansmith: ^^ tests passed now, so I removed the 'or {}' | 22:05 |
| *** acormier has joined #openstack-nova | 22:05 | |
| *** tssurya__ has quit IRC | 22:06 | |
| openstackgerrit | Merged openstack/nova master: Move restart_compute_service to a common place https://review.openstack.org/512551 | 22:07 |
| *** gjayavelu has quit IRC | 22:08 | |
| *** gjayavelu has joined #openstack-nova | 22:09 | |
| openstackgerrit | Merged openstack/nova stable/pike: Regenerate context during targeting https://review.openstack.org/512456 | 22:09 |
| openstackgerrit | Merged openstack/nova stable/ocata: libvirt: add check for VIR_DOMAIN_BLOCK_REBASE_COPY_DEV https://review.openstack.org/512406 | 22:09 |
| *** acormier has quit IRC | 22:10 | |
| openstackgerrit | Merged openstack/nova stable/pike: Reproduce bug 1721652 in the functional test env https://review.openstack.org/511759 | 22:10 |
| openstack | bug 1721652 in OpenStack Compute (nova) pike "Evacuate cleanup fails at _delete_allocation_for_moved_instance" [High,In progress] https://launchpad.net/bugs/1721652 - Assigned to Matt Riedemann (mriedem) | 22:10 |
| *** dave-mccowan has quit IRC | 22:11 | |
| *** acormier has joined #openstack-nova | 22:16 | |
| *** jmlowe has quit IRC | 22:16 | |
| *** gyee has joined #openstack-nova | 22:17 | |
| mriedem | mlavalle: johnthetubaguy: sean-k-mooney: ok more comments in the port binding spec, specifically https://review.openstack.org/#/c/375580/13/specs/queens/approved/neutron-new-port-binding-api.rst@136 | 22:17 |
| mlavalle | mriedem: thanks I saw them | 22:17 |
| mriedem | i think there is a cleaner way to orchestrate some of the old/new flow stuff, which would also allow you to turn on the new flow if the source/dest during live migration are both running queens code | 22:17 |
| mriedem | make conductor create the dest host binding, shove that into the migrate_data object, and have the computes key off that for doing stuff with the new dest host binding | 22:18 |
| mriedem | also, don't have the virt driver call the neutron api to activate the dest host port binding, that needs to happen via compute manager in a generic way | 22:18 |
| *** burt has quit IRC | 22:19 | |
| mriedem | i think the dest host port binding contains the details that are required to be put into the domain xml that goes on the dest host, but the spec isn't real clear about that | 22:19 |
| mriedem | but that's probably the stuff that goes in the migrate_data and the compute keys off if it's doing new or old style stuff | 22:19 |
| *** acormier has quit IRC | 22:19 | |
| *** acormier has joined #openstack-nova | 22:20 | |
| mlavalle | mriedem: cool, thanks. I'll probably shoot this in an email to sean-k-mooney later in an email to make sure he sees it firt thing in the morning | 22:21 |
| mriedem | mlavalle: ok we might need a hangout in the morning | 22:21 |
| mriedem | including johnthetubaguy | 22:21 |
| mriedem | i feel like the spec goes 2 steps forward and 1 back each time i review it | 22:21 |
| mlavalle | mriedem: do you have a time in mind? | 22:21 |
| mriedem | nova team meeting is at 9am CT | 22:22 |
| mriedem | so how about 10am CT? | 22:22 |
| *** chyka has joined #openstack-nova | 22:22 | |
| *** lbragstad has joined #openstack-nova | 22:22 | |
| mriedem | that would be 4pm for john | 22:22 |
| mlavalle | mriedem: that sounds good. I have a meeting at that time, but I think I can delegate it | 22:22 |
| mriedem | neutron drivers meeting? | 22:22 |
| mlavalle | no, L3 sub-team | 22:23 |
| *** med_ has quit IRC | 22:23 | |
| *** Guest34657 has quit IRC | 22:23 | |
| *** brad[] has quit IRC | 22:23 | |
| *** felipemonteiro__ has quit IRC | 22:23 | |
| mriedem | ah | 22:23 |
| mlavalle | drivers is in the afternoon out time | 22:23 |
| *** med_ has joined #openstack-nova | 22:23 | |
| mriedem | well i think if i can get sean and john on a hangout we can work through the major issues | 22:23 |
| *** mfisch has joined #openstack-nova | 22:23 | |
| mriedem | i'll set something up | 22:23 |
| *** mfisch has quit IRC | 22:23 | |
| *** mfisch has joined #openstack-nova | 22:23 | |
| *** brad[] has joined #openstack-nova | 22:23 | |
| *** med_ is now known as Guest99060 | 22:23 | |
| mlavalle | mriedem: cool, thanks | 22:24 |
| *** acormier has quit IRC | 22:24 | |
| mlavalle | mriedem: would 8 be too early? | 22:24 |
| *** lyan has quit IRC | 22:24 | |
| mriedem | for me yeah | 22:26 |
| mriedem | i've got to get my kid cleaned up and on the bus | 22:26 |
| mlavalle | ok, cool, I suspected that | 22:26 |
| mlavalle | and I know how un-clean kids can be :-) | 22:27 |
| mriedem | dansmith: i assume you don't want to be part of this port binding live migration love fest | 22:28 |
| *** mlavalle has quit IRC | 22:28 | |
| mriedem | or melwitt | 22:28 |
| mriedem | or anyone else in their right mind | 22:28 |
| dansmith | mriedem: I certainly can be if you'd like | 22:28 |
| mriedem | ok added | 22:31 |
| dansmith | I can't friggin wait | 22:31 |
| mriedem | i think my recent comments in the spec are the way to do this, | 22:31 |
| mriedem | just need sean and john to tell me if i'm missing something | 22:32 |
| *** edmondsw has joined #openstack-nova | 22:32 | |
| *** amodi has quit IRC | 22:32 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Keep updating allocations for Ironic https://review.openstack.org/513198 | 22:32 |
| *** esberglu has quit IRC | 22:33 | |
| *** salv-orlando has quit IRC | 22:33 | |
| *** esberglu has joined #openstack-nova | 22:33 | |
| *** jmlowe has joined #openstack-nova | 22:33 | |
| *** penick has quit IRC | 22:34 | |
| melwitt | mriedem: I've got another call at that time, so I have to miss out :) | 22:34 |
| mriedem | your loss | 22:36 |
| melwitt | oh I know | 22:36 |
| *** edmondsw has quit IRC | 22:36 | |
| *** gouthamr has quit IRC | 22:41 | |
| *** andreas_s has joined #openstack-nova | 22:42 | |
| *** nicolasbock has quit IRC | 22:43 | |
| *** esberglu has quit IRC | 22:43 | |
| *** rodolof has quit IRC | 22:45 | |
| *** andreas_s has quit IRC | 22:46 | |
| openstackgerrit | Merged openstack/nova stable/pike: fix cleaning up evacuated instances https://review.openstack.org/512716 | 22:47 |
| *** eharney has quit IRC | 22:52 | |
| *** andreas_s has joined #openstack-nova | 22:56 | |
| *** tbachman has quit IRC | 22:57 | |
| *** andreas_s has quit IRC | 23:00 | |
| *** Tom__ has quit IRC | 23:00 | |
| *** Sukhdev has quit IRC | 23:00 | |
| *** dave-mccowan has joined #openstack-nova | 23:06 | |
| *** sdague has quit IRC | 23:07 | |
| *** lbragstad has quit IRC | 23:09 | |
| *** jdavis has joined #openstack-nova | 23:12 | |
| *** ijw has quit IRC | 23:13 | |
| *** jdavis has quit IRC | 23:17 | |
| *** andreas_s has joined #openstack-nova | 23:18 | |
| *** AlexeyAbashkin has joined #openstack-nova | 23:19 | |
| *** hongbin has quit IRC | 23:21 | |
| *** andreas_s has quit IRC | 23:23 | |
| *** AlexeyAbashkin has quit IRC | 23:23 | |
| *** chyka has quit IRC | 23:31 | |
| *** thorst has joined #openstack-nova | 23:32 | |
| *** salv-orlando has joined #openstack-nova | 23:34 | |
| *** ijw has joined #openstack-nova | 23:34 | |
| *** thorst has quit IRC | 23:36 | |
| *** smatzek has joined #openstack-nova | 23:37 | |
| *** ijw has quit IRC | 23:38 | |
| *** salv-orlando has quit IRC | 23:39 | |
| *** Apoorva_ has joined #openstack-nova | 23:40 | |
| *** smatzek has quit IRC | 23:41 | |
| *** Apoorva has quit IRC | 23:43 | |
| *** ijw has joined #openstack-nova | 23:44 | |
| *** acormier has joined #openstack-nova | 23:44 | |
| *** andreas_s has joined #openstack-nova | 23:46 | |
| *** smatzek has joined #openstack-nova | 23:46 | |
| *** Apoorva_ has quit IRC | 23:47 | |
| *** Apoorva has joined #openstack-nova | 23:47 | |
| *** acormier has quit IRC | 23:49 | |
| *** andreas_s has quit IRC | 23:50 | |
| *** ijw has quit IRC | 23:51 | |
| *** tbachman has joined #openstack-nova | 23:51 | |
| *** acormier has joined #openstack-nova | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!