| *** gyee has quit IRC | 00:02 | |
| alex_xu | mriedem: yes, it is change the API behavior, do you know what happened now if I didn't specific boot_index? | 00:02 |
|---|---|---|
| *** hemna_ has quit IRC | 00:02 | |
| alex_xu | for now | 00:02 |
| *** pcaruana has quit IRC | 00:02 | |
| alex_xu | or I will check then when I reach to the office | 00:04 |
| *** chyka has quit IRC | 00:11 | |
| *** artom_ has joined #openstack-nova | 00:25 | |
| *** hoangcx has joined #openstack-nova | 00:32 | |
| *** tonyb has quit IRC | 00:33 | |
| *** artom_ has quit IRC | 00:34 | |
| *** tonyb has joined #openstack-nova | 00:35 | |
| *** tetsuro has joined #openstack-nova | 00:36 | |
| *** Dinesh_Bhor has joined #openstack-nova | 00:36 | |
| mriedem | alex_xu: yeah https://review.openstack.org/#/c/563732/ i have to update that, tomorrow | 00:36 |
| *** mriedem is now known as mriedem_away | 00:37 | |
| *** gjayavelu has quit IRC | 00:39 | |
| *** namnh has joined #openstack-nova | 00:42 | |
| openstackgerrit | Adam Harwell proposed openstack/nova stable/pike: Add support for listing hosts in cellv2 https://review.openstack.org/563797 | 00:54 |
| *** mriedem_away has quit IRC | 01:05 | |
| *** phuongnh has joined #openstack-nova | 01:07 | |
| *** hiro-kobayashi has joined #openstack-nova | 01:09 | |
| openstackgerrit | Merged openstack/nova master: Add CPUWeigher https://review.openstack.org/379525 | 01:09 |
| openstackgerrit | Merged openstack/nova master: libvirt: add support for virtio-net rx/tx queue sizes https://review.openstack.org/484997 | 01:09 |
| openstackgerrit | Merged openstack/nova master: Move some tests into nova.tests.unit.notifications.objects.test_instance https://review.openstack.org/562793 | 01:10 |
| melwitt | Kevin_Zheng: your blueprint was removed from the review runway today because all of the related code merged. please feel free to add comments to the log area at L144 if you have any comments or feedback about your experience with runways https://etherpad.openstack.org/p/nova-runways-rocky | 01:11 |
| Kevin_Zheng | melwitt cool, I will | 01:11 |
| *** yikun has joined #openstack-nova | 01:13 | |
| *** MasterofJOKers has quit IRC | 01:16 | |
| *** MasterofJOKers has joined #openstack-nova | 01:16 | |
| *** yamahata has quit IRC | 01:26 | |
| *** salv-orl_ has joined #openstack-nova | 01:28 | |
| *** salv-orlando has quit IRC | 01:31 | |
| *** hongbin_ has joined #openstack-nova | 01:32 | |
| *** tiendc has joined #openstack-nova | 01:42 | |
| gmann | alex_xu: testing in tempest too - https://review.openstack.org/#/c/563801/ | 01:44 |
| *** esberglu has joined #openstack-nova | 01:53 | |
| *** artom_ has joined #openstack-nova | 01:54 | |
| *** phuongnh has quit IRC | 01:55 | |
| *** phuongnh has joined #openstack-nova | 01:56 | |
| *** dougshelley66 has quit IRC | 01:57 | |
| *** fragatina has quit IRC | 02:02 | |
| *** zhaochao has joined #openstack-nova | 02:05 | |
| *** Tom-Tom has joined #openstack-nova | 02:06 | |
| *** artom_ has quit IRC | 02:10 | |
| openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Address nits in Iac23a574a05e62a99aab20ffce4265f4fb5a44d9 https://review.openstack.org/563802 | 02:22 |
| *** tomtom001 has quit IRC | 02:27 | |
| *** tomtom001 has joined #openstack-nova | 02:27 | |
| *** fragatina has joined #openstack-nova | 02:39 | |
| *** annp has quit IRC | 02:42 | |
| *** blkart_ has joined #openstack-nova | 02:42 | |
| *** blkart has quit IRC | 02:43 | |
| *** gongysh has joined #openstack-nova | 02:45 | |
| openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: add snapshot function https://review.openstack.org/534240 | 02:46 |
| openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: add power actions https://review.openstack.org/543340 | 02:46 |
| openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: add get console output https://review.openstack.org/543344 | 02:46 |
| *** psachin has joined #openstack-nova | 02:46 | |
| openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Address nits in Iac23a574a05e62a99aab20ffce4265f4fb5a44d9 https://review.openstack.org/563802 | 02:47 |
| *** jdillaman has quit IRC | 02:51 | |
| *** yamamoto has quit IRC | 02:53 | |
| *** annp has joined #openstack-nova | 02:54 | |
| *** yamamoto has joined #openstack-nova | 02:54 | |
| *** yamamoto has quit IRC | 02:59 | |
| *** esberglu has quit IRC | 03:01 | |
| *** vladikr has quit IRC | 03:13 | |
| *** vladikr has joined #openstack-nova | 03:13 | |
| *** cfriesen has quit IRC | 03:13 | |
| *** cfriesen has joined #openstack-nova | 03:14 | |
| *** vladikr has quit IRC | 03:19 | |
| *** vladikr has joined #openstack-nova | 03:19 | |
| *** takashin has quit IRC | 03:24 | |
| *** nicolasbock has quit IRC | 03:26 | |
| *** hiro-kobayashi has quit IRC | 03:35 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Use os.rename, not mv. https://review.openstack.org/562463 | 03:36 |
| *** Tom-Tom has quit IRC | 03:38 | |
| *** Tom-Tom has joined #openstack-nova | 03:39 | |
| *** lpetrut has joined #openstack-nova | 03:39 | |
| *** Tom-Tom has quit IRC | 03:43 | |
| *** janki has joined #openstack-nova | 03:44 | |
| *** sridharg has joined #openstack-nova | 03:48 | |
| *** hongbin_ has quit IRC | 03:58 | |
| *** lpetrut has quit IRC | 04:11 | |
| *** takashin has joined #openstack-nova | 04:11 | |
| *** evrardjp has quit IRC | 04:15 | |
| *** dklyle has joined #openstack-nova | 04:17 | |
| *** ratailor has joined #openstack-nova | 04:20 | |
| *** ratailor has quit IRC | 04:21 | |
| *** yikun_ has joined #openstack-nova | 04:23 | |
| *** yikun has quit IRC | 04:25 | |
| *** markvoelker has quit IRC | 04:29 | |
| *** ratailor has joined #openstack-nova | 04:35 | |
| *** ratailor has quit IRC | 04:35 | |
| *** dklyle has quit IRC | 04:37 | |
| *** slaweq has joined #openstack-nova | 04:39 | |
| *** janki has quit IRC | 04:39 | |
| *** cfriesen has quit IRC | 04:43 | |
| *** edmondsw has joined #openstack-nova | 04:43 | |
| *** edmondsw_ has joined #openstack-nova | 04:44 | |
| openstackgerrit | Julia Kreger proposed openstack/nova master: Ironic: Lock the instance if early vif plug https://review.openstack.org/563714 | 04:45 |
| *** slaweq has quit IRC | 04:47 | |
| *** edmondsw has quit IRC | 04:48 | |
| *** lpetrut has joined #openstack-nova | 04:58 | |
| *** sapd has quit IRC | 04:59 | |
| *** sapd_ has joined #openstack-nova | 04:59 | |
| *** edmondsw_ has quit IRC | 04:59 | |
| *** hoangcx has quit IRC | 05:06 | |
| *** hoangcx has joined #openstack-nova | 05:07 | |
| *** sapd_ has quit IRC | 05:07 | |
| *** sapd__ has joined #openstack-nova | 05:07 | |
| *** tomtom001 has quit IRC | 05:10 | |
| *** tomtom001 has joined #openstack-nova | 05:11 | |
| *** gongysh has quit IRC | 05:11 | |
| *** tianhui_ has joined #openstack-nova | 05:15 | |
| *** tianhui has quit IRC | 05:17 | |
| *** rajinir has quit IRC | 05:18 | |
| *** Tom-Tom has joined #openstack-nova | 05:20 | |
| *** evrardjp has joined #openstack-nova | 05:21 | |
| *** abhishekk has joined #openstack-nova | 05:25 | |
| *** lpetrut has quit IRC | 05:27 | |
| *** ccamacho has quit IRC | 05:37 | |
| *** ratailor has joined #openstack-nova | 05:40 | |
| *** edmondsw has joined #openstack-nova | 05:41 | |
| *** edmondsw has quit IRC | 05:45 | |
| *** janki has joined #openstack-nova | 05:49 | |
| *** edmondsw has joined #openstack-nova | 06:02 | |
| *** edmondsw has quit IRC | 06:06 | |
| *** gongysh has joined #openstack-nova | 06:07 | |
| *** pratik has joined #openstack-nova | 06:12 | |
| *** links has joined #openstack-nova | 06:16 | |
| pratik | deletion of snapshot created from volume attached to an instance is getting stuck in 'deleting' state with NFS backend. can anyone help? https://developer.openstack.org/api-ref/compute/#delete-assisted-volume-snapshot this API returns 204 response but not sure why it gets stuck | 06:16 |
| *** do3meli has joined #openstack-nova | 06:16 | |
| *** sar has joined #openstack-nova | 06:17 | |
| *** armaan has joined #openstack-nova | 06:24 | |
| *** trinaths has joined #openstack-nova | 06:24 | |
| openstackgerrit | XiaojueGuan proposed openstack/nova master: reduce complex if clause to nice or clause https://review.openstack.org/563834 | 06:26 |
| *** stakeda has joined #openstack-nova | 06:26 | |
| kashyap | stephenfin: Morning | 06:29 |
| kashyap | stephenfin: It's in the commit message :-) | 06:29 |
| *** artom has quit IRC | 06:29 | |
| *** artom_ has joined #openstack-nova | 06:29 | |
| *** lpetrut has joined #openstack-nova | 06:29 | |
| *** markvoelker has joined #openstack-nova | 06:30 | |
| openstackgerrit | Merged openstack/nova master: Record the host info in EventReporter https://review.openstack.org/556746 | 06:30 |
| kashyap | stephenfin: IOW: | 06:31 |
| kashyap | [quote] | 06:31 |
| kashyap | The advertized NEXT_MIN_{LIBVIRT,QEMU} versions during | 06:31 |
| kashyap | "Pike" release were set to: libvirt 1.3.1 and QEMU 2.5.0 -- but they | 06:31 |
| kashyap | weren't actually bumped for "Queens". So let's actually bump them for | 06:31 |
| kashyap | the "Rocky" release. | 06:31 |
| kashyap | [/quote] | 06:31 |
| kashyap | (From the commit message) | 06:31 |
| *** slaweq has joined #openstack-nova | 06:32 | |
| *** threestrands has quit IRC | 06:32 | |
| *** moshele has joined #openstack-nova | 06:39 | |
| *** slaweq has quit IRC | 06:42 | |
| *** salv-orl_ has quit IRC | 06:45 | |
| *** salv-orlando has joined #openstack-nova | 06:46 | |
| *** tesseract has joined #openstack-nova | 06:49 | |
| *** threestrands has joined #openstack-nova | 06:50 | |
| *** threestrands has quit IRC | 06:50 | |
| *** threestrands has joined #openstack-nova | 06:50 | |
| *** salv-orlando has quit IRC | 06:50 | |
| *** Tom-Tom has quit IRC | 06:51 | |
| *** Tom-Tom has joined #openstack-nova | 06:53 | |
| *** ccamacho has joined #openstack-nova | 06:55 | |
| *** pcaruana has joined #openstack-nova | 06:58 | |
| *** gongysh has quit IRC | 06:59 | |
| *** lajoskatona has joined #openstack-nova | 06:59 | |
| *** salv-orlando has joined #openstack-nova | 07:00 | |
| *** markvoelker has quit IRC | 07:04 | |
| *** armaan has joined #openstack-nova | 07:06 | |
| *** avolkov has joined #openstack-nova | 07:07 | |
| *** jaosorior has joined #openstack-nova | 07:08 | |
| *** threestrands has quit IRC | 07:10 | |
| alex_xu | jaypipes, ericyoung, we miss this case in this thread http://lists.openstack.org/pipermail/openstack-dev/2018-April/129763.html | 07:10 |
| *** amoralej|off is now known as amoralej | 07:11 | |
| kashyap | stephenfin: And for "Stein", we've picked the NEXT_MIN versions here (this is merged): https://review.openstack.org/#/c/558171/ | 07:15 |
| *** slaweq has joined #openstack-nova | 07:16 | |
| *** rcernin has quit IRC | 07:16 | |
| *** ragiman has joined #openstack-nova | 07:18 | |
| *** jchhatbar has joined #openstack-nova | 07:21 | |
| *** kholkina has joined #openstack-nova | 07:21 | |
| *** sahid has joined #openstack-nova | 07:22 | |
| *** janki has quit IRC | 07:23 | |
| *** edmondsw has joined #openstack-nova | 07:24 | |
| *** ralonsoh has joined #openstack-nova | 07:25 | |
| *** pratik has quit IRC | 07:26 | |
| *** armaan has quit IRC | 07:28 | |
| *** edmondsw has quit IRC | 07:28 | |
| *** abhishekk has quit IRC | 07:29 | |
| *** rmart04 has joined #openstack-nova | 07:31 | |
| *** avolkov has quit IRC | 07:34 | |
| *** avolkov has joined #openstack-nova | 07:34 | |
| *** dpawlik has joined #openstack-nova | 07:36 | |
| *** damien_r has joined #openstack-nova | 07:42 | |
| *** ygl has joined #openstack-nova | 07:44 | |
| *** edmondsw has joined #openstack-nova | 07:45 | |
| *** tssurya has joined #openstack-nova | 07:45 | |
| *** jpena|off is now known as jpena | 07:48 | |
| *** edmondsw has quit IRC | 07:49 | |
| *** hamzy has quit IRC | 07:51 | |
| *** vivsoni_ has joined #openstack-nova | 07:51 | |
| *** hamzy has joined #openstack-nova | 07:51 | |
| *** vivsoni has quit IRC | 07:51 | |
| ygl | anyone here can help me with my issue please | 07:53 |
| ygl | i have created a vm using a heat stack. when I delete that stack, I want a user script to be trigerred automatically in the VM before its deltion | 07:54 |
| ygl | is that possible in openstack as of now ? | 07:54 |
| *** gjayavelu has joined #openstack-nova | 07:54 | |
| *** mgoddard has joined #openstack-nova | 07:57 | |
| *** takashin has left #openstack-nova | 08:00 | |
| *** markvoelker has joined #openstack-nova | 08:01 | |
| *** AlexeyAbashkin has joined #openstack-nova | 08:05 | |
| *** edmondsw has joined #openstack-nova | 08:05 | |
| bauzas | ygl: looks like it's not a Nova feature | 08:06 |
| bauzas | ygl: AFAIK | 08:07 |
| *** armaan has joined #openstack-nova | 08:08 | |
| *** edmondsw has quit IRC | 08:09 | |
| *** ktibi has joined #openstack-nova | 08:10 | |
| *** gongysh has joined #openstack-nova | 08:15 | |
| stephenfin | kashyap: Ah, so it was a different commit. That's what caught me out :) | 08:16 |
| kashyap | stephenfin: Maybe I should've mentioned it | 08:16 |
| kashyap | stephenfin: Because it requires discussion on the Operators / Dev list | 08:16 |
| stephenfin | kashyap: Ah, it's fine. +Wd now | 08:17 |
| kashyap | stephenfin: Most excellent. I can build other clean-up patches on top of it | 08:18 |
| kashyap | Thanks | 08:18 |
| stephenfin | kashyap: Cool. Feel free to add me as a reviewer to those when you do | 08:18 |
| openstackgerrit | sahid proposed openstack/nova master: hardware: only take into account small pages https://review.openstack.org/532168 | 08:18 |
| kashyap | Definitely. But before that I'm trying to get this out of the way: https://bugs.launchpad.net/nova/+bug/1766208 | 08:18 |
| openstack | Launchpad bug 1766208 in OpenStack Compute (nova) "Lift the restriction on choices for `cpu_model_extra_flags` config attribute" [Undecided,New] - Assigned to Kashyap Chamarthy (kashyapc) | 08:18 |
| *** abhishekk has joined #openstack-nova | 08:19 | |
| openstackgerrit | sahid proposed openstack/nova master: remove IVS plug/unplug as they're moved to separate plugin https://review.openstack.org/534371 | 08:25 |
| *** priteau has joined #openstack-nova | 08:25 | |
| *** edmondsw has joined #openstack-nova | 08:26 | |
| *** avolkov has quit IRC | 08:27 | |
| *** mvk has quit IRC | 08:28 | |
| *** jistr is now known as jistr|mtgs | 08:28 | |
| *** mdbooth has joined #openstack-nova | 08:30 | |
| *** edmondsw has quit IRC | 08:30 | |
| *** gjayavelu has quit IRC | 08:31 | |
| *** lucas-afk is now known as lucasagomes | 08:31 | |
| *** markvoelker has quit IRC | 08:34 | |
| *** mdnadeem has joined #openstack-nova | 08:39 | |
| *** derekh has joined #openstack-nova | 08:41 | |
| *** hiro-kobayashi has joined #openstack-nova | 08:42 | |
| *** ygl has quit IRC | 08:49 | |
| *** ianw is now known as ianw_pto | 08:54 | |
| *** cdent has joined #openstack-nova | 08:55 | |
| *** bzhao__ has joined #openstack-nova | 08:56 | |
| *** armaan has quit IRC | 08:58 | |
| *** armaan has joined #openstack-nova | 08:58 | |
| *** mvk has joined #openstack-nova | 08:59 | |
| *** armaan has quit IRC | 09:03 | |
| *** dtantsur|afk is now known as dtantsur | 09:09 | |
| *** sridharg has quit IRC | 09:14 | |
| *** sridharg has joined #openstack-nova | 09:18 | |
| *** jaosorior has quit IRC | 09:18 | |
| Kevin_Zheng | alex_xu Thanks for the review, but Error instances could also have Ip, so I guess we should not skip cell0? | 09:19 |
| alex_xu | Kevin_Zheng: cell0 means the instance didn't get right scheduling, so they shouldn't have IP I think | 09:28 |
| *** wolverineav has joined #openstack-nova | 09:29 | |
| Kevin_Zheng | let me think | 09:29 |
| alex_xu | even if they go to a cell and fail, the IP should be released? | 09:29 |
| Kevin_Zheng | error instance will still be cell1? | 09:29 |
| alex_xu | Kevin_Zheng: yes | 09:29 |
| Kevin_Zheng | No, Ip will still be on instances records | 09:29 |
| alex_xu | Kevin_Zheng: one of case I'm sure is the pre-created ported | 09:30 |
| Kevin_Zheng | then you should comment erlier :) | 09:30 |
| alex_xu | Kevin_Zheng: if the instance turn to error after booting, they shouldn't be in cell0, and yes they has IP | 09:30 |
| Kevin_Zheng | yeah, I got that | 09:31 |
| alex_xu | Kevin_Zheng: yea, but i'm not -1 :) | 09:31 |
| *** markvoelker has joined #openstack-nova | 09:31 | |
| alex_xu | Kevin_Zheng: if that makes sense, I still think they should be separated patch | 09:32 |
| *** FoXMaN_ is now known as FoXMaN | 09:32 | |
| *** FoXMaN has quit IRC | 09:32 | |
| *** FoXMaN has joined #openstack-nova | 09:32 | |
| *** Dinesh_Bhor has quit IRC | 09:35 | |
| *** maciejjozefczyk has joined #openstack-nova | 09:37 | |
| *** maciejjozefczyk has left #openstack-nova | 09:39 | |
| Kevin_Zheng | alex_xu I will consider it :) | 09:40 |
| *** jaosorior has joined #openstack-nova | 09:44 | |
| *** gongysh has quit IRC | 09:48 | |
| *** wolverineav has quit IRC | 09:49 | |
| *** wolverineav has joined #openstack-nova | 09:49 | |
| openstackgerrit | XiaojueGuan proposed openstack/nova master: change complex if clause to nice or clause https://review.openstack.org/563872 | 09:50 |
| openstackgerrit | Merged openstack/nova master: libvirt: Bump MIN_{LIBVIRT,QEMU}_VERSION for "Rocky" https://review.openstack.org/558783 | 09:53 |
| *** wolverineav has quit IRC | 09:54 | |
| *** namnh has quit IRC | 09:54 | |
| *** hiro-kobayashi has quit IRC | 10:01 | |
| *** armaan has joined #openstack-nova | 10:02 | |
| *** abhishekk has quit IRC | 10:03 | |
| *** hoangcx has quit IRC | 10:03 | |
| *** rmart04_ has joined #openstack-nova | 10:04 | |
| *** markvoelker has quit IRC | 10:06 | |
| *** rmart04 has quit IRC | 10:06 | |
| *** rmart04_ is now known as rmart04 | 10:06 | |
| *** sdague has joined #openstack-nova | 10:09 | |
| *** sambetts_ is now known as sambetts | 10:11 | |
| *** priteau has quit IRC | 10:11 | |
| *** priteau has joined #openstack-nova | 10:11 | |
| *** pmannidi has joined #openstack-nova | 10:11 | |
| openstackgerrit | Merged openstack/nova master: Drop MIN_LIBVIRT_SET_ADMIN_PASSWD https://review.openstack.org/562312 | 10:17 |
| openstackgerrit | Merged openstack/nova master: Remove vestigial system_metadata param from info_from_instance() https://review.openstack.org/561724 | 10:17 |
| *** dougshelley66 has joined #openstack-nova | 10:17 | |
| *** rmart04 has quit IRC | 10:17 | |
| *** wolverineav has joined #openstack-nova | 10:18 | |
| *** armaan has quit IRC | 10:28 | |
| *** armaan has joined #openstack-nova | 10:29 | |
| *** annp has quit IRC | 10:29 | |
| *** tiendc has quit IRC | 10:29 | |
| *** mvk has quit IRC | 10:29 | |
| *** tiendc has joined #openstack-nova | 10:30 | |
| *** annp has joined #openstack-nova | 10:30 | |
| *** armaan has quit IRC | 10:33 | |
| *** rmart04 has joined #openstack-nova | 10:33 | |
| *** armaan has joined #openstack-nova | 10:33 | |
| *** dpawlik has quit IRC | 10:34 | |
| *** dpawlik has joined #openstack-nova | 10:36 | |
| *** mvk has joined #openstack-nova | 10:42 | |
| *** jaosorior has quit IRC | 10:43 | |
| *** sapd__ has quit IRC | 10:45 | |
| *** rmart04 has quit IRC | 10:46 | |
| *** annp has quit IRC | 10:46 | |
| *** pmannidi has quit IRC | 10:47 | |
| *** phuongnh has quit IRC | 10:49 | |
| *** Tom-Tom has quit IRC | 10:52 | |
| *** Tom-Tom has joined #openstack-nova | 10:52 | |
| *** Tom-Tom has quit IRC | 10:53 | |
| *** Tom-Tom has joined #openstack-nova | 10:53 | |
| *** mdnadeem has quit IRC | 10:53 | |
| *** mdnadeem has joined #openstack-nova | 10:53 | |
| *** dougshelley66 has quit IRC | 10:54 | |
| openstackgerrit | Merged openstack/nova master: Improve performance when list instances with IP filter https://review.openstack.org/539469 | 10:56 |
| *** markvoelker has joined #openstack-nova | 11:02 | |
| *** nicolasbock has joined #openstack-nova | 11:05 | |
| *** chyka has joined #openstack-nova | 11:06 | |
| *** rmart04 has joined #openstack-nova | 11:09 | |
| *** chyka has quit IRC | 11:11 | |
| *** vladikr has quit IRC | 11:13 | |
| *** vladikr has joined #openstack-nova | 11:13 | |
| *** ktibi has quit IRC | 11:13 | |
| *** trinaths has quit IRC | 11:14 | |
| *** hjensas has quit IRC | 11:14 | |
| *** stakeda has quit IRC | 11:18 | |
| *** dougshelley66 has joined #openstack-nova | 11:22 | |
| openstackgerrit | Naichuan Sun proposed openstack/nova master: xenapi(N-R-P): Add API to support vgpu resource provider create https://review.openstack.org/520313 | 11:23 |
| *** armaan has quit IRC | 11:26 | |
| *** armaan has joined #openstack-nova | 11:26 | |
| *** sar has quit IRC | 11:29 | |
| *** evin has joined #openstack-nova | 11:29 | |
| *** armaan has quit IRC | 11:33 | |
| *** armaan has joined #openstack-nova | 11:33 | |
| *** cdent has quit IRC | 11:34 | |
| *** markvoelker has quit IRC | 11:36 | |
| *** cdent has joined #openstack-nova | 11:40 | |
| *** lucasagomes is now known as lucas-hungry | 11:41 | |
| *** ktibi has joined #openstack-nova | 11:43 | |
| *** jaosorior has joined #openstack-nova | 11:48 | |
| *** jpena is now known as jpena|lunch | 11:50 | |
| *** mdbooth has quit IRC | 11:52 | |
| *** liuyulong has joined #openstack-nova | 11:53 | |
| *** tiendc has quit IRC | 11:57 | |
| jaypipes | alex_xu: will respond on the ML thread, ok? | 12:08 |
| *** QianYu has joined #openstack-nova | 12:09 | |
| *** QianYu has quit IRC | 12:11 | |
| *** Kevin_Zheng has quit IRC | 12:11 | |
| kashyap | Goddamnit | 12:12 |
| kashyap | The Gerrit UI | 12:12 |
| *** Kevin_Zheng has joined #openstack-nova | 12:12 | |
| *** wolverineav has quit IRC | 12:12 | |
| kashyap | It _keeps_ jumping around. | 12:12 |
| *** wolverineav has joined #openstack-nova | 12:12 | |
| *** Tom-Tom has quit IRC | 12:13 | |
| kashyap | No wonder I still like the blazing fast e-mail workflow. /me whips up the 'ncurses'-based 'Gertty' tool to see if it has gotten a bit less crashy | 12:13 |
| sean-k-mooney | kashyap: matt found a workaround for that. in your preferences set render mode to slow | 12:13 |
| *** wolverineav has quit IRC | 12:13 | |
| kashyap | sean-k-mooney: Oh really? /me goes to look | 12:13 |
| jaypipes | kashyap: I know. It's infuriating. | 12:13 |
| *** wolverineav has joined #openstack-nova | 12:14 | |
| kashyap | This just makes the throw the laptop out the fucking window | 12:14 |
| *** yamamoto has joined #openstack-nova | 12:14 | |
| *** tbachman has quit IRC | 12:14 | |
| jaypipes | sean-k-mooney: I have that set in my prefs and still happens occasionally. | 12:14 |
| cdent | sean-k-mooney, kashyap the slow render mode helps some, but not all of it | 12:14 |
| cdent | jinx | 12:14 |
| *** liverpooler has joined #openstack-nova | 12:14 | |
| sean-k-mooney | jaypipes: ya it seams to depend on gerrit version | 12:14 |
| sean-k-mooney | there is a new gerrit ui based on javascitp on the latest realease called polygerrit | 12:15 |
| kashyap | sean-k-mooney: Okay, so in Diff Preferences --> Render --> "Slow", yes? | 12:15 |
| sean-k-mooney | kashyap: yes | 12:15 |
| *** jaosorior has quit IRC | 12:15 | |
| *** jaosorior has joined #openstack-nova | 12:16 | |
| kashyap | sean-k-mooney: Any other preferences that you "can't live without"? | 12:16 |
| *** efried has joined #openstack-nova | 12:16 | |
| *** markvoelker has joined #openstack-nova | 12:16 | |
| kashyap | Maybe I'm "missing out" something | 12:16 |
| kashyap | cdent: Noted | 12:16 |
| sean-k-mooney | kashyap: not that come to mind | 12:16 |
| kashyap | Cool; thanks | 12:16 |
| *** Tom-Tom has joined #openstack-nova | 12:17 | |
| sean-k-mooney | kashyap: if we ever update the openstack gerrit to support polygerrit ui then that should solve this permently but im sure that has its own bugs | 12:18 |
| jaypipes | kashyap: oh, I'm pretty sure you're missing out on lots of things :P | 12:18 |
| *** wolverineav has quit IRC | 12:18 | |
| kashyap | jaypipes: I just maintain my sanity (from Gerrit) by spending a portion of time on mailing list based projects :P | 12:18 |
| kashyap | sean-k-mooney: What does "polygerrit" do? | 12:18 |
| jaypipes | kashyap: it's gerrit that simply repeats stuff back to you. | 12:19 |
| jaypipes | kashyap: oh wait, no, that's PollyGerrit. | 12:19 |
| *** tomhambleton_ has quit IRC | 12:19 | |
| *** tomhambleton_ has joined #openstack-nova | 12:20 | |
| * kashyap nods | 12:20 | |
| sean-k-mooney | kashyap: its a complete reimplementaiton of the entire gerrit ui in plomer.js and html5 so no more java/gwt | 12:20 |
| kashyap | Unrelated "taste" question -- is it bad taste to write a small clarifying comment in a unit test? | 12:20 |
| kashyap | E.g.: | 12:20 |
| kashyap | + # For 'host-model', it is now valid to use 'extra_flags'; | 12:20 |
| kashyap | + # so warning should not be thrown | 12:20 |
| kashyap | + self.assertFalse(mock_warn.called) | 12:20 |
| jaypipes | kashyap: that is good taste, IMHO. | 12:20 |
| kashyap | There are multiple unit tests, but the "asserts" won't speak for themselves, if you're not reading code carefully around | 12:20 |
| *** Tom-Tom has quit IRC | 12:21 | |
| kashyap | jaypipes: Thanks. It is subtle, and this helps. So I'll add it in | 12:21 |
| kashyap | sean-k-mooney: My single biggest feature request is: if I can reply from Gerrit mail, that'll solve "everything" for me with Gerrit | 12:21 |
| sean-k-mooney | kashyap: the only time i would consider that bad taste is if it is done instead of splitting a test that is too complex. adding comments to explain clearly what your testing is good | 12:21 |
| kashyap | As long as I don't have to deal with the clickety-clicky, RSI-inducing GUI | 12:21 |
| *** amoralej is now known as amoralej|lunch | 12:22 | |
| kashyap | sean-k-mooney: Good point; I did split the test. I'm lifting the restriction we added here: https://bugs.launchpad.net/nova/+bug/1766208 | 12:22 |
| openstack | Launchpad bug 1766208 in OpenStack Compute (nova) "Lift the restriction on choices for `cpu_model_extra_flags` config attribute" [Undecided,New] - Assigned to Kashyap Chamarthy (kashyapc) | 12:22 |
| sean-k-mooney | kashyap: if openstack had an email only interface it would never work on it again. but if email via gerrit work then that would be cool | 12:22 |
| kashyap | In the earlier patch, for 'host-model' it was invalid to specify 'extra_flags'. But now we allow it (as it is valid libvirt form) | 12:23 |
| kashyap | sean-k-mooney: s/"it would"/I would/ ? | 12:23 |
| sean-k-mooney | ah the restiction we added for backporting | 12:23 |
| *** tbachman has joined #openstack-nova | 12:24 | |
| sean-k-mooney | ya i think being able to extend host-model makes sense. it was just one extra vairible that we did not want to backport originally so i dont think that bug is controverial | 12:24 |
| kashyap | sean-k-mooney: Yeah, now I'm lifting that | 12:25 |
| sean-k-mooney | kashyap: it is technically a feature not a bug but even a specless blueprint seams to heavy for that so bug makes sense | 12:26 |
| kashyap | git diff --cached | 12:26 |
| kashyap | Wrong window | 12:26 |
| kashyap | sean-k-mooney: Yep | 12:26 |
| sean-k-mooney | kashyap: password: :) | 12:26 |
| *** mwhahaha has quit IRC | 12:26 | |
| kashyap | Heh | 12:26 |
| *** mwhahaha has joined #openstack-nova | 12:27 | |
| *** edmondsw has joined #openstack-nova | 12:28 | |
| *** lucas-hungry is now known as lucasagomes | 12:29 | |
| *** lbragstad has joined #openstack-nova | 12:29 | |
| *** edmondsw_ has joined #openstack-nova | 12:29 | |
| openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Lift the restriction of choices for `cpu_model_extra_flags` https://review.openstack.org/563926 | 12:30 |
| kashyap | sean-k-mooney: ^ When you can, mind having a gander? | 12:31 |
| kashyap | (Pinged you explicitly as you have context from the prior patch.) | 12:31 |
| *** jackie-truong has joined #openstack-nova | 12:31 | |
| sean-k-mooney | kashyap: ill be away for like 20 mins or so but i have it open in a tab for when i get back | 12:31 |
| kashyap | Thanks! | 12:32 |
| *** mchlumsky has joined #openstack-nova | 12:33 | |
| *** edmondsw has quit IRC | 12:33 | |
| bhagyashris | efried; Hi, I just want to discuss regarding the zuul failure on patches https://review.openstack.org/#/c/560444/ https://review.openstack.org/#/c/560459/ . I have some observations; 1. Yesterday I had list down the test which are failing on both the patches [1][2] and then put the recheck in morning and checked wheather the same test are failing or not but I saw that the different tests are failing | 12:35 |
| efried | bhagyashris: Unit or functional? | 12:36 |
| bhagyashris | efried: Most of the test are failing with the error like (No valid host is found and Server <id> failed to build and is in ERROR status) so it seems that the host is not return properly from scheduler side. | 12:36 |
| efried | oh, tempest | 12:36 |
| bhagyashris | efried: tempest-full, tempest-full-py3 etc | 12:36 |
| efried | Have you looked into the compute logs? | 12:36 |
| *** psachin has quit IRC | 12:37 | |
| bhagyashris | efried: I have checked the n-sch logs #link: http://logs.openstack.org/59/560459/3/check/tempest-full/b9c97a9/controller/logs/screen-n-sch.txt.gz#_Apr_24_06_52_41_192819 | 12:37 |
| bhagyashris | efried: and it shows that the get_alocation_candidates() at https://github.com/openstack/nova/blob/master/nova/scheduler/manager.py#L148 is returning the empty list | 12:38 |
| bhagyashris | efried: As n-sch is not returning the host and our patch has changes at n-cpu side so I am not getting where exactly it's failing? | 12:41 |
| *** cdent has quit IRC | 12:42 | |
| efried | bhagyashris: http://logs.openstack.org/59/560459/3/check/tempest-full/b9c97a9/controller/logs/screen-placement-api.txt.gz#_Apr_24_06_52_41_190125 | 12:44 |
| *** edmondsw_ has quit IRC | 12:44 | |
| efried | bhagyashris: But requests before that are succeeding. It's like the host is running out of resources. This could be an allocation ratio thing. | 12:44 |
| bhagyashris | efried: I have debug the tempest test tempest.api.compute.servers.test_multiple_create.MultipleCreateTestJSON.test_multiple_create on patch https://review.openstack.org/#/c/560459/ and observed that the allocation_candidates() return at https://github.com/openstack/nova/blob/master/nova/scheduler/manager.py#L148 is empty list and same test i have ran on master there the allocation_candidates() return is successfully | 12:44 |
| *** maciejjozefczyk1 has joined #openstack-nova | 12:45 | |
| bhagyashris | efried: sorry i am getting fully . Means we will need some changes at placement side to fix the failing tests on zuul | 12:47 |
| *** edmondsw has joined #openstack-nova | 12:48 | |
| efried | bhagyashris: We definitely shouldn't need placement changes, no. | 12:48 |
| efried | bhagyashris: You say you have a way to step through the tempest test and reproduce the failure? | 12:49 |
| efried | bhagyashris: And presumably you would be able to step through that same test in an environment that did *not* include the patches in question (i.e. from the tip of the master branch)? | 12:49 |
| *** cdent has joined #openstack-nova | 12:49 | |
| efried | bhagyashris: So what we should do is query placement for the inventory records right before the meat of the test is run. | 12:50 |
| efried | bhagyashris: They should be the *same* with or without our patch. | 12:50 |
| *** felipemonteiro__ has joined #openstack-nova | 12:52 | |
| *** edmondsw has quit IRC | 12:52 | |
| *** jpena|lunch is now known as jpena | 12:54 | |
| bhagyashris | efried: I am not clear what will need to fix this | 12:54 |
| *** maciejjozefczyk1 has left #openstack-nova | 12:55 | |
| bhagyashris | efried: As the same test are passing on master and our patches are not making any change at placement or n-sch side | 12:55 |
| *** wolverineav has joined #openstack-nova | 12:56 | |
| efried | bhagyashris: I am also not clear what is needed to fix this, which is why I suggested the above to debug. If we can demonstrate that the inventories in placement are different between master and our patch, then we've done something wrong with the transition from get_inventory to update_provider_tree. | 12:56 |
| efried | bhagyashris: But if they're the same... then we need to look somewhere else (not sure where). | 12:56 |
| bhagyashris | efried: ohh ok | 12:57 |
| efried | bhagyashris: The tests fail the same way with the bottom patch as with the top, right? | 12:58 |
| efried | So the problem isn't with our conditional DISK_GB thing. | 12:58 |
| *** pchavva has joined #openstack-nova | 12:58 | |
| efried | It's with the translation from get_inventory to update_provider_tree. | 12:58 |
| efried | Could be in the resource tracker. | 12:58 |
| efried | or in the report client. | 12:58 |
| *** edmondsw has joined #openstack-nova | 12:59 | |
| bhagyashris | efried: just checked on both the patches different test are failing | 13:00 |
| *** awaugama has joined #openstack-nova | 13:00 | |
| *** lyan has joined #openstack-nova | 13:01 | |
| *** tbachman_ has joined #openstack-nova | 13:01 | |
| *** lyan is now known as Guest46588 | 13:01 | |
| efried | bhagyashris: If we're reporting the inventory wrong, it could mean that we're running out of capacity sooner than we used to. But the tempest tests run in parallel in zuul. So which test runs out of capacity first could vary from one run to another. | 13:01 |
| *** edmondsw has quit IRC | 13:01 | |
| bhagyashris | on parent patch the tempest-full 2 test are failing and on child patch tempest-full 7 tests are failing | 13:01 |
| *** tbachman has quit IRC | 13:02 | |
| *** tbachman_ is now known as tbachman | 13:02 | |
| efried | Let's just focus on the first patch compared to master. | 13:02 |
| *** alexchadin has joined #openstack-nova | 13:02 | |
| efried | bhagyashris: You said you were able to reproduce the failure manually? | 13:03 |
| bhagyashris | efried: no | 13:03 |
| bhagyashris | efried: I have debugged tempest test tempest.api.compute.servers.test_multiple_create.MultipleCreateTestJSON.test_multiple_create on patch https://review.openstack.org/#/c/560459/ and observed that the allocation_candidates() return at https://github.com/openstack/nova/blob/master/nova/scheduler/manager.py#L148 is empty list and same test i have ran on master there the allocation_candidates() return is successfully | 13:04 |
| efried | bhagyashris: What do you mean by "debugged" then - you mean just looking at logs? | 13:06 |
| bhagyashris | efried: I mean I have put pdb at https://github.com/openstack/nova/blob/master/nova/scheduler/manager.py#L121 and ran the tempest test using the tox -e py27 tempest test tempest.api.compute.servers.test_multiple_create.MultipleCreateTestJSON.test_multiple_create | 13:07 |
| efried | bhagyashris: And you were able to reproduce the fact that GET /allocation_candidates returns no results? | 13:08 |
| efried | ...with our patch | 13:08 |
| efried | ...but on master it returns good results? | 13:08 |
| bhagyashris | efried: yes | 13:08 |
| efried | bhagyashris: Okay, so what I'm asking is for you to do the exact same thing, but when you hit your breakpoint, manually query the placement API and pull back the inventories and allocations for the compute host. | 13:09 |
| efried | bhagyashris: If you do that for both environments - one with our patch and one with master - we should be able to determine whether those inventories/allocations are the same or different. | 13:10 |
| efried | bhagyashris: I'm especially interested in whether the total, reserved, and allocation ratio match; and whether the allocations match. | 13:10 |
| *** tbachman_ has joined #openstack-nova | 13:10 | |
| *** armaan has quit IRC | 13:12 | |
| *** tbachman has quit IRC | 13:13 | |
| *** armaan has joined #openstack-nova | 13:13 | |
| *** tbachman has joined #openstack-nova | 13:14 | |
| *** tbachman_ has quit IRC | 13:16 | |
| *** sahid has quit IRC | 13:17 | |
| *** salv-orlando has quit IRC | 13:18 | |
| *** salv-orlando has joined #openstack-nova | 13:19 | |
| openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Lift the restriction of choices for `cpu_model_extra_flags` https://review.openstack.org/563926 | 13:19 |
| openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: Do-Not-Merge: Test multiple CPU flags https://review.openstack.org/563948 | 13:19 |
| *** armaan has quit IRC | 13:20 | |
| *** armaan has joined #openstack-nova | 13:21 | |
| *** dave-mccowan has joined #openstack-nova | 13:22 | |
| *** salv-orlando has quit IRC | 13:24 | |
| *** abhishekk has joined #openstack-nova | 13:25 | |
| *** edmondsw has joined #openstack-nova | 13:27 | |
| *** jmlowe has quit IRC | 13:27 | |
| *** liuyulong has quit IRC | 13:27 | |
| *** yamamoto has quit IRC | 13:28 | |
| *** yamamoto has joined #openstack-nova | 13:28 | |
| *** edmondsw has quit IRC | 13:31 | |
| *** armaan has quit IRC | 13:32 | |
| *** armaan has joined #openstack-nova | 13:32 | |
| *** cfriesen has joined #openstack-nova | 13:33 | |
| *** sahid has joined #openstack-nova | 13:33 | |
| *** sahid has quit IRC | 13:34 | |
| *** sahid has joined #openstack-nova | 13:35 | |
| *** jbryce has quit IRC | 13:37 | |
| *** jbryce has joined #openstack-nova | 13:37 | |
| *** amoralej|lunch is now known as amoralej | 13:40 | |
| *** esberglu has joined #openstack-nova | 13:40 | |
| *** moshele has quit IRC | 13:41 | |
| openstackgerrit | Julia Kreger proposed openstack/nova master: Ironic: Lock the instance if early vif plug https://review.openstack.org/563714 | 13:42 |
| *** artom_ is now known as artom | 13:43 | |
| *** QianYu has joined #openstack-nova | 13:43 | |
| *** zhaochao has quit IRC | 13:43 | |
| *** ragiman has quit IRC | 13:45 | |
| *** abhishekk has quit IRC | 13:45 | |
| *** zul has quit IRC | 13:48 | |
| *** zul has joined #openstack-nova | 13:48 | |
| *** evin has quit IRC | 13:49 | |
| *** alexchadin has quit IRC | 13:50 | |
| *** ratailor has quit IRC | 13:50 | |
| openstackgerrit | Jens Harbott (frickler) proposed openstack/nova master: DNM: Test devstack + ceph plugin patches https://review.openstack.org/563097 | 13:51 |
| *** armaan has quit IRC | 13:51 | |
| *** tbachman has quit IRC | 13:51 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Fix dropped check for boot_index 0 in _validate_bdm https://review.openstack.org/563732 | 13:51 |
| *** armaan has joined #openstack-nova | 13:51 | |
| *** mlavalle has joined #openstack-nova | 13:53 | |
| *** QianYu has quit IRC | 13:54 | |
| *** artom2 has joined #openstack-nova | 13:54 | |
| *** QianYu has joined #openstack-nova | 13:55 | |
| *** pchavva has quit IRC | 13:55 | |
| *** jaosorior has quit IRC | 13:55 | |
| *** jaosorior has joined #openstack-nova | 13:55 | |
| *** felipemonteiro__ has quit IRC | 13:57 | |
| *** felipemonteiro__ has joined #openstack-nova | 13:57 | |
| *** jaypipes has quit IRC | 13:58 | |
| *** jaypipes has joined #openstack-nova | 13:58 | |
| *** artom2 has quit IRC | 13:59 | |
| *** hongbin_ has joined #openstack-nova | 13:59 | |
| *** edmondsw has joined #openstack-nova | 13:59 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/queens: Improve performance when list instances with IP filter https://review.openstack.org/563972 | 14:01 |
| *** yamahata has joined #openstack-nova | 14:04 | |
| *** edmondsw has quit IRC | 14:04 | |
| *** edmondsw has joined #openstack-nova | 14:04 | |
| *** artom2 has joined #openstack-nova | 14:05 | |
| *** jaosorior has quit IRC | 14:07 | |
| *** edmondsw has quit IRC | 14:09 | |
| *** edmondsw has joined #openstack-nova | 14:09 | |
| *** r-daneel has joined #openstack-nova | 14:10 | |
| *** edmondsw has quit IRC | 14:14 | |
| *** rajinir has joined #openstack-nova | 14:14 | |
| *** wolverineav has quit IRC | 14:18 | |
| *** wolverineav has joined #openstack-nova | 14:18 | |
| *** pchavva has joined #openstack-nova | 14:20 | |
| *** READ10 has joined #openstack-nova | 14:22 | |
| *** wolverineav has quit IRC | 14:24 | |
| *** wolverineav has joined #openstack-nova | 14:24 | |
| *** alexchadin has joined #openstack-nova | 14:25 | |
| *** AlexeyAbashkin has quit IRC | 14:25 | |
| *** mriedem has joined #openstack-nova | 14:26 | |
| mriedem | stephenfin: can https://review.openstack.org/#/c/541290/ be updated now? | 14:26 |
| stephenfin | mriedem: Sure. I was working through PoC to make sure the idea worked and it does. I'll update the spec pronto | 14:27 |
| stephenfin | *a PoC | 14:27 |
| mriedem | cool, thanks | 14:27 |
| openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Drop MIN_LIBVIRT_BLOCK_LM_WITH_VOLUMES_VERSION https://review.openstack.org/563984 | 14:28 |
| *** wolverineav has quit IRC | 14:28 | |
| *** tomtom001 has quit IRC | 14:28 | |
| *** tomtom001 has joined #openstack-nova | 14:29 | |
| *** cristicalin has joined #openstack-nova | 14:31 | |
| mriedem | johnthetubaguy_: can you go over https://review.openstack.org/#/c/552078/ again since i've updated it? | 14:33 |
| *** edmondsw has joined #openstack-nova | 14:35 | |
| *** namnh has joined #openstack-nova | 14:35 | |
| esberglu | mriedem: Thoughts on my last comment here? https://review.openstack.org/#/c/526094/45/nova/virt/powervm/driver.py@559 | 14:37 |
| esberglu | Ignore the 1st UT comment, that was some confusion on our end | 14:38 |
| mriedem | so it's a DriverVolumeBlockDevice (which is a dict) rather than a BlockDeviceMapping object | 14:38 |
| mriedem | DriverVolumeBlockDevice wraps BlockDeviceMapping | 14:38 |
| *** r-daneel has quit IRC | 14:38 | |
| mriedem | i think the ironic driver has the same need for the is_volume getting exposed from the internally wrapped bdm | 14:38 |
| mriedem | sec | 14:38 |
| *** r-daneel has joined #openstack-nova | 14:39 | |
| mriedem | https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L392-L396 | 14:39 |
| *** edmondsw has quit IRC | 14:40 | |
| mriedem | so you could do that and then when we handle the ironic driver TODO we can also cleanup the powervm driver | 14:40 |
| *** hemna_ has joined #openstack-nova | 14:40 | |
| esberglu | mriedem: Sounds good thanks! | 14:40 |
| mriedem | that also forces you to use DriverVolumeBlockDevice objects in your unit tests, but i think that's a good thing, given a BDM can be one of at least 3 or 4 things at any given point in the code | 14:41 |
| *** links has quit IRC | 14:42 | |
| *** edmondsw has joined #openstack-nova | 14:42 | |
| esberglu | mriedem: We already are using DriverVolumeBlockDevice objects :) | 14:42 |
| mriedem | then you get a root beer scented scratch-n-sniff | 14:43 |
| *** moshele has joined #openstack-nova | 14:43 | |
| *** eharney has joined #openstack-nova | 14:44 | |
| stephenfin | mriedem, jaypipes, bauzas, gibi: I'm thinking most of the information from here down is too detailed for the spec (it was mostly to help me figure out the problem boundary myself). I think I could drop the whole piece. Thoughts? https://review.openstack.org/#/c/541290/7/specs/rocky/approved/numa-aware-vswitches.rst@38 | 14:45 |
| *** edmondsw has quit IRC | 14:46 | |
| mriedem | stephenfin: given my lack of knowledge on numa stuff, i'll likely appreciate details in the problem description | 14:47 |
| stephenfin | mriedem: This is more about OVS-DPDK internals. If you think that's be helpful, I can keep it | 14:48 |
| stephenfin | I'd like to add it to a different section but that upsets pep8 :) | 14:48 |
| gibi | stephenfin: I have the same mental debate about the bandwidth spec. It is too detailed for a reader who is familar with the problem and the proposed solution, but it has a lot of nice details and reasoning for a new reader. | 14:48 |
| *** alexchadin has quit IRC | 14:48 | |
| gibi | stephenfin: for me it is OK to remove that section from your spec | 14:48 |
| *** moshele has quit IRC | 14:48 | |
| gibi | stephenfin: you can add new subsections but you cannot add a new top level section | 14:49 |
| stephenfin | maybe I can publish it as a separate blog and link to that from there | 14:49 |
| mriedem | stephenfin: i was just thinking that | 14:49 |
| *** eharney has quit IRC | 14:49 | |
| mriedem | 'for more information on how this relates to dpdk, see $link' | 14:49 |
| stephenfin | mriedem: Sounds good to me. I'll do that | 14:50 |
| * stephenfin drags out his blogging tools | 14:50 | |
| jaypipes | stephenfin: I don't mind that detail. | 14:53 |
| *** yamamoto has quit IRC | 14:58 | |
| *** dpawlik has quit IRC | 15:00 | |
| *** rmart04 has quit IRC | 15:01 | |
| *** esberglu has quit IRC | 15:04 | |
| *** jaosorior has joined #openstack-nova | 15:05 | |
| kashyap | stephenfin: Yeah, it comes useful for that poor soul who will look at it 5 years down the line | 15:05 |
| *** esberglu has joined #openstack-nova | 15:05 | |
| *** tesseract has quit IRC | 15:06 | |
| *** tesseract has joined #openstack-nova | 15:06 | |
| *** AlexeyAbashkin has joined #openstack-nova | 15:08 | |
| *** felipemonteiro_ has joined #openstack-nova | 15:13 | |
| *** alexchadin has joined #openstack-nova | 15:13 | |
| melwitt | lyaaaaaaaaarwood: could you please hit this again? pike change has merged https://review.openstack.org/#/c/561613/ | 15:14 |
| *** armaan has quit IRC | 15:14 | |
| *** armaan has joined #openstack-nova | 15:14 | |
| melwitt | dansmith: could you please look at this stack of two backports for ocata? these and the one ^ are the last needed for the ocata release https://review.openstack.org/#/c/560162 | 15:15 |
| *** felipemonteiro__ has quit IRC | 15:16 | |
| dansmith | ack | 15:17 |
| *** eharney has joined #openstack-nova | 15:18 | |
| openstackgerrit | Jay Pipes proposed openstack/nova-specs master: Support initial allocation ratios https://review.openstack.org/552105 | 15:19 |
| *** lyaaaaaaaaarwood is now known as lyarwood | 15:19 | |
| lyarwood | melwitt: done | 15:19 |
| melwitt | mriedem: what do you think of this approach for fixing the ceph job? frickler is trying something different to check the target branch to determine "if pike uca" https://review.openstack.org/#/c/563870 | 15:20 |
| melwitt | thanks lyarwood | 15:20 |
| *** ccamacho1 has joined #openstack-nova | 15:21 | |
| *** sahid has quit IRC | 15:21 | |
| *** ccamacho has quit IRC | 15:21 | |
| mriedem | melwitt: since stable/pike devstack uses the ocata UCA, and rocky now uses the queens UCA, and devstack-plugin-ceph is branchless, this seems appropriate | 15:23 |
| melwitt | mriedem: k, cool. just wanted to make sure stable/queens won't be changing which UCA it uses in the future (makes sense that it wouldn't change) | 15:24 |
| mriedem | it could change, but likely wont | 15:24 |
| kashyap | Does anyone with Parallels / Virtuozzo experience, do you know if QEMU Guest Agent is required to set password in Nova? | 15:24 |
| mriedem | kashyap: you'd have to reach out to mnestratov | 15:25 |
| * kashyap checks on OFTC #virt, have seen Virtuozzo folks there a few times | 15:25 | |
| kashyap | mriedem: Yep, checking with one of his colleagues | 15:25 |
| mriedem | https://wiki.openstack.org/wiki/ThirdPartySystems/Virtuozzo_CI | 15:25 |
| melwitt | cool | 15:25 |
| kashyap | As Maxim normally doesn't seem to hangout here, only occasionally | 15:25 |
| *** do3meli has quit IRC | 15:27 | |
| kashyap | None of the contacts are on IRC (neither on FN, nor on OFTC), I'll email them probably | 15:28 |
| *** dklyle has joined #openstack-nova | 15:29 | |
| *** spsurya has quit IRC | 15:31 | |
| *** spsurya has joined #openstack-nova | 15:32 | |
| *** eharney has quit IRC | 15:32 | |
| *** edmondsw has joined #openstack-nova | 15:33 | |
| *** salv-orl_ has joined #openstack-nova | 15:35 | |
| *** moshele has joined #openstack-nova | 15:35 | |
| kashyap | Sent | 15:37 |
| *** tbachman has joined #openstack-nova | 15:37 | |
| *** sahid has joined #openstack-nova | 15:38 | |
| openstackgerrit | Merged openstack/os-vif master: Trivial: Update pypi url to new url https://review.openstack.org/563246 | 15:38 |
| *** gyee has joined #openstack-nova | 15:38 | |
| *** munimehan has joined #openstack-nova | 15:38 | |
| openstackgerrit | Jay Pipes proposed openstack/nova master: mirror nova host aggregate members to placement https://review.openstack.org/553597 | 15:39 |
| TheJulia | Greetings nova folk, we're currently looking at an issue with ironic virt driver where due to the need for networking information for block device mappings, we end up getting called for vif attachment actions prior to a node being reserved in the spawn action by our virt driver. We're pondering two options, explicitly check during a vif plugging action, or adding a new virt driver call that would be along the lines of | 15:40 |
| TheJulia | preparing to spawn in order to facilitate the actual lock of the node resource. Thoughts would be appreciated since we somehow need to flag the node as in use for any other users of ironic's API prior to attaching the vifs. | 15:40 |
| openstackgerrit | Eric Berglund proposed openstack/nova master: PowerVM Driver: vSCSI Fibre Channel volume adapter https://review.openstack.org/526094 | 15:41 |
| openstackgerrit | Eric Berglund proposed openstack/nova master: PowerVM Driver: Snapshot https://review.openstack.org/543023 | 15:41 |
| openstackgerrit | Eric Berglund proposed openstack/nova master: PowerVM Driver: DiskAdapter parent class https://review.openstack.org/549053 | 15:41 |
| openstackgerrit | Eric Berglund proposed openstack/nova master: PowerVM Driver: Localdisk https://review.openstack.org/549300 | 15:41 |
| melwitt | jbernard: hi, we're trying to fix the ceph job that's failing 100% on master, would appreciate your review https://review.openstack.org/#/c/563870 | 15:42 |
| jbernard | melwitt: certainly | 15:43 |
| *** tbachman has quit IRC | 15:43 | |
| melwitt | thanks! | 15:43 |
| jaypipes | TheJulia: I'm confused why vif setup actions are being called prior to the node being reserved. | 15:43 |
| *** thorst has joined #openstack-nova | 15:43 | |
| melwitt | same | 15:44 |
| jaypipes | TheJulia: I would think that setup_networking_on_host() would only happen after Ironic has notified the Ironic virt driver that the node is ready for provisioining? | 15:44 |
| *** alexchadin has quit IRC | 15:46 | |
| TheJulia | jaypipes: melwitt: let me grab the link for the change so we can discuss this with more information | 15:47 |
| *** lajoskatona has quit IRC | 15:47 | |
| TheJulia | between three other conversations :( | 15:47 |
| *** tbachman has joined #openstack-nova | 15:48 | |
| openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Drop MIN_LIBVIRT_BLOCK_LM_WITH_VOLUMES_VERSION https://review.openstack.org/563984 | 15:48 |
| openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Drop MIN_LIBVIRT_NUMA_VERSION_PPC https://review.openstack.org/564010 | 15:48 |
| openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: Drop BAD_LIBVIRT_NUMA_VERSIONS https://review.openstack.org/564011 | 15:48 |
| openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Drop BAD_LIBVIRT_CPU_POLICY_VERSIONS https://review.openstack.org/564012 | 15:48 |
| openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Drop MIN_LIBVIRT_PARALLELS_SET_ADMIN_PASSWD https://review.openstack.org/564013 | 15:48 |
| openstackgerrit | Stephen Finucane proposed openstack/nova-specs master: Add 'numa-aware-vswitches' spec https://review.openstack.org/541290 | 15:49 |
| kashyap | (Damn, missed the 'libivrt' prefix for one of the commits; will fix it after I figure out to fix the 2 failing unit tests.) | 15:49 |
| *** felipemonteiro_ has quit IRC | 15:49 | |
| *** felipemonteiro_ has joined #openstack-nova | 15:49 | |
| *** damien_r has quit IRC | 15:50 | |
| *** chyka has joined #openstack-nova | 15:50 | |
| TheJulia | melwitt: jaypipes: This is the change that changed the behavior https://github.com/openstack/nova/commit/23d935b3a60741ddb52f076ffeacde9c37f17c8c which should hopefully shed light as to why | 15:50 |
| *** pcaruana has quit IRC | 15:51 | |
| melwitt | oh, I remember that now | 15:52 |
| *** trinaths has joined #openstack-nova | 15:52 | |
| *** moshele has quit IRC | 15:53 | |
| *** chyka_ has joined #openstack-nova | 15:53 | |
| jaypipes | TheJulia: gimme a bit to read the original review. | 15:53 |
| * TheJulia guesses maybe just assert the lock there.... in the ironic virt driver | 15:54 | |
| TheJulia | jaypipes: no worries, 2 other conversations and a meeting shortly :( | 15:54 |
| melwitt | IP is needed for the volume backend (or some volume backends require it) | 15:55 |
| *** ccamacho1 has quit IRC | 15:55 | |
| *** jmlowe has joined #openstack-nova | 15:55 | |
| TheJulia | Correct, as some do IP level filtering on inbound iscsi connections | 15:55 |
| *** chyka has quit IRC | 15:56 | |
| melwitt | so the vif plug is the problem right? I would think you could get the IP early but wait to plug the vif until the normal time | 15:57 |
| melwitt | (until after it's reserved) or would that not help? | 15:57 |
| openstackgerrit | Merged openstack/nova master: Test case: traits don't sync if first access fails https://review.openstack.org/558066 | 15:58 |
| *** jmlowe has quit IRC | 15:59 | |
| *** yamamoto has joined #openstack-nova | 15:59 | |
| *** r-daneel_ has joined #openstack-nova | 15:59 | |
| TheJulia | Well, getting the IP earlier would help, I think but there is a caveat there I need to try and remember around vif behavior | 15:59 |
| *** r-daneel has quit IRC | 16:00 | |
| *** r-daneel_ is now known as r-daneel | 16:00 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Proxy is_volume through DriverBlockDevice https://review.openstack.org/564017 | 16:01 |
| efried | mriedem, esberglu, TheJulia: ^^ | 16:01 |
| melwitt | what I mean is decouple the two (creating port vs plugging vif). because that patch moved both of them earlier, so I was thinking maybe decoupling them to leave the port create earlier but do the vif plug later (back to the original place). I need to look at it more to see if what I'm saying makes sense or not | 16:02 |
| *** sahid has quit IRC | 16:03 | |
| melwitt | oh, all prepare_networks_before_block_device_mapping does is plug vifs. it doesn't create the port | 16:03 |
| *** armaan has quit IRC | 16:04 | |
| melwitt | hm, I didn't think vif plugging had anything to do with getting an IP address. I thought that was connected to the port creation | 16:04 |
| *** yamamoto has quit IRC | 16:04 | |
| *** armaan has joined #openstack-nova | 16:05 | |
| *** esberglu has quit IRC | 16:05 | |
| *** esberglu has joined #openstack-nova | 16:05 | |
| *** moshele has joined #openstack-nova | 16:06 | |
| *** lucasagomes is now known as lucas-afk | 16:06 | |
| *** armaan_ has joined #openstack-nova | 16:07 | |
| *** moshele has quit IRC | 16:07 | |
| *** armaan has quit IRC | 16:08 | |
| *** armaan_ has quit IRC | 16:09 | |
| *** esberglu has quit IRC | 16:10 | |
| *** armaan has joined #openstack-nova | 16:12 | |
| *** armaan has quit IRC | 16:13 | |
| *** yamahata has quit IRC | 16:15 | |
| *** cristicalin has quit IRC | 16:16 | |
| TheJulia | efried: I completely forgot about that *blink* *blink* | 16:16 |
| TheJulia | feels like a lifetime ago | 16:16 |
| melwitt | TheJulia: I see that the patch gets the IP address from the attached vif from ironic. is there some reason why we couldn't just use the IP address from the neutron port instead of attaching the vif early? https://developer.openstack.org/api-ref/network/v2/#show-port-details | 16:17 |
| jaypipes | melwitt: it's not really port creation that is needed. it's IP allocation. | 16:17 |
| jaypipes | melwitt: but if that's what you mean by port creation, then yes, decoupling those things would be ++ | 16:18 |
| melwitt | okay, so with ironic driver we don't get an IP when we create a port in neutron? or do we not even create a port in neutron when ironic driver? | 16:18 |
| jaypipes | melwitt: as with most thing neutron, it depends :) | 16:18 |
| TheJulia | heh | 16:19 |
| jaypipes | melwitt: if the subnet upon which the port resides uses DHCP, then the IP is doled out to the port after the port is set up on the host. | 16:19 |
| TheJulia | I think if we could get the IP address in advance then ++++++ but I'm having strong deja vu, I just can't place it at hte moment | 16:19 |
| melwitt | okay. yeah, from what I understand, creating the port in neutron will allocate the IP(s). plugging the vif will just attach the instance to the network. so I was thinking can we decouple that and get the IP from neutron instead of getting it from ironic by way of the vif | 16:19 |
| TheJulia | uhg, yeah | 16:19 |
| TheJulia | which means the port has to be plugged to have correct dhcp information | 16:20 |
| jaypipes | melwitt: in TheJulia's case, I think that basically the only way that it will work is if an IP is statically assigned ahead of time. | 16:20 |
| jaypipes | melwitt: but I'm definitely no expert in Neutron-isms. Perhaps sean-k-mooney is a good person to ask about this if not mriedem. | 16:20 |
| melwitt | jaypipes: oh, I see. I wasn't thinking of DHCP :( | 16:20 |
| jaypipes | melwitt: in this specific case (the hitachi/fujitsu NFS/SAN thing) I would think that a statically-assigned IP address is really the only way it would work. | 16:21 |
| jaypipes | melwitt: otherwise, the connector info would need to essentially say "this storage NIC is gonna get some IP address in this CIDR but I don't know what that specific IP address is right now". And I'm pretty sure no such affordance is possible in the volume connector info ;) | 16:23 |
| *** tssurya has quit IRC | 16:23 | |
| TheJulia | jaypipes: as in operator pre-creation of the ports, definition of said vifs upon spawning a node? | 16:23 |
| melwitt | yeah. huh. I guess that means that any deployment using DHCP must be creating neutron ports in deferred mode or no IP allocation mode? | 16:23 |
| *** jdillaman has joined #openstack-nova | 16:23 | |
| jaypipes | TheJulia: yes, which is a very common thing already. | 16:23 |
| jaypipes | TheJulia: and passing nova boot --nic port=<UUID> (or whatever the magical incantation is...) | 16:24 |
| TheJulia | jaypipes: that is correct, we can't say "later" for the volume connection info because it gets shipped all the way to the backend storage upfront | 16:24 |
| TheJulia | hshiina|afk: ^^^ thoughts | 16:24 |
| * TheJulia is sure he is asleep :( | 16:24 | |
| jaypipes | TheJulia: although saying "laterz dude" in the connector info would be, well, amaze-balls. | 16:24 |
| TheJulia | jaypipes: totally | 16:24 |
| jaypipes | TheJulia: I think you meant "totes magotes". | 16:25 |
| melwitt | hah | 16:25 |
| melwitt | jobin | 16:25 |
| TheJulia | lol | 16:25 |
| *** moshele has joined #openstack-nova | 16:26 | |
| melwitt | going down a different thought path, can we not wait until after the node is reserved to attach the block device instead? | 16:27 |
| TheJulia | we actually should be waiting | 16:27 |
| TheJulia | but the cinderside of that has to be done first with information about the node too | 16:28 |
| TheJulia | wow, what a fun chicken and the egg | 16:28 |
| melwitt | okay, I think I'm confused because the new problem that's happening is vifs are being plugged before the node is reserved. and we need to plug the vifs to get the IP address so we can attach the volume | 16:28 |
| melwitt | so I think I don't get why we can do both after the node is reserved | 16:28 |
| jaypipes | melwitt: we could definitely do that, yes. Though that won't solve the problem if the port has no IP address already, right? | 16:28 |
| melwitt | *can't | 16:28 |
| melwitt | like, why can't we reserve the node, plug vifs, get IP for volume connector, attach volume | 16:29 |
| *** moshele has quit IRC | 16:29 | |
| TheJulia | Ideally that is what we should be doing in the grand scheme of the universe | 16:29 |
| TheJulia | ideally | 16:29 |
| melwitt | there is something preventing that from being possible? | 16:30 |
| *** thorst has quit IRC | 16:30 | |
| jaypipes | melwitt: nope | 16:30 |
| jaypipes | melwitt: nothing preventing that AFAICT | 16:30 |
| *** mgoddard has quit IRC | 16:30 | |
| TheJulia | what would be more ideal I guess is the question from a nova point of view, a new pre-spawn virt driver method call or we just quietly check/assert when we get the vif plug call | 16:30 |
| melwitt | let's do that | 16:30 |
| *** artom2 has quit IRC | 16:31 | |
| *** jchhatbar has quit IRC | 16:32 | |
| melwitt | oh, so the first step in spawn would not be reserve? | 16:32 |
| melwitt | (I don't know where reserve is currently happening) | 16:33 |
| TheJulia | melwitt: in spawn when we begin to populate information in ironic about the instance | 16:33 |
| melwitt | ohhh yeah. sorry | 16:33 |
| melwitt | this network prep thing is called in compute/manager early | 16:33 |
| TheJulia | no worries | 16:34 |
| TheJulia | yeah | 16:34 |
| melwitt | looking in the code for where reserve is currently happening and can't find it | 16:37 |
| jaypipes | melwitt: yeah, we might want to move the network prep for block devices thing to being a method that is called from the virt driver and not the compute manager | 16:37 |
| * jroll pokes his head in | 16:37 | |
| jaypipes | melwitt: so that the virt driver can dictate when it is appropriate to do that prep work | 16:38 |
| * jaypipes hides from jroll | 16:38 | |
| dansmith | melwitt: are you suggesting plugging vifs before we call virt spawn across the board? | 16:38 |
| TheJulia | melwitt: instance_uuid being set | 16:38 |
| jroll | I did a poc for the pre-spawn method call TheJulia mentioned, fwiw: https://review.openstack.org/#/c/563722/ | 16:38 |
| jaypipes | dansmith: nope, not plugging vifs. | 16:38 |
| melwitt | dansmith: no, I mean, where can we do the ironic node reserve call | 16:38 |
| dansmith | jaypipes: okay I see vif plugging discussion above, but wasn't following | 16:39 |
| melwitt | because ultimately we want to reserve the node before plugging vifs or attaching volumes. I just don't know where that's currently being done | 16:39 |
| TheJulia | melwitt: let me get you the line, one moment | 16:39 |
| jroll | melwitt: currently the ironic driver reserves the node within spawn() | 16:39 |
| jroll | by sending instance_uuid in a PUT request | 16:39 |
| jroll | or node.update I guess, in ironicclient terms | 16:39 |
| melwitt | okay I see | 16:39 |
| melwitt | I mean, the cheat would be move that call to "prepare networking etc" method | 16:40 |
| TheJulia | https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L360 | 16:40 |
| jroll | melwitt: ya, that's the other version: https://review.openstack.org/#/c/563714/ | 16:40 |
| TheJulia | :) | 16:41 |
| jaypipes | dansmith: no worries. we were discussing that ironic (actually, some cinder drivers) need to know the IP address of a port up front. and the prep_network_for-blokc_devices() virt driver API method was added in order to address that need. But that method does vif plugging (because that's unfortunately when a port's IP address is guaranteed to be set). We would like to see the IP address allocation decoupled from the vif plugging action. | 16:41 |
| jroll | feels out of place to me but if the bug gets fixed then ¯\_(ツ)_/¯ | 16:41 |
| melwitt | jroll: ah, so that's what y'all mean by "lock" | 16:41 |
| dansmith | jaypipes: okay | 16:41 |
| TheJulia | s/lock/giant flag saying node is in use/ | 16:41 |
| jroll | melwitt: we also have internal locks which block certain actions on the node, so... sometimes :) | 16:42 |
| melwitt | yeah, makes sense | 16:42 |
| melwitt | heh | 16:42 |
| melwitt | jaypipes, dansmith: but it can't be because DHCP, right? | 16:42 |
| dansmith | melwitt: hmm? | 16:43 |
| dansmith | melwitt: once you know the host, you can do the binding and get a port allocation at that point | 16:43 |
| melwitt | dansmith: like, I had been thinking up to now that we get an IP allocated when we create the neutron port. but in the case of DHCP being used, that would not be true, right? | 16:43 |
| dansmith | er, an address allocation for the port I mean | 16:43 |
| jaypipes | melwitt: yes, when a port is in a subnet that is DHCP-enabled, the port does not get an IP address until after vif plugging (and the DHCP lease is done) | 16:43 |
| *** pcaruana has joined #openstack-nova | 16:43 | |
| dansmith | jaypipes: I think you get an address when you host-bind it, not exactly plug right? | 16:44 |
| jroll | note that ironic doesn't bind the host to the port in nova, but later in ironic, because it can't be attached to the tenant network until it's deployed | 16:44 |
| melwitt | dansmith: because ultimately what they need is to know the IP before they attach the volume. and so far, they have to plug the vif first in order to get the IP. and the problem that's happening is that the vif plug is happening outside of the node reserve lock, so things are racing | 16:45 |
| jaypipes | dansmith: in the case of DHCP, the VIF needs to be fully set up and then the DHCP request made to the gateway, though, right? only after that will the port get an IP adderess. | 16:45 |
| dansmith | jaypipes: you don't have to hit the dhcp server with a client to get an address | 16:45 |
| jaypipes | dansmith: sorry, I wasn't aware that was possible. | 16:46 |
| dansmith | melwitt: I'm not positive at which exact step neutron will assign an address I guess (plug vs. bind), | 16:46 |
| dansmith | but I'm nearly positive it happens before the client is really set up, | 16:46 |
| dansmith | otherwise you wouldn't be able to see what ip your instance is going to have until it has come up enough to have hit the dhcp server | 16:46 |
| melwitt | dansmith: plug is just a local thing (os-vif in the case of libvirt) so it must be the bind, I think | 16:46 |
| *** armaan has joined #openstack-nova | 16:46 | |
| dansmith | which wouldn't make any sense | 16:46 |
| melwitt | sean-k-mooney we need you! | 16:47 |
| melwitt | :) | 16:47 |
| jroll | I feel like IP allocation is done at port create time, but I would need to verify | 16:47 |
| TheJulia | I'm 95% sure it is | 16:47 |
| dansmith | jroll: exactly | 16:47 |
| melwitt | that's what I said earlier | 16:47 |
| jroll | dansmith: with or without a host binding, to be clear | 16:47 |
| melwitt | so I was thinking, why not just ask neutron for the IP instead of doing plug_vifs | 16:47 |
| melwitt | *plug_vifs early | 16:48 |
| dansmith | jroll: I think it depends on how the network is setup whether you get it early or late, IIRC, but I dunno | 16:48 |
| jaypipes | dansmith: by "port creation time" are you referring to when neutron port-create is done? because I'm pretty sure that *isn't* when IP allocation is done. | 16:48 |
| jroll | could be, neutron is just a framework after all :) | 16:48 |
| *** salv-orl_ has quit IRC | 16:48 | |
| dansmith | I think it can happen at port-create time, and I think it can happen at host bind time | 16:48 |
| dansmith | but I don't think it happens at vif_plug time | 16:48 |
| melwitt | yes it's configurable https://developer.openstack.org/api-ref/network/v2/#ip-allocation-extension | 16:48 |
| *** ccamacho has joined #openstack-nova | 16:49 | |
| dansmith | think about when you're booting an instance and when you get to see the IP via the api in the scheme of it booting | 16:49 |
| dansmith | usually you see it before it has even finished downloaded the image to the compute node right? | 16:49 |
| melwitt | right, that's what I thought | 16:49 |
| melwitt | but I thought is that only for static IPs and not DHCP? | 16:49 |
| melwitt | I had thought it didn't matter | 16:50 |
| dansmith | dhcp is just how you communicate the ip to the guest, | 16:50 |
| dansmith | I don't think it changes how/when the port would get assigned an ip | 16:50 |
| jroll | melwitt: so, ironic does a very late host binding of the port, because at that time it's put onto the tenant network (which we don't want during deployment). our plug_vifs call is the api endpoint for the code that does the host binding in ironic: https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L1620 | 16:50 |
| melwitt | yeah, good point. we use DHCP in the gate and yeah, pretty sure the IP is known once the neutron port is created. but we do know that's configurable, not necessarily true that the IP will be known at port create time depending on how the network is setup in neutron, seems like | 16:51 |
| jroll | (and so during BFV deployment, prepare_networks_before_block_device_mapping is a fine time to put it on the tenant network, since we skip the deployment ramdisk) | 16:52 |
| melwitt | jroll: yeah, figured it must be because plug_vifs was needed to get the IP | 16:52 |
| jroll | melwitt: I assume it's just to hook up the networks, but not sure, I don't know this code well | 16:53 |
| * jroll looks around | 16:53 | |
| artom | Which one between flavor extra specs and image properties is arbitrary again? | 16:53 |
| dansmith | artom: the former | 16:53 |
| dansmith | melwitt: maybe mlavalle is around and could answer some questions | 16:53 |
| artom | dansmith, so operators can add a "foo" extra spec, and enable a filter (which one?) that would schedule all those foos to a certain aggregate? | 16:53 |
| jroll | ah yes, the IP comes from the BDM info: https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L399 | 16:53 |
| *** trinaths has quit IRC | 16:54 | |
| jroll | the plug_vifs call is just to get networking up | 16:54 |
| melwitt | jroll: yeah, so back when we started talking about this today I was saying can we decouple the vif plugging from the IP get query and leave the vif plugging for after the node reserve like it used to be. not sure if the host bind should be behind reserve too though | 16:54 |
| dansmith | artom: I have to go look for the linkage every time I'm asked.. I think there is an AggregateExtraSpecs filter or something that you use | 16:54 |
| jroll | melwitt: the vif plugging is the host bind for us, but yeah, good question | 16:54 |
| artom | dansmith, aha, thanks, I'll dig in the code then | 16:55 |
| melwitt | jroll: this is the change that moved vif plug out from the node reserve in order to get an IP for the volume connector https://review.openstack.org/#/c/468353/19/nova/virt/ironic/driver.py | 16:55 |
| dansmith | see I think in the late case, the host binding step is when you get your allocation | 16:55 |
| jroll | melwitt: it feels like we could | 16:55 |
| *** sambetts is now known as sambetts|afk | 16:55 | |
| melwitt | dansmith: yeah. so would it be safe to do that outside of node reserve? jroll? | 16:56 |
| jroll | dansmith: melwitt: oh, right, that docstring tells us exactly that | 16:56 |
| melwitt | besides that, wouldn't that require a change to ironic API too? | 16:56 |
| dansmith | melwitt: you can do host binding before spawn, that should be fine, you just can't do the plug before it | 16:56 |
| *** itlinux has joined #openstack-nova | 16:57 | |
| melwitt | k | 16:57 |
| jroll | melwitt: so, the problem we're seeing is when scheduling races with two instances to a node, they both try to do the plug because we haven't set that reservation. so I'm thinking if we do that reservation first thing, then we never hit this again | 16:57 |
| melwitt | so it sounds like we have two options: decouple the host binding and do that in prepare_networks_before_block_device_mapping, get the IP for the volume attach, then reserve, then plug vifs etc | 16:58 |
| melwitt | or, add a way to do the reserve first thing | 16:58 |
| dansmith | jroll: why are two things racing to the same node? | 16:58 |
| dansmith | jroll: scheduler should have prevented that already | 16:58 |
| melwitt | dansmith: the reserve isn't done until spawn | 16:58 |
| dansmith | melwitt: doesn't matter | 16:58 |
| jroll | dansmith: not a clue | 16:58 |
| melwitt | hm | 16:58 |
| TheJulia | and there can be multiple consumers of ironic's api | 16:58 |
| *** felipemonteiro__ has joined #openstack-nova | 16:59 | |
| dansmith | melwitt: we have committed the allocation in scheduler, which means the node isn't a candidate for any other scheduler runs | 16:59 |
| TheJulia | so we can't rely upon nova's scheduler to be the source of truth on locking | 16:59 |
| dansmith | TheJulia: is that it? nova is racing with something else? | 16:59 |
| *** fragatina has quit IRC | 16:59 | |
| melwitt | but is that what's happening in the environment you're seeing the problem? multiple consumers of ironic API? | 16:59 |
| TheJulia | dansmith: nova can race with something else, nova can also race if resource classes are not used, which is how we first noticed the issue actually | 16:59 |
| jroll | oh my | 16:59 |
| dansmith | well, "if resource classes are not used" should not be a thing | 17:00 |
| TheJulia | agreed, totally agreed | 17:00 |
| dansmith | but if it's the former, then that's fine | 17:00 |
| jroll | dansmith: I wasn't aware the allocation in scheduler landed, my bad | 17:00 |
| *** yamamoto has joined #openstack-nova | 17:00 | |
| dansmith | jroll: yeah, so nova racing with something else is a thing, I guess, but makes it less concerning to me | 17:01 |
| *** felipemonteiro__ has quit IRC | 17:01 | |
| *** derekh has quit IRC | 17:01 | |
| *** felipemonteiro__ has joined #openstack-nova | 17:01 | |
| *** mgoddard has joined #openstack-nova | 17:01 | |
| *** AlexeyAbashkin has quit IRC | 17:01 | |
| * jroll tends to think if ironic is being used with nova it should only be used with nova, but idk | 17:01 | |
| melwitt | yeah, I mean really I feel like we could just change this to something more generic, "pre-spawn-prep" kind of method and use that to do a node reserve https://review.openstack.org/#/c/468353/19/nova/virt/driver.py | 17:02 |
| TheJulia | jroll: there are some discussions in the hpc/htc world of central ironic, multiple consumers | 17:02 |
| jroll | dansmith: but anyway, I thought there was still an opportunity for a scheduler race, glad to here that's gone | 17:02 |
| dansmith | melwitt: gotta make sure you have a post-spawn-failure method to unreserve too | 17:02 |
| TheJulia | like, ironic ends up being a central broker of baremetal across datacenters *blink* *blink* | 17:02 |
| dansmith | jroll: not if you're doing the resource class thang | 17:02 |
| *** felipemonteiro_ has quit IRC | 17:02 | |
| jroll | TheJulia: I'm aware people do crazy things with ironic, like using it to manage VMs, I'm not saying it doesn't happen. I'm just saying I'm not sure we should support nova being used with ironic without owning it :) | 17:03 |
| melwitt | dansmith: ah, yeah | 17:03 |
| *** felipemonteiro has joined #openstack-nova | 17:03 | |
| jroll | dansmith: sweet. | 17:03 |
| *** fragatina has joined #openstack-nova | 17:03 | |
| TheJulia | dansmith: I think we already rip the instance_uuid in the cleanup | 17:03 |
| TheJulia | rip it off the node that is | 17:04 |
| TheJulia | so we should be covered if there is a failure | 17:04 |
| dansmith | TheJulia: not if we fail before we called spawn I imagine | 17:04 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Address issues raised in adding member_of to GET /a-c https://review.openstack.org/554357 | 17:04 |
| jroll | dansmith: ++ | 17:04 |
| *** edmondsw has quit IRC | 17:04 | |
| dansmith | TheJulia: I'm saying if we do a pre-spawn method that could have allocated resources, and then we fail to talk to glance or neutron, we have to make sure we let the virt driver know we were joking | 17:04 |
| TheJulia | dansmith: that is a good point... I thought it still got called but maybe not | 17:04 |
| TheJulia | oh jeeze, that is another way we could be orphaning vifs | 17:04 |
| * TheJulia goes and gets liquor | 17:04 | |
| * TheJulia fails to find anything | 17:05 | |
| *** yamamoto has quit IRC | 17:06 | |
| jroll | yeah, it does not, only if we fail spawn(). whomp whomp | 17:06 |
| TheJulia | :( | 17:06 |
| jroll | TheJulia: this ensures we don't orphan vifs: https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L2198 | 17:06 |
| *** felipemonteiro__ has quit IRC | 17:06 | |
| melwitt | TheJulia, jroll: so what would y'all rather do? pre-spawn and have to deal with failure cleanup cases or do something to allow the host binding to be done separately from plug_vifs? or another solution I'm not thinking of? | 17:07 |
| TheJulia | jroll: if InstanceDeployFailure is added to https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L2192 then that would prevent the case I'm seeing in a couple different cases | 17:07 |
| *** ralonsoh has quit IRC | 17:07 | |
| *** Tom-Tom has joined #openstack-nova | 17:07 | |
| jroll | melwitt: I don't think we can split the host-binding from the plug_vifs, really. I think either way we have to do a pre-spawn, this started with talking about a new method vs hacking it into plug_vifs :) | 17:08 |
| *** fragatina has quit IRC | 17:08 | |
| TheJulia | what jroll said :) | 17:09 |
| melwitt | okay | 17:09 |
| jroll | TheJulia: that only comes from spawn(), right? | 17:09 |
| jroll | maybe not :/ | 17:09 |
| efried | mriedem (or anyone): Are you aware of an recent changes in nova or elsewhere that would make instance.uuid stop responding to isinstance(str)? | 17:09 |
| melwitt | yeah, I guess duh, the methods that were added have a cleanup with it already too https://review.openstack.org/#/c/468353/19/nova/virt/driver.py | 17:10 |
| TheJulia | jroll: I just spotted https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L2214 | 17:10 |
| *** mvk has quit IRC | 17:10 | |
| mriedem | efried: nope | 17:11 |
| efried | k | 17:11 |
| jroll | efried: uuid.uuid4() or whatever will yield some object rather than a string, we tend to use uuidutils.generate<tab>, could be it | 17:11 |
| jroll | TheJulia: ah, yeah | 17:11 |
| *** fragatina has joined #openstack-nova | 17:11 | |
| *** QianYu has quit IRC | 17:11 | |
| dansmith | jroll: instance.uuid will coerce it to a string thouigh | 17:11 |
| jroll | ah ok | 17:11 |
| efried | yeah, see, that's what seems not to be happening anymore in a certain code path for us. | 17:12 |
| *** arvindn05 has quit IRC | 17:12 | |
| *** jpena is now known as jpena|off | 17:12 | |
| *** tomtom001 has quit IRC | 17:13 | |
| *** kholkina has quit IRC | 17:14 | |
| openstackgerrit | melanie witt proposed openstack/nova stable/queens: DNM: testing the ceph job https://review.openstack.org/563175 | 17:15 |
| *** udesale has joined #openstack-nova | 17:15 | |
| gibi | Kevin_Zheng: I have an approved bp that could be interesting for you if you have time: https://blueprints.launchpad.net/nova/+spec/add-full-traceback-to-error-notifications | 17:16 |
| *** fragatina has quit IRC | 17:17 | |
| gibi | Kevin_Zheng: it is totally OK if you don't have time either, I just wanted advertise the opportunity | 17:17 |
| *** dtantsur is now known as dtantsur|afk | 17:17 | |
| *** felipemonteiro_ has joined #openstack-nova | 17:17 | |
| *** gjayavelu has joined #openstack-nova | 17:18 | |
| *** tomtom001 has joined #openstack-nova | 17:19 | |
| *** QianYu has joined #openstack-nova | 17:19 | |
| jroll | melwitt: dansmith: jaypipes: thanks for the help, btw :) | 17:20 |
| *** Tom-Tom has quit IRC | 17:20 | |
| openstackgerrit | Merged openstack/nova master: Add periodic task to clean expired console tokens https://review.openstack.org/325381 | 17:20 |
| *** artom_ has joined #openstack-nova | 17:20 | |
| jaypipes | jroll: I feel like I did nothing but add confusion to the situation, honestly. | 17:20 |
| *** artom has quit IRC | 17:20 | |
| *** felipemonteiro has quit IRC | 17:20 | |
| jroll | jaypipes: thanks for trying to help? :P | 17:21 |
| dansmith | jroll: jaypipes needs a hug | 17:21 |
| jroll | or a pug | 17:21 |
| melwitt | pug hug | 17:21 |
| *** namnh has quit IRC | 17:21 | |
| dansmith | or a pug hug | 17:21 |
| *** Tom-Tom has joined #openstack-nova | 17:21 | |
| *** tbachman has quit IRC | 17:21 | |
| TheJulia | Pug hugs sound far better than cat cuddles... and walking away bleeding | 17:22 |
| jroll | jaypipes: do aussies also cheer you up? https://i.imgur.com/Yswxtpy.jpg | 17:24 |
| *** arvindn05 has joined #openstack-nova | 17:24 | |
| melwitt | heh. not our cat. we think he might be part ragdoll | 17:24 |
| dansmith | jroll: I think he only likes ugly dogs | 17:24 |
| *** QianYu has quit IRC | 17:24 | |
| jroll | ha, fair | 17:24 |
| *** jaosorior has quit IRC | 17:24 | |
| jaypipes | jroll: ++ aussie's are a good cheerup. | 17:25 |
| jroll | :) | 17:25 |
| melwitt | jroll: that's adorbz | 17:25 |
| dansmith | jaypipes: but. but.. their eyeballs are fully contained within their heads... | 17:25 |
| jroll | melwitt: thanks, make sure you pass it along to james :) | 17:25 |
| *** namnh has joined #openstack-nova | 17:25 | |
| TheJulia | It is side conversations like ^^^ why I love this community | 17:25 |
| *** mdnadeem has quit IRC | 17:26 | |
| melwitt | jroll: forwarding it now | 17:26 |
| jaypipes | dansmith: details, details... | 17:27 |
| *** arvindn05 has quit IRC | 17:27 | |
| jaypipes | dansmith: they are furry, fluffy and perfect. | 17:27 |
| jaypipes | dansmith: even if they are missing googly eyes. | 17:27 |
| * dansmith doesn't understand | 17:27 | |
| jaypipes | heh | 17:27 |
| *** evin has joined #openstack-nova | 17:30 | |
| *** arvindn05 has joined #openstack-nova | 17:30 | |
| *** namnh has quit IRC | 17:30 | |
| *** rmart04 has joined #openstack-nova | 17:31 | |
| *** namnh has joined #openstack-nova | 17:31 | |
| TheJulia | jroll: Any thoughts on continuing your poc forward or just rewrite mine? | 17:32 |
| jroll | TheJulia: I could do it, or you could take it over, or you could rewrite yours, whatever you'd like to do :) | 17:33 |
| *** armaan has quit IRC | 17:33 | |
| *** lpetrut_ has joined #openstack-nova | 17:34 | |
| TheJulia | I've got it on the brain so I'll pickup yours and continue it along | 17:34 |
| jroll | awesome, thanks! happy to review if needed | 17:36 |
| jroll | TheJulia: fyi I probably picked up your bug from patchset 1 where you needed the patch wrapped in [] | 17:36 |
| *** fragatina has joined #openstack-nova | 17:37 | |
| TheJulia | my brain is currently trying to think of any other ways we could be leaking vifs and thus blocking future deploys outside of tearing down an instance and I'm not thinking of any | 17:37 |
| openstackgerrit | Jay Pipes proposed openstack/os-traits master: Add compute capabilities traits https://review.openstack.org/546713 | 17:37 |
| TheJulia | jroll: easy fix :) | 17:37 |
| *** lpetrut has quit IRC | 17:38 | |
| jaypipes | artom_, gibi, efried: addressed the rewording in https://review.openstack.org/#/c/546713/. | 17:38 |
| melwitt | mriedem: why do you think we can't drop the API code until T? I thought once all computes are upgraded to rocky, then things are guaranteed to all be using the database backend, so removal would be in Stein? https://review.openstack.org/#/c/325414/31/nova/compute/api.py@3613 | 17:38 |
| jroll | TheJulia: yep, just a heads up so you don't wait an hour for CI to find it :) | 17:38 |
| gibi | jaypipes: thanks, +2 | 17:39 |
| mriedem | melwitt: i might have been overthinking it | 17:39 |
| melwitt | k, just trying to make sure there's not something I'm missing | 17:40 |
| mriedem | replied to clarify | 17:40 |
| melwitt | cool thanks | 17:41 |
| *** abhishekk has joined #openstack-nova | 17:41 | |
| *** jaypipes is now known as jaypipes-lunch | 17:43 | |
| sean-k-mooney | melwitt: sorry i was in meeting for the last 4 hours. did ye resolve the issue ye were having? | 17:43 |
| melwitt | sean-k-mooney: yeah, I think so. we were talking about, when is a port guaranteed to have an IP allocated to it? maybe never, but it sounded like after host binding it has to? | 17:44 |
| *** namnh has quit IRC | 17:44 | |
| *** dpawlik has joined #openstack-nova | 17:45 | |
| openstackgerrit | Merged openstack/nova master: Extract generate_hostid method into utils.py https://review.openstack.org/555282 | 17:45 |
| sean-k-mooney | melwitt: right so with multi segment, l3 routed networks the allocation of the ip happens only when the port is bound to a specific host. for the general case the port will get an ip when it is created but you can have ports that only have mac adresses | 17:45 |
| *** rmart04 has quit IRC | 17:45 | |
| *** namnh has joined #openstack-nova | 17:45 | |
| *** cristicalin has joined #openstack-nova | 17:46 | |
| *** rmart04 has joined #openstack-nova | 17:46 | |
| melwitt | sean-k-mooney: gotcha. thanks | 17:46 |
| sean-k-mooney | melwitt: so after you do port binding it should have an ip if it is connected to a neutron network that has a subnet | 17:46 |
| *** cristicalin has quit IRC | 17:47 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova-specs master: Network bandwidth resource provider https://review.openstack.org/502306 | 17:47 |
| *** tbachman has joined #openstack-nova | 17:49 | |
| melwitt | sean-k-mooney: okay, so it's not ever necessarily guaranteed (would a neutron network ever not have a subnet?). we were looking at some code in the ironic driver where they need to get the IP in order to hand it to the volume connector (some volume backends require the IP before attaching). and we were wondering, at what point could one reliably query for the IP | 17:49 |
| *** dpawlik has quit IRC | 17:50 | |
| sean-k-mooney | melwitt: neutron allows your to have interfaces with no ips. nova used to require one for a neutron port to be used with an vm/instance but that requrement was removed. | 17:50 |
| sean-k-mooney | melwitt: the reason it was removed was to cater for non ip networking e.g. infinaband over ethernet | 17:51 |
| melwitt | I see | 17:51 |
| sean-k-mooney | melwitt: it sound like in the ironic case there is a hard requirement for an ip presuable you are using it to configre iscsi targest for the baremtal not or something like that? | 17:52 |
| melwitt | sean-k-mooney: yeah must be a hard requirement. it's already doing it like this https://review.openstack.org/#/c/468353/19/nova/virt/ironic/driver.py but yeah need the IP to set in the volume connector | 17:53 |
| *** tbachman has quit IRC | 17:54 | |
| *** namnh has quit IRC | 17:55 | |
| sean-k-mooney | in general l2 only connectivity is not common in neutron so this is an extream edgecase. | 17:55 |
| melwitt | and the problem was that they have to do their equivalent of "plug_vifs" first in order to get the IP and that's happening outside their node reserve lock and there are races happening. so at first we were talking about "can we get the IP before plugging the vif" but it ended up not mattering and the solution needs to be to reserve the node first before doing anything with the networking | 17:55 |
| *** edmondsw has joined #openstack-nova | 17:56 | |
| *** udesale has quit IRC | 17:57 | |
| openstackgerrit | Merged openstack/nova master: Address nits in I00d29e9fd80e6b8f7ba3bbd8e82dde9d4cb1522f https://review.openstack.org/561493 | 17:58 |
| *** bkopilov has quit IRC | 17:59 | |
| *** namnh has joined #openstack-nova | 18:00 | |
| sean-k-mooney | from a ironic perspective i think its prefectly resonable to scope the cinder volume support to jsut instance with ips at a first pass. volumes attached over infinaband is something in the storage space where we might not have ips but that is less common. | 18:00 |
| *** tbachman has joined #openstack-nova | 18:01 | |
| melwitt | yeah, that's what they've done | 18:01 |
| *** wolverineav has joined #openstack-nova | 18:01 | |
| *** moshele has joined #openstack-nova | 18:02 | |
| *** yamamoto has joined #openstack-nova | 18:03 | |
| *** edmondsw_ has joined #openstack-nova | 18:03 | |
| *** mvk has joined #openstack-nova | 18:03 | |
| openstackgerrit | Merged openstack/nova stable/ocata: Add regression test for persisted RequestSpec.retry from failed resize https://review.openstack.org/560162 | 18:05 |
| openstackgerrit | Merged openstack/nova stable/ocata: Don't persist RequestSpec.retry https://review.openstack.org/560167 | 18:05 |
| openstackgerrit | Merged openstack/nova stable/ocata: only increment disk address unit for scsi devices https://review.openstack.org/561613 | 18:05 |
| *** edmonds__ has joined #openstack-nova | 18:05 | |
| *** edmonds__ is now known as edmondsw__ | 18:06 | |
| *** edmondsw__ is now known as edmondsw___ | 18:06 | |
| *** edmondsw has quit IRC | 18:06 | |
| *** edmondsw___ is now known as edmondsw | 18:06 | |
| *** wolverineav has quit IRC | 18:06 | |
| *** yamamoto has quit IRC | 18:08 | |
| efried | cdent: yt? | 18:09 |
| *** edmondsw_ has quit IRC | 18:09 | |
| cdent | efried: hi, yup | 18:09 |
| efried | cdent: Good evening to you. Do you know of any reason Instance.uuid would or would not respond to isinstance(str) ? | 18:09 |
| *** namnh has quit IRC | 18:10 | |
| *** moshele has quit IRC | 18:10 | |
| cdent | I read you talking about that a bit earlier, but didn't chase it. Is it showing up in a particular piece of code that I can poke at? Have you been able to find out what type it is when that happens? Or is it a racey thing that you've got no easy replication for? | 18:11 |
| sean-k-mooney | efried: cdent jaypipes-lunch i need to run very soon but was a decision reached on the mailing list of how to proceed with resouce provider groups? | 18:13 |
| efried | sean-k-mooney: You mean whether numbered groups are separate by default or unrestricted? | 18:14 |
| cdent | sean-k-mooney: I think you mean this https://review.openstack.org/#/c/562687/ | 18:14 |
| sean-k-mooney | efried: yes. last i read was matt suggesting that its explcit | 18:14 |
| efried | sean-k-mooney: Yup, what cdent said - that guy has (all the links to) all the info you need. | 18:14 |
| efried | cdent: This is what I'm chasing down: http://184.172.12.213/58/557958/10/check/nova-out-of-tree-pvm/c1d7e99/logs/n-cpu.txt.gz?#_Apr_20_08_51_16_452651 | 18:15 |
| sean-k-mooney | cdent: thanks im out of office tomrow but ill print out the current version and review tomrow. | 18:15 |
| cdent | thanks efried | 18:15 |
| sean-k-mooney | efried: im glad ye found a path forward | 18:15 |
| cdent | woah, colors finally merged | 18:15 |
| efried | cdent: No, I think that's just because it's in our CI env and I have that patched in there (cause that's where I was testing it) | 18:16 |
| sean-k-mooney | cdent: colors? | 18:16 |
| efried | cdent: But you should definitely tell everybody how much you like it in https://review.openstack.org/524744 so they might merge it. | 18:17 |
| cdent | oh, sorry, didn't recognize that was your ci efried | 18:17 |
| melwitt | cdent: I had wanted to bring this bug to your attention, in case you might have some idea why the test_wsgi stuff would fail with webob 1.8.1 https://bugs.launchpad.net/nova/+bug/1765748 | 18:17 |
| openstack | Launchpad bug 1765748 in OpenStack Global Requirements "webob-1.8.1 breaks projects" [High,In progress] - Assigned to Matthew Thode (prometheanfire) | 18:17 |
| *** esberglu has joined #openstack-nova | 18:17 | |
| *** lpetrut_ has quit IRC | 18:17 | |
| *** esberglu has quit IRC | 18:17 | |
| *** esberglu has joined #openstack-nova | 18:18 | |
| efried | cdent: Anyway, the deal here is that powervm has a utility method that accepts either an integer ID or a UUID. It detects which one it is and then behaves accordingly. The code that does that hasn't changed in yeeears. | 18:18 |
| efried | The code path that calls it is when we're disconnecting a disk, which (I think) also hasn't changed in yeeeears. | 18:18 |
| sean-k-mooney | melwitt: the stack trace look like one that we get when we need to cap a dependcy in upper constrataint because of an incompatible change | 18:19 |
| cdent | melwitt: hmmm. webob often breaks such stuff, but that looks like a bad mock? is there an in-nova example? | 18:19 |
| efried | cdent: But suddenly on Friday afternoon, our CI started failing with that error. I don't actually know what type it thinks it has in there - just know that isinstance(str) is failing where it didn't before. | 18:19 |
| mriedem | sean-k-mooney: totally unrelated to what you're talking about, but i'm a bit lost in https://review.openstack.org/#/c/551370/16/nova/virt/libvirt/migration.py@229 and looking for some feedback when you get a chance | 18:19 |
| cdent | efried: still parsing | 18:20 |
| *** bkopilov has joined #openstack-nova | 18:20 | |
| sean-k-mooney | mriedem: in the generation of the updated xml for the vif on the destination node | 18:21 |
| mriedem | sean-k-mooney: yeah, i'm looking at how _update_volume_xml works and it's basically an update of any volume disks on the source using the destination block device config | 18:21 |
| mriedem | it does that by keying off the volume 'serial' which is the volume id | 18:21 |
| mriedem | we don't have something like that for the interface config in a domain xml | 18:22 |
| sean-k-mooney | mriedem: we could posibly key of the interface mac adress | 18:22 |
| mriedem | i'm not really even sure if i should be updating the interface xml entries, or replacing them | 18:22 |
| mriedem | i.e. i'm trying to handle the case that you're live migrating from a host using ovs to a host using ovn, or linuxbridge, or vhostuser, et al | 18:23 |
| sean-k-mooney | that said im not sure if we can have a vm with two port with the same mac.. | 18:23 |
| *** jaypipes-lunch is now known as jaypipes | 18:23 | |
| mriedem | i've been trying to write a test for this for a couple of hours and it just seems like doing a vif type conversion like this down in the bowels of the xml code is going to be....not reasy | 18:23 |
| mriedem | *easy | 18:23 |
| sean-k-mooney | mriedem: right in that case we are replaceing them but we likely want to keep the guest pci adress the same on both ends | 18:23 |
| *** amoralej is now known as amoralej|off | 18:24 | |
| mriedem | yeah the only thing that _update_volume_xml doesn't change is the address | 18:24 |
| cdent | efried: so "ValueError: invalid literal for int() with base 10: '4E27E1E6-6A24-4F0A-8E7B-2BBE7B4A28BA'" is caused by a conditional faililng somewhere that wasn't before? I'm unable to grep isinstance anywhere in the log? | 18:25 |
| efried | cdent: It's caused by this: https://github.com/powervm/pypowervm/blob/master/pypowervm/utils/uuid.py#L50 | 18:25 |
| efried | That isinstance() fails, so we try to int() the UUID on L55, leading to the ValueError. | 18:26 |
| mriedem | efried: have you looked at https://github.com/openstack/oslo.versionedobjects/compare/1.32.0...1.33.1 ? | 18:26 |
| mriedem | https://github.com/openstack/oslo.versionedobjects/commit/b1d0b5d886afef8c08330bf3c2291e180aa1f534 | 18:27 |
| efried | cdent: or, shit, I guess it's possible the regex match could be failing. But when I str(instance.uuid) up the stack, it succeeds. | 18:27 |
| efried | mriedem: looking... | 18:27 |
| sean-k-mooney | mriedem: so if we can assume that the vm cannont have 2 intefaces with the same mac then i think that is likely the best way to approch. if we had a way to store the neutron port uuid in the xml that would help alot but i dont think we can do that with libvirt | 18:27 |
| efried | mriedem: Bingo. When did we subsume that req? | 18:27 |
| efried | in nova | 18:27 |
| efried | in queens | 18:27 |
| efried | cause I looked for that | 18:28 |
| mriedem | efried: upper-constraints on friday for rocky | 18:28 |
| mriedem | https://github.com/openstack/requirements/commit/87540884100650cfd1a67f05163a724906efb46f#diff-0bdd949ed8a7fdd4f95240bd951779c8 | 18:28 |
| efried | ahhhh, upper-constraints. | 18:28 |
| efried | Yup, that'd do it. Thanks mriedem | 18:28 |
| efried | I knew you would come through for me. | 18:28 |
| *** gyee has quit IRC | 18:28 | |
| * cdent is relieved | 18:28 | |
| efried | mriedem: That same thing must have gone into queens somehow. | 18:30 |
| mriedem | or your CI is using the wrong upper-constraints? | 18:30 |
| mriedem | your queens CI is likely pointing at master | 18:30 |
| mriedem | although maybe not https://github.com/openstack/oslo.versionedobjects/commit/e918eb976fb5a6f9fa7b7644d5a10d383fcfcf21 | 18:31 |
| mriedem | https://review.openstack.org/#/q/Ic6b6308fb1960ec40407e6efde30137b64543e72 | 18:31 |
| mriedem | that's not released yet on stable though | 18:32 |
| *** pcaruana has quit IRC | 18:32 | |
| *** moshele has joined #openstack-nova | 18:32 | |
| cdent | efried: even if that change isn't your problem, it may be the clue. are you in py2? | 18:33 |
| mriedem | sean-k-mooney: so do you think this is safe https://review.openstack.org/#/c/551370/16/nova/virt/libvirt/migration.py@229 where it's basically taking the source vif and just overwriting whatever we got from the dest to get the new config xml? | 18:33 |
| *** mgoddard has quit IRC | 18:33 | |
| efried | cdent: Probably | 18:34 |
| cdent | so if you've got a unicode there (for whatever random reason) | 18:34 |
| efried | cdent: Our "official" fix is going to be using is_uuid_like. But that's going to require changes to pypowervm, which is going to need a requirements bump, which I'm not sure if we can swing in stable. Because we're going to have the same problem in nova (right esberglu?) | 18:35 |
| *** moshele has quit IRC | 18:36 | |
| cdent | I'm totally riffing at this point (because multitasking), but does six.text_type make a difference? | 18:36 |
| sean-k-mooney | mriedem: my concern is how to you merge the two so that if i have a vm with 2 interfaces of the same type they dont swap places e.g. eth0 becomes eth1 and vice versa. | 18:36 |
| efried | and pike | 18:36 |
| esberglu | efried: That wasn't hitting queens | 18:37 |
| esberglu | Only master | 18:37 |
| efried | esberglu: See email - it is now. | 18:37 |
| efried | and based on https://review.openstack.org/#/q/Ic6b6308fb1960ec40407e6efde30137b64543e72 it'll hit pike as soon as that percolates down. | 18:37 |
| cdent | melwitt: okay, I've repeated fhe failures so can look more sensibly now | 18:37 |
| sean-k-mooney | mriedem: i think you will have to loop over each interface element in the original xml and find the corresponding vif based on mac and then update the xml with the new atributes but maintain the order of the interfaces and maintianing the guest pci adress | 18:38 |
| *** felipemonteiro__ has joined #openstack-nova | 18:39 | |
| *** felipemonteiro_ has quit IRC | 18:39 | |
| mriedem | sean-k-mooney: but wouldn't it we be weird to have interface xmls from the guest with certain source bridge and target dev values which are then unchanged on the dest host, but things like the vif type and vnic type could change? | 18:39 |
| melwitt | thanks cdent | 18:39 |
| melwitt | mriedem: pike https://review.openstack.org/#/c/562879 and ocata https://review.openstack.org/#/c/564044 release reviews for your perusal | 18:40 |
| sean-k-mooney | mriedem: the bridge name might change on the dest as might hte vhost-user socekt path. | 18:40 |
| sean-k-mooney | mriedem: centos use /run/openvswitch/... ubuntu uses /var/run/openvswitch/... | 18:40 |
| mriedem | sean-k-mooney: but we don't have the bridge name in the migrate data object from the dest when we're munging the guest xml on the source | 18:40 |
| sean-k-mooney | mriedem: you should have that as we have already created the binding on the dest host but not activated it | 18:41 |
| sean-k-mooney | mriedem: it will be in the respocne from neutron | 18:41 |
| mriedem | is that in the details or profile dict? | 18:42 |
| sean-k-mooney | its in the vif binding_details | 18:42 |
| sean-k-mooney | i belive the key is just bridge_name | 18:42 |
| sean-k-mooney | mriedem: yep https://github.com/openstack/neutron-lib/blob/master/neutron_lib/api/definitions/portbindings.py#L53 | 18:43 |
| cdent | melwitt: looks like a google summoer of code project totally revamped accept* handling in webob 1.8.*. still digging up details | 18:43 |
| mriedem | is the vhostuser socket patch also in the vif binding details dict? | 18:43 |
| mriedem | *path | 18:43 |
| sean-k-mooney | yes | 18:43 |
| mriedem | ok | 18:43 |
| sean-k-mooney | get_vif_config(vif=vif) is the same fuction we use when spawning a vm right? | 18:44 |
| mriedem | yes | 18:44 |
| sean-k-mooney | if so it should be able to extract that info from the vif object | 18:44 |
| sean-k-mooney | ok cool | 18:44 |
| mriedem | sean-k-mooney: when you say "maintain the guest pci address" i don't see anything in the interface elements in the xml, e.g. http://logs.openstack.org/95/563995/1/check/neutron-tempest-linuxbridge/a3015a9/logs/screen-n-cpu.txt#_Apr_24_16_42_59_327342 | 18:46 |
| mriedem | oh, is that only for sriov ports? | 18:46 |
| mriedem | like vnic_type='direct'? | 18:47 |
| sean-k-mooney | no the libvirt xml for the running vm is not the same as the one we hand to libvirt. it adds pci adress for each device itself | 18:47 |
| sean-k-mooney | at least i think it does let me dump the xml from a running vm | 18:48 |
| sean-k-mooney | mriedem: so this is a running vm xml http://paste.openstack.org/show/719855/ | 18:51 |
| sean-k-mooney | the interfaces have an addtional <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> element added which is the guest virtual pci adresss | 18:51 |
| sean-k-mooney | when we generate the xml fragment using get_vif_config we do not set that | 18:52 |
| mriedem | right | 18:52 |
| sean-k-mooney | so if you just merged the generated fagment with the exising interface and done touch the adress element it will be fine | 18:52 |
| mriedem | we can parse it out of the running domain | 18:52 |
| sean-k-mooney | yep | 18:52 |
| mriedem | so here is another wrinkle wrt merging, | 18:53 |
| mriedem | let's say i'm starting from a source host with ovs and have an interface element like this http://paste.openstack.org/show/719858/ | 18:53 |
| mriedem | <source bridge="qbra188171c-ea"/> | 18:53 |
| *** rmart04 has quit IRC | 18:53 | |
| mriedem | then i live migrate to a dest host using vhostuser, | 18:53 |
| mriedem | looking at a dpdk vhostuser CI logs, that is something like http://paste.openstack.org/show/719857/ | 18:53 |
| mriedem | <source mode="server" path="/var/run/openvswitch/vhu88445a68-94" type="unix"/> | 18:53 |
| mriedem | if we merge those, we have something like <source bridge="qbra188171c-ea" mode="server" path="/var/run/openvswitch/vhu88445a68-94" type="unix"/> | 18:54 |
| mriedem | i would expect that to totally eff with libvirt/qemu | 18:54 |
| mriedem | unless it's smart enough to only parse out attributes that it knows matter for the given interface type | 18:54 |
| sean-k-mooney | right so if the vif types change we just want to copy the adress element other wise we replace it with the new vif | 18:54 |
| sean-k-mooney | that might work in all cases actully | 18:55 |
| mriedem | address or mac address? | 18:55 |
| mriedem | get_vif_config doesn't give me the device address | 18:55 |
| *** ociuhandu has joined #openstack-nova | 18:55 | |
| *** xinliang has quit IRC | 18:56 | |
| sean-k-mooney | the address element e.g. guest pci adress | 18:56 |
| sean-k-mooney | so we jsut copy the <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> form the runing xml and add it ot what we get form get_vif_config | 18:57 |
| sean-k-mooney | i think that will always be correct even if the vifs types are the same as i think that is the only thing we dont set | 18:57 |
| *** suresh12 has joined #openstack-nova | 18:58 | |
| *** suresh12 has quit IRC | 18:58 | |
| mriedem | yeah ok | 18:58 |
| mriedem | i knew there was a reason i've been putting off implementing this TODO | 18:59 |
| *** sridharg has quit IRC | 18:59 | |
| sean-k-mooney | mriedem: ya its a bit of a pain but its doable. here is a xml from a running guest with vhost user for reference http://paste.openstack.org/show/719861/ | 19:00 |
| *** gjayavelu has quit IRC | 19:00 | |
| sean-k-mooney | you should be able to use that to fake out the conversion from http://paste.openstack.org/show/719855/ which is kernel ovs | 19:00 |
| sean-k-mooney | those are two completely different vms unfortunetly but atleast it has the interface definitions which is what you need | 19:01 |
| *** gjayavelu has joined #openstack-nova | 19:02 | |
| *** dims has quit IRC | 19:02 | |
| sean-k-mooney | i have a 2 hour drive to my parents to do tonight so i have to run. ill be offline tomrow but feel free to ping me later in the week if you want any more input. | 19:03 |
| *** abhishekk has quit IRC | 19:03 | |
| *** gjayavelu has quit IRC | 19:03 | |
| *** yamahata has joined #openstack-nova | 19:04 | |
| mriedem | ack, thanks | 19:04 |
| *** yamamoto has joined #openstack-nova | 19:04 | |
| *** lpetrut_ has joined #openstack-nova | 19:04 | |
| efried | edmondsw, esberglu, mriedem: https://bugs.launchpad.net/pypowervm/+bug/1766692 | 19:06 |
| openstack | Launchpad bug 1766692 in pypowervm "instance.uuid no longer being a str breaks powervm scsi disconnect" [Undecided,New] | 19:06 |
| efried | mriedem: What are the odds of backporting a pypowervm requirements bump to queens & pike? | 19:07 |
| mriedem | not good | 19:08 |
| mriedem | i don't understand why this is an issue on stable though | 19:08 |
| *** dims has joined #openstack-nova | 19:09 | |
| *** yamamoto has quit IRC | 19:10 | |
| *** esberglu has quit IRC | 19:11 | |
| *** xinliang has joined #openstack-nova | 19:11 | |
| openstackgerrit | Merged openstack/os-traits master: Add compute capabilities traits https://review.openstack.org/546713 | 19:11 |
| *** imacdonn has quit IRC | 19:14 | |
| *** ktibi has quit IRC | 19:14 | |
| edmondsw | mriedem because https://review.openstack.org/#/q/Ic6b6308fb1960ec40407e6efde30137b64543e72 was backported to pike and queens | 19:14 |
| *** esberglu has joined #openstack-nova | 19:14 | |
| *** imacdonn has joined #openstack-nova | 19:14 | |
| edmondsw | I suspect we'll have to do something like https://review.openstack.org/#/c/563314/1/nova_powervm/virt/powervm/vm.py@808 for pike and queens, as much as I hate that, to avoid a pypowervm requirements bump | 19:15 |
| edmondsw | but if we could get a bump, we could avoid that | 19:15 |
| *** salv-orlando has joined #openstack-nova | 19:16 | |
| *** Tom-Tom has quit IRC | 19:17 | |
| mriedem | edmondsw: those aren't released in pike or queens | 19:18 |
| mriedem | upper-constraints depends on released packages on pypi | 19:18 |
| mriedem | are you guys sure that your CI running against stable isn't using upper-constraints from master? | 19:19 |
| edmondsw | mriedem yes, we're sure | 19:19 |
| edmondsw | but I'm not following you | 19:19 |
| mriedem | your CI should not be pulling in those changes from stable | 19:20 |
| *** abhishekk has joined #openstack-nova | 19:20 | |
| edmondsw | I don't know that we've seen this in CI for stable... we just saw that it merged in stable | 19:20 |
| edmondsw | we've seen this in CI for master | 19:20 |
| mriedem | then you revert those changes before they are released | 19:20 |
| mriedem | or, backport whatever the fix ends up being from master | 19:21 |
| edmondsw | for master, we should just fix pypowervm and bump requirements | 19:21 |
| edmondsw | hence the question of whether we can backport a requirements bump | 19:22 |
| edmondsw | we could try to get the oslo change reverted | 19:22 |
| efried | mriedem: We have seen this in queens, live, this morning. | 19:22 |
| mriedem | efried: in CI? | 19:22 |
| efried | no, live. | 19:23 |
| mriedem | if so, link me to the failed patch | 19:23 |
| mriedem | so someone isn't using upper-constraints in production | 19:23 |
| efried | esberglu: Can you spin up a queens CI run without the pypowervm patch so we can confirm whether this fails there? | 19:23 |
| efried | please and thank you | 19:23 |
| esberglu | efried: Sure | 19:23 |
| mriedem | also, i don't know what "live" means here, in your internal CI/CD pipeline? in a customer site, in some ibm public cloud service, other? | 19:24 |
| *** tesseract has quit IRC | 19:26 | |
| *** abhishekk has quit IRC | 19:26 | |
| efried | mriedem: An internal customer, I think. | 19:32 |
| efried | mriedem: They claim to have installed canonical's nova-compute/Queens and then nova-powervm stable/queens via git clone. | 19:33 |
| efried | and python setup.py install | 19:33 |
| mriedem | alright, well, they aren't using upper-constraints, | 19:40 |
| mriedem | or testing what they are doing apparently if they are pushing that to production | 19:40 |
| *** jackie-truong has quit IRC | 19:44 | |
| openstackgerrit | Merged openstack/nova master: Update os_compute_api:os-flavor-extra-specs:index docs for 2.61 https://review.openstack.org/561404 | 19:50 |
| openstackgerrit | Merged openstack/nova master: docs: link to volume multi-attach demo recording https://review.openstack.org/563734 | 19:50 |
| *** READ10 has quit IRC | 19:58 | |
| cdent | melwitt: I dumped a small amount of state on that bug. 1.8.x is way different and my brain has stalled for the day. | 20:00 |
| *** fragatina has quit IRC | 20:01 | |
| *** cdent has quit IRC | 20:01 | |
| melwitt | cdent: cool, thanks for looking into it. much appreciated | 20:01 |
| *** fragatina has joined #openstack-nova | 20:02 | |
| *** weshay has quit IRC | 20:05 | |
| *** yamamoto has joined #openstack-nova | 20:06 | |
| *** lpetrut_ has quit IRC | 20:07 | |
| *** weshay has joined #openstack-nova | 20:07 | |
| *** yamamoto has quit IRC | 20:11 | |
| *** hemna_ has quit IRC | 20:11 | |
| *** itlinux has quit IRC | 20:13 | |
| openstackgerrit | melanie witt proposed openstack/nova master: Use ConsoleAuthToken object to generate authorizations https://review.openstack.org/325414 | 20:14 |
| openstackgerrit | melanie witt proposed openstack/nova master: Convert websocketproxy to use db for token validation https://review.openstack.org/333990 | 20:14 |
| openstackgerrit | melanie witt proposed openstack/nova master: Update layout docs for running console proxies https://review.openstack.org/557489 | 20:14 |
| *** dklyle has quit IRC | 20:18 | |
| *** itlinux has joined #openstack-nova | 20:19 | |
| *** fragatina has quit IRC | 20:22 | |
| *** fragatina has joined #openstack-nova | 20:22 | |
| *** liuzz has quit IRC | 20:25 | |
| *** slaweq has quit IRC | 20:25 | |
| *** slaweq has joined #openstack-nova | 20:26 | |
| *** dougshelley66 has quit IRC | 20:26 | |
| *** Tom-Tom has joined #openstack-nova | 20:27 | |
| *** yamahata has quit IRC | 20:29 | |
| *** liuzz has joined #openstack-nova | 20:29 | |
| *** priteau_ has joined #openstack-nova | 20:31 | |
| *** Tom-Tom has quit IRC | 20:32 | |
| *** evin has quit IRC | 20:33 | |
| *** priteau has quit IRC | 20:34 | |
| *** hemna_ has joined #openstack-nova | 20:37 | |
| *** gouthamr has quit IRC | 20:38 | |
| *** damien_r has joined #openstack-nova | 20:38 | |
| *** alexchadin has joined #openstack-nova | 20:38 | |
| *** alexchadin has quit IRC | 20:38 | |
| *** damien_r has quit IRC | 20:38 | |
| *** damien_r has joined #openstack-nova | 20:38 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Proxy is_volume through DriverBlockDevice https://review.openstack.org/564017 | 20:39 |
| efried | mriedem, melwitt, TheJulia: With UT ^ | 20:39 |
| TheJulia | efried: awesome! | 20:39 |
| *** eharney has joined #openstack-nova | 20:41 | |
| *** gjayavelu has joined #openstack-nova | 20:41 | |
| *** READ10 has joined #openstack-nova | 20:42 | |
| *** gouthamr has joined #openstack-nova | 20:43 | |
| *** damien_r has quit IRC | 20:44 | |
| *** pchavva has quit IRC | 20:46 | |
| *** moshele has joined #openstack-nova | 20:47 | |
| *** moshele has quit IRC | 20:50 | |
| *** jmlowe has joined #openstack-nova | 20:50 | |
| *** jmlowe has quit IRC | 20:52 | |
| *** liuzz_ has joined #openstack-nova | 20:54 | |
| esberglu | efried: Queens CI is fine without the pypowervm patch | 20:54 |
| esberglu | Must have been something wrong on the customers end | 20:55 |
| efried | esberglu: Yeah, what's weird is, I'm talking to Vlad and he's got 1.31.2 installed - which should be fine. | 20:55 |
| *** liuzz has quit IRC | 20:55 | |
| efried | esberglu: But he may have had some pip weirdness hanging around before. | 20:55 |
| *** dklyle has joined #openstack-nova | 20:56 | |
| efried | esberglu: so - that's a relief. We only need to fix this in master. But also, https://review.openstack.org/#/c/560639/ (edmondsw FYI) | 20:56 |
| *** dougshelley66 has joined #openstack-nova | 20:57 | |
| edmondsw | efried well not quite... they haven't cut oslo.versionedobjects releases for stable pike/queens *yet* but that doesn't mean they aren't going to | 20:57 |
| efried | edmondsw: But they *aren't* going to bump upper-constraints for same. | 20:57 |
| edmondsw | I fully expect they will, or they wouldn't have backported | 20:57 |
| efried | edmondsw: But also ---^ | 20:58 |
| edmondsw | efried they won't need to | 20:58 |
| efried | edmondsw: What do you mean? | 20:58 |
| efried | edmondsw: If they don't bump upper-constraints in pike/queens, then it's illegal to use the bad versions of the packages. | 20:58 |
| efried | illegal => unsupported | 20:59 |
| edmondsw | oh, well you're right, they would... I thought u-c was setup differently than it is | 20:59 |
| edmondsw | but why do you think they won't update u-c? | 20:59 |
| edmondsw | I fully expect they will | 20:59 |
| edmondsw | as they have in the past | 20:59 |
| efried | Well, they recognize this one is broken, so hopefully they'll wait until the backports of ----^ merge. | 20:59 |
| edmondsw | efried ok that I agree with | 21:00 |
| *** Tom-Tom has joined #openstack-nova | 21:01 | |
| *** Tom-Tom has quit IRC | 21:05 | |
| *** yamamoto has joined #openstack-nova | 21:08 | |
| *** yamahata has joined #openstack-nova | 21:09 | |
| *** edmondsw_ has joined #openstack-nova | 21:11 | |
| *** itlinux has quit IRC | 21:12 | |
| *** rajinir has quit IRC | 21:12 | |
| *** edmondsw has quit IRC | 21:13 | |
| *** yamamoto has quit IRC | 21:14 | |
| *** dklyle has quit IRC | 21:14 | |
| *** slaweq has quit IRC | 21:14 | |
| openstackgerrit | Chris Dent proposed openstack/nova master: WIP: Add PLACEMENT_DB_ENABLED=True to the nova-next job https://review.openstack.org/564067 | 21:15 |
| *** slaweq has joined #openstack-nova | 21:15 | |
| openstackgerrit | Chris Dent proposed openstack/nova master: WIP: Add PLACEMENT_DB_ENABLED=True to the nova-next job https://review.openstack.org/564067 | 21:15 |
| *** slaweq has quit IRC | 21:20 | |
| *** tbachman has quit IRC | 21:24 | |
| *** munimehan has quit IRC | 21:32 | |
| *** priteau_ has quit IRC | 21:32 | |
| *** wolverineav has joined #openstack-nova | 21:35 | |
| *** awaugama has quit IRC | 21:35 | |
| *** namnh has joined #openstack-nova | 21:37 | |
| *** ociuhandu has quit IRC | 21:39 | |
| *** sdague has quit IRC | 21:42 | |
| *** tbachman has joined #openstack-nova | 21:43 | |
| *** dklyle has joined #openstack-nova | 21:44 | |
| *** ociuhandu has joined #openstack-nova | 21:46 | |
| *** gjayavelu has quit IRC | 21:49 | |
| *** tbachman has quit IRC | 21:49 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Wait for network-vif-plugged before starting live migration https://review.openstack.org/558001 | 21:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add check if neutron "binding-extended" extension is available https://review.openstack.org/523548 | 21:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add "bind_ports_to_host" neutron API method https://review.openstack.org/523604 | 21:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add "delete_port_binding" network API method https://review.openstack.org/552170 | 21:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add "activate_port_binding" neutron API method https://review.openstack.org/555947 | 21:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Delete port bindings in setup_networks_on_host if teardown=True https://review.openstack.org/556333 | 21:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Implement migrate_instance_start method for neutron https://review.openstack.org/556334 | 21:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add VIFMigrateData object for live migration https://review.openstack.org/515423 | 21:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: libvirt: use dest host vif migrate details for live migration https://review.openstack.org/551370 | 21:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: compute: use port binding extended API during live migration https://review.openstack.org/551371 | 21:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Port binding based on events during live migration https://review.openstack.org/434870 | 21:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: conductor: use port binding extended API in during live migrate https://review.openstack.org/522537 | 21:51 |
| *** r-daneel has quit IRC | 21:52 | |
| *** tbachman has joined #openstack-nova | 21:54 | |
| *** edmondsw_ has quit IRC | 21:55 | |
| *** abalutoiu has joined #openstack-nova | 21:56 | |
| *** abalutoiu_ has quit IRC | 21:57 | |
| *** abalutoiu_ has joined #openstack-nova | 22:02 | |
| *** mriedem has quit IRC | 22:03 | |
| *** esberglu has quit IRC | 22:04 | |
| *** edmondsw has joined #openstack-nova | 22:05 | |
| *** edmondsw has quit IRC | 22:05 | |
| *** moshele has joined #openstack-nova | 22:06 | |
| *** burt has quit IRC | 22:06 | |
| *** abalutoiu has quit IRC | 22:06 | |
| *** namnh has quit IRC | 22:07 | |
| *** yamamoto has joined #openstack-nova | 22:09 | |
| *** cfriesen has quit IRC | 22:11 | |
| *** yamamoto has quit IRC | 22:14 | |
| *** dave-mccowan has quit IRC | 22:15 | |
| *** esberglu has joined #openstack-nova | 22:17 | |
| *** gyee has joined #openstack-nova | 22:23 | |
| *** Guest46588 has quit IRC | 22:32 | |
| *** ociuhandu_ has joined #openstack-nova | 22:32 | |
| *** ociuhandu has quit IRC | 22:33 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Move image conversion to privsep. https://review.openstack.org/554437 | 22:35 |
| openstackgerrit | Michael Still proposed openstack/nova master: We don't need utils.trycmd any more. https://review.openstack.org/554439 | 22:35 |
| openstackgerrit | Michael Still proposed openstack/nova master: We no longer need rootwrap. https://review.openstack.org/554438 | 22:35 |
| *** efried has quit IRC | 22:42 | |
| *** moshele has quit IRC | 22:43 | |
| *** liverpooler has quit IRC | 22:47 | |
| openstackgerrit | Arvind Nadendla proposed openstack/nova master: update scheduler to use image-traits https://review.openstack.org/560596 | 22:54 |
| Kevin_Zheng | mriedem I can take the traceback BP, that one seems easy | 22:56 |
| Kevin_Zheng | I already start working on migration one, had some poc in my pc, and setting up multi-node env for further testing last night, since we moved to our public cloud, I have to set up a new one:) | 22:58 |
| *** dougshelley66 has quit IRC | 23:02 | |
| *** dougshelley66 has joined #openstack-nova | 23:02 | |
| *** yamamoto has joined #openstack-nova | 23:10 | |
| *** felipemonteiro__ has quit IRC | 23:16 | |
| *** yamamoto has quit IRC | 23:16 | |
| *** sdague has joined #openstack-nova | 23:16 | |
| *** tbachman has quit IRC | 23:17 | |
| *** chyka_ has quit IRC | 23:29 | |
| *** hongbin_ has quit IRC | 23:33 | |
| *** mlavalle has quit IRC | 23:38 | |
| *** Tom-Tom has joined #openstack-nova | 23:40 | |
| *** QianYu has joined #openstack-nova | 23:42 | |
| *** Tom-Tom has quit IRC | 23:45 | |
| *** sdeath has joined #openstack-nova | 23:49 | |
| *** sdeath has joined #openstack-nova | 23:49 | |
| *** stakeda has joined #openstack-nova | 23:49 | |
| *** hoonetorg has quit IRC | 23:52 | |
| *** QianYu has quit IRC | 23:55 | |
| *** yamamoto has joined #openstack-nova | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
