| *** brault has joined #openstack-nova | 00:00 | |
| *** yingjun has joined #openstack-nova | 00:03 | |
| *** nicolasbock has quit IRC | 00:03 | |
| *** Apoorva_ has joined #openstack-nova | 00:04 | |
| *** brault has quit IRC | 00:05 | |
| *** jaypipes has quit IRC | 00:05 | |
| *** Apoorva has quit IRC | 00:07 | |
| *** wasmum has quit IRC | 00:15 | |
| *** salv-orlando has quit IRC | 00:16 | |
| *** dave-mccowan has quit IRC | 00:17 | |
| *** mingyu has joined #openstack-nova | 00:18 | |
| *** mingyu has quit IRC | 00:22 | |
| *** gianpietro has quit IRC | 00:23 | |
| *** Apoorva_ has quit IRC | 00:23 | |
| *** itlinux has joined #openstack-nova | 00:24 | |
| *** salv-orlando has joined #openstack-nova | 00:29 | |
| *** dimtruck is now known as zz_dimtruck | 00:33 | |
| *** marst_ has joined #openstack-nova | 00:34 | |
| *** kaisers has quit IRC | 00:36 | |
| *** litao__ has joined #openstack-nova | 00:43 | |
| *** kaisers has joined #openstack-nova | 00:43 | |
| *** zz_dimtruck is now known as dimtruck | 00:44 | |
| *** ihrachys|afk is now known as ihrachys | 00:46 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/467344 | 00:50 |
|---|---|---|
| *** dave-mccowan has joined #openstack-nova | 00:50 | |
| mriedem | cfriesen: you don't need to have multiple cells, | 00:52 |
| mriedem | it wasn't about that | 00:52 |
| *** acormier has joined #openstack-nova | 00:52 | |
| mriedem | it was an issue where we thought db connections were being cached by oslo.db or sqla but they weren't | 00:52 |
| mriedem | so every time one was created it was new and they weren't getting gc'ed | 00:53 |
| *** tovin07_ has joined #openstack-nova | 00:54 | |
| *** dave-mccowan has quit IRC | 00:55 | |
| *** tbachman has quit IRC | 00:56 | |
| *** acormier has quit IRC | 00:57 | |
| *** acormier has joined #openstack-nova | 00:58 | |
| *** phuongnh has joined #openstack-nova | 01:01 | |
| *** kaisers__ has joined #openstack-nova | 01:03 | |
| *** Apoorva has joined #openstack-nova | 01:04 | |
| *** Shunli has joined #openstack-nova | 01:04 | |
| *** tbachman has joined #openstack-nova | 01:05 | |
| *** itlinux has quit IRC | 01:06 | |
| *** kaisers_ has quit IRC | 01:06 | |
| *** zsli_ has joined #openstack-nova | 01:07 | |
| *** dikonoor has joined #openstack-nova | 01:09 | |
| *** Shunli has quit IRC | 01:10 | |
| *** ijw_ has joined #openstack-nova | 01:10 | |
| *** tbachman has quit IRC | 01:11 | |
| *** nic has quit IRC | 01:12 | |
| *** ijw has quit IRC | 01:13 | |
| *** gianpietro has joined #openstack-nova | 01:15 | |
| *** Apoorva_ has joined #openstack-nova | 01:16 | |
| *** tbachman has joined #openstack-nova | 01:16 | |
| *** salv-orlando has quit IRC | 01:17 | |
| *** Apoorva has quit IRC | 01:19 | |
| *** gianpietro has quit IRC | 01:19 | |
| *** salv-orlando has joined #openstack-nova | 01:20 | |
| *** Apoorva_ has quit IRC | 01:21 | |
| *** takashin has quit IRC | 01:22 | |
| *** acormier has quit IRC | 01:27 | |
| *** hongbin has joined #openstack-nova | 01:28 | |
| openstackgerrit | Huan Xie proposed openstack/nova master: XenAPI use os-xenapi v2 in nova https://review.openstack.org/453493 | 01:31 |
| *** itlinux has joined #openstack-nova | 01:35 | |
| *** priteau has joined #openstack-nova | 01:42 | |
| *** baoli has joined #openstack-nova | 01:42 | |
| *** smatzek has joined #openstack-nova | 01:44 | |
| *** tbachman has quit IRC | 01:44 | |
| *** salv-orlando has quit IRC | 01:45 | |
| *** priteau has quit IRC | 01:46 | |
| *** baoli has quit IRC | 01:46 | |
| *** itlinux has quit IRC | 01:52 | |
| *** penick has joined #openstack-nova | 01:57 | |
| *** ihrachys has quit IRC | 02:03 | |
| *** dillaman has quit IRC | 02:10 | |
| *** zhurong has joined #openstack-nova | 02:11 | |
| *** lei-zh has joined #openstack-nova | 02:11 | |
| *** jichen has joined #openstack-nova | 02:12 | |
| *** mingyu has joined #openstack-nova | 02:13 | |
| *** baoli has joined #openstack-nova | 02:14 | |
| *** smatzek has quit IRC | 02:19 | |
| *** gianpietro has joined #openstack-nova | 02:26 | |
| *** thorst_afk has joined #openstack-nova | 02:27 | |
| *** gjayavelu has quit IRC | 02:28 | |
| *** gianpietro has quit IRC | 02:29 | |
| *** nicolasbock has joined #openstack-nova | 02:31 | |
| *** gouthamr has quit IRC | 02:33 | |
| *** cNilesh has joined #openstack-nova | 02:33 | |
| melwitt | mriedem: guh, instance groups and members are in the API db. I forgot | 02:35 |
| *** thorst_afk has quit IRC | 02:35 | |
| *** edmondsw has joined #openstack-nova | 02:35 | |
| melwitt | but the way it counts members is to find instances owned by the user that are also members of the group, and returns len(instances) | 02:36 |
| *** thorst_afk has joined #openstack-nova | 02:37 | |
| melwitt | the problem is there's no user association with instance group members, so you can't just query the API db. have to lookup the group in the API db, then count how many instances belong to the user that are also in that group | 02:38 |
| melwitt | so I would think if you boot an instance with some group, boot another instance with the same group that lands in a different cell, you're at the point where you have to query all cells. I dunno if it's possible for that to happen based on the available policies, which is what you were thinking about | 02:39 |
| *** edmondsw has quit IRC | 02:40 | |
| openstackgerrit | melanie witt proposed openstack/nova master: Add FixedIP.get_count_by_project() https://review.openstack.org/446246 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Add FloatingIP.get_count_by_project() https://review.openstack.org/446247 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Add get_count_by_vm_state() to Instance object https://review.openstack.org/446244 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Add SecurityGroup.get_counts() https://review.openstack.org/446245 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Remove 'reserved' count from used limits https://review.openstack.org/446242 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Remove useless quota_usage_refresh from nova-manage https://review.openstack.org/446243 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Count networks to check quota https://review.openstack.org/446241 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Count instances to check quota https://review.openstack.org/416521 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Count server group members to check quota https://review.openstack.org/457859 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Count security groups to check quota https://review.openstack.org/457860 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Make Quotas object favor the API database https://review.openstack.org/410945 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Count fixed ips to check quota https://review.openstack.org/457861 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Add online migration to move quotas to API database https://review.openstack.org/410946 | 02:40 |
| openstackgerrit | melanie witt proposed openstack/nova master: Count floating ips to check quota https://review.openstack.org/457862 | 02:40 |
| *** masber has joined #openstack-nova | 02:45 | |
| *** marst_ has quit IRC | 02:49 | |
| *** dillaman has joined #openstack-nova | 02:50 | |
| mriedem | melwitt: huh, not sure. we could write a tempest test or something for this which might tell us | 02:51 |
| mriedem | and run that against dan's multi-cell devstack change | 02:51 |
| *** yamamoto_ has joined #openstack-nova | 02:51 | |
| mriedem | if you can come up with the test scenario i could help work on that in tempest | 02:52 |
| *** thorst_afk has quit IRC | 02:52 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Use plain routes list for os-migrations endpoint instead of stevedore https://review.openstack.org/461628 | 02:53 |
| *** yamahata has quit IRC | 03:00 | |
| *** itlinux has joined #openstack-nova | 03:10 | |
| *** mriedem has quit IRC | 03:11 | |
| *** mingyu has quit IRC | 03:17 | |
| *** krtaylor has joined #openstack-nova | 03:39 | |
| *** baoli has quit IRC | 03:39 | |
| *** boris-42_ has quit IRC | 03:39 | |
| *** vks1 has joined #openstack-nova | 03:40 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/467344 | 03:41 |
| *** nicolasbock has quit IRC | 03:42 | |
| *** hongbin has quit IRC | 03:44 | |
| *** slaweq has joined #openstack-nova | 03:50 | |
| *** kornicameister has joined #openstack-nova | 03:51 | |
| *** trinaths has joined #openstack-nova | 03:55 | |
| *** slaweq has quit IRC | 03:55 | |
| *** ChanServ changes topic to "This channel is for Nova development. For support of Nova deployments, please use #openstack. Please see: https://wiki.openstack.org/wiki/Nova/Ocata_Release_Schedule" | 04:07 | |
| -openstackstatus- NOTICE: Sufficient free space has been reclaimed that jobs are passing again; any POST_FAILURE results can now be rechecked. | 04:07 | |
| *** itlinux has quit IRC | 04:08 | |
| *** psachin has joined #openstack-nova | 04:09 | |
| *** zhurong has quit IRC | 04:11 | |
| *** ratailor has joined #openstack-nova | 04:13 | |
| *** zhurong has joined #openstack-nova | 04:15 | |
| *** yamamoto_ has quit IRC | 04:18 | |
| *** mingyu has joined #openstack-nova | 04:18 | |
| *** vks1 has quit IRC | 04:20 | |
| *** lucasxu has joined #openstack-nova | 04:20 | |
| *** vks1 has joined #openstack-nova | 04:20 | |
| openstackgerrit | Tristan Cacqueray proposed openstack/nova master: Mask the token used to allow access to consoles https://review.openstack.org/220622 | 04:22 |
| *** mingyu has quit IRC | 04:22 | |
| *** udesale has joined #openstack-nova | 04:24 | |
| openstackgerrit | Eric Berglund proposed openstack/nova master: Add strict option to discover_hosts https://review.openstack.org/467218 | 04:25 |
| *** arunman has joined #openstack-nova | 04:26 | |
| *** diga has joined #openstack-nova | 04:28 | |
| *** armax has quit IRC | 04:28 | |
| *** penick has quit IRC | 04:28 | |
| *** armax has joined #openstack-nova | 04:28 | |
| *** armax has quit IRC | 04:29 | |
| *** yamahata has joined #openstack-nova | 04:32 | |
| *** psachin has quit IRC | 04:35 | |
| *** arunman has quit IRC | 04:38 | |
| *** adisky_ has joined #openstack-nova | 04:48 | |
| openstackgerrit | Huan Xie proposed openstack/nova master: XenAPI use os-xenapi v2 in nova https://review.openstack.org/453493 | 04:52 |
| *** psachin has joined #openstack-nova | 04:53 | |
| *** bkopilov has joined #openstack-nova | 04:55 | |
| *** jaosorior_away is now known as jaosorior | 04:55 | |
| *** mdnadeem has joined #openstack-nova | 04:55 | |
| *** yamamoto_ has joined #openstack-nova | 04:56 | |
| *** mdnadeem has quit IRC | 05:01 | |
| *** sree has joined #openstack-nova | 05:09 | |
| *** lucasxu has quit IRC | 05:10 | |
| *** yolkfull has joined #openstack-nova | 05:15 | |
| *** prateek__ has joined #openstack-nova | 05:17 | |
| *** links has joined #openstack-nova | 05:20 | |
| *** ltomasbo|away is now known as ltomasbo | 05:28 | |
| *** mdnadeem has joined #openstack-nova | 05:30 | |
| *** diga has quit IRC | 05:31 | |
| openstackgerrit | Huan Xie proposed openstack/nova master: XenAPI use os-xenapi v2 in nova https://review.openstack.org/453493 | 05:34 |
| *** dimtruck is now known as zz_dimtruck | 05:35 | |
| *** gcb has quit IRC | 05:39 | |
| *** Oku_OS-away is now known as Oku_OS | 05:40 | |
| *** mdnadeem has quit IRC | 05:40 | |
| *** gcb has joined #openstack-nova | 05:40 | |
| *** yingjun has quit IRC | 05:43 | |
| *** psachin has quit IRC | 05:53 | |
| *** arunman has joined #openstack-nova | 05:54 | |
| *** mdnadeem has joined #openstack-nova | 05:54 | |
| *** markus_z has joined #openstack-nova | 05:55 | |
| *** brault has joined #openstack-nova | 06:00 | |
| *** rcernin has quit IRC | 06:00 | |
| *** andreas_s has joined #openstack-nova | 06:03 | |
| *** brault has quit IRC | 06:04 | |
| *** psachin has joined #openstack-nova | 06:05 | |
| openstackgerrit | falseuser proposed openstack/nova master: Clear instance root_device_name in rebuild operation https://review.openstack.org/464991 | 06:11 |
| *** mingyu has joined #openstack-nova | 06:11 | |
| *** belmoreira has joined #openstack-nova | 06:13 | |
| *** gyee has quit IRC | 06:17 | |
| *** rcernin has joined #openstack-nova | 06:17 | |
| *** haplo37 has quit IRC | 06:18 | |
| *** haplo37 has joined #openstack-nova | 06:20 | |
| *** psachin has quit IRC | 06:23 | |
| *** psachin has joined #openstack-nova | 06:23 | |
| *** hoonetorg has quit IRC | 06:25 | |
| *** brault has joined #openstack-nova | 06:27 | |
| *** djohnsto has quit IRC | 06:34 | |
| *** hoonetorg has joined #openstack-nova | 06:37 | |
| *** abalutoiu has joined #openstack-nova | 06:41 | |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Send out notifications when instance tags changed https://review.openstack.org/459923 | 06:45 |
| *** mingyu has quit IRC | 06:50 | |
| *** mingyu has joined #openstack-nova | 06:51 | |
| *** mingyu has quit IRC | 06:51 | |
| *** bkopilov has quit IRC | 06:55 | |
| *** mingyu has joined #openstack-nova | 06:55 | |
| *** mingyu has quit IRC | 06:59 | |
| *** bkopilov has joined #openstack-nova | 07:08 | |
| *** jroll has quit IRC | 07:12 | |
| *** yamahata has quit IRC | 07:15 | |
| *** pcaruana has joined #openstack-nova | 07:16 | |
| *** hshiina has joined #openstack-nova | 07:21 | |
| *** mingyu has joined #openstack-nova | 07:23 | |
| *** swebster_ has joined #openstack-nova | 07:24 | |
| *** swebster has quit IRC | 07:24 | |
| *** mlakat has joined #openstack-nova | 07:26 | |
| openstackgerrit | Li Yingjun proposed openstack/nova master: Fix duplicate Neutron ports on instance reschedule https://review.openstack.org/467509 | 07:30 |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Exclude deleted service records when calling hyervisor statistics https://review.openstack.org/467220 | 07:35 |
| *** karimb has joined #openstack-nova | 07:35 | |
| *** oanson has quit IRC | 07:36 | |
| *** oanson has joined #openstack-nova | 07:37 | |
| *** jpena|off is now known as jpena | 07:38 | |
| *** mingyu has quit IRC | 07:46 | |
| *** aarefiev_afk is now known as aarefiev | 07:46 | |
| *** lpetrut has joined #openstack-nova | 07:58 | |
| *** edmondsw has joined #openstack-nova | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-nova | 08:00 | |
| *** priteau has joined #openstack-nova | 08:03 | |
| *** edmondsw has quit IRC | 08:04 | |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Use plain routes list for os-server-groups endpoint instead of stevedore https://review.openstack.org/462169 | 08:06 |
| *** rha has quit IRC | 08:08 | |
| openstackgerrit | Béla Vancsics proposed openstack/nova master: Transform keypair.import notification https://review.openstack.org/467514 | 08:13 |
| *** lucas-afk is now known as lucasagomes | 08:16 | |
| *** sambetts|afk is now known as sambetts | 08:20 | |
| *** ralonsoh has joined #openstack-nova | 08:23 | |
| *** rha has joined #openstack-nova | 08:24 | |
| *** rha has quit IRC | 08:24 | |
| *** rha has joined #openstack-nova | 08:24 | |
| *** sree_ has joined #openstack-nova | 08:27 | |
| *** sree_ is now known as Guest25627 | 08:28 | |
| *** sree has quit IRC | 08:30 | |
| openstackgerrit | Gábor Antal proposed openstack/nova master: Add json style checking for sample notifications https://review.openstack.org/443677 | 08:35 |
| *** lei-zh has quit IRC | 08:37 | |
| *** derekh has joined #openstack-nova | 08:37 | |
| *** gszasz has joined #openstack-nova | 08:41 | |
| *** gszasz has quit IRC | 08:46 | |
| *** gszasz has joined #openstack-nova | 08:51 | |
| *** mvk has joined #openstack-nova | 08:58 | |
| *** sree has joined #openstack-nova | 09:01 | |
| *** Guest25627 has quit IRC | 09:03 | |
| *** phuongnh has quit IRC | 09:05 | |
| *** diga has joined #openstack-nova | 09:17 | |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref for DELETE RP inventory https://review.openstack.org/455215 | 09:21 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref for PUT RP inventory https://review.openstack.org/455214 | 09:21 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref for GET RP inventory https://review.openstack.org/455213 | 09:21 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Fix placement-api-ref check tool https://review.openstack.org/456198 | 09:21 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref for GET RP inventories https://review.openstack.org/449765 | 09:21 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref for DELETE RP inventories https://review.openstack.org/452708 | 09:21 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref POST resource provider https://review.openstack.org/456176 | 09:21 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref for PUT RP inventories https://review.openstack.org/452707 | 09:21 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref GET resource provider https://review.openstack.org/467541 | 09:21 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref PUT resource provider https://review.openstack.org/467542 | 09:21 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref DELETE resource provider https://review.openstack.org/467543 | 09:21 |
| *** rmart04 has joined #openstack-nova | 09:23 | |
| *** zsli_ has quit IRC | 09:26 | |
| *** salv-orlando has joined #openstack-nova | 09:35 | |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Send out notifications when instance tags changed https://review.openstack.org/459923 | 09:37 |
| openstackgerrit | John Haan proposed openstack/nova-specs master: Support volume_type with BDM paramter https://review.openstack.org/466595 | 09:42 |
| *** mvk has quit IRC | 09:42 | |
| *** sdague has joined #openstack-nova | 09:44 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-manage: Deprecate '--version' parameters https://review.openstack.org/453808 | 09:47 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-manage: Rename 'api_db', 'cellsv2' commands https://review.openstack.org/453809 | 09:47 |
| *** salv-orlando has quit IRC | 09:48 | |
| *** edmondsw has joined #openstack-nova | 09:49 | |
| *** edmondsw has quit IRC | 09:54 | |
| *** links has quit IRC | 09:55 | |
| *** tristanC has joined #openstack-nova | 09:56 | |
| *** tbachman has joined #openstack-nova | 10:02 | |
| *** tovin07_ has quit IRC | 10:03 | |
| *** zhurong has quit IRC | 10:04 | |
| *** links has joined #openstack-nova | 10:08 | |
| *** mvk has joined #openstack-nova | 10:14 | |
| *** cNilesh has quit IRC | 10:23 | |
| *** cNilesh has joined #openstack-nova | 10:24 | |
| *** jroll has joined #openstack-nova | 10:25 | |
| *** cNilesh has quit IRC | 10:33 | |
| *** ayogi has joined #openstack-nova | 10:33 | |
| *** udesale__ has joined #openstack-nova | 10:38 | |
| *** tbachman has quit IRC | 10:40 | |
| *** udesale has quit IRC | 10:41 | |
| *** yamamoto_ has quit IRC | 10:43 | |
| *** udesale__ has quit IRC | 10:43 | |
| *** udesale has joined #openstack-nova | 10:44 | |
| *** cdent has joined #openstack-nova | 10:44 | |
| *** nicolasbock has joined #openstack-nova | 10:45 | |
| *** cNilesh has joined #openstack-nova | 10:45 | |
| lyarwood | mdbooth: ah sorry, I missed your summary note in https://review.openstack.org/#/c/443951/20 and just assumed you were suggesting we didn't need to wait for os-brick | 10:56 |
| *** cNilesh has quit IRC | 10:59 | |
| *** arunman has quit IRC | 11:07 | |
| openstackgerrit | falseuser proposed openstack/nova master: Fix the rebuild operation bug https://review.openstack.org/467588 | 11:10 |
| openstackgerrit | Hong Hui Xiao proposed openstack/nova master: VMware: Check if network is ready on cluster host https://review.openstack.org/467589 | 11:12 |
| *** abalutoiu has quit IRC | 11:12 | |
| openstackgerrit | Claudiu Belu proposed openstack/nova master: POC: tests: autospecs all the mock.patch usages https://review.openstack.org/447505 | 11:13 |
| *** sree has quit IRC | 11:14 | |
| *** acormier has joined #openstack-nova | 11:16 | |
| *** acormier has quit IRC | 11:16 | |
| *** acormier has joined #openstack-nova | 11:17 | |
| *** lucasagomes is now known as lucas-pto | 11:17 | |
| *** yolkfull has quit IRC | 11:21 | |
| *** liverpooler has quit IRC | 11:22 | |
| *** zz_dimtruck is now known as dimtruck | 11:23 | |
| *** fragatina has joined #openstack-nova | 11:28 | |
| *** fragatina has quit IRC | 11:29 | |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref for GET resource provider https://review.openstack.org/467541 | 11:29 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref for PUT resource provider https://review.openstack.org/467542 | 11:29 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref for DELETE resource provider https://review.openstack.org/467543 | 11:29 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref for POST resource provider https://review.openstack.org/456176 | 11:29 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref for resource classes https://review.openstack.org/467596 | 11:29 |
| *** fragatina has joined #openstack-nova | 11:29 | |
| *** smatzek has joined #openstack-nova | 11:31 | |
| *** gszasz has quit IRC | 11:31 | |
| *** yamamoto has joined #openstack-nova | 11:31 | |
| *** udesale has quit IRC | 11:34 | |
| *** udesale has joined #openstack-nova | 11:35 | |
| *** acormier has quit IRC | 11:40 | |
| *** edmondsw has joined #openstack-nova | 11:42 | |
| *** nicolasbock has quit IRC | 11:43 | |
| *** belmoreira has quit IRC | 11:45 | |
| *** MVenesio has joined #openstack-nova | 11:45 | |
| *** acormier has joined #openstack-nova | 11:46 | |
| *** abalutoiu has joined #openstack-nova | 11:47 | |
| *** hemna has quit IRC | 11:47 | |
| *** dansmith has quit IRC | 11:48 | |
| *** anish has quit IRC | 11:49 | |
| *** hemna has joined #openstack-nova | 11:49 | |
| *** dansmith has joined #openstack-nova | 11:51 | |
| *** dansmith is now known as Guest36154 | 11:51 | |
| *** anish has joined #openstack-nova | 11:51 | |
| *** litao__ has quit IRC | 11:52 | |
| *** jaypipes has joined #openstack-nova | 11:52 | |
| *** MVenesio has quit IRC | 11:59 | |
| *** diga has quit IRC | 12:01 | |
| *** annegentle has joined #openstack-nova | 12:02 | |
| *** tbachman has joined #openstack-nova | 12:03 | |
| *** trinaths has quit IRC | 12:03 | |
| *** dillaman has quit IRC | 12:04 | |
| *** gianpietro has joined #openstack-nova | 12:08 | |
| *** vks1 has quit IRC | 12:09 | |
| *** belmoreira has joined #openstack-nova | 12:12 | |
| *** gianpietro has quit IRC | 12:12 | |
| *** annegentle has quit IRC | 12:16 | |
| *** winston-d_ has quit IRC | 12:19 | |
| *** acormier has quit IRC | 12:20 | |
| *** acormier has joined #openstack-nova | 12:20 | |
| *** peter-hamilton has joined #openstack-nova | 12:22 | |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Send out notifications when instance tags changed https://review.openstack.org/459923 | 12:23 |
| *** rdo__ has quit IRC | 12:23 | |
| *** krtaylor has quit IRC | 12:24 | |
| peter-hamilton | hi all, hoping to get some reviews on cert validation patches: https://review.openstack.org/#/c/457711/, https://review.openstack.org/#/c/357202/, and https://review.openstack.org/#/c/457678/ | 12:25 |
| peter-hamilton | any and all reviews welcome :) | 12:25 |
| *** mdnadeem has quit IRC | 12:25 | |
| *** FL1SK has quit IRC | 12:28 | |
| *** rdo_ has joined #openstack-nova | 12:30 | |
| *** lucasxu has joined #openstack-nova | 12:31 | |
| *** zhurong has joined #openstack-nova | 12:35 | |
| *** zhurong has quit IRC | 12:36 | |
| *** mdnadeem has joined #openstack-nova | 12:36 | |
| *** ratailor has quit IRC | 12:37 | |
| *** annegentle has joined #openstack-nova | 12:38 | |
| *** dave-mccowan has joined #openstack-nova | 12:41 | |
| *** jpena is now known as jpena|lunch | 12:44 | |
| alex_xu | nova api meeting is in 15 mins at #openstack-meeting-4 | 12:45 |
| *** eharney has joined #openstack-nova | 12:45 | |
| sfinucan | alex_xu: Where would I find the agenda for that meeting? | 12:46 |
| *** annegentle has quit IRC | 12:47 | |
| alex_xu | sfinucan: here is https://wiki.openstack.org/wiki/Meetings/NovaAPI | 12:47 |
| sfinucan | alex_xu: ++ | 12:47 |
| *** lyan has joined #openstack-nova | 12:49 | |
| *** lucasxu has quit IRC | 12:50 | |
| *** liverpooler has joined #openstack-nova | 12:55 | |
| *** gcb has quit IRC | 12:57 | |
| *** gcb has joined #openstack-nova | 12:57 | |
| *** baoli has joined #openstack-nova | 12:58 | |
| alex_xu | nova api meeting is running now | 13:00 |
| *** jichen has quit IRC | 13:00 | |
| *** efoley has joined #openstack-nova | 13:00 | |
| *** nicolasbock has joined #openstack-nova | 13:00 | |
| *** kfarr has joined #openstack-nova | 13:03 | |
| *** mdrabe has joined #openstack-nova | 13:04 | |
| *** ekuris has quit IRC | 13:04 | |
| *** xyang1 has joined #openstack-nova | 13:04 | |
| *** rfolco has joined #openstack-nova | 13:06 | |
| *** vladikr has joined #openstack-nova | 13:08 | |
| *** MVenesio has joined #openstack-nova | 13:09 | |
| *** cleong has joined #openstack-nova | 13:10 | |
| *** thorst_afk has joined #openstack-nova | 13:12 | |
| *** gszasz has joined #openstack-nova | 13:17 | |
| *** ekuris has joined #openstack-nova | 13:19 | |
| *** lucasxu has joined #openstack-nova | 13:20 | |
| *** tbachman has quit IRC | 13:20 | |
| *** mriedem has joined #openstack-nova | 13:20 | |
| *** jamesdenton has joined #openstack-nova | 13:21 | |
| *** kylek3h has joined #openstack-nova | 13:21 | |
| *** liverpooler has quit IRC | 13:22 | |
| *** liverpooler has joined #openstack-nova | 13:22 | |
| *** tbachman has joined #openstack-nova | 13:23 | |
| *** Yangyapeng has joined #openstack-nova | 13:26 | |
| openstackgerrit | Jay Pipes proposed openstack/nova master: integrate trait cache with TraitList and Trait https://review.openstack.org/462770 | 13:26 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: add cache which keeps DB and os_traits in sync https://review.openstack.org/462769 | 13:26 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: integrate trait cache with TraitList and Trait https://review.openstack.org/462770 | 13:27 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: add cache which keeps DB and os_traits in sync https://review.openstack.org/462769 | 13:27 |
| *** esberglu has joined #openstack-nova | 13:28 | |
| *** prateek__ has quit IRC | 13:30 | |
| openstackgerrit | Hong Hui Xiao proposed openstack/nova master: VMware: Check if network is ready on cluster host https://review.openstack.org/467589 | 13:34 |
| *** ekuris has quit IRC | 13:35 | |
| *** READ10 has joined #openstack-nova | 13:38 | |
| *** ekuris has joined #openstack-nova | 13:38 | |
| *** sree has joined #openstack-nova | 13:41 | |
| *** dimtruck is now known as zz_dimtruck | 13:42 | |
| *** felipemonteiro has joined #openstack-nova | 13:42 | |
| openstackgerrit | Eric Berglund proposed openstack/nova master: Add strict option to discover_hosts https://review.openstack.org/467218 | 13:43 |
| *** felipemonteiro_ has joined #openstack-nova | 13:44 | |
| *** ayogi has quit IRC | 13:44 | |
| *** jpena|lunch is now known as jpena | 13:45 | |
| *** mtanino has joined #openstack-nova | 13:46 | |
| *** felipemonteiro has quit IRC | 13:47 | |
| *** krtaylor has joined #openstack-nova | 13:47 | |
| openstackgerrit | Eric Berglund proposed openstack/nova master: Add strict option to discover_hosts https://review.openstack.org/467218 | 13:48 |
| *** gouthamr has joined #openstack-nova | 13:50 | |
| *** efried has joined #openstack-nova | 13:52 | |
| *** ZZelle has quit IRC | 13:52 | |
| *** yamahata has joined #openstack-nova | 13:53 | |
| *** gianpietro has joined #openstack-nova | 13:53 | |
| larsks | The network_data.json provided by nova provides nameserver information globally in the "services" key, rather than scoping it per-interface. This would seem to mean that it's not possible to associate different sets of DNS servers with different interfaces. | 13:54 |
| larsks | Am I reading the situation correctly? | 13:54 |
| *** burt has joined #openstack-nova | 13:55 | |
| *** prateek has joined #openstack-nova | 13:57 | |
| sdague | larsks: that sounds right | 13:57 |
| artom | larsks, isn't that a limitation of networking in general though? I mean, nameservers are for the whole system, I don'tknow of a way to limit nameservers to an interface, with Nova or without | 13:57 |
| larsks | artom: not at all. I mean, you may have interface that are only reachable via specific interfaces. If everything is up, that's fine, but if you bring down the corresponding interface you want those nameservers to go away. | 13:58 |
| openstackgerrit | Daniel Pawlik proposed openstack/nova master: Add `hide_hypervisor_id` image property https://review.openstack.org/459753 | 13:58 |
| sdague | larsks: yeh, this is basically just the /etc/resolv.conf handled case, nothing fancier | 13:58 |
| sdague | it's going to be processed by cloud-init | 13:59 |
| larsks | sdague: well, the problem here is that since Nova doesn't provide interface-scoped DNS servers, cloud-init...or anything else...can't actually configure the system correctly. | 13:59 |
| larsks | E.g., DNS information should be added to interface config files (like /etc/sysconfig/network-scripts/ifcfg-eth0). | 13:59 |
| larsks | But we can't, since the servers are only listed globally. | 13:59 |
| artom | larsks, ah, so you want DNS servers being dynamically added/removed based on if they'd be reachable or not | 14:00 |
| *** mtanino has quit IRC | 14:00 | |
| Guest36154 | artom: no, you can put all the dns servers in resolv.conf and it'll use the right route to get to each server | 14:00 |
| larsks | Right. That is typically how things are configured, and most distros have facilities for managing /etc/resolv.conf as interfaces come up and down. | 14:00 |
| sdague | larsks: if you can figure out a way to get neutron to build that information that way, it's probably possible to make corresponding nova changes to expose this | 14:00 |
| danpawlik | mriedem, efried, kashyap: I fixed all what you comment in my PS: https://review.openstack.org/#/c/459753 | 14:00 |
| *** Guest36154 is now known as dansmith | 14:00 | |
| mriedem | johnthetubaguy: got a policy question for you on https://github.com/openstack/nova/blob/master/nova/policies/quota_class_sets.py#L25 | 14:00 |
| sdague | but nova doesn't own that datastructure | 14:00 |
| kashyap | danpawlik: Yep, will look in a bit; in the middle of something | 14:00 |
| mriedem | johnthetubaguy: the quota_class is the id in the GET call, | 14:01 |
| mriedem | so effectively it means: 'is_admin:True or quota_class:default' | 14:01 |
| larsks | sdague: all right, I'll poke around neutron. Does network_data.json come directly from neutron (e.g., nova is just proxying the information)? | 14:01 |
| mriedem | johnthetubaguy: does that mean you could just configure policy per quota class? | 14:01 |
| mriedem | even though we only have one | 14:01 |
| artom | dansmith, yeah, they end up being global for the system, but what I think larsks has in mind is to add them to the global pool based on what interface is up/down | 14:01 |
| dansmith | artom: sure, but not like added and removed as they become dynamically reachable, just assumed reachable because the interface is up | 14:02 |
| *** jpena is now known as jpena|brb | 14:02 | |
| dansmith | artom: which is what I thought you meant | 14:02 |
| artom | dansmith, right, the "reachable" part is meaning we humans assign | 14:02 |
| artom | For the machine it's just nic up -> add nameserver | 14:02 |
| larsks | dansmith: artom: networkmanager and the legacy network scripts will manage entries in resolv.conf as interfaces come up/down. Which is what I think we would want. | 14:02 |
| dansmith | yah | 14:03 |
| mriedem | alex_xu: gmann: i've updated the bug - we'll need a spec to work the microversion fix, any volunteers? | 14:03 |
| dansmith | larsks: yeah, I understand.. adding a nic to an instance should end up with all that network's info merged in, just like configuring a nic in a distro | 14:03 |
| dansmith | larsks: sdague: don't we construct network.json from the pieces we get from neutron? | 14:04 |
| larsks | dansmith: right. But it sounds like this is actually a neutron issue. Yeah. | 14:04 |
| sdague | dansmith: we do | 14:04 |
| sdague | https://github.com/openstack/nova/blob/c2c6960e374351b3ce1b43a564b57e14b54c4877/nova/virt/netutils.py#L166-L222 | 14:04 |
| alex_xu | mriedem: i can done that, gmann already take another task for deprecated hide-address policy | 14:04 |
| sdague | that's where the structure is built from our network_info block | 14:04 |
| mriedem | ok | 14:04 |
| dansmith | sdague: right, so I'm not sure why those are't already merged if multiple networks have dns info | 14:05 |
| dansmith | L210 there | 14:05 |
| sdague | yeh | 14:05 |
| dansmith | larsks: ^ | 14:06 |
| *** crushil has joined #openstack-nova | 14:06 | |
| larsks | dansmith: I'm not sure I followed you there. | 14:07 |
| *** zz_dimtruck is now known as dimtruck | 14:07 | |
| *** dillaman has joined #openstack-nova | 14:07 | |
| larsks | I mean, they might be "merged in", but the issue is that they are provided globablly rather than interface-scoped so we can't put the information in the right place. | 14:07 |
| *** mingyu has joined #openstack-nova | 14:08 | |
| dansmith | larsks: oh I see you want to be able to configure the distro interface files so that if they ifdown an interface, it removes those dns servers from the merged resolv.conf? | 14:08 |
| sdague | larsks: do you want them at the link or networks side? | 14:08 |
| dansmith | in that case, this is a nova-side change, although it's a change to our metadata which is something not to be taken lightly | 14:09 |
| larsks | sdague: I *think* on the networks side. | 14:09 |
| larsks | dansmith: understood! | 14:09 |
| sdague | larsks: you could probably change things so that they *also* are at the networks side, but they are going to have to also stay global for systems that can't understand that change | 14:09 |
| larsks | dansmith: also, yes, in response to your ealier question. | 14:09 |
| larsks | sdague: that makes the most sense, I think. | 14:09 |
| dansmith | larsks: sdague yeah, adding them in both places is the only thing you could do without breaking people | 14:10 |
| sdague | larsks: that's at least the place to play around with things | 14:10 |
| mriedem | btw, | 14:12 |
| mriedem | i heard that one of the outcomes of a forum session on apis was that we don't have config drive documented anywhere | 14:13 |
| mriedem | there is this https://docs.openstack.org/user-guide/cli-config-drive.html | 14:13 |
| openstackgerrit | Daniel Pawlik proposed openstack/nova master: Add `hide_hypervisor_id` image property https://review.openstack.org/459753 | 14:13 |
| mriedem | i'm assuming it's more a question of what the contents are | 14:13 |
| *** coreywright has quit IRC | 14:14 | |
| mriedem | maybe per version, like what we have in the rest api version history | 14:14 |
| sdague | yep, it's definitely in the state of something that you need to read code to understand | 14:14 |
| dansmith | well, that goes for metadata too | 14:16 |
| mriedem | there was a spec that mgagne recently updated for the network data json blob | 14:16 |
| mriedem | dansmith: right, that's what i was thinking with versions | 14:16 |
| mriedem | e.g. in newton you get a new version with device tags | 14:17 |
| dansmith | yeah | 14:17 |
| mriedem | this one https://review.openstack.org/#/c/337819/ | 14:18 |
| *** awaugama has joined #openstack-nova | 14:18 | |
| mriedem | let me see if i can find the forum notes and start something in the ML to ask what people are looking for | 14:19 |
| mriedem | i've also been thinking about starting an in-tree doc with a dump of all known flavor extra specs | 14:19 |
| *** mingyu has quit IRC | 14:20 | |
| mgagne | I feel like this review is losing momentum, is there a way to highlight it somewhere to get more attention? https://review.openstack.org/#/c/454322/ | 14:22 |
| mgagne | (Add ability to signal and perform online volume size change) | 14:22 |
| *** armax has joined #openstack-nova | 14:22 | |
| mriedem | mgagne: it's on my list | 14:22 |
| mriedem | mgagne: i've been going through some of the random smaller bp changes this week | 14:23 |
| mgagne | thanks =) | 14:23 |
| *** hferenc has quit IRC | 14:23 | |
| *** sree_ has joined #openstack-nova | 14:23 | |
| *** sree_ is now known as Guest88303 | 14:23 | |
| *** hferenc has joined #openstack-nova | 14:24 | |
| *** prateek has quit IRC | 14:25 | |
| *** sree has quit IRC | 14:25 | |
| *** FL1SK has joined #openstack-nova | 14:26 | |
| *** gianpietro has quit IRC | 14:27 | |
| *** thorst_afk has quit IRC | 14:27 | |
| *** coreywright has joined #openstack-nova | 14:27 | |
| *** ihrachys has joined #openstack-nova | 14:30 | |
| *** mdnadeem has quit IRC | 14:30 | |
| *** hongbin has joined #openstack-nova | 14:34 | |
| *** pchavva has joined #openstack-nova | 14:35 | |
| *** lucasxu has quit IRC | 14:36 | |
| *** lucasxu has joined #openstack-nova | 14:37 | |
| *** yamahata has quit IRC | 14:39 | |
| mriedem | http://lists.openstack.org/pipermail/openstack-dev/2017-May/117401.html | 14:41 |
| mriedem | mgagne: ^ you might have input also | 14:41 |
| *** markus_z has quit IRC | 14:43 | |
| *** itlinux has joined #openstack-nova | 14:45 | |
| mriedem | sdague: from http://lists.openstack.org/pipermail/openstack-dev/2017-May/117374.html - http://enos.irisa.fr/html/seqdiag/v1/trace-boot-and-delete.yaml.html | 14:46 |
| mriedem | i remember someone from ibm research a few years ago wrote some tooling to do tracing like this too, using osprofiler i think | 14:46 |
| mriedem | reminded me of the nova onboarding session | 14:46 |
| *** mdrabe has quit IRC | 14:47 | |
| sdague | yeh | 14:47 |
| sdague | it would be nice if the output wasn't an eye chart with a soda straw | 14:48 |
| mriedem | yeah it's hard to navigate | 14:48 |
| sdague | and non searchable | 14:49 |
| sdague | the svg thing looks all sexy, until you try to do things with it | 14:49 |
| *** annegentle has joined #openstack-nova | 14:49 | |
| *** lucasxu has quit IRC | 14:50 | |
| *** abalutoiu has quit IRC | 14:50 | |
| *** lucasxu has joined #openstack-nova | 14:52 | |
| *** nicolasbock has quit IRC | 14:52 | |
| *** pabelanger has quit IRC | 14:52 | |
| *** pabelanger has joined #openstack-nova | 14:52 | |
| *** mdrabe has joined #openstack-nova | 14:53 | |
| *** psachin has quit IRC | 14:55 | |
| *** marst_ has joined #openstack-nova | 14:57 | |
| *** savvas has joined #openstack-nova | 14:57 | |
| *** jpena|brb is now known as jpena | 14:58 | |
| *** andreas_s has quit IRC | 15:00 | |
| *** penick has joined #openstack-nova | 15:06 | |
| *** Guest88303 has quit IRC | 15:08 | |
| savvas | Hi guys, I've been hopping from channel to channel trying to isolate the cause of a problem I've been having | 15:09 |
| savvas | when I try to boot an instance as following: nova boot newInstance --flavor testpack --security-groups default --nic net-id=7a2a1e61-1d86-4551-b578-dedf7f8443ea --block-device source=image,id=de61646b-8c48-43ac-a8b1-8f8348757d66,dest=volume,size=10,shutdown=remove,bootindex=0 --availability-zone hv01-zone | 15:09 |
| *** sree has joined #openstack-nova | 15:09 | |
| savvas | nova seems to ignore the availability-zone for cinder, it tries to use the default "nova" zone for creating the volume, instead of the AZ defined in the boot command. Am I missing something in my configuration perhaps that tells nova to look in diff volume AZ? | 15:10 |
| *** gjayavelu has joined #openstack-nova | 15:11 | |
| savvas | I should add that if I create a volume manually in the right AZ and then boot an instance from that volume, it works just fine. However, combining those actions into a nova boot / server create command fails | 15:12 |
| *** ctrath has joined #openstack-nova | 15:12 | |
| mriedem | cfriesen: you might be interested in this thread http://lists.openstack.org/pipermail/openstack-dev/2017-May/116595.html | 15:13 |
| mriedem | savvas: which release? | 15:14 |
| savvas | ocata | 15:14 |
| mriedem | and what's the value of [cinder]cross_az_attach in nvoa.conf? | 15:14 |
| mriedem | *nova.conf | 15:14 |
| mriedem | or is it not set? | 15:14 |
| savvas | that's left to default, I found comments on that but I didn't think it was relevant in my case | 15:14 |
| savvas | not set | 15:14 |
| *** gyee has joined #openstack-nova | 15:15 | |
| savvas | I figured based on the AZ I define when creating an instance that it would look for the available AZ as defined by the cinder-volume service | 15:15 |
| mriedem | nova doesn't list AZs from cinder | 15:15 |
| mriedem | have you looked at https://github.com/openstack/nova/blob/81bdbd0b50aeac9a677a0cef9001081008a2c407/nova/virt/block_device.py#L55 ? | 15:16 |
| mriedem | cross_az_attach defaults to True, so that method is going to return None | 15:17 |
| mriedem | which means when nova creates the volume, it's not going to pass an az to cinder, | 15:17 |
| mriedem | so cinder uses it's default az, which is 'nova' | 15:17 |
| mriedem | because that makes total sense right?! | 15:17 |
| savvas | right lol | 15:18 |
| mriedem | if you want nova to specify the same az for the volume as the vm, you have to set cross_az_attach=False | 15:18 |
| sdague | yay for inherited defaults | 15:18 |
| *** vks1 has joined #openstack-nova | 15:18 | |
| *** rcernin has quit IRC | 15:18 | |
| *** arunman has joined #openstack-nova | 15:19 | |
| mriedem | there are apparently at least 3 cinder config options for the default az | 15:19 |
| mriedem | one global one, which if not set defaults to another global one, which defaults to nova, but can be overridden on a per-backend basis | 15:19 |
| mriedem | using yet another option | 15:19 |
| mriedem | savvas: anyway, does that answer your question? | 15:20 |
| savvas | trying it as we speak :) | 15:20 |
| mriedem | maybe we need to update the cross_az_attach config option help docs a bit to make this clear | 15:20 |
| mriedem | i.e. by default nova will not specify an AZ when creating a volume so the volume will be created in the default AZ defined in Cinder | 15:21 |
| *** tbachman has quit IRC | 15:21 | |
| mriedem | which may or may not be the same as the AZ that the instance is created in | 15:21 |
| savvas | it still fails on the same error for me though | 15:21 |
| *** fragatina has quit IRC | 15:22 | |
| savvas | I set cross_az_attach to False and restarted my scheduler service | 15:22 |
| savvas | but it still tries to create a volume in the nova az, regardless of whether I defined the AZ for the instance to be created in or not | 15:22 |
| smcginnis | savvas: As mriedem explained, the AZ doesn't get passed through to cinder. So that makes sense. | 15:23 |
| *** kenperkins has joined #openstack-nova | 15:24 | |
| *** salv-orlando has joined #openstack-nova | 15:24 | |
| mriedem | savvas: that flag is checked in the compute service | 15:24 |
| savvas | smcginnis: yes that's what i noticed as well, but his suggested fix for cross_az_attach would/should help from my understanding | 15:24 |
| mriedem | not scheduler | 15:24 |
| mriedem | nova-compute is what creates the volume | 15:25 |
| mriedem | surprise! | 15:25 |
| savvas | oh I see so it is done on the compute nodes | 15:25 |
| mriedem | yeah - ideally conductor would do this, but... | 15:25 |
| mriedem | or even the api so we could fail fast | 15:25 |
| smcginnis | savvas: That will just allow it to be attached across AZs. But there is no way to have it created in the right AZ in the first place unless the right AZ is the default one. | 15:25 |
| mriedem | i've wanted that for a long time | 15:25 |
| savvas | smcginnis: right that's what i figured, is there any way around that? | 15:26 |
| *** adisky_ has quit IRC | 15:26 | |
| savvas | mriedem: ye that would make much more sense | 15:26 |
| *** jwcroppe has joined #openstack-nova | 15:26 | |
| mriedem | we've also talked about changing the cinder reserve (now attachment_create) api to take an AZ and fail if it doesn't exist, something like that | 15:26 |
| mriedem | so we could fail early in the api | 15:26 |
| mriedem | when reserving the volume | 15:26 |
| mriedem | smcginnis: setting cross_az_attach=False will make nova pass the instance az to cinder when creating the volume | 15:27 |
| mriedem | if that az doesn't exist in cinder, it will fail | 15:27 |
| *** belmoreira has quit IRC | 15:27 | |
| mriedem | and you'll get an instance in ERROR state and NoValidHost, because we don't do retries during bfv | 15:27 |
| mriedem | bfv == boot from volume | 15:27 |
| smcginnis | mriedem: Ah, missed that part. | 15:27 |
| mriedem | https://github.com/openstack/nova/blob/81bdbd0b50aeac9a677a0cef9001081008a2c407/nova/virt/block_device.py#L80 | 15:27 |
| mriedem | now don't forget that cinder has allow_availability_zone_fallback | 15:28 |
| mriedem | which is yet another terrible wrinkle in this mess, and should probably be deleted | 15:28 |
| mriedem | as it was a hack workaround for some bug in nova, which i think we fixed | 15:28 |
| smcginnis | That was actually the one I was thinking of. | 15:28 |
| savvas | mriedem: your cross_az suggestion does seem to fix it when explicitly selecting a zone to create the instance in | 15:29 |
| mriedem | allow_availability_zone_fallback=True means (i think) if nova says create the instance in this az but that az doesn't exist, don't fail | 15:29 |
| mriedem | savvas: cool | 15:29 |
| smcginnis | That was actually an end user request where they didn't care about nova AZs matching cinder AZs. | 15:29 |
| *** felipemonteiro_ has quit IRC | 15:29 | |
| mriedem | so if you set allow_availability_zone_fallback=True in cinder and cross_az_attach=False in nova, you're just screwing your users | 15:29 |
| *** arunman has quit IRC | 15:29 | |
| mriedem | smcginnis: then they should have set cross_az_attach=False (or left the default) | 15:29 |
| mriedem | sorry, True | 15:30 |
| *** salv-orlando has quit IRC | 15:30 | |
| mriedem | cross_az_attach=True by default, which means we don't care | 15:30 |
| savvas | mriedem: now from a production perspective, it would make sense to have nova define the best pool to provision though. Any suggestions for that? To create an instance with the "any availability zone" selected or via cli left blank? | 15:30 |
| mriedem | i'm fairly certain that when i wrote https://github.com/openstack/nova/blob/81bdbd0b50aeac9a677a0cef9001081008a2c407/nova/virt/block_device.py#L80 it was to fix a bug which was hacked around by allow_availability_zone_fallback in cinder | 15:30 |
| *** nicolasbock has joined #openstack-nova | 15:30 | |
| *** awaugama_ has joined #openstack-nova | 15:31 | |
| mriedem | savvas: if you don't need to be in a specific az, then you don't specify one | 15:31 |
| *** Oku_OS is now known as Oku_OS-away | 15:31 | |
| mriedem | smcginnis: we (and by we i mean you or one of your henchmen) should investigate removing allow_availability_zone_fallback | 15:31 |
| mriedem | via deprecation first of course | 15:31 |
| savvas | mriedem: right, but then creation fails as it will try to put the volume in nova again | 15:31 |
| mriedem | savvas: i don't understand that statement | 15:31 |
| mriedem | you mean if you set cross_az_attach=False? | 15:31 |
| savvas | your cross_az_attach fixed that when I define an AZ, it will grab the right volume zone | 15:31 |
| savvas | but if I don't define/select an AZ to create the instance in | 15:32 |
| savvas | it still fails | 15:32 |
| mriedem | savvas: the default instance az in nova matches the default volume az in cinder | 15:32 |
| mriedem | which is 'nova' | 15:32 |
| smcginnis | mriedem: Well, there's the non-Nova case to account for too. So I think it's still needed. You just can't misconfigure your nova and cinder settings like that. | 15:32 |
| cdent | melwitt, edleafe: in case it wasn't clear from my posting, I totally prefer a new porcelain api over transitioning the existing cruft. Was merely trying to pose an alternative/observation/etc. But as sdague eloquently pointed out in #openstack-dev last night, unless we put some muscle behind it, it is for naught. Got spare muscle? | 15:32 |
| mriedem | smcginnis: psh non-nova case | 15:32 |
| *** itlinux has quit IRC | 15:33 | |
| mriedem | smcginnis: allow_availability_zone_fallback is also not interoperable | 15:33 |
| smcginnis | mriedem: Not sure I follow what you mean. | 15:33 |
| savvas | mriedem: right, however leaving that blank is what would leave nova to determine the best node to spawn the instance on right? This would be a desirable feature when automating provisioning tasks | 15:33 |
| mriedem | smcginnis: on one cloud i can create a volume with az=foo even though it doesn't exist, on another cloud i can't create a volume in az=foo because it doesn't exist and it's enforced | 15:33 |
| edleafe | cdent: I know that you were just being hypothetical | 15:33 |
| mriedem | smcginnis: it's per-cloud configurable API behavior | 15:33 |
| edleafe | cdent: And no, no spare muscles at the moment :) | 15:33 |
| mriedem | which is by definition not interoperable | 15:34 |
| *** awaugama has quit IRC | 15:34 | |
| cdent | not so much hypothetical as omnithetical | 15:34 |
| sdague | cdent: I also think it's far more work than people imagine. Even the code itself is a lot of work, but in lessons learn from nova v3 and the current api-ref effort, the code is only a small amount of the total work | 15:34 |
| cdent | sdague: no dispute | 15:34 |
| smcginnis | mriedem: If that's the concern, we have much bigger fish to fry than AZ enforcement. | 15:35 |
| mriedem | smcginnis: maybe i should propose a deprecation patch in cinder and people can discuss i there | 15:35 |
| mriedem | smcginnis: it's also complexity | 15:35 |
| mriedem | which the foundation is apparently caring about now | 15:35 |
| *** arunman has joined #openstack-nova | 15:35 | |
| mriedem | hell, even thingee might get behind this | 15:35 |
| smcginnis | mriedem: And deprecate the nova option too? | 15:35 |
| *** yamahata has joined #openstack-nova | 15:35 | |
| mriedem | being foundation + cinder guy | 15:35 |
| mriedem | smcginnis: which one? | 15:35 |
| *** aarefiev is now known as aarefiev_afk | 15:35 | |
| mriedem | cross_az_attach? | 15:35 |
| smcginnis | mriedem: Yep. | 15:35 |
| *** itlinux has joined #openstack-nova | 15:36 | |
| smcginnis | mriedem: Same argument, if that is set on one cloud and not another, you get different behavior. | 15:36 |
| mriedem | i'd like to | 15:36 |
| *** MVenesio has quit IRC | 15:36 | |
| mriedem | true | 15:36 |
| mriedem | you know what, | 15:36 |
| jmlowe | I think I've botched adding cellsv2, I'm on newton | 15:36 |
| sdague | cdent: and, the reference point that everyone keeps referencing is git, which isn't doing those calls over a network, with a token validation in the middle. I'm not actually sure how applicable a porcelain approach is to REST services. It's at least a research project to even figure it out | 15:36 |
| *** mtanino_ has joined #openstack-nova | 15:36 | |
| mriedem | we should just allow passing all of the things you need to create a volume in to nova, | 15:36 |
| mriedem | volume type, | 15:36 |
| mriedem | volume az, | 15:36 |
| mriedem | volume qos | 15:36 |
| mriedem | everything | 15:36 |
| jmlowe | nova list shows an instance, nova delete sayas it's not there | 15:36 |
| cdent | jmlowe: did you show it some bourbon? | 15:36 |
| mriedem | jmlowe: sec | 15:37 |
| smcginnis | mriedem: There are some who would be in favor of that. | 15:37 |
| edleafe | sdague: writing an SDK is sort of like writing a porcelain wrapper (but much simpler), and that was a LOT of work | 15:37 |
| mriedem | jmlowe: see #3 https://docs.openstack.org/developer/nova/cells.html#faqs | 15:37 |
| jmlowe | cdent: I'm going to need some bourbon to steady my nerves here in a minute if I don't figure this out | 15:37 |
| mriedem | jmlowe: if that fixes your problem, i can die happy | 15:37 |
| edleafe | creating a full orchestrator would be an order of magnitude more | 15:37 |
| sdague | mriedem: that might be a good nova-status check | 15:39 |
| jmlowe | wait, so --cell_uuid is the source not the destination? | 15:39 |
| mriedem | jmlowe: do you have a single nova database? | 15:39 |
| jmlowe | that may have been my gross conceptual error | 15:39 |
| mriedem | i.e. you're not using cells v1? | 15:39 |
| mriedem | sdague: yeah maybe, would have to think about it | 15:40 |
| * mriedem is putting his fingers in too many pots this morning | 15:40 | |
| sdague | mriedem: anyway, faq is great | 15:40 |
| *** Sukhdev has joined #openstack-nova | 15:40 | |
| mriedem | jmlowe: i'm assuming you have a basic deployment with 2 cells, cell0 and cell1 | 15:40 |
| sdague | ffaq items probably moving into "am I ok" checks is better | 15:40 |
| mriedem | sdague: sure, but faq is cheap and easy today | 15:41 |
| sdague | yep | 15:41 |
| mriedem | jmlowe: nova-manage cell_v2 list_cells | 15:41 |
| *** hshiina has quit IRC | 15:41 | |
| jmlowe | ran the simple setup, figured out I forgot to create a new db for cell0, created db, did map_cell0/map_cell_and_hosts/map_instances | 15:41 |
| mriedem | will tell you what you have setup, i'm guessing there are 2 entries | 15:41 |
| mriedem | ok, when you run map_instances, it should be pointing at the non-cell0 cell | 15:41 |
| mriedem | which is your existing main 'nova' database | 15:41 |
| mriedem | with the instances | 15:41 |
| jmlowe | yep, ok, that was not what I was doing | 15:42 |
| *** mikal_ has joined #openstack-nova | 15:44 | |
| *** trinaths has joined #openstack-nova | 15:45 | |
| jmlowe | so that I can stop panicking, is there a way to go back to no cells in newton? | 15:45 |
| *** mikal has quit IRC | 15:47 | |
| mriedem | i don't think nova-manage cell_v2 delete_cell existed in newton, | 15:47 |
| mriedem | i mean you could hack the db, | 15:47 |
| mriedem | but honestly i can't really advise how to rollback | 15:47 |
| mriedem | jmlowe: i think the reason you're getting the 404 on instance delete is because the instance isn't mapped to the cell probably | 15:47 |
| *** jaypipes has quit IRC | 15:47 | |
| mriedem | we might not have had the list_cells command either - you'd have to see what's in the nova_api db cell_mappings table | 15:48 |
| mriedem | are there 2 entries in there? | 15:48 |
| jmlowe | there are two in there | 15:48 |
| mriedem | ok, one is pointing at your nova_cell0 db? | 15:48 |
| mriedem | and the other is pointing at your nova db? | 15:48 |
| *** tbachman has joined #openstack-nova | 15:48 | |
| *** lyan has quit IRC | 15:48 | |
| jmlowe | ok, did map_instances, this time with the correct uuid, no luck with nova show | 15:48 |
| *** mnestratov has quit IRC | 15:48 | |
| *** sree has quit IRC | 15:49 | |
| mriedem | do you see the uuid for the instance in the nova_api.instance_mappings table? | 15:49 |
| mriedem | savvas: i'm not sure how that is going to affect this - yes nova will pick a host which may be in an AZ, but i didn't think we set instance.availability_zone in that case if the user didn't explicitly request an az | 15:50 |
| *** mvk_ has joined #openstack-nova | 15:50 | |
| jmlowe | http://paste.openstack.org/show/610573/ | 15:50 |
| *** Sukhdev_ has joined #openstack-nova | 15:50 | |
| mriedem | savvas: is this at all related to what you're seeing? https://bugs.launchpad.net/nova/+bug/1497253 | 15:50 |
| openstack | Launchpad bug 1497253 in OpenStack Compute (nova) "different availability zone for nova and cinder when AZ is not explicitly given" [Low,In progress] - Assigned to Roman Podoliaka (rpodolyaka) | 15:50 |
| *** lyan has joined #openstack-nova | 15:51 | |
| *** salv-orlando has joined #openstack-nova | 15:52 | |
| mriedem | jmlowe: right so 0bbfb73d-f761-4c43-ad72-ab47a559615e is your main cell | 15:52 |
| mriedem | with the nova db | 15:52 |
| *** fragatina has joined #openstack-nova | 15:52 | |
| *** trinaths1 has joined #openstack-nova | 15:52 | |
| jmlowe | correct, I did 'nova-manage cell_v2 map_instances --cell_uuid 0bbfb73d-f761-4c43-ad72-ab47a559615e' | 15:52 |
| mriedem | jmlowe: is there an entry in the nova_api.instance_mappings table with the instance uuid you're looking for and cell 0bbfb73d-f761-4c43-ad72-ab47a559615e ? | 15:52 |
| *** itlinux has quit IRC | 15:52 | |
| savvas | mriedem: yes, let me explain why I would like to have nova determine the best node. Basically these would be nodes with local ssd storage, not clustered. So I want instances to have volumes on their own hypervisors but all hypervisors serve the same purpose. Therefore when an instance is to be created, all AZs would qualify and based on available resources nova should determine which AZ to pick. Now I figured if you don't | 15:53 |
| savvas | explicitly define the AZ, it will trigger nova to determine the best candidate, however that action fails as it will try to create the volume in the default "nova" AZ again | 15:53 |
| *** trinaths has quit IRC | 15:54 | |
| mriedem | savvas: does this patch fix your issue? https://review.openstack.org/#/c/225119/ | 15:55 |
| savvas | so your cross_az_attach fix works like a charm when explicitly defining an AZ, but not when trying to let nova determine the best AZ/node | 15:55 |
| jmlowe | http://paste.openstack.org/show/610574/ | 15:55 |
| savvas | mriedem: YES! That looks exactly like it | 15:55 |
| savvas | mriedem: thanks for the help! | 15:56 |
| *** lucasxu has quit IRC | 15:56 | |
| mriedem | savvas: so where does the failure actually happen? on the cinder side? | 15:56 |
| jmlowe | yes, the particular instance I'm after is present in the instance mappings mapped to cell0 | 15:57 |
| jmlowe | is it a problem that there is no transport url for cell0 in cell_mappings? | 15:57 |
| *** salv-orlando has quit IRC | 15:57 | |
| savvas | mriedem: well cinder works just fine, it does what it is beign told. Nova's just not telling cinder which AZ to use if you don't explicitly define the AZ for instance creating | 15:57 |
| mriedem | jmlowe: the problem is the instance is mapped to cell0 | 15:58 |
| jmlowe | yes | 15:58 |
| openstackgerrit | Andrey Volkov proposed openstack/nova master: [placement] Add api-ref for resource classes https://review.openstack.org/467596 | 15:59 |
| *** Apoorva has joined #openstack-nova | 15:59 | |
| savvas | mriedem: https://review.openstack.org/#/c/225119/ this right here what you just sent me is exactly what I am seeing | 15:59 |
| mriedem | jmlowe: so i think what probably happened was, the instances got mapped to cell0 by mistake, somehow, i'm not sure how - but now when you run map_instances with the correct cell 0bbfb73d-f761-4c43-ad72-ab47a559615e it does nothing b/c they are already mapped, | 15:59 |
| *** yamahata has quit IRC | 16:00 | |
| jmlowe | should the database connection for cell0 and the legacy nova be different? | 16:00 |
| mriedem | jmlowe: so i think you basically need to purge your instance_mappings table | 16:00 |
| mriedem | jmlowe: they should be separate databases yes | 16:00 |
| mriedem | you will have 3 separate databases: nova_api, nova_cell0 and nova | 16:00 |
| jmlowe | ok, just checking | 16:00 |
| mriedem | so i think you need to purge the instance_mappings table, and then re-map with the proper cell uuid 0bbfb73d-f761-4c43-ad72-ab47a559615e | 16:00 |
| jmlowe | no harm in ' delete from instance_mappings;' ? | 16:01 |
| mriedem | purging that table shouldn't be a problem since it's all wrong anyway | 16:01 |
| mriedem | dansmith: right? ^ | 16:01 |
| dansmith | yeah | 16:01 |
| *** fragatina has quit IRC | 16:01 | |
| jmlowe | rerunning mapping | 16:01 |
| mriedem | savvas: ok can you reply to the question i put in the commit messagE? | 16:01 |
| *** jaypipes has joined #openstack-nova | 16:02 | |
| mriedem | savvas: i.e. the volume gets created successfully but in the default 'nova' AZ, | 16:02 |
| mriedem | which is different from the explicit non-default AZ that the instance is in, | 16:02 |
| mriedem | and that's the bug, right? | 16:02 |
| mriedem | but the boot request doesn't actually fail? | 16:02 |
| savvas | no the boot request is accepted, it then tries to create a volume in AZ nova (default), when it fails it removes the attempted volume creation and leaves the new instance in error state | 16:03 |
| *** nic1 has joined #openstack-nova | 16:03 | |
| *** awaugama_ has quit IRC | 16:03 | |
| *** felipemonteiro has joined #openstack-nova | 16:04 | |
| mriedem | savvas: so is nova actually passing availability_zone='nova' to cinder when creating the volume? | 16:04 |
| mriedem | or None? | 16:04 |
| savvas | I believe it selects nova for it not being defined, but I can't tell for sure | 16:04 |
| mriedem | edleafe: in the absence of bauzas, can a compute host live in more than one AZ? | 16:04 |
| savvas | I've been using openstack for a week so I am still finding my way ;) | 16:04 |
| mriedem | savvas: that's kind of important, because if nova is passing az=None then it's a different issue | 16:04 |
| mriedem | savvas: you're a pro now | 16:04 |
| mriedem | congratulations | 16:05 |
| edleafe | mriedem: nope | 16:05 |
| mriedem | ok, but a compute host can be in more than one host aggregate | 16:05 |
| mriedem | that's where i get confused | 16:05 |
| edleafe | sure | 16:05 |
| edleafe | yes, it's very terrible | 16:05 |
| *** fragatina has joined #openstack-nova | 16:05 | |
| mriedem | https://docs.openstack.org/developer/nova/aggregates.html | 16:05 |
| mriedem | "one host can be in multiple aggregates, but it can only be in one availability zone" | 16:05 |
| mriedem | i guess i should have read the manual | 16:06 |
| *** fragatina has quit IRC | 16:06 | |
| savvas | mriedem: | OS-EXT-AZ:availability_zone | | 16:06 |
| savvas | it leaves the zone empty when not defined | 16:06 |
| *** nic1 is now known as nic | 16:06 | |
| savvas | so it doesn't explicitly pass on nova | 16:06 |
| *** r-daneel has joined #openstack-nova | 16:06 | |
| *** fragatina has joined #openstack-nova | 16:06 | |
| *** awaugama has joined #openstack-nova | 16:06 | |
| mriedem | savvas: ok so i don't see why the volume creation fails then | 16:07 |
| mriedem | if nova isn't passing an AZ, cinder will create the volume in it's default AZ, which is 'nova' | 16:07 |
| mriedem | i can see why / how the instance and volume can get into different AZs here, which is a bug | 16:08 |
| savvas | mriedem: exactly, I don't have any cinder-volumes available in nova though | 16:08 |
| savvas | right now I have 3 hypervisors setup in my test environment, all 3 in separate aggregates with separate storage zones | 16:08 |
| savvas | in my case it looks like this: | 16:08 |
| savvas | host-aggregate hv01-zone, has 1 member, hv01 | 16:08 |
| savvas | cinder on hv01 has storage/default zone set to hv01-zone | 16:09 |
| savvas | and I follow the same structure for hv02 and hv03 | 16:09 |
| savvas | but the default nova group has no usable cinder volumes available in my setup | 16:09 |
| *** thorst has joined #openstack-nova | 16:09 | |
| savvas | so when the AZ is not defined, it fails | 16:09 |
| mriedem | are you setting storage_availability_zone in cinder.conf on your 3 storage nodes? | 16:10 |
| *** Yangyapeng has quit IRC | 16:10 | |
| *** brault has quit IRC | 16:10 | |
| mriedem | i don't really know how cinder handles the AZs on their side | 16:10 |
| mriedem | so i don't know what the actual error looks like when creating the volume on the cinder side, | 16:11 |
| mriedem | if you have those details you could put them in that bug | 16:11 |
| *** kylek3h_ has joined #openstack-nova | 16:11 | |
| savvas | mriedem: yes, they are all on all 3 nodes | 16:12 |
| jmlowe | ok, looking much better | 16:12 |
| mriedem | jmlowe: sweet | 16:12 |
| mriedem | rpodolyaka: can you explain where we fail with https://review.openstack.org/#/c/366724/ during boot? | 16:12 |
| mriedem | is it during attach? | 16:12 |
| *** salv-orlando has joined #openstack-nova | 16:12 | |
| *** vks1 has quit IRC | 16:12 | |
| mriedem | savvas: the volume gets created successfully though right? but then something else fails? | 16:13 |
| *** kylek3h has quit IRC | 16:14 | |
| savvas | mriedem: when the AZ upon instance creation is defined, yes. When the AZ upon instance creation is not defined, then no. When I create a volume manually via the CLI in the nova zone (so create a volume without defining AZ), it creates just fine | 16:15 |
| mriedem | i think i see it | 16:15 |
| jmlowe | I blame my complete lack of reading comprehension on my new monitor where the text is all very small and cannot be increased lest it injure my pride | 16:15 |
| savvas | mriedem: let me correct that, the creation fails, sorry it accepts the command but it fails to create | 16:16 |
| mriedem | jmlowe: so now that you've gone through this, it would be interesting to know which docs you read before you started upgrading | 16:16 |
| mriedem | savvas: i think it fails here https://github.com/openstack/nova/blob/master/nova/virt/block_device.py#L368 | 16:16 |
| savvas | which in my opinion is logical behavior since there are no cinder-volume services running in the nova zone | 16:16 |
| *** dikonoor has quit IRC | 16:16 | |
| *** udesale has quit IRC | 16:16 | |
| jmlowe | I half read this https://docs.openstack.org/releasenotes/nova/newton.html | 16:16 |
| *** trinaths1 has quit IRC | 16:17 | |
| mriedem | jmlowe: did you see any of https://docs.openstack.org/developer/nova/cells.html#upgrade-minimal ? | 16:17 |
| jmlowe | wasn't really thinking about what I was doing, was irritated by the cells0 db missing warning from nova-manage db sync | 16:17 |
| mriedem | ^ is really the page with the basic instructions on upgrading to cells v2 | 16:18 |
| mriedem | so it'd be good info to know if people aren't aware of it, or it doesn't make sense in some parts, or there are things missing | 16:18 |
| jmlowe | no, and that warning about the db name would definitely save me some headaches | 16:18 |
| mriedem | which warning? | 16:18 |
| mriedem | oh i see | 16:18 |
| mriedem | in the doc | 16:18 |
| mriedem | yeah, so simple_cell_setup defaulting the cell0 db name to nova_api_cell0 is a bug | 16:19 |
| savvas | mriedem: I don't think so but i could be mistaken. To me it looks like a bug in determining where to deploy. If you explicitly define a zone, it will grab the right storage az. If you don't define a zone, it will grab an available HV AZ but it won't grab its corresponding available storage az | 16:19 |
| jmlowe | so I'm still a little concerned that my transport_url for cell0 is none:/// | 16:19 |
| jmlowe | is that really not a problem? | 16:19 |
| dansmith | jmlowe: yeah, that's wrong | 16:20 |
| dansmith | jmlowe: you'll fail when some instance doesn't schedule if tat | 16:20 |
| dansmith | jmlowe: but you don't need to do anything other than fix that record at this point.. no need to remap or anything | 16:20 |
| dansmith | oh | 16:20 |
| dansmith | sorry | 16:20 |
| dansmith | transport_url | 16:20 |
| mriedem | that's normal | 16:20 |
| dansmith | yeah, there's no transport for cell0 | 16:20 |
| dansmith | yeah sorry, was thinking database | 16:20 |
| mriedem | cell0 is a db which is a graveyard for instances that failed to schedule | 16:21 |
| jmlowe | ah, ok that makes more sense | 16:21 |
| mriedem | maybe, "Why is the transport_url for cell0 none:/// ?" should be in the FAQs | 16:21 |
| mriedem | savvas: i've asked in https://review.openstack.org/#/c/366724/ which is the current proposed fix for the bug, | 16:22 |
| mriedem | at this point i really need a clear idea of what the actual failure is, either in reply to that question in the patch or in the bug report | 16:22 |
| mriedem | but we're kind of going in circle | 16:22 |
| mriedem | *circles | 16:22 |
| *** thorst has quit IRC | 16:23 | |
| mriedem | i understand there is a problem, but i'd like to make sure i understand the problem before reviewing a fix, and i'd also like to consider some integration testing for this since it's complicated | 16:23 |
| *** ltomasbo is now known as ltomasbo|away | 16:23 | |
| *** pcaruana has quit IRC | 16:24 | |
| *** gianpietro has joined #openstack-nova | 16:25 | |
| *** bkopilov has quit IRC | 16:25 | |
| *** thorst has joined #openstack-nova | 16:26 | |
| *** annegentle has quit IRC | 16:26 | |
| savvas | mriedem: alright let me see how I can get a more conclusive answer for you | 16:27 |
| *** annegentle has joined #openstack-nova | 16:27 | |
| *** dtp has joined #openstack-nova | 16:28 | |
| *** lpetrut has quit IRC | 16:31 | |
| *** Apoorva_ has joined #openstack-nova | 16:32 | |
| mriedem | jmlowe: btw i'm sort of working on backporting that cell0 db name fix to newton https://review.openstack.org/#/c/420461/ but it gets a bit complicated, and at this point i'm not sure if it helps anyone or not, but i'd surely like to help avoid people from falling into this trap in the first place where they have a nova_api_cell0 db in newton and then need to rename that to nova_cell0 in ocata | 16:33 |
| *** efoley_ has joined #openstack-nova | 16:33 | |
| savvas | mriedem: in my cinder scheduler log I caught this : default default] No weighed backend found for volume with properties: None. | 16:33 |
| savvas | after attempting to create an instance without defining the AZ | 16:33 |
| *** Apoorva has quit IRC | 16:34 | |
| savvas | so nova passed on the None value for the AZ to cinder I guess | 16:34 |
| *** sambetts is now known as sambetts|afk | 16:34 | |
| *** bkopilov has joined #openstack-nova | 16:34 | |
| mriedem | jmlowe: thoughts on that? would that at least be helpful to give people in the operators ML a heads up? | 16:34 |
| *** gianpietro has quit IRC | 16:35 | |
| mriedem | savvas: right and i'm saying that's no different from the case that cross_az_attach=True, which is why i don't think it would result in the volume create failing | 16:35 |
| mriedem | so i think there is something else happening | 16:35 |
| *** abalutoiu has joined #openstack-nova | 16:36 | |
| *** gianpietro has joined #openstack-nova | 16:36 | |
| savvas | mmm, any thoughts as to where I should be looking? I've been tailing the nova and cinder logs to see what happens when I call for a nova boot | 16:36 |
| *** efoley has quit IRC | 16:37 | |
| *** nicolasbock has quit IRC | 16:37 | |
| savvas | mriedem: either way, I'll keep working on it, if I find anything useful I'll be sure to let you know. Thanks for your time! | 16:38 |
| mriedem | savvas: if the instance goes to error state, it's mostly likely something failing in the nova-compute logs | 16:39 |
| savvas | mriedem: ye from those logs I only find the error I initially reported: BuildAbortException: Build of instance 9484f5a7-3198-47ff-b728-178515a26277 aborted: Block Device Mapping is Invalid. | 16:41 |
| mriedem | savvas: ok i think that's resulting from https://github.com/openstack/nova/blob/81bdbd0b50aeac9a677a0cef9001081008a2c407/nova/virt/block_device.py#L368 | 16:42 |
| *** annegentle has quit IRC | 16:42 | |
| mriedem | savvas: don't you see a traceback from here? https://github.com/openstack/nova/blob/81bdbd0b50aeac9a677a0cef9001081008a2c407/nova/compute/manager.py#L1593 | 16:42 |
| mriedem | wow i guess we really don't try to help out with the error message in this ase | 16:43 |
| mriedem | *Case | 16:43 |
| savvas | mriedem: | 16:44 |
| savvas | 2017-05-24 16:33:26.127 2331 ERROR nova.compute.manager [req-b5388b21-5f75-4946-8ace-56cd91ebdc72 be0e3c8d93f345a6889e76d1507ba130 7509210fbb1a4e30bf62d81aa3b4e369 - - -] [instance: 9484f5a7-3198-47ff-b728-178515a26277] Instance failed block device setup | 16:44 |
| mriedem | savvas: there should be a traceback | 16:44 |
| mriedem | please put that into a paste and link here | 16:44 |
| mriedem | it's using LOG.exception which will traceback | 16:44 |
| savvas | ye grabbed this with cat, looking it up now | 16:44 |
| savvas | http://paste.as47869.net/p/9qbburh7z3w3toi | 16:45 |
| *** annegentle has joined #openstack-nova | 16:46 | |
| mriedem | VolumeNotCreated: Volume da947c97-66c6-4b7e-9ae6-54eb8128bb75 did not finish being created even after we waited 3 seconds or 2 attempts. And its status is error. | 16:49 |
| mriedem | that is a different issue | 16:49 |
| jaypipes | gosh darn it... | 16:49 |
| *** slaweq has joined #openstack-nova | 16:49 | |
| mriedem | penick: ^ is why bfv is awful | 16:49 |
| mriedem | savvas: you're failing in here https://github.com/openstack/nova/blob/81bdbd0b50aeac9a677a0cef9001081008a2c407/nova/compute/manager.py#L1222 | 16:50 |
| mriedem | it's timing out waiting for the volume that nova created to be available so it can attach it to the instance | 16:50 |
| mriedem | you probably need to setup image cache on the cinder side, and tweak the timeout values on the nova compute side | 16:50 |
| *** mingyu has joined #openstack-nova | 16:50 | |
| *** lucasxu has joined #openstack-nova | 16:51 | |
| penick | Is its disease of awfulness irreparable? | 16:51 |
| smcginnis | Larger images may take a long time. | 16:51 |
| savvas | mriedem: the volume fails to create though | 16:52 |
| *** efoley__ has joined #openstack-nova | 16:52 | |
| savvas | it fails instantly, as it tries to do so in an AZ which isn't available | 16:52 |
| mriedem | savvas: does the volume go to error state? | 16:52 |
| savvas | yes | 16:52 |
| mriedem | savvas: but i thought nova was passing az=None when creating the volume? | 16:52 |
| savvas | correct | 16:52 |
| *** salv-orlando has quit IRC | 16:53 | |
| *** slaweq has quit IRC | 16:53 | |
| savvas | which leads cinder to attempt and create the volume in the default az of "nova" | 16:53 |
| savvas | which fails | 16:53 |
| mriedem | my head is going to explode | 16:53 |
| *** slaweq has joined #openstack-nova | 16:53 | |
| openstackgerrit | Jay Pipes proposed openstack/nova master: integrate trait cache with TraitList and Trait https://review.openstack.org/462770 | 16:53 |
| mriedem | ok, so is the problem that things get more strict on the cinder side when you actually have AZs in cinder? | 16:53 |
| mriedem | because if you don't have az's in cinder, you can create volumes w/o an az (by default in the nova az) just fine | 16:54 |
| mriedem | but once you add an az, cinder won't allow that anymore? | 16:54 |
| savvas | ye I am sorry if I am making you go in circles here, like I said my lack of exp isn't helping much either I am sure | 16:54 |
| mriedem | by the way, we should totally get that VolumeNotCreated error into https://github.com/openstack/nova/blob/81bdbd0b50aeac9a677a0cef9001081008a2c407/nova/compute/manager.py#L1595 which is fed back up and goes into the instance fault | 16:54 |
| *** efoley_ has quit IRC | 16:55 | |
| mriedem | savvas: don't worry about it, you're doing great - i obviously don't know how anything works here either :) | 16:55 |
| mriedem | what i'd like to do is know a simple recreate so i can write a tempest test for this | 16:55 |
| kashyap | Does anyone know for sure, about whether the double quotes are *mandatory* when you specify a key-value in a Nova config attribute as following: | 16:56 |
| kashyap | [libvirt] | 16:56 |
| kashyap | hw_machine_type="x86_64=pc-i440fx-rhel7.2.0" | 16:56 |
| savvas | I run 3 cinder volume servers, each with their own AZ. The controller has no storage/default AZ defined | 16:56 |
| * kashyap knows for sure that using double-quotes works. However, checking if it's mandatory | 16:56 | |
| savvas | mriedem: as in steps to reproduce this error? | 16:56 |
| *** salv-orlando has joined #openstack-nova | 16:57 | |
| *** derekh has quit IRC | 16:57 | |
| mriedem | savvas: i think just even knowing if you can create a volume in cinder w/o specifying AZ if there is a non-default AZ defined, just one | 16:57 |
| *** Sukhdev_ has quit IRC | 16:57 | |
| savvas | no, that doesn't work. At this stage I HAVE to specify an AZ | 16:57 |
| jmlowe | mriedem: yeah, I'm going to trip over this later | 16:57 |
| *** mlakat has quit IRC | 16:57 | |
| mriedem | savvas: huh, ok, figured cinder would allow it if az isn't specified | 16:58 |
| mriedem | smcginnis: jgriffith: ^ is that by design? | 16:58 |
| mriedem | hell it might even be how nova does it but i'm not sure | 16:58 |
| *** mingyu has quit IRC | 16:58 | |
| smcginnis | mriedem: Didn't follow everything, but are you saying if AZ is None, Cinder fails the call? | 16:58 |
| mriedem | smcginnis: is there is a non-default AZ defined in cinder | 16:59 |
| mriedem | so if i create az=foo in cinder, | 17:00 |
| mriedem | do i have to create all volumes explicitly in that az now? | 17:00 |
| smcginnis | mriedem: I didn't think so. | 17:00 |
| smcginnis | Checking... | 17:00 |
| * kashyap answers his own: Since it's a comma-separated key-value pair, I don't need the double quoting. | 17:01 | |
| smcginnis | So if storage_availability_zone is set to something other than the default, you may need to also update default_availability_zone. Still looking though. | 17:01 |
| *** salv-orlando has quit IRC | 17:02 | |
| savvas | smcginnis: I have both values set on each node running cinder-volume service | 17:02 |
| mriedem | dansmith: are we supposed to be in meeting-3 for cells? | 17:02 |
| mriedem | and the interop guys are going long? | 17:02 |
| smcginnis | savvas: So both are set to unique values, but if None is passed in for AZ it fails? | 17:02 |
| *** lucasxu has quit IRC | 17:03 | |
| savvas | smcginnis: I have both set to the zone available to the node. I run nova compute and cinder volume on the same host for this purpose. So hv01 would have default/storage_availability_zone set to hv01-zone, hv02 to hv02-zone and so on | 17:03 |
| mriedem | i think that's wrong | 17:04 |
| mriedem | i think default_availability_zone is supposed to be global | 17:04 |
| savvas | as these hypervisors are supposed to be dependent of their local storage, they shouldn't be looking to place volumes in any other zones | 17:04 |
| melwitt | mriedem: yeah on my calendar we should have a cells meeting right now | 17:04 |
| mriedem | that's what storage_availability_zone is for, | 17:05 |
| mriedem | and it overrides default_availability_zone | 17:05 |
| mriedem | is my understanding | 17:05 |
| mriedem | 'Default availability zone for new volumes. If not set, ' | 17:05 |
| mriedem | 'the storage_availability_zone option value is used as ' | 17:05 |
| mriedem | 'the default for new volumes.' | 17:05 |
| smcginnis | savvas: So still looking for details, if None is passed in for AZ it fails? | 17:06 |
| savvas | mriedem: ye but let's say I put default_availability_zone to "nova", wouldn't that result in volumes floating across the nodes? I am trying to isolate the volumes to the nodes that serve the instances | 17:07 |
| *** lucasxu has joined #openstack-nova | 17:07 | |
| savvas | smcginnis: sorry, yes if None is passed for AZ, it fails | 17:07 |
| mriedem | savvas: i think the point is you don't set a default_availability_zone value | 17:07 |
| *** djohnsto has joined #openstack-nova | 17:07 | |
| mriedem | setting to 'nova' and leaving unset is probably handled differently in the cinder code | 17:07 |
| smcginnis | mriedem: Oh yeah, that's cinder-wide, not per-backend. | 17:08 |
| mriedem | right, that's what i said above, it's global | 17:08 |
| savvas | mmm | 17:08 |
| mriedem | storage_availability_zone is per node | 17:08 |
| mriedem | default_availability_zone is global | 17:08 |
| savvas | so this value should not be set on the cinder-volumes | 17:08 |
| mriedem | backend_availability_zone is per backed per nod | 17:09 |
| mriedem | *node | 17:09 |
| mriedem | savvas: i don't think so no | 17:09 |
| mriedem | but, i'm not entirely sure, hence roping in smcginnis | 17:09 |
| djohnsto | mriedem: Any thoughts on how to resolve this bug - seems to be disagreement with the fix 193047 | 17:09 |
| *** thorst has quit IRC | 17:09 | |
| mriedem | djohnsto: which bug? | 17:09 |
| mriedem | oh https://review.openstack.org/#/c/193047/ | 17:10 |
| djohnsto | Yep. | 17:10 |
| smcginnis | savvas: I can try to test this out later, but try removing those conflicting default_availability_zone values. | 17:10 |
| mriedem | djohnsto: in a meeting now, | 17:10 |
| mriedem | that probably needs to be in the mailing list | 17:11 |
| mriedem | as it's a change in behavior | 17:11 |
| djohnsto | Ok | 17:11 |
| *** arunman has quit IRC | 17:11 | |
| *** gjayavelu has quit IRC | 17:12 | |
| savvas | smcginnis: I removed it but it didn't change anything in terms of the volume create command failing when AZ is not defined | 17:14 |
| smcginnis | savvas: OK, will have to look in to it then. | 17:14 |
| *** links has quit IRC | 17:16 | |
| *** mvk_ has quit IRC | 17:17 | |
| savvas | smcginnis: appreciate it | 17:17 |
| mriedem | savvas: you restarted the services after changing the config right? | 17:19 |
| *** mvk has quit IRC | 17:22 | |
| *** efoley__ has quit IRC | 17:22 | |
| savvas | mriedem: yes | 17:23 |
| *** jaosorior has quit IRC | 17:24 | |
| *** mingyu has joined #openstack-nova | 17:24 | |
| *** rmart04 has quit IRC | 17:25 | |
| *** thorst has joined #openstack-nova | 17:29 | |
| *** ijw_ has quit IRC | 17:30 | |
| *** thorst has quit IRC | 17:33 | |
| *** thorst has joined #openstack-nova | 17:33 | |
| *** logan- has quit IRC | 17:34 | |
| *** logan- has joined #openstack-nova | 17:35 | |
| *** Apoorva_ has quit IRC | 17:38 | |
| *** Apoorva has joined #openstack-nova | 17:38 | |
| *** fragatina has quit IRC | 17:39 | |
| *** gszasz has quit IRC | 17:39 | |
| *** kenperkins has quit IRC | 17:42 | |
| *** Sukhdev_ has joined #openstack-nova | 17:46 | |
| *** ralonsoh has quit IRC | 17:48 | |
| *** salv-orlando has joined #openstack-nova | 17:49 | |
| mriedem | anyone remember when the guy in the nova onboarding session asked how he knows if an instance variable is a dict or an object or something else? | 17:53 |
| *** mvk_ has joined #openstack-nova | 17:53 | |
| mriedem | same question, but block_device_mapping | 17:53 |
| *** _danpawlik has joined #openstack-nova | 17:53 | |
| mriedem | is a list, is it a single thing? dict or object? if object, which type of object? | 17:53 |
| mriedem | super fun | 17:53 |
| melwitt | I remember | 17:54 |
| artom | mdbooth wrote a thing about that | 17:54 |
| artom | http://lists.openstack.org/pipermail/openstack-dev/2016-June/097529.html | 17:55 |
| melwitt | and yeah. generally I've noticed, things are objects until you get into the virt driver, then a lot of things are dicts | 17:55 |
| artom | The fact that you need a novel to understand wtf is concerning, but at least we now have this novel for posterity | 17:55 |
| *** salv-orlando has quit IRC | 17:56 | |
| mriedem | "as there is also something else typically called 'block_device_mapping' which is not a BlockDeviceMapping object." | 17:57 |
| mriedem | or a BlockDeviceMappingList | 17:57 |
| mriedem | which is the case in places | 17:57 |
| mriedem | sometime the actual variable is bdm passed to a method whose formal parameter name is bdms | 17:57 |
| * artom hands mriedem a scalpel and points to his wrists | 17:58 | |
| mriedem | ha, wow | 17:59 |
| artom | No no, I want to help :) | 17:59 |
| mriedem | wait, my wrists or yours? | 17:59 |
| artom | Yes. | 18:00 |
| *** thorst has quit IRC | 18:00 | |
| mriedem | i was specifically looking at _prep_block_device | 18:00 |
| mriedem | which i think takes in a BlockDeviceMappingList | 18:00 |
| *** ctrath1 has joined #openstack-nova | 18:00 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/nova master: provide interface-scoped nameserver information https://review.openstack.org/467699 | 18:00 |
| mriedem | and through the magic of driver.get_block_device_info(instance, bdms) converst that list to a list of DriverBlockDevice objects | 18:00 |
| mriedem | which are wrappers around a BlockDeviceMapping objec | 18:00 |
| mriedem | *object | 18:00 |
| *** ctrath has quit IRC | 18:04 | |
| *** jpena is now known as jpena|off | 18:04 | |
| *** tidwellr has joined #openstack-nova | 18:05 | |
| *** Sukhdev has quit IRC | 18:10 | |
| *** kaisers__ has quit IRC | 18:10 | |
| *** salv-orlando has joined #openstack-nova | 18:10 | |
| *** ijw has joined #openstack-nova | 18:13 | |
| *** gjayavelu has joined #openstack-nova | 18:17 | |
| *** thorst has joined #openstack-nova | 18:19 | |
| *** rmart04 has joined #openstack-nova | 18:21 | |
| *** salv-orlando has quit IRC | 18:22 | |
| tidwellr | I'm probably grasping at straws, but is there a chance anyone here can make sense of this error http://paste.openstack.org/show/610594 seen on stable/mitaka? | 18:22 |
| mriedem | gmann: weren't you talking about something with hide addresses earlier today? ^ | 18:23 |
| *** gianpietro has quit IRC | 18:24 | |
| mriedem | tidwellr: the instance isn't in the req cache for some reason https://github.com/openstack/nova/blob/stable/mitaka/nova/api/openstack/compute/hide_server_addresses.py#L62 | 18:25 |
| tidwellr | mriedem: that's what it looks like to me, the question is why | 18:25 |
| mriedem | it should be cached here https://github.com/openstack/nova/blob/stable/mitaka/nova/api/openstack/compute/servers.py#L443 | 18:25 |
| mriedem | so not sure | 18:25 |
| *** READ10 has quit IRC | 18:26 | |
| mriedem | unless the extension's show() method is processed before the instance is cached? | 18:26 |
| mriedem | sdague: ^ any idea how that craziness works? | 18:26 |
| tidwellr | what's weird is the user that reported this can run operations from the CLI just fine, but has an app that invokes the API directly and that is where we see this | 18:26 |
| *** kaisers_ has joined #openstack-nova | 18:26 | |
| *** gianpietro has joined #openstack-nova | 18:27 | |
| tidwellr | I'm wondering if it is related to auth/domains somehow, again I'm grasping at straws here | 18:27 |
| *** Swami has joined #openstack-nova | 18:28 | |
| sdague | mriedem: I need you to summarize the question | 18:28 |
| mriedem | sdague: heh, | 18:28 |
| mriedem | how do extensions work in the api :) | 18:28 |
| artom | mriedem, what I'm seeing is that the instance is obtained here: https://github.com/openstack/nova/blob/stable/mitaka/nova/api/openstack/compute/hide_server_addresses.py#L62 | 18:29 |
| mriedem | artom: it has to be None | 18:29 |
| artom | Is that from cache? Or is it missing from the bd | 18:29 |
| mriedem | it's not in the cache | 18:29 |
| mriedem | AttributeError: 'NoneType' object has no attribute 'get' | 18:29 |
| mriedem | sdague: do the servers extensions for show() happen after the actual servers controller is called? | 18:30 |
| sdague | yes, iirc. This is mitaka? | 18:30 |
| mriedem | sdague: i.e. we do GET /servers/{server_id} and store the instance in the request cache here https://github.com/openstack/nova/blob/stable/mitaka/nova/api/openstack/compute/servers.py#L443 | 18:30 |
| mriedem | yeah | 18:30 |
| sdague | that's my recollection | 18:30 |
| sdague | tidwellr: what was going on before the stack trace? | 18:30 |
| *** gianpietro has quit IRC | 18:30 | |
| mriedem | i see other server extensions like for security groups handle this differently | 18:31 |
| *** kaisers_ has quit IRC | 18:31 | |
| mriedem | every other extension does something like https://github.com/openstack/nova/blob/stable/mitaka/nova/api/openstack/compute/servers.py#L443 | 18:32 |
| mriedem | oops | 18:32 |
| mriedem | req.get_db_instance(server['id']) | 18:33 |
| *** ctrath1 has quit IRC | 18:33 | |
| mriedem | they don't use the id parameter in the 'show' method | 18:33 |
| tidwellr | sdague: I've got a user who is making calls to v2.1/<project ID>/servers/<server ID> | 18:33 |
| tidwellr | in this case, it's a GET | 18:33 |
| sdague | tidwellr: what kind of calls? GET calls? | 18:33 |
| sdague | tidwellr: is it immediately after a POST? | 18:33 |
| *** lyan has quit IRC | 18:34 | |
| *** ctrath has joined #openstack-nova | 18:34 | |
| tidwellr | sdague: no, we're troublshooting this call against an instance that's been running for a while | 18:35 |
| sdague | tidwellr: do you have any local custom extensions? | 18:35 |
| tidwellr | sdague: no, we don't | 18:35 |
| sdague | hmmm | 18:35 |
| *** lyan has joined #openstack-nova | 18:35 | |
| mriedem | https://github.com/openstack/nova/blob/stable/mitaka/nova/api/openstack/wsgi.py#L619 | 18:36 |
| mriedem | what are **action_args here? | 18:36 |
| sdague | that's basically the peek of the actions dict iirc | 18:37 |
| mriedem | but if this is a GET | 18:37 |
| sdague | so it should be nothing | 18:37 |
| mriedem | ok, so that would be the issue | 18:37 |
| sdague | it really shouldn't be | 18:37 |
| *** ayoung has quit IRC | 18:38 | |
| mriedem | if id passed to the show() method is None https://github.com/openstack/nova/blob/stable/mitaka/nova/api/openstack/compute/hide_server_addresses.py#L62 | 18:38 |
| mriedem | note that every other show() extension gets the instance from the cache doing something like this https://github.com/openstack/nova/blob/stable/mitaka/nova/api/openstack/compute/config_drive.py#L52 | 18:38 |
| mriedem | from the response object | 18:38 |
| mriedem | resp_obj.obj['servers']['id'] | 18:38 |
| sdague | mriedem: no, that's different | 18:40 |
| sdague | https://github.com/openstack/nova/blob/d3297e2e73a2578ffc2987facf5b894667056f97/nova/api/openstack/compute/config_drive.py#L32 | 18:40 |
| *** kaisers_ has joined #openstack-nova | 18:40 | |
| sdague | get_db_instance goes into the request instance cache | 18:41 |
| sdague | that other thing is where it's munging the resp obj before it comes back | 18:41 |
| sdague | tidwellr: is there anything notable before that part of the log? | 18:42 |
| tidwellr | sdague: let me take another look, not that I recall | 18:42 |
| tidwellr | just a sec | 18:43 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Provide original fault message when BFV fails https://review.openstack.org/467715 | 18:43 |
| tidwellr | sdague: my logs are pretty quiet leading up this | 18:46 |
| tidwellr | sdague: it only shows up when the tenant makes the call to show the instance | 18:46 |
| mriedem | i don't know what would be different between CLI and a direct curl request to the api | 18:46 |
| sdague | tidwellr: ..... why is the instance UUID uppercased? | 18:47 |
| sdague | 5100C340-8967-4DB1-97F7-BFA1C155F250 | 18:47 |
| tidwellr | the difference I'm thinking is the way the user is getting a token | 18:47 |
| *** lyan has quit IRC | 18:47 | |
| sdague | because, you know, that could actually totally cause this problem if that id is not case matched to the db id | 18:48 |
| melwitt | mriedem: I was thinking I'm gonna just write a functional test that tests the counting across cells for server group members, without trying to do anything more complicated with scheduling. I'm thinking to try to set up two cell databases, put an instance in each that is associated with the same group, and see if the counting function returns the right thing | 18:48 |
| sdague | because... mysql | 18:48 |
| mriedem | melwitt: that's probably a good idea | 18:49 |
| melwitt | cool | 18:49 |
| dansmith | melwitt: not that you asked me, but I agree too :) | 18:49 |
| tidwellr | sdague: that makes sense, I hadn't noticed that :) | 18:50 |
| mriedem | ah... | 18:50 |
| melwitt | dansmith: votes of confidence always good :) | 18:50 |
| sdague | tidwellr: yeh, I was just looking for things that seemed odd | 18:50 |
| mriedem | and because this extension is using the id from the request, | 18:50 |
| * tidwellr puts palm on face | 18:50 | |
| mriedem | and not what's in the resp_obj | 18:50 |
| mriedem | which could be different case | 18:50 |
| sdague | tidwellr: no, it's like a legit nova bug | 18:50 |
| sdague | it's just not an edge I've seen people cross | 18:51 |
| dansmith | sdague: not a legit bug, just *like* a legit bug, yes? | 18:51 |
| * dansmith is being super helpful today | 18:51 | |
| mriedem | tidwellr: can you report a bug? | 18:51 |
| sdague | tidwellr: could you figure out if the user works if they use the lower case version of the uuid? | 18:51 |
| tidwellr | sdague: sure, I can do that | 18:51 |
| mriedem | there is a simple fix i can think of, which is make that extension behave like the rest, | 18:52 |
| sdague | mriedem: it is behaving like the rest | 18:52 |
| sdague | mriedem: I'm trying to understand why you think it isn't :) | 18:52 |
| *** itlinux has joined #openstack-nova | 18:52 | |
| mriedem | https://github.com/openstack/nova/blob/stable/mitaka/nova/api/openstack/compute/hide_server_addresses.py#L62 is looking up the instance in the cache using the id parameter to the show() method | 18:52 |
| mriedem | which is passed in via the wsgi extension processing code, right? | 18:52 |
| melwitt | mysql is case-insensitive by default, right? it's the request instance cache in the REST API that is case-sensitive (python) | 18:52 |
| mriedem | and i'm assuming is what came in on the request, the {server_id} part that is upper case | 18:53 |
| sdague | mriedem: sure | 18:53 |
| mriedem | sdague: if you look at all of the other extensions, they do something like resp_obj.obj['server']['id'] | 18:53 |
| sdague | oh, right | 18:53 |
| mriedem | which is presumably the id for the server obj that's coming out of the db | 18:53 |
| mriedem | which is why it matches | 18:53 |
| sdague | right, makes sense | 18:54 |
| mriedem | please state that i'm correct for the record | 18:54 |
| mriedem | let the record show | 18:54 |
| mriedem | etc | 18:54 |
| sdague | heh | 18:54 |
| mriedem | tidwellr: can you get a bug reported? | 18:55 |
| mriedem | we can backport to newton, but you're on your own for mitaka | 18:55 |
| tidwellr | mriedem: fair enough, I'll report the bug | 18:55 |
| sdague | mriedem: you want to whip up the fix? or should I? | 18:57 |
| tidwellr | mriedem sdague: thanks for looking into this | 18:57 |
| mriedem | sdague: i can wip it | 18:57 |
| mriedem | btw, way to break s390x guys | 18:57 |
| mriedem | "it's all fun and games until s390 shows up" | 18:58 |
| mriedem | where is jlk when we need him? | 18:58 |
| sdague | tidwellr: no prob. I would love to know why the client application was upper casing things | 18:58 |
| sdague | mriedem: that the etcd thing? | 18:59 |
| mriedem | yeah | 18:59 |
| sdague | it's a good thing that wasn't discussed on the mailing list for the last month | 19:00 |
| mriedem | but also something quotable from jlk back at the first meetup at intel, talking about zvm | 19:00 |
| mriedem | sdague: it actually caught a lot of people by surprise, | 19:00 |
| mriedem | non-dev people | 19:00 |
| sdague | mriedem: sure, but if you are going to be maintaining a non primary architecture, it seems like you should keeping an eye on things | 19:01 |
| *** itlinux has quit IRC | 19:01 | |
| *** gjayavelu has quit IRC | 19:01 | |
| mriedem | i don't actually care, | 19:01 |
| mriedem | i just thought it was kind of amusing | 19:01 |
| sdague | heh | 19:02 |
| mriedem | now that i'm no longer paid to care | 19:02 |
| mriedem | \oo/ | 19:02 |
| *** thorst has quit IRC | 19:02 | |
| mriedem | whoa | 19:02 |
| mriedem | that came out wrong | 19:02 |
| sdague | so, to be fair, there was all this work in the devstack patch that looked multiarch | 19:02 |
| sdague | but, then when I started to add sha256sums this morning | 19:02 |
| sdague | I found that nothing except amd64 existed | 19:02 |
| sdague | but ship had sailed | 19:02 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Provide original fault message when BFV fails https://review.openstack.org/467715 | 19:03 |
| *** eharney has quit IRC | 19:04 | |
| tidwellr | sdague: well, it turns out the user has an app that was forcing the UUID to upper case | 19:05 |
| sdague | tidwellr: heh | 19:06 |
| melwitt | there's an app for that | 19:06 |
| sdague | tidwellr: is that changable? | 19:07 |
| sdague | or is it going to be easier for you to patch openstack? | 19:07 |
| tidwellr | sdague: yes, I had them change their app to force everything to lower case and all is right in the world | 19:08 |
| sdague | heh | 19:08 |
| sdague | tidwellr: nice | 19:08 |
| tidwellr | sadgue: it would be nice if that was sanitized by nova, but that's pretty low on my priority list :) | 19:09 |
| sdague | tidwellr: fwiw, this is the mitaka patch that would fix things https://gist.github.com/sdague/863d31d4dba44193c6095b21566cd7fa | 19:09 |
| *** crushil has quit IRC | 19:09 | |
| sdague | tidwellr: it actually came up recently, our uuid validation is much looser than people realized, this is probably another instance of that | 19:09 |
| *** rmart04 has quit IRC | 19:13 | |
| melwitt | be careful with forcing everything to lowercase in clients though, we had a bug a long time ago in novaclient where it tried to lowerc flavor names but they could have been created with mixed case and could cause them not to be found in request cache https://bugs.launchpad.net/python-novaclient/+bug/1446850 | 19:13 |
| openstack | Launchpad bug 1446850 in python-novaclient "flavor-show of mixed case flavorid fails" [High,Fix released] - Assigned to melanie witt (melwitt) | 19:13 |
| mriedem | melwitt: what about mogan indeed http://git.openstack.org/cgit/openstack/mogan/tree/mogan/network/api.py#n120 | 19:14 |
| mriedem | any of that look familiar? | 19:14 |
| tidwellr | sdague: thanks, I'll get a bug filed by EOD | 19:14 |
| *** itlinux has joined #openstack-nova | 19:15 | |
| sdague | tidwellr: cool | 19:15 |
| melwitt | mriedem: yes ... surprised they wanted to use that, heh | 19:15 |
| *** eharney has joined #openstack-nova | 19:17 | |
| mriedem | finding out how to write a unit test for this hide_server_addresses thing is going to be the hard part | 19:17 |
| sdague | mriedem: yeh, you can't use the real test condition, because sqlite goes case sensitive | 19:19 |
| *** gianpietro has joined #openstack-nova | 19:22 | |
| sdague | I don't remember if we ever landed the patch to run real tests with mysql backend for the other case sensitive issues | 19:22 |
| *** tbachman has quit IRC | 19:22 | |
| *** itlinux has quit IRC | 19:23 | |
| *** ckopper has joined #openstack-nova | 19:25 | |
| tidwellr | sdague mriedem: https://bugs.launchpad.net/nova/+bug/1693335 | 19:26 |
| openstack | Launchpad bug 1693335 in OpenStack Compute (nova) "UUID case sensitivity causing unfriendly and unexpected API errors" [Undecided,New] | 19:26 |
| *** thorst has joined #openstack-nova | 19:26 | |
| *** crushil has joined #openstack-nova | 19:28 | |
| mriedem | thanks | 19:29 |
| *** tbachman has joined #openstack-nova | 19:30 | |
| *** thorst has quit IRC | 19:31 | |
| *** slaweq has quit IRC | 19:31 | |
| *** lpetrut has joined #openstack-nova | 19:31 | |
| *** slaweq has joined #openstack-nova | 19:31 | |
| ckopper | Hi! I am new to nova and openstack development, so I apologize in advance if this is the wrong place to ask or if there is a certain procedure for this. I have a local use case for OpenStack where we want to use PCI passthrough for consumer GPUs which works well in principle. However the NVidia driver checks if it is run within a VM and refuses to load for consumer cards if you don't set a certain KVM/qemu flag (`kvm=off`). I have a local patch | 19:33 |
| ckopper | that adds a flavor extra_spec `hw:hide_kvm` to set the correct options through libvirt and was wondering what the correct procedure to get this proposed for upstream was. | 19:33 |
| ckopper | The patch itself is pretty trivial (mostly tests): https://gist.github.com/claudiok/5dd9fd01b9628e35f0b48884471e58cf | 19:33 |
| ckopper | I assume this needs a spec and blueprint and then submission to gerrit for review but I thought I would check here first | 19:34 |
| openstackgerrit | Sean Dague proposed openstack/nova master: WIP: request_id passing to neutron https://review.openstack.org/467242 | 19:34 |
| *** rmart04 has joined #openstack-nova | 19:35 | |
| *** felipemonteiro_ has joined #openstack-nova | 19:36 | |
| *** rmart04 has quit IRC | 19:36 | |
| mriedem | ckopper: lucky for you someone is already working on that https://review.openstack.org/#/c/459753/ | 19:38 |
| *** masayukig has quit IRC | 19:38 | |
| *** abalutoiu_ has joined #openstack-nova | 19:38 | |
| ckopper | Haha - I have to admit I searched for this but apparently missed this review | 19:38 |
| mriedem | sdague: yup, i have a functional test but b/c of sqlite, doing a GET /servers/id with upper-case returns 404 :( | 19:39 |
| *** felipemonteiro has quit IRC | 19:39 | |
| *** mingyu has quit IRC | 19:39 | |
| *** itlinux has joined #openstack-nova | 19:39 | |
| sdague | mriedem: yep | 19:39 |
| *** itlinux has quit IRC | 19:39 | |
| mriedem | so, i'm not sure how to hack this | 19:39 |
| *** slaweq has quit IRC | 19:40 | |
| sdague | so, there is the right way, which is figure out how to be able to run some tests against a mysql backend directly | 19:40 |
| mriedem | i could stub the pull from the db to change the case on what is returned from the db so what's in the cache is different from what's in the request | 19:40 |
| sdague | right, please don't do that | 19:40 |
| sdague | honestly, any energy doing crazy stuff like that should be put into real mysql support in the test suite | 19:41 |
| sdague | the biggest issue was the way the magic oslo.db stuff worked for that iirc | 19:41 |
| mriedem | i'll poke | 19:41 |
| sdague | it's honestly I think better to just ship the patch | 19:41 |
| mriedem | maybe i can just extend test_base.MySQLOpportunisticTestCase | 19:41 |
| sdague | mriedem: there was something weird about that when I tried | 19:41 |
| melwitt | too bad there's not a sqlite pragma for that | 19:42 |
| *** gianpietro has quit IRC | 19:42 | |
| sdague | mriedem: https://review.openstack.org/#/c/283364/ that's a restore of an attempt to go down that path | 19:43 |
| *** abalutoiu has quit IRC | 19:43 | |
| sdague | maybe it was working, but the fix never landed | 19:43 |
| sdague | mriedem: the issue was about tricking engine fascade I think | 19:44 |
| mriedem | trying it | 19:44 |
| sdague | mriedem: anyway, that might be useful to build the pattern from | 19:44 |
| mriedem | which mysql package do we need? | 19:45 |
| mriedem | mysql-server? | 19:45 |
| *** gianpietro has joined #openstack-nova | 19:45 | |
| mriedem | bindep has both the server and client | 19:46 |
| mriedem | but for some reason they fail to install on 16.04 | 19:46 |
| mriedem | ah here we go | 19:46 |
| *** openstackgerrit has quit IRC | 19:48 | |
| ckopper | mriedem: concerning the img_hide_hypervisor_id feature: there one more flag that needs to be set to hide the hypervisor for Windows VMs (not necessary for Linux). (<hyperv><vendor_id state="on" value="FakeID"/></hyperv>). Is this something that should go into a separate patch or would it be appropriate to add this as a comment to the current code review? | 19:49 |
| *** salv-orlando has joined #openstack-nova | 19:49 | |
| ckopper | (thanks again for pointing me to it!) | 19:49 |
| mriedem | ckopper: please comment on the review | 19:49 |
| ckopper | thanks | 19:49 |
| mriedem | sdague: do you remember if you had to do any special creds tweaking with the mysql server or anything locally to get it to connect? | 19:52 |
| mriedem | i thought there was a special userid/password or something | 19:53 |
| *** acormier_ has joined #openstack-nova | 19:53 | |
| mriedem | ah | 19:54 |
| mriedem | For the opportunistic testing you need to set up db's named 'openstack_citest' | 19:54 |
| mriedem | with user 'openstack_citest' and password 'openstack_citest' on localhost. | 19:54 |
| *** lucasxu has quit IRC | 19:55 | |
| *** gianpietro has quit IRC | 19:55 | |
| *** ctrath has quit IRC | 19:55 | |
| sdague | yep, that | 19:55 |
| mriedem | also, tools/test-setup.sh | 19:55 |
| *** awaugama has quit IRC | 19:56 | |
| *** Apoorva has quit IRC | 19:56 | |
| *** lucasxu has joined #openstack-nova | 19:56 | |
| *** acormier has quit IRC | 19:56 | |
| *** gianpietro has joined #openstack-nova | 19:57 | |
| *** itlinux has joined #openstack-nova | 19:57 | |
| cdent | mriedem, sdague, melwitt (whatever other cores are around): this https://review.openstack.org/#/c/456198/ is a fix to tooling used by the placement api-ref that makes the tooling work with multiple inc files instead of just one monolithic file. getting it merged will allow some placement api-ref work to proceed more easily without needing to be in the same stack | 19:58 |
| sdague | +2 | 19:59 |
| cdent | thanks | 19:59 |
| *** gianpietro has quit IRC | 19:59 | |
| *** gianpietro has joined #openstack-nova | 20:00 | |
| *** ctrath has joined #openstack-nova | 20:00 | |
| *** _danpawlik has quit IRC | 20:00 | |
| cdent | thanks melwitt and dansmith | 20:01 |
| dansmith | two +Ws means you skip the gate I think | 20:01 |
| cdent | \o/ | 20:01 |
| melwitt | heh, secret code | 20:01 |
| * dansmith wishes | 20:01 | |
| *** lyan has joined #openstack-nova | 20:02 | |
| *** Apoorva has joined #openstack-nova | 20:03 | |
| *** acormier_ has quit IRC | 20:06 | |
| *** acormier has joined #openstack-nova | 20:06 | |
| mriedem | sdague: EngineFacadeFixture isn't in nova, is that part of your patch series somewhere? | 20:08 |
| mriedem | huh removed here | 20:09 |
| mriedem | https://review.openstack.org/#/c/434843/2 | 20:09 |
| sdague | mriedem: yeh, so I guess there is an oslo.db solution now? | 20:10 |
| mriedem | yeah looking at ReplaceEngineFacadeFixture | 20:10 |
| *** eharney has quit IRC | 20:11 | |
| mriedem | it at least connected to my local mysql server which is progress | 20:12 |
| *** _danpawlik has joined #openstack-nova | 20:13 | |
| *** smatzek has quit IRC | 20:13 | |
| melwitt | dansmith: is this true that online_data_migrations runs in the background after the command exits? someone working on a man page entry https://review.openstack.org/#/c/464634 | 20:15 |
| dansmith | no | 20:15 |
| melwitt | okay, I didn't think so | 20:16 |
| mriedem | there is no scheduling | 20:16 |
| mriedem | or queueing | 20:16 |
| dansmith | which is kinda the point | 20:17 |
| *** openstackgerrit has joined #openstack-nova | 20:18 | |
| openstackgerrit | Kevin Benton proposed openstack/nova master: WIP: Bulk query floating IPs in _nw_info_get_ips https://review.openstack.org/465792 | 20:18 |
| *** itlinux has quit IRC | 20:18 | |
| *** liverpooler has quit IRC | 20:19 | |
| mriedem | i'm lost as to how to use the oslo.db opportunistic test fixture stuff | 20:21 |
| melwitt | this is all I found about it https://specs.openstack.org/openstack/oslo-specs/specs/kilo/long-lived-transactionalized-db-fixtures.html#opportunistic-urls | 20:24 |
| sdague | mriedem: if you put up a partial patch, I might play in the morning | 20:26 |
| mriedem | ok yeah b/c i'm going to have to give up on this soon | 20:27 |
| *** slaweq has joined #openstack-nova | 20:28 | |
| sdague | that's fine, having something to chew on over coffee in the morning is usually useful | 20:28 |
| *** peter-hamilton has quit IRC | 20:30 | |
| *** ayoung has joined #openstack-nova | 20:31 | |
| *** lyan has quit IRC | 20:31 | |
| *** kylek3h_ is now known as kylek3h | 20:36 | |
| *** mingyu has joined #openstack-nova | 20:40 | |
| *** _danpawlik has left #openstack-nova | 20:40 | |
| *** dimtruck is now known as zz_dimtruck | 20:41 | |
| mriedem | zzzeek: i'm strugglying trying to use OpportunisticDBTestMixin to get a mysql-backed test running | 20:42 |
| mriedem | i've got a test extending OpportunisticDBTestMixin and defining FIXTURE = test_fixtures.MySQLOpportunisticFixture | 20:43 |
| zzzeek | mriedem: OK...are there no existing tests using it? | 20:43 |
| mriedem | but teardown complains about not having a schema attribute on the test | 20:43 |
| mriedem | nope | 20:43 |
| mriedem | well, | 20:43 |
| mriedem | our db schema migration tests do some stuff, but i can't make heads or tails of those | 20:43 |
| mriedem | going through the setup code in oslo.db totally gets me lost | 20:44 |
| zzzeek | mriedem: yeah | 20:44 |
| *** mingyu has quit IRC | 20:44 | |
| zzzeek | mriedem: are you mixing in test_fixtures.OpportunisticDBTestMixin, | 20:44 |
| zzzeek | oslo_test_base.BaseTestCase ? | 20:44 |
| mriedem | not the BaseTestCase | 20:44 |
| zzzeek | mriedem: try sticking "SCHEMA_SCOPE=None" on your test class ? | 20:45 |
| mriedem | trying it | 20:46 |
| zzzeek | mriedem: hmmm that's not it | 20:46 |
| zzzeek | mriedem: stack trace ? | 20:46 |
| *** itlinux has joined #openstack-nova | 20:47 | |
| *** ctrath1 has joined #openstack-nova | 20:47 | |
| zzzeek | mriedem: oh. this is all deprecated stuff anyway. you on newish oslo.db ? | 20:48 |
| mriedem | yeah i'm trying to use the fixtures | 20:48 |
| zzzeek | mriedem: e.g. dont need to backport to mitaka ? | 20:48 |
| mriedem | with our nova base TestCase code | 20:48 |
| mriedem | which has it's own DatabaseFixture | 20:48 |
| mriedem | i started copying this https://review.openstack.org/#/c/283364/6/nova/tests/functional/regressions/test_bug_1538011.py but that's extending a deprecated test class in oslo.db | 20:48 |
| *** salv-orlando has quit IRC | 20:49 | |
| zzzeek | mriedem: yeah i was goign to go in there and change it all a while back, a lot of this fixture stuff had nova in mind. | 20:49 |
| *** lucasxu has quit IRC | 20:49 | |
| mriedem | getting this back to where i started and then i can push it up | 20:50 |
| jose-phillips | hey | 20:51 |
| *** ctrath has quit IRC | 20:51 | |
| jose-phillips | someone now how to set a metadata with python novaclient | 20:51 |
| zzzeek | mriedem: yeah i need stack trace to work w/ this here | 20:51 |
| zzzeek | mriedem: need to see where it looks for .schema | 20:51 |
| jose-phillips | should be nova.aggregates.set_metadata (openstackId,metadata) ? | 20:51 |
| zzzeek | mriedem: id guess your fixture is mixing in stuff from your existing fixture stuff ? | 20:51 |
| mriedem | zzzeek: yeah | 20:52 |
| *** tidwellr has quit IRC | 20:52 | |
| *** crushil has quit IRC | 20:52 | |
| mriedem | hmm, maybe this worked for https://review.openstack.org/#/c/283364/6/nova/tests/functional/regressions/test_bug_1538011.py because it wasn't pulling in our TestCase default setup in nova | 20:52 |
| zzzeek | mriedem: you'd need to start totally clean first. i had a plan to totally rewrork nova's fixtures at some point | 20:53 |
| *** crushil has joined #openstack-nova | 20:53 | |
| mriedem | which means i'd have to reinvent some things in my test | 20:53 |
| mriedem | ok yeah | 20:53 |
| mriedem | bummer | 20:53 |
| *** lucasxu has joined #openstack-nova | 20:53 | |
| sdague | zzzeek: is there a way we can get some version we can use with our existing fixture set? | 20:54 |
| zzzeek | sdague: of course | 20:54 |
| sdague | we do have this class of mysql related issues that would be good to have a pattern to write regressions for | 20:55 |
| *** lyan has joined #openstack-nova | 20:55 | |
| zzzeek | sdague: id have to look at it again to see if the base fixture had some patterns that werent' going to work. the main one is that weird way you rebuild the sqlite schema using a dumpfile | 20:55 |
| sdague | zzzeek: yeh, but that isn't used in the NoDBTestCase | 20:55 |
| *** cleong has quit IRC | 20:56 | |
| *** itlinux has quit IRC | 20:57 | |
| zzzeek | sdague: if mriedem wants to give me code I can re-familiarize with everything and what nova looks like today and get his test to run | 20:57 |
| zzzeek | sdague: i had a lot of ideas for fixing nova's DB fixtures and a lot of what is in oslo_db today is based around being able to do that w/ maximum flexibility | 20:58 |
| *** krtaylor has quit IRC | 20:59 | |
| sdague | zzzeek: sure, I don't know where that stands. All I've got is the code I abandoned, that used the old fixture that he linked https://review.openstack.org/#/c/283364/6/nova/tests/functional/regressions/test_bug_1538011.py | 21:00 |
| sdague | the preamble that gets to the point of being able to run migration.db_sync(database='main') | 21:00 |
| sdague | is kind of what needs to be figured out | 21:01 |
| mriedem | i'm close | 21:01 |
| zzzeek | sdague: are these the tests you want to run? | 21:01 |
| mriedem | no | 21:01 |
| mriedem | things have changed quite a bit from that patch | 21:02 |
| sdague | mriedem: ok | 21:02 |
| zzzeek | sdague: the fixture would include GeneratesSchema as a mixin and implement the generate_schema_migrations(engine) method, wher you pass that engine into migration.db_sync(database='main', engine=engine) IIRC how you had that in your test suite already | 21:03 |
| sdague | right, I think the trick was getting the engine allocated | 21:04 |
| zzzeek | sdague: err GeneratesSchemaFromMigrations | 21:04 |
| zzzeek | sdague: yeah this happens in your existing test suite somehwere. or maybe the patch I had included a small tweak to allow it. guess i have to find it | 21:04 |
| *** penick has quit IRC | 21:05 | |
| *** annegentle has quit IRC | 21:05 | |
| zzzeek | sdague mriedem here we are https://review.openstack.org/#/c/349057/ | 21:05 |
| mriedem | heh well i'm getting closer Table 'frkgzoinub.flavors' doesn't exist | 21:06 |
| mriedem | looks like it didn't run the migrations properly | 21:06 |
| sdague | mriedem: you have to run them manually | 21:06 |
| zzzeek | mriedem sdague look at generate_schema_migrations in https://review.openstack.org/#/c/349057/2/nova/tests/fixtures.py | 21:07 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Fix instance lookup in hide_server_addresses extension https://review.openstack.org/467772 | 21:09 |
| mriedem | zzzeek: sdague: ^ is the start | 21:09 |
| *** acormier has quit IRC | 21:10 | |
| *** abalutoiu_ has quit IRC | 21:10 | |
| sdague | mriedem: cool, yeh, that looks kind of what I'd expect | 21:10 |
| *** acormier has joined #openstack-nova | 21:10 | |
| *** abalutoiu_ has joined #openstack-nova | 21:10 | |
| sdague | mriedem: I can play in the morning, I need to start working on dinner here | 21:11 |
| zzzeek | mriedem: I can work on using all the newest patterns in just this one test if you want | 21:12 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Fix live migration devstack hook for multicell environment https://review.openstack.org/458537 | 21:12 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Target cell on local delete https://review.openstack.org/464059 | 21:12 |
| mriedem | zzzeek: that's fine if you want, we'll actually have two db's to sync | 21:14 |
| mriedem | the api db and the main db | 21:14 |
| mriedem | not sure how that's going to work here | 21:14 |
| zzzeek | mriedem: in one test ? | 21:14 |
| mriedem | yeah | 21:15 |
| *** acormier has quit IRC | 21:15 | |
| zzzeek | mriedem: here's why oslo.db is so complicated :) | 21:15 |
| mriedem | https://github.com/openstack/nova/blob/master/nova/test.py#L273 | 21:15 |
| mriedem | that sets up the api db, | 21:15 |
| mriedem | and then 2 cells mappings, which are really 2 dbs | 21:15 |
| mriedem | with the same schema | 21:15 |
| mriedem | so we really have 3 dbs per test | 21:15 |
| mriedem | https://github.com/openstack/nova/blob/master/nova/test.py#L317 | 21:16 |
| openstackgerrit | Matt Rabe proposed openstack/nova master: Query deleted instance records during _destroy_evacuated_instances https://review.openstack.org/467774 | 21:16 |
| zzzeek | mriedem: I shoved dozens of weird nova use cases into this and that...hmm actually I can do that. one fixture per DB | 21:16 |
| *** lucasxu has quit IRC | 21:17 | |
| zzzeek | mriedem: so the test would create three schemas on one MySQL server ? | 21:17 |
| *** zz_dimtruck is now known as dimtruck | 21:17 | |
| zzzeek | err three databases | 21:18 |
| *** salv-orlando has joined #openstack-nova | 21:19 | |
| *** dave-mccowan has quit IRC | 21:20 | |
| *** lyan has quit IRC | 21:20 | |
| mriedem | yeah | 21:23 |
| mriedem | nova_api, nova_cell0 and nova | 21:23 |
| mriedem | schema for the first is 'api' and 'main' for the latter 2 | 21:23 |
| *** priteau has quit IRC | 21:24 | |
| *** salv-orlando has quit IRC | 21:30 | |
| *** avolkov has quit IRC | 21:32 | |
| *** ctrath1 has quit IRC | 21:37 | |
| jose-phillips | someone know | 21:38 |
| jose-phillips | if i can update a metadata from a vm with a post command? | 21:38 |
| jose-phillips | to the metadata address? | 21:38 |
| *** imacdonn has quit IRC | 21:39 | |
| *** imacdonn has joined #openstack-nova | 21:39 | |
| mriedem | update in the config drive? | 21:40 |
| mriedem | config drive is static after you've created the server | 21:40 |
| *** lpetrut has quit IRC | 21:40 | |
| jose-phillips | no i m mean | 21:40 |
| jose-phillips | for example | 21:40 |
| jose-phillips | i want to update a metadata called last-login | 21:40 |
| jose-phillips | the question is if i can perform the update of these metadata from this address http://169.254.169.254/openstack/latest/meta_data.json | 21:41 |
| jose-phillips | on each v | 21:41 |
| jose-phillips | m | 21:41 |
| mriedem | no | 21:41 |
| *** ctrath has joined #openstack-nova | 21:41 | |
| mriedem | metadata API is read-only | 21:41 |
| mriedem | you can change the metadata on the server via the compute REST API | 21:41 |
| mriedem | https://developer.openstack.org/api-ref/compute/#server-metadata-servers-metadata | 21:41 |
| jose-phillips | got it | 21:41 |
| *** ctrath1 has joined #openstack-nova | 21:41 | |
| *** acormier has joined #openstack-nova | 21:42 | |
| jose-phillips | i was thinking if i can doint from there as a post | 21:42 |
| jose-phillips | my idea is track the last time activity on each server | 21:42 |
| jose-phillips | so i will send this information to a intermediate server and this server will going to update the metadata then. | 21:42 |
| jose-phillips | with nova api | 21:43 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Have scheduler claim resources https://review.openstack.org/463993 | 21:45 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Pass the number of hosts to return explicitly https://review.openstack.org/465767 | 21:45 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Remove selecting host based on host_subset_size https://review.openstack.org/465174 | 21:45 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Make the method to put allocations public https://review.openstack.org/464086 | 21:45 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Don't delete allocation if instance being scheduled https://review.openstack.org/460177 | 21:45 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Pass a list of instance UUIDs to scheduler https://review.openstack.org/465171 | 21:45 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Return multiple hosts from select_destinations https://review.openstack.org/465768 | 21:45 |
| *** ctrath has quit IRC | 21:45 | |
| *** ayoung has quit IRC | 21:46 | |
| *** fragatina has joined #openstack-nova | 21:46 | |
| *** thorst has joined #openstack-nova | 21:47 | |
| *** esberglu has quit IRC | 21:50 | |
| *** esberglu has joined #openstack-nova | 21:51 | |
| *** annegentle has joined #openstack-nova | 21:51 | |
| *** takashin has joined #openstack-nova | 21:54 | |
| *** esberglu has quit IRC | 21:55 | |
| *** edmondsw has quit IRC | 21:58 | |
| *** efried has quit IRC | 21:59 | |
| *** acormier has quit IRC | 22:00 | |
| *** acormier has joined #openstack-nova | 22:00 | |
| *** salv-orlando has joined #openstack-nova | 22:01 | |
| *** wasmum has joined #openstack-nova | 22:03 | |
| zzzeek | mriedem: this test case https://review.openstack.org/#/c/467772/1/nova/tests/functional/test_servers.py seems to use just one database right now? I'd need to see how that cell logic relates the UUID to a database, and I'd set up a fixture per-DB which will each make a new anonymous per-test schema | 22:04 |
| *** acormier has quit IRC | 22:05 | |
| zzzeek | mriedem: but...i would need to find some time. let me know if I can just show you around the API and maybe build a less-nova-ish proof of concept | 22:05 |
| *** acormier has joined #openstack-nova | 22:06 | |
| *** baoli has quit IRC | 22:06 | |
| *** salv-orl_ has joined #openstack-nova | 22:07 | |
| *** mdrabe has quit IRC | 22:07 | |
| *** slaweq has quit IRC | 22:08 | |
| *** felipemonteiro_ has quit IRC | 22:08 | |
| *** acormier has quit IRC | 22:10 | |
| *** jamesdenton has quit IRC | 22:11 | |
| *** jbernard has quit IRC | 22:11 | |
| *** salv-orlando has quit IRC | 22:11 | |
| *** karimb has quit IRC | 22:12 | |
| *** crushil has quit IRC | 22:13 | |
| *** crushil has joined #openstack-nova | 22:14 | |
| *** crushil has quit IRC | 22:15 | |
| *** crushil has joined #openstack-nova | 22:15 | |
| *** jbernard has joined #openstack-nova | 22:16 | |
| *** cdent has quit IRC | 22:18 | |
| *** salv-orl_ has quit IRC | 22:19 | |
| *** ckopper has quit IRC | 22:20 | |
| openstackgerrit | Ildiko Vancsa proposed openstack/nova master: WIP/POC Implement new attach Cinder flow https://review.openstack.org/330285 | 22:22 |
| *** thorst has quit IRC | 22:23 | |
| *** Swami has quit IRC | 22:23 | |
| *** dikonoor has joined #openstack-nova | 22:23 | |
| *** marst_ has quit IRC | 22:23 | |
| *** marst_ has joined #openstack-nova | 22:24 | |
| *** annegentle has quit IRC | 22:24 | |
| *** dikonoo has joined #openstack-nova | 22:27 | |
| *** ctrath has joined #openstack-nova | 22:28 | |
| *** ijw has quit IRC | 22:28 | |
| *** mingyu has joined #openstack-nova | 22:28 | |
| *** marst_ has quit IRC | 22:29 | |
| *** ctrath1 has quit IRC | 22:29 | |
| *** pchavva has quit IRC | 22:29 | |
| *** dikonoor has quit IRC | 22:30 | |
| *** jwcroppe has quit IRC | 22:31 | |
| *** gouthamr has quit IRC | 22:32 | |
| *** mingyu has quit IRC | 22:32 | |
| *** gianpietro has quit IRC | 22:33 | |
| *** gianpietro has joined #openstack-nova | 22:34 | |
| *** esberglu has joined #openstack-nova | 22:36 | |
| *** gianpietro has quit IRC | 22:37 | |
| *** gianpiet_ has joined #openstack-nova | 22:37 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(1/2) https://review.openstack.org/408955 | 22:37 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(2/2) https://review.openstack.org/408964 | 22:39 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Add functional tests for cold migration to same host https://review.openstack.org/414926 | 22:40 |
| openstackgerrit | Takashi NATSUME proposed openstack/python-novaclient master: Microversion 2.46 - Enable cold migration with target host https://review.openstack.org/406707 | 22:40 |
| *** esberglu has quit IRC | 22:40 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Add parameters in cold migrate action https://review.openstack.org/410042 | 22:40 |
| *** ctrath has quit IRC | 22:43 | |
| *** itlinux has joined #openstack-nova | 22:45 | |
| *** krtaylor has joined #openstack-nova | 22:49 | |
| *** acormier has joined #openstack-nova | 22:51 | |
| *** ijw has joined #openstack-nova | 22:51 | |
| *** hamzy has quit IRC | 22:53 | |
| *** ijw has quit IRC | 22:56 | |
| *** gouthamr has joined #openstack-nova | 23:04 | |
| *** ijw has joined #openstack-nova | 23:05 | |
| *** ijw has quit IRC | 23:06 | |
| *** ijw has joined #openstack-nova | 23:08 | |
| *** ijw has quit IRC | 23:08 | |
| *** ijw has joined #openstack-nova | 23:09 | |
| *** itlinux has quit IRC | 23:11 | |
| *** sdague has quit IRC | 23:17 | |
| *** jwcroppe has joined #openstack-nova | 23:20 | |
| *** acormier has quit IRC | 23:28 | |
| *** jaypipes has quit IRC | 23:31 | |
| *** edmondsw has joined #openstack-nova | 23:32 | |
| *** Apoorva_ has joined #openstack-nova | 23:36 | |
| *** pchavva has joined #openstack-nova | 23:36 | |
| openstackgerrit | Claudiu Belu proposed openstack/nova master: POC: tests: autospecs all the mock.patch usages https://review.openstack.org/447505 | 23:36 |
| *** edmondsw has quit IRC | 23:36 | |
| *** acormier has joined #openstack-nova | 23:37 | |
| *** acormier has joined #openstack-nova | 23:37 | |
| *** Apoorva has quit IRC | 23:39 | |
| *** jwcroppe has quit IRC | 23:40 | |
| *** jwcroppe has joined #openstack-nova | 23:40 | |
| *** Apoorva_ has quit IRC | 23:40 | |
| *** salv-orlando has joined #openstack-nova | 23:41 | |
| *** mriedem1 has joined #openstack-nova | 23:44 | |
| *** mriedem1 has quit IRC | 23:45 | |
| *** mriedem has quit IRC | 23:45 | |
| *** mriedem has joined #openstack-nova | 23:45 | |
| *** mtanino_ has quit IRC | 23:47 | |
| mriedem | zzzeek: it would eventually need to use at least the nova_api db and the nova (cell) db | 23:47 |
| mriedem | the instance is going to live in the cell db | 23:48 |
| mriedem | i'm not starting enough services for the actual instance create to work yet, | 23:48 |
| mriedem | but it seems the schema migrations aren't getting run anyway because when i try to create/start the services, like nova-api, it's blowing up because the services table doesn't exist yet | 23:48 |
| *** fragatina has quit IRC | 23:48 | |
| *** yamahata has joined #openstack-nova | 23:51 | |
| mriedem | i'm getting a little further, if i sync the 'main' db i can start services, but w/o syncing the api db i don't have flavors to create a server | 23:53 |
| mriedem | trying to sync the api db fails with http://paste.openstack.org/show/610607/ | 23:53 |
| mriedem | i assume b/c i'm using the wrong engine | 23:53 |
| *** salv-orlando has quit IRC | 23:54 | |
| gmann | mriedem: yea, that was hide server address cfg and policy deprecation things which i will be pushing spec for that | 23:55 |
| gmann | mriedem: got the issues with instance id. | 23:56 |
| *** ijw has quit IRC | 23:56 | |
| gmann | alex_xu: thanks for help. i will push doc and other things | 23:56 |
| mriedem | gmann: working on that here https://review.openstack.org/#/c/467772/ | 23:56 |
| *** lyan has joined #openstack-nova | 23:56 | |
| mriedem | the code fix for this bug is easy, but we're trying to write a functional test to recreate it using mysql as the backend | 23:57 |
| *** mingyu has joined #openstack-nova | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!