*** takashin has joined #openstack-nova | 00:00 | |
*** Apoorva has quit IRC | 00:01 | |
*** Apoorva has joined #openstack-nova | 00:04 | |
*** Apoorva has quit IRC | 00:06 | |
*** ijw has quit IRC | 00:06 | |
*** ijw has joined #openstack-nova | 00:06 | |
*** Apoorva has joined #openstack-nova | 00:10 | |
*** Apoorva has quit IRC | 00:14 | |
*** ijw has quit IRC | 00:20 | |
*** thorst has quit IRC | 00:25 | |
*** ijw has joined #openstack-nova | 00:41 | |
mriedem | dansmith: the claims in scheduler spec is close https://review.openstack.org/#/c/437424/ - i've posted some ideas on how to handle the issue with the overhead estimates coming from the virt driver which are used in the claim, and which we won't have in the controller layer | 00:42 |
---|---|---|
*** lyan has quit IRC | 00:42 | |
*** david-lyle has joined #openstack-nova | 00:44 | |
*** amotoki has quit IRC | 00:45 | |
*** gjayavelu has joined #openstack-nova | 00:46 | |
*** amotoki has joined #openstack-nova | 00:50 | |
*** johnsom has quit IRC | 00:53 | |
*** johnsom has joined #openstack-nova | 00:53 | |
*** vladikr has joined #openstack-nova | 00:53 | |
*** morgabra has quit IRC | 00:54 | |
*** morgabra has joined #openstack-nova | 00:57 | |
*** amotoki has quit IRC | 00:59 | |
*** liusheng has quit IRC | 01:00 | |
*** gyee has quit IRC | 01:01 | |
*** crushil has joined #openstack-nova | 01:02 | |
*** nic has quit IRC | 01:03 | |
*** phuongnh has joined #openstack-nova | 01:03 | |
*** cNilesh has joined #openstack-nova | 01:04 | |
*** NikhilS has joined #openstack-nova | 01:06 | |
*** kevinz has joined #openstack-nova | 01:06 | |
*** mriedem has quit IRC | 01:08 | |
*** Apoorva has joined #openstack-nova | 01:08 | |
*** ijw has quit IRC | 01:09 | |
*** amotoki has joined #openstack-nova | 01:14 | |
*** Sukhdev has quit IRC | 01:19 | |
*** gus has quit IRC | 01:23 | |
*** gus has joined #openstack-nova | 01:26 | |
*** Apoorva_ has joined #openstack-nova | 01:27 | |
openstackgerrit | STEW TY proposed openstack/nova master: Transform instance.unrescue notifications https://review.openstack.org/388275 | 01:28 |
*** Kevin_Zheng has joined #openstack-nova | 01:31 | |
*** Apoorva has quit IRC | 01:31 | |
*** iceyao has joined #openstack-nova | 01:31 | |
*** Apoorva_ has quit IRC | 01:32 | |
*** Jack_Iv has joined #openstack-nova | 01:38 | |
*** Guest86170 has quit IRC | 01:40 | |
*** Guest86170 has joined #openstack-nova | 01:42 | |
*** dtp has quit IRC | 01:42 | |
*** Jack_Iv has quit IRC | 01:43 | |
*** gjayavelu has quit IRC | 01:44 | |
*** iceyao has quit IRC | 01:45 | |
*** ngupta has joined #openstack-nova | 01:47 | |
*** tbachman has quit IRC | 01:48 | |
*** Sukhdev has joined #openstack-nova | 01:48 | |
*** Sukhdev has quit IRC | 01:51 | |
*** stvnoyes has joined #openstack-nova | 01:53 | |
*** gongysh has joined #openstack-nova | 01:54 | |
*** thorst has joined #openstack-nova | 02:00 | |
*** iceyao has joined #openstack-nova | 02:01 | |
*** ssurana has quit IRC | 02:03 | |
*** takashin has quit IRC | 02:04 | |
*** Shunli has joined #openstack-nova | 02:05 | |
*** ociuhandu has quit IRC | 02:06 | |
*** yongjiexu has joined #openstack-nova | 02:06 | |
*** fragatin_ has joined #openstack-nova | 02:11 | |
*** fragatina has quit IRC | 02:14 | |
*** fragatin_ has quit IRC | 02:15 | |
*** thorst has quit IRC | 02:16 | |
*** hongbin has joined #openstack-nova | 02:16 | |
*** fragatina has joined #openstack-nova | 02:17 | |
*** yamahata has quit IRC | 02:17 | |
Kevin_Zheng | mriedem: Hi, I replied on https://bugs.launchpad.net/nova/+bug/1645175 | 02:18 |
openstack | Launchpad bug 1645175 in OpenStack Compute (nova) "Neutron port got deleted when attach interface failed" [Medium,In progress] - Assigned to Matt Riedemann (mriedem) | 02:18 |
*** fragatina has quit IRC | 02:21 | |
*** liusheng has joined #openstack-nova | 02:32 | |
*** ngupta has quit IRC | 02:32 | |
*** ngupta has joined #openstack-nova | 02:33 | |
*** amotoki has quit IRC | 02:35 | |
*** ociuhandu has joined #openstack-nova | 02:36 | |
*** ngupta has quit IRC | 02:37 | |
openstackgerrit | ZhaoBo proposed openstack/nova master: [WIP]Less neutron call in build_nw_info https://review.openstack.org/457845 | 02:40 |
*** dave-mccowan has quit IRC | 02:47 | |
openstackgerrit | Huan Xie proposed openstack/nova master: WIP: XenAPI use os-xenapi V2 in nova https://review.openstack.org/453493 | 02:48 |
*** dharinic has joined #openstack-nova | 02:48 | |
*** amotoki has joined #openstack-nova | 02:50 | |
openstackgerrit | Huan Xie proposed openstack/nova master: WIP: XenAPI use os-xenapi V2 in nova https://review.openstack.org/453493 | 02:57 |
openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Support tag instances when boot https://review.openstack.org/394321 | 03:03 |
*** yongjiexu has quit IRC | 03:06 | |
*** ducnc has quit IRC | 03:06 | |
*** ducnc1 has joined #openstack-nova | 03:07 | |
*** dharinic has quit IRC | 03:07 | |
*** yongjiexu has joined #openstack-nova | 03:08 | |
*** kfarr has quit IRC | 03:08 | |
*** ducnc1 is now known as ducnc | 03:09 | |
*** iceyao has quit IRC | 03:10 | |
*** phuongnh has quit IRC | 03:10 | |
*** MasterOfBugs has quit IRC | 03:11 | |
*** thorst has joined #openstack-nova | 03:13 | |
*** amotoki has quit IRC | 03:15 | |
*** ngupta has joined #openstack-nova | 03:17 | |
*** links has joined #openstack-nova | 03:19 | |
*** kencjohnston_ has quit IRC | 03:19 | |
*** kencjohnston has joined #openstack-nova | 03:19 | |
*** hongbin has quit IRC | 03:20 | |
*** jerrygb has joined #openstack-nova | 03:21 | |
*** imacdonn has quit IRC | 03:28 | |
*** gjayavelu has joined #openstack-nova | 03:28 | |
*** imacdonn has joined #openstack-nova | 03:28 | |
*** ngupta has quit IRC | 03:28 | |
*** ngupta has joined #openstack-nova | 03:29 | |
*** ngupta has quit IRC | 03:31 | |
*** ngupta has joined #openstack-nova | 03:32 | |
*** gouthamr has quit IRC | 03:32 | |
*** thorst has quit IRC | 03:32 | |
*** amotoki has joined #openstack-nova | 03:35 | |
*** ngupta has quit IRC | 03:36 | |
*** iceyao has joined #openstack-nova | 03:37 | |
*** lifeless has quit IRC | 03:38 | |
*** mdrabe has joined #openstack-nova | 03:40 | |
*** crushil has quit IRC | 03:41 | |
*** iceyao has quit IRC | 03:42 | |
*** hieulq_ has joined #openstack-nova | 03:42 | |
*** mdrabe has quit IRC | 03:44 | |
*** lifeless has joined #openstack-nova | 03:46 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove unused os-pci API https://review.openstack.org/457854 | 03:49 |
*** nicolasbock has quit IRC | 03:51 | |
openstackgerrit | Huan Xie proposed openstack/nova master: WIP: XenAPI use os-xenapi v2 in nova https://review.openstack.org/453493 | 03:51 |
*** baoli has quit IRC | 03:53 | |
*** bmace has quit IRC | 03:54 | |
*** ducnc1 has joined #openstack-nova | 03:56 | |
openstackgerrit | melanie witt proposed openstack/nova master: Add FixedIP.get_count_by_project() https://review.openstack.org/446246 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Add FloatingIP.get_count_by_project() https://review.openstack.org/446247 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Add get_count_by_vm_state() to Instance object https://review.openstack.org/446244 | 03:56 |
*** gongysh has quit IRC | 03:56 | |
openstackgerrit | melanie witt proposed openstack/nova master: Add SecurityGroup.get_counts() https://review.openstack.org/446245 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Remove 'reserved' count from used limits https://review.openstack.org/446242 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Remove useless quota_usage_refresh from nova-manage https://review.openstack.org/446243 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Count server groups to check quota https://review.openstack.org/446240 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Count networks to check quota https://review.openstack.org/446241 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Add check_deltas() and limit_check_project_and_user() to Quotas https://review.openstack.org/446239 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Count instances to check quota https://review.openstack.org/416521 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Make Quotas object favor the API database https://review.openstack.org/410945 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Add online migration to move quotas to API database https://review.openstack.org/410946 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Add InstanceGroup.get_counts() https://review.openstack.org/457857 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Add InstanceGroup._remove_members_in_db https://review.openstack.org/457858 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Count server group members to check quota https://review.openstack.org/457859 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Count security groups to check quota https://review.openstack.org/457860 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Count fixed ips for checking quota https://review.openstack.org/457861 | 03:56 |
openstackgerrit | melanie witt proposed openstack/nova master: Count floating ips to check quota https://review.openstack.org/457862 | 03:56 |
*** ducnc has quit IRC | 03:56 | |
*** ducnc1 is now known as ducnc | 03:56 | |
*** amotoki_ has joined #openstack-nova | 03:58 | |
*** amotoki has quit IRC | 04:00 | |
*** takashin has joined #openstack-nova | 04:00 | |
*** Sukhdev has joined #openstack-nova | 04:04 | |
*** takashin has left #openstack-nova | 04:05 | |
*** takashin has joined #openstack-nova | 04:06 | |
*** amotoki_ has quit IRC | 04:06 | |
*** phuongnh has joined #openstack-nova | 04:09 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(1/2) https://review.openstack.org/408955 | 04:10 |
*** vks1 has joined #openstack-nova | 04:11 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(2/2) https://review.openstack.org/408964 | 04:11 |
openstackgerrit | Takashi NATSUME proposed openstack/python-novaclient master: Microversion 2.42 - Fix tag attribute disappearing https://review.openstack.org/429512 | 04:12 |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Add parameters in cold migrate action https://review.openstack.org/410042 | 04:13 |
*** amotoki has joined #openstack-nova | 04:19 | |
*** slaweq has joined #openstack-nova | 04:20 | |
*** trinaths has joined #openstack-nova | 04:20 | |
*** iceyao has joined #openstack-nova | 04:21 | |
*** tbachman has joined #openstack-nova | 04:22 | |
*** salv-orlando has joined #openstack-nova | 04:23 | |
*** slaweq has quit IRC | 04:25 | |
*** fragatina has joined #openstack-nova | 04:26 | |
*** iceyao has quit IRC | 04:26 | |
*** adisky_ has joined #openstack-nova | 04:26 | |
*** salv-orlando has quit IRC | 04:28 | |
*** fragatina has quit IRC | 04:29 | |
*** fragatina has joined #openstack-nova | 04:30 | |
*** diga has joined #openstack-nova | 04:34 | |
*** links has quit IRC | 04:36 | |
*** sridharg has joined #openstack-nova | 04:36 | |
*** moshele has joined #openstack-nova | 04:36 | |
*** moshele has quit IRC | 04:39 | |
*** sudipto has joined #openstack-nova | 04:39 | |
*** moshele has joined #openstack-nova | 04:39 | |
*** hieulq_ has quit IRC | 04:40 | |
*** ayogi has joined #openstack-nova | 04:42 | |
*** jianghuaw has quit IRC | 04:44 | |
*** jianghuaw has joined #openstack-nova | 04:45 | |
*** links has joined #openstack-nova | 04:53 | |
*** ratailor has joined #openstack-nova | 04:53 | |
*** baoli has joined #openstack-nova | 04:54 | |
*** bkopilov has joined #openstack-nova | 04:54 | |
*** salv-orlando has joined #openstack-nova | 04:56 | |
*** moshele has quit IRC | 04:57 | |
*** hieulq_ has joined #openstack-nova | 04:57 | |
*** moshele has joined #openstack-nova | 04:57 | |
*** hieulq_ has quit IRC | 04:58 | |
*** baoli has quit IRC | 04:59 | |
*** yongjiexu has quit IRC | 04:59 | |
*** bkopilov has quit IRC | 04:59 | |
*** bkopilov has joined #openstack-nova | 05:00 | |
*** mdnadeem has joined #openstack-nova | 05:00 | |
*** gongysh has joined #openstack-nova | 05:01 | |
*** iceyao has joined #openstack-nova | 05:01 | |
*** bkopilov has quit IRC | 05:02 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Add functional tests for cold migration to same host https://review.openstack.org/414926 | 05:03 |
*** bkopilov has joined #openstack-nova | 05:04 | |
*** udesale has joined #openstack-nova | 05:04 | |
*** iceyao has quit IRC | 05:06 | |
*** tbachman has quit IRC | 05:08 | |
*** tojuvone has quit IRC | 05:14 | |
*** yamahata has joined #openstack-nova | 05:15 | |
*** tbachman has joined #openstack-nova | 05:17 | |
*** Jack_Iv has joined #openstack-nova | 05:20 | |
*** ijw has joined #openstack-nova | 05:23 | |
*** amotoki_ has joined #openstack-nova | 05:23 | |
*** yingwei has joined #openstack-nova | 05:24 | |
*** links has quit IRC | 05:25 | |
*** jerrygb has quit IRC | 05:25 | |
*** tovin07_ has joined #openstack-nova | 05:26 | |
*** amotoki has quit IRC | 05:26 | |
*** ltomasbo|away is now known as ltomasbo | 05:26 | |
*** Jack_Iv has quit IRC | 05:28 | |
openstackgerrit | Maho Koshiya proposed openstack/nova master: Add interfaces functional negative tests https://review.openstack.org/442892 | 05:29 |
*** thorst has joined #openstack-nova | 05:29 | |
*** markvoelker has quit IRC | 05:29 | |
*** Jack_Iv has joined #openstack-nova | 05:29 | |
*** coreywright has quit IRC | 05:32 | |
*** nmathew has joined #openstack-nova | 05:36 | |
*** links has joined #openstack-nova | 05:37 | |
openstackgerrit | melanie witt proposed openstack/nova master: Add FixedIP.get_count_by_project() https://review.openstack.org/446246 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Add FloatingIP.get_count_by_project() https://review.openstack.org/446247 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Add get_count_by_vm_state() to Instance object https://review.openstack.org/446244 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Add SecurityGroup.get_counts() https://review.openstack.org/446245 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Remove 'reserved' count from used limits https://review.openstack.org/446242 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Remove useless quota_usage_refresh from nova-manage https://review.openstack.org/446243 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Count server groups to check quota https://review.openstack.org/446240 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Count networks to check quota https://review.openstack.org/446241 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Count instances to check quota https://review.openstack.org/416521 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Add InstanceGroup.get_counts() https://review.openstack.org/457857 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Add InstanceGroup._remove_members_in_db https://review.openstack.org/457858 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Count server group members to check quota https://review.openstack.org/457859 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Count security groups to check quota https://review.openstack.org/457860 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Count fixed ips for checking quota https://review.openstack.org/457861 | 05:38 |
openstackgerrit | melanie witt proposed openstack/nova master: Count floating ips to check quota https://review.openstack.org/457862 | 05:38 |
*** omkar_telee has joined #openstack-nova | 05:38 | |
omkar_telee | Hi, facing weird issue with nova conductor | 05:40 |
omkar_telee | ERROR nova.servicegroup.drivers.db DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: u'UPDATE services SET updated_at=%(updated_at)s, report_count=%(report_count)s, last_seen_up=%(last_seen_up)s WHERE services.id = %(services_id)s'] [parameters: {'last_seen_up': datetime.datetime(2017, 4, 19, 5, 38, 13, 911802), 'services_id': 34, 'updated_at': datetime.datetime(2017, 4, 19, 5, 38, | 05:40 |
omkar_telee | 13, 912601), 'report_count': 1776936}] | 05:40 |
*** ekuris has joined #openstack-nova | 05:41 | |
*** zhurong has joined #openstack-nova | 05:42 | |
*** slaweq has joined #openstack-nova | 05:42 | |
*** iceyao has joined #openstack-nova | 05:46 | |
*** armax has quit IRC | 05:48 | |
*** thorst has quit IRC | 05:48 | |
*** prateek has joined #openstack-nova | 05:48 | |
*** moshele has quit IRC | 05:50 | |
*** iceyao has quit IRC | 05:51 | |
*** karthiks has joined #openstack-nova | 05:52 | |
*** baoli has joined #openstack-nova | 05:55 | |
*** moshele has joined #openstack-nova | 06:03 | |
*** salv-orlando has quit IRC | 06:04 | |
*** baoli has quit IRC | 06:06 | |
*** rcernin has joined #openstack-nova | 06:08 | |
*** moshele has quit IRC | 06:10 | |
*** zenoway has joined #openstack-nova | 06:13 | |
*** zenoway has quit IRC | 06:16 | |
*** zenoway has joined #openstack-nova | 06:16 | |
*** zenoway has quit IRC | 06:19 | |
*** ijw has quit IRC | 06:19 | |
*** moshele has joined #openstack-nova | 06:24 | |
*** voelzmo has joined #openstack-nova | 06:25 | |
*** zenoway has joined #openstack-nova | 06:27 | |
*** iceyao has joined #openstack-nova | 06:28 | |
*** markvoelker has joined #openstack-nova | 06:29 | |
*** markus_z has joined #openstack-nova | 06:30 | |
openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Support tag instances when boot https://review.openstack.org/394321 | 06:32 |
*** pcaruana has joined #openstack-nova | 06:33 | |
*** iceyao has quit IRC | 06:33 | |
*** markvoelker has quit IRC | 06:35 | |
*** tojuvone has joined #openstack-nova | 06:39 | |
openstackgerrit | Ritesh proposed openstack/nova master: Add image flatten when unshelve rbd image backend https://review.openstack.org/457886 | 06:41 |
*** tbachman has quit IRC | 06:43 | |
*** ralonsoh has joined #openstack-nova | 06:44 | |
*** thorst has joined #openstack-nova | 06:45 | |
*** nmathew- has joined #openstack-nova | 06:47 | |
*** thorst has quit IRC | 06:49 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Update doc/source/process.rst https://review.openstack.org/457888 | 06:50 |
*** zenoway has quit IRC | 06:50 | |
*** nmathew has quit IRC | 06:51 | |
*** zenoway has joined #openstack-nova | 06:53 | |
*** jaosorior has joined #openstack-nova | 06:53 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Add functional tests for cold migration to same host https://review.openstack.org/414926 | 06:54 |
*** Jack_Iv has quit IRC | 06:55 | |
*** Jack_Iv has joined #openstack-nova | 07:00 | |
*** winston-d_ has joined #openstack-nova | 07:00 | |
*** Sukhdev has quit IRC | 07:01 | |
*** tesseract has joined #openstack-nova | 07:01 | |
*** MasterOfBugs has joined #openstack-nova | 07:03 | |
*** sridharg has quit IRC | 07:03 | |
*** yamahata has quit IRC | 07:03 | |
*** belmoreira has joined #openstack-nova | 07:04 | |
*** iceyao has joined #openstack-nova | 07:12 | |
*** tovin07 has joined #openstack-nova | 07:12 | |
*** damien_r has joined #openstack-nova | 07:13 | |
openstackgerrit | Dinesh Bhor proposed openstack/nova master: Limits the scheduler_hints additionalProperties to string and list https://review.openstack.org/457890 | 07:13 |
*** Jack_Iv has quit IRC | 07:15 | |
*** ijw has joined #openstack-nova | 07:17 | |
*** salv-orlando has joined #openstack-nova | 07:17 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Avoid forcing translation on logging calls https://review.openstack.org/413876 | 07:19 |
*** faizy has joined #openstack-nova | 07:20 | |
*** ijw has quit IRC | 07:22 | |
*** Jack_Iv has joined #openstack-nova | 07:25 | |
*** trinaths is now known as trinaths_at_lunc | 07:26 | |
*** trinaths_at_lunc is now known as trinaths_lunch | 07:26 | |
*** markvoelker has joined #openstack-nova | 07:30 | |
*** sridharg has joined #openstack-nova | 07:34 | |
*** markvoelker has quit IRC | 07:35 | |
*** jpena|off is now known as jpena | 07:37 | |
*** baoli has joined #openstack-nova | 07:37 | |
rpodolyaka | omkar_telee: it may happen when a mysql server is restarted or a galera cluster configuration is changed | 07:39 |
*** baoli has quit IRC | 07:42 | |
*** zsli_ has joined #openstack-nova | 07:43 | |
*** ratailor is now known as ratailor|Lunch | 07:45 | |
*** thorst has joined #openstack-nova | 07:46 | |
*** Shunli has quit IRC | 07:46 | |
*** Jack_Iv has quit IRC | 07:47 | |
*** omkar_telee has quit IRC | 07:49 | |
*** trinaths_lunch is now known as trinaths | 07:50 | |
*** Jack_Iv has joined #openstack-nova | 07:50 | |
*** Jack_Iv has quit IRC | 07:50 | |
*** thorst has quit IRC | 07:50 | |
*** jerrygb has joined #openstack-nova | 07:55 | |
*** iceyao has quit IRC | 07:56 | |
*** trinaths has left #openstack-nova | 07:57 | |
*** zzzeek has quit IRC | 08:00 | |
*** jerrygb has quit IRC | 08:00 | |
*** gabor_antal_ has quit IRC | 08:01 | |
*** zzzeek has joined #openstack-nova | 08:01 | |
*** omkar_telee has joined #openstack-nova | 08:03 | |
*** ducnc has quit IRC | 08:06 | |
omkar_telee | rpodolyaka : Thanks for input .. can u give me some directions to resolve this issue, | 08:07 |
*** lucas-afk is now known as lucasagomes | 08:07 | |
omkar_telee | we have galera cluster .. .many queries i can see are in ' wsrep in pre-commit stage ' | 08:08 |
omkar_telee | nova conductor, cinder and neutron are continuously sending simillar error is constantly | 08:09 |
rpodolyaka | omkar_telee: I'd start from mysql logs. look for the signs of errors or warnings | 08:09 |
rpodolyaka | omkar_telee: and check whether all cluster members have a consistent view of the galera cluster | 08:09 |
rpodolyaka | (i.e. they all see the same set of nodes in the cluster) | 08:10 |
omkar_telee | Mysql logs : WSREP: Failed to report last committed - (Interrupted system call) | 08:10 |
*** karimb has joined #openstack-nova | 08:10 | |
omkar_telee | WSREP: referenced FK check fail: 35WSREP: referenced FK check fail: | 08:11 |
omkar_telee | i am not a database guy :( | 08:11 |
*** carthaca_ has joined #openstack-nova | 08:12 | |
rpodolyaka | omkar_telee: hmm, I haven't seen this problem before. According to https://www.percona.com/blog/2016/05/27/galera-error-failed-to-report-last-committed-interrupted-system-call/ it's just warning, though... | 08:14 |
omkar_telee | rpodolyaka : yes, thats why I am little confused | 08:15 |
*** coreywright has joined #openstack-nova | 08:15 | |
*** takashin has left #openstack-nova | 08:18 | |
omkar_telee | rpodolyaka : we can see galera cluster status OK .. | 08:18 |
*** ijw has joined #openstack-nova | 08:19 | |
rpodolyaka | omkar_telee: http://galeracluster.com/documentation-webpages/monitoringthecluster.html#checking-cluster-integrity | 08:19 |
rpodolyaka | omkar_telee: check that all the nodes are the part of the same cluster | 08:19 |
omkar_telee | rpodoyaka : just on same page ... checked all commands... all look normal .. | 08:20 |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove redundant code https://review.openstack.org/457917 | 08:21 |
rpodolyaka | omkar_telee: and do you use pacemaker, maybe? it may restart the nodes | 08:21 |
omkar_telee | yes, we use pacemaker | 08:21 |
*** amotoki_ has quit IRC | 08:22 | |
*** hferenc has quit IRC | 08:22 | |
*** gjayavelu has quit IRC | 08:23 | |
*** ijw has quit IRC | 08:24 | |
*** derekh has joined #openstack-nova | 08:25 | |
*** Jack_Iv has joined #openstack-nova | 08:25 | |
*** mvk has quit IRC | 08:26 | |
omkar_telee | rpodolyaka : no, we dont use pacemaker | 08:26 |
omkar_telee | its just haproxy and vip | 08:26 |
*** efoley has joined #openstack-nova | 08:27 | |
*** efoley_ has joined #openstack-nova | 08:27 | |
*** efoley_ has quit IRC | 08:27 | |
*** aloga has quit IRC | 08:34 | |
*** aloga has joined #openstack-nova | 08:35 | |
*** zenoway has quit IRC | 08:36 | |
*** MasterOfBugs has quit IRC | 08:37 | |
*** baoli has joined #openstack-nova | 08:38 | |
*** tuan_luong has joined #openstack-nova | 08:39 | |
*** baoli has quit IRC | 08:43 | |
*** peter-hamilton has quit IRC | 08:47 | |
*** thorst has joined #openstack-nova | 08:47 | |
*** moshele has quit IRC | 08:50 | |
*** thorst has quit IRC | 08:52 | |
*** moshele has joined #openstack-nova | 08:52 | |
*** sambetts|afk is now known as sambetts | 08:52 | |
openstackgerrit | Stephen Finucane proposed openstack/python-novaclient master: Explicitly set 'builders' option https://review.openstack.org/457929 | 08:54 |
openstackgerrit | Stephen Finucane proposed openstack/python-novaclient master: doc: Remove cruft from conf.py https://review.openstack.org/457930 | 08:54 |
*** moshele has quit IRC | 08:55 | |
*** mvk has joined #openstack-nova | 08:56 | |
*** tuan_luong has quit IRC | 08:57 | |
*** sree has joined #openstack-nova | 09:00 | |
*** tuan_luong has joined #openstack-nova | 09:02 | |
*** tuan_luong has quit IRC | 09:04 | |
*** ratailor|Lunch is now known as ratailor | 09:05 | |
*** tuan_luong has joined #openstack-nova | 09:06 | |
*** cdent has joined #openstack-nova | 09:08 | |
*** moshele has joined #openstack-nova | 09:08 | |
*** slaweq has quit IRC | 09:09 | |
*** slaweq has joined #openstack-nova | 09:09 | |
*** moshele has quit IRC | 09:10 | |
*** tuan_luong has quit IRC | 09:10 | |
*** mvk has quit IRC | 09:12 | |
*** ociuhandu has quit IRC | 09:12 | |
*** zenoway has joined #openstack-nova | 09:15 | |
*** rmart04 has joined #openstack-nova | 09:16 | |
*** slaweq has quit IRC | 09:16 | |
*** slaweq has joined #openstack-nova | 09:17 | |
*** slaweq has quit IRC | 09:17 | |
*** slaweq has joined #openstack-nova | 09:17 | |
*** ijw has joined #openstack-nova | 09:20 | |
*** fragatin_ has joined #openstack-nova | 09:20 | |
*** fragatina has quit IRC | 09:22 | |
*** thomasem has quit IRC | 09:22 | |
*** thomasem has joined #openstack-nova | 09:23 | |
*** mvk has joined #openstack-nova | 09:23 | |
*** ijw has quit IRC | 09:26 | |
*** zsli_ has quit IRC | 09:27 | |
*** amotoki has joined #openstack-nova | 09:29 | |
*** udesale__ has joined #openstack-nova | 09:30 | |
*** moshele has joined #openstack-nova | 09:31 | |
*** djohnsto has joined #openstack-nova | 09:32 | |
*** udesale has quit IRC | 09:33 | |
*** tuan_luong has joined #openstack-nova | 09:33 | |
*** moshele has quit IRC | 09:37 | |
*** zenoway has quit IRC | 09:38 | |
*** tuan_luong has quit IRC | 09:38 | |
*** zenoway has joined #openstack-nova | 09:38 | |
*** mnestratov has joined #openstack-nova | 09:38 | |
*** baoli has joined #openstack-nova | 09:39 | |
*** moshele has joined #openstack-nova | 09:39 | |
*** prateek_ has joined #openstack-nova | 09:40 | |
*** prateek_ has quit IRC | 09:41 | |
*** prateek_ has joined #openstack-nova | 09:41 | |
*** prateek has quit IRC | 09:42 | |
*** baoli has quit IRC | 09:43 | |
*** aarefiev_afk is now known as aarefiev | 09:45 | |
*** amotoki has quit IRC | 09:45 | |
*** thorst has joined #openstack-nova | 09:47 | |
*** salv-orl_ has joined #openstack-nova | 09:48 | |
*** ociuhandu has joined #openstack-nova | 09:48 | |
*** Jack_Iv has quit IRC | 09:50 | |
*** salv-orlando has quit IRC | 09:51 | |
*** thorst has quit IRC | 09:52 | |
*** Jack_Iv has joined #openstack-nova | 09:53 | |
*** tuan_luong has joined #openstack-nova | 09:53 | |
*** tuan_luong has quit IRC | 09:54 | |
*** tuan_luong has joined #openstack-nova | 09:55 | |
*** sdague has joined #openstack-nova | 09:55 | |
*** cNilesh has quit IRC | 09:55 | |
*** Jack_Iv has quit IRC | 09:55 | |
*** Jack_Iv has joined #openstack-nova | 09:56 | |
*** cNilesh has joined #openstack-nova | 09:56 | |
*** amotoki has joined #openstack-nova | 09:58 | |
*** Jack_Iv has quit IRC | 09:58 | |
*** Jack_Iv has joined #openstack-nova | 09:58 | |
*** cdent has quit IRC | 10:00 | |
*** karimb has quit IRC | 10:02 | |
*** NikhilS has quit IRC | 10:04 | |
*** gszasz has joined #openstack-nova | 10:04 | |
*** karimb has joined #openstack-nova | 10:10 | |
*** zenoway has quit IRC | 10:11 | |
*** djohnsto has quit IRC | 10:15 | |
*** zenoway has joined #openstack-nova | 10:15 | |
*** tovin07_ has quit IRC | 10:19 | |
openstackgerrit | Zhaokun Fu proposed openstack/nova-specs master: fix typos https://review.openstack.org/458001 | 10:21 |
*** ijw has joined #openstack-nova | 10:21 | |
*** tuan_luong has quit IRC | 10:21 | |
openstackgerrit | Alex Xu proposed openstack/nova master: Add check to ensure the versioned_methods are sequential https://review.openstack.org/458004 | 10:22 |
*** cNilesh has quit IRC | 10:22 | |
*** ijw has quit IRC | 10:26 | |
*** tuan_luong has joined #openstack-nova | 10:26 | |
*** nicolasbock has joined #openstack-nova | 10:28 | |
*** kevinz has quit IRC | 10:28 | |
*** yingwei has quit IRC | 10:29 | |
openstackgerrit | Ritesh proposed openstack/nova master: Add image flatten when unshelve rbd image backend https://review.openstack.org/457886 | 10:29 |
*** zenoway has quit IRC | 10:30 | |
*** zenoway has joined #openstack-nova | 10:31 | |
*** zhurong has quit IRC | 10:34 | |
*** udesale__ has quit IRC | 10:36 | |
*** Jack_Iv has quit IRC | 10:36 | |
*** omkar_telee_ has joined #openstack-nova | 10:38 | |
*** prateek has joined #openstack-nova | 10:38 | |
*** prateek_ has quit IRC | 10:38 | |
*** baoli has joined #openstack-nova | 10:40 | |
*** Jack_Iv has joined #openstack-nova | 10:40 | |
*** omkar_telee has quit IRC | 10:41 | |
*** baoli has quit IRC | 10:44 | |
openstackgerrit | Zhaokun Fu proposed openstack/nova master: fix typos https://review.openstack.org/458016 | 10:44 |
johnthetubaguy | sfinucan: do you have more context on this one? https://review.openstack.org/#/c/430026 | 10:44 |
sfinucan | johnthetubaguy: What particular aspects of it? | 10:45 |
johnthetubaguy | sfinucan: added some questions on the patch | 10:46 |
* sfinucan looking | 10:46 | |
johnthetubaguy | sfinucan: basically, I am trying to workout if we are using the API correctly | 10:46 |
openstackgerrit | Zhaokun Fu proposed openstack/nova-specs master: fix version typo https://review.openstack.org/458019 | 10:47 |
johnthetubaguy | I may have found some more context in https://bugs.launchpad.net/openstack-api-site/+bug/1242019 | 10:48 |
openstack | Launchpad bug 1226279 in openstack-manuals "duplicate for #1242019 document multiprovidernet extension" [Medium,Fix released] - Assigned to Diane Fleming (diane-fleming) | 10:48 |
johnthetubaguy | "For these attributes validation rules are identical to the provider networks extension. Obviously both extensions cannot be used at the same time." | 10:48 |
*** zenoway has quit IRC | 10:48 | |
*** thorst has joined #openstack-nova | 10:48 | |
*** zenoway has joined #openstack-nova | 10:49 | |
johnthetubaguy | "Finally, at least in ML2, the providernet and multiprovidernet extensions are two different APIs to supply/view the same underlying information. The older providernet extension can only deal with single-segment networks, but is easier to use. The newer multiprovidernet extension handles multi-segment networks and potentially supports an extensible set of a segment properties, but is more cumbersome to use, at | 10:51 |
johnthetubaguy | least from the CLI. Either extension can be used to create single-segment networks with ML2. " | 10:51 |
johnthetubaguy | hmm, I am confused | 10:51 |
*** salv-orl_ has quit IRC | 10:52 | |
*** zenoway has quit IRC | 10:52 | |
*** zenoway has joined #openstack-nova | 10:52 | |
*** zenoway has quit IRC | 10:52 | |
*** winston-d_ has quit IRC | 10:53 | |
*** zenoway has joined #openstack-nova | 10:53 | |
*** thorst has quit IRC | 10:53 | |
*** zenoway has quit IRC | 10:54 | |
*** zenoway has joined #openstack-nova | 10:55 | |
sfinucan | johnthetubaguy: Far as I understand it, enabling that extension turns your typical response from something like this | 10:56 |
sfinucan | {'provider:physical_network': {'network': 'foo', ...}, ...} | 10:57 |
sfinucan | to this | 10:57 |
sfinucan | {'segments': ['provider:physical_network': {'network': 'foo', ...}, ...]} | 10:57 |
*** prateek_ has joined #openstack-nova | 10:57 | |
*** zenoway has quit IRC | 10:58 | |
sfinucan | so vladikr is checking to see if that extension is enabled, then either simply returning 'provider:physical_network'->'network', or iterating through 'segments' to find the same | 10:58 |
sfinucan | johnthetubaguy: If that makes sense? | 10:59 |
*** prateek has quit IRC | 11:00 | |
*** Jack_Iv has quit IRC | 11:01 | |
*** cdent has joined #openstack-nova | 11:01 | |
*** dmk0202 has joined #openstack-nova | 11:02 | |
*** zenoway has joined #openstack-nova | 11:02 | |
*** sudipto has quit IRC | 11:03 | |
*** sudipto has joined #openstack-nova | 11:03 | |
*** sudipto has quit IRC | 11:03 | |
*** Jack_Iv has joined #openstack-nova | 11:03 | |
*** zenoway has quit IRC | 11:11 | |
*** zenoway has joined #openstack-nova | 11:12 | |
*** slaweq has quit IRC | 11:16 | |
*** slaweq has joined #openstack-nova | 11:16 | |
*** smatzek has joined #openstack-nova | 11:17 | |
*** sree has quit IRC | 11:18 | |
*** dmk0202 has quit IRC | 11:21 | |
*** omkar_telee_ has quit IRC | 11:21 | |
*** dmk0202 has joined #openstack-nova | 11:21 | |
*** liverpooler has quit IRC | 11:21 | |
*** ijw has joined #openstack-nova | 11:22 | |
*** rfolco has joined #openstack-nova | 11:27 | |
*** ijw has quit IRC | 11:28 | |
*** sree has joined #openstack-nova | 11:28 | |
*** tuan_luong has quit IRC | 11:30 | |
*** sree has quit IRC | 11:32 | |
*** omkar_telee_ has joined #openstack-nova | 11:34 | |
*** gongysh has quit IRC | 11:35 | |
*** baoli has joined #openstack-nova | 11:41 | |
openstackgerrit | Zhaokun Fu proposed openstack/nova-specs master: fix overridden error https://review.openstack.org/458034 | 11:41 |
*** hferenc has joined #openstack-nova | 11:41 | |
*** thorst has joined #openstack-nova | 11:42 | |
*** salv-orlando has joined #openstack-nova | 11:42 | |
*** thorst_ has joined #openstack-nova | 11:42 | |
*** edmondsw has joined #openstack-nova | 11:46 | |
*** thorst has quit IRC | 11:47 | |
*** baoli has quit IRC | 11:47 | |
*** salv-orlando has quit IRC | 11:48 | |
*** nmathew- has quit IRC | 11:48 | |
*** amotoki has quit IRC | 11:50 | |
*** timello has joined #openstack-nova | 11:50 | |
openstackgerrit | Zhaokun Fu proposed openstack/nova master: fix overridden error https://review.openstack.org/458037 | 11:53 |
*** kevinz has joined #openstack-nova | 11:55 | |
*** slaweq has quit IRC | 11:55 | |
*** claudiub has joined #openstack-nova | 11:55 | |
*** karimb has quit IRC | 11:55 | |
*** karimb has joined #openstack-nova | 11:56 | |
*** karimb has quit IRC | 11:57 | |
*** amotoki has joined #openstack-nova | 11:57 | |
*** lucasagomes is now known as lucas-hungry | 11:59 | |
*** ralonsoh_ has joined #openstack-nova | 12:01 | |
*** omkar_telee_ has quit IRC | 12:01 | |
*** efoley_ has joined #openstack-nova | 12:02 | |
*** kevinz has quit IRC | 12:02 | |
*** amotoki has quit IRC | 12:02 | |
*** ralonsoh has quit IRC | 12:04 | |
*** efoley has quit IRC | 12:05 | |
*** vks1 has quit IRC | 12:05 | |
*** satyar has joined #openstack-nova | 12:06 | |
*** dane-fichter has joined #openstack-nova | 12:06 | |
openstackgerrit | Roman Podoliaka proposed openstack/osc-placement master: tests: add a hook for functional testing in the gate https://review.openstack.org/452122 | 12:08 |
*** sudipto has joined #openstack-nova | 12:09 | |
*** phuongnh has quit IRC | 12:09 | |
*** diga has quit IRC | 12:11 | |
*** sapcc-bot has quit IRC | 12:11 | |
*** carthaca_ has quit IRC | 12:11 | |
*** sapcc-bot1 has joined #openstack-nova | 12:11 | |
*** carthaca_1 has joined #openstack-nova | 12:11 | |
*** databus23_ has joined #openstack-nova | 12:11 | |
*** tpatzig_ has joined #openstack-nova | 12:11 | |
*** mkoderer_ has joined #openstack-nova | 12:11 | |
*** david_1 has joined #openstack-nova | 12:11 | |
*** dgonzalez_ has joined #openstack-nova | 12:11 | |
*** databus23_ has quit IRC | 12:13 | |
*** tpatzig_ has quit IRC | 12:13 | |
*** mkoderer_ has quit IRC | 12:13 | |
*** dgonzalez_ has quit IRC | 12:13 | |
*** david_1 has quit IRC | 12:13 | |
*** cdent has quit IRC | 12:18 | |
*** markvoelker has joined #openstack-nova | 12:19 | |
*** karthiks has quit IRC | 12:22 | |
openstackgerrit | Alex Xu proposed openstack/nova master: Add test ensure all the microversions are sequential in placement API https://review.openstack.org/458049 | 12:23 |
*** voelzmo has quit IRC | 12:23 | |
*** voelzmo has joined #openstack-nova | 12:23 | |
*** voelzmo has quit IRC | 12:24 | |
*** ijw has joined #openstack-nova | 12:24 | |
*** voelzmo has joined #openstack-nova | 12:24 | |
*** timello has quit IRC | 12:25 | |
*** liverpooler has joined #openstack-nova | 12:25 | |
*** ayogi has quit IRC | 12:26 | |
*** ijw has quit IRC | 12:29 | |
openstackgerrit | Zhaokun Fu proposed openstack/nova-specs master: accomodate=>accommodate https://review.openstack.org/458050 | 12:29 |
*** edmondsw has quit IRC | 12:29 | |
*** edmondsw has joined #openstack-nova | 12:30 | |
*** slaweq has joined #openstack-nova | 12:31 | |
*** zhurong has joined #openstack-nova | 12:31 | |
*** iceyao has joined #openstack-nova | 12:31 | |
*** zenoway has quit IRC | 12:33 | |
*** karimb has joined #openstack-nova | 12:35 | |
*** slaweq has quit IRC | 12:37 | |
*** zenoway has joined #openstack-nova | 12:37 | |
*** slaweq has joined #openstack-nova | 12:38 | |
openstackgerrit | Andy McCrae proposed openstack/nova master: Allow CONTENT_LENGTH to be present but empty https://review.openstack.org/455710 | 12:40 |
*** gongysh has joined #openstack-nova | 12:41 | |
*** zenoway has quit IRC | 12:41 | |
*** lyan has joined #openstack-nova | 12:43 | |
*** jaypipes has joined #openstack-nova | 12:44 | |
alex_xu | nova api meeting is in 15 mins at #openstack-meeting-4 | 12:45 |
*** zhurong has quit IRC | 12:45 | |
*** ratailor has quit IRC | 12:46 | |
*** zenoway has joined #openstack-nova | 12:46 | |
openstackgerrit | Roman Podoliaka proposed openstack/osc-placement master: tests: add a hook for functional testing in the gate https://review.openstack.org/452122 | 12:48 |
*** catintheroof has joined #openstack-nova | 12:48 | |
*** jpena is now known as jpena|lunch | 12:52 | |
*** jerrygb has joined #openstack-nova | 12:53 | |
*** falseuser has joined #openstack-nova | 12:54 | |
*** falseuser has left #openstack-nova | 12:55 | |
*** artom has quit IRC | 12:55 | |
*** artom has joined #openstack-nova | 12:56 | |
*** zenoway has quit IRC | 12:56 | |
*** zenoway has joined #openstack-nova | 12:56 | |
*** falseuser has joined #openstack-nova | 12:57 | |
falseuser | 1 | 12:57 |
*** nmathew- has joined #openstack-nova | 12:57 | |
*** nmathew- has quit IRC | 12:57 | |
*** efoley__ has joined #openstack-nova | 12:58 | |
falseuser | hello! | 12:58 |
*** gouthamr has joined #openstack-nova | 12:59 | |
*** cleong has joined #openstack-nova | 13:00 | |
*** ralonsoh__ has joined #openstack-nova | 13:01 | |
*** cdent has joined #openstack-nova | 13:01 | |
*** efoley_ has quit IRC | 13:01 | |
*** ralonsoh__ is now known as ralonsoh | 13:01 | |
johnthetubaguy | sfinucan: sorry, missed your note, yeah thats what I was seeing, I am just trying to see if there is something else we should do too, maybe not | 13:01 |
johnthetubaguy | sfinucan: I wasn't expecting the neutron API to transform like that based on its settings, I guess thats what it does, confusing | 13:03 |
*** ralonsoh_ has quit IRC | 13:04 | |
sfinucan | johnthetubaguy: Yeah, I must admit I based that on the docs. Maybe the docs don't reflect reality but I presumed they would | 13:04 |
*** falseuser has quit IRC | 13:06 | |
*** falseuser has joined #openstack-nova | 13:07 | |
*** lucas-hungry is now known as lucasagomes | 13:07 | |
*** mdrabe has joined #openstack-nova | 13:09 | |
*** sean-k-mooney has joined #openstack-nova | 13:09 | |
*** dane-fichter has quit IRC | 13:10 | |
*** jamesdenton has joined #openstack-nova | 13:11 | |
*** falseuser has quit IRC | 13:13 | |
*** artom has quit IRC | 13:14 | |
*** artom has joined #openstack-nova | 13:14 | |
*** Zhaomingjun has joined #openstack-nova | 13:16 | |
*** ngupta has joined #openstack-nova | 13:17 | |
*** felipemonteiro has joined #openstack-nova | 13:22 | |
openstackgerrit | Andy McCrae proposed openstack/nova master: Allow CONTENT_LENGTH to be present but empty https://review.openstack.org/455710 | 13:23 |
*** Zhaomingjun has quit IRC | 13:23 | |
*** moshele has quit IRC | 13:23 | |
*** slaweq has quit IRC | 13:23 | |
*** slaweq has joined #openstack-nova | 13:24 | |
*** jamesdenton has quit IRC | 13:24 | |
*** jamesdenton has joined #openstack-nova | 13:25 | |
*** ijw has joined #openstack-nova | 13:25 | |
*** xyang1 has joined #openstack-nova | 13:25 | |
*** mriedem has joined #openstack-nova | 13:25 | |
*** eharney has joined #openstack-nova | 13:26 | |
mriedem | o/ | 13:26 |
*** slaweq has quit IRC | 13:28 | |
*** ijw has quit IRC | 13:30 | |
*** esberglu has joined #openstack-nova | 13:30 | |
*** kfarr has joined #openstack-nova | 13:30 | |
*** pchavva has joined #openstack-nova | 13:30 | |
*** awaugama has joined #openstack-nova | 13:33 | |
*** smatzek has quit IRC | 13:35 | |
*** abalutoiu_ is now known as abalutoiu | 13:36 | |
*** nkorabli has joined #openstack-nova | 13:37 | |
openstackgerrit | Andy McCrae proposed openstack/nova master: Allow CONTENT_LENGTH to be present but empty https://review.openstack.org/455710 | 13:37 |
*** voelzmo has quit IRC | 13:38 | |
*** voelzmo has joined #openstack-nova | 13:39 | |
johnthetubaguy | sfinucan: I couldn't really find docs, just found the odd bug and things, where did you look for those? | 13:43 |
sfinucan | sec | 13:43 |
*** voelzmo has quit IRC | 13:43 | |
*** vks1 has joined #openstack-nova | 13:43 | |
sfinucan | johnthetubaguy: https://developer.openstack.org/api-ref/networking/v2/#multiple-provider-extension | 13:44 |
johnthetubaguy | sfinucan: ah, yeah, I did look at those, just wasn't 100% sure how you use it still. | 13:44 |
*** voelzmo has joined #openstack-nova | 13:46 | |
sfinucan | johnthetubaguy: maybe we should ping the neutron guys directly? | 13:46 |
sfinucan | someone there could surely tell us this in a heartbeat :) | 13:47 |
sfinucan | one would hope, anyway ;) | 13:47 |
*** gcb has joined #openstack-nova | 13:47 | |
*** vks1 has quit IRC | 13:47 | |
johnthetubaguy | sfinucan: yeah, we totally should | 13:48 |
johnthetubaguy | sfinucan: I think I get it now, just want to make sure I interpreted things correctly. | 13:48 |
sfinucan | johnthetubaguy: I'll let you do that and just lurk myself - you can ask your own questions best, heh | 13:48 |
*** dimtruck is now known as zz_dimtruck | 13:51 | |
mriedem | ha well this was popular https://review.openstack.org/#/c/457854/ | 13:55 |
*** jpena|lunch is now known as jpena | 13:56 | |
mriedem | lyarwood: can i get you to take a look at these backports? https://review.openstack.org/#/q/status:open+project:openstack/nova+topic:bug/1682693 | 13:57 |
*** smatzek has joined #openstack-nova | 13:58 | |
*** kfarr has quit IRC | 13:59 | |
jaypipes | mriedem: reading your comment on bauzas placement-claims spec got me wondering... why is it that with multi-cell + super-conductor we are getting rid of the possibility of retries in the scheduling process? | 14:00 |
*** slaweq has joined #openstack-nova | 14:00 | |
*** prateek_ has quit IRC | 14:00 | |
openstackgerrit | Feodor Tersin proposed openstack/nova master: Implement ScaleIO image backend https://review.openstack.org/407440 | 14:01 |
*** eharney has quit IRC | 14:01 | |
mriedem | jaypipes: because the computes can only call back to the local cell conductor, not the super conductor, is my understanding | 14:01 |
mriedem | and there is no scheduler local to the cell, | 14:01 |
mriedem | so the local conductor can't ask the scheduler for a new list of hosts to retry | 14:01 |
*** links has quit IRC | 14:02 | |
mriedem | it would have to upcall to the top-level scheduler (the only scheduler), and i think we're avoid upcalls, because that's like cells v1 | 14:02 |
dansmith | it's not just that we want to avoid them (we do), | 14:02 |
openstackgerrit | Andy McCrae proposed openstack/nova master: Allow CONTENT_LENGTH to be present but empty https://review.openstack.org/455710 | 14:02 |
dansmith | but we have no connection information for the upcall | 14:02 |
*** vks1 has joined #openstack-nova | 14:03 | |
mriedem | dansmith: does the cell conductor nova.conf have api_database set? | 14:03 |
*** nkorabli has quit IRC | 14:03 | |
dansmith | no | 14:03 |
mriedem | ok, just [database]connection = cell db | 14:04 |
edleafe | So the cell conductor talk to the super conductor? | 14:04 |
*** tbachman has joined #openstack-nova | 14:04 | |
mriedem | edleafe: no | 14:04 |
dansmith | edleafe: they're on different busses, and the lower layer has no information about how to connect to the top layer | 14:04 |
*** david-lyle has quit IRC | 14:04 | |
mriedem | jaypipes: so for the claims in scheduler spec and the overhead stuff, couldn't we take the overhead values from the virt driver and adjust the allocations in the resource tracker? | 14:05 |
mriedem | if the overhead pushes us over what's available for inventory on that provider, we get a 409 i think, and then we fail the build | 14:05 |
dansmith | ugh | 14:06 |
mriedem | i would think if you had reserved some space for ram and disk for the provider itself, then the chances of hitting overhead 409s once we pick a host might be slim | 14:06 |
dansmith | I really hate that | 14:06 |
mriedem | dansmith: see my other options in the spec :) | 14:06 |
mriedem | there are worse options | 14:06 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add online data migration for populating services.uuid https://review.openstack.org/454899 | 14:07 |
*** yingwei has joined #openstack-nova | 14:10 | |
jaypipes | mriedem: yes, we could possibly do that | 14:10 |
*** yingwei has quit IRC | 14:10 | |
jaypipes | mriedem: I don't like it, same as dansmith, but not sure a better solution | 14:10 |
dansmith | so the point being, | 14:10 |
mriedem | i figured that would be better than conductor doing an rpc call into the compute to get the overhead values before posting allocations | 14:11 |
dansmith | we tell people to make sure they account for the slack in the reserved amounts on each host to keep the chances of a failure down? | 14:11 |
mriedem | dansmith: yeah | 14:11 |
mriedem | it sucks | 14:11 |
mriedem | i know | 14:11 |
dansmith | the conductor->compute call isn't so terrible, | 14:11 |
dansmith | it's just that we can't make it until we have a compute | 14:11 |
mriedem | right | 14:11 |
dansmith | which lengthens our window | 14:11 |
cdent | if we wiggle the reserved then we can't add the overhead to the allocations, right? | 14:12 |
cdent | it's one or the other | 14:12 |
mriedem | so conductor asks scheduler for a host, conductor gets the host mapping, rpc calls to the compute with the flavor to get the overhead, and uses that to post the allocations to placement, | 14:12 |
mriedem | if that fails, we have to go back through the scheduler again for a new host | 14:12 |
dansmith | cdent: hmm, yeah, placement won't let you eat the reserved amount I guess right? | 14:12 |
cdent | dansmith: correct | 14:12 |
dansmith | yeah | 14:12 |
cdent | I left a big comment there about quota too, not sure if/how that fits in | 14:13 |
mriedem | i liked the idea of posting the allocations from the scheduler where if we needed to retry we already have the list of filtered hosts, but we know that's a toss up perf wise | 14:13 |
*** zz_dimtruck is now known as dimtruck | 14:13 | |
*** iceyao has quit IRC | 14:13 | |
mriedem | if we have to rpc call into the compute to get overhead, i think we then have to move everything into conductor | 14:14 |
dansmith | mriedem: well, and scheduler calling to compute is worse than conductor | 14:14 |
dansmith | much worse | 14:14 |
dansmith | yeah | 14:14 |
*** amotoki has joined #openstack-nova | 14:14 | |
*** david-lyle has joined #openstack-nova | 14:14 | |
dansmith | so, another way to look at this: | 14:15 |
dansmith | we're talking about having resource overrides in the flavor | 14:15 |
*** amotoki has quit IRC | 14:15 | |
dansmith | we could also just say that the drivers can't calculate different values for the resources, and have to build the vm from the things they're given, | 14:15 |
bauzas | sorry, was afk | 14:16 |
dansmith | which in the case of hyperv means you get $mem fewer MBs of disk, | 14:16 |
* bauzas scrolling back | 14:16 | |
dansmith | and in the case of libvirt, you get one fewer vcpu | 14:16 |
dansmith | and if you don't want that as an operator, then you override the actual values for those with room for the slack, leaving the display values as what people will really get | 14:16 |
dansmith | for people that really use the same flavor for two hypervisor types (if that really happens) then things get ugly | 14:16 |
dansmith | but I kinda feel like the cloudy approach here is to not be as snowflake-y on the virt side | 14:17 |
bauzas | could someone tell which problem you folks are discussing ? #1 reschedules in a cellsv2 world or #2 overhead values for instance given by virt drivers ? | 14:17 |
mriedem | that also pushes a lot of complexity on the operator | 14:17 |
dansmith | it does, and that sucks | 14:17 |
mriedem | bauzas: #2 | 14:17 |
*** eharney has joined #openstack-nova | 14:17 | |
dansmith | mriedem: so, we should probably go the extra-call-to-compute route for now and if that ends up being too expensive, then punt later | 14:18 |
dansmith | we already do that for things like getting predicted-but-never-correct bdm device names right? | 14:18 |
mriedem | yeah, we do that from the api | 14:18 |
bauzas | so, my take on that is that overheads, since are only virt-related are things which wouldn't be exposed to users | 14:18 |
mriedem | when attaching a volume | 14:18 |
dansmith | so here's another potential optimization: | 14:18 |
bauzas | users ask for memory sizes they know | 14:18 |
*** sree has joined #openstack-nova | 14:18 | |
bauzas | they don't know how much the hypervisor has | 14:19 |
bauzas | so | 14:19 |
dansmith | we could do that call once, and record the value we got for the flavor id, hypervisor type and version, and only do that once per boot if we have to try several hosts in a single cycle | 14:19 |
*** hongbin has joined #openstack-nova | 14:19 | |
*** satyar has quit IRC | 14:19 | |
mriedem | oh btw, this is nice in the py35 tests: "Fatal Python error: Cannot recover from stack overflow." | 14:19 |
dansmith | mriedem: like, if we have to try four libvirt hosts in a single boot call, we only have to call to one of the computes to get the overhead | 14:19 |
mriedem | sdague: ^ | 14:19 |
bauzas | when the scheduler is choosing a destination, he has to pick it based on the user request, but related to the total amount of memory is left | 14:20 |
mriedem | dansmith: yeah that's not a bad idea | 14:20 |
mriedem | cache the results in conductor | 14:20 |
mriedem | take the rpc call hit once | 14:20 |
dansmith | we need more information than just the hostname coming back from scheduler though, else we have to hit the db ourselves to look up the host info again | 14:20 |
dansmith | yeah | 14:20 |
dansmith | either once per call or once per conductor worker | 14:21 |
dansmith | or memcache or something | 14:21 |
mriedem | i assumed once per worker | 14:21 |
dansmith | well, that could get big, | 14:21 |
mriedem | sure, if we use the cache utils stuff, | 14:21 |
dansmith | as there are tons of workers, and potentially lots of flavors and stuff | 14:21 |
mriedem | it's configurable | 14:21 |
dansmith | yeah, that's the way to go I think | 14:21 |
mriedem | default is per worker in memory cache | 14:21 |
mriedem | if you want memcache, configure it | 14:21 |
dansmith | yeah | 14:21 |
bauzas | wait | 14:22 |
bauzas | why placement couldn't compare the user flavor vs. the size of what's left, ie. inventory - instances ? | 14:22 |
mriedem | gcb: i'm seeing "Fatal Python error: Cannot recover from stack overflow." in the py35 job for nova unit tests randomly | 14:22 |
mriedem | gcb: http://logs.openstack.org/97/456397/3/check/gate-nova-python35/05322ec/console.html#_2017-04-19_12_45_10_724578 | 14:22 |
bauzas | instances being "instance.flavor + instance.overhead" ? | 14:22 |
mriedem | bauzas: placement doesn't have the overhead info | 14:22 |
*** sree has quit IRC | 14:22 | |
bauzas | mriedem: placement knows inventory I know | 14:23 |
mriedem | bauzas: we're saying we need to get the overhead from the compute before we post the allocations | 14:23 |
mriedem | to take into account the overhead | 14:23 |
mriedem | then placement tells us if that works or not for the inventory on the provider | 14:23 |
*** dharinic has joined #openstack-nova | 14:23 | |
mriedem | if POST /allocations/instance fails, then we retry through the scheduler | 14:23 |
mriedem | dan was just saying that we can cache the rpc call results in conductor - the results of the call to the compute to get the overhead | 14:24 |
mriedem | per flavorid/hypervisortype/version | 14:24 |
bauzas | mriedem: that would assume the overhead is not calculated per instance | 14:24 |
mriedem | huh? | 14:24 |
gcb | mriedem: I saw the email , trying to figure out the root cause and fix it | 14:24 |
mriedem | the overhead is calculated per instance | 14:24 |
mriedem | gcb: this is a different error :) | 14:24 |
bauzas | mriedem: yup, so we would query the compute every time a boot request comes in to know the overhead, right? | 14:25 |
mriedem | bauzas: yes | 14:25 |
mriedem | and cache the results | 14:25 |
bauzas | mriedem: cache what ? given we don't know which compute | 14:25 |
gcb | mriedem, wow, let me check the details | 14:25 |
mriedem | bauzas: we'd do this in conductor after we get a host from the scheduler | 14:25 |
bauzas | we would have to cache overheads per flavor for all computes | 14:25 |
mriedem | bauzas: right | 14:25 |
dansmith | no | 14:25 |
bauzas | mriedem: oh, after ? | 14:25 |
bauzas | erm, not sure I like that | 14:25 |
dansmith | per hypervisor type/version | 14:26 |
bauzas | I'd tend to prefer considering that the flavor is what the user requests | 14:26 |
mriedem | bauzas: that's not how it works today | 14:26 |
bauzas | and placement should verify against the inventory which would be decremented by the sum of overheads | 14:26 |
*** ijw has joined #openstack-nova | 14:26 | |
mriedem | i request 8GB of RAM for my vm, but xen says i really need 8GB + 256MB or something | 14:26 |
bauzas | at the moment, placement matches against the inventory minus the sum of allocations | 14:27 |
lyarwood | mriedem: ack sure looking now | 14:27 |
mriedem | bauzas: "and placement should verify against the inventory which would be decremented by the sum of overheads" - yes, but we have to get the overheads to placement | 14:27 |
bauzas | I'm proposing to match against the inventory minus the allocations+overhead | 14:27 |
mriedem | we do that via the allocations | 14:27 |
mriedem | bauzas: yes, we all agree on that | 14:27 |
mriedem | that's not new | 14:27 |
dansmith | the fact that we have larger allocations than the flavor is not ideal, but at the moment we have no choice | 14:27 |
*** yingwei has joined #openstack-nova | 14:28 | |
bauzas | but you would not just compare with the flavor for the instance, but flavor+cached_overhead ? | 14:28 |
bauzas | well, huge thing | 14:28 |
*** dharinic has quit IRC | 14:28 | |
mriedem | the allocations are made up of the flavor today | 14:28 |
bauzas | dansmith: mriedem: okay, I think why you'd like to cache that | 14:28 |
*** satyar has joined #openstack-nova | 14:28 | |
*** satyar has quit IRC | 14:29 | |
*** satyar has joined #openstack-nova | 14:29 | |
mriedem | should i go back and update the spec with a summary? | 14:29 |
mriedem | bauzas: unfortunately for you, this means redoing a large part of the spec where you changed it from posting allocations in conductor to scheduler, now back to conductor :( | 14:30 |
cdent | mriedem: what does that mean with regard to the reasons it moved back to the scheduler in the first place? | 14:31 |
*** iceyao has joined #openstack-nova | 14:31 | |
*** satyar has quit IRC | 14:31 | |
*** satyar has joined #openstack-nova | 14:31 | |
*** ijw has quit IRC | 14:31 | |
cdent | conductor ->(reasons)->sched->(new reasons)->conductor | 14:31 |
bauzas | mriedem: this is fine https://www.nytimes.com/2016/08/06/arts/this-is-fine-meme-dog-fire.html | 14:32 |
mriedem | cdent: we moved it to scheduler because that's where the filtered host list is, so retries there might be theoretically faster, | 14:33 |
cdent | so it's just a performance thing? I guess that's okay then | 14:33 |
mriedem | cdent: we're moving to conductor now because conductor is what's going to need to do the rpc call into the compute to get the overhead values, | 14:33 |
bauzas | mriedem: dansmith: wait, we expose flavors to scheduler, right? | 14:33 |
bauzas | oh crap, nvm | 14:34 |
*** moshele has joined #openstack-nova | 14:34 | |
mriedem | so conductor -> scheduler (select_destinations) -> conductor (rpc call to compute to get overhead for the selected host) -> post allocations (flavor + overhead) to placement -> (1) success, build on compute, or (2) fail, retry through scheduler for a new host | 14:34 |
mriedem | cdent: ^ make sense? | 14:34 |
bauzas | I'm trying to consider how we could inform placement of the overhead for the specific instance | 14:34 |
mriedem | bauzas: via the allocations that we post | 14:34 |
mriedem | see ^ | 14:34 |
cdent | mriedem: yeah, makes sense, but is frustrating | 14:35 |
mriedem | cdent: agree, | 14:35 |
bauzas | mriedem: I'd love to have posted when we do GET /RPs=memory=X | 14:35 |
mriedem | especially since i for one didn't even know this overhead thing existed until yesterday | 14:35 |
mriedem | bauzas: we don't know the host then | 14:35 |
mriedem | it's a chicken and egg | 14:35 |
*** belmoreira has quit IRC | 14:35 | |
bauzas | mriedem: where X would be flavor+overhead | 14:35 |
*** iceyao has quit IRC | 14:35 | |
bauzas | fuuuuuuuuuu | 14:36 |
mriedem | bauzas: we have to have the host to get the overhead | 14:36 |
mriedem | because the virt driver gives the overhead values | 14:36 |
bauzas | right, so the only problem is with the new POST allocation | 14:36 |
bauzas | sorry, slow brain here | 14:36 |
bauzas | my brain is fried by that shit ton of political discussions I'm eating | 14:37 |
*** baoli has joined #openstack-nova | 14:37 | |
mriedem | i don't read the news anymore | 14:37 |
mriedem | i heard we bombed afghanistan with a large bomb | 14:38 |
mriedem | to show how cool we are | 14:38 |
edleafe | Is the overhead specific to each hypervisor, but the same for all instances on that hypervisor, regardless of instance size? | 14:38 |
mriedem | edleafe: no | 14:39 |
edleafe | ugh | 14:39 |
bauzas | mriedem: I do recommend https://www.youtube.com/watch?v=hkZir1L7fSY for your knowledge | 14:39 |
*** amotoki has joined #openstack-nova | 14:40 | |
mriedem | bauzas: ok, saved for later | 14:40 |
bauzas | mriedem: NSFW | 14:40 |
mriedem | i'm at home | 14:40 |
mriedem | so everything is safe | 14:40 |
bauzas | s/NSFW/NSFWFH | 14:40 |
mriedem | between the hours of 9am and 4pm that is | 14:40 |
bauzas | anyway | 14:40 |
mriedem | edleafe: the hyperv overhead calculation is pretty simple | 14:41 |
bauzas | mriedem: posting a summary in the spec ? | 14:41 |
mriedem | 'disk_gb': (instance_info['memory_mb'] + 512) // units.Ki | 14:41 |
mriedem | bauzas: yeah, in a minute | 14:41 |
mriedem | looking at this py35 weirdness | 14:41 |
bauzas | mriedem: okay, because I was about writing a new rev -ish | 14:41 |
*** baoli has quit IRC | 14:41 | |
*** moshele has quit IRC | 14:42 | |
edleafe | mriedem: oh, that's much clearer | 14:42 |
mriedem | edleafe: the xen and libvirt ones are more confusing | 14:43 |
mriedem | gcb: i'm having a hard time knowing which test is doing the stack overflow | 14:44 |
*** Swami has joined #openstack-nova | 14:44 | |
mriedem | but there appears to be an infinite recursion in oslo.config | 14:44 |
mriedem | gcb: i also see at the end: nova.tests.unit.test_rpc.TestRPC.test_add_extra_exmods [] ... inprogress | 14:44 |
bauzas | mriedem: the libvirt one is scarying me, because I wonder if we could even cache that | 14:44 |
mriedem | so maybe it's that one | 14:44 |
mriedem | bauzas: because it's config driven? | 14:44 |
mriedem | and per-image | 14:44 |
mriedem | bauzas: yeah that's a good point | 14:45 |
mriedem | dansmith: ^ | 14:45 |
melwitt | mriedem: is anyone working on the intermittent ironic test failure? I want to take a stab at it if not | 14:45 |
mriedem | the libvirt overhead one kind of screws us | 14:45 |
mriedem | melwitt: no | 14:45 |
bauzas | mriedem: exactly this | 14:45 |
mriedem | melwitt: i was considering just skipping it for now | 14:45 |
dansmith | hmm, I don't remember the config bit | 14:45 |
* dansmith looks | 14:45 | |
mriedem | dansmith: might not be config, but it's based on image meta | 14:45 |
gcb | mriedem, Do you get error from https://review.openstack.org/#/c/456397 ? It seems oslo.config have recursion calls | 14:46 |
johnthetubaguy | melwitt: I saw talk of something in the neutron channel about ironic, but seemed more like a hard failure | 14:46 |
dansmith | mriedem: yeah image meta | 14:46 |
mriedem | gcb: it's multiple changes failing on this | 14:46 |
mriedem | according to logstash | 14:46 |
melwitt | mriedem: okay. I think the right thing to do is just raise the Timeout exception. we shouldn't be doing a real timeout | 14:46 |
melwitt | (as discussed on the bug) | 14:46 |
mriedem | melwitt: so remove all of the fake stub methods that are doing logic to trigger the timeout? | 14:47 |
mriedem | melwitt: that's the easy fix | 14:47 |
mriedem | i think i get the point of why the test was doing that though | 14:47 |
mriedem | to stub and mimic what the driver is doing | 14:47 |
mriedem | but it's pretty fragile | 14:47 |
melwitt | mriedem: yeah, stub the looping call to raise the timeout. I thought the test wants to check that it does the right thing when a timeout occurs, that it raises the ConsoleNotAvailable | 14:48 |
melwitt | that is, I think we can assume that oslo_service looping calls work correctly, else we're also testing oslo functionality | 14:49 |
mriedem | melwitt: yeah it's a fine line | 14:49 |
bauzas | mriedem: dansmith: we also lookup the instance if we don't have the numa topology set in the instance object for knowing the overhead | 14:49 |
mriedem | melwitt: i'm fine with doing that | 14:49 |
dansmith | mriedem: so, a couple things | 14:49 |
mriedem | melwitt: because my solution was skipTest :) | 14:50 |
*** omkar_telee_ has joined #openstack-nova | 14:50 | |
gcb | mriedem, it's really strange, nova.tests.unit.test_rpc.TestRPC.test_add_extra_exmods is simple test. what I found just deprecated warning from oslo.messaging | 14:50 |
*** kaisers has joined #openstack-nova | 14:50 | |
dansmith | mriedem: (1) presumably we'll do this without the cache first, (2) we can cache on flavorid/hv/ver first, (3) we might just make a hash key function that generates a key based on all the things currently known to matter | 14:50 |
*** eharney has quit IRC | 14:50 | |
mriedem | dansmith: where (3) could take into account the image id too? | 14:51 |
dansmith | mriedem: and (4) the penalty for missing means we *might* fail to build because of overhead on the compute, which sucks, but.. builds can fail | 14:51 |
dansmith | mriedem: yeah | 14:51 |
mriedem | dansmith: and the image meta could change w/o changing the image id | 14:51 |
*** kornicameister has quit IRC | 14:51 | |
dansmith | mriedem: or just hash in the actual fields we know are ever looked at | 14:51 |
dansmith | mriedem: right well, that's why I was thinking ^ instead of id, but yeah | 14:51 |
bauzas | mriedem: dansmith: so just to make it clear, we introspect the instance every time we claim the resource in the RT if libvirt | 14:51 |
melwitt | mriedem: heh, okay. I'll upload it and we'll see | 14:51 |
mriedem | changing meta on an image w/o dumping the old image seems like a bad idea | 14:52 |
dansmith | because if you have two images, but without cpu policy set, those shouldn't need to be done separately | 14:52 |
mriedem | bauzas: if libvirt/hyperv/xen | 14:52 |
bauzas | mriedem: dansmith: for knowing the numa topology | 14:52 |
*** annegentle has joined #openstack-nova | 14:52 | |
mriedem | bauzas: where do we even set instance.numa_topology during instance creatE? | 14:52 |
dansmith | bauzas: I know, what's your point? hopefully that all goes away anyway | 14:52 |
dansmith | mriedem: it's during virt build I think | 14:52 |
mriedem | heh | 14:52 |
mriedem | so... | 14:53 |
dansmith | well, that's where we fill it out | 14:53 |
bauzas | dansmith: the fact that we could potentially not be able to cache things | 14:53 |
bauzas | because there could be only one occurence | 14:53 |
mriedem | sfinucan: do you know where we set instance.numa_topology during instance build? | 14:53 |
bauzas | I mean a cache hit of 1 occurrence | 14:53 |
sfinucan | mriedem: We set it twice | 14:53 |
sfinucan | Once during the filtering stage (to see if an instance would fit on the host) | 14:54 |
dansmith | bauzas: the looking at the instance.numa part is just to calculate the same thing, but without having flavor/image meta | 14:54 |
sfinucan | and once when actually booting the instance | 14:54 |
sfinucan | I'll get the two calls now | 14:54 |
dansmith | bauzas: you would get the same answer from the instance as from the metadata | 14:54 |
dansmith | mriedem: ^ | 14:54 |
*** sridharg has quit IRC | 14:54 | |
mriedem | sfinucan: looks like RT.instance_claim sets it on the instance | 14:55 |
bauzas | dansmith: mmm, you're right, two instances sharing same flavors/images would necessarly have the same overhead even with numa | 14:55 |
dansmith | right, | 14:56 |
dansmith | it's just that we get the value either calculated from meta, or already set if the instance has had it done | 14:56 |
dansmith | it's still the same answer | 14:56 |
bauzas | right | 14:56 |
bauzas | so, the key is the tuple (image, flavor) | 14:56 |
bauzas | well | 14:56 |
dansmith | no | 14:56 |
bauzas | (image, flavor, hv_type, hv_version) | 14:56 |
dansmith | the key is a hash value of flavorid, a set of image properties, hv, version) | 14:56 |
dansmith | yeah | 14:56 |
dansmith | not image id though | 14:57 |
mriedem | what other nasty things is the RT doing that we aren't thinking about? | 14:57 |
mriedem | cpu pinning stuff on the host? | 14:57 |
edleafe | Can we simplify things and get a good estimate of what the max total overhead could ever be on a particular host? | 14:57 |
bauzas | mriedem: I think we CPU pin indeed | 14:57 |
edleafe | And then just reserve that? | 14:57 |
*** mlakat has quit IRC | 14:57 | |
mriedem | edleafe: as cdent noted earlier, we don't get the reserved inventory for this | 14:57 |
bauzas | mriedem: AFAIK, we just verify if we can accept a host for CPU pinning, but we do set the pin between pCPU and vCPU at the RT stage | 14:57 |
bauzas | sfinucan: correct ? ^ | 14:58 |
sfinucan | mriedem: Yeah, you're looking for calls to 'numa_fit_instance_to_host' | 14:58 |
edleafe | mriedem: I mean when creating the resource provider, add the total overhead it might need to the reserved part for the hypervisor | 14:58 |
sfinucan | bauzas: Correct | 14:58 |
cdent | mriedem: that's not what I said. What I said was _if_ we change reserved, we don't change the allocations. I actually think making a good guess at what global overhead is at boot time, and adding that to reserved is the right way to go | 14:58 |
*** marst has joined #openstack-nova | 14:58 | |
cdent | s/boot/host boot/ | 14:58 |
sfinucan | We call 'numa_fit_instance_to_host' to make sure that the instance would fit on a host with a given CPU pinning permutation | 14:59 |
dansmith | cdent: meaning claim more and update later? | 14:59 |
*** marst has quit IRC | 14:59 | |
edleafe | dansmith: no, just claim what the instance uses | 14:59 |
mriedem | edleafe: cdent: i don't really know how we can safely estimate that, | 14:59 |
dansmith | edleafe: eh? | 14:59 |
mriedem | w/o knowing which flavors will be used, which scheduler filters are being used, etc | 14:59 |
cdent | dansmith: no, continue making allocations using the non-overhead values. incorporate the expected in 'reserved' of inventory | 14:59 |
sfinucan | It's the easiest way to check that out for things like cpu_thread_policy, where we can't do a simple "have I X free CPUs" check | 14:59 |
dansmith | edleafe: we're claiming before we know that, that's the whole point | 14:59 |
*** namnh has joined #openstack-nova | 14:59 | |
*** marst has joined #openstack-nova | 14:59 | |
bauzas | okay, here is a thinh | 15:00 |
edleafe | dansmith: it would already be accounted for | 15:00 |
*** mdnadeem has quit IRC | 15:00 | |
dansmith | cdent: oh, that's what I initially was saying, yeah | 15:00 |
*** karthiks has joined #openstack-nova | 15:00 | |
bauzas | given all the nasty and fancy things we do with RT | 15:00 |
edleafe | in the RP's reserved | 15:00 |
bauzas | I have a though | 15:00 |
*** rmart04 has quit IRC | 15:00 | |
bauzas | why not just posting an allocation without all that stuff, and do modify the allocation at the RT state ? | 15:00 |
dansmith | cdent: not claim the flavor+overhead, but claim flavor, and require reserved to be set high enough to cover it | 15:00 |
mriedem | bauzas: that's one of the options i said in the spec | 15:00 |
dansmith | bauzas: because that's terrible | 15:00 |
edleafe | I see chasing the last tiny bit of resource is going to make the code an even bigger mess than it is now | 15:01 |
bauzas | ie. we claim for the resouces we know, but we later heal that when we claim | 15:01 |
bauzas | when we /RT/.claim | 15:01 |
cdent | dansmith: yes, but doing that in an semi-automated way based on the initial calculated (and config'd) inventory. Updating it at boot time. | 15:01 |
*** karthiks has quit IRC | 15:01 | |
bauzas | either way, placement doesn't know a bit of that NFV gangband | 15:01 |
dansmith | cdent: well, whether or not we do that is a detail I guess | 15:01 |
* cdent nods | 15:01 | |
bauzas | so I think NFV claims would still be a 2-phase step | 15:01 |
dansmith | cdent: however, I think I lost sight of that as a simple option early on | 15:02 |
bauzas | ie. rounding the allocation by the scheduler, and refine that allocation as soon as we have a better vision | 15:02 |
dansmith | cdent: that's probably the way to go, yeah, and do the more complex thing if that ends up being to naive for some reason | 15:02 |
cdent | dansmith: yes | 15:02 |
cdent | otherwise we run into some very complex wangling for unclear gains | 15:02 |
dansmith | cdent: I lost sight of it when we started talking about claiming the flavor+overhead in one go | 15:02 |
dansmith | cdent: which means we couldn't rely on reserved | 15:02 |
*** rcernin has quit IRC | 15:03 | |
bauzas | soooo | 15:03 |
mriedem | dansmith: cdent: so would that be based on reserved_host_disk_mb and reserved_host_memory_mb ? | 15:03 |
bauzas | could we save my life, and assume that we would POST an allocation that is rounded, and later refine it within the instance_claim phase, exactly like we already do ? | 15:03 |
bauzas | 90% of users would have benefits, and things wouldn't change (even improve) for NFV users | 15:04 |
cdent | bauzas: we slightly increase the risk of retry/error if the second claim can't claim | 15:04 |
*** voelzmo has quit IRC | 15:04 | |
dansmith | mriedem: cdent: and vcpu | 15:04 |
cdent | seems better to not allocation overhead per instance | 15:04 |
bauzas | cdent: like we already do :) | 15:04 |
cdent | yes | 15:04 |
cdent | and instead cover it with reserved | 15:04 |
cdent | it is safer | 15:04 |
dansmith | mriedem: cdent: meaning, we'd have to always have at least one reserved vcpu | 15:04 |
cdent | more likely to have successful claims more often | 15:04 |
mriedem | dansmith: today in _compute_node_to_inventory_dict in the scheduler report client we don't reserve any vcpu | 15:05 |
dansmith | right | 15:05 |
cdent | dansmith: I believe you, but why? | 15:05 |
dansmith | cdent: because libvirt needs to have vcpu+1 if certain flavor configs are set | 15:05 |
cdent | ah, okay | 15:05 |
* edleafe almost jinxed cdent's question | 15:05 | |
*** eharney has joined #openstack-nova | 15:05 | |
dansmith | cdent: if you ask for dedicated io threads or something, then it requires another vcpu dedicated to you to handle that | 15:06 |
mriedem | dansmith: cdent: thinking ahead, _compute_node_to_inventory_dict is only used for the old style driver.get_available_resource call, | 15:06 |
dansmith | cdent: which is really expensive, and probably unfortunate for people that don't want that, so we'd need a way to not reserve the last vcpu on a system for people that don't want it | 15:06 |
mriedem | with get_inventory() we could make the reservation calculation in the virt drivers that actually do this overhead thing | 15:06 |
cdent | yes | 15:06 |
dansmith | sure, but libvirt needs to not do that if the operator doesn't want it, | 15:07 |
dansmith | because they may have no flavors configured for this dedicated thing, | 15:07 |
dansmith | and we don't want to prevent them from using their last vcpu :) | 15:07 |
mriedem | are you talking to me or cdent? | 15:07 |
cdent | how much does that matter (the last vcpu) | 15:07 |
dansmith | you | 15:07 |
cdent | mriedem: yes, about get_inventory, I like get_inventory | 15:07 |
dansmith | heh | 15:08 |
dansmith | cdent: vcpus are few | 15:08 |
dansmith | cdent: compared to memory or disk | 15:08 |
bauzas | sorry, in a meeting atm | 15:08 |
dansmith | cdent: imagine a cloud of 4-core ARM boxes | 15:08 |
dansmith | where you lose one core per system | 15:08 |
cdent | are we losing a pcpu or a vcpu? | 15:08 |
mriedem | dansmith: "libvirt needs to not do that if the operator doesn't want it," - we just take that into account in the libvirt get_inventory() method don't we? | 15:09 |
mriedem | when determining the reserved value for the VCPU resource provider inventory? | 15:09 |
dansmith | mriedem: yeah, it just has to be configurable | 15:09 |
cdent | (physical, not pinned) | 15:09 |
dansmith | mriedem: and we don't have that currently, AFAIK | 15:09 |
dansmith | mriedem: we have reserved disk and memory only right? | 15:09 |
mriedem | dansmith: as far as i know | 15:09 |
mriedem | but i learn new terrible things every day :) | 15:09 |
dansmith | cdent: pcpu in the case of \this dedicated thing | 15:09 |
*** sree has joined #openstack-nova | 15:09 | |
*** iceyao has joined #openstack-nova | 15:10 | |
cdent | dansmith: gotchya | 15:10 |
namnh | Hi everyone, I am reading the rolling upgrade in Nova, there is a point that make me confuse. According to the docs, we have to gracefully shutdown all Nova services except nova-compute. In my understanding, this will ensures no old server (like nova-api, nova-conductor, nova-scheduler) won't interact with new schema DB. | 15:11 |
namnh | But in the docs was written "Install the code for the next version of Nova, either in a venv or a separate control plane node, including all the python dependencies. Using the newly installed nova code, run the DB sync. (nova-manage db sync; nova-manage api_db sync)." it means there will have period, old services interact with new schema DB. Could you please explain for me this point? | 15:11 |
*** Oku_OS is now known as Oku_OS-away | 15:11 | |
namnh | Here is the docs: https://docs.openstack.org/developer/nova/upgrade.html#minimal-downtime-upgrade-process | 15:11 |
edleafe | dansmith: so those who are configuring flavors this way are already sacrificed a pcpu now, right? IOW, this wouldn't change it? | 15:11 |
edleafe | s/sacrificed/sacrificiing | 15:11 |
dansmith | namnh: nova compute does not talk to the db directly, so it won't touch the different schema | 15:12 |
dansmith | edleafe: they are, but only at claim time, not at reserved-for-the-future time | 15:12 |
dansmith | edleafe: since that is not config, but a flavor setting, we need a config to know if we _should_ reserve that or not | 15:12 |
edleafe | dansmith: ok, but in your 4 core example, they can only use 3 in either case | 15:13 |
dansmith | and of course, we should validate all this with the people that wrote this code :) | 15:13 |
dansmith | edleafe: but people that don't use that dedicated thing.. those are the ones we careabout | 15:13 |
dansmith | edleafe: because we don't want to reserve (and thus never schedule to) the fourth cpu | 15:13 |
*** sree has quit IRC | 15:13 | |
edleafe | dansmith: so maybe add a config option to compute: WASTE_PCPU = True | 15:14 |
*** psachin has quit IRC | 15:14 | |
edleafe | :) | 15:14 |
dansmith | edleafe: exactly what I'm saying | 15:14 |
edleafe | and these are a small minority of deployments? | 15:14 |
*** iceyao has quit IRC | 15:15 | |
namnh | dansmith: Yes, I know. we just have to gracefully shutdown all nova server *except* nova-compute. And in my understading, we have to do that to ensure no nova service (like nova-api, nova-condutor, nova-scheduler) can interact with new schema DB | 15:16 |
dansmith | I would definitely imagine so | 15:16 |
dansmith | edleafe: it's an expensive change to make RT performance better | 15:16 |
namnh | dansmith: is that right? | 15:16 |
namnh | s/server/services | 15:16 |
gcb | mriedem, for the first issue you mentioned in the email , we can revert the change of file https://review.openstack.org/#/c/457188/3/nova/tests/unit/virt/ironic/test_driver.py | 15:16 |
dansmith | namnh: no, you can apply the schema change before you shut down the control services | 15:16 |
mriedem | the schema changes are always additive so it shouldn't matter right? | 15:17 |
dansmith | namnh: that's why the docs say "or venv". You can apply the schema before you do anything, then shut down and upgrade your control services at the same time, then start on computes | 15:17 |
dansmith | mriedem: right | 15:17 |
gcb | mriedem, I have no idea why it fails randomly now | 15:17 |
mriedem | gcb: melwitt is going to re-write the test | 15:17 |
*** satyar has quit IRC | 15:17 | |
*** satyar has joined #openstack-nova | 15:18 | |
gcb | mriedem, good to know that, for the second issue, when the issue occurred ? From the Monday ? | 15:18 |
mriedem | namnh: see the 3rd bullet there which says "At this point, new columns and tables may exist in the database. These DB schema changes are done in a way that both the N and N+1 release can perform operations against the same schema." | 15:18 |
*** amotoki has quit IRC | 15:19 | |
mriedem | namnh: meaning the schema changes are all additive and won't break old code running against them, | 15:19 |
mriedem | like any new column is always nullable | 15:19 |
mriedem | and we don't drop columns | 15:19 |
*** jamesdenton has quit IRC | 15:19 | |
namnh | dansmith: so why we have to shutdown all nova services (except nova-compute)? due to RPC or something? | 15:20 |
dansmith | namnh: you only have to shut them down when you upgrade them, and all of them have to be shutdown together | 15:20 |
dansmith | namnh: what you can't have is nova-api and nova-scheduler on different *code* versions accessing the database at the same time | 15:21 |
mriedem | "For maximum safety (no failed API operations)," | 15:22 |
dansmith | it says that? | 15:22 |
mriedem | namnh: the control services have code in place to check versions of the computes since we support mixed level computes, but we don't for the control services | 15:22 |
mriedem | dansmith: yeah | 15:22 |
dansmith | that's not really the reason | 15:22 |
mriedem | see step 2 bullet 1 | 15:22 |
dansmith | maybe that's easier to understand than the real reason, I dunno | 15:23 |
* dansmith goes to see if he wrote that | 15:23 | |
namnh | dansmith mriedem: if possible, could you give me an example for error when nova-api and nova-scheduler on different *code* versions accessing the database at the same time? | 15:24 |
*** armax has joined #openstack-nova | 15:24 | |
dansmith | namnh: data corruption | 15:24 |
dansmith | seriously, don't do it | 15:24 |
namnh | dansmith: ok, I understood. Thanks for your time. | 15:26 |
*** gszasz has quit IRC | 15:26 | |
*** baoli has joined #openstack-nova | 15:26 | |
*** pcaruana has quit IRC | 15:28 | |
namnh | mriedem: I just have understood. thanks | 15:28 |
*** ijw has joined #openstack-nova | 15:28 | |
*** chyka has joined #openstack-nova | 15:30 | |
*** eharney has quit IRC | 15:30 | |
*** iceyao has joined #openstack-nova | 15:30 | |
*** baoli has quit IRC | 15:30 | |
*** kfarr has joined #openstack-nova | 15:31 | |
*** Sukhdev has joined #openstack-nova | 15:31 | |
*** gszasz has joined #openstack-nova | 15:32 | |
*** hurricanerix has quit IRC | 15:32 | |
*** ijw has quit IRC | 15:32 | |
*** iceyao has quit IRC | 15:35 | |
*** zenoway has quit IRC | 15:36 | |
*** Sukhdev_ has joined #openstack-nova | 15:37 | |
*** chyka_ has joined #openstack-nova | 15:37 | |
*** chyka has quit IRC | 15:40 | |
*** david-lyle has quit IRC | 15:41 | |
*** dr_gogeta86 has joined #openstack-nova | 15:43 | |
dr_gogeta86 | hi | 15:45 |
dr_gogeta86 | how can I force a compute node up | 15:45 |
dr_gogeta86 | ? | 15:45 |
dr_gogeta86 | i've also rebooted many times but is always down | 15:45 |
efried | andymccr https://review.openstack.org/#/c/455710/12 - Pretty. So pretty. | 15:47 |
imacdonn | dr_gogeta86, I think you're supposed to ask questions like that (i.e. how to make it work, not regarding code development) in #openstack | 15:47 |
imacdonn | see topic ;) | 15:47 |
dr_gogeta86 | sorry | 15:48 |
imacdonn | np | 15:48 |
efried | dr_gogeta86 Yeah, what imacdonn said - but, check your n-cpu log | 15:48 |
*** namnh has quit IRC | 15:48 | |
efried | Sounds like compute service is failing to start or check in. | 15:48 |
cdent | efried: "save, like, five whole lines of code" <- my favorite review comment today, can hear it in my head | 15:49 |
efried | cdent :) | 15:49 |
*** damien_r has quit IRC | 15:51 | |
dr_gogeta86 | efried, imacdonn tnx | 15:51 |
mriedem | cdent: to answer your question in the spec, i don't think we account for overheads when commiting the quota reservation | 15:51 |
mriedem | cdent: because the quota reservation is created in the api based on the flavor, | 15:52 |
cdent | mriedem: that's what I figured, thus my concern | 15:52 |
cdent | thanks for confirming it | 15:52 |
mriedem | cdent: then the reservation id for the quota is passed through to compute | 15:52 |
mriedem | and if the claim is good, we commit the reservation on the compute | 15:52 |
mriedem | but we don't modify it at all | 15:52 |
*** ociuhandu has quit IRC | 15:52 | |
cdent | so if we make allocations be the true count, if they include overhead, user is going to be doing WTF sometimes | 15:53 |
*** chyka has joined #openstack-nova | 15:53 | |
mriedem | now that i say this, i don't see us passing reservations to build_and_run_instance | 15:53 |
mriedem | so i'm digging | 15:53 |
cdent | gyres within gyres | 15:53 |
*** markus_z has quit IRC | 15:53 | |
cdent | what rough quota, its limit come round at last | 15:54 |
*** yamahata has joined #openstack-nova | 15:54 | |
*** smatzek has quit IRC | 15:56 | |
*** mlavalle has joined #openstack-nova | 15:56 | |
mriedem | cdent: so i was totally wrong | 15:56 |
mriedem | we commit the reservations in the api | 15:56 |
mriedem | in the _provision_instances method | 15:56 |
*** vks1 has quit IRC | 15:57 | |
*** chyka_ has quit IRC | 15:57 | |
cdent | mriedem: that sounds like only partially wrong | 15:57 |
mriedem | either way we don't consider the overhead in the quota | 15:57 |
mriedem | quota usage i mean | 15:57 |
mriedem | had to fix that before melwitt dropped the 'quota usage' hammer on me | 15:57 |
*** eharney has joined #openstack-nova | 15:57 | |
*** omkar_telee_ has quit IRC | 15:57 | |
melwitt | lol | 15:58 |
cdent | so many hammers, so few channels | 15:59 |
*** Jack_Iv has quit IRC | 15:59 | |
*** tesseract has quit IRC | 15:59 | |
mriedem | ok, so yeah if we don't account for the overhead in the quota usage, | 16:00 |
mriedem | but we did in the allocation, | 16:00 |
*** Jack_Iv has joined #openstack-nova | 16:00 | |
mriedem | and we start using allocations (quota usage) for counting quotas stuff that mel is doing, | 16:00 |
mriedem | we're in a bind | 16:00 |
mriedem | because horizon shows me that i have 4GB of memory quota left, but the allocation is really 4GB + 256MB RAM | 16:01 |
mriedem | however, that's already the state we're in today | 16:01 |
mriedem | you're getting that extra overhead from the flavor w/o paying for it | 16:01 |
mriedem | if we account for the overhead in the allocations, and we use allocations for reporting quota, then we actually fix that hole don't we? | 16:02 |
mriedem | so you can bill your customers based on real usage? | 16:02 |
cdent | people will not like that change | 16:02 |
mriedem | define people | 16:02 |
cdent | end users | 16:02 |
cdent | "yesterday i was able to do X but today I can do x-1" | 16:03 |
mriedem | i imagine cloud providers would like it though | 16:03 |
mriedem | more cash for the utility company | 16:03 |
cdent | yeah, like tron or whatever, I fight for the users | 16:03 |
*** tommylikehu_ has joined #openstack-nova | 16:03 | |
*** Jack_Iv has quit IRC | 16:04 | |
*** mdrabe has quit IRC | 16:04 | |
mriedem | cdent: just once, join evil corp | 16:04 |
melwitt | "we fixed the glitch" | 16:04 |
*** tommylikehu_ has quit IRC | 16:04 | |
mriedem | bauzas: dansmith: jaypipes: i left a summary in the spec | 16:04 |
mriedem | https://review.openstack.org/#/c/437424/ | 16:05 |
cdent | mriedem: I'm not sure I have any soul left to sell | 16:05 |
*** tjones has joined #openstack-nova | 16:05 | |
jaypipes | mriedem: danke | 16:05 |
mriedem | at a high level i feel like we should be accounting for the overhead (real usage) in the allocations | 16:05 |
mriedem | which would also benefit the initial select_destinations since placement has the whole story for actual allocations on a provider | 16:05 |
hypothermic_cat | lyarwood: hi, are you around? | 16:05 |
*** gszasz has quit IRC | 16:06 | |
lyarwood | hypothermic_cat: hey, what's up? | 16:06 |
*** dave-mccowan has joined #openstack-nova | 16:06 | |
mriedem | i agree that over-estimating the reserved inventory buffer is an easier solution on us, but it also means operators have to be taking that into consideration now when configuring the comptues and doing capacity planning | 16:06 |
cdent | only if we don't automate it (through magic yet to be determined) | 16:07 |
dansmith | mriedem: unless we inflate the reserved amount ourselves | 16:07 |
dansmith | right | 16:07 |
mriedem | yeah i don't know how we do that yet | 16:07 |
bauzas | mriedem: okay, will read it | 16:07 |
mriedem | this is definitely fodder for the forum session on claims in the scheduler | 16:07 |
bauzas | and will try to make a new rev soon-ish | 16:07 |
melwitt | I don't remember what the "overhead" is. I've seen it before in the RT | 16:07 |
mriedem | melwitt: see estimate_instance_overhead in the virt drivers | 16:08 |
melwitt | or the virt driver | 16:08 |
*** mdrabe has joined #openstack-nova | 16:08 | |
*** lucasagomes is now known as lucas-afk | 16:08 | |
bauzas | melwitt: don't put your foot into that ... :p | 16:08 |
mriedem | it's related to quota so melwitt has to put both feet in | 16:08 |
melwitt | I have before but then I forgot, so I guess I'm safe | 16:08 |
*** mnestratov has quit IRC | 16:08 | |
bauzas | or take the left one, if you want to be lucky | 16:08 |
dansmith | mind the boots | 16:09 |
mriedem | i was going to say, | 16:09 |
mriedem | it would have to be deep to get up over the boots | 16:09 |
melwitt | hah, yeah. feet protection | 16:09 |
*** dmk0202 has quit IRC | 16:09 | |
bauzas | I should consider that for myself | 16:09 |
hypothermic_cat | lyarwood: I split the dteach patch into a zillion small ones: https://review.openstack.org/#/q/topic:bp/cinder-new-attach-apis | 16:10 |
* cdent reminds mriedem behind his hands that it is "quota usage" | 16:10 | |
melwitt | it feels weird to think of taking up more quota usage than the flavor says though | 16:10 |
bauzas | yup | 16:10 |
bauzas | and it would expose the hypervisor usage to the users, nope ? | 16:10 |
melwitt | so I don't think I would be for that | 16:10 |
bauzas | melwitt: +1 | 16:10 |
hypothermic_cat | lyarwood: and I remember you asked about it earlier and was wondering whether you have bandwidth to look into any of those :) | 16:10 |
*** mvk has quit IRC | 16:11 | |
bauzas | I think we should not impact the quota usage by that, or it would expose some internal consumption logic for the end-user, nope ? | 16:11 |
bauzas | if I was nasty, I'd guess which host I'm in if I'm able to see my quota decrease differently | 16:11 |
bauzas | at leasy | 16:11 |
dansmith | if we increase our allocations, that's how it would manifest | 16:11 |
dansmith | which is another reason why hiding it in reserved is better | 16:11 |
dansmith | IMHO | 16:11 |
lyarwood | hypothermic_cat: I will tomorrow morning, I've been stuck downstream all week but I'll make time to reviews these in the morning. mdbooth, johnthetubaguy & mriedem ^ might also want to look at these prior to the meeting tomorrow. | 16:12 |
openstackgerrit | Mikhail Feoktistov proposed openstack/nova master: Remove fstype param from ploop init https://review.openstack.org/444970 | 16:12 |
bauzas | dansmith: maybe | 16:12 |
bauzas | if we try to merge quotas with placement | 16:12 |
dansmith | bauzas: we're doing that | 16:12 |
bauzas | I know | 16:12 |
bauzas | speaking out loud | 16:12 |
hypothermic_cat | lyarwood: additional tests are on their way for the base detach changes | 16:12 |
mriedem | dansmith: bauzas: melwitt: ok i didn't think about that part, so reply in the spec i suppose | 16:13 |
bauzas | dansmith: FWIW I tried to advocate way earlier this morning that I'm in favor of decrementing the total left amount than fixing the allocation | 16:13 |
hypothermic_cat | lyarwood: I'm stuck a bit too this week, I need to find more people, who could look into the code :) | 16:13 |
bauzas | dansmith: unrelated, I have a couple of comments on your cells-aware series | 16:14 |
bauzas | both can be me being wrong | 16:14 |
*** nic has joined #openstack-nova | 16:15 | |
*** eantyshev has joined #openstack-nova | 16:15 | |
rfolco | cdent, quick question: I am doing a cleanup on inventory.py replacing http error msg from db api with specific messages, like here: https://github.com/openstack/nova/blob/master/nova/api/openstack/placement/handlers/inventory.py#L409 - should we do this for other cases like BadRequest ? | 16:16 |
*** dtp has joined #openstack-nova | 16:16 | |
dansmith | bauzas: one is why my devstack patch is failing :D | 16:17 |
bauzas | I'M NOT WRONG, WOOOOT! | 16:17 |
* bauzas should make a t-shirt | 16:17 | |
*** felipemonteiro_ has joined #openstack-nova | 16:17 | |
cdent | rfolco: just a sec, catching up | 16:18 |
dansmith | bauzas: no, you're still wrong | 16:18 |
dansmith | no t-shirt for you | 16:18 |
* bauzas facepalms | 16:18 | |
bauzas | dansmith: L71 ? | 16:19 |
*** david-lyle has joined #openstack-nova | 16:19 | |
bauzas | how come ? | 16:19 |
dansmith | bauzas: no, L71.5 | 16:19 |
rfolco | cdent, more context: would be an extension of https://review.openstack.org/#/c/436773 | 16:19 |
*** gszasz has joined #openstack-nova | 16:19 | |
bauzas | dansmith: excuse my ignorance, but what is L71.5 ? | 16:19 |
cdent | rfolco: yeah, the general idea is to not expose the database error in the exception message, throughout the placement service | 16:19 |
dansmith | bauzas: the line between 71 and 72 | 16:20 |
cdent | rfolco: sometimes the exception message will already be good, other times not. it depends on the exception that's coming from the object level: it's inconsistent | 16:20 |
bauzas | like the platform 9 3/4 ? | 16:20 |
melwitt | yeeeah | 16:20 |
cdent | rfolco: in general the goal is to make the message that the end user sees less annoying, so use that as your guide | 16:20 |
*** felipemonteiro has quit IRC | 16:20 | |
cdent | rfolco: but unfortunately I need to go, house guests just showed up... | 16:21 |
dansmith | bauzas: I don't get that reference, but.. probably? | 16:21 |
rfolco | cdent, that helped. Thanks. | 16:21 |
melwitt | dansmith: you don't know ... harry potter?? | 16:21 |
cdent | rfolco: add me to the review(s) when stuff's ready please, so I can be sure to look at them and also to add them to the weekly email | 16:21 |
*** cdent has quit IRC | 16:21 | |
dansmith | melwitt: never seen it | 16:21 |
melwitt | omg | 16:22 |
bauzas | melwitt: seriously, he doesn't loose a lot | 16:22 |
dansmith | melwitt: well, I watched five minutes of it, and couldn't handle it | 16:22 |
*** gongysh has quit IRC | 16:22 | |
dansmith | LOTR and harry potter, I just can't stomach | 16:22 |
bauzas | dansmith: dammit, the platform 9 3/4 was shown at 10 mins after the beginning | 16:22 |
dansmith | oh well :) | 16:22 |
*** ltomasbo is now known as ltomasbo|away | 16:23 | |
bauzas | either way, I have to change my glasses this week | 16:24 |
bauzas | so probably I'll review better | 16:24 |
*** dimtruck is now known as zz_dimtruck | 16:24 | |
*** zz_dimtruck is now known as dimtruck | 16:25 | |
dansmith | bauzas: in my defense, the tests did add a cell, but I neglected to create the instance in the new cell, so .. I intended to have coverage to prove I was doing the right thing, I just failed.. twice | 16:25 |
*** dharinic has joined #openstack-nova | 16:26 | |
*** ijw has joined #openstack-nova | 16:29 | |
*** dharinic has quit IRC | 16:31 | |
*** kaisers has quit IRC | 16:32 | |
*** kaisers has joined #openstack-nova | 16:32 | |
*** karimb has quit IRC | 16:34 | |
*** ijw has quit IRC | 16:34 | |
*** aarefiev is now known as aarefiev_afk | 16:35 | |
openstackgerrit | melanie witt proposed openstack/nova master: Mock timeout in test__get_node_console_with_reset_wait_timeout https://review.openstack.org/458161 | 16:35 |
*** yamahata has quit IRC | 16:36 | |
*** kaisers has quit IRC | 16:37 | |
mriedem | dansmith: is this for the server groups thing? | 16:37 |
dansmith | yeah | 16:37 |
mriedem | could just write a functional test instead, | 16:38 |
*** jheroux has joined #openstack-nova | 16:38 | |
mriedem | i'm finding that's easier with some of the api driven stuff and multi-cell | 16:38 |
dansmith | mriedem: this one is basically functional.. uses the actual db | 16:38 |
dansmith | mriedem: it didn't catch it because I made the same mistake in the test as the code | 16:38 |
*** Swami has quit IRC | 16:39 | |
*** Apoorva has joined #openstack-nova | 16:40 | |
*** smatzek has joined #openstack-nova | 16:43 | |
melwitt | mriedem: I wonder if there's a bug in the backoff looping timer, it doesn't make sense that it wouldn't time out at all | 16:45 |
melwitt | it's supposed to end early if the backoff would put it over the specified timeout | 16:45 |
openstackgerrit | Dan Smith proposed openstack/nova master: Make server groups api aware of multiple cells for membership https://review.openstack.org/457338 | 16:46 |
openstackgerrit | Dan Smith proposed openstack/nova master: Sort CellMappingList.get_all() for safety https://review.openstack.org/443174 | 16:46 |
openstackgerrit | Dan Smith proposed openstack/nova master: Clean up ClientRouter debt https://review.openstack.org/444487 | 16:46 |
openstackgerrit | Dan Smith proposed openstack/nova master: Add workaround to disable group policy check upcall https://review.openstack.org/442736 | 16:46 |
mriedem | melwitt: i didn't dig into how the jitter stuff works in there | 16:46 |
melwitt | yeah. I'm looking at it out of curiosity | 16:46 |
mriedem | melwitt: i figured maybe there was a bug in the fake stub method logic | 16:46 |
mriedem | but didn't dig into it | 16:47 |
melwitt | hm, yeah | 16:47 |
melwitt | I was thinking we shouldn't be doing real timeouts anyway, but it doesn't make sense that it wouldn't time out that way too | 16:47 |
openstackgerrit | Feodor Tersin proposed openstack/nova master: Implement ScaleIO image backend https://review.openstack.org/407440 | 16:50 |
*** gjayavelu has joined #openstack-nova | 16:51 | |
*** david-lyle has quit IRC | 16:51 | |
*** felipemonteiro_ has quit IRC | 16:53 | |
openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Fix typo in deprecate-os-hosts spec https://review.openstack.org/458165 | 16:53 |
*** amotoki has joined #openstack-nova | 16:54 | |
*** salv-orlando has joined #openstack-nova | 16:54 | |
*** tjones has left #openstack-nova | 16:55 | |
*** kaisers has joined #openstack-nova | 16:57 | |
*** kaisers_ has joined #openstack-nova | 16:58 | |
*** sambetts is now known as sambetts|afk | 17:00 | |
*** kaisers has quit IRC | 17:02 | |
*** ralonsoh has quit IRC | 17:02 | |
*** kaisers_ has quit IRC | 17:02 | |
*** derekh has quit IRC | 17:05 | |
*** Sukhdev_ has quit IRC | 17:07 | |
*** hieulq_ has joined #openstack-nova | 17:10 | |
*** moshele has joined #openstack-nova | 17:10 | |
dansmith | gdi py35 | 17:13 |
*** harlowja_ has quit IRC | 17:13 | |
*** moshele has quit IRC | 17:14 | |
*** marst_ has joined #openstack-nova | 17:14 | |
*** harlowja has joined #openstack-nova | 17:15 | |
*** kaisers has joined #openstack-nova | 17:15 | |
*** harlowja has quit IRC | 17:17 | |
*** harlowja has joined #openstack-nova | 17:17 | |
*** marst has quit IRC | 17:17 | |
*** efoley__ has quit IRC | 17:18 | |
*** sdague has quit IRC | 17:19 | |
*** xyang1 has quit IRC | 17:19 | |
*** karimb has joined #openstack-nova | 17:24 | |
*** toure has joined #openstack-nova | 17:24 | |
*** ijw has joined #openstack-nova | 17:30 | |
*** yamahata has joined #openstack-nova | 17:30 | |
*** kaisers has quit IRC | 17:30 | |
*** kaisers has joined #openstack-nova | 17:31 | |
*** ijw has quit IRC | 17:35 | |
*** kaisers has quit IRC | 17:35 | |
*** kaisers has joined #openstack-nova | 17:35 | |
*** ijw has joined #openstack-nova | 17:36 | |
*** karimb has quit IRC | 17:36 | |
*** iceyao has joined #openstack-nova | 17:37 | |
*** felipemonteiro has joined #openstack-nova | 17:41 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Deprecate os-hosts API https://review.openstack.org/456504 | 17:41 |
mriedem | ^ is doctastic | 17:41 |
*** iceyao has quit IRC | 17:41 | |
*** sudipto has quit IRC | 17:43 | |
*** sudipto has joined #openstack-nova | 17:43 | |
*** sudipto has quit IRC | 17:44 | |
*** hieulq_ has quit IRC | 17:44 | |
*** Vishal_ has joined #openstack-nova | 17:46 | |
*** Vishal_ has quit IRC | 17:46 | |
*** kaisers has quit IRC | 17:47 | |
*** catintheroof has quit IRC | 17:47 | |
*** jpena is now known as jpena|off | 17:49 | |
*** jaosorior is now known as jaosorior_away | 17:54 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/458185 | 17:54 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-vif master: Updated from global requirements https://review.openstack.org/451049 | 17:56 |
*** xyang1 has joined #openstack-nova | 17:58 | |
*** jamesden_ has joined #openstack-nova | 17:59 | |
*** jvgrant_ has joined #openstack-nova | 18:02 | |
*** jvgrant_ has left #openstack-nova | 18:02 | |
*** fragatin_ has quit IRC | 18:02 | |
*** sdague has joined #openstack-nova | 18:03 | |
*** fragatina has joined #openstack-nova | 18:05 | |
openstackgerrit | Steve Noyes proposed openstack/nova master: Add Cinder V3 Detach calls https://review.openstack.org/438750 | 18:12 |
*** voelzmo has joined #openstack-nova | 18:15 | |
*** kaisers has joined #openstack-nova | 18:15 | |
*** claudiub has quit IRC | 18:16 | |
*** gszasz has quit IRC | 18:17 | |
*** mlavalle has quit IRC | 18:18 | |
dansmith | I see melwitt pushed up the revised quotapalooza | 18:19 |
dansmith | I'm glad, but also sad, 'cause now we have to review it | 18:19 |
*** adisky_ has quit IRC | 18:19 | |
mriedem | i think my afternoon just got busy with something else... | 18:21 |
*** mlavalle has joined #openstack-nova | 18:22 | |
mriedem | do we want/need to get the placement usages API stuff in first? | 18:22 |
mriedem | before counting quotas? | 18:22 |
dansmith | I think she's got it so it can count inefficiently without placement | 18:23 |
dansmith | iirc | 18:23 |
mriedem | alright | 18:23 |
dansmith | we really can't miss landing this this cycle, so whatever makes the most sense time-wise I guess | 18:23 |
mriedem | i wanted something easier to review | 18:23 |
melwitt | sorry peeps | 18:23 |
mriedem | oh we can miss it | 18:23 |
mriedem | we can miss it real good | 18:23 |
*** satyar has quit IRC | 18:25 | |
*** Jack_Iv has joined #openstack-nova | 18:28 | |
hypothermic_cat | lyarwood: mriedem: johnthetubaguy: this one for the new detach flow is ready for review: https://review.openstack.org/#/c/438750/ | 18:28 |
hypothermic_cat | I will add it to the etherpad too | 18:28 |
mriedem | ok | 18:29 |
mriedem | hypothermic_cat: doesn't the commit message need updating? | 18:29 |
*** catinthe_ has joined #openstack-nova | 18:30 | |
*** amotoki has quit IRC | 18:30 | |
hypothermic_cat | mriedem: bah, yes, that should be too :) | 18:31 |
mriedem | let me go through the rest first | 18:31 |
hypothermic_cat | mriedem: or well, actually I updated it | 18:31 |
mriedem | "for each case of terminate_connection" is wrong | 18:32 |
hypothermic_cat | mriedem: but I can remove the "overview" part from it as it seems to be confusing | 18:32 |
mriedem | yeah, just don't change anything yet | 18:33 |
*** fragatina has quit IRC | 18:34 | |
mriedem | hypothermic_cat: there you go, comments inline | 18:39 |
*** catinthe_ has quit IRC | 18:39 | |
*** gyee has joined #openstack-nova | 18:40 | |
mriedem | hypothermic_cat: i'm confused about the changes, are they not in a series? | 18:41 |
mriedem | you're going to have conflicts if those aren't done in a series | 18:42 |
hypothermic_cat | mriedem: I tried not to have a like 8 patches long series to be able to get more hands on the code, etc | 18:42 |
hypothermic_cat | mriedem: that's a pain to maintain | 18:42 |
mriedem | conflicts aren't fun either | 18:42 |
hypothermic_cat | these are small changes there won't be that much conflict | 18:42 |
hypothermic_cat | I have a few that have a common base | 18:42 |
mriedem | ok i was thinking more about the crud operations in nova/volume/cinder.py | 18:43 |
mriedem | those are common and should be at the bottom of the series | 18:43 |
hypothermic_cat | if we can get the base in then there's at least two IIRC that can be independent from the rest for instance | 18:43 |
hypothermic_cat | mriedem: those are only in this base detach patch right now | 18:44 |
mriedem | ok i asked for the attachment_update one to be split out of that change | 18:44 |
mriedem | until it's used | 18:44 |
hypothermic_cat | mriedem: I should've marked the other as WIP, will do that a bit later | 18:44 |
mriedem | which is why i figured things were in a series | 18:44 |
*** nicolasbock has quit IRC | 18:45 | |
hypothermic_cat | hmm, I think we don't even use that right now, so I might simply need to delete it | 18:45 |
hypothermic_cat | as we have delete and create for things like swap | 18:45 |
*** lucasxu has joined #openstack-nova | 18:45 | |
*** kaisers has quit IRC | 18:45 | |
*** kaisers has joined #openstack-nova | 18:48 | |
*** nicolasbock has joined #openstack-nova | 18:55 | |
*** gyee has quit IRC | 18:55 | |
*** Sukhdev has quit IRC | 18:56 | |
*** Jack_Iv has quit IRC | 18:57 | |
*** Jack_Iv has joined #openstack-nova | 18:57 | |
*** tbachman has quit IRC | 18:58 | |
*** Jack_Iv has quit IRC | 18:59 | |
*** Jack_Iv has joined #openstack-nova | 18:59 | |
*** MasterOfBugs has joined #openstack-nova | 19:03 | |
*** sree has joined #openstack-nova | 19:06 | |
*** david-lyle has joined #openstack-nova | 19:06 | |
*** yingwei has quit IRC | 19:06 | |
*** lucasxu has quit IRC | 19:08 | |
*** lucasxu has joined #openstack-nova | 19:09 | |
*** sree has quit IRC | 19:10 | |
*** fragatina has joined #openstack-nova | 19:15 | |
*** david-lyle_ has joined #openstack-nova | 19:17 | |
*** david-lyle has quit IRC | 19:17 | |
*** eharney has quit IRC | 19:18 | |
*** claudiub has joined #openstack-nova | 19:22 | |
*** Jack_Iv has quit IRC | 19:26 | |
*** Jack_Iv has joined #openstack-nova | 19:27 | |
*** gyee has joined #openstack-nova | 19:27 | |
*** Jack_Iv has quit IRC | 19:28 | |
*** Jack_Iv has joined #openstack-nova | 19:28 | |
*** eharney has joined #openstack-nova | 19:33 | |
*** kfarr has quit IRC | 19:42 | |
*** Jack_Iv has quit IRC | 19:43 | |
*** iceyao has joined #openstack-nova | 19:44 | |
*** Jack_Iv has joined #openstack-nova | 19:44 | |
*** Jack_Iv has quit IRC | 19:44 | |
*** voelzmo has quit IRC | 19:44 | |
*** dmk0202 has joined #openstack-nova | 19:47 | |
*** iceyao has quit IRC | 19:48 | |
*** awaugama has quit IRC | 19:49 | |
*** pchavva has quit IRC | 19:51 | |
*** david-lyle_ has quit IRC | 19:52 | |
*** voelzmo has joined #openstack-nova | 19:57 | |
*** Apoorva has quit IRC | 19:57 | |
*** catintheroof has joined #openstack-nova | 19:59 | |
*** voelzmo has quit IRC | 20:02 | |
*** iceyao has joined #openstack-nova | 20:03 | |
*** kfarr has joined #openstack-nova | 20:03 | |
*** annegentle has quit IRC | 20:07 | |
*** iceyao has quit IRC | 20:08 | |
*** cdent has joined #openstack-nova | 20:08 | |
*** lucasxu has quit IRC | 20:13 | |
*** lucasxu has joined #openstack-nova | 20:14 | |
*** damien_r has joined #openstack-nova | 20:14 | |
*** cdent has quit IRC | 20:17 | |
openstackgerrit | Feodor Tersin proposed openstack/nova master: libvirt: Use config types to parse XML for instance disks https://review.openstack.org/410667 | 20:18 |
openstackgerrit | Feodor Tersin proposed openstack/nova master: libvirt: Add missing tests for utils.find_disk https://review.openstack.org/414750 | 20:18 |
openstackgerrit | Feodor Tersin proposed openstack/nova master: libvirt: Use config types to parse XML for root disk https://review.openstack.org/411941 | 20:18 |
*** felipemonteiro has quit IRC | 20:18 | |
jaypipes | mriedem, dansmith: any chance either of you would be able to review https://review.openstack.org/#/c/448282/ and series? :) | 20:18 |
dansmith | jaypipes: like you're looking for odds or what? | 20:19 |
dansmith | I'd say about 33% | 20:19 |
*** tbachman has joined #openstack-nova | 20:19 | |
jaypipes | dansmith: fair enough :) | 20:20 |
mriedem | jaypipes: once i get my state of the union for pike-1 email done | 20:21 |
jaypipes | cheers | 20:22 |
*** karimb has joined #openstack-nova | 20:23 | |
*** iceyao has joined #openstack-nova | 20:24 | |
dansmith | jaypipes: say yes to my comment on the bottom patch and I will approve | 20:28 |
*** Apoorva has joined #openstack-nova | 20:28 | |
*** iceyao has quit IRC | 20:29 | |
jaypipes | dansmith: you mean like this? https://github.com/openstack/os-traits/blob/master/os_traits/__init__.py#L27 | 20:29 |
dansmith | jaypipes: but accessible from the command line | 20:30 |
jaypipes | dansmith: sure I can add that. | 20:30 |
dansmith | maybe just make this do it: "python -mos_traits" | 20:30 |
*** sneti_ has joined #openstack-nova | 20:30 | |
*** sneti_ has quit IRC | 20:30 | |
jaypipes | dansmith: yep, I can add a patch that does that. | 20:31 |
*** ngupta has quit IRC | 20:31 | |
*** liverpooler has quit IRC | 20:31 | |
dansmith | jaypipes: ack, +W | 20:31 |
jaypipes | cheers | 20:31 |
*** Sukhdev has joined #openstack-nova | 20:32 | |
openstackgerrit | Steve Noyes proposed openstack/nova master: Update detach to use V3 Cinder API https://review.openstack.org/438750 | 20:32 |
*** ijw has quit IRC | 20:37 | |
*** david-lyle_ has joined #openstack-nova | 20:38 | |
*** sdague has quit IRC | 20:38 | |
*** nkorabli has joined #openstack-nova | 20:38 | |
*** annegentle has joined #openstack-nova | 20:42 | |
dansmith | vladikr: still around? | 20:42 |
dansmith | vladikr: can you look over this and see if there's anything missing from this that we should add? https://review.openstack.org/#/c/448283/4 | 20:42 |
*** rfolco has quit IRC | 20:42 | |
vladikr | dansmith, sure, looking | 20:43 |
hypothermic_cat | mriedem: update posted, hope it looks better now | 20:52 |
*** david-lyle_ has quit IRC | 20:53 | |
*** kaisers has quit IRC | 20:53 | |
*** kaisers has joined #openstack-nova | 20:54 | |
*** catintheroof has quit IRC | 20:55 | |
*** catintheroof has joined #openstack-nova | 20:55 | |
mriedem | hypothermic_cat: ok | 20:58 |
*** cleong has quit IRC | 20:58 | |
*** kaisers has quit IRC | 20:58 | |
*** catintheroof has quit IRC | 21:00 | |
vladikr | dansmith, seems fine overall. sriov VFs can be also "trusted" by it's PF. This will allow it to set a custom mac and enter promiscuous mode | 21:00 |
*** catintheroof has joined #openstack-nova | 21:01 | |
vladikr | dansmith, perhaps it should state the function (virtual/physical)? | 21:02 |
dansmith | vladikr: I'm in another meeting, but can you just comment on the review? | 21:02 |
vladikr | sure | 21:02 |
dansmith | thanks | 21:02 |
*** edmondsw has quit IRC | 21:05 | |
*** edmondsw has joined #openstack-nova | 21:06 | |
cburgess | Does the libvirt LXC driver still work? or is that dead-ish code? | 21:06 |
*** edmondsw has quit IRC | 21:10 | |
*** thorst_ has quit IRC | 21:10 | |
*** eharney has quit IRC | 21:12 | |
*** dimtruck is now known as zz_dimtruck | 21:18 | |
*** flwang has joined #openstack-nova | 21:18 | |
*** lucasxu has quit IRC | 21:19 | |
flwang | mriedem: ping | 21:19 |
*** jheroux has quit IRC | 21:23 | |
openstackgerrit | Jon Bernard proposed openstack/nova master: Add tempest-dsvm-ceph-rc https://review.openstack.org/456292 | 21:24 |
*** catintheroof has quit IRC | 21:24 | |
mriedem | cburgess: hard to say, we have a job in the experimental queue for it, but it's never been passing - it might be better now on the kernel in 16.04 though, i think the last time i looked at it, there were kernel issues with trusty | 21:25 |
mriedem | flwang: pong | 21:25 |
cburgess | mriedem Ew ok | 21:25 |
flwang | mriedem: may i get your comments on this spec https://review.openstack.org/#/c/190919/ ? | 21:26 |
*** lucasxu has joined #openstack-nova | 21:26 | |
*** kfarr has quit IRC | 21:26 | |
flwang | especially if nova is still happy to keep the 'backup' function | 21:26 |
*** nkorabli has quit IRC | 21:26 | |
flwang | mriedem: Paul Murray commented it's not really necessary to backup a volume-backed instance, may i know your opinions? thanks | 21:27 |
*** nkorabli has joined #openstack-nova | 21:27 | |
*** smatzek has quit IRC | 21:27 | |
*** dtp has quit IRC | 21:27 | |
*** smatzek has joined #openstack-nova | 21:28 | |
flwang | mriedem: i revisited this spec because i got an email yesterday asked me why I gave up this patch, which means it's useful i think | 21:28 |
*** gouthamr has quit IRC | 21:29 | |
*** Sukhdev has quit IRC | 21:30 | |
efried | jaypipes mriedem mordred How does a guy get "the" ServiceCatalog initially? I can find APIs to ask keystone for endpoint URLs, but presumably that goes to keystone every time, and we want to load up the service catalog just once. | 21:31 |
melwitt | dansmith: I replied to your comment on the quota review. I'm not sure what to make of the Quotas object. I used it as a place to do the api/main db straddle because no other place made sense, but it's not a true object like the others | 21:31 |
*** ngupta has joined #openstack-nova | 21:31 | |
*** nkorabli has quit IRC | 21:32 | |
mordred | efried: it actually doesn't go to keystone every time | 21:32 |
jaypipes | efried: check out the code that starts here: https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L195-L198 | 21:32 |
mordred | efried: the keystoneauth functoins to ask for endpoint urls all work from the catalog - unless they need to do version discovery because of what you requested | 21:32 |
mordred | if they do need to do version discovery, that is cached | 21:33 |
efried | mordred Okay, so I can really just use endpoint URL APIs. | 21:33 |
mordred | and yes- what jaypipes pasted is a good code example | 21:33 |
mordred | yes | 21:33 |
*** david-lyle_ has joined #openstack-nova | 21:33 | |
mordred | you, in fact, _should_ use the endpoint url apis - definitely don't try to do it yourself :) | 21:33 |
*** catintheroof has joined #openstack-nova | 21:34 | |
* mordred just spent all day in a keystoneauth patch around discovery ... | 21:34 | |
efried | neat. | 21:34 |
dansmith | melwitt: do those methods need to be remoted? | 21:35 |
*** thorst has joined #openstack-nova | 21:35 | |
*** smatzek has quit IRC | 21:35 | |
melwitt | dansmith: I'm not sure. I thought the already existing update_limit and create_limit were that these should be too | 21:36 |
melwitt | *because the already existing | 21:37 |
dansmith | melwitt: are they ever called from compute? that's the reason they'd need to be remotable | 21:37 |
cfriesen | Hi folks...nova.virt.libvirt.driver.LibvirtDriver._supports_direct_io() checks whether we can mmap a 512-byte aligned block. How is this supposed to work with disks with 4K sectors? | 21:37 |
dansmith | since we're moving them to the api, I'd tend to thing not | 21:37 |
*** damien_r has quit IRC | 21:37 | |
dansmith | melwitt: the problem is returning an unversioned dict from a supposedly-versioned ovo method | 21:37 |
dansmith | melwitt: those are all expected to, in almost all cases, return a class of the object, unless they return nothing | 21:38 |
jaypipes | cfriesen: probably good to just update the code to check the block size of the local disk before that mmap check. | 21:38 |
melwitt | hm. I think in the nova-network case compute would read limits for fixed ips | 21:38 |
mriedem | flwang: i think paul's comments and questions are valid, i.e. you do backups for persistence of ephemeral disk, but if you're using volumes you already have persistence, and as john pointed out it's really an orchestration API that nova has been trying to pull away from, because we do orchestration API poorly in general (think boot from volume where nova creates a new volume, or the shelve API which is mostly broken for volum | 21:38 |
mriedem | cked instances) | 21:38 |
*** zz_dimtruck is now known as dimtruck | 21:38 | |
mriedem | flwang: so i don't have great interest in adding support to the backup api personally | 21:38 |
cfriesen | jaypipes: I was wondering if we could just unconditionally switch to 4K | 21:39 |
*** david-lyle_ has quit IRC | 21:39 | |
flwang | mriedem: ok, got it. then i may stop putting more effort on that. thanks for the comments | 21:39 |
*** ijw has joined #openstack-nova | 21:39 | |
jaypipes | cfriesen: yeah, I suppose so. not like mmap'ing 4K on a 512-byte sector disk will fail. | 21:39 |
*** thorst has quit IRC | 21:40 | |
melwitt | dansmith: I see. hm, I need to go over it again as to which things compute will call. if it needs limit objects, then I would have to add a new object QuotaLimit or something I think. currently it's just reading them from its own database | 21:40 |
mriedem | flwang: alternatively work it through the operators or product work group and see if there has been any interest for the same thing from their customers | 21:41 |
mriedem | flwang: but i've never heard of anyone that wanted this besides you :) | 21:41 |
dansmith | melwitt: I would think limits are only read from the api regardless, yeah | 21:41 |
melwitt | dansmith: compute will read them for fixed ips at least though. when allocating a fixed ip | 21:41 |
melwitt | with nova-network | 21:41 |
flwang | mriedem: haha, we do have some customers want to see a built-in/outofbox backup, since the freezer is not really ready | 21:41 |
dansmith | oh, hm | 21:41 |
dansmith | melwitt: and how does this work with the move to the api db? | 21:42 |
melwitt | floating ips might be one too, it's been awhile | 21:42 |
melwitt | dansmith: compute would have to read them from the api db until nova-network is no longer a thing | 21:42 |
mriedem | uh oh | 21:42 |
mriedem | just like server groups | 21:42 |
dansmith | if it's just for n-net, then it's not a huge deal I guess | 21:43 |
dansmith | technically a violation | 21:43 |
*** rfolco has joined #openstack-nova | 21:43 | |
dansmith | but in reality.. | 21:43 |
melwitt | yeah | 21:43 |
mriedem | flwang: yeah i understand that - some people just want nova to do all of the orchestration, and we'd prefer that nova provide the APIs so that a higher-level service can put them together as the orchestrator | 21:43 |
mriedem | flwang: which it certainly could with the snapshot api | 21:44 |
*** ijw has quit IRC | 21:44 | |
flwang | mriedem: i see and i agree it makes more sense | 21:44 |
*** shaner has quit IRC | 21:44 | |
*** shaner has joined #openstack-nova | 21:44 | |
*** slaweq has quit IRC | 21:44 | |
flwang | mriedem: yep. btw, another think i'd like to get your comments from nova view | 21:44 |
*** mvk has joined #openstack-nova | 21:44 | |
*** slaweq has joined #openstack-nova | 21:45 | |
*** Jack_Iv has joined #openstack-nova | 21:45 | |
*** jerrygb has quit IRC | 21:47 | |
flwang | if I snapshot a volume-backend instance, then after delete the image in glance, do you expect the snapshot is fully delete? | 21:49 |
*** salv-orl_ has joined #openstack-nova | 21:49 | |
*** slaweq has quit IRC | 21:49 | |
*** lucasxu has quit IRC | 21:49 | |
*** Jack_Iv has quit IRC | 21:49 | |
*** salv-orlando has quit IRC | 21:52 | |
flwang | mriedem: i asked because currently, after delete the image, the volume behind the image will be left | 21:52 |
mriedem | flwang: an actual volume in cinder? | 21:52 |
mriedem | the volume snapshot right? | 21:52 |
flwang | yes | 21:52 |
*** tbachman has quit IRC | 21:52 | |
mriedem | i wouldn't expect glance to delete the volume snapshot | 21:52 |
mriedem | when the instance snapshot image is deleted | 21:53 |
flwang | mriedem: interesting, why? | 21:53 |
mriedem | because glance shouldn't have control over cinder resources | 21:53 |
mriedem | and it would tightly couple the image snapshot from the server with the volume snapshot, based on an operation that nova is performing | 21:54 |
mriedem | which seems wrong | 21:54 |
imacdonn | there is no dependency between the volume and the image it was created from ... so I see no reason to delete the volume if the image is deleted | 21:54 |
*** lucasxu has joined #openstack-nova | 21:54 | |
mriedem | nova could just as easily not create a volume snapshot when creating an instance snapshot in glance | 21:54 |
flwang | mriedem: that's a good point, but why glance can delete an image when it's stored in swift, can you see the difference? | 21:54 |
mriedem | flwang: because swift is the backing store for the image right? | 21:54 |
mriedem | if you're using swift as the backend | 21:54 |
mriedem | cinder is not the backing store for the volume snapshot, cinder is | 21:55 |
mriedem | oops | 21:55 |
mriedem | glance is not the backing store for the volume snapshot, cinder is | 21:55 |
flwang | good point | 21:55 |
imacdonn | yeah, that ;) | 21:55 |
mriedem | swift is the backing store for the image | 21:55 |
mriedem | or ceph | 21:55 |
mriedem | or local file | 21:55 |
mriedem | or whatever | 21:55 |
flwang | but if glance is using cinder as the backend store | 21:56 |
flwang | for this case, should the snapshot being deleted? | 21:56 |
dansmith | melwitt: there are three fields on the quotas object.. those are not sufficient to return what we've got from those new calls? | 21:57 |
mriedem | flwang: only the image snapshot, not the volume snapshot | 21:58 |
dansmith | I'm not really sure what we're getting there actually.. usage I guess? | 21:58 |
melwitt | dansmith: I don't think so because those functions are returning db models that have like a limit attribute, for example | 21:58 |
mriedem | flwang: i go to glance to manage images, not volumes | 21:58 |
melwitt | dansmith: those are limits | 21:58 |
mriedem | flwang: regardless of what is storing those images | 21:58 |
flwang | mriedem: ok, cool, thanks for all the inputs | 21:59 |
flwang | that's very helpful | 21:59 |
melwitt | dansmith: most of them are limits. some are QuotaClass which has its own fields | 21:59 |
mriedem | if you're using cinder as the backend for glance (i didn't even know that was possible), and you delete the volume out of band via the cinder API, won't that totally mess up glance's representation of that image? | 21:59 |
mriedem | flwang: like if you boot a server in nova and then delete the guest via virsh | 21:59 |
dansmith | melwitt: it looks like we don't really have any of those existing methods that return raw data though right? we return an integer in one place I think, but.. nothing like a bag of dicts | 22:00 |
*** tbachman has joined #openstack-nova | 22:00 | |
melwitt | dansmith: no, and I didn't realize the implications of what I added that needed to return things | 22:01 |
dansmith | hrm. | 22:01 |
melwitt | dansmith: another way I considered but didn't do is I could have added the new api db accesses to nova/quota.py and do the api/main straddle there | 22:03 |
*** jamesden_ has quit IRC | 22:03 | |
flwang | mriedem: yep, it will. just like you delete a vm from vmcontrol instead of openstack :D | 22:04 |
dansmith | melwitt: what we need to avoid is returning unversioned data to the compute, which I don't think is solved purely by putting the straddle in quotas.py | 22:04 |
melwitt | dansmith: I was thinking of the Quotas object as an abstraction but wasn't think of the remotable methods part | 22:04 |
dansmith | melwitt: what we really need is a composite operation that just says "yo dawg, check this quota limit for me and raise if there's a problem" right? | 22:04 |
dansmith | melwitt: then all the data is on the conductor side and compute is just asking for a check instead of getting the data itself | 22:05 |
melwitt | dansmith: it's not but it would be doing the same thing it is now (without having a Quotas object version attached to it) | 22:05 |
melwitt | dansmith: yeah, that makes sense | 22:05 |
*** mdrabe has quit IRC | 22:05 | |
dansmith | melwitt: right now we remote the call to the quotas db code through the object action without returning data, right? | 22:05 |
*** abalutoiu_ has joined #openstack-nova | 22:05 | |
dansmith | and your patch ends up with us returning that data to compute I think | 22:05 |
melwitt | dansmith: check_deltas is supposed to do that, but atm I'm confused as to where that occurs or if it solves the problem | 22:05 |
melwitt | check_deltas is the composite operation that calls count followed by limit_check | 22:06 |
dansmith | melwitt: where is check_deltas? | 22:08 |
*** lucasxu has quit IRC | 22:08 | |
dansmith | that must be something later in your patch series? | 22:08 |
*** abalutoiu has quit IRC | 22:09 | |
melwitt | dansmith: third patch I think | 22:09 |
melwitt | dansmith: https://review.openstack.org/#/c/446239 | 22:10 |
*** esberglu has quit IRC | 22:11 | |
cfriesen | config option question: when specifying the "live_migration_inbound_addr" config option, is it expected that an ipv6 address will be enclosed in square brackets? Or should nova handle that when parsing the config option? | 22:11 |
dansmith | melwitt: ah yep.. that just takes resources and counts (from compute in this case), remotes to conductor where it looks at all the stuff and either explodes or doesn't, right? | 22:11 |
*** ngupta has quit IRC | 22:11 | |
*** ngupta has joined #openstack-nova | 22:11 | |
*** burt has quit IRC | 22:13 | |
openstackgerrit | Eric Fried proposed openstack/nova master: WIP/PoC: nova.utils.get_service_url(group) https://review.openstack.org/458257 | 22:13 |
melwitt | dansmith: it takes the deltas but it does the count and pulls the limits itself | 22:13 |
dansmith | melwitt: right, it just takes a resource and count, and explodes if the quota would be violated | 22:13 |
dansmith | melwitt: that's what we need yeah | 22:14 |
clarkb | cfriesen: I thought I could answer based on how we configure things in multinode testing but that appears to be an entirely ipv4 control plane :/ | 22:14 |
melwitt | dansmith: if by count you mean delta, then yes. if you want to check if you have room for 5 more instances, you pass it 5 and then it will count how many instances your project and user have allocated, then it pulls the limits and compares | 22:14 |
cfriesen | clarkb: I'm wondering if maybe nova should do: | 22:15 |
cfriesen | migrate_data.target_connect_addr = utils.safe_ip_format(CONF.libvirt.live_migration_inbound_addr) | 22:15 |
dansmith | melwitt: yeah | 22:15 |
*** yingwei has joined #openstack-nova | 22:16 | |
*** mlavalle has quit IRC | 22:16 | |
melwitt | dansmith: okay, so that solves that problem. so I need to figure out what to do about the db access methods I have in the Quotas object | 22:17 |
*** dmk0202 has quit IRC | 22:17 | |
melwitt | I put them there as a universal place to call api/main db to do the right thing, and the caller should only be the quota driver in nova/quota.py | 22:18 |
melwitt | I think ... | 22:18 |
dansmith | melwitt: right but does compute call into nova.quota for anythign? I thought it did | 22:18 |
dansmith | if so, then your check_deltas conversion needs to come first | 22:19 |
melwitt | dansmith: it does, for the reserve/commit/rollback | 22:19 |
openstackgerrit | Peter Hamilton proposed openstack/nova master: Add configuration options for certificate validation https://review.openstack.org/457678 | 22:19 |
dansmith | melwitt: yeah, then you need to do something in a different order I guess | 22:19 |
melwitt | dansmith: check_deltas only works if the quota has been converted to Countable | 22:19 |
dansmith | yeah | 22:19 |
*** ijw has joined #openstack-nova | 22:20 | |
melwitt | I shall think on it | 22:24 |
melwitt | my brain's too fried at the moment | 22:25 |
*** marst_ has quit IRC | 22:26 | |
*** felipemonteiro has joined #openstack-nova | 22:27 | |
*** eandersson has joined #openstack-nova | 22:27 | |
eandersson | Is there a way to extend the data in metadata? (e.g. adding tenant name) | 22:28 |
*** marst has joined #openstack-nova | 22:35 | |
*** ngupta has quit IRC | 22:37 | |
*** gongysh has joined #openstack-nova | 22:38 | |
*** esberglu has joined #openstack-nova | 22:39 | |
*** gongysh has quit IRC | 22:40 | |
*** Sukhdev has joined #openstack-nova | 22:40 | |
*** sree has joined #openstack-nova | 22:42 | |
*** salv-orl_ has quit IRC | 22:44 | |
*** david-lyle has joined #openstack-nova | 22:45 | |
*** sree has quit IRC | 22:47 | |
*** jerrygb has joined #openstack-nova | 22:49 | |
*** gjayavelu has quit IRC | 22:50 | |
*** gjayavelu has joined #openstack-nova | 22:50 | |
*** jerrygb has quit IRC | 22:53 | |
mriedem | eandersson: you can update the metadata associated with a server yes | 22:53 |
mriedem | eandersson: https://developer.openstack.org/api-ref/compute/#server-metadata-servers-metadata | 22:54 |
mriedem | https://docs.openstack.org/cli-reference/nova.html#nova-meta | 22:54 |
*** rfolco_ has joined #openstack-nova | 22:55 | |
*** rfolco has quit IRC | 22:57 | |
*** jamesden_ has joined #openstack-nova | 22:59 | |
mriedem | melwitt: did you get a patch up for that ironic unit test failure? | 23:04 |
melwitt | mriedem: yes, https://review.openstack.org/458161 | 23:05 |
mriedem | sweet | 23:05 |
melwitt | I think the only thing it misses out on is running the _wait_state function but I think one of the other unit tests runs it | 23:06 |
melwitt | double check it though | 23:06 |
mriedem | the commit message says it's covered in other tests | 23:06 |
mriedem | i guess you're lying | 23:06 |
mriedem | potentially | 23:06 |
*** yingwei has quit IRC | 23:07 | |
mriedem | but yeah there are | 23:07 |
mriedem | off the hook this time witt | 23:07 |
openstackgerrit | Mathieu Gagné proposed openstack/nova master: Add ability to signal and perform online volume size change https://review.openstack.org/454322 | 23:10 |
melwitt | haha | 23:10 |
melwitt | I thought I saw it covered in other tests but maybe I misunderstood something | 23:11 |
mriedem | +2 | 23:12 |
*** nic has quit IRC | 23:13 | |
*** felipemonteiro has quit IRC | 23:13 | |
*** ngupta has joined #openstack-nova | 23:13 | |
melwitt | mriedem: thanks. at first I removed those overrides but then kept them to use in the assert_called_with to verify they're being passed along to the timer as expected | 23:14 |
mriedem | alright - that's fine for the configurable one, the module scope variable was just there for tricking the timer | 23:14 |
melwitt | oh | 23:14 |
*** esberglu has quit IRC | 23:20 | |
mriedem | mdbooth: do you plan on rebasing this https://review.openstack.org/#/c/430213/ ? - something came into triage today that was a duplicate | 23:22 |
*** dimtruck is now known as zz_dimtruck | 23:23 | |
mriedem | sean-k-mooney: who is running the intel 3rd party ci now that wznoinsk is gone? | 23:23 |
*** zz_dimtruck is now known as dimtruck | 23:24 | |
*** ngupta has quit IRC | 23:29 | |
*** ijw has quit IRC | 23:31 | |
*** jamesden_ has quit IRC | 23:33 | |
*** chyka has quit IRC | 23:33 | |
*** chyka has joined #openstack-nova | 23:34 | |
*** chyka has quit IRC | 23:39 | |
imacdonn | mriedem, still around ? | 23:39 |
mriedem | imacdonn: yeah | 23:41 |
imacdonn | hey .. re. https://bugs.launchpad.net/nova/+bug/1683972 | 23:42 |
openstack | Launchpad bug 1662483 in OpenStack Compute (nova) "duplicate for #1683972 detach_volume races with delete" [Undecided,In progress] - Assigned to Matthew Booth (mbooth-9) | 23:42 |
imacdonn | thanks, openstack | 23:42 |
imacdonn | I'm not sure it's really the same problem as the one you marked it a dup of .. it's slightly related, I guess | 23:42 |
mriedem | feel free to unduplicate it if you want, but i thought the solution was the same | 23:43 |
mriedem | lock on detach_volume in the compute manager | 23:43 |
imacdonn | my locking was way more extensive (and possibly way more wrong, but it works for me) | 23:44 |
mriedem | care to post your change? | 23:44 |
mriedem | i'm sure mdbooth would like to look at it | 23:44 |
imacdonn | but my case was overlap between attach and detach .. not two detach's | 23:44 |
imacdonn | if mdbooth is the right guy, I can get with him ... what TZ is he in ? | 23:44 |
mriedem | UK | 23:45 |
mriedem | so he'd be around in the morning | 23:45 |
imacdonn | OK, I'll look for him them ... I can post what I did somewhere, but I'm fairly sure it's not "right" | 23:46 |
mriedem | hard to know if you don't post it | 23:46 |
mriedem | posting to gerrit would be preferrable, else you could attach a patch file in the bug report | 23:46 |
*** dimtruck is now known as zz_dimtruck | 23:47 | |
*** zz_dimtruck is now known as dimtruck | 23:47 | |
imacdonn | I think it's too much of a hack to put in a review .. should I attach to my bug (the one marked as a dup) ? | 23:47 |
mriedem | nothing is too much of a hack to put it in a review - just put WIP in the prefix of the commit title | 23:49 |
mriedem | or -Workflow it in gerrit | 23:49 |
mriedem | no one is going to think less of you :) | 23:49 |
imacdonn | heh | 23:50 |
imacdonn | I'll take another look at it first ... don't want to embarrass myself any more than necessary :) | 23:50 |
*** Fdaisuke has quit IRC | 23:51 | |
imacdonn | I have another thing I wanted to get your opinion on (completely unrelated) | 23:52 |
*** hongbin has quit IRC | 23:53 | |
*** Fdaisuke has joined #openstack-nova | 23:53 | |
mriedem | ok | 23:55 |
imacdonn | so when nova plugs an instance's vif into a neutron network that has MTU != 1500, something needs to set the MTU on the tap interface. Whose job is that? nova-compute? os_vif? the neutron l2 agent? ... ? | 23:55 |
imacdonn | asking because it's currently not getting done, and I'm not sure who to blame. | 23:56 |
imacdonn | For more detail, see https://ask.openstack.org/en/question/105521/whos-supposed-to-set-the-mtu-on-a-nova-instances-vifs-tap-interface/ | 23:56 |
mriedem | sean-k-mooney: ^ | 23:56 |
mriedem | imacdonn: in part it depends on the vif type | 23:57 |
*** dimtruck is now known as zz_dimtruck | 23:57 | |
mriedem | the libvirt driver isn't using os-vif yet for all vif types | 23:57 |
imacdonn | it is in my case .. vif_type is bridge | 23:57 |
mriedem | then i believe os-vif does it | 23:58 |
imacdonn | I think I have the terminology right there ... in any case, vif_plug_linux_bridge under os_vif creates the bridge | 23:58 |
imacdonn | then libvirt creates the domain, which creates the tap interface, and puts it on the bridge | 23:58 |
mriedem | does the network in neutron have the mtu attribute set? | 23:58 |
imacdonn | yes | 23:59 |
imacdonn | I've studied the code, and I can't find anything that's supposed to do the job | 23:59 |
imacdonn | I don't think os_vif can do it, because the tap interface doesn't exist yet | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!