| *** sree has joined #openstack-nova | 00:00 | |
| *** hoonetorg has quit IRC | 00:05 | |
| *** sree has quit IRC | 00:06 | |
| *** mriedem has joined #openstack-nova | 00:10 | |
| *** salv-orlando has joined #openstack-nova | 00:12 | |
| *** hshiina has joined #openstack-nova | 00:14 | |
| *** markvoelker has joined #openstack-nova | 00:17 | |
| *** salv-orlando has quit IRC | 00:17 | |
| jroll | melwitt: congrats and condolences | 00:24 |
|---|---|---|
| jroll | :) | 00:24 |
| *** markvoelker has quit IRC | 00:24 | |
| *** liusheng has quit IRC | 00:24 | |
| melwitt | heh, thanks jroll | 00:24 |
| *** liusheng has joined #openstack-nova | 00:24 | |
| *** efried has joined #openstack-nova | 00:25 | |
| *** rodolof has quit IRC | 00:27 | |
| mriedem | gibi: i likely can't run the nova meeting tomorrow, can you do that? i'll update the agenda tonight. | 00:27 |
| mnaser | melwitt: early unofficial congrats too :) | 00:30 |
| melwitt | thanks mnaser :) | 00:30 |
| *** yassine has joined #openstack-nova | 00:37 | |
| *** yassine is now known as Guest11631 | 00:38 | |
| *** liusheng has quit IRC | 00:38 | |
| *** liusheng has joined #openstack-nova | 00:39 | |
| *** chyka has quit IRC | 00:42 | |
| mriedem | efried: apparently we lookup the image service endpoint url from the catalog 410 times in n-api alone in a successful tempest run | 00:43 |
| mriedem | which seems....excessive | 00:43 |
| *** claudiub|2 has quit IRC | 00:45 | |
| *** gyee has quit IRC | 00:47 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Workaround glanceclient bug when CONF.glance.api_servers not set https://review.openstack.org/541008 | 00:48 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: [cellv2] Improve getting BDMs in multiple cells https://review.openstack.org/521400 | 00:49 |
| *** zhurong has joined #openstack-nova | 00:52 | |
| *** edmondsw has joined #openstack-nova | 00:53 | |
| *** edmondsw has quit IRC | 00:58 | |
| *** brad[] has quit IRC | 01:15 | |
| efried | mriedem: Accessing an image 410 times in a tempest run doesn't seem excessive to me. And if things are set up correctly, that lookup ought to be really really cheap. | 01:15 |
| mriedem | we just reconstruct the glance client wrapper every time | 01:16 |
| efried | Now if we were doing endpoint discovery every one of those times (or even a tenth of them) that would be excessive. | 01:16 |
| mriedem | i'm pretty sure we do the same for cinder client though too | 01:16 |
| efried | I don't doubt it. | 01:16 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove unnecessary variables https://review.openstack.org/541964 | 01:17 |
| efried | Are you suggesting we could cache the client? Maybe so. | 01:17 |
| efried | FWIW, constructing the client is also pretty cheap. | 01:17 |
| mriedem | i was more worried about the endpoint lookup from ksa every time, | 01:17 |
| mriedem | but is that cached somewhere? | 01:17 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Workaround glanceclient bug when CONF.glance.api_servers not set https://review.openstack.org/541008 | 01:18 |
| mriedem | btw, this fixes the nova-next job ^, despite using some regex parsing and stripping | 01:18 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove unnecessary arguments in notification methods https://review.openstack.org/535599 | 01:18 |
| efried | mriedem: Yes, the endpoint is cached, if things are working right. | 01:20 |
| * efried adds patch to list to review when awake | 01:21 | |
| efried | oh, you did that, thanks. | 01:21 |
| *** tiendc has joined #openstack-nova | 01:23 | |
| *** yangyapeng has quit IRC | 01:27 | |
| openstackgerrit | melanie witt proposed openstack/nova master: Make scheduler.utils.setup_instance_group query all cells https://review.openstack.org/540258 | 01:27 |
| *** yangyapeng has joined #openstack-nova | 01:27 | |
| *** zhaochao has joined #openstack-nova | 01:29 | |
| openstackgerrit | Merged openstack/nova master: Update links in documents https://review.openstack.org/533134 | 01:29 |
| *** Daisy_ has joined #openstack-nova | 01:34 | |
| *** Daisy__ has joined #openstack-nova | 01:41 | |
| *** Daisy_ has quit IRC | 01:41 | |
| *** hiro-kobayashi has joined #openstack-nova | 01:42 | |
| *** Daisy_ has joined #openstack-nova | 01:42 | |
| *** hongbin has joined #openstack-nova | 01:45 | |
| *** Daisy__ has quit IRC | 01:45 | |
| *** chyka has joined #openstack-nova | 01:48 | |
| *** chyka has quit IRC | 01:53 | |
| *** annp has joined #openstack-nova | 01:58 | |
| *** hshiina2 has joined #openstack-nova | 02:00 | |
| *** hshiina has quit IRC | 02:03 | |
| *** hshiina3 has joined #openstack-nova | 02:03 | |
| *** acormier has quit IRC | 02:03 | |
| mriedem | mordred: would you like it if the GET /flavors/detail response included the extra specs with each flavor also so you don't have to make a 2nd request per flavor to get the specs (as a subresource GET) ? | 02:04 |
| *** gjayavelu has quit IRC | 02:05 | |
| *** hshiina2 has quit IRC | 02:06 | |
| *** hshiina3 is now known as hshiina | 02:08 | |
| *** pchavva has quit IRC | 02:08 | |
| *** nicolasbock has quit IRC | 02:10 | |
| *** sree has joined #openstack-nova | 02:16 | |
| *** yamahata has quit IRC | 02:20 | |
| *** sree has quit IRC | 02:20 | |
| *** Sukhdev has quit IRC | 02:27 | |
| *** sdague has quit IRC | 02:27 | |
| *** hshiina2 has joined #openstack-nova | 02:29 | |
| *** hshiina has quit IRC | 02:32 | |
| *** masahisa has joined #openstack-nova | 02:36 | |
| *** hshiina3 has joined #openstack-nova | 02:37 | |
| *** hshiina2 has quit IRC | 02:41 | |
| *** edmondsw has joined #openstack-nova | 02:41 | |
| mriedem | sgordon: is red hat still interested in this? https://blueprints.launchpad.net/nova/+spec/complex-soft-anti-affinity-policies | 02:42 |
| mriedem | because i think our product team wants that also | 02:42 |
| *** acormier has joined #openstack-nova | 02:44 | |
| *** edmondsw has quit IRC | 02:46 | |
| *** jichen has joined #openstack-nova | 02:50 | |
| *** sree has joined #openstack-nova | 02:51 | |
| *** hshiina3 is now known as hshiina | 02:52 | |
| *** sree has quit IRC | 02:56 | |
| mriedem | Kevin_Zheng: this is the bp for the error code thing I was thinking of for placement https://review.openstack.org/#/c/418393/ | 02:58 |
| mriedem | Kevin_Zheng: https://blueprints.launchpad.net/nova/+spec/add-extra-specs-to-flavor-list | 03:01 |
| mriedem | yikun: ^ | 03:01 |
| mriedem | https://review.openstack.org/#/c/39920/ | 03:02 |
| mriedem | apparently people weren't against it 4 years ago | 03:02 |
| mriedem | :) | 03:02 |
| *** acormier has quit IRC | 03:02 | |
| *** tianhui has quit IRC | 03:04 | |
| *** tianhui has joined #openstack-nova | 03:04 | |
| Kevin_Zheng | yeah | 03:05 |
| Kevin_Zheng | more about v2 v3 thing | 03:05 |
| *** fragatina has quit IRC | 03:06 | |
| *** fragatina has joined #openstack-nova | 03:06 | |
| *** fragatina has quit IRC | 03:06 | |
| mriedem | this was the other bp i was looking for from ibm years ago https://blueprints.launchpad.net/nova/+spec/formal-message-ids | 03:07 |
| *** fragatina has joined #openstack-nova | 03:07 | |
| Kevin_Zheng | Hmm got approved :) | 03:08 |
| mriedem | ? | 03:08 |
| mriedem | it's marked obsolete | 03:08 |
| Kevin_Zheng | Oh ok | 03:08 |
| mriedem | it's complete in that it's dead | 03:08 |
| *** amodi has quit IRC | 03:09 | |
| *** hoangcx has quit IRC | 03:14 | |
| *** hoangcx has joined #openstack-nova | 03:14 | |
| *** udesale has joined #openstack-nova | 03:15 | |
| *** gongysh has joined #openstack-nova | 03:16 | |
| *** mriedem has quit IRC | 03:16 | |
| openstackgerrit | Fan Zhang proposed openstack/osc-placement master: Update doc link in README.rst https://review.openstack.org/542002 | 03:27 |
| *** mdnadeem has joined #openstack-nova | 03:29 | |
| *** gongysh has quit IRC | 03:33 | |
| *** Daisy_ has quit IRC | 03:33 | |
| *** Daisy_ has joined #openstack-nova | 03:34 | |
| *** Daisy_ has quit IRC | 03:34 | |
| *** Daisy_ has joined #openstack-nova | 03:35 | |
| *** yamamoto has joined #openstack-nova | 03:38 | |
| *** dave-mccowan has quit IRC | 03:39 | |
| *** Daisy_ has quit IRC | 03:39 | |
| *** mdnadeem has quit IRC | 03:53 | |
| *** fragatina has quit IRC | 03:58 | |
| *** fragatina has joined #openstack-nova | 04:02 | |
| *** gongysh has joined #openstack-nova | 04:03 | |
| *** fragatina has quit IRC | 04:07 | |
| *** andreas_s has joined #openstack-nova | 04:09 | |
| *** esberglu has quit IRC | 04:10 | |
| *** oomichi has joined #openstack-nova | 04:10 | |
| *** Tom-Tom has joined #openstack-nova | 04:12 | |
| *** jichen has quit IRC | 04:12 | |
| *** Daisy_ has joined #openstack-nova | 04:13 | |
| *** jichen has joined #openstack-nova | 04:13 | |
| *** andreas_s has quit IRC | 04:13 | |
| *** hieulq has quit IRC | 04:15 | |
| *** Daisy_ has quit IRC | 04:17 | |
| openstackgerrit | Fan Zhang proposed openstack/osc-placement master: Update doc link in README.rst https://review.openstack.org/542002 | 04:18 |
| *** Daisy_ has joined #openstack-nova | 04:19 | |
| *** Tom-Tom has quit IRC | 04:20 | |
| *** bhujay has joined #openstack-nova | 04:21 | |
| *** psachin has joined #openstack-nova | 04:23 | |
| *** Daisy_ has quit IRC | 04:24 | |
| *** esberglu has joined #openstack-nova | 04:26 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova master: trivial: Fix microversion number in test comment https://review.openstack.org/542019 | 04:30 |
| *** edmondsw has joined #openstack-nova | 04:30 | |
| *** esberglu has quit IRC | 04:30 | |
| *** slaweq has joined #openstack-nova | 04:34 | |
| *** edmondsw has quit IRC | 04:34 | |
| *** slaweq has quit IRC | 04:39 | |
| *** lpetrut has joined #openstack-nova | 04:45 | |
| *** Daisy_ has joined #openstack-nova | 04:49 | |
| *** zhurong has quit IRC | 04:56 | |
| *** hongbin has quit IRC | 04:58 | |
| *** jchhatba_ has joined #openstack-nova | 05:02 | |
| *** ratailor has joined #openstack-nova | 05:03 | |
| *** acormier has joined #openstack-nova | 05:03 | |
| *** abhishekk has joined #openstack-nova | 05:05 | |
| *** acormier has quit IRC | 05:07 | |
| *** artom has quit IRC | 05:08 | |
| *** lpetrut has quit IRC | 05:09 | |
| *** artom has joined #openstack-nova | 05:11 | |
| *** trinaths has joined #openstack-nova | 05:12 | |
| *** Tom-Tom has joined #openstack-nova | 05:14 | |
| *** moshele has joined #openstack-nova | 05:23 | |
| *** claudiub|2 has joined #openstack-nova | 05:25 | |
| *** hieulq has joined #openstack-nova | 05:31 | |
| *** slaweq has joined #openstack-nova | 05:34 | |
| *** lbragstad has quit IRC | 05:37 | |
| *** slaweq has quit IRC | 05:39 | |
| *** oomichi has quit IRC | 05:41 | |
| *** fragatina has joined #openstack-nova | 05:42 | |
| *** traskat has joined #openstack-nova | 05:44 | |
| *** mdnadeem has joined #openstack-nova | 05:45 | |
| *** traskat has quit IRC | 05:48 | |
| *** zhurong has joined #openstack-nova | 05:49 | |
| *** yamahata has joined #openstack-nova | 05:50 | |
| *** eandersson has quit IRC | 05:50 | |
| *** threestrands has quit IRC | 05:57 | |
| *** oomichi has joined #openstack-nova | 06:00 | |
| *** yangyapeng has quit IRC | 06:10 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata https://review.openstack.org/541561 | 06:13 |
| *** yangyapeng has joined #openstack-nova | 06:15 | |
| *** edmondsw has joined #openstack-nova | 06:18 | |
| *** kholkina has joined #openstack-nova | 06:21 | |
| *** trinaths has quit IRC | 06:22 | |
| *** chyka has joined #openstack-nova | 06:22 | |
| *** edmondsw has quit IRC | 06:22 | |
| *** yamamoto_ has joined #openstack-nova | 06:26 | |
| *** chyka has quit IRC | 06:26 | |
| *** hshiina2 has joined #openstack-nova | 06:29 | |
| *** hshiina3 has joined #openstack-nova | 06:30 | |
| *** yamamoto has quit IRC | 06:30 | |
| *** hshiina has quit IRC | 06:32 | |
| *** Eran_Kuris has joined #openstack-nova | 06:33 | |
| *** hshiina2 has quit IRC | 06:34 | |
| *** slaweq has joined #openstack-nova | 06:34 | |
| *** slaweq has quit IRC | 06:39 | |
| *** hoonetorg has joined #openstack-nova | 06:44 | |
| *** slaweq has joined #openstack-nova | 06:55 | |
| *** slaweq has quit IRC | 06:59 | |
| openstackgerrit | Merged openstack/nova master: fix misspelling of 'projectUser' https://review.openstack.org/541108 | 07:01 |
| *** lajoskatona has joined #openstack-nova | 07:01 | |
| *** itlinux has quit IRC | 07:06 | |
| *** hoonetorg has quit IRC | 07:06 | |
| *** andreas_s has joined #openstack-nova | 07:14 | |
| *** efried has quit IRC | 07:14 | |
| *** efried has joined #openstack-nova | 07:15 | |
| *** xinliang has joined #openstack-nova | 07:16 | |
| *** rcernin has quit IRC | 07:16 | |
| *** AlexeyAbashkin has joined #openstack-nova | 07:20 | |
| *** bhagyashris has quit IRC | 07:21 | |
| *** hoonetorg has joined #openstack-nova | 07:23 | |
| *** WangShuaili_ has quit IRC | 07:30 | |
| *** pcaruana has joined #openstack-nova | 07:31 | |
| *** jichen has quit IRC | 07:32 | |
| *** Daisy_ has quit IRC | 07:32 | |
| *** jichen has joined #openstack-nova | 07:33 | |
| *** Daisy_ has joined #openstack-nova | 07:33 | |
| *** Daisy_ has quit IRC | 07:38 | |
| *** AlexeyAbashkin has quit IRC | 07:38 | |
| *** Daisy_ has joined #openstack-nova | 07:39 | |
| *** AlexeyAbashkin has joined #openstack-nova | 07:43 | |
| *** Daisy_ has quit IRC | 07:43 | |
| *** lpetrut has joined #openstack-nova | 07:45 | |
| *** AlexeyAbashkin has quit IRC | 07:47 | |
| *** hshiina2 has joined #openstack-nova | 07:48 | |
| openstackgerrit | Ameed Ashour proposed openstack/osc-placement master: Update doc link in README.rst https://review.openstack.org/542067 | 07:52 |
| *** hshiina3 has quit IRC | 07:52 | |
| *** AlexeyAbashkin has joined #openstack-nova | 07:52 | |
| *** hshiina2 is now known as hshiina | 07:53 | |
| *** bhagyashris has joined #openstack-nova | 07:53 | |
| *** slaweq has joined #openstack-nova | 07:55 | |
| *** hshiina2 has joined #openstack-nova | 07:55 | |
| *** Daisy_ has joined #openstack-nova | 07:57 | |
| *** hshiina has quit IRC | 07:58 | |
| *** ragiman has joined #openstack-nova | 07:59 | |
| *** slaweq has quit IRC | 08:00 | |
| *** abalutoiu has joined #openstack-nova | 08:02 | |
| *** lpetrut_ has joined #openstack-nova | 08:02 | |
| *** claudiub has joined #openstack-nova | 08:02 | |
| *** claudiub|2 has quit IRC | 08:04 | |
| *** lpetrut has quit IRC | 08:04 | |
| *** abalutoiu__ has quit IRC | 08:05 | |
| *** artom has quit IRC | 08:06 | |
| *** edmondsw has joined #openstack-nova | 08:06 | |
| *** dtantsur|afk is now known as dtantsur | 08:09 | |
| *** edmondsw has quit IRC | 08:11 | |
| hrw | morning | 08:11 |
| hrw | https://review.openstack.org/#/c/541728/ - can someone take a look at aarch64 support matrix stuff and help get it merged? | 08:11 |
| *** chyka has joined #openstack-nova | 08:11 | |
| *** jpena|off is now known as jpena | 08:11 | |
| *** damien_r has joined #openstack-nova | 08:12 | |
| *** slaweq has joined #openstack-nova | 08:13 | |
| *** stakeda has quit IRC | 08:15 | |
| *** chyka has quit IRC | 08:16 | |
| *** oomichi has quit IRC | 08:16 | |
| *** zioproto has quit IRC | 08:17 | |
| *** mnaser has quit IRC | 08:17 | |
| *** kmalloc has quit IRC | 08:17 | |
| *** mnaser has joined #openstack-nova | 08:17 | |
| *** zioproto has joined #openstack-nova | 08:17 | |
| *** jbryce has quit IRC | 08:17 | |
| *** artom has joined #openstack-nova | 08:18 | |
| *** kmalloc has joined #openstack-nova | 08:18 | |
| *** gmann_ has quit IRC | 08:18 | |
| openstackgerrit | Thomas Goirand proposed openstack/python-novaclient master: Fix crashing console-log https://review.openstack.org/541610 | 08:23 |
| *** alexchadin has joined #openstack-nova | 08:25 | |
| *** tesseract has joined #openstack-nova | 08:26 | |
| *** hiro-kobayashi has quit IRC | 08:28 | |
| *** gmann_ has joined #openstack-nova | 08:28 | |
| *** alexchadin has quit IRC | 08:34 | |
| *** alexchadin has joined #openstack-nova | 08:40 | |
| *** masahisa has quit IRC | 08:41 | |
| *** mgoddard_ has joined #openstack-nova | 08:46 | |
| openstackgerrit | jichenjc proposed openstack/nova master: TrivialFix: Add a blankline https://review.openstack.org/542094 | 08:52 |
| *** tiendc has quit IRC | 08:52 | |
| *** hoangcx has quit IRC | 08:56 | |
| *** annp has quit IRC | 08:56 | |
| *** yamamoto has joined #openstack-nova | 08:57 | |
| *** ralonsoh has joined #openstack-nova | 08:57 | |
| openstackgerrit | jichenjc proposed openstack/nova master: TrivialFix: rename cinder to volume https://review.openstack.org/542095 | 08:58 |
| *** sahid has joined #openstack-nova | 08:58 | |
| *** yamamoto_ has quit IRC | 09:00 | |
| *** tiendc has joined #openstack-nova | 09:02 | |
| *** annp has joined #openstack-nova | 09:02 | |
| *** hoangcx has joined #openstack-nova | 09:02 | |
| bauzas | good morning Nova | 09:03 |
| hrw | hi bauzas | 09:03 |
| *** sshwarts has joined #openstack-nova | 09:04 | |
| *** tssurya has joined #openstack-nova | 09:06 | |
| *** derekh has joined #openstack-nova | 09:10 | |
| *** rodolof has joined #openstack-nova | 09:14 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Add log for snapshot an instance https://review.openstack.org/542101 | 09:17 |
| *** claudiub has quit IRC | 09:18 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Use with method to consistent oslo timeutils usage https://review.openstack.org/542105 | 09:24 |
| *** slaweq_ has joined #openstack-nova | 09:25 | |
| *** amoralej|off is now known as amoralej | 09:26 | |
| *** sapd has quit IRC | 09:29 | |
| *** slaweq_ has quit IRC | 09:30 | |
| *** hshiina2 is now known as hshiina|afk | 09:32 | |
| *** sapd has joined #openstack-nova | 09:33 | |
| *** trinaths has joined #openstack-nova | 09:34 | |
| *** gongysh has quit IRC | 09:36 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove a duplicate colon https://review.openstack.org/542109 | 09:36 |
| *** takashin has left #openstack-nova | 09:38 | |
| *** tiendc_ has joined #openstack-nova | 09:38 | |
| *** tiendc has quit IRC | 09:40 | |
| *** hshiina|afk has quit IRC | 09:41 | |
| *** damien_r1 has joined #openstack-nova | 09:42 | |
| *** damien_r has quit IRC | 09:43 | |
| *** tssurya has quit IRC | 09:46 | |
| *** alexchadin has quit IRC | 09:48 | |
| *** sambetts|afk is now known as sambetts | 09:51 | |
| *** edmondsw has joined #openstack-nova | 09:55 | |
| *** Daisy_ has quit IRC | 09:55 | |
| *** Daisy_ has joined #openstack-nova | 09:56 | |
| *** abhishekk has quit IRC | 09:58 | |
| *** edmondsw has quit IRC | 09:59 | |
| *** jbryce has joined #openstack-nova | 10:00 | |
| *** Daisy_ has quit IRC | 10:00 | |
| *** tssurya has joined #openstack-nova | 10:01 | |
| *** tiendc_ has quit IRC | 10:02 | |
| *** zhurong has quit IRC | 10:04 | |
| *** annp has quit IRC | 10:08 | |
| *** annp has joined #openstack-nova | 10:08 | |
| *** abhishekk has joined #openstack-nova | 10:12 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/nova master: Provide basic data for AArch64 support matrix/functionality https://review.openstack.org/541728 | 10:13 |
| *** trinaths has quit IRC | 10:13 | |
| hrw | bauzas: marked live migration as missing | 10:13 |
| bauzas | hrw: you tramplet my revision | 10:15 |
| bauzas | trampled | 10:15 |
| hrw | sorry, will refix | 10:16 |
| bauzas | hrw: https://review.openstack.org/#/c/541728/4..5/releasenotes/notes/aarch64-minimum-libvirt-version-86331e5282effbf0.yaml | 10:16 |
| bauzas | hrw: np, just FYI because Zuul will NACK | 10:16 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/nova master: Provide basic data for AArch64 support matrix/functionality https://review.openstack.org/541728 | 10:17 |
| hrw | restored | 10:17 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/nova master: Provide basic data for AArch64 support matrix/functionality https://review.openstack.org/541728 | 10:18 |
| hrw | typo ;( | 10:18 |
| gibi | mriedem: sure, I will do the weekly meeting | 10:24 |
| *** Daisy_ has joined #openstack-nova | 10:26 | |
| bauzas | hrw: again, you will have a problem https://review.openstack.org/#/c/541728/4..7/releasenotes/notes/aarch64-minimum-libvirt-version-86331e5282effbf0.yaml | 10:27 |
| hrw | s... | 10:28 |
| bauzas | hrw: the simpliest thing for passing a new rev is just to do git review -d <change_number> | 10:28 |
| bauzas | then, commit -a --amend and git review -y | 10:28 |
| hrw | thx | 10:28 |
| bauzas | hrw: so, here, just do git review -d 541728,4 | 10:28 |
| bauzas | it will get the PS4 | 10:29 |
| *** sticker has joined #openstack-nova | 10:29 | |
| bauzas | and you'll just have to modify the support-matrix.ini file | 10:29 |
| bauzas | (git review -d does the same than git fetch https://git.openstack.org/openstack/nova refs/changes/<change_nr>/<ps_nr> && git checkout FETCH_HEAD | 10:30 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/nova master: Provide basic data for AArch64 support matrix/functionality https://review.openstack.org/541728 | 10:31 |
| hrw | everyday learns something new :) | 10:31 |
| hrw | thx bauzas | 10:31 |
| bauzas | np | 10:31 |
| *** annp has quit IRC | 10:31 | |
| bauzas | stephenfin: look at https://bugs.launchpad.net/nova/+bug/1746188 | 10:32 |
| openstack | Launchpad bug 1746188 in OpenStack Compute (nova) "Virtlogd recreates console.log file as root:root after live migration" [Undecided,New] | 10:32 |
| stephenfin | bauzas: I thought we'd fixed that | 10:34 |
| bauzas | yeah me too | 10:35 |
| *** sdague has joined #openstack-nova | 10:35 | |
| bauzas | but the reporter used a Pike version | 10:35 |
| *** abhishekk has quit IRC | 10:35 | |
| *** alexchadin has joined #openstack-nova | 10:36 | |
| *** abhishekk has joined #openstack-nova | 10:37 | |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: RP list: member_of and resources parameters (v1.3, v1.4) https://review.openstack.org/511183 | 10:42 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: RP delete inventories (v1.5) https://review.openstack.org/514642 | 10:42 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: CLI for traits (v1.6) https://review.openstack.org/514643 | 10:42 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: Resource class set (v1.7) https://review.openstack.org/514644 | 10:42 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: Usages per project and user (v1.8, v1.9) https://review.openstack.org/514646 | 10:42 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: CLI allocation candidates (v1.10) https://review.openstack.org/514647 | 10:42 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: [WIP] Get resource provider by uuid or name https://review.openstack.org/527791 | 10:42 |
| *** abhishekk has quit IRC | 10:43 | |
| sticker | bauzas: that reporter is me if you need any more info | 10:47 |
| sticker | it actually stopped us from being able to live migrate instances when the permissions were root:root | 10:47 |
| *** alexchadin has quit IRC | 10:49 | |
| *** alexchadin has joined #openstack-nova | 10:50 | |
| *** links has joined #openstack-nova | 10:50 | |
| *** alexchadin has quit IRC | 10:55 | |
| *** alexchadin has joined #openstack-nova | 10:56 | |
| *** sticker has quit IRC | 10:56 | |
| *** sticker has joined #openstack-nova | 10:56 | |
| *** claudiub has joined #openstack-nova | 10:57 | |
| *** jpena is now known as jpena|away | 10:59 | |
| *** hiro-kobayashi has joined #openstack-nova | 11:00 | |
| *** tssurya has quit IRC | 11:03 | |
| *** elmaciej has joined #openstack-nova | 11:04 | |
| *** lucas-afk is now known as lucasagomes | 11:05 | |
| *** dtantsur is now known as dtantsur|bbl | 11:06 | |
| stephenfin | bauzas: https://bugs.launchpad.net/reno/+bug/1748164 | 11:07 |
| openstack | Launchpad bug 1748164 in reno "Reno doesn't scale" [Undecided,New] | 11:07 |
| stephenfin | I've found a _tonne_ of bugs in reno this morning :( | 11:07 |
| *** tetsuro has joined #openstack-nova | 11:08 | |
| *** andreas_s has quit IRC | 11:10 | |
| *** andreas_s has joined #openstack-nova | 11:10 | |
| *** cdent has joined #openstack-nova | 11:10 | |
| openstackgerrit | Merged openstack/nova master: Remove a duplicate colon https://review.openstack.org/542109 | 11:15 |
| *** ratailor has quit IRC | 11:19 | |
| *** andreas_s has quit IRC | 11:19 | |
| *** yamahata has quit IRC | 11:27 | |
| *** zhurong has joined #openstack-nova | 11:29 | |
| *** andreas_s has joined #openstack-nova | 11:30 | |
| *** alexchadin has quit IRC | 11:33 | |
| *** alexchadin has joined #openstack-nova | 11:33 | |
| *** andreas_s has quit IRC | 11:34 | |
| *** tssurya has joined #openstack-nova | 11:35 | |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: CLI for traits (v1.6) https://review.openstack.org/514643 | 11:40 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: Resource class set (v1.7) https://review.openstack.org/514644 | 11:40 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: Usages per project and user (v1.8, v1.9) https://review.openstack.org/514646 | 11:40 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: CLI allocation candidates (v1.10) https://review.openstack.org/514647 | 11:40 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: [WIP] Get resource provider by uuid or name https://review.openstack.org/527791 | 11:40 |
| *** hiro-kobayashi has quit IRC | 11:42 | |
| *** andreas_s has joined #openstack-nova | 11:43 | |
| *** links has quit IRC | 11:44 | |
| *** chyka has joined #openstack-nova | 11:47 | |
| *** nicolasbock has joined #openstack-nova | 11:50 | |
| *** tbachman has quit IRC | 11:50 | |
| *** hamzy_ is now known as hamzy | 11:50 | |
| *** chyka has quit IRC | 11:52 | |
| *** links has joined #openstack-nova | 11:57 | |
| *** stvnoyes has quit IRC | 11:59 | |
| *** tssurya has quit IRC | 12:00 | |
| *** owalsh_ has joined #openstack-nova | 12:00 | |
| *** masahisa has joined #openstack-nova | 12:01 | |
| *** owalsh has quit IRC | 12:02 | |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: Resource class set (v1.7) https://review.openstack.org/514644 | 12:04 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: Usages per project and user (v1.8, v1.9) https://review.openstack.org/514646 | 12:04 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: CLI allocation candidates (v1.10) https://review.openstack.org/514647 | 12:04 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: [WIP] Get resource provider by uuid or name https://review.openstack.org/527791 | 12:04 |
| *** owalsh_ has quit IRC | 12:05 | |
| *** andreas_s has quit IRC | 12:05 | |
| *** owalsh has joined #openstack-nova | 12:05 | |
| *** andreas_s has joined #openstack-nova | 12:06 | |
| *** dave-mccowan has joined #openstack-nova | 12:11 | |
| *** alexchadin has quit IRC | 12:14 | |
| *** andreas_s has quit IRC | 12:14 | |
| *** andreas_s has joined #openstack-nova | 12:15 | |
| *** m3m0 has joined #openstack-nova | 12:17 | |
| *** alexchadin has joined #openstack-nova | 12:18 | |
| *** links has quit IRC | 12:21 | |
| *** m3m0 has left #openstack-nova | 12:21 | |
| *** m3m0 has joined #openstack-nova | 12:22 | |
| *** alexchadin has quit IRC | 12:22 | |
| m3m0 | Hello guys, I'm trying to install nova from source using the branch stable/pike on arch using python 2.7.14 and python 3.6.4 and I keep getting this error when trying to run ANY nova-manage command, even --help https://etherpad.openstack.org/p/nova_error_retry_on_request | 12:23 |
| m3m0 | have you seen this? | 12:23 |
| *** tssurya has joined #openstack-nova | 12:26 | |
| *** Daisy_ has quit IRC | 12:26 | |
| *** Daisy_ has joined #openstack-nova | 12:26 | |
| *** takashin has joined #openstack-nova | 12:28 | |
| *** andreas_s has quit IRC | 12:30 | |
| *** tetsuro has left #openstack-nova | 12:30 | |
| *** Daisy_ has quit IRC | 12:31 | |
| *** andreas_s has joined #openstack-nova | 12:31 | |
| *** andreas_s has quit IRC | 12:35 | |
| *** ccamacho is now known as ccamacho|lunch | 12:39 | |
| *** belmoreira has joined #openstack-nova | 12:40 | |
| *** alexchadin has joined #openstack-nova | 12:45 | |
| *** tbachman has joined #openstack-nova | 12:46 | |
| *** tbachman_ has joined #openstack-nova | 12:48 | |
| *** alexchadin has quit IRC | 12:49 | |
| *** tbachman has quit IRC | 12:50 | |
| *** tbachman_ is now known as tbachman | 12:50 | |
| *** jpena|away is now known as jpena|off | 12:52 | |
| *** alexchadin has joined #openstack-nova | 12:54 | |
| *** abhishekk has joined #openstack-nova | 12:56 | |
| *** jaosorior has quit IRC | 12:56 | |
| *** jaosorior has joined #openstack-nova | 12:56 | |
| *** andreas_s has joined #openstack-nova | 12:59 | |
| *** links has joined #openstack-nova | 13:01 | |
| *** AlexeyAbashkin has quit IRC | 13:03 | |
| *** hemna_ has joined #openstack-nova | 13:04 | |
| *** AlexeyAbashkin has joined #openstack-nova | 13:04 | |
| *** jpena|off is now known as jpena | 13:06 | |
| *** hemna_ has quit IRC | 13:09 | |
| *** edmondsw has joined #openstack-nova | 13:11 | |
| *** stvnoyes has joined #openstack-nova | 13:13 | |
| bauzas | sticker: hey | 13:14 |
| bauzas | sorry was at lunch et al. | 13:14 |
| bauzas | sticker: I just closed your bug because I tried to get some knowledge on what would the best option for config | 13:14 |
| m3m0 | afer some debugging, I had to remove the parameter retry_on_request on 4 functions and it's "working" | 13:15 |
| bauzas | and looks to me there is a consensus on having dynamic_ownership=1 as the base value for Nova | 13:15 |
| sticker | bauzas: yeah, unfortunately for me, the NetApp recommendation is still to set that to 0 when integrating with their SAN :/ | 13:15 |
| sticker | I'll have to find some other way around it | 13:16 |
| bauzas | sticker: feels like it's a larger problem than just it looks like now | 13:16 |
| bauzas | but I'm not a console expert, neither a libvirt one | 13:16 |
| bauzas | sticker: one option for you would be to run a remote console and not ask for a single file | 13:17 |
| bauzas | https://docs.openstack.org/nova/pike/admin/remote-console-access.html | 13:17 |
| sticker | maybe i'll see if i can get some more detail and come back to it. when i hit the issue i wasn't able to live migrate anything (would just fail with a permissions error) | 13:18 |
| sticker | i'm sure i'm not the only one that would be bitten by it | 13:18 |
| *** jchhatbar has joined #openstack-nova | 13:18 | |
| bauzas | oops, wrong link I meant https://docs.openstack.org/nova/latest/admin/remote-console-access.html#serial-console | 13:19 |
| bauzas | sticker: and yeah, I understand your concern | 13:19 |
| *** jaypipes has joined #openstack-nova | 13:20 | |
| *** efried has quit IRC | 13:20 | |
| *** efried has joined #openstack-nova | 13:21 | |
| *** jchhatba_ has quit IRC | 13:21 | |
| sticker | bauzas: all good.. thanks for looking at it :) | 13:21 |
| *** masahisa has quit IRC | 13:21 | |
| jaypipes | morning supernovas | 13:23 |
| openstackgerrit | Merged openstack/nova stable/pike: Fix pike GA prelude release note https://review.openstack.org/541498 | 13:25 |
| *** hemna_ has joined #openstack-nova | 13:26 | |
| *** zhurong has quit IRC | 13:27 | |
| *** READ10 has joined #openstack-nova | 13:27 | |
| bauzas | jaypipes: I don't feel like I was about to explode in the next years | 13:27 |
| bauzas | and don't treat me of black hole | 13:28 |
| efried | Heh. Good morning jaypipes | 13:29 |
| efried | jaypipes: I should have something pretty interesting coming down the "pipes" for you later today | 13:29 |
| efried | jaypipes: But if you get a few minutes, I'd like to pick your brain about this concept of "aggregate distance" to represent [anti-]affinity. | 13:30 |
| efried | ...at some point today. | 13:30 |
| *** bhujay has quit IRC | 13:33 | |
| jaypipes | efried: ok, sounds good to me. I'll be working on the spec for solving mgagne's problems around host aggregate allocation ratios. | 13:33 |
| efried | Cool | 13:33 |
| cdent | efried: just to throw a thing in your brain on that: I'd like to see anti-affinity and affinity represented internally as numbers on the same scale -something to +something, rather than two different scales. If that's possible. I'm not certain it is, but mathematically it could make for a simpler representation | 13:34 |
| cdent | I also wonder if the UI should represent it as one scale, but that may be too much to bear. | 13:34 |
| *** jchhatbar has quit IRC | 13:34 | |
| efried | cdent: I agree with that as a long-term goal for some generic mechanism. | 13:35 |
| *** jchhatbar has joined #openstack-nova | 13:35 | |
| efried | cdent: My concern is that this "aggregate distance" solution - which may give us that - is going to be an order of magnitude tougher to implement, model, and use than what I talked about a couple days ago with edleafe and sean-k-mooney and cfriesen. | 13:37 |
| bauzas | jaypipes: have you seen my workaround for the aggregate ratios ? | 13:37 |
| bauzas | jaypipes: tl;dr set on every compute ratios to 9999.0 | 13:37 |
| efried | cdent: But that's why I want to understand the "aggregate distance" thing before I go off and write up that spec. | 13:37 |
| * cdent nods | 13:38 | |
| efried | cdent: Is that a concept you comprehend? | 13:38 |
| cdent | efried: it is not fresh in my mind | 13:38 |
| efried | k | 13:38 |
| *** bhujay has joined #openstack-nova | 13:38 | |
| *** tbachman has quit IRC | 13:38 | |
| *** jichen has quit IRC | 13:38 | |
| bauzas | jaypipes: needs some SQL-fu on execution plans https://review.openstack.org/#/c/531117/8/nova/db/sqlalchemy/api.py | 13:40 |
| *** jchhatbar has quit IRC | 13:41 | |
| bauzas | jaypipes: basically, say I have a long list of rows with no index on timestamps (AFAIK), is it OK to just filter by some things and then ordering by those timestamps ? | 13:41 |
| bauzas | because the temp table should be small | 13:42 |
| *** jchhatbar has joined #openstack-nova | 13:42 | |
| *** psachin has quit IRC | 13:44 | |
| efried | bauzas: Timestamps are internally represented as long integers, I believe. Which SQLs are really good at sorting. Are you concerned about performance or about data integrity? | 13:48 |
| bauzas | performance | 13:48 |
| efried | Yeah, compared to some of the other stuff we're doing, should be a drop in the bucket. | 13:48 |
| bauzas | when I was an operator, I *never* sorted by dates | 13:48 |
| efried | I could be wrong of course :) | 13:48 |
| bauzas | it's just a perf killer | 13:49 |
| bauzas | but if you put a where clause *before* the order, that should be fine | 13:49 |
| efried | bauzas: Did you use SQL Server 2008 perchance? | 13:49 |
| bauzas | efried: SQL2K even | 13:49 |
| bauzas | I mean, I was in a company that was doing ASP and SQL Server 2K | 13:50 |
| bauzas | then PHP | 13:50 |
| efried | bauzas: The other thing to consider is whether there's actually any need to sort. Are the rows created in chronological order already? | 13:50 |
| bauzas | can you just imagine how much I loved my job | 13:50 |
| efried | bauzas: Heh, that sounds like my gig from 2000 to 2003 | 13:50 |
| bauzas | ... it was in 2011 ... | 13:51 |
| efried | actually from 1998 | 13:51 |
| bauzas | call it tech deby | 13:51 |
| efried | So yeah, if the rows are already sorted in chrono order, you can cheat. Either don't sort, because they'll already come back in the right order; or sort by the primary key ID (assuming that's an auto int). | 13:52 |
| *** Tom-Tom has quit IRC | 13:52 | |
| *** jchhatbar has quit IRC | 13:53 | |
| bauzas | anyway | 13:53 |
| *** jchhatbar has joined #openstack-nova | 13:53 | |
| bauzas | looks like the index can solve most of the problem | 13:53 |
| bauzas | given it's on the top patch, I +Wd | 13:53 |
| *** mriedem has joined #openstack-nova | 13:54 | |
| bauzas | but I'm curious if that index was needed | 13:54 |
| *** bhujay has quit IRC | 13:54 | |
| bauzas | in general, we put indexes on dates because we like to ask in a where clause something like "where created > today - 1yr" | 13:55 |
| bauzas | but here, it's a order by | 13:55 |
| bauzas | so AFAIK in the SQL execution plan, it goes at the last | 13:55 |
| mriedem | bauzas: if you're talking about https://review.openstack.org/#/c/530429/, it's used in a filter | 13:55 |
| mriedem | for changes-since | 13:55 |
| bauzas | mriedem: yeah | 13:55 |
| *** AlexeyAbashkin has quit IRC | 13:56 | |
| bauzas | ok, so the order by is required | 13:56 |
| *** AlexeyAbashkin has joined #openstack-nova | 13:56 | |
| bauzas | oops | 13:56 |
| bauzas | so the index is required anyway | 13:56 |
| mriedem | the index is for the filter, | 13:56 |
| mriedem | we order by created_at | 13:56 |
| mriedem | not updated_at | 13:56 |
| bauzas | but I'm still curious | 13:56 |
| *** Tom-Tom has joined #openstack-nova | 13:57 | |
| *** jchhatbar has quit IRC | 13:57 | |
| *** jchhatbar has joined #openstack-nova | 13:57 | |
| bauzas | meeting time in 3 mins, right? | 13:57 |
| gibi | right | 13:58 |
| bauzas | cool | 13:58 |
| *** dtantsur|bbl is now known as dtantsur | 13:59 | |
| *** Tom-Tom_ has joined #openstack-nova | 13:59 | |
| *** eharney has quit IRC | 14:00 | |
| *** Tom-Tom has quit IRC | 14:01 | |
| *** rodolof has quit IRC | 14:03 | |
| *** rodolof has joined #openstack-nova | 14:03 | |
| *** Tom-Tom_ has quit IRC | 14:04 | |
| *** tssurya has quit IRC | 14:05 | |
| *** jchhatbar has quit IRC | 14:06 | |
| *** jchhatbar has joined #openstack-nova | 14:06 | |
| *** liverpooler has joined #openstack-nova | 14:06 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Workaround glanceclient bug when CONF.glance.api_servers not set https://review.openstack.org/541008 | 14:07 |
| mordred | mriedem: yes, I would like it if GET /flavors/detail included the extra specs - but it's not *super* important so I certainly wouldn't prioritize it just for me :) | 14:07 |
| mriedem | mordred: just getting user feedback; our product team wants it because they have a time limit on loading flavors in the UI, and they have to first get all flavors and then for each one, get their extra specs, and that can timeout the UI panel | 14:09 |
| mriedem | i actually found a blueprint from 4 years ago for the same thing when we were doing nova v3 api | 14:09 |
| *** jchhatbar has quit IRC | 14:11 | |
| *** elmaciej has quit IRC | 14:11 | |
| *** jchhatbar has joined #openstack-nova | 14:11 | |
| mordred | mriedem: yah - I have the same issue in shade (minus the timelimit) because I was dumb and made the default behavior of list_flavors be to add the extra-specs by default - so doing a list_flavors on a cloud with a lot of flavors takes *forever* | 14:12 |
| *** Tom-Tom has joined #openstack-nova | 14:12 | |
| mordred | mriedem: I swapped the default behavior when we merged the shade code into the sdk repo, but I do think it would be nice to just get it all at once | 14:13 |
| mriedem | we actually load it all up from the db too, so we have it in the api, we just never returned it | 14:13 |
| *** tssurya has joined #openstack-nova | 14:13 | |
| mriedem | ameeda: should be an easy bug to fix https://bugs.launchpad.net/nova/+bug/1746386 | 14:16 |
| openstack | Launchpad bug 1746386 in OpenStack Compute (nova) "Bindep does not catch missing libpcre3-dev on Ubuntu" [Low,Confirmed] | 14:16 |
| *** jchhatbar has quit IRC | 14:16 | |
| ameeda | mriedem: thanks a lot | 14:16 |
| *** jchhatbar has joined #openstack-nova | 14:16 | |
| *** alexchadin has quit IRC | 14:18 | |
| *** jchhatbar has quit IRC | 14:21 | |
| *** jchhatbar has joined #openstack-nova | 14:22 | |
| *** ingy has joined #openstack-nova | 14:25 | |
| *** lucasagomes is now known as lucas-hungry | 14:26 | |
| ingy | mordred: o/ | 14:27 |
| *** esberglu has joined #openstack-nova | 14:28 | |
| *** jchhatbar has quit IRC | 14:31 | |
| *** jchhatbar has joined #openstack-nova | 14:32 | |
| *** amodi has joined #openstack-nova | 14:33 | |
| *** yamamoto has quit IRC | 14:34 | |
| jianghuaw | bauzas, mriedem: I guess we should pick up this small patch which only corrects the example for the vGPU config option: https://review.openstack.org/#/c/539183/ | 14:35 |
| *** kholkina has quit IRC | 14:35 | |
| *** rmcall has joined #openstack-nova | 14:36 | |
| bauzas | jianghuaw: right, I catched it but forgot to update it | 14:37 |
| bauzas | jianghuaw: FWIW, we don't need brackets | 14:37 |
| jianghuaw | bauzas, yes. | 14:37 |
| mordred | ingy: heya! | 14:37 |
| *** lbragstad has joined #openstack-nova | 14:37 | |
| bauzas | jianghuaw: I mean, we don't need quotes | 14:38 |
| jianghuaw | it should work regardless there is quotes. | 14:38 |
| ingy | mordred: hi. msged you yesterday but not sure you got it. | 14:38 |
| ingy | cdent told me to look for you here... | 14:39 |
| jianghuaw | bauzas, I mean oslo will parse it correctly. | 14:40 |
| mriedem | jianghuaw: another question inline | 14:40 |
| openstackgerrit | Adrien Cunin proposed openstack/nova master: Fixed auto-convergence option name in doc https://review.openstack.org/542237 | 14:41 |
| jianghuaw | mriedem, yes. I will update it. thanks. | 14:42 |
| *** mdnadeem has quit IRC | 14:42 | |
| cdent | mriedem: I'm continuing my explorations with slamming placement etc. and am now wondering: What are the reasons (if any) that we don't allow nova-scheduler to have worker processes? | 14:43 |
| bauzas | cdent: IIRC, that was because we were having racinesses | 14:43 |
| bauzas | I can find old threads | 14:44 |
| *** pchavva has joined #openstack-nova | 14:44 | |
| cdent | bauzas: thanks | 14:44 |
| mriedem | here you go https://review.openstack.org/#/c/159382/ | 14:44 |
| mriedem | cdent: bauzas: ^ | 14:44 |
| mriedem | that's a huawei patch so i've got'er starred :) | 14:44 |
| bauzas | ideally, I just feel we should pursue the idea to drop the whole n-sch service and do the thing in the conductor | 14:44 |
| stephenfin | dansmith: Highlighted the RPC 5.0-ish things I'm aware of here https://review.openstack.org/#/c/541005/ | 14:45 |
| mriedem | cdent: fwiw, i've had a todo sitting here to update nova-next in devstack to run with 2 nova-scheduler processes | 14:45 |
| *** jchhatbar has quit IRC | 14:45 | |
| dansmith | stephenfin: thanks will look in a sec | 14:45 |
| cdent | forcing some workers makes the rpc timeout problems go away and the instances to land, but I've got all filters turned off, so I suspect raciness won't rear its head if it is still there | 14:45 |
| bauzas | cdent: in particular if you split placement, having multiple n-sch besides conductors is a PITA for operators | 14:45 |
| stephenfin | Not sure if that can be done or not, so I'm relying on you to educate me. Can tackle it myself though, if so (and if it would help) | 14:45 |
| *** jchhatbar has joined #openstack-nova | 14:45 | |
| * stephenfin waits for DevStack to deploy and hopes sean-k-mooney's networking-ovs-dpdk plugin still works | 14:46 | |
| bauzas | cdent: mriedem: the problem was tied to the HostManager.consume_from_instance() lock, IIRC | 14:46 |
| cdent | bauzas: you say that but I find it hard to believe in a world of automation that running another service is a big deal, especially in the face of so many services... | 14:46 |
| *** eharney has joined #openstack-nova | 14:46 | |
| bauzas | call it microservices :) | 14:46 |
| *** eharney has quit IRC | 14:46 | |
| *** eharney has joined #openstack-nova | 14:46 | |
| openstackgerrit | Jianghua Wang proposed openstack/nova master: VGPU: Modify the example of vgpu white_list set https://review.openstack.org/539183 | 14:46 |
| *** yamamoto has joined #openstack-nova | 14:46 | |
| mriedem | most places are running multiple schedulers, they have to for the load, they just get reschedules if they are packing | 14:47 |
| jianghuaw | bauzas, mriedem: ^ | 14:47 |
| ameeda | mriedem: when I try to do "tox bindep" I got those errors http://paste.openstack.org/show/666615/ , I use master branch "queens" , any idea ? | 14:47 |
| bauzas | multiple schedulers != multiple workers, and I don't exactly remember why | 14:47 |
| bauzas | that's old plain story I don't remind | 14:47 |
| *** tbachman has joined #openstack-nova | 14:48 | |
| stephenfin | ameeda: What host OS are you using? | 14:48 |
| ameeda | Centos , should I do it on ubuntu ? | 14:49 |
| cdent | mriedem, bauzas : do you recall if Nikola ever produced the email message or blog post that was claimed? | 14:49 |
| bauzas | mriedem: oh thanks for the patch, yeah I got the problem now | 14:49 |
| stephenfin | Not yet. Try adding 'basepython = python2.7' above 'deps' in the '[testenv:bindep]' section of tox.ini | 14:50 |
| bauzas | cdent: what do you mean by "claimed" ? | 14:50 |
| stephenfin | ameeda: ^ | 14:50 |
| *** jchhatbar has quit IRC | 14:50 | |
| bauzas | cdent: I can point you some ndipanov's changes about fixing the locking mechanism | 14:50 |
| stephenfin | ameeda: That'll force tox to use Python 2.7 | 14:50 |
| bauzas | that's related | 14:50 |
| *** links has quit IRC | 14:50 | |
| cdent | bauzas: he said in the comments that he would right a more detail comment in an email message. did he? | 14:50 |
| stephenfin | Actually, nvm me | 14:50 |
| *** jchhatbar has joined #openstack-nova | 14:50 | |
| stephenfin | ameeda: It's 'tox -e bindep' | 14:50 |
| bauzas | cdent: don't blame me, I'm 37 but I have poor memory :) | 14:50 |
| ameeda | stephenfin: thanks !! | 14:51 |
| bauzas | but I know we merged some concurrency patches around consume_from_instance, which later became consume_from_request() | 14:51 |
| *** yamamoto has quit IRC | 14:51 | |
| openstackgerrit | Jianghua Wang proposed openstack/nova master: VGPU: Modify the example of vgpu white_list set https://review.openstack.org/539183 | 14:52 |
| dansmith | stephenfin: the instance object stuff is definitely clear, and I think host as well, but if you could track down the host bit that would be appreciated | 14:52 |
| *** Swami has joined #openstack-nova | 14:52 | |
| stephenfin | dansmith: Sure thing | 14:53 |
| *** tbachman_ has joined #openstack-nova | 14:53 | |
| ameeda | stephenfin: Missing packages: postgresql-server python34-devel sqlite-devel ERROR: InvocationError: '/opt/stack/nova/.tox/bindep/bin/bindep test' | 14:53 |
| dansmith | even so, I'm not sure those compat blocks are fully legit, as we've had obj_compat decorators to hide that stuff for many year | 14:53 |
| *** mlavalle has joined #openstack-nova | 14:53 | |
| cdent | Well, for now I will continue my experiments with multiple scheduler workers and see what happens. | 14:53 |
| *** ccamacho|lunch has quit IRC | 14:53 | |
| *** tbachman has quit IRC | 14:53 | |
| *** tbachman_ is now known as tbachman | 14:53 | |
| stephenfin | ameeda: Right, so bindep isn't tracking the correct packages for CentOS, That's another bug | 14:54 |
| stephenfin | ameeda: But given the issue was reported against Ubuntu, you probably _should_ use that to fix _that_ particular bug :) | 14:54 |
| bauzas | cdent: I think I found the ML thread | 14:54 |
| ameeda | stephenfin: I will test it on ubuntu | 14:54 |
| ameeda | stephenfin: do you know the link of current centos bug :$ | 14:55 |
| jianghuaw | bauzas, have removed the quotes:-) https://review.openstack.org/#/c/539183 | 14:55 |
| cdent | bauzas: awesome | 14:55 |
| bauzas | cdent: http://thread.gmane.org/gmane.comp.cloud.openstack.devel/47882 | 14:55 |
| stephenfin | ameeda: Nope, there probably isn't one. You should report it (and maybe try to fix it) | 14:55 |
| *** dtantsur is now known as dtantsur|brb | 14:55 | |
| ameeda | stephenfin: great, Thanks for help :) | 14:55 |
| stephenfin | Assuming we support CentOS for that. I'm not sure if we do, given that we don't gate on it | 14:55 |
| stephenfin | np | 14:55 |
| mriedem | just add the rpm and deb packages to bindep in the same patch | 14:56 |
| *** r-daneel has joined #openstack-nova | 14:56 | |
| *** salv-orlando has joined #openstack-nova | 14:56 | |
| mriedem | libpcre3-dev [platform:dpkg] | 14:57 |
| mriedem | i think that's all you need | 14:57 |
| mriedem | looks like it's pcre-devel on fedora/centos | 14:58 |
| mriedem | https://rpmfind.net/linux/rpm2html/search.php?query=pkgconfig(libpcre) | 14:58 |
| ameeda | mriedem: you are talking about current opened bug of ubuntu . what do you think about the Centos one ? | 14:58 |
| mriedem | ameeda: it's a nova bug that the entries are missing from nova's bindep, | 14:58 |
| mriedem | just add the entries for deb and rpm | 14:58 |
| mriedem | which i've given above | 14:58 |
| *** jchhatbar has quit IRC | 14:58 | |
| ameeda | to this file bindep.txt right ? | 14:59 |
| mriedem | yes | 14:59 |
| mriedem | see the existing entries in there as an example | 14:59 |
| ameeda | cool, thanks | 14:59 |
| mriedem | same for opensuse https://software.opensuse.org/package/pcre-devel | 14:59 |
| mriedem | looks like we don't have specific entries for suse | 15:00 |
| sean-k-mooney | stephenfin: since the intel nfv ci has been offline we dont test int 300 times a day and i have only been using it on ubuntu lately but i fixed the centos support a few months ago when centos decided qemu-kvm should nolonger install qemu.. | 15:00 |
| sean-k-mooney | stephenfin: if you have issue let me know | 15:01 |
| *** awaugama has joined #openstack-nova | 15:01 | |
| Roamer` | mriedem, pcre-devel should cover all RPM-based distributions | 15:01 |
| mriedem | ameeda: btw, you can see the same thing done in devstack https://github.com/openstack-dev/devstack/commits/master/files | 15:01 |
| stephenfin | sean-k-mooney: I'm using CentOS, so I sure will | 15:01 |
| mriedem | devstack changes aren't bindep, but that shows you which packages for which distro | 15:01 |
| Roamer` | mriedem, there's a bit less divergence in RPM-based distributions than there is between Debian and Ubuntu sometimes, at least WRT libraries and development packages, not the system startup stuff :) | 15:01 |
| *** yamahata has joined #openstack-nova | 15:02 | |
| *** takashin has left #openstack-nova | 15:02 | |
| ameeda | mriedem: now I am using Centos, and the bug for Ubuntu , so the fix needs to be on ubuntu or don't care ? | 15:02 |
| *** itlinux has joined #openstack-nova | 15:02 | |
| Roamer` | (and I say this a bit sadly, with all my love for Debian and respect for Ubuntu and, well, reluctance when it comes to working on RPM-based distributions) | 15:02 |
| mriedem | ameeda: i'm not sure how to answer that | 15:02 |
| mriedem | ameeda: you can update nova and push the fix from a gentoo system, it doesn't matter, | 15:03 |
| mriedem | just add the packages to nova's bindep file | 15:03 |
| Roamer` | ameeda, try to figure out what the bug actually is, what libpcre3-dev is and why it needs to be added | 15:03 |
| mriedem | Roamer`: it's a transitive dependency, | 15:03 |
| *** links has joined #openstack-nova | 15:03 | |
| Roamer` | mriedem, I know, I fixed it for our CI | 15:03 |
| mriedem | because of the new dep on the whereto package | 15:03 |
| mriedem | whereto requires pcre | 15:03 |
| cdent | bauzas: thanks for that. I read through and I wonder to what extent claims in the scheduler are now making a difference to the concerns? | 15:03 |
| ameeda | thanks all for help, I have to go now, I will back soon. | 15:04 |
| *** acormier has joined #openstack-nova | 15:05 | |
| bauzas | cdent: I feel we solved the main blocker | 15:06 |
| gibi | mriedem: I think it is not a big deal but we have some inconsistency here https://review.openstack.org/#/c/541008/9/nova/tests/unit/image/test_glance.py@1629 | 15:06 |
| bauzas | cdent: because I was wrong in the past | 15:06 |
| bauzas | cdent: the fact that we have workers doesn't mean greenlets | 15:06 |
| * cdent nods | 15:06 | |
| bauzas | hence separate processes, exactly like having multiple n-sch services | 15:06 |
| bauzas | so, what we solved with scheduler claims is also a valid argument for saying we can have workers | 15:07 |
| *** READ10 has quit IRC | 15:07 | |
| *** READ10 has joined #openstack-nova | 15:09 | |
| *** tidwellr has joined #openstack-nova | 15:09 | |
| cdent | I've made reference to the code and the email thread in the notes I'm writing up, so we'll have that to refer back to later if needed | 15:10 |
| mriedem | gibi: i think it's probably fine, the only place we append anything to that url is in "generate_image_url" and we append /images/{id} to it | 15:11 |
| mriedem | for the createImage response location header | 15:11 |
| mriedem | and some notification during rebuild | 15:11 |
| *** hamzy has quit IRC | 15:12 | |
| edleafe | bauzas: I do remember that the argument was made for claiming in the scheduler that it would allow for multiple scheduler processes | 15:13 |
| mriedem | the pike release notes also say you can now run multiple schedulers b/c we do claims in the scheduler | 15:13 |
| mriedem | which is why i wanted to add that test wrinkle to the nova-next job | 15:13 |
| mriedem | since we have had 409 issues since pike with claims in the scheduler | 15:13 |
| stephenfin | sean-k-mooney: So etcd failed to start. Lovely :) | 15:13 |
| bauzas | mriedem: sure, but we don't support yet multiple workers, hence the discussion | 15:14 |
| bauzas | it's just a very simple patch | 15:14 |
| bauzas | but someone has to write it | 15:14 |
| mriedem | bauzas: you mean this patch? https://review.openstack.org/#/c/159382/ | 15:15 |
| bauzas | and again, I think I wonder what is the opportunity of having a separate process for filtering | 15:15 |
| bauzas | in particular now we have cells v2 and superconductor/conductors | 15:15 |
| bauzas | mriedem: yup | 15:16 |
| bauzas | anyway, something to merge in Rocky :) | 15:17 |
| openstackgerrit | Merged openstack/nova master: Fix 500 in test_resize_server_negative_invalid_state https://review.openstack.org/531117 | 15:17 |
| *** chyka has joined #openstack-nova | 15:20 | |
| openstackgerrit | Jianghua Wang proposed openstack/nova master: VGPU: Modify the example of vgpu white_list set https://review.openstack.org/539183 | 15:21 |
| openstackgerrit | Merged openstack/nova master: Add index(instance_uuid, updated_at) on instance_actions table https://review.openstack.org/530429 | 15:23 |
| *** rmcall has quit IRC | 15:23 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: VGPU: Modify the example of vgpu white_list set https://review.openstack.org/539183 | 15:23 |
| gibi | mriedem: OK, then I'm +2 | 15:24 |
| jianghuaw | mriedem, thanks. | 15:26 |
| *** lucas-hungry is now known as lucasagomes | 15:26 | |
| *** links has quit IRC | 15:28 | |
| sean-k-mooney | stephenfin: that is unrelated i normally trun it off as it is not need at all for a default devstack install | 15:28 |
| sean-k-mooney | stephenfin: i have found the etcd installation in devstack to be kindo of flaky | 15:29 |
| efried | lajoskatona: I'm going to rebase the series upon which you have https://review.openstack.org/#/c/527728/9 stacked. I'll go ahead and pull yours into the rebase unless you have objections? | 15:29 |
| stephenfin | sean-k-mooney: So I had HOST_IP configured to the IP of the IF I was binding DPDK to. Think I had that wrong, tbhg | 15:30 |
| sean-k-mooney | stephenfin: haha ya that could cause issues allright | 15:30 |
| dansmith | mriedem: in case it's not clear I think this patch from tssurya is closer to being ready than takashi's https://review.openstack.org/#/c/541246/ | 15:31 |
| *** chyka has quit IRC | 15:31 | |
| *** yamamoto has joined #openstack-nova | 15:32 | |
| sean-k-mooney | stephenfin: are you deploying on a phyicla server or a vm | 15:33 |
| stephenfin | sean-k-mooney: The latter | 15:33 |
| mriedem | dansmith: i think it is too | 15:33 |
| stephenfin | Sorry - former | 15:33 |
| stephenfin | Got a machine sat here beside me | 15:33 |
| *** brad[] has joined #openstack-nova | 15:34 | |
| *** dtantsur|brb is now known as dtantsur | 15:34 | |
| *** salv-orlando has quit IRC | 15:35 | |
| *** salv-orlando has joined #openstack-nova | 15:36 | |
| sean-k-mooney | ok this let me see if i have the vm i was doing the centos fixes on still and i can see if i can grab the local.conf. that said if you have issue with the getting started guide it would be nice to fix them too | 15:36 |
| *** lpetrut_ has quit IRC | 15:36 | |
| *** salv-orlando has quit IRC | 15:36 | |
| *** salv-orlando has joined #openstack-nova | 15:36 | |
| *** yamamoto has quit IRC | 15:37 | |
| stephenfin | sean-k-mooney: Well, let's see. It's proceeding quite nicely so far | 15:37 |
| stephenfin | since I fixed the HOST_IP issue | 15:37 |
| *** Eran_Kuris has quit IRC | 15:38 | |
| *** rmart04 has joined #openstack-nova | 15:38 | |
| *** moshele has quit IRC | 15:38 | |
| *** hongbin has joined #openstack-nova | 15:41 | |
| *** itlinux has quit IRC | 15:42 | |
| lajoskatona | efried: from my side it is ok for rebasing. I just tried to put my patch for tests on top of yours to see how it goes on latest nested patches | 15:43 |
| efried | lajoskatona: Okay. Should be coming up in the next 10-15 minutes. | 15:43 |
| *** yamamoto has joined #openstack-nova | 15:44 | |
| *** yamamoto has quit IRC | 15:44 | |
| mriedem | dansmith: one of the proxy methods in https://review.openstack.org/#/c/541005/ is broken | 15:44 |
| mriedem | otherwise just some questions | 15:45 |
| *** felipemonteiro has joined #openstack-nova | 15:45 | |
| dansmith | mriedem: ack thanks /cc stephenfin | 15:45 |
| *** felipemonteiro_ has joined #openstack-nova | 15:46 | |
| *** hamzy has joined #openstack-nova | 15:46 | |
| *** salv-orlando has quit IRC | 15:46 | |
| *** salv-orlando has joined #openstack-nova | 15:47 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Fix wrong link for "Manage Flavors" in CPU topologies doc https://review.openstack.org/542270 | 15:49 |
| stephenfin | mriedem, dansmith: Alrighty then, dumb question time 🎉 How are we able to drop the v4 proxy in the above change so early? Surely that means all our clients would have to talk 5.0 as soon as we do that? | 15:50 |
| *** hamzy_ has joined #openstack-nova | 15:50 | |
| *** felipemonteiro has quit IRC | 15:50 | |
| dansmith | stephenfin: we merge the 5.0 server and client in queens, | 15:50 |
| dansmith | then in rocky we can drop the 4.x server proxy | 15:50 |
| dansmith | stephenfin: we send 5.0 by default after that second change | 15:51 |
| dansmith | which means queens supports 5.0 client side, and since we only support one gap, we can drop 4.x in rocky | 15:51 |
| *** salv-orlando has quit IRC | 15:51 | |
| dansmith | stephenfin: you saw the second change in that stack right? | 15:51 |
| *** links has joined #openstack-nova | 15:52 | |
| *** hamzy has quit IRC | 15:52 | |
| stephenfin | dansmith: Riiight, so once people start deploying from master (future Rocky), the expectation is that _everything_ in the deployment will be on stable/queens code or newer | 15:53 |
| stephenfin | Yup, I did indeed | 15:53 |
| dansmith | stephenfin: them's the rules yeah | 15:54 |
| stephenfin | sean-k-mooney: Success! (I think) Now to actually test it and recreate NUMA issues :) | 15:54 |
| stephenfin | dansmith: Gotcha. And the 6 month rule we have for conf options doesn't apply to this? | 15:55 |
| dansmith | stephenfin: no | 15:55 |
| dansmith | stephenfin: (no it does not) | 15:55 |
| *** zhaochao has quit IRC | 15:55 | |
| stephenfin | 👍 | 15:55 |
| *** slaweq has quit IRC | 15:56 | |
| *** tidwellr has quit IRC | 15:56 | |
| *** slaweq has joined #openstack-nova | 15:56 | |
| dansmith | I'm assuming you mean the 6-mo deprecation warning period.. this is per release, and nothing is being deprecated.. we only support one version back technically anyway, so this is just us officially dropping stuff that has technically been deprecated for a long time | 15:56 |
| dansmith | (and this is the pattern we do every time we bump) | 15:56 |
| *** tidwellr has joined #openstack-nova | 15:57 | |
| stephenfin | dansmith: Yup, that's the one. Thanks for the context | 15:58 |
| stephenfin | dansmith: and a last one: this is a different RPC API with it's own unique version, right? https://github.com/openstack/nova/blob/master/nova/scheduler/manager.py#L51 | 15:58 |
| dansmith | aye | 15:59 |
| stephenfin | Lovely. So now I need to go figure out _which_ other RPC API needs to be bumped to v5 to remove all that code I linked. Fun times :) | 16:00 |
| *** gongysh has joined #openstack-nova | 16:00 | |
| *** slaweq has quit IRC | 16:01 | |
| openstackgerrit | Merged openstack/nova master: Fixed auto-convergence option name in doc https://review.openstack.org/542237 | 16:01 |
| dansmith | given you linked to stuff in virt, really it should only be compute rpc | 16:01 |
| dansmith | if not, we're leaking details (which is possible I guess) | 16:01 |
| *** pcaruana has quit IRC | 16:02 | |
| *** mvk_ has quit IRC | 16:05 | |
| mriedem | dansmith: did you want to +W this backport https://review.openstack.org/#/c/539005/ ? | 16:05 |
| *** ratailor has joined #openstack-nova | 16:08 | |
| hrw | mriedem: thanks for accepting my pike backport | 16:08 |
| *** ragiman has quit IRC | 16:09 | |
| mriedem | yw | 16:09 |
| stephenfin | dansmith: [1] is my main concern. Assuming RequestSpec objects are used by the scheduler, we'll need to bump that version too to remove the called function [1] https://github.com/openstack/nova/blob/master/nova/objects/request_spec.py#L140 | 16:09 |
| hrw | mriedem, stephenfin: can you find a few minutes for https://review.openstack.org/#/c/541728/ one? support matrix for aarch64 patch | 16:09 |
| stephenfin | hrw: I can probably squeeze it in | 16:09 |
| hrw | thx | 16:10 |
| *** udesale has quit IRC | 16:10 | |
| hrw | trying to get my nova queue cleaned | 16:10 |
| stephenfin | dansmith: More specifically, that calls into one of those offending functions here https://github.com/openstack/nova/blob/master/nova/objects/request_spec.py#L177-L178 | 16:11 |
| dansmith | stephenfin: I'm not sure why that's a problem, but I can't really concentrate while on this call so I'll look when I'm done | 16:11 |
| mriedem | hrw: left a comment in doc/source/user/feature-matrix-gp.ini but i don't really understand what the values are supposed to mean in that doc | 16:11 |
| mriedem | if 'missing' means CI or functionality | 16:11 |
| mriedem | johnthetubaguy might know | 16:11 |
| mriedem | it was part of the feature classification work that osic was doing | 16:12 |
| hrw | mriedem: functionality rather. there are other column without CI stuff | 16:12 |
| mriedem | hrw: you can't create/delete a server with aarch64? | 16:12 |
| *** rmart04 has quit IRC | 16:12 | |
| *** ccamacho has joined #openstack-nova | 16:12 | |
| stephenfin | mriedem: Looking at line 76, it would seem we should be using partial, not missing | 16:13 |
| hrw | mriedem: docs part is weird. | 16:13 |
| stephenfin | Assuming you _can_ create a server, heh | 16:13 |
| *** gongysh has quit IRC | 16:13 | |
| hrw | mriedem: functionality list depends on tempest tests. and in tempest output I did not found ones referred there | 16:14 |
| hrw | mriedem: support-matrix depends on commands == can be tested | 16:14 |
| mriedem | doc/source/user/support-matrix.ini is much more straight forward, it doesn't concern itself with CI coverage | 16:14 |
| mriedem | the doc/source/user/feature-matrix-gp.ini one is the one that annoys me | 16:14 |
| hrw | mriedem: did not found or found errors in tempest | 16:14 |
| mriedem | we have no CI coverage for libvirt+aarch64, | 16:15 |
| mriedem | so that's an easy one, | 16:15 |
| mriedem | but i don't know if the gp doc is just about CI coverage or not | 16:15 |
| mriedem | it's half baked | 16:15 |
| mriedem | and i'd kind of like to delete it | 16:15 |
| hrw | mriedem: if feature-matrix-gp.ini tells me that feature X depends on test A-B-C-D and I see that A-B-C-D failed in tempest run then it looks like missing rather then complete | 16:15 |
| mriedem | hrw: so for L73 you're saying you can't create or delete a server with libvirt+aarch64? | 16:16 |
| *** belmoreira has quit IRC | 16:17 | |
| *** tssurya has quit IRC | 16:18 | |
| hrw | mriedem: if I go straight through tests like this doc suggests then it looks like that | 16:18 |
| *** tbachman has quit IRC | 16:19 | |
| *** salv-orlando has joined #openstack-nova | 16:20 | |
| hrw | feature-matrix-gp.ini/operation.create-delete-server lists two tests: 9a438d88-10c6-4bcd-8b5b-5b6e25e1346f (test_list_servers) and 585e934c-448e-43c4-acbf-d06a9b899997 (test_list_servers_with_detail) and I lack both in any tempest run logs | 16:21 |
| mriedem | hrw: honestly i'd just remove the changes for the -gp doc and ignore it | 16:21 |
| mriedem | let's just sort out the more complete feature support matrix, which isn't about CI | 16:22 |
| hrw | mriedem: that's an option | 16:22 |
| openstackgerrit | Claudiu Belu proposed openstack/nova master: hyperv: Cleans up live migration Planned VM https://review.openstack.org/478943 | 16:24 |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Add release note for Aggregate[Core|Ram|Disk]Filter change https://review.openstack.org/542290 | 16:26 |
| cfriesen | is there a debug option to include the body of requests in the nova-api log? | 16:28 |
| hrw | mriedem: will check your comments on my setup | 16:28 |
| *** masayukig has quit IRC | 16:29 | |
| *** tesseract has quit IRC | 16:29 | |
| *** xinliang has quit IRC | 16:29 | |
| *** tesseract has joined #openstack-nova | 16:29 | |
| *** masayukig has joined #openstack-nova | 16:30 | |
| ameeda | mriedem: I am back. I added this line "libpcre3-dev [platform:dpkg]" as you mentioned before to bindep.txt , do I have to add "pcre-devel" too ? | 16:31 |
| *** lajoskatona has quit IRC | 16:32 | |
| mriedem | ameeda: i'm going to restore and approve https://review.openstack.org/#/c/542002/ | 16:32 |
| mriedem | it's so trivial it's not worth dropping it since yours would be the same | 16:32 |
| mriedem | ameeda: yes you'd add pcre-devel for rpm | 16:32 |
| ameeda | mriedem: but I take it before him :( , anyway feel free to do what you want | 16:34 |
| hrw | how to use interface-detach? "nova interface-detach dd8 eth1" does nothing | 16:35 |
| ameeda | mriedem: pcre-devel [platform:rpm test] is fine ? | 16:35 |
| *** itlinux has joined #openstack-nova | 16:36 | |
| johnthetubaguy | hrw: good questions, the long term aim was for the tests to help auto generate the grid, only some tests passing sounds like partial to me | 16:37 |
| hrw | johnthetubaguy: create-delete does not test either creating nor deleting | 16:37 |
| *** elmaciej has joined #openstack-nova | 16:38 | |
| johnthetubaguy | hrw: that sounds wrong, you got the links I can dig to see what was going on there | 16:38 |
| hrw | johnthetubaguy: at least it goes like that when you look at 'tempest --list' output (sth like that - the one which gives names<>uuid mapping) | 16:38 |
| *** sticker has quit IRC | 16:39 | |
| *** hemna_ has quit IRC | 16:39 | |
| johnthetubaguy | hrw: yep I see now, this looks broken: https://github.com/openstack/nova/blob/5158ca7dcffd583dc8dd7c29b0a9a595d7de7dcf/doc/source/feature_matrix_gp.ini#L51 | 16:40 |
| hrw | johnthetubaguy: exactly | 16:41 |
| hrw | anyone used 'interface-detach' without --port-id? | 16:41 |
| johnthetubaguy | hrw: oh wait... that does a create in the setup | 16:41 |
| johnthetubaguy | hrw: I think its taken from what was used for the logo certification stuff at the time | 16:42 |
| hrw | johnthetubaguy: anyway I skip that part for aarch64 | 16:42 |
| johnthetubaguy | hrw: I think that's a nova-network thingy, the error handling is super dodgy | 16:42 |
| hrw | johnthetubaguy: support-matrix.ini is easier to fill | 16:42 |
| johnthetubaguy | hrw: why skip for aarch64? I missed that | 16:42 |
| johnthetubaguy | ah, got you | 16:43 |
| hrw | johnthetubaguy: like I told earlier: feature-matrix-gp.ini/operation.create-delete-server lists two tests: 9a438d88-10c6-4bcd-8b5b-5b6e25e1346f (test_list_servers) and 585e934c-448e-43c4-acbf-d06a9b899997 (test_list_servers_with_detail) and I lack both in any tempest run logs | 16:43 |
| hrw | johnthetubaguy: so if I go right then create-delete functionality is missing, right?? | 16:44 |
| *** amodi has quit IRC | 16:44 | |
| *** yamamoto has joined #openstack-nova | 16:44 | |
| *** rmart04 has joined #openstack-nova | 16:45 | |
| johnthetubaguy | hrw: correct, if its not tested in the gate, you would mark it as missing | 16:46 |
| johnthetubaguy | by gate I mean 3rdparty I guess | 16:46 |
| hrw | johnthetubaguy: http://logs.openstack.org/28/541728/8/check/build-openstack-sphinx-docs/b9ac718/html/user/feature-classification.html | 16:47 |
| *** openstackgerrit has quit IRC | 16:48 | |
| *** Swami has quit IRC | 16:48 | |
| *** hongbin has quit IRC | 16:48 | |
| *** damien_r1 has quit IRC | 16:48 | |
| hrw | johnthetubaguy: table is bogus for aarch64: is marked as missing or unknown despite working. just because tests used in ini files test for other stuff than names say | 16:48 |
| hrw | johnthetubaguy: or listed tests are not used anymore | 16:49 |
| johnthetubaguy | hrw: yeah seems like its bit rotted | 16:49 |
| hrw | hm. no volumes in my setup | 16:49 |
| hrw | (openstack) volume create --image f91ae3a7-e067-466c-b1b3-e592ea58d266 --size 8 --availability-zone nova my-new-volume | 16:49 |
| hrw | internal endpoint for volumev2 service in RegionOne region not found | 16:49 |
| *** hongbin has joined #openstack-nova | 16:50 | |
| johnthetubaguy | probably worth deleting at some point... | 16:50 |
| hrw | johnthetubaguy: so instead of filling table with 'sorry, but nothing works here' I prefer to fill support-matrix one with 'this works, this does not and that is not tested' | 16:50 |
| johnthetubaguy | hrw: yes makes sense | 16:50 |
| *** salv-orlando has quit IRC | 16:50 | |
| *** salv-orlando has joined #openstack-nova | 16:51 | |
| *** ratailor has quit IRC | 16:51 | |
| johnthetubaguy | separate thing to work out how this matches up with interop tests and the gate, sounds worrying | 16:52 |
| mriedem | ameeda: i don't know what the "test" part is for in bindep, probably need to ask about that in #openstack-infra | 16:52 |
| *** tbachman has joined #openstack-nova | 16:53 | |
| mriedem | hrw: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/api/compute/servers/test_create_server.py#n87 does test create/delete | 16:53 |
| mriedem | hrw: the test class setup creates some servers, and the teardown deletes those servers | 16:53 |
| mriedem | http://git.openstack.org/cgit/openstack/tempest/tree/tempest/api/compute/servers/test_create_server.py#n54 | 16:53 |
| mriedem | johnthetubaguy: hrw: interface attach/detach is specifically neutron only | 16:54 |
| mriedem | https://developer.openstack.org/api-ref/compute/#create-interface | 16:54 |
| mriedem | https://developer.openstack.org/api-ref/compute/#detach-interface | 16:54 |
| hrw | mriedem: then why feature-matrix-gp lists list_servers instead of server_create etc? | 16:54 |
| mriedem | hrw: likely because it's also a defcore interop test | 16:55 |
| mriedem | any tempest compute api test that has a server in it creates a server | 16:55 |
| mriedem | so they probably just picked one | 16:55 |
| hrw | https://refstack.openstack.org/#/results/952ebce2-af82-4ed6-81ba-860e80d38af4 is one of our latest runs. 75% passed. | 16:55 |
| *** salv-orlando has quit IRC | 16:55 | |
| hrw | anyway... let me check what other entries I am missing in support matrix | 16:56 |
| mriedem | my guess is if tempest is blowing up on your CI run, things aren't getting cleaned up properly and you're seeing cascading failures | 16:56 |
| mriedem | if you just run tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers it should be fine | 16:56 |
| hrw | other than volumes which for some reason does not work on my setup | 16:57 |
| hrw | mriedem: possible | 16:57 |
| hrw | found. no cinder ;D | 16:58 |
| *** amodi has joined #openstack-nova | 16:59 | |
| *** itlinux has quit IRC | 17:00 | |
| johnthetubaguy | mriedem: yeah I think we picked interop ones over any other | 17:01 |
| *** tssurya has joined #openstack-nova | 17:02 | |
| johnthetubaguy | hrw: the basic one doesn't use volumes I thought | 17:02 |
| *** yamamoto has quit IRC | 17:02 | |
| mriedem | it doesn't | 17:02 |
| mriedem | he's just saying that's why he's "unknown" about anything wrt volumes | 17:02 |
| hrw | anyway redeploying with cinder now | 17:03 |
| johnthetubaguy | ah | 17:03 |
| mriedem | yeah you kind of need cinder for volumes | 17:03 |
| mriedem | unless you're still running essex somewhere | 17:03 |
| *** slaweq has joined #openstack-nova | 17:04 | |
| hrw | essex for me is some part of uk or sth like that ;D | 17:04 |
| *** openstackgerrit has joined #openstack-nova | 17:04 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Ensure resource classes correctly https://review.openstack.org/539738 | 17:04 |
| openstackgerrit | Eric Fried proposed openstack/nova master: New-style _set_inventory_for_provider https://review.openstack.org/537648 | 17:04 |
| openstackgerrit | Eric Fried proposed openstack/nova master: SchedulerReportClient.update_from_provider_tree https://review.openstack.org/533821 | 17:04 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use update_provider_tree from resource tracker https://review.openstack.org/520246 | 17:04 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Fix nits in update_provider_tree series https://review.openstack.org/531260 | 17:04 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Move refresh time from report client to prov tree https://review.openstack.org/535517 | 17:04 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Make generation optional in ProviderTree https://review.openstack.org/539324 | 17:04 |
| openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Add nested resources to server moving tests https://review.openstack.org/527728 | 17:04 |
| *** abhishekk has quit IRC | 17:05 | |
| stvnoyes | mriedem: fyi - I just updated that bug on multiattach + multi-create. The next issue is stickier than the first one. https://bugs.launchpad.net/nova/+bug/1747985 | 17:06 |
| openstack | Launchpad bug 1747985 in OpenStack Compute (nova) "Create Multiple Servers fails when a volume is specified even with a multiattach volume" [Low,Confirmed] | 17:06 |
| bauzas | mriedem: diablo, not essex | 17:06 |
| bauzas | mriedem: cinder was a thing by essex | 17:06 |
| *** sahid has quit IRC | 17:06 | |
| mriedem | nova-volume still existed in essex | 17:06 |
| smcginnis | Split out in folsom. | 17:06 |
| mriedem | check and mate | 17:07 |
| efried | jaypipes: gory manual rebase on ==> Ensure resource classes correctly https://review.openstack.org/539738 No functional change, ready for re-review (ditto remainder of series) | 17:07 |
| bauzas | wait | 17:07 |
| *** gjayavelu has joined #openstack-nova | 17:07 | |
| bauzas | nova-volume was the thing in Essex ? | 17:07 |
| bauzas | I thought it was diablo | 17:07 |
| smcginnis | Trivial Persuit - OpenStack Edition :) | 17:07 |
| bauzas | the only change I made when upgrading to Folsom was to deploy Quantum | 17:07 |
| bauzas | I don't recall needing to spin cinder | 17:08 |
| mriedem | https://github.com/openstack/nova/blob/essex-eol/bin/nova-api-os-volume | 17:08 |
| *** felipemonteiro__ has joined #openstack-nova | 17:08 | |
| *** Eran_Kuris has joined #openstack-nova | 17:08 | |
| bauzas | mmm, I should check the governance files directly and see if that's just an incubated/integrated question | 17:08 |
| mriedem | https://github.com/openstack/cinder/tree/essex-eol | 17:08 |
| hrw | the first version of openstack I touched code was Liberty. Mitaka/Newton were ones I packaged. Ocata+ were ones I contributed | 17:08 |
| *** slaweq has quit IRC | 17:09 | |
| openstackgerrit | Merged openstack/osc-placement master: Update doc link in README.rst https://review.openstack.org/542002 | 17:09 |
| mriedem | stvnoyes: re comment 2, yes that's what i was saying when i thought this would fail, but with a multiattach volume we should be able to create >1 attachment to that same volume | 17:09 |
| *** andreas_s has quit IRC | 17:09 | |
| mriedem | stvnoyes: or is the issue that we create the first attachment, but we can't create the 2nd attachment until the 1st attachment is 'completed'? | 17:10 |
| *** andreas_s has joined #openstack-nova | 17:10 | |
| stvnoyes | currently cinder won't allow you to attach to a reserved volume. has to be in-use or available | 17:10 |
| stvnoyes | so yes, the attach has to be completed | 17:11 |
| bauzas | snap, I dislike to be wrong https://wiki.openstack.org/wiki/ReleaseNotes/Folsom#OpenStack_Block_Storage_.28Cinder.29 | 17:11 |
| *** rmart04 has quit IRC | 17:11 | |
| mriedem | stvnoyes: we could easily recreate by adding a min_count=2 to the server create call in this tempest test https://github.com/openstack/tempest/blob/70ebe69cc2e4fa8a06071d48d19f61d2f01a33f6/tempest/api/compute/volumes/test_attach_volume.py#L393 | 17:11 |
| mriedem | i can push a patch quick | 17:12 |
| *** felipemonteiro_ has quit IRC | 17:12 | |
| bauzas | probably because migrating from nova-volumes to cinder was seamless - compared to deploying Quantum *cough* *cough* | 17:12 |
| stvnoyes | yeah I have a temptest test already to do this. I can put it up for rv if you like | 17:12 |
| *** elmaciej has quit IRC | 17:12 | |
| smcginnis | bauzas: Hah | 17:12 |
| *** lpetrut has joined #openstack-nova | 17:13 | |
| ameeda | mriedem: Thank you, please check the channel , they answered me | 17:13 |
| stephenfin | dansmith: Alright, so I think I've figured this all out, if you're curious | 17:14 |
| stephenfin | this being the RPC versioning for those functions | 17:14 |
| stvnoyes | mriedem: let me know if you want me to post a review for the multi-create + multi-attach tempest test I have. (Once you go > 1 vms you'll need to set validated=False on server_create.) | 17:15 |
| dansmith | stephenfin: shoot | 17:15 |
| *** salv-orlando has joined #openstack-nova | 17:15 | |
| mriedem | stvnoyes: easier than this? https://review.openstack.org/542322 | 17:15 |
| stephenfin | dansmith: So the issue isn't with the HostState object any more - it's with the HostState.numa_topology attribute | 17:16 |
| ameeda | mriedem: FYI: ameeda: in that case "test" is just an arbitrary profile name we've settled on to indicate that it's not a runtime dependency just a test dependency | 17:16 |
| stvnoyes | mriedem: that's pretty good. | 17:16 |
| mriedem | ameeda: that's what i figured, so yeah just use that, we only need this dep for building docs | 17:17 |
| stephenfin | dansmith: Anything that plays with HostState objects needs to call functions like this https://github.com/openstack/nova/blob/master/nova/scheduler/filters/numa_topology_filter.py#L32-L33 | 17:17 |
| *** andreas_s_ has joined #openstack-nova | 17:17 | |
| stvnoyes | Though I was using the volume as a data disk, not a boot disk. just to avoid the corruption on a m-a boot disk. | 17:18 |
| stephenfin | That's because we set HostState.numa_topology to a value that we're retrieving from ComputeNode objects (ComputeNode.numa_topology) | 17:18 |
| ameeda | mriedem: cool :) | 17:18 |
| stephenfin | and, for legacy reasons, the ComputeNode.numa_topology attribute is a JSON blob | 17:18 |
| *** derekh has quit IRC | 17:18 | |
| *** andreas_s has quit IRC | 17:18 | |
| *** AlexeyAbashkin has quit IRC | 17:19 | |
| stephenfin | dansmith: I've traced the flow here http://paste.openstack.org/show/666746/ | 17:19 |
| *** andreas_s has joined #openstack-nova | 17:19 | |
| *** sambetts is now known as sambetts|af | 17:20 | |
| *** sambetts|af is now known as sambetts|afk | 17:20 | |
| stephenfin | dansmith: So, basically, if we want to _really_ get rid of all that crap, we need to bump the version of ComputeNode to 2.0 and store objects, or add some wrapper that will auto-convert the JSON to an object | 17:20 |
| dansmith | stephenfin: that's going to be a lot of work | 17:20 |
| stephenfin | Yup :( | 17:21 |
| dansmith | definitely not happening as part of this effort before GA | 17:21 |
| *** salv-orlando has quit IRC | 17:21 | |
| *** Eran_Kuris has quit IRC | 17:21 | |
| stephenfin | Anything that deals with converting the HostState objects from strings or non-object'y stuff _can_ go and the comments need to be updated as such | 17:21 |
| stephenfin | Nope, definitely not. Far too much intertwined stuff here | 17:21 |
| *** andreas_s_ has quit IRC | 17:22 | |
| *** andreas_s_ has joined #openstack-nova | 17:23 | |
| *** Swami has joined #openstack-nova | 17:23 | |
| *** AlexeyAbashkin has joined #openstack-nova | 17:23 | |
| openstackgerrit | melanie witt proposed openstack/nova stable/ocata: Add release note for Aggregate[Core|Ram|Disk]Filter change https://review.openstack.org/542323 | 17:23 |
| *** andreas_s has quit IRC | 17:24 | |
| hrw | hm. whom to believe... "nova volume-attach dd9 uu-i-d" told "/dev/vdb" and on second try says "volume already attached" but horizon/instance/overview says "no volumes attached" | 17:25 |
| hrw | multitail++ | 17:26 |
| *** andreas_s_ has quit IRC | 17:27 | |
| hrw | ok. logs show traceback. will keep unknown then | 17:27 |
| *** AlexeyAbashkin has quit IRC | 17:28 | |
| bauzas | stephenfin: dansmith: I don't have the context, but yeah, it requires a major version bump to get rid of the past JSON string | 17:30 |
| openstackgerrit | Ameed Ashour proposed openstack/nova master: Bindep does not catch missing libpcre3-dev on Ubuntu https://review.openstack.org/542340 | 17:31 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Avoid inventory DELETE API (no conflict detection) https://review.openstack.org/539712 | 17:32 |
| efried | jaypipes: ^ another gory rebase | 17:32 |
| *** AlexeyAbashkin has joined #openstack-nova | 17:33 | |
| *** burt has joined #openstack-nova | 17:34 | |
| *** trozet has quit IRC | 17:35 | |
| *** moshele has joined #openstack-nova | 17:36 | |
| *** AlexeyAbashkin has quit IRC | 17:37 | |
| *** salv-orlando has joined #openstack-nova | 17:39 | |
| sean-k-mooney | stephenfin: glad to hear. | 17:41 |
| *** salv-orlando has quit IRC | 17:42 | |
| sean-k-mooney | stephenfin: did you modify our ovs-dpdk compilateion code to explcitly enable numa support? | 17:42 |
| *** efried has quit IRC | 17:44 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/nova master: Provide basic data for AArch64 support matrix/functionality https://review.openstack.org/541728 | 17:44 |
| hrw | still several unknown states but should be closer to sanity | 17:45 |
| hrw | mriedem: upgrade note added | 17:45 |
| sean-k-mooney | stephenfin: try this before you get too far in grep CONFIG_RTE_LIBRTE_VHOST_NUMA /opt/stack/DPDK-*/build/.config. if it is set to n which i belive it will be the numa support in ovs/dpdk is disabled but that should allow you to get the worst case setup | 17:46 |
| stephenfin | sean-k-mooney: I did not. Damn it | 17:48 |
| *** efried has joined #openstack-nova | 17:48 | |
| sean-k-mooney | stephenfin: actullly wost case is nic on numa node 0, vcpu_pin_set allows only numa node 0 cpus and ovs_pmd_mask set pmd on numa node 1 | 17:48 |
| sean-k-mooney | stephenfin: well if you want to mesure the maxium performance hit then leave it disabled and set up the topology above. | 17:49 |
| mriedem | so apparently this is a regression unique to queens https://review.openstack.org/#/c/522161/ | 17:49 |
| mriedem | recreated it here https://review.openstack.org/#/c/542232/ | 17:49 |
| mriedem | doesn't fail in pike, ocata or newton | 17:49 |
| sean-k-mooney | stephenfin: if you want to fix it just add another sed line here https://github.com/openstack/networking-ovs-dpdk/blob/master/devstack/libs/ovs-dpdk#L392-L399 | 17:50 |
| *** mvk_ has joined #openstack-nova | 17:50 | |
| *** salv-orlando has joined #openstack-nova | 17:51 | |
| *** sshwarts has quit IRC | 17:51 | |
| *** amoralej is now known as amoralej|off | 17:53 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Bump compute RPC API to version 5.0 https://review.openstack.org/541005 | 17:54 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Compute RPC client bump to 5.0 https://review.openstack.org/541035 | 17:54 |
| *** moshele has quit IRC | 17:54 | |
| *** tidwellr_ has joined #openstack-nova | 17:55 | |
| *** tidwellr has quit IRC | 17:55 | |
| * hrw ends a day | 17:56 | |
| dansmith | melwitt: I was about to say this dep change proves your patch works, but.. I didn't think you could specify the url as the depends-on.. did I miss them adding that feature? https://review.openstack.org/#/c/540087/ | 17:57 |
| melwitt | dansmith: yeah. you missed the controversy /me digs up link | 17:58 |
| dansmith | ugh seriously? | 17:58 |
| *** dtantsur is now known as dtantsur|afk | 17:58 | |
| melwitt | here's the original post http://lists.openstack.org/pipermail/openstack-dev/2018-January/126535.html | 17:59 |
| dansmith | yeah found it | 17:59 |
| dansmith | me no likey | 17:59 |
| melwitt | same | 17:59 |
| *** itlinux has joined #openstack-nova | 18:00 | |
| *** oomichi has joined #openstack-nova | 18:02 | |
| dansmith | melwitt: mriedem: so on that change, we passed all but one in the last round, which was a volume timeout | 18:03 |
| dansmith | same for the dep patch, | 18:03 |
| dansmith | but on this recheck we failed a ton of volume things | 18:03 |
| dansmith | I would expect these are unrelated, but... know of any known-broken volume stuff at the moment? | 18:04 |
| openstackgerrit | Ameed Ashour proposed openstack/nova master: change instance_system_metadata column type https://review.openstack.org/526900 | 18:04 |
| mriedem | this job http://logs.openstack.org/87/540087/2/check/tempest-full-py3/0d74482/ ? | 18:04 |
| dansmith | and tempest-full | 18:04 |
| mriedem | looks like cinder-scheduler shit the bed http://logs.openstack.org/42/541442/3/check/tempest-full/3f33082/controller/logs/screen-c-sch.txt.gz?level=TRACE | 18:06 |
| mriedem | which isn't our fault | 18:06 |
| mriedem | Volume group "stack-volumes-lvmdriver-1" not found | 18:06 |
| dansmith | yeah this is the other job: http://logs.openstack.org/42/541442/3/check/tempest-full/3f33082/controller/logs/screen-c-sch.txt.gz?level=TRACE | 18:07 |
| openstackgerrit | Ameed Ashour proposed openstack/nova master: change instance_system_metadata column type https://review.openstack.org/526900 | 18:07 |
| *** Eran_Kuris has joined #openstack-nova | 18:09 | |
| *** slaweq has joined #openstack-nova | 18:10 | |
| *** moshele has joined #openstack-nova | 18:13 | |
| *** jpena is now known as jpena|off | 18:13 | |
| *** slaweq_ has joined #openstack-nova | 18:13 | |
| mriedem | dansmith: one lingering thing in https://review.openstack.org/#/c/541005/ | 18:15 |
| openstackgerrit | Merged openstack/nova stable/pike: live-mig: keep disk device address same https://review.openstack.org/541642 | 18:16 |
| openstackgerrit | Merged openstack/nova stable/pike: Fixes 'Not enough available memory' log message https://review.openstack.org/536297 | 18:16 |
| openstackgerrit | Merged openstack/nova stable/pike: libvirt: use 'host-passthrough' as default on AArch64 https://review.openstack.org/532504 | 18:16 |
| openstackgerrit | Merged openstack/nova stable/pike: Unmap compute nodes when deleting host mapping https://review.openstack.org/527560 | 18:16 |
| openstackgerrit | Merged openstack/nova master: Add release note for Aggregate[Core|Ram|Disk]Filter change https://review.openstack.org/541018 | 18:16 |
| dansmith | mriedem: replied | 18:16 |
| mriedem | but you didn't remove the defaults from build_and_run_instance | 18:17 |
| mriedem | in 5.0 | 18:17 |
| mriedem | ... | 18:17 |
| dansmith | mriedem: ah right, because I excluded that one unlike the others | 18:18 |
| dansmith | so, fine, I'll remove it | 18:18 |
| mriedem | there was another 5.x thing for migrate_data in rollback live migration | 18:18 |
| mriedem | just noticed | 18:18 |
| *** slaweq_ has quit IRC | 18:19 | |
| dansmith | ugh okay | 18:19 |
| dansmith | mriedem: oh I can just remove that one | 18:21 |
| dansmith | not sure what that was about, because it's already converted in live_migration always | 18:21 |
| dansmith | we're even setting it on an object that enforces the type right before both calls to that | 18:22 |
| dansmith | so we'd have been broken already | 18:22 |
| *** Eran_Kuris has quit IRC | 18:22 | |
| mriedem | true | 18:24 |
| mriedem | so yeah just remove those 2 things and i'm +2 | 18:24 |
| *** ralonsoh has quit IRC | 18:25 | |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Marker reset option for nova-manage map_instances https://review.openstack.org/539501 | 18:26 |
| *** moshele has quit IRC | 18:26 | |
| sean-k-mooney | Jeffrey4l: hi are you still working on https://bugs.launchpad.net/nova/+bug/1414895 i recently deployed stable pike and have this issue for standard livemigrations not just host evacuate | 18:27 |
| openstack | Launchpad bug 1414895 in OpenStack Compute (nova) "failed compute node didn't delete instance's path directory in init_host" [Low,In progress] - Assigned to Jeffrey Zhang (jeffrey4l) | 18:27 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: WIP: Ensure 'HostState.numa_topology' is always an object https://review.openstack.org/542362 | 18:28 |
| stephenfin | dansmith, bauzas: ^ | 18:28 |
| stephenfin | It's rather low priority, but I would appreciate a sanity check on that at some future date | 18:28 |
| stephenfin | Context here http://paste.openstack.org/show/666746/ | 18:28 |
| *** rmart04 has joined #openstack-nova | 18:28 | |
| sean-k-mooney | stephenfin: am could that break people who use the jason filter also do we care? | 18:29 |
| stephenfin | sean-k-mooney: NUMATopologyFilter, I assume? | 18:29 |
| Jeffrey4l | sean-k-mooney, no i am not working on it. feel free to take it. | 18:30 |
| stephenfin | sean-k-mooney: It should not because we currently have code to handle both objects or strings https://github.com/openstack/nova/blob/master/nova/scheduler/filters/numa_topology_filter.py#L32-L33 | 18:30 |
| sean-k-mooney | stephenfin: no the json filter allow you to match on any key/value pair on the hostsate dictionary | 18:31 |
| stephenfin | ...which is what I want to delete | 18:31 |
| stephenfin | sean-k-mooney: Hmm, I'm not sure | 18:31 |
| sean-k-mooney | stephenfin: i think it might break it but for the second quest i also dont think we should really care | 18:31 |
| sean-k-mooney | stephenfin: this filter to be specific https://github.com/openstack/nova/blob/master/nova/scheduler/filters/json_filter.py | 18:32 |
| stephenfin | sean-k-mooney: I didn't even know that was a thing. I guess we could convert back to a JSON blob specifically for that string | 18:32 |
| stephenfin | Or, more sanely, blacklist that key | 18:33 |
| sean-k-mooney | stephenfin: you use it with scheduler hints | 18:33 |
| stephenfin | I don't even think that would work at the moment. The 'numa_topology' string is one of those o.v.o object-in-a-string kind of strings | 18:33 |
| stephenfin | i.e. with 'nova_object.version' and 'nova_object.changes' keys | 18:34 |
| stephenfin | Probably a good point to note in the review | 18:34 |
| *** felipemonteiro__ has quit IRC | 18:34 | |
| stephenfin | And now, I'm off home o/ | 18:34 |
| sean-k-mooney | Jeffrey4l: ok good to know. i dont know if i will have time to try and fix it but i hit it with kolla ansible deploy stable pike image for docker hub using external ceph | 18:34 |
| *** felipemonteiro__ has joined #openstack-nova | 18:34 | |
| *** slaweq has quit IRC | 18:35 | |
| *** rmart04 has quit IRC | 18:36 | |
| *** tssurya has quit IRC | 18:36 | |
| openstackgerrit | Merged openstack/nova stable/pike: Stop globally caching host states in scheduler HostManager https://review.openstack.org/539005 | 18:36 |
| *** felipemonteiro__ has quit IRC | 18:36 | |
| *** rmart04 has joined #openstack-nova | 18:37 | |
| *** tesseract has quit IRC | 18:37 | |
| *** rmart04 has quit IRC | 18:39 | |
| *** moshele has joined #openstack-nova | 18:40 | |
| *** links has quit IRC | 18:42 | |
| *** Sukhdev has joined #openstack-nova | 18:46 | |
| *** tidwellr_ has quit IRC | 18:51 | |
| *** oomichi has quit IRC | 18:51 | |
| *** tidwellr has joined #openstack-nova | 18:52 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Bump compute RPC API to version 5.0 https://review.openstack.org/541005 | 18:54 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Compute RPC client bump to 5.0 https://review.openstack.org/541035 | 18:54 |
| *** liverpooler has quit IRC | 18:55 | |
| *** tidwellr has quit IRC | 18:56 | |
| *** slaweq has joined #openstack-nova | 18:56 | |
| *** efried1 has joined #openstack-nova | 18:57 | |
| *** efried has quit IRC | 18:58 | |
| *** efried1 is now known as efried | 18:58 | |
| mriedem | jaypipes: want to send this to it's final resting place? https://review.openstack.org/#/c/541495/ | 18:59 |
| *** efried has quit IRC | 18:59 | |
| mriedem | we need another core on https://review.openstack.org/#/c/541008/ - the nova-next job is passing again with that regression fix | 19:00 |
| *** slaweq has quit IRC | 19:01 | |
| dansmith | mriedem: oh this is the thing from yesterday | 19:02 |
| *** liverpooler has joined #openstack-nova | 19:03 | |
| mriedem | sho is | 19:03 |
| *** efried has joined #openstack-nova | 19:04 | |
| *** fanzhang has quit IRC | 19:05 | |
| *** hieulq has quit IRC | 19:06 | |
| *** fanzhang has joined #openstack-nova | 19:08 | |
| *** lucasagomes is now known as lucas-afk | 19:09 | |
| melwitt | dansmith: I updated the instance group get_hosts patch, not sure if that's what you had in mind https://review.openstack.org/#/c/540258 | 19:10 |
| mriedem | pippo likes it | 19:10 |
| mriedem | pippo likes lots of things | 19:10 |
| melwitt | +W, pippo likes it | 19:10 |
| dansmith | melwitt: oh I had looked and didn't think you had, but I must have missed it | 19:10 |
| *** READ10 has quit IRC | 19:11 | |
| melwitt | dansmith: it was later in the afternoon, ran into some snags with putting the test together. so I think it was after you were off for the day | 19:11 |
| openstackgerrit | Ameed Ashour proposed openstack/osc-placement master: The documentation build should be changed to use openstackdocstheme instead of oslosphinx. https://review.openstack.org/542378 | 19:11 |
| dansmith | I looked this morning | 19:11 |
| dansmith | I was just .. blind I guess | 19:11 |
| melwitt | oh. blind to the awesomeness I'm sure! | 19:12 |
| *** bkopilov has quit IRC | 19:12 | |
| dansmith | I'm not sure what this setup_instance_group() method is though | 19:12 |
| * dansmith digs | 19:12 | |
| mriedem | shoves a bunch of crap in the reqspec i think | 19:13 |
| melwitt | it appeared to me to be the entry point for things that wanted to look at the instance group on the request spec | 19:13 |
| dansmith | yeah, that's just so odd | 19:13 |
| dansmith | and | 19:13 |
| dansmith | not really well named | 19:13 |
| melwitt | so it's called just before select_destinations in conductor, for example. but it's also called for conductor tasks like migrate | 19:13 |
| melwitt | yeah | 19:14 |
| jaypipes | mriedem: done | 19:14 |
| mriedem | nova.scheduler.utils.shove_group_crap_in_reqspec | 19:14 |
| openstackgerrit | Ameed Ashour proposed openstack/osc-placement master: Change documentation theme https://review.openstack.org/542378 | 19:14 |
| *** lpetrut has quit IRC | 19:14 | |
| *** slaweq has joined #openstack-nova | 19:14 | |
| *** tidwellr has joined #openstack-nova | 19:15 | |
| dansmith | melwitt: well, I think I would have done it differently so we could scatter/gather and use the cell cache in there | 19:15 |
| dansmith | but this should work I guess if it's in front of all the places where we need it | 19:15 |
| melwitt | dansmith: do you mean like duplicate the get_hosts code there? I considered that but wasn't sure what you would prefer | 19:15 |
| melwitt | I do wish to use scatter-gather ideally | 19:16 |
| dansmith | I mean like just pull the whole group with hosts from the cells and then use the .hosts from those things | 19:16 |
| dansmith | however, | 19:16 |
| dansmith | can we really not pull a group out with the hosts pre-populated? | 19:16 |
| dansmith | I don't see any that let you specify it | 19:16 |
| melwitt | because scatter-gather expects to call a method that takes a context as the first arg and get_hosts uses the object._context | 19:16 |
| melwitt | oh, I see | 19:17 |
| *** slaweq has quit IRC | 19:17 | |
| dansmith | right, so just do a query for the group and get those back | 19:17 |
| dansmith | you can always adapt s/g by just using a closure | 19:17 |
| dansmith | oh | 19:18 |
| dansmith | yeah, | 19:18 |
| dansmith | this would be better | 19:18 |
| dansmith | hang on | 19:18 |
| dansmith | https://pastebin.com/Gv26a83b | 19:20 |
| dansmith | that will just do the load with the right context in each cell in parallel | 19:20 |
| dansmith | then you can stitch the hosts together after | 19:20 |
| dansmith | right? | 19:20 |
| melwitt | seems like it ... let me try it out | 19:21 |
| melwitt | I wanted to do something like that, be able to pass something for scatter-gather. so if this works that would be ideal | 19:23 |
| *** cargonza has quit IRC | 19:25 | |
| *** csatari has quit IRC | 19:26 | |
| *** DuncanT has quit IRC | 19:26 | |
| *** efried has quit IRC | 19:28 | |
| openstackgerrit | Merged openstack/nova master: TrivialFix: Add a blankline https://review.openstack.org/542094 | 19:28 |
| *** cargonza has joined #openstack-nova | 19:29 | |
| melwitt | I noticed something else weird, another query for get_hosts. trying to figure out what to do with that https://github.com/openstack/nova/blob/master/nova/scheduler/utils.py#L687 | 19:29 |
| *** salv-orlando has quit IRC | 19:30 | |
| melwitt | it seems like it's redundant. we already got hosts for the group, then we query for an instance group again based on instance uuid, then get the hosts for that one? | 19:30 |
| *** trozet has joined #openstack-nova | 19:30 | |
| *** csatari has joined #openstack-nova | 19:30 | |
| *** DuncanT has joined #openstack-nova | 19:31 | |
| *** lbragstad has quit IRC | 19:31 | |
| *** psachin has joined #openstack-nova | 19:31 | |
| *** lbragstad has joined #openstack-nova | 19:32 | |
| melwitt | I guess it's that, first get the hosts for the request_spec.instance_group. but if request_spec.instance_uuid is populated, override the old request_spec.instance_group with the instance group associated with the instance_uuid | 19:32 |
| cfriesen | So we recently tripped over an interesting live migration bug....if you have an instance with an rbd-backed root disk and a config drive, libvirt will try to block-migrate the rbd drive and fail. The libvirt folks (dpb) seem to be saying that nova shouldn't set VIR_MIGRATE_NON_SHARED_INC if there aren't any disks to migrate. | 19:32 |
| *** efried has joined #openstack-nova | 19:32 | |
| mriedem | dansmith: just realized we have some compat code doing up-calls in the compute manager, so that's fun https://review.openstack.org/#/c/541005/6 | 19:32 |
| dansmith | mriedem: yep but super old, before multi-cell could be a thing anyway | 19:33 |
| melwitt | cfriesen: that sounds like something artom might know about ^ | 19:33 |
| mriedem | right. comment in https://review.openstack.org/#/c/541035/ btw | 19:33 |
| mriedem | cfriesen: i think mdbooth already patched that | 19:34 |
| dansmith | mriedem: ack, thanks | 19:34 |
| mriedem | https://review.openstack.org/#/q/I9b545ca8aa6dd7b41ddea2d333190c9fbed19bc1 | 19:34 |
| mriedem | cfriesen: ^ | 19:34 |
| cfriesen | mriedem: yeah, I'm pretty sure we're seeing this in pike, which should have that change in it. Will try and bottom it out. | 19:36 |
| mriedem | pike 16.0.4+? | 19:36 |
| *** AlexeyAbashkin has joined #openstack-nova | 19:37 | |
| *** trozet has quit IRC | 19:38 | |
| cfriesen | I can see the change in our version of the code, I just need to confirm we can reproduce the bug with the current code. | 19:38 |
| *** fragatina has quit IRC | 19:40 | |
| dansmith | mriedem: I'm going to fix that self.reservations thing in a follow-on patch because that bubbles up pretty high | 19:41 |
| mriedem | that's fine | 19:41 |
| *** tbachman has quit IRC | 19:41 | |
| *** mgoddard_ has quit IRC | 19:43 | |
| *** tssurya has joined #openstack-nova | 19:43 | |
| *** slaweq has joined #openstack-nova | 19:43 | |
| *** salv-orlando has joined #openstack-nova | 19:45 | |
| mriedem | melwitt: given you're going to want to backport this to pike and ocata, https://review.openstack.org/#/c/541442/ - i'm not sure if you want to address nits now or not | 19:54 |
| mriedem | but i'll be around for 2 more hours if you do so i can +W | 19:54 |
| melwitt | mriedem: I'm cool with fixing nits. thanks for the heads up. I'll update it right after I update this instance group thing. adding test coverage | 19:55 |
| *** imacdonn has quit IRC | 19:56 | |
| *** imacdonn has joined #openstack-nova | 19:56 | |
| dansmith | melwitt: es worky? | 19:58 |
| melwitt | dansmith: yis. thank you | 19:58 |
| dansmith | \o/ | 19:58 |
| melwitt | o/ high five! | 19:58 |
| *** jmlowe has quit IRC | 19:59 | |
| *** mvk_ has quit IRC | 19:59 | |
| dansmith | let it be known I had a good idea once | 19:59 |
| *** gjayavelu has quit IRC | 19:59 | |
| melwitt | heh | 20:00 |
| artom | We have no way to detach an interface when the compute is down, right? | 20:01 |
| artom | I know it's an RPC cast and everything, so compute needs to be running to receive it | 20:01 |
| mriedem | yes | 20:02 |
| mriedem | correct i mean | 20:02 |
| melwitt | yeah. you could at best tell neutron to do things with the port | 20:02 |
| artom | But just sanity-checking, you can't mark an interface as detached and then later unplug the vif when compute comes back, right? | 20:02 |
| dansmith | artom: not currently, but also, | 20:02 |
| dansmith | consider if compute manager is all that is down, | 20:02 |
| dansmith | but the interface and address are still being used on the data plane | 20:02 |
| dansmith | that would be like bad and stuff to re-assign it | 20:02 |
| artom | dansmith, ah, indeed. | 20:03 |
| artom | So not only we don't do it, but we don't even want to do it | 20:03 |
| artom | Thanks dudes :) | 20:03 |
| artom | (And Mel) | 20:03 |
| artom | ;) | 20:03 |
| melwitt | :) | 20:04 |
| *** Daisy_ has joined #openstack-nova | 20:04 | |
| openstackgerrit | Ameed Ashour proposed openstack/osc-placement master: Change documentation theme https://review.openstack.org/542378 | 20:07 |
| *** salv-orlando has quit IRC | 20:08 | |
| *** moshele has quit IRC | 20:08 | |
| *** Daisy_ has quit IRC | 20:08 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Compute RPC client bump to 5.0 https://review.openstack.org/541035 | 20:10 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Clean up reservations in migrate_task call path https://review.openstack.org/542409 | 20:10 |
| dansmith | artom: not without a lot more infrastructure around it I would say | 20:10 |
| dansmith | mriedem: ^ as promised with cleanup | 20:10 |
| *** jmlowe has joined #openstack-nova | 20:11 | |
| *** gjayavelu has joined #openstack-nova | 20:11 | |
| mriedem | dansmith: https://review.openstack.org/#/c/541035/5/nova/compute/rpcapi.py@752 | 20:16 |
| mriedem | my point there was the same as the reservations things you removed | 20:16 |
| dansmith | mriedem: replied | 20:17 |
| mriedem | sure, my point is, pass migration_id=None | 20:17 |
| *** tssurya has quit IRC | 20:17 | |
| dansmith | but that wasn't valid | 20:17 |
| dansmith | reservations=None was | 20:17 |
| dansmith | something else will try to use migration_id as an integer and fail | 20:18 |
| dansmith | oh, it was defaulted to none | 20:18 |
| dansmith | FFS, fine.. we have migration still passed here and don't for reservations, so it seems like the most compatible to just do the right thing but whatever | 20:19 |
| mriedem | long ago it didn't have a default of None https://review.openstack.org/#/c/287997/19/nova/compute/manager.py@5167 | 20:19 |
| *** moshele has joined #openstack-nova | 20:19 | |
| dansmith | ah, that was tdurakov's mistake yeah, | 20:20 |
| mriedem | we could also just remove that later in cleanup | 20:20 |
| dansmith | it's not compatible that way | 20:20 |
| *** chyka has joined #openstack-nova | 20:20 | |
| dansmith | so passing None there would break that older code if we were to interact with ti | 20:20 |
| dansmith | mriedem: all the 4.x stuff goes away in rocky anyway | 20:20 |
| dansmith | so yes, the same cleanup that removes all this would remove that anyway | 20:21 |
| openstackgerrit | melanie witt proposed openstack/nova master: Make scheduler.utils.setup_instance_group query all cells https://review.openstack.org/540258 | 20:21 |
| mriedem | +2 | 20:21 |
| *** vladikr has quit IRC | 20:21 | |
| mriedem | onto the cleanup patch | 20:21 |
| dansmith | I havent' written the "drop 4.x" patch yet, but can get on that once we start to slow down | 20:22 |
| mriedem | +2s all the way | 20:22 |
| mriedem | time to find another core | 20:22 |
| mriedem | they tend to hide | 20:23 |
| *** cali_boxer has joined #openstack-nova | 20:23 | |
| *** trozet has joined #openstack-nova | 20:23 | |
| *** vladikr has joined #openstack-nova | 20:24 | |
| *** chyka has quit IRC | 20:24 | |
| *** moshele has quit IRC | 20:25 | |
| openstackgerrit | Merged openstack/nova master: Workaround glanceclient bug when CONF.glance.api_servers not set https://review.openstack.org/541008 | 20:26 |
| openstackgerrit | Merged openstack/nova master: Add a prelude release note for the 17.0.0 Queens GA https://review.openstack.org/541495 | 20:26 |
| *** trozet has quit IRC | 20:30 | |
| *** awaugama has quit IRC | 20:33 | |
| *** moshele has joined #openstack-nova | 20:35 | |
| dansmith | gah pep8 | 20:38 |
| *** trozet has joined #openstack-nova | 20:39 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Clean up reservations in migrate_task call path https://review.openstack.org/542409 | 20:40 |
| cdent | mriedem, dansmith: wrote up some of the scale stuff I was playing with last night (and today too): https://anticdent.org/placement-scale-fun.html (efried, jaypipes might be of interest to you too). Some conclusions/observations towards the end. | 20:42 |
| mriedem | ok | 20:45 |
| mriedem | thanks | 20:45 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Encode libvirt domain XML in UTF-8 https://review.openstack.org/522161 | 20:46 |
| openstackgerrit | melanie witt proposed openstack/nova master: Refine waiting for vif plug events during _hard_reboot https://review.openstack.org/541442 | 20:47 |
| dansmith | cdent: conductors do more than boot things, so conductors=schedulers isn't right | 20:47 |
| dansmith | you'll always need more conductors than schedulers | 20:47 |
| melwitt | gdi I forgot another thing I wanted to update | 20:47 |
| cdent | dansmith: the point I was trying to make there was that _if_ you have eight conductors and you slam the api, then the conductor is going to slam the scheduler | 20:47 |
| dansmith | you're measuring mostly boot load there which is why it seems like they're the same | 20:47 |
| mriedem | dansmith: melwitt: need another +2 on https://review.openstack.org/#/c/522161/ - tempest regression test is passing with that, and it's clearly a regression in queens because the tempest test before i added the depends-on failed in master and passed on all the stable branches | 20:48 |
| *** gjayavelu has quit IRC | 20:48 | |
| cdent | so at the starting point you're always going to overwhelm the scheduler processes | 20:48 |
| cdent | with an otherwise initially idle conductor | 20:48 |
| dansmith | cdent: also s/rcp timeout/rpc timeout/ | 20:48 |
| cdent | thanks | 20:48 |
| dansmith | cdent: also, the reasoning for the lack of workers= on the scheduler is that it used to be that >1 would just kill you because they'd stomp all over each other | 20:49 |
| dansmith | with claims in the scheduling process, that stops being a problem | 20:49 |
| cdent | yeah, bauzas and I were talking about that earlier today | 20:50 |
| dansmith | ack | 20:50 |
| dansmith | obviously the next thing would be to figure out what scheduler is doing the most of in there | 20:50 |
| cdent | when I had 8 workers, the scheduler seemed to work just fine, it didn't show unreasonable suffering | 20:51 |
| dansmith | with one worker, all the load for scheduler work must be serialized, on a single core and in a single process | 20:52 |
| melwitt | mriedem: that's interesting, I had thought in the past we have encoded only the instance name in the XML to let non-ascii names work, not the entire XML. but I never knew if there's any harm in encoding the whole thing. must not be if that's what py3 does by default, right? | 20:52 |
| dansmith | it will be penalized for that against anything else wanting to run | 20:52 |
| dansmith | and on a system with everything running on it, it will get a smallish slice of the system, being CPU-bound | 20:52 |
| openstackgerrit | melanie witt proposed openstack/nova master: Refine waiting for vif plug events during _hard_reboot https://review.openstack.org/541442 | 20:53 |
| dansmith | everything else having multiple workers gives those things way more bandwidth and time slice, relative to scheduler, yet everything funnels through scheduler | 20:53 |
| dansmith | which isn't necessarily how it would be on a real system with things separated, depending on the layout | 20:53 |
| * cdent nods | 20:53 | |
| dansmith | but | 20:54 |
| dansmith | on a multi-core system(i.e. anything from this decade) a single scheduler worker on the box makes no sense either | 20:54 |
| dansmith | allowing workers= to be configured on the scheduler process is probably something we can/should do now | 20:54 |
| dansmith | maybe default=1 for the moment, but get some feedback on that | 20:55 |
| openstackgerrit | melanie witt proposed openstack/nova master: Make scheduler.utils.setup_instance_group query all cells https://review.openstack.org/540258 | 20:55 |
| cdent | yeah, I tried to make it clear that I wasn't modeling a real world with what I was doing | 20:55 |
| dansmith | no, I know, I'm just saying words | 20:55 |
| cdent | it was pretty cool the way stuff mostly just worked | 20:56 |
| *** jmlowe has quit IRC | 20:56 | |
| *** ChanServ has quit IRC | 20:57 | |
| mriedem | cdent: you could brush up https://review.openstack.org/#/c/159382/ and throw it into the env and see what difference it makes | 20:57 |
| mriedem | heh i suppose i'd have to get jogo's -2 removed | 20:58 |
| cdent | mriedem: I already did (my own version of) that. I had to go to eight workers to get things to not timeout | 20:58 |
| *** hamzy_ has quit IRC | 21:00 | |
| *** mgoddard_ has joined #openstack-nova | 21:00 | |
| *** Tom-Tom has quit IRC | 21:02 | |
| *** Tom-Tom has joined #openstack-nova | 21:03 | |
| *** moshele has quit IRC | 21:03 | |
| cdent | mriedem: what I'm not clear on (yet) is what needs to be done to exercise any of the hoststate management concerns | 21:03 |
| mriedem | in the scheduler? | 21:03 |
| mriedem | using the default enabled filters is probably a good start | 21:03 |
| dansmith | what does that mean? | 21:04 |
| dansmith | hoststate management concerns | 21:04 |
| mriedem | he disabled all of the filters | 21:04 |
| mriedem | oh | 21:04 |
| dansmith | oh, I missed that.. what is the scheduler doing then? | 21:04 |
| mriedem | querying placement | 21:04 |
| mriedem | fin | 21:04 |
| *** vladikr has quit IRC | 21:04 | |
| dansmith | oh, yeah, I totally missed that part | 21:04 |
| dansmith | that's not awesome, but maybe it's just the "8 people asking 1 person to do all the work" then | 21:05 |
| mriedem | cdent: another thing to consider is that all 75 fake computes are going to be rpc broadcasting the shit out of the scheduler(s) for all instance resource tracker type actions, and every update_available_resource periodic | 21:05 |
| dansmith | ...with no IO delays between them yeah | 21:05 |
| mriedem | CONF.filter_scheduler.track_instance_changes is that guy | 21:05 |
| mriedem | defaults to True | 21:05 |
| mriedem | although, | 21:06 |
| cdent | dansmith: the comments on https://review.openstack.org/#/c/159382/ and the email in http://thread.gmane.org/gmane.comp.cloud.openstack.devel/47882 has more about the host state stuff from the original stuff | 21:06 |
| mriedem | in your setup it should be using superconductor mode, | 21:06 |
| mriedem | where we disable track_instance_changes b/c compute can't reach scheduler | 21:06 |
| *** acormier has quit IRC | 21:06 | |
| mriedem | http://git.openstack.org/cgit/openstack-dev/devstack/tree/lib/nova#n859 | 21:07 |
| dansmith | cdent: okay but that is super old and unrelated anymore I think | 21:07 |
| *** acormier has joined #openstack-nova | 21:07 | |
| dansmith | cdent: all irrelevant after claims being in the scheduler | 21:07 |
| dansmith | we're also pumping all the old RT stats into the database now, which we shouldn't need to do anymore because placement | 21:07 |
| cdent | dansmith: I'm only reporting it to provide context to the earlier conversation with bauzas, who thought there might be still be issues, but I had been assuming it ought to irrelevant with claims in the scheduler | 21:07 |
| dansmith | which just adds to the mq load | 21:07 |
| dansmith | cdent: irrelevant afaik | 21:08 |
| *** acormier has quit IRC | 21:08 | |
| mriedem | you probably got lucky here | 21:08 |
| *** acormier_ has joined #openstack-nova | 21:08 | |
| mriedem | nova-manage cell_v2 discover_hosts openstack hypervisor list | 21:08 |
| *** acormier_ has quit IRC | 21:08 | |
| mriedem | swap those around | 21:08 |
| *** acormier has joined #openstack-nova | 21:08 | |
| mriedem | need i link to our favorite dokken video? | 21:08 |
| *** salv-orlando has joined #openstack-nova | 21:08 | |
| cdent | mriedem: ? | 21:08 |
| mriedem | https://www.youtube.com/watch?v=mBluR6cLxJ8 | 21:09 |
| *** oomichi has joined #openstack-nova | 21:09 | |
| cdent | not the video, why the order | 21:09 |
| cdent | if I don't discover hosts, I've got no hypervisors | 21:09 |
| mriedem | you should run openstack service list first, before discover_hosts | 21:09 |
| mriedem | to make sure the compute node records are created | 21:09 |
| mriedem | grep service-list in here https://docs.openstack.org/nova/latest/user/cells.html | 21:10 |
| mriedem | since you're using the fake driver it's probably just fast enough | 21:10 |
| cdent | wait_for_compute won't pass | 21:10 |
| mriedem | oh right devstack does that... | 21:10 |
| cdent | unless the service records are started | 21:10 |
| cdent | I had to fix how wait_for_compute works in the devstack fix | 21:11 |
| cdent | Perhaps tomorrow I'll try it with the filters enabled to see what happens | 21:13 |
| mriedem | in your nova boot calls, | 21:14 |
| mriedem | i see you used --min-count once | 21:14 |
| mriedem | but not later in the loops, is there a reason for that? | 21:14 |
| mriedem | like, boot 100 per request, in a loop of 10 | 21:14 |
| cdent | yeah, it's only when making lots of requests to /allocation_candidates that placement shows any load at all (and loading placement is the goal of all this) | 21:15 |
| bauzas | dansmith: like I said to cdent, now there are no reasons to not support workers | 21:16 |
| dansmith | this is all unsurprising though right? | 21:16 |
| *** yamahata has quit IRC | 21:16 | |
| dansmith | placement should be mostly an http-to-sql adapter | 21:16 |
| dansmith | bauzas: ack | 21:16 |
| cdent | so many smal requests hits things way harder than anything | 21:16 |
| *** salv-orlando has quit IRC | 21:16 | |
| cdent | dansmith: yes, and I've been saying that all along, but it's good to confirm it | 21:16 |
| dansmith | cdent: ack, okay | 21:16 |
| cdent | as an initial starting point of the exploration | 21:16 |
| cdent | it supports the assertion I've been making for a while: Placement is not going to be a a bottleneck, at least not until we clean up some of the other stuff. | 21:17 |
| *** vladikr has joined #openstack-nova | 21:17 | |
| cdent | mriedem: the first paragraphs after "playing with it" header talk about some of | 21:18 |
| cdent | that | 21:18 |
| dansmith | well, that was the assertion jaypipes made when he proofed all this early on, but yeah :) | 21:18 |
| mriedem | i think this is still useful / good to see someone kicking things around, | 21:18 |
| ianw | apropos nothing -- does configdrive work with aarch64? afaict it's just a libvirt level thing, so shouldn't have particular problems on a different architecture? | 21:18 |
| mriedem | i've literally had some of this on my paper todo list on my desk for months | 21:19 |
| dansmith | mriedem: oh yah, I'm not saying it's bad at all | 21:19 |
| dansmith | mriedem: we learned a lot doing this for my instance list patch you were trying to blame :P | 21:19 |
| cdent | dansmith: of course, but his tests were at just sql level, and the sql's changed a lot since then | 21:19 |
| dansmith | cdent: totes | 21:19 |
| cdent | so more playing the merrier | 21:19 |
| mriedem | dansmith: heh and see how productive that was? | 21:20 |
| dansmith | mriedem: again, not saying we shouldn't do this, I just thought this was going somewhere and thought the implication was "huh, well, placement isn't the bottleneck" | 21:20 |
| cdent | it is going somewhere: more (concrete) info on how to arrange services and confirmation of stuff we mostly know (like scheduer needs workers and "apache is meh, use nginx") etc | 21:22 |
| efried | cdent: s/duel/dual/ | 21:22 |
| cdent | thanks efried | 21:22 |
| efried | unless it is duel, idk | 21:22 |
| cdent | dansmith: what were you hoping for? Maybe I can try it now that I've leveled my brain up a bit. | 21:25 |
| efried | cdent: s/message bug/message bus/ ? | 21:25 |
| cdent | efried: heh, yup | 21:25 |
| efried | I mean.... | 21:25 |
| efried | could be... | 21:25 |
| *** gjayavelu has joined #openstack-nova | 21:25 | |
| cdent | plenty of message bugs | 21:25 |
| mriedem | cdent: this might be of interest to you https://cloudblog.switch.ch/2017/08/28/starting-1000-instances-on-switchengines/ | 21:26 |
| cdent | mriedem: yeah saw that when it came out | 21:26 |
| *** fragatina has joined #openstack-nova | 21:27 | |
| efried | cdent: "the placement api process are lost" => "...processes..."? | 21:29 |
| efried | "of the much great effort"? | 21:29 |
| cdent | you're hired | 21:29 |
| mriedem | heh, better do this blog post via gerrit review first next time | 21:29 |
| efried | At some point I'll contribute a substantive comment. | 21:30 |
| mriedem | and then pick up the brain and skull bits from the wall | 21:30 |
| mriedem | melwitt: on https://review.openstack.org/#/c/522161/ idk | 21:30 |
| mriedem | don't know what regressed it | 21:30 |
| mriedem | but i know it's busted w/o this | 21:30 |
| * melwitt nods | 21:30 | |
| *** dave-mccowan has quit IRC | 21:30 | |
| *** ChanServ has joined #openstack-nova | 21:31 | |
| *** barjavel.freenode.net sets mode: +o ChanServ | 21:31 | |
| cdent | I suspect if it had gone through gerrit it would fall on the floor and I'd give up before it got through the nit factory. post hoc nit fixing ++ | 21:31 |
| mriedem | and for anyone in china/japan/etc they'd probably like to be able to create a vm in queens | 21:31 |
| *** tidwellr has quit IRC | 21:32 | |
| *** yamamoto has joined #openstack-nova | 21:32 | |
| *** jmlowe has joined #openstack-nova | 21:33 | |
| mriedem | melwitt: ha https://review.openstack.org/#/c/541442/3/nova/virt/libvirt/driver.py@5404 | 21:33 |
| mriedem | no one wins when it's block_device_info | 21:33 |
| melwitt | you can say that again | 21:34 |
| mriedem | not all entries are a list of dicts | 21:34 |
| mriedem | 'root_device_name': instance.root_device_name, | 21:34 |
| mriedem | AND | 21:34 |
| melwitt | :| | 21:34 |
| mriedem | the 'block_device_mapping' entry is not a list of dicts | 21:34 |
| mriedem | no ma'am | 21:34 |
| melwitt | FINE | 21:34 |
| melwitt | :) | 21:34 |
| mriedem | it's a list of DriverVolumeBlockDevice objects, which wrap a BlockDeviceMapping object | 21:34 |
| mriedem | and proxy all of the bdm object stuff to the db | 21:34 |
| mriedem | DriverVolumeBlockDevice at some level might extend dict, so maybe you're right :) | 21:35 |
| mriedem | it does https://github.com/openstack/nova/blob/master/nova/virt/block_device.py#L81 | 21:35 |
| mriedem | heh | 21:35 |
| *** awaugama has joined #openstack-nova | 21:35 | |
| mriedem | shows what i know | 21:35 |
| *** pchavva has quit IRC | 21:36 | |
| melwitt | from this, they're probably not all lists | 21:36 |
| melwitt | https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L1566-L1569 | 21:37 |
| melwitt | or maybe swap's not. I dunno | 21:37 |
| *** m3m0 has quit IRC | 21:37 | |
| mriedem | swap, | 21:38 |
| mriedem | is a list of DriverSwapBlockDevice objects which extend DriverVolumeBlockDevice (i think) | 21:38 |
| jaypipes | cdent: nice article. | 21:38 |
| mriedem | https://github.com/openstack/nova/blob/master/nova/virt/block_device.py#L202 | 21:38 |
| melwitt | hah | 21:38 |
| *** edmondsw has quit IRC | 21:38 | |
| mriedem | or not, wtf knows | 21:39 |
| *** Sukhdev has quit IRC | 21:39 | |
| mriedem | it's bdm roulette | 21:39 |
| mriedem | melwitt: +W if you want to start backports | 21:39 |
| melwitt | thanks | 21:40 |
| cdent | thanks jaypipes | 21:41 |
| mriedem | general observation, | 21:43 |
| *** eharney has quit IRC | 21:44 | |
| mriedem | i feel like this rc1 period has been much less of a clusterfuck than pike and ocata | 21:44 |
| mriedem | so i think that's progress | 21:44 |
| mriedem | right? | 21:44 |
| cdent | mriedem: it has kind of felt like this cycle has been more to do with either fixing stuff or laying ground work for later stuff, so perhaps that means less exposure? but I agree things do seem a bit more chilled out | 21:46 |
| *** jamesdenton has quit IRC | 21:46 | |
| *** dave-mccowan has joined #openstack-nova | 21:47 | |
| *** READ10 has joined #openstack-nova | 21:48 | |
| *** salv-orlando has joined #openstack-nova | 21:50 | |
| *** tidwellr has joined #openstack-nova | 21:51 | |
| *** slaweq has quit IRC | 21:51 | |
| *** vladikr has quit IRC | 21:53 | |
| *** takashin has joined #openstack-nova | 21:54 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova stable/ocata: Add 'delete_host' command in 'nova-manage cell_v2' https://review.openstack.org/513721 | 21:54 |
| *** rmart04 has joined #openstack-nova | 21:55 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (1/2) https://review.openstack.org/430608 | 21:55 |
| *** mgoddard_ has quit IRC | 21:56 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (2/2) https://review.openstack.org/459483 | 21:56 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Parameter verification for servers.inc https://review.openstack.org/528201 | 21:56 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] Add functional tests for traits API https://review.openstack.org/524094 | 21:57 |
| *** vladikr has joined #openstack-nova | 21:57 | |
| *** rmart04 has quit IRC | 21:57 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Example verification for servers.inc https://review.openstack.org/529520 | 21:57 |
| openstackgerrit | Takashi NATSUME proposed openstack/python-novaclient master: Microversion 2.61 - List/Show all server migration types https://review.openstack.org/430839 | 21:58 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Fix parameter order in rebuild https://review.openstack.org/529718 | 21:58 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] Move body examples to an isolated directory https://review.openstack.org/529998 | 21:59 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add a nova-caching-scheduler job to the experimental queue https://review.openstack.org/539260 | 21:59 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Fix 500 error while passing 4-byte unicode data https://review.openstack.org/407514 | 22:00 |
| mriedem | hmm, we seem to be running both legacy-tempest-dsvm-neutron-full and tempest-full on changes | 22:03 |
| mriedem | which are redundant | 22:03 |
| mriedem | gmann_: ^ right? | 22:03 |
| *** gaurangt has quit IRC | 22:03 | |
| *** m3m0 has joined #openstack-nova | 22:04 | |
| *** oomichi has left #openstack-nova | 22:04 | |
| *** oomichi has quit IRC | 22:04 | |
| mriedem | ah yes i see the problem | 22:05 |
| mriedem | oh hmm | 22:06 |
| *** gaurangt has joined #openstack-nova | 22:06 | |
| mriedem | melwitt: i've got the rc1 patch up with depends-on to the 2 remaining things we need to get into rc1 https://review.openstack.org/#/c/542459/ | 22:09 |
| mriedem | plus cycle highlights pulled from the release note prelude | 22:09 |
| mriedem | i've gotta run to parent/teacher conferences (yay) but will be back online later | 22:10 |
| melwitt | ack | 22:10 |
| *** felipemonteiro has joined #openstack-nova | 22:10 | |
| *** itlinux has quit IRC | 22:12 | |
| *** Eran_Kuris has joined #openstack-nova | 22:12 | |
| *** psachin has quit IRC | 22:16 | |
| openstackgerrit | Merged openstack/nova master: Fix the wrong description https://review.openstack.org/540265 | 22:17 |
| *** gjayavelu has quit IRC | 22:19 | |
| *** Eran_Kuris has quit IRC | 22:19 | |
| *** felipemonteiro_ has joined #openstack-nova | 22:20 | |
| *** abalutoiu_ has joined #openstack-nova | 22:21 | |
| *** AlexeyAbashkin has quit IRC | 22:23 | |
| *** mgoddard_ has joined #openstack-nova | 22:24 | |
| *** felipemonteiro has quit IRC | 22:24 | |
| *** abalutoiu has quit IRC | 22:25 | |
| *** chyka has joined #openstack-nova | 22:27 | |
| *** mgoddard_ has quit IRC | 22:30 | |
| *** rcernin has joined #openstack-nova | 22:31 | |
| *** chyka has quit IRC | 22:32 | |
| *** gjayavelu has joined #openstack-nova | 22:36 | |
| openstackgerrit | Arvind Nadendla proposed openstack/nova-specs master: Update to push image traits to ironic https://review.openstack.org/542468 | 22:37 |
| *** Sukhdev has joined #openstack-nova | 22:40 | |
| openstackgerrit | melanie witt proposed openstack/nova master: Make scheduler.utils.setup_instance_group query all cells https://review.openstack.org/540258 | 22:41 |
| *** vladikr has quit IRC | 22:46 | |
| *** abalutoiu has joined #openstack-nova | 22:47 | |
| *** claudiub|2 has joined #openstack-nova | 22:48 | |
| *** abalutoiu__ has joined #openstack-nova | 22:48 | |
| openstackgerrit | Arvind Nadendla proposed openstack/nova-specs master: Support traits in Glance https://review.openstack.org/541507 | 22:49 |
| *** abalutoiu_ has quit IRC | 22:50 | |
| *** claudiub has quit IRC | 22:50 | |
| *** abalutoiu has quit IRC | 22:53 | |
| bkero- | Hey all, can anyone recall seeing a nova-libvirt bug in 2.5 about logfile chardev not being supported? | 22:54 |
| *** felipemonteiro_ has quit IRC | 22:55 | |
| *** felipemonteiro_ has joined #openstack-nova | 22:56 | |
| cfriesen | this is maybe a weird question, but is the ec2-id returned by the instance metadata server (in the format "i-00000004") expected to match the "instance-xxxx" value as returned in the OS-EXT-SRV-ATTR:instance_name field of "nova show"? | 22:59 |
| *** mvk_ has joined #openstack-nova | 22:59 | |
| *** tbachman has joined #openstack-nova | 23:01 | |
| openstackgerrit | Jianghua Wang proposed openstack/nova master: VGPU: Modify the example of vgpu white_list set https://review.openstack.org/539183 | 23:02 |
| *** Sukhdev has quit IRC | 23:07 | |
| *** acormier has quit IRC | 23:08 | |
| *** acormier has joined #openstack-nova | 23:08 | |
| *** chyka has joined #openstack-nova | 23:08 | |
| *** amodi has quit IRC | 23:10 | |
| *** dave-mccowan has quit IRC | 23:12 | |
| *** acormier has quit IRC | 23:13 | |
| *** tbachman has quit IRC | 23:18 | |
| *** rodolof has quit IRC | 23:19 | |
| smcginnis | mriedem: Hows that RC coming along? :) | 23:22 |
| melwitt | smcginnis: he's away atm, the release patch is up https://review.openstack.org/#/c/542459/ and depends-on the things we have left, which I'm going to finish reviewing in a few | 23:23 |
| melwitt | he'll be back later, he said | 23:23 |
| smcginnis | melwitt: OK, so just a couple things to push through yet? | 23:24 |
| melwitt | yeah, one is in the gate already, the other's need a +W and I'm gonna review those now | 23:24 |
| mriedem | i'm back | 23:24 |
| mriedem | bkero-: sounds familiar but not sure, might have been something markus zoeller worked on in ocata? | 23:25 |
| mriedem | bkero-: https://specs.openstack.org/openstack/nova-specs/specs/ocata/implemented/libvirt-virtlogd.html ? | 23:25 |
| smcginnis | melwitt: Thanks! | 23:25 |
| * cdent waves goodnight | 23:25 | |
| *** cdent has quit IRC | 23:25 | |
| *** hongbin has quit IRC | 23:26 | |
| *** tidwellr has quit IRC | 23:29 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Check for leaked server resource allocations in post_test_hook https://review.openstack.org/538510 | 23:30 |
| *** Daisy_ has joined #openstack-nova | 23:30 | |
| *** chyka has quit IRC | 23:34 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] Add functional tests for traits API https://review.openstack.org/524094 | 23:34 |
| *** Jeffrey4l has quit IRC | 23:34 | |
| *** Daisy_ has quit IRC | 23:34 | |
| *** awaugama has quit IRC | 23:34 | |
| *** claudiub|2 has quit IRC | 23:37 | |
| melwitt | mriedem: do you know why this test is removed instead of setting up the ComputeV4Proxy like the others? https://review.openstack.org/#/c/541005/6/nova/tests/unit/compute/test_compute_mgr.py@a6834 | 23:38 |
| mriedem | because _rollback_live_migration doesn't do that thing anymore | 23:38 |
| mriedem | and _do_live_migration calls _rollback_live_migration | 23:39 |
| mriedem | and _do_live_migration already has the non-dict form of migrate_data by the time it calls _rollback_live_migration | 23:39 |
| mriedem | i think that's why anyway | 23:39 |
| mriedem | https://review.openstack.org/#/c/541005/5/nova/compute/manager.py@6394 | 23:39 |
| melwitt | yeah, I mean, it looks like the other "handles_dict" tests were adapted to use the _ComputeV4Proxy because the V4Proxy version has to do the dict compat thing, right? | 23:41 |
| *** felipemonteiro_ has quit IRC | 23:42 | |
| mriedem | yeah, but there isn't a compute v4 proxy for that rollback method | 23:42 |
| mriedem | the entry point / proxy method is live_migration | 23:43 |
| melwitt | oh, I see. okay | 23:43 |
| mriedem | which does the massageroo | 23:43 |
| *** yamahata has joined #openstack-nova | 23:45 | |
| *** moshele has joined #openstack-nova | 23:49 | |
| *** chyka has joined #openstack-nova | 23:49 | |
| *** cali_boxer has quit IRC | 23:50 | |
| *** chyka has quit IRC | 23:51 | |
| *** Daisy_ has joined #openstack-nova | 23:52 | |
| gmann_ | mriedem: yea it seems both running. it has been replaced with tempest-full in integrated job(and fix for stable branches etc) | 23:52 |
| ianw | in case anyone finds my comment in logs about aarch64 config-drive ... yes it does work, but ensure you've got all the right kernel cdrom drivers, which the default xenial kernel may not | 23:52 |
| mriedem | gmann_: https://review.openstack.org/542484 | 23:53 |
| mriedem | think i figured it out | 23:53 |
| gmann_ | mriedem: legacy-tempest-dsvm-neutron-ful should be running on stable branches only but it seem we have it running on master too in many place | 23:53 |
| mriedem | ianw: hrw is the aarch64 expert around these parts | 23:53 |
| mriedem | https://review.openstack.org/#/c/541728/ | 23:53 |
| mriedem | ianw: maybe you can provide some details here? https://review.openstack.org/#/c/541728/9/doc/source/user/support-matrix.ini@872 | 23:54 |
| mriedem | hrw is working on documenting aarch64+libvirt support in the feature matrix | 23:54 |
| mriedem | so that would be good info since we can put notes in these doc entries | 23:54 |
| ianw | mriedem: yes, wouldn't have got nearly so far without his help ;) | 23:54 |
| gmann_ | mriedem: yea but that should not needed i guess as it is handled in integrated-gate template - http://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/zuul.d/zuul-legacy-project-templates.yaml#n107 | 23:54 |
| mriedem | gmann_: see the response from corvus in -infra, | 23:55 |
| mriedem | apparently b/c nova re-defines it in project-config w/o the branch specifier, it messes that up | 23:55 |
| *** liverpooler has quit IRC | 23:55 | |
| gmann_ | mriedem: yes, i think we should remove it all from project-config (nova, tempest, swift etc) | 23:55 |
| cfriesen | mriedem: that earlier issue with libvirt and specifying the disks to migrate....I think it was from before we rebased to 16.0.4. So likely has gone away now. | 23:56 |
| gmann_ | mriedem: anyways i ll check that. thanks for this | 23:56 |
| *** Daisy_ has quit IRC | 23:56 | |
| *** cali_boxer has joined #openstack-nova | 23:56 | |
| ianw | mriedem: oh cool! thanks for pointing to that. yeah, we're working on bringing up dib/nodepool/infra etc on the linaro cloud. all things considered, it's going well i'd say! soon you should be able to easily add aarch64 testing (modulo cloud capacity ... it will be a soft start) | 23:57 |
| mriedem | cfriesen: ok | 23:57 |
| mriedem | ianw: that would be nice | 23:57 |
| mriedem | given the work he's been doing on fixing bugs in the libvirt driver | 23:57 |
| *** Daisy_ has joined #openstack-nova | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!