| *** brinzhang has joined #openstack-nova | 00:01 | |
| *** tetsuro has joined #openstack-nova | 00:15 | |
| *** gyee has quit IRC | 00:21 | |
| openstackgerrit | Jing Zhang proposed openstack/nova master: [WIP] Default mem_page_size to small for pinned instances https://review.opendev.org/686079 | 00:28 |
|---|---|---|
| *** markvoelker has joined #openstack-nova | 00:31 | |
| *** markvoelker has quit IRC | 00:35 | |
| *** SonPham has joined #openstack-nova | 00:36 | |
| SonPham | Hi. Any way to create live-snapshot with keep process | 00:36 |
| *** SonPham has quit IRC | 00:46 | |
| *** brinzhang_ has joined #openstack-nova | 01:00 | |
| *** brinzhang has quit IRC | 01:04 | |
| *** jangutter_ has joined #openstack-nova | 01:10 | |
| *** panda|off has quit IRC | 01:12 | |
| *** panda has joined #openstack-nova | 01:12 | |
| *** jangutter has quit IRC | 01:12 | |
| openstackgerrit | Takashi NATSUME proposed openstack/python-novaclient master: Remove cells v1 and extension commands and APIs https://review.opendev.org/686516 | 01:13 |
| *** tetsuro has quit IRC | 01:19 | |
| *** brinzhang has joined #openstack-nova | 01:25 | |
| *** efried has quit IRC | 01:26 | |
| *** markvoelker has joined #openstack-nova | 01:26 | |
| *** efried has joined #openstack-nova | 01:26 | |
| *** dklyle has quit IRC | 01:27 | |
| *** gbarros has quit IRC | 01:28 | |
| *** dklyle has joined #openstack-nova | 01:28 | |
| *** brinzhang_ has quit IRC | 01:29 | |
| *** d34dh0r53 has quit IRC | 01:30 | |
| *** aloga has quit IRC | 01:30 | |
| *** markvoelker has quit IRC | 01:30 | |
| *** aloga has joined #openstack-nova | 01:31 | |
| *** d34dh0r53 has joined #openstack-nova | 01:32 | |
| *** markvoelker has joined #openstack-nova | 01:54 | |
| *** brinzhang_ has joined #openstack-nova | 01:54 | |
| *** brinzhang has quit IRC | 01:58 | |
| *** markvoelker has quit IRC | 01:58 | |
| *** markvoelker has joined #openstack-nova | 02:05 | |
| *** ricolin has joined #openstack-nova | 02:27 | |
| *** markvoelker has quit IRC | 02:35 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Fix security groups parameters https://review.opendev.org/686517 | 02:47 |
| *** markvoelker has joined #openstack-nova | 03:06 | |
| *** markvoelker has quit IRC | 03:36 | |
| *** markvoelker has joined #openstack-nova | 03:36 | |
| *** mkrai has joined #openstack-nova | 03:42 | |
| *** mkrai_ has joined #openstack-nova | 03:42 | |
| *** mkrai has quit IRC | 03:42 | |
| *** mkrai_ has quit IRC | 03:42 | |
| *** mkrai has joined #openstack-nova | 03:44 | |
| *** artom has quit IRC | 03:51 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-guide: Fix available info in handling down cells https://review.opendev.org/686520 | 03:56 |
| *** markvoelker has quit IRC | 04:07 | |
| *** gouthamr has quit IRC | 04:15 | |
| *** gouthamr has joined #openstack-nova | 04:16 | |
| *** markvoelker has joined #openstack-nova | 04:35 | |
| *** markvoelker has quit IRC | 04:39 | |
| *** Luzi has joined #openstack-nova | 04:58 | |
| *** tetsuro has joined #openstack-nova | 05:11 | |
| *** ratailor has joined #openstack-nova | 05:13 | |
| *** markvoelker has joined #openstack-nova | 05:19 | |
| *** markvoelker has quit IRC | 05:24 | |
| *** markvoelker has joined #openstack-nova | 05:28 | |
| *** markvoelker has quit IRC | 05:33 | |
| *** tssurya has quit IRC | 05:36 | |
| *** markvoelker has joined #openstack-nova | 05:37 | |
| *** markvoelker has quit IRC | 05:42 | |
| *** markvoelker has joined #openstack-nova | 05:47 | |
| *** markvoelker has quit IRC | 05:51 | |
| *** markvoelker has joined #openstack-nova | 05:56 | |
| *** markvoelker has quit IRC | 06:01 | |
| *** markvoelker has joined #openstack-nova | 06:05 | |
| *** markvoelker has quit IRC | 06:10 | |
| *** markvoelker has joined #openstack-nova | 06:14 | |
| *** markvoelker has quit IRC | 06:19 | |
| *** markvoelker has joined #openstack-nova | 06:23 | |
| *** markvoelker has quit IRC | 06:28 | |
| *** takashin has left #openstack-nova | 06:32 | |
| *** markvoelker has joined #openstack-nova | 06:33 | |
| *** spsurya has joined #openstack-nova | 06:33 | |
| *** slaweq has joined #openstack-nova | 06:37 | |
| *** markvoelker has quit IRC | 06:38 | |
| *** markvoelker has joined #openstack-nova | 06:42 | |
| *** udesale has joined #openstack-nova | 06:46 | |
| *** markvoelker has quit IRC | 06:46 | |
| *** brinzhang has joined #openstack-nova | 06:50 | |
| *** markvoelker has joined #openstack-nova | 06:52 | |
| *** brinzhang_ has quit IRC | 06:53 | |
| *** maciejjozefczyk has joined #openstack-nova | 06:55 | |
| *** markvoelker has quit IRC | 06:56 | |
| *** damien_r has joined #openstack-nova | 06:58 | |
| *** markvoelker has joined #openstack-nova | 07:01 | |
| *** ttsiouts has joined #openstack-nova | 07:03 | |
| *** markvoelker has quit IRC | 07:06 | |
| *** tetsuro has quit IRC | 07:09 | |
| *** brinzhang_ has joined #openstack-nova | 07:10 | |
| *** rpittau|afk is now known as rpittau | 07:10 | |
| *** markvoelker has joined #openstack-nova | 07:11 | |
| bauzas | good morning Nova | 07:11 |
| *** brinzhang has quit IRC | 07:13 | |
| *** pcaruana has joined #openstack-nova | 07:15 | |
| *** markvoelker has quit IRC | 07:15 | |
| *** markvoelker has joined #openstack-nova | 07:20 | |
| *** luksky has joined #openstack-nova | 07:21 | |
| *** xek has joined #openstack-nova | 07:22 | |
| *** markvoelker has quit IRC | 07:24 | |
| gibi | bauzas: good morning! | 07:25 |
| *** ttsiouts has quit IRC | 07:26 | |
| *** ttsiouts has joined #openstack-nova | 07:26 | |
| *** ttsiouts has quit IRC | 07:31 | |
| *** ivve has joined #openstack-nova | 07:41 | |
| *** markvoelker has joined #openstack-nova | 07:47 | |
| *** brinzhang has joined #openstack-nova | 07:51 | |
| * bauzas bbiab - appointment | 07:51 | |
| *** markvoelker has quit IRC | 07:52 | |
| *** brinzhang_ has quit IRC | 07:55 | |
| *** ttsiouts has joined #openstack-nova | 07:56 | |
| *** markvoelker has joined #openstack-nova | 07:57 | |
| *** markvoelker has quit IRC | 08:01 | |
| * gibi stuck in another internal workshop day - without too much motivation | 08:01 | |
| *** brinzhang has quit IRC | 08:09 | |
| *** ttsiouts has quit IRC | 08:10 | |
| *** ttsiouts has joined #openstack-nova | 08:11 | |
| *** ttsiouts_ has joined #openstack-nova | 08:14 | |
| *** ttsiouts has quit IRC | 08:15 | |
| *** rcernin has quit IRC | 08:15 | |
| *** markvoelker has joined #openstack-nova | 08:15 | |
| *** markvoelker has quit IRC | 08:20 | |
| *** xek_ has joined #openstack-nova | 08:21 | |
| *** tssurya has joined #openstack-nova | 08:21 | |
| *** zbr is now known as zbr|ruck | 08:23 | |
| *** xek has quit IRC | 08:24 | |
| *** lpetrut has joined #openstack-nova | 08:25 | |
| *** tkajinam has quit IRC | 08:27 | |
| *** tetsuro has joined #openstack-nova | 08:31 | |
| *** ociuhandu has joined #openstack-nova | 08:37 | |
| *** derekh has joined #openstack-nova | 08:37 | |
| *** markvoelker has joined #openstack-nova | 08:43 | |
| *** markvoelker has quit IRC | 08:48 | |
| *** ociuhandu has quit IRC | 08:54 | |
| *** ociuhandu has joined #openstack-nova | 08:54 | |
| *** ociuhandu has quit IRC | 08:59 | |
| *** ociuhandu has joined #openstack-nova | 08:59 | |
| *** markvoelker has joined #openstack-nova | 09:02 | |
| *** markvoelker has quit IRC | 09:07 | |
| *** ccamacho has joined #openstack-nova | 09:19 | |
| *** markvoelker has joined #openstack-nova | 09:21 | |
| *** panda is now known as panda|bbl | 09:25 | |
| *** markvoelker has quit IRC | 09:25 | |
| *** markvoelker has joined #openstack-nova | 09:39 | |
| *** markvoelker has quit IRC | 09:45 | |
| *** markvoelker has joined #openstack-nova | 09:58 | |
| *** markvoelker has quit IRC | 10:02 | |
| *** mugsie has quit IRC | 10:03 | |
| *** mugsie has joined #openstack-nova | 10:05 | |
| *** markvoelker has joined #openstack-nova | 10:07 | |
| *** markvoelker has quit IRC | 10:12 | |
| *** ttsiouts_ has quit IRC | 10:12 | |
| *** ttsiouts has joined #openstack-nova | 10:13 | |
| openstackgerrit | Merged openstack/nova master: nova-net: Migrate 'test_floating_ip_pools' functional tests https://review.opendev.org/684333 | 10:14 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Migrate 'test_quota_sets' functional tests https://review.opendev.org/684334 | 10:16 |
| *** ttsiouts has quit IRC | 10:17 | |
| stephenfin | Is this displaying oddly for anyone else? https://bugs.launchpad.net/nova/+bug/1846559 | 10:20 |
| openstack | Launchpad bug 1846559 in OpenStack Compute (nova) "Handling Down Cells in nova - security_groups can be in the response for GET /servers/detail" [Medium,In progress] - Assigned to Takashi NATSUME (natsume-takashi) | 10:20 |
| *** ociuhandu has quit IRC | 10:22 | |
| *** ociuhandu has joined #openstack-nova | 10:22 | |
| *** factor has joined #openstack-nova | 10:26 | |
| kashyap | stephenfin: Yeah, it is odd | 10:27 |
| kashyap | stephenfin: Not just that, but also blueprints are displayed oddly, too | 10:29 |
| kashyap | sean-k-mooney: To check if a guest is using multiqueues looking for 'queues' / 'vhost' bits in the XML should suffice I guess? | 10:32 |
| *** markvoelker has joined #openstack-nova | 10:35 | |
| kashyap | I'd say so | 10:37 |
| *** markvoelker has quit IRC | 10:39 | |
| *** panda|bbl is now known as panda | 10:39 | |
| *** ociuhandu has quit IRC | 10:47 | |
| *** tbachman has quit IRC | 10:47 | |
| *** ociuhandu has joined #openstack-nova | 10:48 | |
| *** ociuhandu has quit IRC | 10:52 | |
| *** ociuhandu has joined #openstack-nova | 10:52 | |
| *** markvoelker has joined #openstack-nova | 10:53 | |
| *** jaosorior has joined #openstack-nova | 10:54 | |
| *** mkrai has quit IRC | 10:55 | |
| *** mkrai has joined #openstack-nova | 10:56 | |
| *** markvoelker has quit IRC | 10:57 | |
| *** mkrai_ has joined #openstack-nova | 10:59 | |
| *** mkrai has quit IRC | 11:00 | |
| *** markvoelker has joined #openstack-nova | 11:02 | |
| *** SonPham has joined #openstack-nova | 11:06 | |
| *** mkrai_ has quit IRC | 11:06 | |
| *** markvoelker has quit IRC | 11:06 | |
| *** jangutter_ is now known as jangutter | 11:07 | |
| *** ociuhandu has quit IRC | 11:07 | |
| *** ociuhandu has joined #openstack-nova | 11:08 | |
| *** SonPham has quit IRC | 11:10 | |
| *** markvoelker has joined #openstack-nova | 11:11 | |
| *** ttsiouts has joined #openstack-nova | 11:12 | |
| *** ociuhandu has quit IRC | 11:12 | |
| *** ociuhandu has joined #openstack-nova | 11:14 | |
| *** zbr|ruck is now known as zbr|lunch | 11:15 | |
| *** markvoelker has quit IRC | 11:16 | |
| *** ociuhandu has quit IRC | 11:18 | |
| *** markvoelker has joined #openstack-nova | 11:21 | |
| *** ociuhandu has joined #openstack-nova | 11:25 | |
| *** markvoelker has quit IRC | 11:25 | |
| *** markvoelker has joined #openstack-nova | 11:39 | |
| *** panda is now known as panda|eat | 11:43 | |
| *** markvoelker has quit IRC | 11:44 | |
| *** ccamacho has quit IRC | 11:45 | |
| *** markvoelker has joined #openstack-nova | 11:48 | |
| *** markvoelker has quit IRC | 11:49 | |
| *** markvoelker has joined #openstack-nova | 11:49 | |
| *** ociuhandu has quit IRC | 11:55 | |
| *** ociuhandu has joined #openstack-nova | 11:57 | |
| *** ociuhandu has quit IRC | 11:59 | |
| *** ratailor has quit IRC | 11:59 | |
| *** ociuhandu has joined #openstack-nova | 11:59 | |
| *** ratailor has joined #openstack-nova | 11:59 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Remove @safe_connect from put_allocations https://review.opendev.org/686579 | 12:02 |
| *** ociuhandu has quit IRC | 12:03 | |
| *** ociuhandu has joined #openstack-nova | 12:04 | |
| *** tbachman has joined #openstack-nova | 12:06 | |
| *** kukacz has joined #openstack-nova | 12:09 | |
| *** ociuhandu has quit IRC | 12:09 | |
| *** tbachman_ has joined #openstack-nova | 12:10 | |
| *** spsurya has quit IRC | 12:10 | |
| *** tbachman has quit IRC | 12:12 | |
| *** tbachman_ is now known as tbachman | 12:12 | |
| *** udesale has quit IRC | 12:16 | |
| *** udesale has joined #openstack-nova | 12:16 | |
| *** ociuhandu has joined #openstack-nova | 12:34 | |
| *** panda|eat is now known as panda | 12:37 | |
| *** xek_ has quit IRC | 12:39 | |
| *** xek_ has joined #openstack-nova | 12:40 | |
| *** ociuhandu has quit IRC | 12:40 | |
| *** maciejjozefczyk has quit IRC | 12:40 | |
| *** maciejjozefczyk has joined #openstack-nova | 12:41 | |
| *** markvoelker has quit IRC | 12:41 | |
| *** ivve has quit IRC | 12:41 | |
| *** xek_ has quit IRC | 12:42 | |
| *** xek_ has joined #openstack-nova | 12:42 | |
| *** xek_ has quit IRC | 12:43 | |
| *** xek_ has joined #openstack-nova | 12:44 | |
| *** kukacz has quit IRC | 12:44 | |
| *** kukacz has joined #openstack-nova | 12:45 | |
| *** vesper11 has quit IRC | 12:53 | |
| *** vesper11 has joined #openstack-nova | 12:54 | |
| *** Luzi has quit IRC | 12:55 | |
| *** udesale has quit IRC | 12:56 | |
| *** markvoelker has joined #openstack-nova | 12:58 | |
| *** vesper11 has quit IRC | 12:59 | |
| *** ociuhandu has joined #openstack-nova | 13:03 | |
| *** ociuhandu has quit IRC | 13:09 | |
| *** psachin has joined #openstack-nova | 13:10 | |
| *** BjoernT has joined #openstack-nova | 13:11 | |
| *** mriedem has joined #openstack-nova | 13:18 | |
| *** xek__ has joined #openstack-nova | 13:19 | |
| *** BjoernT has quit IRC | 13:19 | |
| *** xek_ has quit IRC | 13:21 | |
| *** BjoernT has joined #openstack-nova | 13:22 | |
| *** ratailor has quit IRC | 13:23 | |
| *** dpawlik has quit IRC | 13:25 | |
| *** zbr|lunch is now known as zbr|ruck | 13:25 | |
| mriedem | stephenfin: i'm not sure what gmann wants to see happen here but i left some thoughts in the commit message https://review.opendev.org/#/c/685927/ | 13:26 |
| *** vesper11 has joined #openstack-nova | 13:27 | |
| *** vesper11 has quit IRC | 13:31 | |
| *** vesper11 has joined #openstack-nova | 13:32 | |
| mriedem | takashin already posted fixes for the 2 docs bugs | 13:35 |
| mriedem | gibi: efried: dansmith: shall i send this along or are we waiting for updates? https://review.opendev.org/#/c/686232/ | 13:43 |
| mriedem | looks like sean-k-mooney is +1 so i think i can put it to bed | 13:43 |
| mriedem | or do we have a new rule about a majority of specs cores being on board with it? | 13:43 |
| efried | no such rule yet, no. If we merge it I'll have to update the core liaisons patch to add that template section for this one. but go aheda. | 13:44 |
| efried | ahead. | 13:44 |
| *** ttsiouts has quit IRC | 13:44 | |
| dansmith | mriedem: yep, cool with me | 13:44 |
| *** ttsiouts has joined #openstack-nova | 13:45 | |
| *** ttsiouts has quit IRC | 13:46 | |
| *** ttsiouts has joined #openstack-nova | 13:46 | |
| mriedem | ok, replied about the validation before the 202 response but approved anyway | 13:47 |
| mriedem | i don't know if i can change the blueprint "Direction" field to "Approved" | 13:47 |
| mriedem | but i updated the Definition | 13:47 |
| mriedem | i'm gonna say this is med/high priority though given the amount of previous attempts to try and get a similar thing done | 13:48 |
| efried | mriedem: yes, let's hold off on "Direction" for now, pending validation of this bit https://review.opendev.org/#/c/685857/4/README.rst@44 | 13:51 |
| dansmith | mriedem: you're worried about them providing a hundred images and us taking too long to ask glance about all of them? | 13:51 |
| mriedem | dansmith: yeah | 13:55 |
| *** mlavalle has joined #openstack-nova | 13:56 | |
| dansmith | mriedem: do we have anything similar in some of our proxy apis? I mean I know we contact neutron a bunch for like instance detail list | 13:56 |
| dansmith | mriedem: would it be too crazy to define in the api-ref that "if you specify more images than some threshold, the images may be validated asynchronously" ? | 13:56 |
| mriedem | i'll say i'm not terribly worried since it's an admin api by default | 13:56 |
| mriedem | so based on some config limit you punt the validation to conductor? | 13:57 |
| dansmith | or not config, just some hard limit we set in the code like 5 | 13:57 |
| *** sapd1_x has joined #openstack-nova | 13:57 | |
| *** gmann_afk is now known as gmann | 13:58 | |
| mriedem | i think for v1 we can just validate in the api and ignore my fears | 13:58 |
| dansmith | or we could be totally crazy and measure how long it takes to do the first one and then decide what the limit should be, assuming a 60s timeout or something :D | 13:58 |
| dansmith | we could also just state in the API that it's max 5 per request or something | 13:58 |
| mriedem | if we did that i think i'd add a new quota item like metadata_items or injected_files which are there for the same reason i think | 13:59 |
| dansmith | that'd be kindof an odd use of quota | 13:59 |
| mriedem | that's what those quotas are used for though right? rate limiting | 14:00 |
| mriedem | same with instances quota | 14:00 |
| *** JamesBenson has joined #openstack-nova | 14:00 | |
| dansmith | metadata_items? isn't that actual storage in the db? | 14:00 |
| openstackgerrit | Merged openstack/nova-specs master: Add image-precache-support spec https://review.opendev.org/686232 | 14:00 |
| mriedem | user metadata is just a foreign key pair in another table so i'm not sure why that would matter | 14:01 |
| mriedem | i mean, | 14:01 |
| mriedem | sure you don't want someone blasting 1K metadata keys per instance since that will likely slow queries down | 14:01 |
| dansmith | because a billion metadata items cost actual space | 14:01 |
| dansmith | seems different to me | 14:01 |
| dansmith | anyway | 14:01 |
| dansmith | we can haggle in the api patch | 14:01 |
| mriedem | i know injected_files isn't in the db | 14:01 |
| dansmith | at least a note in the ref about "if you specify a hundred things here, you'll likely timeout before we've asked glance about all of them" | 14:01 |
| dansmith | no, but it is still resource-related | 14:02 |
| *** ociuhandu has joined #openstack-nova | 14:02 | |
| mriedem | i probably wouldn't even mention anything in the ref unless/until someone reports it as a problem | 14:03 |
| mriedem | so like i said, i'm not terribly worried about it | 14:03 |
| mriedem | especially since it's admin-only by default | 14:03 |
| mriedem | and yeah when you're admin listing 1K all_tenants instances we're going to ask neutron for the combined set of ports and security groups for all of them | 14:03 |
| dansmith | I don't see what a note would hurt, given not everyone would piece together what is happening where, but... whatever, we can talk about it in the patch | 14:03 |
| mriedem | i just have no idea what the limits would be, so wouldn't want to say "you'll likely timeout" | 14:04 |
| dansmith | sure, it'd just be a warning about "too many" | 14:04 |
| dansmith | whatever, I'll stop trying to address your concerns :) | 14:05 |
| mriedem | "Since the number of images to cache is not rate limited use caution when sending a large set of images." | 14:05 |
| mriedem | something like that | 14:05 |
| mriedem | anyway | 14:05 |
| *** JamesBenson has quit IRC | 14:05 | |
| dansmith | or I could push validation to the conductor | 14:05 |
| mriedem | failing fast in the API is nice though... | 14:06 |
| mriedem | for this kind of thing | 14:06 |
| dansmith | so basically, | 14:06 |
| dansmith | you will not be pleased with any outcome, is that right mr. midwest? | 14:06 |
| mriedem | that's my general stance with anything in my life yes | 14:06 |
| dansmith | right, got it :) | 14:06 |
| mriedem | laura was all riled up about this impeachment stuff last night and i had to remind her to keep expectations very low and assume the worst in whatever outcome she wants - like i do! | 14:07 |
| mriedem | it's very healthy | 14:07 |
| dansmith | heh | 14:07 |
| mriedem | so here is a thing to compare to in the api, | 14:09 |
| *** munimeha1 has joined #openstack-nova | 14:09 | |
| mriedem | during server create i don't think we limit the number of bdms you can specify, | 14:09 |
| mriedem | you can't include the same pre-existing volume more than once since we don't support multiattach that way, | 14:09 |
| mriedem | but you could say, boot me 10 servers with 255 bdms each and they are all using the same image for the volume's disk, | 14:10 |
| mriedem | the api will GET that image 2550 times at least | 14:10 |
| mriedem | since we're too dumb to cache the results | 14:10 |
| mriedem | that's in _validate_bdm called from a for loop in _provision_instances | 14:11 |
| dansmith | yeah, you're saying we do that today and nobody is complaining? | 14:13 |
| dansmith | obviously less likely to run afoul of that with 255 BDMs vs. images to pre-cache | 14:13 |
| dansmith | but same deal | 14:13 |
| dansmith | actually, that all happens in the conductor right? | 14:13 |
| dansmith | used to be in the api | 14:13 |
| mriedem | no it's in the api | 14:14 |
| mriedem | and yeah no one is complaining about that right now | 14:14 |
| dansmith | okay | 14:14 |
| mriedem | i remember the power boyz really wanting a couple hundred volumes attached per server | 14:14 |
| mriedem | so do that + multicreate | 14:14 |
| dansmith | yeah | 14:15 |
| dansmith | mriedem: well, we have the new imagecache group, maybe we just chuck a configurable limit in there.. no real reason not to I guess | 14:18 |
| mriedem | config-driven api is the only reason not to... | 14:20 |
| dansmith | yup | 14:20 |
| mriedem | which is why i was thinking of quota config etc | 14:20 |
| *** ricolin_ has joined #openstack-nova | 14:25 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add boot from volume functional test with a huge request https://review.opendev.org/686734 | 14:26 |
| *** ricolin has quit IRC | 14:26 | |
| *** damien_r has quit IRC | 14:32 | |
| *** damien_r has joined #openstack-nova | 14:32 | |
| openstackgerrit | Eric Fried proposed openstack/nova-specs master: Add 'Core Liaison' spec process https://review.opendev.org/685857 | 14:32 |
| efried | updated to make dansmith his own liaison on his precaching spec, and took out the idioms gibi called me on ^ | 14:33 |
| efried | also clarified self-liaison wording can just be "None" as bauzas suggested ^ | 14:33 |
| *** JamesBenson has joined #openstack-nova | 14:34 | |
| *** maciejjozefczyk has quit IRC | 14:39 | |
| *** TxGirlGeek has joined #openstack-nova | 14:41 | |
| efried | aspiers: update on SEV fix? | 14:49 |
| *** ricolin_ has quit IRC | 14:49 | |
| stephenfin | mriedem: I'm reworking the NeutronFixture to mock out the security group-related APIs instead. It's going to be much larger but seems more correct | 14:49 |
| efried | aspiers: I'm gonna say by... Tuesday we will merge the "document it's busted" patch if the fix isn't ready. | 14:50 |
| efried | so that we can be sure it's through the gate by Thursday when we have to produce our final RC. | 14:50 |
| *** ociuhandu has quit IRC | 14:51 | |
| mriedem | stephenfin: ugh....can we just do that in a follow up? | 14:52 |
| mriedem | b/c that's going to slow things down quite a bit | 14:52 |
| *** ociuhandu has joined #openstack-nova | 14:52 | |
| stephenfin | mriedem: We can. Want me to just fix that commit message comment and merge as-is so? | 14:52 |
| bauzas | efried: honestly, I'm not opinionated, I just wanted to explain it would look a bit weirdo if the same name would be for both the owner and the liaison | 14:53 |
| bauzas | efried: something either "None" or "Not needed" is cool with me | 14:53 |
| efried | bauzas: I agree, I tried to explain it in the FAQ | 14:53 |
| mriedem | stephenfin: if you're going to rev the commit message, i think you could also the thing i asked for in the stub which is only return a default security group for an instance that has a non-empty info_cache | 14:53 |
| mriedem | stephenfin: i think that's as easy as: | 14:53 |
| efried | bauzas: and yes, latest PS has "or None" in the template | 14:53 |
| bauzas | ok, will look at it then | 14:53 |
| efried | thx | 14:54 |
| *** bnemec is now known as beekneemech | 14:54 | |
| mriedem | if instance.get_network_info() | 14:54 |
| stephenfin | I'm not sure if can rely on that since I think we mock a lot of it. See https://github.com/stephenfin/nova/commit/afb4698e8f7e39154e90dfe775d2d0e3e1f20dbc#diff-c731e6017d325067e73f0124f4ade91c | 14:55 |
| stephenfin | Is that something else though? | 14:55 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add boot from volume functional test with a huge request https://review.opendev.org/686734 | 14:56 |
| mriedem | dansmith: so ^ proves my point about the server create case, mayhap i should open a bug for that | 14:56 |
| *** ociuhandu has quit IRC | 14:56 | |
| dansmith | mriedem: ack | 14:56 |
| *** artom has joined #openstack-nova | 14:58 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add boot from volume functional test with a huge request https://review.opendev.org/686734 | 15:00 |
| mriedem | stephenfin: ok so i guess for the current patch, how about just (1) fix the commit message and (2) leave a TODO in the new stub method that it should be smarter about instances that don't have networks/ports and thus won't have security groups | 15:02 |
| *** ociuhandu has joined #openstack-nova | 15:04 | |
| *** BjoernT has quit IRC | 15:04 | |
| *** BjoernT has joined #openstack-nova | 15:05 | |
| *** arxcruz|ruck is now known as arxcruz|rover | 15:08 | |
| *** ociuhandu has quit IRC | 15:09 | |
| stephenfin | mriedem: Yup, I can do that | 15:12 |
| stephenfin | Will respin now | 15:13 |
| *** donnyd is now known as donnyd_afk | 15:19 | |
| *** gyee has joined #openstack-nova | 15:22 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: nova-net: Migrate 'test_quota_sets' functional tests https://review.opendev.org/684334 | 15:22 |
| *** ociuhandu has joined #openstack-nova | 15:23 | |
| mriedem | gibi: could i ask you to hit the bottom 2 FUPs in the cross-cell resize series https://review.opendev.org/#/c/676228/ since i think you're familiar with the changes they are...FUPing (aleady have a +2 on them) | 15:27 |
| gibi | mriedem: sure, looking... | 15:27 |
| mriedem | dansmith: what do you think about getting this CellTimeout logging traceback change in to debug the gate failure? https://review.opendev.org/#/c/684118/ - i'm unable to recreate on that change itself after many rechecks but it's one of the top gate failures: http://status.openstack.org/elastic-recheck/#1844929 | 15:29 |
| dansmith | mriedem: sure | 15:30 |
| gibi | efried: so https://blueprints.launchpad.net/nova/+spec/support-move-ops-with-qos-ports is in Implemented state. So I think I need to open a new bp for U about the rest of the move operations (live migrate, evacuate, unshelve) and then propose a spec that is a slimmed down version of the original spec https://review.opendev.org/#/c/652608/ Do you agree? | 15:33 |
| *** BjoernT_ has joined #openstack-nova | 15:33 | |
| mriedem | i did get the mysqld logs published for these failing grenade jobs and it looks like we do start mysqld at least 3 times during the grenade run which i didn't expect | 15:33 |
| mriedem | we can see things really start to go south about the time that we hit the cell timeout failures | 15:33 |
| mriedem | https://zuul.opendev.org/t/openstack/build/4085120e390f4f1e971c6ff61304a596/log/logs/mysql/error.txt.gz#213 | 15:33 |
| dansmith | mriedem: yeah that seems weird | 15:33 |
| efried | gibi: That would be fine. If you prefer I can un-implement the train bp and you can reuse it. I don't really care too much. But I think the old process hounds have a preference for creating a new bp (-ussuri suffix). | 15:34 |
| dansmith | mriedem: are we actually upgrading mysql packages? | 15:34 |
| mriedem | so i guess 2 starts would mean...old devstack and new devstack | 15:34 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: tests: Correctly mock out security groups in NeutronFixture https://review.opendev.org/685927 | 15:34 |
| stephenfin | mriedem: ^ | 15:34 |
| stephenfin | think that's what you were looking for | 15:34 |
| *** BjoernT has quit IRC | 15:35 | |
| gibi | efried: OK, I will go with a new one. thanks | 15:36 |
| *** ttsiouts has quit IRC | 15:37 | |
| mriedem | dansmith: we're not upgrading packages, same version for all 3 starts: | 15:37 |
| mriedem | mysqld (mysqld 5.7.27-0ubuntu0.18.04.1) starting as process | 15:37 |
| dansmith | mriedem: so why are we restarting it at all? | 15:38 |
| *** ttsiouts has joined #openstack-nova | 15:38 | |
| mriedem | for one old and new devstack will just blindly try to restart the service i think | 15:38 |
| mriedem | i need to dig into the grenade log | 15:38 |
| dansmith | odd | 15:38 |
| sean-k-mooney | dansmith: we also could be tweaking the mysql config between release | 15:39 |
| dansmith | mriedem: unrelated, remind me.. are we not supposed to 404 for things like specifying a missing image id in my request? | 15:39 |
| sean-k-mooney | although i dont think we actully do set much in grenade | 15:39 |
| dansmith | sean-k-mooney: possible, but not sure what that would be | 15:39 |
| mriedem | dansmith: 400 | 15:39 |
| dansmith | sean-k-mooney: but maybe some implicit restart in case it has changed or something | 15:39 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: tests: Correctly mock out security groups in NeutronFixture https://review.opendev.org/685927 | 15:39 |
| dansmith | mriedem: okay | 15:39 |
| mriedem | dansmith: 404 is if the resouce in the path is missing i think | 15:40 |
| mriedem | 400 if a thing in the body is | 15:40 |
| dansmith | mriedem: okay | 15:40 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Migrate 'test_server_tags' functional tests https://review.opendev.org/684335 | 15:40 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Migrate 'test_server_tags' functional tests https://review.opendev.org/684335 | 15:40 |
| *** jaosorior has quit IRC | 15:41 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Migrate 'test_rescue' functional tests https://review.opendev.org/684339 | 15:41 |
| mriedem | stephenfin: +2 | 15:42 |
| *** ttsiouts has quit IRC | 15:42 | |
| mriedem | gibi: i'm +2 on https://review.opendev.org/#/c/685927/ if you want to re-+2 | 15:42 |
| stephenfin | ta | 15:42 |
| gibi | mriedem: going... | 15:42 |
| dansmith | mriedem: sean-k-mooney: in grenade's resource phase, mysql has to be up because we validate some things without the api, but we might then stop it between the upgrade steps I guess, but wouldn't expect to restart it more than that one time | 15:42 |
| stephenfin | mriedem: Fixed you commit message nit on https://review.opendev.org/#/c/684335/ if you want to blast that through too | 15:42 |
| mriedem | dansmith: yeah it's the more than once i'm confused about, so grenade log digging i go | 15:44 |
| dansmith | yeah | 15:44 |
| sean-k-mooney | dansmith: i think devstack would restart it twice becasue it will try to install mysql for both new and old and then explcitly restart it | 15:44 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Migrate 'test_servers' functional tests https://review.opendev.org/684336 | 15:44 |
| mriedem | blasted | 15:44 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Migrate 'test_hosts' functional tests https://review.opendev.org/684337 | 15:44 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Migrate 'test_rescue' functional tests https://review.opendev.org/684339 | 15:44 |
| *** tssurya has quit IRC | 15:44 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Migrate 'test_hypervisors' functional tests https://review.opendev.org/684340 | 15:44 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Migrate 'test_attach_interfaces' functional tests https://review.opendev.org/684341 | 15:45 |
| dansmith | sean-k-mooney: well, that's why I was saying I wonder if we're upgrading packages, which would be one of those restarts.. but yeah, maybe it's all expected, I dunno | 15:45 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Migrate 'test_simple_tenant_usage' functional tests https://review.opendev.org/684342 | 15:45 |
| *** rpittau is now known as rpittau|afk | 15:45 | |
| sean-k-mooney | well devstack will do an apt-get update on each run and i think that will result in 2 mysql restart on on the old code and one on the new | 15:46 |
| dansmith | sean-k-mooney: only if we actually changed the mysql package right? | 15:46 |
| sean-k-mooney | i dont know of a reason to require a third restart but im looking | 15:46 |
| dansmith | sean-k-mooney: if we're going from xenial to xenial it won't, I wouldn't think | 15:46 |
| sean-k-mooney | dansmith: im not sure if it was conditional | 15:46 |
| mriedem | i doubt the devstack code is conditional | 15:47 |
| *** ociuhandu has quit IRC | 15:47 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Neutron fixture cleanup https://review.opendev.org/684343 | 15:47 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Migrate 'test_floating_ips' functional tests https://review.opendev.org/684344 | 15:47 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Add TODOs for remaining nova-network functional tests https://review.opendev.org/684345 | 15:47 |
| mriedem | devstack is pretty biased to just assume fresh install | 15:47 |
| *** damien_r has quit IRC | 15:47 | |
| *** ociuhandu has joined #openstack-nova | 15:48 | |
| dansmith | mriedem: but we're not changing OS releases or pinning OS packages right? so the apt upgrade between grenade phases shouldn't change the packages for that right? | 15:48 |
| mriedem | so maybe a newer mysqld package triggers a restart on any update | 15:48 |
| mriedem | the version isn't changing | 15:48 |
| sean-k-mooney | ya its not https://github.com/openstack/devstack/blob/master/lib/databases/mysql#L129 | 15:48 |
| dansmith | a newer mysql package will definitely do a restart | 15:48 |
| dansmith | I just expect no package change | 15:48 |
| mriedem | devstack is just outright restarting as sean pointed out | 15:48 |
| dansmith | oh I see | 15:49 |
| sean-k-mooney | to be fair it does also regenrate teh mysql config before it does that | 15:49 |
| dansmith | so that's one | 15:49 |
| sean-k-mooney | so it need to do the restart to make sure that is applied | 15:49 |
| dansmith | yeah | 15:49 |
| dansmith | okay so you found 33% of them :D | 15:49 |
| sean-k-mooney | well taht shoudl accound for 2 restart right | 15:50 |
| sean-k-mooney | the old run and new run | 15:50 |
| dansmith | so, package install is one start, config refresh 1, config refresh 2... is that your three starts mriedem ? | 15:51 |
| mriedem | that's probably it | 15:51 |
| dansmith | I don't remember the details, but weren't you saying we do something in the new phase that requires the db and then later the db seems to be gone? | 15:52 |
| dansmith | so maybe it's something more obscure than just an ill-timed restart? | 15:52 |
| mriedem | post-restart of the scheduler and before that timeout, the verify_instance command runs successfully which connects to the cell1 database | 15:53 |
| mriedem | that ^? | 15:53 |
| dansmith | yeah and then fails during actual schedule? | 15:53 |
| mriedem | yup | 15:54 |
| mriedem | but from the mysqld logs shit just goes bad fast it seems | 15:54 |
| mriedem | https://zuul.opendev.org/t/openstack/build/4085120e390f4f1e971c6ff61304a596/log/logs/mysql/error.txt.gz#213 | 15:54 |
| mriedem | 2019-10-03T21:49:22.135122Z 0 [Note] Event Scheduler: Loaded 0 events 2019-10-03T21:49:22.135429Z 0 [Note] /usr/sbin/mysqld: ready for connections. Version: '5.7.27-0ubuntu0.18.04.1' socket: '/var/run/mysqld/mysqld.sock' port: 3306 (Ubuntu) 2019-10-03T21:49:37.141359Z 4 [Note] Aborted connection 4 to db: 'keystone' user: 'root' host: 'localhost' (Got an error reading communication packets) | 15:55 |
| mriedem | i guess within 15 seconds | 15:55 |
| *** macz has joined #openstack-nova | 15:55 | |
| mriedem | checking the grenade log to see what happens in that window | 15:55 |
| mriedem | yeah so final restart here: | 15:55 |
| mriedem | 2019-10-03 21:49:20.113 | + functions-common:restart_service:2202 : sudo /bin/systemctl restart mysql | 15:56 |
| *** ociuhandu has quit IRC | 15:56 | |
| dansmith | why wouldn't that restart be before we start any of the openstack services? | 15:56 |
| sean-k-mooney | it is | 15:57 |
| sean-k-mooney | its in stack.sh | 15:57 |
| sean-k-mooney | https://github.com/openstack/devstack/blob/729f8b8ca62d0e6cba339be82ff371fa5abee62c/stack.sh#L1063 | 15:57 |
| mriedem | then we do dstat, mem tracker, etcd stuff and start setting up the keystone db | 15:57 |
| sean-k-mooney | right before we start the services | 15:57 |
| mriedem | yeah new side is recreating the dbs and running the sync | 15:57 |
| mriedem | umm, | 15:58 |
| mriedem | doesn't keystone do upgrades using db triggers? | 15:58 |
| mriedem | lbragstad: ^ | 15:58 |
| dansmith | I think it can do either | 15:58 |
| sean-k-mooney | mriedem: keystone sir unning under uwsgi right | 15:58 |
| mriedem | why would that matter? | 15:58 |
| lbragstad | mriedem it depends | 15:58 |
| *** tbachman has quit IRC | 15:58 | |
| mriedem | my point is, is there a keystone db migration late in train that f's up the db | 15:58 |
| sean-k-mooney | im wondering when we restart appache | 15:58 |
| mriedem | or f's up mysql | 15:59 |
| *** adriant has quit IRC | 15:59 | |
| sean-k-mooney | could it be starting keysone service before we reconfig the db | 15:59 |
| mriedem | the keystone db sync on the new side happens here https://zuul.opendev.org/t/openstack/build/4085120e390f4f1e971c6ff61304a596/log/logs/grenade.sh.txt.gz#12915 | 15:59 |
| *** donnyd_afk is now known as donnyd | 16:01 | |
| mriedem | actually that looks like the old side db sync, so i'm confused | 16:01 |
| mriedem | Loading script /opt/stack/old/keystone/keystone/common/sql/contract_repo/versions/025_placeholder.py | 16:01 |
| sean-k-mooney | so in a greade run the wsgi sripts and pacakages would be installed already for keystoen so wehn we do https://github.com/openstack/devstack/blob/729f8b8ca62d0e6cba339be82ff371fa5abee62c/stack.sh#L892 which restart apache https://github.com/openstack/devstack/blob/94ca9f6756e7b677b1ee3fd2e32b555447e950dd/lib/apache#L79 | 16:03 |
| sean-k-mooney | it could start running keystone | 16:03 |
| sean-k-mooney | that would happen before the db migration are run on the new run | 16:03 |
| mriedem | this is when n-sch is restarted on the new side | 16:04 |
| mriedem | 2019-10-03 22:17:55.659 | + functions-common:_run_under_systemd:1564 : sudo systemctl start devstack@n-sch.service | 16:04 |
| mriedem | so those times don't line up with mysqld error logs puking | 16:04 |
| *** tbachman has joined #openstack-nova | 16:06 | |
| mriedem | after that we verify the instance created on the old side | 16:07 |
| mriedem | 2019-10-03 22:20:00.703 | + /opt/stack/new/grenade/projects/60_nova/resources.sh:verify:175 : nova-manage cell_v2 verify_instance --uuid cb3d18d0-3266-43b8-9288-50151fe3b68b | 16:07 |
| fungi | is there any formal specification for network_data.json? so far i've only found an example at https://docs.openstack.org/nova/latest/user/metadata.html#openstack-format-metadata | 16:08 |
| mriedem | fungi: not formal no, i think there is an abandoned spec somewhere that people reference... | 16:09 |
| fungi | ahh, okay. is it treated as a stable api at least? | 16:10 |
| fungi | came up in working on improving ipv6 support in glean on rh-derived distros | 16:10 |
| mriedem | this is what i could find from the original spec https://specs.openstack.org/openstack/nova-specs/specs/liberty/implemented/metadata-service-network-info.html#rest-api-impact | 16:11 |
| mriedem | and https://specs.openstack.org/openstack/nova-specs/specs/rocky/approved/multiple-fixed-ips-network-information.html#rest-api-impact but the multiple fixed ips thing never landed... | 16:12 |
| mriedem | fungi: it's not microversioned, | 16:12 |
| mriedem | it's supposed to be stable, | 16:12 |
| mriedem | but i wouldn't be surprised if things slip through the nested dicts that get in htere | 16:12 |
| fungi | no worries, that's probably good enough, thanks!!! | 16:13 |
| mriedem | i remember this coming up in that latter spec because it says, "The old ip_address and netmask fields found in network_data.json need to be preserved for backward compatible reasons. This means those fields will continue to contain information of the first IP address." | 16:13 |
| mriedem | so it's like old school backward compat pre-microversion where we add keys but don't remove old ones | 16:13 |
| fungi | neat, i'd call that fairly stable | 16:13 |
| mriedem | the metadata api also rarely changes | 16:14 |
| fungi | i figured | 16:14 |
| dansmith | yeah that's what we did for the multiple dns or multple subnets or whatever change we made | 16:14 |
| *** mriedem is now known as mriedem_lunch | 16:14 | |
| fungi | thanks again, this is helpful | 16:14 |
| sean-k-mooney | do the peole that maintain cloud-init have a specfication for what whoudl be returned | 16:20 |
| sean-k-mooney | i know initlaly we based our metadata api on the ec2 version but we have diveraged along time ago | 16:21 |
| *** sapd1_x has quit IRC | 16:21 | |
| sean-k-mooney | stephenfin: i added some info on what case will not work with sev currently https://review.opendev.org/#/c/686414/1/releasenotes/notes/bug-1845986-95cbede0a296b088.yaml | 16:25 |
| sean-k-mooney | aspiers: are you working on a new version of the sev fix by the way? | 16:31 |
| *** zbr|ruck has quit IRC | 16:39 | |
| *** lpetrut has quit IRC | 16:41 | |
| *** dpawlik has joined #openstack-nova | 16:44 | |
| stephenfin | efried: Comment left on https://review.opendev.org/#/c/677443/ | 16:50 |
| stephenfin | *reply | 16:50 |
| *** zbr has joined #openstack-nova | 16:52 | |
| efried | stephenfin: but I mean, did something in this patch expose the need? | 16:54 |
| stephenfin | efried: Yeah, the option directives are indexed | 16:54 |
| efried | or just because this is the first patch hitting docs builds since whatever | 16:54 |
| efried | ah, thx | 16:54 |
| *** jangutter has quit IRC | 16:56 | |
| efried | +A | 16:56 |
| stephenfin | ]ta | 17:01 |
| *** derekh has quit IRC | 17:06 | |
| *** ociuhandu has joined #openstack-nova | 17:09 | |
| *** lpetrut has joined #openstack-nova | 17:15 | |
| openstackgerrit | Merged openstack/nova master: Add Selection.availability_zone field https://review.opendev.org/685807 | 17:24 |
| openstackgerrit | Merged openstack/nova master: FUP to I30916d8d10d70ce25523fa4961007cedbdfe8ad7 https://review.opendev.org/676228 | 17:25 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova-specs master: Support move operations with qos ports - Ussuri https://review.opendev.org/686779 | 17:25 |
| gibi | efried, mriedem_lunch: ^^ | 17:25 |
| gibi | and now I run away to have weekend... | 17:26 |
| *** psachin has quit IRC | 17:36 | |
| *** lpetrut has quit IRC | 17:49 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Neutron fixture cleanup https://review.opendev.org/684343 | 17:50 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Migrate 'test_floating_ips' functional tests https://review.opendev.org/684344 | 17:50 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Add TODOs for remaining nova-network functional tests https://review.opendev.org/684345 | 17:50 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: fixtures: Beef up NeutronFixture https://review.opendev.org/686795 | 17:50 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: fixtures: Handle iterable params for 'NeutronFixture.list_*' https://review.opendev.org/686796 | 17:50 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: fixtures: Store 'device_id' when creating port in NeutronFixture https://review.opendev.org/686797 | 17:50 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Change name of network provided by NeutronFixture https://review.opendev.org/686798 | 17:50 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Stop mocking the instance network cache https://review.opendev.org/686799 | 17:50 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Make it obvious where we're getting our names from https://review.opendev.org/686800 | 17:50 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Make even more nova-net stuff optional https://review.opendev.org/686801 | 17:51 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: fixtures: Add support for security groups https://review.opendev.org/686802 | 17:51 |
| *** mriedem_lunch is now known as mriedem | 17:51 | |
| * efried reboots... | 17:56 | |
| *** efried has quit IRC | 17:56 | |
| mriedem | ociuhandu: looks like hyperv cloudbase ci is having problems | 17:58 |
| *** efried has joined #openstack-nova | 17:58 | |
| mriedem | http://cloudbase-ci.com/nova/656656/30/devstack-build.log.gz | 17:58 |
| mriedem | fatal: [10.222.0.14]: FAILED! => { "msg": "The conditional check 'devstack_clone_result.rc != 0' failed. The error was: error while evaluating conditional (devstack_clone_result.rc != 0): 'dict object' has no attribute 'rc' | 17:58 |
| ociuhandu | mriedem: thank you, I'll ping the team asap and ask them to check and fix it | 17:59 |
| mriedem | thanks | 17:59 |
| *** jdillaman has joined #openstack-nova | 18:00 | |
| openstackgerrit | Eric Fried proposed openstack/nova-specs master: WIP: Spec: Ussuri: Emulated Virtual TPM https://review.opendev.org/686804 | 18:03 |
| *** ociuhandu has quit IRC | 18:08 | |
| *** ociuhandu has joined #openstack-nova | 18:08 | |
| ociuhandu | mriedem: I've checked with the team, the errors started from late last evening and by noon today the fix was commited: https://github.com/cloudbase/openstack-cis/commit/6b2f428d22dcd9f99d396ac3c596c7d9618e9796 | 18:11 |
| mriedem | ah cool, i must have just been looking at an old result | 18:13 |
| mriedem | thanks again | 18:13 |
| ociuhandu | here's a recent run: https://review.opendev.org/#/c/684334/ | 18:13 |
| *** nutcr4ck3r has joined #openstack-nova | 18:16 | |
| ociuhandu | mriedem: thanks, it's definitely better to check twice than miss some problems :) | 18:21 |
| *** nutcr4ck3r has quit IRC | 18:21 | |
| mriedem | yp | 18:22 |
| mriedem | *yup | 18:22 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove 'os-security-group-default-rules' REST API https://review.opendev.org/686807 | 18:22 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Remove unused '*_default_rules' security group DB APIs https://review.opendev.org/686808 | 18:22 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove (most) '/os-networks' REST APIs https://review.opendev.org/686809 | 18:22 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove '/os-tenant-networks' REST API https://review.opendev.org/686810 | 18:22 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Remove 'USE_NEUTRON' from functional tests https://review.opendev.org/686811 | 18:22 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Remove 'networks' quota https://review.opendev.org/686812 | 18:22 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove 'nova-manage network' commands https://review.opendev.org/686813 | 18:22 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Remove associate, disassociate network APIs https://review.opendev.org/686814 | 18:22 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Remove 'nova-dhcpbridge' binary https://review.opendev.org/686815 | 18:22 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Remove 'nova-network' binary https://review.opendev.org/686816 | 18:22 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: docs: Blast most references to nova-network https://review.opendev.org/686817 | 18:22 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: WIP https://review.opendev.org/686818 | 18:22 |
| *** TxGirlGeek has quit IRC | 18:22 | |
| *** TxGirlGeek has joined #openstack-nova | 18:46 | |
| mriedem | while on the topic if migrating off old volume attachments, https://review.opendev.org/#/c/541420/ has a +2 and gets us to stop creating legacy attachments during boot from volume which will make the eventually data migration less bad | 18:48 |
| mriedem | *of | 18:48 |
| mriedem | the patch is mostly comments and test code | 18:48 |
| *** pcaruana has quit IRC | 18:51 | |
| *** ociuhandu has quit IRC | 18:51 | |
| *** ociuhandu has joined #openstack-nova | 18:52 | |
| *** Sundar has joined #openstack-nova | 18:52 | |
| *** Sundar has quit IRC | 18:56 | |
| *** ociuhandu has quit IRC | 18:56 | |
| *** BjoernT_ has quit IRC | 19:02 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove Rocky compute compat checks for live migration with port bindings https://review.opendev.org/680005 | 19:11 |
| *** maciejjozefczyk has joined #openstack-nova | 19:11 | |
| mriedem | efried: aspiers: i take it there isn't much urgency in getting this fixed? https://review.opendev.org/#/c/684825/ - there have been no updates on the patch since tuesday. | 19:26 |
| mriedem | for an RC kind of thing that's a bit disappointing | 19:26 |
| efried | agree | 19:26 |
| efried | that it's disappointing. No idea if there's urgency. Kinda seemed like there should be. | 19:27 |
| efried | last time I heard from aspiers was on the "document this is broke" patch, yesterday morning. | 19:28 |
| mriedem | yeah i saw that | 19:32 |
| *** panda is now known as panda|off | 19:38 | |
| openstackgerrit | Merged openstack/nova master: FUP to I4d181b44494f3b0b04537d5798537831c8fdf400 https://review.opendev.org/676231 | 19:38 |
| openstackgerrit | Merged openstack/nova master: nova-net: Migrate 'test_quota_sets' functional tests https://review.opendev.org/684334 | 19:38 |
| *** maciejjozefczyk has quit IRC | 19:40 | |
| *** BjoernT has joined #openstack-nova | 19:40 | |
| *** CeeMac has quit IRC | 19:41 | |
| *** munimeha1 has quit IRC | 19:46 | |
| *** zbr has quit IRC | 19:46 | |
| *** BjoernT has quit IRC | 19:49 | |
| *** BjoernT has joined #openstack-nova | 19:51 | |
| mriedem | gibi: you said you were weekending | 19:55 |
| *** markvoelker has quit IRC | 19:55 | |
| openstackgerrit | Merged openstack/nova master: tests: Correctly mock out security groups in NeutronFixture https://review.opendev.org/685927 | 19:57 |
| openstackgerrit | Artom Lifshitz proposed openstack/nova master: [WIP] Functional tests for NUMA live migration https://review.opendev.org/672595 | 20:16 |
| openstackgerrit | Artom Lifshitz proposed openstack/nova master: [WIP] Helper to start computes with different HostInfos https://review.opendev.org/686832 | 20:16 |
| artom | I think I've done the hardest - get (re-) started and overcome that initial hurdle | 20:17 |
| artom | And with that - kids pick up time | 20:17 |
| *** artom has quit IRC | 20:17 | |
| *** jamesden_ has joined #openstack-nova | 20:30 | |
| *** jamesdenton has quit IRC | 20:31 | |
| *** tbachman has quit IRC | 20:37 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Cache image GETs for multi-create/multi-BDM requests https://review.opendev.org/686835 | 20:39 |
| *** jamesden_ has quit IRC | 20:41 | |
| *** jamesdenton has joined #openstack-nova | 20:41 | |
| mriedem | hmm, nova.tests.functional.libvirt.test_numa_servers.ReshapeForPCPUsTest.test_vcpu_to_pcpu_reshape might be a problem for the subunit parser bug | 20:44 |
| mriedem | https://zuul.opendev.org/t/openstack/build/4f649747fd9c44f29a105e5100a6232e/log/job-output.txt#2574 | 20:44 |
| mriedem | that test dumps a lot of stuff in the output stream | 20:44 |
| mriedem | only 1 fail in logstash though so maybe rare enough to not care http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22INFO%20%5Bnova.virt.libvirt.driver%5D%20Requesting%20provider%20tree%20reshape%20in%20order%20to%20move%20VCPU%20to%20PCPU%20allocations%20to%20the%20compute%20node%20provider%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=7d | 20:45 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Filter out alembic logs below WARNING in tests https://review.opendev.org/686836 | 20:51 |
| *** dpawlik has quit IRC | 20:54 | |
| *** slaweq has quit IRC | 20:59 | |
| *** xek_ has joined #openstack-nova | 21:13 | |
| dking_desktop | My attempts to boot an ironic instance seem to be stuck in BUILD/scheduling/NOSTATE. I'm seeing this message a lot in nova-compute.log: "Unknown column 'instance_extra_1.resources' in 'field list'". Could somebody confirm whether that column should be in the db? | 21:15 |
| *** xek__ has quit IRC | 21:16 | |
| efried | dking_desktop: I'm not the expert here, but it sounds like you may need to run some of the nova-manage db migratey things | 21:17 |
| dking_desktop | efried: Do you know where I might find out more about nova-manage? I saw that before, but it's not a command I currently have installed, and so I thought it might have been something older. | 21:19 |
| efried | mriedem and dansmith would probably know your answer off the top, but I can find the docs, sec... | 21:21 |
| efried | https://docs.openstack.org/nova/latest/cli/index.html | 21:21 |
| mriedem | efried: that would be your vpmem stuff :/ | 21:22 |
| mriedem | dking_desktop: but yeah you need to sync the db schema, probably on cell1 | 21:22 |
| efried | mriedem: oh, yeah, I recognize it now | 21:22 |
| mriedem | nova-manage --config-file <path to cell1 config> db sync | 21:22 |
| mriedem | if you only have 1 config (nova.conf) then if the [database]/connection entry isn't pointing at your cell1 database you're not syncing the cell1 db schema | 21:23 |
| efried | mriedem: does a | 21:23 |
| efried | nova-status upgrade check | 21:23 |
| efried | tell you whether you're done? | 21:23 |
| mriedem | with schema migrations? | 21:23 |
| mriedem | no | 21:24 |
| mriedem | but, i think mgoddard opened a bug asking for that | 21:24 |
| efried | ack | 21:24 |
| mriedem | https://review.opendev.org/#/c/667047/ | 21:24 |
| dking_desktop | mriedem: Thanks for the tip! I think that at least gives me a goal. However, I'm still very new. I'm working with tripleo, and if there's an error, I suppose that means that it missed something. | 21:26 |
| mriedem | dking_desktop: as in your a tripleo developer working on making it work with nova from train? | 21:27 |
| mriedem | or you're using tripleo for your deployment? | 21:27 |
| dking_desktop | I'm an end user using it for deployment, but I've found that it's also been necessary to patch some bugs along the way. | 21:27 |
| efried | heresy! | 21:28 |
| mriedem | then i'm guessing you should ask in the tripleo channel unfortunately | 21:28 |
| dking_desktop | lol. Wouldn't it be nice if things just worked out of the box! | 21:28 |
| mriedem | i assume that all tripleo users are also red hat core developers | 21:28 |
| mriedem | the channel is #tripleo btw | 21:29 |
| dking_desktop | I started there. They recommended here, but any info I can get will likely help. There's just a lot of different pieces to learn. | 21:29 |
| mriedem | huh | 21:29 |
| mriedem | if only we had some red hat people that talked to each other in the different channels... | 21:29 |
| mriedem | melwitt: ^ | 21:29 |
| dking_desktop | I think they mean #openstack, which I also tried, but nobody seemed to respond at all in there. | 21:29 |
| mriedem | dking_desktop: but yeah something isn't running the schema migration | 21:29 |
| *** derekh has joined #openstack-nova | 21:29 | |
| *** derekh has quit IRC | 21:29 | |
| dking_desktop | Okay, that sounds like what I expected. I just don't know yet where to find all that. So, I'll continue looking. I know that this channel is dev stuff, so thank you for taking the time to at least give me something to look at. | 21:32 |
| mriedem | also, fwiw, i have no idea if/when tripleo officially says it's cool to use it for upgrading to train | 21:32 |
| mriedem | i'm assuming they do | 21:32 |
| mriedem | and i'm assuming they lag behind the service projects (nova) | 21:32 |
| *** JamesBenson has quit IRC | 21:32 | |
| dking_desktop | I'm not upgrading anything myself. I'm attempting my first deploy, and it's on stein. | 21:33 |
| mriedem | that's very weird because that column is not in the stein code | 21:34 |
| mriedem | instance_extra_1.resources is new in train | 21:35 |
| mriedem | so maybe check your source packages | 21:35 |
| dking_desktop | Ah, that might be! I've found it's common for stuff to get in there that shouldn't be. So, that gives me a place to check. | 21:36 |
| dking_desktop | mriedem: Thanks for the tip, that cracked the problem for me! It turns out that I'm just a stupid end user. I accidentally installed train containers at an earlier point, and when I got the right repos, it didn't remove the containers. Thank you so much! | 21:46 |
| mriedem | ah np | 21:46 |
| openstackgerrit | Merged openstack/nova master: docs: Document global options for nova-manage https://review.opendev.org/677443 | 21:46 |
| mriedem | with that good deed i'm out of here o/ | 21:47 |
| *** mriedem has quit IRC | 21:47 | |
| *** gbarros has joined #openstack-nova | 21:57 | |
| *** slaweq has joined #openstack-nova | 22:11 | |
| *** slaweq has quit IRC | 22:16 | |
| *** xek_ has quit IRC | 22:17 | |
| *** BjoernT has quit IRC | 22:44 | |
| *** BjoernT has joined #openstack-nova | 22:45 | |
| openstackgerrit | Eric Fried proposed openstack/nova-specs master: WIP: Spec: Ussuri: Emulated Virtual TPM https://review.opendev.org/686804 | 22:55 |
| openstackgerrit | Eric Fried proposed openstack/nova-specs master: WIP: Spec: Ussuri: Emulated Virtual TPM https://review.opendev.org/686804 | 22:56 |
| *** macz has quit IRC | 22:59 | |
| *** luksky has quit IRC | 23:00 | |
| *** slaweq has joined #openstack-nova | 23:11 | |
| *** slaweq has quit IRC | 23:16 | |
| *** TxGirlGeek has quit IRC | 23:26 | |
| openstackgerrit | Merged openstack/nova master: Set Instance AZ from Selection AZ during build reschedule https://review.opendev.org/686047 | 23:38 |
| openstackgerrit | Merged openstack/nova master: Set Instance AZ from Selection AZ during migrate reschedule https://review.opendev.org/686050 | 23:38 |
| openstackgerrit | Merged openstack/nova master: Update cells v2 up-call caveats doc https://review.opendev.org/686053 | 23:38 |
| openstackgerrit | Merged openstack/nova stable/rocky: Reduce scope of 'path' query parameter to noVNC consoles https://review.opendev.org/686067 | 23:38 |
| openstackgerrit | Merged openstack/nova master: Create volume attachment during boot from volume in compute https://review.opendev.org/541420 | 23:39 |
| openstackgerrit | Merged openstack/nova master: nova-net: Migrate 'test_server_tags' functional tests https://review.opendev.org/684335 | 23:39 |
| eandersson | We are having a lot of instances stuck in building / scheduling again :'( | 23:43 |
| eandersson | I can see the allocation in placement, but no error logs etc | 23:44 |
| *** JamesBenson has joined #openstack-nova | 23:46 | |
| *** JamesBenson has quit IRC | 23:51 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!