| opendevreview | Brin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from Rebuild Server API https://review.opendev.org/c/openstack/nova/+/766380 | 00:03 |
|---|---|---|
| opendevreview | Brin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from List SG API https://review.opendev.org/c/openstack/nova/+/766726 | 00:04 |
| opendevreview | Brin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from Flavor Access APIs https://review.opendev.org/c/openstack/nova/+/767704 | 00:52 |
| opendevreview | Brin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from List/Show usage APIs https://review.opendev.org/c/openstack/nova/+/768509 | 01:08 |
| opendevreview | Brin Zhang proposed openstack/nova master: Replace tenants* with projects* of policies https://review.opendev.org/c/openstack/nova/+/765315 | 02:02 |
| opendevreview | Brin Zhang proposed openstack/nova master: Replace os-simple-tenant-usage with os-simple-project-usage https://review.opendev.org/c/openstack/nova/+/768852 | 02:02 |
| opendevreview | Brin Zhang proposed openstack/nova master: Replace tenant_id with project_id in os-quota-sets path https://review.opendev.org/c/openstack/nova/+/768851 | 02:02 |
| opendevreview | Brin Zhang proposed openstack/nova master: Replace tenant_id with project_id in Limits API https://review.opendev.org/c/openstack/nova/+/768862 | 02:02 |
| opendevreview | Brin Zhang proposed openstack/nova master: Replace tenant* with project* in codes https://review.opendev.org/c/openstack/nova/+/769329 | 02:02 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: tests: Add test for bug #1936278 https://review.opendev.org/c/openstack/nova/+/802893 | 02:09 |
| *** rpittau|afk is now known as rpittau | 06:15 | |
| *** mtreinish_ is now known as mtreinish | 06:40 | |
| opendevreview | Slawek Kaplonski proposed openstack/nova stable/queens: [neutron] Get only ID and name of the SGs from Neutron https://review.opendev.org/c/openstack/nova/+/791421 | 07:01 |
| kashyap | lyarwood: Looking | 08:36 |
| kashyap | lyarwood: Okay, I see that error was already discussed upstream QEMU by Debian folks last year ... looking | 08:54 |
| kashyap | lyarwood: Okay, talking to upstream QEMU maint: | 09:05 |
| kashyap | - That terrible error is thrown becuase QEMU is unable execute code from the memory QEMU is executing from — IOW, it requires the allocated chunk of memory to be executable. | 09:06 |
| kashyap | - Peter (from QEMU) had three possible guesses off-hand: | 09:07 |
| kashyap | (a) host OS is enforcing no-rwx like OpenBSD can, or (b) if the user's set a very aggressive 'ulimit'on virtual memory usage, or (c) perhaps a system with no swap and not enough RAM either | 09:07 |
| kashyap | - From QEMU 6.0 or higher, they fixed that usless error to report a better error including the error code: https://git.qemu.org/?p=qemu.git;a=commitdiff;h=6bc144237a857b | 09:11 |
| kashyap | So, our possible options are: | 09:11 |
| kashyap | (1) Check if this is repetable at all -- and rule out 'ulimit' and "not enough RAM" options | 09:12 |
| kashyap | (2) Try QEMU 6.0 or higher, to identify the precise error - that may give better info to the QEMU folks to debug further | 09:12 |
| kashyap | (3) In case we have access to the host, get `strace` output, which should tell us where the mmap() call is failing. | 09:13 |
| kashyap | I don't think (2) and (3) are not possible because our hands are tied, and no access to the machine? :-( | 09:15 |
| kashyap | Oh, correction: Peter tells me that the 'strace' will give the same info as trying with QEMU 6.0 or higher. So we can try whatever is eaiser: option two or (2) or (3) from the above. | 09:16 |
| kashyap | s/two or// | 09:19 |
| lyarwood | kashyap: kk, we don't have virt-preview for centos stream so I'm not sure what we can do tbh | 09:27 |
| lyarwood | oh wait we do | 09:27 |
| lyarwood | TIL | 09:27 |
| lyarwood | cool I'll enable that now | 09:27 |
| kashyap | lyarwood: Yeah, CentOS does have it, last I checked | 09:27 |
| kashyap | lyarwood: Via a CI job? | 09:27 |
| lyarwood | yeah | 09:27 |
| kashyap | lyarwood: Ah, cool. In case this is not resolved by tomm afternoon (I'll be on PTO from day after), you can follow-up with 'pm215' (Peter Maydell) on #qemu, OFTC. He helped the initial diagnosis from QEMU | 09:30 |
| kashyap | (If he's not around, then 'davidgiluk') | 09:30 |
| kashyap | s/helped the/helped with the/ | 09:31 |
| lyarwood | kashyap: ack thanks | 09:33 |
| lyarwood | kashyap: https://review.opendev.org/c/openstack/tempest/+/804055 will enable the repo | 09:33 |
| kashyap | lyarwood: Excellent; thank you! Do you know what version of QEMU it'll bring? | 09:58 |
| lyarwood | kashyap: 6.0.0-12 appears to be in the repo | 09:59 |
| * kashyap goes to look at https://download.copr.fedorainfracloud.org/results/@virtmaint-sig/virt-preview/ | 09:59 | |
| kashyap | lyarwood: Ah, was just looking at the repo | 09:59 |
| lyarwood | https://copr.fedorainfracloud.org/coprs/g/virtmaint-sig/virt-preview/build/2353031/ | 10:00 |
| kashyap | lyarwood: Isn't that -12 for fc34? - 6.0.0-12.fc34 - maybe it's the same for CentOS 8 too | 10:01 |
| kashyap | Yes, it is - https://download.copr.fedorainfracloud.org/results/@virtmaint-sig/virt-preview/centos-stream-8-x86_64/02353031-qemu/ | 10:01 |
| lyarwood | yeah I think it's cross built | 10:01 |
| kashyap | Yep, you're right | 10:01 |
| kashyap | lyarwood: BTW, I double-checked that version of QEMU has the commit we want: | 10:02 |
| kashyap | $> git tag --contains 6bc144237a857b | head -1 | 10:02 |
| kashyap | v6.0.0 | 10:02 |
| kashyap | Gave my paltry ACK on the Tempest change, with a note | 10:07 |
| sean-k-mooney1 | gmann: gibi_pto ye might find https://review.opendev.org/c/openstack/keystonemiddleware/+/787822 interesting its the implementation of X-Project-Id passthru that allows you to use project ids with system scoped tokens | 10:37 |
| *** sean-k-mooney1 is now known as sean-k-mooney | 10:37 | |
| opendevreview | Lee Yarwood proposed openstack/nova master: compute: Query the service group API within check_instance_host https://review.opendev.org/c/openstack/nova/+/802317 | 11:11 |
| *** xek_ is now known as xek | 11:52 | |
| *** lbragstad__ is now known as lbragstad | 13:35 | |
| *** slaweq_ is now known as slaweq | 14:01 | |
| *** whoami-rajat__ is now known as whoami-rajat | 14:06 | |
| artom | Am I high? Why am I seeing api_models.py in Newton? I thought cells v2 was way after that... | 14:38 |
| artom | I guess we'd already started by then... | 14:43 |
| sean-k-mooney | i dont think that was new to cells v2 | 14:44 |
| sean-k-mooney | even with v1 i think we had a seperate top level db that we then had sync tasks runing btween the cells | 14:45 |
| sean-k-mooney | i try to block out cell_v1's existance form my mind as much as i can | 14:45 |
| stephenfin | It was new to cells v2 | 14:57 |
| stephenfin | we only turned it on in Pike, but there was ground work way before that | 14:58 |
| *** ralonsoh_ is now known as ralonsoh | 15:22 | |
| *** owalsh_ is now known as owalsh | 15:31 | |
| gmann | sean-k-mooney: ack, thanks | 15:58 |
| *** rpittau is now known as rpittau|afk | 16:31 | |
| b1tsh1ft3r | Hey all, had a compute node hardware failure. Ive removed the compute node and re-added according to the docs here: https://docs.openstack.org/openstack-ansible/train/admin/scale-environment.html#add-compute-host | 18:49 |
| b1tsh1ft3r | i'm having issues however being able to live migrate instances to the compute node. I'm not seeing any real errors in logs or the UI. It looks as if it works, but doesnt. | 18:50 |
| sean-k-mooney | i would check that ssh is workign between the compute nodes and that the host name resolve correctly | 18:54 |
| sean-k-mooney | you need passworad less ssh to work as the use nova is running as and yuou will need to have exchanged keys | 18:55 |
| sean-k-mooney | assuming you are getting that far | 18:55 |
| sean-k-mooney | b1tsh1ft3r: in general thougfh you might be better of asking the osa developers | 18:56 |
| b1tsh1ft3r | it has nothing to do with ansible deployment of the new compute node itself. The plays ran through clean. its purely a nova issue or config of nova but i cant imagine what it might be since the config hasnt changed between this node and any of the other nodes when it was setup. | 19:02 |
| b1tsh1ft3r | SSH access is open between both nodes without prompts | 19:02 |
| sean-k-mooney | b1tsh1ft3r: just becasue the play ran thoguh clean does not mean the plays were correct | 19:02 |
| b1tsh1ft3r | Yes but the config hasn't changed. | 19:03 |
| sean-k-mooney | have you used this procdeure to add other nodes | 19:04 |
| b1tsh1ft3r | yes, its worked fine. my only guess here is something is left over residual somewhere from removing the node, but its probably burried in db in galera somewhere is my only real guess. | 19:09 |
| sean-k-mooney | when you added the new node did you give it a new host name | 19:10 |
| sean-k-mooney | its generally not a good idea to reuse the hostname | 19:10 |
| b1tsh1ft3r | used same node name, so my guess is thats probably the issue here. i guess i can change it, but... since its a replacement for a hardware failure i wanted to keep the same name ideally | 19:13 |
| sean-k-mooney | you can keep the same name but there are extra steps you ahve to take and osa is know to not do the replacement properly | 19:13 |
| sean-k-mooney | b1tsh1ft3r: if you are ligitimatly replaceing the node not adding one its important to ensure that you do not delete the compute sesrvice record for the node for example | 19:14 |
| sean-k-mooney | that way it will keep the same service uuid and placement resouce provider | 19:15 |
| sean-k-mooney | if you delete the compute serivce record the service uuid will change and cause a conflict in placment when trying to create a resouce provier with a different uuid but same host name | 19:15 |
| *** lbragstad_ is now known as lbragstad | 19:45 | |
| opendevreview | melanie witt proposed openstack/nova master: Add stub unified limits driver https://review.opendev.org/c/openstack/nova/+/712137 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: Assert quota related API behavior when noop https://review.opendev.org/c/openstack/nova/+/712140 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: Make unified limits APIs return reserved of 0 https://review.opendev.org/c/openstack/nova/+/712141 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: Add logic to enforce local api and db limits https://review.opendev.org/c/openstack/nova/+/712139 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: Enforce api and db limits https://review.opendev.org/c/openstack/nova/+/712142 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: Update quota_class APIs for db and api limits https://review.opendev.org/c/openstack/nova/+/712143 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: Update limit APIs https://review.opendev.org/c/openstack/nova/+/712707 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: Update quota sets APIs https://review.opendev.org/c/openstack/nova/+/712749 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: Tell oslo.limit how to count nova resources https://review.opendev.org/c/openstack/nova/+/713301 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: Enforce resource limits using oslo.limit https://review.opendev.org/c/openstack/nova/+/615180 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: Add legacy limits and usage to unified limits https://review.opendev.org/c/openstack/nova/+/713498 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: Update quota apis with keystone limits and usage https://review.opendev.org/c/openstack/nova/+/713499 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: Add reno for unified limits https://review.opendev.org/c/openstack/nova/+/715271 | 23:05 |
| opendevreview | melanie witt proposed openstack/nova master: WIP Enable unified limits in the nova-next job https://review.opendev.org/c/openstack/nova/+/789963 | 23:21 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!