| opendevreview | Artom Lifshitz proposed openstack/nova master: weights debug log: stop using tuples as dict keys https://review.opendev.org/c/openstack/nova/+/904060 | 01:39 |
|---|---|---|
| opendevreview | Merged openstack/nova master: pre-commit: Add mypy https://review.opendev.org/c/openstack/nova/+/896228 | 05:00 |
| opendevreview | Merged openstack/nova master: pre-commit: Bump linter versions https://review.opendev.org/c/openstack/nova/+/903749 | 05:33 |
| alisafari | Hi sean-k-mooney would you take a look at this backport. When you had the time ? https://review.opendev.org/c/openstack/nova/+/903444 | 10:39 |
| kashyap | alisafari: That backport looks safe to me, but I can't +2 it, though. | 10:47 |
| alisafari | kashyap Thank you. | 10:57 |
| kashyap | alisafari: I just ACKed it, FWIW | 10:59 |
| opendevreview | Sylvain Bauza proposed openstack/nova master: Augment the LibvirtLiveMigrateData object https://review.opendev.org/c/openstack/nova/+/904175 | 11:14 |
| opendevreview | Sylvain Bauza proposed openstack/nova master: check both source and dest compute libvirt versions for mdev lv https://review.opendev.org/c/openstack/nova/+/904176 | 11:14 |
| opendevreview | Sylvain Bauza proposed openstack/nova master: WIP: Check can destination can support mdev types https://review.opendev.org/c/openstack/nova/+/904177 | 11:14 |
| opendevreview | Sylvain Bauza proposed openstack/nova master: WIP: Check can destination can support mdev types https://review.opendev.org/c/openstack/nova/+/904177 | 11:20 |
| dvo-plv | Hello, All | 11:41 |
| dvo-plv | Could you pelase help me zull | 11:41 |
| dvo-plv | gate jobs failed https://review.opendev.org/c/openstack/glance/+/882133 | 11:41 |
| dvo-plv | How I can rerun it, just with recheck comment ? | 11:41 |
| bauzas | correct, please write 'recheck <something>' | 12:21 |
| sean-k-mooney | dvo-plv: ya we dont allow reruning just gate any more so recheck and the reason why it failed | 12:21 |
| sean-k-mooney | tempest.lib.exceptions.IdentityError: Got identity error | 12:21 |
| sean-k-mooney | so it looks like keystone died | 12:22 |
| sean-k-mooney | proably oom killed | 12:22 |
| dvo-plv | I get it, as far as I understand, I just need some luck to avoid this issue, right ? | 12:24 |
| sean-k-mooney | ya https://zuul.opendev.org/t/openstack/build/2874580c83d0484593f800d6d9c6fde2/log/controller/logs/screen-keystone.txt#89780 os the connection form keyston to the db was killed im guessign the db was killed | 12:24 |
| sean-k-mooney | yep https://zuul.opendev.org/t/openstack/build/2874580c83d0484593f800d6d9c6fde2/log/controller/logs/syslog.txt#7394 | 12:25 |
| sean-k-mooney | dvo-plv: ya unfortunetly | 12:25 |
| sean-k-mooney | we try to optimise the jobs so that it wont happen | 12:25 |
| sean-k-mooney | but sometimes it will still cause a failure | 12:25 |
| sean-k-mooney | with that siad i need to fix the spellign mistaks in my devstack patch to improve this situration | 12:26 |
| dvo-plv | I see, thank you | 12:26 |
| sean-k-mooney | im hoping https://review.opendev.org/c/openstack/devstack/+/890693 will fix it or at least help | 12:27 |
| sean-k-mooney | since you remineded me of that ill go fix the spelling issue now | 12:27 |
| dvo-plv | you are welcome) | 12:28 |
| opendevreview | alisafari proposed openstack/nova stable/2023.1: Fix traits to cpu flags mapping https://review.opendev.org/c/openstack/nova/+/903444 | 13:52 |
| opendevreview | Sylvain Bauza proposed openstack/nova master: check both source and dest compute libvirt versions for mdev lv https://review.opendev.org/c/openstack/nova/+/904176 | 13:56 |
| opendevreview | Sylvain Bauza proposed openstack/nova master: Check if destination can support the src mdev types https://review.opendev.org/c/openstack/nova/+/904177 | 13:56 |
| opendevreview | Sylvain Bauza proposed openstack/nova master: WIP returns mdevs https://review.opendev.org/c/openstack/nova/+/904209 | 13:56 |
| opendevreview | Sylvain Bauza proposed openstack/nova master: check both source and dest compute libvirt versions for mdev lv https://review.opendev.org/c/openstack/nova/+/904176 | 15:25 |
| opendevreview | Sylvain Bauza proposed openstack/nova master: Check if destination can support the src mdev types https://review.opendev.org/c/openstack/nova/+/904177 | 15:25 |
| opendevreview | Sylvain Bauza proposed openstack/nova master: WIP returns mdevs https://review.opendev.org/c/openstack/nova/+/904209 | 15:25 |
| opendevreview | Alex Welsh proposed openstack/nova master: Add --update flag for map_cell0 https://review.opendev.org/c/openstack/nova/+/903140 | 16:19 |
| opendevreview | Artom Lifshitz proposed openstack/nova stable/2023.2: Call Neutron immediately upon _post_live_migration() start https://review.opendev.org/c/openstack/nova/+/904225 | 16:44 |
| opendevreview | Artom Lifshitz proposed openstack/nova stable/2023.2: Allow best effort sending of notifications https://review.opendev.org/c/openstack/nova/+/904226 | 16:44 |
| opendevreview | Artom Lifshitz proposed openstack/nova stable/2023.1: Call Neutron immediately upon _post_live_migration() start https://review.opendev.org/c/openstack/nova/+/904227 | 16:45 |
| opendevreview | Artom Lifshitz proposed openstack/nova stable/2023.1: Allow best effort sending of notifications https://review.opendev.org/c/openstack/nova/+/904228 | 16:45 |
| opendevreview | Artom Lifshitz proposed openstack/nova stable/zed: Call Neutron immediately upon _post_live_migration() start https://review.opendev.org/c/openstack/nova/+/904229 | 16:47 |
| opendevreview | Artom Lifshitz proposed openstack/nova stable/zed: Allow best effort sending of notifications https://review.opendev.org/c/openstack/nova/+/904230 | 16:47 |
| gksk | Hi Team | 16:54 |
| gksk | Did any one face this error | 16:54 |
| gksk | ERROR oslo.messaging._drivers.impl_rabbit [-] [2940a4d9-ce1c-4d6c-a51d-771c7c2e16a0] AMQP server on x.x.x.x is unreachable: Server unexpectedly closed connection. | 16:54 |
| gksk | I am getting this error on nova-api log when I try to spin a vm on specific compute node | 16:54 |
| sean-k-mooney | that generally just means that either the tcp connection dropped or the rabbitmq server was restarted | 16:54 |
| sean-k-mooney | oh ok | 16:55 |
| sean-k-mooney | that can be ignored entirly | 16:55 |
| sean-k-mooney | well it depends so is it causing an error with booting the vm | 16:55 |
| gksk | any solution for this issue? | 16:56 |
| sean-k-mooney | gksk: ther eare two reason this happens oen is not an error the other means you had an infra probelm | 16:56 |
| sean-k-mooney | are you runign nova api under a wsgi server like appche | 16:56 |
| sean-k-mooney | if you are and its not causing the vm creation to fail | 16:57 |
| gksk | No basically when I try to create another vm on the same host (compute node ) immediately the previous vm is coming to active state | 16:57 |
| sean-k-mooney | then this is just because apache kills the wsgi application after the request suspendign the heatbeat and causing the connection to close | 16:58 |
| gksk | do we have any fix for this | 16:58 |
| gksk | ? | 16:58 |
| sean-k-mooney | it depend on why the conenction was closed | 16:59 |
| sean-k-mooney | we have once ase where this is prented that we do not consider a bug as it not fixable in nova | 16:59 |
| sean-k-mooney | if it impacts the spawnign fo a vm and result in it going to error | 16:59 |
| sean-k-mooney | it might be a diffent edgecase that might be a fixable bug | 16:59 |
| gksk | I am not sure why conenction was closed | 16:59 |
| sean-k-mooney | lets start by determing how your runing nova-api | 17:00 |
| sean-k-mooney | are you using the nova-api binary or runing it as a wsgi applcition on a webserver | 17:00 |
| gksk | no I am using nova-api binary | 17:01 |
| sean-k-mooney | ok in that case that messge would indicate that the tcp connection to rabbit was closed likely due to a networkign issue | 17:02 |
| sean-k-mooney | when using nova-api directly it runnign under the eventlet webserver | 17:02 |
| sean-k-mooney | that webserver will not terminate the rabbitmq connect based on the time form the last request | 17:03 |
| sean-k-mooney | it will keep it open wiht a heatbeat | 17:03 |
| sean-k-mooney | can you confrim taht you have https://docs.openstack.org/nova/latest/configuration/config.html#oslo_messaging_rabbit.heartbeat_in_pthread set ot false | 17:03 |
| gksk | Let me check | 17:04 |
| gksk | give me 2 mins | 17:04 |
| sean-k-mooney | heartbeat_in_pthread=true is only for runing under a wsgi server like apache mod_wsgi and is knwo to break running under eventlet | 17:06 |
| sean-k-mooney | so in your config its imporant to set that to false | 17:06 |
| sean-k-mooney | which is the default | 17:06 |
| opendevreview | Sylvain Bauza proposed openstack/nova master: Check if destination can support the src mdev types https://review.opendev.org/c/openstack/nova/+/904177 | 17:07 |
| opendevreview | Sylvain Bauza proposed openstack/nova master: WIP reserve mdevs to return to the source https://review.opendev.org/c/openstack/nova/+/904209 | 17:07 |
| gksk | Hi Sean | 17:09 |
| gksk | heartbeat_in_pthread is false in nova conf | 17:09 |
| sean-k-mooney | ack | 17:09 |
| gksk | but its commented out | 17:09 |
| sean-k-mooney | ya thats the default | 17:09 |
| gksk | do we need to uncomment it | 17:09 |
| sean-k-mooney | so that is fine | 17:09 |
| sean-k-mooney | no its false unless you set it otherwise | 17:10 |
| gksk | okay | 17:10 |
| *** blarnath is now known as d34dh0r53 | 19:24 | |
| *** elodilles is now known as elodilles_pto | 19:24 | |
| opendevreview | Merged openstack/nova stable/2023.1: Fix traits to cpu flags mapping https://review.opendev.org/c/openstack/nova/+/903444 | 20:02 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!