| opendevreview | melanie witt proposed openstack/nova master: WIP Enable unified limits in the nova-next job https://review.opendev.org/c/openstack/nova/+/789963 | 04:56 |
|---|---|---|
| opendevreview | melanie witt proposed openstack/nova master: WIP Enable unified limits in the nova-next job https://review.opendev.org/c/openstack/nova/+/789963 | 07:02 |
| bauzas | gibi: thanks for having approved the nova RC1 change | 07:26 |
| gibi | bauzas: the gate seems to be down due to pip resolve issue (jobs times out) so we haven't merged the RC1 yet | 07:26 |
| bauzas | yeah I saw | 07:26 |
| bauzas | infra is on it ? | 07:26 |
| gibi | release team knows it but nobody able to reproduce it locally afaik | 07:27 |
| bauzas | shit. | 07:27 |
| bauzas | gibi: I'm happy to see you signed up our team for the PTG :p | 07:53 |
| gibi | bauzas: yepp I did that early :) | 07:54 |
| gibi | would be fun missing that | 07:54 |
| bauzas | what could be fun would be the miss the registration | 07:55 |
| bauzas | be to miss* | 07:55 |
| songwenping_ | bauzas: morning, i have two gpus virtualized on my env, and i config one pci address for the vgpu device_addresses, but nova report all gpus to placement, is this a bug? | 07:59 |
| bauzas | songwenping_: could you provide me the conf ? | 08:00 |
| bauzas | songwenping_: I think it's because you only have one type | 08:00 |
| bauzas | you need to create a fake second type | 08:00 |
| songwenping_ | yes, only one type. | 08:00 |
| bauzas | yeah, I know, it's bad | 08:00 |
| bauzas | do something like enabled_vgpu_types = nvidia-XXX, foo | 08:01 |
| bauzas | and create a fake section [vgpu_foo] | 08:01 |
| bauzas | with a fake device | 08:01 |
| bauzas | that's because we don't look at the vgpu sections if we only have one type | 08:01 |
| bauzas | for supporting the previous releases | 08:01 |
| songwenping_ | yes, i looked into the code. | 08:02 |
| songwenping_ | if the lenth of supported type is 1, it returns the type. | 08:02 |
| bauzas | yup | 08:04 |
| songwenping_ | will we change this logic? | 08:05 |
| bauzas | songwenping_: we could remove the compatibility and just look whether we have a specific section | 08:10 |
| bauzas | actually, this would continue to support the compatibility | 08:11 |
| bauzas | songwenping_: if you want, create a new bug report and if you want, you could provide a new change that I'd review | 08:11 |
| bauzas | it's simple, that's only done in a methond | 08:11 |
| bauzas | method* | 08:11 |
| songwenping_ | bauzas: ok, i will report a new bug and fix it. | 08:12 |
| bauzas | songwenping_: lovely, thanks ! | 08:13 |
| songwenping_ | cool | 08:13 |
| gibi | melwitt, bauzas: the placement release notes now published properly https://docs.openstack.org/releasenotes/placement/xena.html | 08:39 |
| bauzas | naïce | 08:39 |
| gibi | you have strange letters :) | 08:39 |
| bauzas | ... tells someone speaking Hungarian :p | 08:40 |
| gibi | those are not strange :D | 08:40 |
| gibi | to me :D | 08:40 |
| gibi | áÁ-éÉ-íÍ-óÓ-öÖ-őŐ-úÚ-üÜ-űŰ | 08:41 |
| bauzas | heh | 08:41 |
| bauzas | actually, naïce is a French pun | 08:41 |
| bauzas | this is because naice would mean "ai" == "è" (like heh) | 08:42 |
| bauzas | instead, aï mean "ah-ee" | 08:42 |
| bauzas | and of course, you know the "ain" which is only one syllab | 08:43 |
| gibi | playing with phonetic | 08:44 |
| gibi | that is fun | 08:44 |
| gibi | hungary has some strange phonetic compared to the english e.g. around s, z, sz, zs, | 08:44 |
| gibi | basically how s sounds in english is sz in hungarian | 08:46 |
| gibi | and the hungarian s is closer to sh in english | 08:46 |
| opendevreview | Wenping Song proposed openstack/nova master: Remove the code that never reach https://review.opendev.org/c/openstack/nova/+/809572 | 08:47 |
| bauzas | gibi: I know, Balach :p | 08:50 |
| bauzas | or should I say Balass actually ? | 08:51 |
| gibi | I don't know a direct mapping betwen zs sound to english | 08:51 |
| bauzas | I remember you telling me once "Balach" but I could be wrong | 08:51 |
| gibi | ohh | 08:51 |
| gibi | google helped | 08:51 |
| gibi | zs (pronounced like the “s” in pleasure) | 08:51 |
| bauzas | I see | 08:52 |
| gibi | plezsör | 08:52 |
| bauzas | lol | 08:52 |
| gibi | if I use hungarian pronunciation :D | 08:52 |
| bauzas | plizure | 08:53 |
| bauzas | actually, plizeure | 08:53 |
| gibi | and our languages are not even that far from each other, I guess gmann could add many other strangness to this discussion | 09:00 |
| gibi | or alex_zu | 09:00 |
| bauzas | heh | 09:01 |
| bauzas | on a sad note, RC1 is still on the weeds https://review.opendev.org/c/openstack/releases/+/808706 | 09:01 |
| bauzas | I'm tempted to recheck but i'm not sure it will help | 09:01 |
| gibi | elodilles and hberaud discussion the issue on #openstack-release | 09:03 |
| gibi | so I opt to wait a bit | 09:03 |
| bauzas | oh, was looking at the release chan ealier | 09:05 |
| gibi | and elod is actally előd where ő is the double long sound of 'e' in the english her | 09:13 |
| gibi | elodilles: // | 09:13 |
| gibi | I mean ^^ | 09:13 |
| gibi | just I had to switch layout for ő | 09:13 |
| elodilles | :) | 09:15 |
| bauzas | gibi: elodilles: so what's the prununciation ? helid ? | 09:15 |
| bauzas | oh, found https://www.youtube.com/watch?v=eLr9sfjk_Q8 | 09:16 |
| bauzas | https://fr.forvo.com/word/el%C5%91d/ | 09:17 |
| bauzas | \o/ | 09:17 |
| gibi | bauzas: that sounds like szilva (plum) in hungarian | 09:17 |
| elodilles | yes, I can confirm that it's szilva :) | 09:18 |
| bauzas | hah, fun to know | 09:18 |
| bauzas | I'm not that light-weight, especially after summer break | 09:19 |
| opendevreview | Rajat Dhasmana proposed openstack/nova-specs master: Add spec for volume backed server rebuild https://review.opendev.org/c/openstack/nova-specs/+/809621 | 09:45 |
| opendevreview | Rajat Dhasmana proposed openstack/nova-specs master: Add spec for volume backed server rebuild https://review.opendev.org/c/openstack/nova-specs/+/809621 | 09:55 |
| oklhost | hey buddies, someone else facing this issue my co-worker reported: https://bugs.launchpad.net/nova/+bug/1943793 | 10:00 |
| *** bhagyashris_ is now known as bhagyashris | 11:43 | |
| sean-k-mooney | oklhost: i think this is a just a duplicat of a know issue that is not really a bug | 11:54 |
| sean-k-mooney | oklhost: i think this is just the behavior we expect when nova-api is running under a wsgi server but you do not use the experimntal fature to run the heatbeat thread in a seperet pthread | 11:55 |
| gmann | gibi: bauzas :)at first read, I thought 'naice' means 'nice'. | 14:04 |
| bauzas | gmann: that is korrect | 14:04 |
| bauzas | but you need to use the ï | 14:04 |
| bauzas | or it would be "nehsse" | 14:04 |
| gmann | i see. | 14:05 |
| dansmith | in 'merican we don't have none of those funky looking characters | 14:05 |
| gmann | japanese has a lot and i was always confused with those | 14:06 |
| dansmith | uh, yeah :P | 14:06 |
| gmann | but honestly saying using 'K' for 'c as k' sounds more clear and easy, especially for non-native english people :) | 14:09 |
| bauzas | well, our French written level dropped a lot since a few year so I guess in a few years you'll see some Simple French too | 14:14 |
| bauzas | which is an oxymore | 14:14 |
| bauzas | oxymoron* actually | 14:14 |
| * bauzas drops for taxi driving | 14:14 | |
| opendevreview | OpenStack Release Bot proposed openstack/nova stable/xena: Update .gitreview for stable/xena https://review.opendev.org/c/openstack/nova/+/809759 | 14:44 |
| opendevreview | OpenStack Release Bot proposed openstack/nova stable/xena: Update TOX_CONSTRAINTS_FILE for stable/xena https://review.opendev.org/c/openstack/nova/+/809760 | 14:44 |
| opendevreview | OpenStack Release Bot proposed openstack/nova master: Update master for stable/xena https://review.opendev.org/c/openstack/nova/+/809761 | 14:44 |
| opendevreview | OpenStack Release Bot proposed openstack/nova master: Add Python3 yoga unit tests https://review.opendev.org/c/openstack/nova/+/809762 | 14:44 |
| gibi | \o/ we have RC1 cut | 14:46 |
| bauzas | wahooo | 14:54 |
| ade_lee | stephenfin, lyarwood melwitt sean-k-mooney -- hey - can anyone look at https://zuul.opendev.org/t/openstack/build/af88c0d00ebb48509a51f6eb941c65c6/logs please -- there are octavia jobs failing in a fips enabled tripleo-stanalone job here -- looks like nova api is throwing 500s | 15:22 |
| lyarwood | ade_lee: ack I'll look shortly | 15:23 |
| ade_lee | lyarwood, thanks! | 15:23 |
| sean-k-mooney | interesting are there trace backs | 15:26 |
| sean-k-mooney | looks like there was a rabit issue then we see OSError: Apache/mod_wsgi request data read error: Partial results are valid but processing is incomplete. | 15:28 |
| sean-k-mooney | so ya there is an oslo messaging time out then a buch of thost partial result errors | 15:29 |
| sean-k-mooney | thsi does not look related to nova | 15:29 |
| sean-k-mooney | https://zuul.opendev.org/t/openstack/build/af88c0d00ebb48509a51f6eb941c65c6/log/logs/undercloud/var/log/containers/nova/nova-api.log#2561 | 15:30 |
| ade_lee | sean-k-mooney, hmm - guess I'll do a recheck and see if its something transient -- I see nothing in rabbit logs | 15:32 |
| mloza | hello, I have two ceph clusters and I create cinder volumes with two types however, I can only attach first volume type to the instances, the second volume type throws an error https://paste.opendev.org/show/bq8pYJCpViYfJawKy943/ | 15:38 |
| mloza | the cinder secrets are the same on both | 15:39 |
| mloza | I can query second ceph cluster using from the compute ceph -c ceph.conf -n client.cinder --keyring=cinder.keyring status | 15:43 |
| mloza | not sure why nova compute is throwing perm denied | 15:44 |
| sean-k-mooney | you likely need to add a scond keyring to the libvirt secrets | 15:44 |
| sean-k-mooney | normally when you add ceph you do something like this https://github.com/openstack/devstack-plugin-ceph/blob/master/devstack/lib/ceph#L244-L259 | 15:46 |
| sean-k-mooney | but unless the same keyrign works for both clusters you will need to add a second one and then set the right keyring infor in the ceph backend in cinder | 15:46 |
| sean-k-mooney | https://ceph.io/geen-categorie/openstack-nova-configure-multiple-ceph-backends-on-one-hypervisor/ | 15:48 |
| sean-k-mooney | mloza: kolla does not actuly support using muliple ceph clusters out of the box today | 15:49 |
| mloza | sean-k-mooney: i have cinder-backup and cinder keyring the same on both ceph cluster. Yes, I modified the playbooks by hand and creating two type of volumes works. | 15:52 |
| mloza | i can only attach first volume type two tho | 15:53 |
| mloza | type tho* | 15:53 |
| sean-k-mooney | you have to do somehting like this i think | 15:53 |
| sean-k-mooney | cat <<EOF>> /etc/cinder/cinder.conf | 15:53 |
| sean-k-mooney | [ceph] | 15:54 |
| sean-k-mooney | volume_driver = cinder.volume.drivers.rbd.RBDDriver | 15:54 |
| sean-k-mooney | volume_backend_name=ceph | 15:54 |
| sean-k-mooney | rbd_pool = volumes | 15:54 |
| sean-k-mooney | rbd_ceph_conf = /etc/ceph/ceph.conf | 15:54 |
| sean-k-mooney | rbd_flatten_volume_from_snapshot = false | 15:54 |
| sean-k-mooney | rbd_max_clone_depth = 5 | 15:54 |
| sean-k-mooney | rbd_store_chunk_size = 4 | 15:54 |
| sean-k-mooney | rados_connect_timeout = -1 | 15:54 |
| sean-k-mooney | glance_api_version = 2 | 15:54 |
| sean-k-mooney | rbd_user =cinder | 15:54 |
| sean-k-mooney | rbd_secret_uuid = `cat /root/uuid` | 15:54 |
| sean-k-mooney | EOF | 15:54 |
| mloza | sean-k-mooney: does nova look up ceph.conf when attaching a volume? | 15:54 |
| sean-k-mooney | 17. Restart the Cinder services. | 15:54 |
| sean-k-mooney | no | 15:54 |
| sean-k-mooney | we only use the info passed form cinder in the attachment connection info | 15:54 |
| sean-k-mooney | which will incudle the rbd_secret_uuid | 15:55 |
| sean-k-mooney | which is used to retirve the keyring form the libvirt secrte | 15:55 |
| sean-k-mooney | mloza: the cinder folks might be able to help more | 15:56 |
| sean-k-mooney | i know this is definetly possible | 15:56 |
| sean-k-mooney | i jsut dont have the docs to hand | 15:56 |
| sean-k-mooney | but other have done this | 15:56 |
| sean-k-mooney | actully https://medium.com/walmartglobaltech/deploying-cinder-with-multiple-ceph-cluster-backends-2cd90d64b10 might be what i was looking for | 15:57 |
| sean-k-mooney | ya that explains the addtion of the second secret and the cinder config | 15:57 |
| sean-k-mooney | """Create the appropriate cinder user on your new Ceph cluster. The username must be different from the existing Ceph cluster cinder username""" | 15:58 |
| mloza | i stumbled upon that blog yesterday | 16:00 |
| mloza | looks like the second secret must be unique | 16:00 |
| mloza | this is how my cinder.conf looks like https://paste.opendev.org/raw/809414/ | 16:00 |
| mloza | these are what inside the libvirt/secrets | 16:01 |
| mloza | (nova-libvirt)[root@compute33 secrets]# pwd | 16:01 |
| mloza | /etc/libvirt/secrets | 16:01 |
| mloza | (nova-libvirt)[root@compute33 secrets]# ls -al | 16:01 |
| mloza | total 16 | 16:01 |
| mloza | drw------- 2 root root 204 Sep 17 15:20 . | 16:01 |
| mloza | drwxr-xr-x 1 root root 75 Sep 17 15:20 .. | 16:01 |
| mloza | -rw------- 1 root root 40 Sep 17 15:20 1d5b8192-6acf-4f06-8c60-1eb7ecbfe911.base64 | 16:01 |
| mloza | -rw------- 1 root root 170 Sep 17 15:20 1d5b8192-6acf-4f06-8c60-1eb7ecbfe911.xml | 16:01 |
| mloza | -rw------- 1 root root 40 Sep 17 15:20 c5730348-ff66-4491-8973-9a31317eaf00.base64 | 16:02 |
| mloza | -rw------- 1 root root 168 Sep 17 15:20 c5730348-ff66-4491-8973-9a31317eaf00.xml | 16:02 |
| mloza | (nova-libvirt)[root@compute33 secrets]# | 16:02 |
| sean-k-mooney | ya so your using the same user for both | 16:02 |
| sean-k-mooney | so i think you need a different user and a diffent secret for each | 16:02 |
| mloza | I guess the same user can stay. I'll try with a different secret | 16:04 |
| mloza | thx for the info | 16:04 |
| lyarwood | ade_lee: https://paste.opendev.org/show/809415/ - looks like libvirtd was super slow plugging the device for some reason | 16:35 |
| lyarwood | assuming that's the request that octavia failed on | 16:36 |
| * lyarwood checks | 16:36 | |
| ade_lee | lyarwood, thanks - lets see if it recurs | 16:41 |
| lyarwood | ade_lee: ack, no idea how to trace the nova requests from octavia fwiw | 16:42 |
| johnsom | lyarwood https://zuul.opendev.org/t/openstack/build/af88c0d00ebb48509a51f6eb941c65c6/log/logs/undercloud/var/log/containers/octavia/worker.log#6865 | 16:45 |
| johnsom | http://192.168.24.3:8774/v2.1/servers/52249295-f031-4f53-b403-86577a6a6e01/os-interface | 16:45 |
| johnsom | {"interfaceAttachment": {"port_id": "47a2114d-ae49-4928-b00e-87948bd73183"}} | 16:45 |
| lyarwood | ah ha | 16:45 |
| lyarwood | odd that it didn't log the request-id | 16:46 |
| johnsom | Yeah, I was puzzled too until I saw it was the tripleo haproxy process that responded with the 504 | 16:47 |
| johnsom | https://zuul.opendev.org/t/openstack/build/af88c0d00ebb48509a51f6eb941c65c6/log/logs/undercloud/var/log/containers/haproxy/haproxy.log#1276 | 16:47 |
| opendevreview | Dan Smith proposed openstack/nova master: DNM: Test glance multistore default https://review.opendev.org/c/openstack/nova/+/809883 | 17:33 |
| mloza | sean-k-mooney: i defined a different ceph user and secret for second cluster however, but i'm getting the same error https://paste.opendev.org/raw/809420/ | 19:50 |
| mloza | is rbd_secret_uuid in [libvirt] for nova.conf supports multiple uuids? | 20:02 |
| opendevreview | melanie witt proposed openstack/nova master: Add legacy limits and usage to placement unified limits https://review.opendev.org/c/openstack/nova/+/713498 | 20:59 |
| opendevreview | melanie witt proposed openstack/nova master: Update quota apis with keystone limits and usage https://review.opendev.org/c/openstack/nova/+/713499 | 20:59 |
| opendevreview | melanie witt proposed openstack/nova master: Add reno for unified limits https://review.opendev.org/c/openstack/nova/+/715271 | 20:59 |
| opendevreview | melanie witt proposed openstack/nova master: WIP Enable unified limits in the nova-next job https://review.opendev.org/c/openstack/nova/+/789963 | 21:08 |
| *** tbachman is now known as Guest172 | 21:11 | |
| opendevreview | melanie witt proposed openstack/nova master: WIP Enable unified limits in the nova-next job https://review.opendev.org/c/openstack/nova/+/789963 | 23:36 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!