Friday, 2022-11-18

opendevreviewMatthew Thode proposed openstack/openstack-ansible-os_ceilometer master: remove loadbalancer from installed definitions  https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/86496202:31
opendevreviewMatthew Thode proposed openstack/openstack-ansible-os_aodh master: Install git into aodh containers  https://review.opendev.org/c/openstack/openstack-ansible-os_aodh/+/86496602:49
prometheanfireI think that octavia is failing in master due to https://storyboard.openstack.org/#!/story/201009904:04
prometheanfiretracked in https://review.opendev.org/864553 heh04:04
*** akahat|ruck is now known as akahat04:12
*** ysandeep|out is now known as ysandeep|ruck05:00
*** ysandeep|ruck is now known as ysandeep|ruck|afk10:22
*** ysandeep|ruck|afk is now known as ysandeep|ruck10:45
noonedeadpunkUgh, SSL and Java - tons of fun10:52
noonedeadpunkall these keystores/truststores10:54
noonedeadpunkI can even hardly read docs on how to set it up or what it does want to work...11:03
noonedeadpunkhttps://zookeeper.apache.org/doc/r3.5.5/zookeeperAdmin.html#Quorum+TLS11:04
noonedeadpunkWhy in the world they generate cert with keytool.... ugh11:04
noonedeadpunkmost confusing, that you can set zookeeper.ssl.keystore.type = PEM11:05
noonedeadpunkI bet it doesn't mean you can just place PEM files and provide path to it....11:08
noonedeadpunkI think you still need to import them11:09
noonedeadpunkbut then why you need to define path if they're imported 11:12
noonedeadpunk(╯°□°)╯︵ ɐʌɐᒋ11:12
noonedeadpunkDocs like https://support.ptc.com/help/thingworx/platform/r9/en/index.html#page/ThingWorx/Help/ThingWorxHighAvailability/configuringssltlsforzookeeper.html doesn't say anything about import though11:13
noonedeadpunkTHough they use safe certs for cluster and for clients from what I can tell11:14
noonedeadpunks/safe/same11:14
*** dviroel|out is now known as dviroel11:21
dok53HI all, I have set up cinder with quobyte and can create, delete and snapshot volumes no problem. However when I try to attach them I get an error in the horizon dashboard as seen here with logs. https://paste.openstack.org/show/bL2coOmPxbxFMuEmwtDj/ I also can't see my default_volume_type in the dropdown when creating a volumt (config line also in the paste) The logs don't tell me anything so any pointers where to look or what might be causing it?12:30
*** frenzy_friday is now known as frenzy_friday|lunch12:31
fricklernoonedeadpunk: opendev sets up zookeeper with ssl for zuul, not sure how much that helps you, but maybe worth a look https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/zookeeper12:33
noonedeadpunkfrickler: that is helpful12:34
noonedeadpunkwill need to check what's you put inside keystore/trustore12:35
fricklerthat should be essentially https://opendev.org/zuul/zuul/src/branch/master/tools/zk-ca.sh12:36
fricklerand then this setup for the zk container https://opendev.org/zuul/zuul/src/branch/master/tools/docker-compose.yaml#L27-L4112:39
fricklerand the matching zoo.cfg https://opendev.org/zuul/zuul/src/branch/master/tools/zoo.cfg12:40
fricklerthe latter links are for the zuul testing environment, which might be a bit simpler than the production setup, though12:41
fricklerfeel free to ask in #opendev if you need more info, I also only deployed this in a local install without really understanding all the bits and pieces12:42
*** ysandeep|ruck is now known as ysandeep|ruck|afk12:46
*** dviroel_ is now known as dviroel12:57
noonedeadpunkfrickler: yeah, zk-ca is what I was looking for:) seems you indeed don't use any keytool -importcert13:06
noonedeadpunkbut reading openssl commands is way better then keytool :D13:08
noonedeadpunkso truststore is simply CA cert and keystore is cert/private key13:10
noonedeadpunkwhich is everything I needed to know :)13:10
fricklercool, glad it was useful13:24
*** ysandeep|ruck|afk is now known as ysandeep|ruck13:30
*** frenzy_friday|lunch is now known as frenzy_friday13:32
noonedeadpunkXneWv963!rg91w13:56
noonedeadpunkwell.... need to rotate some passwords...13:57
*** ysandeep|ruck is now known as ysandeep|out14:42
mgariepyat least it wasn't password123415:06
*** dviroel is now known as dviroel|lunch15:07
MouaaHi guys, I'm working for a client for upgrading his openstack platform which is based on Ubuntu 18.04 and openstack-ansible in train version, all in distro install method... Initialized at the time in stein, it seemed simpler at the time for the people who set it up to start with a distro method. Since then, you have warned me here several times that the test coverage was minimal in distro + ubuntu mode...15:18
MouaaFacing difficulties in distro install method (python3 on 18.04 is limited to 3.6.9 and playbooks for upgrade reclaims min 3.8 for venv build utility containers, I mounted a DEV platform (openstack DEV over openstack PRODUCTION) in source mode to compare.15:18
MouaaIs it normal in source mode not to find a "repo" container on any controllers? In any case, no container contains a "/var/www/repo" directory.15:18
MouaaDid I miss something?15:18
MouaaSee: https://docs.openstack.org/openstack-ansible/victoria/admin/upgrades/distribution-upgrades.html15:18
noonedeadpunkMouaa: in source install repo containers are quite important15:38
noonedeadpunkthey're not needed for distro install15:38
noonedeadpunkMouaa: you can check for example on how to define it here https://opendev.org/openstack/openstack-ansible/src/branch/master/etc/openstack_deploy/openstack_user_config.yml.example#L328-L35115:39
noonedeadpunkthey should be explicitly stated in openstack_user_config15:39
MouaaI know, no repo on distro method...On my test platform in source method, no container repo, no container with /var/www/repo, surprising !15:40
Mouaaroot@osa-deployer-tlse:/opt/openstack-ansible# grep -i method /etc/openstack_deploy/user_variables.yml15:46
Mouaainstall_method: source15:46
MouaaNo group repo in inventory, no container repo on controllers, no conatainer who have /var/www/repo15:46
Mouaathe install doc say to define install_method in user_variables.yml15:50
Mouaahttps://docs.openstack.org/project-deploy-guide/openstack-ansible/train/configure.html15:50
MouaaIt therefore seems mandatory to define the hosts of the repository in the inventory in the source method... My error seems to be found! Thanks15:54
jrosserMouaa: there are a bunch of example configs in this directory https://opendev.org/openstack/openstack-ansible/src/branch/master/etc/openstack_deploy/openstack_user_config.yml.example15:55
MouaaThe config yaml are inherited from a platform deployed in production since 4 years in distro mode, so they are valid.16:00
MouaaI took over these, just changed the install method to source, but in fact I didn't create any repo containers in the ansible inventories... This must be why I don't have a CT created repo16:00
jrosserthey must be defined in openstack_user_config16:03
jrosserlike this https://opendev.org/openstack/openstack-ansible/src/branch/master/etc/openstack_deploy/openstack_user_config.yml.example#L342-L35016:03
MouaaOK, but documentation said in v train to put it in user var16:04
Mouaafor the method install param16:05
jrosseryes, install_method goes in user varliables16:05
jrosserthe IP of the repo hosts must go in openstack_user_config16:05
jrosseryou need both16:05
Mouaaok thank you16:05
*** dviroel|lunch is now known as dviroel16:16
nixbuilderDoes anyone know where to set the cinder timeouts for volume creation?  I have tried the 'block_device_creation_timeout=300' in nova.conf, but I am still getting the error "Build of instance a84c1741-a443-4d4f-a754-fe92c418caec aborted: Volume 01d84acf-3671-4628-8e63-ddba43692e09 did not finish being created even after we waited 21 seconds or 8 attempts. And its status is error.: nova.exception.BuildAbortException: Build of in16:26
nixbuilderstance a84c1741-a443-4d4f-a754-fe92c418caec aborted: Volume 01d84acf-3671-4628-8e63-ddba43692e09 did not finish being created even after we waited 21 seconds or 8 attempts. And its status is error."  Where does the 20 seconds variable get set?16:26
prometheanfirelooks like external ceph isn't working with rocky-9, it calls ceph-client role which tries to install a gpg file that doesn't exist16:45
noonedeadpunknixbuilder: I think you need both to expand nova timeout and in cinder as well from what I can recall16:58
noonedeadpunkI can recall I was doing that but can't find that variable in cinder for some reason....17:01
noonedeadpunkMaybe I'm wrong and I've adjusted only nova....17:01
noonedeadpunkHm....17:01
noonedeadpunkprometheanfire: try setting `ceph_pkg_source: distro`17:02
noonedeadpunkBut I think we need to patch ceph role actually...17:02
nixbuildernoonedeadpunk: Thanks... I will check in cinder.17:03
noonedeadpunkprometheanfire: but isn't ansible_facts['distribution_major_version'] != 9?17:03
noonedeadpunkfor rocky?17:03
noonedeadpunknixbuilder: btw nova should have not only timeout, but also number of attempts17:04
noonedeadpunknixbuilder: btw I don't see such thing as block_device_creation_timeout in nova17:05
noonedeadpunkthere're block_device_allocate_retries_interval and block_device_allocate_retries17:06
damiandabrowskiregarding tls for haproxy backends. Is it even possible to secure glance API with TLS when uWSGI is not used?17:28
damiandabrowskiI can't find anything about it in docs17:28
nixbuildernoonedeadpunk: Thanks... I am finding out that, for some reason, I am getting the error 'Requested image 7ac8cef3-37d4-4882-b117-9d2ddcf80ed9 is not in raw format.' That particular image is the cirros image that has always worked on our Pike cloud but now does not seem to work in the Yoga cloud.  I am changing the format to raw and see what happens.17:34
nixbuildernoonedeadpunk: Changing the image to raw got rid of the error, but did not get rid of the problem with instance creation.  Got to dig in to this further I guess.  Thanks again for the help.17:42
prometheanfirenoonedeadpunk: ya, needed to add the ceph quincy package to the default container packages too17:46
*** dviroel is now known as dviroel|out20:13
damiandabrowskithere's one more thing: I think we may have broken gating for glance(and probably for cinder) due to openstack-ansible-deploy-aio_nfs-ubuntu-jammy job21:42
damiandabrowskithis job failed on 2 latest patches: https://review.opendev.org/q/project:openstack%252Fopenstack-ansible-os_glance21:43
damiandabrowskiworth looking into this next week21:43

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!