Monday, 2025-04-14

noonedeadpunkgood morning07:10
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add ability to decompress images for upload  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/94691807:26
jrossero/ good morning07:47
opendevreviewMerged openstack/openstack-ansible master: docs: minor fixes with OpenStack-Ansible naming  https://review.opendev.org/c/openstack/openstack-ansible/+/94703907:59
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add ability to decompress images for upload  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/94691810:03
opendevreviewMerged openstack/openstack-ansible master: docs: fix for small error  https://review.opendev.org/c/openstack/openstack-ansible/+/94705510:18
derekokeeffeMorning all, I was away Friday so couldn't get on. The third playbook finished Thursday evening but had one error (not sure if it's significant as it didn't fail) https://paste.openstack.org/show/bUlfiIJY0Dog7rGZVnyP/10:34
derekokeeffeI now have a horizon dashboard but when I log in I get "Something went wrong!10:34
derekokeeffeAn unexpected error has occurred. Try refreshing the page. If that doesn't help, contact your local administrator."10:34
derekokeeffelosg that I think are relevant https://paste.openstack.org/show/bE3nsp0JfTSF4LZDPgl9/ & https://paste.openstack.org/show/bE3nsp0JfTSF4LZDPgl9/ if anyone has a minute to take a look please10:35
derekokeeffeOh!! CLI openstack commands work from the utility container, get users, projects etc..10:37
f0othen it might be a horizon issue10:47
derekokeeffeYep that's what I'm thinking just not sure what to do about it. I really don't want to mess anything up after getting this far10:48
f0odo you have the horizon logs somewhere?10:51
f0ocould be as simple as the wrong interface type (internal|public)10:51
derekokeeffeThat's the logs from the horizon container f0o11:07
derekokeeffehttps://paste.openstack.org/show/bE3nsp0JfTSF4LZDPgl9/11:07
f0othat's keystone11:07
noonedeadpunkyeah, it's not horizon11:07
noonedeadpunkhttps://paste.openstack.org/show/bUlfiIJY0Dog7rGZVnyP/ -> is significant for Gnocchi for sure11:08
derekokeeffeSorry that's weird that brings me to keystone too even though it's not them. I'll create a new paste11:08
derekokeeffeSorry j0o that should be them now https://paste.openstack.org/show/b26EcEoGQDPJJZ3Ftlco/11:10
derekokeeffenoonedeadpunk so I need to go back and run another playbook to try fix that issue?11:10
f0o> Login successful for user "admin" using domain "Default", - Well at least Horizon can talk to keystone hah. No idea what the stacktrace is but my guess is that's the problem xD11:11
derekokeeffeYep those two lines made me feel happy for a nanosecond :)11:12
f0owell it cascades down to Neutron, so this could be a neutron issue11:12
derekokeeffedidn't spot that!!11:13
f0otry browsing to /project/api_access/ on horizon11:13
f0o(after login)11:14
derekokeeffeWill do11:14
f0oit should return the list of endpoints the way horizon sees them (`openstack endpoint list` is afaik the cli variant)11:14
noonedeadpunkit seems that neutron is not working11:17
derekokeeffeNow the browser is just giving me a "503 service unavailable"11:17
derekokeeffeThis is from neutron https://paste.openstack.org/show/b7sQoVZEprUJyuXH5TVH/11:17
noonedeadpunkwell :)11:17
noonedeadpunkI'm not sure what intended driver to use is11:18
noonedeadpunkbut smth is off for sure11:18
noonedeadpunkBut horizon fails due to neutron being down11:18
derekokeeffeThat's not something I specified in my config (or at least should I have?)11:19
noonedeadpunkit should go with ovn by default then11:19
noonedeadpunkif everything worked as expected11:19
derekokeeffeSo it just didn't install the driver? Should I run the neutron playbook?11:20
noonedeadpunkmight be...11:20
noonedeadpunkor can be smth off with inventory11:20
noonedeadpunkso that it didn't detect things correctly11:21
derekokeeffeSorry I'm wrong, I used the same user_variables from an older successful deploy and it has this line neutron_plugin_type: ml2.ovs (is that the cause of the issue?)11:23
noonedeadpunkum, can be...11:25
noonedeadpunkso it really depends11:25
derekokeeffeRemove/change that and run neutron playbook again?11:26
darkhackernchi team, any quick way to redeploy the osa-caracal version, test bed (virtual) deployed with 1 contrlloer and 1 compute I want to redeploy this without deleting the VM, how I can 11:46
darkhackerncsuggest please11:46
noonedeadpunkrun an aio scenario?11:48
noonedeadpunkwithout deleting VM... um11:49
noonedeadpunkI guess you need explain a bit more what you imply under re-deployment11:49
darkhackerncnoonedeadpunk, so I want to redeploy the testbed , testbed infra deployed on the KVM VM's, somehow I messed up the environemnt, I want to redeploy it completely but dont want to delete the infra vm, I am thinking to remove the /openstack and inventry file 12:14
darkhackerncalso ansible 12:14
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-haproxy_server master: Add custom errorfiles  https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/94661712:17
darkhackerncnoonedeadpunk, basically uninstall 12:18
noonedeadpunkwell, I'm not sure you can fully un-install12:20
noonedeadpunkI can suggest some things, like dropping containers (if they were used)12:20
noonedeadpunkbut then complete "undo what you did" is kinda not what ansible is good at12:21
NeilHanlonyeah... i usually just fully redeploy my test infras using Terraform12:23
noonedeadpunk++12:25
darkhackernc1NeilHanlon, thanks, possible to share the terraform templates?12:26
darkhackernc1noonedeadpunk, yeah that is what I want, complete undo 12:26
NeilHanlondarkhackernc1: i really need to update this.. but https://git.shrug.pw/linuxadminbooks/AdvancedLinuxAdmin12:58
NeilHanlonanother option, if your provider supports it, would be snapshots12:58
NeilHanloninstall the vm, get it setup and ready... then snapshot. **then** run OSA deploy, and if you need to re-set, you can revert to those snapshots 12:59
noonedeadpunk++12:59
darkhackernc1NeilHanlon, yeah, I was about to manage the same way the provider is KVM 13:01
darkhackernc1but this time I missed, due to laptop crashed, I lost all my automations13:01
darkhackernc1NeilHanlon++ Thanks for sharing this. 13:01
noonedeadpunkdarkhackernc1: I don't lknow if it works today or not, but we also had this: https://opendev.org/openstack/openstack-ansible-ops/src/branch/master/multi-node-aio13:03
darkhackernc1noonedeadpunk, humn, let me check13:04
darkhackernc1Bjoern Teipel - Rackspace, I worked with him 13:04
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: Replace LXB check with OVS  https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/94711913:35
opendevreviewMerged openstack/openstack-ansible-rabbitmq_server master: Fail with human-readable errors if upgrade impossible  https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/94623214:05
opendevreviewMerged openstack/openstack-ansible master: Optimize generation of required roles/collections  https://review.opendev.org/c/openstack/openstack-ansible/+/93922114:38
opendevreviewMerged openstack/openstack-ansible master: Use FQCN for modules and fix YAML issues  https://review.opendev.org/c/openstack/openstack-ansible/+/94604215:02
opendevreviewMerged openstack/openstack-ansible master: [doc] Update 2023.1 maintenance state  https://review.opendev.org/c/openstack/openstack-ansible/+/94697515:02
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Maximize amount of ANSIBLE_FORKS for CI  https://review.opendev.org/c/openstack/openstack-ansible/+/94712815:02
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Maximize amount of ANSIBLE_FORKS for CI  https://review.opendev.org/c/openstack/openstack-ansible/+/94712815:03
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_mount master: Replace a shell with a command  https://review.opendev.org/c/openstack/ansible-role-systemd_mount/+/94712915:26
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_mount master: Replace block/rescue with ignore_errors/register  https://review.opendev.org/c/openstack/ansible-role-systemd_mount/+/94713115:36
f0onoonedeadpunk: got any idea why all other swift changes are now in conflict? it feels like I'm submitting my patches wrong because these are very simple additive changes that shouldnt conflict with eachother15:46
f0omaybe I'm just using gerrit wrong15:46
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-os_swift master: Remove md5 checks of rings/builders  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94702115:47
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-os_swift master: swift-object-expirer is its own distro package  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94704815:47
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-os_swift master: Remove seemingly unsused mlocate cronjob  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94705015:47
noonedeadpunkyou didn't rebased in on the actual patch, but they were based on the one, which was already merged15:48
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-os_swift master: Migrate role to SSHCA  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94698815:48
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-os_swift master: Migrate ring distribution to SSHCA  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94699015:48
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-os_swift master: Remove md5 checks of rings/builders  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94702115:48
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-os_swift master: swift-object-expirer is its own distro package  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94704815:48
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-os_swift master: Remove seemingly unsused mlocate cronjob  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94705015:48
f0omaybe it's because of the relation chain15:48
noonedeadpunkwell, yeah, but I fixed it. and you fixed it as well :)15:49
f0ooh15:49
f0ooops15:49
f0ostill new to this relation chain thing15:49
noonedeadpunkso basically because chain should be updated if some patch beneath is updated15:49
noonedeadpunkyou moved patch out of the chain, but did not update ones depending on it15:49
f0ooh15:49
f0oI thought I did15:50
noonedeadpunkas they now depend on a different one eventually15:50
f0omakes sense15:50
f0oI guess its just a matter of using gerrit more to get a hang of those nuances15:51
noonedeadpunkyup15:51
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_swift master: Migrate ring distribution to SSHCA  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94699015:53
noonedeadpunkas technically - they're based not on patches - but on a specific patchset15:53
noonedeadpunkso if you check the state after I pushed the updated - they will show "(Indirect relation)"15:54
f0ospeaking of 990; how do we proceed with the trusted_ca update that this seems to require?15:54
noonedeadpunkSo they will be tested together, except on different code15:54
noonedeadpunkfrankly - I think that doing some kind of re-ordering in swift should do the trick15:55
noonedeadpunkie https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/946990/5..615:55
f0ofingers crossed15:56
noonedeadpunkas we should be able to setup ssh keys as soon as swift user is created, but no services are yet installed15:56
f0othat's true15:56
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-os_swift master: Remove md5 checks of rings/builders  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94702115:56
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-os_swift master: swift-object-expirer is its own distro package  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94704815:56
f0oopendevreview seems a bit delayed15:56
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-os_swift master: Remove seemingly unsused mlocate cronjob  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94705015:57
f0oI'm drinking coffee far away from git15:57
f0o:D15:57
noonedeadpunkis it?15:57
noonedeadpunkyeah, it's confused a bit'15:57
noonedeadpunk`Dmitriy Rabotyagov Patch Set 5 was rebased on behalf of Daniel Preussker`15:57
f0oso what's the reviewer policy on this now? you and me are both authors and we shouldnt pat our own shoulders right? :D15:59
noonedeadpunkweeeeeeeeelll16:00
NeilHanlon😂16:01
f0ohehe, just teasing16:01
noonedeadpunkwe kind of ignore small patches made and allow to still review the code if this happens16:02
noonedeadpunkas gerrit itself doesn't apply any restrictions with this regard16:02
noonedeadpunkand we're low on core reviewers16:02
noonedeadpunkwhile still trying to maintain org diversity for landing new features16:03
f0othats convenivent; previously in similar situations I've had to alter the merge conditions on github to allow admins to bypass checks for these to go through16:03
NeilHanlonfwiw noonedeadpunk I am trying to convince some coworkers to get involved16:04
f0okinda pandoras box when you start making those changes "the norm"16:04
noonedeadpunkI think you can configure it such way, but currently it's an "administrative" way only16:04
noonedeadpunkNeilHanlon: that would be extremely sweet for sure16:04
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Unfreeze roles after milestone release  https://review.opendev.org/c/openstack/openstack-ansible/+/94628116:14
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_magnum master: Use libxslt1-dev package instead of unversioned one  https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/94656016:15
f0onoonedeadpunk: how do I remove https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/947050 from the chain so that it wont cause conflicts again?16:36
f0olast time I used the web rebase `Rebase on top of the master branch (breaks relation chain)`16:37
noonedeadpunkjust rebase on master16:37
noonedeadpunkyeah, that's fine16:37
opendevreviewDaniel Preussker proposed openstack/openstack-ansible-os_swift master: Remove seemingly unsused mlocate cronjob  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/94705016:37
f0oanything else I need to do?16:37
noonedeadpunkI guess not16:38
f0othen I dont know why I had those conflicts. this is what I did before too16:38
f0ohrm16:38
noonedeadpunkso you moved the one in the center16:38
f0oyeah but I rebased the followup commits onto the previous one removing it from the graph16:38
noonedeadpunkthen all which were dependant on it needed to be rebased to 94698816:39
noonedeadpunkwell there were not when I looked at gerrit16:39
f0ooh16:39
f0oguess thats where I messed up16:39
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cinder master: Add EPEL repo for distro-based installs  https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/94714217:08
opendevreviewMerged openstack/openstack-ansible-haproxy_server master: Add custom errorfiles  https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/94661717:54
f0othanks for the merge :)18:07
f0ois there any guess which release will have this? just so I know when I need to revert my local changes to the deployhost18:08
f0onoonedeadpunk: https://zuul.opendev.org/t/openstack/build/76e7e9aa345c490196eab904bb705282 your moving around failed in the same spot; trying to restart services that dont yet exist18:15
f0obut18:16
f0oit did regenerate them correctly18:16
f0oso something about rocky is funky18:16
f0obut anyway I'm going to abandon my keypairs change since this changeset does seem to work; rocky issues excluded18:17
f0owill have some time tomorrow after lunch to spin up a rocky to play with18:18
*** jotik is now known as Guest1366018:23
*** jotik^^ is now known as jotik18:23
NeilHanlonf0o: that rocky error could be some differences in the default ssh configs on Rocky vs deb-based18:36

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!