Tuesday, 2022-06-14

*** ysandeep|sick is now known as ysandeep04:37
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Change default mode while creating directories  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/82477406:13
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add support for role list  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/84569006:30
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: Support service tokens  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/82300906:34
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Use system-scope by default  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/83283706:54
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Disable service_token requirement by default  https://review.opendev.org/c/openstack/openstack-ansible/+/82300506:58
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: Support service tokens  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/82300907:02
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Disable service_token requirement by default  https://review.opendev.org/c/openstack/openstack-ansible/+/82300507:03
noonedeadpunkmornings07:03
jrosser_good morning07:13
noonedeadpunkhm... interesting, where does centos-release-gluster9 come from for 9 stream....07:23
noonedeadpunkas for some reason it's not installable on my image07:23
jrosser_it starts with needing this i think https://github.com/openstack/openstack-ansible-plugins/blob/master/roles/glusterfs/vars/centos-9.yml#L16-L1707:26
noonedeadpunkand exactly this package fails to be isntalled07:26
noonedeadpunkok. it appeared after dnf update....07:27
noonedeadpunkso disregard07:27
opendevreviewMerged openstack/ansible-config_template master: Remove orphaned releasenotes  https://review.opendev.org/c/openstack/ansible-config_template/+/84560907:27
jrosser_missing from here though i'm not sure how much i trust it https://pkgs.org/search/?q=centos-release-gluster907:28
noonedeadpunkIt's coming from extras-common fwiw07:29
noonedeadpunkhttps://mirrors.centos.org/metalink?repo=centos-extras-sig-extras-common-$stream&arch=$basearch&protocol=https,http07:29
noonedeadpunkAnd I bet smth brought in this repo with some other package update07:30
jrosser_i think i have a very old c9s image here which behaves oddly until i dnf update07:31
noonedeadpunkyeah, same here07:32
noonedeadpunkI'm likely not used that package update brings in new repos....07:33
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Install LXC from EPEL for CentOS Stream 9  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/84569307:33
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Do not install COPR repo for CentOS LXC  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/84367207:37
*** ysandeep is now known as ysandeep|lunch07:45
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add support for role list  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/84569008:03
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Use system-scope by default  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/83283708:04
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-config_template master: Release config-template to 1.3.0  https://review.opendev.org/c/openstack/ansible-config_template/+/84569908:08
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add support for role list  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/84569008:45
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Use system-scope by default  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/83283708:45
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_placement master: Support service tokens  https://review.opendev.org/c/openstack/openstack-ansible-os_placement/+/84570808:58
*** ysandeep|lunch is now known as ysandeep09:14
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cinder master: Forcefully remove Cinder v2 endpoints  https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/84571409:16
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cinder master: Support service tokens  https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/84571709:30
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Disable service_token requirement by default  https://review.opendev.org/c/openstack/openstack-ansible/+/82300509:32
MouaaHi guys. On a mission for an upgrade of ubuntu nodes 18.04 to 20.04 + train openstack upgrade to at least wallaby for a customer, I begin to understand difficulties due to the fact of the distro installation method (few tests, documentation, ... )09:57
MouaaIf I understood correctly, the only solution to switch from the distro to source method is to reinstall everything. I imagine that involves backing up everything. Is there a doc/procedure for this?09:58
jrosser_Mouaa: i expect that you could do it without a complete re-install10:12
jrosser_you are might be going to re-install the nodes from 18.04 to 20.04 anyway10:13
Mouaajrosser_ Indeed, We are obliged to upgrade the ubuntu nodes. But i we want to swap to source method, there isn't documentation/procedure for this? I imagine that the sequencing must be very precise 10:17
jrosser_the documentation is kind of clear on this "The install_method variable is set during the initial deployment and you must not change it as OpenStack-Ansible is not able to convert itself from one installation method to the other"10:18
jrosser_but really what that means is that there is no support in the tool itself for switching between distro and source10:19
jrosser_you could test this out pretty easily in an all-in-one, buy deploying as distro method, then trying to work through in sequence and destroy/recreate the LXC containers as source installations by using variable overrides10:20
jrosser_for example keystone there is a variable here https://github.com/openstack/openstack-ansible-os_keystone/blob/stable/train/defaults/main.yml#L3110:21
jrosser_and you will notice that for the train branch that is always set to "source", so i imagine you are already running keystone installed from source anyway10:22
Mouaa<jrosser_> Thanks for the clarification10:38
jrosser_there should be variables like that in all the role defaults10:39
noonedeadpunkTbh I think for controllers conversion it would be easy10:39
noonedeadpunkAs you can just destroy container and re-create it with source method10:39
jrosser_yes, its really not much more than that is it10:39
noonedeadpunkmore tricky for computes/net nodes though10:40
noonedeadpunkas there you might need to drop packages manually10:40
noonedeadpunkbut again - if you upgrade and re-install OS, it shouldn't be too tricky10:40
jrosser_if you empty out computes one by one and re-install them that should be OK as well10:40
jrosser_noonedeadpunk: we made an error in here btw https://docs.openstack.org/openstack-ansible/latest/en_GB/admin/upgrades/compatibility-matrix.html10:42
noonedeadpunkUh, suse10:43
jrosser_debian 9 stream :)10:43
noonedeadpunkyeah...10:43
noonedeadpunkMy bad10:43
noonedeadpunkWill push a fix for that10:43
noonedeadpunkI should have checked result in artifacts though...10:44
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add support for role list  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/84569010:58
*** dviroel|out is now known as dviroel11:22
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Fix compatability matrix layout  https://review.opendev.org/c/openstack/openstack-ansible/+/84573111:32
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Use system-scope by default  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/83283712:00
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add support for role list  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/84569012:01
*** ysandeep is now known as ysandeep|afk12:15
*** ysandeep|afk is now known as ysandeep12:30
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Remove usage of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible/+/84573912:33
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Explicitly use collection for haproxy module  https://review.opendev.org/c/openstack/openstack-ansible/+/84574012:35
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/84574112:42
mgariepyhttps://b6fb961759099b9433ee-f8d3aa66ce3962c6e3c5c35044bdfdd4.ssl.cf2.rackcdn.com/845731/1/check/openstack-tox-docs/21c5e22/docs/en_GB/admin/upgrades/compatibility-matrix.html12:42
mgariepyit's missing a couple TD there i think12:43
noonedeadpunkyeah...12:46
mgariepyi wonder if using table in MD would be easier to maintains.12:46
noonedeadpunkI can recall I couldn't implement smth in md....12:49
noonedeadpunkmaybe smth like coloring12:49
mgariepylet me test something quickly.12:51
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Fix compatability matrix layout  https://review.opendev.org/c/openstack/openstack-ansible/+/84573112:54
noonedeadpunkit was smth like readable vs maintainable tradeoff12:54
mgariepyhttps://sublime-and-sphinx-guide.readthedocs.io/en/latest/tables.html#csv-files12:54
mgariepyi would be nice to be able to just mimic the tables in other format.12:55
noonedeadpunkcan find how to merge cells there12:57
noonedeadpunkah, totally possible with grid layout...12:58
noonedeadpunkbut grid also pita to maintain kind of?12:59
mgariepyyep i guess so.12:59
mgariepyor we generate the file with a script ?13:00
noonedeadpunknope, just edit html manually13:01
noonedeadpunkwell it's not _that_ bad if use wysiwyg for html...13:02
noonedeadpunkAt least now looks not that bad https://815896f084e866f51698-f734581470945d848d2e1e75c1fa1768.ssl.cf1.rackcdn.com/845731/2/check/openstack-tox-docs/9500bd0/docs/admin/upgrades/compatibility-matrix.html13:15
mgariepyyep looks good indeed.13:17
mgariepymaybe we could just add comments in the html to help us a bit13:18
noonedeadpunkoh yes, I was thinking about comments as well just now13:18
mgariepyhaha would be easier to implement than to rewrite the stuff.13:19
mgariepyi'll patch it up.13:19
noonedeadpunkbut faced that not sure how to make them really helpfull...13:19
noonedeadpunkso yeah, if you have ideas - super welcome13:19
opendevreviewMarc Gariépy proposed openstack/openstack-ansible master: add comments to make editing the table clearer  https://review.opendev.org/c/openstack/openstack-ansible/+/84575813:43
mgariepyso what do you think ?13:46
mgariepythis way when we add support for rockylinux 9, we would be able to add the extra column with sed :) haha13:47
noonedeadpunkoh man. it's really good.13:47
mgariepylow tech ftw13:48
noonedeadpunkI also somehow broke Glance NFS test14:16
noonedeadpunklikely with https://opendev.org/openstack/openstack-ansible-os_glance/commit/887a59256eeba7a346b63d5c0db6d1f909d6b26c14:17
*** ysandeep is now known as ysandeep|out14:25
noonedeadpunkoh damn14:30
noonedeadpunkseems that default is trying to be compiled when it should not be14:30
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: Fix glance mounts compatability  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/84576714:36
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: Support service tokens  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/82300914:36
jrosser_oh yes that is kind of unfortunate14:40
noonedeadpunkyeah (14:40
jrosser_i've had similar before where it was good to define a task vars: with some stuff in it14:40
jrosser_and then use ternary, the task var is only evaluated f it actually gets used that way14:41
opendevreviewJesse Pretorius proposed openstack/ansible-config_template master: [WIP] Add more complete examples with sample output  https://review.opendev.org/c/openstack/ansible-config_template/+/84576814:41
jrosser_odyssey4me: if you are poking around config_template we were talking about how to support 'sysctl' style config files the other day14:42
odyssey4meo/ jrosser_ noonedeadpunk :) I noticed the docs for config_template are rather sparse... it doesn't sell too well. I thought I'd add some examples, which can hopefully be extended in the future.14:42
jrosser_like ini but no [sections]14:42
odyssey4mehrm, doesn't it already? I thought that was added for MariaDB at some point14:43
noonedeadpunknah, it wasn't at the end I believe14:43
noonedeadpunkas we parent template from Ansible that can not do that14:43
noonedeadpunkAnd I believe I finally need to publish config_template in galaxy as well...14:44
mgariepyjamesdenton, we need this one first :D https://review.opendev.org/c/openstack/openstack-ansible/+/845731/214:46
noonedeadpunkI also kind of fail to understand what;s wrong with nmap isntallation for ironic tempest role14:47
noonedeadpunkAs locally I didn't have any issue with installing it....14:47
jrosser_that for centos-9-s ?14:48
noonedeadpunkand 8-s14:48
noonedeadpunkhttps://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/831544 as example14:49
jrosser_maybe we shuld just recheck it14:51
jrosser_becasue we switched to the infra mirrors recently14:51
noonedeadpunkyeah, maybe..14:51
jrosser_though that doesnt explain 8 though.....14:51
noonedeadpunkhttps://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/844021/2 was rechecked more recently...14:51
noonedeadpunkbut there only 9 fails...14:52
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests  https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/83570914:52
jrosser_"Status code was -1 and not [200]: Request failed: <urlopen error [Errno -2] Name or service not known>", "redirected": false, "status": -1, "url": "https://opendev.org/openstack/rally-openstack/raw/branch/master/upper-constraints.txt"14:52
jrosser_thats different14:53
noonedeadpunkyeah, agree14:53
jrosser_i think i had some comment on your "dont run rally everywhere" patch14:53
noonedeadpunkI rebased yet another change that's super dummy to check14:53
noonedeadpunkah14:53
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/xena: Install rally only when rally_install is set  https://review.opendev.org/c/openstack/openstack-ansible/+/84568414:54
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/wallaby: Install rally only when rally_install is set  https://review.opendev.org/c/openstack/openstack-ansible/+/84568514:55
noonedeadpunkjrosser_: thanks for pingng14:56
jrosser_why did the ironic patch fail on getting rally u-c if we already merge the one to stop deploying it14:56
jrosser_oh oops `rally_install: yes` of course14:57
jrosser_yeah so for 840685 i think i didnt see it run tempest, but lets see what the new logs say14:59
noonedeadpunk Ithink you're right15:00
noonedeadpunkBut still loved to have logs to see why :)15:00
noonedeadpunk#startmeeting openstack_ansible_meeting15:00
opendevmeetMeeting started Tue Jun 14 15:00:57 2022 UTC and is due to finish in 60 minutes.  The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'openstack_ansible_meeting'15:00
noonedeadpunk#topic roll call15:01
noonedeadpunkI'm on meeting for next several mins just in case15:01
damiandabrowski[m]hey! I'm semi-available this week as we're dealing with major incident15:02
noonedeadpunk#topic office hours15:05
noonedeadpunkSo we need to release next week15:05
mgariepyhey /o15:05
noonedeadpunkBefore branching I think we might have at least 1 topic to cover15:06
noonedeadpunkwhich is https://review.opendev.org/q/topic:osa%252Fservice_tokens15:06
noonedeadpunkI think it should be passing now... And hopefully it does right thing..15:07
noonedeadpunkAnother thing I pushed is https://review.opendev.org/q/topic:osa%252Fmanage_lb which is basically clean-up15:08
admin1partly here \o 15:08
noonedeadpunkBut with that I wonder, if instead of just disabling haproxy backends, we should just set them to drain?15:09
noonedeadpunkWhould we great to set drain and then disable, but dunno how to do that...15:09
mgariepydraining connection from galera takes a long time.15:10
noonedeadpunkWell, it's equal to connection timeout I believe15:10
noonedeadpunkBut as we do before running role... It might be not that bad. And previously we were just disabling... 15:11
noonedeadpunkSo I guess that draining at least smth is better then just dropping at once?15:11
noonedeadpunkAnd also I'm thinking about rest of services, not only galera15:11
mgariepynot sure it does make a big difference.15:12
noonedeadpunkYeah, maybe you're right15:12
mgariepyfor galera the only used node is the first one anyway15:12
mgariepywhen it's drop, they switch to the second node. and when it comes back then the fallback.15:13
opendevreviewMerged openstack/openstack-ansible master: [doc] Fix compatability matrix layout  https://review.opendev.org/c/openstack/openstack-ansible/+/84573115:13
opendevreviewMerged openstack/openstack-ansible master: add comments to make editing the table clearer  https://review.opendev.org/c/openstack/openstack-ansible/+/84575815:13
noonedeadpunkwell, yeah...15:14
noonedeadpunkso should I update to disable to be consistent?15:15
jrosser_having that external role for only the galera playbook not so good, agree to remove that15:15
mgariepycurrenlty services tolerate db disconnect a lot better than they used to.15:16
noonedeadpunkI wish they did same for rabbit...15:17
noonedeadpunkanyway15:17
mgariepywell. or memcached 15:17
noonedeadpunkthe problem is that now galera backend will be disabled regardles if changes are required which kind of not neat15:18
noonedeadpunkso tried to be as tolerant as possible...15:18
noonedeadpunkbut for other services external role was keeping backend when it could be broken so...15:19
spatelsorry little late in meeting just trying to catching up with haproxy discussion, why do we need to drain connection? 15:24
spatelremove galera from haproxy? 15:25
noonedeadpunknah, it was more that when you run playbook, in advance you drain connection just in case 15:26
spateloh! we are using F5 so never looked at haproxy. but curious why need to drain them? what are we going to gain? 15:28
mgariepydrain will continue to send health-check.15:28
mgariepydisable won't i guess15:28
noonedeadpunkyup, that's mostly the difference15:29
spatelalso curious why are we not using conntrackd with keepalived/haproxy, it will keep all connection in sync between keepalived15:30
spatelwe are running conntrackd in production with keepalived and it works great15:30
mgariepybut. well it's for the whole galera backend do drain might recover faster ?15:31
noonedeadpunkAnother topic - during summit there was interest from different parties on reviving ceph-ansible. 15:36
noonedeadpunkThe main question is about governance of it afterwards15:36
noonedeadpunkhopefully, we can un-deprecate it given contributions to it.15:37
mgariepywho will be working on it?15:37
noonedeadpunkexcept us (and I hope BBC:)) interest was raisen by 23Tech and vexxhost. It's obviously won't be RedHat15:39
noonedeadpunkright now we're in stage of gathering other interested to contribute parties15:39
noonedeadpunkand we agreed to start doing more active steps in July15:40
mgariepyok nice then :)15:40
noonedeadpunkbut I really hope that repo can stay under their governance at least, as otherwise things can get messy...15:41
noonedeadpunkI believe JP reached them with some suggestions.15:41
noonedeadpunkBut will see were it all will end up15:42
mgariepyyeah obviously but if it works it would be awesome :D15:43
mgariepyas it kinda work really well in my limited experience with it.15:44
admin1i used it in a lot of clusters .. it works very well 15:44
mgariepyalso not a big fan of docker stuff..15:44
admin1too bad that its deprecated and there is no similar tool 15:44
noonedeadpunkyeah, it appeared there's more not docker fans 15:45
noonedeadpunkI have heard that cephadm can deploy on bare metal, but never researched that15:45
noonedeadpunk(and was pretty sure it can't15:45
admin1ceph-ansible does not use docker or any containers .. 15:46
admin1its on bare metal 15:46
admin1though you can also have it use containers 15:46
noonedeadpunkceph-ansible actually has support for docker15:46
noonedeadpunkyeah15:46
mgariepydid you had time to start asking nicely monty about 22.04 for lts mariadb ?15:52
noonedeadpunkuh, no, sorry. My first working day in 2 weeks today. And started from total internal crap...15:56
* noonedeadpunk goes now :P15:56
*** dviroel is now known as dviroel|lunch15:58
opendevreviewJesse Pretorius proposed openstack/ansible-config_template master: [WIP] Add more complete examples with sample output  https://review.opendev.org/c/openstack/ansible-config_template/+/84576815:58
admin1i am encountering a strange issue  .. may be nothing to do with OSA .. but since I only use OSA , asking here anyway .. I have ceph as object storage and   osa points to ceph ..   i can create buckets and  upload/download objects on it .. the issue is when I set a bucket to public, if I click the link, the link gives  NoSuckBucket15:59
admin1(https://cloud.domain.com:8080/swift/v1/AUTH_8022c6328c8949bda2ff928295240a6a/test)  -- test is the bucket name ..        configs here:  https://gist.githubusercontent.com/a1git/9f58a83cc142b85c2675d8b5678af009/raw/d1676fd8ec077fe34cbf379cd02a6aec7eeac046/gistfile1.txt   15:59
noonedeadpunkadmin1: there was totally a bug in Luminous or smth like that on rbd side16:00
noonedeadpunk*rgw16:00
noonedeadpunkSo basically for OSA Victoria16:00
admin1i am on pacific  16:01
noonedeadpunkThe only solution I was able to get is just upgrade Ceph....16:01
noonedeadpunkHuh16:01
admin1osa and ceph both were installed independently using osa and ceph-ansible 16:01
noonedeadpunkOn Pacific it worked nicely....16:01
admin1if anyone has the same setup, a quick copy/paste of the endpoint list and    maybe ceph.conf or rgw.conf might help ( ips and secrets removed ofcourse) 16:03
noonedeadpunkat glance config looks good16:11
noonedeadpunkI don't think though it would allow to list directories anyway... But not 100% sure16:12
noonedeadpunkyeah, it does....16:13
noonedeadpunkI have created https://jira.mariadb.org/browse/MDEV-28842 for CentOS. For ubuntu will be only with next release.16:28
noonedeadpunk#nedmeeting16:28
noonedeadpunk#endmeeting16:28
opendevmeetMeeting ended Tue Jun 14 16:28:12 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:28
opendevmeetMinutes:        https://meetings.opendev.org/meetings/openstack_ansible_meeting/2022/openstack_ansible_meeting.2022-06-14-15.00.html16:28
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/openstack_ansible_meeting/2022/openstack_ansible_meeting.2022-06-14-15.00.txt16:28
opendevmeetLog:            https://meetings.opendev.org/meetings/openstack_ansible_meeting/2022/openstack_ansible_meeting.2022-06-14-15.00.log.html16:28
jrosser_admin1: when you say "if I click the link" do you mean in horizon, or put the link in a browser, or wget maybe? which of these works/breaks?16:35
opendevreviewJesse Pretorius proposed openstack/ansible-config_template master: [WIP] Add more complete examples with sample output  https://review.opendev.org/c/openstack/ansible-config_template/+/84576816:40
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Bump ansible-core to 2.13.0  https://review.opendev.org/c/openstack/openstack-ansible/+/84238716:42
opendevreviewJesse Pretorius proposed openstack/ansible-config_template master: [WIP] Add more complete examples with sample output  https://review.opendev.org/c/openstack/ansible-config_template/+/84576816:49
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Create  containers for rally/tempest independently  https://review.opendev.org/c/openstack/openstack-ansible/+/84068517:05
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/84578717:08
admin1browser, curl,  wget -- same 17:09
admin1no such bucket 17:09
jrosser_hmm well it'a working here17:17
*** dviroel|lunch is now known as dviroel17:17
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-plugins master: Use shlex_quote from ansible module_utils rather than SSH plugin  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/84579217:40
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Bump ansible-core to 2.13.0  https://review.opendev.org/c/openstack/openstack-ansible/+/84238717:41
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/84579317:42
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cinder master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/84579417:46
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-uwsgi master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/ansible-role-uwsgi/+/84579517:49
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/84579617:50
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/84579617:51
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_placement master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_placement/+/84579717:52
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/84579817:53
jrosser_i fugure we are about to find which roles are broken for centos-9 / jammy17:54
noonedeadpunkwe are 17:56
noonedeadpunktomorrow I will push changes to all roles anyway...17:57
noonedeadpunkThe worst part is we lack time fixing them :(17:57
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_mistral master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_mistral/+/84580017:58
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_manila master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_manila/+/84580118:01
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_mistral master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_mistral/+/84580018:01
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/84579618:02
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_placement master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_placement/+/84579718:02
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cinder master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/84579418:02
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-uwsgi master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/ansible-role-uwsgi/+/84579518:02
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/84579818:03
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_murano master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_murano/+/84580218:05
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: Remove mention of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/84580318:06
noonedeadpunkSo, recently rebased Ironic failed with nmap as well https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/83570918:08
noonedeadpunkweird though is only ironic fails this way18:10
noonedeadpunkand we don't do anything weird in the role itself...18:12
mgariepydo you have a recheck ?18:21
mgariepymaybe it's only a timing issue on the infra mirror or something.18:21
noonedeadpunkThat's like 3-rd or 4rth issue. First one I saw on 4th of June18:30
noonedeadpunkok, first one nmap was on May 2018:31
noonedeadpunkand only for ironic18:31
mgariepyhmm. should we ask for a hold on this one then ?18:33
noonedeadpunkI'd say it's worth it... As I couldn't reproduce locally...18:34
noonedeadpunkAnd don't see what's wrong actually18:34
noonedeadpunkBut I need to head out now as it was terrible day/night...18:34
opendevreviewMarc Gariépy proposed openstack/openstack-ansible master: DNM nmap c9s test  https://review.opendev.org/c/openstack/openstack-ansible/+/84580418:35
mgariepysure no worries.18:35
mgariepyi'll try to dig a bit on it for nmap stuff 18:36
noonedeadpunkto have that said - we isntall nmap for all jobs, as it's part of tempest18:36
noonedeadpunkhttps://opendev.org/openstack/openstack-ansible-os_tempest/src/branch/master/vars/redhat-8.yml#L2118:37
mgariepyhmm what does ironic do then :/ 18:38
noonedeadpunkfrom what I see - nothing specific....18:39
mgariepyhmm ok18:39
noonedeadpunkWell, maybe things go south when deploying dnsmasq or smth....18:39
mgariepyi'll take a look see if i spot it.18:39
noonedeadpunkAnother thing I can suppose is that vars file for yum somehow becomes missing18:39
noonedeadpunkbut then all package isntallation would fail...18:39
noonedeadpunkAnd we somehow don't gather content of /etc/yum/18:40
noonedeadpunk(or there's nothing which would be weird...18:40
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Add tempest repos to required-repos  https://review.opendev.org/c/openstack/openstack-ansible/+/83428918:45
mgariepyreally look like the dnsmask is causing some issue.18:54
mgariepyhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_7d3/835709/3/check/openstack-ansible-deploy-aio_metal-centos-9-stream/7d3b557/logs/openstack/instance-info/host_dns_info_16-20-37.log.txt19:00
mgariepyhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_7d3/835709/3/check/openstack-ansible-deploy-aio_metal-centos-9-stream/7d3b557/logs/host/ironic-inspector-dnsmasq.service.journal-16-21-23.log.txt19:02
mgariepyhttps://zuul.opendev.org/t/openstack/build/7d3b55790eea4af085e3426df67c7dd7/log/logs/openstack/instance-info/host_networkd_status_16-20-37.log.txt#1019:04
mgariepyironic dnsmasq does give an ip, which swap the dns server/19:05
noonedeadpunkuh19:17
noonedeadpunkand yeah, changes to dnsmasq were landed recently19:17
mgariepywell the device shouldn't ask for an ip via dhcp i guess..19:18
jrosser_mgariepy: there’s a gateway via eth15 - is that right?19:24
mgariepywell it does go from carrier to routable once the ip i set via dnsmasq19:29
mgariepy72.29.228.1 on eth1519:31
mgariepyhttps://zuul.opendev.org/t/openstack/build/7d3b55790eea4af085e3426df67c7dd7/log/logs/openstack/instance-info/host_networkd_status_16-20-37.log.txt#2619:33
mgariepyjrosser_, i guess it's not supposed to happen.. but why does eth15 ask for an ip via dhcp ?19:34
mgariepyNetwork manager seems to be doing some desktopish stuff there19:42
mgariepyhttps://zuul.opendev.org/t/openstack/build/7d3b55790eea4af085e3426df67c7dd7/log/logs/host/messages.txt#3781419:51
mgariepylate enough for me today. not sure how to fix that, we do have 2 services that are managing network on centos.. .. so it's kinda bad.19:53
mgariepyc9s and c8s does have the same issue, rockylinux is some file not found : https://zuul.opendev.org/t/openstack/build/aa9b832e4f11408abec2d41e723702a1/log/job-output.txt#1381319:55
jrosser_oh I already made a patch to os_ironic for that19:57
mgariepyfor the shim i guess .. :) 19:58
mgariepythe networkmanager stuff is anoying haha19:58
mgariepyand ofcourse it didn't merge because of the networknamager issue..20:07
opendevreviewMerged openstack/openstack-ansible master: Remove usage of haproxy-endpoints role  https://review.opendev.org/c/openstack/openstack-ansible/+/84573920:31
*** dviroel is now known as dviroel|afk20:46

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!