Tuesday, 2021-04-20

openstackgerritMerged openstack/openstack-ansible stable/train: Bump setuptools pin to 44.1.1  https://review.opendev.org/c/openstack/openstack-ansible/+/78650800:12
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty master: Fix wsgi_venv path for cloudkitty-api  https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/78283700:44
*** gyee has quit IRC01:21
*** spatel_ has joined #openstack-ansible01:23
*** spatel_ is now known as spatel01:23
*** spatel has quit IRC01:41
*** spatel_ has joined #openstack-ansible02:14
*** spatel_ is now known as spatel02:14
*** evrardjp has quit IRC02:33
*** evrardjp has joined #openstack-ansible02:33
*** rh-jelabarre has quit IRC03:27
*** ianychoi__ has joined #openstack-ansible04:48
*** ianychoi_ has quit IRC04:50
openstackgerritSebastian Gumprich proposed openstack/openstack-ansible-galera_server master: add support for encryption  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/78406905:03
*** mmercer has quit IRC05:03
*** mmercer has joined #openstack-ansible05:05
*** miloa has joined #openstack-ansible05:31
*** miloa has quit IRC05:33
*** kleini has joined #openstack-ansible06:06
*** spatel has quit IRC06:10
*** pto has joined #openstack-ansible06:17
*** shyamb has joined #openstack-ansible06:40
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: add support for encryption  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/78406906:42
*** andrewbonney has joined #openstack-ansible07:14
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_gnocchi master: Fix gnocchi installation for new pip resolver  https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/78151307:34
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_gnocchi master: Fix gnocchi installation for new pip resolver  https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/78151307:34
*** rpittau|afk is now known as rpittau07:35
*** luksky has joined #openstack-ansible07:40
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_gnocchi master: Fix gnocchi installation for new pip resolver  https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/78151307:42
*** tosky has joined #openstack-ansible07:45
jonherlooking at why the OOO test for 784885 failed, it seems to be using tempest 27.0.0 and openstack_ansible_os_tempest-18.1.0.dev389-py3-none-any.whl but yet it complains about "unrecognized arguments: --exclude-list".  This option should be avaialble in that version, so what am i missing here?08:32
noonedeadpunkjonher: you mean tripleo-ci-centos-7-standalone-os-tempest-train job?08:35
jonhercorrect08:35
noonedeadpunkarxcruz: chandankumar any thoughts what might be the thing? Probably we can drop train support against master now, considering train goes to EM in several weeks?08:39
chandankumarnoonedeadpunk: arx is working  on a patch to make it compatible with exclude list08:49
noonedeadpunkgotcha, thanks!08:50
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_adjutant master: Remove incorrect horizon_post_install example  https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/78442008:50
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Optionally build container image as a local chroot  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/77620108:56
jonhergood, thanks :)09:00
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Remove OpenSUSE from role maturity matrix  https://review.opendev.org/c/openstack/openstack-ansible/+/78717309:12
noonedeadpunkjrosser: do you recall where we were fixing versions for tempest plugins?09:16
jrosserthere are some patches to stable branches which are wierdly broken09:16
noonedeadpunkyeah I was specificaly looking into https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/78539309:17
jrosseri was wondering if we're needing to bump pip/setuptools on branches that support py2 to be the latest that support py209:17
noonedeadpunkwell, U is py3 only...09:18
noonedeadpunkbut it's failing on oslo version I think09:18
noonedeadpunkwhich would be the case when we're trying to use newer plugin then the one that was supposed...09:19
noonedeadpunkhttps://975174e533396eaf5276-b327662bb948fd03f559dc332dd2e67c.ssl.cf2.rackcdn.com/785393/1/check/openstack-ansible-uw_apache-ubuntu-bionic/5bb53c6/logs/ara-report/result/c9a0daf0-03de-4e6b-94f9-48ff4a450103/09:19
jrosseroh this is super odd https://zuul.opendev.org/t/openstack/build/5bb53c634af24764baafbdc67fd84cdd/log/job-output.txt#10454409:19
jrosser2021-04-09 07:02:42.895949 | ubuntu-bionic |         "    from oslo_utils.secretutils import md5",09:20
jrosser2021-04-09 07:02:42.895962 | ubuntu-bionic |         "ImportError: cannot import name 'md5'"09:20
noonedeadpunkyeah, posted same thing from ara)09:20
jrosseriirc there was work in oslo around PCI-DSS(?) compliance which moved the md5 function out09:20
jrosserand something like md5_noncrypto <- guessing there, but you get the idea09:21
jrosserwas a replacement to indicate that it was use of md5 but in a non crypto critical context09:21
jrosseri wonder if that got backported to U09:21
noonedeadpunkbut even if it would, it should be also updated in constraints09:23
noonedeadpunkand then integrated would also fail?09:23
jrosseroh hold on well it's just not there https://github.com/openstack/oslo.utils/blob/stable/ussuri/oslo_utils/secretutils.py09:24
jrosserso i would say that the version of tempest there is too new, or somehow unpinned09:25
jrosseras it's assuming changes in oslo secretutils that are not available in the U oslo branch09:26
openstackgerritMerged openstack/openstack-ansible-tests master: Set buster job to NV  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/78691709:36
*** shyamb has quit IRC09:38
arxcruznoonedeadpunk: hey https://review.opendev.org/c/openstack/tripleo-ci/+/785841 is merged should be fixed now09:40
noonedeadpunkarxcruz: I think we were seing issues with train test. and not sure pathc is fixing that?09:41
arxcruznoonedeadpunk: let me check, sorry these days are being a messy :)09:41
noonedeadpunkie https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/78488509:42
noonedeadpunkmaster test has actually passed there09:42
arxcruznoonedeadpunk: oh, i got it, the --exclude-list09:43
arxcruzchandankumar: we need to update tempest on train...09:44
arxcruzto add the --exclude-list patch09:44
arxcruznoonedeadpunk: we use tempest rpm package09:44
arxcruzit is probably pinned with a version prior to --exclude-list09:44
arxcruzchandankumar: do we need to keep train tests ? this will also block tripeo train jobs09:45
jonher783236 my understanding is that the new secrets should be added by the "Add missing secrets" task in "scripts/upgrade-utilities/deploy-config-changes.yml"   we don't want to manage the value like the designate example linked, so do i need to add anything extra there or we good?09:47
noonedeadpunkyeah, they will be added09:48
noonedeadpunkbut the thing is, that in case they're already defined somewhere except user_secrets, new values will be generated09:49
noonedeadpunkI think that we're bsically good as is, but we can go extra mile and add this task to ensure we don't break current deployments if any09:50
chandankumararxcruz: yes, we need to keep train tests, mkopec will give a try to bump tempest version to 26.1.0 or otherwise we will cherry-pick include or exclude list review in train09:51
*** shyamb has joined #openstack-ansible09:53
*** shyam89 has joined #openstack-ansible09:54
*** shyamb has quit IRC09:58
*** shyam89 has quit IRC09:59
*** rpittau is now known as rpittau|bbl10:04
openstackgerritMerged openstack/openstack-ansible-os_placement master: Allow to override placement policy files  https://review.opendev.org/c/openstack/openstack-ansible-os_placement/+/78230310:22
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Use the cached copy of the u-c file from the repo server  https://review.opendev.org/c/openstack/openstack-ansible/+/77452310:25
openstackgerritMerged openstack/openstack-ansible-galera_server master: Use infra LXC upgrade jobs instead of metal  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/78683910:26
openstackgerritMerged openstack/openstack-ansible master: Add custom user-agent for git clones from opendev.org  https://review.opendev.org/c/openstack/openstack-ansible/+/78659610:28
openstackgerritMerged openstack/openstack-ansible-os_ironic master: Use global service variables  https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/76993510:30
*** shyamb has joined #openstack-ansible10:37
*** shyamb has quit IRC10:48
openstackgerritMerged openstack/openstack-ansible-os_sahara master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_sahara/+/78231011:02
*** shyamb has joined #openstack-ansible11:03
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-tests master: Bump ansible-lint version  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/78475111:06
noonedeadpunkzbr: any advices on how to debug custom lint rules? in context of that patch ^11:08
noonedeadpunkas eventually after update of ansible lint, rules are not failing when expected11:08
openstackgerritMerged openstack/openstack-ansible master: Switch openstack_services to stable/wallaby  https://review.opendev.org/c/openstack/openstack-ansible/+/78682911:09
openstackgerritMerged openstack/openstack-ansible master: Add mgr caps to manila keys  https://review.opendev.org/c/openstack/openstack-ansible/+/78695411:15
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Optionally build container image as a local chroot  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/77620111:34
*** jbadiapa is now known as jbadiapa|lunch11:48
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Extend telemetry testing  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/78300412:01
*** shyamb has quit IRC12:08
*** jbadiapa|lunch is now known as jbadiapa12:11
*** pto has quit IRC12:11
*** pto has joined #openstack-ansible12:18
*** rh-jelabarre has joined #openstack-ansible12:19
*** pto has quit IRC12:22
*** rpittau|bbl is now known as rpittau12:37
*** spatel_ has joined #openstack-ansible13:00
*** spatel_ is now known as spatel13:00
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Update octavia_management_net_subnet_cidr in CI  https://review.opendev.org/c/openstack/openstack-ansible/+/78719913:37
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/78228613:38
spatelnoonedeadpunk yesterday i hit this issue during my production upgrade to 22.1.2  - http://paste.openstack.org/show/804638/13:47
spatelI don't have any cluster name specified in var yaml file13:48
spatelI have to bring up my galera cluster manually to fix this issue..13:48
*** pto has joined #openstack-ansible13:48
spatelis it mandatory now to set cluster name in user_*.yaml file?13:49
noonedeadpunkspatel: um, no, it could be easily a default13:52
*** pto has quit IRC13:53
spatelthat is what i thought it should be default, it brought down my galera cluster so i did manual recovery and then add cluster name in user*.yml file and run playbook and that works13:53
*** pto has joined #openstack-ansible13:53
spatelThat was heart attack for me when mysql went down :(13:54
noonedeadpunkhm... that's interesting... I wish it was sandbox so we could experiment and check more13:54
noonedeadpunkBut I'd say that you could get such failure when running against not healthy cluster13:55
spatelit seems that TASK looking for name and trying to match.. last week i did upgrade my lab and i didn't see that issue.. my lab was single infra node13:55
spatelhmm very odd condition13:56
spateli will re-upgrade as soon as we have 22.1.3 and see if hitting same issue13:57
spatelalso we have one more issue which is os-designate pool update related - http://paste.openstack.org/show/804639/13:58
spateli have tested this on multiple machine and everytime i hit that issue.. i think its designate issue13:58
spatelMay be this one - https://bugs.launchpad.net/designate/+bug/182804913:59
openstackLaunchpad bug 1828049 in Designate "designate pool update" [Undecided,Confirmed]13:59
noonedeadpunkwell, I don't see any changes in designate role at least... But could be designate pool id?14:00
noonedeadpunkhttps://opendev.org/openstack/openstack-ansible/src/branch/master/scripts/upgrade-utilities/deploy-config-changes.yml#L89-L9714:01
noonedeadpunkbut we haven't backport that to V14:02
noonedeadpunkbut yeah, might be designate thing as well... not sure...14:03
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Remove support for nspawn containers.  https://review.opendev.org/c/openstack/openstack-ansible/+/78256914:03
spatelIts not related pool id issue, i believe its bug in designate14:07
spatelother folks also having same issue14:08
*** pto_ has joined #openstack-ansible14:09
johnsomspatel Can you point to the bug in Designate. The one above is just that it's not reporting a syntax error in the pool.yaml14:12
*** pto has quit IRC14:12
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron master: Use global dhcp_domain by default  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/78720314:23
*** spatel has quit IRC14:24
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Log tempestconf inside tempest_log_dir  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/78363714:25
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Cleanup after service variables merged  https://review.opendev.org/c/openstack/openstack-ansible/+/76997414:37
*** spatel_ has joined #openstack-ansible14:40
*** spatel_ is now known as spatel14:40
spateljohnsom sure i will report that14:46
*** gshippey has joined #openstack-ansible14:46
johnsomsaptel I am just trying to understand what issue you are seeing. Is there an existing bug?14:47
spateljohnsom i don't know this is existing issue or not. all i found this - https://bugs.launchpad.net/designate/+bug/182804914:53
openstackLaunchpad bug 1828049 in Designate "designate pool update" [Undecided,Confirmed]14:53
spatelwhenever i run14:53
spateldesignate-manage pool update14:53
spatelit doesn't throw error but exit code is non-zero14:53
johnsomspatel https://bugs.launchpad.net/designate/+bug/1828049 is just about the tool not clearly reporting what is invalid in the pool.yaml. I.e. someone made a typo in the pool.yaml and the tool is not listing where the typo is.14:54
openstackLaunchpad bug 1828049 in Designate "designate pool update" [Undecided,Confirmed]14:54
spateljohnsom this is production designate and functional server14:55
spatelIf it has typo or error then this shouldn't be working anymore14:55
johnsomspatel Yeah, but you are running the pool update tool for some reason right? That pool.yaml that is being passed in must have a bug if it is returning failed14:56
johnsomspatel I just won't load the bad pool.yaml file, it will continue to run with the old pools configuration14:56
spatelhere is my pool file - http://paste.openstack.org/show/804640/14:56
noonedeadpunkJust in case - we won't have a meeting today, since we're having PTG https://www.openstack.org/ptg/rooms/cactus in 3 mins14:57
spateljohnsom i didn't update pool.yaml but osa still trying to update14:57
spatellook like we need good debug option with that command.. i can't debug this14:58
*** jbadiapa has quit IRC14:58
*** macz_ has joined #openstack-ansible15:02
johnsomspatel So I just ran that with --dry-run, it looks valid. I wonder if there is permission issue not allowing it to run under OSA15:02
noonedeadpunkspatel: johnsom to you want to join us just in case?15:03
spatellike this designate-manage pool update --dry-run ?15:03
johnsomdesignate-manage pool --file pool.yaml --dry-run15:03
johnsomOpps, typo: designate-manage pool update --file pool.yaml --dry-run15:03
spateljohnsom look at this - http://paste.openstack.org/show/804643/15:06
spatelsame error15:06
johnsomhttps://www.irccloud.com/pastebin/PRkwzlp1/15:06
spatelhmmm15:07
spatelwhy i have no output ?15:07
spatelwhat version are you running?15:08
johnsomI am running a Wallaby devstack15:08
spateloh!!! i am in old rev..15:08
spatelvictoria15:08
spateli think i should upgrade15:08
spatellet me try to upgrade and see what is going on.. i am upgrading to latest master15:09
johnsomOk, I'm not sure what would have changed. Let me know either way as I'm interested to know if there is a patch not backported or it's using something that is new in the pool.yaml (I don't think so, but ...)15:10
spatellet me upgrade and get back to you15:13
spateljohnsom my all playbook ran successful without error but when i am trying your command dry-run still no output..15:25
spatelmay be i need to change logging to debug ?15:25
johnsomYeah, maybe I have a config enabling debug due to using devstack15:26
spatellet me enable and see15:26
johnsomThat is good to know. I can look at why victoria doesn't like that pool.yaml.15:27
spateli have enabled debug in designate.conf and still i can't see output on dry run15:29
spateli am running master branch so it should be latest one15:29
spateljohnsom how do i check what version of designate i am running ?15:32
spatelI have noticed i don't have designate-manager service running. not sure if that has something to do15:33
johnsomspatel in your designate.conf [DEFAULT] debug = True15:33
johnsomspatel Sorry, I am in a PTG session, so multi-tasking a bit15:34
spatelyes i do have debug = True in [ DEFAULT ]15:34
spatelno worry we can talk after meeting15:34
openstackgerritMerged openstack/openstack-ansible-galera_server master: add support for encryption  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/78406916:13
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Implement WEBSSO redirect  https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/78646716:45
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_magnum master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/78153816:49
spatelnoonedeadpunk this is what i found with designate, as soon as i upgrade to latest master i am not seeing pool update error anymore16:56
spatellook like 22.1.2 has older pointer causing pool update error16:57
*** rpittau is now known as rpittau|afk16:59
*** spatel has quit IRC17:11
*** jbadiapa has joined #openstack-ansible17:12
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Cleanup after service variables merged  https://review.opendev.org/c/openstack/openstack-ansible/+/76997417:52
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: Fix oslo_messaging topic condition  https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/78727517:57
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: [reno] Stop publishing release notes  https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/77205317:59
*** luksky has quit IRC18:21
*** luksky has joined #openstack-ansible18:21
*** csmart has quit IRC18:27
*** csmart has joined #openstack-ansible18:30
*** andrewbonney has quit IRC18:40
*** pto has joined #openstack-ansible19:16
*** pto_ has quit IRC19:19
*** luksky has quit IRC19:33
*** luksky has joined #openstack-ansible19:33
*** spatel_ has joined #openstack-ansible19:44
*** spatel_ is now known as spatel19:44
*** pto has quit IRC20:10
*** spatel has quit IRC20:45
*** odyssey4me has quit IRC21:05
*** jamesdenton has quit IRC21:11
*** gshippey has quit IRC22:53
*** macz_ has quit IRC23:02
*** tosky has quit IRC23:17
*** luksky has quit IRC23:22
*** rh-jlabarre has joined #openstack-ansible23:45
*** rh-jelabarre has quit IRC23:47
*** rh-jlabarre has quit IRC23:50

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!