*** dsneddon has joined #tripleo | 00:05 | |
*** dsneddon has quit IRC | 00:10 | |
*** ansmith_ has quit IRC | 00:11 | |
*** jmasud has quit IRC | 00:13 | |
*** jmasud has joined #tripleo | 00:14 | |
openstackgerrit | Merged openstack/diskimage-builder master: Add efi packages for ironic-agent https://review.opendev.org/707195 | 00:28 |
---|---|---|
*** dsneddon has joined #tripleo | 01:13 | |
*** dsneddon has quit IRC | 01:18 | |
*** dsneddon has joined #tripleo | 01:21 | |
*** dsneddon has quit IRC | 01:26 | |
*** rlandy has joined #tripleo | 01:32 | |
*** rlandy has quit IRC | 01:33 | |
EmilienM | dciabrin, sshnaidm : when you get some time to review this. I finally got idempotency improved with the new role https://review.opendev.org/#/q/topic:container_manage/idempotency+(status:open+OR+status:merged) | 01:51 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/train: keystone/ldap: add missing cloud name https://review.opendev.org/708044 | 01:54 |
*** dsneddon has joined #tripleo | 01:55 | |
EmilienM | lbragstad__: ^ | 01:57 |
*** dsneddon has quit IRC | 02:00 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add missing region_name for nova auth in cinder https://review.opendev.org/707850 | 02:06 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: add tht/common to trigger path https://review.opendev.org/704886 | 02:06 |
*** fultonj has joined #tripleo | 02:48 | |
*** saneax has quit IRC | 02:58 | |
openstackgerrit | Luke Short proposed openstack/tripleo-repos master: Add missing current-passed-ci repository choice. https://review.opendev.org/706962 | 03:06 |
openstackgerrit | Luke Short proposed openstack/tripleo-common master: Expose --limit, --skip-tags, and --tags in config-download. https://review.opendev.org/692420 | 03:41 |
*** jdandrea has joined #tripleo | 03:50 | |
*** jdandrea has quit IRC | 03:51 | |
openstackgerrit | Luke Short proposed openstack/python-tripleoclient master: Expose --limit, --skip-tags, and --tags on the CLI. https://review.opendev.org/692421 | 03:55 |
*** dsneddon has joined #tripleo | 03:56 | |
*** dsneddon has quit IRC | 04:00 | |
*** ykarel|away is now known as ykarel | 04:05 | |
*** udesale has joined #tripleo | 04:10 | |
*** jmasud has quit IRC | 04:11 | |
*** jmasud has joined #tripleo | 04:15 | |
openstackgerrit | Luke Short proposed openstack/paunch master: Retry removing containers. https://review.opendev.org/697696 | 04:19 |
*** ramishra has joined #tripleo | 04:40 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Move package_update worflow related functionality to utils https://review.opendev.org/706815 | 04:45 |
*** dsneddon has joined #tripleo | 04:46 | |
*** skramaja has joined #tripleo | 04:50 | |
*** dsneddon has quit IRC | 04:51 | |
*** dsneddon has joined #tripleo | 05:00 | |
*** shyamb has joined #tripleo | 05:07 | |
*** shyamb has quit IRC | 05:08 | |
*** dpawlik has joined #tripleo | 05:21 | |
*** dsneddon has quit IRC | 05:24 | |
openstackgerrit | Merged openstack/tripleo-ansible stable/train: Remove json_error callback https://review.opendev.org/708017 | 05:25 |
*** evrardjp has quit IRC | 05:34 | |
*** evrardjp has joined #tripleo | 05:34 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Update the new rcm image server url https://review.opendev.org/707574 | 05:36 |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Update the new rcm image server url https://review.opendev.org/707574 | 05:40 |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: [RHEL-8] Update release file with new image server address https://review.opendev.org/707359 | 05:40 |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: [RHEL-8] Update release file with new image server address https://review.opendev.org/707359 | 05:41 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Add custom ansible-lint rule for Role Names https://review.opendev.org/703463 | 05:45 |
*** dsneddon has joined #tripleo | 05:52 | |
*** saneax has joined #tripleo | 05:57 | |
*** ratailor has joined #tripleo | 05:58 | |
*** ramishra_ has joined #tripleo | 06:03 | |
*** ramishra has quit IRC | 06:05 | |
Tengu | gchamoul: heya! aren't you supposed to be on PTO? :] | 06:09 |
gchamoul | Tengu: hi, yes I was just writing a mail with my status | 06:10 |
gchamoul | Tengu: and rebases this one | 06:10 |
gchamoul | didn't have time to do before leaving | 06:10 |
gchamoul | Tengu: the small one ended the week with the chickenpox ... just when I started to be on PTO! | 06:12 |
* gchamoul can't wait for next week ... | 06:13 | |
*** abdysn has joined #tripleo | 06:13 | |
Tengu | gchamoul: uhuhuhuhu - good luck! | 06:13 |
gchamoul | Tengu: that's in the mail I just sent but could you please take care of https://review.opendev.org/#/c/706865/ | 06:14 |
gchamoul | Tengu: I know you love lower constraints | 06:14 |
Tengu | again? | 06:15 |
Tengu | meh. | 06:15 |
Tengu | nasty wes | 06:15 |
Tengu | nasty weshay|ruck | 06:15 |
gchamoul | Tengu: no that's a backport | 06:15 |
Tengu | ah | 06:15 |
gchamoul | so lower constraints MASTER != TRAIN | 06:15 |
Tengu | is it needed? | 06:15 |
gchamoul | for the 3 others patches on top yes | 06:16 |
*** lmiccini has joined #tripleo | 06:16 | |
Tengu | ... | 06:16 |
Tengu | pip._vendor.pkg_resources.ContextualVersionConflict: (pbr 2.0.0 (/home/zuul/src/opendev.org/openstack/tripleo-validations/.tox/lower-constraints/lib/python3.6/site-packages), Requirement.parse('pbr>=3.1.1'), | 06:16 |
Tengu | guess we're bound to NOT backport it. | 06:16 |
*** marios|ruck has joined #tripleo | 06:23 | |
*** dpawlik has quit IRC | 06:31 | |
*** dpawlik has joined #tripleo | 06:31 | |
* Tengu needs more coffee | 06:37 | |
openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-validations stable/train: Fix upper and lower constraints https://review.opendev.org/706865 | 06:39 |
Tengu | guess that should be it | 06:39 |
*** sri_ has joined #tripleo | 06:40 | |
*** bandini has joined #tripleo | 06:41 | |
*** dpawlik has quit IRC | 06:42 | |
*** dpawlik has joined #tripleo | 06:48 | |
ykarel | chandankumar, the virtualenv hacks have broken libvirt deployments, is think known? | 06:48 |
chandankumar | ykarel, I donot think so | 06:49 |
chandankumar | ykarel, what is the new issue | 06:49 |
ykarel | chandankumar, https://ci.centos.org/job/tripleo-quickstart-promote-master-current-tripleo-delorean-minimal/672/consoleText | 06:49 |
ykarel | all releases are broken lik ^^ | 06:49 |
chandankumar | ykarel, awesome , will look into that | 06:49 |
ykarel | soniya29, u filed bug for similar thing noticed locally on Friday? ^^ | 06:49 |
*** jfrancoa has joined #tripleo | 06:54 | |
soniya29 | ykarel, not still | 06:57 |
*** iurygregory has joined #tripleo | 06:57 | |
ykarel | soniya29, ack, so filing now? | 06:58 |
soniya29 | ykarel, yeah :) | 06:58 |
ykarel | soniya29, ack, chandankumar fyi ^^ | 06:58 |
ykarel | though it's related to virtualenv cause of failure in CI and local looks different | 06:59 |
*** shyamb has joined #tripleo | 07:01 | |
*** ykarel is now known as ykarel|afk | 07:01 | |
*** yprokule has joined #tripleo | 07:05 | |
*** jbadiapa has joined #tripleo | 07:05 | |
*** pkopec has joined #tripleo | 07:11 | |
*** ykarel|afk is now known as ykarel | 07:14 | |
openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-validations stable/train: Add pre/post ceph validation groups https://review.opendev.org/707072 | 07:17 |
openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-validations stable/train: Make groups documentation part dynamic https://review.opendev.org/706866 | 07:17 |
openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-validations stable/train: Remove default ansible option in test runs https://review.opendev.org/707076 | 07:18 |
Tengu | gchamoul: -^^ rebased. should be good now. | 07:18 |
*** shyamb has quit IRC | 07:31 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: [RHEL-8] Update release file with new image server address https://review.opendev.org/707359 | 07:42 |
*** apetrich has joined #tripleo | 07:46 | |
*** slaweq_ has joined #tripleo | 07:58 | |
*** slaweq_ is now known as slaweq | 07:59 | |
Tengu | chandankumar, ykarel heya! care to confirm if https://bugs.launchpad.net/tripleo/+bug/1863352 is now solved? Patches merged, so I guess we're good right? | 07:59 |
openstack | Launchpad bug 1863352 in tripleo "TASK [Generate container puppet configs for step. TypeError: write() argument must be str, not bytes 1] , " [Critical,Fix released] - Assigned to Emilien Macchi (emilienm) | 07:59 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Improve the way of handling inventory for ansible_runner https://review.opendev.org/708043 | 08:02 |
ykarel | Tengu, yes atleast that rhel8 job moved forward, but sill looks there are other errors in that job | 08:03 |
ykarel | me looking https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master | 08:03 |
Tengu | ykarel: unrelated to the initial issue right? | 08:03 |
ykarel | Tengu, yes different issue now | 08:03 |
Tengu | ouch. that's a lot of yellow. | 08:03 |
Tengu | ykarel: so I can move the card to "done"? | 08:03 |
ykarel | Tengu, if RCA/PA taken care, i think yes | 08:04 |
Tengu | yeah I've triaged it | 08:04 |
Tengu | just a matter of "finding the right column" now and moving it :). | 08:04 |
ykarel | ack | 08:05 |
Tengu | bam. done. | 08:05 |
Tengu | thanks for the confirmation, ykarel :) | 08:05 |
Tengu | ykarel: ah... 2020-02-16 21:54:01 | msg: Aborting, target uses selinux but python bindings (libselinux-python) aren't installed! | 08:07 |
Tengu | I think I've already seen something about it last week. | 08:07 |
Tengu | related to ansible version, of something. | 08:07 |
ykarel | Tengu, hmm there was one, but workaround was proposed for that | 08:07 |
ykarel | let me check | 08:07 |
Tengu | ykarel: ok :) | 08:07 |
ykarel | Tengu, few days back it was cleared with https://review.opendev.org/#/c/706465/ | 08:10 |
Tengu | hmmm. | 08:10 |
*** rpittau|afk is now known as rpittau | 08:10 | |
Tengu | the log I just pasted comes from latest failure in the page you linked.... | 08:10 |
Tengu | soooo I'd say: "not fixed" ? | 08:10 |
Tengu | see the date... that's from today. | 08:10 |
ykarel | Tengu, hmm not completely fixed, | 08:12 |
ykarel | so standalone rhel8 were fixed with that | 08:12 |
ykarel | and overcloud partial | 08:12 |
ykarel | in ovn | 08:12 |
ykarel | ovb | 08:12 |
Tengu | ok. well. wouldn't it be easier to install the selinux thingy? | 08:12 |
ykarel | so https://opendev.org/openstack/python-tripleoclient/src/branch/master/tripleoclient/workflows/deployment.py#L363 | 08:14 |
Tengu | ? | 08:14 |
ykarel | ansible_python_interpreter not handled there | 08:15 |
*** tkajinam has quit IRC | 08:15 | |
Tengu | apetrich, d0ugal -^^ ? | 08:16 |
Tengu | ykarel: the method run_ansible_playbook doesn't seem to handle it at all | 08:17 |
ykarel | Tengu, hmm me also was checking that method | 08:18 |
Tengu | we'd need to pass it as an extra_env_variable imh | 08:18 |
Tengu | *imho | 08:18 |
ykarel | so looks like it uncovered after rhel8.1 | 08:19 |
ykarel | and with ansible < 2.9 | 08:19 |
Tengu | "yay" | 08:19 |
*** mschuppert has joined #tripleo | 08:19 | |
*** apetrich has quit IRC | 08:19 | |
*** ykarel is now known as ykarel|lunch | 08:22 | |
d0ugal | Tengu: Not sure what you want me to look at | 08:29 |
d0ugal | Tengu: issue with the new ansible playbook for getting the horizon url? | 08:29 |
d0ugal | oh, something we need to pass to Ansible? | 08:29 |
Tengu | d0ugal: apparently, yes, due to (missing) python interpreter at some point... Not 100% sure though, seeing the reported error, but.. | 08:30 |
Tengu | would be good if you could take a moment to check it on a rhel8.1 env? | 08:30 |
d0ugal | Tengu: where can I see the error? | 08:30 |
*** tesseract has joined #tripleo | 08:30 | |
Tengu | 1s | 08:30 |
d0ugal | I don't have a rhel8 env atm, I can try and set one up | 08:30 |
Tengu | d0ugal: https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/68a211d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 08:31 |
Tengu | d0ugal: search for "libselinux", you'll find the error directly | 08:31 |
d0ugal | aha | 08:31 |
Tengu | d0ugal: and it's pretty.... nasty: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master | 08:31 |
d0ugal | got it | 08:31 |
soniya29 | ykarel, the issue isn't occuring now. I think recent patches have solved them | 08:31 |
d0ugal | Tengu: ouch | 08:32 |
d0ugal | Tengu: so is it just a packaging issue? i.e. we need a new dep? | 08:32 |
Tengu | d0ugal: as you say :). btw, no harm with that Dennis «tempest» ? | 08:32 |
d0ugal | Dennis tempest?? | 08:33 |
Tengu | d0ugal: according to ykarel|lunch it's more due to a missing ansible_python_interpreter=/usr/bin/python3 | 08:33 |
d0ugal | ah | 08:33 |
d0ugal | I see | 08:33 |
Tengu | that same issue was solved for undercloud and standalone with https://review.opendev.org/#/c/706465/2 | 08:33 |
Tengu | I'm still a bit surprised, but.... apparently that's it | 08:34 |
Tengu | due to the use of ansible 2.8 - apparently 2.9 wouldn't have any issue. pfrrtt | 08:34 |
d0ugal | Tengu: I see we handle it differently in a few different places... :/ | 08:35 |
Tengu | so the workflow might benefit of passing set ansible_python_interpreter at some point | 08:35 |
d0ugal | user provided: https://github.com/openstack/python-tripleoclient/blob/d7e6d90060085ad79885ba1d4bc7ab1158fa24d3/tripleoclient/v1/overcloud_deploy.py#L427 | 08:35 |
d0ugal | assume what you have locally is the same as the target: https://github.com/openstack/python-tripleoclient/blob/76bbb37984cfda623823f51b0be8a33b79afa21c/tripleoclient/v1/tripleo_deploy.py#L854 | 08:35 |
Tengu | d0ugal: care to have a look? maybe with matbu since he's also working on some ansible things within tripleoclients | 08:35 |
d0ugal | Oops, second link, should have been; https://github.com/openstack/python-tripleoclient/blob/458799f4aae641f29ae854f09039e924fb09d90f/tripleoclient/utils.py#L454 | 08:35 |
Tengu | pfff | 08:36 |
d0ugal | oh but the second and third one both assume that whever you use for the client is the same for the target | 08:36 |
d0ugal | they both seem like bad approaches | 08:36 |
Tengu | "yay". convergence... ;) | 08:36 |
d0ugal | okay, I can work on this shortly | 08:36 |
Tengu | d0ugal++ :) | 08:36 |
*** amoralej|off is now known as amoralej | 08:37 | |
*** ccamacho has joined #tripleo | 08:37 | |
openstackgerrit | Federico Ressi proposed openstack/tripleo-quickstart-extras master: Allow to disable test package building https://review.opendev.org/704979 | 08:41 |
*** dtantsur|afk is now known as dtantsur | 08:41 | |
*** apetrich has joined #tripleo | 08:45 | |
d0ugal | Tengu: so I guess the easy fix is just to have it default to sys.executable | 08:46 |
d0ugal | but that doesn't seem like a great solution | 08:46 |
Tengu | d0ugal: guess we should "default" to that sys.executable, but also allow to override it as we can do with plain ansible... ? | 08:46 |
d0ugal | Maybe I can try that for now and then we can get some help from cloudnull | 08:46 |
d0ugal | Tengu: yeah, that sounds better. It means adding a new arg to every command that runs Ansible :( | 08:47 |
Tengu | can't we use the extra_env? | 08:47 |
d0ugal | Tengu: how would you pass that to tripleoclient? | 08:47 |
*** shyamb has joined #tripleo | 08:47 | |
Tengu | it's a dict - at least it doesn't require a new param. | 08:48 |
d0ugal | Tengu: Right, not a new param but a new CLI arg for the user? | 08:48 |
Tengu | iirc, cloudnull would prefer passing env var rather than adding config|params. but maybe for the interepreter, getting a new dedicated param would be better in the end? not really sure. | 08:48 |
Tengu | oh. that. | 08:49 |
Tengu | yeah.... guess we can't really do anything else right? :/ | 08:49 |
Tengu | another way.... auto-detect the interpreter? if os.path.exists(...) in the right order and exit with the "best match"? but that's probably a bad idea. | 08:49 |
d0ugal | Not sure | 08:50 |
d0ugal | I feel like this must be a common problem and there should be a sensible Ansible solution... | 08:50 |
*** tosky has joined #tripleo | 08:51 | |
d0ugal | so the deploy command has --deployment-python-interpreter | 08:52 |
d0ugal | Which is annoyingly specific, so can't even reuse that arg name | 08:52 |
d0ugal | maybe we can introduce a new "standard" one and start deprecating that name | 08:52 |
*** xek has joined #tripleo | 08:52 | |
*** jpena|off is now known as jpena | 08:52 | |
*** lucasagomes has joined #tripleo | 08:53 | |
Tengu | d0ugal: maybe? not really sure about the best way to handle it :/. might be good to discuss that this afternoon once cloudnull and Team are up'n'running | 08:54 |
Tengu | d0ugal: and, yeah, Dennis seems to be the name of a new tempest hitting UK. But you probably are safe where you are :). | 08:54 |
d0ugal | Tengu: oh, TIL tempest == storm :) | 08:55 |
d0ugal | Tengu: lots of rain and wind, but generally okay here | 08:56 |
*** bogdando has joined #tripleo | 08:56 | |
d0ugal | tbh, I just described normal scottish weather ^ but it is a bit worse than normal! | 08:56 |
Tengu | ah, yeah. storm. bah. tempest was funnier, sorry ;) | 08:56 |
Tengu | hehe, yeah, well... here we get some funky weather as well - imagin, still NO snow at all, we even see birds building nests and so on! | 08:57 |
Tengu | we have flies. FLIES, in February o_O | 08:57 |
ramishra_ | Do we know these rdo job failures? looks like cpeh-ansible broken or something... https://logserver.rdoproject.org/15/706815/7/openstack-check/tripleo-ci-rhel-8-scenario001-standalone-rdo/a444f63/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 08:57 |
ramishra_ | ykarel|lunch: ^^ | 08:57 |
d0ugal | wow, it is almost like spring already | 08:57 |
Tengu | completely. | 08:57 |
Tengu | ramishra_: meh. gfidente doesn't seem up | 09:00 |
*** jpich has joined #tripleo | 09:01 | |
ramishra_ | Tengu: fultonj may know too:) | 09:01 |
Tengu | ramishra_: yeah, but he's in the US, while Giulio is in Italy :) | 09:07 |
ramishra_ | Tengu: ah! sorry, I thought he is in EMEA too | 09:09 |
Tengu | ;) | 09:09 |
*** shardy has joined #tripleo | 09:19 | |
openstackgerrit | Merged openstack/paunch stable/rocky: Do not force remove containers https://review.opendev.org/704672 | 09:22 |
*** paramite|clone has joined #tripleo | 09:23 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-ci master: Tests cireports script with py3 https://review.opendev.org/634452 | 09:32 |
*** derekh has joined #tripleo | 09:33 | |
Tengu | folks, care to +A https://review.opendev.org/#/c/706865/ ? it will unlock "some" patches stacked upon it :). | 09:34 |
Tengu | matbu: -^^ please? :) | 09:35 |
matbu | Tengu: sure :) | 09:38 |
Tengu | thanks :) | 09:38 |
*** chem has joined #tripleo | 09:40 | |
*** ratailor has quit IRC | 09:43 | |
*** ratailor has joined #tripleo | 09:44 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/queens: Pass image import conf file to command which runs glance server https://review.opendev.org/708077 | 09:45 |
*** suuuper has joined #tripleo | 09:46 | |
*** shyamb has quit IRC | 09:54 | |
*** gfidente has joined #tripleo | 09:54 | |
openstackgerrit | Adriano Petrich proposed openstack/tripleo-ansible master: Create a node import module and playbook https://review.opendev.org/692363 | 09:59 |
*** udesale_ has joined #tripleo | 10:00 | |
*** udesale_ has quit IRC | 10:01 | |
*** udesale has quit IRC | 10:01 | |
*** udesale has joined #tripleo | 10:01 | |
*** ykarel|lunch is now known as ykarel | 10:05 | |
ykarel | ramishra_, looking | 10:08 |
ykarel | or u already found the issue? | 10:08 |
*** shyamb has joined #tripleo | 10:09 | |
ykarel | the job looks green https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-rhel-8-scenario001-standalone-rdo | 10:11 |
ykarel | may be issue is patch specific or random | 10:11 |
ramishra_ | ykarel: no I've not looked at it. can't be patch specific I guess.. neither the error looks something random.. but I don't know | 10:14 |
ykarel | ramishra_, i see ANSIBLE_SSH_ARGS=-o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o ControlMaster=auto -o ControlPersist=30m -o ServerAliveInterval=64 -o ServerAliveCountMax=1024 -o Compression=no -o TCPKeepAlive=yes -o VerifyHostKeyDNS=no -o ForwardX11=no -o ForwardAgent=yes -o PreferredAuthentications=publickey | 10:17 |
ykarel | ^^ without quotes could cause issues | 10:17 |
ykarel | by any chance u changing env vars | 10:17 |
*** sri_ has quit IRC | 10:18 | |
jbadiapa | Hi, can we merge https://review.opendev.org/#/c/690698/ ? it's to add the installation of rear to the scenario 1 on the tests | 10:22 |
ykarel | mm in passing jobs i don't see ANSIBLE_SSH_ARGS | 10:22 |
ykarel | ramishra_, so afais it's related to open matches for mistral to ansible | 10:36 |
ykarel | i can't find failures other than those | 10:36 |
ramishra_ | ykarel: ok, I'll check later | 10:37 |
ykarel | ramishra_, ack | 10:37 |
*** udesale has quit IRC | 10:38 | |
*** shyamb has quit IRC | 10:46 | |
openstackgerrit | Carlos Goncalves proposed openstack/tripleo-common stable/stein: Do not create symlink conf.d/post-deploy https://review.opendev.org/708090 | 10:53 |
*** leanderthal has joined #tripleo | 10:55 | |
openstackgerrit | Carlos Goncalves proposed openstack/tripleo-common stable/rocky: Do not create symlink conf.d/post-deploy https://review.opendev.org/708091 | 10:57 |
openstackgerrit | Carlos Goncalves proposed openstack/tripleo-common stable/queens: Do not create symlink conf.d/post-deploy https://review.opendev.org/708093 | 11:01 |
*** rpittau is now known as rpittau|bbl | 11:03 | |
*** avivgt has joined #tripleo | 11:06 | |
matbu | cloudnull: Hey so I think we are good to go with https://review.opendev.org/#/c/706170/ | 11:15 |
matbu | cloudnull: the update and upgrade jobs were passing before the last recheck | 11:15 |
*** ratailor has quit IRC | 11:16 | |
matbu | cloudnull: there is only the build image job which is broken but with a known issue: https://bugs.launchpad.net/tripleo/+bug/1862674 | 11:16 |
openstack | Launchpad bug 1862674 in tripleo "build-containers jobs failing on "no module named http"" [Critical,Fix released] - Assigned to yatin (yatinkarel) | 11:16 |
*** ratailor has joined #tripleo | 11:23 | |
openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: WIP: Makes collection commands configurable https://review.opendev.org/705623 | 11:23 |
*** TripleConfused has joined #tripleo | 11:25 | |
TripleConfused | Hi all. Question: ovn_controller - should this run on both Controllers AND the compute nodes? | 11:25 |
ykarel | matbu, nope ^^ issue was related to container builds not image builds | 11:28 |
ykarel | is that effecting images build too? | 11:28 |
ykarel | affecting | 11:28 |
ykarel | :) | 11:29 |
ykarel | that job is green http://zuul.openstack.org/builds?job_name=tripleo-buildimage-overcloud-full-centos-7&branch=master | 11:29 |
ykarel | so possibly the failure are related to open reviews | 11:30 |
openstackgerrit | Gregory Thiemonge proposed openstack/tripleo-heat-templates master: Fix permission issue when removing octavia temp dirs https://review.opendev.org/708100 | 11:30 |
openstackgerrit | Gregory Thiemonge proposed openstack/tripleo-heat-templates stable/train: Fix permission issue when removing octavia temp dirs https://review.opendev.org/708101 | 11:30 |
*** shyamb has joined #tripleo | 11:33 | |
*** ansmith_ has joined #tripleo | 11:37 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-ansible master: DNM: molecule-yolo https://review.opendev.org/708026 | 11:37 |
*** raildo has joined #tripleo | 11:45 | |
*** gfidente has quit IRC | 11:47 | |
*** ratailor has quit IRC | 11:47 | |
openstackgerrit | Sagi Shnaidman proposed openstack/ansible-role-collect-logs master: DNM: run containers stats command https://review.opendev.org/708105 | 11:50 |
*** jpich has quit IRC | 11:50 | |
*** jpich has joined #tripleo | 11:51 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: DNM: test new docker with logs https://review.opendev.org/708106 | 11:51 |
sshnaidm | marbindrakon, ykarel ^^ | 11:51 |
sshnaidm | if logs collection pass there, then it's solved | 11:51 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates stable/train: [stable/train only] Use service_name in heira for firewall rules https://review.opendev.org/708107 | 11:51 |
ykarel | sshnaidm, new docker released? | 11:51 |
sshnaidm | ykarel, idk | 11:52 |
ykarel | sshnaidm, or u mean something else fixed it | 11:52 |
sshnaidm | ykarel, yeah, maybe | 11:52 |
ykarel | sshnaidm, ohhk so blind test :) | 11:52 |
sshnaidm | ykarel, I'm not aware of any fixes, maybe marios|ruck :) | 11:52 |
*** ramishra_ has quit IRC | 11:52 | |
ykarel | me too not followed fixes | 11:52 |
*** ansmith_ has quit IRC | 11:53 | |
*** ykarel is now known as ykarel|afk | 11:54 | |
*** marios|ruck is now known as marios|ruck|food | 11:55 | |
*** ramishra has joined #tripleo | 11:55 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Revert "Revert "Remove hardcoding of python interpreter for rhel8"" https://review.opendev.org/708108 | 11:57 |
sshnaidm | chandankumar, let's check it with new rhel8 images ^ | 11:57 |
chandankumar | sshnaidm, Does the new rhel8 image got built without py2? | 11:59 |
chandankumar | sshnaidm, ok | 11:59 |
sshnaidm | chandankumar, yeah, see rhos-ops | 12:00 |
chandankumar | sshnaidm, ack, thanks | 12:00 |
openstackgerrit | Lucas Alvares Gomes proposed openstack/tripleo-heat-templates master: [OVN] Split NeutronWorkers and NeutronMetadataWorkers for OVN https://review.opendev.org/707361 | 12:01 |
*** rfolco has joined #tripleo | 12:04 | |
*** hberaud has quit IRC | 12:09 | |
*** hberaud has joined #tripleo | 12:09 | |
*** bfournie|afk is now known as bfournie | 12:09 | |
*** jmasud has quit IRC | 12:12 | |
*** marios|ruck|food is now known as marios|ruck | 12:14 | |
*** jmasud has joined #tripleo | 12:14 | |
*** hberaud has quit IRC | 12:21 | |
*** sri_ has joined #tripleo | 12:21 | |
odyssey4me | chandankumar weshay|ruck looks like we're getting a consistent fail for standalone001 for stable/stein on https://review.opendev.org/#/c/703764/1 - https://0e4946a809d3ba8ed039-2e4779f3cb2ed6b8482a8051dc8df3aa.ssl.cf1.rackcdn.com/703764/1/check/tripleo-ci-centos-7-scenario001-standalone/e78d66f/logs/_Failed_to_start_metrics_qdr_container_Tempest_test_failed.log | 12:21 |
openstackgerrit | Merged openstack/tripleo-ci master: Update the new rcm image server url https://review.opendev.org/707574 | 12:21 |
*** hberaud has joined #tripleo | 12:25 | |
*** jpich has quit IRC | 12:27 | |
chandankumar | marios|ruck, ^^, odyssey4me I will take a look in few mins | 12:27 |
*** jpich has joined #tripleo | 12:28 | |
openstackgerrit | Gregory Thiemonge proposed openstack/tripleo-heat-templates stable/stein: Fix permission issue when removing octavia temp dirs https://review.opendev.org/708116 | 12:29 |
*** udesale has joined #tripleo | 12:31 | |
chandankumar | odyssey4me, from this http://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-scenario001-standalone&pipeline=check&branch=stable%2Fstein it looks, weired, sometime it passes or fails | 12:34 |
*** jpena is now known as jpena|lunch | 12:35 | |
*** shyamb has quit IRC | 12:36 | |
*** fuzzball81 is now known as jjoyce | 12:36 | |
*** rpittau|bbl is now known as rpittau | 12:37 | |
*** jaosorior has joined #tripleo | 12:37 | |
*** rh-jelabarre has joined #tripleo | 12:43 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: add support for rhel8/centos8 virthosts https://review.opendev.org/702100 | 12:43 |
odyssey4me | chandankumar: :( so just recheck again and hope for the best? | 12:44 |
chandankumar | odyssey4me, I will take a look into that | 12:44 |
odyssey4me | chandankumar: thank you | 12:44 |
openstackgerrit | Merged openstack/tripleo-validations stable/train: Fix upper and lower constraints https://review.opendev.org/706865 | 12:45 |
matbu | ykarel|afk: sorry , /me reads back.. so you think it can be related to the review ? | 12:52 |
matbu | ykarel|afk: i don't get what is the root cause of the failure | 12:52 |
*** rlandy has joined #tripleo | 12:55 | |
*** marios|ruck is now known as marios|ruck|call | 13:01 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: Allow to update container startup config with new config hashes https://review.opendev.org/708024 | 13:03 |
*** morazi has joined #tripleo | 13:04 | |
EmilienM | bogdando: ^ and replied on https://review.opendev.org/#/c/708024/3/tripleo_ansible/ansible_plugins/modules/container_puppet_config.py | 13:04 |
EmilienM | sshnaidm: ^ | 13:04 |
bogdando | EmilienM: yes thanks I saw those. The "if needed" part is not quite clear. | 13:06 |
bogdando | I'm used to think, that only puppet apply defines the need | 13:06 |
EmilienM | bogdando: do you want me to rephrase it? | 13:06 |
EmilienM | in the doc | 13:06 |
bogdando | or having config ids hacked in tht | 13:06 |
bogdando | EmilienM: elaborated, yes please | 13:07 |
EmilienM | ok, I will | 13:07 |
bogdando | thanks | 13:07 |
bogdando | just thinking if I couldn't get through it, other readers may be confused as well ( or that's just me!) | 13:08 |
bogdando | EmilienM: may be providing an opposite tripleo_container_manage_check_puppet_config: false example could improve that | 13:09 |
bogdando | in docs | 13:09 |
bogdando | and explaining outcomes in generated hashes compared to puppet execs | 13:09 |
*** amoralej is now known as amoralej|lunch | 13:12 | |
EmilienM | bogdando, sshnaidm : also replied on https://review.opendev.org/#/c/707889 | 13:12 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: Allow to update container startup config with new config hashes https://review.opendev.org/708024 | 13:16 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: create a filter to get changed containers https://review.opendev.org/707889 | 13:16 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: reduce cleanup when single config is given https://review.opendev.org/707244 | 13:16 |
sshnaidm | EmilienM, it's weird about async and changed, lemme test it locally, it shouldn't be that way | 13:17 |
sshnaidm | EmilienM, otherwise ansible has a bug.. | 13:17 |
EmilienM | sshnaidm: sure, I can also make you a demo | 13:17 |
EmilienM | my env is ready | 13:17 |
sshnaidm | EmilienM, works too | 13:19 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: reduce downtime for minor updates https://review.opendev.org/707710 | 13:19 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: avoid excessive logging with podman facts https://review.opendev.org/707859 | 13:20 |
*** gfidente has joined #tripleo | 13:25 | |
*** ansmith has joined #tripleo | 13:30 | |
*** jpena|lunch is now known as jpena | 13:34 | |
openstackgerrit | Merged openstack/tripleo-quickstart master: [RHEL-8] Update release file with new image server address https://review.opendev.org/707359 | 13:37 |
chandankumar | dpawlik, sshnaidm ^^ | 13:38 |
chandankumar | weshay|ruck, ^^ | 13:38 |
*** suuuper has quit IRC | 13:41 | |
cloudnull | matbu excellent, thanks ! | 13:41 |
cloudnull | d0ugal Tengu mind giving me the tldr on the env vs param discussion from earlier ? | 13:43 |
dpawlik | chandankumar, finally it finish | 13:43 |
d0ugal | cloudnull: We don't set ansible_python_interpreter for rhel8 | 13:44 |
*** saneax has quit IRC | 13:44 | |
dpawlik | chandankumar, did you find why its fail on ripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001? | 13:44 |
d0ugal | cloudnull: we need to figure out a way to do that. Any suggestions? | 13:44 |
chandankumar | dpawlik, that is a different issue not related to our patch | 13:44 |
openstackgerrit | Merged openstack/tripleo-upgrade master: Switch from using cat to slurp https://review.opendev.org/703583 | 13:44 |
Tengu | cloudnull: what d0ugal said :) (sorry, on mtg) | 13:45 |
cloudnull | d0ugal oh, you could set it to sys.executable when the environment variable ANSIBLE_PYTHON_INTERPRETER is undefined ? | 13:45 |
d0ugal | cloudnull: There is already some weirdness as tripleoclient handles it differently in two places already | 13:45 |
cloudnull | tbh, we should be setting that in our ansible inventory | 13:46 |
d0ugal | cloudnull: for the deploy command it is a user arg; https://github.com/openstack/python-tripleoclient/blob/d7e6d90060085ad79885ba1d4bc7ab1158fa24d3/tripleoclient/v1/overcloud_deploy.py#L886 | 13:46 |
*** ykarel|afk is now known as ykarel | 13:46 | |
d0ugal | cloudnull: and here we default it to whatever tripleoclient is running under https://github.com/openstack/python-tripleoclient/blob/76bbb37984cfda623823f51b0be8a33b79afa21c/tripleoclient/v1/tripleo_deploy.py#L833 | 13:47 |
d0ugal | using sys.executable is super weird to me | 13:47 |
cloudnull | that seems like a sensible approach, given we're already doing it ? | 13:48 |
ykarel | matbu, as per the symptoms, yes it's look review related | 13:48 |
cloudnull | however that would break in spectacular ways if running from a venv | 13:48 |
dpawlik | chandankumar, k | 13:48 |
dpawlik | chandankumar, can we switch now the domains? | 13:48 |
d0ugal | cloudnull: I am not sure that having done it already makes it sensible :) | 13:49 |
chandankumar | dpawlik, you mean to images.rdoproject.org na? | 13:49 |
d0ugal | Assuing a client is running on the same version as a server seems kinda crazy | 13:49 |
cloudnull | d0ugal Tengu: https://docs.ansible.com/ansible/latest/reference_appendices/python_3_support.html#using-python-3-on-the-managed-machines-with-commands-and-playbooks - can we not continue to use the autodetection ? | 13:49 |
openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient master: Remove extra whitespaces from getent. https://review.opendev.org/708128 | 13:50 |
d0ugal | cloudnull: I am not sure about autodetection, maybe it isn't working | 13:50 |
Tengu | cloudnull: I think there are issues with 2.8 which is still used on rhel-8 images | 13:50 |
d0ugal | cloudnull: I believe this is causing all these failures; https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master | 13:50 |
cloudnull | OIC | 13:51 |
cloudnull | If I was going to set that option, I would define it in inventory on a per-host basis, allowing us to use different python on different hosts. | 13:53 |
*** amoralej|lunch is now known as amoralej | 13:53 | |
*** Goneri has joined #tripleo | 13:53 | |
cloudnull | however, if we're looking for a quick fix, probably best to just replicate what already do with sys.executable | 13:53 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Configure Undercloud hostname in the overcloud during upgrade. https://review.opendev.org/707865 | 13:53 |
*** marios|ruck|call is now known as marios|ruck | 13:54 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Configure Undercloud hostname in the overcloud during upgrade. https://review.opendev.org/707865 | 13:55 |
Tengu | cloudnull: that would be great indeed (setting in the inventory) - maybe we can do the "quick fix" first and do the "nice and clean" way once we unlock CI? | 13:55 |
*** dmacpher has joined #tripleo | 13:57 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: reduce cleanup when single config is given https://review.opendev.org/707244 | 13:57 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: reduce downtime for minor updates https://review.opendev.org/707710 | 13:58 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: avoid excessive logging with podman facts https://review.opendev.org/707859 | 13:58 |
cloudnull | d0ugal apetrich - mind giving https://review.opendev.org/#/c/705793/ a review again. | 13:59 |
*** ekultails has joined #tripleo | 13:59 | |
cloudnull | I had to rebase that from last week | 13:59 |
cloudnull | sshnaidm - ping - does this https://review.opendev.org/#/c/708108/ - fix our CI issues ? | 14:00 |
*** marios|ruck is now known as marios|ruck|call | 14:00 | |
*** marios|ruck|call is now known as marios|ruck | 14:00 | |
sshnaidm | cloudnull, nope, I wait for a new rhel8 images without py2 and they should help | 14:02 |
cloudnull | ok | 14:02 |
sshnaidm | jpena, do you know if they are built today? ^ | 14:02 |
jpena | sshnaidm: it's built now, I'm waiting for the upload to vexxhost | 14:03 |
cloudnull | so there's not much we can do atm to resolve the CIX without these new images ? | 14:03 |
jpena | for some reason, it takes longer to upload there than rdocloud | 14:03 |
sshnaidm | cloudnull, which issue do you mean? because we have a few :) | 14:03 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Disable Paunch by default Standalone/Overcloud https://review.opendev.org/700738 | 14:08 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Disable Paunch by default Standalone/Overcloud https://review.opendev.org/700738 | 14:08 |
openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient master: Remove extra whitespaces from getent. https://review.opendev.org/708128 | 14:14 |
*** nkinder has joined #tripleo | 14:15 | |
*** lbragstad__ is now known as lbragstad | 14:15 | |
fultonj | Tengu: gfidente is at a hackfest and you know what those are like ;) | 14:16 |
apetrich | cloudnull, looking | 14:16 |
fultonj | Tengu: do you still have a question he or i might have been able to answer? | 14:16 |
*** cdearborn has joined #tripleo | 14:17 | |
cloudnull | sshnaidm my bad, posted to the wrong channel | 14:17 |
cloudnull | > the card "RHEL-8 jobs for train and master got broken with Aborting, target uses selinux but python bindings (libselinux-python) aren't installed!" | 14:17 |
Tengu | fultonj: what, hackfest? bahhhh, easy right? | 14:19 |
*** jdandrea has joined #tripleo | 14:19 | |
fultonj | spain | 14:19 |
Tengu | fultonj: as for question: I think there's still an open one, yeah | 14:19 |
fultonj | similar to what we did in germany in november | 14:19 |
Tengu | fultonj: yup, I was invited but my manager declined ^^'. | 14:19 |
Tengu | anyway, the question is probably still up, was from ramishra about the ceph-ansible issue here: https://logserver.rdoproject.org/15/706815/7/openstack-check/tripleo-ci-rhel-8-scenario001-standalone-rdo/a444f63/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 14:20 |
sshnaidm | cloudnull, I hope new images will resolve it | 14:21 |
*** lbragstad has quit IRC | 14:21 | |
cloudnull | k | 14:22 |
fultonj | Tengu: so the command interpoltation introduced something the shell couldn't parse | 14:23 |
Tengu | ramishra: -^^ you probably want to follow :) | 14:23 |
fultonj | well | 14:23 |
fultonj | let's see what inserted that | 14:23 |
Tengu | fultonj: smells like a missing \ on the previous line | 14:24 |
Tengu | the "stderr: '/bin/sh: -o: command not found'" is a pretty good sign of it | 14:25 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove left over mistral layers of abstration https://review.opendev.org/707894 | 14:26 |
fultonj | https://opendev.org/openstack/tripleo-ansible/src/branch/master/tripleo_ansible/roles/tripleo_ceph_uuid/tasks/gather.yml | 14:26 |
fultonj | Tengu: ^ | 14:26 |
fultonj | So why is the log spread over 3 lines? | 14:28 |
fultonj | 2020-02-17 05:27:24 | cmd: (blah blah blah) | 14:28 |
fultonj | 2020-02-17 05:27:24 | ANSIBLE_CACHE_PLUGIN=... | 14:28 |
fultonj | 2020-02-17 05:27:24 | ANSIBLE_ROLES_PATH=... | 14:28 |
Tengu | among other questions, I'd say | 14:28 |
Tengu | have to jump on a call, sorry | 14:28 |
Tengu | (but it will be short I guess) | 14:29 |
fultonj | the env vars need have \n in them but shouldn't | 14:29 |
Tengu | yup... something's smelly in there | 14:29 |
openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient master: Remove extra whitespaces from getent. https://review.opendev.org/708128 | 14:29 |
fultonj | ramishra: ^ | 14:30 |
Tengu | matbu: quick mtg? | 14:30 |
*** sri_ has quit IRC | 14:37 | |
fultonj | ramishra Tengu i commented in the review with what i think is going on https://review.opendev.org/#/c/706815/7 | 14:38 |
fultonj | if you think the tripleo-ansible ceph portions need to strip the newlines then let me know | 14:40 |
Tengu | fultonj: wondering if using some kind of "\" would be good, that would allow to get something readable in the console|log instead of an endless on-liner | 14:40 |
fultonj | i'd rather just strip them out | 14:40 |
fultonj | if i inject them and there's new line then what? | 14:41 |
Tengu | |replace('\n', '\n \\') ? | 14:41 |
Tengu | or something... | 14:41 |
fultonj | i'd rather take things away that shouldn't be there then add extra stuff just in case | 14:41 |
fultonj | what's adding new lines now. this worked for > year | 14:42 |
Tengu | right | 14:43 |
Tengu | wondering if it's linked to that patch or if it's a general issue... | 14:43 |
*** jdandrea has quit IRC | 14:44 | |
fultonj | Tengu: https://bugs.launchpad.net/tripleo/+bug/1863629 | 14:48 |
openstack | Launchpad bug 1863629 in tripleo "tripleo-ansible ceph executions add unwanted newlines when interpolating ansible environment variables" [Medium,Triaged] - Assigned to John Fulton (jfulton-org) | 14:48 |
Tengu | fultonj: sounds good. but still, wondering what injects that -o thing. | 14:48 |
fultonj | Tengu: those are SSH options for ansible-playbook | 14:49 |
Tengu | aahh yeah, just saw it | 14:49 |
Tengu | missing quotes as well, maybe? | 14:49 |
fultonj | ansible-playbook --ssh-extra-args "-o StrictHostKeyChecking=no" | 14:49 |
fultonj | yeah | 14:50 |
fultonj | likely missing quotes | 14:50 |
fultonj | Tengu: i'll put a patch up for them to try it | 14:50 |
fultonj | basically let's make the code handle new lines getting in there | 14:51 |
fultonj | we know we don't want them | 14:51 |
openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient master: Remove extra whitespaces from getent. https://review.opendev.org/708128 | 14:51 |
*** jdandrea has joined #tripleo | 14:53 | |
*** artom has joined #tripleo | 14:56 | |
*** abdysn has quit IRC | 14:56 | |
*** TrevorV has joined #tripleo | 14:58 | |
Tengu | fultonj: +1 | 14:59 |
*** leanderthal has quit IRC | 15:00 | |
*** gfidente has quit IRC | 15:06 | |
weshay|ruck | ekultails++ | 15:07 |
*** jpich has quit IRC | 15:09 | |
*** jpich has joined #tripleo | 15:10 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: Revert "Unskip test_cross_tenant_traffic tempest test" https://review.opendev.org/708137 | 15:10 |
marios|ruck | arxcruz: chandankumar: weshay|ruck: ^^ | 15:10 |
weshay|ruck | apetrich, which job? | 15:11 |
apetrich | weshay|ruck, https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master | 15:12 |
weshay|ruck | apetrich, ah nice.. see it.. we weren't sure if that was the cloud or code | 15:12 |
apetrich | weshay|ruck, it is code. It is calling ansible for it to try python2 on centos8. I don't know much details about it though. d0ugal has more | 15:13 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/stein: DNM: Use ceph-systemd until package available. https://review.opendev.org/708139 | 15:14 |
weshay|ruck | apetrich, centos-8? | 15:14 |
weshay|ruck | there are no centos-8 jobs | 15:14 |
weshay|ruck | apetrich, show me a specific review | 15:15 |
weshay|ruck | please | 15:15 |
apetrich | weshay|ruck, \facepalm: rhel-8 | 15:15 |
apetrich | weshay|ruck, take this https://review.opendev.org/#/c/692363/ for instance. that code changes nothing that impacts that gate. | 15:16 |
weshay|ruck | k.. thanks I'll take a look | 15:17 |
*** gfidente has joined #tripleo | 15:19 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the package_update_* workflows https://review.opendev.org/706170 | 15:19 |
*** ykarel is now known as ykarel|away | 15:20 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: remove podman/delete.yml and use another role https://review.opendev.org/708142 | 15:24 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-common master: Improve step task check to cater for whitespace https://review.opendev.org/708143 | 15:27 |
openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient master: Remove extra whitespaces from getent. https://review.opendev.org/708128 | 15:27 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates stable/train: Add DeployIdentifier to extra config containers https://review.opendev.org/704402 | 15:27 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates stable/train: Add DeployIdentifier to extra config containers https://review.opendev.org/704402 | 15:32 |
*** skramaja has quit IRC | 15:33 | |
*** chandankumar is now known as raukadah | 15:33 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the deploy_on_servers workflow https://review.opendev.org/706640 | 15:38 |
EmilienM | pkopec: hey, did you have time to take a look at https://review.opendev.org/#/c/706882/ ? | 15:39 |
EmilienM | bogdando: see my comment on https://review.opendev.org/#/c/708025, it's to avoid useless run of the module in the role | 15:42 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Improve the way of handling inventory for ansible_runner https://review.opendev.org/708043 | 15:45 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Improve the way of handling inventory for ansible_runner https://review.opendev.org/708043 | 15:45 |
openstackgerrit | Merged openstack/python-tripleoclient master: update ironclient requirements https://review.opendev.org/707927 | 15:47 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Improve the way of handling inventory for ansible_runner https://review.opendev.org/708043 | 15:48 |
*** ccamacho has quit IRC | 15:58 | |
*** ccamacho has joined #tripleo | 15:58 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart-extras master: Allow full path to be specified for amphora destination https://review.opendev.org/692858 | 16:03 |
*** ccamacho has quit IRC | 16:05 | |
*** jdandrea has quit IRC | 16:08 | |
*** jdandrea_ has joined #tripleo | 16:09 | |
openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient stable/queens: Revert "Default to zero verbosity when using Ansible." https://review.opendev.org/708206 | 16:09 |
openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient stable/train: Revert "Default to zero verbosity when using Ansible." https://review.opendev.org/708207 | 16:10 |
openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Revert "Default to zero verbosity when using Ansible." https://review.opendev.org/708208 | 16:10 |
*** d0ugal has quit IRC | 16:10 | |
*** jmasud has quit IRC | 16:12 | |
openstackgerrit | Gregory Thiemonge proposed openstack/tripleo-heat-templates stable/train: Fix permission issue when removing octavia temp dirs https://review.opendev.org/708101 | 16:13 |
*** jmasud has joined #tripleo | 16:14 | |
openstackgerrit | Gregory Thiemonge proposed openstack/tripleo-heat-templates stable/stein: Fix permission issue when removing octavia temp dirs https://review.opendev.org/708116 | 16:14 |
*** jdandrea_ has quit IRC | 16:15 | |
openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Revert "Default to zero verbosity when using Ansible." https://review.opendev.org/708208 | 16:16 |
EmilienM | sshnaidm, bogdando : can I get a review on https://review.opendev.org/#/c/708024/ ? thanks | 16:17 |
*** jdandrea has joined #tripleo | 16:17 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart-extras master: Allow full path to be specified for amphora destination https://review.opendev.org/692858 | 16:24 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart-extras master: Allow full path to be specified for amphora destination https://review.opendev.org/692858 | 16:30 |
weshay|ruck | mwhahaha, look ok to you? http://paste.openstack.org/show/789655/ | 16:30 |
mwhahaha | weshay|ruck: yea probably | 16:31 |
*** TripleConfused has quit IRC | 16:31 | |
openstackgerrit | Merged openstack/tripleo-validations stable/train: Add pre/post ceph validation groups https://review.opendev.org/707072 | 16:45 |
openstackgerrit | Merged openstack/tripleo-validations stable/train: Make groups documentation part dynamic https://review.opendev.org/706866 | 16:45 |
weshay|ruck | mwhahaha, EmilienM ok.. this should pass all the tests now and include operator https://review.opendev.org/#/c/707746/ | 16:46 |
mwhahaha | a likely story | 16:47 |
*** rpittau is now known as rpittau|afk | 16:54 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-ci master: Upgrade molecule to 3.0a9 https://review.opendev.org/708021 | 16:55 |
*** marios|ruck is now known as marios|ruck|call | 16:55 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-operator-ansible master: Upgrades molecule to 3.0a9 https://review.opendev.org/708022 | 17:00 |
*** bogdando has quit IRC | 17:02 | |
*** lucasagomes has quit IRC | 17:02 | |
*** dtantsur is now known as dtantsur|afk | 17:03 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-ansible master: Upgrade molecule to 3.0a9 https://review.opendev.org/708026 | 17:03 |
*** marios|ruck|call is now known as marios|out | 17:04 | |
mwhahaha | weshay|ruck: did we add https://review.opendev.org/#/c/706572/ to kolla so they can remove the centos7 jobs/py27 support? | 17:06 |
weshay|ruck | mwhahaha, it's in the template, but let me double check for you | 17:07 |
weshay|ruck | rfolco, rlandy ^ | 17:07 |
rfolco | apparently yes, its running weshay|ruck mwhahaha for example https://review.opendev.org/#/c/707787/ tripleo-build-containers-centos-8-masterSUCCESS in 30m 05s (non-voting) | 17:13 |
mwhahaha | ok let's pull the centos-7 job | 17:13 |
mwhahaha | and they can merge their 27 removal bits | 17:13 |
mwhahaha | specifically https://review.opendev.org/#/c/691316/ | 17:14 |
*** lmiccini has quit IRC | 17:15 | |
*** udesale has quit IRC | 17:17 | |
*** gfidente has quit IRC | 17:18 | |
*** ccamacho has joined #tripleo | 17:20 | |
*** dpawlik has quit IRC | 17:22 | |
*** marios|out has quit IRC | 17:32 | |
*** evrardjp has quit IRC | 17:34 | |
*** evrardjp has joined #tripleo | 17:34 | |
*** jpich has quit IRC | 17:38 | |
*** bandini has quit IRC | 17:38 | |
*** yprokule has quit IRC | 17:44 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: improve testing coverage with molecule https://review.opendev.org/708216 | 17:46 |
openstackgerrit | Merged openstack/tripleo-ansible master: tripleo-container-manage: remove hashed-* from default https://review.opendev.org/707862 | 17:55 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: improve testing coverage with molecule https://review.opendev.org/708216 | 17:56 |
weshay|ruck | mwhahaha, rfolco https://review.opendev.org/708218 | 18:00 |
*** derekh has quit IRC | 18:00 | |
rfolco | weshay|ruck, +1 | 18:01 |
*** tesseract has quit IRC | 18:02 | |
*** avivgt has quit IRC | 18:02 | |
*** rcernin has quit IRC | 18:06 | |
*** shardy has quit IRC | 18:06 | |
*** shardy has joined #tripleo | 18:07 | |
*** jpena is now known as jpena|off | 18:09 | |
fultonj | slagle: did you get a chance to reivew https://review.opendev.org/#/c/707727/ ? | 18:11 |
fultonj | i see bogdando +w'd it, but wasn't sure if you wanted to comment first | 18:12 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: improve testing coverage with molecule https://review.opendev.org/708216 | 18:13 |
*** jmasud has quit IRC | 18:14 | |
*** jmasud_ has joined #tripleo | 18:14 | |
*** shardy has quit IRC | 18:18 | |
openstackgerrit | Merged openstack/diskimage-builder master: Allow python3 to be used in Debian https://review.opendev.org/705920 | 18:18 |
*** shardy has joined #tripleo | 18:18 | |
openstackgerrit | Merged openstack/tripleo-ansible stable/train: container_puppet_config: cleanup old config files https://review.opendev.org/707725 | 18:20 |
*** rcernin has joined #tripleo | 18:21 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: tripleo-container-manage: remove hashed-* from default https://review.opendev.org/708221 | 18:23 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: container_puppet_config: update config_hash for all steps https://review.opendev.org/708222 | 18:23 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: tripleo-container-manage: provide more debug doc https://review.opendev.org/708223 | 18:25 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove left over mistral layers of abstration https://review.opendev.org/707894 | 18:28 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the package_update_* workflows https://review.opendev.org/706170 | 18:28 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the deploy_on_servers workflow https://review.opendev.org/706640 | 18:29 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Improve the way of handling inventory for ansible_runner https://review.opendev.org/708043 | 18:29 |
*** ramishra has quit IRC | 18:38 | |
openstackgerrit | Merged openstack/tripleo-operator-ansible master: Add tripleo_overcloud_node_bios_configure role https://review.opendev.org/707514 | 18:42 |
openstackgerrit | Merged openstack/tripleo-operator-ansible master: Add tripleo_overcloud_node_delete role https://review.opendev.org/707209 | 18:42 |
*** ahosam has joined #tripleo | 18:42 | |
*** amoralej is now known as amoralej|off | 18:52 | |
*** sshnaidm is now known as sshnaidm|afk | 18:57 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: [update] Ensure we get fresh hiera data before running update_steps. https://review.opendev.org/707230 | 18:59 |
openstackgerrit | Merged openstack/tripleo-common master: Remove container_image_prepare_default workflow https://review.opendev.org/706235 | 18:59 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: improve testing coverage with molecule https://review.opendev.org/708216 | 19:02 |
*** jmasud_ has quit IRC | 19:04 | |
*** jmasud has joined #tripleo | 19:06 | |
*** Tengu has quit IRC | 19:07 | |
*** Tengu has joined #tripleo | 19:09 | |
*** Tengu has quit IRC | 19:14 | |
*** Tengu has joined #tripleo | 19:15 | |
*** Tengu has quit IRC | 19:21 | |
*** Tengu has joined #tripleo | 19:22 | |
weshay|ruck | MIGHTY BIG QUEUE you got there tripleo | 19:25 |
*** jmasud has quit IRC | 19:26 | |
openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: DNM: debug lp#1862612 https://review.opendev.org/708239 | 19:31 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: improve testing coverage with molecule https://review.opendev.org/708216 | 19:34 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: improve testing coverage with molecule https://review.opendev.org/708216 | 19:36 |
openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: DNM: debug lp#1862612 https://review.opendev.org/708239 | 19:40 |
*** Tengu has quit IRC | 19:44 | |
*** Tengu has joined #tripleo | 19:46 | |
zbr | cloudnull: ekultails : hi! | 19:46 |
ekultails | zbr: Hey, what's up? | 19:46 |
Tengu | sorry for the part|join.... playing with my internal DNS and pi-hole :] | 19:47 |
Tengu | "oopssss". | 19:47 |
zbr | earlier today I released molecule==3.0a9 which known regressions. i already tested if with several repos, including https://review.opendev.org/#/c/708026/ | 19:47 |
zbr | please have a look and let me know if that one does not bring unexpected surprises. | 19:47 |
zbr | if everything goes well, I will make 3.0 release on Friday, or Monday. | 19:48 |
zbr | I also created a short migration checklist, https://github.com/ansible-community/molecule/issues/2560 | 19:49 |
*** openstackstatus has quit IRC | 19:49 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: improve testing coverage with molecule https://review.opendev.org/708216 | 19:50 |
*** Tengu has quit IRC | 19:51 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the generate_fencing_parameters deploy workflow https://review.opendev.org/707187 | 19:52 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the generate_fencing_parameters deploy workflow https://review.opendev.org/707187 | 19:52 |
*** Tengu has joined #tripleo | 19:55 | |
ekultails | zbr: I've been keeping an eye on the Molecule project, you've been making some nice work and I appreciate the Molecule v3 checklist! I'll try to manually run through some Molecule tests on our major repos (tripleo-ansible, triploe-operator-ansible, etc.) and see if anything strange shows up. I will let you know if I run into any problems. | 19:56 |
ekultails | 3.0 has been a long-time coming. :-) | 19:56 |
ekultails | I also have some personal projects I can try to test/break Molecule 3.0 with. | 19:57 |
*** jdandrea has quit IRC | 19:59 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-upgrade master: Configure undercloud_enable_paunch when set https://review.opendev.org/708241 | 20:01 |
*** jaosorior has quit IRC | 20:02 | |
openstackgerrit | Merged openstack/tripleo-ansible master: Allow to update container startup config with new config hashes https://review.opendev.org/708024 | 20:03 |
openstackgerrit | Merged openstack/tripleo-ansible stable/train: Stop docker service when is available only. https://review.opendev.org/707128 | 20:03 |
openstackgerrit | Merged openstack/tripleo-ansible master: tripleo_container_manage: create a filter to get changed containers https://review.opendev.org/707889 | 20:03 |
openstackgerrit | Merged openstack/tripleo-ansible stable/train: Octavia: do not attempt container restart on empty list https://review.opendev.org/706495 | 20:03 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-upgrade master: Configure undercloud_enable_paunch when set https://review.opendev.org/708241 | 20:03 |
*** jdandrea has joined #tripleo | 20:03 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/train: [train-squash] Backport "all Keystone resources with Ansible" https://review.opendev.org/706882 | 20:05 |
EmilienM | sshnaidm|afk, cloudnull : https://review.opendev.org/#/c/708216/ more testing (passed molecule job) | 20:06 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: tripleo-container-manage: remove hashed-* from default https://review.opendev.org/708221 | 20:08 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo_overcloud_node_bios_reset role https://review.opendev.org/707515 | 20:10 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: Allow to update container startup config with new config hashes https://review.opendev.org/708243 | 20:10 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: tripleo_container_manage: create a filter to get changed containers https://review.opendev.org/708245 | 20:13 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: tripleo_container_manage: reduce cleanup when single config is given https://review.opendev.org/708246 | 20:13 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: tripleo_container_manage: reduce downtime for minor updates https://review.opendev.org/708247 | 20:13 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: tripleo_container_manage: avoid excessive logging with podman facts https://review.opendev.org/708248 | 20:14 |
*** hoonetorg has quit IRC | 20:14 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: tripleo_container_manage: remove podman/delete.yml and use another role https://review.opendev.org/708249 | 20:16 |
*** hoonetorg has joined #tripleo | 20:18 | |
zbr | ekultails: please try to break it if you can. it was a mistake to delay the v3 for so long. | 20:19 |
zbr | after that I plan to avoid waiting ~1y for it. | 20:20 |
*** jmasud has joined #tripleo | 20:22 | |
ekultails | zbr: I'll try my best. :-) Also, +1 for having quicker releases. | 20:24 |
openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates master: Adding Rear check to CI https://review.opendev.org/690698 | 20:25 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Remove deprecated securetty https://review.opendev.org/707293 | 20:25 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Remove deprecated time services https://review.opendev.org/707296 | 20:25 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Remove deprecated tuned-baremetal-puppet https://review.opendev.org/707299 | 20:26 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Remove deprecated aide puppet service https://review.opendev.org/707300 | 20:26 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Remove deprecated kubernetes services https://review.opendev.org/707292 | 20:28 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Remove deprecated securetty https://review.opendev.org/707293 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Remove deprecated time services https://review.opendev.org/707296 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Remove deprecated tuned-baremetal-puppet https://review.opendev.org/707299 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Remove deprecated aide puppet service https://review.opendev.org/707300 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Remove kernel class https://review.opendev.org/707291 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Remove deprecated securetty https://review.opendev.org/707294 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Remove unused time/ptp class https://review.opendev.org/707298 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Remove k8s from haproxy https://review.opendev.org/707301 | 20:29 |
EmilienM | weshay|ruck: do we have gate timeouts ? or just too many patches? | 20:30 |
weshay|ruck | EmilienM, lot's o patches | 20:30 |
EmilienM | everyone: stop working | 20:31 |
openstackgerrit | John Fulton proposed openstack/tripleo-ansible master: Remove new lines from env variables used by ceph-ansible https://review.opendev.org/708252 | 20:34 |
fultonj | yeah! | 20:35 |
openstackgerrit | Sagi Shnaidman proposed openstack/python-tripleoclient master: Migrate the CLI introspection from Mistral to Ansible https://review.opendev.org/695893 | 20:36 |
weshay|ruck | EmilienM, just you man | 20:36 |
weshay|ruck | somebody may have killed scenario10 | 20:37 |
EmilienM | weshay|ruck: /me looks at mountains /me loads the car :D | 20:37 |
EmilienM | what's 10 again? ironic? | 20:37 |
weshay|ruck | octavia I think | 20:38 |
weshay|ruck | EmilienM, comments on https://review.opendev.org/#/c/707935/ | 20:38 |
weshay|ruck | same issue here https://caf2f172638deaa44bce-d94eb819944fd5bc8105d713aef77d0b.ssl.cf1.rackcdn.com/707935/1/gate/tripleo-ci-centos-7-scenario010-standalone/817a10a/logs/undercloud/home/zuul/standalone_deploy.log | 20:39 |
weshay|ruck | so that's two hits | 20:39 |
* mwhahaha blames ceph | 20:39 | |
weshay|ruck | outside the gates.. it's fine http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-scenario010-standalone | 20:40 |
mwhahaha | i think tha'ts the bug fultonj is working on to remove the \n's | 20:40 |
* weshay|ruck looks | 20:40 | |
openstackgerrit | Merged openstack/python-tripleoclient master: Remove mistral from the config_download deploy workflow https://review.opendev.org/705793 | 20:40 |
openstackgerrit | Carlos Goncalves proposed openstack/tripleo-heat-templates stable/train: Ensure /var/run/octavia is present upon reboot https://review.opendev.org/708253 | 20:40 |
weshay|ruck | https://bugs.launchpad.net/tripleo/+bug/1863629 | 20:41 |
openstack | Launchpad bug 1863629 in tripleo "tripleo-ansible ceph executions add unwanted newlines when interpolating ansible environment variables" [Medium,In progress] - Assigned to John Fulton (jfulton-org) | 20:41 |
weshay|ruck | that one? | 20:41 |
mwhahaha | sure | 20:41 |
cloudnull | mwhahaha have you seen this - https://bugs.launchpad.net/tripleo/+bug/1863670 - I'm hoping this is just user error, maybe something i've missing from my minion config ? | 20:41 |
openstack | Launchpad bug 1863670 in tripleo "ironic contuctor minions result in nodes with the state "cleaning failed"" [Undecided,New] | 20:41 |
weshay|ruck | yup | 20:42 |
mwhahaha | cloudnull: nope, didn't do much ironic conductor tesating | 20:42 |
cloudnull | it seems its not finding the cleaning network, but idk why | 20:43 |
weshay|ruck | fultonj++ | 20:44 |
cloudnull | does the minion config need the network section from the undercloud.conf? | 20:44 |
fultonj | weshay|ruck: are you saying that 010 has been broken because of new lines in env variables? | 20:44 |
fultonj | i wonder how long it's been like that. | 20:44 |
weshay|ruck | fultonj, about 4 hours | 20:44 |
mwhahaha | cloudnull: no idea, ask someone who knows ironic | 20:44 |
weshay|ruck | fultonj, not long | 20:45 |
fultonj | i opened bug 1863629 for an 001 scenario | 20:45 |
openstack | bug 1863629 in tripleo "tripleo-ansible ceph executions add unwanted newlines when interpolating ansible environment variables" [Medium,In progress] https://launchpad.net/bugs/1863629 - Assigned to John Fulton (jfulton-org) | 20:45 |
mwhahaha | fultonj: why are we trying to pass teh ansible env vars along? seems like we're just goign to keep hitting this stuff forever | 20:45 |
fultonj | mwhahaha: https://review.opendev.org/#/c/674706/ | 20:46 |
fultonj | the commit message of ^ explains why | 20:47 |
mwhahaha | just seems terrible | 20:47 |
*** morazi has quit IRC | 20:47 | |
fultonj | If a config-download user exported a variable, e.g. ANSIBLE_PRIVATE_KEY_FILE, then they might be surprised if they got to the Ceph installation and it failed because Ansible was unable to SSH into the target nodes because it didn't have that environment variable set. | 20:47 |
mwhahaha | seems like a case we shouldn't necessarily support tbh | 20:47 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade stable/train: Switch from using cat to slurp https://review.opendev.org/708254 | 20:48 |
mwhahaha | fultonj: also why not just use the environment: in the shell task to properly set all teh things? | 20:48 |
mwhahaha | this seems like a terrible idea to try and turn all the env vars into a long command line string | 20:49 |
mwhahaha | example, https://review.opendev.org/#/c/706143/15/roles/tripleo_overcloud_image_build/tasks/main.yml@13 | 20:49 |
fultonj | theres a few open questions here | 20:50 |
fultonj | 1. should we do it | 20:50 |
fultonj | 2. if we do how | 20:50 |
fultonj | 3. what the default should be | 20:50 |
fultonj | 4. why this is suddenly breaking when it worked since aug 2019 | 20:50 |
fultonj | 5. why newlines are in the env variables | 20:51 |
fultonj | mwhahaha: i see you have comments on #1 and #2 worth considering | 20:51 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud image build role https://review.opendev.org/706143 | 20:52 |
fultonj | perhaps we shouldnt' inherrit them by default | 20:53 |
weshay|ruck | fultonj, image build is failing? | 20:54 |
mwhahaha | i think that's why we're hitting this now is that we weren't doing them by default until recently right? | 20:54 |
weshay|ruck | probably because of the ironic deps | 20:54 |
weshay|ruck | we have a fix up | 20:54 |
fultonj | i don't see why this should make image build fail | 20:54 |
weshay|ruck | https://review.opendev.org/#/c/707927/ | 20:55 |
mwhahaha | fultonj: so the issue here is that env doesn't return quoted vars | 20:55 |
mwhahaha | fultonj: so it'll always fail if ansible_<something>: contains a space with other bits | 20:55 |
mwhahaha | the issue here being ANSIBLE_SSH_ARGS | 20:56 |
mwhahaha | so if we want to keep this, we should actually parse it into a correct environment structure and either quote all the things or actually handle key: value | 20:57 |
*** jfrancoa has quit IRC | 20:58 | |
fultonj | here --> https://review.opendev.org/#/c/706815 ? | 20:58 |
mwhahaha | i actually don't think there's a \n in the latest failure. I think it's because ANSIBLE_SSH_ARGS value is nto quoted | 20:58 |
fultonj | mwhahaha: you're probably right | 20:58 |
fultonj | are we talking about a review other than https://review.opendev.org/#/c/706815 ? | 20:59 |
fultonj | i heard of scenario010 not 001 | 20:59 |
mwhahaha | i'm just talking about the failure https://caf2f172638deaa44bce-d94eb819944fd5bc8105d713aef77d0b.ssl.cf1.rackcdn.com/707935/1/gate/tripleo-ci-centos-7-scenario010-standalone/817a10a/logs/undercloud/home/zuul/standalone_deploy.log | 20:59 |
fultonj | ah | 20:59 |
*** Goneri has quit IRC | 20:59 | |
openstackgerrit | Merged openstack/tripleo-ansible master: tripleo_container_manage: reduce cleanup when single config is given https://review.opendev.org/707244 | 21:00 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Example overcloud build playbook https://review.opendev.org/706902 | 21:00 |
fultonj | mwhahaha: do you know which patch introduced the "-o foo -o bar" etc? | 21:00 |
fultonj | i'm not saying that patch should be reverted, but i'd like to identify it in the fix | 21:01 |
fultonj | and update https://bugs.launchpad.net/tripleo/+bug/1863629 | 21:01 |
openstack | Launchpad bug 1863629 in tripleo "tripleo-ansible ceph executions add unwanted newlines when interpolating ansible environment variables" [Medium,In progress] - Assigned to John Fulton (jfulton-org) | 21:01 |
mwhahaha | it might not be us, it could just be an ansible version change or something | 21:01 |
mwhahaha | i don't know if ANSIBLE_SSH_ARGS has always been set | 21:02 |
mwhahaha | unfortunately there's too much in flight to probably pin it down, we can look though | 21:02 |
fultonj | i'm inclined to disable the feature to take the heat off | 21:02 |
fultonj | default the inheritance to false | 21:03 |
fultonj | improve the inheritance feature | 21:03 |
fultonj | only maybe default it to true again | 21:03 |
fultonj | ^ mwhahaha weshay|ruck how's that for a plan? | 21:04 |
mwhahaha | seems reasonable | 21:04 |
fultonj | ack | 21:04 |
* fultonj begins | 21:04 | |
* weshay|ruck reads | 21:05 | |
* fultonj will update LP bug description and associated patch | 21:05 | |
mwhahaha | it's likely caused by https://review.opendev.org/#/c/705793/ | 21:05 |
mwhahaha | btw | 21:05 |
weshay|ruck | fultonj, ya.. let's watch your patch through.. it's fine | 21:05 |
weshay|ruck | stuff happens | 21:05 |
mwhahaha | https://review.opendev.org/#/c/705793/21/tripleoclient/utils.py@360 | 21:06 |
mwhahaha | so we can blame cloudnull | 21:06 |
*** jdandrea has quit IRC | 21:06 | |
cloudnull | ? | 21:06 |
weshay|ruck | blame CANADA | 21:06 |
*** morazi has joined #tripleo | 21:06 | |
*** jdandrea has joined #tripleo | 21:06 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Disable paunch on fs050 https://review.opendev.org/708256 | 21:06 |
mwhahaha | cloudnull: by setting ANSIBLE_SSH_ARGS, we've broken ceph's env var inheritiance | 21:07 |
mwhahaha | cloudnull: so that patch broke scenario010 | 21:07 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Disable paunch on fs050 https://review.opendev.org/708256 | 21:07 |
mwhahaha | it's exposed some fragile bits in the ceph roles | 21:07 |
cloudnull | OIC | 21:07 |
EmilienM | weshay|ruck: :-O | 21:07 |
fultonj | cloudnull: fragile bits in ceph roles can be made less fragile | 21:08 |
cloudnull | do we need to just have the ansible commands inherit the whole environment ? | 21:09 |
mwhahaha | well it's inheriting the ANSIBLE_ vars | 21:09 |
cloudnull | or are there a set of ssh options that make sense for ceph ? | 21:09 |
weshay|ruck | EmilienM, https://www.youtube.com/watch?v=bOR38552MJA | 21:09 |
mwhahaha | still not sure it's safe to do that | 21:09 |
mwhahaha | cloudnull: see further up for some backstory | 21:09 |
* cloudnull reading | 21:09 | |
EmilienM | weshay|ruck: is that safe for work? | 21:10 |
EmilienM | ah I know that one lol | 21:10 |
weshay|ruck | :) | 21:10 |
weshay|ruck | reasonable question though | 21:10 |
*** artom has quit IRC | 21:20 | |
openstackgerrit | John Fulton proposed openstack/tripleo-ansible master: Do not inherit the calling ansible env by default https://review.opendev.org/708252 | 21:21 |
*** paramite|clone has quit IRC | 21:25 | |
*** TrevorV has quit IRC | 21:33 | |
openstackgerrit | Merged openstack/tripleo-ansible master: tripleo_container_manage: reduce downtime for minor updates https://review.opendev.org/707710 | 21:34 |
openstackgerrit | Merged openstack/tripleo-ansible master: tripleo_container_manage: avoid excessive logging with podman facts https://review.opendev.org/707859 | 21:34 |
*** jdandrea has quit IRC | 21:39 | |
*** ansmith has quit IRC | 21:40 | |
*** xek has quit IRC | 21:45 | |
openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Revert "Default to zero verbosity when using Ansible." https://review.opendev.org/708208 | 21:50 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Ensures rsync is present on the overcloud nodes https://review.opendev.org/707785 | 21:58 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: WIP: ensure sudo is not called in ci.centos https://review.opendev.org/708264 | 21:58 |
*** morazi has quit IRC | 22:04 | |
*** Goneri has joined #tripleo | 22:04 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add DCN Scale Out Roles https://review.opendev.org/707727 | 22:11 |
*** pkopec has quit IRC | 22:15 | |
*** ansmith has joined #tripleo | 22:15 | |
*** adrianc has quit IRC | 22:15 | |
*** lennyb has quit IRC | 22:17 | |
*** adrianc has joined #tripleo | 22:17 | |
*** slaweq has quit IRC | 22:17 | |
*** lennyb has joined #tripleo | 22:20 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-ci master: add move_bugs to scripts https://review.opendev.org/706970 | 22:22 |
*** raildo has quit IRC | 22:29 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/train: Ensures rsync is present on the overcloud nodes https://review.opendev.org/708270 | 22:36 |
*** rh-jelabarre has quit IRC | 22:44 | |
openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Fix default image registry address lookup https://review.opendev.org/708271 | 22:45 |
*** tkajinam has joined #tripleo | 22:59 | |
*** tkajinam has quit IRC | 22:59 | |
openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates stable/train: Add DCN Scale Out Roles https://review.opendev.org/708272 | 23:01 |
*** tkajinam has joined #tripleo | 23:01 | |
*** openstackstatus has joined #tripleo | 23:02 | |
*** ChanServ sets mode: +v openstackstatus | 23:02 | |
*** ekultails has quit IRC | 23:06 | |
openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Revert "Default to zero verbosity when using Ansible." https://review.opendev.org/708208 | 23:08 |
*** slaweq has joined #tripleo | 23:11 | |
*** slaweq has quit IRC | 23:16 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: [stable/train only] Use service_name in heira for firewall rules https://review.opendev.org/708107 | 23:26 |
openstackgerrit | Merged openstack/tripleo-common stable/train: Revert "Added support of overcloud os_cloud" https://review.opendev.org/706857 | 23:26 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/train: Add novajoin to EndpointMap https://review.opendev.org/706884 | 23:30 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/train: keystone/ldap: add missing cloud name https://review.opendev.org/708044 | 23:30 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Add support to run Container Puppet tasks without Paunch https://review.opendev.org/706890 | 23:41 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the list_available_roles deploy workflow https://review.opendev.org/708276 | 23:43 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add strategy optimization https://review.opendev.org/704691 | 23:44 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add additional strategy optimization https://review.opendev.org/704443 | 23:44 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Client code to do node import with ansible instead of mistral https://review.opendev.org/704561 | 23:46 |
*** tosky has quit IRC | 23:49 | |
*** artom has joined #tripleo | 23:53 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!