| opendevreview | Merged openstack/tripleo-heat-templates stable/wallaby: Do not create mysql user if it already exists https://review.opendev.org/c/openstack/tripleo-heat-templates/+/807642 | 00:55 |
|---|---|---|
| opendevreview | Brendan Shephard proposed openstack/python-tripleoclient master: Fix update run for Ephemeral Heat https://review.opendev.org/c/openstack/python-tripleoclient/+/805575 | 02:13 |
| opendevreview | Michele Baldessari proposed openstack/tripleo-heat-templates master: DNM/DNR drop systemd file limit support https://review.opendev.org/c/openstack/tripleo-heat-templates/+/807815 | 05:11 |
| opendevreview | Michele Baldessari proposed openstack/puppet-tripleo master: DNM/DNR drop systemd file limit support https://review.opendev.org/c/openstack/puppet-tripleo/+/807816 | 05:12 |
| opendevreview | Merged openstack/openstack-tempest-skiplist master: Adding Periodic SC10 standalone ussuri job to skiplist https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/807770 | 05:24 |
| *** pojadhav- is now known as pojadhav | 05:28 | |
| *** ysandeep|out is now known as ysandeep | 05:54 | |
| pdeore | Hello, everyone | 05:54 |
| pdeore | I need a help in enabling a THT parameter in this rdo job , https://review.rdoproject.org/r/c/rdo-jobs/+/33859/7/zuul.d/layout.yaml | 05:55 |
| pdeore | which I'm running against the patch, https://review.opendev.org/c/openstack/tripleo-heat-templates/+/782636 | 05:55 |
| pdeore | so, basically here i want to enable, GlanceEnabledImportMethods: 'glance-direct' | 05:56 |
| pdeore | and want some tempest tests to run for the same | 05:56 |
| ysandeep | pdeore: checking | 05:58 |
| ysandeep | pdeore: what's the issue you are facing currently? | 06:00 |
| *** amoralej|off is now known as amoralej | 06:04 | |
| ysandeep | pdeore: Do you want to know how you can pass GlanceEnabledImportMethods: 'glance-direct' here? I see default is web-download. | 06:05 |
| opendevreview | Bhagyashri Shewale proposed openstack/tripleo-repos master: Add module to generate CentOS Compose repos https://review.opendev.org/c/openstack/tripleo-repos/+/804306 | 06:05 |
| pdeore | ysandeep, hey | 06:05 |
| pdeore | yes i want glance-direct to be set for the about parameter | 06:05 |
| pdeore | can we do that in tha rdo job? | 06:06 |
| ysandeep | pdeore, yes there should be a way.. Give me few mins to check | 06:06 |
| pdeore | yeah sure, Thanks for looking into this.. | 06:07 |
| opendevreview | Jiri Podivin proposed openstack/tripleo-ci master: WIP/DNM - Add fips job https://review.opendev.org/c/openstack/tripleo-ci/+/798948 | 06:13 |
| opendevreview | Sandeep Yadav proposed openstack/tripleo-heat-templates master: [DNM] Temporary patch to test 'glance-direct' https://review.opendev.org/c/openstack/tripleo-heat-templates/+/807823 | 06:16 |
| ysandeep | pdeore: add depends on above ^^ and before in your rdo testpatch | 06:18 |
| ysandeep | ~~~ | 06:18 |
| ysandeep | featureset_override: | 06:18 |
| ysandeep | extra_args: >- | 06:18 |
| ysandeep | -e /usr/share/openstack-tripleo-heat-templates/ci/environments/cutom-glance.yaml | 06:18 |
| ysandeep | ~~~ | 06:18 |
| ysandeep | pdeore: do you mind if I update your test patch | 06:18 |
| pdeore | ysandeep, yeah sure please go ahead :) | 06:19 |
| ysandeep | pdeore: updated, let's see how this goes | 06:23 |
| ysandeep | replaced the previous depends-on as it was already merged | 06:23 |
| pdeore | ysandeep, but you remove my original patch's dependency .. | 06:25 |
| pdeore | how this will be tested now? https://review.opendev.org/c/openstack/tripleo-heat-templates/+/782636/6/deployment/glance/glance-api-container-puppet.yaml | 06:26 |
| pdeore | there is some space left https://review.rdoproject.org/r/c/rdo-jobs/+/33859/7..8/zuul.d/layout.yaml | 06:26 |
| ysandeep | pdeore: ^^ is already merged in tht | 06:27 |
| pdeore | ohh yes, right :) | 06:27 |
| *** slaweq_ is now known as slaweq | 07:06 | |
| opendevreview | Francesco Pantano proposed openstack/tripleo-heat-templates master: DNM - Test Pending Ceph Pacific daemons in CI https://review.opendev.org/c/openstack/tripleo-heat-templates/+/778915 | 07:07 |
| opendevreview | Jiri Podivin proposed openstack/validations-libs master: Validation help improvement https://review.opendev.org/c/openstack/validations-libs/+/807828 | 07:14 |
| opendevreview | Bhagyashri Shewale proposed openstack/tripleo-repos master: Add module to generate CentOS Compose repos https://review.opendev.org/c/openstack/tripleo-repos/+/804306 | 07:24 |
| *** jpena|off is now known as jpena | 07:38 | |
| opendevreview | Bhagyashri Shewale proposed openstack/tripleo-repos master: Add module to generate CentOS Compose repos https://review.opendev.org/c/openstack/tripleo-repos/+/804306 | 07:39 |
| opendevreview | Jiri Podivin proposed openstack/validations-libs master: Validation help improvement https://review.opendev.org/c/openstack/validations-libs/+/807828 | 07:44 |
| opendevreview | Sandeep Yadav proposed openstack/tripleo-quickstart-extras master: Allow Override default network_data/vip yaml https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/806724 | 08:03 |
| opendevreview | mbu proposed openstack/validations-libs master: Expand validations_logs table with reason of failure https://review.opendev.org/c/openstack/validations-libs/+/804392 | 08:05 |
| opendevreview | Marios Andreou proposed openstack/tripleo-repos master: Fix config issue loaded default config and ignoring overrides https://review.opendev.org/c/openstack/tripleo-repos/+/807836 | 08:13 |
| marios | zbr: ^^^ updated and brought the tests from your patch here ^ | 08:14 |
| marios | zbr: ugh... 2 change_id cos I didn't leava space? :/ fixing | 08:14 |
| opendevreview | Marios Andreou proposed openstack/tripleo-repos master: Fix config issue loaded default config and ignoring overrides https://review.opendev.org/c/openstack/tripleo-repos/+/807709 | 08:15 |
| marios | that one :) zbr ^^ | 08:15 |
| opendevreview | Marios Andreou proposed openstack/tripleo-quickstart master: Use tripleo.repos.get_hash in repo-setup role https://review.opendev.org/c/openstack/tripleo-quickstart/+/791486 | 08:43 |
| marios | chandankumar: re-added -p ^^ https://review.opendev.org/c/openstack/tripleo-quickstart/+/791486/51#message-07dbf83cc47da41b41b8711afc522e225f87a403 | 08:43 |
| marios | chandankumar: please add to your reviews list https://review.opendev.org/c/openstack/tripleo-repos/+/807709 | 08:43 |
| opendevreview | Martin Schuppert proposed openstack/tripleo-ansible stable/victoria: tuned: install cpu-partitioning profile by default https://review.opendev.org/c/openstack/tripleo-ansible/+/807758 | 08:55 |
| opendevreview | Martin Schuppert proposed openstack/tripleo-ansible stable/ussuri: tuned: install cpu-partitioning profile by default https://review.opendev.org/c/openstack/tripleo-ansible/+/807759 | 08:56 |
| opendevreview | Martin Schuppert proposed openstack/tripleo-ansible stable/train: tuned: install cpu-partitioning profile by default https://review.opendev.org/c/openstack/tripleo-ansible/+/807760 | 08:56 |
| opendevreview | Bhagyashri Shewale proposed openstack/tripleo-repos master: Add module to generate CentOS Compose repos https://review.opendev.org/c/openstack/tripleo-repos/+/804306 | 09:08 |
| opendevreview | Francesco Pantano proposed openstack/tripleo-heat-templates master: Add CephRbdTrashPurgeInterval parameter https://review.opendev.org/c/openstack/tripleo-heat-templates/+/805987 | 09:14 |
| opendevreview | Arx Cruz proposed openstack/openstack-tempest-skiplist master: Add minimal group https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/807841 | 09:19 |
| opendevreview | Arx Cruz proposed openstack/tripleo-quickstart master: Update minimal featureset to run tempest_allow https://review.opendev.org/c/openstack/tripleo-quickstart/+/807842 | 09:26 |
| opendevreview | Vijayalakshmi proposed openstack/os-net-config master: Update sriov config service to handle nic partitioned PF https://review.opendev.org/c/openstack/os-net-config/+/806561 | 09:32 |
| opendevreview | Merged openstack/tripleo-ansible master: Check whether an HA resource already exists explicitly https://review.opendev.org/c/openstack/tripleo-ansible/+/806610 | 09:33 |
| opendevreview | Harald Jensås proposed openstack/tripleo-quickstart master: Disable protected resourced types in fs010,fs037 https://review.opendev.org/c/openstack/tripleo-quickstart/+/807703 | 09:37 |
| opendevreview | Harald Jensås proposed openstack/tripleo-quickstart master: Re-enable protected resource types https://review.opendev.org/c/openstack/tripleo-quickstart/+/807704 | 09:37 |
| opendevreview | Michele Baldessari proposed openstack/tripleo-ansible stable/wallaby: Check whether an HA resource already exists explicitly https://review.opendev.org/c/openstack/tripleo-ansible/+/807761 | 09:39 |
| opendevreview | Jiri Podivin proposed openstack/python-tripleoclient stable/wallaby: Eliminating a race condition in the export_stack function https://review.opendev.org/c/openstack/python-tripleoclient/+/807845 | 09:39 |
| opendevreview | Bhagyashri Shewale proposed openstack/tripleo-repos master: Add module to generate CentOS Compose repos https://review.opendev.org/c/openstack/tripleo-repos/+/804306 | 09:46 |
| opendevreview | Merged openstack/tripleo-common stable/wallaby: Re-add tripleoclient and tempest container https://review.opendev.org/c/openstack/tripleo-common/+/806521 | 09:50 |
| opendevreview | Bhagyashri Shewale proposed openstack/tripleo-repos master: Ansible's output is missing from molecule commands https://review.opendev.org/c/openstack/tripleo-repos/+/807850 | 09:57 |
| opendevreview | Bhagyashri Shewale proposed openstack/tripleo-repos master: Add module to generate CentOS Compose repos https://review.opendev.org/c/openstack/tripleo-repos/+/804306 | 10:05 |
| opendevreview | Jiri Podivin proposed openstack/tripleo-ci master: WIP/DNM - Add fips job https://review.opendev.org/c/openstack/tripleo-ci/+/798948 | 10:09 |
| opendevreview | Bhagyashri Shewale proposed openstack/tripleo-repos master: Add module to generate CentOS Compose repos https://review.opendev.org/c/openstack/tripleo-repos/+/804306 | 10:11 |
| opendevreview | Merged openstack/tripleo-validations stable/train: remove using containers-prepare-parameter.yaml https://review.opendev.org/c/openstack/tripleo-validations/+/806899 | 10:25 |
| opendevreview | amolkahat proposed openstack/tripleo-operator-ansible master: Added logging vars in tripleo_overcloud_status https://review.opendev.org/c/openstack/tripleo-operator-ansible/+/807852 | 10:30 |
| opendevreview | Merged openstack/tripleo-validations stable/victoria: remove using containers-prepare-parameter.yaml https://review.opendev.org/c/openstack/tripleo-validations/+/806897 | 10:32 |
| opendevreview | amolkahat proposed openstack/tripleo-quickstart-extras master: Added stack_name variable to overcloud-delete defaults https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/805260 | 10:35 |
| opendevreview | Merged openstack/tripleo-repos master: Fix config issue loaded default config and ignoring overrides https://review.opendev.org/c/openstack/tripleo-repos/+/807709 | 10:44 |
| opendevreview | chandan kumar proposed openstack/tripleo-common master: Update tcib for CentOS Stream 9 https://review.opendev.org/c/openstack/tripleo-common/+/800580 | 10:46 |
| *** jcapitao is now known as jcapitao_lunch | 10:54 | |
| jpodivin | ade_lee_: one more thing turned up in relations to fips. If we are going to build the docs for updated, fips compliant tempest, we will have to bump the sphinx to version 3.0.4 or so. Otherwise we will trigger md5 | 11:07 |
| opendevreview | Merged openstack/tripleo-heat-templates master: Check whether an HA resource already exists explicitly https://review.opendev.org/c/openstack/tripleo-heat-templates/+/806611 | 11:18 |
| amar___ | hi team, Could some one pls help me with this I am facing issues while deploying Standalone deployment of RHOSP-16.1. | 11:19 |
| amar___ | "msg": "Paunch failed with config_id tripleo_step2" | 11:19 |
| amar___ | detailed log :- https://paste.opendev.org/raw/808915/ | 11:24 |
| *** jpena is now known as jpena|lunch | 11:30 | |
| opendevreview | Michele Baldessari proposed openstack/tripleo-heat-templates stable/wallaby: Check whether an HA resource already exists explicitly https://review.opendev.org/c/openstack/tripleo-heat-templates/+/807861 | 11:41 |
| *** pojadhav is now known as pojadhav|brb | 12:06 | |
| *** amoralej is now known as amoralej|lunch | 12:09 | |
| opendevreview | Merged openstack/tripleo-heat-templates master: CentOS 9: support restart of HA resources https://review.opendev.org/c/openstack/tripleo-heat-templates/+/807572 | 12:13 |
| *** jcapitao_lunch is now known as jcapitao | 12:18 | |
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Added support for CentOS stream 9 container build https://review.opendev.org/c/openstack/tripleo-ci/+/800577 | 12:23 |
| opendevreview | Michele Baldessari proposed openstack/tripleo-heat-templates stable/wallaby: CentOS 9: support restart of HA resources https://review.opendev.org/c/openstack/tripleo-heat-templates/+/807768 | 12:25 |
| *** jpena|lunch is now known as jpena | 12:34 | |
| *** pojadhav|brb is now known as pojadhav | 12:46 | |
| bogdando | chandankumar: hi, do you know what should be adjusted to have https://review.opendev.org/c/openstack/tripleo-quickstart/+/805953 as well applied to the fs35-wallaby? | 12:54 |
| bogdando | please see https://bugs.launchpad.net/tripleo/+bug/1939023/comments/23 for the context | 12:54 |
| bogdando | the job logs show no signs of that extra env file... | 12:54 |
| bogdando | since there is no branches on quickstart, I thought that change would be automagically caught by all branched fs35 jobs | 12:55 |
| bogdando | weshay|ruck: ^^ | 12:55 |
| bogdando | correction: and *periodic* ones | 12:56 |
| chandankumar | bogdando: regarding env file https://review.opendev.org/c/openstack/tripleo-heat-templates/+/805952 we need to backport this patch to all release and tq deploying specific release have env file via tht rpm | 12:57 |
| bogdando | ohh, indeed | 12:57 |
| bogdando | thanks:) | 12:57 |
| chandankumar | https://review.opendev.org/c/openstack/tripleo-heat-templates/+/807051 got merged for wallaby | 12:57 |
| chandankumar | bogdando: if you do a testproject run of fs35 wallaby you will get the results and file will be there | 12:58 |
| chandankumar | let me do it for you | 12:58 |
| bogdando | many thanks | 12:58 |
| bogdando | so that log was just outdated? | 12:58 |
| bogdando | before the backport happened | 12:58 |
| bogdando | slaweq: hi, ^^ | 12:59 |
| chandankumar | bogdando: https://review.rdoproject.org/zuul/status#805953 | 12:59 |
| chandankumar | sorry | 12:59 |
| chandankumar | bogdando: https://review.rdoproject.org/r/c/testproject/+/35240 | 13:01 |
| bogdando | chandankumar: wait, but the backport was done at Sept 2, and that linked job is by sept 7 https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-wallaby/c3c8003/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 13:01 |
| bogdando | ugh, sorry, I thought https://review.opendev.org/c/openstack/tripleo-quickstart/+/805953 has been already merged | 13:02 |
| opendevreview | Michele Baldessari proposed openstack/tripleo-ansible stable/wallaby: Fix molecule job for tripleo_ha_wrapper https://review.opendev.org/c/openstack/tripleo-ansible/+/807769 | 13:02 |
| opendevreview | Michele Baldessari proposed openstack/tripleo-ansible stable/wallaby: Check whether an HA resource already exists explicitly https://review.opendev.org/c/openstack/tripleo-ansible/+/807761 | 13:03 |
| mwhahaha | weshay|ruck, anbanerj|ruck: can we switch ussuri undercloud upgrade to non-voting? it's holding up landing patches and it's been broken for weeks now | 13:06 |
| weshay|ruck | mwhahaha, looking | 13:07 |
| weshay|ruck | https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-8-standalone-upgrade-ussuri | 13:07 |
| weshay|ruck | aye | 13:07 |
| mwhahaha | i'm still not certain upgrading ovs in train is the right call on that one but i'm trying to avoid that bug at all costs :D | 13:08 |
| weshay|ruck | mwhahaha, bumping it to 2.15 initially? We're going to testproject and see what happens. | 13:13 |
| mwhahaha | yea | 13:13 |
| mwhahaha | i'm sure it'll work but i don't like the fact that we have to roll forward many versions on a stable branch | 13:13 |
| *** chem is now known as Guest6688 | 13:13 | |
| weshay|ruck | aye.. worth poking at, we've had to do this before for basically the same reason. We can fall back to other b.s. hacks | 13:15 |
| mwhahaha | hjensas: so how does one recover from ironic provisioning ending up at a UEFI shell? Seems uefi by default may not be go great | 13:16 |
| bogdando | mwhahaha: maybe better merge https://review.opendev.org/c/openstack/tripleo-quickstart/+/806955 | 13:17 |
| bogdando | and keep it voting | 13:17 |
| bogdando | weshay|ruck: ^^ | 13:17 |
| mwhahaha | yea that way is probably better | 13:17 |
| mwhahaha | for now | 13:17 |
| opendevreview | Ananya proposed openstack/tripleo-ci master: Moving ussuri standalone upgrade to non voting https://review.opendev.org/c/openstack/tripleo-ci/+/807872 | 13:17 |
| bogdando | yup! | 13:17 |
| bogdando | or bring the special magic upstream :) | 13:18 |
| weshay|ruck | we'd need a new patch to work it today.. | 13:18 |
| weshay|ruck | rlandy is out | 13:18 |
| bogdando | hjensas: hi, PTAL https://bugs.launchpad.net/tripleo/+bug/1943018 | 13:19 |
| bogdando | that does not make the jobs failing... but looks funny too much to keep it unfixed | 13:19 |
| *** amoralej|lunch is now known as amoralej | 13:20 | |
| opendevreview | wes hayutin proposed openstack/tripleo-ci master: Moving ussuri standalone upgrade to non voting https://review.opendev.org/c/openstack/tripleo-ci/+/807872 | 13:20 |
| bogdando | ;( | 13:20 |
| weshay|ruck | bogdando, it's just an option | 13:21 |
| weshay|ruck | don't be sad.. | 13:21 |
| weshay|ruck | anbanerj|ruck, do you know if you or rlandy tested https://review.opendev.org/c/openstack/tripleo-quickstart/+/806955 w/ ussuri's standalone upgrade? | 13:21 |
| anbanerj|ruck | weshay|ruck, no, I didnt test | 13:23 |
| weshay|ruck | anbanerj|ruck, check rlandy's test projects as well... let's see it run once at least before making a call between the restart and NV | 13:23 |
| bogdando | thanks weshay|ruck | 13:24 |
| bogdando | you bring the hope | 13:25 |
| anbanerj|ruck | weshay|ruck, i think https://review.rdoproject.org/r/c/testproject/+/35111 | 13:25 |
| bogdando | yay, passed | 13:25 |
| hjensas | mwhahaha: ugh, I did'nt use UEFI much. You can always switch it back to bios for each node. But actual hardware is moving to uefi, keeping bios which does not work with todays hardware is a bad default. | 13:25 |
| weshay|ruck | anbanerj|ruck, yup | 13:25 |
| weshay|ruck | it failed :) | 13:25 |
| weshay|ruck | lolz | 13:25 |
| bogdando | woot | 13:25 |
| bogdando | why zuul CI posted +1 then | 13:26 |
| weshay|ruck | anbanerj|ruck, I'll recheck and look at the error.. you can go after the other items | 13:26 |
| bogdando | ugh | 13:26 |
| bogdando | dat noop | 13:26 |
| weshay|ruck | last one failed | 13:26 |
| weshay|ruck | periodic-tripleo-ci-centos-8-standalone-upgrade-ussuri https://review.rdoproject.org/zuul/build/18ba9ab0ca15475d94e650091351f76c : SUCCESS in 1h 59m 59s (non-voting) | 13:26 |
| weshay|ruck | but that worked | 13:26 |
| bogdando | and the last one finised upgrade, ws that tempest failing | 13:27 |
| anbanerj|ruck | it passed twice in the testP | 13:27 |
| bogdando | oh, ok, that's the same failure as in the bug, right? os_tempest : Ping router ip address | 13:28 |
| bogdando | not good | 13:28 |
| mwhahaha | hjensas: I think it's UEFI with overcloud-full, I'm testing | 13:29 |
| hjensas | mwhahaha: I know stevebaker and TheJulia is having their hands full fixing UEFI weirdness and grub issues. | 13:30 |
| bogdando | so the job goes back to 15 y.o. I guess | 13:30 |
| bogdando | > 3:16:51 PM - mwhahaha: hjensas: so how does one recover from ironic provisioning ending up at a UEFI shell? […] | 13:31 |
| bogdando | plays doom? | 13:31 |
| bogdando | https://doomwiki.org/wiki/Doom_UEFI | 13:32 |
| * TheJulia is waking up | 13:32 | |
| hjensas | bogdando: :D Doom. | 13:32 |
| TheJulia | wait in uefi shell?! | 13:32 |
| bogdando | sure, what is the place hasn't been running yet | 13:32 |
| TheJulia | true | 13:32 |
| hjensas | bogdando: re https://bugs.launchpad.net/tripleo/+bug/1943018, that's a lot of br-ctlplane ips. At first glance this looks like some ceph? node-exported thing is confused. | 13:33 |
| TheJulia | I knew about doom in UEFI, but a deployment dropped you into a UEFI shell, what version of ironic is this, what is the hardware, what type of image was used? | 13:33 |
| bogdando | seems so | 13:33 |
| bogdando | fultonj: ^^ | 13:33 |
| mwhahaha | TheJulia: master, vms, overcloud-full was used | 13:34 |
| hjensas | bogdando: could it be because ... | 13:34 |
| hjensas | 6: br-ctlplane: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 | 13:34 |
| hjensas | inet 192.168.24.1/24 brd 192.168.24.255 scope global br-ctlplane | 13:34 |
| hjensas | valid_lft forever preferred_lft forever | 13:34 |
| hjensas | inet 192.168.24.1/32 brd 192.168.24.1 scope global br-ctlplane | 13:34 |
| hjensas | valid_lft forever preferred_lft forever | 13:34 |
| TheJulia | has master been changed secretly to centos9? | 13:34 |
| hjensas | bogdando: 192.168.24.1 is assigned twice. | 13:34 |
| TheJulia | mwhahaha: I think the agent logs from the deploy would be the next step, /var/log/containers/ironic/deploy/NODEUUID_INSTANCEUUID.tar.gz | 13:36 |
| TheJulia | mwhahaha: asking because we change uefi settings inside of the ramdisk, and it would be good to see what it interpretted/logged before we poke at the UEFI shell | 13:37 |
| fultonj | fmount: ^ fyi | 13:37 |
| fultonj | [09:37] <fultonj> fmount: ^ fyi | 13:38 |
| fmount | mmm | 13:39 |
| * fmount looking | 13:39 | |
| fmount | yeah maybe it's related to: https://tracker.ceph.com/issues/52083 | 13:39 |
| fultonj | fmount: i'm not sure if it's really ceph related | 13:39 |
| fmount | yeah | 13:40 |
| fultonj | but when i saw the repeated addresses it made me think of that same ceph issue | 13:40 |
| fultonj | however, that's just cephadm "over collecting" a known bug | 13:40 |
| mwhahaha | TheJulia: i'll get back to you | 13:40 |
| fultonj | it misreads/overcollects | 13:40 |
| fultonj | but doesn't write back to the host AFAICT | 13:41 |
| fmount | exactly, that's true | 13:41 |
| *** bnemec-pto is now known as bnemec | 13:41 | |
| TheJulia | mwhahaha: bottom line, we explicitly tell where uefi where to find the loader, so something has gone horribly wrong | 13:41 |
| fmount | (and the last patch disables cephadm at step3 to avoid the mgr being killed by oom) | 13:41 |
| fmount | fultonj: fyi this change https://github.com/ceph/ceph/pull/42699 is now backported to pacific | 13:43 |
| * fmount triggering a new job w/ the nightly ceph build | 13:43 | |
| opendevreview | Francesco Pantano proposed openstack/tripleo-heat-templates master: DNM - Test Pending Ceph Pacific daemons in CI https://review.opendev.org/c/openstack/tripleo-heat-templates/+/778915 | 13:44 |
| fmount | fultonj: ^ | 13:44 |
| bogdando | weshay|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart/+/806955 posted a few observations | 13:46 |
| fultonj | thx | 13:46 |
| bogdando | it seems that restart works, but triggers too early | 13:46 |
| opendevreview | James Parker proposed openstack/tripleo-upgrade master: Add different migration actions based on guest https://review.opendev.org/c/openstack/tripleo-upgrade/+/798373 | 13:49 |
| opendevreview | Harald Jensås proposed openstack/tripleo-upgrade master: Add extra_args to update prepare and converge https://review.opendev.org/c/openstack/tripleo-upgrade/+/807879 | 14:05 |
| opendevreview | Harald Jensås proposed openstack/python-tripleoclient master: Deprecate network data v1 definition https://review.opendev.org/c/openstack/python-tripleoclient/+/798642 | 14:06 |
| weshay|ruck | bogdando, /me reading.. ya.. that is too early | 14:08 |
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Added support for CentOS stream 9 container build https://review.opendev.org/c/openstack/tripleo-ci/+/800577 | 14:19 |
| weshay|ruck | bogdando, fyi.. repo-setup runs twice in upgrades.. checking logs to see what happens on the second invocation | 14:31 |
| weshay|ruck | TASK [Standalone upgrade generate new dlrn repo-setup script.] ***************** | 14:32 |
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Added support for CentOS stream 9 container build https://review.opendev.org/c/openstack/tripleo-ci/+/800577 | 14:44 |
| opendevreview | Merged openstack/tripleo-ansible stable/wallaby: The ceph dashboard backends should listen on the storage network https://review.opendev.org/c/openstack/tripleo-ansible/+/807753 | 14:47 |
| opendevreview | Sandeep Yadav proposed openstack/paunch stable/train: Port jobs from Centos7 to Centos8 https://review.opendev.org/c/openstack/paunch/+/807891 | 14:56 |
| *** tosky is now known as Guest6702 | 15:22 | |
| *** tosky_ is now known as tosky | 15:22 | |
| opendevreview | wes hayutin proposed openstack/tripleo-quickstart master: Install and Restart openvswitch for upgrade to ussuri https://review.opendev.org/c/openstack/tripleo-quickstart/+/806955 | 15:30 |
| *** amoralej is now known as amoralej|off | 15:30 | |
| mwhahaha | TheJulia: there is no deploy/ folder | 15:36 |
| mwhahaha | hmm the ironic overcloud-hardened-uefi-full.raw image seems empty. that's probably a problem | 15:38 |
| opendevreview | Ananya proposed openstack/tripleo-ci-health-queries master: Updating query for fs35 wallaby bug https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/807902 | 15:40 |
| TheJulia | mwhahaha: no partition table? | 15:43 |
| opendevreview | Chris Sibbitt proposed openstack/tripleo-ansible master: WIP/DNM Testing fips playbook with metrics_qdr https://review.opendev.org/c/openstack/tripleo-ansible/+/806268 | 15:44 |
| mwhahaha | we don't fail if the source qcow2 was empty | 15:44 |
| mwhahaha | rebuilding my env after fixing that, we'll see in an hour | 15:44 |
| TheJulia | mwhahaha: like 0 bytes size empty? | 15:44 |
| mwhahaha | yes | 15:44 |
| TheJulia | freaky | 15:44 |
| TheJulia | mwhahaha: let me know what you find in an hour or so | 15:45 |
| mwhahaha | https://bugs.launchpad.net/tripleo/+bug/1943055 filed a bug about it -cc stevebaker | 15:46 |
| ade_lee_ | jpodivin, hey - so how is the tripleo-ci job going? | 15:46 |
| TheJulia | mwhahaha: a zero byte check likely should get added in a couple places, fwiw... but I can see it epicly failing deep down in the deploy process | 15:47 |
| ade_lee_ | jpodivin, I see the last one had a failure in the content-provider job and so everything was skipped | 15:47 |
| mwhahaha | TheJulia: yea we can add it in the overcloud image upload to do a image validation check which is at the beginning of the tripleo ingest point at least. but just something for future UX improvements | 15:48 |
| *** marios is now known as marios|out | 15:58 | |
| opendevreview | alexey-mr proposed openstack/os-net-config stable/wallaby: Allow linux tap to use routes https://review.opendev.org/c/openstack/os-net-config/+/807648 | 16:10 |
| opendevreview | alexey-mr proposed openstack/os-net-config stable/ussuri: Allow linux tap to use routes https://review.opendev.org/c/openstack/os-net-config/+/807649 | 16:10 |
| opendevreview | alexey-mr proposed openstack/os-net-config stable/victoria: Allow linux tap to use routes https://review.opendev.org/c/openstack/os-net-config/+/807750 | 16:10 |
| opendevreview | alexey-mr proposed openstack/os-net-config stable/train: Allow linux tap to use routes https://review.opendev.org/c/openstack/os-net-config/+/807751 | 16:11 |
| opendevreview | David Vallee Delisle proposed openstack/tripleo-heat-templates master: Enable support for Libvirt modular daemons https://review.opendev.org/c/openstack/tripleo-heat-templates/+/803915 | 17:00 |
| weshay|ruck | ok.. think that worked https://review.rdoproject.org/zuul/stream/8fee72b3395943068b32497e08ab8060?logfile=console.log https://review.opendev.org/c/openstack/tripleo-quickstart/+/806955 | 17:01 |
| opendevreview | Merged openstack/tripleo-ansible stable/victoria: tuned: install cpu-partitioning profile by default https://review.opendev.org/c/openstack/tripleo-ansible/+/807758 | 17:04 |
| opendevreview | Merged openstack/tripleo-ansible stable/ussuri: tuned: install cpu-partitioning profile by default https://review.opendev.org/c/openstack/tripleo-ansible/+/807759 | 17:04 |
| *** jpena is now known as jpena|off | 17:09 | |
| mwhahaha | TheJulia: yea so we don't create the deploy logs evidently. will try and capture something on the console | 17:25 |
| TheJulia | mwhahaha: was the node in active state? | 17:27 |
| mwhahaha | yes | 17:27 |
| TheJulia | mwhahaha: wow... | 17:27 |
| mwhahaha | the nodes introspect just fine | 17:27 |
| mwhahaha | so it's the deploy owhere it breaks | 17:27 |
| TheJulia | as I would expect, entirely disjointed | 17:27 |
| TheJulia | hmm | 17:28 |
| mwhahaha | this was working with code from last week using overcloud-full, so something's changed recently re: uefi where it's not anymore | 17:28 |
| mwhahaha | will try and scrounge up some logs or additional info | 17:29 |
| mwhahaha | but it's just failing and the nodes are at a uefi shell | 17:29 |
| TheJulia | mwhahaha: so stevebaker has been working on making uefi based images the default... I think he mentioned that merged but I don't know where/what exactly... although maybe gerrit knows :) | 17:32 |
| mwhahaha | yea i went poking, didn't spot anything specific other than the switch | 17:32 |
| mwhahaha | i'll dig further and pester him later when he comes on | 17:32 |
| TheJulia | it occurs to me that we're likely just loading the entire image into ironic. If you can get me the baremetal node show output, that would tell me exactly what is going on with regards to ironic,, since if it is not touching the conductor and only the agent, its a bit of a difficult case to... head off. | 17:33 |
| TheJulia | or at least fail with a "you gave us a bad image" error | 17:33 |
| TheJulia | mwhahaha: and your using the hardened dib template as a base? I wonder if there is an incompatability there since it was partition based and I think steve headed in a LVM path | 17:34 |
| mwhahaha | i'm using the images we publish on images.rdoproject.org | 17:34 |
| mwhahaha | i'm not building | 17:34 |
| mwhahaha | which is what we use in CI so should be good | 17:34 |
| TheJulia | mwhahaha: got a link, I'm going to take apart one of the images | 17:35 |
| mwhahaha | https://images.rdoproject.org/centos8/master/rdo_trunk/tripleo-ci-testing/overcloud-hardened-uefi-full.qcow2 | 17:35 |
| mwhahaha | where's one of the nodes https://paste.centos.org/view/6f372405 | 17:36 |
| mwhahaha | maybe i need to switch something in my libvirt to make uefi to work | 17:36 |
| TheJulia | mwhahaha: I meant when provisioned | 17:36 |
| mwhahaha | k i'll try again | 17:36 |
| TheJulia | mwhahaha: if already uefi vms, it should just work. You mentioned the UEFI shell | 17:37 |
| opendevreview | Merged openstack/tripleo-ansible stable/train: tuned: install cpu-partitioning profile by default https://review.opendev.org/c/openstack/tripleo-ansible/+/807760 | 17:37 |
| mwhahaha | they might not be uefi vms | 17:37 |
| mwhahaha | let me check my vm provisioning | 17:37 |
| mwhahaha | TheJulia: yea looks like it's not booting when provisioning, https://paste.opendev.org/show/809179/ | 17:48 |
| mwhahaha | so introspection so worked fine, the provisioning image not so much | 17:48 |
| TheJulia | mwhahaha: the image appears to be fine https://paste.opendev.org/show/809178/ at least it is not zero bytes and does have a partition tableand all. | 17:48 |
| mwhahaha | let me make sure i don't have some stupid dhcp conflict | 17:48 |
| mwhahaha | i think it was a dnsmasq overlap, let me reset the env | 17:54 |
| TheJulia | that would explain the uefi shell if no dhcp server was responding | 17:57 |
| mwhahaha | yea odd that introspection worked just fine | 17:57 |
| TheJulia | different servers with different address ranges/subnets | 17:58 |
| mwhahaha | not in my env, they overlap in terms of ranges and same interface | 17:58 |
| * mwhahaha shrugs | 17:58 | |
| mwhahaha | TheJulia: yup so it worked this time once i fixed up the host dnsmasq. sorry for the noise | 18:49 |
| TheJulia | mwhahaha: no worries. I'm curious if the bug you created earlier is even valid at all? | 18:51 |
| mwhahaha | it is | 18:52 |
| mwhahaha | because i was able to upload and use a 0 byte image | 18:52 |
| mwhahaha | and by upload i mean we convert from a qcow2 to raw and tell ironic/metalsmith to use it | 18:52 |
| TheJulia | so I'm confused because I thought you indicated you used the upstream image | 18:52 |
| mwhahaha | i did | 18:52 |
| mwhahaha | but i goofed on my wget | 18:52 |
| mwhahaha | so it created a zero by file | 18:52 |
| TheJulia | ahh' | 18:52 |
| TheJulia | funky that the convert didn't throw an error on that | 18:53 |
| mwhahaha | exactly | 18:53 |
| TheJulia | sounds slightly more like a qemu-img bug if it returns with exit code 0 instead of 1 | 18:53 |
| mwhahaha | or we just ignored the code | 18:53 |
| mwhahaha | which is also a possibly | 18:53 |
| TheJulia | eh, it returns a zero | 18:54 |
| TheJulia | I just tried it locally | 18:54 |
| mwhahaha | looks like we do check for success | 18:54 |
| mwhahaha | so yea qemu-img issue i guess | 18:54 |
| TheJulia | \o/ | 18:55 |
| ade_lee_ | weshay|ruck, hey -- I'm looking at the error in https://zuul.opendev.org/t/openstack/build/e31b557d5f494fd4a6fbb26f73a0a5ba | 18:56 |
| ade_lee_ | weshay|ruck, is it a known issue? or is this something new? | 18:56 |
| * weshay|ruck looks | 18:56 | |
| weshay|ruck | ade_lee_, https://d309d76ed3f2d8789e3c-39ac2ea6b70a8aee8c7ab76b5ac78d60.ssl.cf1.rackcdn.com/798948/11/check/tripleo-ci-centos-8-content-provider/e31b557/logs/delorean_logs/component/tempest/47/93/479385c762eac99267e1b236d9e65b897785bd55_dev/index.html https://paste.opendev.org/show/809180/ https://review.opendev.org/c/openstack/tempest/+/807849 | 18:59 |
| weshay|ruck | ade_lee_, that tempest patch is busted when building a rpm | 18:59 |
| ade_lee_ | weshay|ruck, ack - yeah -thanks - just saw that | 18:59 |
| opendevreview | Sandeep Yadav proposed openstack/tripleo-quickstart master: [wip] Remove the obselete featuresets https://review.opendev.org/c/openstack/tripleo-quickstart/+/807936 | 19:03 |
| opendevreview | Sandeep Yadav proposed openstack/tripleo-ci master: [WIP] Remove jobs corresponds to obselete featuresets https://review.opendev.org/c/openstack/tripleo-ci/+/807937 | 19:05 |
| *** ysandeep is now known as ysandeep|out | 19:24 | |
| ade_lee_ | weshay|ruck, so what jpodivin was trying to do with the dependant patch was pull in a later version of sphinx where the problem is fixed. but it seems that the earlier version of sphinx was installed instead | 19:27 |
| ade_lee_ | weshay|ruck, trying to figure out how to force a later version of sphinx | 19:27 |
| opendevreview | Merged openstack/python-tripleoclient stable/wallaby: Eliminating a race condition in the export_stack function https://review.opendev.org/c/openstack/python-tripleoclient/+/807845 | 20:14 |
| opendevreview | wes hayutin proposed openstack/tripleo-quickstart master: openstack-tox-molecule timing out uploading logs https://review.opendev.org/c/openstack/tripleo-quickstart/+/807949 | 20:48 |
| opendevreview | wes hayutin proposed openstack/tripleo-quickstart master: openstack-tox-molecule timing out uploading logs https://review.opendev.org/c/openstack/tripleo-quickstart/+/807949 | 20:51 |
| opendevreview | wes hayutin proposed openstack/tripleo-quickstart-extras master: openstack-tox-molecule timing out uploading logs https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/807952 | 20:53 |
| -opendevstatus- NOTICE: The Gerrit service on review.opendev.org is going offline momentarily for a host migration and zuul upgrade, downtime should be only a few minutes. | 21:07 | |
| opendevreview | Sergii Golovatiuk proposed openstack/python-tripleoclient stable/train: [TRAIN-ONLY] Fix inventory path when upgrading https://review.opendev.org/c/openstack/python-tripleoclient/+/784416 | 22:04 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!