| zaitcev | My overcloud deploy with Metalsmith continues to immediately abort with the lack of Glance in the service catalog: http://people.redhat.com/zaitcev/tmp/20201029_1/ostk_overcloud_deploy.txt | 00:04 |
|---|---|---|
| zaitcev | Why is this happening? Presumably Glance is missing because Nova is missing in the undercloud. | 00:05 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-ansible master: port_map: remove NETWORK_KEYS and SUBNET_KEYS https://review.opendev.org/761030 | 00:09 |
| *** tosky has quit IRC | 00:26 | |
| artom | Y'all know about https://www.tripleos.com/ | 00:27 |
| artom | ? :D | 00:27 |
| *** mmethot_ has quit IRC | 00:51 | |
| *** ramishra has joined #tripleo | 00:55 | |
| openstackgerrit | Takashi Kajinami proposed openstack/tripleo-heat-templates master: Add manila db purge job https://review.opendev.org/746428 | 01:09 |
| *** zzzeek has quit IRC | 01:13 | |
| *** zzzeek has joined #tripleo | 01:16 | |
| openstackgerrit | Takashi Kajinami proposed openstack/tripleo-heat-templates master: Strictly require service token roles https://review.opendev.org/677599 | 01:20 |
| *** lbragstad has joined #tripleo | 01:37 | |
| *** ayoung has quit IRC | 01:38 | |
| *** jmasud has quit IRC | 02:07 | |
| *** lbragstad has quit IRC | 02:13 | |
| *** jmasud has joined #tripleo | 02:15 | |
| *** jmasud has quit IRC | 02:25 | |
| *** tmazur has quit IRC | 02:30 | |
| openstackgerrit | likui proposed openstack/python-tripleoclient master: Use TOX_CONSTRAINTS_FILE https://review.opendev.org/761036 | 02:32 |
| *** lbragstad has joined #tripleo | 02:40 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Fix typo in bond options group var name (1/2) https://review.opendev.org/761039 | 02:50 |
| *** rcernin has quit IRC | 02:50 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-ansible master: Fix typo in network config templates https://review.opendev.org/761040 | 02:51 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Fix typo in bond options group var name (2/2) https://review.opendev.org/761041 | 02:51 |
| *** rcernin has joined #tripleo | 03:01 | |
| *** rcernin has quit IRC | 03:07 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Remove mistral parameters from undercloud.yaml https://review.opendev.org/761042 | 03:09 |
| *** skramaja has joined #tripleo | 03:16 | |
| *** apetrich has quit IRC | 03:19 | |
| *** udesale has joined #tripleo | 03:22 | |
| openstackgerrit | Merged openstack/tripleo-ansible master: Update requirements URLs in tox config https://review.opendev.org/760344 | 03:22 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Drop duplicate paramter NeutronPublicInterface https://review.opendev.org/761043 | 03:23 |
| *** lbragstad has quit IRC | 03:27 | |
| hjensas | artom: " secret Triple "O" sauce. " :D | 03:31 |
| *** rcernin has joined #tripleo | 03:32 | |
| *** lbragstad has joined #tripleo | 03:33 | |
| *** rcernin has quit IRC | 03:40 | |
| *** rcernin has joined #tripleo | 03:40 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-specs master: [WiP] Network Data v2 - node ports spec https://review.opendev.org/760536 | 03:44 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-specs master: [WiP] Network Data v2 - node ports spec https://review.opendev.org/760536 | 03:46 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/stein: Add clear facts to the start of all major playbooks https://review.opendev.org/759303 | 03:59 |
| openstackgerrit | Merged openstack/tripleo-validations master: Update master for stable/victoria https://review.opendev.org/760607 | 03:59 |
| *** jmasud has joined #tripleo | 04:09 | |
| *** rh-jelabarre has quit IRC | 04:27 | |
| *** ykarel|away has joined #tripleo | 04:43 | |
| *** lbragstad has quit IRC | 04:44 | |
| *** ykarel|away is now known as ykarel | 04:47 | |
| *** HardCase has quit IRC | 04:51 | |
| openstackgerrit | Merged openstack/tripleo-validations master: Add Python3 wallaby unit tests https://review.opendev.org/760608 | 04:53 |
| *** HardCase has joined #tripleo | 04:55 | |
| openstackgerrit | Merged openstack/tripleo-validations stable/victoria: Update .gitreview for stable/victoria https://review.opendev.org/760605 | 04:59 |
| openstackgerrit | Merged openstack/tripleo-validations stable/victoria: Update TOX_CONSTRAINTS_FILE for stable/victoria https://review.opendev.org/760606 | 04:59 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/stein: STEIN - reduce upstream coverage https://review.opendev.org/760221 | 04:59 |
| *** ratailor has joined #tripleo | 04:59 | |
| *** saneax has joined #tripleo | 05:06 | |
| *** pojadhav|sick is now known as pojadhav | 05:09 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #tripleo | 05:33 | |
| *** ysandeep|away is now known as ysandeep | 05:53 | |
| *** ysandeep is now known as ysandeep|ruck | 05:53 | |
| *** marios has joined #tripleo | 06:00 | |
| *** jpalanis has joined #tripleo | 06:01 | |
| openstackgerrit | likui proposed openstack/tripleo-ansible master: replace imp module https://review.opendev.org/757679 | 06:02 |
| *** lmiccini has joined #tripleo | 06:35 | |
| *** jfrancoa has joined #tripleo | 06:45 | |
| *** rcernin has quit IRC | 06:45 | |
| openstackgerrit | Pooja Jadhav proposed openstack/tripleo-ci master: DNM : Add build-image jobs for stable/victoria jobs https://review.opendev.org/761059 | 06:48 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart master: use py3 for tq on centos 7.8+ https://review.opendev.org/758453 | 06:50 |
| *** karthiks has joined #tripleo | 06:58 | |
| *** hakhande has joined #tripleo | 06:59 | |
| hakhande | skramaja, ping | 06:59 |
| skramaja | yes hakhande | 06:59 |
| hakhande | mwhahaha, ping | 07:00 |
| openstackgerrit | Sandeep Yadav proposed openstack/tripleo-quickstart master: [wip] Test installing older openjdk package https://review.opendev.org/761061 | 07:01 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Workaround for jdk zstream breaking freeipa install https://review.opendev.org/760994 | 07:04 |
| *** bandini has joined #tripleo | 07:06 | |
| Tengu | hakhande: mwhahaha: is in North America - deeply asleep :) | 07:09 |
| Tengu | hmmm, is the CI really green? I have some doubts.. | 07:10 |
| *** frenzy_friday has quit IRC | 07:10 | |
| *** amoralej|off is now known as amoralej | 07:10 | |
| ysandeep|ruck | Tengu, hi o/ which job failing for you :) | 07:11 |
| *** ramishra has quit IRC | 07:14 | |
| Tengu | ysandeep|ruck: not failing. just taking 9+ hours.... | 07:14 |
| Tengu | i.e. gate seems to be clogged | 07:15 |
| Tengu | ysandeep|ruck: aaannd... I think I've seen something about "error locating item named "manifest" for image with ID "ab4acfea2fd3eb3ac8be35ad185a11931d77b965b87f6192b80d50befb15c48e": file does not exist" - it's hitting randomly, isn't it? | 07:17 |
| Tengu | for instance https://4df4f93294a075e54cb3-43d1ee02bfc31d9313394c40dcba45c9.ssl.cf5.rackcdn.com/760901/1/gate/tripleo-ci-centos-8-content-provider/c612353/logs/undercloud/home/zuul/container_image_build.log - in gate | 07:17 |
| Tengu | failed the content-provider job, so everything behind it is basically dead :( | 07:17 |
| ysandeep|ruck | Tengu, ack i will keep an eye on gate clogging, checking ^^ | 07:18 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-upgrade master: Update zuul layout with content provider jobs + improve coverage https://review.opendev.org/760900 | 07:18 |
| Tengu | dang... there are jobs with 14h+ in there X( | 07:19 |
| ysandeep|ruck | Tengu, we have bug for content provider job sometime failing - https://bugs.launchpad.net/tripleo/+bug/1901753 | 07:20 |
| openstack | Launchpad bug 1901753 in tripleo "Building container fails because manifest is not found" [Critical,Triaged] | 07:20 |
| ysandeep|ruck | We have submit an issue with buildah https://github.com/containers/buildah/issues/2727 | 07:21 |
| Tengu | ysandeep|ruck: ah! thanks - I wasn't 100% sure if my memory was good :) | 07:22 |
| ysandeep|ruck | Tengu, and i just check gate queue also, jobs are progressing there, hopefully it will clear soon :) | 07:23 |
| Tengu | ysandeep|ruck: ok. so I'll go get some coffee. | 07:24 |
| ysandeep|ruck | :) yeah please | 07:24 |
| *** pcaruana has joined #tripleo | 07:25 | |
| *** ramishra has joined #tripleo | 07:37 | |
| openstackgerrit | Martin Schuppert proposed openstack/python-tripleoclient stable/train: [train/stein] Handle UseTLSTransportForNbd for previous created envs https://review.opendev.org/760789 | 07:37 |
| openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Revert "Revert "Update horizon manifest to use new ssl variable names"" https://review.opendev.org/761065 | 07:38 |
| openstackgerrit | Takashi Kajinami proposed openstack/tripleo-heat-templates master: Revert "Revert "Use the appropriate name for horizon ssl ca parameter"" https://review.opendev.org/761066 | 07:38 |
| *** jbadiapa has joined #tripleo | 07:41 | |
| hakhande | Tengu, ohh, thanks, I shouldn't disturb beautiful dreams then :-) | 07:48 |
| *** bogdando has joined #tripleo | 07:49 | |
| Tengu | hakhande: :) | 07:50 |
| Tengu | hakhande: may I help you? | 07:51 |
| *** hakhande has quit IRC | 07:53 | |
| *** hakhande_ has joined #tripleo | 07:54 | |
| *** ccamacho has joined #tripleo | 07:54 | |
| *** zzzeek has quit IRC | 07:55 | |
| *** zzzeek has joined #tripleo | 07:56 | |
| *** karthiks has quit IRC | 07:57 | |
| *** hakhande_ has quit IRC | 07:58 | |
| *** hakhande has joined #tripleo | 07:59 | |
| *** hakhande has quit IRC | 07:59 | |
| *** hakhande has joined #tripleo | 08:00 | |
| *** slaweq has joined #tripleo | 08:01 | |
| openstackgerrit | Merged openstack/tripleo-validations stable/train: Optimize container_cli usage by mysql-open-files-limit validation https://review.opendev.org/760688 | 08:02 |
| *** jcapitao has joined #tripleo | 08:05 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/python-tripleoclient stable/ussuri: [ussuri] Migrate to content provider jobs/template https://review.opendev.org/757836 | 08:11 |
| *** apetrich has joined #tripleo | 08:17 | |
| *** rpittau|afk is now known as rpittau | 08:19 | |
| openstackgerrit | Merged openstack/tripleo-ci master: Add job definition for victoria content-provider https://review.opendev.org/759654 | 08:23 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove the ineffective AdminEmail parameter https://review.opendev.org/759809 | 08:23 |
| *** abdysn has joined #tripleo | 08:25 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Workaround for jdk zstream breaking freeipa install https://review.opendev.org/760994 | 08:25 |
| openstackgerrit | Bhagyashri Shewale proposed openstack/tripleo-ci master: Add containers multinode stable/victoria jobs https://review.opendev.org/759823 | 08:28 |
| *** frenzyfriday has joined #tripleo | 08:29 | |
| *** gfidente has joined #tripleo | 08:35 | |
| *** tosky has joined #tripleo | 08:40 | |
| openstackgerrit | likui proposed openstack/tripleo-common master: Use TOX_CONSTRAINTS_FILE https://review.opendev.org/761085 | 08:42 |
| *** ykarel has quit IRC | 08:42 | |
| *** matbu has quit IRC | 08:51 | |
| *** matbu has joined #tripleo | 08:52 | |
| *** jpena|off is now known as jpena | 08:56 | |
| *** pojadhav is now known as pojadhav|lunch | 08:57 | |
| *** ysandeep|ruck is now known as ysandeep|lunch | 08:58 | |
| *** jpich has joined #tripleo | 09:01 | |
| *** lyarwood has quit IRC | 09:01 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Workaround for jdk zstream breaking freeipa install https://review.opendev.org/760994 | 09:04 |
| *** lucasagomes has joined #tripleo | 09:04 | |
| openstackgerrit | Daniel Bengtsson proposed openstack/tripleo-upgrade master: Add setuptools in requirements file. https://review.opendev.org/756009 | 09:04 |
| *** apetrich has quit IRC | 09:09 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add SendQueueLimit to collectd-amqp1 https://review.opendev.org/755288 | 09:19 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Cleanup unused parameters from nova templates https://review.opendev.org/759806 | 09:19 |
| *** apetrich has joined #tripleo | 09:24 | |
| *** pojadhav|lunch is now known as pojadhav | 09:27 | |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-heat-templates master: node_exporter_container_image is needed in 'all' group https://review.opendev.org/760217 | 09:31 |
| *** dtantsur|afk is now known as dtantsur | 09:35 | |
| *** derekh has joined #tripleo | 09:37 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Workaround for jdk zstream breaking freeipa install https://review.opendev.org/760994 | 09:40 |
| openstackgerrit | Merged openstack/tripleo-repos master: Add 8-stream repo support https://review.opendev.org/760584 | 09:41 |
| *** frenzy_friday has joined #tripleo | 09:42 | |
| *** frenzyfriday has quit IRC | 09:44 | |
| Tengu | hmmm.... can anyone from CI help me understand what's going on in this job? https://91ff29b727df918ccc6e-8f5f018882d3021118fd2a10a0e880db.ssl.cf5.rackcdn.com/760911/1/check/openstacksdk-functional-devstack-tips/9a58aa9/job-output.txt | 09:47 |
| Tengu | ysandeep|lunch: when you're back maybe? or marios ? :) -^ | 09:47 |
| Tengu | ah... Nov 02 15:07:28 ubuntu-bionic-ovh-bhs1-0021354473 kernel: oom_reaper: reaped process 4350 (python), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB | 09:51 |
| Tengu | oomkiller playing games on that one. great. | 09:51 |
| Tengu | Nov 02 15:07:28 ubuntu-bionic-ovh-bhs1-0021354473 kernel: Out of memory: Kill process 4350 (python) score 163 or sacrifice child | 09:51 |
| marios | o/ Tengu | 09:53 |
| *** sshnaidm|afk is now known as sshnaidm|rover | 09:56 | |
| Tengu | marios: heya :) So it seems we get some resources issues on 2 jobs in train | 09:57 |
| Tengu | https://review.opendev.org/#/c/760911/1 related patch | 09:57 |
| Tengu | it's failing on the very same jobs, with an oomkiller. | 09:57 |
| marios | Tengu: k but those are not our jobs | 10:00 |
| marios | Tengu: i mean that is openstack/keystoneauth | 10:00 |
| Tengu | marios: meh... where shall I go complaining then | 10:01 |
| openstackgerrit | Matthias Runge proposed openstack/tripleo-heat-templates stable/victoria: Add SendQueueLimit to collectd-amqp1 https://review.opendev.org/761103 | 10:01 |
| *** ysandeep|lunch is now known as ysandeep|ruck | 10:02 | |
| marios | Tengu: no idea probably whoever is core on that repo will know | 10:02 |
| marios | Tengu: but it doesn't appear to be a general thing yet https://zuul.opendev.org/t/openstack/builds?job_name=openstacksdk-functional-devstack-tips&project=openstack/keystoneauth | 10:02 |
| marios | Tengu: well, it might be a general thing it just isn't running very often | 10:03 |
| marios | Tengu: cant even find where the job is defined http://codesearch.openstack.org/?q=openstacksdk-functional-devstack-tips-python2 | 10:04 |
| Tengu | "great"... | 10:05 |
| *** ykarel has joined #tripleo | 10:06 | |
| Tengu | is there any keystone related channel in here | 10:06 |
| Tengu | ah, there is. | 10:06 |
| Tengu | openstack-keystone. | 10:06 |
| Tengu | let's go. | 10:06 |
| tosky | Tengu: generally speaking: http://eavesdrop.openstack.org/ | 10:08 |
| ysandeep|ruck | hmm, very less patches goes in that repo for stable/train.. but build history is not good - 4/4 failed , and last green job was in August - https://zuul.openstack.org/builds?job_name=openstacksdk-functional-devstack-tips&branch=stable%2Ftrain , could be an issue with job itself.. not sure though | 10:09 |
| Tengu | tosky: seems to be related to the meetings, not really channels.. ? | 10:10 |
| tosky | Tengu: not only | 10:10 |
| Tengu | ysandeep|ruck: yeah... trying to get some attention on #openstack-keystone | 10:10 |
| Tengu | tosky: at least, that's what matches "keystone" on that page. | 10:10 |
| Tengu | more http://eavesdrop.openstack.org/irclogs/ then | 10:10 |
| tosky | Tengu, marios : also, the prefix should help; with an "openstacksdk-" prefix I would look into the openstacksdk repository | 10:11 |
| marios | tosky: o/ thanks | 10:13 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-ci master: Adds layouts for victoria upgrade and update jobs https://review.opendev.org/760323 | 10:15 |
| *** Abdallahyas has joined #tripleo | 10:17 | |
| Tengu | last patch in openstacksdk is 5 months old... | 10:17 |
| Tengu | so not really the source of the issue, imho. | 10:17 |
| ysandeep|ruck | got the job definitions - https://opendev.org/openstack/openstacksdk/src/branch/stable/train/.zuul.yaml#L178-L199 | 10:20 |
| *** abdysn has quit IRC | 10:20 | |
| Tengu | shall we pass them to non-voting? | 10:21 |
| Tengu | ysandeep|ruck: any idea where we can find how much memory is in the node? | 10:26 |
| * Tengu trying to follow the job definition | 10:26 | |
| Tengu | https://opendev.org/openstack/devstack/src/branch/stable/train/.zuul.yaml#L177 higher parent I could find... | 10:27 |
| ysandeep|ruck | i think its should be 8gb.. checking https://91ff29b727df918ccc6e-8f5f018882d3021118fd2a10a0e880db.ssl.cf5.rackcdn.com/760911/1/check/openstacksdk-functional-devstack-tips/9a58aa9/zuul-info/host-info.controller.yaml | 10:27 |
| Tengu | oh. nice catch. I was trying to find info in the controller directly | 10:28 |
| Tengu | yeah. seems to be 8gb without any swap. | 10:28 |
| Tengu | no wonder. | 10:28 |
| sshnaidm|rover | Tengu, you can add role that adding swap | 10:32 |
| Tengu | hmm | 10:32 |
| Tengu | sshnaidm|rover: just got a ping on the other channel - they are testing https://review.opendev.org/#/c/757488/ | 10:33 |
| sshnaidm|rover | openstack-zuul-jobs/roles/configure-swap | 10:33 |
| ysandeep|ruck | https://91ff29b727df918ccc6e-8f5f018882d3021118fd2a10a0e880db.ssl.cf5.rackcdn.com/760911/1/check/openstacksdk-functional-devstack-tips/9a58aa9/job-output.txt seems to calling that role - configure-swap | 10:36 |
| ysandeep|ruck | its setting swap at later stage to 1G in this case | 10:37 |
| ysandeep|ruck | i recall an older patch where we reduced default swap size https://review.opendev.org/#/c/750941/ | 10:39 |
| ysandeep|ruck | bad thing is older good job are not accessible anymore, so we can't check swap size there | 10:39 |
| ysandeep|ruck | Tengu, ^^ fyi.. may be it all started after https://review.opendev.org/#/c/750941/ | 10:41 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: ROCKY - reduce upstream coverage https://review.opendev.org/760244 | 10:45 |
| *** d34dh0r53 has quit IRC | 10:50 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/ussuri: Run online migration tasks from external_update_tasks too. https://review.opendev.org/759725 | 11:06 |
| Tengu | ysandeep|ruck: yeah - that one might get reverted | 11:08 |
| Tengu | or, at least, the size | 11:09 |
| Tengu | iirc... there were already things about that in some other project. | 11:09 |
| ykarel | Tengu, we hit in tripleo, and we increased the size for tripleo jobs | 11:09 |
| openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/tripleo-ansible master: Support tox for ansible v2.10 https://review.opendev.org/761106 | 11:10 |
| Tengu | ykarel: ah, that was it! | 11:10 |
| ykarel | Tengu, https://review.opendev.org/#/c/752187/2/roles/prepare-node/tasks/main.yaml | 11:10 |
| Tengu | ykarel: thanks for the pointers! | 11:11 |
| *** soniya29 is now known as soniya29|afk | 11:11 | |
| *** dtantsur is now known as dtantsur|bbl | 11:16 | |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-heat-templates master: Always set dashboard_protocol when Ceph Dashboard is enabled https://review.opendev.org/761110 | 11:20 |
| *** pcaruana has quit IRC | 11:20 | |
| *** udesale_ has joined #tripleo | 11:21 | |
| *** udesale has quit IRC | 11:24 | |
| openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/tripleo-ansible master: Add CI molecule job for ansible modules future https://review.opendev.org/761112 | 11:26 |
| *** pcaruana has joined #tripleo | 11:33 | |
| *** jcapitao is now known as jcapitao_lunch | 11:36 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/train: [c7-train] Switch c7 jobs to content provider https://review.opendev.org/759738 | 11:46 |
| *** rfolco has joined #tripleo | 12:00 | |
| *** ratailor has quit IRC | 12:22 | |
| *** raildo has joined #tripleo | 12:25 | |
| *** rlandy has joined #tripleo | 12:26 | |
| *** boazel has quit IRC | 12:27 | |
| *** jcapitao_lunch is now known as jcapitao | 12:27 | |
| *** boazel has joined #tripleo | 12:28 | |
| sshnaidm|rover | mwhahaha, do you know why we run yum_update.sh in containers during the deploy? wrt errors like http://paste.openstack.org/show/799644/ | 12:30 |
| *** jpena is now known as jpena|lunch | 12:32 | |
| openstackgerrit | Pooja Jadhav proposed openstack/tripleo-ci master: DNM : Add build-image jobs for stable/victoria jobs https://review.opendev.org/761059 | 12:32 |
| *** boazel_ has joined #tripleo | 12:33 | |
| *** boazel has quit IRC | 12:34 | |
| *** shyamb has joined #tripleo | 12:34 | |
| *** waleedm has joined #tripleo | 12:38 | |
| *** waleedm_ has joined #tripleo | 12:38 | |
| *** waleedm_ has quit IRC | 12:38 | |
| *** shyamb has quit IRC | 12:48 | |
| *** morazi has quit IRC | 12:51 | |
| *** lbragstad has joined #tripleo | 12:53 | |
| *** ccamacho has quit IRC | 12:54 | |
| *** dtantsur|bbl is now known as dtantsur | 12:54 | |
| *** amoralej is now known as amoralej|lunch | 12:56 | |
| *** morazi has joined #tripleo | 12:57 | |
| *** lbragstad has quit IRC | 13:06 | |
| *** rh-jelabarre has joined #tripleo | 13:07 | |
| *** lbragstad has joined #tripleo | 13:09 | |
| bogdando | what job do we have in upsteam CI that covers https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/deployment/nova/nova-az-config.yaml#L82 | 13:14 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Do not set update_containers_append_tag for consumer jobs https://review.opendev.org/761137 | 13:15 |
| rlandy | marios: ^^ | 13:15 |
| marios | rlandy: ack will check in sec | 13:16 |
| *** rh-jelabarre has quit IRC | 13:17 | |
| *** rh-jelabarre has joined #tripleo | 13:17 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-ci master: Make minion jobs use the content provider in pipeline https://review.opendev.org/760929 | 13:25 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP - IPA test adding all forwarders https://review.opendev.org/757943 | 13:27 |
| *** derekh has quit IRC | 13:27 | |
| openstackgerrit | Raildo Mascena proposed openstack/puppet-tripleo master: Adding key_size option on the certmonger_certificate function https://review.opendev.org/757142 | 13:29 |
| *** mmethot has joined #tripleo | 13:31 | |
| *** jpena|lunch is now known as jpena | 13:32 | |
| *** raukadah is now known as chandankumar | 13:32 | |
| *** jpich has quit IRC | 13:36 | |
| *** jpich has joined #tripleo | 13:37 | |
| openstackgerrit | zbr proposed openstack/tripleo-ci master: Contain molecule specific changes https://review.opendev.org/758558 | 13:38 |
| mwhahaha | sshnaidm|rover: which job did that come from? check the container-image-prepare to make sure it doesn't have the update references still | 13:40 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart master: use py3 for tq on centos 7.8+ https://review.opendev.org/758453 | 13:40 |
| sshnaidm|rover | mwhahaha, I saw in ovb and standalone jobs | 13:41 |
| *** slaweq has quit IRC | 13:42 | |
| mwhahaha | sshnaidm|rover: modify_vars needs to be droppped https://logserver.rdoproject.org/21/760921/1/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/3497659/logs/undercloud/home/zuul/containers-prepare-parameter.yaml.txt.gz | 13:42 |
| sshnaidm|rover | mwhahaha, yeah, it has modiy-role, in periodic | 13:42 |
| mwhahaha | if we have a content provider | 13:42 |
| sshnaidm|rover | mwhahaha, it's promotion jobs, not a content provider | 13:43 |
| mwhahaha | k then that's why | 13:43 |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Filter computes with nova_host defined https://review.opendev.org/761151 | 13:43 |
| sshnaidm|rover | but I don't think we need to use it in promotion jobs? | 13:43 |
| * mwhahaha shrugs | 13:43 | |
| sshnaidm|rover | we anyway build containers there | 13:43 |
| mwhahaha | then no you wouldnt' need it | 13:43 |
| sshnaidm|rover | mwhahaha, and aside, can we have logs from these failed yum runs? | 13:44 |
| mwhahaha | they should be in an ansible log | 13:44 |
| mwhahaha | we output them seperately | 13:44 |
| mwhahaha | for readability sake | 13:44 |
| sshnaidm|rover | found only error running [bash -x /tmp/yum_update.sh delorean-current] in container \\\"openstack-rabbitmq-working-container\\\": error while running runtime: exit status 1 | 13:45 |
| sshnaidm|rover | but not actual logs of yum_update | 13:45 |
| sshnaidm|rover | and "standard_init_linux.go:211: exec user process caused \"exec format error\" | 13:46 |
| mwhahaha | cloudnull might have more info, pretty sure we record them somewhere | 13:46 |
| sshnaidm|rover | cloudnull, do you know maybe? ^ | 13:46 |
| mwhahaha | hence why i asked for the job logs | 13:46 |
| mwhahaha | :D | 13:46 |
| *** slaweq has joined #tripleo | 13:47 | |
| * cloudnull looking | 13:48 | |
| *** jpich has quit IRC | 13:50 | |
| cloudnull | In the users home folder there should be an ansible.log for local runs. If this is a yum failure in the container there should be a build log in the container sub directory. | 13:50 |
| *** jpich has joined #tripleo | 13:51 | |
| cloudnull | Assuming we’re talking about container builds) | 13:51 |
| mwhahaha | modifications, not builds | 13:52 |
| cloudnull | Using the modify role? | 13:52 |
| mwhahaha | ya | 13:52 |
| cloudnull | Then there should be an ansible.log in ~/ from the client execution. | 13:53 |
| * cloudnull unless we changed that ? | 13:53 | |
| openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-ansible master: Allow to disable GSSAPI authentication https://review.opendev.org/759057 | 13:53 |
| mwhahaha | not that i'm aware of, though we've broken it in the past | 13:53 |
| cloudnull | A distinct possibility :) | 13:54 |
| openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-ansible master: Kill sudo once we don't need it anymore https://review.opendev.org/761154 | 13:55 |
| *** efoley has joined #tripleo | 13:59 | |
| *** amoralej|lunch is now known as amoralej | 14:02 | |
| *** derekh has joined #tripleo | 14:05 | |
| *** d34dh0r53 has joined #tripleo | 14:10 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix MetricsQdrUseSSL value https://review.opendev.org/758251 | 14:11 |
| openstackgerrit | Nicolas Hicher proposed openstack/diskimage-builder master: yum-minimal: Add centos-stream-repos package for centos-8-stream https://review.opendev.org/760951 | 14:11 |
| *** jamesdenton has joined #tripleo | 14:17 | |
| *** saneax has quit IRC | 14:19 | |
| *** saneax has joined #tripleo | 14:20 | |
| sshnaidm|rover | cloudnull, there is ansible.log, but no errors from the script there: https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario002-standalone-master/c425eec/logs/undercloud/home/zuul/ | 14:21 |
| *** udesale_ has quit IRC | 14:23 | |
| sshnaidm|rover | and I don't see containers stdouts | 14:23 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP Allow to specify a nic for the VIPs https://review.opendev.org/760640 | 14:23 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/python-tripleoclient master: Logging refactor https://review.opendev.org/760980 | 14:23 |
| openstackgerrit | John Fulton proposed openstack/tripleo-specs master: Introduce tripleo-ceph spec https://review.opendev.org/723108 | 14:26 |
| *** pojadhav is now known as pojadhav|brb | 14:26 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-validations master: Add validation to verify undercloud.conf content. https://review.opendev.org/761162 | 14:27 |
| openstackgerrit | Merged openstack/tripleo-validations stable/ussuri: [USSURI-ONLY] Remove undercloud_cpu molecule job from zuul jobs https://review.opendev.org/760329 | 14:30 |
| cloudnull | sshnaidm|rover looking at the logs, all I see is the failure from executing [bash -x /tmp/yum_update.sh delorean-current] which I'm guessing is stdout trapped within the container itself | 14:30 |
| sshnaidm|rover | cloudnull, yeah | 14:30 |
| *** abdysn has joined #tripleo | 14:31 | |
| cloudnull | there is a task `TASK | Run yum_update.sh` | 14:31 |
| cloudnull | maybe we can trap the stdout / stderr and print on failure? | 14:31 |
| *** tmazur has joined #tripleo | 14:31 | |
| cloudnull | https://github.com/openstack/ansible-role-tripleo-modify-image/blob/4130a447d49498a8c2595acc04676547bd034fb9/tasks/yum_update_buildah.yml#L104-L123 | 14:32 |
| mwhahaha | can we capture stdout to /var/log/containers/stdout? | 14:32 |
| sshnaidm|rover | cloudnull, yeah, would be useful | 14:32 |
| mwhahaha | instead | 14:32 |
| cloudnull | oh that might be good | 14:33 |
| *** Abdallahyas has quit IRC | 14:33 | |
| cloudnull | I dont see var/log/containers here - https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario002-standalone-master/c425eec/logs/undercloud/var/log/ | 14:34 |
| mwhahaha | we create that as part of teh deploy | 14:34 |
| cloudnull | so yeah if we could capture all of that dir, I think that would be super useful | 14:34 |
| mwhahaha | so since this is prior to that, it hasnt been created yet | 14:34 |
| cloudnull | oic | 14:34 |
| * cloudnull wonders if we can log stdout from buildah? | 14:34 | |
| *** Goneri has joined #tripleo | 14:36 | |
| mwhahaha | hberaud: do you mind if i take over https://github.com/containers/podman-py/pull/27 | 14:39 |
| hberaud | mwhahaha: feel free | 14:40 |
| mwhahaha | cool thanks | 14:40 |
| hberaud | mwhahaha: if you submit patches don't hesitate to ask for reviews if needed | 14:42 |
| mwhahaha | hberaud: will do. i appreciate it | 14:43 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/python-tripleoclient master: Logging refactor https://review.opendev.org/760980 | 14:43 |
| *** ykarel is now known as ykarel|away | 14:44 | |
| *** lmiccini has quit IRC | 14:45 | |
| *** TrevorV has joined #tripleo | 14:48 | |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-heat-templates master: Always set dashboard_protocol when Ceph Dashboard is enabled https://review.opendev.org/761110 | 14:53 |
| *** ysandeep|ruck is now known as ysandeep|away | 14:55 | |
| *** lmiccini has joined #tripleo | 14:55 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add support for skiping tests based on deployment type https://review.opendev.org/759211 | 14:59 |
| openstackgerrit | Merged openstack/paunch stable/train: [c7-train] Switch c7 jobs to content provider https://review.opendev.org/759741 | 14:59 |
| bogdando | mwhahaha, cloudnull: JFYI for *better* capturing of *.log files, by some matchning nested subdirs, of unpredictable */*/... depth, you'll need https://review.opendev.org/#/c/759663/ | 15:00 |
| openstackgerrit | Bob Fournier proposed openstack/diskimage-builder master: Add support for vlan interfaces in dhcp-all-interfaces.sh https://review.opendev.org/761177 | 15:05 |
| *** skramaja has quit IRC | 15:13 | |
| *** ykarel|away has quit IRC | 15:14 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: the tag for building rpms should be build https://review.opendev.org/759912 | 15:14 |
| openstackgerrit | Ronelle Landy proposed openstack/os-net-config stable/queens: [CentOS-7] Migrate to content provider jobs/templates https://review.opendev.org/760094 | 15:15 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-ansible stable/ussuri: [ussuri] Added remove_tags to zuul jobs. https://review.opendev.org/759821 | 15:18 |
| *** sanjayu_ has joined #tripleo | 15:21 | |
| *** saneax has quit IRC | 15:24 | |
| *** abdysn has quit IRC | 15:35 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-specs master: Introduce tripleo-ceph spec https://review.opendev.org/723108 | 15:40 |
| *** HardCase has quit IRC | 15:41 | |
| openstackgerrit | amolkahat proposed openstack/tripleo-ci master: Add c7 content provider jobs in new template https://review.opendev.org/759985 | 15:44 |
| *** bnemec has quit IRC | 15:50 | |
| sshnaidm|rover | if someone is interested, there is "Podman community meeting" starting in 5 min: https://bluejeans.com/796412039 & https://hackmd.io/fc1zraYdS0-klJ2KJcfC7w | 15:52 |
| *** pojadhav|brb is now known as pojadhav | 15:54 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-ci master: WIP - moving multi parent upgrade jobs to branch templates https://review.opendev.org/761188 | 16:05 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: WIP - wire up master standalone-upgrade content provider template https://review.opendev.org/761189 | 16:06 |
| marios | sshnaidm|rover: weshay|ruck: maybe ^^^ not sure if it works yet | 16:06 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: WIP - wire up victoria standalone-upgrade content provider template https://review.opendev.org/761190 | 16:08 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-ci master: WIP - moving multi parent upgrade jobs to branch templates https://review.opendev.org/761188 | 16:09 |
| weshay|ruck | marios, ah.. yes .. branched | 16:11 |
| weshay|ruck | marios, we should chat about the goals of these templates for a hot sec | 16:11 |
| *** shyamb has joined #tripleo | 16:11 | |
| weshay|ruck | if you have time.. or can be later this week | 16:11 |
| *** shyamb has quit IRC | 16:12 | |
| *** sanjayu_ has quit IRC | 16:13 | |
| *** amoralej is now known as amoralej|off | 16:13 | |
| *** sanjayu_ has joined #tripleo | 16:13 | |
| openstackgerrit | amolkahat proposed openstack/tripleo-ci master: Add c7 content provider jobs in new template https://review.opendev.org/759985 | 16:14 |
| marios | weshay|ruck: sure, but the goal is as written on the commit message https://review.opendev.org/761188 try to reduce redundant content providers running | 16:14 |
| marios | weshay|ruck: i.e https://review.opendev.org/#/c/761188/2/zuul.d/standalone-jobs.yaml@634 | 16:15 |
| weshay|ruck | marios, ya.. for this.. I'd like ua/pm it | 16:15 |
| marios | weshay|ruck: assuming it checks out though - well see with the two tests i posted (master/victoria https://review.opendev.org/761189 & https://review.opendev.org/761190 ) | 16:16 |
| weshay|ruck | marios, go experiments ++ | 16:16 |
| marios | weshay|ruck: maybe we can discuss tomorrow once the tests run | 16:16 |
| weshay|ruck | but would rather discuss goals upfront | 16:16 |
| marios | weshay|ruck: ok | 16:16 |
| weshay|ruck | so we don't have re-do things | 16:16 |
| weshay|ruck | we chat for 5 and talk design.. or chat later.. up to you | 16:17 |
| marios | sure lets talk | 16:17 |
| weshay|ruck | https://meet.google.com/ucy-ifxh-xfa?authuser=1 | 16:18 |
| *** dwilde has joined #tripleo | 16:22 | |
| *** d34dh0r53 has quit IRC | 16:24 | |
| *** dwilde has quit IRC | 16:24 | |
| *** d34dh0r53 has joined #tripleo | 16:24 | |
| *** sanjayu_ has quit IRC | 16:37 | |
| ade_lee | weshay|ruck, rlandy - hey - do you know if we have any ci jobs where we reboot one of the nodes? | 16:38 |
| rlandy | ade_lee: reboot ... not that I can think of - do we need such a job? | 16:40 |
| ade_lee | rlandy, I'm trying to create a job where fips is enabled | 16:40 |
| rlandy | upstream or downstream? | 16:40 |
| ade_lee | both eventually :) but upstream first | 16:41 |
| mwhahaha | i don't think you can fips upstream | 16:41 |
| ade_lee | mwhahaha, why not? | 16:41 |
| rlandy | we do reboot overcloud nodes in ovb | 16:42 |
| mwhahaha | imho it goes along the lines of selinux type of stuff where we're likely going to be on the hook for some downstream stuff first | 16:42 |
| mwhahaha | i don't think fips coverage is necessarily gateable upstream as well | 16:42 |
| ade_lee | mwhahaha, well - so what I've seen so far is that most a lot of fips failures are due to things like md5 | 16:44 |
| ade_lee | so I've created some patches to fix those upstream | 16:44 |
| mwhahaha | yea i know, i just don't think it's something we should test upstream (resource constraints, etc) | 16:44 |
| openstackgerrit | Harald Jensås proposed openstack/python-tripleoclient master: Extract provisioned networks from stack https://review.opendev.org/750672 | 16:45 |
| openstackgerrit | Harald Jensås proposed openstack/python-tripleoclient master: Provision composable networks command https://review.opendev.org/751875 | 16:45 |
| ade_lee | https://review.opendev.org/#/q/topic:replace_md5_for_fips+(status:open+OR+status:merged) | 16:45 |
| ade_lee | mwhahaha, well - what I'm looking to do right now is just create a zuul job to check that the tests pass for the individual projects upstream -- ie. for nova, glance, barbican etc. | 16:46 |
| *** rpittau is now known as rpittau|afk | 16:46 | |
| ade_lee | ie. to make sure that we don't accidentally break fips once I've fixed all that | 16:46 |
| ade_lee | and then on the tripleo side, maybe a periodic job? | 16:46 |
| mwhahaha | it's fine if you can get it into other projects,i just don't think tripleo should | 16:46 |
| openstackgerrit | Harald Jensås proposed openstack/python-tripleoclient master: Provision composable networks command https://review.opendev.org/751875 | 16:47 |
| ade_lee | mwhahaha, because of resource constraints? | 16:47 |
| *** dtantsur is now known as dtantsur|afk | 16:47 | |
| mwhahaha | it falls under one of those more edge cases where it might be a nice to have but we have more pressing things we should test but don't because of resource constraints | 16:48 |
| *** saneax has joined #tripleo | 16:49 | |
| ade_lee | mwhahaha, we can defer this discussion in tripleo until we have something more concrete to test - certainly we'll need this downstream. but if we have a job that is run periodically and on-demand, and that is created and maintained by the security team - then .. | 16:50 |
| weshay|ruck | ade_lee, no.. you can't do that upstream | 16:52 |
| rlandy | ade_lee: is this a test for the downstream pipeline/integration line? | 16:52 |
| ade_lee | rlandy, eventually maybe .. | 16:52 |
| ade_lee | weshay|ruck, explain? | 16:52 |
| ade_lee | weshay|ruck, you can't reboot? | 16:53 |
| weshay|ruck | ade_lee, correct | 16:53 |
| ade_lee | weshay|ruck, becuase when you do, nodepool takes the node away? | 16:53 |
| weshay|ruck | last time I checked | 16:53 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: IPA test - adding all forwarders to IPA server https://review.opendev.org/757943 | 16:54 |
| ade_lee | and there is no way to tell it not to? rlandy just mentioned something about rebooting overcloud nodes .. | 16:54 |
| ade_lee | in ovb .. | 16:54 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: IPA test - adding all forwarders to IPA server https://review.opendev.org/757943 | 16:54 |
| ade_lee | weshay|ruck, anything you point me to that shows where that happens? | 16:55 |
| ade_lee | rlandy, where do we reboot nodes? | 16:55 |
| rlandy | weshay|ruck: ade_lee: to be clear, we can't reboot nodepool nodes | 16:55 |
| rlandy | ovb has nodes assigned outside of nodepool | 16:55 |
| rlandy | we provision those nodes | 16:56 |
| ade_lee | ah | 16:56 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-ci master: WIP - moving multi parent upgrade jobs to branch templates https://review.opendev.org/761188 | 16:56 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates stable/victoria: WIP - wire up victoria standalone-upgrade content provider template https://review.opendev.org/761199 | 16:56 |
| rlandy | so not the undercloud node | 16:56 |
| ade_lee | any way to tell nodepool not to reclaim a node? | 16:57 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP Allow to specify a nic for the VIPs https://review.opendev.org/760640 | 16:58 |
| rlandy | ade_lee: what's your timeline on needing this test done? | 16:58 |
| ade_lee | rlandy, not urgent -- this is ongoing dev for w+ | 16:59 |
| rlandy | ade_lee: I am forwarding you an invite for the next Tripleo CI community meeting - | 17:00 |
| rlandy | let's present this to the team and see what can be done | 17:00 |
| ade_lee | rlandy, ok cool | 17:00 |
| *** bnemec has joined #tripleo | 17:00 | |
| rlandy | invite sent | 17:01 |
| *** bogdando has quit IRC | 17:01 | |
| ade_lee | rlandy, if we can't reboot the nodes, one other option is to create a fips enabled image and just boot that | 17:01 |
| ade_lee | certainly we may be able to do that downstream .. | 17:02 |
| ade_lee | rlandy, or can we reboot nodes downstream? | 17:02 |
| rlandy | ade_lee: same story with zuul downstream - ovb reboots but not nodepool | 17:02 |
| rlandy | let's discuss more at the community meeting | 17:03 |
| ade_lee | ack thanks | 17:03 |
| *** jpich has quit IRC | 17:04 | |
| spotz | Hey all re-running my tripleo standalone as I had some errors last night and we have a warning at the top of the docs about standalone only being in Rocky and newer but have how to enable queens and pike repos. Should I rip them out of the docs? | 17:08 |
| *** marios is now known as marios|out | 17:10 | |
| *** jcapitao has quit IRC | 17:15 | |
| mwhahaha | spotz: the repo bits is shared on all pages hence the warning | 17:21 |
| *** gfidente is now known as gfidente|afk | 17:21 | |
| mwhahaha | we can likely drop the pike repo references but queens is still valid though you cannot use standalone with queens | 17:22 |
| *** sshnaidm|rover is now known as sshnaidm|afk | 17:22 | |
| *** lucasagomes has quit IRC | 17:24 | |
| spotz | mwhahaha: Ahh yeah I remember the page had some includes last time I edited it to add python3. Ok next time I patch I'll remove pike. | 17:25 |
| *** sanjayu_ has joined #tripleo | 17:26 | |
| *** saneax has quit IRC | 17:27 | |
| *** jmasud has quit IRC | 17:31 | |
| *** sanjayu_ has quit IRC | 17:33 | |
| *** sanjayu_ has joined #tripleo | 17:33 | |
| *** jmasud has joined #tripleo | 17:33 | |
| *** suryasingh has quit IRC | 17:36 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP Allow to specify a nic for the VIPs https://review.opendev.org/760640 | 17:37 |
| *** jmasud has quit IRC | 17:43 | |
| *** marios|out has quit IRC | 17:44 | |
| *** dsneddon has quit IRC | 17:46 | |
| *** tosky has quit IRC | 17:57 | |
| *** derekh has quit IRC | 18:03 | |
| *** saneax has joined #tripleo | 18:04 | |
| *** dwilde has joined #tripleo | 18:05 | |
| *** d34dh0r53 has quit IRC | 18:05 | |
| *** sanjayu_ has quit IRC | 18:06 | |
| *** dsneddon has joined #tripleo | 18:07 | |
| *** dsneddon has quit IRC | 18:08 | |
| *** dsneddon has joined #tripleo | 18:08 | |
| hakhande | mwhahaha, ping | 18:19 |
| mwhahaha | ? | 18:20 |
| hakhande | mwhahaha, regarding https://review.opendev.org/#/c/748439/ - Config parameters for timemaster service , want your some time | 18:20 |
| mwhahaha | What about it? | 18:21 |
| hakhande | mwhahaha, regarding this comment, "Please add a timemaster specific service file" the idea behind keeping it along with chrony as keeping it separate requires additional work for admin, as he has to create roles and add this new time service for nodes where admin wants timemaster service | 18:23 |
| mwhahaha | We don't mix services like you have defined. The expectation is that a user specifies what services goes on what role | 18:24 |
| hakhande | mwhahaha, so idea is, to have it in chrony and differentiate via role specific parameter (EnableTimemaster) , so if this is true, then only timemaster would be installed (no chrony), else chrony as it is today | 18:24 |
| mwhahaha | Which can be handled at a role level with services | 18:24 |
| mwhahaha | You end up with extra cruft left over the way you have defined it and makes it hard to handle upgrades/updates/etc | 18:25 |
| *** jmasud has joined #tripleo | 18:25 | |
| mwhahaha | I know what you are going for and we don't use that pattern | 18:25 |
| mwhahaha | If a user is using PTp for some roles, it should be an enabled service for only those roles not a flag as defined in a metal service | 18:27 |
| *** arxcruz has quit IRC | 18:28 | |
| hakhande | mwhahaha, i see | 18:29 |
| mwhahaha | You break some other things by configuring a different service in the same file. It's not a pattern we wish to do | 18:29 |
| mwhahaha | e.g. firewall rules, enabled service information | 18:30 |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/tripleo-validations master: Adding restore validation group https://review.opendev.org/761215 | 18:32 |
| *** jpena is now known as jpena|off | 18:33 | |
| hakhande | mwhahaha, got that, i need your opinion for this, lets take ComputerSriov role, it has TimeSync service, if i add TimeMaster, it is conflict, so admin needs to change this after creating role file | 18:33 |
| mwhahaha | They would remove the tiemsync service for the role definitions where they want ptp | 18:34 |
| mwhahaha | We named it timesync to support the ntpd/chrony transition. If PTP is not enabled globally on all nodes, it needs to be a specific service only defined in the roles that need it | 18:35 |
| hakhande | mwhahaha, ok, timemaster is superset of chrony + ptp so it can do both, but i get your point, that not need to add complexity in the code, let admin do those service related changes in roles | 18:38 |
| *** LaurentDumont has joined #tripleo | 18:43 | |
| *** ayoung has joined #tripleo | 18:47 | |
| hakhande | mwhahaha, thanks, appreciate for your time | 18:53 |
| *** jamesdenton has quit IRC | 18:54 | |
| LaurentDumont | Has anyone ever seen a case where the Memory Used seen from something like "openstack hypervisor show" or the Horizon GUI is almost to 100% while there are no VMs running? It shows that amount for a few seconds and drops down to the expected level after? | 18:54 |
| *** jmasud has quit IRC | 18:54 | |
| *** jmasud_ has joined #tripleo | 18:54 | |
| *** pleimer has joined #tripleo | 18:56 | |
| *** jmasud_ has quit IRC | 18:57 | |
| *** ianw_pto is now known as ianw | 18:59 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP Allow to specify a nic for the VIPs https://review.opendev.org/760640 | 19:04 |
| *** marst has joined #tripleo | 19:11 | |
| *** ayoung has quit IRC | 19:15 | |
| *** ayoung has joined #tripleo | 19:17 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: WIP, run netstat port audit https://review.opendev.org/756897 | 19:21 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: run netstat port audit https://review.opendev.org/756897 | 19:23 |
| *** saneax has quit IRC | 19:24 | |
| *** ayoung has quit IRC | 19:24 | |
| *** ayoung has joined #tripleo | 19:26 | |
| *** arxcruz has joined #tripleo | 19:28 | |
| *** hakhande has quit IRC | 19:39 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart master: Disable os_tempest https://review.opendev.org/759830 | 19:41 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP Allow to specify a nic for the VIPs https://review.opendev.org/760640 | 19:56 |
| openstackgerrit | Rafael Folco proposed openstack/tripleo-ci master: [WIP] build report for container builds https://review.opendev.org/755124 | 20:02 |
| *** jamesdenton has joined #tripleo | 20:17 | |
| *** LaurentDumont has quit IRC | 20:23 | |
| *** tosky has joined #tripleo | 20:27 | |
| *** slaweq has quit IRC | 20:33 | |
| *** slaweq has joined #tripleo | 20:45 | |
| *** frenzy_friday has quit IRC | 20:46 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: [WIP] Allow Ansible 2.10 to be used in test https://review.opendev.org/761225 | 20:51 |
| *** luk4s has joined #tripleo | 20:55 | |
| luk4s | Evening | 20:55 |
| cloudnull | o/ | 20:56 |
| luk4s | I'm in the process of deploying the undercloud, but getting errors related to the cron and haproxy containers. /var/log/containers/stdouts/container-puppet-crond.log contains: stderr F standard_init_linux.go:211: exec user process caused "exec format error" | 20:58 |
| slagle | hey, i'm seeing the same thing :) | 21:00 |
| slagle | was just trying to debug it | 21:00 |
| luk4s | Looking at the docker hub the latest tag 68f97388ca61ef3b5c419b6480308f6a (and corresponding current-tripleo) are listed as linux/ppc64le architecture. | 21:00 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: Don't update containers on periodic jobs https://review.opendev.org/761226 | 21:01 |
| luk4s | I suspect that is the cause of the problem. | 21:01 |
| cloudnull | weshay|ruck ^ ? | 21:01 |
| * weshay|ruck looks | 21:02 | |
| cloudnull | maybe related to our mass docker exodus ? | 21:02 |
| weshay|ruck | naw... didn't happen and rdo jobs don't use it | 21:02 |
| weshay|ruck | cloudnull, what did you want me to look at, sagi's review? | 21:03 |
| cloudnull | > Looking at the docker hub the latest tag 68f97388ca61ef3b5c419b6480308f6a (and corresponding current-tripleo) are listed as linux/ppc64le architecture. | 21:03 |
| cloudnull | re: luk4s | 21:04 |
| *** waleedm_ has joined #tripleo | 21:04 | |
| weshay|ruck | cloudnull, which container? but really the jobs sshnaidm|afk is solving for do not use docker.io | 21:04 |
| slagle | looks like haproxy and crond | 21:05 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo stable/train: Cleanup old workaround for ipv6 VIPs https://review.opendev.org/761227 | 21:05 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo stable/train: WIP Allow to specify a nic for the VIPs https://review.opendev.org/761228 | 21:05 |
| *** waleedm has quit IRC | 21:05 | |
| luk4s | The containers in question are openstack-haproxy and openstack-cron | 21:07 |
| luk4s | From tripleomaster | 21:10 |
| *** rcernin has joined #tripleo | 21:19 | |
| *** rfolco has quit IRC | 21:24 | |
| *** rfolco has joined #tripleo | 21:24 | |
| *** ChanServ has quit IRC | 21:26 | |
| zaitcev | So I overcame a number of failures at the overcloud deploy, and now it fails while trying to ssh to overcloud nodes. | 21:28 |
| zaitcev | FATAL | Wait for connection to become available | 21:28 |
| zaitcev | here's the terminal log: http://people.redhat.com/zaitcev/tmp/20201103_1/ostk_overcloud_deploy.txt | 21:28 |
| *** rfolco has quit IRC | 21:29 | |
| zaitcev | Anyone knows how to diagnose this? I should look at the nodes, right? | 21:29 |
| *** ChanServ has joined #tripleo | 21:32 | |
| *** tepper.freenode.net sets mode: +o ChanServ | 21:32 | |
| mwhahaha | it's failing because it can't ssh | 21:33 |
| mwhahaha | the heat-admin key isn't good | 21:33 |
| mwhahaha | so yes you need to troubleshoot ssh connectivity to heat-admin@server | 21:34 |
| zaitcev | ok | 21:34 |
| *** raildo has quit IRC | 21:35 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart master: use py3 for tq on centos 7.8+ https://review.opendev.org/758453 | 21:38 |
| *** jmasud has joined #tripleo | 21:39 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/victoria: Update .gitreview for stable/victoria https://review.opendev.org/760598 | 21:39 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-validations master: Make local molecule testing running. https://review.opendev.org/761231 | 21:40 |
| *** jfrancoa has quit IRC | 21:41 | |
| zaitcev | mwhahaha: The problem is, all I have now is a failure to install the public key in authorized_keys at overcloud nodes. I don't know (a) why it happened, and (b) what to do to fix it. I can connect to console of overcloud node, but I don't have a root password. | 21:43 |
| mwhahaha | update overcloud-full and set a password | 21:44 |
| zaitcev | Here, http://people.redhat.com/zaitcev/tmp/20201103_1/ssh_log_from_uc.txt - but there's nothing interesting in there, just an authentication failure. | 21:44 |
| mwhahaha | via virt-customize and reprovision | 21:44 |
| *** gfidente|afk has quit IRC | 21:52 | |
| *** waleedm_ has quit IRC | 21:55 | |
| *** slaweq has quit IRC | 22:02 | |
| *** bandini has quit IRC | 22:03 | |
| *** aedc has joined #tripleo | 22:03 | |
| *** waleedm_ has joined #tripleo | 22:03 | |
| *** aedc has quit IRC | 22:04 | |
| *** holser has quit IRC | 22:10 | |
| *** holser has joined #tripleo | 22:11 | |
| *** waleedm__ has joined #tripleo | 22:13 | |
| *** waleedm_ has quit IRC | 22:17 | |
| openstackgerrit | Douglas Mendizábal proposed openstack/tripleo-heat-templates master: Identify HSMs using labels instead of Slot ID https://review.opendev.org/760136 | 22:17 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-common stable/stein: Add Octavia use of the rsyslog image https://review.opendev.org/761243 | 22:32 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates stable/stein: Add the ability to offload amphora logs https://review.opendev.org/761244 | 22:33 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-common stable/stein: Add support for Octavia amphora log offloading https://review.opendev.org/761245 | 22:34 |
| *** paramite|clone has quit IRC | 22:41 | |
| *** waleedm__ has quit IRC | 22:48 | |
| *** tkajinam has joined #tripleo | 22:59 | |
| *** tosky has quit IRC | 23:01 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-common stable/rocky: Add Octavia use of the rsyslog image https://review.opendev.org/761247 | 23:02 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-common stable/queens: Add Octavia use of the rsyslog image https://review.opendev.org/761248 | 23:06 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/diskimage-builder master: Fix python-stow-versions https://review.opendev.org/751610 | 23:10 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/diskimage-builder master: Run autoremove on post-install step https://review.opendev.org/751614 | 23:10 |
| *** mmethot has quit IRC | 23:18 | |
| *** TrevorV has quit IRC | 23:25 | |
| *** mmethot has joined #tripleo | 23:34 | |
| *** tmazur has quit IRC | 23:34 | |
| cloudnull | mwhahaha https://review.opendev.org/#/c/761225/ - we're looking halfway decent. granted its with the compatibility layer but that's a lot more promising than I was expecting. | 23:36 |
| mwhahaha | cloudnull: yea it works. with the collectiosn from https://hackmd.io/2qUJLzGUSbaWGAqmo8QvMw it deployed fine with just ansible-base | 23:41 |
| mwhahaha | (shockingly enough) | 23:41 |
| * cloudnull color me surprised | 23:42 | |
| *** luk4s has quit IRC | 23:49 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!