| *** rlandy|rover is now known as rlandy|rover|bbl | 00:00 | |
| *** leanderthal has quit IRC | 00:04 | |
| *** leanderthal has joined #tripleo | 00:04 | |
| *** mcornea has quit IRC | 00:09 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 00:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 00:10 |
| *** leanderthal has quit IRC | 00:19 | |
| *** psahoo has joined #tripleo | 00:26 | |
| *** tzumainn has quit IRC | 00:33 | |
| *** agopi has quit IRC | 00:38 | |
| *** agopi has joined #tripleo | 00:39 | |
| *** tzumainn has joined #tripleo | 00:41 | |
| *** limao has joined #tripleo | 00:54 | |
| *** radeks has joined #tripleo | 00:54 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 01:10 |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 01:10 |
| *** Petersingh has joined #tripleo | 01:16 | |
| *** mdnadeem has joined #tripleo | 01:21 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-docs master: Document workflow driven container prepare https://review.openstack.org/553104 | 01:22 |
| openstackgerrit | gaofei proposed openstack/tripleo-heat-templates master: Fix typo https://review.openstack.org/542068 | 01:25 |
| *** yamahata has quit IRC | 01:25 | |
| *** agopi has quit IRC | 01:26 | |
| *** mrsoul has joined #tripleo | 01:27 | |
| *** tzumainn has quit IRC | 01:27 | |
| *** mschuppert has quit IRC | 01:30 | |
| *** psahoo has quit IRC | 01:33 | |
| *** tzumainn has joined #tripleo | 01:38 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: mysql: create healthcheck user https://review.openstack.org/574933 | 01:40 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: healthcheck/mariadb: run mysql with healthcheck user https://review.openstack.org/574934 | 01:42 |
| *** psahoo has joined #tripleo | 01:45 | |
| *** radeks has quit IRC | 01:55 | |
| *** rfolco_doctor is now known as rfolco | 02:00 | |
| *** bkopilov has quit IRC | 02:07 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 02:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 02:10 |
| *** agopi has joined #tripleo | 02:23 | |
| *** itlinux has joined #tripleo | 02:24 | |
| *** myoung|bbl is now known as myoung | 02:28 | |
| *** dhill_ has quit IRC | 02:29 | |
| *** liverpooler has quit IRC | 02:33 | |
| *** zshi_ has quit IRC | 02:33 | |
| *** leanderthal has joined #tripleo | 02:39 | |
| *** mdnadeem has quit IRC | 02:41 | |
| *** Petersingh is now known as Petersingh|afk | 02:43 | |
| *** zshi_ has joined #tripleo | 02:46 | |
| *** leanderthal has quit IRC | 02:48 | |
| *** mdnadeem has joined #tripleo | 02:53 | |
| *** psachin has joined #tripleo | 02:58 | |
| *** rlandy|rover|bbl is now known as rlandy|rover | 02:59 | |
| *** mdnadeem has quit IRC | 02:59 | |
| *** rlandy|rover has quit IRC | 02:59 | |
| *** leanderthal has joined #tripleo | 03:01 | |
| *** Petersingh|afk is now known as Petersingh | 03:07 | |
| *** limao has quit IRC | 03:09 | |
| *** limao has joined #tripleo | 03:09 | |
| *** limao has quit IRC | 03:09 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 03:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 03:10 |
| *** khyr0n has joined #tripleo | 03:13 | |
| itlinux | hi guys. has anyone done vbmc with bonds? and VLANs id? | 03:13 |
| *** leanderthal has quit IRC | 03:14 | |
| *** leanderthal has joined #tripleo | 03:22 | |
| *** bkopilov has joined #tripleo | 03:26 | |
| *** leanderthal has quit IRC | 03:29 | |
| *** rajinir has joined #tripleo | 03:31 | |
| *** ramishra has joined #tripleo | 03:36 | |
| *** agopi has quit IRC | 03:36 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-upgrade master: Add timestamps to update log files https://review.openstack.org/574886 | 03:36 |
| *** agopi has joined #tripleo | 03:43 | |
| *** leanderthal has joined #tripleo | 03:45 | |
| *** udesale has joined #tripleo | 03:45 | |
| *** ramishra has quit IRC | 03:45 | |
| *** dciabrin has quit IRC | 03:46 | |
| *** dciabrin_ has joined #tripleo | 03:46 | |
| *** skramaja has joined #tripleo | 03:48 | |
| *** mdnadeem has joined #tripleo | 03:48 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-upgrade master: Add timestamps to update log files https://review.openstack.org/574886 | 03:49 |
| *** agopi has quit IRC | 03:51 | |
| *** agopi has joined #tripleo | 03:51 | |
| *** leanderthal has quit IRC | 03:52 | |
| *** leanderthal has joined #tripleo | 03:53 | |
| *** Petersingh is now known as Petersingh|afk | 03:55 | |
| *** radeks has joined #tripleo | 03:57 | |
| *** agopi has quit IRC | 04:00 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates master: enable support for openidc federation in keystone https://review.openstack.org/574855 | 04:05 |
| *** sai_p has quit IRC | 04:06 | |
| *** tzumainn has quit IRC | 04:07 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 04:10 |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 04:10 |
| *** Petersingh|afk is now known as Petersingh | 04:12 | |
| *** dmsimard has quit IRC | 04:13 | |
| *** shreshtha has joined #tripleo | 04:17 | |
| *** leanderthal has quit IRC | 04:17 | |
| *** ramishra has joined #tripleo | 04:20 | |
| *** leanderthal has joined #tripleo | 04:20 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-upgrade stable/pike: Add log artifacts for upgrade steps https://review.openstack.org/574969 | 04:21 |
| openstackgerrit | Matt Young proposed openstack/tripleo-upgrade stable/queens: Add log artifacts for upgrade steps https://review.openstack.org/574970 | 04:22 |
| *** links has joined #tripleo | 04:24 | |
| *** leanderthal has quit IRC | 04:27 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-quickstart-extras master: Add upgrade and update logs to logstash indexing https://review.openstack.org/570896 | 04:28 |
| openstackgerrit | Matt Young proposed openstack/tripleo-quickstart-extras master: Make ansible linting script executable https://review.openstack.org/574971 | 04:28 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Use "openstack tripleo container image prepare" https://review.openstack.org/568403 | 04:36 |
| *** leanderthal has joined #tripleo | 04:39 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-upgrade master: Add timestamps to logs of upgrade tasks https://review.openstack.org/574892 | 04:40 |
| *** ykarel|away has joined #tripleo | 04:43 | |
| *** holser__ has joined #tripleo | 04:43 | |
| *** leanderthal has quit IRC | 04:48 | |
| *** pcaruana has joined #tripleo | 04:50 | |
| *** limao has joined #tripleo | 04:58 | |
| *** yprokule has joined #tripleo | 05:00 | |
| *** holser___ has joined #tripleo | 05:01 | |
| *** holser___ has quit IRC | 05:02 | |
| *** holser__ has quit IRC | 05:05 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Handle renaming of Cinder VNX backend parameter https://review.openstack.org/574873 | 05:06 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: mysql: create healthcheck user https://review.openstack.org/574933 | 05:07 |
| tonyb | EmilienM: I'm actually a little confused about how we EOL newton in the new EM world. I suspect that as it's tripleo we can just go ahead and do it. I'll add a TODO for tomorrow to start that discussion and update the docs | 05:08 |
| tonyb | EmilienM: did the releases you required happen manually? | 05:09 |
| *** paramite has joined #tripleo | 05:09 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 05:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 05:10 |
| *** cshastri has joined #tripleo | 05:13 | |
| EmilienM | tonyb: no | 05:13 |
| tonyb | EmilienM: okay, Do you want me to work with dhellman to make that happen? | 05:14 |
| EmilienM | tonyb: if possible, yes | 05:14 |
| tonyb | EmilienM: it's quite probable that I can run the scripts but I'd rather he did it | 05:14 |
| tonyb | EmilienM: okay leave it with me, I | 05:14 |
| tonyb | 'll work out about the EOL as well | 05:14 |
| EmilienM | thanks | 05:15 |
| *** pcaruana has quit IRC | 05:18 | |
| *** yamahata has joined #tripleo | 05:19 | |
| *** ykarel|away is now known as ykarel | 05:20 | |
| ykarel | dansmith, hi | 05:20 |
| *** Petersingh is now known as Petersingh|afk | 05:20 | |
| ykarel | dansmith, after https://review.openstack.org/#/c/573239/, seeing issue AttributeError: 'IronicNodeState' object has no attribute 'failed_builds' | 05:21 |
| ykarel | dansmith, is this expected? and need to be fixed on tripleo side? | 05:21 |
| ykarel | dansmith, logs:- https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-queens-upload/556a09f/undercloud/var/log/extra/errors.txt.gz | 05:22 |
| *** Petersingh|afk is now known as Petersingh | 05:22 | |
| *** janki has joined #tripleo | 05:23 | |
| ykarel | dansmith, and the issue is not in master | 05:24 |
| EmilienM | ykarel: fyi he's on PST, so probably offline now | 05:24 |
| ykarel | EmilienM, ohhk | 05:25 |
| tonyb | ykarel: I | 05:25 |
| *** ratailor has joined #tripleo | 05:25 | |
| EmilienM | but tonyb is also nova expert (/me hide) | 05:25 |
| tonyb | 'll have a poke but I suspect that the answer is "no" and you shoudl probably file a bug/follwo-up patch | 05:25 |
| tonyb | EmilienM: LOL far from an expert ;P | 05:25 |
| *** jbadiapa has joined #tripleo | 05:27 | |
| ykarel | tonyb, in master it's not seen because ironic_host_manager is removed there:- https://review.openstack.org/#/c/565805/ | 05:30 |
| tonyb | ykarel: then somehow we're missing a migration to fix the database | 05:31 |
| ykarel | tonyb, may be but i don't have idea about it | 05:31 |
| tonyb | ykarel: Give me a little while to look into it. The quick fix would be to use getattr() but that's almost certainly wrong | 05:32 |
| ykarel | tonyb, ack | 05:32 |
| *** leanderthal has joined #tripleo | 05:33 | |
| EmilienM | @all we need a review on https://review.openstack.org/#/c/574873/ to unblock the gate on puppet-tripleo | 05:34 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: HA overcloud: wait for db before running grant commands https://review.openstack.org/574732 | 05:34 |
| *** leanderthal has quit IRC | 05:39 | |
| *** rajinir has quit IRC | 05:39 | |
| tonyb | ykarel: is the nova db available in the job logs anywhere? | 05:41 |
| ykarel | tonyb, i don't think db is stored | 05:41 |
| tonyb | ykarel: I don't see how we can be using master and end up with stale data | 05:41 |
| tonyb | ykarel: rats | 05:41 |
| *** janki has quit IRC | 05:42 | |
| tonyb | ykarel: Oh wait the job is periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-queens-upload that isn't master (sorry for asking simple questions) but I havn't ever really needed to debug this kind os thing in toci | 05:43 |
| *** hjensas has quit IRC | 05:44 | |
| ykarel | tonyb, we are seeing this in all queens periodic jobs | 05:45 |
| tonyb | ykarel: okay that makes slightly more sense then | 05:46 |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Fix error in the role-specific parameter merging in rhsm service https://review.openstack.org/574987 | 05:48 |
| tonyb | ykarel: Okay I think it's just a bad backport | 05:49 |
| *** janki has joined #tripleo | 05:49 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Fix error in the role-specific parameter merging in rhsm service https://review.openstack.org/574987 | 05:49 |
| tonyb | ykarel: Can you open a bug and link to https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-queens-upload/556a09f/undercloud/var/log/nova/nova-scheduler.log.txt.gz#_2018-06-13_01_10_02_061 I'll try to work out the right way to fix it | 05:50 |
| ykarel | tonyb, done:- https://bugs.launchpad.net/tripleo/+bug/1776596 | 05:50 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Undecided,New] | 05:50 |
| *** kopecmartin has joined #tripleo | 05:51 | |
| openstackgerrit | Merged openstack/tripleo-common master: Improve ssh connection handling https://review.openstack.org/573984 | 05:52 |
| *** moshele has joined #tripleo | 05:58 | |
| *** cshastri has quit IRC | 05:58 | |
| *** zshi_ has quit IRC | 05:59 | |
| tonyb | ykarel: Can we run toci on a nova change? | 06:00 |
| ykarel | tonyb, i think yes, by updating ZUUL_CHANGES in https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-queens-upload/556a09f/reproducer-quickstart.sh | 06:02 |
| ykarel | oh you mean a ci job? | 06:03 |
| *** lvdombrkr has joined #tripleo | 06:03 | |
| tonyb | ykarel: Yeah I *think* I have a fix for nova and I was wondering if we could run a similar job against the nova change before it merges to check if it's enough | 06:05 |
| *** radeks has quit IRC | 06:05 | |
| *** Petersingh is now known as Petersingh|afk | 06:05 | |
| *** pcaruana has joined #tripleo | 06:06 | |
| ykarel | tonyb, we have ovb experimental job in rdo zuul, but since it's experimental it would take time to gate nodes to run job | 06:06 |
| ykarel | to run experimental, gerrit comment: check rdo experimental | 06:06 |
| tonyb | ykarel: but it would run on on the chnage I'm about to upload to nova (stable/queens) albeit slowly and manually triggered | 06:07 |
| *** dparkes has quit IRC | 06:07 | |
| *** lvdombrkr89 has joined #tripleo | 06:07 | |
| ykarel | tonyb, yes after you publish change and add comment it will run ovb featureset001 against all releases | 06:09 |
| openstackgerrit | Andrey Kurilin proposed openstack/tripleo-ha-utils master: Port rally plugins to use proper modules https://review.openstack.org/574994 | 06:10 |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 06:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 06:10 |
| *** lvdombrkr has quit IRC | 06:10 | |
| tonyb | ykarel: https://review.openstack.org/574997 | 06:11 |
| *** zshi_ has joined #tripleo | 06:12 | |
| tonyb | I know it's a long shot but is there a tracking bug or similar for using (keystone) v3 by default everywhere in tripleo? | 06:14 |
| *** cshastri has joined #tripleo | 06:14 | |
| *** mrsoul is now known as mschuppert | 06:15 | |
| ykarel | tonyb, job in queue in rdo zuul, let's see when we get node for it. | 06:17 |
| tonyb | ykarel: cool. | 06:17 |
| ykarel | tonyb, for keystone v3 i have seen many patches to switch to v3, but no idea if there is a bug | 06:17 |
| tonyb | ykarel: Okay thanks | 06:18 |
| *** bogdando has joined #tripleo | 06:18 | |
| *** khyr0n has quit IRC | 06:19 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Revert "Revert "Alter default http boot path for containerized Ironic"" https://review.openstack.org/575003 | 06:21 |
| ykarel | bogdando, ^^ is the issue last time we faced, fixed? | 06:24 |
| *** slaweq has joined #tripleo | 06:24 | |
| bogdando | ykarel: hi, IIRC, it was ovb 35 failing | 06:24 |
| bogdando | fixed in https://review.openstack.org/#/c/566916/ | 06:24 |
| bogdando | we also switched remaining jobs https://review.openstack.org/#/c/542906, and one more is waiting https://review.openstack.org/#/c/572215/ | 06:25 |
| bogdando | ykarel: the idea is never ever install instack underclouds in CI jobs doing HW provisioning | 06:26 |
| *** lifeless has quit IRC | 06:26 | |
| *** lifeless has joined #tripleo | 06:26 | |
| ykarel | bogdando, ack if all are switched to containerized undercloud, we are good | 06:26 |
| bogdando | then we're good to go with https://review.openstack.org/575003 | 06:26 |
| bogdando | yupp | 06:26 |
| *** florianf has joined #tripleo | 06:27 | |
| bogdando | jistr: hi, https://review.openstack.org/#/c/574884/1 needs blessing of yours :) | 06:28 |
| *** Petersingh|afk is now known as Petersingh | 06:29 | |
| *** quiquell|off is now known as quiquell | 06:29 | |
| *** nyechiel_ has joined #tripleo | 06:30 | |
| *** moshele has quit IRC | 06:30 | |
| *** zshi_ has quit IRC | 06:32 | |
| *** holser__ has joined #tripleo | 06:34 | |
| *** zshi_ has joined #tripleo | 06:34 | |
| *** waleedm has joined #tripleo | 06:36 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-upgrade master: before executing tripleo-inventory esure it's installed https://review.openstack.org/574884 | 06:36 |
| *** dparkes has joined #tripleo | 06:38 | |
| *** saneax has joined #tripleo | 06:38 | |
| *** tosky has joined #tripleo | 06:40 | |
| *** radeks has joined #tripleo | 06:43 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Switch more promotion jobs to containerized undercloud https://review.openstack.org/572215 | 06:44 |
| *** lvdombrkr89 has quit IRC | 06:45 | |
| *** sanjay__u has joined #tripleo | 06:46 | |
| *** lifeless_ has joined #tripleo | 06:48 | |
| *** lifeless has quit IRC | 06:48 | |
| *** cshastri has quit IRC | 06:49 | |
| *** jpena|off is now known as jpena | 06:51 | |
| *** ukalifon has joined #tripleo | 06:57 | |
| *** rcernin has quit IRC | 07:00 | |
| *** lvdombrkr has joined #tripleo | 07:03 | |
| *** lvdombrkr89 has joined #tripleo | 07:05 | |
| *** cshastri has joined #tripleo | 07:06 | |
| *** tesseract has joined #tripleo | 07:07 | |
| *** ramishra has quit IRC | 07:07 | |
| *** lvdombrkr has quit IRC | 07:08 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates stable/queens: Match only haproxy for docker ps and skipp all *-haproxy occurences https://review.openstack.org/574624 | 07:09 |
| openstackgerrit | Christian Schwede proposed openstack/puppet-tripleo master: Limit curl operation to pull/push Swift rings to 120 seconds https://review.openstack.org/575009 | 07:10 |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 07:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 07:10 |
| *** cschwede|mtg is now known as cschwede | 07:10 | |
| *** leanderthal has joined #tripleo | 07:11 | |
| *** dxiri has quit IRC | 07:14 | |
| *** dxiri has joined #tripleo | 07:15 | |
| flaper87 | hey folks, do we collect all files from /etc in our CI jobs? I was expecting to see some files here that are not there: http://logs.openstack.org/33/574233/4/experimental/tripleo-ci-centos-7-scenario009-multinode-oooq/6650a88/logs/subnode-2/etc/ | 07:15 |
| flaper87 | I checked in oooqe and it looks like we do collect them all | 07:15 |
| flaper87 | unless I looked in the wrong file | 07:15 |
| *** avivgt has joined #tripleo | 07:17 | |
| *** ffiore has joined #tripleo | 07:17 | |
| *** nguyenhai_ has quit IRC | 07:17 | |
| *** threestrands has quit IRC | 07:21 | |
| *** leanderthal has quit IRC | 07:23 | |
| *** rbrady_ has joined #tripleo | 07:26 | |
| *** rbrady_ is now known as Guest52381 | 07:27 | |
| *** Petersingh is now known as Petersingh|lunch | 07:28 | |
| *** slaweq has quit IRC | 07:28 | |
| *** rbrady has quit IRC | 07:29 | |
| *** ffiore has quit IRC | 07:29 | |
| *** ffiore has joined #tripleo | 07:30 | |
| *** ccamacho has joined #tripleo | 07:31 | |
| *** amoralej|off is now known as amoralej | 07:36 | |
| *** brault has joined #tripleo | 07:37 | |
| *** zoli is now known as zoli|wfh | 07:38 | |
| *** zoli|wfh is now known as zoli | 07:38 | |
| numans | bandini, A very gentle Hi and good morning :) | 07:39 |
| *** jpich has joined #tripleo | 07:39 | |
| *** moshele has joined #tripleo | 07:39 | |
| bandini | heya numans :) what's up? | 07:40 |
| *** avivgt has quit IRC | 07:40 | |
| *** avivgt has joined #tripleo | 07:40 | |
| numans | bandini, need your little time here - https://review.openstack.org/#/c/573411/ | 07:40 |
| bandini | numans: ah righto, sorry got swamped. let me do it now | 07:41 |
| *** shreshtha has quit IRC | 07:41 | |
| numans | bandini, no probs. thank you | 07:41 |
| *** shreshtha has joined #tripleo | 07:41 | |
| *** pdeore has joined #tripleo | 07:44 | |
| bandini | numans: I am kind of surprised that the review is not in merge conflict after we merged https://github.com/openstack/tripleo-heat-templates/commit/a6389da22d43fa61d4db16b676b23c3a4c468dfd#diff-0bb0673d935ac2e750640003a05cdb60 | 07:45 |
| bandini | (nothing important, just surprised :) | 07:45 |
| *** moshele has quit IRC | 07:45 | |
| *** brault has quit IRC | 07:46 | |
| *** moshele has joined #tripleo | 07:46 | |
| *** shreshtha has quit IRC | 07:47 | |
| *** shreshtha has joined #tripleo | 07:48 | |
| *** shreshtha has quit IRC | 07:49 | |
| *** shreshtha_ has joined #tripleo | 07:49 | |
| *** akrivoka has joined #tripleo | 07:50 | |
| jistr | flaper87: hi, we don't collect all, we had issues with logs taking up too muc space so the log collecting is very targeted nowadays. You can add new subdirs at https://github.com/openstack-infra/tripleo-ci/blob/master/toci-quickstart/config/collect-logs.yml#L8 | 07:51 |
| flaper87 | a-haaaaaaaaaaa.... toci is the repo I was missing | 07:52 |
| flaper87 | jistr: thanks | 07:52 |
| flaper87 | I couldn't find it anymore | 07:52 |
| *** lifeless has joined #tripleo | 07:52 | |
| numans | bandini, let me check. shall i rebase and spin a new one ? | 07:52 |
| * flaper87 will get a tattoo with all the repos he should check before asking questions | 07:52 | |
| *** lifeless_ has quit IRC | 07:52 | |
| bandini | numans: don't think so, as long as gerrit doesn't scream at us, just worth noting that if we merge it, it should not revert those bits | 07:54 |
| numans | bandini, ok. i will anyway locally rebase and see if there is any conflict | 07:54 |
| openstackgerrit | Flavio Percoco proposed openstack-infra/tripleo-ci master: Collect origin and NetworkManager dirs https://review.openstack.org/575015 | 07:56 |
| *** cylopez has joined #tripleo | 07:56 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Update for openshift 3.9 https://review.openstack.org/574233 | 07:57 |
| jistr | bogdando: it's probably ok but me & mcornea would like to know how come we need it at all https://review.openstack.org/#/c/574884/2//COMMIT_MSG | 07:58 |
| jistr | i wonder if we're missing a RPM dependency perhaps | 07:58 |
| *** cylopez has quit IRC | 07:58 | |
| jistr | cc weshay ^ | 07:59 |
| *** arxcruz|brb is now known as arxcruz|ruck | 07:59 | |
| *** jaganathan has quit IRC | 07:59 | |
| *** cylopez has joined #tripleo | 07:59 | |
| *** rodolof has joined #tripleo | 08:00 | |
| *** jcoufal has joined #tripleo | 08:00 | |
| *** dxiri_ has joined #tripleo | 08:01 | |
| *** dxiri has quit IRC | 08:02 | |
| *** brault has joined #tripleo | 08:03 | |
| *** brault has quit IRC | 08:06 | |
| *** brault has joined #tripleo | 08:06 | |
| *** avivgt has quit IRC | 08:09 | |
| *** avivgt has joined #tripleo | 08:09 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 08:10 |
| *** avivgt has quit IRC | 08:10 | |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 08:10 |
| *** avivgt has joined #tripleo | 08:10 | |
| *** ramishra has joined #tripleo | 08:10 | |
| *** chem has joined #tripleo | 08:16 | |
| openstackgerrit | Merged openstack/tripleo-validations master: Check if a bridge with name br-int exists https://review.openstack.org/573469 | 08:20 |
| *** Petersingh|lunch is now known as Petersingh | 08:20 | |
| *** gkadam has joined #tripleo | 08:20 | |
| *** udesale_ has joined #tripleo | 08:21 | |
| *** slaweq has joined #tripleo | 08:23 | |
| *** ffiore has quit IRC | 08:24 | |
| *** udesale has quit IRC | 08:24 | |
| *** ffiore has joined #tripleo | 08:24 | |
| *** udesale__ has joined #tripleo | 08:26 | |
| *** leanderthal has joined #tripleo | 08:27 | |
| *** udesale_ has quit IRC | 08:29 | |
| *** shardy has joined #tripleo | 08:29 | |
| *** Petersingh is now known as Petersingh|bomga | 08:30 | |
| *** ykarel is now known as ykarel|lunch | 08:31 | |
| numans | bandini, thanks for the review. I rebased and there isn't any conflict | 08:32 |
| bandini | numans: w00t! | 08:32 |
| numans | i mean locally | 08:32 |
| bandini | ack | 08:32 |
| *** derekh has joined #tripleo | 08:33 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Add release to gating repo https://review.openstack.org/572736 | 08:34 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Add release to gating repo https://review.openstack.org/572736 | 08:35 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Add release to gating repo https://review.openstack.org/572736 | 08:36 |
| *** ramishra has quit IRC | 08:42 | |
| openstackgerrit | Merged openstack/tripleo-common master: Set the initial introspection attempt to 0 https://review.openstack.org/571169 | 08:43 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix typo https://review.openstack.org/574538 | 08:43 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Remove hardcoded validation options https://review.openstack.org/571680 | 08:43 |
| *** ramishra has joined #tripleo | 08:44 | |
| *** rodolof has quit IRC | 08:47 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Use user specified private key when deleting temp keys https://review.openstack.org/570933 | 08:48 |
| *** moshele has quit IRC | 08:54 | |
| *** dtantsur|afk is now known as dtantsur | 08:58 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Fix bootloader packages for rhel https://review.openstack.org/573726 | 08:58 |
| *** moshele has joined #tripleo | 08:59 | |
| holser__ | mandre thanks | 09:03 |
| holser__ | by the way put your thoughts in comment I described | 09:04 |
| holser__ | there are 2 cases | 09:04 |
| holser__ | my change addresses 1st | 09:04 |
| holser__ | second is still unresolved as it needs logic similar to what we did in OCF https://github.com/ClusterLabs/resource-agents/blob/master/heartbeat/mysql-common.sh#L135-L144 | 09:04 |
| *** sshnaidm has quit IRC | 09:06 | |
| mandre | holser__: i'm not sure we can rely on the pid value in the container | 09:07 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Let's tempestconf tool handle swift related conf https://review.openstack.org/573220 | 09:07 |
| *** links has quit IRC | 09:08 | |
| mandre | from what I understand, the combination of a pid file and sock file are enough to assume mariadb is accepting connections | 09:08 |
| holser__ | mandre in first case yes. and patch addresses then | 09:08 |
| holser__ | mandre, second case is crash of container. In that case you'll have pid and sock file from previus mysql run | 09:09 |
| holser__ | mandre I am not 100% sure that's the case | 09:09 |
| mandre | holser__: is it really keeping the sock files around if the container restarts? | 09:09 |
| holser__ | mandre if restart everything will work correctly | 09:10 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 09:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 09:10 |
| holser__ | I am talking about something of unexpected | 09:10 |
| holser__ | sudden power off of node or crash of mariadb | 09:10 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Sanitize messages in FormErrorList https://review.openstack.org/575041 | 09:11 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-heat-templates master: [DNM] to test fs050 https://review.openstack.org/575042 | 09:11 |
| mandre | holser__: yeah I meant if the container crash, i've never heard of zombie sock files, that's why I'm curious | 09:12 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Sanitize messages in FormErrorList https://review.openstack.org/575041 | 09:14 |
| *** ffiore has quit IRC | 09:21 | |
| *** pdeore has quit IRC | 09:21 | |
| *** mhenkel_ has joined #tripleo | 09:22 | |
| *** salmankhan has joined #tripleo | 09:22 | |
| *** limao has quit IRC | 09:22 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-heat-templates master: Update capabilities-map https://review.openstack.org/562135 | 09:22 |
| *** ffiore has joined #tripleo | 09:23 | |
| *** links has joined #tripleo | 09:25 | |
| *** udesale_ has joined #tripleo | 09:26 | |
| holser__ | mandre that's why I am not trying to resolve second case | 09:26 |
| *** ykarel|lunch is now known as ykarel | 09:26 | |
| *** udesale__ has quit IRC | 09:26 | |
| holser__ | mandre but thanks for +2 | 09:26 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-heat-templates master: [DNM] to thest fs050 with pareting patches https://review.openstack.org/575051 | 09:27 |
| *** udesale__ has joined #tripleo | 09:28 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-heat-templates stable/queens: To test new fs050 job from-release-upgrades https://review.openstack.org/575052 | 09:28 |
| jtomasek | shardy: to limit the roles by deployment plan type, we could just add key to plan-environment which would whitelist role names and update list_available_roles to check the whitelist. Alternatively we can do the same but on the role tag level - add list of role tags to plan-environment and make list_available_roles workflow list just those with the tag | 09:29 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-common master: [DNM] to test fs050 with Depends-On and parenting https://review.openstack.org/575054 | 09:31 |
| *** udesale_ has quit IRC | 09:31 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Align roles file to become a normalized path https://review.openstack.org/572404 | 09:32 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-common master: [DNM] to test fs050 with Depends-On and parenting https://review.openstack.org/575054 | 09:34 |
| *** lifeless_ has joined #tripleo | 09:34 | |
| *** lifeless has quit IRC | 09:34 | |
| shardy | jtomasek: ack yeah I was thinking the role tags may be best, so we don't have to update every plan-environment each time e.g a new OpenStack role gets added? | 09:35 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-common stable/queens: [DNM] to test fs050 new job from-release-upgrades with pareting and Depends-On https://review.openstack.org/575055 | 09:37 |
| *** gfidente has joined #tripleo | 09:38 | |
| *** gfidente has quit IRC | 09:38 | |
| *** gfidente has joined #tripleo | 09:38 | |
| jtomasek | shardy: sounds good yes, so a new task would be added before here https://github.com/openstack/tripleo-common/blob/master/workbooks/plan_management.yaml#L1196 which checks plan-environment for available_roles_tags | 09:38 |
| jtomasek | and get_role_files would filter out objects without the tag | 09:39 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Align roles file to become a normalized path https://review.openstack.org/572404 | 09:40 |
| *** slaweq has quit IRC | 09:41 | |
| *** sshnaidm has joined #tripleo | 09:42 | |
| gfidente | need another vote on https://review.openstack.org/#/c/574341/, ceph specific but easy | 09:43 |
| gfidente | same here :D https://review.openstack.org/#/c/574664/ | 09:43 |
| *** lifeless has joined #tripleo | 09:44 | |
| *** ffiore has quit IRC | 09:45 | |
| *** bkopilov has quit IRC | 09:45 | |
| *** tcw1 has joined #tripleo | 09:45 | |
| *** lifeless_ has quit IRC | 09:46 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-common stable/queens: [DNM] to test fs050 new job from-release-upgrades with pareting and Depends-On https://review.openstack.org/575055 | 09:47 |
| *** tcw has quit IRC | 09:47 | |
| openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo master: Add QDR profile for metrics purposes. https://review.openstack.org/571743 | 09:50 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-upgrade master: Add timestamps to logs of upgrade tasks https://review.openstack.org/574892 | 09:51 |
| chem | matbu: hi, there's an issue in the backport https://review.openstack.org/#/c/574624/2 | 09:58 |
| chem | matbu: I let a comment there | 09:58 |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-specs master: Spec for improved privilege escalation in py-scripts https://review.openstack.org/572761 | 10:00 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Fix logrotate_crond issues https://review.openstack.org/574835 | 10:01 |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-specs master: [WIP] Spec for improved privilege escalation in py-scripts https://review.openstack.org/572761 | 10:02 |
| *** ffiore has joined #tripleo | 10:04 | |
| *** pdeore has joined #tripleo | 10:04 | |
| *** salmankhan has quit IRC | 10:06 | |
| *** salmankhan has joined #tripleo | 10:07 | |
| *** slaweq has joined #tripleo | 10:08 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 10:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 10:10 |
| *** links has quit IRC | 10:12 | |
| *** leanderthal has quit IRC | 10:17 | |
| *** d0ugal has quit IRC | 10:17 | |
| *** jbadiapa has quit IRC | 10:19 | |
| *** rodolof has joined #tripleo | 10:20 | |
| *** rodolof has quit IRC | 10:21 | |
| *** rodolof has joined #tripleo | 10:21 | |
| *** lifeless has quit IRC | 10:23 | |
| *** lifeless has joined #tripleo | 10:24 | |
| *** jpena is now known as jpena|off | 10:24 | |
| *** links has joined #tripleo | 10:25 | |
| *** mdnadeem has quit IRC | 10:25 | |
| *** psahoo has quit IRC | 10:26 | |
| *** udesale_ has joined #tripleo | 10:26 | |
| *** udesale__ has quit IRC | 10:29 | |
| *** Petersingh|bomga is now known as Petersingh | 10:29 | |
| *** udesale__ has joined #tripleo | 10:30 | |
| *** jbadiapa has joined #tripleo | 10:30 | |
| *** lifeless_ has joined #tripleo | 10:32 | |
| *** jpena|off is now known as jpena | 10:32 | |
| *** lifeless has quit IRC | 10:32 | |
| *** udesale_ has quit IRC | 10:33 | |
| *** zoli is now known as zoli|lunch | 10:33 | |
| *** akrivoka has quit IRC | 10:35 | |
| *** d0ugal has joined #tripleo | 10:37 | |
| *** jaganathan has joined #tripleo | 10:40 | |
| *** lvdombrkr89 has quit IRC | 10:43 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Implement fetching of networks https://review.openstack.org/548685 | 10:43 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Initial Network configuration views https://review.openstack.org/569124 | 10:43 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: [WIP] Add Network Topology diagram https://review.openstack.org/569125 | 10:43 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: progress with lines https://review.openstack.org/575075 | 10:43 |
| *** rodolof has quit IRC | 10:49 | |
| *** rodolof has joined #tripleo | 10:51 | |
| *** hjensas has joined #tripleo | 10:52 | |
| *** hjensas has quit IRC | 10:52 | |
| *** hjensas has joined #tripleo | 10:52 | |
| *** aufi has joined #tripleo | 10:54 | |
| *** suuuper has joined #tripleo | 10:57 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Enable decoupled deployment plans e.g for OpenShift, DPDK etc https://review.openstack.org/574753 | 10:59 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add OpenShift plans https://review.openstack.org/575077 | 10:59 |
| *** leanderthal has joined #tripleo | 11:01 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-heat-templates stable/queens: [DNM] To test fs050 from-release-upgrades job https://review.openstack.org/574671 | 11:01 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-heat-templates stable/queens: To test new fs050 job from-release-upgrades https://review.openstack.org/575052 | 11:01 |
| *** anande has joined #tripleo | 11:03 | |
| *** florianf has quit IRC | 11:04 | |
| *** ratailor has quit IRC | 11:04 | |
| *** florianf has joined #tripleo | 11:04 | |
| sri_ | shardy: Hi, I am trying to deploy undercloud in containers but I am getting this error !! http://paste.openstack.org/show/723376/ | 11:06 |
| anande | Hi Guys - How do we pass values to a j2.yaml file for execution during overcloud deploy - any idea ? | 11:07 |
| anande | I was looking at - https://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/roles/README.rst#n10 | 11:07 |
| anande | which makes me think it needs a role with a resource_registry definition pointing to the j2.yaml | 11:07 |
| *** udesale_ has joined #tripleo | 11:07 | |
| anande | am I right | 11:07 |
| *** quiquell is now known as quiquell|afk | 11:08 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 11:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 11:10 |
| *** udesale__ has quit IRC | 11:10 | |
| *** jaganathan has quit IRC | 11:11 | |
| *** leanderthal has quit IRC | 11:13 | |
| *** mhenkel_ has quit IRC | 11:15 | |
| *** florianf has quit IRC | 11:15 | |
| *** florianf has joined #tripleo | 11:16 | |
| *** leanderthal has joined #tripleo | 11:16 | |
| *** ansmith has quit IRC | 11:23 | |
| *** bkopilov has joined #tripleo | 11:25 | |
| *** abishop has joined #tripleo | 11:26 | |
| *** pradk has joined #tripleo | 11:29 | |
| *** lvdombrkr has joined #tripleo | 11:29 | |
| *** jidar has quit IRC | 11:30 | |
| *** lvdombrkr89 has joined #tripleo | 11:31 | |
| *** morazi has joined #tripleo | 11:32 | |
| *** atoth has joined #tripleo | 11:33 | |
| *** lvdombrkr has quit IRC | 11:33 | |
| *** quiquell|afk is now known as quiquell | 11:35 | |
| *** mhenkel_ has joined #tripleo | 11:39 | |
| *** vpickard_ is now known as vpickard | 11:41 | |
| anande | shardy, bnemec ^^ any thoughts on my above query | 11:42 |
| *** lifeless_ has quit IRC | 11:42 | |
| *** lifeless has joined #tripleo | 11:42 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add upgrade and update logs to logstash indexing https://review.openstack.org/570896 | 11:44 |
| *** shreshtha_ has quit IRC | 11:45 | |
| *** akrivoka has joined #tripleo | 11:45 | |
| *** shreshtha_ has joined #tripleo | 11:45 | |
| *** jpena is now known as jpena|lunch | 11:45 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/queens: Use user specified private key when deleting temp keys https://review.openstack.org/570935 | 11:46 |
| *** zoli|lunch is now known as zoli|wfh | 11:47 | |
| openstackgerrit | Flavio Percoco proposed openstack-infra/tripleo-ci master: Collect /etc/os-*/ to get os-net-config https://review.openstack.org/575088 | 11:48 |
| *** rlandy has joined #tripleo | 11:49 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Update for openshift 3.9 https://review.openstack.org/574233 | 11:49 |
| *** rlandy is now known as rlandy|rover | 11:50 | |
| *** dhill_ has joined #tripleo | 11:53 | |
| *** pkovar has joined #tripleo | 11:53 | |
| *** fultonj has quit IRC | 11:53 | |
| *** ffiore has quit IRC | 11:53 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Add release to gating repo https://review.openstack.org/572736 | 11:56 |
| *** lblanchard has joined #tripleo | 11:57 | |
| *** leanderthal has quit IRC | 11:57 | |
| *** fultonj has joined #tripleo | 11:58 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Add release to gating repo https://review.openstack.org/572736 | 11:59 |
| jaosorior | moguimar, lhinds: around? | 12:00 |
| moguimar | o/ | 12:00 |
| jaosorior | redrobot: ^^ | 12:00 |
| jaosorior | hey moguimar! how's it going? | 12:01 |
| jaosorior | moguimar: know where raildo is? | 12:01 |
| jaosorior | #startmeeting TripleO Security Squad | 12:01 |
| moguimar | didn't talk to him today | 12:01 |
| openstack | Meeting started Wed Jun 13 12:01:19 2018 UTC and is due to finish in 60 minutes. The chair is jaosorior. Information about MeetBot at http://wiki.debian.org/MeetBot. | 12:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 12:01 |
| *** openstack changes topic to " (Meeting topic: TripleO Security Squad)" | 12:01 | |
| jaosorior | lets wait some minutes for some folks to log in | 12:01 |
| openstack | The meeting name has been set to 'tripleo_security_squad' | 12:01 |
| moguimar | he was feeling sick yesterday | 12:01 |
| moguimar | #link https://etherpad.openstack.org/p/tripleo-security-squad | 12:02 |
| jaosorior | that's a bummer :/ | 12:02 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-common master: DONT REVIEW: used for testing only https://review.openstack.org/447276 | 12:02 |
| openstackgerrit | Sagi Shnaidman proposed openstack/puppet-tripleo master: DONT REVIEW: testing patch https://review.openstack.org/529077 | 12:03 |
| *** pkovar1 has joined #tripleo | 12:03 | |
| *** pkovar has quit IRC | 12:03 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: DNM: test built-tests with all jobs https://review.openstack.org/575090 | 12:03 |
| sshnaidm | quiquell, ^^ | 12:03 |
| *** trown|outtypewww is now known as trown | 12:04 | |
| *** amoralej is now known as amoralej|lunch | 12:04 | |
| quiquell | sshnaidm: I see, I was just adding one file | 12:05 |
| *** chem` has joined #tripleo | 12:06 | |
| *** waleedm has quit IRC | 12:06 | |
| openstackgerrit | Flavio Percoco proposed openstack-infra/tripleo-ci master: Collect /etc/os-*/ to get os-net-config https://review.openstack.org/575088 | 12:06 |
| *** chem has quit IRC | 12:06 | |
| *** chem` is now known as chem | 12:07 | |
| jaosorior | Alright, I guess we can begin | 12:07 |
| moguimar | ok | 12:07 |
| jaosorior | #topic oslo pluggable secrets backend discussion | 12:07 |
| *** openstack changes topic to "oslo pluggable secrets backend discussion (Meeting topic: TripleO Security Squad)" | 12:07 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates stable/queens: Match only haproxy for docker ps and skipp all *-haproxy occurences https://review.openstack.org/574624 | 12:07 |
| *** edmondsw has joined #tripleo | 12:07 | |
| moguimar | I'm currently working on the sample generator | 12:07 |
| moguimar | for the ini driver | 12:07 |
| moguimar | to be used with oslo-config-generator | 12:08 |
| *** Guest52381 is now known as rbrady | 12:08 | |
| *** rbrady has joined #tripleo | 12:08 | |
| moguimar | we still have two other tasks to the end of phase 0 | 12:08 |
| jaosorior | What are the plans for the ini driver? | 12:08 |
| jaosorior | is that something that we | 12:09 |
| jaosorior | we'll take into use? | 12:09 |
| jaosorior | or was it just a reference driver? | 12:09 |
| moguimar | in general, we are adding to oslo.config the hability to fetch extra config from external locations | 12:09 |
| *** quiquell is now known as quiquell|lunch | 12:09 | |
| moguimar | at first as a reference, but it kinda seems usable | 12:09 |
| moguimar | as we can use https | 12:10 |
| jaosorior | moguimar: any further plans on that front? | 12:10 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 12:10 |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 12:10 |
| moguimar | the user can specify ca_path, client_cert and client_key | 12:10 |
| *** nyechiel_ has quit IRC | 12:10 | |
| moguimar | so we can strip sensitive data out of config files and centralize it somewhere else | 12:11 |
| jaosorior | moguimar: wasn't that the plan but instead to use the castellan driver? | 12:11 |
| moguimar | castellan driver is phase 1 | 12:11 |
| moguimar | phase 0 is a proof of concept with the ini driver | 12:12 |
| moguimar | so, phase 0 is the ini driver | 12:12 |
| moguimar | phase 1 is the castellan driver | 12:12 |
| moguimar | and phase 2 is triple0 integration | 12:12 |
| moguimar | we are aiming to land phase 0 on rocky and phase 1 on stein | 12:13 |
| jaosorior | I see | 12:13 |
| jaosorior | So, what are the plans regarding TripleO integration at the moment? anything that could be started now? | 12:14 |
| *** leanderthal has joined #tripleo | 12:14 | |
| moguimar | we are working on a spec | 12:15 |
| moguimar | actually phase 2 is not tripleO integration | 12:15 |
| moguimar | it is about automation support | 12:15 |
| moguimar | when the spec comes out we'll have more details | 12:15 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Streamline variables passed in different environments https://review.openstack.org/573819 | 12:15 |
| moguimar | #link https://etherpad.openstack.org/p/oslo-config-plaintext-secrets | 12:15 |
| *** dprince has joined #tripleo | 12:16 | |
| moguimar | the link to the spec is here | 12:16 |
| moguimar | #link https://review.openstack.org/#/c/474304/ | 12:16 |
| jaosorior | moguimar: right, but that was the oslo spec | 12:16 |
| jaosorior | for TripleO we would prefer to have a separate one | 12:16 |
| jaosorior | and from what I can tell, the same is with the oslo folks, they would prefer to remove the TripleO specifics from that spec | 12:17 |
| moguimar | so far we only have a placeholder for the tripleO bits | 12:17 |
| moguimar | yep, the tripleO parts are to be defined yet in a separate spec | 12:17 |
| jaosorior | ok | 12:18 |
| moguimar | that's all I have for nwo | 12:18 |
| moguimar | now* | 12:18 |
| jaosorior | thanks | 12:18 |
| jaosorior | if there's anything you want to discuss regarding TripleO integration, this is a good place to bring it up | 12:18 |
| moguimar | ok | 12:19 |
| jaosorior | At some point we do need to discuss what backend will castellan use | 12:19 |
| jaosorior | and how that deployment will look like | 12:19 |
| moguimar | the castellan phase still need some planning | 12:19 |
| jaosorior | that's alright | 12:20 |
| jaosorior | there is time :) | 12:20 |
| moguimar | I'll leave a note in the trello card to bring the discussion here | 12:20 |
| jaosorior | lets come back to this once that's more defined | 12:20 |
| jaosorior | lhinds, are you around? | 12:20 |
| *** marios has quit IRC | 12:20 | |
| *** marios has joined #tripleo | 12:20 | |
| lhinds | yep jaosorior | 12:20 |
| lhinds | just in.. | 12:20 |
| jaosorior | #topic Limit TripleO users | 12:21 |
| *** openstack changes topic to "Limit TripleO users (Meeting topic: TripleO Security Squad)" | 12:21 | |
| jaosorior | lhinds: can you give a brief update on the status of that? | 12:21 |
| jaosorior | I know you're quite busy, so I really appreciate that you were able to make it | 12:21 |
| lhinds | for this one we will need to move the spec into stein, as to late for rocky (which is understandable) | 12:21 |
| lhinds | cederic has a spec in review, and mine should be up later today or at least before the end of this week as a latest. | 12:22 |
| lhinds | that's it for now | 12:22 |
| jaosorior | lhinds: did you manage to get some resolution on getting the sudo rules from CI? | 12:23 |
| *** udesale__ has joined #tripleo | 12:23 | |
| *** aufi has quit IRC | 12:23 | |
| lhinds | I have some ideas, as sudo gives an exit code, but need to chew it over with someone from CI. | 12:24 |
| lhinds | If command is specified but not allowed, sudo will exit with a status value of 1 | 12:24 |
| lhinds | so we could harness this in CI as that would consitute a build failure. | 12:24 |
| lhinds | some of this we may need to trash out in review though | 12:25 |
| jaosorior | lhinds: wouldn't that be just a deployment failure? | 12:25 |
| lhinds | yes, hold on I see what you mean now. | 12:25 |
| *** udesale_ has quit IRC | 12:25 | |
| lhinds | so two phases , the first is to gather the info. | 12:25 |
| lhinds | second above, would be to test it on-going | 12:26 |
| jaosorior | oh, I see | 12:27 |
| lhinds | but need to see if that would be agreed, as like you say it breaks a deployment | 12:28 |
| lhinds | It's SELinux all over again | 12:28 |
| *** saneax has quit IRC | 12:28 | |
| jaosorior | x_X | 12:28 |
| *** saneax has joined #tripleo | 12:28 | |
| jaosorior | lhinds: thanks for the update | 12:29 |
| jaosorior | lhinds: let me know if there's something I can help out with regarding that task | 12:30 |
| lhinds | will do , thanks jaosorior | 12:30 |
| * redrobot is still waiting for the coffee to kick in ... 😴 | 12:30 | |
| jaosorior | #topic Any other business | 12:30 |
| *** openstack changes topic to "Any other business (Meeting topic: TripleO Security Squad)" | 12:30 | |
| jaosorior | Anything else that folks want to bring up to the meeting? | 12:30 |
| EmilienM | dciabrin_: can you please review https://review.openstack.org/#/c/574873/ when you have time? | 12:31 |
| jaosorior | redrobot: haha same here, but it's 3pm here :P | 12:31 |
| EmilienM | dciabrin_: err wrong link nevermind. | 12:31 |
| *** jpich has quit IRC | 12:31 | |
| dciabrin_ | EmilienM, :) | 12:31 |
| EmilienM | dciabrin_: too early :P | 12:31 |
| *** udesale__ has quit IRC | 12:31 | |
| *** moshele has quit IRC | 12:32 | |
| *** liverpooler has joined #tripleo | 12:32 | |
| *** moshele has joined #tripleo | 12:33 | |
| jaosorior | Alright folks! thanks for joining! | 12:33 |
| jaosorior | #endmeeting | 12:33 |
| *** openstack changes topic to "Welcome to Rocky. CI status: ORANGE, rdo-cloud/zuul issues causing delays in third party | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest" | 12:33 | |
| openstack | Meeting ended Wed Jun 13 12:33:35 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 12:33 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo_security_squad/2018/tripleo_security_squad.2018-06-13-12.01.html | 12:33 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo_security_squad/2018/tripleo_security_squad.2018-06-13-12.01.txt | 12:33 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo_security_squad/2018/tripleo_security_squad.2018-06-13-12.01.log.html | 12:33 |
| EmilienM | dciabrin_: replied on https://review.openstack.org/#/c/574934/ | 12:34 |
| *** anande has quit IRC | 12:35 | |
| dciabrin_ | EmilienM, ack let me manage to deploy a containerized undercloud and I'll follow up shortly | 12:38 |
| EmilienM | dciabrin_: let me know if you need help for that | 12:38 |
| *** aufi has joined #tripleo | 12:38 | |
| dciabrin_ | EmilienM, i'm trying to do that with dprince's undercloud_containers. Do you have other means? maybe a simple cmd to replicate what CI does? | 12:39 |
| *** nguyenhai has joined #tripleo | 12:39 | |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-docs master: Add Fast Forward Upgrade docs https://review.openstack.org/549892 | 12:39 |
| *** quiquell|lunch is now known as quiquell | 12:40 | |
| EmilienM | dciabrin_: not sure what's "dprince's undercloud_containers" but the only way we support a containerized undercloud is to use --use-heat now: openstack undercloud install --use-heat | 12:40 |
| EmilienM | dciabrin_: everything is documented on https://docs.openstack.org/tripleo-docs/latest/install/installation/installation.html#installing-the-undercloud | 12:40 |
| dciabrin_ | EmilienM, ack thx! | 12:40 |
| *** pdeore has quit IRC | 12:40 | |
| EmilienM | dciabrin_: this is the gist I use on my fresh centos7 VM: https://gist.github.com/EmilienM/2968a53e6ca03de8a0eed6a9a1cc9f73 | 12:41 |
| dciabrin_ | EmilienM, even better :) | 12:41 |
| dprince | EmilienM: it is the same thing. I updated it to --use-heat a while back, https://github.com/dprince/undercloud_containers/blob/master/doit.sh#L159 | 12:42 |
| dprince | dciabrin_: but you should use the latest and greatest for sure | 12:42 |
| dciabrin_ | dprince, EmilienM ack thanks guys | 12:42 |
| *** shardy has quit IRC | 12:42 | |
| *** tcw1 has quit IRC | 12:43 | |
| EmilienM | dprince: sure I guess what I'm saying is we don't need your repo to deploy a containerized undercloud, we can just follow the doc | 12:43 |
| EmilienM | and if something isn't working out of the box we need to fix it | 12:44 |
| weshay | gfidente, https://review.openstack.org/#/c/573142/ is failing unit tests in the gate :( | 12:44 |
| dprince | EmilienM: absolutely. nobody is arguing for a new repo. But for you to know a group of us used this repo in the past to develop the Containerized Overcloud. | 12:44 |
| *** jcoufal has quit IRC | 12:45 | |
| dprince | EmilienM: it was *very* useful at the time to prototype, etc. | 12:45 |
| gfidente | weshay though it passed at check | 12:45 |
| gfidente | weshay I'll review it | 12:45 |
| EmilienM | dprince: I know, it's fine | 12:45 |
| weshay | gfidente, ya.. thanks | 12:45 |
| gfidente | weshay thanks for pinging | 12:45 |
| dprince | EmilienM: without it, none of what you are now documenting would exist I think :). But agree, lets point people to the new docs instead | 12:45 |
| weshay | arxcruz|ruck, rlandy|rover for the ruck/rover handoff.. please note to the newbies that the zuul gate is at 21hr | 12:46 |
| rlandy|rover | weshay: oh they will get our sob story on gate times on both zuul queues | 12:46 |
| weshay | :) | 12:47 |
| weshay | thanks | 12:47 |
| *** tcw has joined #tripleo | 12:47 | |
| tosky | weshay: and I thought that everyone has zuul tab open and checks the number of elements in the queue every few minutes! | 12:47 |
| beagles | weshay: were you looking adding a DVR job - it's been on my TODO list for awhile but I won't get to it until I'm done with release issues | 12:47 |
| beagles | weshay: or were you just checking for where it was and why it wasn't being run ;) | 12:48 |
| weshay | beagles, I just emailed Assaf, I can forward the email to you as well | 12:48 |
| beagles | weshay: cool thanks | 12:48 |
| EmilienM | dprince: i've got your point, it's fine ;-) | 12:48 |
| *** nyechiel_ has joined #tripleo | 12:48 | |
| *** cshastri has quit IRC | 12:49 | |
| weshay | beagles, let's just expose what is needed on the list, agenda and work from there | 12:50 |
| beagles | weshay: agreed! | 12:50 |
| *** liverpooler has quit IRC | 12:51 | |
| *** liverpooler has joined #tripleo | 12:51 | |
| *** jidar has joined #tripleo | 12:54 | |
| *** shardy has joined #tripleo | 12:59 | |
| flaper87 | weshay: EmilienM the collect `/etc/os-net-config` change you +2'd depends on this one (for no reason other than me avoiding conflicts) https://review.openstack.org/#/c/575015/ | 13:01 |
| flaper87 | mind reviewing the base change too? | 13:01 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Update for openshift 3.9 https://review.openstack.org/574233 | 13:02 |
| EmilienM | flaper87: maybe | 13:02 |
| *** moshele has quit IRC | 13:02 | |
| flaper87 | EmilienM: pretty please? | 13:02 |
| EmilienM | :P | 13:04 |
| *** ffiore has joined #tripleo | 13:04 | |
| *** mhenkel__ has joined #tripleo | 13:07 | |
| *** Goneri has joined #tripleo | 13:07 | |
| *** mhenkel_ has quit IRC | 13:07 | |
| sri_ | dprince, Hi, I have a small query related to overcloud networking, as of now I've created overcloud with single nic and single nic with vlan, but this time I have a server with 6 NICs and we are planning to create three bonds, first bond for management and provisioning, second bond for tenant and storage, and third bond for external networking(for floating IPs ). any suggestions how to archive this. | 13:08 |
| dprince | sri_: you could model it after this: http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/network/config/bond-with-vlans/README.md | 13:10 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 13:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 13:10 |
| dprince | sri_: you'd need to model it differently so you had a bond for each NIC pair you want. And then assign the networks accordingly | 13:10 |
| *** mhenkel__ has quit IRC | 13:11 | |
| dprince | sri_: also, I'm not sure we support a bonded provisioning network (ctlplane) | 13:11 |
| *** tzumainn has joined #tripleo | 13:13 | |
| *** moshele has joined #tripleo | 13:13 | |
| *** jcoufal has joined #tripleo | 13:14 | |
| sri_ | dprince: understood, i can create a external network with out subnet or IP address right ? so that all the all the traffic on the bond is L2 | 13:14 |
| dprince | sri_: should be okay yes | 13:15 |
| sri_ | dprince, i am little confused about why there is no external network in compute node ? when we enable dvr all the north-south traffic directly goes to compute node right ? | 13:16 |
| dprince | sri_: without DVR it isn't needed and those network templates were probably not made for DVR | 13:18 |
| dprince | sri_: you can craft your own for that if you wish I think | 13:18 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/newton: Add missing nfs_mount_options for Cinder Netapp backend https://review.openstack.org/574365 | 13:19 |
| *** skramaja has quit IRC | 13:21 | |
| *** ansmith has joined #tripleo | 13:21 | |
| sri_ | dprince: I see, thanks for your time :) | 13:22 |
| sri_ | dprince, i am sorry if i ask silly questions, thanx :) | 13:25 |
| dprince | sri_: good questions, and no problem | 13:25 |
| lvdombrkr89 | hello folks, is there possibility create networking not as default - network ->subnet->VM, bet something like network (vlan) -> instance ? i mean without subnets | 13:27 |
| *** amoralej|lunch is now known as amoralej | 13:28 | |
| *** shardy has quit IRC | 13:30 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Align roles file to become a normalized path https://review.openstack.org/572404 | 13:31 |
| *** hrybacki is now known as hrybacki|mtg | 13:31 | |
| gfidente | weshay funny though the issues are completely unrelated :D | 13:33 |
| gfidente | http://logs.openstack.org/42/573142/2/gate/puppet-openstack-unit-4.8-centos-7/a4ee042/job-output.txt.gz | 13:33 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Set ODL API restart policy to unless-stopped https://review.openstack.org/575111 | 13:33 |
| *** kopecmartin has quit IRC | 13:34 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Set ODL API restart policy to unless-stopped before stopping it https://review.openstack.org/575111 | 13:34 |
| *** hakhande_ has joined #tripleo | 13:38 | |
| *** yprokule_ has joined #tripleo | 13:38 | |
| *** mcornea has joined #tripleo | 13:39 | |
| *** yprokule has quit IRC | 13:40 | |
| *** yprokule_ is now known as yprokule | 13:40 | |
| hakhande_ | Hello, I am facing issue with my deployment..It says "Expected hypervisor stats not met Configuration has 1 errors, fix them before proceeding. Ignoring these errors is likely to lead to a failed deploy." However, i see enough nodes under ironic node-list and introspection too went fine.. Can anyone suggests what might went wrong.. I am using RHOSP10 | 13:40 |
| hakhande_ | Appreciate your help/suggestions | 13:41 |
| openstackgerrit | Alan Bishop proposed openstack/puppet-tripleo stable/queens: Handle renaming of Cinder VNX backend parameter https://review.openstack.org/575114 | 13:43 |
| *** slaweq has quit IRC | 13:47 | |
| *** slaweq has joined #tripleo | 13:51 | |
| *** slaweq has quit IRC | 13:51 | |
| *** slaweq has joined #tripleo | 13:52 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Set ODL API restart policy to unless-stopped https://review.openstack.org/575111 | 13:56 |
| *** moshele has quit IRC | 14:02 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add a lookup plugin to get mistral workflow results https://review.openstack.org/575121 | 14:03 |
| *** yprokule_ has joined #tripleo | 14:05 | |
| *** jpena|lunch is now known as jpena | 14:06 | |
| *** yprokule has quit IRC | 14:07 | |
| *** yprokule_ is now known as yprokule | 14:07 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 14:10 |
| *** shreshtha_ has quit IRC | 14:10 | |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 14:10 |
| *** sanjay__u has quit IRC | 14:10 | |
| *** shreshtha_ has joined #tripleo | 14:10 | |
| *** Noam_ has joined #tripleo | 14:12 | |
| *** dtrainor has joined #tripleo | 14:13 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/queens: Add environment/services-baremetal/*. https://review.openstack.org/567797 | 14:15 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/queens: Default environment/services/* to docker https://review.openstack.org/567800 | 14:15 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/queens: Delete not-used services-docker files https://review.openstack.org/567810 | 14:15 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/queens: Move remnants of environments/services-docker https://review.openstack.org/567811 | 14:15 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/queens: Switch remaining env files to containers defaults https://review.openstack.org/567813 | 14:15 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/queens: Support containerized DVR in compute role https://review.openstack.org/573199 | 14:15 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/queens: Adds docker SFC and cleans up ODL envs https://review.openstack.org/575122 | 14:15 |
| *** florianf has quit IRC | 14:15 | |
| *** dparkes has quit IRC | 14:16 | |
| *** akrivoka_ has joined #tripleo | 14:17 | |
| *** akrivoka has quit IRC | 14:18 | |
| *** florianf has joined #tripleo | 14:19 | |
| *** shardy has joined #tripleo | 14:25 | |
| *** dparkes has joined #tripleo | 14:28 | |
| *** rodolof has quit IRC | 14:29 | |
| *** dmsimard has joined #tripleo | 14:29 | |
| *** dmsimard has quit IRC | 14:29 | |
| *** dmsimard has joined #tripleo | 14:29 | |
| *** rodolof has joined #tripleo | 14:29 | |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-heat-templates master: Remove unuseful become: true from deploy-steps https://review.openstack.org/575128 | 14:30 |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates master: Reduce verbosity during mysql bootstrap, non-HA https://review.openstack.org/575129 | 14:30 |
| *** itlinux has quit IRC | 14:34 | |
| larsks | mwhahaha: if you're around, I have a question about the puppet-keystone module, which it looks like you've worked on a bit. This is w/r/t to adding support for openidc federation to tripleo. | 14:44 |
| * mwhahaha didn't do the federation stuff | 14:44 | |
| mwhahaha | but sure what's your question? | 14:44 |
| *** rodolof has quit IRC | 14:44 | |
| *** kopecmartin has joined #tripleo | 14:45 | |
| *** rodolof has joined #tripleo | 14:45 | |
| *** Noam_ has quit IRC | 14:45 | |
| *** ksambor has quit IRC | 14:45 | |
| *** ffiore has quit IRC | 14:45 | |
| larsks | mwhahaha: the openidc manifest references $::keystone::public_endpoint (https://github.com/openstack/puppet-keystone/blob/master/manifests/federation/openidc.pp#L122), but that isn't even set in a typical deployment. | 14:46 |
| larsks | What *should* it be using? | 14:46 |
| larsks | $::keystone::endpoint::public_url, maybe? | 14:46 |
| mwhahaha | so for v3 admin == public | 14:46 |
| larsks | Well, same question for ::keystone::admin_endpoint, which also isn't set. | 14:47 |
| mwhahaha | i mean this code could be bad | 14:47 |
| larsks | Yeah, it is. | 14:47 |
| larsks | I am wondering if it should be using one of the $::keystone::endpoint::... variables. | 14:47 |
| larsks | (that is, can I assume that those will be set) | 14:47 |
| mwhahaha | so it's likely because of the way it's being included | 14:47 |
| mwhahaha | techincally those params exist | 14:47 |
| *** strigazi has joined #tripleo | 14:48 | |
| mwhahaha | or could exist | 14:48 |
| mwhahaha | https://github.com/openstack/puppet-keystone/blob/master/manifests/init.pp#L307-L321 | 14:48 |
| *** ffiore has joined #tripleo | 14:48 | |
| mwhahaha | it's likely that the class needs to be updated to accept those params | 14:48 |
| larsks | mwhahaha: but they're optional, and we don't set them. | 14:48 |
| strigazi | Hello, I have a question about openstack/puppet-heat | 14:48 |
| strigazi | it seems that it is not possible to set the creds for the trustee section | 14:48 |
| larsks | But we do set $::keystone::endpoint::public_url and friends. | 14:48 |
| mwhahaha | larsks: so that's a question for the keystone folks on if we should set this stuff | 14:49 |
| larsks | Hmmm. I mean, the value is only used to build a URL that goes into the Apache configuration...so I figured it was less of a keystone question. But I'll ask around. | 14:49 |
| *** ffiore has quit IRC | 14:49 | |
| mwhahaha | larsks: but it's not, it's set in keystone conf | 14:50 |
| mwhahaha | larsks: but i don't know what should be set or not which is why i said ask the keystone folks on if we should be setting it | 14:50 |
| larsks | It can be, right, but in a typical tripleo install those values aren't set at all. | 14:50 |
| larsks | They're commented out. | 14:50 |
| mwhahaha | https://github.com/openstack/puppet-keystone/blob/master/manifests/init.pp#L823-L827 | 14:50 |
| mwhahaha | because we just inherit the defaults from keystone | 14:50 |
| larsks | I'll ask the keystone folks. | 14:51 |
| mwhahaha | but if we need to be setting them for other things, the class needs to be updated. but the problem is *i* don't know what's correct | 14:51 |
| mwhahaha | strigazi: yes you can? https://github.com/openstack/puppet-heat/blob/09e9499c4774f4a427acbe2e8dd983b6331ce896/manifests/init.pp#L429-L435 | 14:51 |
| shardy | strigazi: the trustee is the user interacting with heat, you get the credentials/token in the context of the API request | 14:51 |
| mwhahaha | or rather it is already set | 14:52 |
| strigazi | mwhahaha: it can not be different than the authtoken section | 14:53 |
| mwhahaha | see shardy's response -^ | 14:53 |
| shardy | strigazi: sorry I was thinking of the trustor, but yes as mwhahaha says you can set the trustee credentials | 14:53 |
| * mwhahaha doesn't know enough about heat to know if they could/should be different | 14:54 | |
| shardy | and it should always be in a different section to the authtoken middleware | 14:54 |
| shardy | e.g in TripleO we always create two different users for each of those sections | 14:54 |
| mwhahaha | it is in a different section, but it's reusing the same creds | 14:54 |
| shardy | Oh hmm I thought we were delegating to the heat domain admin user | 14:55 |
| mwhahaha | if that needs to be changed, it should be a patch to puppet-heat with a fall back to the keystone creds if not provided i guess | 14:55 |
| * mwhahaha doesn't know how this stuff works in heat | 14:55 | |
| * shardy looks at the templates to remember how this works in heat ;) | 14:55 | |
| strigazi | mwhahaha: shardy but at the moment they are always the same | 14:55 |
| mwhahaha | it's one of those things that we don't actually test anywhere | 14:56 |
| beagles | bandini: dciabrin_: just a heads up. - afaict running "paunch apply" to update a container with a new image does not appear to affect other running containers that are using other images | 14:56 |
| strigazi | trustee/username value => $keystone_username; $keystone_username = $::heat::keystone::authtoken::username | 14:56 |
| mwhahaha | so it "works" in that we configure it, but i don't think we're exercising this functionality anywhere | 14:56 |
| bandini | beagles: nice. at least that part is confirmed | 14:56 |
| strigazi | shardy: https://github.com/openstack/puppet-heat/blob/stable/queens/manifests/init.pp | 14:57 |
| strigazi | shardy: this part https://github.com/openstack/puppet-heat/blob/stable/queens/manifests/init.pp#L474-L488 | 14:58 |
| shardy | strigazi: yeah sorry looks like you're right, we default trustee/password to keystone_password | 14:58 |
| shardy | so we'll need to add a new puppet-heat parameter if you need to change that | 14:58 |
| strigazi | I'm upgrading the puppet module and discovered that we carry some patches/hacks for this | 14:59 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: WIP: Add instance reboot ssh test during upgrade https://review.openstack.org/553858 | 14:59 |
| strigazi | shardy: where should we add the new params? | 14:59 |
| mwhahaha | strigazi: in puppet-heat | 14:59 |
| mwhahaha | move those vars to params | 14:59 |
| mwhahaha | and leave the defaults as is | 14:59 |
| mwhahaha | then in THT we can set them | 15:00 |
| *** jlibosva has joined #tripleo | 15:00 | |
| shardy | yeah sounds good - strigazi have you tested that this works fine delegating to a user other than the heat admin user@? | 15:00 |
| shardy | it should but tbh I've not tested it | 15:00 |
| * shardy wrote this stuff in like 2013, it's hard to remember the details :) | 15:00 | |
| strigazi | shardy: my heat.conf looks like: | 15:01 |
| dciabrin_ | beagles, phew, great :) | 15:03 |
| strigazi | shardy: http://paste.openstack.org/show/723394/ I was removing passwords/urls | 15:03 |
| *** hrybacki|mtg is now known as hrybacki | 15:04 | |
| shardy | strigazi: ack, yeah as mwhahaha said you can add the params to puppet-heat to enable independently setting each section | 15:05 |
| shardy | provided the defaults stay the same | 15:05 |
| strigazi | ok | 15:05 |
| shardy | thanks for pointing it out :) | 15:05 |
| strigazi | mwhahaha: changes go to init.pp ? I'm not very familiar with module development | 15:06 |
| strigazi | shardy: my pleasure :) | 15:06 |
| *** agopi has joined #tripleo | 15:07 | |
| lhinds | can anyone tell me where the directories (logs) here are placed: tripleo-ci/toci-quickstart/config/collect-logs.yml , do they get dumped onto logs.openstack.org as part of zuul check? | 15:07 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Set ODL API restart policy to unless-stopped https://review.openstack.org/575111 | 15:08 |
| *** shrjoshi has joined #tripleo | 15:08 | |
| *** jcoufal has quit IRC | 15:09 | |
| *** hakhande_ has quit IRC | 15:09 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 15:10 |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| *** jcoufal has joined #tripleo | 15:10 | |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 15:10 |
| *** shreshtha_ has quit IRC | 15:10 | |
| *** hakhande has joined #tripleo | 15:11 | |
| *** psahoo has joined #tripleo | 15:12 | |
| *** shrjoshi has quit IRC | 15:13 | |
| hamzy | who here is familiar with corosync? I am seeing the puppet deploy of corosync never finish after "(/Stage[main]/Pacemaker::Corosync/User[hacluster]) Scheduling refresh of Exec[reauthenticate-across-all-nodes]" | 15:13 |
| *** shrjoshi has joined #tripleo | 15:14 | |
| *** hakhande_ has joined #tripleo | 15:14 | |
| *** hakhande_ has quit IRC | 15:14 | |
| *** hakhande has quit IRC | 15:14 | |
| *** hakhande has joined #tripleo | 15:14 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: Remove validations that moved to tripleo-validations https://review.openstack.org/564204 | 15:15 |
| larsks | hamzy: you may find folks familiar with corosync on #linux-cluster or #linux-ha. | 15:16 |
| larsks | EmilienM: is openidc support in puppet-keystone doing the right thing here? https://github.com/openstack/puppet-keystone/blob/master/manifests/federation/openidc_httpd_configuration.pp | 15:16 |
| hamzy | larsks, would the be familiar with how TripleO deploys and configures corosync? | 15:16 |
| hamzy | they | 15:16 |
| *** Haresh has joined #tripleo | 15:17 | |
| *** Haresh has quit IRC | 15:17 | |
| *** hakhande has quit IRC | 15:17 | |
| larsks | EmilienM: it needs to add config to the generated wsgi configuration files, but it's building the path to the file itself rather than getting it from somewhere else. | 15:17 |
| EmilienM | larsks: I never tested this code, I'm not sure. You better ask to mnaser | 15:17 |
| *** Haresh has joined #tripleo | 15:17 | |
| larsks | That seems prone to failure. This isn't really about whether the config is correct; this is really just a puppet question... | 15:17 |
| larsks | hamzy: probably not for the most part. | 15:17 |
| *** dxiri_ has quit IRC | 15:17 | |
| larsks | mnaser: ^^^^ if you have any thoughts re: the way puppet-keystone openidc support is getting at the apache config. | 15:18 |
| mnaser | commited in sep 2016 | 15:18 |
| * mnaser flexes memory | 15:18 | |
| mnaser | let me see | 15:18 |
| larsks | EmilienM: I was asking because you're the listed author on openstacklib::wsgi::apache... | 15:19 |
| EmilienM | larsks: right but I didn't work on https://github.com/openstack/puppet-keystone/commits/master/manifests/federation/openidc_httpd_configuration.pp | 15:19 |
| larsks | Right, but I think you may be misunderstaning my question. This is about how to handle adding config to the wsgi configuration. | 15:19 |
| larsks | Is there a better way than what the openidc module is doing? | 15:19 |
| larsks | Specifically, https://github.com/openstack/puppet-keystone/blob/master/manifests/federation/openidc_httpd_configuration.pp#L19 | 15:20 |
| larsks | That looks fragile to me. | 15:20 |
| larsks | A change in openstacklab::wsgi::apache in how the files are named would break that. | 15:20 |
| *** dmsimard has quit IRC | 15:21 | |
| EmilienM | larsks: oh ok | 15:21 |
| EmilienM | larsks: it is fragile, but at that time I remember we didn't find a better way to do it | 15:21 |
| *** rpioso|afk is now known as rpioso | 15:21 | |
| mnaser | that is true, yeah | 15:21 |
| EmilienM | but any proposals are welcome | 15:22 |
| *** rajinir has joined #tripleo | 15:22 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Enable decoupled deployment plans e.g for OpenShift, DPDK etc https://review.openstack.org/574753 | 15:23 |
| larsks | Darn. I figured since I was hacking on this anyway that now would be the time to fix it if there was a A Better Way, but I will leave it as is for now... | 15:23 |
| *** itlinux has joined #tripleo | 15:23 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Fix DNS firewall rules https://review.openstack.org/575146 | 15:24 |
| EmilienM | larsks: where are you blocked exactly? | 15:24 |
| EmilienM | what can't you do now? | 15:25 |
| *** akrivoka_ has quit IRC | 15:25 | |
| larsks | EmilienM: I'm not blocked at this point. I'm submitting some patches for puppet-keystone, and this just seemed like an opportune moment to fix this fragile code if there was a fix to be had. Which there isn't, so I'll just move on. No blocks. | 15:25 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Enable decoupled deployment plans e.g for OpenShift, DPDK etc https://review.openstack.org/574753 | 15:25 |
| EmilienM | larsks: what is fragile? please give more details | 15:27 |
| larsks | EmilienM: what we were just talking about. https://github.com/openstack/puppet-keystone/blob/master/manifests/federation/openidc_httpd_configuration.pp#L19 | 15:27 |
| larsks | The openidc manifest is generating the wsgi configuration filename there, but it's making an assumption that it knows how openstacklib::wsgi::apache (and ultimately apache::vhost) will name that file. | 15:28 |
| EmilienM | larsks: could you please describe a situation where the priority can mess with something? I want to understand how fragile it is for you | 15:28 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Remove deploy playbook from `update run` https://review.openstack.org/574230 | 15:29 |
| larsks | I'm not sure how to more clearly explain the issue. Like I said, it's not a blocker. It just seems like bad code. | 15:29 |
| *** pkovar1 has quit IRC | 15:29 | |
| larsks | If ever apache::vhost changes how it names configuration files, this code would break. | 15:29 |
| EmilienM | larsks: among many other things, I guess | 15:30 |
| larsks | mwhahaha: Anyway, this is what I'm proposing to get rid of the problematic use of keystone::{admin,public}_endpoint: https://review.openstack.org/#/c/575147/1 | 15:31 |
| larsks | Let me know if that looks sane. | 15:31 |
| *** lifeless has quit IRC | 15:31 | |
| *** lifeless has joined #tripleo | 15:31 | |
| larsks | (I asked in #keystone re: the public_endpoint/admin_endpoint settings and the answer was basically "don't use those") | 15:31 |
| mwhahaha | larsks: yea should be ok | 15:31 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add openshift params to containers prepare cmd https://review.openstack.org/573209 | 15:33 |
| *** ykarel is now known as ykarel|away | 15:33 | |
| *** pkovar has joined #tripleo | 15:34 | |
| *** pradk has quit IRC | 15:35 | |
| *** liverpooler has quit IRC | 15:36 | |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient stable/queens: Remove deploy playbook from `update run` https://review.openstack.org/575149 | 15:36 |
| *** links has quit IRC | 15:36 | |
| *** lvdombrkr89 has quit IRC | 15:37 | |
| *** ramishra has quit IRC | 15:38 | |
| *** pkovar has quit IRC | 15:38 | |
| *** saneax has quit IRC | 15:39 | |
| EmilienM | dciabrin_: are you going to take over https://review.openstack.org/574934 or should I continue to look at it? | 15:40 |
| dciabrin_ | EmilienM, I'll take it over | 15:40 |
| dciabrin_ | EmilienM, let me set the proper status in launchpad. | 15:40 |
| dciabrin_ | EmilienM, undercloud still being set up :) | 15:40 |
| EmilienM | dciabrin_: I'm ok with having a password, maybe we could export the password in the env, and read it from the healthcheck? | 15:41 |
| EmilienM | dciabrin_: ack | 15:41 |
| dciabrin_ | EmilienM, yeah so I want to understand what's the status re. mandre's comment, and then i should have a clear idea of why healthcheck is misbehaving | 15:41 |
| EmilienM | dciabrin_, mandre : I'm curious why the healthcheck works fine when not upgrading | 15:42 |
| EmilienM | how can it reach mysql database | 15:42 |
| EmilienM | without my.cnf | 15:42 |
| *** dprince has quit IRC | 15:42 | |
| *** pradk has joined #tripleo | 15:42 | |
| *** dparkes has quit IRC | 15:43 | |
| dciabrin_ | EmilienM, i'd like to understand what's the default user for healthcheck on clean containerized undercloud | 15:44 |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-quickstart master: Define a 'baremetal' file for nodes config https://review.openstack.org/553465 | 15:44 |
| EmilienM | dciabrin_: well it should be "mysql" | 15:45 |
| larsks | For getting a new package into a tripleo docker image, does that still require changes to tripleo-puppet-elements? | 15:45 |
| dciabrin_ | EmilienM, so mysql by default should have no password and almost no privilege per mandre's comment | 15:45 |
| *** ukalifon has quit IRC | 15:46 | |
| dciabrin_ | EmilienM, then question is does anything change when upgrading from non-containerized to containerized | 15:46 |
| *** dtantsur is now known as dtantsur|afk | 15:46 | |
| *** quiquell is now known as quiquell|off | 15:47 | |
| dciabrin_ | EmilienM, if you still have an env can you quickly run "mysql -e 'select user,password,host from mysql.user;'" ? | 15:48 |
| *** pkovar has joined #tripleo | 15:50 | |
| *** bogdando has quit IRC | 15:50 | |
| EmilienM | dciabrin_: I have an env but it's an upgraded setup, does it work? | 15:51 |
| *** moshele has joined #tripleo | 15:52 | |
| *** bogdando has joined #tripleo | 15:52 | |
| dciabrin_ | EmilienM, yep so I can compare with what my undercloud deploy will give me | 15:52 |
| *** jaganathan has joined #tripleo | 15:52 | |
| EmilienM | dciabrin_: once sec | 15:53 |
| *** bugzy_ has joined #tripleo | 15:53 | |
| EmilienM | dciabrin_: ERROR 1142 (42000) at line 1: SELECT command denied to user 'mysql'@'localhost' for table 'user' | 15:53 |
| EmilienM | dciabrin_: I used "mysql" user | 15:54 |
| EmilienM | dciabrin_: I can give you SSH, see PM | 15:54 |
| dciabrin_ | EmilienM, that would be grand, thx | 15:54 |
| *** bugzy has quit IRC | 15:57 | |
| *** myoung is now known as myoung|biaf | 15:58 | |
| *** leanderthal has quit IRC | 15:59 | |
| *** weshay is now known as weshay|ruck | 16:00 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 16:00 |
| *** rodolof has quit IRC | 16:00 | |
| *** florianf has quit IRC | 16:00 | |
| *** arxcruz|ruck is now known as arxcruz | 16:01 | |
| *** bogdando has quit IRC | 16:03 | |
| *** myoung|biaf is now known as myoung | 16:03 | |
| *** yamahata has quit IRC | 16:05 | |
| *** florianf has joined #tripleo | 16:05 | |
| *** rlandy|rover is now known as rlandy | 16:06 | |
| *** myoung is now known as myoung|biaf | 16:07 | |
| *** ksambor has joined #tripleo | 16:08 | |
| *** moshele has quit IRC | 16:08 | |
| *** gkadam has quit IRC | 16:08 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 16:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 16:10 |
| *** ksambor has quit IRC | 16:12 | |
| ayoung | when installing the undercloud, what is supposed to happen with the interface specified for the ctl-plane subnet. Mine is down, and has no ip address etc. | 16:12 |
| *** ykarel|away has quit IRC | 16:12 | |
| larsks | ayoung: it is supposed to get assigned to an OVS bridge (br-ctlplane), and the *bridge* should have the ip configuration. | 16:13 |
| ayoung | https://paste.fedoraproject.org/paste/Fb2TXVzJN3fNSW-ssYuMRg | 16:13 |
| ayoung | larsks, ok...lets see | 16:13 |
| ayoung | 10: br-ctlplane: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 | 16:13 |
| ayoung | larsks, likst that? | 16:13 |
| larsks | Yeah, but that should have an address. | 16:14 |
| ayoung | ah...I misread the section... | 16:14 |
| ayoung | 10: br-ctlplane: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 | 16:14 |
| ayoung | link/ether 00:21:9b:98:a3:21 brd ff:ff:ff:ff:ff:ff | 16:14 |
| ayoung | inet 10.0.21.100/24 brd 10.0.21.255 scope global br-ctlplane | 16:14 |
| ayoung | valid_lft forever preferred_lft forever | 16:14 |
| ayoung | inet6 fe80::221:9bff:fe98:a321/64 scope link | 16:14 |
| * ayoung hopes that was short enough to avoid the paste | 16:14 | |
| larsks | That looks reasonable. | 16:14 |
| ayoung | larsks, so, is it a problem that em2 is down? | 16:15 |
| ayoung | 3: em2: <BROADCAST,MULTICAST> mtu 1500 qdisc mq master ovs-system state DOWN group default qlen 1000 | 16:15 |
| ayoung | link/ether 00:21:9b:98:a3:21 brd ff:ff:ff:ff:ff:ff | 16:15 |
| larsks | ayoung: Yeah, it should not be down. | 16:15 |
| ayoung | https://paste.fedoraproject.org/paste/bEROF8s9LmO1KYwuXUtvGg | 16:16 |
| ayoung | trying to bring it up gives me | 16:16 |
| ayoung | $ sudo ifup em2 | 16:16 |
| ayoung | RTNETLINK answers: Device or resource busy | 16:16 |
| ayoung | RTNETLINK answers: Network is down | 16:16 |
| larsks | ayoung: what does /etc/sysconfig/network-scripts/ifcfg-em2 look like? | 16:17 |
| *** kopecmartin has quit IRC | 16:17 | |
| *** akrivoka has joined #tripleo | 16:17 | |
| weshay|ruck | toure, do you have a sec to look at a fairly straight forward mistral tempest failure | 16:17 |
| ayoung | larsks, https://paste.fedoraproject.org/paste/bEROF8s9LmO1KYwuXUtvGg | 16:19 |
| weshay|ruck | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset018-master/c940db4/tempest.html.gz | 16:19 |
| ayoung | larsks, this is a "real" deployment, not nested virt, and it is entirely possible that I messed up the network configuration on the switch-and-router setup that is connected to port em2. I did seem to have it working yesterday, though | 16:20 |
| larsks | ayoung: Any chance that /etc/sysconfig/network-scripts/route-em2 exists? Your ifcfg-em2 looks okay to me, and I'm not sure what would generate those particular errors. | 16:20 |
| larsks | Also, after running `ifup em2`, is the link still down? | 16:21 |
| ayoung | larsks, cat /etc/sysconfig/network-scripts/route-em2 | 16:21 |
| ayoung | (undercloud) [stack@zygarde ~]$ | 16:21 |
| ayoung | so it exists and is empty | 16:21 |
| *** ccamacho has quit IRC | 16:21 | |
| ayoung | and yes, I get the errors I posted a few lines up | 16:22 |
| larsks | Right, but is the link up despite those errors? Or is it still down? | 16:22 |
| ayoung | state DOWN | 16:22 |
| larsks | And if you just run `ip link set em2 up`, do things work as you would expect? | 16:22 |
| ayoung | $ sudo ip link set em2 up | 16:23 |
| ayoung | RTNETLINK answers: Device or resource busy | 16:23 |
| ayoung | (undercloud) [stack@zygarde ~]$ ip addr show em2 | 16:23 |
| ayoung | 3: em2: <BROADCAST,MULTICAST> mtu 1500 qdisc mq master ovs-system state DOWN group default qlen 1000 | 16:23 |
| ayoung | link/ether 00:21:9b:98:a3:21 brd ff:ff:ff:ff:ff:ff | 16:23 |
| ayoung | so, no, does not | 16:23 |
| *** agopi has quit IRC | 16:23 | |
| d0ugal | weshay|ruck: I am taking a look. | 16:23 |
| larsks | Huh. I've not seen that before. | 16:23 |
| weshay|ruck | d0ugal, thanks looks like it's happened once before in jan | 16:23 |
| *** cylopez has quit IRC | 16:24 | |
| *** florianf has quit IRC | 16:24 | |
| *** cylopez has joined #tripleo | 16:24 | |
| weshay|ruck | d0ugal, toure fyi https://bugs.launchpad.net/tripleo/+bug/1736950 | 16:24 |
| openstack | Launchpad bug 1736950 in tripleo "CI: mistral testmistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter fails in gate scenario003 containers" [Critical,Triaged] | 16:24 |
| *** ykarel|away has joined #tripleo | 16:25 | |
| larsks | ayoung: at this point, I would hunt down dsneddon or something and see if he has any thoughts. | 16:25 |
| toure | weshay|ruck will take a look | 16:25 |
| weshay|ruck | EmilienM, mwhahaha please review the one bug here, maybe we can fix it.. maybe we can skip it.. it would be the only thing preventing refreshing master w/ a promotion | 16:25 |
| ayoung | larsks, thansk | 16:25 |
| ayoung | thanks | 16:25 |
| mwhahaha | weshay|ruck: the mistral one? | 16:26 |
| *** radeks has quit IRC | 16:26 | |
| *** dmsimard has joined #tripleo | 16:26 | |
| weshay|ruck | mwhahaha, aye.. fs20 full tempest is not complete but that would only impact downstream.. | 16:26 |
| weshay|ruck | probably good imho to refresh upstream | 16:26 |
| ayoung | larsks, what is that route file for anyway? | 16:27 |
| mwhahaha | weshay|ruck: ¯\_(ツ)_/¯ mistral problems | 16:27 |
| ayoung | and why is it empty | 16:27 |
| larsks | ayoung: that's for specifying static routes to add when bringing up the interface. | 16:27 |
| ayoung | larsks, so there is a placeholde, but no static routes? | 16:27 |
| larsks | It's empty because you don't have any static routes, which is typical. | 16:27 |
| larsks | Yeah. | 16:27 |
| larsks | Probably. | 16:27 |
| ayoung | cool | 16:27 |
| larsks | I mean, you could try deleting it, but I'm pretty sure that's not the problem. | 16:28 |
| larsks | The fact that 'ip link set em2 up' is failing is weird. | 16:28 |
| *** jcoufal has quit IRC | 16:28 | |
| *** myoung|biaf is now known as myoung|lunch | 16:29 | |
| *** yamahata has joined #tripleo | 16:31 | |
| *** brault has quit IRC | 16:31 | |
| larsks | EmilienM: puppet is telling me: Unknown variable: '::keystone::endpoint::public_url'. at /etc/puppet/modules/keystone/manifests/federation/openidc.pp:128:28 But I see "keystone::endpoint::public_url": "https://os.example.com.cloud:13000" in /etc/puppet/hieradata/service_configs.json. What could I be missing? | 16:31 |
| *** etingof is now known as etingof|brb | 16:32 | |
| *** tesseract has quit IRC | 16:33 | |
| *** salmankhan has quit IRC | 16:35 | |
| *** ykarel|away has quit IRC | 16:37 | |
| *** zul has quit IRC | 16:39 | |
| *** zul_ has joined #tripleo | 16:39 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: fix typo in chart https://review.openstack.org/575167 | 16:40 |
| *** ffiore has joined #tripleo | 16:40 | |
| *** zul has joined #tripleo | 16:40 | |
| mwhahaha | larsks: if it's not included in the class, it wont' be defined | 16:41 |
| *** psahoo has quit IRC | 16:41 | |
| mwhahaha | larsks: that's the problem with trying to reference vars from other classes in puppet. if you don't have the keystone::endpoint defined in the catalog, it won't work | 16:41 |
| larsks | So I should 'include ::keystone::endpoint' in openidc.pp? | 16:41 |
| mwhahaha | you probably don't want to | 16:41 |
| *** holser__ has quit IRC | 16:42 | |
| mwhahaha | it's better to expose that url as a param to openidc and specify it | 16:42 |
| mwhahaha | this is one of the problems with the way we use puppet | 16:42 |
| larsks | mwhahaha: I see. So that means finding the right Heat parameter, and then passing that down through the layers, right? | 16:42 |
| mwhahaha | yes | 16:42 |
| larsks | Do you happen to know how to get Keystone endpoint(s) from heat off the top of your head? | 16:43 |
| mwhahaha | patching puppet-keystone, then updating THT to set the heiradata | 16:43 |
| *** etingof|brb has quit IRC | 16:43 | |
| larsks | Specifically, patching manifests/federation/openidc.pp in puppet-keystone, right? | 16:43 |
| *** ffiore_ has joined #tripleo | 16:43 | |
| mwhahaha | yea | 16:43 |
| *** cylopez has quit IRC | 16:44 | |
| *** zul_ has quit IRC | 16:44 | |
| mwhahaha | larsks: it might be something like https://github.com/openstack/tripleo-heat-templates/blob/e64c10b9c13188f37e6f122475fe02280eaa6686/puppet/services/ironic-api.yaml#L104 in THT | 16:44 |
| mwhahaha | it's in the endpoint map | 16:44 |
| mwhahaha | {get_param: [EndpointMap, KeystoneInternal, uri_no_suffix]} | 16:44 |
| larsks | Awesome, thanks. | 16:44 |
| *** ffiore has quit IRC | 16:45 | |
| *** weshay|ruck changes topic to "Welcome to Rocky. CI status: ORANGE, Upstream Zuul Gate at 24hrs | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest" | 16:49 | |
| weshay|ruck | mwhahaha, upstream gate at 24hrs fyi | 16:49 |
| mwhahaha | weshay|ruck: because? | 16:49 |
| weshay|ruck | saw a few things.. scen002/3 timedout, undercloud install failed on pulling a container | 16:50 |
| *** yprokule has quit IRC | 16:50 | |
| weshay|ruck | mwhahaha, list of failing jobs is in http://38.145.34.131:3000/d/pgdr_WVmk/ruck-rover?orgId=1 | 16:50 |
| weshay|ruck | 7 gate failures today | 16:51 |
| mwhahaha | pesky containers | 16:52 |
| *** ykarel|away has joined #tripleo | 16:52 | |
| *** Haresh has quit IRC | 16:52 | |
| paramite | shardy, Hey Steve, just an additional question, do those extraconfig templates for openshift require deployed openstack? Eg. can we deploy openshift on baremetal? | 16:53 |
| weshay|ruck | mwhahaha, so.. can we skip that mistral test? | 16:53 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates master: enable support for openidc federation in keystone https://review.openstack.org/574855 | 16:53 |
| mwhahaha | weshay|ruck: ask the mistral folks | 16:53 |
| weshay|ruck | d0ugal, toure please think about the impact of skipping that tempest test in the short term until it's resolved would be | 16:54 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-common master: WIP - Add mistral job to rotate passwords https://review.openstack.org/574782 | 16:56 |
| *** etingof has joined #tripleo | 16:58 | |
| shardy | paramite: Hi, no they don't require an OpenStack overcloud unless you choose to share networks (which we did for the demo, but isn't required) | 16:58 |
| shardy | paramite: it's definitely possible to deploy just an undercloud then OpenShift on baremetal, that's basically what the t-h-t integration currently enables | 16:58 |
| *** moshele has joined #tripleo | 17:01 | |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo master: Ensure appropriate ACL mask is set on CephX keyrings https://review.openstack.org/573142 | 17:02 |
| *** derekh has quit IRC | 17:03 | |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo stable/queens: Ensure appropriate ACL mask is set on CephX keyrings https://review.openstack.org/573382 | 17:03 |
| *** moshele has quit IRC | 17:05 | |
| *** shardy has quit IRC | 17:05 | |
| weshay|ruck | mwhahaha, EmilienM on the timeout jobs.. the undercloud install is taking an hour | 17:06 |
| weshay|ruck | :( | 17:06 |
| mwhahaha | thanks containers | 17:07 |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo master: Ensure appropriate ACL mask is set on CephX keyrings https://review.openstack.org/573142 | 17:09 |
| d0ugal | weshay|ruck: low impact I guess | 17:10 |
| d0ugal | weshay|ruck: I can look more tomorrow if needed | 17:10 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 17:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 17:10 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: skip mistral test actions test https://review.openstack.org/575176 | 17:11 |
| weshay|ruck | d0ugal, toure k k.. if we skip we still need to fix it if needed but would take the pressure off and allow us to refresh master w/ a promotion | 17:11 |
| weshay|ruck | https://review.openstack.org/575176 | 17:11 |
| *** shrjoshi has quit IRC | 17:14 | |
| EmilienM | weshay|ruck: we're in a call, give us some time and we'll look | 17:14 |
| *** ansmith has quit IRC | 17:15 | |
| weshay|ruck | EmilienM, k no worries | 17:15 |
| openstackgerrit | Jill Rouleau proposed openstack/tripleo-common master: Verify host_vars and group_vars are valid yaml https://review.openstack.org/573794 | 17:16 |
| *** amoralej is now known as amoralej|off | 17:18 | |
| *** liverpooler has joined #tripleo | 17:18 | |
| *** myoung|lunch is now known as myoung | 17:19 | |
| weshay|ruck | dam | 17:21 |
| weshay|ruck | object storage just died in the latest build too | 17:23 |
| *** trown is now known as trown|lunch | 17:24 | |
| *** jpena is now known as jpena|off | 17:24 | |
| *** agopi has joined #tripleo | 17:24 | |
| *** ansmith has joined #tripleo | 17:25 | |
| EmilienM | welcome to m3 :( | 17:27 |
| weshay|ruck | tonight we dine in HELLL | 17:29 |
| *** ykarel|away has quit IRC | 17:37 | |
| *** zoli|wfh is now known as zoli|gone | 17:38 | |
| *** zoli|gone is now known as zoli | 17:39 | |
| mwhahaha | and it'll be delicious | 17:39 |
| EmilienM | if they serve chicken and egg I'm in :-P | 17:41 |
| *** Goneri has quit IRC | 17:43 | |
| EmilienM | weshay|ruck: done with meetings, I can help now. Do you have logs handy? | 17:43 |
| weshay|ruck | EmilienM, tracking two issues | 17:44 |
| weshay|ruck | 1 simple one w/ mistra | 17:44 |
| weshay|ruck | l | 17:44 |
| *** rodolof has joined #tripleo | 17:44 | |
| weshay|ruck | second .. looks like in the object_storage tests.. getting access denied in the setup | 17:44 |
| weshay|ruck | https://bugs.launchpad.net/tripleo/+bug/1776729 | 17:45 |
| openstack | Launchpad bug 1776729 in tripleo "tempest, access denied error in object storage tests failing in rocky build" [Critical,Triaged] | 17:45 |
| weshay|ruck | https://bugs.launchpad.net/tripleo/+bug/1736950 | 17:45 |
| openstack | Launchpad bug 1736950 in tripleo "CI: mistral testmistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter fails in gate scenario003 containers" [Critical,Triaged] | 17:45 |
| EmilienM | weshay|ruck: you mentioned a timeout on the containeirzed undercloud | 17:45 |
| weshay|ruck | oh.. ya. let me show you | 17:46 |
| *** etingof has quit IRC | 17:46 | |
| *** rodolof has quit IRC | 17:50 | |
| *** yolanda has quit IRC | 17:50 | |
| chandankumar | EmilienM: please have a look at healthcheck api implementation in tempestconf https://review.openstack.org/#/c/568869/ | 17:52 |
| chandankumar | we need your feedback on that | 17:52 |
| *** dxiri has joined #tripleo | 17:52 | |
| *** suuuper has quit IRC | 17:53 | |
| *** brault has joined #tripleo | 17:55 | |
| *** mschuppert has quit IRC | 17:56 | |
| alee_ | d0ugal, toure , rbrady -- trying to set up an action/workbook to change passwords. Got some questions trying to make it work -- https://review.openstack.org/#/c/574782/ | 17:56 |
| *** pkovar has quit IRC | 17:56 | |
| *** mschuppert has joined #tripleo | 17:57 | |
| *** ffiore_ has quit IRC | 17:58 | |
| *** brault has quit IRC | 17:59 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: undercloud: manage mysql user + revoke grant during upgrade https://review.openstack.org/575186 | 18:00 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Check container health as part of the deploy https://review.openstack.org/569153 | 18:01 |
| larsks | EmilienM: I've updated https://review.openstack.org/#/c/575147/ per your comment. | 18:01 |
| EmilienM | larsks: looks better indeed | 18:03 |
| EmilienM | do we have unit tests for this code? | 18:03 |
| *** openstackgerrit has quit IRC | 18:04 | |
| *** yolanda has joined #tripleo | 18:05 | |
| *** myoung is now known as myoung|biab | 18:08 | |
| larsks | Not yet. I'm just trying to get validation from zuul and a working deployment, then I will try adding some unit tests. | 18:09 |
| larsks | I'm happy to mark them WIP if you would like. | 18:09 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736950 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 18:10 |
| openstack | Launchpad bug 1736950 in tripleo "CI: mistral testmistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter fails in gate scenario003 containers" [Critical,Triaged] | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 18:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 18:10 |
| *** mcornea has quit IRC | 18:12 | |
| *** mcornea has joined #tripleo | 18:13 | |
| *** ffiore_ has joined #tripleo | 18:14 | |
| *** jaganathan has quit IRC | 18:17 | |
| *** waleedm has joined #tripleo | 18:18 | |
| toure | alee_ let me take a look | 18:22 |
| alee_ | toure, so just a couple questions .. | 18:22 |
| alee_ | toure, in my test environment, I try to do the replace_password action , but it fails because .. | 18:23 |
| alee_ | toure, Failed to find action [action_name=tripleo.parameters.replace_passwords] | 18:23 |
| *** dxiri has quit IRC | 18:24 | |
| alee_ | toure, so I must be missing a step | 18:24 |
| *** dxiri has joined #tripleo | 18:24 | |
| *** moshele has joined #tripleo | 18:24 | |
| toure | yeah you don't have a defined action which match | 18:24 |
| toure | oops I take that back | 18:24 |
| toure | ok you don't have a defined class for that action | 18:25 |
| toure | let me get you an example | 18:26 |
| *** waleedm has quit IRC | 18:26 | |
| alee_ | toure, huh? | 18:26 |
| *** moshele has quit IRC | 18:26 | |
| *** waleedm has joined #tripleo | 18:27 | |
| alee_ | toure, I think actually I just dont have it in my openstack action definition list | 18:27 |
| toure | so you need implement an action for the given name | 18:27 |
| alee_ | toure, that is I need to add it | 18:27 |
| alee_ | toure, but I did .. | 18:27 |
| alee_ | toure, see https://review.openstack.org/#/c/574782/2/setup.cfg | 18:28 |
| itlinux | hello all .. if I use vxlan do you still need this option NeutronNetworkVLANRanges: datacentre:1902:1902,datacentre:1904:1919 | 18:28 |
| toure | sorry yeah just saw that | 18:28 |
| *** Goneri has joined #tripleo | 18:28 | |
| larsks | Does tripleo regenerate the contents of /var/lib/config-data on every 'overcloud deploy'? I have a deploy that failed because of invalid content in an apache configuration file. I've updated the puppet modules and re-run the overcloud deploy, but it doesn't appear to regenerate these config files. | 18:29 |
| alee_ | toure, I just need to add the deinition -- just like I needed to update my workbooks | 18:29 |
| toure | alee_ quick question how did you deploy this change? | 18:30 |
| alee_ | openstack workflow update /usr/share/tripleo-common/workbooks/fernet-key-rotate.yaml | 18:30 |
| *** trown|lunch is now known as trown | 18:30 | |
| alee_ | oops | 18:30 |
| toure | was it an in place source patch or did you pull this in with quickstart | 18:30 |
| alee_ | in place patch | 18:31 |
| toure | did you restart all mistral services? | 18:31 |
| toure | systemctl restart openstack-mistral* | 18:31 |
| toure | alee_ that one always gets me with source changes | 18:31 |
| alee_ | specifically -- I have my undercloud already, then I cloned repo, setup.py install , did mistral-db-manage populate | 18:32 |
| alee_ | and restarted mistral services | 18:32 |
| toure | can I take a look at the system? | 18:32 |
| alee_ | and had to update the workflow -- openstack workflow update /usr/share/tripleo-common/workbooks/plan-managgement.yaml | 18:33 |
| alee_ | I need to do the same for the actions .. | 18:33 |
| alee_ | like openstack workflow definition update <foo> or similar | 18:33 |
| alee_ | toure, just a sec | 18:34 |
| *** waleedm has quit IRC | 18:35 | |
| toure | ack | 18:35 |
| *** openstackgerrit has joined #tripleo | 18:37 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Implement TripleoValidations composable service https://review.openstack.org/575193 | 18:37 |
| *** matbu has quit IRC | 18:38 | |
| *** toure is now known as toure|brb | 18:38 | |
| *** etingof has joined #tripleo | 18:40 | |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: undercloud: deploy tripleo-validations when needed https://review.openstack.org/575196 | 18:40 |
| EmilienM | mcornea, weshay|ruck: ^ these 2 patches is what we want | 18:40 |
| * weshay|ruck looks | 18:41 | |
| chandankumar | weshay|ruck: do we run container check on undercloud containers? | 18:41 |
| weshay|ruck | health check? | 18:41 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Switch more promotion jobs to containerized undercloud https://review.openstack.org/572215 | 18:41 |
| EmilienM | weshay|ruck: updated ^ and abandoned your patch | 18:42 |
| weshay|ruck | ack | 18:42 |
| EmilienM | chandankumar: I'll look asap | 18:42 |
| EmilienM | weshay|ruck: the gate is terrible as you know | 18:43 |
| EmilienM | what is slower than before? | 18:43 |
| EmilienM | weshay|ruck: since when it's slower? | 18:44 |
| weshay|ruck | some deployments are taking an additional 10 min on undercloud and overcloud | 18:44 |
| *** pkovar has joined #tripleo | 18:44 | |
| *** ksambor has joined #tripleo | 18:44 | |
| EmilienM | some? | 18:44 |
| EmilienM | which ones? | 18:44 |
| weshay|ruck | 2018-06-13 05:41:46 | 18:45 |
| EmilienM | 10min is bad but not that terrible, we have seen worse | 18:45 |
| weshay|ruck | http://38.145.34.131:3000/d/pgdr_WVmk/ruck-rover?orgId=1&panelId=61&fullscreen | 18:45 |
| EmilienM | we need to get a domain name at some point ;-) | 18:45 |
| EmilienM | weshay|ruck: ask bnemec or dprince to create something on tripleo.org | 18:45 |
| weshay|ruck | well.. maybe after we move tripleo.org | 18:46 |
| EmilienM | we don't even have logs collected for some of these | 18:46 |
| EmilienM | so hard to debug | 18:46 |
| * bnemec can't do dns | 18:46 | |
| *** etingof has quit IRC | 18:48 | |
| *** etingof has joined #tripleo | 18:48 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Create an additional network interface on libvirt subnode https://review.openstack.org/572798 | 18:48 |
| *** ksambor has quit IRC | 18:50 | |
| *** Haresh has joined #tripleo | 18:50 | |
| *** Haresh has quit IRC | 18:52 | |
| weshay|ruck | tdasilva, ping need a second if you have it.. hitting a swift issue | 18:52 |
| d0ugal | alee_: did you pip install tripleo-common after updating the setup.cfg? | 18:53 |
| alee_ | d0ugal, let me do that -- I just did python setup.py install | 18:54 |
| *** brault has joined #tripleo | 18:54 | |
| d0ugal | alee_: either way should work, I prefer pip tho' | 18:54 |
| d0ugal | alee_: just checking as you need to do a package install for the setup changes to work | 18:54 |
| EmilienM | do we have gnocchi on featureset020 ? | 18:54 |
| EmilienM | I'm looking at https://bugs.launchpad.net/tripleo/+bug/1776729 | 18:55 |
| openstack | Launchpad bug 1776729 in tripleo "tempest, access denied error in object storage tests failing in rocky build" [Critical,Triaged] | 18:55 |
| EmilienM | and https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/cd35af6/overcloud-controller-0/var/log/journal.txt.gz | 18:55 |
| d0ugal | alee_: Then you need to populate the db as rbrady said and restart mistral | 18:55 |
| EmilienM | I see gnocchi hitting swift a lot | 18:55 |
| d0ugal | alee_: I am just passing through, I can help tomorrow if you are around earlier (I'm UTC+1) | 18:55 |
| EmilienM | I think swift is actually working | 18:55 |
| EmilienM | but the tempest test isn't | 18:55 |
| *** ffiore has joined #tripleo | 18:55 | |
| weshay|ruck | EmilienM, you looking at the journal? | 18:55 |
| EmilienM | weshay|ruck: yep | 18:55 |
| weshay|ruck | ya.. | 18:55 |
| EmilienM | on the controller | 18:56 |
| weshay|ruck | ya | 18:56 |
| tdasilva | weshay|ruck: wwwwhat's up? | 18:56 |
| *** ffiore_ has quit IRC | 18:56 | |
| alee_ | d0ugal, ok thanks -- I did the setup.py install , and then db populate and restart mistral though .. | 18:56 |
| weshay|ruck | tdasilva, looks like tempest is having some issues in the setup classes for object storage tests | 18:56 |
| alee_ | d0ugal, will chek with you if I'm stuck | 18:56 |
| weshay|ruck | https://bugs.launchpad.net/tripleo/+bug/1776729 | 18:56 |
| openstack | Launchpad bug 1776729 in tripleo "tempest, access denied error in object storage tests failing in rocky build" [Critical,Triaged] | 18:56 |
| weshay|ruck | tdasilva, EmilienM and I are poking at it now | 18:56 |
| * weshay|ruck is also bringing up the env if needed | 18:56 | |
| alee_ | still stuck | 18:56 |
| EmilienM | tdasilva: debugging https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/cd35af6/tempest.html.gz (see the error: Details: <html><h1>Forbidden</h1><p>Access was denied to this resource.</p></html>= | 18:57 |
| EmilienM | looks like tempest credentials used to test swift are not enough anymore | 18:58 |
| *** moshele has joined #tripleo | 18:58 | |
| EmilienM | because swift is actually working, i see gnocchi using it and it doesn't complain | 18:58 |
| tdasilva | EmilienM, weshay|ruck looking | 18:59 |
| *** brault has quit IRC | 18:59 | |
| *** moshele has quit IRC | 18:59 | |
| weshay|ruck | https://github.com/openstack/swift/commit/fcd7a05e8c8a7cf5fb46f42bf730f2fff7e1a7d8 | 19:01 |
| weshay|ruck | ? | 19:01 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-repos master: Clean metadata after switching repos https://review.openstack.org/575202 | 19:01 |
| tdasilva | weshay|ruck: wouldn't it have broken on gate before it merged thou? | 19:02 |
| tdasilva | weshay|ruck: wondering if there's a difference between upstream gate and the rdo gate in this case | 19:03 |
| EmilienM | yeah i thought about this one but I don't think it's it | 19:03 |
| weshay|ruck | tdasilva, tempest is configured in two diff ways for sure | 19:05 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Define a 'baremetal' file for nodes config https://review.openstack.org/553465 | 19:07 |
| weshay|ruck | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/cd35af6/undercloud/home/jenkins/tempest.log.txt.gz | 19:07 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Add barematal-specific nodes files with toplogy https://review.openstack.org/574894 | 19:07 |
| weshay|ruck | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/cd35af6/undercloud/home/jenkins/tempest/etc/tempest.conf.txt.gz | 19:07 |
| tdasilva | weshay|ruck: do you have access to the environment? wondering if we could take a look at configs and do some manual testing | 19:09 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736950 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 19:10 |
| openstack | Launchpad bug 1736950 in tripleo "CI: mistral testmistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter fails in gate scenario003 containers" [Critical,Triaged] | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 19:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 19:10 |
| tdasilva | weshay|ruck: looking here https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/cd35af6/undercloud/home/jenkins/ | 19:12 |
| tdasilva | mmm...can't get to swift config https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/cd35af6/overcloud-controller-0/var/lib/ | 19:13 |
| tdasilva | why is there no config_data dir? | 19:14 |
| mwhahaha | tdasilva: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/cd35af6/overcloud-controller-0/var/log/config-data/ | 19:14 |
| mwhahaha | tdasilva: it's in var/log | 19:14 |
| tdasilva | heh, ok | 19:15 |
| *** myoung|biab is now known as myoung | 19:15 | |
| *** gfidente has quit IRC | 19:20 | |
| *** moshele has joined #tripleo | 19:28 | |
| *** moshele has quit IRC | 19:30 | |
| *** tcw has quit IRC | 19:34 | |
| *** tcw has joined #tripleo | 19:35 | |
| *** psachin has quit IRC | 19:36 | |
| *** janki has quit IRC | 19:43 | |
| *** lifeless_ has joined #tripleo | 19:49 | |
| *** lifeless has quit IRC | 19:49 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Add ability to upgrade FROM change under test https://review.openstack.org/572419 | 19:51 |
| *** pkovar has quit IRC | 19:51 | |
| *** radeks has joined #tripleo | 19:54 | |
| *** artom_ has joined #tripleo | 19:57 | |
| *** artom has quit IRC | 19:57 | |
| weshay|ruck | tdasilva, anything jumping out at cha? | 20:04 |
| *** mhenkel_ has joined #tripleo | 20:05 | |
| tdasilva | weshay|ruck: sorry, had to join a couple of meetings | 20:05 |
| weshay|ruck | k np | 20:05 |
| *** liverpooler has quit IRC | 20:06 | |
| *** mhenkel_ has quit IRC | 20:09 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736950 | 20:10 |
| openstack | Launchpad bug 1736950 in tripleo "CI: mistral testmistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter fails in gate scenario003 containers" [Critical,Triaged] | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 20:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 20:10 |
| *** avivgt has quit IRC | 20:13 | |
| *** cdearborn has joined #tripleo | 20:14 | |
| *** ksambor has joined #tripleo | 20:15 | |
| openstackgerrit | Bob Fournier proposed openstack/os-net-config master: Restore the order of params in ifcfg file that was inadvertently changed https://review.openstack.org/575220 | 20:19 |
| *** ffiore has quit IRC | 20:20 | |
| *** jlibosva has quit IRC | 20:22 | |
| stevebaker | morning | 20:23 |
| dalvarez | hi guys! can someone please take a look at this patch https://review.openstack.org/#/c/570942/ ? | 20:25 |
| dalvarez | thanks! | 20:25 |
| dalvarez | beagles: ^ not sure if you have +2 powers there | 20:26 |
| *** avivgt has joined #tripleo | 20:27 | |
| *** ansmith has quit IRC | 20:36 | |
| *** jlibosva has joined #tripleo | 20:37 | |
| *** radeks has quit IRC | 20:38 | |
| *** jlibosva has quit IRC | 20:41 | |
| *** mcornea has quit IRC | 20:44 | |
| *** jlibosva has joined #tripleo | 20:46 | |
| *** mcornea has joined #tripleo | 20:46 | |
| *** aufi has quit IRC | 20:48 | |
| *** artom_ is now known as artom | 20:52 | |
| *** jlibosva has quit IRC | 20:54 | |
| *** matbu has joined #tripleo | 20:57 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: remove the pike->queens upgrade job https://review.openstack.org/574794 | 21:00 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Set docker environment files during ffu prepare and converge https://review.openstack.org/573850 | 21:00 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade stable/queens: Set docker environment files during ffu prepare and converge https://review.openstack.org/575232 | 21:01 |
| *** trown is now known as trown|outtypewww | 21:01 | |
| *** openstackgerrit has quit IRC | 21:04 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736950 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 21:10 |
| openstack | Launchpad bug 1736950 in tripleo "CI: mistral testmistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter fails in gate scenario003 containers" [Critical,Triaged] | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 21:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 21:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 21:10 |
| *** slaweq has quit IRC | 21:12 | |
| *** slaweq has joined #tripleo | 21:12 | |
| *** abishop has quit IRC | 21:16 | |
| *** lifeless_ has quit IRC | 21:23 | |
| *** lifeless has joined #tripleo | 21:24 | |
| *** openstackgerrit has joined #tripleo | 21:31 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Fix standalone ip configuration https://review.openstack.org/575239 | 21:31 |
| *** jlibosva has joined #tripleo | 21:33 | |
| *** edmondsw has quit IRC | 21:33 | |
| dsneddon | beagles, trozet: Can either of you possibly merge this brief patch? It's a requirement for a serious upgrade bug: https://review.openstack.org/#/c/575220/ | 21:34 |
| *** lblanchard has quit IRC | 21:35 | |
| mwhahaha | is the os-net-config in the tripleo ci queue? | 21:35 |
| *** dtrainor has quit IRC | 21:35 | |
| mwhahaha | if so it's not going to land anytime soon | 21:35 |
| weshay|ruck | bah.. another timeout | 21:35 |
| *** edmondsw has joined #tripleo | 21:35 | |
| mwhahaha | weshay|ruck: what kinda timeout | 21:36 |
| dsneddon | beagles, trozet: Without this, the ifcfg files get interpreted as changed, and every interface gets restarted, causing flow corruption in OVS and update failure in some cases. | 21:36 |
| weshay|ruck | in nodepool provider limestone-regionone hit the 143 while running tempest | 21:36 |
| *** lifeless_ has joined #tripleo | 21:36 | |
| *** lifeless has quit IRC | 21:37 | |
| *** jlibosva has quit IRC | 21:37 | |
| PagliaccisCloud | is 'openstack tripleo deploy' a newly added command? i'm trying a standalone install but i keep getting an error from openstack cli | 21:38 |
| PagliaccisCloud | using pike ^ | 21:38 |
| mwhahaha | PagliaccisCloud: yes it's master only | 21:38 |
| weshay|ruck | standalone is rocky/master | 21:38 |
| mwhahaha | PagliaccisCloud: the docs were improperly updated to include stable references | 21:38 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-common master: DNM: test patch https://review.openstack.org/575242 | 21:39 |
| PagliaccisCloud | oh h*ck, ok. can i use 'undercloud deploy' instead for versions < rocky? | 21:40 |
| mwhahaha | no | 21:40 |
| mwhahaha | it's not supported | 21:40 |
| *** edmondsw has quit IRC | 21:40 | |
| mwhahaha | it's really not a good idea | 21:40 |
| PagliaccisCloud | :/ ok | 21:41 |
| mwhahaha | so you could try, but if you get an error no one will help you | 21:41 |
| mwhahaha | and we didn't test it | 21:41 |
| PagliaccisCloud | i'll try it out for the h*ck of it | 21:42 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-common stable/queens: DNM: test queens patch https://review.openstack.org/575244 | 21:42 |
| weshay|ruck | mwhahaha, you have a minute to discuss performance? | 21:43 |
| mwhahaha | weshay|ruck: i have 15 | 21:43 |
| weshay|ruck | and how you are the slowest RH dude in colorado | 21:43 |
| mwhahaha | i'm pretty sure i've never been known for speed :D | 21:44 |
| openstackgerrit | Sagi Shnaidman proposed openstack/puppet-tripleo master: DNM: test patch https://review.openstack.org/575245 | 21:46 |
| openstackgerrit | Sagi Shnaidman proposed openstack/puppet-tripleo master: DNM: top test patch https://review.openstack.org/575246 | 21:48 |
| *** itlinux has quit IRC | 21:52 | |
| *** ansmith has joined #tripleo | 21:52 | |
| *** jlibosva has joined #tripleo | 21:54 | |
| *** atoth has quit IRC | 21:54 | |
| *** cdearborn has quit IRC | 21:56 | |
| *** jlibosva has quit IRC | 21:58 | |
| *** pradk has quit IRC | 21:59 | |
| *** tzumainn has quit IRC | 22:03 | |
| *** jlibosva has joined #tripleo | 22:05 | |
| *** Goneri has quit IRC | 22:06 | |
| *** jlibosva has quit IRC | 22:09 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736950 | 22:10 |
| openstack | Launchpad bug 1736950 in tripleo "CI: mistral testmistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter fails in gate scenario003 containers" [Critical,Triaged] | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 22:10 |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 22:10 |
| *** jlibosva has joined #tripleo | 22:11 | |
| *** morazi has quit IRC | 22:13 | |
| *** jlibosva has quit IRC | 22:16 | |
| tonyb | For the record on 1776596 we have the nova fix but it's blocked due to a tempest bug | 22:18 |
| *** limao has joined #tripleo | 22:18 | |
| *** myoung is now known as myoung|off | 22:20 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Allow a containerized mistral-executor to access docker https://review.openstack.org/574905 | 22:20 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM - Testing copy j2 files in THT https://review.openstack.org/575257 | 22:23 |
| *** limao_ has joined #tripleo | 22:23 | |
| *** limao has quit IRC | 22:24 | |
| *** rcernin has joined #tripleo | 22:26 | |
| weshay|ruck | tdasilva, fyi.. I have a live environment up, it should finish tempest in a bit | 22:26 |
| *** rcernin is now known as rcernin|brekkie | 22:27 | |
| *** rcernin|brekkie is now known as rcernin | 22:27 | |
| *** jlibosva has joined #tripleo | 22:27 | |
| *** jlibosva has quit IRC | 22:31 | |
| *** slaweq has quit IRC | 22:33 | |
| *** ksambor has quit IRC | 22:33 | |
| *** limao_ has quit IRC | 22:33 | |
| *** limao has joined #tripleo | 22:34 | |
| *** mcornea has quit IRC | 22:37 | |
| *** limao has quit IRC | 22:37 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-repos master: Clean metadata after switching repos https://review.openstack.org/575202 | 22:39 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: containerized undercloud may be contributing to long run times https://review.openstack.org/575259 | 22:39 |
| *** limao has joined #tripleo | 22:41 | |
| *** gkadam has joined #tripleo | 22:46 | |
| *** threestrands has joined #tripleo | 22:47 | |
| *** threestrands has quit IRC | 22:47 | |
| *** threestrands has joined #tripleo | 22:47 | |
| *** athomas has quit IRC | 22:47 | |
| *** slaweq has joined #tripleo | 22:53 | |
| *** jlibosva has joined #tripleo | 22:59 | |
| EmilienM | I'm going to clear the gate | 23:03 |
| EmilienM | revert my patch that enable containerized undercloud on scenarios | 23:03 |
| *** jlibosva has quit IRC | 23:03 | |
| EmilienM | land steve's work to optimize the way we pull containers | 23:04 |
| EmilienM | and re-enable containerized undercloud on scenarios | 23:04 |
| EmilienM | mwhahaha: ^ | 23:04 |
| mwhahaha | yes plz | 23:04 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Revert "Switch scenario00{1,2,3,4,7} to containerized undercloud" https://review.openstack.org/575264 | 23:04 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Revert "Switch scenario00{1,2,3,4,7} to containerized undercloud" https://review.openstack.org/575264 | 23:04 |
| EmilienM | mwhahaha, weshay|ruck ^ please review it | 23:05 |
| EmilienM | and let me clear the gate | 23:05 |
| mwhahaha | can probably leave the gate for now | 23:05 |
| mwhahaha | since this patch has to pass check which may or may not happen anytime soone | 23:05 |
| EmilienM | yeah | 23:06 |
| *** weshay|ruck changes topic to "Welcome to Rocky. CI status: RED, Clearing gate to disable cont. undercloud on most jobs | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest" | 23:07 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736950 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776596 | 23:10 |
| openstack | Launchpad bug 1736950 in tripleo "CI: mistral testmistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter fails in gate scenario003 containers" [Critical,Triaged] | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 23:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 23:10 |
| EmilienM | the gate is clear | 23:12 |
| *** weshay|ruck changes topic to "Welcome to Rocky. CI status: RED, Do not workfow +1, Clearing gate to disable cont. undercloud on most jobs | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest" | 23:12 | |
| EmilienM | mwhahaha: I'm confused because docker.io should never be used | 23:18 |
| EmilienM | it should pull from mirrors | 23:19 |
| EmilienM | Jun 13 05:18:02 undercloud.localdomain dockerd-current[1254]: time="2018-06-13T05:18:02.270365390Z" level=debug msg="Trying to pull docker.io/tripleomaster/centos-binary-rsyslog-base from http://mirror.mtl01.inap.openstack.org:8081/registry-1.docker/ v2" | 23:19 |
| EmilienM | http://logs.openstack.org/03/568403/22/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/7d3f2e4/logs/undercloud/var/log/journal.txt.gz#_Jun_13_05_18_02 | 23:19 |
| EmilienM | so what we really want to have is what Steve did: | 23:21 |
| EmilienM | http://logs.openstack.org/03/568403/22/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/7d3f2e4/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-06-13_05_17_58 | 23:21 |
| EmilienM | it prepares the undercloud registry with containers from docker.io (actually pulling from mirrors) | 23:21 |
| EmilienM | which is the ONLY time we pull containers from docker.io in the whole deployment (undercloud + overcloud) | 23:21 |
| EmilienM | well, actually we run the "openstack tripleo container image prepare" command twice | 23:21 |
| EmilienM | but the second time pulls missing containers for overcloud | 23:22 |
| *** jlibosva has joined #tripleo | 23:25 | |
| EmilienM | stevebaker: hey can we merge https://review.openstack.org/#/c/571631/ ? or will it break something? I think we need it asap | 23:25 |
| EmilienM | we need to https://review.openstack.org/#/c/568403 to stop timeouts in our gate | 23:27 |
| *** jlibosva has quit IRC | 23:29 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: Set update_containers for containerized_undercloud https://review.openstack.org/574101 | 23:31 |
| stevebaker | EmilienM: you think the ansible based yum update is quicker than container-check? | 23:37 |
| weshay|ruck | EmilienM, toci-quickstart/config/testenv/multinode.yml:10:undercloud_docker_registry_mirror: "{{ lookup('env','NODEPOOL_DOCKER_REGISTRY_PROXY') }}" | 23:37 |
| *** dtrainor has joined #tripleo | 23:38 | |
| weshay|ruck | mwhahaha, ^ | 23:38 |
| stevebaker | I guess its doing one less push/pull from the undercloud registry, thats why I wrote it :) | 23:38 |
| EmilienM | stevebaker: can you join my BJ? | 23:38 |
| stevebaker | yes | 23:38 |
| EmilienM | nice, we're with wes | 23:38 |
| *** artom has quit IRC | 23:39 | |
| *** limao has quit IRC | 23:40 | |
| *** artom has joined #tripleo | 23:41 | |
| *** owalsh_ has quit IRC | 23:41 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Streamline variables passed in different environments https://review.openstack.org/573819 | 23:44 |
| *** dmacpher has quit IRC | 23:47 | |
| *** tosky has quit IRC | 23:51 | |
| *** jlibosva has joined #tripleo | 23:54 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM - Testing copy j2 files in THT https://review.openstack.org/575257 | 23:57 |
| *** jlibosva has quit IRC | 23:58 | |
| *** dtrainor has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!